2024-09-12T18:12:31.450 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T18:12:31.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T18:12:31.569 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7902784 branch: wip-cls-rgw-busy-resharding description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7902784' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 compression type: random ec-data-pool: false frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 tenant: RGW33333333333333333 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cls-rgw-busy-resharding sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f owner: scheduled_cbodley@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-cls-rgw-busy-resharding suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f targets: smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIzTqTXaDAPVnxhab6097CPZ7SFbaZu+LRFHdwYcgxQIN2CvVfZwYcb/85p3g78N5LmgMdegBI2yCJEXj/1VmB8= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFIYL11/SXNYkMIlaUaXYwXuJaPpF3rXv/fcgKAD4u8ueezYP2WSY55P/vS5+8X2KLomTzivQq3T3ddzUgbcONg= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_18:03:08 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T18:12:31.569 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa; will attempt to use it 2024-09-12T18:12:31.570 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa/tasks 2024-09-12T18:12:31.570 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T18:12:31.572 INFO:teuthology.task.internal:Checking packages... 2024-09-12T18:12:31.594 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-12T18:12:31.594 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T18:12:31.594 INFO:teuthology.packaging:ref: None 2024-09-12T18:12:31.594 INFO:teuthology.packaging:tag: None 2024-09-12T18:12:31.595 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-12T18:12:31.595 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T18:12:31.595 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-12T18:12:31.747 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753-gd011c522-1jammy 2024-09-12T18:12:31.749 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T18:12:31.755 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T18:12:31.755 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T18:12:31.805 INFO:teuthology.task.internal:Saving configuration 2024-09-12T18:12:31.828 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T18:12:31.865 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T18:12:31.890 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7902784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 18:06:27.961348', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIbkDmzKA1s0258sZst8R+tiiIjthUZcsvWmWBEFVq1K'} 2024-09-12T18:12:31.913 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7902784', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 18:06:27.959364', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDYtq+APnmIKdakVMucbbWLk9qE3fasF4bbEpEbVqxUO'} 2024-09-12T18:12:31.913 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T18:12:31.920 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T18:12:31.920 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T18:12:31.920 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T18:12:31.998 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f33b5b17490>, signals=[15]) 2024-09-12T18:12:31.998 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T18:12:32.005 INFO:teuthology.task.internal:Opening connections... 2024-09-12T18:12:32.005 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T18:12:32.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:12:32.101 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T18:12:32.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:12:32.187 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T18:12:32.195 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-09-12T18:12:32.199 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-09-12T18:12:32.199 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-09-12T18:12:32.244 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T18:12:32.245 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2024-09-12T18:12:32.245 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2024-09-12T18:12:32.245 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T18:12:32.245 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2024-09-12T18:12:32.245 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2024-09-12T18:12:32.245 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2024-09-12T18:12:32.245 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T18:12:32.245 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T18:12:32.245 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T18:12:32.245 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T18:12:32.245 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2024-09-12T18:12:32.246 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-09-12T18:12:32.272 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-09-12T18:12:32.277 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-09-12T18:12:32.277 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-09-12T18:12:32.322 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T18:12:32.322 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2024-09-12T18:12:32.322 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04" 2024-09-12T18:12:32.322 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T18:12:32.322 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy 2024-09-12T18:12:32.323 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2024-09-12T18:12:32.323 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2024-09-12T18:12:32.323 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T18:12:32.323 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T18:12:32.323 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T18:12:32.323 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T18:12:32.323 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy 2024-09-12T18:12:32.323 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-09-12T18:12:32.346 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T18:12:32.356 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T18:12:32.386 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T18:12:32.387 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2024-09-12T18:12:32.389 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-09-12T18:12:32.398 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T18:12:32.444 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T18:12:32.444 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2024-09-12T18:12:32.446 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-09-12T18:12:32.461 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T18:12:32.519 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T18:12:32.543 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T18:12:32.544 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T18:12:32.544 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T18:12:32.545 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T18:12:32.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:12:32.550 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-09-12T18:12:32.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:12:32.551 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-12T18:12:32.597 INFO:teuthology.orchestra.run.smithi111.stdout:5.15.0-56-generic 2024-09-12T18:12:32.597 INFO:teuthology.task.kernel:Running kernel on smithi111: 5.15.0-56-generic 2024-09-12T18:12:32.598 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2024-09-12T18:12:32.603 INFO:teuthology.orchestra.run.smithi153.stdout:5.15.0-56-generic 2024-09-12T18:12:32.603 INFO:teuthology.task.kernel:Running kernel on smithi153: 5.15.0-56-generic 2024-09-12T18:12:32.604 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2024-09-12T18:12:32.732 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-12T18:12:32.750 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-09-12T18:12:32.864 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:12:32.887 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T18:12:32.892 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T18:12:32.958 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T18:12:32.982 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T18:12:33.004 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:12:33.085 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T18:12:33.086 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T18:12:33.114 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T18:12:33.191 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T18:12:33.197 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T18:12:33.199 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T18:12:33.200 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T18:12:33.214 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T18:12:33.218 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T18:12:33.219 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T18:12:33.219 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T18:12:33.221 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T18:12:33.222 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T18:12:33.223 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T18:12:33.223 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T18:12:33.223 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T18:12:33.232 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T18:12:33.238 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T18:12:33.241 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T18:12:33.241 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T18:12:33.243 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T18:12:33.247 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T18:12:33.247 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T18:12:33.253 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T18:12:33.256 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T18:12:33.257 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T18:12:33.257 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T18:12:33.257 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T18:12:33.257 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T18:12:33.260 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T18:12:33.262 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T18:12:33.262 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T18:12:33.263 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T18:12:33.263 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T18:12:33.268 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T18:12:33.269 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T18:12:33.286 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T18:12:33.286 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T18:12:33.287 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T18:12:33.287 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T18:12:33.295 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T18:12:33.422 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T18:12:33.441 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T18:12:33.581 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T18:12:33.774 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T18:12:33.842 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T18:12:33.859 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T18:12:33.868 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T18:12:33.868 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T18:12:33.932 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T18:12:33.946 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T18:12:33.947 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T18:12:33.948 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T18:12:33.964 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T18:12:33.965 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T18:12:33.976 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T18:12:33.976 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T18:12:33.992 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T18:12:34.019 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T18:12:34.024 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T18:12:34.029 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T18:12:34.029 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T18:12:34.048 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T18:12:34.058 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T18:12:34.059 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T18:12:34.089 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T18:12:34.105 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T18:12:34.105 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T18:12:34.114 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T18:12:34.122 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T18:12:34.123 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T18:12:34.124 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T18:12:34.126 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T18:12:34.178 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T18:12:34.178 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T18:12:34.179 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T18:12:34.180 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T18:12:34.259 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T18:12:34.259 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T18:12:34.260 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T18:12:34.260 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T18:12:34.261 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T18:12:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 15.8 MB in 2s (7,479 kB/s) 2024-09-12T18:12:39.663 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 15.8 MB in 2s (7,452 kB/s) 2024-09-12T18:12:40.689 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-12T18:12:40.706 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:12:40.766 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-12T18:12:40.975 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-12T18:12:40.976 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-12T18:12:41.150 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:12:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:12:41.150 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:12:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:12:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T18:12:41.151 INFO:teuthology.orchestra.run.smithi153.stdout: python2.7-minimal 2024-09-12T18:12:41.151 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:12:41.152 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-12T18:12:41.152 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T18:12:41.152 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T18:12:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T18:12:41.153 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-12T18:12:41.153 INFO:teuthology.orchestra.run.smithi153.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T18:12:41.154 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-09-12T18:12:41.154 INFO:teuthology.orchestra.run.smithi153.stdout: thermald 2024-09-12T18:12:41.187 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T18:12:41.203 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-12T18:12:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T18:12:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T18:12:41.204 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T18:12:41.205 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:12:41.206 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-09-12T18:12:41.206 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T18:12:41.256 INFO:teuthology.orchestra.run.smithi153.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:12:41.256 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 113 MB of archives. 2024-09-12T18:12:41.256 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T18:12:41.256 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T18:12:41.265 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T18:12:41.473 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-09-12T18:12:41.474 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-09-12T18:12:41.651 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:12:41.651 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:12:41.651 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:12:41.652 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:12:41.652 INFO:teuthology.orchestra.run.smithi111.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T18:12:41.652 INFO:teuthology.orchestra.run.smithi111.stdout: python2.7-minimal 2024-09-12T18:12:41.652 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:12:41.653 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-09-12T18:12:41.653 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T18:12:41.653 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T18:12:41.654 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T18:12:41.655 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-09-12T18:12:41.655 INFO:teuthology.orchestra.run.smithi111.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T18:12:41.655 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2024-09-12T18:12:41.655 INFO:teuthology.orchestra.run.smithi111.stdout: thermald 2024-09-12T18:12:41.693 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T18:12:41.699 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-09-12T18:12:41.699 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T18:12:41.699 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T18:12:41.699 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T18:12:41.701 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages will be upgraded: 2024-09-12T18:12:41.701 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T18:12:41.752 INFO:teuthology.orchestra.run.smithi111.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:12:41.752 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 113 MB of archives. 2024-09-12T18:12:41.752 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T18:12:41.752 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T18:12:41.795 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T18:12:42.199 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T18:12:42.296 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T18:12:42.577 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T18:12:42.577 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T18:12:42.577 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T18:12:42.696 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T18:12:42.719 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T18:12:43.092 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T18:12:43.092 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T18:12:43.092 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T18:12:43.110 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 113 MB in 2s (75.2 MB/s) 2024-09-12T18:12:43.213 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T18:12:43.281 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T18:12:43.343 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T18:12:43.745 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 113 MB in 2s (69.3 MB/s) 2024-09-12T18:12:43.920 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T18:12:45.252 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T18:12:45.256 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:12:45.320 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:12:45.969 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T18:12:45.973 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:12:46.207 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:12:47.396 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T18:12:47.417 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:12:47.502 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:12:47.958 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T18:12:47.980 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:12:48.016 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:12:48.661 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T18:12:48.682 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:12:48.774 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:12:49.289 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T18:12:49.309 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:12:49.347 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:12:54.299 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:12:54.401 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:12:54.744 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:12:54.865 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:12:55.159 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T18:12:55.181 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T18:12:55.225 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:12:56.182 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:12:56.350 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:12:57.009 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:12:57.146 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:12:57.491 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T18:12:57.513 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T18:12:57.557 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:13:00.959 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T18:13:00.996 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:13:01.034 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:13:03.464 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T18:13:03.502 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T18:13:03.539 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:13:03.688 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:13:03.810 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:13:04.285 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:13:04.406 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:13:04.532 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T18:13:04.661 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:13:05.988 INFO:teuthology.orchestra.run.smithi153.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:13:05.988 INFO:teuthology.orchestra.run.smithi153.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T18:13:05.988 INFO:teuthology.orchestra.run.smithi153.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:13:05.988 INFO:teuthology.orchestra.run.smithi153.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T18:13:06.147 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:13:06.467 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T18:13:06.568 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T18:13:06.935 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T18:13:07.479 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:13:07.540 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:13:07.683 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T18:13:07.837 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:13:09.177 INFO:teuthology.orchestra.run.smithi111.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:13:09.177 INFO:teuthology.orchestra.run.smithi111.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T18:13:09.177 INFO:teuthology.orchestra.run.smithi111.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:13:09.177 INFO:teuthology.orchestra.run.smithi111.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T18:13:09.209 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T18:13:09.334 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T18:13:09.431 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:13:09.460 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:13:09.527 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T18:13:09.527 INFO:teuthology.orchestra.run.smithi153.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:13:10.857 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:13:12.250 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T18:13:12.401 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T18:13:12.528 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T18:13:12.632 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T18:13:12.632 INFO:teuthology.orchestra.run.smithi111.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:13:24.151 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T18:13:24.152 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub' 2024-09-12T18:13:24.162 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:13:24.184 INFO:teuthology.orchestra.run.smithi153.stdout:Generating grub configuration file ... 2024-09-12T18:13:24.455 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:13:24.474 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:13:24.782 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:13:24.787 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:13:24.857 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:13:24.862 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:13:25.030 INFO:teuthology.orchestra.run.smithi153.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:13:25.030 INFO:teuthology.orchestra.run.smithi153.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:13:25.030 INFO:teuthology.orchestra.run.smithi153.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:13:25.082 INFO:teuthology.orchestra.run.smithi153.stdout:done 2024-09-12T18:13:25.536 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2024-09-12T18:13:25.560 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2024-09-12T18:13:25.560 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2024-09-12T18:13:25.560 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2024-09-12T18:13:25.560 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2024-09-12T18:13:25.560 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 21 2024-09-12T18:13:25.561 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:13:25.561 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2024-09-12T18:13:25.561 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2024-09-12T18:13:25.561 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.15.0.119.119 2024-09-12T18:13:25.561 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:13:25.561 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:13:25.561 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2024-09-12T18:13:25.561 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2024-09-12T18:13:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:13:25.561 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2024-09-12T18:13:25.562 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T18:13:25.562 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T18:13:25.562 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T18:13:25.562 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T18:13:25.562 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T18:13:25.563 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2024-09-12T18:13:25.730 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-12T18:13:25.841 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:13:25.841 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:13:25.851 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:13:25.868 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:13:27.022 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T18:13:27.022 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub' 2024-09-12T18:13:27.060 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:13:27.081 INFO:teuthology.orchestra.run.smithi111.stdout:Generating grub configuration file ... 2024-09-12T18:13:27.183 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-12T18:13:27.205 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:13:27.262 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-12T18:13:27.367 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:13:27.389 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:13:27.447 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-12T18:13:27.448 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-12T18:13:27.615 INFO:teuthology.orchestra.run.smithi153.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T18:13:27.615 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:13:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:13:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:13:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:13:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:13:27.617 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:13:27.617 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:13:27.656 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:13:27.658 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2024-09-12T18:13:27.670 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2024-09-12T18:13:27.670 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2024-09-12T18:13:27.670 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2024-09-12T18:13:27.670 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2024-09-12T18:13:27.670 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 21 2024-09-12T18:13:27.671 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:13:27.671 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2024-09-12T18:13:27.671 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2024-09-12T18:13:27.671 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.15.0.119.119 2024-09-12T18:13:27.671 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:13:27.671 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:13:27.671 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2024-09-12T18:13:27.671 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2024-09-12T18:13:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:13:27.671 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2024-09-12T18:13:27.672 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-12T18:13:27.718 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.9UhFm1OGq0 2024-09-12T18:13:27.718 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub/grub.cfg /tmp/tmp.9UhFm1OGq0 2024-09-12T18:13:27.739 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:13:27.745 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:13:27.772 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.9UhFm1OGq0 2024-09-12T18:13:27.818 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:13:27.822 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:13:27.894 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.9UhFm1OGq0 is 10KB 2024-09-12T18:13:27.907 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.9UhFm1OGq0 2024-09-12T18:13:27.912 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T18:13:27.964 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:13:27.965 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T18:13:27.965 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T18:13:27.991 INFO:teuthology.orchestra.run.smithi111.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:13:27.991 INFO:teuthology.orchestra.run.smithi111.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:13:27.991 INFO:teuthology.orchestra.run.smithi111.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:13:28.027 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T18:13:28.028 DEBUG:teuthology.orchestra.run.smithi153:> sudo update-grub 2024-09-12T18:13:28.028 INFO:teuthology.orchestra.run.smithi111.stdout:done 2024-09-12T18:13:28.564 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2024-09-12T18:13:28.582 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2024-09-12T18:13:28.582 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2024-09-12T18:13:28.582 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2024-09-12T18:13:28.582 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2024-09-12T18:13:28.583 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 21 2024-09-12T18:13:28.583 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:13:28.583 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2024-09-12T18:13:28.583 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2024-09-12T18:13:28.583 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.15.0.119.119 2024-09-12T18:13:28.583 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:13:28.583 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:13:28.583 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2024-09-12T18:13:28.583 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2024-09-12T18:13:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:13:28.583 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2024-09-12T18:13:28.583 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T18:13:28.584 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T18:13:28.584 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T18:13:28.584 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T18:13:28.584 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi111.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T18:13:28.584 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2024-09-12T18:13:28.734 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-09-12T18:13:28.875 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:13:28.885 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:13:28.902 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:13:28.997 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:13:29.159 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub' 2024-09-12T18:13:29.160 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:13:29.162 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-09-12T18:13:29.329 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:13:29.335 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:13:29.583 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:13:29.588 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:13:29.629 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:13:29.635 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:13:29.756 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:13:29.756 INFO:teuthology.orchestra.run.smithi153.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:13:29.756 INFO:teuthology.orchestra.run.smithi153.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:13:29.775 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-09-12T18:13:29.777 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-09-12T18:13:30.247 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T18:13:30.264 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T18:13:30.332 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T18:13:30.538 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-09-12T18:13:30.539 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-09-12T18:13:30.724 INFO:teuthology.orchestra.run.smithi111.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T18:13:30.724 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:13:30.724 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:13:30.724 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:13:30.724 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:13:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:13:30.725 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:13:30.725 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:13:30.770 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T18:13:30.772 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2024-09-12T18:13:30.785 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2024-09-12T18:13:30.786 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2024-09-12T18:13:30.786 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2024-09-12T18:13:30.786 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2024-09-12T18:13:30.786 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 21 2024-09-12T18:13:30.786 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T18:13:30.786 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2024-09-12T18:13:30.786 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2024-09-12T18:13:30.786 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.15.0.119.119 2024-09-12T18:13:30.786 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T18:13:30.786 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T18:13:30.786 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2024-09-12T18:13:30.786 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2024-09-12T18:13:30.786 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2024-09-12T18:13:30.787 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2024-09-12T18:13:30.787 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-09-12T18:13:30.832 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.DCUAhl8hGu 2024-09-12T18:13:30.833 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /boot/grub/grub.cfg /tmp/tmp.DCUAhl8hGu 2024-09-12T18:13:30.889 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.DCUAhl8hGu 2024-09-12T18:13:31.004 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.DCUAhl8hGu is 10KB 2024-09-12T18:13:31.017 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.DCUAhl8hGu 2024-09-12T18:13:31.022 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T18:13:31.076 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:13:31.076 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T18:13:31.077 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T18:13:31.160 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T18:13:31.161 DEBUG:teuthology.orchestra.run.smithi111:> sudo update-grub 2024-09-12T18:13:32.624 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub' 2024-09-12T18:13:32.625 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T18:13:32.638 INFO:teuthology.orchestra.run.smithi111.stderr:Generating grub configuration file ... 2024-09-12T18:13:32.878 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T18:13:32.885 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T18:13:33.180 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T18:13:33.185 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T18:13:33.228 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T18:13:33.233 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T18:13:33.385 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T18:13:33.386 INFO:teuthology.orchestra.run.smithi111.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T18:13:33.386 INFO:teuthology.orchestra.run.smithi111.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T18:13:33.398 INFO:teuthology.orchestra.run.smithi111.stderr:done 2024-09-12T18:13:33.401 DEBUG:teuthology.orchestra.run.smithi111:> sudo shutdown -r now 2024-09-12T18:13:59.805 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T18:13:59.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T18:13:59.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:14:03.407 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T18:14:03.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-12T18:14:03.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:14:18.177 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-12T18:14:21.757 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-12T18:14:27.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T18:14:27.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:14:30.237 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-12T18:14:30.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-12T18:14:30.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:14:33.821 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-12T18:14:42.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T18:14:42.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:14:45.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-12T18:14:45.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:14:48.893 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-12T18:15:03.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-12T18:15:03.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:15:13.725 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-12T18:15:22.429 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-12T18:15:28.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T18:15:28.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:15:28.969 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-12T18:15:29.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T18:15:29.479 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T18:15:29.479 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-12T18:15:29.524 INFO:teuthology.orchestra.run.smithi153.stdout:5.15.0-119-generic 2024-09-12T18:15:29.524 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T18:15:29.524 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T18:15:29.525 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T18:15:30.525 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T18:15:30.526 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T18:15:30.877 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2024-09-12T18:15:30.922 DEBUG:teuthology.parallel:result is None 2024-09-12T18:15:40.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-12T18:15:40.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:15:40.771 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-09-12T18:15:41.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-12T18:15:41.386 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T18:15:41.386 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-09-12T18:15:41.433 INFO:teuthology.orchestra.run.smithi111.stdout:5.15.0-119-generic 2024-09-12T18:15:41.433 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T18:15:41.433 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T18:15:41.434 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T18:15:42.434 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T18:15:42.435 DEBUG:teuthology.orchestra.run.smithi111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T18:15:42.789 INFO:teuthology.orchestra.run.smithi111.stdout:ttyS1 2024-09-12T18:15:42.827 DEBUG:teuthology.parallel:result is None 2024-09-12T18:15:42.828 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T18:15:42.836 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T18:15:42.836 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T18:15:42.838 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T18:15:42.844 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T18:15:42.876 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T18:15:42.925 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T18:15:42.926 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T18:15:42.928 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T18:15:43.045 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T18:15:43.051 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T18:15:43.052 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T18:15:43.054 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T18:15:43.072 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:15:43.075 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:15:43.080 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:15:43.083 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T18:15:43.084 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T18:15:43.091 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T18:15:43.091 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T18:15:43.126 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T18:15:43.139 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T18:15:43.148 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T18:15:43.148 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T18:15:43.183 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T18:15:43.188 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T18:15:43.234 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T18:15:43.282 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:15:43.282 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T18:15:43.348 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T18:15:43.354 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T18:15:43.400 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:15:43.401 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T18:15:43.472 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2024-09-12T18:15:43.474 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-09-12T18:15:43.551 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T18:15:43.558 INFO:teuthology.task.internal:Starting timer... 2024-09-12T18:15:43.558 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T18:15:43.606 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T18:15:43.653 DEBUG:teuthology.task.selinux:Excluding smithi111: OS 'ubuntu' does not support SELinux 2024-09-12T18:15:43.653 DEBUG:teuthology.task.selinux:Excluding smithi153: OS 'ubuntu' does not support SELinux 2024-09-12T18:15:43.653 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T18:15:43.653 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T18:15:43.654 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T18:15:43.654 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T18:15:43.703 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T18:15:43.717 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T18:15:43.718 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi111.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T18:23:09.540 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi111.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-09-12T18:23:09.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-12T18:23:09.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:23:09.622 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-09-12T18:23:09.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-12T18:23:09.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T18:23:09.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T18:23:09.799 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-12T18:23:09.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T18:23:09.877 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T18:23:09.891 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T18:23:09.891 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T18:23:09.892 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:23:09.894 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T18:23:09.895 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T18:23:09.922 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T18:23:09.922 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: Command line: ntpd -gq 2024-09-12T18:23:09.922 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: ---------------------------------------------------- 2024-09-12T18:23:09.923 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T18:23:09.923 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T18:23:09.923 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: corporation. Support and training for ntp-4 are 2024-09-12T18:23:09.923 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: available at https://www.nwtime.org/support 2024-09-12T18:23:09.923 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: ---------------------------------------------------- 2024-09-12T18:23:09.924 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: proto: precision = 0.045 usec (-24) 2024-09-12T18:23:09.924 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: basedate set to 2022-02-04 2024-09-12T18:23:09.924 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: gps base set to 2022-02-06 (week 2196) 2024-09-12T18:23:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:23:09.925 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:23:09.925 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:23:09.925 INFO:teuthology.orchestra.run.smithi111.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:23:09.926 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T18:23:09.926 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T18:23:09.926 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T18:23:09.926 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: Listen normally on 3 enp3s0f1 172.21.15.111:123 2024-09-12T18:23:09.926 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: Listen normally on 4 lo [::1]:123 2024-09-12T18:23:09.926 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc2f%5]:123 2024-09-12T18:23:09.926 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:09 ntpd[18467]: Listening on routing socket on fd #22 for interface updates 2024-09-12T18:23:09.947 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T18:23:09.947 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: Command line: ntpd -gq 2024-09-12T18:23:09.947 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: ---------------------------------------------------- 2024-09-12T18:23:09.947 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T18:23:09.947 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T18:23:09.947 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: corporation. Support and training for ntp-4 are 2024-09-12T18:23:09.947 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: available at https://www.nwtime.org/support 2024-09-12T18:23:09.947 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: ---------------------------------------------------- 2024-09-12T18:23:09.948 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: proto: precision = 0.056 usec (-24) 2024-09-12T18:23:09.948 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: basedate set to 2022-02-04 2024-09-12T18:23:09.948 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: gps base set to 2022-02-06 (week 2196) 2024-09-12T18:23:09.948 INFO:teuthology.orchestra.run.smithi153.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:23:09.949 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T18:23:09.949 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:23:09.949 INFO:teuthology.orchestra.run.smithi153.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T18:23:09.950 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T18:23:09.950 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T18:23:09.950 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T18:23:09.950 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: Listen normally on 3 enp3s0f1 172.21.15.153:123 2024-09-12T18:23:09.950 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: Listen normally on 4 lo [::1]:123 2024-09-12T18:23:09.950 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6deb%5]:123 2024-09-12T18:23:09.950 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:09 ntpd[18499]: Listening on routing socket on fd #22 for interface updates 2024-09-12T18:23:10.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:10 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:10.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:10 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:10.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:10 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:10.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:10 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:10.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:10 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:10.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:10 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:10.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:10 ntpd[18467]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:10.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:10 ntpd[18467]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:10.947 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:10 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:10.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:10 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:10.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:10 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:10.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:10 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:10.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:10 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:10.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:10 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:11.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:11 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:11.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:11 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:11.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:11 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:11.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:11 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:11.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:11 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:11.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:11 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:11.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:11 ntpd[18467]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:11.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:11 ntpd[18467]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:11.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:11 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:11.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:11 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:11.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:11 ntpd[18467]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:11.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:11 ntpd[18467]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:12.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:12 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:12.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:12 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:12.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:12 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:12.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:12 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:12.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:12 ntpd[18467]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:12.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:12 ntpd[18467]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:12 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:12 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:12 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:12 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:12 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:12 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:12 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:12 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:12 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:12 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:12 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:12 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:12 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:12.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:12 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:13.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:13 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:13.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:13 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:13.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:13 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:13.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:13 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:13.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:13 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:13.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:13 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:13.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:13 ntpd[18467]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:13.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:13 ntpd[18467]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:13.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:13 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:13.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:13 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:13.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:13 ntpd[18467]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:13.925 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:13 ntpd[18467]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:14.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:14 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:14.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:14 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:14.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:14 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:14.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:14 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:14.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:14 ntpd[18467]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:14.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:14 ntpd[18467]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:14.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:14 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:15.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:15 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:15.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:15 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:15.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:15 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:15.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:15 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:15.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:15 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:15.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:15 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:15.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:15 ntpd[18467]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:15.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:15 ntpd[18467]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:15.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:15 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:15.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:15 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:15.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:15 ntpd[18467]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:15.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:15 ntpd[18467]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:16.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:16 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:16.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:16 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:16.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:16 ntpd[18467]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:16.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:16 ntpd[18467]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:16.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:16 ntpd[18467]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:16.923 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:16 ntpd[18467]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:16.924 INFO:teuthology.orchestra.run.smithi111.stdout:12 Sep 18:23:16 ntpd[18467]: ntpd: time slew -0.001624 s 2024-09-12T18:23:16.924 INFO:teuthology.orchestra.run.smithi111.stdout:ntpd: time slew -0.001624s 2024-09-12T18:23:16.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:16 ntpd[18467]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T18:23:16.924 INFO:teuthology.orchestra.run.smithi111.stderr:12 Sep 18:23:16 ntpd[18467]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T18:23:16.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:16 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:16.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:16 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:16.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:16 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:16.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:16 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:16.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:16 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:16.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:16 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:16.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:16 ntpd[18499]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T18:23:16.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:16 ntpd[18499]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T18:23:16.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:16 ntpd[18499]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T18:23:16.948 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:16 ntpd[18499]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T18:23:16.949 INFO:teuthology.orchestra.run.smithi153.stdout:12 Sep 18:23:16 ntpd[18499]: ntpd: time slew +0.000563 s 2024-09-12T18:23:16.949 INFO:teuthology.orchestra.run.smithi153.stdout:ntpd: time slew +0.000563s 2024-09-12T18:23:16.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:16 ntpd[18499]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T18:23:16.949 INFO:teuthology.orchestra.run.smithi153.stderr:12 Sep 18:23:16 ntpd[18499]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T18:23:16.975 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:23:16.975 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-09-12T18:23:16.975 INFO:teuthology.orchestra.run.smithi111.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:23:16.975 INFO:teuthology.orchestra.run.smithi111.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:23:16.975 INFO:teuthology.orchestra.run.smithi111.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:23:16.975 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:23:17.000 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T18:23:17.000 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-09-12T18:23:17.000 INFO:teuthology.orchestra.run.smithi153.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:23:17.000 INFO:teuthology.orchestra.run.smithi153.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:23:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:23:17.001 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T18:23:17.002 INFO:teuthology.run_tasks:Running task install... 2024-09-12T18:23:17.010 DEBUG:teuthology.task.install:project ceph 2024-09-12T18:23:17.010 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T18:23:17.011 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T18:23:17.011 INFO:teuthology.task.install:Using flavor: default 2024-09-12T18:23:17.016 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T18:23:17.016 INFO:teuthology.task.install:extra packages: [] 2024-09-12T18:23:17.016 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-key list | grep Ceph 2024-09-12T18:23:17.017 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-key list | grep Ceph 2024-09-12T18:23:17.075 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T18:23:17.102 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T18:23:17.102 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T18:23:17.103 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T18:23:17.103 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T18:23:17.103 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T18:23:17.108 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T18:23:17.137 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T18:23:17.137 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T18:23:17.137 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T18:23:17.138 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T18:23:17.138 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T18:23:17.255 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T18:23:17.255 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T18:23:17.271 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T18:23:17.271 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T18:23:17.366 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:23:17.366 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T18:23:17.379 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:23:17.379 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T18:23:17.380 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-09-12T18:23:17.393 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-12T18:23:17.545 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:23:17.554 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:23:17.557 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:23:17.571 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:23:17.600 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T18:23:17.613 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T18:23:17.620 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T18:23:17.635 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T18:23:17.642 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T18:23:17.657 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T18:23:17.662 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T18:23:17.679 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T18:23:17.690 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T18:23:17.697 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T18:23:17.697 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T18:23:17.718 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T18:23:17.761 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T18:23:17.843 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T18:23:17.901 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 29.2 kB in 0s (86.7 kB/s) 2024-09-12T18:23:18.067 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 29.2 kB in 0s (59.0 kB/s) 2024-09-12T18:23:18.916 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T18:23:18.933 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T18:23:19.000 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T18:23:19.137 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-12T18:23:19.154 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T18:23:19.209 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-09-12T18:23:19.209 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-09-12T18:23:19.219 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-12T18:23:19.414 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:23:19.415 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:23:19.415 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:23:19.415 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:23:19.415 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:23:19.415 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:23:19.416 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:23:19.416 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-09-12T18:23:19.416 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T18:23:19.417 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T18:23:19.417 INFO:teuthology.orchestra.run.smithi111.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T18:23:19.417 INFO:teuthology.orchestra.run.smithi111.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T18:23:19.418 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T18:23:19.418 INFO:teuthology.orchestra.run.smithi111.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T18:23:19.419 INFO:teuthology.orchestra.run.smithi111.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T18:23:19.419 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T18:23:19.419 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T18:23:19.419 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T18:23:19.419 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T18:23:19.419 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T18:23:19.419 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T18:23:19.419 INFO:teuthology.orchestra.run.smithi111.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T18:23:19.419 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T18:23:19.419 INFO:teuthology.orchestra.run.smithi111.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T18:23:19.420 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T18:23:19.420 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T18:23:19.420 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T18:23:19.420 INFO:teuthology.orchestra.run.smithi111.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T18:23:19.420 INFO:teuthology.orchestra.run.smithi111.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T18:23:19.420 INFO:teuthology.orchestra.run.smithi111.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T18:23:19.420 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T18:23:19.420 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet zip 2024-09-12T18:23:19.421 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-09-12T18:23:19.421 INFO:teuthology.orchestra.run.smithi111.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T18:23:19.421 INFO:teuthology.orchestra.run.smithi111.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T18:23:19.421 INFO:teuthology.orchestra.run.smithi111.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T18:23:19.421 INFO:teuthology.orchestra.run.smithi111.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T18:23:19.421 INFO:teuthology.orchestra.run.smithi111.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T18:23:19.421 INFO:teuthology.orchestra.run.smithi111.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T18:23:19.421 INFO:teuthology.orchestra.run.smithi111.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T18:23:19.421 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2024-09-12T18:23:19.421 INFO:teuthology.orchestra.run.smithi111.stdout: btrfs-tools 2024-09-12T18:23:19.426 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-12T18:23:19.427 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-12T18:23:19.524 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-09-12T18:23:19.524 INFO:teuthology.orchestra.run.smithi111.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T18:23:19.524 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T18:23:19.524 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T18:23:19.524 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T18:23:19.524 INFO:teuthology.orchestra.run.smithi111.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T18:23:19.524 INFO:teuthology.orchestra.run.smithi111.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T18:23:19.525 INFO:teuthology.orchestra.run.smithi111.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T18:23:19.526 INFO:teuthology.orchestra.run.smithi111.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T18:23:19.526 INFO:teuthology.orchestra.run.smithi111.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T18:23:19.526 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T18:23:19.526 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T18:23:19.526 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T18:23:19.526 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T18:23:19.526 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T18:23:19.526 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T18:23:19.526 INFO:teuthology.orchestra.run.smithi111.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T18:23:19.526 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T18:23:19.526 INFO:teuthology.orchestra.run.smithi111.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T18:23:19.526 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T18:23:19.526 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T18:23:19.527 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T18:23:19.527 INFO:teuthology.orchestra.run.smithi111.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T18:23:19.527 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T18:23:19.527 INFO:teuthology.orchestra.run.smithi111.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T18:23:19.527 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T18:23:19.527 INFO:teuthology.orchestra.run.smithi111.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T18:23:19.625 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:23:19.626 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:23:19.626 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:23:19.626 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:23:19.626 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:23:19.627 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:23:19.627 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:23:19.627 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-12T18:23:19.627 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T18:23:19.627 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T18:23:19.627 INFO:teuthology.orchestra.run.smithi153.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T18:23:19.628 INFO:teuthology.orchestra.run.smithi153.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T18:23:19.629 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T18:23:19.629 INFO:teuthology.orchestra.run.smithi153.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T18:23:19.629 INFO:teuthology.orchestra.run.smithi153.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T18:23:19.629 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T18:23:19.629 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T18:23:19.629 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T18:23:19.629 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T18:23:19.629 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T18:23:19.629 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T18:23:19.629 INFO:teuthology.orchestra.run.smithi153.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T18:23:19.629 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T18:23:19.629 INFO:teuthology.orchestra.run.smithi153.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T18:23:19.630 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T18:23:19.630 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T18:23:19.630 INFO:teuthology.orchestra.run.smithi153.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T18:23:19.630 INFO:teuthology.orchestra.run.smithi153.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T18:23:19.630 INFO:teuthology.orchestra.run.smithi153.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T18:23:19.630 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T18:23:19.630 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T18:23:19.630 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet zip 2024-09-12T18:23:19.630 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-12T18:23:19.630 INFO:teuthology.orchestra.run.smithi153.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T18:23:19.631 INFO:teuthology.orchestra.run.smithi153.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T18:23:19.631 INFO:teuthology.orchestra.run.smithi153.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T18:23:19.631 INFO:teuthology.orchestra.run.smithi153.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T18:23:19.631 INFO:teuthology.orchestra.run.smithi153.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T18:23:19.631 INFO:teuthology.orchestra.run.smithi153.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T18:23:19.631 INFO:teuthology.orchestra.run.smithi153.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T18:23:19.631 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-09-12T18:23:19.631 INFO:teuthology.orchestra.run.smithi153.stdout: btrfs-tools 2024-09-12T18:23:19.665 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:23:19.665 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 251 MB of archives. 2024-09-12T18:23:19.665 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T18:23:19.666 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T18:23:19.712 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T18:23:19.732 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-12T18:23:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T18:23:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T18:23:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T18:23:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T18:23:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T18:23:19.733 INFO:teuthology.orchestra.run.smithi153.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T18:23:19.734 INFO:teuthology.orchestra.run.smithi153.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T18:23:19.734 INFO:teuthology.orchestra.run.smithi153.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T18:23:19.734 INFO:teuthology.orchestra.run.smithi153.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T18:23:19.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T18:23:19.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T18:23:19.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T18:23:19.734 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T18:23:19.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T18:23:19.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T18:23:19.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T18:23:19.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T18:23:19.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T18:23:19.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T18:23:19.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T18:23:19.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T18:23:19.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T18:23:19.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T18:23:19.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T18:23:19.735 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T18:23:19.735 INFO:teuthology.orchestra.run.smithi153.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T18:23:19.876 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:23:19.947 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 251 MB of archives. 2024-09-12T18:23:19.948 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T18:23:19.948 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T18:23:19.948 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T18:23:19.949 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T18:23:19.965 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T18:23:19.978 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T18:23:19.988 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T18:23:19.989 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T18:23:19.992 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T18:23:19.993 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T18:23:20.000 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T18:23:20.115 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T18:23:20.136 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T18:23:20.149 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T18:23:20.207 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T18:23:20.210 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T18:23:20.218 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T18:23:20.230 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T18:23:20.257 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T18:23:20.272 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T18:23:20.299 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T18:23:20.301 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T18:23:20.305 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T18:23:20.307 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T18:23:20.314 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T18:23:20.340 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T18:23:20.353 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T18:23:20.434 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T18:23:20.459 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T18:23:20.471 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T18:23:20.500 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T18:23:20.509 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T18:23:20.510 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T18:23:20.511 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T18:23:20.529 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T18:23:20.533 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T18:23:20.537 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T18:23:20.541 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T18:23:20.622 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T18:23:20.626 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T18:23:20.630 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T18:23:20.634 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T18:23:20.635 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T18:23:20.636 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T18:23:20.638 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T18:23:20.638 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T18:23:20.639 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T18:23:20.657 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T18:23:20.660 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T18:23:20.682 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T18:23:20.688 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T18:23:20.698 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T18:23:20.705 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T18:23:20.706 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T18:23:20.713 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T18:23:20.713 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T18:23:20.715 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T18:23:20.721 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T18:23:20.722 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T18:23:20.723 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T18:23:20.728 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T18:23:20.729 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T18:23:20.732 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T18:23:20.736 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T18:23:20.740 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T18:23:20.769 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T18:23:20.787 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T18:23:20.788 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T18:23:20.790 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T18:23:20.790 INFO:teuthology.orchestra.run.smithi111.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T18:23:20.825 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T18:23:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T18:23:20.834 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T18:23:20.838 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T18:23:20.839 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T18:23:20.840 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T18:23:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T18:23:20.842 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T18:23:20.850 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T18:23:20.868 INFO:teuthology.orchestra.run.smithi111.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T18:23:20.870 INFO:teuthology.orchestra.run.smithi111.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T18:23:20.872 INFO:teuthology.orchestra.run.smithi111.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T18:23:20.873 INFO:teuthology.orchestra.run.smithi111.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T18:23:20.883 INFO:teuthology.orchestra.run.smithi111.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T18:23:20.925 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T18:23:20.926 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T18:23:20.927 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T18:23:20.928 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T18:23:20.933 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T18:23:20.934 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T18:23:20.935 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T18:23:20.936 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T18:23:20.938 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T18:23:20.949 INFO:teuthology.orchestra.run.smithi111.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T18:23:20.950 INFO:teuthology.orchestra.run.smithi111.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T18:23:20.951 INFO:teuthology.orchestra.run.smithi111.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T18:23:20.954 INFO:teuthology.orchestra.run.smithi111.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T18:23:20.958 INFO:teuthology.orchestra.run.smithi111.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T18:23:21.013 INFO:teuthology.orchestra.run.smithi153.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T18:23:21.013 INFO:teuthology.orchestra.run.smithi153.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T18:23:21.016 INFO:teuthology.orchestra.run.smithi153.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T18:23:21.031 INFO:teuthology.orchestra.run.smithi111.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T18:23:21.094 INFO:teuthology.orchestra.run.smithi153.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T18:23:21.095 INFO:teuthology.orchestra.run.smithi153.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T18:23:21.100 INFO:teuthology.orchestra.run.smithi111.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T18:23:21.100 INFO:teuthology.orchestra.run.smithi111.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T18:23:21.102 INFO:teuthology.orchestra.run.smithi111.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T18:23:21.106 INFO:teuthology.orchestra.run.smithi111.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T18:23:21.107 INFO:teuthology.orchestra.run.smithi153.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T18:23:21.107 INFO:teuthology.orchestra.run.smithi153.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T18:23:21.107 INFO:teuthology.orchestra.run.smithi111.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T18:23:21.108 INFO:teuthology.orchestra.run.smithi153.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T18:23:21.109 INFO:teuthology.orchestra.run.smithi153.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T18:23:21.112 INFO:teuthology.orchestra.run.smithi153.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T18:23:21.112 INFO:teuthology.orchestra.run.smithi111.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T18:23:21.117 INFO:teuthology.orchestra.run.smithi111.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T18:23:21.176 INFO:teuthology.orchestra.run.smithi153.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T18:23:21.177 INFO:teuthology.orchestra.run.smithi153.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T18:23:21.180 INFO:teuthology.orchestra.run.smithi153.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T18:23:21.194 INFO:teuthology.orchestra.run.smithi111.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T18:23:21.199 INFO:teuthology.orchestra.run.smithi111.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T18:23:21.202 INFO:teuthology.orchestra.run.smithi111.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T18:23:21.239 INFO:teuthology.orchestra.run.smithi111.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T18:23:21.243 INFO:teuthology.orchestra.run.smithi111.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T18:23:21.245 INFO:teuthology.orchestra.run.smithi111.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T18:23:21.247 INFO:teuthology.orchestra.run.smithi111.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T18:23:21.247 INFO:teuthology.orchestra.run.smithi111.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T18:23:21.250 INFO:teuthology.orchestra.run.smithi111.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T18:23:21.257 INFO:teuthology.orchestra.run.smithi153.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T18:23:21.262 INFO:teuthology.orchestra.run.smithi153.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T18:23:21.263 INFO:teuthology.orchestra.run.smithi153.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T18:23:21.265 INFO:teuthology.orchestra.run.smithi153.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T18:23:21.270 INFO:teuthology.orchestra.run.smithi153.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T18:23:21.310 INFO:teuthology.orchestra.run.smithi111.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T18:23:21.320 INFO:teuthology.orchestra.run.smithi111.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T18:23:21.321 INFO:teuthology.orchestra.run.smithi111.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T18:23:21.380 INFO:teuthology.orchestra.run.smithi111.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T18:23:21.381 INFO:teuthology.orchestra.run.smithi111.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T18:23:21.382 INFO:teuthology.orchestra.run.smithi111.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T18:23:21.383 INFO:teuthology.orchestra.run.smithi111.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T18:23:21.384 INFO:teuthology.orchestra.run.smithi111.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T18:23:21.385 INFO:teuthology.orchestra.run.smithi111.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T18:23:21.432 INFO:teuthology.orchestra.run.smithi153.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T18:23:21.434 INFO:teuthology.orchestra.run.smithi153.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T18:23:21.437 INFO:teuthology.orchestra.run.smithi153.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T18:23:21.438 INFO:teuthology.orchestra.run.smithi153.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T18:23:21.438 INFO:teuthology.orchestra.run.smithi111.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T18:23:21.439 INFO:teuthology.orchestra.run.smithi111.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T18:23:21.440 INFO:teuthology.orchestra.run.smithi153.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T18:23:21.446 INFO:teuthology.orchestra.run.smithi111.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T18:23:21.473 INFO:teuthology.orchestra.run.smithi153.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T18:23:21.505 INFO:teuthology.orchestra.run.smithi153.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T18:23:21.505 INFO:teuthology.orchestra.run.smithi153.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T18:23:21.516 INFO:teuthology.orchestra.run.smithi111.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T18:23:21.519 INFO:teuthology.orchestra.run.smithi111.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T18:23:21.523 INFO:teuthology.orchestra.run.smithi111.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T18:23:21.524 INFO:teuthology.orchestra.run.smithi111.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T18:23:21.533 INFO:teuthology.orchestra.run.smithi111.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T18:23:21.538 INFO:teuthology.orchestra.run.smithi153.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T18:23:21.538 INFO:teuthology.orchestra.run.smithi153.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T18:23:21.540 INFO:teuthology.orchestra.run.smithi111.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T18:23:21.542 INFO:teuthology.orchestra.run.smithi111.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T18:23:21.543 INFO:teuthology.orchestra.run.smithi111.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T18:23:21.599 INFO:teuthology.orchestra.run.smithi153.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T18:23:21.601 INFO:teuthology.orchestra.run.smithi111.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T18:23:21.602 INFO:teuthology.orchestra.run.smithi111.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T18:23:21.610 INFO:teuthology.orchestra.run.smithi111.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T18:23:21.626 INFO:teuthology.orchestra.run.smithi153.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T18:23:21.627 INFO:teuthology.orchestra.run.smithi153.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T18:23:21.628 INFO:teuthology.orchestra.run.smithi153.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T18:23:21.677 INFO:teuthology.orchestra.run.smithi153.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T18:23:21.677 INFO:teuthology.orchestra.run.smithi153.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T18:23:21.678 INFO:teuthology.orchestra.run.smithi153.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T18:23:21.682 INFO:teuthology.orchestra.run.smithi111.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T18:23:21.684 INFO:teuthology.orchestra.run.smithi111.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T18:23:21.685 INFO:teuthology.orchestra.run.smithi111.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T18:23:21.687 INFO:teuthology.orchestra.run.smithi153.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T18:23:21.689 INFO:teuthology.orchestra.run.smithi111.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T18:23:21.691 INFO:teuthology.orchestra.run.smithi111.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T18:23:21.691 INFO:teuthology.orchestra.run.smithi153.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T18:23:21.695 INFO:teuthology.orchestra.run.smithi153.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T18:23:21.696 INFO:teuthology.orchestra.run.smithi153.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T18:23:21.708 INFO:teuthology.orchestra.run.smithi111.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T18:23:21.709 INFO:teuthology.orchestra.run.smithi111.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T18:23:21.758 INFO:teuthology.orchestra.run.smithi153.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T18:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T18:23:21.761 INFO:teuthology.orchestra.run.smithi153.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T18:23:21.763 INFO:teuthology.orchestra.run.smithi153.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T18:23:21.764 INFO:teuthology.orchestra.run.smithi111.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T18:23:21.768 INFO:teuthology.orchestra.run.smithi153.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T18:23:21.769 INFO:teuthology.orchestra.run.smithi111.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T18:23:21.770 INFO:teuthology.orchestra.run.smithi153.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T18:23:21.771 INFO:teuthology.orchestra.run.smithi111.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T18:23:21.812 INFO:teuthology.orchestra.run.smithi153.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T18:23:21.843 INFO:teuthology.orchestra.run.smithi153.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T18:23:21.854 INFO:teuthology.orchestra.run.smithi153.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T18:23:21.856 INFO:teuthology.orchestra.run.smithi153.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T18:23:21.863 INFO:teuthology.orchestra.run.smithi153.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T18:23:21.864 INFO:teuthology.orchestra.run.smithi153.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T18:23:21.866 INFO:teuthology.orchestra.run.smithi153.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T18:23:21.866 INFO:teuthology.orchestra.run.smithi153.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T18:23:21.924 INFO:teuthology.orchestra.run.smithi153.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T18:23:21.926 INFO:teuthology.orchestra.run.smithi153.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T18:23:21.943 INFO:teuthology.orchestra.run.smithi153.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T18:23:21.968 INFO:teuthology.orchestra.run.smithi153.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T18:23:22.005 INFO:teuthology.orchestra.run.smithi153.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T18:23:22.006 INFO:teuthology.orchestra.run.smithi153.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T18:23:22.012 INFO:teuthology.orchestra.run.smithi153.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T18:23:22.014 INFO:teuthology.orchestra.run.smithi153.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T18:23:22.603 INFO:teuthology.orchestra.run.smithi111.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T18:23:22.604 INFO:teuthology.orchestra.run.smithi111.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T18:23:22.621 INFO:teuthology.orchestra.run.smithi111.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T18:23:22.639 INFO:teuthology.orchestra.run.smithi153.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T18:23:22.640 INFO:teuthology.orchestra.run.smithi153.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T18:23:22.654 INFO:teuthology.orchestra.run.smithi153.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T18:23:22.662 INFO:teuthology.orchestra.run.smithi111.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T18:23:22.672 INFO:teuthology.orchestra.run.smithi111.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T18:23:22.674 INFO:teuthology.orchestra.run.smithi111.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T18:23:22.691 INFO:teuthology.orchestra.run.smithi153.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T18:23:22.701 INFO:teuthology.orchestra.run.smithi153.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T18:23:22.702 INFO:teuthology.orchestra.run.smithi153.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T18:23:24.389 INFO:teuthology.orchestra.run.smithi153.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T18:23:24.554 INFO:teuthology.orchestra.run.smithi153.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T18:23:24.554 INFO:teuthology.orchestra.run.smithi153.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T18:23:25.682 INFO:teuthology.orchestra.run.smithi111.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T18:23:25.939 INFO:teuthology.orchestra.run.smithi111.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T18:23:25.940 INFO:teuthology.orchestra.run.smithi111.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T18:23:26.101 INFO:teuthology.orchestra.run.smithi153.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T18:23:26.104 INFO:teuthology.orchestra.run.smithi153.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T18:23:26.105 INFO:teuthology.orchestra.run.smithi153.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T18:23:26.524 INFO:teuthology.orchestra.run.smithi153.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T18:23:27.097 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 251 MB in 7s (37.0 MB/s) 2024-09-12T18:23:27.270 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T18:23:27.321 INFO:teuthology.orchestra.run.smithi111.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T18:23:27.323 INFO:teuthology.orchestra.run.smithi111.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T18:23:27.325 INFO:teuthology.orchestra.run.smithi111.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T18:23:27.368 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T18:23:27.374 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T18:23:27.452 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:23:27.632 INFO:teuthology.orchestra.run.smithi111.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T18:23:27.756 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T18:23:27.782 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T18:23:27.814 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:23:28.150 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T18:23:28.176 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T18:23:28.185 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 251 MB in 8s (31.0 MB/s) 2024-09-12T18:23:28.217 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:23:28.346 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T18:23:28.445 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T18:23:28.450 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T18:23:28.527 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:23:28.614 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T18:23:28.640 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:23:28.689 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:23:28.806 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T18:23:28.832 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T18:23:28.864 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:23:29.067 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T18:23:29.093 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:23:29.133 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:23:29.217 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T18:23:29.243 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T18:23:29.284 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:23:29.478 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T18:23:29.504 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:23:29.544 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:23:29.745 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T18:23:29.771 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:23:29.828 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:23:29.898 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T18:23:29.924 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T18:23:29.964 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:23:30.240 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T18:23:30.258 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librados2. 2024-09-12T18:23:30.266 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:23:30.274 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:30.306 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:23:30.308 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:30.601 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T18:23:30.627 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T18:23:30.660 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:23:30.769 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librbd1. 2024-09-12T18:23:30.796 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:30.836 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:30.988 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T18:23:31.013 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T18:23:31.054 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:23:31.264 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T18:23:31.290 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:31.330 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:31.373 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librados2. 2024-09-12T18:23:31.400 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:31.440 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:31.608 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rados. 2024-09-12T18:23:31.623 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:31.666 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:31.851 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librbd1. 2024-09-12T18:23:31.877 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:31.918 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:31.977 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T18:23:32.004 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:23:32.035 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:32.254 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T18:23:32.269 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:32.279 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T18:23:32.294 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:32.312 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:32.337 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:32.615 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rados. 2024-09-12T18:23:32.624 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T18:23:32.641 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:32.650 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:23:32.681 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:32.690 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:33.018 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T18:23:33.044 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T18:23:33.084 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:23:33.242 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T18:23:33.269 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:23:33.384 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:33.596 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T18:23:33.620 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T18:23:33.622 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T18:23:33.635 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:33.662 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T18:23:33.669 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:33.881 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T18:23:33.907 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:33.922 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T18:23:33.948 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:33.948 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:23:33.989 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:34.293 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T18:23:34.309 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T18:23:34.319 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T18:23:34.335 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T18:23:34.359 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:23:34.376 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:23:34.637 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T18:23:34.663 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T18:23:34.686 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T18:23:34.703 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:23:34.712 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T18:23:34.753 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T18:23:34.981 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T18:23:34.997 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T18:23:34.997 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T18:23:35.012 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:35.031 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:23:35.047 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:35.325 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T18:23:35.352 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T18:23:35.384 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua5.1. 2024-09-12T18:23:35.391 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:23:35.411 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T18:23:35.451 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:23:35.669 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T18:23:35.696 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T18:23:35.736 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:23:35.770 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-any. 2024-09-12T18:23:35.796 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T18:23:35.837 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T18:23:36.038 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T18:23:36.053 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T18:23:36.073 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package zip. 2024-09-12T18:23:36.088 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T18:23:36.096 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:23:36.123 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T18:23:36.409 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package unzip. 2024-09-12T18:23:36.436 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T18:23:36.441 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua5.1. 2024-09-12T18:23:36.467 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T18:23:36.475 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:23:36.517 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:23:36.786 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-any. 2024-09-12T18:23:36.801 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T18:23:36.836 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T18:23:36.871 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package luarocks. 2024-09-12T18:23:36.897 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T18:23:36.938 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:23:37.080 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package zip. 2024-09-12T18:23:37.095 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T18:23:37.138 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T18:23:37.320 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librgw2. 2024-09-12T18:23:37.347 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:37.386 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:37.433 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package unzip. 2024-09-12T18:23:37.459 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T18:23:37.500 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:23:37.895 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package luarocks. 2024-09-12T18:23:37.921 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T18:23:37.962 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:23:38.006 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T18:23:38.032 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:38.072 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:38.525 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T18:23:38.536 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librgw2. 2024-09-12T18:23:38.552 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T18:23:38.563 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:38.603 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:38.827 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:23:39.163 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T18:23:39.178 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T18:23:39.179 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:39.204 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:39.213 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:39.245 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:39.549 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T18:23:39.573 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-common. 2024-09-12T18:23:39.576 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T18:23:39.600 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:39.616 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:23:39.640 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:39.896 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T18:23:39.923 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:39.954 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:40.374 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-common. 2024-09-12T18:23:40.401 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:40.441 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:41.128 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-base. 2024-09-12T18:23:41.154 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:41.204 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:41.782 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T18:23:41.808 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T18:23:41.846 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-base. 2024-09-12T18:23:41.848 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:23:41.873 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:41.922 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:42.151 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T18:23:42.177 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T18:23:42.218 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:23:42.484 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T18:23:42.510 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T18:23:42.550 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:23:42.579 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T18:23:42.605 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T18:23:42.654 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:23:42.862 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T18:23:42.888 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T18:23:42.915 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T18:23:42.928 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:23:42.930 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T18:23:42.965 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:23:43.223 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T18:23:43.234 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T18:23:43.238 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T18:23:43.261 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T18:23:43.273 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:23:43.301 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:23:43.542 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T18:23:43.569 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T18:23:43.603 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T18:23:43.609 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:23:43.630 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T18:23:43.670 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T18:23:43.921 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T18:23:43.947 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T18:23:43.973 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-portend. 2024-09-12T18:23:43.987 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:23:44.003 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T18:23:44.173 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T18:23:44.290 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T18:23:44.316 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T18:23:44.356 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T18:23:44.434 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T18:23:44.461 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T18:23:44.492 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T18:23:44.609 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-portend. 2024-09-12T18:23:44.624 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T18:23:44.659 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T18:23:44.778 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T18:23:44.805 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T18:23:44.845 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:23:44.971 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T18:23:44.997 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T18:23:45.037 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T18:23:45.190 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T18:23:45.217 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T18:23:45.270 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T18:23:45.340 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T18:23:45.366 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T18:23:45.406 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:23:45.543 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T18:23:45.558 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T18:23:45.593 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T18:23:45.718 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T18:23:45.745 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T18:23:45.777 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T18:23:45.895 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T18:23:45.922 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T18:23:45.962 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:23:46.088 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T18:23:46.115 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T18:23:46.155 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T18:23:46.290 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-mako. 2024-09-12T18:23:46.317 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T18:23:46.356 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:23:46.483 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T18:23:46.509 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T18:23:46.549 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:23:46.701 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T18:23:46.728 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T18:23:46.768 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:23:46.827 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-mako. 2024-09-12T18:23:46.850 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T18:23:46.885 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:23:47.029 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T18:23:47.044 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T18:23:47.079 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:23:47.172 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T18:23:47.187 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T18:23:47.222 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:23:47.373 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webob. 2024-09-12T18:23:47.400 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T18:23:47.440 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:23:47.508 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T18:23:47.535 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T18:23:47.575 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:23:47.776 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T18:23:47.802 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T18:23:47.862 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:23:47.877 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webob. 2024-09-12T18:23:47.904 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T18:23:47.953 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:23:48.170 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T18:23:48.197 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T18:23:48.237 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:23:48.297 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T18:23:48.324 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T18:23:48.475 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:23:48.548 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-paste. 2024-09-12T18:23:48.575 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T18:23:48.615 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:23:48.792 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T18:23:48.818 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T18:23:48.850 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:23:48.943 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T18:23:48.958 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T18:23:49.001 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:23:49.137 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-paste. 2024-09-12T18:23:49.163 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T18:23:49.203 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:23:49.404 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T18:23:49.430 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T18:23:49.470 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:23:49.523 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T18:23:49.538 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T18:23:49.573 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:23:49.765 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T18:23:49.780 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T18:23:49.815 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T18:23:49.851 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T18:23:49.877 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T18:23:49.917 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:23:50.101 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T18:23:50.128 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T18:23:50.167 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:23:50.221 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T18:23:50.248 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T18:23:50.287 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T18:23:50.506 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T18:23:50.532 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T18:23:50.557 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T18:23:50.572 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T18:23:50.584 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T18:23:50.615 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:23:50.918 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-idna. 2024-09-12T18:23:50.944 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T18:23:50.962 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T18:23:50.983 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:23:50.988 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T18:23:51.028 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T18:23:51.261 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T18:23:51.287 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T18:23:51.327 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:23:51.348 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-idna. 2024-09-12T18:23:51.375 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T18:23:51.414 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:23:51.647 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests. 2024-09-12T18:23:51.674 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T18:23:51.714 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:23:51.726 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T18:23:51.752 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T18:23:51.792 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:23:52.025 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T18:23:52.051 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T18:23:52.091 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:23:52.096 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests. 2024-09-12T18:23:52.123 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T18:23:52.162 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:23:52.361 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T18:23:52.377 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:23:52.411 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:52.473 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T18:23:52.500 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T18:23:52.540 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:23:52.791 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T18:23:52.818 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:52.857 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:53.602 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T18:23:53.629 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:23:53.668 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:53.977 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T18:23:53.993 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T18:23:54.027 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:23:54.173 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T18:23:54.189 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:54.223 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:54.421 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T18:23:54.448 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T18:23:54.485 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T18:23:54.487 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T18:23:54.511 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T18:23:54.551 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:23:54.849 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T18:23:54.854 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T18:23:54.876 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:54.881 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T18:23:54.915 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:54.920 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T18:23:55.291 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T18:23:55.310 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T18:23:55.317 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:55.337 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:55.357 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:55.377 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:55.702 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T18:23:55.729 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:55.760 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:55.931 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T18:23:55.957 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:55.988 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:56.372 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T18:23:56.399 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:56.439 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:57.066 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph. 2024-09-12T18:23:57.082 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:57.125 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:57.444 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T18:23:57.471 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:57.510 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:57.517 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph. 2024-09-12T18:23:57.544 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:57.584 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:57.836 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T18:23:57.852 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:57.872 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T18:23:57.886 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:57.899 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:57.939 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:58.265 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T18:23:58.266 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephadm. 2024-09-12T18:23:58.281 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:58.291 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:58.324 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:58.331 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:58.644 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T18:23:58.671 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T18:23:58.710 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T18:23:58.751 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package cephadm. 2024-09-12T18:23:58.778 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:23:58.817 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:23:59.005 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T18:23:59.031 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:23:59.080 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:23:59.095 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T18:23:59.119 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T18:23:59.153 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T18:23:59.465 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T18:23:59.480 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:23:59.514 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:24:00.051 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-babel. 2024-09-12T18:24:00.078 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:24:00.117 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:24:00.470 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T18:24:00.497 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T18:24:00.528 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-babel. 2024-09-12T18:24:00.537 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:24:00.555 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T18:24:00.594 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:24:00.873 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T18:24:00.882 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T18:24:00.899 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T18:24:00.908 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:24:00.931 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:24:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:01.234 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T18:24:01.261 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:24:01.293 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:01.293 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T18:24:01.320 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T18:24:01.359 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T18:24:01.596 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T18:24:01.623 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T18:24:01.662 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T18:24:01.662 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-routes. 2024-09-12T18:24:01.689 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T18:24:01.729 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:24:01.923 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-routes. 2024-09-12T18:24:01.950 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T18:24:01.981 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:24:02.065 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T18:24:02.093 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:24:02.132 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:02.276 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T18:24:02.303 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:24:02.334 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:05.003 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T18:24:05.020 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T18:24:05.061 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:24:05.098 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T18:24:05.115 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T18:24:05.156 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:24:05.615 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T18:24:05.642 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T18:24:05.681 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:24:05.712 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T18:24:05.737 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T18:24:05.776 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:24:06.018 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T18:24:06.045 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T18:24:06.084 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:24:06.155 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T18:24:06.171 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T18:24:06.213 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:24:06.395 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T18:24:06.423 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T18:24:06.461 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:24:06.507 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T18:24:06.535 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T18:24:06.574 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:24:07.163 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T18:24:07.191 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:24:07.216 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T18:24:07.235 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:24:07.315 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:07.343 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:08.277 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T18:24:08.305 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T18:24:08.335 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T18:24:08.405 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T18:24:08.433 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T18:24:08.472 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T18:24:08.571 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T18:24:08.599 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T18:24:08.629 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:24:08.741 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T18:24:08.769 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T18:24:08.800 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:24:08.941 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T18:24:08.969 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T18:24:09.008 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:24:09.053 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T18:24:09.069 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T18:24:09.119 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:24:09.319 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T18:24:09.347 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T18:24:09.385 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T18:24:09.417 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T18:24:09.442 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T18:24:09.481 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T18:24:09.706 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T18:24:09.733 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T18:24:09.768 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T18:24:09.772 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T18:24:09.796 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T18:24:09.826 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T18:24:10.092 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T18:24:10.109 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T18:24:10.130 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T18:24:10.150 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:24:10.158 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T18:24:10.196 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:24:10.453 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T18:24:10.481 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T18:24:10.508 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T18:24:10.519 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T18:24:10.535 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T18:24:10.574 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T18:24:10.814 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T18:24:10.842 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T18:24:10.881 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:24:10.886 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T18:24:10.913 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T18:24:10.952 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:24:11.478 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T18:24:11.491 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:24:11.527 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:11.575 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T18:24:11.591 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:24:11.625 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:11.872 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T18:24:11.900 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T18:24:11.928 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T18:24:11.938 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:24:11.955 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T18:24:11.994 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:24:12.292 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T18:24:12.320 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:24:12.339 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T18:24:12.358 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:24:12.367 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:24:12.405 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:24:12.594 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package jq. 2024-09-12T18:24:12.610 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:24:12.643 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T18:24:12.675 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package jq. 2024-09-12T18:24:12.703 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T18:24:12.741 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T18:24:12.821 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package socat. 2024-09-12T18:24:12.837 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T18:24:12.879 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:24:12.944 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package socat. 2024-09-12T18:24:12.957 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T18:24:12.994 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:24:13.174 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T18:24:13.190 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T18:24:13.232 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:24:13.289 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T18:24:13.317 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T18:24:13.355 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:24:13.586 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-test. 2024-09-12T18:24:13.603 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:24:13.645 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:13.718 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-test. 2024-09-12T18:24:13.746 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:24:13.785 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:16.216 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T18:24:16.261 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:24:16.282 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:16.381 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T18:24:16.409 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T18:24:16.447 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:16.588 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T18:24:16.603 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:24:16.644 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:16.796 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T18:24:16.824 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:24:16.859 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:16.938 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T18:24:16.966 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T18:24:17.004 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:24:17.146 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T18:24:17.173 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T18:24:17.212 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:24:17.284 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T18:24:17.301 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T18:24:17.334 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:24:17.551 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T18:24:17.578 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T18:24:17.617 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:24:17.721 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T18:24:17.750 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T18:24:17.788 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:24:17.963 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T18:24:17.990 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T18:24:18.029 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:24:18.210 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package pkg-config. 2024-09-12T18:24:18.238 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T18:24:18.276 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:24:18.426 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package pkg-config. 2024-09-12T18:24:18.454 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T18:24:18.484 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:24:18.537 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T18:24:18.566 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T18:24:18.603 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:24:18.745 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T18:24:18.761 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T18:24:18.795 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:24:19.057 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T18:24:19.085 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T18:24:19.123 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T18:24:19.151 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T18:24:19.179 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T18:24:19.209 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T18:24:19.426 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T18:24:19.454 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T18:24:19.492 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T18:24:19.503 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T18:24:19.531 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T18:24:19.570 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T18:24:19.787 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T18:24:19.815 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T18:24:19.845 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:24:19.898 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T18:24:19.926 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T18:24:19.965 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:24:20.123 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T18:24:20.152 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T18:24:20.189 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T18:24:20.277 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T18:24:20.304 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T18:24:20.343 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T18:24:20.510 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-py. 2024-09-12T18:24:20.538 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T18:24:20.567 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T18:24:20.663 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-py. 2024-09-12T18:24:20.690 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T18:24:20.729 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T18:24:20.829 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T18:24:20.846 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T18:24:20.890 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:24:21.049 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T18:24:21.077 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T18:24:21.115 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:24:21.342 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T18:24:21.370 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T18:24:21.408 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:24:21.578 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T18:24:21.607 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T18:24:21.644 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:24:21.719 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-toml. 2024-09-12T18:24:21.747 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T18:24:21.785 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T18:24:21.922 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-toml. 2024-09-12T18:24:21.938 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T18:24:21.972 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T18:24:22.130 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T18:24:22.158 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T18:24:22.196 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:24:22.275 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T18:24:22.303 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T18:24:22.341 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:24:22.591 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T18:24:22.619 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T18:24:22.645 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T18:24:22.657 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:24:22.673 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T18:24:22.703 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:24:22.931 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T18:24:22.935 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T18:24:22.947 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T18:24:22.964 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T18:24:22.981 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:24:23.001 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:24:23.702 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package radosgw. 2024-09-12T18:24:23.730 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:24:23.730 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package radosgw. 2024-09-12T18:24:23.759 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:24:23.768 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:23.796 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:24.671 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T18:24:24.687 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:24:24.692 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T18:24:24.721 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T18:24:24.729 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:24.758 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:25.034 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T18:24:25.070 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T18:24:25.276 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:24:25.321 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T18:24:25.385 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:24:25.430 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T18:24:25.673 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T18:24:25.968 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T18:24:26.005 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T18:24:26.307 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T18:24:26.477 INFO:teuthology.orchestra.run.smithi111.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T18:24:26.713 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:26.746 INFO:teuthology.orchestra.run.smithi153.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T18:24:27.000 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:27.171 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user cephadm....done 2024-09-12T18:24:27.303 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:24:27.508 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user cephadm....done 2024-09-12T18:24:27.571 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:24:27.631 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T18:24:27.822 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:24:27.915 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T18:24:27.931 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:24:28.166 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T18:24:28.166 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T18:24:28.292 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T18:24:28.409 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:24:28.535 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T18:24:28.560 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T18:24:28.820 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T18:24:28.837 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:24:28.946 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T18:24:29.197 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T18:24:29.249 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T18:24:29.448 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T18:24:29.608 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T18:24:29.716 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:24:29.867 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T18:24:30.135 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T18:24:30.284 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:24:30.361 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T18:24:30.535 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:24:30.612 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T18:24:30.795 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:24:30.880 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T18:24:31.131 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:31.137 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:31.391 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:24:31.396 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T18:24:31.506 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:24:31.516 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T18:24:31.616 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:24:31.626 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T18:24:31.725 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:24:31.735 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T18:24:31.969 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:24:31.993 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T18:24:32.339 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T18:24:32.363 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T18:24:32.375 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T18:24:32.391 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T18:24:32.439 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:24:32.454 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T18:24:32.565 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T18:24:32.580 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T18:24:32.933 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:24:32.940 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T18:24:33.050 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T18:24:33.057 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T18:24:33.309 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:24:33.318 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T18:24:33.578 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:24:33.585 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T18:24:33.853 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T18:24:33.903 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T18:24:33.980 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:24:34.029 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T18:24:34.623 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:24:34.672 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T18:24:34.891 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:24:34.915 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T18:24:35.017 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:24:35.033 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T18:24:35.118 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:24:35.134 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T18:24:35.427 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T18:24:35.427 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T18:24:35.787 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T18:24:35.811 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T18:24:36.029 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:24:36.054 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T18:24:36.406 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:24:36.439 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T18:24:36.715 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:24:36.731 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T18:24:37.042 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:24:37.084 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T18:24:37.285 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:24:37.326 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T18:24:37.411 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:37.427 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:37.703 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:24:37.712 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T18:24:38.004 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:24:38.030 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T18:24:39.093 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:24:39.194 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T18:24:39.320 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:24:39.429 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T18:24:39.445 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:24:39.580 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T18:24:39.672 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:24:39.798 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:24:39.864 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T18:24:39.932 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:24:39.974 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T18:24:40.083 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T18:24:40.250 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:24:40.376 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T18:24:40.534 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T18:24:40.627 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T18:24:40.785 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:24:40.879 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:24:40.903 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:24:41.004 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T18:24:41.221 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:24:41.306 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T18:24:41.455 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T18:24:41.557 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T18:24:41.723 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T18:24:41.791 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T18:24:42.000 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:24:42.051 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T18:24:42.250 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T18:24:42.302 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T18:24:42.518 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:24:42.578 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T18:24:42.619 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T18:24:42.704 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T18:24:42.903 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:24:42.989 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T18:24:43.029 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:24:43.090 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T18:24:43.330 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:24:43.375 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T18:24:43.640 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:24:43.675 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T18:24:43.935 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:24:43.941 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T18:24:44.061 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:24:44.067 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T18:24:44.187 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:24:44.192 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T18:24:44.277 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T18:24:44.282 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T18:24:44.519 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:24:44.555 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T18:24:44.637 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:24:44.681 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T18:24:45.021 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:24:45.058 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T18:24:45.281 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T18:24:45.309 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T18:24:45.415 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T18:24:45.435 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T18:24:45.675 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:24:45.678 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T18:24:45.801 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:24:45.804 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T18:24:46.113 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:24:46.135 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T18:24:46.406 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:24:46.594 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T18:24:46.674 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T18:24:46.800 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T18:24:46.854 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T18:24:46.980 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T18:24:47.076 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T18:24:47.256 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T18:24:47.344 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:24:47.524 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T18:24:47.689 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:24:47.885 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T18:24:48.057 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T18:24:48.245 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T18:24:48.343 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:24:48.521 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T18:24:48.678 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:24:48.804 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:48.866 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T18:24:48.930 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:48.992 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:49.040 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:24:49.101 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:49.227 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T18:24:49.351 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:49.477 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:49.538 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:49.603 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T18:24:49.664 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:49.799 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T18:24:49.880 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:50.006 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:50.075 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:50.140 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:50.201 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:50.302 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:50.355 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:24:50.355 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:24:50.500 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:24:50.500 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T18:24:50.842 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:50.968 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:51.003 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:51.085 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:51.129 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:51.203 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:24:51.255 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:51.381 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T18:24:52.415 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:52.516 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:52.520 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:52.646 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:52.667 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:52.772 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:52.793 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:52.898 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:52.919 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:53.024 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:53.437 INFO:teuthology.orchestra.run.smithi111.stdout:Adding group ceph....done 2024-09-12T18:24:53.491 INFO:teuthology.orchestra.run.smithi153.stdout:Adding group ceph....done 2024-09-12T18:24:53.810 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user ceph....done 2024-09-12T18:24:53.813 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user ceph....done 2024-09-12T18:24:53.965 INFO:teuthology.orchestra.run.smithi111.stdout:Setting system user ceph properties....done 2024-09-12T18:24:53.979 INFO:teuthology.orchestra.run.smithi153.stdout:Setting system user ceph properties....done 2024-09-12T18:24:53.980 INFO:teuthology.orchestra.run.smithi111.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T18:24:53.997 INFO:teuthology.orchestra.run.smithi153.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T18:24:54.115 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T18:24:54.131 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T18:24:54.435 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T18:24:54.450 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T18:24:54.887 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:54.942 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:55.013 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:55.043 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:55.477 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:24:55.478 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:24:55.481 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:24:55.481 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T18:24:55.953 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:55.982 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:56.302 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T18:24:56.331 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T18:24:56.830 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:56.834 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:57.043 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:24:57.043 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:24:57.054 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:24:57.054 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T18:24:57.524 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:57.544 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:57.745 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:24:57.745 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:24:57.759 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:24:57.759 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T18:24:58.245 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:58.275 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:58.523 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:24:58.523 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:24:58.533 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:24:58.533 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T18:24:59.014 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:59.018 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:59.123 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:59.127 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:59.249 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:59.279 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:59.459 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:24:59.459 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:24:59.488 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:24:59.488 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T18:24:59.942 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:24:59.955 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:25:00.076 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:25:00.097 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:25:00.202 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:25:00.224 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:25:00.362 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:25:00.375 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T18:25:00.723 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:25:00.728 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:25:00.820 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:25:00.832 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:25:00.964 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:25:00.985 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:25:02.036 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:25:02.091 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T18:25:02.674 INFO:teuthology.orchestra.run.smithi111.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:25:02.677 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T18:25:02.732 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T18:25:02.749 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:25:02.752 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T18:25:02.807 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-12T18:25:02.948 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-09-12T18:25:02.949 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-09-12T18:25:03.017 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-12T18:25:03.018 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-12T18:25:03.150 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:25:03.150 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:25:03.150 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:25:03.150 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:25:03.151 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:25:03.151 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:25:03.151 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:25:03.152 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-09-12T18:25:03.152 INFO:teuthology.orchestra.run.smithi111.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T18:25:03.152 INFO:teuthology.orchestra.run.smithi111.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T18:25:03.153 INFO:teuthology.orchestra.run.smithi111.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T18:25:03.153 INFO:teuthology.orchestra.run.smithi111.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T18:25:03.153 INFO:teuthology.orchestra.run.smithi111.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T18:25:03.153 INFO:teuthology.orchestra.run.smithi111.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T18:25:03.153 INFO:teuthology.orchestra.run.smithi111.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T18:25:03.153 INFO:teuthology.orchestra.run.smithi111.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T18:25:03.153 INFO:teuthology.orchestra.run.smithi111.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T18:25:03.153 INFO:teuthology.orchestra.run.smithi111.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T18:25:03.153 INFO:teuthology.orchestra.run.smithi111.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T18:25:03.154 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-09-12T18:25:03.154 INFO:teuthology.orchestra.run.smithi111.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T18:25:03.154 INFO:teuthology.orchestra.run.smithi111.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T18:25:03.155 INFO:teuthology.orchestra.run.smithi111.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T18:25:03.155 INFO:teuthology.orchestra.run.smithi111.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T18:25:03.155 INFO:teuthology.orchestra.run.smithi111.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T18:25:03.197 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-09-12T18:25:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T18:25:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T18:25:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T18:25:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T18:25:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T18:25:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T18:25:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T18:25:03.198 INFO:teuthology.orchestra.run.smithi111.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T18:25:03.198 INFO:teuthology.orchestra.run.smithi111.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T18:25:03.198 INFO:teuthology.orchestra.run.smithi111.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T18:25:03.198 INFO:teuthology.orchestra.run.smithi111.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T18:25:03.198 INFO:teuthology.orchestra.run.smithi111.stdout: s3cmd 2024-09-12T18:25:03.204 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:25:03.205 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:25:03.205 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:25:03.205 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:25:03.206 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:25:03.207 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:25:03.207 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:25:03.207 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-12T18:25:03.207 INFO:teuthology.orchestra.run.smithi153.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T18:25:03.207 INFO:teuthology.orchestra.run.smithi153.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T18:25:03.207 INFO:teuthology.orchestra.run.smithi153.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T18:25:03.207 INFO:teuthology.orchestra.run.smithi153.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T18:25:03.207 INFO:teuthology.orchestra.run.smithi153.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T18:25:03.207 INFO:teuthology.orchestra.run.smithi153.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T18:25:03.207 INFO:teuthology.orchestra.run.smithi153.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T18:25:03.207 INFO:teuthology.orchestra.run.smithi153.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T18:25:03.207 INFO:teuthology.orchestra.run.smithi153.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T18:25:03.208 INFO:teuthology.orchestra.run.smithi153.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T18:25:03.208 INFO:teuthology.orchestra.run.smithi153.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T18:25:03.208 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-12T18:25:03.208 INFO:teuthology.orchestra.run.smithi153.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T18:25:03.208 INFO:teuthology.orchestra.run.smithi153.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T18:25:03.209 INFO:teuthology.orchestra.run.smithi153.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T18:25:03.209 INFO:teuthology.orchestra.run.smithi153.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T18:25:03.209 INFO:teuthology.orchestra.run.smithi153.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T18:25:03.247 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-12T18:25:03.247 INFO:teuthology.orchestra.run.smithi153.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T18:25:03.247 INFO:teuthology.orchestra.run.smithi153.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T18:25:03.247 INFO:teuthology.orchestra.run.smithi153.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T18:25:03.247 INFO:teuthology.orchestra.run.smithi153.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T18:25:03.247 INFO:teuthology.orchestra.run.smithi153.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T18:25:03.247 INFO:teuthology.orchestra.run.smithi153.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T18:25:03.247 INFO:teuthology.orchestra.run.smithi153.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T18:25:03.247 INFO:teuthology.orchestra.run.smithi153.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T18:25:03.248 INFO:teuthology.orchestra.run.smithi153.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T18:25:03.248 INFO:teuthology.orchestra.run.smithi153.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T18:25:03.248 INFO:teuthology.orchestra.run.smithi153.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T18:25:03.248 INFO:teuthology.orchestra.run.smithi153.stdout: s3cmd 2024-09-12T18:25:03.251 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:25:03.252 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 10.4 MB of archives. 2024-09-12T18:25:03.252 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T18:25:03.252 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T18:25:03.269 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T18:25:03.270 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T18:25:03.273 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T18:25:03.301 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:25:03.301 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 10.4 MB of archives. 2024-09-12T18:25:03.301 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T18:25:03.301 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T18:25:03.307 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T18:25:03.317 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T18:25:03.317 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T18:25:03.320 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T18:25:03.322 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T18:25:03.324 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T18:25:03.353 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T18:25:03.354 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T18:25:03.369 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T18:25:03.370 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T18:25:03.373 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T18:25:03.373 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T18:25:03.374 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T18:25:03.399 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T18:25:03.419 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T18:25:03.420 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T18:25:03.421 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T18:25:03.423 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T18:25:03.424 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T18:25:03.441 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T18:25:03.441 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T18:25:03.441 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T18:25:03.442 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T18:25:03.443 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T18:25:03.446 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T18:25:03.446 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T18:25:03.452 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T18:25:03.460 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T18:25:03.460 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T18:25:03.461 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T18:25:03.461 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T18:25:03.466 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T18:25:03.466 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T18:25:03.477 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T18:25:03.477 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T18:25:03.479 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T18:25:03.483 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T18:25:03.484 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T18:25:03.484 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T18:25:03.484 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T18:25:03.485 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T18:25:03.485 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T18:25:03.486 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T18:25:03.489 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T18:25:03.489 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T18:25:03.495 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T18:25:03.499 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T18:25:03.500 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T18:25:03.502 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T18:25:03.502 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T18:25:03.514 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T18:25:03.515 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T18:25:03.515 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T18:25:03.516 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T18:25:03.517 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T18:25:03.517 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T18:25:03.517 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T18:25:03.520 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T18:25:03.521 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T18:25:03.522 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T18:25:03.536 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T18:25:03.536 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T18:25:03.553 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T18:25:03.553 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T18:25:03.554 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T18:25:03.939 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 10.4 MB in 0s (34.7 MB/s) 2024-09-12T18:25:03.956 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 10.4 MB in 0s (33.5 MB/s) 2024-09-12T18:25:04.021 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T18:25:04.049 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T18:25:04.090 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T18:25:04.096 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T18:25:04.110 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T18:25:04.116 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T18:25:04.137 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T18:25:04.166 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T18:25:04.373 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T18:25:04.389 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T18:25:04.426 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T18:25:04.431 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T18:25:04.454 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T18:25:04.493 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T18:25:04.700 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T18:25:04.728 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T18:25:04.745 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T18:25:04.762 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T18:25:04.767 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T18:25:04.796 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T18:25:05.011 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T18:25:05.028 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T18:25:05.048 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T18:25:05.061 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T18:25:05.064 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T18:25:05.107 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T18:25:05.297 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T18:25:05.313 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T18:25:05.355 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T18:25:05.368 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T18:25:05.384 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T18:25:05.426 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T18:25:05.633 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T18:25:05.649 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T18:25:05.691 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T18:25:05.771 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T18:25:05.799 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T18:25:05.944 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T18:25:05.973 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T18:25:06.010 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T18:25:06.181 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T18:25:06.279 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T18:25:06.307 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T18:25:06.346 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T18:25:06.533 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T18:25:06.549 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T18:25:06.591 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T18:25:06.598 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T18:25:06.615 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T18:25:06.657 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T18:25:06.844 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T18:25:06.860 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T18:25:06.902 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T18:25:06.909 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T18:25:06.937 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T18:25:06.976 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T18:25:07.229 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libguava-java. 2024-09-12T18:25:07.245 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T18:25:07.271 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T18:25:07.287 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T18:25:07.288 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T18:25:07.321 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T18:25:07.574 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T18:25:07.602 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T18:25:07.641 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T18:25:07.673 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T18:25:07.690 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T18:25:07.731 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T18:25:07.877 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libguava-java. 2024-09-12T18:25:07.893 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T18:25:07.935 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T18:25:08.019 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libguice-java. 2024-09-12T18:25:08.047 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T18:25:08.101 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T18:25:08.354 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T18:25:08.371 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T18:25:08.413 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T18:25:08.505 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T18:25:08.533 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T18:25:08.572 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T18:25:08.640 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libguice-java. 2024-09-12T18:25:08.668 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T18:25:08.716 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T18:25:08.816 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T18:25:08.832 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T18:25:08.866 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T18:25:09.111 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T18:25:09.119 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T18:25:09.136 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T18:25:09.139 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T18:25:09.177 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T18:25:09.178 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T18:25:09.397 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T18:25:09.414 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T18:25:09.429 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T18:25:09.455 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T18:25:09.460 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T18:25:09.496 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T18:25:09.710 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T18:25:09.726 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T18:25:09.748 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T18:25:09.768 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T18:25:09.776 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T18:25:09.815 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T18:25:10.021 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T18:25:10.037 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T18:25:10.073 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T18:25:10.092 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T18:25:10.121 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T18:25:10.159 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T18:25:10.331 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T18:25:10.348 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T18:25:10.379 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T18:25:10.390 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T18:25:10.395 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T18:25:10.437 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T18:25:10.667 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T18:25:10.695 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T18:25:10.732 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T18:25:10.743 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T18:25:10.748 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T18:25:10.790 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T18:25:10.995 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T18:25:11.011 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T18:25:11.045 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T18:25:11.060 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T18:25:11.076 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T18:25:11.118 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T18:25:11.362 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T18:25:11.378 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T18:25:11.412 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T18:25:11.434 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T18:25:11.463 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T18:25:11.509 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T18:25:11.640 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T18:25:11.668 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T18:25:11.706 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T18:25:11.770 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T18:25:11.787 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T18:25:11.828 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T18:25:11.950 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T18:25:11.967 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T18:25:12.009 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T18:25:12.064 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T18:25:12.081 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T18:25:12.114 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T18:25:12.270 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T18:25:12.286 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T18:25:12.328 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T18:25:12.333 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T18:25:12.347 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T18:25:12.392 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T18:25:12.597 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T18:25:12.625 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T18:25:12.644 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T18:25:12.661 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T18:25:12.663 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T18:25:12.703 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T18:25:12.934 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T18:25:12.950 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T18:25:12.963 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T18:25:12.980 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T18:25:12.992 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T18:25:13.022 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T18:25:13.232 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T18:25:13.249 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T18:25:13.282 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T18:25:13.347 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T18:25:13.375 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T18:25:13.413 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T18:25:13.578 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T18:25:13.595 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T18:25:13.637 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T18:25:13.716 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T18:25:13.732 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T18:25:13.774 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T18:25:13.906 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T18:25:13.922 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T18:25:13.956 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T18:25:14.120 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T18:25:14.137 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T18:25:14.179 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T18:25:14.217 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T18:25:14.245 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T18:25:14.283 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T18:25:14.397 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T18:25:14.414 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T18:25:14.456 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T18:25:14.663 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T18:25:14.679 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T18:25:14.721 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T18:25:14.925 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package maven. 2024-09-12T18:25:14.953 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T18:25:14.974 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T18:25:14.992 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T18:25:15.002 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T18:25:15.040 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T18:25:15.295 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-magic. 2024-09-12T18:25:15.323 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T18:25:15.362 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T18:25:15.535 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package maven. 2024-09-12T18:25:15.563 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T18:25:15.602 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T18:25:15.639 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package s3cmd. 2024-09-12T18:25:15.668 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T18:25:15.706 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T18:25:15.888 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-magic. 2024-09-12T18:25:15.917 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T18:25:15.955 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T18:25:16.060 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T18:25:16.211 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T18:25:16.257 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package s3cmd. 2024-09-12T18:25:16.286 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T18:25:16.324 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T18:25:16.337 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T18:25:16.463 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T18:25:16.572 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T18:25:16.673 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T18:25:16.745 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T18:25:16.791 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T18:25:16.847 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T18:25:16.917 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T18:25:16.973 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T18:25:17.043 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T18:25:17.099 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T18:25:17.169 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T18:25:17.225 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T18:25:17.295 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T18:25:17.351 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T18:25:17.421 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T18:25:17.477 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T18:25:17.547 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T18:25:17.603 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T18:25:17.648 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T18:25:17.724 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T18:25:17.749 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T18:25:17.838 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T18:25:17.866 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T18:25:17.956 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T18:25:18.073 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T18:25:18.126 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T18:25:18.183 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T18:25:18.252 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T18:25:18.309 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T18:25:18.378 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T18:25:18.443 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T18:25:18.504 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T18:25:18.569 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T18:25:18.630 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T18:25:18.837 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T18:25:18.963 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T18:25:19.079 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T18:25:19.089 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T18:25:19.207 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T18:25:19.308 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T18:25:19.326 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T18:25:19.434 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T18:25:19.568 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T18:25:19.619 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T18:25:19.770 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T18:25:19.861 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T18:25:19.896 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T18:25:19.987 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T18:25:20.113 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T18:25:20.214 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T18:25:20.239 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T18:25:20.315 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T18:25:20.365 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T18:25:20.416 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T18:25:20.491 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T18:25:20.558 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T18:25:20.617 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T18:25:20.684 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T18:25:20.727 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T18:25:20.819 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T18:25:20.836 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T18:25:20.945 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T18:25:20.962 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T18:25:21.071 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T18:25:21.096 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T18:25:21.197 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T18:25:21.222 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T18:25:21.430 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T18:25:21.479 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T18:25:21.501 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:25:21.595 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:25:22.757 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:25:22.763 DEBUG:teuthology.parallel:result is None 2024-09-12T18:25:23.019 INFO:teuthology.orchestra.run.smithi111.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T18:25:23.023 DEBUG:teuthology.parallel:result is None 2024-09-12T18:25:23.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T18:25:23.165 DEBUG:teuthology.orchestra.run.smithi111:> dpkg-query -W -f '${Version}' ceph 2024-09-12T18:25:23.180 INFO:teuthology.orchestra.run.smithi111.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T18:25:23.181 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T18:25:23.181 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T18:25:23.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T18:25:23.322 DEBUG:teuthology.orchestra.run.smithi153:> dpkg-query -W -f '${Version}' ceph 2024-09-12T18:25:23.342 INFO:teuthology.orchestra.run.smithi153.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T18:25:23.342 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T18:25:23.342 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T18:25:23.344 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T18:25:23.344 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:23.344 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T18:25:23.359 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:25:23.359 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T18:25:23.400 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T18:25:23.400 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:23.401 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T18:25:23.415 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T18:25:23.470 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:25:23.471 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T18:25:23.485 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T18:25:23.541 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T18:25:23.542 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:23.542 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T18:25:23.554 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T18:25:23.609 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:25:23.609 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T18:25:23.622 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T18:25:23.678 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T18:25:23.678 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:23.678 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T18:25:23.692 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T18:25:23.745 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:25:23.746 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T18:25:23.758 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T18:25:23.813 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T18:25:23.908 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T18:25:23.909 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /var/log/ceph 2024-09-12T18:25:23.911 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-09-12T18:25:23.925 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T18:25:23.925 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T18:25:23.967 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T18:25:23.980 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T18:25:23.980 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T18:25:24.023 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T18:25:24.048 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T18:25:24.048 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T18:25:24.048 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7902784', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7902784', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0'}, 'compression type': 'random', 'ec-data-pool': False, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cls-rgw-busy-resharding', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cls-rgw-busy-resharding', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_d011c522bb171e70fc5782f1e7a71ce5f37e573f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'targets': {'smithi111.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIzTqTXaDAPVnxhab6097CPZ7SFbaZu+LRFHdwYcgxQIN2CvVfZwYcb/85p3g78N5LmgMdegBI2yCJEXj/1VmB8=', 'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFIYL11/SXNYkMIlaUaXYwXuJaPpF3rXv/fcgKAD4u8ueezYP2WSY55P/vS5+8X2KLomTzivQq3T3ddzUgbcONg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_18:03:08', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T18:25:24.049 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T18:25:24.079 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T18:25:24.085 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:25:24.127 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T18:25:24.141 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:24.141 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T18:25:24.186 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T18:25:24.186 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2024-09-12T18:25:24.234 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T18:25:24.234 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:25:24.234 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 877 Links: 1 2024-09-12T18:25:24.234 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:25:24.234 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-12 18:19:43.471267514 +0000 2024-09-12T18:25:24.234 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-12 18:19:43.235269623 +0000 2024-09-12T18:25:24.235 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-12 18:19:43.235269623 +0000 2024-09-12T18:25:24.235 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-09-12T18:25:24.235 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T18:25:24.288 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-12T18:25:24.288 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-12T18:25:24.288 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000450843 s, 1.1 MB/s 2024-09-12T18:25:24.290 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T18:25:24.339 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2024-09-12T18:25:24.387 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T18:25:24.387 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:25:24.387 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-09-12T18:25:24.387 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:25:24.387 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-12 18:19:43.927263441 +0000 2024-09-12T18:25:24.387 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-12 18:19:43.683265620 +0000 2024-09-12T18:25:24.387 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-12 18:19:43.683265620 +0000 2024-09-12T18:25:24.387 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-09-12T18:25:24.388 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T18:25:24.440 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-12T18:25:24.440 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-12T18:25:24.440 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000308337 s, 1.7 MB/s 2024-09-12T18:25:24.441 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T18:25:24.491 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2024-09-12T18:25:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T18:25:24.538 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:25:24.538 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-09-12T18:25:24.538 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:25:24.538 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-12 18:19:44.155261405 +0000 2024-09-12T18:25:24.538 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-12 18:19:44.151261440 +0000 2024-09-12T18:25:24.539 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-12 18:19:44.151261440 +0000 2024-09-12T18:25:24.539 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-09-12T18:25:24.539 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T18:25:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-12T18:25:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-12T18:25:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000433223 s, 1.2 MB/s 2024-09-12T18:25:24.593 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T18:25:24.643 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2024-09-12T18:25:24.690 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T18:25:24.690 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:25:24.690 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 924 Links: 1 2024-09-12T18:25:24.690 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:25:24.690 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-12 18:19:44.911254653 +0000 2024-09-12T18:25:24.690 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-12 18:19:44.655256939 +0000 2024-09-12T18:25:24.691 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-12 18:19:44.655256939 +0000 2024-09-12T18:25:24.691 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-09-12T18:25:24.691 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T18:25:24.744 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-12T18:25:24.744 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-12T18:25:24.744 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000329166 s, 1.6 MB/s 2024-09-12T18:25:24.745 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T18:25:24.795 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T18:25:24.796 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:25:24.796 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T18:25:24.802 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T18:25:24.802 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-09-12T18:25:24.850 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T18:25:24.851 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:25:24.851 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 878 Links: 1 2024-09-12T18:25:24.851 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:25:24.851 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 18:19:40.903046889 +0000 2024-09-12T18:25:24.851 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 18:19:40.639068254 +0000 2024-09-12T18:25:24.851 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 18:19:40.639068254 +0000 2024-09-12T18:25:24.851 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-12T18:25:24.851 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T18:25:24.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T18:25:24.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T18:25:24.905 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000380217 s, 1.3 MB/s 2024-09-12T18:25:24.906 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T18:25:24.955 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-09-12T18:25:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T18:25:25.001 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:25:25.002 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-09-12T18:25:25.002 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:25:25.002 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 18:19:41.411006583 +0000 2024-09-12T18:25:25.002 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 18:19:41.135028369 +0000 2024-09-12T18:25:25.002 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 18:19:41.135028369 +0000 2024-09-12T18:25:25.002 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-12T18:25:25.002 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T18:25:25.055 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T18:25:25.056 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T18:25:25.056 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000351015 s, 1.5 MB/s 2024-09-12T18:25:25.057 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T18:25:25.106 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-09-12T18:25:25.153 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T18:25:25.153 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:25:25.154 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-09-12T18:25:25.154 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:25:25.154 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 18:19:41.650987640 +0000 2024-09-12T18:25:25.154 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 18:19:41.646987955 +0000 2024-09-12T18:25:25.154 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 18:19:41.646987955 +0000 2024-09-12T18:25:25.154 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-12T18:25:25.154 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T18:25:25.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T18:25:25.208 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T18:25:25.208 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000416709 s, 1.2 MB/s 2024-09-12T18:25:25.209 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T18:25:25.259 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-09-12T18:25:25.305 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T18:25:25.305 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T18:25:25.305 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-09-12T18:25:25.306 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T18:25:25.306 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 18:19:42.390930384 +0000 2024-09-12T18:25:25.306 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 18:19:42.146948912 +0000 2024-09-12T18:25:25.306 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 18:19:42.146948912 +0000 2024-09-12T18:25:25.306 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-12T18:25:25.306 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T18:25:25.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T18:25:25.360 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T18:25:25.360 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000386526 s, 1.3 MB/s 2024-09-12T18:25:25.361 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T18:25:25.410 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T18:25:25.410 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T18:25:25.411 INFO:tasks.ceph:Generating config... 2024-09-12T18:25:25.412 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T18:25:25.412 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T18:25:25.412 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T18:25:25.412 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T18:25:25.412 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T18:25:25.412 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T18:25:25.412 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T18:25:25.412 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T18:25:25.412 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T18:25:25.412 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T18:25:25.413 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T18:25:25.413 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T18:25:25.413 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T18:25:25.413 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T18:25:25.413 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T18:25:25.413 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T18:25:25.413 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T18:25:25.413 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T18:25:25.413 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T18:25:25.413 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T18:25:25.413 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T18:25:25.413 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T18:25:25.413 INFO:tasks.ceph:[mon] lockdep = True 2024-09-12T18:25:25.413 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] lockdep = True 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T18:25:25.414 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T18:25:25.415 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T18:25:25.415 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T18:25:25.415 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T18:25:25.415 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T18:25:25.450 INFO:teuthology.orchestra.run.smithi111.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T18:25:25.464 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T18:25:25.540 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:25:25.594 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.111'), ('mon.c', '[v2:172.21.15.111:3301,v1:172.21.15.111:6790]'), ('mon.b', '172.21.15.153')] 2024-09-12T18:25:25.594 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790],172.21.15.153', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T18:25:25.596 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:25.596 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T18:25:25.642 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.111 --addv c '[v2:172.21.15.111:3301,v1:172.21.15.111:6790]' --add b 172.21.15.153 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:25:25.729 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:25:25.729 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:25:25.729 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:25:25.730 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: generated fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:25:25.730 INFO:teuthology.orchestra.run.smithi111.stdout:setting min_mon_release = quincy 2024-09-12T18:25:25.730 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 0 2024-09-12T18:25:25.730 INFO:teuthology.orchestra.run.smithi111.stdout:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:25:25.730 INFO:teuthology.orchestra.run.smithi111.stdout:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:25:25.730 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:25:25.730 INFO:teuthology.orchestra.run.smithi111.stdout:min_mon_release 17 (quincy) 2024-09-12T18:25:25.730 INFO:teuthology.orchestra.run.smithi111.stdout:election_strategy: 1 2024-09-12T18:25:25.730 INFO:teuthology.orchestra.run.smithi111.stdout:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:25:25.730 INFO:teuthology.orchestra.run.smithi111.stdout:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:25:25.730 INFO:teuthology.orchestra.run.smithi111.stdout:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:25:25.730 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T18:25:25.732 DEBUG:teuthology.orchestra.run.smithi111:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T18:25:25.780 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2cc18cb2-6afc-4366-93a9-b1f579cd792f... 2024-09-12T18:25:25.781 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T18:25:25.823 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T18:25:25.852 INFO:teuthology.orchestra.run.smithi111.stdout:[global] 2024-09-12T18:25:25.852 INFO:teuthology.orchestra.run.smithi111.stdout: chdir = "" 2024-09-12T18:25:25.852 INFO:teuthology.orchestra.run.smithi111.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T18:25:25.852 INFO:teuthology.orchestra.run.smithi111.stdout: auth supported = cephx 2024-09-12T18:25:25.852 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.852 INFO:teuthology.orchestra.run.smithi111.stdout: filestore xattr use omap = true 2024-09-12T18:25:25.853 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.853 INFO:teuthology.orchestra.run.smithi111.stdout: mon clock drift allowed = 1.000 2024-09-12T18:25:25.853 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.853 INFO:teuthology.orchestra.run.smithi111.stdout: osd crush chooseleaf type = 0 2024-09-12T18:25:25.853 INFO:teuthology.orchestra.run.smithi111.stdout: auth debug = true 2024-09-12T18:25:25.853 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.853 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on old message = true 2024-09-12T18:25:25.853 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on bug = true 2024-09-12T18:25:25.853 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.853 INFO:teuthology.orchestra.run.smithi111.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T18:25:25.853 INFO:teuthology.orchestra.run.smithi111.stdout: mon pg warn max object skew = 0 2024-09-12T18:25:25.853 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.853 INFO:teuthology.orchestra.run.smithi111.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T18:25:25.854 INFO:teuthology.orchestra.run.smithi111.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T18:25:25.854 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.854 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default size = 2 2024-09-12T18:25:25.854 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.854 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow primary affinity = true 2024-09-12T18:25:25.854 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow pg remap = true 2024-09-12T18:25:25.854 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on legacy crush tunables = false 2024-09-12T18:25:25.854 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on crush straw calc version zero = false 2024-09-12T18:25:25.854 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on no sortbitwise = false 2024-09-12T18:25:25.854 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on osd down out interval zero = false 2024-09-12T18:25:25.854 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on too few osds = false 2024-09-12T18:25:25.854 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T18:25:25.854 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T18:25:25.855 INFO:teuthology.orchestra.run.smithi111.stdout: mon_allow_pool_size_one = true 2024-09-12T18:25:25.855 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.855 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T18:25:25.856 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.856 INFO:teuthology.orchestra.run.smithi111.stdout: osd default data pool replay window = 5 2024-09-12T18:25:25.856 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.856 INFO:teuthology.orchestra.run.smithi111.stdout: mon allow pool delete = true 2024-09-12T18:25:25.856 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.856 INFO:teuthology.orchestra.run.smithi111.stdout: mon cluster log file level = debug 2024-09-12T18:25:25.856 INFO:teuthology.orchestra.run.smithi111.stdout: debug asserts on shutdown = true 2024-09-12T18:25:25.856 INFO:teuthology.orchestra.run.smithi111.stdout: mon health detail to clog = false 2024-09-12T18:25:25.856 INFO:teuthology.orchestra.run.smithi111.stdout: mon host = "172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790],172.21.15.153" 2024-09-12T18:25:25.856 INFO:teuthology.orchestra.run.smithi111.stdout: mon client directed command retry = 5 2024-09-12T18:25:25.856 INFO:teuthology.orchestra.run.smithi111.stdout: ms inject socket failures = 5000 2024-09-12T18:25:25.857 INFO:teuthology.orchestra.run.smithi111.stdout: osd_max_pg_log_entries = 10 2024-09-12T18:25:25.857 INFO:teuthology.orchestra.run.smithi111.stdout: osd_min_pg_log_entries = 10 2024-09-12T18:25:25.857 INFO:teuthology.orchestra.run.smithi111.stdout: fsid = 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:25:25.857 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.857 INFO:teuthology.orchestra.run.smithi111.stdout:[osd] 2024-09-12T18:25:25.857 INFO:teuthology.orchestra.run.smithi111.stdout: osd journal size = 100 2024-09-12T18:25:25.857 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.857 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub load threshold = 5.0 2024-09-12T18:25:25.857 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub max interval = 600 2024-09-12T18:25:25.857 INFO:teuthology.orchestra.run.smithi111.stdout: osd mclock profile = high_recovery_ops 2024-09-12T18:25:25.857 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.857 INFO:teuthology.orchestra.run.smithi111.stdout: osd recover clone overlap = true 2024-09-12T18:25:25.857 INFO:teuthology.orchestra.run.smithi111.stdout: osd recovery max chunk = 1048576 2024-09-12T18:25:25.858 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.858 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug shutdown = true 2024-09-12T18:25:25.858 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug op order = true 2024-09-12T18:25:25.858 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug verify stray on activate = true 2024-09-12T18:25:25.858 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug trim objects = true 2024-09-12T18:25:25.858 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.858 INFO:teuthology.orchestra.run.smithi111.stdout: osd open classes on start = true 2024-09-12T18:25:25.858 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug pg log writeout = true 2024-09-12T18:25:25.858 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.858 INFO:teuthology.orchestra.run.smithi111.stdout: osd deep scrub update digest min age = 30 2024-09-12T18:25:25.858 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.858 INFO:teuthology.orchestra.run.smithi111.stdout: osd map max advance = 10 2024-09-12T18:25:25.858 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.859 INFO:teuthology.orchestra.run.smithi111.stdout: journal zero on create = true 2024-09-12T18:25:25.859 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.859 INFO:teuthology.orchestra.run.smithi111.stdout: filestore ondisk finisher threads = 3 2024-09-12T18:25:25.859 INFO:teuthology.orchestra.run.smithi111.stdout: filestore apply finisher threads = 3 2024-09-12T18:25:25.859 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.859 INFO:teuthology.orchestra.run.smithi111.stdout: bdev debug aio = true 2024-09-12T18:25:25.859 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug misdirected ops = true 2024-09-12T18:25:25.859 INFO:teuthology.orchestra.run.smithi111.stdout: bdev async discard = True 2024-09-12T18:25:25.859 INFO:teuthology.orchestra.run.smithi111.stdout: bdev enable discard = True 2024-09-12T18:25:25.859 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore allocator = bitmap 2024-09-12T18:25:25.859 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore block size = 96636764160 2024-09-12T18:25:25.859 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore fsck on mount = True 2024-09-12T18:25:25.859 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluefs = 1/20 2024-09-12T18:25:25.859 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluestore = 1/20 2024-09-12T18:25:25.860 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-09-12T18:25:25.860 INFO:teuthology.orchestra.run.smithi111.stdout: debug objclass = 20 2024-09-12T18:25:25.860 INFO:teuthology.orchestra.run.smithi111.stdout: debug osd = 20 2024-09-12T18:25:25.860 INFO:teuthology.orchestra.run.smithi111.stdout: debug rocksdb = 4/10 2024-09-12T18:25:25.860 INFO:teuthology.orchestra.run.smithi111.stdout: lockdep = True 2024-09-12T18:25:25.860 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T18:25:25.860 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd full ratio = 0.9 2024-09-12T18:25:25.860 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd nearfull ratio = 0.8 2024-09-12T18:25:25.860 INFO:teuthology.orchestra.run.smithi111.stdout: osd failsafe full ratio = 0.95 2024-09-12T18:25:25.860 INFO:teuthology.orchestra.run.smithi111.stdout: osd objectstore = bluestore 2024-09-12T18:25:25.860 INFO:teuthology.orchestra.run.smithi111.stdout: osd shutdown pgref assert = True 2024-09-12T18:25:25.861 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.861 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr] 2024-09-12T18:25:25.861 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-09-12T18:25:25.861 INFO:teuthology.orchestra.run.smithi111.stdout: debug mgr = 20 2024-09-12T18:25:25.861 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-09-12T18:25:25.861 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-09-12T18:25:25.861 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:25:25.861 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:25:25.861 INFO:teuthology.orchestra.run.smithi111.stdout: mgr/telemetry/nag = false 2024-09-12T18:25:25.861 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.861 INFO:teuthology.orchestra.run.smithi111.stdout:[mon] 2024-09-12T18:25:25.861 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-09-12T18:25:25.861 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-09-12T18:25:25.861 INFO:teuthology.orchestra.run.smithi111.stdout: debug paxos = 20 2024-09-12T18:25:25.862 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-09-12T18:25:25.862 INFO:teuthology.orchestra.run.smithi111.stdout: mon data avail warn = 5 2024-09-12T18:25:25.862 INFO:teuthology.orchestra.run.smithi111.stdout: mon mgr mkfs grace = 240 2024-09-12T18:25:25.862 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:25:25.862 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd reporter subtree level = osd 2024-09-12T18:25:25.862 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd prime pg temp = true 2024-09-12T18:25:25.862 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:25:25.862 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.862 INFO:teuthology.orchestra.run.smithi111.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T18:25:25.862 INFO:teuthology.orchestra.run.smithi111.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T18:25:25.862 INFO:teuthology.orchestra.run.smithi111.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T18:25:25.862 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.863 INFO:teuthology.orchestra.run.smithi111.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T18:25:25.863 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T18:25:25.863 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T18:25:25.863 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.863 INFO:teuthology.orchestra.run.smithi111.stdout: # 1m isn't quite enough 2024-09-12T18:25:25.863 INFO:teuthology.orchestra.run.smithi111.stdout: mon_down_mkfs_grace = 2m 2024-09-12T18:25:25.863 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.863 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_filestore_osds = false 2024-09-12T18:25:25.863 INFO:teuthology.orchestra.run.smithi111.stdout: lockdep = True 2024-09-12T18:25:25.863 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:25:25.863 INFO:teuthology.orchestra.run.smithi111.stdout:[client] 2024-09-12T18:25:25.863 INFO:teuthology.orchestra.run.smithi111.stdout: rgw cache enabled = true 2024-09-12T18:25:25.863 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable ops log = true 2024-09-12T18:25:25.864 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable usage log = true 2024-09-12T18:25:25.864 INFO:teuthology.orchestra.run.smithi111.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T18:25:25.864 INFO:teuthology.orchestra.run.smithi111.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T18:25:25.864 INFO:teuthology.orchestra.run.smithi111.stdout: debug rgw = 20 2024-09-12T18:25:25.864 INFO:teuthology.orchestra.run.smithi111.stdout: debug rgw notification = 20 2024-09-12T18:25:25.864 INFO:teuthology.orchestra.run.smithi111.stdout: rgw bucket counters cache = True 2024-09-12T18:25:25.864 INFO:teuthology.orchestra.run.smithi111.stdout: rgw crypt require ssl = False 2024-09-12T18:25:25.864 INFO:teuthology.orchestra.run.smithi111.stdout: rgw crypt s3 kms backend = testing 2024-09-12T18:25:25.864 INFO:teuthology.orchestra.run.smithi111.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T18:25:25.864 INFO:teuthology.orchestra.run.smithi111.stdout: rgw reshard progress judge interval = 10 2024-09-12T18:25:25.864 INFO:teuthology.orchestra.run.smithi111.stdout: rgw s3 auth use sts = True 2024-09-12T18:25:25.864 INFO:teuthology.orchestra.run.smithi111.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T18:25:25.864 INFO:teuthology.orchestra.run.smithi111.stdout: rgw torrent flag = True 2024-09-12T18:25:25.865 INFO:teuthology.orchestra.run.smithi111.stdout: rgw user counters cache = True 2024-09-12T18:25:25.865 INFO:teuthology.orchestra.run.smithi111.stdout: setgroup = ceph 2024-09-12T18:25:25.865 INFO:teuthology.orchestra.run.smithi111.stdout: setuser = ceph 2024-09-12T18:25:25.865 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.a] 2024-09-12T18:25:25.865 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.c] 2024-09-12T18:25:25.865 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.b] 2024-09-12T18:25:25.866 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-09-12T18:25:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-09-12T18:25:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T18:25:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-09-12T18:25:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-09-12T18:25:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-09-12T18:25:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-09-12T18:25:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-09-12T18:25:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.867 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-09-12T18:25:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-09-12T18:25:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T18:25:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-09-12T18:25:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T18:25:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T18:25:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-09-12T18:25:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-09-12T18:25:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-09-12T18:25:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-09-12T18:25:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-09-12T18:25:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-09-12T18:25:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-09-12T18:25:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-09-12T18:25:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T18:25:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T18:25:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-09-12T18:25:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T18:25:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-09-12T18:25:25.869 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-09-12T18:25:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-09-12T18:25:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-09-12T18:25:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-09-12T18:25:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790],172.21.15.153" 2024-09-12T18:25:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: mon client directed command retry = 5 2024-09-12T18:25:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: ms inject socket failures = 5000 2024-09-12T18:25:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: osd_max_pg_log_entries = 10 2024-09-12T18:25:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: osd_min_pg_log_entries = 10 2024-09-12T18:25:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:25:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.870 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-09-12T18:25:25.870 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-09-12T18:25:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-09-12T18:25:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-09-12T18:25:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-09-12T18:25:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-09-12T18:25:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-09-12T18:25:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-09-12T18:25:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-09-12T18:25:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-09-12T18:25:25.871 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-09-12T18:25:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-09-12T18:25:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-09-12T18:25:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-09-12T18:25:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-09-12T18:25:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-09-12T18:25:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-09-12T18:25:25.872 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-09-12T18:25:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-09-12T18:25:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-09-12T18:25:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2024-09-12T18:25:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2024-09-12T18:25:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2024-09-12T18:25:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-09-12T18:25:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-09-12T18:25:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2024-09-12T18:25:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2024-09-12T18:25:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-12T18:25:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: debug objclass = 20 2024-09-12T18:25:25.873 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-09-12T18:25:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2024-09-12T18:25:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: lockdep = True 2024-09-12T18:25:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T18:25:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-09-12T18:25:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-09-12T18:25:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-09-12T18:25:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-09-12T18:25:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: osd shutdown pgref assert = True 2024-09-12T18:25:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.874 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-09-12T18:25:25.874 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-12T18:25:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-09-12T18:25:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-12T18:25:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-12T18:25:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:25:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:25:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-09-12T18:25:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.875 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-09-12T18:25:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-12T18:25:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-12T18:25:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-09-12T18:25:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-12T18:25:25.875 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-09-12T18:25:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-09-12T18:25:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-12T18:25:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-09-12T18:25:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-09-12T18:25:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-12T18:25:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T18:25:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T18:25:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T18:25:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T18:25:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T18:25:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T18:25:25.876 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-09-12T18:25:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-09-12T18:25:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-09-12T18:25:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: lockdep = True 2024-09-12T18:25:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T18:25:25.877 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-09-12T18:25:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-09-12T18:25:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-09-12T18:25:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-09-12T18:25:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T18:25:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T18:25:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: debug rgw = 20 2024-09-12T18:25:25.877 INFO:teuthology.orchestra.run.smithi153.stdout: debug rgw notification = 20 2024-09-12T18:25:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: rgw bucket counters cache = True 2024-09-12T18:25:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: rgw crypt require ssl = False 2024-09-12T18:25:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: rgw crypt s3 kms backend = testing 2024-09-12T18:25:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T18:25:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: rgw reshard progress judge interval = 10 2024-09-12T18:25:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: rgw s3 auth use sts = True 2024-09-12T18:25:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T18:25:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: rgw torrent flag = True 2024-09-12T18:25:25.878 INFO:teuthology.orchestra.run.smithi153.stdout: rgw user counters cache = True 2024-09-12T18:25:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: setgroup = ceph 2024-09-12T18:25:25.879 INFO:teuthology.orchestra.run.smithi153.stdout: setuser = ceph 2024-09-12T18:25:25.879 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-09-12T18:25:25.879 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-09-12T18:25:25.880 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-09-12T18:25:25.880 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T18:25:25.880 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T18:25:25.958 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T18:25:25.958 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:25.958 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T18:25:25.963 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:25.963 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T18:25:26.010 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T18:25:26.011 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:26.011 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T18:25:26.011 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:25:26.073 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:26.074 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:25:26.122 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T18:25:26.122 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:25:26.123 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T18:25:26.123 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T18:25:26.145 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:25:26.145 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:25:26.194 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T18:25:26.194 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T18:25:26.194 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T18:25:26.238 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T18:25:26.241 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T18:25:26.283 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T18:25:26.295 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T18:25:26.295 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T18:25:26.296 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T18:25:26.330 INFO:teuthology.orchestra.run.smithi111.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T18:25:26.341 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T18:25:26.377 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T18:25:26.388 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T18:25:26.388 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T18:25:26.389 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T18:25:26.402 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T18:25:26.402 INFO:tasks.ceph:role: osd.0 2024-09-12T18:25:26.402 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T18:25:26.403 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T18:25:26.466 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:25:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:25:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:25:26.466 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:25:26.467 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:25:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:25:26.467 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:25:26.467 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:25:26.467 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:25:26.467 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:25:26.939 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-09-12T18:25:26.941 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-09-12T18:25:26.942 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T18:25:27.098 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T18:25:27.108 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:25:27.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:25:27.109 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T18:25:27.164 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T18:25:27.164 INFO:tasks.ceph:role: osd.1 2024-09-12T18:25:27.164 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T18:25:27.164 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T18:25:27.225 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:25:27.225 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:25:27.225 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:25:27.225 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:25:27.225 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:25:27.225 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:25:27.225 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:25:27.225 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:25:27.226 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:25:27.226 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:25:27.672 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-09-12T18:25:27.674 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-09-12T18:25:27.674 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T18:25:27.765 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T18:25:27.776 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:25:27.776 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:25:27.776 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T18:25:27.828 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T18:25:27.828 INFO:tasks.ceph:role: osd.2 2024-09-12T18:25:27.828 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T18:25:27.828 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T18:25:27.890 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:25:27.890 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:25:27.890 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:25:27.890 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:25:27.890 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:25:27.891 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:25:27.891 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:25:27.891 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:25:27.891 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:25:27.891 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:25:28.343 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-09-12T18:25:28.345 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-09-12T18:25:28.346 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T18:25:28.458 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T18:25:28.469 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:25:28.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:25:28.470 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T18:25:28.525 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T18:25:28.525 INFO:tasks.ceph:role: osd.3 2024-09-12T18:25:28.525 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T18:25:28.525 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T18:25:28.589 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:25:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:25:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:25:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:25:28.589 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:25:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:25:28.589 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:25:28.589 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:25:28.589 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:25:28.590 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:25:29.079 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-09-12T18:25:29.081 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-09-12T18:25:29.081 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T18:25:29.235 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T18:25:29.246 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:25:29.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:25:29.247 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:25:29.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:29.355+0000 7f725ff807c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T18:25:29.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:29.359+0000 7f725ff807c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T18:25:29.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:29.359+0000 7f725ff807c0 -1 bdev(0x55e754787800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T18:25:29.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:29.359+0000 7f725ff807c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T18:25:32.509 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T18:25:32.523 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:25:32.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:32.603+0000 7fcb891a47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T18:25:32.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:32.603+0000 7fcb891a47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T18:25:32.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:32.603+0000 7fcb891a47c0 -1 bdev(0x55c7b4f77800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T18:25:32.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:32.603+0000 7fcb891a47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T18:25:35.750 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T18:25:35.811 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:25:35.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:35.891+0000 7f41ef9937c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T18:25:35.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:35.891+0000 7f41ef9937c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T18:25:35.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:35.891+0000 7f41ef9937c0 -1 bdev(0x56160d003800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T18:25:35.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:35.891+0000 7f41ef9937c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T18:25:39.066 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T18:25:39.122 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:25:39.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:39.199+0000 7f6c811527c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T18:25:39.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:39.199+0000 7f6c811527c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T18:25:39.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:39.199+0000 7f6c811527c0 -1 bdev(0x56415a587800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T18:25:39.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:25:39.199+0000 7f6c811527c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T18:25:42.354 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T18:25:42.409 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T18:25:42.424 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T18:25:42.424 INFO:tasks.ceph:role: osd.4 2024-09-12T18:25:42.424 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T18:25:42.424 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T18:25:42.485 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:25:42.485 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:25:42.486 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:25:42.486 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:25:42.486 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:25:42.486 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:25:42.486 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:25:42.486 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:25:42.486 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:25:42.486 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:25:42.946 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-12T18:25:42.948 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-12T18:25:42.948 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T18:25:43.045 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T18:25:43.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:25:43.055 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:25:43.056 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T18:25:43.111 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T18:25:43.111 INFO:tasks.ceph:role: osd.5 2024-09-12T18:25:43.111 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T18:25:43.111 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T18:25:43.173 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:25:43.174 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:25:43.174 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:25:43.174 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:25:43.174 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:25:43.174 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:25:43.174 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:25:43.174 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:25:43.174 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:25:43.174 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:25:43.652 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-12T18:25:43.654 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-12T18:25:43.654 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T18:25:43.797 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T18:25:43.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:25:43.809 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:25:43.810 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T18:25:43.865 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T18:25:43.865 INFO:tasks.ceph:role: osd.6 2024-09-12T18:25:43.865 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T18:25:43.865 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T18:25:43.928 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:25:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:25:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:25:43.928 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:25:43.929 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:25:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:25:43.929 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:25:43.929 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:25:43.929 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:25:43.929 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:25:44.412 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-12T18:25:44.414 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-12T18:25:44.415 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T18:25:44.553 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T18:25:44.564 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:25:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:25:44.566 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T18:25:44.621 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T18:25:44.622 INFO:tasks.ceph:role: osd.7 2024-09-12T18:25:44.622 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T18:25:44.622 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T18:25:44.688 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T18:25:44.689 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T18:25:44.689 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T18:25:44.689 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T18:25:44.689 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T18:25:44.689 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-12T18:25:44.689 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T18:25:44.689 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T18:25:44.689 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T18:25:44.689 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T18:25:45.149 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-12T18:25:45.151 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-12T18:25:45.151 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T18:25:45.251 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T18:25:45.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:25:45.262 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T18:25:45.262 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:25:45.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:45.366+0000 7f670cf077c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T18:25:45.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:45.366+0000 7f670cf077c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T18:25:45.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:45.366+0000 7f670cf077c0 -1 bdev(0x5606d92b7800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T18:25:45.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:45.366+0000 7f670cf077c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T18:25:48.530 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T18:25:48.544 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:25:48.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:48.634+0000 7f179518b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T18:25:48.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:48.634+0000 7f179518b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T18:25:48.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:48.634+0000 7f179518b7c0 -1 bdev(0x55582686b800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T18:25:48.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:48.634+0000 7f179518b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T18:25:51.773 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T18:25:51.831 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:25:51.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:51.914+0000 7fd414e137c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T18:25:51.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:51.914+0000 7fd414e137c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T18:25:51.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:51.914+0000 7fd414e137c0 -1 bdev(0x5581675c3800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T18:25:51.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:51.914+0000 7fd414e137c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T18:25:55.065 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T18:25:55.121 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:25:55.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:55.202+0000 7f55641ba7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T18:25:55.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:55.206+0000 7f55641ba7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T18:25:55.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:55.206+0000 7f55641ba7c0 -1 bdev(0x55a3972ff800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T18:25:55.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T18:25:55.206+0000 7f55641ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T18:25:58.328 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T18:25:58.385 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T18:25:58.386 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:58.386 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T18:25:58.399 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:58.399 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T18:25:58.453 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:58.453 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T18:25:58.508 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:58.508 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T18:25:58.561 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:58.561 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T18:25:58.617 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:25:58.617 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T18:25:58.630 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:25:58.631 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T18:25:58.686 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:25:58.686 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T18:25:58.744 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:25:58.744 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T18:25:58.800 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:25:58.800 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T18:25:58.852 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:25:58.852 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T18:25:58.858 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:25:58.858 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T18:25:58.897 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T18:25:58.897 DEBUG:teuthology.orchestra.run.smithi111:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T18:25:58.903 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T18:25:58.943 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr.y] 2024-09-12T18:25:58.943 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAWMuNm87smDhAAZwkIikM61rhkdC9Z+BL3TA== 2024-09-12T18:25:58.943 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.0] 2024-09-12T18:25:58.943 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAZMuNmPNZzFRAAThK/MKuu/m3YK0FGrhc5zw== 2024-09-12T18:25:58.943 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.1] 2024-09-12T18:25:58.944 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAcMuNm5FM7JBAAOa+NfuTm/DXFgHi05TJLRA== 2024-09-12T18:25:58.944 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.2] 2024-09-12T18:25:58.944 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAfMuNmAhViNRAAM72OJHwW0hZ0SF21DTuZhQ== 2024-09-12T18:25:58.944 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.3] 2024-09-12T18:25:58.944 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAjMuNmapAGDBAA4GEcPMo9n+91cLXjdI6xaQ== 2024-09-12T18:25:58.944 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr.x] 2024-09-12T18:25:58.944 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAWMuNmoEP2EBAAYj/n3MfhdOyor4uBsyZ50w== 2024-09-12T18:25:58.944 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.4] 2024-09-12T18:25:58.944 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQApMuNmW7T3FRAAWO+HL2dTVgh/5kkwSfe6+w== 2024-09-12T18:25:58.945 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.5] 2024-09-12T18:25:58.945 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAsMuNmlBXRJRAA5QfFh//8oygzoe70vv2KTg== 2024-09-12T18:25:58.945 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.6] 2024-09-12T18:25:58.945 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAvMuNm0tGrNhAAJN6UISglRpqmddLtH57ktw== 2024-09-12T18:25:58.945 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.7] 2024-09-12T18:25:58.945 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAzMuNmrBFCDBAAYzbYIEnbR7hwTOugyO1ZMw== 2024-09-12T18:25:58.945 INFO:teuthology.orchestra.run.smithi111.stdout:[client.0] 2024-09-12T18:25:58.945 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAWMuNmFTCrExAA7ZyDlryB9bsfk4Wnu810UA== 2024-09-12T18:25:58.945 INFO:teuthology.orchestra.run.smithi111.stdout:[client.1] 2024-09-12T18:25:58.945 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQAWMuNmV3KVFhAAi1PMjzHvbE1HQEPuKNFiow== 2024-09-12T18:25:58.951 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2024-09-12T18:25:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAWMuNm87smDhAAZwkIikM61rhkdC9Z+BL3TA== 2024-09-12T18:25:58.951 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2024-09-12T18:25:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAZMuNmPNZzFRAAThK/MKuu/m3YK0FGrhc5zw== 2024-09-12T18:25:58.951 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2024-09-12T18:25:58.951 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAcMuNm5FM7JBAAOa+NfuTm/DXFgHi05TJLRA== 2024-09-12T18:25:58.951 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2024-09-12T18:25:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAfMuNmAhViNRAAM72OJHwW0hZ0SF21DTuZhQ== 2024-09-12T18:25:58.952 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2024-09-12T18:25:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAjMuNmapAGDBAA4GEcPMo9n+91cLXjdI6xaQ== 2024-09-12T18:25:58.952 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2024-09-12T18:25:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAWMuNmoEP2EBAAYj/n3MfhdOyor4uBsyZ50w== 2024-09-12T18:25:58.952 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2024-09-12T18:25:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQApMuNmW7T3FRAAWO+HL2dTVgh/5kkwSfe6+w== 2024-09-12T18:25:58.952 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2024-09-12T18:25:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAsMuNmlBXRJRAA5QfFh//8oygzoe70vv2KTg== 2024-09-12T18:25:58.952 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2024-09-12T18:25:58.952 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAvMuNm0tGrNhAAJN6UISglRpqmddLtH57ktw== 2024-09-12T18:25:58.953 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2024-09-12T18:25:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAzMuNmrBFCDBAAYzbYIEnbR7hwTOugyO1ZMw== 2024-09-12T18:25:58.953 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-09-12T18:25:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAWMuNmFTCrExAA7ZyDlryB9bsfk4Wnu810UA== 2024-09-12T18:25:58.953 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2024-09-12T18:25:58.953 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQAWMuNmV3KVFhAAi1PMjzHvbE1HQEPuKNFiow== 2024-09-12T18:25:58.954 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T18:25:58.991 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T18:25:59.047 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.049 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.092 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.135 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.174 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.215 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.256 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.299 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.338 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T18:25:59.379 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T18:25:59.422 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.459 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.503 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.586 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.619 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.672 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.699 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T18:25:59.757 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T18:25:59.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T18:25:59.843 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T18:25:59.863 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T18:25:59.931 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T18:25:59.932 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T18:25:59.944 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T18:26:00.037 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T18:26:00.049 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T18:26:00.104 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T18:26:00.193 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T18:26:00.203 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T18:26:00.217 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T18:26:00.313 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T18:26:00.324 DEBUG:teuthology.orchestra.run.smithi111:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:26:00.326 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T18:26:00.369 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T18:26:00.369 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T18:26:00.369 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T18:26:00.375 INFO:tasks.ceph.mon.a:Started 2024-09-12T18:26:00.375 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T18:26:00.375 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T18:26:00.377 INFO:tasks.ceph.mon.c:Started 2024-09-12T18:26:00.377 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T18:26:00.377 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T18:26:00.414 INFO:tasks.ceph.mon.b:Started 2024-09-12T18:26:00.415 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T18:26:00.415 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T18:26:00.415 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T18:26:00.418 INFO:tasks.ceph.mgr.y:Started 2024-09-12T18:26:00.418 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T18:26:00.418 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T18:26:00.421 INFO:tasks.ceph.mgr.x:Started 2024-09-12T18:26:00.421 DEBUG:tasks.ceph:set 0 configs 2024-09-12T18:26:00.421 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T18:26:00.421 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T18:26:05.865 INFO:teuthology.orchestra.run.smithi111.stderr:adjusted tunables profile to default 2024-09-12T18:26:05.883 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T18:26:05.883 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T18:26:05.883 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:26:05.884 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T18:26:05.894 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:26:05.894 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T18:26:05.953 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:26:05.953 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T18:26:06.008 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:26:06.009 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T18:26:06.061 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:26:06.061 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T18:26:06.074 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:26:06.074 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T18:26:06.128 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:26:06.128 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T18:26:06.184 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T18:26:06.184 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T18:26:06.235 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new f6d201c3-d36f-4b75-8bcf-d55c910dcf0e 0 2024-09-12T18:26:06.503 INFO:teuthology.orchestra.run.smithi153.stdout:0 2024-09-12T18:26:06.520 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 49140545-86a4-4210-be95-412be10e99c8 1 2024-09-12T18:26:06.721 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-12T18:26:06.739 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new d712690b-6779-4066-8278-fca60e2d67a9 2 2024-09-12T18:26:06.942 INFO:teuthology.orchestra.run.smithi153.stdout:2 2024-09-12T18:26:06.958 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new b9a4ce89-2dd9-4b33-a188-2314de9ffd77 3 2024-09-12T18:26:07.159 INFO:teuthology.orchestra.run.smithi153.stdout:3 2024-09-12T18:26:07.175 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 2ffc2db9-c5bd-432a-a596-fc46893774c3 4 2024-09-12T18:26:07.367 INFO:teuthology.orchestra.run.smithi153.stdout:4 2024-09-12T18:26:07.384 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 6bf980d2-3561-4a7a-8f67-5ae37e945ff9 5 2024-09-12T18:26:07.592 INFO:teuthology.orchestra.run.smithi153.stdout:5 2024-09-12T18:26:07.608 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new 63d95b89-bcdc-4091-bc1a-572a1541f3f0 6 2024-09-12T18:26:07.797 INFO:teuthology.orchestra.run.smithi153.stdout:6 2024-09-12T18:26:07.814 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd new a617f7db-d938-42ab-bf23-1c84983fe4b0 7 2024-09-12T18:26:08.019 INFO:teuthology.orchestra.run.smithi153.stdout:7 2024-09-12T18:26:08.036 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T18:26:08.036 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T18:26:08.039 INFO:tasks.ceph.osd.0:Started 2024-09-12T18:26:08.039 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T18:26:08.039 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T18:26:08.041 INFO:tasks.ceph.osd.1:Started 2024-09-12T18:26:08.041 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T18:26:08.041 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T18:26:08.044 INFO:tasks.ceph.osd.2:Started 2024-09-12T18:26:08.044 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T18:26:08.044 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T18:26:08.046 INFO:tasks.ceph.osd.3:Started 2024-09-12T18:26:08.046 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T18:26:08.046 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T18:26:08.048 INFO:tasks.ceph.osd.4:Started 2024-09-12T18:26:08.048 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T18:26:08.048 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T18:26:08.050 INFO:tasks.ceph.osd.5:Started 2024-09-12T18:26:08.050 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T18:26:08.050 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T18:26:08.052 INFO:tasks.ceph.osd.6:Started 2024-09-12T18:26:08.052 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T18:26:08.052 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T18:26:08.054 INFO:tasks.ceph.osd.7:Started 2024-09-12T18:26:08.055 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:26:08.254 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:26:08.254 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":10,"fsid":"2cc18cb2-6afc-4366-93a9-b1f579cd792f","created":"2024-09-12T18:26:05.742099+0000","modified":"2024-09-12T18:26:08.014473+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T18:26:08.014473+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f6d201c3-d36f-4b75-8bcf-d55c910dcf0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"49140545-86a4-4210-be95-412be10e99c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d712690b-6779-4066-8278-fca60e2d67a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b9a4ce89-2dd9-4b33-a188-2314de9ffd77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2ffc2db9-c5bd-432a-a596-fc46893774c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6bf980d2-3561-4a7a-8f67-5ae37e945ff9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"63d95b89-bcdc-4091-bc1a-572a1541f3f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a617f7db-d938-42ab-bf23-1c84983fe4b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:26:08.270 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T18:26:08.271 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T18:26:08.759 INFO:tasks.ceph.mgr.y.smithi111.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T18:26:08.759 INFO:tasks.ceph.mgr.y.smithi111.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T18:26:08.759 INFO:tasks.ceph.mgr.y.smithi111.stderr: from numpy import show_config as show_numpy_config 2024-09-12T18:26:08.808 INFO:tasks.ceph.mgr.x.smithi153.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T18:26:08.808 INFO:tasks.ceph.mgr.x.smithi153.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T18:26:08.808 INFO:tasks.ceph.mgr.x.smithi153.stderr: from numpy import show_config as show_numpy_config 2024-09-12T18:26:09.075 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T18:26:09.258 INFO:teuthology.misc.health.smithi111.stdout: 2024-09-12T18:26:09.381 INFO:teuthology.misc.health.smithi111.stdout:{"epoch":10,"fsid":"2cc18cb2-6afc-4366-93a9-b1f579cd792f","created":"2024-09-12T18:26:05.742099+0000","modified":"2024-09-12T18:26:08.014473+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T18:26:08.014473+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f6d201c3-d36f-4b75-8bcf-d55c910dcf0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"49140545-86a4-4210-be95-412be10e99c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d712690b-6779-4066-8278-fca60e2d67a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b9a4ce89-2dd9-4b33-a188-2314de9ffd77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2ffc2db9-c5bd-432a-a596-fc46893774c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6bf980d2-3561-4a7a-8f67-5ae37e945ff9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"63d95b89-bcdc-4091-bc1a-572a1541f3f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a617f7db-d938-42ab-bf23-1c84983fe4b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:26:09.383 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T18:26:09.406 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-12T18:26:09.406+0000 7f287f7227c0 -1 Falling back to public interface 2024-09-12T18:26:09.495 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-09-12T18:26:09.491+0000 7faf7d3097c0 -1 Falling back to public interface 2024-09-12T18:26:09.671 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-09-12T18:26:09.667+0000 7fbae30287c0 -1 Falling back to public interface 2024-09-12T18:26:09.682 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:26:09.679+0000 7f56820c17c0 -1 Falling back to public interface 2024-09-12T18:26:09.686 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-12T18:26:09.683+0000 7fb894f8a7c0 -1 Falling back to public interface 2024-09-12T18:26:09.719 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-12T18:26:09.718+0000 7f50e80d17c0 -1 Falling back to public interface 2024-09-12T18:26:09.737 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-12T18:26:09.738+0000 7fd27a7ba7c0 -1 Falling back to public interface 2024-09-12T18:26:09.970 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-12T18:26:09.970+0000 7f09155567c0 -1 Falling back to public interface 2024-09-12T18:26:11.697 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-09-12T18:26:11.691+0000 7f406d048640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T18:26:11.699 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-09-12T18:26:11.695+0000 7f406d048640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T18:26:13.447 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-12T18:26:13.446+0000 7f287f7227c0 -1 osd.7 0 log_to_monitors true 2024-09-12T18:26:13.567 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-09-12T18:26:13.563+0000 7faf7d3097c0 -1 osd.1 0 log_to_monitors true 2024-09-12T18:26:13.703 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-12T18:26:13.702+0000 7f50e80d17c0 -1 osd.6 0 log_to_monitors true 2024-09-12T18:26:13.767 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-09-12T18:26:13.763+0000 7fbae30287c0 -1 osd.3 0 log_to_monitors true 2024-09-12T18:26:13.847 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:26:13.843+0000 7f56820c17c0 -1 osd.0 0 log_to_monitors true 2024-09-12T18:26:13.850 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-12T18:26:13.847+0000 7fb894f8a7c0 -1 osd.2 0 log_to_monitors true 2024-09-12T18:26:14.005 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-12T18:26:14.006+0000 7f09155567c0 -1 osd.5 0 log_to_monitors true 2024-09-12T18:26:14.077 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-12T18:26:14.078+0000 7fd27a7ba7c0 -1 osd.4 0 log_to_monitors true 2024-09-12T18:26:15.695 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-09-12T18:26:15.691+0000 7faf792b2640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T18:26:15.769 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-12T18:26:15.770+0000 7f287b6cb640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T18:26:15.850 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-09-12T18:26:15.847+0000 7faf710e4640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:26:15.867 INFO:tasks.ceph.osd.7.smithi153.stderr:2024-09-12T18:26:15.866+0000 7f28734fd640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:26:16.190 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T18:26:16.520 INFO:teuthology.misc.health.smithi111.stdout: 2024-09-12T18:26:16.520 INFO:teuthology.misc.health.smithi111.stdout:{"epoch":13,"fsid":"2cc18cb2-6afc-4366-93a9-b1f579cd792f","created":"2024-09-12T18:26:05.742099+0000","modified":"2024-09-12T18:26:15.688323+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T18:26:08.014473+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f6d201c3-d36f-4b75-8bcf-d55c910dcf0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"49140545-86a4-4210-be95-412be10e99c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d712690b-6779-4066-8278-fca60e2d67a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b9a4ce89-2dd9-4b33-a188-2314de9ffd77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2ffc2db9-c5bd-432a-a596-fc46893774c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6bf980d2-3561-4a7a-8f67-5ae37e945ff9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"63d95b89-bcdc-4091-bc1a-572a1541f3f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a617f7db-d938-42ab-bf23-1c84983fe4b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:26:16.538 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T18:26:17.381 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-09-12T18:26:17.379+0000 7fbadefd1640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T18:26:17.384 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-12T18:26:17.379+0000 7fb891745640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T18:26:17.402 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-09-12T18:26:17.399+0000 7fb888d65640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:26:17.411 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:26:17.407+0000 7f567e06a640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T18:26:17.422 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-09-12T18:26:17.419+0000 7fbad6e03640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:26:17.454 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-09-12T18:26:17.451+0000 7f5675e9c640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:26:17.497 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-12T18:26:17.497+0000 7f09114ff640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T18:26:17.516 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-12T18:26:17.513+0000 7f50e407a640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T18:26:17.520 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-12T18:26:17.517+0000 7fd276763640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T18:26:17.524 INFO:tasks.ceph.osd.5.smithi153.stderr:2024-09-12T18:26:17.521+0000 7f0909331640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:26:17.537 INFO:tasks.ceph.osd.6.smithi153.stderr:2024-09-12T18:26:17.537+0000 7f50dbeac640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:26:17.541 INFO:tasks.ceph.osd.4.smithi153.stderr:2024-09-12T18:26:17.541+0000 7fd26e595640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T18:26:23.345 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T18:26:23.653 INFO:teuthology.misc.health.smithi111.stdout: 2024-09-12T18:26:23.654 INFO:teuthology.misc.health.smithi111.stdout:{"epoch":18,"fsid":"2cc18cb2-6afc-4366-93a9-b1f579cd792f","created":"2024-09-12T18:26:05.742099+0000","modified":"2024-09-12T18:26:21.416106+0000","last_up_change":"2024-09-12T18:26:18.393867+0000","last_in_change":"2024-09-12T18:26:08.014473+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:26:18.722812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6d201c3-d36f-4b75-8bcf-d55c910dcf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6817","nonce":1581955167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6819","nonce":1581955167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6823","nonce":1581955167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6821","nonce":1581955167}]},"public_addr":"172.21.15.111:6817/1581955167","cluster_addr":"172.21.15.111:6819/1581955167","heartbeat_back_addr":"172.21.15.111:6823/1581955167","heartbeat_front_addr":"172.21.15.111:6821/1581955167","state":["exists","up"]},{"osd":1,"uuid":"49140545-86a4-4210-be95-412be10e99c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6801","nonce":2832238944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6803","nonce":2832238944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6807","nonce":2832238944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6805","nonce":2832238944}]},"public_addr":"172.21.15.111:6801/2832238944","cluster_addr":"172.21.15.111:6803/2832238944","heartbeat_back_addr":"172.21.15.111:6807/2832238944","heartbeat_front_addr":"172.21.15.111:6805/2832238944","state":["exists","up"]},{"osd":2,"uuid":"d712690b-6779-4066-8278-fca60e2d67a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6825","nonce":1702084661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6827","nonce":1702084661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6831","nonce":1702084661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6829","nonce":1702084661}]},"public_addr":"172.21.15.111:6825/1702084661","cluster_addr":"172.21.15.111:6827/1702084661","heartbeat_back_addr":"172.21.15.111:6831/1702084661","heartbeat_front_addr":"172.21.15.111:6829/1702084661","state":["exists","up"]},{"osd":3,"uuid":"b9a4ce89-2dd9-4b33-a188-2314de9ffd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6809","nonce":2609694328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6811","nonce":2609694328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6815","nonce":2609694328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6813","nonce":2609694328}]},"public_addr":"172.21.15.111:6809/2609694328","cluster_addr":"172.21.15.111:6811/2609694328","heartbeat_back_addr":"172.21.15.111:6815/2609694328","heartbeat_front_addr":"172.21.15.111:6813/2609694328","state":["exists","up"]},{"osd":4,"uuid":"2ffc2db9-c5bd-432a-a596-fc46893774c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6817","nonce":2228313878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6819","nonce":2228313878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6823","nonce":2228313878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6821","nonce":2228313878}]},"public_addr":"172.21.15.153:6817/2228313878","cluster_addr":"172.21.15.153:6819/2228313878","heartbeat_back_addr":"172.21.15.153:6823/2228313878","heartbeat_front_addr":"172.21.15.153:6821/2228313878","state":["exists","up"]},{"osd":5,"uuid":"6bf980d2-3561-4a7a-8f67-5ae37e945ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6825","nonce":2813139034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6827","nonce":2813139034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6831","nonce":2813139034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6829","nonce":2813139034}]},"public_addr":"172.21.15.153:6825/2813139034","cluster_addr":"172.21.15.153:6827/2813139034","heartbeat_back_addr":"172.21.15.153:6831/2813139034","heartbeat_front_addr":"172.21.15.153:6829/2813139034","state":["exists","up"]},{"osd":6,"uuid":"63d95b89-bcdc-4091-bc1a-572a1541f3f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6809","nonce":1571723771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6811","nonce":1571723771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6815","nonce":1571723771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6813","nonce":1571723771}]},"public_addr":"172.21.15.153:6809/1571723771","cluster_addr":"172.21.15.153:6811/1571723771","heartbeat_back_addr":"172.21.15.153:6815/1571723771","heartbeat_front_addr":"172.21.15.153:6813/1571723771","state":["exists","up"]},{"osd":7,"uuid":"a617f7db-d938-42ab-bf23-1c84983fe4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6801","nonce":1880471407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6803","nonce":1880471407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6807","nonce":1880471407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6805","nonce":1880471407}]},"public_addr":"172.21.15.153:6801/1880471407","cluster_addr":"172.21.15.153:6803/1880471407","heartbeat_back_addr":"172.21.15.153:6807/1880471407","heartbeat_front_addr":"172.21.15.153:6805/1880471407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.876198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.611738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.865948+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.812023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:15.098612+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:15.038933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.690178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.470574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:26:23.671 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T18:26:23.671 INFO:tasks.ceph:Creating RBD pool 2024-09-12T18:26:23.671 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T18:26:24.456 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'rbd' created 2024-09-12T18:26:24.480 DEBUG:teuthology.orchestra.run.smithi111:> rbd --cluster ceph pool init rbd 2024-09-12T18:26:24.519 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:26:24.519 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:26:27.515 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T18:26:27.516 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T18:26:27.516 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T18:26:27.871 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:26:27.891 INFO:teuthology.orchestra.run.smithi111.stdout:[{"version":9,"timestamp":"2024-09-12T18:26:17.525685+0000","name":"","changes":[{"name":"osd.4/osd_mclock_max_capacity_iops_ssd","new_value":"5287.734664"}]}] 2024-09-12T18:26:27.891 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T18:26:27.891 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T18:26:27.891 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T18:26:27.892 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T18:26:28.234 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:26:28.249 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6832","nonce":3142190257},{"type":"v1","addr":"172.21.15.111:6833","nonce":3142190257}]},"active_addr":"172.21.15.111:6833/3142190257","active_change":"2024-09-12T18:26:10.670167+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":1300385278}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":1185887820}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":4133119374}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":3488714234}]}]} 2024-09-12T18:26:28.254 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T18:26:28.254 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T18:26:28.254 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:26:28.561 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:26:28.562 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":22,"fsid":"2cc18cb2-6afc-4366-93a9-b1f579cd792f","created":"2024-09-12T18:26:05.742099+0000","modified":"2024-09-12T18:26:27.468670+0000","last_up_change":"2024-09-12T18:26:18.393867+0000","last_in_change":"2024-09-12T18:26:08.014473+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:26:18.722812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:26:23.958665+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6d201c3-d36f-4b75-8bcf-d55c910dcf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6817","nonce":1581955167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6819","nonce":1581955167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6823","nonce":1581955167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6821","nonce":1581955167}]},"public_addr":"172.21.15.111:6817/1581955167","cluster_addr":"172.21.15.111:6819/1581955167","heartbeat_back_addr":"172.21.15.111:6823/1581955167","heartbeat_front_addr":"172.21.15.111:6821/1581955167","state":["exists","up"]},{"osd":1,"uuid":"49140545-86a4-4210-be95-412be10e99c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6801","nonce":2832238944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6803","nonce":2832238944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6807","nonce":2832238944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6805","nonce":2832238944}]},"public_addr":"172.21.15.111:6801/2832238944","cluster_addr":"172.21.15.111:6803/2832238944","heartbeat_back_addr":"172.21.15.111:6807/2832238944","heartbeat_front_addr":"172.21.15.111:6805/2832238944","state":["exists","up"]},{"osd":2,"uuid":"d712690b-6779-4066-8278-fca60e2d67a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6825","nonce":1702084661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6827","nonce":1702084661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6831","nonce":1702084661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6829","nonce":1702084661}]},"public_addr":"172.21.15.111:6825/1702084661","cluster_addr":"172.21.15.111:6827/1702084661","heartbeat_back_addr":"172.21.15.111:6831/1702084661","heartbeat_front_addr":"172.21.15.111:6829/1702084661","state":["exists","up"]},{"osd":3,"uuid":"b9a4ce89-2dd9-4b33-a188-2314de9ffd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6809","nonce":2609694328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6811","nonce":2609694328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6815","nonce":2609694328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6813","nonce":2609694328}]},"public_addr":"172.21.15.111:6809/2609694328","cluster_addr":"172.21.15.111:6811/2609694328","heartbeat_back_addr":"172.21.15.111:6815/2609694328","heartbeat_front_addr":"172.21.15.111:6813/2609694328","state":["exists","up"]},{"osd":4,"uuid":"2ffc2db9-c5bd-432a-a596-fc46893774c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6817","nonce":2228313878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6819","nonce":2228313878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6823","nonce":2228313878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6821","nonce":2228313878}]},"public_addr":"172.21.15.153:6817/2228313878","cluster_addr":"172.21.15.153:6819/2228313878","heartbeat_back_addr":"172.21.15.153:6823/2228313878","heartbeat_front_addr":"172.21.15.153:6821/2228313878","state":["exists","up"]},{"osd":5,"uuid":"6bf980d2-3561-4a7a-8f67-5ae37e945ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6825","nonce":2813139034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6827","nonce":2813139034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6831","nonce":2813139034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6829","nonce":2813139034}]},"public_addr":"172.21.15.153:6825/2813139034","cluster_addr":"172.21.15.153:6827/2813139034","heartbeat_back_addr":"172.21.15.153:6831/2813139034","heartbeat_front_addr":"172.21.15.153:6829/2813139034","state":["exists","up"]},{"osd":6,"uuid":"63d95b89-bcdc-4091-bc1a-572a1541f3f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6809","nonce":1571723771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6811","nonce":1571723771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6815","nonce":1571723771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6813","nonce":1571723771}]},"public_addr":"172.21.15.153:6809/1571723771","cluster_addr":"172.21.15.153:6811/1571723771","heartbeat_back_addr":"172.21.15.153:6815/1571723771","heartbeat_front_addr":"172.21.15.153:6813/1571723771","state":["exists","up"]},{"osd":7,"uuid":"a617f7db-d938-42ab-bf23-1c84983fe4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6801","nonce":1880471407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6803","nonce":1880471407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6807","nonce":1880471407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6805","nonce":1880471407}]},"public_addr":"172.21.15.153:6801/1880471407","cluster_addr":"172.21.15.153:6803/1880471407","heartbeat_back_addr":"172.21.15.153:6807/1880471407","heartbeat_front_addr":"172.21.15.153:6805/1880471407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.876198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.611738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.865948+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.812023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:15.098612+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:15.038933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.690178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.470574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:26:28.580 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T18:26:28.581 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T18:26:28.875 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:26:28.875 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":22,"fsid":"2cc18cb2-6afc-4366-93a9-b1f579cd792f","created":"2024-09-12T18:26:05.742099+0000","modified":"2024-09-12T18:26:27.468670+0000","last_up_change":"2024-09-12T18:26:18.393867+0000","last_in_change":"2024-09-12T18:26:08.014473+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:26:18.722812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:26:23.958665+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6d201c3-d36f-4b75-8bcf-d55c910dcf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6817","nonce":1581955167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6819","nonce":1581955167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6823","nonce":1581955167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6821","nonce":1581955167}]},"public_addr":"172.21.15.111:6817/1581955167","cluster_addr":"172.21.15.111:6819/1581955167","heartbeat_back_addr":"172.21.15.111:6823/1581955167","heartbeat_front_addr":"172.21.15.111:6821/1581955167","state":["exists","up"]},{"osd":1,"uuid":"49140545-86a4-4210-be95-412be10e99c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6801","nonce":2832238944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6803","nonce":2832238944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6807","nonce":2832238944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6805","nonce":2832238944}]},"public_addr":"172.21.15.111:6801/2832238944","cluster_addr":"172.21.15.111:6803/2832238944","heartbeat_back_addr":"172.21.15.111:6807/2832238944","heartbeat_front_addr":"172.21.15.111:6805/2832238944","state":["exists","up"]},{"osd":2,"uuid":"d712690b-6779-4066-8278-fca60e2d67a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6825","nonce":1702084661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6827","nonce":1702084661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6831","nonce":1702084661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6829","nonce":1702084661}]},"public_addr":"172.21.15.111:6825/1702084661","cluster_addr":"172.21.15.111:6827/1702084661","heartbeat_back_addr":"172.21.15.111:6831/1702084661","heartbeat_front_addr":"172.21.15.111:6829/1702084661","state":["exists","up"]},{"osd":3,"uuid":"b9a4ce89-2dd9-4b33-a188-2314de9ffd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6809","nonce":2609694328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6811","nonce":2609694328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6815","nonce":2609694328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6813","nonce":2609694328}]},"public_addr":"172.21.15.111:6809/2609694328","cluster_addr":"172.21.15.111:6811/2609694328","heartbeat_back_addr":"172.21.15.111:6815/2609694328","heartbeat_front_addr":"172.21.15.111:6813/2609694328","state":["exists","up"]},{"osd":4,"uuid":"2ffc2db9-c5bd-432a-a596-fc46893774c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6817","nonce":2228313878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6819","nonce":2228313878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6823","nonce":2228313878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6821","nonce":2228313878}]},"public_addr":"172.21.15.153:6817/2228313878","cluster_addr":"172.21.15.153:6819/2228313878","heartbeat_back_addr":"172.21.15.153:6823/2228313878","heartbeat_front_addr":"172.21.15.153:6821/2228313878","state":["exists","up"]},{"osd":5,"uuid":"6bf980d2-3561-4a7a-8f67-5ae37e945ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6825","nonce":2813139034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6827","nonce":2813139034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6831","nonce":2813139034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6829","nonce":2813139034}]},"public_addr":"172.21.15.153:6825/2813139034","cluster_addr":"172.21.15.153:6827/2813139034","heartbeat_back_addr":"172.21.15.153:6831/2813139034","heartbeat_front_addr":"172.21.15.153:6829/2813139034","state":["exists","up"]},{"osd":6,"uuid":"63d95b89-bcdc-4091-bc1a-572a1541f3f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6809","nonce":1571723771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6811","nonce":1571723771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6815","nonce":1571723771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6813","nonce":1571723771}]},"public_addr":"172.21.15.153:6809/1571723771","cluster_addr":"172.21.15.153:6811/1571723771","heartbeat_back_addr":"172.21.15.153:6815/1571723771","heartbeat_front_addr":"172.21.15.153:6813/1571723771","state":["exists","up"]},{"osd":7,"uuid":"a617f7db-d938-42ab-bf23-1c84983fe4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6801","nonce":1880471407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6803","nonce":1880471407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6807","nonce":1880471407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6805","nonce":1880471407}]},"public_addr":"172.21.15.153:6801/1880471407","cluster_addr":"172.21.15.153:6803/1880471407","heartbeat_back_addr":"172.21.15.153:6807/1880471407","heartbeat_front_addr":"172.21.15.153:6805/1880471407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.876198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.611738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.865948+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.812023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:15.098612+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:15.038933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.690178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.470574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T18:26:28.892 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T18:26:28.893 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T18:26:28.893 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T18:26:28.894 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T18:26:28.894 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T18:26:28.894 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T18:26:28.895 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T18:26:28.895 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T18:26:29.151 INFO:teuthology.orchestra.run.smithi111.stdout:64424509445 2024-09-12T18:26:29.151 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:26:29.157 INFO:teuthology.orchestra.run.smithi111.stdout:64424509445 2024-09-12T18:26:29.158 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T18:26:29.163 INFO:teuthology.orchestra.run.smithi111.stdout:60129542150 2024-09-12T18:26:29.163 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:26:29.170 INFO:teuthology.orchestra.run.smithi111.stdout:64424509446 2024-09-12T18:26:29.170 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T18:26:29.171 INFO:teuthology.orchestra.run.smithi111.stdout:64424509444 2024-09-12T18:26:29.172 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:26:29.173 INFO:teuthology.orchestra.run.smithi111.stdout:60129542151 2024-09-12T18:26:29.174 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T18:26:29.175 INFO:teuthology.orchestra.run.smithi111.stdout:64424509446 2024-09-12T18:26:29.176 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T18:26:29.177 INFO:teuthology.orchestra.run.smithi111.stdout:64424509445 2024-09-12T18:26:29.177 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T18:26:29.668 INFO:teuthology.orchestra.run.smithi111.stdout:64424509443 2024-09-12T18:26:29.689 INFO:teuthology.orchestra.run.smithi111.stdout:60129542149 2024-09-12T18:26:29.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.2 2024-09-12T18:26:29.710 INFO:teuthology.orchestra.run.smithi111.stdout:64424509444 2024-09-12T18:26:29.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.1 2024-09-12T18:26:29.715 INFO:teuthology.orchestra.run.smithi111.stdout:64424509443 2024-09-12T18:26:29.727 INFO:teuthology.orchestra.run.smithi111.stdout:64424509442 2024-09-12T18:26:29.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.4 2024-09-12T18:26:29.742 INFO:teuthology.orchestra.run.smithi111.stdout:64424509444 2024-09-12T18:26:29.744 INFO:teuthology.orchestra.run.smithi111.stdout:60129542150 2024-09-12T18:26:29.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.6 2024-09-12T18:26:29.746 INFO:teuthology.orchestra.run.smithi111.stdout:64424509443 2024-09-12T18:26:29.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.0 2024-09-12T18:26:29.766 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.5 2024-09-12T18:26:29.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.7 2024-09-12T18:26:29.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.3 2024-09-12T18:26:30.692 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:26:30.712 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:26:30.742 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T18:26:30.745 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T18:26:30.759 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:26:30.767 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T18:26:30.770 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T18:26:30.770 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T18:26:31.222 INFO:teuthology.orchestra.run.smithi111.stdout:64424509443 2024-09-12T18:26:31.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.2 2024-09-12T18:26:31.256 INFO:teuthology.orchestra.run.smithi111.stdout:60129542149 2024-09-12T18:26:31.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.1 2024-09-12T18:26:31.321 INFO:teuthology.orchestra.run.smithi111.stdout:60129542150 2024-09-12T18:26:31.325 INFO:teuthology.orchestra.run.smithi111.stdout:64424509444 2024-09-12T18:26:31.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.7 2024-09-12T18:26:31.343 INFO:teuthology.orchestra.run.smithi111.stdout:64424509442 2024-09-12T18:26:31.344 INFO:teuthology.orchestra.run.smithi111.stdout:64424509444 2024-09-12T18:26:31.344 INFO:teuthology.orchestra.run.smithi111.stdout:64424509443 2024-09-12T18:26:31.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.4 2024-09-12T18:26:31.361 INFO:teuthology.orchestra.run.smithi111.stdout:64424509443 2024-09-12T18:26:31.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.5 2024-09-12T18:26:31.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.3 2024-09-12T18:26:31.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.0 2024-09-12T18:26:31.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.6 2024-09-12T18:26:32.246 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T18:26:32.274 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T18:26:32.341 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T18:26:32.356 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T18:26:32.370 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T18:26:32.371 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T18:26:32.373 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T18:26:32.383 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T18:26:32.724 INFO:teuthology.orchestra.run.smithi111.stdout:64424509445 2024-09-12T18:26:32.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.2 2024-09-12T18:26:32.750 DEBUG:teuthology.parallel:result is None 2024-09-12T18:26:32.800 INFO:teuthology.orchestra.run.smithi111.stdout:60129542150 2024-09-12T18:26:32.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-09-12T18:26:32.826 DEBUG:teuthology.parallel:result is None 2024-09-12T18:26:32.852 INFO:teuthology.orchestra.run.smithi111.stdout:64424509444 2024-09-12T18:26:32.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.0 2024-09-12T18:26:32.870 DEBUG:teuthology.parallel:result is None 2024-09-12T18:26:32.870 INFO:teuthology.orchestra.run.smithi111.stdout:64424509446 2024-09-12T18:26:32.877 INFO:teuthology.orchestra.run.smithi111.stdout:60129542151 2024-09-12T18:26:32.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.5 2024-09-12T18:26:32.890 DEBUG:teuthology.parallel:result is None 2024-09-12T18:26:32.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.7 2024-09-12T18:26:32.897 DEBUG:teuthology.parallel:result is None 2024-09-12T18:26:32.903 INFO:teuthology.orchestra.run.smithi111.stdout:64424509446 2024-09-12T18:26:32.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-12T18:26:32.920 DEBUG:teuthology.parallel:result is None 2024-09-12T18:26:32.944 INFO:teuthology.orchestra.run.smithi111.stdout:64424509445 2024-09-12T18:26:32.951 INFO:teuthology.orchestra.run.smithi111.stdout:64424509445 2024-09-12T18:26:32.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.3 2024-09-12T18:26:32.964 DEBUG:teuthology.parallel:result is None 2024-09-12T18:26:32.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.6 2024-09-12T18:26:32.969 DEBUG:teuthology.parallel:result is None 2024-09-12T18:26:32.969 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T18:26:32.970 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:26:33.289 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:26:33.290 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-09-12T18:26:33.306 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T18:26:32.684245+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223308,"kb_used_data":2884,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751412,"statfs":{"total":773094113280,"available":772865445888,"internally_reserved":0,"allocated":2953216,"data_stored":1773502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.215599"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:27.699071+0000","last_change":"2024-09-12T18:26:27.699071+0000","last_active":"2024-09-12T18:26:27.699071+0000","last_peered":"2024-09-12T18:26:27.699071+0000","last_clean":"2024-09-12T18:26:27.699071+0000","last_became_active":"2024-09-12T18:26:25.487465+0000","last_became_peered":"2024-09-12T18:26:25.487465+0000","last_unstale":"2024-09-12T18:26:27.699071+0000","last_undegraded":"2024-09-12T18:26:27.699071+0000","last_fullsized":"2024-09-12T18:26:27.699071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:22.342394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010368949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:27.493293+0000","last_change":"2024-09-12T18:26:27.493293+0000","last_active":"2024-09-12T18:26:27.493293+0000","last_peered":"2024-09-12T18:26:27.493293+0000","last_clean":"2024-09-12T18:26:27.493293+0000","last_became_active":"2024-09-12T18:26:25.485137+0000","last_became_peered":"2024-09-12T18:26:25.485137+0000","last_unstale":"2024-09-12T18:26:27.493293+0000","last_undegraded":"2024-09-12T18:26:27.493293+0000","last_fullsized":"2024-09-12T18:26:27.493293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:37.081707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013350759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:28.282195+0000","last_change":"2024-09-12T18:26:28.282666+0000","last_active":"2024-09-12T18:26:28.282195+0000","last_peered":"2024-09-12T18:26:28.282195+0000","last_clean":"2024-09-12T18:26:28.282195+0000","last_became_active":"2024-09-12T18:26:25.484938+0000","last_became_peered":"2024-09-12T18:26:25.484938+0000","last_unstale":"2024-09-12T18:26:28.282195+0000","last_undegraded":"2024-09-12T18:26:28.282195+0000","last_fullsized":"2024-09-12T18:26:28.282195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:50.645807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001083194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:27.492857+0000","last_change":"2024-09-12T18:26:27.492857+0000","last_active":"2024-09-12T18:26:27.492857+0000","last_peered":"2024-09-12T18:26:27.492857+0000","last_clean":"2024-09-12T18:26:27.492857+0000","last_became_active":"2024-09-12T18:26:25.474997+0000","last_became_peered":"2024-09-12T18:26:25.474997+0000","last_unstale":"2024-09-12T18:26:27.492857+0000","last_undegraded":"2024-09-12T18:26:27.492857+0000","last_fullsized":"2024-09-12T18:26:27.492857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:39.276451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099306900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:27.494079+0000","last_change":"2024-09-12T18:26:27.491626+0000","last_active":"2024-09-12T18:26:27.494079+0000","last_peered":"2024-09-12T18:26:27.494079+0000","last_clean":"2024-09-12T18:26:27.494079+0000","last_became_active":"2024-09-12T18:26:25.483909+0000","last_became_peered":"2024-09-12T18:26:25.483909+0000","last_unstale":"2024-09-12T18:26:27.494079+0000","last_undegraded":"2024-09-12T18:26:27.494079+0000","last_fullsized":"2024-09-12T18:26:27.494079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:34.647003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002260153,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:27.893863+0000","last_change":"2024-09-12T18:26:27.893863+0000","last_active":"2024-09-12T18:26:27.893863+0000","last_peered":"2024-09-12T18:26:27.893863+0000","last_clean":"2024-09-12T18:26:27.893863+0000","last_became_active":"2024-09-12T18:26:25.559069+0000","last_became_peered":"2024-09-12T18:26:25.559069+0000","last_unstale":"2024-09-12T18:26:27.893863+0000","last_undegraded":"2024-09-12T18:26:27.893863+0000","last_fullsized":"2024-09-12T18:26:27.893863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:18.983449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065344600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:28.282277+0000","last_change":"2024-09-12T18:26:28.282837+0000","last_active":"2024-09-12T18:26:28.282277+0000","last_peered":"2024-09-12T18:26:28.282277+0000","last_clean":"2024-09-12T18:26:28.282277+0000","last_became_active":"2024-09-12T18:26:25.486681+0000","last_became_peered":"2024-09-12T18:26:25.486681+0000","last_unstale":"2024-09-12T18:26:28.282277+0000","last_undegraded":"2024-09-12T18:26:28.282277+0000","last_fullsized":"2024-09-12T18:26:28.282277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:48.632695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001127308,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:27.490424+0000","last_change":"2024-09-12T18:26:27.490424+0000","last_active":"2024-09-12T18:26:27.490424+0000","last_peered":"2024-09-12T18:26:27.490424+0000","last_clean":"2024-09-12T18:26:27.490424+0000","last_became_active":"2024-09-12T18:26:25.483072+0000","last_became_peered":"2024-09-12T18:26:25.483072+0000","last_unstale":"2024-09-12T18:26:27.490424+0000","last_undegraded":"2024-09-12T18:26:27.490424+0000","last_fullsized":"2024-09-12T18:26:27.490424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:05.867109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010071489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:28.281494+0000","last_change":"2024-09-12T18:26:20.490476+0000","last_active":"2024-09-12T18:26:28.281494+0000","last_peered":"2024-09-12T18:26:28.281494+0000","last_clean":"2024-09-12T18:26:28.281494+0000","last_became_active":"2024-09-12T18:26:20.488464+0000","last_became_peered":"2024-09-12T18:26:20.488464+0000","last_unstale":"2024-09-12T18:26:28.281494+0000","last_undegraded":"2024-09-12T18:26:28.281494+0000","last_fullsized":"2024-09-12T18:26:28.281494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:19.397195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:19.397195+0000","last_clean_scrub_stamp":"2024-09-12T18:26:19.397195+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:55.130875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":665188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":659356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":74839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:26:33.307 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T18:26:33.590 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:26:33.591 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-09-12T18:26:33.607 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T18:26:32.684245+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223308,"kb_used_data":2884,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751412,"statfs":{"total":773094113280,"available":772865445888,"internally_reserved":0,"allocated":2953216,"data_stored":1773502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":225496627},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.215599"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:27.699071+0000","last_change":"2024-09-12T18:26:27.699071+0000","last_active":"2024-09-12T18:26:27.699071+0000","last_peered":"2024-09-12T18:26:27.699071+0000","last_clean":"2024-09-12T18:26:27.699071+0000","last_became_active":"2024-09-12T18:26:25.487465+0000","last_became_peered":"2024-09-12T18:26:25.487465+0000","last_unstale":"2024-09-12T18:26:27.699071+0000","last_undegraded":"2024-09-12T18:26:27.699071+0000","last_fullsized":"2024-09-12T18:26:27.699071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:22.342394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010368949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:27.493293+0000","last_change":"2024-09-12T18:26:27.493293+0000","last_active":"2024-09-12T18:26:27.493293+0000","last_peered":"2024-09-12T18:26:27.493293+0000","last_clean":"2024-09-12T18:26:27.493293+0000","last_became_active":"2024-09-12T18:26:25.485137+0000","last_became_peered":"2024-09-12T18:26:25.485137+0000","last_unstale":"2024-09-12T18:26:27.493293+0000","last_undegraded":"2024-09-12T18:26:27.493293+0000","last_fullsized":"2024-09-12T18:26:27.493293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:37.081707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013350759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:28.282195+0000","last_change":"2024-09-12T18:26:28.282666+0000","last_active":"2024-09-12T18:26:28.282195+0000","last_peered":"2024-09-12T18:26:28.282195+0000","last_clean":"2024-09-12T18:26:28.282195+0000","last_became_active":"2024-09-12T18:26:25.484938+0000","last_became_peered":"2024-09-12T18:26:25.484938+0000","last_unstale":"2024-09-12T18:26:28.282195+0000","last_undegraded":"2024-09-12T18:26:28.282195+0000","last_fullsized":"2024-09-12T18:26:28.282195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:50.645807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001083194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:27.492857+0000","last_change":"2024-09-12T18:26:27.492857+0000","last_active":"2024-09-12T18:26:27.492857+0000","last_peered":"2024-09-12T18:26:27.492857+0000","last_clean":"2024-09-12T18:26:27.492857+0000","last_became_active":"2024-09-12T18:26:25.474997+0000","last_became_peered":"2024-09-12T18:26:25.474997+0000","last_unstale":"2024-09-12T18:26:27.492857+0000","last_undegraded":"2024-09-12T18:26:27.492857+0000","last_fullsized":"2024-09-12T18:26:27.492857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:39.276451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099306900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:27.494079+0000","last_change":"2024-09-12T18:26:27.491626+0000","last_active":"2024-09-12T18:26:27.494079+0000","last_peered":"2024-09-12T18:26:27.494079+0000","last_clean":"2024-09-12T18:26:27.494079+0000","last_became_active":"2024-09-12T18:26:25.483909+0000","last_became_peered":"2024-09-12T18:26:25.483909+0000","last_unstale":"2024-09-12T18:26:27.494079+0000","last_undegraded":"2024-09-12T18:26:27.494079+0000","last_fullsized":"2024-09-12T18:26:27.494079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:34.647003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002260153,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:27.893863+0000","last_change":"2024-09-12T18:26:27.893863+0000","last_active":"2024-09-12T18:26:27.893863+0000","last_peered":"2024-09-12T18:26:27.893863+0000","last_clean":"2024-09-12T18:26:27.893863+0000","last_became_active":"2024-09-12T18:26:25.559069+0000","last_became_peered":"2024-09-12T18:26:25.559069+0000","last_unstale":"2024-09-12T18:26:27.893863+0000","last_undegraded":"2024-09-12T18:26:27.893863+0000","last_fullsized":"2024-09-12T18:26:27.893863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:18.983449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065344600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:28.282277+0000","last_change":"2024-09-12T18:26:28.282837+0000","last_active":"2024-09-12T18:26:28.282277+0000","last_peered":"2024-09-12T18:26:28.282277+0000","last_clean":"2024-09-12T18:26:28.282277+0000","last_became_active":"2024-09-12T18:26:25.486681+0000","last_became_peered":"2024-09-12T18:26:25.486681+0000","last_unstale":"2024-09-12T18:26:28.282277+0000","last_undegraded":"2024-09-12T18:26:28.282277+0000","last_fullsized":"2024-09-12T18:26:28.282277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:48.632695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001127308,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:27.490424+0000","last_change":"2024-09-12T18:26:27.490424+0000","last_active":"2024-09-12T18:26:27.490424+0000","last_peered":"2024-09-12T18:26:27.490424+0000","last_clean":"2024-09-12T18:26:27.490424+0000","last_became_active":"2024-09-12T18:26:25.483072+0000","last_became_peered":"2024-09-12T18:26:25.483072+0000","last_unstale":"2024-09-12T18:26:27.490424+0000","last_undegraded":"2024-09-12T18:26:27.490424+0000","last_fullsized":"2024-09-12T18:26:27.490424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:05.867109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010071489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T18:26:28.281494+0000","last_change":"2024-09-12T18:26:20.490476+0000","last_active":"2024-09-12T18:26:28.281494+0000","last_peered":"2024-09-12T18:26:28.281494+0000","last_clean":"2024-09-12T18:26:28.281494+0000","last_became_active":"2024-09-12T18:26:20.488464+0000","last_became_peered":"2024-09-12T18:26:20.488464+0000","last_unstale":"2024-09-12T18:26:28.281494+0000","last_undegraded":"2024-09-12T18:26:28.281494+0000","last_fullsized":"2024-09-12T18:26:28.281494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:19.397195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:19.397195+0000","last_clean_scrub_stamp":"2024-09-12T18:26:19.397195+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:55.130875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509444,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":665188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":659356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":74839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T18:26:33.608 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T18:26:33.608 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T18:26:33.608 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T18:26:33.609 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T18:26:33.930 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:26:33.930 INFO:teuthology.orchestra.run.smithi111.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T18:26:33.948 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T18:26:33.948 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T18:26:33.961 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-12T18:26:33.961 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T18:26:33.967 DEBUG:teuthology.orchestra.run.smithi111:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-12T18:26:34.410 INFO:teuthology.orchestra.run.smithi111.stderr:...+..........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+.........+...+...+....................+...................+...+......+..+......................+.....+.+......+........+.......+...+...+.......................+....+........+.........+.+.....+..........+..+............+............................+..+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T18:26:34.660 INFO:teuthology.orchestra.run.smithi111.stderr:..+.........+.......+...+..+.+........+.+.....+....+..+.......+..+...+...+....+...+..+...+.......+......+..+...+....+...+...+..+.......+......+..+.+..+...+......+.+..+......+......+.............+...+..+..........+.....+..........+...+.....+...+.+.....+....+...........+....+..+....+...+..+......+...+....+..+....+..+...+......+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*........+..............+....+...+...+......+...........+...+....+...+...+..+...+....+.....+.+............+..+......+.........+......+..........+..+............+.+..............+.+..+............+.+..+....+..............+.+.........+..+...+....+..+......+...+.+......+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+.................+......+.......+...+......+......+..+......+..........+..+...+......+.............+...........+.........+.+..+..........+.........+........+......+....+..+...+............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T18:26:34.675 INFO:teuthology.orchestra.run.smithi111.stderr:----- 2024-09-12T18:26:34.683 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/local/share/ca-certificates/root.crt 2024-09-12T18:26:34.781 DEBUG:teuthology.orchestra.run.smithi111:> sudo update-ca-certificates 2024-09-12T18:26:34.805 INFO:teuthology.orchestra.run.smithi111.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T18:26:35.448 INFO:teuthology.orchestra.run.smithi111.stderr:rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-12T18:26:35.468 INFO:teuthology.orchestra.run.smithi111.stdout:1 added, 0 removed; done. 2024-09-12T18:26:35.474 INFO:teuthology.orchestra.run.smithi111.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T18:26:35.478 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:26:37.159 INFO:teuthology.orchestra.run.smithi111.stdout:Adding debian:root.pem 2024-09-12T18:26:37.182 INFO:teuthology.orchestra.run.smithi111.stdout:done. 2024-09-12T18:26:37.182 INFO:teuthology.orchestra.run.smithi111.stdout:done. 2024-09-12T18:26:37.187 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T18:26:37.234 DEBUG:teuthology.orchestra.run.smithi111:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi111.front.sepia.ceph.com 2024-09-12T18:26:37.965 INFO:teuthology.orchestra.run.smithi111.stderr:.+.......+........+.+..+...+.+..................+..+.+............+..+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.+...............+.........+..+.......+.....+.............+...+............+.....+....+.....+...+.+......+......+...+..+...+......+....+...............+.........+..+.+............+.................+......+....+.........+..+...+.+......+..+...+...+....+..+..........+......+.........+..................+..+......+.........+..........+........+.+.................+.......+............+.....+.+...+.....+.+...+........+.......+..+....+............+.................+.+......+......+..+.+......+........+......+..........+..+....+...........+.......+..+.........+....+.....+..........+..+................+........+.+......+..+.+.....................+.....+.+.....+....+......+.....+.........+.............+......+..+....+...+...+........+......+.+..+.............+...+.....+.........+...+.......+..+....+..+...+......+.............+.....+......+....+.....+............+.+.........+.....+....+..+...+.+........+...+...............+......................+.....+.+.....+....+.....+..........+...+...+.....+.+.....+....+.....+......+.+..+......+.........................+..+.........+....+.....................+.....+....+......+...........+............+..........+..+.+.....+.......+..+......+....+.....+.........+................+...+.....+.+.....+................+........+......+....+...........+....+...+............+........+...+.......+..+...+...+................+.........+..+...+.+.....+...+...+..........+...+............+..+.......+.........+......+...+.....+...+....+........+.+...........+...+.+.....+......+...+...+....+...+...+....................+....+...+...........+....+...+...+.....+.......+...+..............+...+.........+...+...+.........+.+............+..+....+..+.......+.....+.+.....+.+...+............+...+.....+.+...........+...+.+..+.......+..+...............+.+............+..+....+..............+......+.......+.............................+..........+.....+.+........+.+...+...........+....+.....+.+..+.............+.....+.+.........+.....+....+...........+.....................+.+..............+.+....................+.........+..........+.........+..+.......+..+.+..+......+................+...+........+...+......+....+.....+.......+..+..........+..+...+..........+...+..+.+...............+............+..+...+....+...+........+...+.+.........+..............+.........................+...+..+.+...........+.+...+.................+............+............+....+............+...+..+.............+.....+.+........+......+....+..+...+......+.+.....+.+............+...+..+......+......+.............+..+.+...+......+.....+....+..............+.......+...+..+....+...............+..+....+...+...+..+...+...+....+..+.........+.........+.+..+.......+..+...+..........+.....+...+....+.....+...+......+..........+..+......................+...+.................+.+...........+...+.+......+...+......+.....+.........+......+.......+.....+....+...+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T18:26:38.018 INFO:teuthology.orchestra.run.smithi111.stderr:.....+..+.+.....................+...+..+.+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+...+...................+.....+...+....+...+...+..+......+......+...............+.............+..+...+......+.+..............+......+.+...+...........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+...+..+.......+.....+.+........+.......+..+.+..+.............+.........+...+...+..+.........+.........+...............+.+...+..+.+..+............+.+.................+.+..+............+.+.....+.+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T18:26:38.021 INFO:teuthology.orchestra.run.smithi111.stderr:----- 2024-09-12T18:26:38.024 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:26:38.024 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T18:26:38.070 DEBUG:teuthology.orchestra.run.smithi111:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T18:26:38.120 INFO:teuthology.orchestra.run.smithi111.stderr:Certificate request self-signature ok 2024-09-12T18:26:38.121 INFO:teuthology.orchestra.run.smithi111.stderr:subject=CN = smithi111.front.sepia.ceph.com 2024-09-12T18:26:38.133 DEBUG:teuthology.orchestra.run.smithi111:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T18:26:38.181 DEBUG:teuthology.orchestra.run.smithi111:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T18:26:38.233 INFO:teuthology.orchestra.run.smithi111.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-12T18:26:38.234 DEBUG:teuthology.orchestra.run.smithi111:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T18:26:38.282 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T18:26:38.298 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0'}} 2024-09-12T18:26:38.298 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T18:26:38.298 INFO:tasks.rgw:Creating data pools 2024-09-12T18:26:38.298 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T18:26:38.298 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-12T18:26:38.805 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T18:26:38.834 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T18:26:39.821 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T18:26:39.937 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T18:26:40.845 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T18:26:40.870 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T18:26:41.825 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T18:26:41.865 DEBUG:tasks.rgw:Pools created 2024-09-12T18:26:41.865 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T18:26:41.865 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T18:26:41.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T18:26:41.865 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T18:26:41.919 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:26:41.919 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:26:43.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:43.919+0000 7f0a37973640 0 -- 172.21.15.111:0/1530370515 >> [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] conn(0x7f090c0709f0 msgr2=0x7f090c072eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:26:43.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:43.927+0000 7f0a39e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:43.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:43.927+0000 7f0a37172640 0 -- 172.21.15.111:0/1192516402 >> [v2:172.21.15.111:6800/2832238944,v1:172.21.15.111:6801/2832238944] conn(0x55627e47d630 msgr2=0x55627e47faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:26:44.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.131+0000 7f0a39e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:44.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.131+0000 7f0a39e6d9c0 20 realm 2024-09-12T18:26:44.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.131+0000 7f0a39e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:44.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.131+0000 7f0a39e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:44.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.131+0000 7f0a39e6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:26:44.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.131+0000 7f0a39e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:44.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.131+0000 7f0a39e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:44.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.131+0000 7f0a39e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:44.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.135+0000 7f0a39e6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:26:44.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.135+0000 7f0a39e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:44.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.139+0000 7f0a39e6d9c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T18:26:44.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.139+0000 7f0a39e6d9c0 20 searching for the correct realm 2024-09-12T18:26:44.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.167+0000 7f0a39e6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:26:44.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.167+0000 7f0a39e6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:26:44.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.167+0000 7f0a39e6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:26:44.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.167+0000 7f0a39e6d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:26:44.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.167+0000 7f0a39e6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:26:44.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.167+0000 7f0a39e6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:26:44.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.167+0000 7f0a39e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:44.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.171+0000 7f0a39e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:44.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.171+0000 7f0a39e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:44.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.171+0000 7f0a39e6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:26:44.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.171+0000 7f0a39e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:44.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.171+0000 7f0a39e6d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T18:26:44.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.171+0000 7f0a39e6d9c0 20 zone default found 2024-09-12T18:26:44.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.171+0000 7f0a39e6d9c0 4 Realm: () 2024-09-12T18:26:44.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.171+0000 7f0a39e6d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:26:44.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.171+0000 7f0a39e6d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:26:44.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.171+0000 7f0a39e6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:26:44.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.171+0000 7f0a39e6d9c0 20 zonegroup default 2024-09-12T18:26:44.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.171+0000 7f0a39e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:44.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.175+0000 7f0a39e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:44.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:44.175+0000 7f0a39e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:45.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:45.863+0000 7f0a39e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:45.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:45.863+0000 7f0a39e6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:45.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:45.867+0000 7f0a39e6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:45.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:45.867+0000 7f0a39e6d9c0 20 started sync module instance, tier type = 2024-09-12T18:26:45.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:45.867+0000 7f0a39e6d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:26:47.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.915+0000 7f0a39e6d9c0 20 add_watcher() i=0 2024-09-12T18:26:47.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.915+0000 7f0a39e6d9c0 20 add_watcher() i=1 2024-09-12T18:26:47.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.915+0000 7f0a39e6d9c0 20 add_watcher() i=2 2024-09-12T18:26:47.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.915+0000 7f0a39e6d9c0 20 add_watcher() i=3 2024-09-12T18:26:47.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.915+0000 7f0a39e6d9c0 20 add_watcher() i=4 2024-09-12T18:26:47.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.915+0000 7f0a39e6d9c0 20 add_watcher() i=5 2024-09-12T18:26:47.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.915+0000 7f0a39e6d9c0 20 add_watcher() i=6 2024-09-12T18:26:47.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.919+0000 7f0a39e6d9c0 20 add_watcher() i=7 2024-09-12T18:26:47.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.919+0000 7f0a39e6d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:26:47.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.919+0000 7f0a39e6d9c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T18:26:47.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.919+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T18:26:47.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.919+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.919+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T18:26:47.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.919+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T18:26:47.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.919+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T18:26:47.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T18:26:47.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T18:26:47.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T18:26:47.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T18:26:47.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T18:26:47.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T18:26:47.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T18:26:47.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T18:26:47.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T18:26:47.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T18:26:47.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T18:26:47.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T18:26:47.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T18:26:47.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T18:26:47.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T18:26:47.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.923+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T18:26:47.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T18:26:47.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T18:26:47.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T18:26:47.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T18:26:47.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T18:26:47.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T18:26:47.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T18:26:47.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T18:26:47.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T18:26:47.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T18:26:47.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T18:26:47.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T18:26:47.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T18:26:47.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T18:26:47.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T18:26:47.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.927+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T18:26:47.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T18:26:47.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T18:26:47.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T18:26:47.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T18:26:47.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T18:26:47.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T18:26:47.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T18:26:47.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T18:26:47.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T18:26:47.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T18:26:47.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T18:26:47.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T18:26:47.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T18:26:47.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.931+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T18:26:47.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T18:26:47.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T18:26:47.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T18:26:47.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T18:26:47.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T18:26:47.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T18:26:47.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T18:26:47.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T18:26:47.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T18:26:47.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T18:26:47.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T18:26:47.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T18:26:47.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T18:26:47.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T18:26:47.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T18:26:47.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.935+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T18:26:47.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T18:26:47.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T18:26:47.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T18:26:47.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T18:26:47.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T18:26:47.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T18:26:47.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T18:26:47.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T18:26:47.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T18:26:47.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T18:26:47.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T18:26:47.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T18:26:47.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T18:26:47.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.939+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T18:26:47.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T18:26:47.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T18:26:47.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T18:26:47.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T18:26:47.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T18:26:47.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T18:26:47.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T18:26:47.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T18:26:47.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T18:26:47.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T18:26:47.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T18:26:47.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T18:26:47.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T18:26:47.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.943+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T18:26:47.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T18:26:47.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T18:26:47.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T18:26:47.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T18:26:47.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T18:26:47.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T18:26:47.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T18:26:47.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T18:26:47.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T18:26:47.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T18:26:47.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T18:26:47.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T18:26:47.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T18:26:47.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T18:26:47.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T18:26:47.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T18:26:47.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T18:26:47.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.947+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T18:26:47.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T18:26:47.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T18:26:47.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T18:26:47.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T18:26:47.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T18:26:47.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T18:26:47.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T18:26:47.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T18:26:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T18:26:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T18:26:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T18:26:47.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T18:26:47.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T18:26:47.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.951+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T18:26:47.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T18:26:47.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T18:26:47.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T18:26:47.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T18:26:47.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T18:26:47.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T18:26:47.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T18:26:47.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T18:26:47.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T18:26:47.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T18:26:47.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T18:26:47.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T18:26:47.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T18:26:47.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.955+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T18:26:47.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T18:26:47.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T18:26:47.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T18:26:47.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T18:26:47.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T18:26:47.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T18:26:47.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T18:26:47.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T18:26:47.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T18:26:47.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T18:26:47.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T18:26:47.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T18:26:47.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T18:26:47.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.959+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T18:26:47.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T18:26:47.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T18:26:47.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T18:26:47.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T18:26:47.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T18:26:47.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T18:26:47.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T18:26:47.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T18:26:47.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T18:26:47.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T18:26:47.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T18:26:47.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.963+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T18:26:47.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T18:26:47.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T18:26:47.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T18:26:47.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T18:26:47.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T18:26:47.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T18:26:47.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T18:26:47.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T18:26:47.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T18:26:47.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T18:26:47.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T18:26:47.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.967+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T18:26:47.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T18:26:47.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T18:26:47.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T18:26:47.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T18:26:47.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T18:26:47.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T18:26:47.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T18:26:47.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T18:26:47.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T18:26:47.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T18:26:47.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T18:26:47.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.971+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T18:26:47.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T18:26:47.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T18:26:47.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T18:26:47.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T18:26:47.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T18:26:47.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T18:26:47.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T18:26:47.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T18:26:47.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T18:26:47.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T18:26:47.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T18:26:47.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.975+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T18:26:47.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T18:26:47.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T18:26:47.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T18:26:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T18:26:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T18:26:47.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T18:26:47.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T18:26:47.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T18:26:47.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T18:26:47.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T18:26:47.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T18:26:47.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T18:26:47.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T18:26:47.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.979+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T18:26:47.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T18:26:47.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T18:26:47.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T18:26:47.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T18:26:47.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T18:26:47.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T18:26:47.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T18:26:47.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T18:26:47.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T18:26:47.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T18:26:47.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T18:26:47.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T18:26:47.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T18:26:47.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.983+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T18:26:47.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T18:26:47.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T18:26:47.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T18:26:47.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T18:26:47.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T18:26:47.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T18:26:47.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T18:26:47.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T18:26:47.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T18:26:47.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T18:26:47.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T18:26:47.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T18:26:47.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T18:26:47.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.987+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T18:26:47.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T18:26:47.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T18:26:47.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T18:26:47.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T18:26:47.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T18:26:47.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T18:26:47.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T18:26:47.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T18:26:47.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T18:26:47.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T18:26:47.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T18:26:47.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.991+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:47.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.995+0000 7f0a39e6d9c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T18:26:47.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.995+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T18:26:48.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:47.995+0000 7f0a39e6d9c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T18:26:48.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:48.007+0000 7f08e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:26:48.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:48.007+0000 7f0a39e6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:26:48.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:48.007+0000 7f0a39e6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:26:50.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.887+0000 7f0a39e6d9c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T18:26:50.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.887+0000 7f0a39e6d9c0 5 note: GC not initialized 2024-09-12T18:26:50.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.903+0000 7f08e8fe1640 20 reqs_thread_entry: start 2024-09-12T18:26:50.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.903+0000 7f0a39e6d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:26:50.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.903+0000 7f0a39e6d9c0 20 Filter name: none 2024-09-12T18:26:50.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.903+0000 7f08527fc640 20 reqs_thread_entry: start 2024-09-12T18:26:50.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.959+0000 7f08e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:26:50.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.967+0000 7f0a39e6d9c0 20 remove_watcher() i=0 2024-09-12T18:26:50.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.967+0000 7f0a39e6d9c0 2 removed watcher, disabling cache 2024-09-12T18:26:50.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.967+0000 7f0a39e6d9c0 20 remove_watcher() i=1 2024-09-12T18:26:50.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.971+0000 7f0a39e6d9c0 20 remove_watcher() i=2 2024-09-12T18:26:50.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.971+0000 7f0a39e6d9c0 20 remove_watcher() i=3 2024-09-12T18:26:50.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.975+0000 7f0a39e6d9c0 20 remove_watcher() i=4 2024-09-12T18:26:50.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.979+0000 7f0a39e6d9c0 20 remove_watcher() i=5 2024-09-12T18:26:50.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.979+0000 7f0a39e6d9c0 20 remove_watcher() i=6 2024-09-12T18:26:50.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:50.983+0000 7f0a39e6d9c0 20 remove_watcher() i=7 2024-09-12T18:26:51.004 INFO:teuthology.orchestra.run.smithi111.stdout:[] 2024-09-12T18:26:51.005 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T18:26:51.005 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T18:26:51.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T18:26:51.005 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T18:26:51.047 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:26:51.047 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:26:51.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.071+0000 7fc22efa59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:26:51.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.071+0000 7fc22efa59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:26:51.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.075+0000 7fc072ffd640 20 reqs_thread_entry: start 2024-09-12T18:26:51.100 INFO:teuthology.orchestra.run.smithi111.stdout:{"id":"97c2b296-1395-4700-8053-4f06c4c86557","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T18:26:51.101 DEBUG:tasks.util.rgw: json result: {'id': '97c2b296-1395-4700-8053-4f06c4c86557', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T18:26:51.101 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T18:26:51.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T18:26:51.102 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T18:26:51.175 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:26:51.176 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:26:51.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.211+0000 7efecdc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.215+0000 7efecdc3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:51.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.215+0000 7efecdc3a9c0 20 realm 2024-09-12T18:26:51.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.215+0000 7efecdc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.215+0000 7efecdc3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:51.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.215+0000 7efecdc3a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:26:51.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.215+0000 7efecdc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.215+0000 7efecdc3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:51.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.215+0000 7efecdc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.215+0000 7efecdc3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:26:51.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.215+0000 7efecdc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.219+0000 7efecdc3a9c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T18:26:51.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.219+0000 7efecdc3a9c0 20 searching for the correct realm 2024-09-12T18:26:51.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.219+0000 7efecbf41640 0 -- 172.21.15.111:0/3763382295 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7efeb4008050 msgr2=0x7efeb407c790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:26:51.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.227+0000 7efecaf3f640 0 -- 172.21.15.111:0/3763382295 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7efec40a9070 msgr2=0x7efec4123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:26:51.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.443+0000 7efecdc3a9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:26:51.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.443+0000 7efecdc3a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:26:51.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.443+0000 7efecdc3a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:26:51.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.443+0000 7efecdc3a9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:26:51.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.443+0000 7efecdc3a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:26:51.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.443+0000 7efecdc3a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:26:51.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.443+0000 7efecdc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.443+0000 7efecdc3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:51.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.443+0000 7efecdc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:26:51.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T18:26:51.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 20 zone default found 2024-09-12T18:26:51.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 4 Realm: () 2024-09-12T18:26:51.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:26:51.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:26:51.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:26:51.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 20 zonegroup default 2024-09-12T18:26:51.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:51.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:51.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:51.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 20 started sync module instance, tier type = 2024-09-12T18:26:51.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.447+0000 7efecdc3a9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:26:51.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.471+0000 7efecdc3a9c0 20 add_watcher() i=0 2024-09-12T18:26:51.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.471+0000 7efecdc3a9c0 20 add_watcher() i=1 2024-09-12T18:26:51.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.471+0000 7efecdc3a9c0 20 add_watcher() i=2 2024-09-12T18:26:51.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.471+0000 7efecdc3a9c0 20 add_watcher() i=3 2024-09-12T18:26:51.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.471+0000 7efecdc3a9c0 20 add_watcher() i=4 2024-09-12T18:26:51.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.471+0000 7efecdc3a9c0 20 add_watcher() i=5 2024-09-12T18:26:51.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.471+0000 7efecdc3a9c0 20 add_watcher() i=6 2024-09-12T18:26:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.471+0000 7efecdc3a9c0 20 add_watcher() i=7 2024-09-12T18:26:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.471+0000 7efecdc3a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:26:51.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.475+0000 7efd81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:26:51.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.475+0000 7efecdc3a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:26:51.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.475+0000 7efecdc3a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:26:51.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.475+0000 7efecdc3a9c0 5 note: GC not initialized 2024-09-12T18:26:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.475+0000 7efd80fe1640 20 reqs_thread_entry: start 2024-09-12T18:26:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.475+0000 7efecdc3a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:26:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.475+0000 7efecdc3a9c0 20 Filter name: none 2024-09-12T18:26:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.479+0000 7efcfa7fc640 20 reqs_thread_entry: start 2024-09-12T18:26:51.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.495+0000 7efd81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:26:51.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.503+0000 7efecdc3a9c0 20 remove_watcher() i=0 2024-09-12T18:26:51.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.503+0000 7efecdc3a9c0 2 removed watcher, disabling cache 2024-09-12T18:26:51.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.503+0000 7efecdc3a9c0 20 remove_watcher() i=1 2024-09-12T18:26:51.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.507+0000 7efecdc3a9c0 20 remove_watcher() i=2 2024-09-12T18:26:51.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.511+0000 7efecdc3a9c0 20 remove_watcher() i=3 2024-09-12T18:26:51.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.511+0000 7efecdc3a9c0 20 remove_watcher() i=4 2024-09-12T18:26:51.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.511+0000 7efecdc3a9c0 20 remove_watcher() i=5 2024-09-12T18:26:51.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.515+0000 7efecdc3a9c0 20 remove_watcher() i=6 2024-09-12T18:26:51.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.515+0000 7efecdc3a9c0 20 remove_watcher() i=7 2024-09-12T18:26:51.534 INFO:teuthology.orchestra.run.smithi111.stdout:[] 2024-09-12T18:26:51.535 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T18:26:51.535 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T18:26:51.535 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T18:26:51.535 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T18:26:51.620 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:26:51.620 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:26:51.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.647+0000 7f4d056579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:26:51.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.647+0000 7f4d056579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:26:51.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.651+0000 7f4b49ffb640 20 reqs_thread_entry: start 2024-09-12T18:26:51.674 INFO:teuthology.orchestra.run.smithi111.stdout:{"id":"97c2b296-1395-4700-8053-4f06c4c86557","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T18:26:51.674 DEBUG:tasks.util.rgw: json result: {'id': '97c2b296-1395-4700-8053-4f06c4c86557', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T18:26:51.674 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T18:26:51.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T18:26:51.675 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T18:26:51.746 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:26:51.747 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:26:51.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.783+0000 7f51e1f019c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.787+0000 7f51e1f019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:51.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.787+0000 7f51e1f019c0 20 realm 2024-09-12T18:26:51.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.787+0000 7f51e1f019c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.787+0000 7f51e1f019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:51.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.787+0000 7f51e1f019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:26:51.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.787+0000 7f51e1f019c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.787+0000 7f51e1f019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:51.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.787+0000 7f51e1f019c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.787+0000 7f51e1f019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:26:51.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.787+0000 7f51e1f019c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:51.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.787+0000 7f51e1f019c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T18:26:51.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.787+0000 7f51e1f019c0 20 searching for the correct realm 2024-09-12T18:26:51.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:51.791+0000 7f51df206640 0 -- 172.21.15.111:0/1503488463 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f51c801c040 msgr2=0x7f51c8038410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:26:52.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.003+0000 7f51dfa07640 0 -- 172.21.15.111:0/1503488463 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f51d0096c20 msgr2=0x7f51d007e530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:26:52.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.019+0000 7f51e1f019c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:26:52.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.019+0000 7f51e1f019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:26:52.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.019+0000 7f51e1f019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:26:52.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.019+0000 7f51e1f019c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:26:52.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.019+0000 7f51e1f019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:26:52.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.019+0000 7f51e1f019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:26:52.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.019+0000 7f51e1f019c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:52.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.019+0000 7f51e1f019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:52.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.019+0000 7f51e1f019c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:52.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.019+0000 7f51e1f019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:26:52.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.019+0000 7f51e1f019c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:52.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T18:26:52.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 20 zone default found 2024-09-12T18:26:52.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 4 Realm: () 2024-09-12T18:26:52.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:26:52.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:26:52.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:26:52.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 20 zonegroup default 2024-09-12T18:26:52.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:52.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:52.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:52.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:52.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 20 rados->read ofs=0 len=0 2024-09-12T18:26:52.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:26:52.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 20 started sync module instance, tier type = 2024-09-12T18:26:52.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.023+0000 7f51e1f019c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:26:52.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.051+0000 7f51e1f019c0 20 add_watcher() i=0 2024-09-12T18:26:52.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.051+0000 7f51e1f019c0 20 add_watcher() i=1 2024-09-12T18:26:52.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.051+0000 7f51e1f019c0 20 add_watcher() i=2 2024-09-12T18:26:52.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.051+0000 7f51e1f019c0 20 add_watcher() i=3 2024-09-12T18:26:52.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.051+0000 7f51e1f019c0 20 add_watcher() i=4 2024-09-12T18:26:52.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.051+0000 7f51e1f019c0 20 add_watcher() i=5 2024-09-12T18:26:52.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.051+0000 7f51e1f019c0 20 add_watcher() i=6 2024-09-12T18:26:52.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.051+0000 7f51e1f019c0 20 add_watcher() i=7 2024-09-12T18:26:52.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.051+0000 7f51e1f019c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:26:52.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.055+0000 7f5095fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:26:52.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.055+0000 7f51e1f019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:26:52.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.055+0000 7f51e1f019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:26:52.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.055+0000 7f51e1f019c0 5 note: GC not initialized 2024-09-12T18:26:52.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.055+0000 7f5094fe1640 20 reqs_thread_entry: start 2024-09-12T18:26:52.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.055+0000 7f51e1f019c0 20 init_complete bucket index max shards: 11 2024-09-12T18:26:52.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.055+0000 7f51e1f019c0 20 Filter name: none 2024-09-12T18:26:52.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.059+0000 7f500e7fc640 20 reqs_thread_entry: start 2024-09-12T18:26:52.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.079+0000 7f5095fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:26:52.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.083+0000 7f51e1f019c0 20 remove_watcher() i=0 2024-09-12T18:26:52.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.083+0000 7f51e1f019c0 2 removed watcher, disabling cache 2024-09-12T18:26:52.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.086+0000 7f51e1f019c0 20 remove_watcher() i=1 2024-09-12T18:26:52.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.090+0000 7f51e1f019c0 20 remove_watcher() i=2 2024-09-12T18:26:52.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.090+0000 7f51e1f019c0 20 remove_watcher() i=3 2024-09-12T18:26:52.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.094+0000 7f51e1f019c0 20 remove_watcher() i=4 2024-09-12T18:26:52.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.094+0000 7f51e1f019c0 20 remove_watcher() i=5 2024-09-12T18:26:52.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.094+0000 7f51e1f019c0 20 remove_watcher() i=6 2024-09-12T18:26:52.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.098+0000 7f51e1f019c0 20 remove_watcher() i=7 2024-09-12T18:26:52.120 INFO:teuthology.orchestra.run.smithi111.stdout:[] 2024-09-12T18:26:52.120 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T18:26:52.121 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T18:26:52.121 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T18:26:52.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T18:26:52.121 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T18:26:52.208 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:26:52.208 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:26:52.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.234+0000 7f9ef6d539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:26:52.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.234+0000 7f9ef6d539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:26:52.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.238+0000 7f9d3affd640 20 reqs_thread_entry: start 2024-09-12T18:26:52.262 INFO:teuthology.orchestra.run.smithi111.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T18:26:52.262 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T18:26:52.262 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T18:26:52.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T18:26:52.263 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T18:26:52.348 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:26:52.348 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:26:52.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.370+0000 7f9a371ca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:26:52.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.370+0000 7f9a371ca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:26:52.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.374+0000 7f987affd640 20 reqs_thread_entry: start 2024-09-12T18:26:52.401 INFO:teuthology.orchestra.run.smithi111.stdout:{"id":"97c2b296-1395-4700-8053-4f06c4c86557","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T18:26:52.402 DEBUG:tasks.util.rgw: json result: {'id': '97c2b296-1395-4700-8053-4f06c4c86557', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T18:26:52.402 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T18:26:52.402 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T18:26:52.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T18:26:52.402 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T18:26:52.485 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:26:52.485 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:26:52.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.506+0000 7fa3f4a419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:26:52.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.506+0000 7fa3f4a419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:26:52.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.510+0000 7fa2b4fe1640 20 reqs_thread_entry: start 2024-09-12T18:26:52.537 INFO:teuthology.orchestra.run.smithi111.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T18:26:52.537 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T18:26:52.537 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T18:26:52.537 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T18:26:52.537 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T18:26:52.618 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:26:52.618 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:26:52.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.642+0000 7f44462d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:26:52.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.642+0000 7f44462d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:26:52.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:26:52.646+0000 7f4301ffb640 20 reqs_thread_entry: start 2024-09-12T18:26:52.670 INFO:teuthology.orchestra.run.smithi111.stdout:{"id":"97c2b296-1395-4700-8053-4f06c4c86557","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T18:26:52.671 DEBUG:tasks.util.rgw: json result: {'id': '97c2b296-1395-4700-8053-4f06c4c86557', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T18:26:52.671 INFO:tasks.rgw:Starting rgw... 2024-09-12T18:26:52.671 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2024-09-12T18:26:52.671 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T18:26:52.671 DEBUG:teuthology.orchestra.run.smithi111:> sudo echo -n https://smithi111.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T18:26:52.725 INFO:teuthology.orchestra.run.smithi111.stdout:https://smithi111.front.sepia.ceph.com:443 2024-09-12T18:26:52.725 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T18:26:52.782 DEBUG:teuthology.orchestra.run.smithi111:> sudo keytool -import -alias smithi111.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-12T18:26:53.150 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-12T18:26:53.413 INFO:teuthology.orchestra.run.smithi111.stderr:Certificate was added to keystore 2024-09-12T18:26:53.457 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T18:26:53.457 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T18:26:53.459 INFO:tasks.rgw.client.0:Started 2024-09-12T18:26:53.459 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi111.front.sepia.ceph.com:443/ 2024-09-12T18:26:53.460 DEBUG:teuthology.orchestra.run.smithi111:> curl https://smithi111.front.sepia.ceph.com:443/ 2024-09-12T18:26:53.489 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T18:26:53.490 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2024-09-12T18:26:53.491 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T18:26:53.492 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T18:26:53.492 INFO:teuthology.orchestra.run.smithi111.stderr:curl: (7) Failed to connect to smithi111.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T18:26:53.779 INFO:tasks.rgw.client.0.smithi111.stdout:2024-09-12T18:26:53.774+0000 7fbe8c057a40 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-12T18:26:54.492 DEBUG:teuthology.orchestra.run.smithi111:> curl https://smithi111.front.sepia.ceph.com:443/ 2024-09-12T18:26:54.503 INFO:teuthology.orchestra.run.smithi111.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T18:26:54.503 INFO:teuthology.orchestra.run.smithi111.stderr: Dload Upload Total Spent Left Speed 2024-09-12T18:26:54.617 INFO:teuthology.orchestra.run.smithi111.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 1638 0 --:--:-- --:--:-- --:--:-- 1640 2024-09-12T18:26:54.621 INFO:teuthology.orchestra.run.smithi111.stdout:anonymous 2024-09-12T18:26:54.621 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T18:26:54.655 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T18:26:54.655 DEBUG:teuthology.orchestra.run.smithi111:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T18:26:57.570 DEBUG:teuthology.orchestra.run.smithi111:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T18:26:58.264 INFO:teuthology.orchestra.run.smithi111.stdout:Collecting tox==3.15.0 2024-09-12T18:26:58.360 INFO:teuthology.orchestra.run.smithi111.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T18:26:58.415 INFO:teuthology.orchestra.run.smithi111.stdout: ---------------------------------------- 82.1/82.1 KB 1.5 MB/s eta 0:00:00 2024-09-12T18:26:58.528 INFO:teuthology.orchestra.run.smithi111.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T18:26:58.543 INFO:teuthology.orchestra.run.smithi111.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T18:26:58.632 INFO:teuthology.orchestra.run.smithi111.stdout:Collecting toml>=0.9.4 2024-09-12T18:26:58.647 INFO:teuthology.orchestra.run.smithi111.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T18:26:58.743 INFO:teuthology.orchestra.run.smithi111.stdout:Collecting six<2,>=1.14.0 2024-09-12T18:26:58.759 INFO:teuthology.orchestra.run.smithi111.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T18:26:58.871 INFO:teuthology.orchestra.run.smithi111.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T18:26:58.885 INFO:teuthology.orchestra.run.smithi111.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T18:26:59.150 INFO:teuthology.orchestra.run.smithi111.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T18:26:59.164 INFO:teuthology.orchestra.run.smithi111.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T18:26:59.339 INFO:teuthology.orchestra.run.smithi111.stdout: ---------------------------------------- 6.0/6.0 MB 35.0 MB/s eta 0:00:00 2024-09-12T18:26:59.477 INFO:teuthology.orchestra.run.smithi111.stdout:Collecting packaging>=14 2024-09-12T18:26:59.491 INFO:teuthology.orchestra.run.smithi111.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T18:26:59.521 INFO:teuthology.orchestra.run.smithi111.stdout: ---------------------------------------- 54.0/54.0 KB 1.7 MB/s eta 0:00:00 2024-09-12T18:26:59.623 INFO:teuthology.orchestra.run.smithi111.stdout:Collecting py<2,>=1.4.17 2024-09-12T18:26:59.638 INFO:teuthology.orchestra.run.smithi111.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T18:26:59.681 INFO:teuthology.orchestra.run.smithi111.stdout: ---------------------------------------- 98.7/98.7 KB 2.3 MB/s eta 0:00:00 2024-09-12T18:26:59.870 INFO:teuthology.orchestra.run.smithi111.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T18:26:59.884 INFO:teuthology.orchestra.run.smithi111.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T18:26:59.986 INFO:teuthology.orchestra.run.smithi111.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T18:27:00.003 INFO:teuthology.orchestra.run.smithi111.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T18:27:00.050 INFO:teuthology.orchestra.run.smithi111.stdout: -------------------------------------- 468.9/468.9 KB 10.8 MB/s eta 0:00:00 2024-09-12T18:27:00.210 INFO:teuthology.orchestra.run.smithi111.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-12T18:27:01.159 INFO:teuthology.orchestra.run.smithi111.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T18:27:01.248 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T18:27:01.296 INFO:tasks.workunit:Pulling workunits from ref d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T18:27:01.297 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T18:27:01.297 DEBUG:teuthology.orchestra.run.smithi111:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:27:01.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:27:01.303 INFO:teuthology.orchestra.run.smithi111.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T18:27:01.303 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:27:01.350 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T18:27:01.350 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T18:27:01.401 INFO:tasks.workunit:timeout=3h 2024-09-12T18:27:01.402 INFO:tasks.workunit:cleanup=True 2024-09-12T18:27:01.402 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T18:27:01.451 INFO:tasks.workunit.client.0.smithi111.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:27:58.499 INFO:tasks.workunit.client.0.smithi111.stderr:Note: switching to 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'. 2024-09-12T18:27:58.500 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:27:58.500 INFO:tasks.workunit.client.0.smithi111.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:27:58.500 INFO:tasks.workunit.client.0.smithi111.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:27:58.500 INFO:tasks.workunit.client.0.smithi111.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:27:58.500 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:27:58.500 INFO:tasks.workunit.client.0.smithi111.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:27:58.500 INFO:tasks.workunit.client.0.smithi111.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:27:58.500 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:27:58.501 INFO:tasks.workunit.client.0.smithi111.stderr: git switch -c 2024-09-12T18:27:58.501 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:27:58.501 INFO:tasks.workunit.client.0.smithi111.stderr:Or undo this operation with: 2024-09-12T18:27:58.501 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:27:58.501 INFO:tasks.workunit.client.0.smithi111.stderr: git switch - 2024-09-12T18:27:58.501 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:27:58.501 INFO:tasks.workunit.client.0.smithi111.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:27:58.501 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:27:58.501 INFO:tasks.workunit.client.0.smithi111.stderr:HEAD is now at d011c522bb1 cls/rgw: duplicate reshard checks in all cls_rgw write operations 2024-09-12T18:27:58.506 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:27:58.553 INFO:tasks.workunit.client.0.smithi111.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:27:58.556 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:27:58.556 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:27:59.360 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:27:59.443 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:27:59.488 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:27:59.490 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:27:59.490 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:27:59.533 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:27:59.537 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:27:59.537 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:27:59.585 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T18:27:59.586 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T18:27:59.586 DEBUG:teuthology.orchestra.run.smithi111:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T18:27:59.638 INFO:tasks.workunit.client.0.smithi111.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T18:27:59.638 INFO:tasks.workunit.client.0.smithi111.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:27:59.639 INFO:tasks.workunit.client.0.smithi111.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:28:02.548 INFO:tasks.workunit.client.0.smithi111.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T18:28:02.548 INFO:tasks.workunit.client.0.smithi111.stderr:++ deactivate nondestructive 2024-09-12T18:28:02.548 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n '' ']' 2024-09-12T18:28:02.549 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n '' ']' 2024-09-12T18:28:02.549 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:28:02.549 INFO:tasks.workunit.client.0.smithi111.stderr:++ hash -r 2024-09-12T18:28:02.549 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n '' ']' 2024-09-12T18:28:02.549 INFO:tasks.workunit.client.0.smithi111.stderr:++ unset VIRTUAL_ENV 2024-09-12T18:28:02.549 INFO:tasks.workunit.client.0.smithi111.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T18:28:02.549 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T18:28:02.549 INFO:tasks.workunit.client.0.smithi111.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:28:02.549 INFO:tasks.workunit.client.0.smithi111.stderr:++ export VIRTUAL_ENV 2024-09-12T18:28:02.549 INFO:tasks.workunit.client.0.smithi111.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:28:02.550 INFO:tasks.workunit.client.0.smithi111.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:28:02.550 INFO:tasks.workunit.client.0.smithi111.stderr:++ export PATH 2024-09-12T18:28:02.550 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n '' ']' 2024-09-12T18:28:02.550 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -z '' ']' 2024-09-12T18:28:02.550 INFO:tasks.workunit.client.0.smithi111.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T18:28:02.551 INFO:tasks.workunit.client.0.smithi111.stderr:++ PS1='(rgw) ' 2024-09-12T18:28:02.551 INFO:tasks.workunit.client.0.smithi111.stderr:++ export PS1 2024-09-12T18:28:02.551 INFO:tasks.workunit.client.0.smithi111.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T18:28:02.551 INFO:tasks.workunit.client.0.smithi111.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T18:28:02.551 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:28:02.551 INFO:tasks.workunit.client.0.smithi111.stderr:++ hash -r 2024-09-12T18:28:02.551 INFO:tasks.workunit.client.0.smithi111.stderr:+ pip install pip --upgrade 2024-09-12T18:28:02.909 INFO:tasks.workunit.client.0.smithi111.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T18:28:03.144 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting pip 2024-09-12T18:28:03.243 INFO:tasks.workunit.client.0.smithi111.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T18:28:03.517 INFO:tasks.workunit.client.0.smithi111.stdout: ---------------------------------------- 1.8/1.8 MB 6.7 MB/s eta 0:00:00 2024-09-12T18:28:03.591 INFO:tasks.workunit.client.0.smithi111.stdout:Installing collected packages: pip 2024-09-12T18:28:03.591 INFO:tasks.workunit.client.0.smithi111.stdout: Attempting uninstall: pip 2024-09-12T18:28:03.592 INFO:tasks.workunit.client.0.smithi111.stdout: Found existing installation: pip 22.0.2 2024-09-12T18:28:03.874 INFO:tasks.workunit.client.0.smithi111.stdout: Uninstalling pip-22.0.2: 2024-09-12T18:28:03.880 INFO:tasks.workunit.client.0.smithi111.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T18:28:04.626 INFO:tasks.workunit.client.0.smithi111.stdout:Successfully installed pip-24.2 2024-09-12T18:28:04.686 INFO:tasks.workunit.client.0.smithi111.stderr:+ pip install boto3 2024-09-12T18:28:05.738 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting boto3 2024-09-12T18:28:05.781 INFO:tasks.workunit.client.0.smithi111.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T18:28:06.412 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T18:28:06.426 INFO:tasks.workunit.client.0.smithi111.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T18:28:06.565 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T18:28:06.580 INFO:tasks.workunit.client.0.smithi111.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T18:28:06.729 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T18:28:06.746 INFO:tasks.workunit.client.0.smithi111.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T18:28:06.907 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:28:06.923 INFO:tasks.workunit.client.0.smithi111.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T18:28:07.134 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:28:07.148 INFO:tasks.workunit.client.0.smithi111.stdout: Downloading urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T18:28:07.536 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:28:07.550 INFO:tasks.workunit.client.0.smithi111.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T18:28:07.626 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T18:28:07.721 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T18:28:07.965 INFO:tasks.workunit.client.0.smithi111.stdout: ---------------------------------------- 12.5/12.5 MB 54.1 MB/s eta 0:00:00 2024-09-12T18:28:07.982 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T18:28:08.047 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T18:28:08.115 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T18:28:08.189 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T18:28:08.268 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T18:28:08.443 INFO:tasks.workunit.client.0.smithi111.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T18:28:09.566 INFO:tasks.workunit.client.0.smithi111.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T18:28:10.030 INFO:tasks.workunit.client.0.smithi111.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T18:28:10.182 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T18:28:10.221 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:10.221 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:10.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.262+0000 7fbe5e6409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:10.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.262+0000 7fbe5e6409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:10.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.262+0000 7fbe5e6409c0 20 realm 2024-09-12T18:28:10.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.262+0000 7fbe5e6409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:10.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.266+0000 7fbe5e6409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:10.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.266+0000 7fbe5e6409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:10.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.266+0000 7fbe5e6409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:10.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.266+0000 7fbe5e6409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:10.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.266+0000 7fbe5e6409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:10.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.266+0000 7fbe5e6409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:10.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.266+0000 7fbe5e6409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:10.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.266+0000 7fbe5e6409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:10.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.266+0000 7fbe5e6409c0 20 searching for the correct realm 2024-09-12T18:28:10.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.270+0000 7fbe5c947640 0 -- 172.21.15.111:0/498165192 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fbe50033070 msgr2=0x7fbe5004a730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:28:10.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.486+0000 7fbe5b945640 0 -- 172.21.15.111:0/498165192 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fbe540fb310 msgr2=0x7fbe540e4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:10.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.702+0000 7fbe5e6409c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:10.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.702+0000 7fbe5e6409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:10.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.702+0000 7fbe5e6409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:10.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.702+0000 7fbe5e6409c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:10.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.702+0000 7fbe5e6409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:10.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.702+0000 7fbe5e6409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:10.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.702+0000 7fbe5e6409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:10.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.702+0000 7fbe5e6409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:10.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.702+0000 7fbe5e6409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:10.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.702+0000 7fbe5e6409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:10.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.702+0000 7fbe5e6409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:10.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:10.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 20 zone default found 2024-09-12T18:28:10.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 4 Realm: () 2024-09-12T18:28:10.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:10.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:10.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:10.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 20 zonegroup default 2024-09-12T18:28:10.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:10.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:10.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:10.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:10.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:10.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:10.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 20 started sync module instance, tier type = 2024-09-12T18:28:10.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.706+0000 7fbe5e6409c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:10.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.734+0000 7fbe5e6409c0 20 add_watcher() i=0 2024-09-12T18:28:10.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.734+0000 7fbe5e6409c0 20 add_watcher() i=1 2024-09-12T18:28:10.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.734+0000 7fbe5e6409c0 20 add_watcher() i=2 2024-09-12T18:28:10.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.734+0000 7fbe5e6409c0 20 add_watcher() i=3 2024-09-12T18:28:10.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.734+0000 7fbe5e6409c0 20 add_watcher() i=4 2024-09-12T18:28:10.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.734+0000 7fbe5e6409c0 20 add_watcher() i=5 2024-09-12T18:28:10.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.734+0000 7fbe5e6409c0 20 add_watcher() i=6 2024-09-12T18:28:10.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.738+0000 7fbe5e6409c0 20 add_watcher() i=7 2024-09-12T18:28:10.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.738+0000 7fbe5e6409c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:10.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbd12fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:10.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbe5e6409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:10.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbe5e6409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:10.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbe5e6409c0 5 note: GC not initialized 2024-09-12T18:28:10.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbd11fdb640 20 reqs_thread_entry: start 2024-09-12T18:28:10.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbe5e6409c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:10.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbe5e6409c0 20 Filter name: none 2024-09-12T18:28:10.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbc837fe640 20 reqs_thread_entry: start 2024-09-12T18:28:10.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbe5e6409c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T18:28:10.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbe5e6409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:10.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbe5e6409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:10.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbe5e6409c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T18:28:10.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbe5e6409c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T18:28:10.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbe5e6409c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T18:28:10.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.742+0000 7fbe5e6409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:10.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.746+0000 7fbe5e6409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:10.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.746+0000 7fbe5e6409c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T18:28:10.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.746+0000 7fbe5e6409c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T18:28:10.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.746+0000 7fbe5e6409c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T18:28:10.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.746+0000 7fbe5e6409c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T18:28:10.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.746+0000 7fbe5e6409c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T18:28:10.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.746+0000 7fbe5e6409c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T18:28:10.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.746+0000 7fbe5e6409c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T18:28:10.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.750+0000 7fbd337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 94593130414480 notifier 4710 bl.length()=593 2024-09-12T18:28:10.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.750+0000 7fbd337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T18:28:10.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.750+0000 7fbd337fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T18:28:10.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.754+0000 7fbe5e6409c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T18:28:10.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.754+0000 7fbe5e6409c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T18:28:10.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.754+0000 7fbe5e6409c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T18:28:10.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.754+0000 7fbd337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 163208757248 cookie 94593130407008 notifier 4710 bl.length()=186 2024-09-12T18:28:10.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.754+0000 7fbd337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T18:28:10.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.754+0000 7fbd337fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T18:28:10.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.754+0000 7fbd12fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:10.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.762+0000 7fbe5e6409c0 20 remove_watcher() i=0 2024-09-12T18:28:10.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.762+0000 7fbe5e6409c0 2 removed watcher, disabling cache 2024-09-12T18:28:10.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.762+0000 7fbe5e6409c0 20 remove_watcher() i=1 2024-09-12T18:28:10.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.766+0000 7fbe5e6409c0 20 remove_watcher() i=2 2024-09-12T18:28:10.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.766+0000 7fbe5e6409c0 20 remove_watcher() i=3 2024-09-12T18:28:10.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.770+0000 7fbe5e6409c0 20 remove_watcher() i=4 2024-09-12T18:28:10.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.770+0000 7fbe5e6409c0 20 remove_watcher() i=5 2024-09-12T18:28:10.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.770+0000 7fbe5e6409c0 20 remove_watcher() i=6 2024-09-12T18:28:10.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:10.774+0000 7fbe5e6409c0 20 remove_watcher() i=7 2024-09-12T18:28:10.946 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:10.947 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:10.995 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:10.995 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.044 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:11.044 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.074 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:11.075 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.098 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:11.098 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.106 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:11.106 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.126 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:11.126 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.137 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:11.137 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.148 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:11.148 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.185 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:11.185 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.193 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:11.193 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.230 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:11.230 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.239 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:11.239 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.276 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:11.276 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.285 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:11.285 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.318 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:11.318 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:11.323 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T18:28:11.323 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:28:11.324 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T18:28:11.359 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:11.359 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:11.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.402+0000 7f2945a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.402+0000 7f2945a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:11.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.402+0000 7f2945a5f9c0 20 realm 2024-09-12T18:28:11.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.402+0000 7f2945a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.402+0000 7f2945a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:11.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.402+0000 7f2945a5f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:11.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.402+0000 7f2945a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.402+0000 7f2945a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:11.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.402+0000 7f2945a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.406+0000 7f2945a5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:11.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.406+0000 7f2945a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.406+0000 7f2945a5f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:11.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.406+0000 7f2945a5f9c0 20 searching for the correct realm 2024-09-12T18:28:11.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.410+0000 7f2943d66640 0 -- 172.21.15.111:0/573533455 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f29380c0070 msgr2=0x7f29380ec4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:11.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.418+0000 7f2942d64640 0 -- 172.21.15.111:0/573533455 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f293c037950 msgr2=0x7f293c0503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:11.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.634+0000 7f2945a5f9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:11.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.634+0000 7f2945a5f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:11.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.634+0000 7f2945a5f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:11.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.634+0000 7f2945a5f9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:11.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.634+0000 7f2945a5f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:11.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.634+0000 7f2945a5f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:11.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.634+0000 7f2945a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.634+0000 7f2945a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:11.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.634+0000 7f2945a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.634+0000 7f2945a5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:11.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.634+0000 7f2945a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:11.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 20 zone default found 2024-09-12T18:28:11.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 4 Realm: () 2024-09-12T18:28:11.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:11.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:11.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:11.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 20 zonegroup default 2024-09-12T18:28:11.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:11.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:11.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:11.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 20 started sync module instance, tier type = 2024-09-12T18:28:11.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.638+0000 7f2945a5f9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:11.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.662+0000 7f2945a5f9c0 20 add_watcher() i=0 2024-09-12T18:28:11.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.662+0000 7f2945a5f9c0 20 add_watcher() i=1 2024-09-12T18:28:11.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.662+0000 7f2945a5f9c0 20 add_watcher() i=2 2024-09-12T18:28:11.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.662+0000 7f2945a5f9c0 20 add_watcher() i=3 2024-09-12T18:28:11.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.662+0000 7f2945a5f9c0 20 add_watcher() i=4 2024-09-12T18:28:11.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.662+0000 7f2945a5f9c0 20 add_watcher() i=5 2024-09-12T18:28:11.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.662+0000 7f2945a5f9c0 20 add_watcher() i=6 2024-09-12T18:28:11.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.666+0000 7f2945a5f9c0 20 add_watcher() i=7 2024-09-12T18:28:11.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.666+0000 7f2945a5f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:11.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f27f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:11.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f2945a5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:11.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f2945a5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:11.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f2945a5f9c0 5 note: GC not initialized 2024-09-12T18:28:11.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f27f8fe1640 20 reqs_thread_entry: start 2024-09-12T18:28:11.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f2945a5f9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:11.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f2945a5f9c0 20 Filter name: none 2024-09-12T18:28:11.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f27727fc640 20 reqs_thread_entry: start 2024-09-12T18:28:11.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f2945a5f9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T18:28:11.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f2945a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f2945a5f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:11.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f2945a5f9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T18:28:11.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f2945a5f9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T18:28:11.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f2945a5f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 : miss 2024-09-12T18:28:11.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.670+0000 7f2945a5f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.674+0000 7f2945a5f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:11.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.674+0000 7f2945a5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 info.flags=0x17 2024-09-12T18:28:11.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.674+0000 7f2945a5f9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 to cache LRU end 2024-09-12T18:28:11.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.674+0000 7f2945a5f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:28:11.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.674+0000 7f2945a5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T18:28:11.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.674+0000 7f2945a5f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 2024-09-12T18:28:11.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.674+0000 7f2945a5f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:11.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.674+0000 7f2945a5f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:11.681 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.678+0000 7f2945a5f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:11.681 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.678+0000 7f2945a5f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:11.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.678+0000 7f2945a5f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:11.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.682+0000 7f2945a5f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:11.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.682+0000 7f2945a5f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:11.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.682+0000 7f2945a5f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:11.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.686+0000 7f2945a5f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:11.690 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.686+0000 7f2945a5f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:11.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.686+0000 7f2945a5f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:11.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.702+0000 7f27f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:11.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.710+0000 7f2945a5f9c0 20 remove_watcher() i=0 2024-09-12T18:28:11.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.710+0000 7f2945a5f9c0 2 removed watcher, disabling cache 2024-09-12T18:28:11.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.710+0000 7f2945a5f9c0 20 remove_watcher() i=1 2024-09-12T18:28:11.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.714+0000 7f2945a5f9c0 20 remove_watcher() i=2 2024-09-12T18:28:11.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.714+0000 7f2945a5f9c0 20 remove_watcher() i=3 2024-09-12T18:28:11.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.718+0000 7f2945a5f9c0 20 remove_watcher() i=4 2024-09-12T18:28:11.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.718+0000 7f2945a5f9c0 20 remove_watcher() i=5 2024-09-12T18:28:11.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.722+0000 7f2945a5f9c0 20 remove_watcher() i=6 2024-09-12T18:28:11.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.722+0000 7f2945a5f9c0 20 remove_watcher() i=7 2024-09-12T18:28:11.744 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T18:28:11.776 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:11.776 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:11.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.818+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.818+0000 7fb64eddb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:11.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.818+0000 7fb64eddb9c0 20 realm 2024-09-12T18:28:11.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.818+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.818+0000 7fb64eddb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:11.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.818+0000 7fb64eddb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:11.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.818+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.818+0000 7fb64eddb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:11.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.818+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.822+0000 7fb64eddb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:11.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.822+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:11.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.822+0000 7fb64eddb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:11.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.822+0000 7fb64eddb9c0 20 searching for the correct realm 2024-09-12T18:28:11.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:11.826+0000 7fb64d0e2640 0 -- 172.21.15.111:0/1388568082 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fb64012b060 msgr2=0x7fb640003430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:28:12.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.042+0000 7fb64c0e0640 0 -- 172.21.15.111:0/1388568082 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fb644070750 msgr2=0x7fb64405b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:28:12.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.258+0000 7fb64eddb9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:12.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.258+0000 7fb64eddb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:12.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.258+0000 7fb64eddb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:12.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.258+0000 7fb64eddb9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:12.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.258+0000 7fb64eddb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:12.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.258+0000 7fb64eddb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:12.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.258+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.258+0000 7fb64eddb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:12.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.258+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:12.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:12.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 20 zone default found 2024-09-12T18:28:12.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 4 Realm: () 2024-09-12T18:28:12.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:12.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:12.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:12.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 20 zonegroup default 2024-09-12T18:28:12.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:12.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:12.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:12.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 20 started sync module instance, tier type = 2024-09-12T18:28:12.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.262+0000 7fb64eddb9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:12.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.290+0000 7fb64eddb9c0 20 add_watcher() i=0 2024-09-12T18:28:12.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.290+0000 7fb64eddb9c0 20 add_watcher() i=1 2024-09-12T18:28:12.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.290+0000 7fb64eddb9c0 20 add_watcher() i=2 2024-09-12T18:28:12.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.290+0000 7fb64eddb9c0 20 add_watcher() i=3 2024-09-12T18:28:12.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.290+0000 7fb64eddb9c0 20 add_watcher() i=4 2024-09-12T18:28:12.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.290+0000 7fb64eddb9c0 20 add_watcher() i=5 2024-09-12T18:28:12.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.290+0000 7fb64eddb9c0 20 add_watcher() i=6 2024-09-12T18:28:12.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.290+0000 7fb64eddb9c0 20 add_watcher() i=7 2024-09-12T18:28:12.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.290+0000 7fb64eddb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:12.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.294+0000 7fb502fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:12.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.294+0000 7fb64eddb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:12.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.294+0000 7fb64eddb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:12.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.294+0000 7fb64eddb9c0 5 note: GC not initialized 2024-09-12T18:28:12.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.294+0000 7fb501fe3640 20 reqs_thread_entry: start 2024-09-12T18:28:12.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.294+0000 7fb64eddb9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:12.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.294+0000 7fb64eddb9c0 20 Filter name: none 2024-09-12T18:28:12.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.298+0000 7fb4737fe640 20 reqs_thread_entry: start 2024-09-12T18:28:12.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.298+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.298+0000 7fb64eddb9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:12.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.298+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.298+0000 7fb64eddb9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:12.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.298+0000 7fb64eddb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:12.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.298+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.298+0000 7fb64eddb9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:12.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.298+0000 7fb64eddb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.298+0000 7fb64eddb9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:12.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.298+0000 7fb64eddb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:12.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.302+0000 7fb502fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:12.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.306+0000 7fb64eddb9c0 20 remove_watcher() i=0 2024-09-12T18:28:12.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.306+0000 7fb64eddb9c0 2 removed watcher, disabling cache 2024-09-12T18:28:12.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.310+0000 7fb64eddb9c0 20 remove_watcher() i=1 2024-09-12T18:28:12.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.314+0000 7fb64eddb9c0 20 remove_watcher() i=2 2024-09-12T18:28:12.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.314+0000 7fb64eddb9c0 20 remove_watcher() i=3 2024-09-12T18:28:12.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.318+0000 7fb64eddb9c0 20 remove_watcher() i=4 2024-09-12T18:28:12.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.318+0000 7fb64eddb9c0 20 remove_watcher() i=5 2024-09-12T18:28:12.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.318+0000 7fb64eddb9c0 20 remove_watcher() i=6 2024-09-12T18:28:12.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.322+0000 7fb64eddb9c0 20 remove_watcher() i=7 2024-09-12T18:28:12.340 INFO:tasks.workunit.client.0.smithi111.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 75, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T18:28:12.340 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T18:28:12.340 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:28:12.340 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T18:28:12.373 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:12.373 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:12.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.414+0000 7f749f7339c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.419 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.414+0000 7f749f7339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:12.419 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.414+0000 7f749f7339c0 20 realm 2024-09-12T18:28:12.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.414+0000 7f749f7339c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.414+0000 7f749f7339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:12.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.414+0000 7f749f7339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:12.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.414+0000 7f749f7339c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.414+0000 7f749f7339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:12.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.414+0000 7f749f7339c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.418+0000 7f749f7339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:12.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.418+0000 7f749f7339c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.418+0000 7f749f7339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:12.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.418+0000 7f749f7339c0 20 searching for the correct realm 2024-09-12T18:28:12.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.422+0000 7f749da3a640 0 -- 172.21.15.111:0/3056718466 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f7494018070 msgr2=0x7f749406f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:28:12.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.638+0000 7f749ca38640 0 -- 172.21.15.111:0/3056718466 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f74980c1040 msgr2=0x7f74980dc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:12.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.854+0000 7f749f7339c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:12.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.854+0000 7f749f7339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:12.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.854+0000 7f749f7339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:12.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.854+0000 7f749f7339c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:12.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.854+0000 7f749f7339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:12.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.854+0000 7f749f7339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:12.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.854+0000 7f749f7339c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.854+0000 7f749f7339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:12.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.854+0000 7f749f7339c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.858+0000 7f749f7339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:12.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.858+0000 7f749f7339c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.858+0000 7f749f7339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:12.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.858+0000 7f749f7339c0 20 zone default found 2024-09-12T18:28:12.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.858+0000 7f749f7339c0 4 Realm: () 2024-09-12T18:28:12.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.858+0000 7f749f7339c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:12.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.858+0000 7f749f7339c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:12.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.858+0000 7f749f7339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:12.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.858+0000 7f749f7339c0 20 zonegroup default 2024-09-12T18:28:12.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.858+0000 7f749f7339c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.858+0000 7f749f7339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:12.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.858+0000 7f749f7339c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.858+0000 7f749f7339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:12.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.858+0000 7f749f7339c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.862+0000 7f749f7339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:12.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.862+0000 7f749f7339c0 20 started sync module instance, tier type = 2024-09-12T18:28:12.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.862+0000 7f749f7339c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:12.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.886+0000 7f749f7339c0 20 add_watcher() i=0 2024-09-12T18:28:12.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.886+0000 7f749f7339c0 20 add_watcher() i=1 2024-09-12T18:28:12.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.886+0000 7f749f7339c0 20 add_watcher() i=2 2024-09-12T18:28:12.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.886+0000 7f749f7339c0 20 add_watcher() i=3 2024-09-12T18:28:12.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.886+0000 7f749f7339c0 20 add_watcher() i=4 2024-09-12T18:28:12.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.886+0000 7f749f7339c0 20 add_watcher() i=5 2024-09-12T18:28:12.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.886+0000 7f749f7339c0 20 add_watcher() i=6 2024-09-12T18:28:12.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.886+0000 7f749f7339c0 20 add_watcher() i=7 2024-09-12T18:28:12.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.886+0000 7f749f7339c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:12.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.890+0000 7f73537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:12.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.890+0000 7f749f7339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:12.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.890+0000 7f749f7339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:12.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 5 note: GC not initialized 2024-09-12T18:28:12.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f73527e4640 20 reqs_thread_entry: start 2024-09-12T18:28:12.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:12.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 20 Filter name: none 2024-09-12T18:28:12.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f72c3fff640 20 reqs_thread_entry: start 2024-09-12T18:28:12.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T18:28:12.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:12.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T18:28:12.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T18:28:12.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 : miss 2024-09-12T18:28:12.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:12.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:12.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 info.flags=0x17 2024-09-12T18:28:12.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 to cache LRU end 2024-09-12T18:28:12.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:28:12.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T18:28:12.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 2024-09-12T18:28:12.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.894+0000 7f749f7339c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:12.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.898+0000 7f749f7339c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T18:28:12.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.898+0000 7f749f7339c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:12.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.898+0000 7f749f7339c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T18:28:12.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.898+0000 7f749f7339c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:12.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.898+0000 7f749f7339c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T18:28:12.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.898+0000 7f749f7339c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:12.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.898+0000 7f749f7339c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T18:28:12.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.898+0000 7f749f7339c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:12.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.902+0000 7f749f7339c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T18:28:12.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.902+0000 7f749f7339c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:12.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.902+0000 7f749f7339c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T18:28:12.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.902+0000 7f749f7339c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:12.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.902+0000 7f749f7339c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T18:28:12.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.902+0000 7f749f7339c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:12.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.902+0000 7f749f7339c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T18:28:12.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.902+0000 7f749f7339c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:12.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.906+0000 7f749f7339c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T18:28:12.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.906+0000 7f749f7339c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:12.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.906+0000 7f749f7339c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T18:28:12.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.906+0000 7f749f7339c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:12.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.910+0000 7f749f7339c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T18:28:12.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.910+0000 7f749f7339c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T18:28:12.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.910+0000 7f73537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:12.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.914+0000 7f749f7339c0 20 remove_watcher() i=0 2024-09-12T18:28:12.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.914+0000 7f749f7339c0 2 removed watcher, disabling cache 2024-09-12T18:28:12.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.918+0000 7f749f7339c0 20 remove_watcher() i=1 2024-09-12T18:28:12.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.922+0000 7f749f7339c0 20 remove_watcher() i=2 2024-09-12T18:28:12.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.922+0000 7f749f7339c0 20 remove_watcher() i=3 2024-09-12T18:28:12.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.926+0000 7f749f7339c0 20 remove_watcher() i=4 2024-09-12T18:28:12.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.926+0000 7f749f7339c0 20 remove_watcher() i=5 2024-09-12T18:28:12.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.930+0000 7f749f7339c0 20 remove_watcher() i=6 2024-09-12T18:28:12.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:12.930+0000 7f749f7339c0 20 remove_watcher() i=7 2024-09-12T18:28:12.951 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:28:13.381 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T18:28:14.807 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:14.807 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:14.873 INFO:tasks.workunit.client.0.smithi111.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:28:14.874 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T18:28:14.909 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:14.909 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:14.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:14.950+0000 7ff61cca79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:14.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:14.950+0000 7ff61cca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:14.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:14.950+0000 7ff61cca79c0 20 realm 2024-09-12T18:28:14.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:14.950+0000 7ff61cca79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:14.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:14.950+0000 7ff61cca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:14.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:14.950+0000 7ff61cca79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:14.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:14.950+0000 7ff61cca79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:14.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:14.950+0000 7ff61cca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:14.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:14.950+0000 7ff61cca79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:14.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:14.954+0000 7ff61cca79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:14.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:14.954+0000 7ff61cca79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:14.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:14.954+0000 7ff61cca79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:14.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:14.954+0000 7ff61cca79c0 20 searching for the correct realm 2024-09-12T18:28:14.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:14.958+0000 7ff61afae640 0 -- 172.21.15.111:0/2114377979 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7ff60409c070 msgr2=0x7ff60407a600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:15.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.170+0000 7ff611fac640 0 -- 172.21.15.111:0/2114377979 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7ff6140de480 msgr2=0x7ff6140cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:15.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.386+0000 7ff61cca79c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:15.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.386+0000 7ff61cca79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:15.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.386+0000 7ff61cca79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:15.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.386+0000 7ff61cca79c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:15.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.386+0000 7ff61cca79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:15.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.386+0000 7ff61cca79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:15.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.386+0000 7ff61cca79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.386+0000 7ff61cca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:15.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.386+0000 7ff61cca79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.386+0000 7ff61cca79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:15.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.386+0000 7ff61cca79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:15.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 20 zone default found 2024-09-12T18:28:15.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 4 Realm: () 2024-09-12T18:28:15.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:15.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:15.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:15.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 20 zonegroup default 2024-09-12T18:28:15.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:15.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:15.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:15.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 20 started sync module instance, tier type = 2024-09-12T18:28:15.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.390+0000 7ff61cca79c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:15.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.414+0000 7ff61cca79c0 20 add_watcher() i=0 2024-09-12T18:28:15.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.414+0000 7ff61cca79c0 20 add_watcher() i=1 2024-09-12T18:28:15.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.414+0000 7ff61cca79c0 20 add_watcher() i=2 2024-09-12T18:28:15.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.414+0000 7ff61cca79c0 20 add_watcher() i=3 2024-09-12T18:28:15.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.414+0000 7ff61cca79c0 20 add_watcher() i=4 2024-09-12T18:28:15.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.414+0000 7ff61cca79c0 20 add_watcher() i=5 2024-09-12T18:28:15.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.414+0000 7ff61cca79c0 20 add_watcher() i=6 2024-09-12T18:28:15.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.418+0000 7ff61cca79c0 20 add_watcher() i=7 2024-09-12T18:28:15.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.418+0000 7ff61cca79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:15.427 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.422+0000 7ff4d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:15.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.422+0000 7ff61cca79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:15.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.422+0000 7ff61cca79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:15.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.422+0000 7ff61cca79c0 5 note: GC not initialized 2024-09-12T18:28:15.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff44b7fe640 20 reqs_thread_entry: start 2024-09-12T18:28:15.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff61cca79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:15.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff61cca79c0 20 Filter name: none 2024-09-12T18:28:15.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff4497fa640 20 reqs_thread_entry: start 2024-09-12T18:28:15.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff61cca79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff61cca79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:15.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff61cca79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff61cca79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:15.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff61cca79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:15.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff61cca79c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:28:15.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff61cca79c0 20 INFO: main: starting shard=0 2024-09-12T18:28:15.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff61cca79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:15.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff61cca79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff61cca79c0 20 INFO: main: starting shard=1 2024-09-12T18:28:15.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.426+0000 7ff61cca79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:15.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.430+0000 7ff61cca79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.430+0000 7ff61cca79c0 20 INFO: main: starting shard=2 2024-09-12T18:28:15.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.430+0000 7ff61cca79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:15.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.430+0000 7ff61cca79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.430+0000 7ff61cca79c0 20 INFO: main: starting shard=3 2024-09-12T18:28:15.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.430+0000 7ff61cca79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:15.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.430+0000 7ff61cca79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.430+0000 7ff61cca79c0 20 INFO: main: starting shard=4 2024-09-12T18:28:15.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.430+0000 7ff61cca79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:15.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.434+0000 7ff61cca79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.434+0000 7ff61cca79c0 20 INFO: main: starting shard=5 2024-09-12T18:28:15.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.434+0000 7ff61cca79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:15.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.434+0000 7ff61cca79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.434+0000 7ff61cca79c0 20 INFO: main: starting shard=6 2024-09-12T18:28:15.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.434+0000 7ff61cca79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:15.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.434+0000 7ff61cca79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.434+0000 7ff61cca79c0 20 INFO: main: starting shard=7 2024-09-12T18:28:15.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.434+0000 7ff61cca79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:15.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.434+0000 7ff61cca79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.434+0000 7ff61cca79c0 20 INFO: main: starting shard=8 2024-09-12T18:28:15.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.434+0000 7ff61cca79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:15.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.438+0000 7ff61cca79c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T18:28:15.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.438+0000 7ff61cca79c0 20 INFO: main: starting shard=9 2024-09-12T18:28:15.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.438+0000 7ff61cca79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:15.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.438+0000 7ff61cca79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.438+0000 7ff61cca79c0 20 INFO: main: starting shard=10 2024-09-12T18:28:15.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.438+0000 7ff61cca79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:15.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.442+0000 7ff61cca79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.442+0000 7ff61cca79c0 20 INFO: main: done 2024-09-12T18:28:15.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.442+0000 7ff4d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:15.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.446+0000 7ff61cca79c0 20 remove_watcher() i=0 2024-09-12T18:28:15.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.446+0000 7ff61cca79c0 2 removed watcher, disabling cache 2024-09-12T18:28:15.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.450+0000 7ff61cca79c0 20 remove_watcher() i=1 2024-09-12T18:28:15.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.454+0000 7ff61cca79c0 20 remove_watcher() i=2 2024-09-12T18:28:15.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.454+0000 7ff61cca79c0 20 remove_watcher() i=3 2024-09-12T18:28:15.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.458+0000 7ff61cca79c0 20 remove_watcher() i=4 2024-09-12T18:28:15.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.458+0000 7ff61cca79c0 20 remove_watcher() i=5 2024-09-12T18:28:15.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.462+0000 7ff61cca79c0 20 remove_watcher() i=6 2024-09-12T18:28:15.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.462+0000 7ff61cca79c0 20 remove_watcher() i=7 2024-09-12T18:28:15.492 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:15.492 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:15.497 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:15.497 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:15.561 INFO:tasks.workunit.client.0.smithi111.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:28:15.562 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T18:28:15.597 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:15.597 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:15.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.638+0000 7eff9bb2c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.642+0000 7eff9bb2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:15.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.642+0000 7eff9bb2c9c0 20 realm 2024-09-12T18:28:15.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.642+0000 7eff9bb2c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.642+0000 7eff9bb2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:15.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.642+0000 7eff9bb2c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:15.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.642+0000 7eff9bb2c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.642+0000 7eff9bb2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:15.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.642+0000 7eff9bb2c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.642+0000 7eff9bb2c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:15.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.642+0000 7eff9bb2c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.642+0000 7eff9bb2c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:15.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.642+0000 7eff9bb2c9c0 20 searching for the correct realm 2024-09-12T18:28:15.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.650+0000 7eff99632640 0 -- 172.21.15.111:0/3102590226 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7eff941150e0 msgr2=0x7eff940ac750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:15.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.654+0000 7eff98e31640 0 -- 172.21.15.111:0/3102590226 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7eff94130a20 msgr2=0x7eff9410c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:15.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.870+0000 7eff9bb2c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:15.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.870+0000 7eff9bb2c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:15.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.870+0000 7eff9bb2c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:15.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.870+0000 7eff9bb2c9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:15.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.870+0000 7eff9bb2c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:15.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.870+0000 7eff9bb2c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:15.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.870+0000 7eff9bb2c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.870+0000 7eff9bb2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:15.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.870+0000 7eff9bb2c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:15.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:15.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 20 zone default found 2024-09-12T18:28:15.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 4 Realm: () 2024-09-12T18:28:15.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:15.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:15.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:15.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 20 zonegroup default 2024-09-12T18:28:15.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:15.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:15.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:15.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 20 started sync module instance, tier type = 2024-09-12T18:28:15.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.874+0000 7eff9bb2c9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:15.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.898+0000 7eff9bb2c9c0 20 add_watcher() i=0 2024-09-12T18:28:15.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.898+0000 7eff9bb2c9c0 20 add_watcher() i=1 2024-09-12T18:28:15.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.898+0000 7eff9bb2c9c0 20 add_watcher() i=2 2024-09-12T18:28:15.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.898+0000 7eff9bb2c9c0 20 add_watcher() i=3 2024-09-12T18:28:15.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.898+0000 7eff9bb2c9c0 20 add_watcher() i=4 2024-09-12T18:28:15.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.898+0000 7eff9bb2c9c0 20 add_watcher() i=5 2024-09-12T18:28:15.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.902+0000 7eff9bb2c9c0 20 add_watcher() i=6 2024-09-12T18:28:15.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.902+0000 7eff9bb2c9c0 20 add_watcher() i=7 2024-09-12T18:28:15.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.902+0000 7eff9bb2c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:15.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.906+0000 7efe4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:15.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.906+0000 7eff9bb2c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:15.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.906+0000 7eff9bb2c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:15.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.906+0000 7eff9bb2c9c0 5 note: GC not initialized 2024-09-12T18:28:15.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.906+0000 7efe4e7e4640 20 reqs_thread_entry: start 2024-09-12T18:28:15.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.906+0000 7eff9bb2c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:15.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.906+0000 7eff9bb2c9c0 20 Filter name: none 2024-09-12T18:28:15.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7efdbffff640 20 reqs_thread_entry: start 2024-09-12T18:28:15.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7eff9bb2c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7eff9bb2c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:15.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7eff9bb2c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:15.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7eff9bb2c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:15.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7eff9bb2c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:15.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7eff9bb2c9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:28:15.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7eff9bb2c9c0 20 INFO: main: starting shard=0 2024-09-12T18:28:15.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7eff9bb2c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:15.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7eff9bb2c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7eff9bb2c9c0 20 INFO: main: starting shard=1 2024-09-12T18:28:15.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7eff9bb2c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:15.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7eff9bb2c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7eff9bb2c9c0 20 INFO: main: starting shard=2 2024-09-12T18:28:15.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.910+0000 7eff9bb2c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:15.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.914+0000 7eff9bb2c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.914+0000 7eff9bb2c9c0 20 INFO: main: starting shard=3 2024-09-12T18:28:15.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.914+0000 7eff9bb2c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:15.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.914+0000 7eff9bb2c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.914+0000 7eff9bb2c9c0 20 INFO: main: starting shard=4 2024-09-12T18:28:15.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.914+0000 7eff9bb2c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:15.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.914+0000 7eff9bb2c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.914+0000 7eff9bb2c9c0 20 INFO: main: starting shard=5 2024-09-12T18:28:15.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.914+0000 7eff9bb2c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:15.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.914+0000 7eff9bb2c9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T18:28:15.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.914+0000 7eff9bb2c9c0 20 INFO: main: starting shard=6 2024-09-12T18:28:15.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.914+0000 7eff9bb2c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:15.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.918+0000 7eff9bb2c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.918+0000 7eff9bb2c9c0 20 INFO: main: starting shard=7 2024-09-12T18:28:15.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.918+0000 7eff9bb2c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:15.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.918+0000 7eff9bb2c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.918+0000 7eff9bb2c9c0 20 INFO: main: starting shard=8 2024-09-12T18:28:15.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.918+0000 7eff9bb2c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:15.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.918+0000 7eff9bb2c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.918+0000 7eff9bb2c9c0 20 INFO: main: starting shard=9 2024-09-12T18:28:15.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.918+0000 7eff9bb2c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:15.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.922+0000 7eff9bb2c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.922+0000 7eff9bb2c9c0 20 INFO: main: starting shard=10 2024-09-12T18:28:15.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.922+0000 7eff9bb2c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:15.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.922+0000 7eff9bb2c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:15.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.922+0000 7eff9bb2c9c0 20 INFO: main: done 2024-09-12T18:28:15.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.922+0000 7efe4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:15.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.930+0000 7eff9bb2c9c0 20 remove_watcher() i=0 2024-09-12T18:28:15.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.930+0000 7eff9bb2c9c0 2 removed watcher, disabling cache 2024-09-12T18:28:15.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.934+0000 7eff9bb2c9c0 20 remove_watcher() i=1 2024-09-12T18:28:15.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.938+0000 7eff9bb2c9c0 20 remove_watcher() i=2 2024-09-12T18:28:15.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.938+0000 7eff9bb2c9c0 20 remove_watcher() i=3 2024-09-12T18:28:15.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.942+0000 7eff9bb2c9c0 20 remove_watcher() i=4 2024-09-12T18:28:15.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.942+0000 7eff9bb2c9c0 20 remove_watcher() i=5 2024-09-12T18:28:15.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.946+0000 7eff9bb2c9c0 20 remove_watcher() i=6 2024-09-12T18:28:15.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:15.946+0000 7eff9bb2c9c0 20 remove_watcher() i=7 2024-09-12T18:28:15.967 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:15.967 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:15.971 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:15.971 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:15.975 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:15.975 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:16.041 INFO:tasks.workunit.client.0.smithi111.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:28:16.042 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T18:28:16.077 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:16.077 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:16.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.118+0000 7fb22830c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.118+0000 7fb22830c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:16.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.118+0000 7fb22830c9c0 20 realm 2024-09-12T18:28:16.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.118+0000 7fb22830c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.118+0000 7fb22830c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:16.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.118+0000 7fb22830c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:16.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.118+0000 7fb22830c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.122+0000 7fb22830c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:16.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.122+0000 7fb22830c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.122+0000 7fb22830c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:16.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.122+0000 7fb22830c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.122+0000 7fb22830c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:16.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.122+0000 7fb22830c9c0 20 searching for the correct realm 2024-09-12T18:28:16.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.126+0000 7fb226613640 0 -- 172.21.15.111:0/2204267972 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fb21c03f030 msgr2=0x7fb21c03f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:28:16.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.134+0000 7fb225611640 0 -- 172.21.15.111:0/2204267972 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fb220064cd0 msgr2=0x7fb2200890d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:28:16.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.350+0000 7fb22830c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:16.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.350+0000 7fb22830c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:16.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.350+0000 7fb22830c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:16.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.350+0000 7fb22830c9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:16.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.350+0000 7fb22830c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:16.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.350+0000 7fb22830c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:16.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.350+0000 7fb22830c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.350+0000 7fb22830c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:16.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.350+0000 7fb22830c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:16.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:16.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 20 zone default found 2024-09-12T18:28:16.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 4 Realm: () 2024-09-12T18:28:16.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:16.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:16.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:16.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 20 zonegroup default 2024-09-12T18:28:16.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:16.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:16.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:16.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 20 started sync module instance, tier type = 2024-09-12T18:28:16.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.354+0000 7fb22830c9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:16.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.378+0000 7fb22830c9c0 20 add_watcher() i=0 2024-09-12T18:28:16.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.378+0000 7fb22830c9c0 20 add_watcher() i=1 2024-09-12T18:28:16.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.378+0000 7fb22830c9c0 20 add_watcher() i=2 2024-09-12T18:28:16.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.378+0000 7fb22830c9c0 20 add_watcher() i=3 2024-09-12T18:28:16.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.378+0000 7fb22830c9c0 20 add_watcher() i=4 2024-09-12T18:28:16.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.378+0000 7fb22830c9c0 20 add_watcher() i=5 2024-09-12T18:28:16.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.378+0000 7fb22830c9c0 20 add_watcher() i=6 2024-09-12T18:28:16.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.382+0000 7fb22830c9c0 20 add_watcher() i=7 2024-09-12T18:28:16.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.382+0000 7fb22830c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:16.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.386+0000 7fb0d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:16.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.386+0000 7fb22830c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:16.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.386+0000 7fb22830c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:16.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.386+0000 7fb22830c9c0 5 note: GC not initialized 2024-09-12T18:28:16.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.386+0000 7fb0d67fc640 20 reqs_thread_entry: start 2024-09-12T18:28:16.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.386+0000 7fb22830c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:16.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.386+0000 7fb22830c9c0 20 Filter name: none 2024-09-12T18:28:16.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.386+0000 7fb047fff640 20 reqs_thread_entry: start 2024-09-12T18:28:16.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.386+0000 7fb22830c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.386+0000 7fb22830c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:16.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.390+0000 7fb22830c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.390+0000 7fb22830c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:16.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.390+0000 7fb22830c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:16.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.390+0000 7fb22830c9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:28:16.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.390+0000 7fb22830c9c0 20 INFO: main: starting shard=0 2024-09-12T18:28:16.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.390+0000 7fb22830c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:16.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.390+0000 7fb22830c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.390+0000 7fb22830c9c0 20 INFO: main: starting shard=1 2024-09-12T18:28:16.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.390+0000 7fb22830c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:16.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.390+0000 7fb22830c9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:28:16.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.390+0000 7fb22830c9c0 20 INFO: main: starting shard=2 2024-09-12T18:28:16.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.390+0000 7fb22830c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:16.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.394+0000 7fb22830c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.394+0000 7fb22830c9c0 20 INFO: main: starting shard=3 2024-09-12T18:28:16.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.394+0000 7fb22830c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:16.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.394+0000 7fb22830c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.394+0000 7fb22830c9c0 20 INFO: main: starting shard=4 2024-09-12T18:28:16.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.394+0000 7fb22830c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:16.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.394+0000 7fb22830c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.394+0000 7fb22830c9c0 20 INFO: main: starting shard=5 2024-09-12T18:28:16.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.394+0000 7fb22830c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:16.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.398+0000 7fb22830c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.398+0000 7fb22830c9c0 20 INFO: main: starting shard=6 2024-09-12T18:28:16.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.398+0000 7fb22830c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:16.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.398+0000 7fb22830c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.398+0000 7fb22830c9c0 20 INFO: main: starting shard=7 2024-09-12T18:28:16.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.398+0000 7fb22830c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:16.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.398+0000 7fb22830c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.398+0000 7fb22830c9c0 20 INFO: main: starting shard=8 2024-09-12T18:28:16.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.398+0000 7fb22830c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:16.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.402+0000 7fb22830c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.402+0000 7fb22830c9c0 20 INFO: main: starting shard=9 2024-09-12T18:28:16.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.402+0000 7fb22830c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:16.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.402+0000 7fb22830c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.402+0000 7fb22830c9c0 20 INFO: main: starting shard=10 2024-09-12T18:28:16.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.402+0000 7fb22830c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:16.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.402+0000 7fb22830c9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.402+0000 7fb22830c9c0 20 INFO: main: done 2024-09-12T18:28:16.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.406+0000 7fb0d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:16.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.410+0000 7fb22830c9c0 20 remove_watcher() i=0 2024-09-12T18:28:16.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.410+0000 7fb22830c9c0 2 removed watcher, disabling cache 2024-09-12T18:28:16.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.414+0000 7fb22830c9c0 20 remove_watcher() i=1 2024-09-12T18:28:16.419 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.414+0000 7fb22830c9c0 20 remove_watcher() i=2 2024-09-12T18:28:16.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.418+0000 7fb22830c9c0 20 remove_watcher() i=3 2024-09-12T18:28:16.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.418+0000 7fb22830c9c0 20 remove_watcher() i=4 2024-09-12T18:28:16.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.422+0000 7fb22830c9c0 20 remove_watcher() i=5 2024-09-12T18:28:16.427 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.422+0000 7fb22830c9c0 20 remove_watcher() i=6 2024-09-12T18:28:16.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.426+0000 7fb22830c9c0 20 remove_watcher() i=7 2024-09-12T18:28:16.448 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:16.448 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:16.452 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:16.453 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:16.513 INFO:tasks.workunit.client.0.smithi111.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:28:16.514 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T18:28:16.549 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:16.549 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:16.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.590+0000 7fdea26409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.590+0000 7fdea26409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:16.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.590+0000 7fdea26409c0 20 realm 2024-09-12T18:28:16.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.590+0000 7fdea26409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.594+0000 7fdea26409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:16.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.594+0000 7fdea26409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:16.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.594+0000 7fdea26409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.594+0000 7fdea26409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:16.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.594+0000 7fdea26409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.594+0000 7fdea26409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:16.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.594+0000 7fdea26409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.594+0000 7fdea26409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:16.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.594+0000 7fdea26409c0 20 searching for the correct realm 2024-09-12T18:28:16.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.598+0000 7fdea0947640 0 -- 172.21.15.111:0/3276919862 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fde8c0e2060 msgr2=0x7fde8c132040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:16.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.606+0000 7fde9f945640 0 -- 172.21.15.111:0/3276919862 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fde980673b0 msgr2=0x7fde9806d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:28:16.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.822+0000 7fdea26409c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:16.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.822+0000 7fdea26409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:16.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.822+0000 7fdea26409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:16.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.822+0000 7fdea26409c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:16.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.822+0000 7fdea26409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:16.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.822+0000 7fdea26409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:16.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:16.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:16.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:16.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 20 zone default found 2024-09-12T18:28:16.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 4 Realm: () 2024-09-12T18:28:16.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:16.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:16.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:16.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 20 zonegroup default 2024-09-12T18:28:16.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:16.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.826+0000 7fdea26409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.830+0000 7fdea26409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:16.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.830+0000 7fdea26409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.830+0000 7fdea26409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:16.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.830+0000 7fdea26409c0 20 started sync module instance, tier type = 2024-09-12T18:28:16.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.830+0000 7fdea26409c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:16.856 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.854+0000 7fdea26409c0 20 add_watcher() i=0 2024-09-12T18:28:16.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.854+0000 7fdea26409c0 20 add_watcher() i=1 2024-09-12T18:28:16.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.854+0000 7fdea26409c0 20 add_watcher() i=2 2024-09-12T18:28:16.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.854+0000 7fdea26409c0 20 add_watcher() i=3 2024-09-12T18:28:16.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.854+0000 7fdea26409c0 20 add_watcher() i=4 2024-09-12T18:28:16.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.854+0000 7fdea26409c0 20 add_watcher() i=5 2024-09-12T18:28:16.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.854+0000 7fdea26409c0 20 add_watcher() i=6 2024-09-12T18:28:16.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.854+0000 7fdea26409c0 20 add_watcher() i=7 2024-09-12T18:28:16.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.854+0000 7fdea26409c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:16.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.858+0000 7fdd55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:16.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdea26409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:16.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdea26409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:16.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdea26409c0 5 note: GC not initialized 2024-09-12T18:28:16.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdd54fe1640 20 reqs_thread_entry: start 2024-09-12T18:28:16.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdea26409c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:16.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdea26409c0 20 Filter name: none 2024-09-12T18:28:16.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdcce7fc640 20 reqs_thread_entry: start 2024-09-12T18:28:16.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdea26409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdea26409c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:16.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdea26409c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:16.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdea26409c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:16.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdea26409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:16.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdea26409c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:28:16.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdea26409c0 20 INFO: main: starting shard=0 2024-09-12T18:28:16.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.862+0000 7fdea26409c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:16.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.866+0000 7fdea26409c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.866+0000 7fdea26409c0 20 INFO: main: starting shard=1 2024-09-12T18:28:16.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.866+0000 7fdea26409c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:16.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.866+0000 7fdea26409c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.866+0000 7fdea26409c0 20 INFO: main: starting shard=2 2024-09-12T18:28:16.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.866+0000 7fdea26409c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:16.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.866+0000 7fdea26409c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.866+0000 7fdea26409c0 20 INFO: main: starting shard=3 2024-09-12T18:28:16.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.866+0000 7fdea26409c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:16.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.866+0000 7fdea26409c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.866+0000 7fdea26409c0 20 INFO: main: starting shard=4 2024-09-12T18:28:16.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.866+0000 7fdea26409c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:16.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.870+0000 7fdea26409c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.870+0000 7fdea26409c0 20 INFO: main: starting shard=5 2024-09-12T18:28:16.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.870+0000 7fdea26409c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:16.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.870+0000 7fdea26409c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.870+0000 7fdea26409c0 20 INFO: main: starting shard=6 2024-09-12T18:28:16.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.870+0000 7fdea26409c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:16.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.870+0000 7fdea26409c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.870+0000 7fdea26409c0 20 INFO: main: starting shard=7 2024-09-12T18:28:16.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.870+0000 7fdea26409c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:16.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.874+0000 7fdea26409c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.874+0000 7fdea26409c0 20 INFO: main: starting shard=8 2024-09-12T18:28:16.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.874+0000 7fdea26409c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:16.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.874+0000 7fdea26409c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.874+0000 7fdea26409c0 20 INFO: main: starting shard=9 2024-09-12T18:28:16.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.874+0000 7fdea26409c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:16.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.874+0000 7fdea26409c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:16.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.874+0000 7fdea26409c0 20 INFO: main: starting shard=10 2024-09-12T18:28:16.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.874+0000 7fdea26409c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:16.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.878+0000 7fdea26409c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:28:16.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.878+0000 7fdea26409c0 20 INFO: main: done 2024-09-12T18:28:16.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.878+0000 7fdd55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:16.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.882+0000 7fdea26409c0 20 remove_watcher() i=0 2024-09-12T18:28:16.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.882+0000 7fdea26409c0 2 removed watcher, disabling cache 2024-09-12T18:28:16.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.886+0000 7fdea26409c0 20 remove_watcher() i=1 2024-09-12T18:28:16.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.890+0000 7fdea26409c0 20 remove_watcher() i=2 2024-09-12T18:28:16.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.890+0000 7fdea26409c0 20 remove_watcher() i=3 2024-09-12T18:28:16.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.894+0000 7fdea26409c0 20 remove_watcher() i=4 2024-09-12T18:28:16.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.894+0000 7fdea26409c0 20 remove_watcher() i=5 2024-09-12T18:28:16.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.894+0000 7fdea26409c0 20 remove_watcher() i=6 2024-09-12T18:28:16.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:16.898+0000 7fdea26409c0 20 remove_watcher() i=7 2024-09-12T18:28:16.922 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:16.922 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:16.925 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:28:17.361 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T18:28:17.795 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T18:28:17.795 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:28:17.795 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T18:28:17.830 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:17.830 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:17.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.870+0000 7fb039f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:17.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.874+0000 7fb039f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:17.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.874+0000 7fb039f359c0 20 realm 2024-09-12T18:28:17.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.874+0000 7fb039f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:17.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.874+0000 7fb039f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:17.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.874+0000 7fb039f359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:17.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.874+0000 7fb039f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:17.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.874+0000 7fb039f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:17.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.874+0000 7fb039f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:17.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.874+0000 7fb039f359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:17.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.874+0000 7fb039f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:17.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.874+0000 7fb039f359c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:17.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.874+0000 7fb039f359c0 20 searching for the correct realm 2024-09-12T18:28:17.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.878+0000 7fb03823c640 0 -- 172.21.15.111:0/3870036551 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fb02c10fbd0 msgr2=0x7fb02c1204b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:17.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:17.886+0000 7fb03723a640 0 -- 172.21.15.111:0/3870036551 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fb030065b80 msgr2=0x7fb030097200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:18.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.102+0000 7fb039f359c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:18.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.102+0000 7fb039f359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:18.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.102+0000 7fb039f359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:18.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.102+0000 7fb039f359c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:18.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.102+0000 7fb039f359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:18.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.102+0000 7fb039f359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:18.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.102+0000 7fb039f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.102+0000 7fb039f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.102+0000 7fb039f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.102+0000 7fb039f359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.102+0000 7fb039f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:18.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 20 zone default found 2024-09-12T18:28:18.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 4 Realm: () 2024-09-12T18:28:18.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:18.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:18.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:18.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 20 zonegroup default 2024-09-12T18:28:18.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 20 started sync module instance, tier type = 2024-09-12T18:28:18.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.106+0000 7fb039f359c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:18.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.130+0000 7fb039f359c0 20 add_watcher() i=0 2024-09-12T18:28:18.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.130+0000 7fb039f359c0 20 add_watcher() i=1 2024-09-12T18:28:18.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.130+0000 7fb039f359c0 20 add_watcher() i=2 2024-09-12T18:28:18.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.130+0000 7fb039f359c0 20 add_watcher() i=3 2024-09-12T18:28:18.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.130+0000 7fb039f359c0 20 add_watcher() i=4 2024-09-12T18:28:18.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.130+0000 7fb039f359c0 20 add_watcher() i=5 2024-09-12T18:28:18.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.130+0000 7fb039f359c0 20 add_watcher() i=6 2024-09-12T18:28:18.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.130+0000 7fb039f359c0 20 add_watcher() i=7 2024-09-12T18:28:18.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.130+0000 7fb039f359c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:18.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.134+0000 7faeedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:18.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:18.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:18.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 5 note: GC not initialized 2024-09-12T18:28:18.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7faeecfe1640 20 reqs_thread_entry: start 2024-09-12T18:28:18.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:18.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 20 Filter name: none 2024-09-12T18:28:18.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fae667fc640 20 reqs_thread_entry: start 2024-09-12T18:28:18.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T18:28:18.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:18.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T18:28:18.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T18:28:18.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 : miss 2024-09-12T18:28:18.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:18.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 info.flags=0x17 2024-09-12T18:28:18.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 to cache LRU end 2024-09-12T18:28:18.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:28:18.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T18:28:18.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 2024-09-12T18:28:18.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.138+0000 7fb039f359c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:18.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.142+0000 7fb039f359c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T18:28:18.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.142+0000 7fb039f359c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:18.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.142+0000 7fb039f359c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:18.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.142+0000 7fb039f359c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T18:28:18.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.142+0000 7fb039f359c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:18.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.146+0000 7fb039f359c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T18:28:18.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.146+0000 7fb039f359c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:18.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.146+0000 7fb039f359c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T18:28:18.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.146+0000 7fb039f359c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:18.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.146+0000 7fb039f359c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:18.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.146+0000 7fb039f359c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T18:28:18.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.146+0000 7fb039f359c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:18.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.150+0000 7fb039f359c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T18:28:18.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.150+0000 7fb039f359c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:18.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.150+0000 7fb039f359c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:18.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.150+0000 7fb039f359c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T18:28:18.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.150+0000 7fb039f359c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:18.158 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.154+0000 7fb039f359c0 1 NOTICE: finished shard 1 (1 entries found) 2024-09-12T18:28:18.158 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.154+0000 7fb039f359c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T18:28:18.158 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.154+0000 7fb039f359c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T18:28:18.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.154+0000 7fb039f359c0 1 NOTICE: finished shard 10 (1 entries found) 2024-09-12T18:28:18.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.154+0000 7fb039f359c0 1 NOTICE: finished all shards (4 entries found) 2024-09-12T18:28:18.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.158+0000 7faeedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:18.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.162+0000 7fb039f359c0 20 remove_watcher() i=0 2024-09-12T18:28:18.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.162+0000 7fb039f359c0 2 removed watcher, disabling cache 2024-09-12T18:28:18.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.166+0000 7fb039f359c0 20 remove_watcher() i=1 2024-09-12T18:28:18.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.166+0000 7fb039f359c0 20 remove_watcher() i=2 2024-09-12T18:28:18.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.170+0000 7fb039f359c0 20 remove_watcher() i=3 2024-09-12T18:28:18.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.170+0000 7fb039f359c0 20 remove_watcher() i=4 2024-09-12T18:28:18.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.174+0000 7fb039f359c0 20 remove_watcher() i=5 2024-09-12T18:28:18.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.174+0000 7fb039f359c0 20 remove_watcher() i=6 2024-09-12T18:28:18.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.174+0000 7fb039f359c0 20 remove_watcher() i=7 2024-09-12T18:28:18.195 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: unlinked entries are not listable 2024-09-12T18:28:18.195 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:28:18.198 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:18.198 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:18.204 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T18:28:18.204 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:28:18.207 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:18.207 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:18.255 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:18.255 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:18.301 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T18:28:18.301 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:28:18.301 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T18:28:18.343 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:18.343 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:18.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.382+0000 7fc5e8a439c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.386+0000 7fc5e8a439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.386+0000 7fc5e8a439c0 20 realm 2024-09-12T18:28:18.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.386+0000 7fc5e8a439c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.386+0000 7fc5e8a439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.386+0000 7fc5e8a439c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:18.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.386+0000 7fc5e8a439c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.386+0000 7fc5e8a439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.386+0000 7fc5e8a439c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.386+0000 7fc5e8a439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:18.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.386+0000 7fc5e8a439c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.390+0000 7fc5e8a439c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:18.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.390+0000 7fc5e8a439c0 20 searching for the correct realm 2024-09-12T18:28:18.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.394+0000 7fc5e6549640 0 -- 172.21.15.111:0/510445377 >> [v2:172.21.15.111:6800/2832238944,v1:172.21.15.111:6801/2832238944] conn(0x5571dbbe33a0 msgr2=0x5571dbbe5840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:18.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.398+0000 7fc5e5d48640 0 -- 172.21.15.111:0/510445377 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fc5d80f6bd0 msgr2=0x7fc5d81241d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:18.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.406+0000 7fc5e8a439c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:18.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.406+0000 7fc5e8a439c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:18.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.406+0000 7fc5e8a439c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:18.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.406+0000 7fc5e8a439c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:18.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.406+0000 7fc5e8a439c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:18.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.406+0000 7fc5e8a439c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:18.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.406+0000 7fc5e8a439c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.406+0000 7fc5e8a439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.406+0000 7fc5e8a439c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.406+0000 7fc5e8a439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:18.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.406+0000 7fc5e8a439c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:18.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 20 zone default found 2024-09-12T18:28:18.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 4 Realm: () 2024-09-12T18:28:18.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:18.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:18.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:18.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 20 zonegroup default 2024-09-12T18:28:18.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 20 started sync module instance, tier type = 2024-09-12T18:28:18.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.410+0000 7fc5e8a439c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:18.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.430+0000 7fc5e8a439c0 20 add_watcher() i=0 2024-09-12T18:28:18.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.430+0000 7fc5e8a439c0 20 add_watcher() i=1 2024-09-12T18:28:18.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.430+0000 7fc5e8a439c0 20 add_watcher() i=2 2024-09-12T18:28:18.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.430+0000 7fc5e8a439c0 20 add_watcher() i=3 2024-09-12T18:28:18.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.430+0000 7fc5e8a439c0 20 add_watcher() i=4 2024-09-12T18:28:18.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.430+0000 7fc5e8a439c0 20 add_watcher() i=5 2024-09-12T18:28:18.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.430+0000 7fc5e8a439c0 20 add_watcher() i=6 2024-09-12T18:28:18.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.430+0000 7fc5e8a439c0 20 add_watcher() i=7 2024-09-12T18:28:18.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.430+0000 7fc5e8a439c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:18.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc49d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:18.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc5e8a439c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:18.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc5e8a439c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:18.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc5e8a439c0 5 note: GC not initialized 2024-09-12T18:28:18.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc4977fe640 20 reqs_thread_entry: start 2024-09-12T18:28:18.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc5e8a439c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:18.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc5e8a439c0 20 Filter name: none 2024-09-12T18:28:18.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc4957fa640 20 reqs_thread_entry: start 2024-09-12T18:28:18.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc5e8a439c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T18:28:18.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc5e8a439c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc5e8a439c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:18.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc5e8a439c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T18:28:18.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc5e8a439c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T18:28:18.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc5e8a439c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 : miss 2024-09-12T18:28:18.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.434+0000 7fc5e8a439c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.438+0000 7fc5e8a439c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:18.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.438+0000 7fc5e8a439c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 info.flags=0x17 2024-09-12T18:28:18.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.438+0000 7fc5e8a439c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 to cache LRU end 2024-09-12T18:28:18.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.438+0000 7fc5e8a439c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:28:18.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.438+0000 7fc5e8a439c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T18:28:18.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.438+0000 7fc5e8a439c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 2024-09-12T18:28:18.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.438+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:18.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.438+0000 7fc5e8a439c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T18:28:18.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.438+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:18.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.438+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:18.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.438+0000 7fc5e8a439c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T18:28:18.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.438+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:18.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.442+0000 7fc5e8a439c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T18:28:18.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.442+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:18.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.442+0000 7fc5e8a439c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T18:28:18.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.442+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:18.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.442+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:18.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.446+0000 7fc5e8a439c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T18:28:18.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.446+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:18.450 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.446+0000 7fc5e8a439c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T18:28:18.450 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.446+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:18.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.446+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:18.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.450+0000 7fc5e8a439c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T18:28:18.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.450+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:18.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.450+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:18.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.450+0000 7fc5e8a439c0 20 get_obj_state: octx=0x5571db8de3b0 obj=check-bucket:e state=0x5571dbc237f8 s->prefetch_data=0 2024-09-12T18:28:18.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.450+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:18.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.450+0000 7fc5e8a439c0 20 get_obj_state: octx=0x5571db9834e0 obj=check-bucket:d state=0x5571dbc1ece8 s->prefetch_data=0 2024-09-12T18:28:18.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.450+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:18.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 get_obj_state: octx=0x5571dbc24a40 obj=check-bucket:c state=0x5571dbc19008 s->prefetch_data=0 2024-09-12T18:28:18.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:18.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 get_obj_state: octx=0x5571dbc241a0 obj=check-bucket:f state=0x5571dbc1a7f8 s->prefetch_data=0 2024-09-12T18:28:18.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 get_obj_state: setting s->obj_tag to zly5vow719x82z3ks0j31re2w5t3bh92 2024-09-12T18:28:18.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 get_obj_state_impl: setting s->olh_tag to 0f31mxururqr3dyd7x2wvmxpy1gmvfd5 2024-09-12T18:28:18.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0f31mxururqr3dyd7x2wvmxpy1gmvfd5 2024-09-12T18:28:18.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 get_obj_state: setting s->obj_tag to jt14io4mzusmf4y5t1p0lb7wa0voj6wj 2024-09-12T18:28:18.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 get_obj_state_impl: setting s->olh_tag to nc9l0qjlgoktgxbd08xs3jhm28vy8pno 2024-09-12T18:28:18.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nc9l0qjlgoktgxbd08xs3jhm28vy8pno 2024-09-12T18:28:18.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 get_obj_state: setting s->obj_tag to lgb2tc1ngswqpw0lv6dc1tipaixxaz4t 2024-09-12T18:28:18.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 get_obj_state_impl: setting s->olh_tag to 66pbxq5zb90v07a00ci1jxtp5oop6iwx 2024-09-12T18:28:18.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=66pbxq5zb90v07a00ci1jxtp5oop6iwx 2024-09-12T18:28:18.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 get_obj_state: setting s->obj_tag to q1aozpu6qvxp2nh238imp8o01jwq6jfk 2024-09-12T18:28:18.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 get_obj_state_impl: setting s->olh_tag to 4gy9svumygiucf8u5gm1dlzyc0gez5dz 2024-09-12T18:28:18.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4gy9svumygiucf8u5gm1dlzyc0gez5dz 2024-09-12T18:28:18.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.454+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:18.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.458+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:18.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.458+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:18.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.458+0000 7fc5e8a439c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T18:28:18.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.458+0000 7fc5e8a439c0 20 olh_log_entry: epoch=2 op=3 key=e[48j-qRpEenbm5fCLWeHEah.roNFOnL8] 2024-09-12T18:28:18.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.458+0000 7fc5e8a439c0 20 get_obj_state: octx=0x5571db8de3b0 obj=check-bucket:_:48j-qRpEenbm5fCLWeHEah.roNFOnL8_e state=0x5571dbcc15e8 s->prefetch_data=0 2024-09-12T18:28:18.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.458+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:18.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.458+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:18.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.458+0000 7fc5e8a439c0 10 manifest: total_size = 22 2024-09-12T18:28:18.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.458+0000 7fc5e8a439c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.13992040804413893523 2024-09-12T18:28:18.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.458+0000 7fc5e8a439c0 20 get_obj_state: octx=0x5571db8de3b0 obj=check-bucket:_:48j-qRpEenbm5fCLWeHEah.roNFOnL8_e state=0x5571dbcc15e8 s->prefetch_data=0 2024-09-12T18:28:18.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.458+0000 7fc5e8a439c0 20 prepare_atomic_modification: state is not atomic. state=0x5571dbcc15e8 2024-09-12T18:28:18.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.458+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:18.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:18.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:18.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 olh_log_entry: epoch=3 op=3 key=c[Dikb5NYjugn2pcn2YjSUFwED8GQpC8s] 2024-09-12T18:28:18.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 get_obj_state: octx=0x5571dbc24a40 obj=check-bucket:_:Dikb5NYjugn2pcn2YjSUFwED8GQpC8s_c state=0x5571dbcc4ae8 s->prefetch_data=0 2024-09-12T18:28:18.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 10 manifest: total_size = 11 2024-09-12T18:28:18.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.2389470169768160198 2024-09-12T18:28:18.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 get_obj_state: octx=0x5571dbc24a40 obj=check-bucket:_:Dikb5NYjugn2pcn2YjSUFwED8GQpC8s_c state=0x5571dbcc4ae8 s->prefetch_data=0 2024-09-12T18:28:18.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 prepare_atomic_modification: state is not atomic. state=0x5571dbcc4ae8 2024-09-12T18:28:18.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:18.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 olh_log_entry: epoch=3 op=3 key=d[JQ9ySAkAG7Cwwy6WnBsX48.5--mq9k8] 2024-09-12T18:28:18.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 get_obj_state: octx=0x5571db9834e0 obj=check-bucket:_:JQ9ySAkAG7Cwwy6WnBsX48.5--mq9k8_d state=0x5571dbcd5078 s->prefetch_data=0 2024-09-12T18:28:18.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 10 manifest: total_size = 12 2024-09-12T18:28:18.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.8260921196748771537 2024-09-12T18:28:18.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 get_obj_state: octx=0x5571db9834e0 obj=check-bucket:_:JQ9ySAkAG7Cwwy6WnBsX48.5--mq9k8_d state=0x5571dbcd5078 s->prefetch_data=0 2024-09-12T18:28:18.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 prepare_atomic_modification: state is not atomic. state=0x5571dbcd5078 2024-09-12T18:28:18.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:18.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:18.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T18:28:18.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 olh_log_entry: epoch=2 op=3 key=f[olrA4wHWpzBRWhFBgccehFm3m.r6PPV] 2024-09-12T18:28:18.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.462+0000 7fc5e8a439c0 20 get_obj_state: octx=0x5571dbc241a0 obj=check-bucket:_:olrA4wHWpzBRWhFBgccehFm3m.r6PPV_f state=0x5571dbcdf1c8 s->prefetch_data=0 2024-09-12T18:28:18.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.466+0000 7fc5e8a439c0 10 manifest: total_size = 22 2024-09-12T18:28:18.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.466+0000 7fc5e8a439c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.14934727158459627151 2024-09-12T18:28:18.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.466+0000 7fc5e8a439c0 20 get_obj_state: octx=0x5571dbc241a0 obj=check-bucket:_:olrA4wHWpzBRWhFBgccehFm3m.r6PPV_f state=0x5571dbcdf1c8 s->prefetch_data=0 2024-09-12T18:28:18.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.466+0000 7fc5e8a439c0 20 prepare_atomic_modification: state is not atomic. state=0x5571dbcdf1c8 2024-09-12T18:28:18.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.466+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:18.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.466+0000 7fc5e8a439c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:28:18.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.466+0000 7fc5e8a439c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T18:28:18.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.466+0000 7fc5e8a439c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:28:18.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.466+0000 7fc5e8a439c0 5 delete_objs_inline: removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.1__shadow:48j-qRpEenbm5fCLWeHEah.roNFOnL8_.vg_4on6fZaxjO4gXbR4-Mj_qJf19F8K_0 2024-09-12T18:28:18.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.466+0000 7fc4c9ffb640 20 handle_completion(): completion ok for obj=e[48j-qRpEenbm5fCLWeHEah.roNFOnL8] 2024-09-12T18:28:18.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.470+0000 7fc5e8a439c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:28:18.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.470+0000 7fc5e8a439c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T18:28:18.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.470+0000 7fc5e8a439c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:28:18.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.470+0000 7fc5e8a439c0 5 delete_objs_inline: removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.1__shadow:JQ9ySAkAG7Cwwy6WnBsX48.5--mq9k8_.CR7V8kmIPOmSqursJnTYGyHaV2tMgZi_0 2024-09-12T18:28:18.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.470+0000 7fc5e8a439c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:28:18.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.470+0000 7fc5e8a439c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T18:28:18.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.470+0000 7fc5e8a439c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:28:18.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.470+0000 7fc5e8a439c0 5 delete_objs_inline: removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.1__shadow:olrA4wHWpzBRWhFBgccehFm3m.r6PPV_.egHiQvuzvTwhKGsYEv86_zeGNspx3QH_0 2024-09-12T18:28:18.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.470+0000 7fc5e8a439c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:28:18.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.470+0000 7fc5e8a439c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:28:18.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.474+0000 7fc5e8a439c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:28:18.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.474+0000 7fc5e8a439c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T18:28:18.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.474+0000 7fc5e8a439c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:28:18.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.474+0000 7fc5e8a439c0 5 delete_objs_inline: removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.1__shadow:Dikb5NYjugn2pcn2YjSUFwED8GQpC8s_.W7Y_QP-E-wbeDmQVarHkDXivKQZqvEU_0 2024-09-12T18:28:18.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.474+0000 7fc5e8a439c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:28:18.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.474+0000 7fc4c9ffb640 20 handle_completion(): completion ok for obj=d[JQ9ySAkAG7Cwwy6WnBsX48.5--mq9k8] 2024-09-12T18:28:18.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.478+0000 7fc4c97fa640 20 handle_completion(): completion ok for obj=f[olrA4wHWpzBRWhFBgccehFm3m.r6PPV] 2024-09-12T18:28:18.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.478+0000 7fc4c9ffb640 20 handle_completion(): completion ok for obj=c[Dikb5NYjugn2pcn2YjSUFwED8GQpC8s] 2024-09-12T18:28:18.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.478+0000 7fc5e8a439c0 20 get_obj_state: octx=0x5571db8de3b0 obj=check-bucket:e state=0x5571dbc237f8 s->prefetch_data=0 2024-09-12T18:28:18.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.478+0000 7fc5e8a439c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0f31mxururqr3dyd7x2wvmxpy1gmvfd5 2024-09-12T18:28:18.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.478+0000 7fc5e8a439c0 20 get_obj_state: octx=0x5571dbc241a0 obj=check-bucket:f state=0x5571dbc1a7f8 s->prefetch_data=0 2024-09-12T18:28:18.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.478+0000 7fc5e8a439c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4gy9svumygiucf8u5gm1dlzyc0gez5dz 2024-09-12T18:28:18.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.478+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:18.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.478+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:18.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.478+0000 7fc5e8a439c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:28:18.485 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.482+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:18.485 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.482+0000 7fc5e8a439c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T18:28:18.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.482+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:18.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.482+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:18.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.486+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:18.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.486+0000 7fc5e8a439c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T18:28:18.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.486+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:18.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.486+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:18.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.486+0000 7fc5e8a439c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T18:28:18.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.490+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:18.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.494+0000 7fc5e8a439c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:18.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.494+0000 7fc5e8a439c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T18:28:18.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.494+0000 7fc5e8a439c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T18:28:18.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.494+0000 7fc49d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:18.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.498+0000 7fc5e8a439c0 20 remove_watcher() i=0 2024-09-12T18:28:18.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.498+0000 7fc5e8a439c0 2 removed watcher, disabling cache 2024-09-12T18:28:18.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.502+0000 7fc5e8a439c0 20 remove_watcher() i=1 2024-09-12T18:28:18.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.502+0000 7fc5e8a439c0 20 remove_watcher() i=2 2024-09-12T18:28:18.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.506+0000 7fc5e8a439c0 20 remove_watcher() i=3 2024-09-12T18:28:18.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.506+0000 7fc5e8a439c0 20 remove_watcher() i=4 2024-09-12T18:28:18.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.510+0000 7fc5e8a439c0 20 remove_watcher() i=5 2024-09-12T18:28:18.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.510+0000 7fc5e8a439c0 20 remove_watcher() i=6 2024-09-12T18:28:18.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.510+0000 7fc5e8a439c0 20 remove_watcher() i=7 2024-09-12T18:28:18.533 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:18.533 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:18.537 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:18.537 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:18.540 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:18.540 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:18.543 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:18.543 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:18.545 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T18:28:18.545 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:28:18.546 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:18.546 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:18.599 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:18.600 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:18.607 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:18.607 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:18.614 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:18.614 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:18.622 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:18.622 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:18.627 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T18:28:18.627 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:28:18.627 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T18:28:18.666 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:18.667 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:18.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.710+0000 7f41db5459c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.710+0000 7f41db5459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.710+0000 7f41db5459c0 20 realm 2024-09-12T18:28:18.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.710+0000 7f41db5459c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.710+0000 7f41db5459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.710+0000 7f41db5459c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:18.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.710+0000 7f41db5459c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.710+0000 7f41db5459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.710+0000 7f41db5459c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.710+0000 7f41db5459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:18.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.710+0000 7f41db5459c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.714+0000 7f41db5459c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:18.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.714+0000 7f41db5459c0 20 searching for the correct realm 2024-09-12T18:28:18.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.718+0000 7f41d904b640 0 -- 172.21.15.111:0/3670609290 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f41d4008050 msgr2=0x7f41d405caf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:18.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.726+0000 7f41d884a640 0 -- 172.21.15.111:0/3670609290 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f41d407e790 msgr2=0x7f41d404b7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:18.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.942+0000 7f41db5459c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:18.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.942+0000 7f41db5459c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:18.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.942+0000 7f41db5459c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:18.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.942+0000 7f41db5459c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:18.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.942+0000 7f41db5459c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:18.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.942+0000 7f41db5459c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:18.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.942+0000 7f41db5459c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.946+0000 7f41db5459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.946+0000 7f41db5459c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.946+0000 7f41db5459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:18.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.946+0000 7f41db5459c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.946+0000 7f41db5459c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:18.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.946+0000 7f41db5459c0 20 zone default found 2024-09-12T18:28:18.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.946+0000 7f41db5459c0 4 Realm: () 2024-09-12T18:28:18.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.946+0000 7f41db5459c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:18.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.946+0000 7f41db5459c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:18.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.946+0000 7f41db5459c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:18.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.946+0000 7f41db5459c0 20 zonegroup default 2024-09-12T18:28:18.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.946+0000 7f41db5459c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.946+0000 7f41db5459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.946+0000 7f41db5459c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.950+0000 7f41db5459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.950+0000 7f41db5459c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.950+0000 7f41db5459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:18.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.950+0000 7f41db5459c0 20 started sync module instance, tier type = 2024-09-12T18:28:18.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.950+0000 7f41db5459c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:18.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.978+0000 7f41db5459c0 20 add_watcher() i=0 2024-09-12T18:28:18.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.978+0000 7f41db5459c0 20 add_watcher() i=1 2024-09-12T18:28:18.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.978+0000 7f41db5459c0 20 add_watcher() i=2 2024-09-12T18:28:18.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.978+0000 7f41db5459c0 20 add_watcher() i=3 2024-09-12T18:28:18.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.978+0000 7f41db5459c0 20 add_watcher() i=4 2024-09-12T18:28:18.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.978+0000 7f41db5459c0 20 add_watcher() i=5 2024-09-12T18:28:18.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.978+0000 7f41db5459c0 20 add_watcher() i=6 2024-09-12T18:28:18.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.982+0000 7f41db5459c0 20 add_watcher() i=7 2024-09-12T18:28:18.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.982+0000 7f41db5459c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:18.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.986+0000 7f408f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:18.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.986+0000 7f41db5459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:18.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.986+0000 7f41db5459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:18.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.986+0000 7f41db5459c0 5 note: GC not initialized 2024-09-12T18:28:18.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.986+0000 7f408e7e4640 20 reqs_thread_entry: start 2024-09-12T18:28:18.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.986+0000 7f41db5459c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:18.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.986+0000 7f41db5459c0 20 Filter name: none 2024-09-12T18:28:18.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.986+0000 7f3ffffff640 20 reqs_thread_entry: start 2024-09-12T18:28:18.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.986+0000 7f41db5459c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T18:28:18.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.986+0000 7f41db5459c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:18.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T18:28:18.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T18:28:18.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 : miss 2024-09-12T18:28:18.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:18.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:18.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 info.flags=0x17 2024-09-12T18:28:18.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 to cache LRU end 2024-09-12T18:28:18.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:28:18.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T18:28:18.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 2024-09-12T18:28:18.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:18.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T18:28:18.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:18.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T18:28:18.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.990+0000 7f41db5459c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:18.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.994+0000 7f41db5459c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T18:28:18.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.994+0000 7f41db5459c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:18.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.994+0000 7f41db5459c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T18:28:18.998 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.994+0000 7f41db5459c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:18.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.994+0000 7f41db5459c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T18:28:18.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.994+0000 7f41db5459c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:19.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.994+0000 7f41db5459c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T18:28:19.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.994+0000 7f41db5459c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:19.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.998+0000 7f41db5459c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T18:28:19.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.998+0000 7f41db5459c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:19.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.998+0000 7f41db5459c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T18:28:19.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.998+0000 7f41db5459c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:19.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.998+0000 7f41db5459c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T18:28:19.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:18.998+0000 7f41db5459c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:19.005 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.002+0000 7f41db5459c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T18:28:19.005 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.002+0000 7f41db5459c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:19.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.002+0000 7f41db5459c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T18:28:19.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.002+0000 7f41db5459c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T18:28:19.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.002+0000 7f408f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:19.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.010+0000 7f41db5459c0 20 remove_watcher() i=0 2024-09-12T18:28:19.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.010+0000 7f41db5459c0 2 removed watcher, disabling cache 2024-09-12T18:28:19.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.010+0000 7f41db5459c0 20 remove_watcher() i=1 2024-09-12T18:28:19.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.014+0000 7f41db5459c0 20 remove_watcher() i=2 2024-09-12T18:28:19.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.014+0000 7f41db5459c0 20 remove_watcher() i=3 2024-09-12T18:28:19.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.018+0000 7f41db5459c0 20 remove_watcher() i=4 2024-09-12T18:28:19.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.018+0000 7f41db5459c0 20 remove_watcher() i=5 2024-09-12T18:28:19.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.022+0000 7f41db5459c0 20 remove_watcher() i=6 2024-09-12T18:28:19.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.022+0000 7f41db5459c0 20 remove_watcher() i=7 2024-09-12T18:28:19.043 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:19.043 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:19.072 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:19.072 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:19.099 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T18:28:19.133 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:19.133 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:19.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.174+0000 7f2cec6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.174+0000 7f2cec6b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.174+0000 7f2cec6b79c0 20 realm 2024-09-12T18:28:19.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.174+0000 7f2cec6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.174+0000 7f2cec6b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.174+0000 7f2cec6b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:19.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.174+0000 7f2cec6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.174+0000 7f2cec6b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.174+0000 7f2cec6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.178+0000 7f2cec6b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:19.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.178+0000 7f2cec6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.178+0000 7f2cec6b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:19.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.178+0000 7f2cec6b79c0 20 searching for the correct realm 2024-09-12T18:28:19.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.182+0000 7f2cea9be640 0 -- 172.21.15.111:0/3820090691 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x560c646487f0 msgr2=0x560c6464abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:19.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.190+0000 7f2ce99bc640 0 -- 172.21.15.111:0/3820090691 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f2ce402c410 msgr2=0x7f2ce402c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:19.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:19.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:19.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:19.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:19.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:19.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:19.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:19.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:19.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 zone default found 2024-09-12T18:28:19.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 4 Realm: () 2024-09-12T18:28:19.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:19.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:19.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:19.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 zonegroup default 2024-09-12T18:28:19.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.198+0000 7f2cec6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.202+0000 7f2cec6b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.202+0000 7f2cec6b79c0 20 started sync module instance, tier type = 2024-09-12T18:28:19.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.202+0000 7f2cec6b79c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:19.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.218+0000 7f2cec6b79c0 20 add_watcher() i=0 2024-09-12T18:28:19.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.218+0000 7f2cec6b79c0 20 add_watcher() i=1 2024-09-12T18:28:19.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.218+0000 7f2cec6b79c0 20 add_watcher() i=2 2024-09-12T18:28:19.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.218+0000 7f2cec6b79c0 20 add_watcher() i=3 2024-09-12T18:28:19.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.218+0000 7f2cec6b79c0 20 add_watcher() i=4 2024-09-12T18:28:19.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.218+0000 7f2cec6b79c0 20 add_watcher() i=5 2024-09-12T18:28:19.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.218+0000 7f2cec6b79c0 20 add_watcher() i=6 2024-09-12T18:28:19.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.222+0000 7f2cec6b79c0 20 add_watcher() i=7 2024-09-12T18:28:19.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.222+0000 7f2cec6b79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:19.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.222+0000 7f2ba0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:19.228 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.222+0000 7f2cec6b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:19.228 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.222+0000 7f2cec6b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:19.228 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.222+0000 7f2cec6b79c0 5 note: GC not initialized 2024-09-12T18:28:19.228 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.222+0000 7f2b1b7fe640 20 reqs_thread_entry: start 2024-09-12T18:28:19.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:19.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 Filter name: none 2024-09-12T18:28:19.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2b197fa640 20 reqs_thread_entry: start 2024-09-12T18:28:19.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:19.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:19.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:19.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:28:19.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 INFO: main: starting shard=0 2024-09-12T18:28:19.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:19.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 INFO: main: starting shard=1 2024-09-12T18:28:19.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:19.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 INFO: main: starting shard=2 2024-09-12T18:28:19.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.226+0000 7f2cec6b79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:19.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.230+0000 7f2cec6b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.230+0000 7f2cec6b79c0 20 INFO: main: starting shard=3 2024-09-12T18:28:19.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.230+0000 7f2cec6b79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:19.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.230+0000 7f2cec6b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.230+0000 7f2cec6b79c0 20 INFO: main: starting shard=4 2024-09-12T18:28:19.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.230+0000 7f2cec6b79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:19.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.230+0000 7f2cec6b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.230+0000 7f2cec6b79c0 20 INFO: main: starting shard=5 2024-09-12T18:28:19.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.230+0000 7f2cec6b79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:19.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.230+0000 7f2cec6b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.230+0000 7f2cec6b79c0 20 INFO: main: starting shard=6 2024-09-12T18:28:19.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.230+0000 7f2cec6b79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:19.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.234+0000 7f2cec6b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.234+0000 7f2cec6b79c0 20 INFO: main: starting shard=7 2024-09-12T18:28:19.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.234+0000 7f2cec6b79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:19.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.234+0000 7f2cec6b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.234+0000 7f2cec6b79c0 20 INFO: main: starting shard=8 2024-09-12T18:28:19.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.234+0000 7f2cec6b79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:19.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.234+0000 7f2cec6b79c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T18:28:19.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.238+0000 7f2cec6b79c0 20 INFO: main: starting shard=9 2024-09-12T18:28:19.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.238+0000 7f2cec6b79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:19.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.238+0000 7f2cec6b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.238+0000 7f2cec6b79c0 20 INFO: main: starting shard=10 2024-09-12T18:28:19.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.238+0000 7f2cec6b79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:19.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.238+0000 7f2cec6b79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.238+0000 7f2cec6b79c0 20 INFO: main: done 2024-09-12T18:28:19.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.242+0000 7f2ba0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:19.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.246+0000 7f2cec6b79c0 20 remove_watcher() i=0 2024-09-12T18:28:19.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.246+0000 7f2cec6b79c0 2 removed watcher, disabling cache 2024-09-12T18:28:19.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.246+0000 7f2cec6b79c0 20 remove_watcher() i=1 2024-09-12T18:28:19.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.250+0000 7f2cec6b79c0 20 remove_watcher() i=2 2024-09-12T18:28:19.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.254+0000 7f2cec6b79c0 20 remove_watcher() i=3 2024-09-12T18:28:19.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.254+0000 7f2cec6b79c0 20 remove_watcher() i=4 2024-09-12T18:28:19.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.258+0000 7f2cec6b79c0 20 remove_watcher() i=5 2024-09-12T18:28:19.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.258+0000 7f2cec6b79c0 20 remove_watcher() i=6 2024-09-12T18:28:19.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.258+0000 7f2cec6b79c0 20 remove_watcher() i=7 2024-09-12T18:28:19.276 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T18:28:19.305 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:19.305 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:19.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.346+0000 7fa8cb24d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.346+0000 7fa8cb24d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.346+0000 7fa8cb24d9c0 20 realm 2024-09-12T18:28:19.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.346+0000 7fa8cb24d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.346+0000 7fa8cb24d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.346+0000 7fa8cb24d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:19.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.346+0000 7fa8cb24d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.346+0000 7fa8cb24d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.346+0000 7fa8cb24d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.350+0000 7fa8cb24d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:19.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.350+0000 7fa8cb24d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.350+0000 7fa8cb24d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:19.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.350+0000 7fa8cb24d9c0 20 searching for the correct realm 2024-09-12T18:28:19.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.354+0000 7fa8c8d53640 0 -- 172.21.15.111:0/2964504508 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fa8c4018040 msgr2=0x7fa8c4029950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:19.365 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.362+0000 7fa8c3fff640 0 -- 172.21.15.111:0/2964504508 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fa8c40358d0 msgr2=0x7fa8c40283d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:19.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.578+0000 7fa8cb24d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:19.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.578+0000 7fa8cb24d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:19.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.578+0000 7fa8cb24d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:19.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.578+0000 7fa8cb24d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:19.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.578+0000 7fa8cb24d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:19.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.578+0000 7fa8cb24d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:19.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:19.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:19.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 20 zone default found 2024-09-12T18:28:19.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 4 Realm: () 2024-09-12T18:28:19.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:19.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:19.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:19.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 20 zonegroup default 2024-09-12T18:28:19.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.582+0000 7fa8cb24d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.586+0000 7fa8cb24d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.586+0000 7fa8cb24d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.586+0000 7fa8cb24d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.586+0000 7fa8cb24d9c0 20 started sync module instance, tier type = 2024-09-12T18:28:19.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.586+0000 7fa8cb24d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:19.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.610+0000 7fa8cb24d9c0 20 add_watcher() i=0 2024-09-12T18:28:19.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.610+0000 7fa8cb24d9c0 20 add_watcher() i=1 2024-09-12T18:28:19.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.610+0000 7fa8cb24d9c0 20 add_watcher() i=2 2024-09-12T18:28:19.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.610+0000 7fa8cb24d9c0 20 add_watcher() i=3 2024-09-12T18:28:19.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.610+0000 7fa8cb24d9c0 20 add_watcher() i=4 2024-09-12T18:28:19.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.610+0000 7fa8cb24d9c0 20 add_watcher() i=5 2024-09-12T18:28:19.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.610+0000 7fa8cb24d9c0 20 add_watcher() i=6 2024-09-12T18:28:19.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.614+0000 7fa8cb24d9c0 20 add_watcher() i=7 2024-09-12T18:28:19.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.614+0000 7fa8cb24d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:19.621 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.618+0000 7fa77efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:19.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.618+0000 7fa8cb24d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:19.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.618+0000 7fa8cb24d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:19.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.618+0000 7fa8cb24d9c0 5 note: GC not initialized 2024-09-12T18:28:19.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.618+0000 7fa77dfe3640 20 reqs_thread_entry: start 2024-09-12T18:28:19.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.618+0000 7fa8cb24d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:19.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.618+0000 7fa8cb24d9c0 20 Filter name: none 2024-09-12T18:28:19.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.618+0000 7fa6ef7fe640 20 reqs_thread_entry: start 2024-09-12T18:28:19.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.618+0000 7fa8cb24d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.618+0000 7fa8cb24d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:19.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.622+0000 7fa8cb24d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.622+0000 7fa8cb24d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:19.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.622+0000 7fa8cb24d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:19.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.622+0000 7fa8cb24d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:28:19.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.622+0000 7fa8cb24d9c0 20 INFO: main: starting shard=0 2024-09-12T18:28:19.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.622+0000 7fa8cb24d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:19.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.622+0000 7fa8cb24d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.622+0000 7fa8cb24d9c0 20 INFO: main: starting shard=1 2024-09-12T18:28:19.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.622+0000 7fa8cb24d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:19.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.622+0000 7fa8cb24d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.622+0000 7fa8cb24d9c0 20 INFO: main: starting shard=2 2024-09-12T18:28:19.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.622+0000 7fa8cb24d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:19.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.626+0000 7fa8cb24d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.626+0000 7fa8cb24d9c0 20 INFO: main: starting shard=3 2024-09-12T18:28:19.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.626+0000 7fa8cb24d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:19.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.626+0000 7fa8cb24d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.626+0000 7fa8cb24d9c0 20 INFO: main: starting shard=4 2024-09-12T18:28:19.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.626+0000 7fa8cb24d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:19.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.626+0000 7fa8cb24d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.626+0000 7fa8cb24d9c0 20 INFO: main: starting shard=5 2024-09-12T18:28:19.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.626+0000 7fa8cb24d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:19.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.630+0000 7fa8cb24d9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T18:28:19.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.630+0000 7fa8cb24d9c0 20 INFO: main: starting shard=6 2024-09-12T18:28:19.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.630+0000 7fa8cb24d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:19.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.630+0000 7fa8cb24d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.630+0000 7fa8cb24d9c0 20 INFO: main: starting shard=7 2024-09-12T18:28:19.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.630+0000 7fa8cb24d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:19.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.630+0000 7fa8cb24d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.630+0000 7fa8cb24d9c0 20 INFO: main: starting shard=8 2024-09-12T18:28:19.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.630+0000 7fa8cb24d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:19.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.634+0000 7fa8cb24d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.634+0000 7fa8cb24d9c0 20 INFO: main: starting shard=9 2024-09-12T18:28:19.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.634+0000 7fa8cb24d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:19.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.634+0000 7fa8cb24d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.634+0000 7fa8cb24d9c0 20 INFO: main: starting shard=10 2024-09-12T18:28:19.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.634+0000 7fa8cb24d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:19.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.634+0000 7fa8cb24d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:19.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.634+0000 7fa8cb24d9c0 20 INFO: main: done 2024-09-12T18:28:19.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.638+0000 7fa77efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:19.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.642+0000 7fa8cb24d9c0 20 remove_watcher() i=0 2024-09-12T18:28:19.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.642+0000 7fa8cb24d9c0 2 removed watcher, disabling cache 2024-09-12T18:28:19.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.646+0000 7fa8cb24d9c0 20 remove_watcher() i=1 2024-09-12T18:28:19.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.650+0000 7fa8cb24d9c0 20 remove_watcher() i=2 2024-09-12T18:28:19.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.650+0000 7fa8cb24d9c0 20 remove_watcher() i=3 2024-09-12T18:28:19.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.654+0000 7fa8cb24d9c0 20 remove_watcher() i=4 2024-09-12T18:28:19.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.654+0000 7fa8cb24d9c0 20 remove_watcher() i=5 2024-09-12T18:28:19.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.658+0000 7fa8cb24d9c0 20 remove_watcher() i=6 2024-09-12T18:28:19.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.658+0000 7fa8cb24d9c0 20 remove_watcher() i=7 2024-09-12T18:28:19.687 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T18:28:19.687 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:28:19.687 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T18:28:19.721 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:19.721 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:19.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.762+0000 7fac348679c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.762+0000 7fac348679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.762+0000 7fac348679c0 20 realm 2024-09-12T18:28:19.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.762+0000 7fac348679c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.762+0000 7fac348679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.762+0000 7fac348679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:19.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.762+0000 7fac348679c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.766+0000 7fac348679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:19.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.766+0000 7fac348679c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.766+0000 7fac348679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:19.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.766+0000 7fac348679c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:19.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.766+0000 7fac348679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:19.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.766+0000 7fac348679c0 20 searching for the correct realm 2024-09-12T18:28:19.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.770+0000 7fac32b6e640 0 -- 172.21.15.111:0/1849638932 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fac280f6730 msgr2=0x7fac280a5a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:19.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.778+0000 7fac31b6c640 0 -- 172.21.15.111:0/1849638932 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fac2c020a90 msgr2=0x7fac2c038400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:19.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.994+0000 7fac348679c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:20.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.994+0000 7fac348679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:20.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.994+0000 7fac348679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:20.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.994+0000 7fac348679c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:20.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.994+0000 7fac348679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:20.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.994+0000 7fac348679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:20.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.994+0000 7fac348679c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:20.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:20.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 20 zone default found 2024-09-12T18:28:20.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 4 Realm: () 2024-09-12T18:28:20.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:20.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:20.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:20.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 20 zonegroup default 2024-09-12T18:28:20.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:19.998+0000 7fac348679c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.002+0000 7fac348679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.002+0000 7fac348679c0 20 started sync module instance, tier type = 2024-09-12T18:28:20.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.002+0000 7fac348679c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:20.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.026+0000 7fac348679c0 20 add_watcher() i=0 2024-09-12T18:28:20.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.026+0000 7fac348679c0 20 add_watcher() i=1 2024-09-12T18:28:20.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.026+0000 7fac348679c0 20 add_watcher() i=2 2024-09-12T18:28:20.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.026+0000 7fac348679c0 20 add_watcher() i=3 2024-09-12T18:28:20.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.026+0000 7fac348679c0 20 add_watcher() i=4 2024-09-12T18:28:20.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.026+0000 7fac348679c0 20 add_watcher() i=5 2024-09-12T18:28:20.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.026+0000 7fac348679c0 20 add_watcher() i=6 2024-09-12T18:28:20.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.026+0000 7fac348679c0 20 add_watcher() i=7 2024-09-12T18:28:20.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.026+0000 7fac348679c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:20.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.030+0000 7faae97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:20.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.030+0000 7fac348679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:20.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.030+0000 7fac348679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:20.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.030+0000 7fac348679c0 5 note: GC not initialized 2024-09-12T18:28:20.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7faae37fe640 20 reqs_thread_entry: start 2024-09-12T18:28:20.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:20.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 20 Filter name: none 2024-09-12T18:28:20.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7faae17fa640 20 reqs_thread_entry: start 2024-09-12T18:28:20.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T18:28:20.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:20.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T18:28:20.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T18:28:20.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 : miss 2024-09-12T18:28:20.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:20.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 info.flags=0x17 2024-09-12T18:28:20.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 to cache LRU end 2024-09-12T18:28:20.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:28:20.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T18:28:20.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 2024-09-12T18:28:20.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.034+0000 7fac348679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:20.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.038+0000 7fac348679c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T18:28:20.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.038+0000 7fac348679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:20.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.038+0000 7fac348679c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T18:28:20.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.038+0000 7fac348679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:20.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.038+0000 7fac348679c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T18:28:20.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.038+0000 7fac348679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:20.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.038+0000 7fac348679c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T18:28:20.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.038+0000 7fac348679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:20.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.038+0000 7fac348679c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T18:28:20.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.038+0000 7fac348679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:20.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.042+0000 7fac348679c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T18:28:20.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.042+0000 7fac348679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:20.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.042+0000 7fac348679c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T18:28:20.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.042+0000 7fac348679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:20.047 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.042+0000 7fac348679c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T18:28:20.047 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.042+0000 7fac348679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:20.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.046+0000 7fac348679c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T18:28:20.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.046+0000 7fac348679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:20.050 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.046+0000 7fac348679c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T18:28:20.050 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.046+0000 7fac348679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:20.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.046+0000 7fac348679c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T18:28:20.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.046+0000 7fac348679c0 1 NOTICE: finished all shards (2 entries found) 2024-09-12T18:28:20.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.050+0000 7faae97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:20.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.054+0000 7fac348679c0 20 remove_watcher() i=0 2024-09-12T18:28:20.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.054+0000 7fac348679c0 2 removed watcher, disabling cache 2024-09-12T18:28:20.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.058+0000 7fac348679c0 20 remove_watcher() i=1 2024-09-12T18:28:20.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.058+0000 7fac348679c0 20 remove_watcher() i=2 2024-09-12T18:28:20.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.062+0000 7fac348679c0 20 remove_watcher() i=3 2024-09-12T18:28:20.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.062+0000 7fac348679c0 20 remove_watcher() i=4 2024-09-12T18:28:20.070 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.066+0000 7fac348679c0 20 remove_watcher() i=5 2024-09-12T18:28:20.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.066+0000 7fac348679c0 20 remove_watcher() i=6 2024-09-12T18:28:20.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.070+0000 7fac348679c0 20 remove_watcher() i=7 2024-09-12T18:28:20.092 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T18:28:20.092 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:28:20.092 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T18:28:20.127 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:20.128 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:20.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.170+0000 7f3336cf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.170+0000 7f3336cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.170+0000 7f3336cf49c0 20 realm 2024-09-12T18:28:20.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.170+0000 7f3336cf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.170+0000 7f3336cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.170+0000 7f3336cf49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:20.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.170+0000 7f3336cf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.170+0000 7f3336cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.170+0000 7f3336cf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.174+0000 7f3336cf49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:20.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.174+0000 7f3336cf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.174+0000 7f3336cf49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:20.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.174+0000 7f3336cf49c0 20 searching for the correct realm 2024-09-12T18:28:20.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.178+0000 7f33347fa640 0 -- 172.21.15.111:0/777482981 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f332c031060 msgr2=0x7f332c062310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:20.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.182+0000 7f3333ff9640 0 -- 172.21.15.111:0/777482981 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f332c06a0b0 msgr2=0x7f332c0648c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:20.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.398+0000 7f3336cf49c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:20.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.398+0000 7f3336cf49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:20.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.398+0000 7f3336cf49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:20.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.398+0000 7f3336cf49c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:20.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.398+0000 7f3336cf49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:20.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.398+0000 7f3336cf49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:20.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.398+0000 7f3336cf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.398+0000 7f3336cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.398+0000 7f3336cf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.398+0000 7f3336cf49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:20.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.398+0000 7f3336cf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:20.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 20 zone default found 2024-09-12T18:28:20.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 4 Realm: () 2024-09-12T18:28:20.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:20.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:20.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:20.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 20 zonegroup default 2024-09-12T18:28:20.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 20 started sync module instance, tier type = 2024-09-12T18:28:20.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.402+0000 7f3336cf49c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:20.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.430+0000 7f3336cf49c0 20 add_watcher() i=0 2024-09-12T18:28:20.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.430+0000 7f3336cf49c0 20 add_watcher() i=1 2024-09-12T18:28:20.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.430+0000 7f3336cf49c0 20 add_watcher() i=2 2024-09-12T18:28:20.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.430+0000 7f3336cf49c0 20 add_watcher() i=3 2024-09-12T18:28:20.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.430+0000 7f3336cf49c0 20 add_watcher() i=4 2024-09-12T18:28:20.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.430+0000 7f3336cf49c0 20 add_watcher() i=5 2024-09-12T18:28:20.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.430+0000 7f3336cf49c0 20 add_watcher() i=6 2024-09-12T18:28:20.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.430+0000 7f3336cf49c0 20 add_watcher() i=7 2024-09-12T18:28:20.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.430+0000 7f3336cf49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:20.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.434+0000 7f31eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:20.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.438+0000 7f3336cf49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:20.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.438+0000 7f3336cf49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:20.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.438+0000 7f3336cf49c0 5 note: GC not initialized 2024-09-12T18:28:20.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.438+0000 7f31e9fdb640 20 reqs_thread_entry: start 2024-09-12T18:28:20.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.438+0000 7f3336cf49c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:20.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.438+0000 7f3336cf49c0 20 Filter name: none 2024-09-12T18:28:20.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.438+0000 7f315b7fe640 20 reqs_thread_entry: start 2024-09-12T18:28:20.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.438+0000 7f3336cf49c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T18:28:20.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.438+0000 7f3336cf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.438+0000 7f3336cf49c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:20.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.438+0000 7f3336cf49c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T18:28:20.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.438+0000 7f3336cf49c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T18:28:20.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.438+0000 7f3336cf49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 : miss 2024-09-12T18:28:20.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.438+0000 7f3336cf49c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.442+0000 7f3336cf49c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:20.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.442+0000 7f3336cf49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 info.flags=0x17 2024-09-12T18:28:20.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.442+0000 7f3336cf49c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 to cache LRU end 2024-09-12T18:28:20.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.442+0000 7f3336cf49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:28:20.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.442+0000 7f3336cf49c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T18:28:20.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.442+0000 7f3336cf49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 2024-09-12T18:28:20.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.442+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:20.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.442+0000 7f3336cf49c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T18:28:20.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.442+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:20.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.442+0000 7f3336cf49c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T18:28:20.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.442+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:20.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.442+0000 7f3336cf49c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T18:28:20.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.442+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:20.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.446+0000 7f3336cf49c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T18:28:20.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.446+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:20.450 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.446+0000 7f3336cf49c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T18:28:20.450 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.446+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:20.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.446+0000 7f3336cf49c0 20 get_obj_state: octx=0x563f9f1cb3b0 obj=check-bucket:d state=0x563f9f5144b8 s->prefetch_data=0 2024-09-12T18:28:20.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.446+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:20.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.450+0000 7f3336cf49c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T18:28:20.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.450+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:20.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.450+0000 7f3336cf49c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T18:28:20.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.450+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:20.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.450+0000 7f3336cf49c0 20 get_obj_state: octx=0x563f9f2704d0 obj=check-bucket:c state=0x563f9f510438 s->prefetch_data=0 2024-09-12T18:28:20.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.454+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:20.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.454+0000 7f3336cf49c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T18:28:20.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.454+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:20.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.454+0000 7f3336cf49c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T18:28:20.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.454+0000 7f3336cf49c0 20 get_obj_state: setting s->obj_tag to jt14io4mzusmf4y5t1p0lb7wa0voj6wj 2024-09-12T18:28:20.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.454+0000 7f3336cf49c0 20 get_obj_state_impl: setting s->olh_tag to nc9l0qjlgoktgxbd08xs3jhm28vy8pno 2024-09-12T18:28:20.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.454+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:20.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.454+0000 7f3336cf49c0 20 get_obj_state: setting s->obj_tag to lgb2tc1ngswqpw0lv6dc1tipaixxaz4t 2024-09-12T18:28:20.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.454+0000 7f3336cf49c0 20 get_obj_state_impl: setting s->olh_tag to 66pbxq5zb90v07a00ci1jxtp5oop6iwx 2024-09-12T18:28:20.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.454+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:20.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.454+0000 7f3336cf49c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T18:28:20.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.454+0000 7f3336cf49c0 20 olh_log_entry: epoch=4 op=3 key=d[-9kV0rPnWPMSAsquRCFvPs4ULFVgX8Q] 2024-09-12T18:28:20.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.458+0000 7f3336cf49c0 20 get_obj_state: octx=0x563f9f53c7a0 obj=check-bucket:_:-9kV0rPnWPMSAsquRCFvPs4ULFVgX8Q_d state=0x563f9f50ea38 s->prefetch_data=0 2024-09-12T18:28:20.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.458+0000 7f3336cf49c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T18:28:20.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.458+0000 7f3336cf49c0 20 olh_log_entry: epoch=4 op=3 key=c[W2MNPO0QKvY4EaTnUb203Er1YsjLIMN] 2024-09-12T18:28:20.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.458+0000 7f3336cf49c0 20 get_obj_state: octx=0x563f9f55c7a0 obj=check-bucket:_:W2MNPO0QKvY4EaTnUb203Er1YsjLIMN_c state=0x563f9f566808 s->prefetch_data=0 2024-09-12T18:28:20.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.458+0000 7f3336cf49c0 20 get_obj_state: octx=0x563f9f53c7a0 obj=check-bucket:d state=0x563f9f566808 s->prefetch_data=0 2024-09-12T18:28:20.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.462+0000 7f3336cf49c0 20 get_obj_state: octx=0x563f9f55c7a0 obj=check-bucket:c state=0x563f9f512098 s->prefetch_data=0 2024-09-12T18:28:20.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.462+0000 7f3336cf49c0 20 get_obj_state: setting s->obj_tag to lgb2tc1ngswqpw0lv6dc1tipaixxaz4t 2024-09-12T18:28:20.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.462+0000 7f3336cf49c0 20 get_obj_state_impl: setting s->olh_tag to 66pbxq5zb90v07a00ci1jxtp5oop6iwx 2024-09-12T18:28:20.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.462+0000 7f3336cf49c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=66pbxq5zb90v07a00ci1jxtp5oop6iwx 2024-09-12T18:28:20.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.462+0000 7f3336cf49c0 20 get_obj_state: setting s->obj_tag to jt14io4mzusmf4y5t1p0lb7wa0voj6wj 2024-09-12T18:28:20.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.462+0000 7f3336cf49c0 20 get_obj_state_impl: setting s->olh_tag to nc9l0qjlgoktgxbd08xs3jhm28vy8pno 2024-09-12T18:28:20.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.462+0000 7f3336cf49c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nc9l0qjlgoktgxbd08xs3jhm28vy8pno 2024-09-12T18:28:20.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.466+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:20.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.466+0000 7f3336cf49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:20.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.470+0000 7f3336cf49c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T18:28:20.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.470+0000 7f3336cf49c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T18:28:20.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.470+0000 7f3336cf49c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T18:28:20.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.470+0000 7f31eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:20.481 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.478+0000 7f3336cf49c0 20 remove_watcher() i=0 2024-09-12T18:28:20.481 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.478+0000 7f3336cf49c0 2 removed watcher, disabling cache 2024-09-12T18:28:20.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.478+0000 7f3336cf49c0 20 remove_watcher() i=1 2024-09-12T18:28:20.485 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.482+0000 7f3336cf49c0 20 remove_watcher() i=2 2024-09-12T18:28:20.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.482+0000 7f3336cf49c0 20 remove_watcher() i=3 2024-09-12T18:28:20.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.486+0000 7f3336cf49c0 20 remove_watcher() i=4 2024-09-12T18:28:20.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.486+0000 7f3336cf49c0 20 remove_watcher() i=5 2024-09-12T18:28:20.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.490+0000 7f3336cf49c0 20 remove_watcher() i=6 2024-09-12T18:28:20.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.490+0000 7f3336cf49c0 20 remove_watcher() i=7 2024-09-12T18:28:20.511 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T18:28:20.544 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:20.544 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:20.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.586+0000 7f805874f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.586+0000 7f805874f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.586+0000 7f805874f9c0 20 realm 2024-09-12T18:28:20.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.586+0000 7f805874f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.590+0000 7f805874f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.590+0000 7f805874f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:20.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.590+0000 7f805874f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.590+0000 7f805874f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.590+0000 7f805874f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.590+0000 7f805874f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:20.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.590+0000 7f805874f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.590+0000 7f805874f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:20.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.590+0000 7f805874f9c0 20 searching for the correct realm 2024-09-12T18:28:20.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.594+0000 7f8055a54640 0 -- 172.21.15.111:0/2365160286 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f80480bd070 msgr2=0x7f80480bd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:20.813 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.810+0000 7f8056255640 0 -- 172.21.15.111:0/2365160286 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f805002f030 msgr2=0x7f805003a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:20.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:20.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:20.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:20.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:20.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:20.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:20.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:20.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:20.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 zone default found 2024-09-12T18:28:20.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 4 Realm: () 2024-09-12T18:28:20.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:20.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:20.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:20.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 zonegroup default 2024-09-12T18:28:20.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.826+0000 7f805874f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.830+0000 7f805874f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.830+0000 7f805874f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.830+0000 7f805874f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.830+0000 7f805874f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.830+0000 7f805874f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.830+0000 7f805874f9c0 20 started sync module instance, tier type = 2024-09-12T18:28:20.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.830+0000 7f805874f9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:20.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.858+0000 7f805874f9c0 20 add_watcher() i=0 2024-09-12T18:28:20.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.858+0000 7f805874f9c0 20 add_watcher() i=1 2024-09-12T18:28:20.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.858+0000 7f805874f9c0 20 add_watcher() i=2 2024-09-12T18:28:20.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.858+0000 7f805874f9c0 20 add_watcher() i=3 2024-09-12T18:28:20.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.858+0000 7f805874f9c0 20 add_watcher() i=4 2024-09-12T18:28:20.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.858+0000 7f805874f9c0 20 add_watcher() i=5 2024-09-12T18:28:20.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.858+0000 7f805874f9c0 20 add_watcher() i=6 2024-09-12T18:28:20.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.858+0000 7f805874f9c0 20 add_watcher() i=7 2024-09-12T18:28:20.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.858+0000 7f805874f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:20.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.866+0000 7f7f0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:20.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.866+0000 7f805874f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:20.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.866+0000 7f805874f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:20.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.866+0000 7f805874f9c0 5 note: GC not initialized 2024-09-12T18:28:20.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.866+0000 7f7e877fe640 20 reqs_thread_entry: start 2024-09-12T18:28:20.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.866+0000 7f805874f9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:20.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.866+0000 7f805874f9c0 20 Filter name: none 2024-09-12T18:28:20.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.866+0000 7f7e857fa640 20 reqs_thread_entry: start 2024-09-12T18:28:20.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.866+0000 7f805874f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.866+0000 7f805874f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:20.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.866+0000 7f805874f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.870+0000 7f805874f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:20.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.870+0000 7f805874f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:20.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.870+0000 7f805874f9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:28:20.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.870+0000 7f805874f9c0 20 INFO: main: starting shard=0 2024-09-12T18:28:20.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.870+0000 7f805874f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:20.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.870+0000 7f805874f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:20.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.870+0000 7f805874f9c0 20 INFO: main: starting shard=1 2024-09-12T18:28:20.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.870+0000 7f805874f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:20.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.870+0000 7f805874f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:20.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.870+0000 7f805874f9c0 20 INFO: main: starting shard=2 2024-09-12T18:28:20.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.870+0000 7f805874f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:20.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.870+0000 7f805874f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:20.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.870+0000 7f805874f9c0 20 INFO: main: starting shard=3 2024-09-12T18:28:20.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.870+0000 7f805874f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:20.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.874+0000 7f805874f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:20.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.874+0000 7f805874f9c0 20 INFO: main: starting shard=4 2024-09-12T18:28:20.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.874+0000 7f805874f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:20.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.874+0000 7f805874f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:20.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.874+0000 7f805874f9c0 20 INFO: main: starting shard=5 2024-09-12T18:28:20.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.874+0000 7f805874f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:20.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.874+0000 7f805874f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:20.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.874+0000 7f805874f9c0 20 INFO: main: starting shard=6 2024-09-12T18:28:20.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.874+0000 7f805874f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:20.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.878+0000 7f805874f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:20.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.878+0000 7f805874f9c0 20 INFO: main: starting shard=7 2024-09-12T18:28:20.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.878+0000 7f805874f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:20.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.878+0000 7f805874f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:20.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.878+0000 7f805874f9c0 20 INFO: main: starting shard=8 2024-09-12T18:28:20.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.878+0000 7f805874f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:20.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.882+0000 7f805874f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:20.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.882+0000 7f805874f9c0 20 INFO: main: starting shard=9 2024-09-12T18:28:20.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.882+0000 7f805874f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:20.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.882+0000 7f805874f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:20.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.882+0000 7f805874f9c0 20 INFO: main: starting shard=10 2024-09-12T18:28:20.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.882+0000 7f805874f9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:20.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.882+0000 7f805874f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:20.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.882+0000 7f805874f9c0 20 INFO: main: done 2024-09-12T18:28:20.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.886+0000 7f7f0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:20.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.890+0000 7f805874f9c0 20 remove_watcher() i=0 2024-09-12T18:28:20.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.890+0000 7f805874f9c0 2 removed watcher, disabling cache 2024-09-12T18:28:20.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.894+0000 7f805874f9c0 20 remove_watcher() i=1 2024-09-12T18:28:20.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.894+0000 7f805874f9c0 20 remove_watcher() i=2 2024-09-12T18:28:20.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.898+0000 7f805874f9c0 20 remove_watcher() i=3 2024-09-12T18:28:20.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.898+0000 7f805874f9c0 20 remove_watcher() i=4 2024-09-12T18:28:20.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.902+0000 7f805874f9c0 20 remove_watcher() i=5 2024-09-12T18:28:20.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.902+0000 7f805874f9c0 20 remove_watcher() i=6 2024-09-12T18:28:20.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.906+0000 7f805874f9c0 20 remove_watcher() i=7 2024-09-12T18:28:20.924 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T18:28:20.952 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:20.952 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:20.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.994+0000 7fa5dcc709c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.998 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.994+0000 7fa5dcc709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.998 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.994+0000 7fa5dcc709c0 20 realm 2024-09-12T18:28:20.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.994+0000 7fa5dcc709c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:20.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.994+0000 7fa5dcc709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:20.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.994+0000 7fa5dcc709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:20.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.994+0000 7fa5dcc709c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.994+0000 7fa5dcc709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:21.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.994+0000 7fa5dcc709c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.998+0000 7fa5dcc709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:21.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.998+0000 7fa5dcc709c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.998+0000 7fa5dcc709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:21.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:20.998+0000 7fa5dcc709c0 20 searching for the correct realm 2024-09-12T18:28:21.005 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.002+0000 7fa5daf77640 0 -- 172.21.15.111:0/3072365113 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fa5d0029070 msgr2=0x7fa5d0043940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:21.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.010+0000 7fa5d9f75640 0 -- 172.21.15.111:0/3072365113 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fa5d4070740 msgr2=0x7fa5d40656e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:21.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.226+0000 7fa5dcc709c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:21.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.226+0000 7fa5dcc709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:21.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.226+0000 7fa5dcc709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:21.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.226+0000 7fa5dcc709c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:21.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.226+0000 7fa5dcc709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:21.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.226+0000 7fa5dcc709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:21.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.226+0000 7fa5dcc709c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.226+0000 7fa5dcc709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:21.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.226+0000 7fa5dcc709c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:21.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:21.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 20 zone default found 2024-09-12T18:28:21.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 4 Realm: () 2024-09-12T18:28:21.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:21.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:21.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:21.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 20 zonegroup default 2024-09-12T18:28:21.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:21.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:21.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:21.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 20 started sync module instance, tier type = 2024-09-12T18:28:21.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.230+0000 7fa5dcc709c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:21.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.254+0000 7fa5dcc709c0 20 add_watcher() i=0 2024-09-12T18:28:21.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.254+0000 7fa5dcc709c0 20 add_watcher() i=1 2024-09-12T18:28:21.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.254+0000 7fa5dcc709c0 20 add_watcher() i=2 2024-09-12T18:28:21.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.254+0000 7fa5dcc709c0 20 add_watcher() i=3 2024-09-12T18:28:21.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.254+0000 7fa5dcc709c0 20 add_watcher() i=4 2024-09-12T18:28:21.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.254+0000 7fa5dcc709c0 20 add_watcher() i=5 2024-09-12T18:28:21.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.254+0000 7fa5dcc709c0 20 add_watcher() i=6 2024-09-12T18:28:21.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.258+0000 7fa5dcc709c0 20 add_watcher() i=7 2024-09-12T18:28:21.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.258+0000 7fa5dcc709c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:21.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.262+0000 7fa490fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:21.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.262+0000 7fa5dcc709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:21.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.262+0000 7fa5dcc709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:21.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.262+0000 7fa5dcc709c0 5 note: GC not initialized 2024-09-12T18:28:21.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.262+0000 7fa40b7fe640 20 reqs_thread_entry: start 2024-09-12T18:28:21.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.262+0000 7fa5dcc709c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:21.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.262+0000 7fa5dcc709c0 20 Filter name: none 2024-09-12T18:28:21.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa4097fa640 20 reqs_thread_entry: start 2024-09-12T18:28:21.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa5dcc709c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa5dcc709c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:21.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa5dcc709c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa5dcc709c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:21.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa5dcc709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:21.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa5dcc709c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:28:21.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa5dcc709c0 20 INFO: main: starting shard=0 2024-09-12T18:28:21.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa5dcc709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:21.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa5dcc709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:21.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa5dcc709c0 20 INFO: main: starting shard=1 2024-09-12T18:28:21.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa5dcc709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:21.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa5dcc709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:21.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa5dcc709c0 20 INFO: main: starting shard=2 2024-09-12T18:28:21.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.266+0000 7fa5dcc709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:21.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.270+0000 7fa5dcc709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:21.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.270+0000 7fa5dcc709c0 20 INFO: main: starting shard=3 2024-09-12T18:28:21.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.270+0000 7fa5dcc709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:21.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.270+0000 7fa5dcc709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:21.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.270+0000 7fa5dcc709c0 20 INFO: main: starting shard=4 2024-09-12T18:28:21.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.270+0000 7fa5dcc709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:21.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.270+0000 7fa5dcc709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:21.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.270+0000 7fa5dcc709c0 20 INFO: main: starting shard=5 2024-09-12T18:28:21.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.270+0000 7fa5dcc709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:21.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.270+0000 7fa5dcc709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:21.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.270+0000 7fa5dcc709c0 20 INFO: main: starting shard=6 2024-09-12T18:28:21.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.270+0000 7fa5dcc709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:21.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.274+0000 7fa5dcc709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:21.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.274+0000 7fa5dcc709c0 20 INFO: main: starting shard=7 2024-09-12T18:28:21.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.274+0000 7fa5dcc709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:21.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.274+0000 7fa5dcc709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:21.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.274+0000 7fa5dcc709c0 20 INFO: main: starting shard=8 2024-09-12T18:28:21.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.274+0000 7fa5dcc709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:21.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.278+0000 7fa5dcc709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:21.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.278+0000 7fa5dcc709c0 20 INFO: main: starting shard=9 2024-09-12T18:28:21.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.278+0000 7fa5dcc709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:21.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.278+0000 7fa5dcc709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:21.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.278+0000 7fa5dcc709c0 20 INFO: main: starting shard=10 2024-09-12T18:28:21.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.278+0000 7fa5dcc709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:21.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.278+0000 7fa5dcc709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:21.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.278+0000 7fa5dcc709c0 20 INFO: main: done 2024-09-12T18:28:21.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.282+0000 7fa490fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:21.289 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.286+0000 7fa5dcc709c0 20 remove_watcher() i=0 2024-09-12T18:28:21.290 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.286+0000 7fa5dcc709c0 2 removed watcher, disabling cache 2024-09-12T18:28:21.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.286+0000 7fa5dcc709c0 20 remove_watcher() i=1 2024-09-12T18:28:21.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.290+0000 7fa5dcc709c0 20 remove_watcher() i=2 2024-09-12T18:28:21.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.294+0000 7fa5dcc709c0 20 remove_watcher() i=3 2024-09-12T18:28:21.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.294+0000 7fa5dcc709c0 20 remove_watcher() i=4 2024-09-12T18:28:21.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.298+0000 7fa5dcc709c0 20 remove_watcher() i=5 2024-09-12T18:28:21.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.298+0000 7fa5dcc709c0 20 remove_watcher() i=6 2024-09-12T18:28:21.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.298+0000 7fa5dcc709c0 20 remove_watcher() i=7 2024-09-12T18:28:21.318 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T18:28:21.318 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:28:21.318 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T18:28:21.351 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:21.351 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:21.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.390+0000 7ffb9ea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.394+0000 7ffb9ea9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:21.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.394+0000 7ffb9ea9d9c0 20 realm 2024-09-12T18:28:21.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.394+0000 7ffb9ea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.394+0000 7ffb9ea9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:21.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.394+0000 7ffb9ea9d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:21.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.394+0000 7ffb9ea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.394+0000 7ffb9ea9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:21.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.394+0000 7ffb9ea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.394+0000 7ffb9ea9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:21.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.394+0000 7ffb9ea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.394+0000 7ffb9ea9d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:21.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.394+0000 7ffb9ea9d9c0 20 searching for the correct realm 2024-09-12T18:28:21.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.398+0000 7ffb9cda4640 0 -- 172.21.15.111:0/3494463579 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7ffb90008040 msgr2=0x7ffb9004b920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:21.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.614+0000 7ffb9bda2640 0 -- 172.21.15.111:0/3494463579 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7ffb8c017070 msgr2=0x7ffb8c09aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:21.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.830+0000 7ffb9ea9d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:21.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.830+0000 7ffb9ea9d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:21.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.830+0000 7ffb9ea9d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:21.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.830+0000 7ffb9ea9d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:21.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.830+0000 7ffb9ea9d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:21.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.830+0000 7ffb9ea9d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:21.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.830+0000 7ffb9ea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.830+0000 7ffb9ea9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:21.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.830+0000 7ffb9ea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:21.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.837 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:21.837 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 20 zone default found 2024-09-12T18:28:21.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 4 Realm: () 2024-09-12T18:28:21.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:21.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:21.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:21.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 20 zonegroup default 2024-09-12T18:28:21.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:21.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:21.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.840 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:21.840 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 20 started sync module instance, tier type = 2024-09-12T18:28:21.840 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.834+0000 7ffb9ea9d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:21.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.862+0000 7ffb9ea9d9c0 20 add_watcher() i=0 2024-09-12T18:28:21.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.862+0000 7ffb9ea9d9c0 20 add_watcher() i=1 2024-09-12T18:28:21.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.862+0000 7ffb9ea9d9c0 20 add_watcher() i=2 2024-09-12T18:28:21.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.862+0000 7ffb9ea9d9c0 20 add_watcher() i=3 2024-09-12T18:28:21.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.862+0000 7ffb9ea9d9c0 20 add_watcher() i=4 2024-09-12T18:28:21.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.862+0000 7ffb9ea9d9c0 20 add_watcher() i=5 2024-09-12T18:28:21.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.862+0000 7ffb9ea9d9c0 20 add_watcher() i=6 2024-09-12T18:28:21.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.866+0000 7ffb9ea9d9c0 20 add_watcher() i=7 2024-09-12T18:28:21.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.866+0000 7ffb9ea9d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:21.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.870+0000 7ffa52fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:21.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.870+0000 7ffb9ea9d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:21.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.870+0000 7ffb9ea9d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:21.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.870+0000 7ffb9ea9d9c0 5 note: GC not initialized 2024-09-12T18:28:21.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.870+0000 7ffa51fdb640 20 reqs_thread_entry: start 2024-09-12T18:28:21.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.870+0000 7ffb9ea9d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:21.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.870+0000 7ffb9ea9d9c0 20 Filter name: none 2024-09-12T18:28:21.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.870+0000 7ff9c37fe640 20 reqs_thread_entry: start 2024-09-12T18:28:21.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.870+0000 7ffb9ea9d9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T18:28:21.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.870+0000 7ffb9ea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.874+0000 7ffb9ea9d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:21.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.874+0000 7ffb9ea9d9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T18:28:21.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.874+0000 7ffb9ea9d9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T18:28:21.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.874+0000 7ffb9ea9d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 : miss 2024-09-12T18:28:21.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.874+0000 7ffb9ea9d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:21.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.874+0000 7ffb9ea9d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:21.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.874+0000 7ffb9ea9d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 info.flags=0x17 2024-09-12T18:28:21.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.874+0000 7ffb9ea9d9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 to cache LRU end 2024-09-12T18:28:21.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.874+0000 7ffb9ea9d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:28:21.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.874+0000 7ffb9ea9d9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T18:28:21.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.874+0000 7ffb9ea9d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 2024-09-12T18:28:21.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.874+0000 7ffb9ea9d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:21.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.874+0000 7ffb9ea9d9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T18:28:21.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.874+0000 7ffb9ea9d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:21.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.878+0000 7ffb9ea9d9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T18:28:21.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.878+0000 7ffb9ea9d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:21.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.878+0000 7ffb9ea9d9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T18:28:21.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.878+0000 7ffb9ea9d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:21.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.878+0000 7ffb9ea9d9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T18:28:21.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.878+0000 7ffb9ea9d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:21.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.878+0000 7ffb9ea9d9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T18:28:21.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.878+0000 7ffb9ea9d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:21.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.882+0000 7ffb9ea9d9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T18:28:21.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.882+0000 7ffb9ea9d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:21.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.882+0000 7ffb9ea9d9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T18:28:21.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.882+0000 7ffb9ea9d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:21.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.882+0000 7ffb9ea9d9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T18:28:21.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.882+0000 7ffb9ea9d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:21.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.882+0000 7ffb9ea9d9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T18:28:21.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.882+0000 7ffb9ea9d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:21.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.886+0000 7ffb9ea9d9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T18:28:21.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.886+0000 7ffb9ea9d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:21.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.886+0000 7ffb9ea9d9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T18:28:21.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.886+0000 7ffb9ea9d9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T18:28:21.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.886+0000 7ffa52fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:21.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.894+0000 7ffb9ea9d9c0 20 remove_watcher() i=0 2024-09-12T18:28:21.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.894+0000 7ffb9ea9d9c0 2 removed watcher, disabling cache 2024-09-12T18:28:21.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.894+0000 7ffb9ea9d9c0 20 remove_watcher() i=1 2024-09-12T18:28:21.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.898+0000 7ffb9ea9d9c0 20 remove_watcher() i=2 2024-09-12T18:28:21.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.902+0000 7ffb9ea9d9c0 20 remove_watcher() i=3 2024-09-12T18:28:21.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.902+0000 7ffb9ea9d9c0 20 remove_watcher() i=4 2024-09-12T18:28:21.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.906+0000 7ffb9ea9d9c0 20 remove_watcher() i=5 2024-09-12T18:28:21.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.906+0000 7ffb9ea9d9c0 20 remove_watcher() i=6 2024-09-12T18:28:21.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:21.906+0000 7ffb9ea9d9c0 20 remove_watcher() i=7 2024-09-12T18:28:21.927 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T18:28:21.927 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:28:21.929 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:21.929 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:21.934 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:21.934 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:21.937 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:21.937 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:21.992 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T18:28:21.992 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:28:21.994 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:21.995 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:22.048 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:22.048 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:22.109 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:22.110 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:22.143 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:22.143 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:22.150 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:22.150 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:22.183 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:22.183 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:22.190 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:22.191 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:22.225 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:22.225 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:22.232 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:22.232 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:22.266 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:22.266 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:22.273 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:22.273 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:22.306 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:22.307 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:22.314 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:22.315 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:22.348 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:22.348 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:22.355 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:28:22.792 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T18:28:24.228 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:24.229 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:24.293 INFO:tasks.workunit.client.0.smithi111.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:28:24.293 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T18:28:24.330 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:24.330 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:24.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.370+0000 7f88805879c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.374+0000 7f88805879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:24.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.374+0000 7f88805879c0 20 realm 2024-09-12T18:28:24.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.374+0000 7f88805879c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.374+0000 7f88805879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:24.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.374+0000 7f88805879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:24.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.374+0000 7f88805879c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.374+0000 7f88805879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:24.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.374+0000 7f88805879c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.374+0000 7f88805879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:24.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.374+0000 7f88805879c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.378+0000 7f88805879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:24.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.378+0000 7f88805879c0 20 searching for the correct realm 2024-09-12T18:28:24.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.382+0000 7f887e88e640 0 -- 172.21.15.111:0/269907136 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f8874008070 msgr2=0x7f887409d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:24.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.390+0000 7f887d88c640 0 -- 172.21.15.111:0/269907136 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f88780c1040 msgr2=0x7f88780b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:24.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.606+0000 7f88805879c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:24.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.606+0000 7f88805879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:24.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.606+0000 7f88805879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:24.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.606+0000 7f88805879c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:24.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.606+0000 7f88805879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:24.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.606+0000 7f88805879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:24.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.606+0000 7f88805879c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.606+0000 7f88805879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:24.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.606+0000 7f88805879c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:24.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:24.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 20 zone default found 2024-09-12T18:28:24.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 4 Realm: () 2024-09-12T18:28:24.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:24.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:24.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:24.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 20 zonegroup default 2024-09-12T18:28:24.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:24.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:24.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:24.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 20 started sync module instance, tier type = 2024-09-12T18:28:24.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.610+0000 7f88805879c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:24.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.638+0000 7f88805879c0 20 add_watcher() i=0 2024-09-12T18:28:24.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.638+0000 7f88805879c0 20 add_watcher() i=1 2024-09-12T18:28:24.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.638+0000 7f88805879c0 20 add_watcher() i=2 2024-09-12T18:28:24.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.638+0000 7f88805879c0 20 add_watcher() i=3 2024-09-12T18:28:24.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.638+0000 7f88805879c0 20 add_watcher() i=4 2024-09-12T18:28:24.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.638+0000 7f88805879c0 20 add_watcher() i=5 2024-09-12T18:28:24.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.638+0000 7f88805879c0 20 add_watcher() i=6 2024-09-12T18:28:24.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.642+0000 7f88805879c0 20 add_watcher() i=7 2024-09-12T18:28:24.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.642+0000 7f88805879c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:24.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.646+0000 7f8734fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:24.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.646+0000 7f88805879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:24.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.646+0000 7f88805879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:24.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.646+0000 7f88805879c0 5 note: GC not initialized 2024-09-12T18:28:24.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.646+0000 7f86af7fe640 20 reqs_thread_entry: start 2024-09-12T18:28:24.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.646+0000 7f88805879c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:24.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.646+0000 7f88805879c0 20 Filter name: none 2024-09-12T18:28:24.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.646+0000 7f86ad7fa640 20 reqs_thread_entry: start 2024-09-12T18:28:24.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.646+0000 7f88805879c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.650+0000 7f88805879c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:24.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.650+0000 7f88805879c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.650+0000 7f88805879c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:24.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.650+0000 7f88805879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:24.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.650+0000 7f88805879c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:28:24.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.650+0000 7f88805879c0 20 INFO: main: starting shard=0 2024-09-12T18:28:24.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.650+0000 7f88805879c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:24.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.650+0000 7f88805879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:24.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.650+0000 7f88805879c0 20 INFO: main: starting shard=1 2024-09-12T18:28:24.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.650+0000 7f88805879c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:24.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.654+0000 7f88805879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:24.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.654+0000 7f88805879c0 20 INFO: main: starting shard=2 2024-09-12T18:28:24.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.654+0000 7f88805879c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:24.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.654+0000 7f88805879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:24.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.654+0000 7f88805879c0 20 INFO: main: starting shard=3 2024-09-12T18:28:24.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.654+0000 7f88805879c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:24.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.654+0000 7f88805879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:24.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.654+0000 7f88805879c0 20 INFO: main: starting shard=4 2024-09-12T18:28:24.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.654+0000 7f88805879c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:24.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.654+0000 7f88805879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:24.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.654+0000 7f88805879c0 20 INFO: main: starting shard=5 2024-09-12T18:28:24.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.654+0000 7f88805879c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:24.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.658+0000 7f88805879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:24.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.658+0000 7f88805879c0 20 INFO: main: starting shard=6 2024-09-12T18:28:24.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.658+0000 7f88805879c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:24.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.658+0000 7f88805879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:24.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.658+0000 7f88805879c0 20 INFO: main: starting shard=7 2024-09-12T18:28:24.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.658+0000 7f88805879c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:24.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.658+0000 7f88805879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:24.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.658+0000 7f88805879c0 20 INFO: main: starting shard=8 2024-09-12T18:28:24.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.658+0000 7f88805879c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:24.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.662+0000 7f88805879c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T18:28:24.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.662+0000 7f88805879c0 20 INFO: main: starting shard=9 2024-09-12T18:28:24.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.662+0000 7f88805879c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:24.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.662+0000 7f88805879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:24.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.662+0000 7f88805879c0 20 INFO: main: starting shard=10 2024-09-12T18:28:24.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.662+0000 7f88805879c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:24.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.666+0000 7f88805879c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:24.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.666+0000 7f88805879c0 20 INFO: main: done 2024-09-12T18:28:24.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.666+0000 7f8734fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:24.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.670+0000 7f88805879c0 20 remove_watcher() i=0 2024-09-12T18:28:24.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.670+0000 7f88805879c0 2 removed watcher, disabling cache 2024-09-12T18:28:24.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.674+0000 7f88805879c0 20 remove_watcher() i=1 2024-09-12T18:28:24.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.678+0000 7f88805879c0 20 remove_watcher() i=2 2024-09-12T18:28:24.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.678+0000 7f88805879c0 20 remove_watcher() i=3 2024-09-12T18:28:24.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.682+0000 7f88805879c0 20 remove_watcher() i=4 2024-09-12T18:28:24.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.682+0000 7f88805879c0 20 remove_watcher() i=5 2024-09-12T18:28:24.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.686+0000 7f88805879c0 20 remove_watcher() i=6 2024-09-12T18:28:24.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.686+0000 7f88805879c0 20 remove_watcher() i=7 2024-09-12T18:28:24.710 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:24.710 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:24.715 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:24.715 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:24.719 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:24.719 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:24.781 INFO:tasks.workunit.client.0.smithi111.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:28:24.782 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T18:28:24.817 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:24.817 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:24.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.862+0000 7f11a6dde9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.862+0000 7f11a6dde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:24.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.862+0000 7f11a6dde9c0 20 realm 2024-09-12T18:28:24.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.862+0000 7f11a6dde9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.862+0000 7f11a6dde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:24.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.862+0000 7f11a6dde9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:24.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.862+0000 7f11a6dde9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.862+0000 7f11a6dde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:24.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.862+0000 7f11a6dde9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.866+0000 7f11a6dde9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:24.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.866+0000 7f11a6dde9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:24.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.866+0000 7f11a6dde9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:24.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.866+0000 7f11a6dde9c0 20 searching for the correct realm 2024-09-12T18:28:24.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.870+0000 7f11a48e4640 0 -- 172.21.15.111:0/1302962585 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f119c0ab070 msgr2=0x7f119c0b9960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:28:24.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:24.878+0000 7f11a40e3640 0 -- 172.21.15.111:0/1302962585 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f119c0d3950 msgr2=0x7f119c0f8410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:28:25.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.094+0000 7f11a6dde9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:25.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.094+0000 7f11a6dde9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:25.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.094+0000 7f11a6dde9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:25.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.094+0000 7f11a6dde9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:25.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.094+0000 7f11a6dde9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:25.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.094+0000 7f11a6dde9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:25.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.094+0000 7f11a6dde9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.094+0000 7f11a6dde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:25.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.094+0000 7f11a6dde9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:25.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:25.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 20 zone default found 2024-09-12T18:28:25.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 4 Realm: () 2024-09-12T18:28:25.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:25.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:25.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:25.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 20 zonegroup default 2024-09-12T18:28:25.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:25.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:25.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:25.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 20 started sync module instance, tier type = 2024-09-12T18:28:25.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.098+0000 7f11a6dde9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:25.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.130+0000 7f11a6dde9c0 20 add_watcher() i=0 2024-09-12T18:28:25.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.130+0000 7f11a6dde9c0 20 add_watcher() i=1 2024-09-12T18:28:25.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.130+0000 7f11a6dde9c0 20 add_watcher() i=2 2024-09-12T18:28:25.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.130+0000 7f11a6dde9c0 20 add_watcher() i=3 2024-09-12T18:28:25.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.130+0000 7f11a6dde9c0 20 add_watcher() i=4 2024-09-12T18:28:25.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.130+0000 7f11a6dde9c0 20 add_watcher() i=5 2024-09-12T18:28:25.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.130+0000 7f11a6dde9c0 20 add_watcher() i=6 2024-09-12T18:28:25.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.130+0000 7f11a6dde9c0 20 add_watcher() i=7 2024-09-12T18:28:25.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.130+0000 7f11a6dde9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:25.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.134+0000 7f105afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:25.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.138+0000 7f11a6dde9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:25.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.138+0000 7f11a6dde9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:25.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.138+0000 7f11a6dde9c0 5 note: GC not initialized 2024-09-12T18:28:25.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.138+0000 7f1059fe3640 20 reqs_thread_entry: start 2024-09-12T18:28:25.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.138+0000 7f11a6dde9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:25.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.138+0000 7f11a6dde9c0 20 Filter name: none 2024-09-12T18:28:25.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.138+0000 7f0fcb7fe640 20 reqs_thread_entry: start 2024-09-12T18:28:25.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.138+0000 7f11a6dde9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.138+0000 7f11a6dde9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:25.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.138+0000 7f11a6dde9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.142+0000 7f11a6dde9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:25.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.142+0000 7f11a6dde9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:25.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.142+0000 7f11a6dde9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:28:25.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.142+0000 7f11a6dde9c0 20 INFO: main: starting shard=0 2024-09-12T18:28:25.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.142+0000 7f11a6dde9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:25.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.142+0000 7f11a6dde9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.142+0000 7f11a6dde9c0 20 INFO: main: starting shard=1 2024-09-12T18:28:25.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.142+0000 7f11a6dde9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:25.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.142+0000 7f11a6dde9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.142+0000 7f11a6dde9c0 20 INFO: main: starting shard=2 2024-09-12T18:28:25.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.142+0000 7f11a6dde9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:25.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.142+0000 7f11a6dde9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.142+0000 7f11a6dde9c0 20 INFO: main: starting shard=3 2024-09-12T18:28:25.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.142+0000 7f11a6dde9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:25.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.146+0000 7f11a6dde9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.146+0000 7f11a6dde9c0 20 INFO: main: starting shard=4 2024-09-12T18:28:25.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.146+0000 7f11a6dde9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:25.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.146+0000 7f11a6dde9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.146+0000 7f11a6dde9c0 20 INFO: main: starting shard=5 2024-09-12T18:28:25.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.146+0000 7f11a6dde9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:25.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.150+0000 7f11a6dde9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T18:28:25.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.150+0000 7f11a6dde9c0 20 INFO: main: starting shard=6 2024-09-12T18:28:25.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.150+0000 7f11a6dde9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:25.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.150+0000 7f11a6dde9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.150+0000 7f11a6dde9c0 20 INFO: main: starting shard=7 2024-09-12T18:28:25.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.150+0000 7f11a6dde9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:25.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.154+0000 7f11a6dde9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.154+0000 7f11a6dde9c0 20 INFO: main: starting shard=8 2024-09-12T18:28:25.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.154+0000 7f11a6dde9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:25.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.154+0000 7f11a6dde9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.154+0000 7f11a6dde9c0 20 INFO: main: starting shard=9 2024-09-12T18:28:25.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.154+0000 7f11a6dde9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:25.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.154+0000 7f11a6dde9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.154+0000 7f11a6dde9c0 20 INFO: main: starting shard=10 2024-09-12T18:28:25.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.154+0000 7f11a6dde9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:25.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.154+0000 7f11a6dde9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.154+0000 7f11a6dde9c0 20 INFO: main: done 2024-09-12T18:28:25.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.158+0000 7f105afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:25.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.162+0000 7f11a6dde9c0 20 remove_watcher() i=0 2024-09-12T18:28:25.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.162+0000 7f11a6dde9c0 2 removed watcher, disabling cache 2024-09-12T18:28:25.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.166+0000 7f11a6dde9c0 20 remove_watcher() i=1 2024-09-12T18:28:25.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.166+0000 7f11a6dde9c0 20 remove_watcher() i=2 2024-09-12T18:28:25.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.170+0000 7f11a6dde9c0 20 remove_watcher() i=3 2024-09-12T18:28:25.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.174+0000 7f11a6dde9c0 20 remove_watcher() i=4 2024-09-12T18:28:25.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.174+0000 7f11a6dde9c0 20 remove_watcher() i=5 2024-09-12T18:28:25.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.178+0000 7f11a6dde9c0 20 remove_watcher() i=6 2024-09-12T18:28:25.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.178+0000 7f11a6dde9c0 20 remove_watcher() i=7 2024-09-12T18:28:25.200 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:25.200 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:25.204 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:25.204 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:25.207 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:25.208 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:25.269 INFO:tasks.workunit.client.0.smithi111.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:28:25.269 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T18:28:25.305 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:25.306 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:25.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.346+0000 7f99bee979c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.350+0000 7f99bee979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:25.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.350+0000 7f99bee979c0 20 realm 2024-09-12T18:28:25.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.350+0000 7f99bee979c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.350+0000 7f99bee979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:25.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.350+0000 7f99bee979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:25.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.350+0000 7f99bee979c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.350+0000 7f99bee979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:25.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.350+0000 7f99bee979c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.350+0000 7f99bee979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:25.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.350+0000 7f99bee979c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.354+0000 7f99bee979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:25.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.354+0000 7f99bee979c0 20 searching for the correct realm 2024-09-12T18:28:25.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.354+0000 7f99bc19c640 0 -- 172.21.15.111:0/1710524664 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f99ac036040 msgr2=0x7f99ac027420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:25.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.566+0000 7f99bc99d640 0 -- 172.21.15.111:0/1710524664 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f99b40c9040 msgr2=0x7f99b40ca030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:25.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.582+0000 7f99bee979c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:25.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.582+0000 7f99bee979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:25.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.582+0000 7f99bee979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:25.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.582+0000 7f99bee979c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:25.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.582+0000 7f99bee979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:25.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.582+0000 7f99bee979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:25.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.582+0000 7f99bee979c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:25.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:25.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:25.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 20 zone default found 2024-09-12T18:28:25.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 4 Realm: () 2024-09-12T18:28:25.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:25.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:25.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:25.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 20 zonegroup default 2024-09-12T18:28:25.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:25.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:25.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.586+0000 7f99bee979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:25.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.590+0000 7f99bee979c0 20 started sync module instance, tier type = 2024-09-12T18:28:25.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.590+0000 7f99bee979c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:25.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.610+0000 7f99bee979c0 20 add_watcher() i=0 2024-09-12T18:28:25.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.610+0000 7f99bee979c0 20 add_watcher() i=1 2024-09-12T18:28:25.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.610+0000 7f99bee979c0 20 add_watcher() i=2 2024-09-12T18:28:25.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.610+0000 7f99bee979c0 20 add_watcher() i=3 2024-09-12T18:28:25.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.610+0000 7f99bee979c0 20 add_watcher() i=4 2024-09-12T18:28:25.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.610+0000 7f99bee979c0 20 add_watcher() i=5 2024-09-12T18:28:25.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.610+0000 7f99bee979c0 20 add_watcher() i=6 2024-09-12T18:28:25.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.614+0000 7f99bee979c0 20 add_watcher() i=7 2024-09-12T18:28:25.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.614+0000 7f99bee979c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:25.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.618+0000 7f9872fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:25.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.618+0000 7f99bee979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:25.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.618+0000 7f99bee979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:25.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.618+0000 7f99bee979c0 5 note: GC not initialized 2024-09-12T18:28:25.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.618+0000 7f9871fe3640 20 reqs_thread_entry: start 2024-09-12T18:28:25.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.618+0000 7f99bee979c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:25.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.618+0000 7f99bee979c0 20 Filter name: none 2024-09-12T18:28:25.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.622+0000 7f97e37fe640 20 reqs_thread_entry: start 2024-09-12T18:28:25.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.622+0000 7f99bee979c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.622+0000 7f99bee979c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:25.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.622+0000 7f99bee979c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.622+0000 7f99bee979c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:25.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.622+0000 7f99bee979c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:25.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.622+0000 7f99bee979c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:28:25.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.622+0000 7f99bee979c0 20 INFO: main: starting shard=0 2024-09-12T18:28:25.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.622+0000 7f99bee979c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:25.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.622+0000 7f99bee979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.622+0000 7f99bee979c0 20 INFO: main: starting shard=1 2024-09-12T18:28:25.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.622+0000 7f99bee979c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:25.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.626+0000 7f99bee979c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:28:25.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.626+0000 7f99bee979c0 20 INFO: main: starting shard=2 2024-09-12T18:28:25.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.626+0000 7f99bee979c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:25.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.626+0000 7f99bee979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.626+0000 7f99bee979c0 20 INFO: main: starting shard=3 2024-09-12T18:28:25.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.626+0000 7f99bee979c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:25.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.626+0000 7f99bee979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.626+0000 7f99bee979c0 20 INFO: main: starting shard=4 2024-09-12T18:28:25.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.626+0000 7f99bee979c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:25.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.626+0000 7f99bee979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.626+0000 7f99bee979c0 20 INFO: main: starting shard=5 2024-09-12T18:28:25.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.626+0000 7f99bee979c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:25.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.630+0000 7f99bee979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.630+0000 7f99bee979c0 20 INFO: main: starting shard=6 2024-09-12T18:28:25.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.630+0000 7f99bee979c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:25.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.630+0000 7f99bee979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.630+0000 7f99bee979c0 20 INFO: main: starting shard=7 2024-09-12T18:28:25.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.630+0000 7f99bee979c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:25.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.630+0000 7f99bee979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.630+0000 7f99bee979c0 20 INFO: main: starting shard=8 2024-09-12T18:28:25.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.630+0000 7f99bee979c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:25.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.634+0000 7f99bee979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.634+0000 7f99bee979c0 20 INFO: main: starting shard=9 2024-09-12T18:28:25.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.634+0000 7f99bee979c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:25.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.634+0000 7f99bee979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.634+0000 7f99bee979c0 20 INFO: main: starting shard=10 2024-09-12T18:28:25.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.634+0000 7f99bee979c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:25.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.634+0000 7f99bee979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:25.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.634+0000 7f99bee979c0 20 INFO: main: done 2024-09-12T18:28:25.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.638+0000 7f9872fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:25.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.642+0000 7f99bee979c0 20 remove_watcher() i=0 2024-09-12T18:28:25.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.642+0000 7f99bee979c0 2 removed watcher, disabling cache 2024-09-12T18:28:25.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.646+0000 7f99bee979c0 20 remove_watcher() i=1 2024-09-12T18:28:25.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.646+0000 7f99bee979c0 20 remove_watcher() i=2 2024-09-12T18:28:25.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.650+0000 7f99bee979c0 20 remove_watcher() i=3 2024-09-12T18:28:25.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.650+0000 7f99bee979c0 20 remove_watcher() i=4 2024-09-12T18:28:25.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.654+0000 7f99bee979c0 20 remove_watcher() i=5 2024-09-12T18:28:25.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.654+0000 7f99bee979c0 20 remove_watcher() i=6 2024-09-12T18:28:25.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.658+0000 7f99bee979c0 20 remove_watcher() i=7 2024-09-12T18:28:25.676 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:25.676 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:25.680 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:25.681 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:25.741 INFO:tasks.workunit.client.0.smithi111.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:28:25.741 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T18:28:25.776 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:25.777 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:25.822 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.818+0000 7f8b6b3de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.822+0000 7f8b6b3de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:25.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.822+0000 7f8b6b3de9c0 20 realm 2024-09-12T18:28:25.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.822+0000 7f8b6b3de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.822+0000 7f8b6b3de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:25.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.822+0000 7f8b6b3de9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:25.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.822+0000 7f8b6b3de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.822+0000 7f8b6b3de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:25.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.822+0000 7f8b6b3de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.822+0000 7f8b6b3de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:25.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.822+0000 7f8b6b3de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:25.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.822+0000 7f8b6b3de9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:25.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.822+0000 7f8b6b3de9c0 20 searching for the correct realm 2024-09-12T18:28:25.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.826+0000 7f8b68ee4640 0 -- 172.21.15.111:0/3200694404 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f8b6003f060 msgr2=0x7f8b60008620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:28:25.840 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:25.834+0000 7f8b686e3640 0 -- 172.21.15.111:0/3200694404 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f8b6000e070 msgr2=0x7f8b6004a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:28:26.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:26.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:26.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:26.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:26.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:26.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:26.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:26.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:26.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:26.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:26.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:26.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:26.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 zone default found 2024-09-12T18:28:26.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 4 Realm: () 2024-09-12T18:28:26.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:26.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:26.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:26.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 zonegroup default 2024-09-12T18:28:26.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:26.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:26.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.058+0000 7f8b6b3de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:26.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.062+0000 7f8b6b3de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:26.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.062+0000 7f8b6b3de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:26.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.062+0000 7f8b6b3de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:26.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.062+0000 7f8b6b3de9c0 20 started sync module instance, tier type = 2024-09-12T18:28:26.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.062+0000 7f8b6b3de9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:26.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.086+0000 7f8b6b3de9c0 20 add_watcher() i=0 2024-09-12T18:28:26.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.086+0000 7f8b6b3de9c0 20 add_watcher() i=1 2024-09-12T18:28:26.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.086+0000 7f8b6b3de9c0 20 add_watcher() i=2 2024-09-12T18:28:26.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.086+0000 7f8b6b3de9c0 20 add_watcher() i=3 2024-09-12T18:28:26.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.086+0000 7f8b6b3de9c0 20 add_watcher() i=4 2024-09-12T18:28:26.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.086+0000 7f8b6b3de9c0 20 add_watcher() i=5 2024-09-12T18:28:26.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.086+0000 7f8b6b3de9c0 20 add_watcher() i=6 2024-09-12T18:28:26.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.090+0000 7f8b6b3de9c0 20 add_watcher() i=7 2024-09-12T18:28:26.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.090+0000 7f8b6b3de9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:26.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.094+0000 7f8a1efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:26.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.094+0000 7f8b6b3de9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:26.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.094+0000 7f8b6b3de9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:26.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.094+0000 7f8b6b3de9c0 5 note: GC not initialized 2024-09-12T18:28:26.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.094+0000 7f8a1dfe3640 20 reqs_thread_entry: start 2024-09-12T18:28:26.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.094+0000 7f8b6b3de9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:26.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.094+0000 7f8b6b3de9c0 20 Filter name: none 2024-09-12T18:28:26.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.094+0000 7f898f7fe640 20 reqs_thread_entry: start 2024-09-12T18:28:26.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.094+0000 7f8b6b3de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:26.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.098+0000 7f8b6b3de9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:26.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.098+0000 7f8b6b3de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:26.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.098+0000 7f8b6b3de9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:26.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.098+0000 7f8b6b3de9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:26.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.098+0000 7f8b6b3de9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T18:28:26.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.098+0000 7f8b6b3de9c0 20 INFO: main: starting shard=0 2024-09-12T18:28:26.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.098+0000 7f8b6b3de9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:26.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.098+0000 7f8b6b3de9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:26.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.098+0000 7f8b6b3de9c0 20 INFO: main: starting shard=1 2024-09-12T18:28:26.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.098+0000 7f8b6b3de9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:26.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.098+0000 7f8b6b3de9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:26.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.098+0000 7f8b6b3de9c0 20 INFO: main: starting shard=2 2024-09-12T18:28:26.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.098+0000 7f8b6b3de9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:26.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.102+0000 7f8b6b3de9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:26.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.102+0000 7f8b6b3de9c0 20 INFO: main: starting shard=3 2024-09-12T18:28:26.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.102+0000 7f8b6b3de9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:26.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.102+0000 7f8b6b3de9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:26.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.102+0000 7f8b6b3de9c0 20 INFO: main: starting shard=4 2024-09-12T18:28:26.106 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.102+0000 7f8b6b3de9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:26.106 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.102+0000 7f8b6b3de9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:26.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.102+0000 7f8b6b3de9c0 20 INFO: main: starting shard=5 2024-09-12T18:28:26.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.102+0000 7f8b6b3de9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:26.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.102+0000 7f8b6b3de9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:26.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.102+0000 7f8b6b3de9c0 20 INFO: main: starting shard=6 2024-09-12T18:28:26.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.102+0000 7f8b6b3de9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:26.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.106+0000 7f8b6b3de9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:26.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.106+0000 7f8b6b3de9c0 20 INFO: main: starting shard=7 2024-09-12T18:28:26.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.106+0000 7f8b6b3de9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:26.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.106+0000 7f8b6b3de9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:26.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.106+0000 7f8b6b3de9c0 20 INFO: main: starting shard=8 2024-09-12T18:28:26.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.106+0000 7f8b6b3de9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:26.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.110+0000 7f8b6b3de9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:26.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.110+0000 7f8b6b3de9c0 20 INFO: main: starting shard=9 2024-09-12T18:28:26.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.110+0000 7f8b6b3de9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:26.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.110+0000 7f8b6b3de9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:28:26.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.110+0000 7f8b6b3de9c0 20 INFO: main: starting shard=10 2024-09-12T18:28:26.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.110+0000 7f8b6b3de9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:26.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.110+0000 7f8b6b3de9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:28:26.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.110+0000 7f8b6b3de9c0 20 INFO: main: done 2024-09-12T18:28:26.117 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.114+0000 7f8a1efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:26.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.118+0000 7f8b6b3de9c0 20 remove_watcher() i=0 2024-09-12T18:28:26.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.118+0000 7f8b6b3de9c0 2 removed watcher, disabling cache 2024-09-12T18:28:26.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.122+0000 7f8b6b3de9c0 20 remove_watcher() i=1 2024-09-12T18:28:26.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.122+0000 7f8b6b3de9c0 20 remove_watcher() i=2 2024-09-12T18:28:26.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.126+0000 7f8b6b3de9c0 20 remove_watcher() i=3 2024-09-12T18:28:26.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.130+0000 7f8b6b3de9c0 20 remove_watcher() i=4 2024-09-12T18:28:26.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.134+0000 7f8b6b3de9c0 20 remove_watcher() i=5 2024-09-12T18:28:26.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.134+0000 7f8b6b3de9c0 20 remove_watcher() i=6 2024-09-12T18:28:26.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:26.138+0000 7f8b6b3de9c0 20 remove_watcher() i=7 2024-09-12T18:28:26.160 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:26.160 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:26.165 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:28:26.598 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T18:28:27.022 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T18:28:27.052 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:27.053 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:27.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.090+0000 7fc430c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.095 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.090+0000 7fc430c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:27.095 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.090+0000 7fc430c6b9c0 20 realm 2024-09-12T18:28:27.095 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.090+0000 7fc430c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.095 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.090+0000 7fc430c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:27.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.090+0000 7fc430c6b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:27.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.090+0000 7fc430c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.090+0000 7fc430c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:27.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.090+0000 7fc430c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.094+0000 7fc430c6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:27.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.094+0000 7fc430c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.094+0000 7fc430c6b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:27.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.094+0000 7fc430c6b9c0 20 searching for the correct realm 2024-09-12T18:28:27.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.094+0000 7fc42e771640 0 -- 172.21.15.111:0/165562162 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fc428008040 msgr2=0x7fc428039420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:27.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.306+0000 7fc42e771640 0 -- 172.21.15.111:0/165562162 >> [v2:172.21.15.153:6808/1571723771,v1:172.21.15.153:6809/1571723771] conn(0x55c2d5740900 msgr2=0x7fc428053910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:28:27.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.530+0000 7fc430c6b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:27.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.530+0000 7fc430c6b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:27.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.530+0000 7fc430c6b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:27.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.530+0000 7fc430c6b9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:27.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.530+0000 7fc430c6b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:27.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.530+0000 7fc430c6b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:27.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.530+0000 7fc430c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.530+0000 7fc430c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:27.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.530+0000 7fc430c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.530+0000 7fc430c6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:27.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.530+0000 7fc430c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.530+0000 7fc430c6b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:27.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.534+0000 7fc430c6b9c0 20 zone default found 2024-09-12T18:28:27.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.534+0000 7fc430c6b9c0 4 Realm: () 2024-09-12T18:28:27.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.534+0000 7fc430c6b9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:27.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.534+0000 7fc430c6b9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:27.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.534+0000 7fc430c6b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:27.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.534+0000 7fc430c6b9c0 20 zonegroup default 2024-09-12T18:28:27.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.534+0000 7fc430c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.534+0000 7fc430c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:27.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.534+0000 7fc430c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.534+0000 7fc430c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:27.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.534+0000 7fc430c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.534+0000 7fc430c6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:27.539 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.534+0000 7fc430c6b9c0 20 started sync module instance, tier type = 2024-09-12T18:28:27.539 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.534+0000 7fc430c6b9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:27.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.558+0000 7fc430c6b9c0 20 add_watcher() i=0 2024-09-12T18:28:27.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.558+0000 7fc430c6b9c0 20 add_watcher() i=1 2024-09-12T18:28:27.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.558+0000 7fc430c6b9c0 20 add_watcher() i=2 2024-09-12T18:28:27.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.558+0000 7fc430c6b9c0 20 add_watcher() i=3 2024-09-12T18:28:27.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.558+0000 7fc430c6b9c0 20 add_watcher() i=4 2024-09-12T18:28:27.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.558+0000 7fc430c6b9c0 20 add_watcher() i=5 2024-09-12T18:28:27.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.558+0000 7fc430c6b9c0 20 add_watcher() i=6 2024-09-12T18:28:27.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.562+0000 7fc430c6b9c0 20 add_watcher() i=7 2024-09-12T18:28:27.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.562+0000 7fc430c6b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:27.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc2e0ff9640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:27.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc430c6b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:27.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc430c6b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:27.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc430c6b9c0 5 note: GC not initialized 2024-09-12T18:28:27.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc2daffd640 20 reqs_thread_entry: start 2024-09-12T18:28:27.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc430c6b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:27.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc430c6b9c0 20 Filter name: none 2024-09-12T18:28:27.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc2d8ff9640 20 reqs_thread_entry: start 2024-09-12T18:28:27.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc430c6b9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T18:28:27.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc430c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc430c6b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:27.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc430c6b9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T18:28:27.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc430c6b9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T18:28:27.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc430c6b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 : miss 2024-09-12T18:28:27.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.566+0000 7fc430c6b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.570+0000 7fc430c6b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:27.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.570+0000 7fc430c6b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 info.flags=0x17 2024-09-12T18:28:27.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.570+0000 7fc430c6b9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 to cache LRU end 2024-09-12T18:28:27.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.570+0000 7fc430c6b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:28:27.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.570+0000 7fc430c6b9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T18:28:27.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.570+0000 7fc430c6b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 2024-09-12T18:28:27.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.570+0000 7fc430c6b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:27.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.570+0000 7fc430c6b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:27.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.570+0000 7fc430c6b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:27.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.570+0000 7fc430c6b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:27.577 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.574+0000 7fc430c6b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:27.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.574+0000 7fc430c6b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:27.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.578+0000 7fc430c6b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:27.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.578+0000 7fc430c6b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:27.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.578+0000 7fc430c6b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:27.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.582+0000 7fc430c6b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:27.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.582+0000 7fc430c6b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:27.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.598+0000 7fc2e0ff9640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:27.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.602+0000 7fc430c6b9c0 20 remove_watcher() i=0 2024-09-12T18:28:27.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.602+0000 7fc430c6b9c0 2 removed watcher, disabling cache 2024-09-12T18:28:27.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.602+0000 7fc430c6b9c0 20 remove_watcher() i=1 2024-09-12T18:28:27.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.606+0000 7fc430c6b9c0 20 remove_watcher() i=2 2024-09-12T18:28:27.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.606+0000 7fc430c6b9c0 20 remove_watcher() i=3 2024-09-12T18:28:27.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.610+0000 7fc430c6b9c0 20 remove_watcher() i=4 2024-09-12T18:28:27.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.610+0000 7fc430c6b9c0 20 remove_watcher() i=5 2024-09-12T18:28:27.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.614+0000 7fc430c6b9c0 20 remove_watcher() i=6 2024-09-12T18:28:27.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.614+0000 7fc430c6b9c0 20 remove_watcher() i=7 2024-09-12T18:28:27.633 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T18:28:27.666 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:27.666 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:27.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.706+0000 7f65645a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.706+0000 7f65645a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:27.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.706+0000 7f65645a69c0 20 realm 2024-09-12T18:28:27.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.706+0000 7f65645a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.706+0000 7f65645a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:27.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.706+0000 7f65645a69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:27.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.706+0000 7f65645a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.706+0000 7f65645a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:27.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.706+0000 7f65645a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.706+0000 7f65645a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:27.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.706+0000 7f65645a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.710+0000 7f65645a69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:27.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.710+0000 7f65645a69c0 20 searching for the correct realm 2024-09-12T18:28:27.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.710+0000 7f65618ab640 0 -- 172.21.15.111:0/2993068424 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f65540b3040 msgr2=0x7f6554134ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:27.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.922+0000 7f65620ac640 0 -- 172.21.15.111:0/2993068424 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f654c003ac0 msgr2=0x7f655c062810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:27.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:27.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:27.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:27.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:27.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:27.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:27.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:27.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:27.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:27.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 zone default found 2024-09-12T18:28:27.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 4 Realm: () 2024-09-12T18:28:27.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:27.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:27.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:27.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 zonegroup default 2024-09-12T18:28:27.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:27.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.942+0000 7f65645a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.946+0000 7f65645a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:27.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.946+0000 7f65645a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.946+0000 7f65645a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:27.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.946+0000 7f65645a69c0 20 started sync module instance, tier type = 2024-09-12T18:28:27.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.946+0000 7f65645a69c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:27.974 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.970+0000 7f65645a69c0 20 add_watcher() i=0 2024-09-12T18:28:27.974 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.970+0000 7f65645a69c0 20 add_watcher() i=1 2024-09-12T18:28:27.974 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.970+0000 7f65645a69c0 20 add_watcher() i=2 2024-09-12T18:28:27.974 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.970+0000 7f65645a69c0 20 add_watcher() i=3 2024-09-12T18:28:27.974 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.970+0000 7f65645a69c0 20 add_watcher() i=4 2024-09-12T18:28:27.974 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.970+0000 7f65645a69c0 20 add_watcher() i=5 2024-09-12T18:28:27.975 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.970+0000 7f65645a69c0 20 add_watcher() i=6 2024-09-12T18:28:27.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.974+0000 7f65645a69c0 20 add_watcher() i=7 2024-09-12T18:28:27.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.974+0000 7f65645a69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:27.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f64197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:27.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f65645a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:27.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f65645a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:27.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f65645a69c0 5 note: GC not initialized 2024-09-12T18:28:27.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f64137fe640 20 reqs_thread_entry: start 2024-09-12T18:28:27.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f65645a69c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:27.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f65645a69c0 20 Filter name: none 2024-09-12T18:28:27.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f64117fa640 20 reqs_thread_entry: start 2024-09-12T18:28:27.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f65645a69c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T18:28:27.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f65645a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f65645a69c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:27.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f65645a69c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T18:28:27.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f65645a69c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T18:28:27.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f65645a69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 : miss 2024-09-12T18:28:27.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.978+0000 7f65645a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:27.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.982+0000 7f65645a69c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:27.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.982+0000 7f65645a69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 info.flags=0x17 2024-09-12T18:28:27.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.982+0000 7f65645a69c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 to cache LRU end 2024-09-12T18:28:27.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.982+0000 7f65645a69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:28:27.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.982+0000 7f65645a69c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T18:28:27.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.982+0000 7f65645a69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.1 2024-09-12T18:28:27.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.982+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.0 2024-09-12T18:28:27.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.982+0000 7f65645a69c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T18:28:27.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.982+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:27.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.982+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.2 2024-09-12T18:28:27.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.982+0000 7f65645a69c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T18:28:27.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.982+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.3 2024-09-12T18:28:27.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.986+0000 7f65645a69c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T18:28:27.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.986+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.4 2024-09-12T18:28:27.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.986+0000 7f65645a69c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T18:28:27.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.986+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:27.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.990+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.6 2024-09-12T18:28:27.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.990+0000 7f65645a69c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T18:28:27.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.990+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.7 2024-09-12T18:28:27.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.990+0000 7f65645a69c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T18:28:27.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.990+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:27.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.994+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.9 2024-09-12T18:28:27.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.994+0000 7f65645a69c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T18:28:27.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.994+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:28.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:28.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 get_obj_state: octx=0x556b51cdf3b0 obj=check-bucket:e state=0x556b5201c5c8 s->prefetch_data=0 2024-09-12T18:28:28.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:28.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 get_obj_state: octx=0x556b51d844e0 obj=check-bucket:d state=0x556b52026f48 s->prefetch_data=0 2024-09-12T18:28:28.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:28.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 get_obj_state: octx=0x556b52025a50 obj=check-bucket:c state=0x556b52023a98 s->prefetch_data=0 2024-09-12T18:28:28.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:28.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 get_obj_state: octx=0x556b520254a0 obj=check-bucket:f state=0x556b52020d98 s->prefetch_data=0 2024-09-12T18:28:28.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 get_obj_state: setting s->obj_tag to venjfqsoohe88uo93c5k16cf86b38fbv 2024-09-12T18:28:28.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 get_obj_state_impl: setting s->olh_tag to rucrs7lv2751dxbxjrlyajhj906cd59r 2024-09-12T18:28:28.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rucrs7lv2751dxbxjrlyajhj906cd59r 2024-09-12T18:28:28.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 get_obj_state: setting s->obj_tag to fygd6exb4kjue4l6vpfxajijh5en95w3 2024-09-12T18:28:28.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 get_obj_state_impl: setting s->olh_tag to gcadqcxc7j498ozkfehyj51jkae4woum 2024-09-12T18:28:28.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gcadqcxc7j498ozkfehyj51jkae4woum 2024-09-12T18:28:28.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 get_obj_state: setting s->obj_tag to vv40roj2mm6cwyeng6inlizqwsnkcph2 2024-09-12T18:28:28.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 get_obj_state_impl: setting s->olh_tag to 781so5dhs8d2gkzuiylvd7jqvk86vnrv 2024-09-12T18:28:28.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:27.998+0000 7f65645a69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=781so5dhs8d2gkzuiylvd7jqvk86vnrv 2024-09-12T18:28:28.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.002+0000 7f65645a69c0 20 get_obj_state: setting s->obj_tag to 0hgu9onnwkybpgofzfchl1u2qvcbd9dz 2024-09-12T18:28:28.005 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.002+0000 7f65645a69c0 20 get_obj_state_impl: setting s->olh_tag to 2tu02ijoe03ok6bz0i78g41spuitu3cr 2024-09-12T18:28:28.005 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.002+0000 7f65645a69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2tu02ijoe03ok6bz0i78g41spuitu3cr 2024-09-12T18:28:28.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.002+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:28.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.002+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:28.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.002+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:28.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.006+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:28.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.006+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:28.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.006+0000 7f65645a69c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T18:28:28.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.006+0000 7f65645a69c0 20 olh_log_entry: epoch=2 op=3 key=e[F8N4TiCd-YndWykFxyizwUtu-.vi5kN] 2024-09-12T18:28:28.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.006+0000 7f65645a69c0 20 get_obj_state: octx=0x556b51cdf3b0 obj=check-bucket:_:F8N4TiCd-YndWykFxyizwUtu-.vi5kN_e state=0x556b520ca558 s->prefetch_data=0 2024-09-12T18:28:28.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.006+0000 7f65645a69c0 10 manifest: total_size = 9 2024-09-12T18:28:28.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.006+0000 7f65645a69c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.11348504578389220309 2024-09-12T18:28:28.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.006+0000 7f65645a69c0 20 get_obj_state: octx=0x556b51cdf3b0 obj=check-bucket:_:F8N4TiCd-YndWykFxyizwUtu-.vi5kN_e state=0x556b520ca558 s->prefetch_data=0 2024-09-12T18:28:28.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.006+0000 7f65645a69c0 20 prepare_atomic_modification: state is not atomic. state=0x556b520ca558 2024-09-12T18:28:28.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.006+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:28.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.006+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:28.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.006+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:28.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 olh_log_entry: epoch=3 op=3 key=c[pUQK.qhbcY-.u7R3ZmgPBtgbfC7ggEE] 2024-09-12T18:28:28.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 get_obj_state: octx=0x556b52025a50 obj=check-bucket:_:pUQK.qhbcY-.u7R3ZmgPBtgbfC7ggEE_c state=0x556b520d0c18 s->prefetch_data=0 2024-09-12T18:28:28.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 olh_log_entry: epoch=3 op=3 key=d[C4XbNd8KyvBtbn04KaFCeSNfA2cIaun] 2024-09-12T18:28:28.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 get_obj_state: octx=0x556b51d844e0 obj=check-bucket:_:C4XbNd8KyvBtbn04KaFCeSNfA2cIaun_d state=0x556b520d6188 s->prefetch_data=0 2024-09-12T18:28:28.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:28.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 10 manifest: total_size = 9 2024-09-12T18:28:28.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.3232759168985642540 2024-09-12T18:28:28.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 get_obj_state: octx=0x556b52025a50 obj=check-bucket:_:pUQK.qhbcY-.u7R3ZmgPBtgbfC7ggEE_c state=0x556b520d0c18 s->prefetch_data=0 2024-09-12T18:28:28.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 prepare_atomic_modification: state is not atomic. state=0x556b520d0c18 2024-09-12T18:28:28.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:28.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 10 manifest: total_size = 22 2024-09-12T18:28:28.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.2408785418061251347 2024-09-12T18:28:28.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 get_obj_state: octx=0x556b51d844e0 obj=check-bucket:_:C4XbNd8KyvBtbn04KaFCeSNfA2cIaun_d state=0x556b520d6188 s->prefetch_data=0 2024-09-12T18:28:28.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 prepare_atomic_modification: state is not atomic. state=0x556b520d6188 2024-09-12T18:28:28.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:28.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T18:28:28.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 olh_log_entry: epoch=2 op=3 key=f[sdrJhnUMY0tOUEHsmqlOeb0tKwfveRW] 2024-09-12T18:28:28.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 get_obj_state: octx=0x556b520254a0 obj=check-bucket:_:sdrJhnUMY0tOUEHsmqlOeb0tKwfveRW_f state=0x556b520cef28 s->prefetch_data=0 2024-09-12T18:28:28.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 10 manifest: total_size = 22 2024-09-12T18:28:28.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.11960083933082511136 2024-09-12T18:28:28.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 get_obj_state: octx=0x556b520254a0 obj=check-bucket:_:sdrJhnUMY0tOUEHsmqlOeb0tKwfveRW_f state=0x556b520cef28 s->prefetch_data=0 2024-09-12T18:28:28.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 prepare_atomic_modification: state is not atomic. state=0x556b520cef28 2024-09-12T18:28:28.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.010+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:28.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.014+0000 7f65645a69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:28:28.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.014+0000 7f65645a69c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T18:28:28.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.014+0000 7f65645a69c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:28:28.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.014+0000 7f65645a69c0 5 delete_objs_inline: removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.1__shadow:F8N4TiCd-YndWykFxyizwUtu-.vi5kN_.5LO0uYwT5yY2SoLQUrJ3nR5D7nbqDaB_0 2024-09-12T18:28:28.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.014+0000 7f65645a69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:28:28.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.014+0000 7f65645a69c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T18:28:28.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.014+0000 7f65645a69c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:28:28.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.014+0000 7f65645a69c0 5 delete_objs_inline: removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.1__shadow:pUQK.qhbcY-.u7R3ZmgPBtgbfC7ggEE_.I1lH2n2aIrtdNIZ_eXzQCRxi0hidZcS_0 2024-09-12T18:28:28.021 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.018+0000 7f6445ffb640 20 handle_completion(): completion ok for obj=e[F8N4TiCd-YndWykFxyizwUtu-.vi5kN] 2024-09-12T18:28:28.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.018+0000 7f65645a69c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:28:28.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.018+0000 7f65645a69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:28:28.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.018+0000 7f65645a69c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T18:28:28.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.018+0000 7f65645a69c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:28:28.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.018+0000 7f65645a69c0 5 delete_objs_inline: removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.1__shadow:sdrJhnUMY0tOUEHsmqlOeb0tKwfveRW_.O_CAqQF3xWrWstygRdwFg8t6zOeJpfO_0 2024-09-12T18:28:28.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.018+0000 7f65645a69c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:28:28.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.022+0000 7f65645a69c0 20 get_obj_state: octx=0x556b51cdf3b0 obj=check-bucket:e state=0x556b5201c5c8 s->prefetch_data=0 2024-09-12T18:28:28.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.022+0000 7f65645a69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rucrs7lv2751dxbxjrlyajhj906cd59r 2024-09-12T18:28:28.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.022+0000 7f64457fa640 20 handle_completion(): completion ok for obj=c[pUQK.qhbcY-.u7R3ZmgPBtgbfC7ggEE] 2024-09-12T18:28:28.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.022+0000 7f65645a69c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:28:28.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.022+0000 7f65645a69c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:28:28.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.022+0000 7f65645a69c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T18:28:28.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.022+0000 7f65645a69c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:28:28.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.022+0000 7f65645a69c0 5 delete_objs_inline: removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.1__shadow:C4XbNd8KyvBtbn04KaFCeSNfA2cIaun_.uWl3JJlst2iTIAjc_TM-to4Q6YuMxsx_0 2024-09-12T18:28:28.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.026+0000 7f6445ffb640 20 handle_completion(): completion ok for obj=f[sdrJhnUMY0tOUEHsmqlOeb0tKwfveRW] 2024-09-12T18:28:28.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.026+0000 7f64457fa640 20 handle_completion(): completion ok for obj=d[C4XbNd8KyvBtbn04KaFCeSNfA2cIaun] 2024-09-12T18:28:28.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.026+0000 7f65645a69c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:28:28.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.026+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:28.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.026+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:28.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.026+0000 7f65645a69c0 20 get_obj_state: octx=0x556b520254a0 obj=check-bucket:f state=0x556b52020d98 s->prefetch_data=0 2024-09-12T18:28:28.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.026+0000 7f65645a69c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2tu02ijoe03ok6bz0i78g41spuitu3cr 2024-09-12T18:28:28.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.030+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:28.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.030+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:28.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.030+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:28.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.030+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.8 2024-09-12T18:28:28.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.030+0000 7f65645a69c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T18:28:28.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.030+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.1 2024-09-12T18:28:28.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.030+0000 7f65645a69c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T18:28:28.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.034+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.5 2024-09-12T18:28:28.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.034+0000 7f65645a69c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T18:28:28.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.034+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:28.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.038+0000 7f65645a69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.1.10 2024-09-12T18:28:28.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.038+0000 7f65645a69c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T18:28:28.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.038+0000 7f65645a69c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T18:28:28.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.038+0000 7f64197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:28.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.042+0000 7f65645a69c0 20 remove_watcher() i=0 2024-09-12T18:28:28.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.042+0000 7f65645a69c0 2 removed watcher, disabling cache 2024-09-12T18:28:28.050 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.046+0000 7f65645a69c0 20 remove_watcher() i=1 2024-09-12T18:28:28.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.050+0000 7f65645a69c0 20 remove_watcher() i=2 2024-09-12T18:28:28.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.050+0000 7f65645a69c0 20 remove_watcher() i=3 2024-09-12T18:28:28.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.054+0000 7f65645a69c0 20 remove_watcher() i=4 2024-09-12T18:28:28.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.054+0000 7f65645a69c0 20 remove_watcher() i=5 2024-09-12T18:28:28.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.058+0000 7f65645a69c0 20 remove_watcher() i=6 2024-09-12T18:28:28.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.058+0000 7f65645a69c0 20 remove_watcher() i=7 2024-09-12T18:28:28.080 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:28.080 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:28.088 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:28.088 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:28.149 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T18:28:28.178 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:28:28.179 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:28:28.222 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.218+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.222+0000 7f829d0cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:28.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.222+0000 7f829d0cd9c0 20 realm 2024-09-12T18:28:28.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.222+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.222+0000 7f829d0cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:28.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.222+0000 7f829d0cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:28:28.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.222+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.222+0000 7f829d0cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:28.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.222+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.222+0000 7f829d0cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:28.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.222+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.222+0000 7f829d0cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:28:28.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.222+0000 7f829d0cd9c0 20 searching for the correct realm 2024-09-12T18:28:28.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.226+0000 7f829b3d4640 0 -- 172.21.15.111:0/2959716483 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f829012ba40 msgr2=0x7f82901018b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:28.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.442+0000 7f829a3d2640 0 -- 172.21.15.111:0/2959716483 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f8294043920 msgr2=0x7f82940313c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:28:28.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.658+0000 7f829d0cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:28:28.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.658+0000 7f829d0cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:28:28.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.658+0000 7f829d0cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:28:28.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.658+0000 7f829d0cd9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:28:28.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.658+0000 7f829d0cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:28:28.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.658+0000 7f829d0cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:28:28.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.658+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.658+0000 7f829d0cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:28.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.658+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.658+0000 7f829d0cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:28:28.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.658+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:28:28.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 20 zone default found 2024-09-12T18:28:28.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 4 Realm: () 2024-09-12T18:28:28.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:28:28.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:28:28.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:28:28.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 20 zonegroup default 2024-09-12T18:28:28.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:28.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:28.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:28:28.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 20 started sync module instance, tier type = 2024-09-12T18:28:28.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.662+0000 7f829d0cd9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:28:28.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.682+0000 7f829d0cd9c0 20 add_watcher() i=0 2024-09-12T18:28:28.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.682+0000 7f829d0cd9c0 20 add_watcher() i=1 2024-09-12T18:28:28.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.682+0000 7f829d0cd9c0 20 add_watcher() i=2 2024-09-12T18:28:28.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.682+0000 7f829d0cd9c0 20 add_watcher() i=3 2024-09-12T18:28:28.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.682+0000 7f829d0cd9c0 20 add_watcher() i=4 2024-09-12T18:28:28.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.682+0000 7f829d0cd9c0 20 add_watcher() i=5 2024-09-12T18:28:28.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.682+0000 7f829d0cd9c0 20 add_watcher() i=6 2024-09-12T18:28:28.690 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.686+0000 7f829d0cd9c0 20 add_watcher() i=7 2024-09-12T18:28:28.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.686+0000 7f829d0cd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:28:28.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.690+0000 7f81517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:28.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.690+0000 7f829d0cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:28:28.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.690+0000 7f829d0cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:28:28.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.690+0000 7f829d0cd9c0 5 note: GC not initialized 2024-09-12T18:28:28.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.690+0000 7f80cbfff640 20 reqs_thread_entry: start 2024-09-12T18:28:28.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.690+0000 7f829d0cd9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:28:28.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.690+0000 7f829d0cd9c0 20 Filter name: none 2024-09-12T18:28:28.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.690+0000 7f80c9ffb640 20 reqs_thread_entry: start 2024-09-12T18:28:28.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.690+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.690+0000 7f829d0cd9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:28.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.690+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.697 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.694+0000 7f829d0cd9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:28.697 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.694+0000 7f829d0cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:28.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.694+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.694+0000 7f829d0cd9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T18:28:28.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.694+0000 7f829d0cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:28:28.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.694+0000 7f829d0cd9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T18:28:28.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.694+0000 7f829d0cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:28:28.703 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.698+0000 7f81517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:28:28.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.702+0000 7f829d0cd9c0 20 remove_watcher() i=0 2024-09-12T18:28:28.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.702+0000 7f829d0cd9c0 2 removed watcher, disabling cache 2024-09-12T18:28:28.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.706+0000 7f829d0cd9c0 20 remove_watcher() i=1 2024-09-12T18:28:28.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.710+0000 7f829d0cd9c0 20 remove_watcher() i=2 2024-09-12T18:28:28.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.710+0000 7f829d0cd9c0 20 remove_watcher() i=3 2024-09-12T18:28:28.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.714+0000 7f829d0cd9c0 20 remove_watcher() i=4 2024-09-12T18:28:28.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.714+0000 7f829d0cd9c0 20 remove_watcher() i=5 2024-09-12T18:28:28.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.718+0000 7f829d0cd9c0 20 remove_watcher() i=6 2024-09-12T18:28:28.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:28:28.718+0000 7f829d0cd9c0 20 remove_watcher() i=7 2024-09-12T18:28:28.736 INFO:tasks.workunit.client.0.smithi111.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T18:28:28.737 INFO:tasks.workunit.client.0.smithi111.stderr:Deleting bucket check-bucket 2024-09-12T18:28:28.739 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:28.739 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:28.744 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:28:28.745 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:28:28.811 INFO:tasks.workunit.client.0.smithi111.stderr:Completed bucket check tests 2024-09-12T18:28:28.811 INFO:tasks.workunit.client.0.smithi111.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T18:28:28.811 INFO:tasks.workunit.client.0.smithi111.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T18:28:28.811 INFO:tasks.workunit.client.0.smithi111.stdout:connected to https://localhost:443 2024-09-12T18:28:28.891 INFO:tasks.workunit.client.0.smithi111.stderr:+ deactivate 2024-09-12T18:28:28.891 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T18:28:28.892 INFO:tasks.workunit.client.0.smithi111.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:28:28.892 INFO:tasks.workunit.client.0.smithi111.stderr:+ export PATH 2024-09-12T18:28:28.892 INFO:tasks.workunit.client.0.smithi111.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T18:28:28.892 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' -n '' ']' 2024-09-12T18:28:28.892 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:28:28.892 INFO:tasks.workunit.client.0.smithi111.stderr:+ hash -r 2024-09-12T18:28:28.892 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' -n '' ']' 2024-09-12T18:28:28.892 INFO:tasks.workunit.client.0.smithi111.stderr:+ unset VIRTUAL_ENV 2024-09-12T18:28:28.892 INFO:tasks.workunit.client.0.smithi111.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T18:28:28.892 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T18:28:28.893 INFO:tasks.workunit.client.0.smithi111.stderr:+ unset -f deactivate 2024-09-12T18:28:28.893 INFO:tasks.workunit.client.0.smithi111.stderr:+ echo OK. 2024-09-12T18:28:28.894 INFO:tasks.workunit.client.0.smithi111.stdout:OK. 2024-09-12T18:28:28.894 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:28:28.894 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:28:28.907 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T18:28:28.907 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:28:29.285 DEBUG:teuthology.parallel:result is None 2024-09-12T18:28:29.285 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:28:29.297 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:28:29.297 DEBUG:teuthology.orchestra.run.smithi111:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:28:29.358 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:28:29.358 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T18:28:29.370 INFO:tasks.workunit:Pulling workunits from ref d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T18:28:29.370 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T18:28:29.370 DEBUG:teuthology.orchestra.run.smithi111:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:28:29.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:28:29.405 INFO:teuthology.orchestra.run.smithi111.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T18:28:29.406 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:28:29.453 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T18:28:29.453 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T18:28:29.501 INFO:tasks.workunit:timeout=3h 2024-09-12T18:28:29.501 INFO:tasks.workunit:cleanup=True 2024-09-12T18:28:29.502 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T18:28:29.551 INFO:tasks.workunit.client.0.smithi111.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:29:25.649 INFO:tasks.workunit.client.0.smithi111.stderr:Updating files: 99% (12601/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T18:29:26.420 INFO:tasks.workunit.client.0.smithi111.stderr:Note: switching to 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'. 2024-09-12T18:29:26.420 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:29:26.420 INFO:tasks.workunit.client.0.smithi111.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:29:26.420 INFO:tasks.workunit.client.0.smithi111.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:29:26.420 INFO:tasks.workunit.client.0.smithi111.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:29:26.421 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:29:26.421 INFO:tasks.workunit.client.0.smithi111.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:29:26.421 INFO:tasks.workunit.client.0.smithi111.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:29:26.421 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:29:26.421 INFO:tasks.workunit.client.0.smithi111.stderr: git switch -c 2024-09-12T18:29:26.421 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:29:26.421 INFO:tasks.workunit.client.0.smithi111.stderr:Or undo this operation with: 2024-09-12T18:29:26.421 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:29:26.421 INFO:tasks.workunit.client.0.smithi111.stderr: git switch - 2024-09-12T18:29:26.421 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:29:26.421 INFO:tasks.workunit.client.0.smithi111.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:29:26.421 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:29:26.421 INFO:tasks.workunit.client.0.smithi111.stderr:HEAD is now at d011c522bb1 cls/rgw: duplicate reshard checks in all cls_rgw write operations 2024-09-12T18:29:26.428 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:29:26.478 INFO:tasks.workunit.client.0.smithi111.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:29:26.481 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:29:26.481 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:29:26.539 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:29:26.590 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:29:26.632 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:29:26.634 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:29:26.634 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:29:26.676 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:29:26.680 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:29:26.680 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:29:26.728 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T18:29:26.729 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T18:29:26.730 DEBUG:teuthology.orchestra.run.smithi111:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T18:29:26.792 INFO:tasks.workunit.client.0.smithi111.stdout:Running main() from gmock_main.cc 2024-09-12T18:29:26.792 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T18:29:26.792 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:29:26.792 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 11 tests from ClsLock 2024-09-12T18:29:26.792 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T18:29:28.077 INFO:tasks.workunit.client.0.smithi111.stdout:lock: mylock 2024-09-12T18:29:28.077 INFO:tasks.workunit.client.0.smithi111.stdout: lock_type: exclusive 2024-09-12T18:29:28.077 INFO:tasks.workunit.client.0.smithi111.stdout: tag: 2024-09-12T18:29:28.078 INFO:tasks.workunit.client.0.smithi111.stdout: lockers: 2024-09-12T18:29:28.078 INFO:tasks.workunit.client.0.smithi111.stdout: client.5208 expiration=2024-09-12T18:31:28.065852+0000 addr=v1:172.21.15.111:0/630277206 cookie= 2024-09-12T18:29:28.088 INFO:tasks.workunit.client.0.smithi111.stdout:lock: mylock 2024-09-12T18:29:28.088 INFO:tasks.workunit.client.0.smithi111.stdout: lock_type: shared 2024-09-12T18:29:28.088 INFO:tasks.workunit.client.0.smithi111.stdout: tag: 2024-09-12T18:29:28.088 INFO:tasks.workunit.client.0.smithi111.stdout: lockers: 2024-09-12T18:29:28.088 INFO:tasks.workunit.client.0.smithi111.stdout: client.5036 expiration=0.000000 addr=v1:172.21.15.111:0/2836569115 cookie= 2024-09-12T18:29:28.088 INFO:tasks.workunit.client.0.smithi111.stdout: client.5208 expiration=2024-09-12T18:31:28.083372+0000 addr=v1:172.21.15.111:0/630277206 cookie= 2024-09-12T18:29:28.091 INFO:tasks.workunit.client.0.smithi111.stdout:lock: mylock 2024-09-12T18:29:28.091 INFO:tasks.workunit.client.0.smithi111.stdout: lock_type: shared 2024-09-12T18:29:28.091 INFO:tasks.workunit.client.0.smithi111.stdout: tag: 2024-09-12T18:29:28.092 INFO:tasks.workunit.client.0.smithi111.stdout: lockers: 2024-09-12T18:29:28.092 INFO:tasks.workunit.client.0.smithi111.stdout: client.5036 expiration=0.000000 addr=v1:172.21.15.111:0/2836569115 cookie= 2024-09-12T18:29:28.923 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsLock.TestMultiLocking (2131 ms) 2024-09-12T18:29:28.924 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T18:29:31.030 INFO:tasks.workunit.client.0.smithi111.stdout:lock: mylock 2024-09-12T18:29:31.030 INFO:tasks.workunit.client.0.smithi111.stdout: lock_type: shared 2024-09-12T18:29:31.030 INFO:tasks.workunit.client.0.smithi111.stdout: tag: 2024-09-12T18:29:31.030 INFO:tasks.workunit.client.0.smithi111.stdout: lockers: 2024-09-12T18:29:31.030 INFO:tasks.workunit.client.0.smithi111.stdout: client.5226 expiration=0.000000 addr=v1:172.21.15.111:0/2514870464 cookie= 2024-09-12T18:29:31.035 INFO:tasks.workunit.client.0.smithi111.stdout:lock: mylock 2024-09-12T18:29:31.035 INFO:tasks.workunit.client.0.smithi111.stdout: lock_type: exclusive 2024-09-12T18:29:31.035 INFO:tasks.workunit.client.0.smithi111.stdout: tag: new_tag 2024-09-12T18:29:31.035 INFO:tasks.workunit.client.0.smithi111.stdout: lockers: 2024-09-12T18:29:31.036 INFO:tasks.workunit.client.0.smithi111.stdout: client.5039 expiration=0.000000 addr=v1:172.21.15.111:0/620046279 cookie= 2024-09-12T18:29:31.962 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsLock.TestMeta (3039 ms) 2024-09-12T18:29:31.962 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T18:29:34.028 INFO:tasks.workunit.client.0.smithi111.stdout:lock: mylock 2024-09-12T18:29:34.029 INFO:tasks.workunit.client.0.smithi111.stdout: lock_type: exclusive 2024-09-12T18:29:34.029 INFO:tasks.workunit.client.0.smithi111.stdout: tag: 2024-09-12T18:29:34.029 INFO:tasks.workunit.client.0.smithi111.stdout: lockers: 2024-09-12T18:29:34.032 INFO:tasks.workunit.client.0.smithi111.stdout:lock: mylock 2024-09-12T18:29:34.032 INFO:tasks.workunit.client.0.smithi111.stdout: lock_type: shared 2024-09-12T18:29:34.032 INFO:tasks.workunit.client.0.smithi111.stdout: tag: 2024-09-12T18:29:34.032 INFO:tasks.workunit.client.0.smithi111.stdout: lockers: 2024-09-12T18:29:34.032 INFO:tasks.workunit.client.0.smithi111.stdout: client.5048 expiration=0.000000 addr=v1:172.21.15.111:0/2225536142 cookie= 2024-09-12T18:29:34.033 INFO:tasks.workunit.client.0.smithi111.stdout: client.5048 expiration=0.000000 addr=v1:172.21.15.111:0/2225536142 cookie=new cookie 2024-09-12T18:29:35.008 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsLock.TestCookie (3046 ms) 2024-09-12T18:29:35.008 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T18:29:38.016 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsLock.TestMultipleLocks (3007 ms) 2024-09-12T18:29:38.016 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T18:29:45.849 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsLock.TestLockDuration (7833 ms) 2024-09-12T18:29:45.849 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T18:29:48.868 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsLock.TestAssertLocked (3016 ms) 2024-09-12T18:29:48.868 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T18:29:51.919 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsLock.TestSetCookie (3055 ms) 2024-09-12T18:29:51.920 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T18:30:12.076 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsLock.TestRenew (20157 ms) 2024-09-12T18:30:12.076 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T18:30:18.215 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6139 ms) 2024-09-12T18:30:18.216 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T18:30:25.907 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7684 ms) 2024-09-12T18:30:25.908 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T18:30:33.903 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8004 ms) 2024-09-12T18:30:33.903 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 11 tests from ClsLock (67111 ms total) 2024-09-12T18:30:33.903 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:30:33.903 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:30:33.903 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 11 tests from 1 test suite ran. (67111 ms total) 2024-09-12T18:30:33.903 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 11 tests. 2024-09-12T18:30:33.911 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:30:33.911 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:30:33.964 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T18:30:33.965 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T18:30:33.965 DEBUG:teuthology.orchestra.run.smithi111:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T18:30:34.030 INFO:tasks.workunit.client.0.smithi111.stdout:Running main() from gmock_main.cc 2024-09-12T18:30:34.030 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T18:30:34.030 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:30:34.030 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 4 tests from cls_log 2024-09-12T18:30:34.030 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T18:30:36.942 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_log.test_log_add_same_time (2912 ms) 2024-09-12T18:30:36.942 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T18:30:39.959 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_log.test_log_add_different_time (3017 ms) 2024-09-12T18:30:39.959 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T18:30:43.027 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_log.trim_by_time (3068 ms) 2024-09-12T18:30:43.027 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T18:30:46.074 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_log.trim_by_marker (3047 ms) 2024-09-12T18:30:46.074 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 4 tests from cls_log (12044 ms total) 2024-09-12T18:30:46.074 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:30:46.074 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:30:46.074 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 4 tests from 1 test suite ran. (12044 ms total) 2024-09-12T18:30:46.074 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 4 tests. 2024-09-12T18:30:46.080 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:30:46.081 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:30:46.138 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T18:30:46.139 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T18:30:46.139 DEBUG:teuthology.orchestra.run.smithi111:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T18:30:46.205 INFO:tasks.workunit.client.0.smithi111.stdout:Running main() from gmock_main.cc 2024-09-12T18:30:46.205 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T18:30:46.205 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:30:46.206 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 10 tests from cls_refcount 2024-09-12T18:30:46.206 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T18:30:49.125 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_refcount.test_implicit (2920 ms) 2024-09-12T18:30:49.126 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T18:30:52.183 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3052 ms) 2024-09-12T18:30:52.184 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T18:31:01.267 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_refcount.test_put_snap (9084 ms) 2024-09-12T18:31:01.267 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T18:31:04.315 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_refcount.test_explicit (3047 ms) 2024-09-12T18:31:04.315 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_refcount.set 2024-09-12T18:31:07.345 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_refcount.set (3036 ms) 2024-09-12T18:31:07.345 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T18:31:14.428 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_refcount.test_implicit_ec (7083 ms) 2024-09-12T18:31:14.428 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T18:31:21.461 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7034 ms) 2024-09-12T18:31:21.461 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T18:31:33.567 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_refcount.test_put_snap_ec (12105 ms) 2024-09-12T18:31:33.568 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T18:31:40.618 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_refcount.test_explicit_ec (7051 ms) 2024-09-12T18:31:40.618 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T18:31:47.724 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_refcount.set_ec (7106 ms) 2024-09-12T18:31:47.724 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 10 tests from cls_refcount (61519 ms total) 2024-09-12T18:31:47.724 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:31:47.724 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:31:47.724 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 10 tests from 1 test suite ran. (61519 ms total) 2024-09-12T18:31:47.724 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 10 tests. 2024-09-12T18:31:47.728 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:31:47.728 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:31:47.784 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T18:31:47.785 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T18:31:47.785 DEBUG:teuthology.orchestra.run.smithi111:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T18:31:47.850 INFO:tasks.workunit.client.0.smithi111.stdout:Running main() from gmock_main.cc 2024-09-12T18:31:47.851 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T18:31:47.851 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:31:47.851 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 19 tests from cls_rgw 2024-09-12T18:31:49.750 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T18:31:49.827 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.index_basic (77 ms) 2024-09-12T18:31:49.827 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T18:31:49.901 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (74 ms) 2024-09-12T18:31:49.902 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T18:31:50.013 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.index_remove_object (111 ms) 2024-09-12T18:31:50.013 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T18:31:52.551 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.index_suggest (2539 ms) 2024-09-12T18:31:52.552 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T18:31:52.566 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.index_suggest_complete (15 ms) 2024-09-12T18:31:52.566 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T18:31:52.622 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.index_list (55 ms) 2024-09-12T18:31:52.622 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T18:32:36.849 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.index_list_delimited (44227 ms) 2024-09-12T18:32:36.850 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T18:32:36.990 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.bi_list (142 ms) 2024-09-12T18:32:36.990 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T18:32:37.220 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.gc_set (230 ms) 2024-09-12T18:32:37.220 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T18:32:37.251 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.gc_list (31 ms) 2024-09-12T18:32:37.251 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T18:32:44.045 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.gc_defer (6793 ms) 2024-09-12T18:32:44.045 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T18:32:44.250 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.usage_basic (206 ms) 2024-09-12T18:32:44.250 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T18:32:44.252 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2024-09-12T18:32:44.252 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T18:32:44.485 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.usage_clear (232 ms) 2024-09-12T18:32:44.485 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T18:32:44.607 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.bi_log_trim (122 ms) 2024-09-12T18:32:44.607 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T18:32:44.641 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.index_racing_removes (34 ms) 2024-09-12T18:32:44.641 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T18:32:44.677 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.reshardlog_list (36 ms) 2024-09-12T18:32:44.678 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T18:32:44.707 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.reshardlog_num (30 ms) 2024-09-12T18:32:44.707 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-12T18:32:44.766 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw.bi_put_entries (60 ms) 2024-09-12T18:32:45.063 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 19 tests from cls_rgw (55017 ms total) 2024-09-12T18:32:45.063 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:32:45.063 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:32:45.064 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 19 tests from 1 test suite ran. (57213 ms total) 2024-09-12T18:32:45.064 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 19 tests. 2024-09-12T18:32:45.070 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:32:45.071 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:32:45.128 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T18:32:45.129 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T18:32:45.129 DEBUG:teuthology.orchestra.run.smithi111:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T18:32:45.198 INFO:tasks.workunit.client.0.smithi111.stdout:Running main() from gmock_main.cc 2024-09-12T18:32:45.198 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T18:32:45.198 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:32:45.198 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T18:32:45.198 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T18:32:47.084 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw_gc.init (1886 ms) 2024-09-12T18:32:47.084 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T18:32:47.122 INFO:tasks.workunit.client.0.smithi111.stderr:[ ] list info tag = chain-0 2024-09-12T18:32:47.122 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (38 ms) 2024-09-12T18:32:47.122 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T18:32:47.136 INFO:tasks.workunit.client.0.smithi111.stderr:[ ] next_marker is: = 0/4263 2024-09-12T18:32:47.138 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (15 ms) 2024-09-12T18:32:47.138 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T18:32:47.154 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (16 ms) 2024-09-12T18:32:47.154 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T18:32:47.258 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (105 ms) 2024-09-12T18:32:47.259 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T18:32:47.280 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (20 ms) 2024-09-12T18:32:47.280 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T18:32:47.300 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (21 ms) 2024-09-12T18:32:47.300 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T18:32:47.317 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (17 ms) 2024-09-12T18:32:47.317 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T18:32:48.100 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw_gc.finalize (781 ms) 2024-09-12T18:32:48.100 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 9 tests from cls_rgw_gc (2900 ms total) 2024-09-12T18:32:48.100 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:32:48.101 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:32:48.101 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 9 tests from 1 test suite ran. (2900 ms total) 2024-09-12T18:32:48.101 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 9 tests. 2024-09-12T18:32:48.103 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:32:48.103 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:32:48.163 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T18:32:48.165 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T18:32:48.165 DEBUG:teuthology.orchestra.run.smithi111:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T18:32:48.240 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:32:48.240 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:32:48.241 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T18:32:48.241 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:32:50.127 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T18:32:50.128 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T18:32:50.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.155+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=Z075WTRJ5YXF type=del size=3972495 2024-09-12T18:32:50.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.159+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~07XVRPPNDLVC.0 size=849130 2024-09-12T18:32:50.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.159+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=07XVRPPNDLVC tag=47O610Y30W85 type=write size=1897706 2024-09-12T18:32:50.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.163+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~48TFTC0NGWM3.0 size=743490 2024-09-12T18:32:50.164 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.163+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=48TFTC0NGWM3 tag=4E71VN72OVG8 type=write size=1792066 2024-09-12T18:32:50.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.163+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=I7YK65M6ISP3 type=write size=451956 2024-09-12T18:32:50.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.167+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=I3MRIWPZB6XF type=write size=101710 2024-09-12T18:32:50.170 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.171+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~B7G3DKM2E333.0 size=289889 2024-09-12T18:32:50.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.171+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=B7G3DKM2E333 tag=15DDEED5NQQV type=write size=1338465 2024-09-12T18:32:50.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.171+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=8C38LZO3A0OK type=del size=379557 2024-09-12T18:32:50.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.175+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~PB74OGGIPX27.0 size=1048576 2024-09-12T18:32:50.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.175+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~PB74OGGIPX27.1 size=549013 2024-09-12T18:32:50.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.175+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=PB74OGGIPX27 tag=CW08P2H5S3I4 type=write size=2646165 2024-09-12T18:32:50.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.179+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=DB9BYP2XWS82 type=write size=339526 2024-09-12T18:32:50.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.179+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=MV0WB3FS9DZT type=del size=592129 2024-09-12T18:32:50.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.183+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~ZRIF1HTP03QR.0 size=1048576 2024-09-12T18:32:50.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.183+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~ZRIF1HTP03QR.1 size=1048576 2024-09-12T18:32:50.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.187+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~ZRIF1HTP03QR.2 size=198437 2024-09-12T18:32:50.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.187+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=ZRIF1HTP03QR tag=J5F1D8C08QWU type=write size=3344165 2024-09-12T18:32:50.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.191+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~MUQ5P5C35C2Y.0 size=139037 2024-09-12T18:32:50.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.191+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=MUQ5P5C35C2Y tag=UW82ETKJB2LX type=write size=1187613 2024-09-12T18:32:50.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.191+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=5JL91XD106QP type=del size=666265 2024-09-12T18:32:50.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.195+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~XRQEPEVJUD6V.0 size=1048576 2024-09-12T18:32:50.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.199+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~XRQEPEVJUD6V.1 size=734609 2024-09-12T18:32:50.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.199+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=XRQEPEVJUD6V tag=A19Y4KOBYOO3 type=write size=2831761 2024-09-12T18:32:50.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.199+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=1EY2IAP2FZY5 type=del size=3040301 2024-09-12T18:32:50.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.203+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~7OEWDOMWAVV8.0 size=985905 2024-09-12T18:32:50.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.203+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=7OEWDOMWAVV8 tag=SS54Y0FHYZKB type=write size=2034481 2024-09-12T18:32:50.207 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.207+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=Z075WTRJ5YXF type=del 2024-09-12T18:32:50.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.207+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=E21OU9LBXAZW type=del size=3591753 2024-09-12T18:32:50.212 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.211+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~07XVRPPNDLVC.0 size=849130 2024-09-12T18:32:50.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.215+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=07XVRPPNDLVC tag=47O610Y30W85 type=write size=1897706 2024-09-12T18:32:50.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.215+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=8BSVXDOROC8H type=write size=467662 2024-09-12T18:32:50.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.219+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~48TFTC0NGWM3.0 size=743490 2024-09-12T18:32:50.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.223+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=48TFTC0NGWM3 tag=4E71VN72OVG8 type=write size=1792066 2024-09-12T18:32:50.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.223+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=DUX7I4WWQPLN type=del size=3027144 2024-09-12T18:32:50.228 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.227+0000 7f41a072b8c0 1 < completed write operation key=YCBC1CHWJQC5 tag=I7YK65M6ISP3 type=write size=451956 2024-09-12T18:32:50.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.231+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=1RT0SAK9SVRW type=write size=403325 2024-09-12T18:32:50.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.231+0000 7f41a072b8c0 1 < canceled operation key=P732C5X0RG8Z tag=I3MRIWPZB6XF type=write size=101710 2024-09-12T18:32:50.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.235+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=BGV9E1UV7K80 type=del size=776404 2024-09-12T18:32:50.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.235+0000 7f41a072b8c0 1 < canceled part key=_multipart_0O97F5ON55TX.2~B7G3DKM2E333.0 size=289889 2024-09-12T18:32:50.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.239+0000 7f41a072b8c0 1 < canceled multipart upload key=0O97F5ON55TX upload=B7G3DKM2E333 tag=15DDEED5NQQV type=write size=1338465 2024-09-12T18:32:50.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.239+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=43VXYG16EWTI type=del size=1077891 2024-09-12T18:32:50.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.243+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=8C38LZO3A0OK type=del 2024-09-12T18:32:50.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.247+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~OD05DC0G2QZE.0 size=882187 2024-09-12T18:32:50.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.247+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=OD05DC0G2QZE tag=0BV8W6QKGJ83 type=write size=1930763 2024-09-12T18:32:50.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.251+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~PB74OGGIPX27.0 size=1048576 2024-09-12T18:32:50.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.251+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~PB74OGGIPX27.1 size=549013 2024-09-12T18:32:50.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.255+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=PB74OGGIPX27 tag=CW08P2H5S3I4 type=write size=2646165 2024-09-12T18:32:50.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.259+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~JPGQX93M7BMT.0 size=756987 2024-09-12T18:32:50.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.259+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=JPGQX93M7BMT tag=4MXKAWTIHZ1K type=write size=1805563 2024-09-12T18:32:50.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.263+0000 7f41a072b8c0 1 < completed write operation key=7MRN7L1DTAMO tag=DB9BYP2XWS82 type=write size=339526 2024-09-12T18:32:50.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.263+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=IQH6Y1FNKOCP type=write size=333713 2024-09-12T18:32:50.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.267+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=MV0WB3FS9DZT type=del 2024-09-12T18:32:50.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.271+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~7GJRUXCDK2A4.0 size=1048576 2024-09-12T18:32:50.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.275+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~7GJRUXCDK2A4.1 size=978468 2024-09-12T18:32:50.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.275+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=7GJRUXCDK2A4 tag=B4OAELB0NFAI type=write size=3075620 2024-09-12T18:32:50.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.279+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~ZRIF1HTP03QR.0 size=1048576 2024-09-12T18:32:50.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.279+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~ZRIF1HTP03QR.1 size=1048576 2024-09-12T18:32:50.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.283+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~ZRIF1HTP03QR.2 size=198437 2024-09-12T18:32:50.289 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.287+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=ZRIF1HTP03QR tag=J5F1D8C08QWU type=write size=3344165 2024-09-12T18:32:50.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.291+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=TFMLSEML6334 type=del size=1837398 2024-09-12T18:32:50.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.295+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~MUQ5P5C35C2Y.0 size=139037 2024-09-12T18:32:50.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.299+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=MUQ5P5C35C2Y tag=UW82ETKJB2LX type=write size=1187613 2024-09-12T18:32:50.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.303+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~MIWLYYDBWH51.0 size=733861 2024-09-12T18:32:50.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.303+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=MIWLYYDBWH51 tag=2P1KALIX2SIF type=write size=1782437 2024-09-12T18:32:50.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.307+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=5JL91XD106QP type=del 2024-09-12T18:32:50.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.311+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=CR352Y0DIBLY type=write size=331345 2024-09-12T18:32:50.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.311+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~XRQEPEVJUD6V.0 size=1048576 2024-09-12T18:32:50.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.315+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~XRQEPEVJUD6V.1 size=734609 2024-09-12T18:32:50.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.319+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=XRQEPEVJUD6V tag=A19Y4KOBYOO3 type=write size=2831761 2024-09-12T18:32:50.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.323+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~7AZI1MNLAWMO.0 size=1048576 2024-09-12T18:32:50.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.327+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~7AZI1MNLAWMO.1 size=537510 2024-09-12T18:32:50.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.327+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=7AZI1MNLAWMO tag=WETCHQZDMXZ3 type=write size=2634662 2024-09-12T18:32:50.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.327+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=1EY2IAP2FZY5 type=del 2024-09-12T18:32:50.334 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.331+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~CMXV2ZNE5M7H.0 size=1048576 2024-09-12T18:32:50.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.335+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~CMXV2ZNE5M7H.1 size=167621 2024-09-12T18:32:50.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.335+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=CMXV2ZNE5M7H tag=2R1K8HPIABL3 type=write size=2264773 2024-09-12T18:32:50.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.339+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~7OEWDOMWAVV8.0 size=985905 2024-09-12T18:32:50.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.343+0000 7f41a072b8c0 1 < completed multipart upload key=L01GL4WOUIL2 upload=7OEWDOMWAVV8 tag=SS54Y0FHYZKB type=write size=2034481 2024-09-12T18:32:50.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.347+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~9KIIU6KGB5OW.0 size=566103 2024-09-12T18:32:50.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.347+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=9KIIU6KGB5OW tag=LG95CG2CD87H type=write size=1614679 2024-09-12T18:32:50.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.347+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=E21OU9LBXAZW type=del 2024-09-12T18:32:50.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.355+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~GG3BHXJK2GLE.0 size=1048576 2024-09-12T18:32:50.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.355+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~GG3BHXJK2GLE.1 size=218661 2024-09-12T18:32:50.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.355+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=GG3BHXJK2GLE tag=0BMI2ZXSM2CN type=write size=2315813 2024-09-12T18:32:50.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.359+0000 7f41a072b8c0 1 < completed write operation key=SK3T82EJFZXE tag=8BSVXDOROC8H type=write size=467662 2024-09-12T18:32:50.363 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.363+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=0W49WHYRPKGD type=del size=1500308 2024-09-12T18:32:50.367 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.367+0000 7f41a072b8c0 1 < suggested update operation key=GA6P1FACU2EQ tag=DUX7I4WWQPLN type=del size=3027144 2024-09-12T18:32:50.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.371+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~274FOCW90ANY.0 size=1048576 2024-09-12T18:32:50.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.371+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~274FOCW90ANY.1 size=1048576 2024-09-12T18:32:50.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.375+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~274FOCW90ANY.2 size=467191 2024-09-12T18:32:50.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.375+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=274FOCW90ANY tag=QBC05J2I1HX8 type=write size=3612919 2024-09-12T18:32:50.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.379+0000 7f41a072b8c0 1 < canceled operation key=5OD9IX408CYO tag=1RT0SAK9SVRW type=write size=403325 2024-09-12T18:32:50.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.379+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=7Z7S9UEQ9DA2 type=del size=4034580 2024-09-12T18:32:50.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.383+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=BGV9E1UV7K80 type=del 2024-09-12T18:32:50.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.387+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~JKABMFO5ZQWI.0 size=1048576 2024-09-12T18:32:50.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.391+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~JKABMFO5ZQWI.1 size=1048576 2024-09-12T18:32:50.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.391+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~JKABMFO5ZQWI.2 size=208761 2024-09-12T18:32:50.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.391+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=JKABMFO5ZQWI tag=P2H2MMT8WL7G type=write size=3354489 2024-09-12T18:32:50.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.395+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=43VXYG16EWTI type=del 2024-09-12T18:32:50.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.403+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~SQGU48J1KLTG.0 size=1048576 2024-09-12T18:32:50.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.403+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~SQGU48J1KLTG.1 size=1048576 2024-09-12T18:32:50.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.407+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~SQGU48J1KLTG.2 size=256134 2024-09-12T18:32:50.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.407+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=SQGU48J1KLTG tag=KVEWDYRASRVO type=write size=3401862 2024-09-12T18:32:50.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.407+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~OD05DC0G2QZE.0 size=882187 2024-09-12T18:32:50.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.411+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=OD05DC0G2QZE tag=0BV8W6QKGJ83 type=write size=1930763 2024-09-12T18:32:50.415 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.415+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=Y9HLKQ0NJGAO type=del size=3000691 2024-09-12T18:32:50.418 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.415+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~JPGQX93M7BMT.0 size=756987 2024-09-12T18:32:50.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.419+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=JPGQX93M7BMT tag=4MXKAWTIHZ1K type=write size=1805563 2024-09-12T18:32:50.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.423+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~WPMBGLELQR71.0 size=1048576 2024-09-12T18:32:50.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.427+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~WPMBGLELQR71.1 size=1048576 2024-09-12T18:32:50.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.427+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~WPMBGLELQR71.2 size=763003 2024-09-12T18:32:50.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.427+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=WPMBGLELQR71 tag=EBYQGCCNAVKJ type=write size=3908731 2024-09-12T18:32:50.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.431+0000 7f41a072b8c0 1 < canceled operation key=C2PRRD3QO9AF tag=IQH6Y1FNKOCP type=write size=333713 2024-09-12T18:32:50.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.435+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=C4JUXR2JR3U5 type=write size=343458 2024-09-12T18:32:50.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.439+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~7GJRUXCDK2A4.0 size=1048576 2024-09-12T18:32:50.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.439+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~7GJRUXCDK2A4.1 size=978468 2024-09-12T18:32:50.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.443+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=7GJRUXCDK2A4 tag=B4OAELB0NFAI type=write size=3075620 2024-09-12T18:32:50.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.447+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=GDYSPETIR836 type=del size=3233681 2024-09-12T18:32:50.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.451+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=TFMLSEML6334 type=del 2024-09-12T18:32:50.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.455+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~O0Y66732FII9.0 size=1048576 2024-09-12T18:32:50.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.459+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~O0Y66732FII9.1 size=1025310 2024-09-12T18:32:50.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.459+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=O0Y66732FII9 tag=E1VJDL6YSURW type=write size=3122462 2024-09-12T18:32:50.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.463+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~MIWLYYDBWH51.0 size=733861 2024-09-12T18:32:50.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.467+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=MIWLYYDBWH51 tag=2P1KALIX2SIF type=write size=1782437 2024-09-12T18:32:50.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.471+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=T4TJBHCNFJKS type=del size=3152902 2024-09-12T18:32:50.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.471+0000 7f41a072b8c0 1 < completed write operation key=63BP9QETTAM8 tag=CR352Y0DIBLY type=write size=331345 2024-09-12T18:32:50.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.475+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=W1NZO1CIM5V3 type=del size=3483685 2024-09-12T18:32:50.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.479+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~7AZI1MNLAWMO.0 size=1048576 2024-09-12T18:32:50.481 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.479+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~7AZI1MNLAWMO.1 size=537510 2024-09-12T18:32:50.485 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.483+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=7AZI1MNLAWMO tag=WETCHQZDMXZ3 type=write size=2634662 2024-09-12T18:32:50.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.491+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~X8RR0T03E609.0 size=1048576 2024-09-12T18:32:50.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.491+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~X8RR0T03E609.1 size=240522 2024-09-12T18:32:50.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.491+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=X8RR0T03E609 tag=71TGKIH9WACG type=write size=2337674 2024-09-12T18:32:50.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.495+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~CMXV2ZNE5M7H.0 size=1048576 2024-09-12T18:32:50.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.499+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~CMXV2ZNE5M7H.1 size=167621 2024-09-12T18:32:50.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.503+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=CMXV2ZNE5M7H tag=2R1K8HPIABL3 type=write size=2264773 2024-09-12T18:32:50.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~B8S1WLPF2NHF.0 size=1048576 2024-09-12T18:32:50.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.511+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~B8S1WLPF2NHF.1 size=1048576 2024-09-12T18:32:50.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.511+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~B8S1WLPF2NHF.2 size=621262 2024-09-12T18:32:50.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.511+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=B8S1WLPF2NHF tag=PYRIEB79QU9B type=write size=3766990 2024-09-12T18:32:50.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.515+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~9KIIU6KGB5OW.0 size=566103 2024-09-12T18:32:50.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.519+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=9KIIU6KGB5OW tag=LG95CG2CD87H type=write size=1614679 2024-09-12T18:32:50.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.527+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~7THDVGZKY5OI.0 size=1048576 2024-09-12T18:32:50.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.527+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~7THDVGZKY5OI.1 size=1048576 2024-09-12T18:32:50.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.531+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~7THDVGZKY5OI.2 size=133418 2024-09-12T18:32:50.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.531+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=7THDVGZKY5OI tag=Q5H607E3YR7N type=write size=3279146 2024-09-12T18:32:50.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.535+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~GG3BHXJK2GLE.0 size=1048576 2024-09-12T18:32:50.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.535+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~GG3BHXJK2GLE.1 size=218661 2024-09-12T18:32:50.542 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.539+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=GG3BHXJK2GLE tag=0BMI2ZXSM2CN type=write size=2315813 2024-09-12T18:32:50.545 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.543+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=FZ4R256S2QP3 type=del size=2337372 2024-09-12T18:32:50.549 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.547+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=0W49WHYRPKGD type=del 2024-09-12T18:32:50.555 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.555+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~OVL2LCPHUNBA.0 size=1048576 2024-09-12T18:32:50.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.555+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~OVL2LCPHUNBA.1 size=1048576 2024-09-12T18:32:50.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.559+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~OVL2LCPHUNBA.2 size=146674 2024-09-12T18:32:50.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.559+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=OVL2LCPHUNBA tag=S3G4D9EENCE2 type=write size=3292402 2024-09-12T18:32:50.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.563+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~274FOCW90ANY.0 size=1048576 2024-09-12T18:32:50.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.567+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~274FOCW90ANY.1 size=1048576 2024-09-12T18:32:50.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.571+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~274FOCW90ANY.2 size=467191 2024-09-12T18:32:50.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.575+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=274FOCW90ANY tag=QBC05J2I1HX8 type=write size=3612919 2024-09-12T18:32:50.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.579+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=YMUR36COQ7HX type=del size=1958181 2024-09-12T18:32:50.582 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.579+0000 7f41a072b8c0 1 < completed delete operation key=3R9RN03RFRJP tag=7Z7S9UEQ9DA2 type=del 2024-09-12T18:32:50.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.587+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~VM0VEPT19GS3.0 size=1048576 2024-09-12T18:32:50.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.587+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~VM0VEPT19GS3.1 size=1048576 2024-09-12T18:32:50.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.591+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~VM0VEPT19GS3.2 size=61623 2024-09-12T18:32:50.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.591+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=VM0VEPT19GS3 tag=6UH6UXS7VT20 type=write size=3207351 2024-09-12T18:32:50.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.591+0000 7f41a072b8c0 1 < canceled part key=_multipart_A6GQZL25YSNL.2~JKABMFO5ZQWI.0 size=1048576 2024-09-12T18:32:50.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.595+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~JKABMFO5ZQWI.1 size=1048576 2024-09-12T18:32:50.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.595+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~JKABMFO5ZQWI.2 size=208761 2024-09-12T18:32:50.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.603+0000 7f41a072b8c0 1 < canceled multipart upload key=A6GQZL25YSNL upload=JKABMFO5ZQWI tag=P2H2MMT8WL7G type=write size=3354489 2024-09-12T18:32:50.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.607+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~IW465YH51TK1.0 size=1048576 2024-09-12T18:32:50.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.611+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~IW465YH51TK1.1 size=1048576 2024-09-12T18:32:50.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.611+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~IW465YH51TK1.2 size=712400 2024-09-12T18:32:50.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.611+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=IW465YH51TK1 tag=L7ROFHHBKZB1 type=write size=3858128 2024-09-12T18:32:50.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.615+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~SQGU48J1KLTG.0 size=1048576 2024-09-12T18:32:50.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.619+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~SQGU48J1KLTG.1 size=1048576 2024-09-12T18:32:50.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.623+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~SQGU48J1KLTG.2 size=256134 2024-09-12T18:32:50.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.627+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=SQGU48J1KLTG tag=KVEWDYRASRVO type=write size=3401862 2024-09-12T18:32:50.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.631+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~1VJLL0YEOXEJ.0 size=1048576 2024-09-12T18:32:50.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.635+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~1VJLL0YEOXEJ.1 size=1048576 2024-09-12T18:32:50.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.635+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~1VJLL0YEOXEJ.2 size=602151 2024-09-12T18:32:50.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.635+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=1VJLL0YEOXEJ tag=MW104CLFDLN8 type=write size=3747879 2024-09-12T18:32:50.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.639+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=Y9HLKQ0NJGAO type=del 2024-09-12T18:32:50.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.643+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=EMJDK4Y19ORM type=del size=468132 2024-09-12T18:32:50.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.643+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~WPMBGLELQR71.0 size=1048576 2024-09-12T18:32:50.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.647+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~WPMBGLELQR71.1 size=1048576 2024-09-12T18:32:50.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.647+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~WPMBGLELQR71.2 size=763003 2024-09-12T18:32:50.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.651+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=WPMBGLELQR71 tag=EBYQGCCNAVKJ type=write size=3908731 2024-09-12T18:32:50.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.655+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=7MC58T5RH3PF type=del size=1528967 2024-09-12T18:32:50.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.659+0000 7f41a072b8c0 1 < completed write operation key=295ZC54QRUPD tag=C4JUXR2JR3U5 type=write size=343458 2024-09-12T18:32:50.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.663+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=TV4A00C1KNOI type=del size=2762037 2024-09-12T18:32:50.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.667+0000 7f41a072b8c0 1 < suggested update operation key=3CGBX19WTMWQ tag=GDYSPETIR836 type=del size=3233681 2024-09-12T18:32:50.672 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.671+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=3T3H9OJZ7455 type=del size=3493189 2024-09-12T18:32:50.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.671+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~O0Y66732FII9.0 size=1048576 2024-09-12T18:32:50.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.675+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~O0Y66732FII9.1 size=1025310 2024-09-12T18:32:50.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.679+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=O0Y66732FII9 tag=E1VJDL6YSURW type=write size=3122462 2024-09-12T18:32:50.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.683+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~FB1U7RFGUN3J.0 size=1048576 2024-09-12T18:32:50.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.687+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~FB1U7RFGUN3J.1 size=178722 2024-09-12T18:32:50.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.687+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=FB1U7RFGUN3J tag=PE4FB2RFPWA5 type=write size=2275874 2024-09-12T18:32:50.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.687+0000 7f41a072b8c0 1 < completed delete operation key=NKMA8FG3V3TR tag=T4TJBHCNFJKS type=del 2024-09-12T18:32:50.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.691+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=H2KI7FBLXMGH type=del size=267327 2024-09-12T18:32:50.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.695+0000 7f41a072b8c0 1 < suggested update operation key=0O97F5ON55TX tag=W1NZO1CIM5V3 type=del size=3483685 2024-09-12T18:32:50.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.699+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=5WWQ05GZ2W1Z type=del size=1504354 2024-09-12T18:32:50.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.699+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~X8RR0T03E609.0 size=1048576 2024-09-12T18:32:50.704 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.703+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~X8RR0T03E609.1 size=240522 2024-09-12T18:32:50.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.707+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=X8RR0T03E609 tag=71TGKIH9WACG type=write size=2337674 2024-09-12T18:32:50.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.711+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~LFF0PTF1NY1C.0 size=1048576 2024-09-12T18:32:50.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.715+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~LFF0PTF1NY1C.1 size=812901 2024-09-12T18:32:50.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.715+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=LFF0PTF1NY1C tag=N9FTTJ4LE9EW type=write size=2910053 2024-09-12T18:32:50.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.715+0000 7f41a072b8c0 1 < canceled part key=_multipart_5JUWC8RXSA5L.2~B8S1WLPF2NHF.0 size=1048576 2024-09-12T18:32:50.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.715+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~B8S1WLPF2NHF.1 size=1048576 2024-09-12T18:32:50.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.719+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~B8S1WLPF2NHF.2 size=621262 2024-09-12T18:32:50.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.723+0000 7f41a072b8c0 1 < canceled multipart upload key=5JUWC8RXSA5L upload=B8S1WLPF2NHF tag=PYRIEB79QU9B type=write size=3766990 2024-09-12T18:32:50.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.727+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~R3P12E5Q2DN7.0 size=1048576 2024-09-12T18:32:50.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.731+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~R3P12E5Q2DN7.1 size=1048576 2024-09-12T18:32:50.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.735+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~R3P12E5Q2DN7.2 size=839236 2024-09-12T18:32:50.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.735+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=R3P12E5Q2DN7 tag=8APSYCG8GKA1 type=write size=3984964 2024-09-12T18:32:50.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.735+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~7THDVGZKY5OI.0 size=1048576 2024-09-12T18:32:50.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.739+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~7THDVGZKY5OI.1 size=1048576 2024-09-12T18:32:50.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.739+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~7THDVGZKY5OI.2 size=133418 2024-09-12T18:32:50.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.747+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=7THDVGZKY5OI tag=Q5H607E3YR7N type=write size=3279146 2024-09-12T18:32:50.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.751+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~SX9LSY7N63P8.0 size=1048576 2024-09-12T18:32:50.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.755+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~SX9LSY7N63P8.1 size=89934 2024-09-12T18:32:50.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.755+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=SX9LSY7N63P8 tag=I4WNRF705B6S type=write size=2187086 2024-09-12T18:32:50.759 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.759+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=FZ4R256S2QP3 type=del 2024-09-12T18:32:50.761 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.759+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=66GPV9FAXMH3 type=del size=1563435 2024-09-12T18:32:50.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.763+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~OVL2LCPHUNBA.0 size=1048576 2024-09-12T18:32:50.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.763+0000 7f41a072b8c0 1 < canceled part key=_multipart_31T6AP6MUBKL.2~OVL2LCPHUNBA.1 size=1048576 2024-09-12T18:32:50.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.767+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~OVL2LCPHUNBA.2 size=146674 2024-09-12T18:32:50.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.771+0000 7f41a072b8c0 1 < canceled multipart upload key=31T6AP6MUBKL upload=OVL2LCPHUNBA tag=S3G4D9EENCE2 type=write size=3292402 2024-09-12T18:32:50.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.775+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=CA1U2MPBN8W7 type=del size=2079128 2024-09-12T18:32:50.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.775+0000 7f41a072b8c0 1 < canceled operation key=YCBC1CHWJQC5 tag=YMUR36COQ7HX type=del size=1958181 2024-09-12T18:32:50.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.783+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~JDQBO0REQ3AI.0 size=1048576 2024-09-12T18:32:50.785 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.783+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~JDQBO0REQ3AI.1 size=1048576 2024-09-12T18:32:50.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.787+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~JDQBO0REQ3AI.2 size=411528 2024-09-12T18:32:50.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.787+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=JDQBO0REQ3AI tag=8L8I6FU5BLYG type=write size=3557256 2024-09-12T18:32:50.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.791+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~VM0VEPT19GS3.0 size=1048576 2024-09-12T18:32:50.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.791+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~VM0VEPT19GS3.1 size=1048576 2024-09-12T18:32:50.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.795+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~VM0VEPT19GS3.2 size=61623 2024-09-12T18:32:50.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.799+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=VM0VEPT19GS3 tag=6UH6UXS7VT20 type=write size=3207351 2024-09-12T18:32:50.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.803+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~L0CIF4LFO4PP.0 size=1048576 2024-09-12T18:32:50.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.807+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~L0CIF4LFO4PP.1 size=226528 2024-09-12T18:32:50.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.807+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=L0CIF4LFO4PP tag=A19YMQ52XAPT type=write size=2323680 2024-09-12T18:32:50.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.807+0000 7f41a072b8c0 1 < canceled part key=_multipart_0G0YWIOD3L3I.2~IW465YH51TK1.0 size=1048576 2024-09-12T18:32:50.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.807+0000 7f41a072b8c0 1 < canceled part key=_multipart_0G0YWIOD3L3I.2~IW465YH51TK1.1 size=1048576 2024-09-12T18:32:50.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.811+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~IW465YH51TK1.2 size=712400 2024-09-12T18:32:50.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.815+0000 7f41a072b8c0 1 < canceled multipart upload key=0G0YWIOD3L3I upload=IW465YH51TK1 tag=L7ROFHHBKZB1 type=write size=3858128 2024-09-12T18:32:50.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.819+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~3UDB0ZQPH5TR.0 size=1048576 2024-09-12T18:32:50.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.823+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~3UDB0ZQPH5TR.1 size=16090 2024-09-12T18:32:50.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.823+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=3UDB0ZQPH5TR tag=GZISIC50U1UY type=write size=2113242 2024-09-12T18:32:50.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.823+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~1VJLL0YEOXEJ.0 size=1048576 2024-09-12T18:32:50.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.827+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~1VJLL0YEOXEJ.1 size=1048576 2024-09-12T18:32:50.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.831+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~1VJLL0YEOXEJ.2 size=602151 2024-09-12T18:32:50.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.835+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=1VJLL0YEOXEJ tag=MW104CLFDLN8 type=write size=3747879 2024-09-12T18:32:50.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.839+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=77QYZGFTZ8T9 type=del size=3159190 2024-09-12T18:32:50.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.839+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=EMJDK4Y19ORM type=del 2024-09-12T18:32:50.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.843+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=EKRV8AL4NYVH type=del size=652536 2024-09-12T18:32:50.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.847+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=7MC58T5RH3PF type=del 2024-09-12T18:32:50.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.847+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=31PJVLSF6JOC type=del size=126354 2024-09-12T18:32:50.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.851+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=TV4A00C1KNOI type=del 2024-09-12T18:32:50.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.855+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~LKGWHJ3JBFU5.0 size=1048576 2024-09-12T18:32:50.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.859+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~LKGWHJ3JBFU5.1 size=555162 2024-09-12T18:32:50.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.859+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=LKGWHJ3JBFU5 tag=1Z1OT7ROIMZT type=write size=2652314 2024-09-12T18:32:50.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.863+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=3T3H9OJZ7455 type=del 2024-09-12T18:32:50.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.867+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=QX0R092NJ9P0 type=del size=3342750 2024-09-12T18:32:50.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.867+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~FB1U7RFGUN3J.0 size=1048576 2024-09-12T18:32:50.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.871+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~FB1U7RFGUN3J.1 size=178722 2024-09-12T18:32:50.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.875+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=FB1U7RFGUN3J tag=PE4FB2RFPWA5 type=write size=2275874 2024-09-12T18:32:50.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.879+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=DKUNUXNBDW0C type=del size=1950784 2024-09-12T18:32:50.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.883+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=H2KI7FBLXMGH type=del 2024-09-12T18:32:50.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.887+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~P3LAQ6ZD9767.0 size=664307 2024-09-12T18:32:50.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.887+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=P3LAQ6ZD9767 tag=PDBCJG2GXPM3 type=write size=1712883 2024-09-12T18:32:50.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.891+0000 7f41a072b8c0 1 < suggested remove operation key=P732C5X0RG8Z tag=5WWQ05GZ2W1Z type=del 2024-09-12T18:32:50.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.895+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=7NN49C8JLJAY type=del size=2114083 2024-09-12T18:32:50.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.899+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~LFF0PTF1NY1C.0 size=1048576 2024-09-12T18:32:50.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.899+0000 7f41a072b8c0 1 < canceled part key=_multipart_0O97F5ON55TX.2~LFF0PTF1NY1C.1 size=812901 2024-09-12T18:32:50.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.903+0000 7f41a072b8c0 1 < canceled multipart upload key=0O97F5ON55TX upload=LFF0PTF1NY1C tag=N9FTTJ4LE9EW type=write size=2910053 2024-09-12T18:32:50.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.903+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=TPR6YZ5YU1RP type=del size=2653024 2024-09-12T18:32:50.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.907+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~R3P12E5Q2DN7.0 size=1048576 2024-09-12T18:32:50.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.911+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~R3P12E5Q2DN7.1 size=1048576 2024-09-12T18:32:50.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.915+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~R3P12E5Q2DN7.2 size=839236 2024-09-12T18:32:50.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.919+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=R3P12E5Q2DN7 tag=8APSYCG8GKA1 type=write size=3984964 2024-09-12T18:32:50.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.923+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=BHS17RQX33U0 type=del size=839469 2024-09-12T18:32:50.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.927+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~SX9LSY7N63P8.0 size=1048576 2024-09-12T18:32:50.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.927+0000 7f41a072b8c0 1 < canceled part key=_multipart_0G0YWIOD3L3I.2~SX9LSY7N63P8.1 size=89934 2024-09-12T18:32:50.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.931+0000 7f41a072b8c0 1 < canceled multipart upload key=0G0YWIOD3L3I upload=SX9LSY7N63P8 tag=I4WNRF705B6S type=write size=2187086 2024-09-12T18:32:50.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.935+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=7S6PM2VHJH7V type=write size=202874 2024-09-12T18:32:50.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.939+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=66GPV9FAXMH3 type=del 2024-09-12T18:32:50.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.939+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=YOPWIGNBDAHN type=del size=2328106 2024-09-12T18:32:50.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.943+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=CA1U2MPBN8W7 type=del 2024-09-12T18:32:50.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.951+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~8FAJTH2KUVTC.0 size=1048576 2024-09-12T18:32:50.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.951+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~8FAJTH2KUVTC.1 size=1048576 2024-09-12T18:32:50.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.955+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~8FAJTH2KUVTC.2 size=90167 2024-09-12T18:32:50.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.955+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=8FAJTH2KUVTC tag=93NHNLPLQ963 type=write size=3235895 2024-09-12T18:32:50.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.959+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~JDQBO0REQ3AI.0 size=1048576 2024-09-12T18:32:50.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.963+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~JDQBO0REQ3AI.1 size=1048576 2024-09-12T18:32:50.965 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.963+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~JDQBO0REQ3AI.2 size=411528 2024-09-12T18:32:50.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.967+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=JDQBO0REQ3AI tag=8L8I6FU5BLYG type=write size=3557256 2024-09-12T18:32:50.975 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.975+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~VF62ADSJ0RCR.0 size=1048576 2024-09-12T18:32:50.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.975+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~VF62ADSJ0RCR.1 size=1048576 2024-09-12T18:32:50.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.979+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~VF62ADSJ0RCR.2 size=454354 2024-09-12T18:32:50.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.979+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=VF62ADSJ0RCR tag=ZTEIIBA74BJ6 type=write size=3600082 2024-09-12T18:32:50.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.983+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~L0CIF4LFO4PP.0 size=1048576 2024-09-12T18:32:50.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.987+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~L0CIF4LFO4PP.1 size=226528 2024-09-12T18:32:50.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.991+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=L0CIF4LFO4PP tag=A19YMQ52XAPT type=write size=2323680 2024-09-12T18:32:50.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.995+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=BOVX9T00QQ0T type=del size=3951717 2024-09-12T18:32:50.998 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.995+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~3UDB0ZQPH5TR.0 size=1048576 2024-09-12T18:32:51.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:50.999+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~3UDB0ZQPH5TR.1 size=16090 2024-09-12T18:32:51.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.003+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=3UDB0ZQPH5TR tag=GZISIC50U1UY type=write size=2113242 2024-09-12T18:32:51.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.007+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~K8DL1FO58WGV.0 size=1048576 2024-09-12T18:32:51.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.011+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~K8DL1FO58WGV.1 size=1048576 2024-09-12T18:32:51.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.011+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~K8DL1FO58WGV.2 size=239477 2024-09-12T18:32:51.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.011+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=K8DL1FO58WGV tag=IZR1CLQX3Q3N type=write size=3385205 2024-09-12T18:32:51.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.015+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=77QYZGFTZ8T9 type=del 2024-09-12T18:32:51.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.019+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=V9OO86TJE89R type=del size=3578223 2024-09-12T18:32:51.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.023+0000 7f41a072b8c0 1 < suggested remove operation key=295ZC54QRUPD tag=EKRV8AL4NYVH type=del 2024-09-12T18:32:51.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.031+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~OEGUP8KZ33ID.0 size=1048576 2024-09-12T18:32:51.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.031+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~OEGUP8KZ33ID.1 size=59279 2024-09-12T18:32:51.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.031+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=OEGUP8KZ33ID tag=7NK383CHAKZI type=write size=2156431 2024-09-12T18:32:51.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.035+0000 7f41a072b8c0 1 < suggested update operation key=A6GQZL25YSNL tag=31PJVLSF6JOC type=del size=126354 2024-09-12T18:32:51.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.043+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~3O6HRO0E3IFH.0 size=1048576 2024-09-12T18:32:51.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.043+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~3O6HRO0E3IFH.1 size=290927 2024-09-12T18:32:51.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.043+0000 7f41a072b8c0 1 > prepared multipart upload key=VEN0P2P1RZ2S upload=3O6HRO0E3IFH tag=XQCN49X2CD9T type=write size=2388079 2024-09-12T18:32:51.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.047+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~LKGWHJ3JBFU5.0 size=1048576 2024-09-12T18:32:51.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.051+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~LKGWHJ3JBFU5.1 size=555162 2024-09-12T18:32:51.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.055+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=LKGWHJ3JBFU5 tag=1Z1OT7ROIMZT type=write size=2652314 2024-09-12T18:32:51.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.063+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~ISV673UV6EXG.0 size=1048576 2024-09-12T18:32:51.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.063+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~ISV673UV6EXG.1 size=1048576 2024-09-12T18:32:51.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.067+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~ISV673UV6EXG.2 size=258358 2024-09-12T18:32:51.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.067+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=ISV673UV6EXG tag=M8JJXHO37VSE type=write size=3404086 2024-09-12T18:32:51.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.071+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=QX0R092NJ9P0 type=del 2024-09-12T18:32:51.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.075+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~BNN04NWTCXU6.0 size=1048576 2024-09-12T18:32:51.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.079+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~BNN04NWTCXU6.1 size=1048576 2024-09-12T18:32:51.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.083+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~BNN04NWTCXU6.2 size=48545 2024-09-12T18:32:51.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.083+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=BNN04NWTCXU6 tag=39OEI40VBE59 type=write size=3194273 2024-09-12T18:32:51.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.083+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=DKUNUXNBDW0C type=del 2024-09-12T18:32:51.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.087+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=J5QSCIINMLBJ type=write size=428991 2024-09-12T18:32:51.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.091+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~P3LAQ6ZD9767.0 size=664307 2024-09-12T18:32:51.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.095+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=P3LAQ6ZD9767 tag=PDBCJG2GXPM3 type=write size=1712883 2024-09-12T18:32:51.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.099+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=YOSB4I2CRYF0 type=del size=3561207 2024-09-12T18:32:51.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.107+0000 7f41a072b8c0 1 < suggested remove operation key=58IT2R988AW9 tag=7NN49C8JLJAY type=del 2024-09-12T18:32:51.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.111+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=YYZEBBGDUL31 type=write size=186138 2024-09-12T18:32:51.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.111+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=TPR6YZ5YU1RP type=del 2024-09-12T18:32:51.117 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.115+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=FL42Z5SP2IB8 type=del size=1525227 2024-09-12T18:32:51.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.119+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=BHS17RQX33U0 type=del 2024-09-12T18:32:51.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.123+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~MG634PM448VP.0 size=1002342 2024-09-12T18:32:51.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.123+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=MG634PM448VP tag=B4MZN2DHNGAQ type=write size=2050918 2024-09-12T18:32:51.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.131+0000 7f41a072b8c0 1 < suggested update operation key=5JUWC8RXSA5L tag=7S6PM2VHJH7V type=write size=202874 2024-09-12T18:32:51.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.135+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=Q12PU90ALVIZ type=del size=2935809 2024-09-12T18:32:51.158 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.155+0000 7f41a072b8c0 1 < suggested update operation key=NKMA8FG3V3TR tag=YOPWIGNBDAHN type=del size=2328106 2024-09-12T18:32:51.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.159+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=JTVFXZZVSUPF type=del size=2700713 2024-09-12T18:32:51.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.163+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~8FAJTH2KUVTC.0 size=1048576 2024-09-12T18:32:51.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.163+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~8FAJTH2KUVTC.1 size=1048576 2024-09-12T18:32:51.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.167+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~8FAJTH2KUVTC.2 size=90167 2024-09-12T18:32:51.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.171+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=8FAJTH2KUVTC tag=93NHNLPLQ963 type=write size=3235895 2024-09-12T18:32:51.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.175+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~3L8OI7SQGBJE.0 size=899146 2024-09-12T18:32:51.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.175+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=3L8OI7SQGBJE tag=2UJZBVF0B399 type=write size=1947722 2024-09-12T18:32:51.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.175+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~VF62ADSJ0RCR.0 size=1048576 2024-09-12T18:32:51.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.179+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~VF62ADSJ0RCR.1 size=1048576 2024-09-12T18:32:51.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.179+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~VF62ADSJ0RCR.2 size=454354 2024-09-12T18:32:51.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.187+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=VF62ADSJ0RCR tag=ZTEIIBA74BJ6 type=write size=3600082 2024-09-12T18:32:51.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.191+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~A31DUW4FL2QQ.0 size=600886 2024-09-12T18:32:51.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.191+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=A31DUW4FL2QQ tag=794EA2HYROHF type=write size=1649462 2024-09-12T18:32:51.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.191+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=BOVX9T00QQ0T type=del 2024-09-12T18:32:51.196 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.195+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=IPN1SNM5M5H0 type=write size=999192 2024-09-12T18:32:51.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.195+0000 7f41a072b8c0 1 < canceled part key=_multipart_ZACT36ZOC9ES.2~K8DL1FO58WGV.0 size=1048576 2024-09-12T18:32:51.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.199+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~K8DL1FO58WGV.1 size=1048576 2024-09-12T18:32:51.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.199+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~K8DL1FO58WGV.2 size=239477 2024-09-12T18:32:51.207 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.207+0000 7f41a072b8c0 1 < canceled multipart upload key=ZACT36ZOC9ES upload=K8DL1FO58WGV tag=IZR1CLQX3Q3N type=write size=3385205 2024-09-12T18:32:51.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.207+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=8OKVEQ34Q55D type=write size=106889 2024-09-12T18:32:51.212 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.211+0000 7f41a072b8c0 -1 < failed to complete operation key=58IT2R988AW9 tag=V9OO86TJE89R type=del size=3578223: (22) Invalid argument 2024-09-12T18:32:51.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.215+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=6MRBR3JLLP10 type=del size=990129 2024-09-12T18:32:51.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.215+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~OEGUP8KZ33ID.0 size=1048576 2024-09-12T18:32:51.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.219+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~OEGUP8KZ33ID.1 size=59279 2024-09-12T18:32:51.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.223+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=OEGUP8KZ33ID tag=7NK383CHAKZI type=write size=2156431 2024-09-12T18:32:51.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.227+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=I18BZZF4T0KX type=del size=2323270 2024-09-12T18:32:51.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.227+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~3O6HRO0E3IFH.0 size=1048576 2024-09-12T18:32:51.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.231+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~3O6HRO0E3IFH.1 size=290927 2024-09-12T18:32:51.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.235+0000 7f41a072b8c0 1 < completed multipart upload key=VEN0P2P1RZ2S upload=3O6HRO0E3IFH tag=XQCN49X2CD9T type=write size=2388079 2024-09-12T18:32:51.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.239+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~X7O36W171Q7X.0 size=623360 2024-09-12T18:32:51.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.239+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=X7O36W171Q7X tag=1PPOV3FDFOS3 type=write size=1671936 2024-09-12T18:32:51.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.243+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~ISV673UV6EXG.0 size=1048576 2024-09-12T18:32:51.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.243+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~ISV673UV6EXG.1 size=1048576 2024-09-12T18:32:51.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.247+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~ISV673UV6EXG.2 size=258358 2024-09-12T18:32:51.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.251+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=ISV673UV6EXG tag=M8JJXHO37VSE type=write size=3404086 2024-09-12T18:32:51.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.255+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=GL0CPGEAUCH7 type=del size=2269782 2024-09-12T18:32:51.258 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.259+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~BNN04NWTCXU6.0 size=1048576 2024-09-12T18:32:51.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.259+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~BNN04NWTCXU6.1 size=1048576 2024-09-12T18:32:51.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.263+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~BNN04NWTCXU6.2 size=48545 2024-09-12T18:32:51.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.267+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=BNN04NWTCXU6 tag=39OEI40VBE59 type=write size=3194273 2024-09-12T18:32:51.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.271+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~PJWIR8FB0EIL.0 size=360913 2024-09-12T18:32:51.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.271+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=PJWIR8FB0EIL tag=MPCCYU8Z6YY0 type=write size=1409489 2024-09-12T18:32:51.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.275+0000 7f41a072b8c0 1 < completed write operation key=GC8797KSO47E tag=J5QSCIINMLBJ type=write size=428991 2024-09-12T18:32:51.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.279+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~1HX2YLX0FGSZ.0 size=315192 2024-09-12T18:32:51.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.279+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=1HX2YLX0FGSZ tag=VQYR04HFU72Q type=write size=1363768 2024-09-12T18:32:51.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.283+0000 7f41a072b8c0 1 < canceled operation key=L1VC63PK1R2Y tag=YOSB4I2CRYF0 type=del size=3561207 2024-09-12T18:32:51.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.287+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=6LED0224VS12 type=del size=4129074 2024-09-12T18:32:51.290 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.287+0000 7f41a072b8c0 1 < completed write operation key=1BSAN5TRTZNZ tag=YYZEBBGDUL31 type=write size=186138 2024-09-12T18:32:51.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.295+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~GW6T1CRVQE9Z.0 size=1048576 2024-09-12T18:32:51.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.299+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~GW6T1CRVQE9Z.1 size=1048576 2024-09-12T18:32:51.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.299+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~GW6T1CRVQE9Z.2 size=29181 2024-09-12T18:32:51.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.299+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=GW6T1CRVQE9Z tag=Z8Z29ZXWL7ZO type=write size=3174909 2024-09-12T18:32:51.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.303+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=FL42Z5SP2IB8 type=del 2024-09-12T18:32:51.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.307+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=ASSQNU5ZUSLV type=del size=1171051 2024-09-12T18:32:51.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.311+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~MG634PM448VP.0 size=1002342 2024-09-12T18:32:51.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.315+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=MG634PM448VP tag=B4MZN2DHNGAQ type=write size=2050918 2024-09-12T18:32:51.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.319+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=4RWR53QY7L94 type=write size=997164 2024-09-12T18:32:51.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.323+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=Q12PU90ALVIZ type=del 2024-09-12T18:32:51.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.327+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~1PCU7M8OQTLV.0 size=1048576 2024-09-12T18:32:51.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.331+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~1PCU7M8OQTLV.1 size=1048576 2024-09-12T18:32:51.334 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.335+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~1PCU7M8OQTLV.2 size=340006 2024-09-12T18:32:51.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.335+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=1PCU7M8OQTLV tag=G6OKZ4ZHJWNN type=write size=3485734 2024-09-12T18:32:51.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.335+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=JTVFXZZVSUPF type=del 2024-09-12T18:32:51.341 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.339+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=4R6NQO4NZJFK type=del size=1873559 2024-09-12T18:32:51.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.343+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~3L8OI7SQGBJE.0 size=899146 2024-09-12T18:32:51.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.347+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=3L8OI7SQGBJE tag=2UJZBVF0B399 type=write size=1947722 2024-09-12T18:32:51.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.351+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=FER0E6RY26LU type=write size=665089 2024-09-12T18:32:51.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.355+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~A31DUW4FL2QQ.0 size=600886 2024-09-12T18:32:51.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.359+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=A31DUW4FL2QQ tag=794EA2HYROHF type=write size=1649462 2024-09-12T18:32:51.366 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.363+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~CTVYDPYXU76Z.0 size=1048576 2024-09-12T18:32:51.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.367+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~CTVYDPYXU76Z.1 size=1048576 2024-09-12T18:32:51.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.371+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~CTVYDPYXU76Z.2 size=399403 2024-09-12T18:32:51.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.371+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=CTVYDPYXU76Z tag=GWD5ESPTRN8H type=write size=3545131 2024-09-12T18:32:51.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.371+0000 7f41a072b8c0 1 < completed write operation key=VEN0P2P1RZ2S tag=IPN1SNM5M5H0 type=write size=999192 2024-09-12T18:32:51.377 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.375+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=7LD4UEVSJWUC type=del size=1078480 2024-09-12T18:32:51.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.383+0000 7f41a072b8c0 1 < suggested update operation key=A6GQZL25YSNL tag=8OKVEQ34Q55D type=write size=106889 2024-09-12T18:32:51.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.387+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~OEF646XI2K2L.0 size=1048576 2024-09-12T18:32:51.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.391+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~OEF646XI2K2L.1 size=1048576 2024-09-12T18:32:51.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.395+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~OEF646XI2K2L.2 size=45599 2024-09-12T18:32:51.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.395+0000 7f41a072b8c0 1 > prepared multipart upload key=VEN0P2P1RZ2S upload=OEF646XI2K2L tag=SFG6B2ITZ7HL type=write size=3191327 2024-09-12T18:32:51.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.395+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=6MRBR3JLLP10 type=del 2024-09-12T18:32:51.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.399+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=JXUBLI5T10XU type=del size=3655424 2024-09-12T18:32:51.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.403+0000 7f41a072b8c0 1 < canceled operation key=ZACT36ZOC9ES tag=I18BZZF4T0KX type=del size=2323270 2024-09-12T18:32:51.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.407+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~TKTK94ZXRAS1.0 size=368888 2024-09-12T18:32:51.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.407+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=TKTK94ZXRAS1 tag=WMUIYPRT6U02 type=write size=1417464 2024-09-12T18:32:51.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.411+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~X7O36W171Q7X.0 size=623360 2024-09-12T18:32:51.418 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.415+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=X7O36W171Q7X tag=1PPOV3FDFOS3 type=write size=1671936 2024-09-12T18:32:51.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.419+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=RCT1UIXS1MVB type=write size=742699 2024-09-12T18:32:51.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.427+0000 7f41a072b8c0 1 < suggested remove operation key=V35A7LK08C7J tag=GL0CPGEAUCH7 type=del 2024-09-12T18:32:51.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.431+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=8F2L6YTR5B0W type=write size=807580 2024-09-12T18:32:51.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.435+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~PJWIR8FB0EIL.0 size=360913 2024-09-12T18:32:51.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.439+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=PJWIR8FB0EIL tag=MPCCYU8Z6YY0 type=write size=1409489 2024-09-12T18:32:51.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.447+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~XAAO44E1G8BL.0 size=769412 2024-09-12T18:32:51.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.447+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=XAAO44E1G8BL tag=J2VIVE3W3GIE type=write size=1817988 2024-09-12T18:32:51.450 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.451+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~1HX2YLX0FGSZ.0 size=315192 2024-09-12T18:32:51.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.455+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=1HX2YLX0FGSZ tag=VQYR04HFU72Q type=write size=1363768 2024-09-12T18:32:51.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.459+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=SV938GGYQB9E type=del size=2627979 2024-09-12T18:32:51.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.463+0000 7f41a072b8c0 1 < canceled operation key=7MRN7L1DTAMO tag=6LED0224VS12 type=del size=4129074 2024-09-12T18:32:51.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.467+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~V33YG5906OZX.0 size=1048576 2024-09-12T18:32:51.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.471+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~V33YG5906OZX.1 size=1048576 2024-09-12T18:32:51.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.471+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~V33YG5906OZX.2 size=1018889 2024-09-12T18:32:51.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.471+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=V33YG5906OZX tag=GSWKXFSET2VR type=write size=4164617 2024-09-12T18:32:51.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.475+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~GW6T1CRVQE9Z.0 size=1048576 2024-09-12T18:32:51.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.479+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~GW6T1CRVQE9Z.1 size=1048576 2024-09-12T18:32:51.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.483+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~GW6T1CRVQE9Z.2 size=29181 2024-09-12T18:32:51.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.491+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=GW6T1CRVQE9Z tag=Z8Z29ZXWL7ZO type=write size=3174909 2024-09-12T18:32:51.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.495+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~2KUSUMLRTXT9.0 size=1048576 2024-09-12T18:32:51.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.499+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~2KUSUMLRTXT9.1 size=384914 2024-09-12T18:32:51.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.499+0000 7f41a072b8c0 1 > prepared multipart upload key=VEN0P2P1RZ2S upload=2KUSUMLRTXT9 tag=GE1476OQS1ZR type=write size=2482066 2024-09-12T18:32:51.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.503+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=ASSQNU5ZUSLV type=del 2024-09-12T18:32:51.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.511+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~PCR3YWP171D7.0 size=1048576 2024-09-12T18:32:51.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.511+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~PCR3YWP171D7.1 size=1048576 2024-09-12T18:32:51.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.515+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~PCR3YWP171D7.2 size=389301 2024-09-12T18:32:51.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.515+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=PCR3YWP171D7 tag=0H5G2KRL3WZ0 type=write size=3535029 2024-09-12T18:32:51.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.519+0000 7f41a072b8c0 1 < completed write operation key=1JIIRDVMT0B0 tag=4RWR53QY7L94 type=write size=997164 2024-09-12T18:32:51.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.523+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~9JVCVA35RAJA.0 size=1048576 2024-09-12T18:32:51.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.527+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~9JVCVA35RAJA.1 size=1048576 2024-09-12T18:32:51.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.531+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~9JVCVA35RAJA.2 size=661281 2024-09-12T18:32:51.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.531+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=9JVCVA35RAJA tag=4MLGMO7TIZ0N type=write size=3807009 2024-09-12T18:32:51.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.535+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~1PCU7M8OQTLV.0 size=1048576 2024-09-12T18:32:51.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.535+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~1PCU7M8OQTLV.1 size=1048576 2024-09-12T18:32:51.539 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.539+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~1PCU7M8OQTLV.2 size=340006 2024-09-12T18:32:51.544 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.543+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=1PCU7M8OQTLV tag=G6OKZ4ZHJWNN type=write size=3485734 2024-09-12T18:32:51.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.551+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~OZYQ8FHF99UL.0 size=1048576 2024-09-12T18:32:51.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.551+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~OZYQ8FHF99UL.1 size=1048576 2024-09-12T18:32:51.555 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.555+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~OZYQ8FHF99UL.2 size=505933 2024-09-12T18:32:51.555 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.555+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=OZYQ8FHF99UL tag=FN1SPE0KGRWG type=write size=3651661 2024-09-12T18:32:51.559 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.559+0000 7f41a072b8c0 -1 < failed to complete operation key=A6GQZL25YSNL tag=4R6NQO4NZJFK type=del size=1873559: (22) Invalid argument 2024-09-12T18:32:51.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.563+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=CP0BCWOBZB29 type=del size=1981633 2024-09-12T18:32:51.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.563+0000 7f41a072b8c0 1 < canceled operation key=295ZC54QRUPD tag=FER0E6RY26LU type=write size=665089 2024-09-12T18:32:51.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.571+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~MJ305JHMJAPC.0 size=1048576 2024-09-12T18:32:51.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.571+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~MJ305JHMJAPC.1 size=1048576 2024-09-12T18:32:51.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.575+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~MJ305JHMJAPC.2 size=632405 2024-09-12T18:32:51.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.575+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=MJ305JHMJAPC tag=V0PHLCLF9M20 type=write size=3778133 2024-09-12T18:32:51.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.579+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~CTVYDPYXU76Z.0 size=1048576 2024-09-12T18:32:51.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.583+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~CTVYDPYXU76Z.1 size=1048576 2024-09-12T18:32:51.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.583+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~CTVYDPYXU76Z.2 size=399403 2024-09-12T18:32:51.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.591+0000 7f41a072b8c0 1 < completed multipart upload key=A6GQZL25YSNL upload=CTVYDPYXU76Z tag=GWD5ESPTRN8H type=write size=3545131 2024-09-12T18:32:51.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.599+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~XOOCKVNJMJ30.0 size=218002 2024-09-12T18:32:51.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.599+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=XOOCKVNJMJ30 tag=ZUQATXO1SANE type=write size=1266578 2024-09-12T18:32:51.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.603+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=7LD4UEVSJWUC type=del 2024-09-12T18:32:51.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.607+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=020L8FGHNKK1 type=del size=2386359 2024-09-12T18:32:51.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.607+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~OEF646XI2K2L.0 size=1048576 2024-09-12T18:32:51.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.611+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~OEF646XI2K2L.1 size=1048576 2024-09-12T18:32:51.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.615+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~OEF646XI2K2L.2 size=45599 2024-09-12T18:32:51.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.619+0000 7f41a072b8c0 1 < completed multipart upload key=VEN0P2P1RZ2S upload=OEF646XI2K2L tag=SFG6B2ITZ7HL type=write size=3191327 2024-09-12T18:32:51.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.623+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~Z8ZW1VLZVHO1.0 size=1048576 2024-09-12T18:32:51.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.627+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~Z8ZW1VLZVHO1.1 size=1048576 2024-09-12T18:32:51.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.631+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~Z8ZW1VLZVHO1.2 size=8473 2024-09-12T18:32:51.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.631+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=Z8ZW1VLZVHO1 tag=639U8KSTL58N type=write size=3154201 2024-09-12T18:32:51.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.635+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=JXUBLI5T10XU type=del 2024-09-12T18:32:51.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.639+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~9XPO2E6G5FMV.0 size=1048576 2024-09-12T18:32:51.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.643+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~9XPO2E6G5FMV.1 size=766785 2024-09-12T18:32:51.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.643+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=9XPO2E6G5FMV tag=V4S8EYDX4E74 type=write size=2863937 2024-09-12T18:32:51.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.647+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~TKTK94ZXRAS1.0 size=368888 2024-09-12T18:32:51.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.651+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=TKTK94ZXRAS1 tag=WMUIYPRT6U02 type=write size=1417464 2024-09-12T18:32:51.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.655+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=4VDQ4XKCLHUK type=del size=2560041 2024-09-12T18:32:51.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.659+0000 7f41a072b8c0 1 < completed write operation key=KP2HF4J376EY tag=RCT1UIXS1MVB type=write size=742699 2024-09-12T18:32:51.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.659+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=UZ4LDJTL6Y94 type=del size=3522233 2024-09-12T18:32:51.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.663+0000 7f41a072b8c0 1 < completed write operation key=XLGVEN6DF5EW tag=8F2L6YTR5B0W type=write size=807580 2024-09-12T18:32:51.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.671+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~5CTJEL5IZ3O0.0 size=71001 2024-09-12T18:32:51.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.671+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=5CTJEL5IZ3O0 tag=ATTD9Q6M5T8V type=write size=1119577 2024-09-12T18:32:51.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.675+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~XAAO44E1G8BL.0 size=769412 2024-09-12T18:32:51.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.679+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=XAAO44E1G8BL tag=J2VIVE3W3GIE type=write size=1817988 2024-09-12T18:32:51.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.683+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=P0DK51322641 type=del size=1914734 2024-09-12T18:32:51.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.687+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=SV938GGYQB9E type=del 2024-09-12T18:32:51.690 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.691+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=7ONSXO8UAC85 type=write size=641097 2024-09-12T18:32:51.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.691+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~V33YG5906OZX.0 size=1048576 2024-09-12T18:32:51.697 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.695+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~V33YG5906OZX.1 size=1048576 2024-09-12T18:32:51.700 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.699+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~V33YG5906OZX.2 size=1018889 2024-09-12T18:32:51.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.707+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=V33YG5906OZX tag=GSWKXFSET2VR type=write size=4164617 2024-09-12T18:32:51.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.707+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=8KENQ25M7UPM type=del size=1102265 2024-09-12T18:32:51.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.711+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~2KUSUMLRTXT9.0 size=1048576 2024-09-12T18:32:51.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.715+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~2KUSUMLRTXT9.1 size=384914 2024-09-12T18:32:51.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.723+0000 7f41a072b8c0 1 < completed multipart upload key=VEN0P2P1RZ2S upload=2KUSUMLRTXT9 tag=GE1476OQS1ZR type=write size=2482066 2024-09-12T18:32:51.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.727+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~B77IHOXI2FZK.0 size=1048576 2024-09-12T18:32:51.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.731+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~B77IHOXI2FZK.1 size=1048576 2024-09-12T18:32:51.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.735+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~B77IHOXI2FZK.2 size=361583 2024-09-12T18:32:51.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.735+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=B77IHOXI2FZK tag=2QWDUBR3HTQF type=write size=3507311 2024-09-12T18:32:51.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.739+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~PCR3YWP171D7.0 size=1048576 2024-09-12T18:32:51.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.739+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~PCR3YWP171D7.1 size=1048576 2024-09-12T18:32:51.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.739+0000 7f41a072b8c0 1 < canceled part key=_multipart_NKMA8FG3V3TR.2~PCR3YWP171D7.2 size=389301 2024-09-12T18:32:51.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.743+0000 7f41a072b8c0 1 < canceled multipart upload key=NKMA8FG3V3TR upload=PCR3YWP171D7 tag=0H5G2KRL3WZ0 type=write size=3535029 2024-09-12T18:32:51.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.747+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=FKO7AABDYFO0 type=del size=1736634 2024-09-12T18:32:51.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.751+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~9JVCVA35RAJA.0 size=1048576 2024-09-12T18:32:51.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.755+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~9JVCVA35RAJA.1 size=1048576 2024-09-12T18:32:51.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.759+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~9JVCVA35RAJA.2 size=661281 2024-09-12T18:32:51.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.763+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=9JVCVA35RAJA tag=4MLGMO7TIZ0N type=write size=3807009 2024-09-12T18:32:51.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.767+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=J9S6S5H58A1F type=del size=2918376 2024-09-12T18:32:51.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.771+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~OZYQ8FHF99UL.0 size=1048576 2024-09-12T18:32:51.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.771+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~OZYQ8FHF99UL.1 size=1048576 2024-09-12T18:32:51.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.775+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~OZYQ8FHF99UL.2 size=505933 2024-09-12T18:32:51.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.779+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=OZYQ8FHF99UL tag=FN1SPE0KGRWG type=write size=3651661 2024-09-12T18:32:51.785 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.783+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=R9SLDIHK0OV8 type=del size=3194997 2024-09-12T18:32:51.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.787+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=CP0BCWOBZB29 type=del 2024-09-12T18:32:51.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.795+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~3F3ILSD5W01I.0 size=1048576 2024-09-12T18:32:51.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.799+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~3F3ILSD5W01I.1 size=1048576 2024-09-12T18:32:51.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.799+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~3F3ILSD5W01I.2 size=438612 2024-09-12T18:32:51.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.799+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=3F3ILSD5W01I tag=LPAV2Z36Y0MY type=write size=3584340 2024-09-12T18:32:51.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.803+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~MJ305JHMJAPC.0 size=1048576 2024-09-12T18:32:51.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.807+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~MJ305JHMJAPC.1 size=1048576 2024-09-12T18:32:51.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.811+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~MJ305JHMJAPC.2 size=632405 2024-09-12T18:32:51.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.815+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=MJ305JHMJAPC tag=V0PHLCLF9M20 type=write size=3778133 2024-09-12T18:32:51.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.819+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=P79AZTWQH6JL type=del size=3316179 2024-09-12T18:32:51.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.823+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~XOOCKVNJMJ30.0 size=218002 2024-09-12T18:32:51.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.827+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=XOOCKVNJMJ30 tag=ZUQATXO1SANE type=write size=1266578 2024-09-12T18:32:51.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.835+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~8I86FST10357.0 size=305528 2024-09-12T18:32:51.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.835+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=8I86FST10357 tag=DV880GLQXGV4 type=write size=1354104 2024-09-12T18:32:51.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.839+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=020L8FGHNKK1 type=del 2024-09-12T18:32:51.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.843+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~F6H1OA7OEOUD.0 size=179472 2024-09-12T18:32:51.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.843+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=F6H1OA7OEOUD tag=FY2IMFEA72Y9 type=write size=1228048 2024-09-12T18:32:51.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.847+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~Z8ZW1VLZVHO1.0 size=1048576 2024-09-12T18:32:51.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.851+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~Z8ZW1VLZVHO1.1 size=1048576 2024-09-12T18:32:51.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.851+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~Z8ZW1VLZVHO1.2 size=8473 2024-09-12T18:32:51.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.859+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=Z8ZW1VLZVHO1 tag=639U8KSTL58N type=write size=3154201 2024-09-12T18:32:51.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.863+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~3QXYMYZZ650B.0 size=1048576 2024-09-12T18:32:51.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.867+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~3QXYMYZZ650B.1 size=1048576 2024-09-12T18:32:51.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.867+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~3QXYMYZZ650B.2 size=586547 2024-09-12T18:32:51.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.867+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=3QXYMYZZ650B tag=JY1D52LBWTEI type=write size=3732275 2024-09-12T18:32:51.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.871+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~9XPO2E6G5FMV.0 size=1048576 2024-09-12T18:32:51.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.875+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~9XPO2E6G5FMV.1 size=766785 2024-09-12T18:32:51.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.879+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=9XPO2E6G5FMV tag=V4S8EYDX4E74 type=write size=2863937 2024-09-12T18:32:51.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.883+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=ZAXA65MFYJEZ type=del size=3896646 2024-09-12T18:32:51.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.887+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=4VDQ4XKCLHUK type=del 2024-09-12T18:32:51.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.887+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=G0UB6ZQKCYKR type=del size=2866245 2024-09-12T18:32:51.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.891+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=UZ4LDJTL6Y94 type=del 2024-09-12T18:32:51.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.899+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~ZDMVSAPOEGHJ.0 size=422041 2024-09-12T18:32:51.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.899+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=ZDMVSAPOEGHJ tag=UFFXJ7DRAHXJ type=write size=1470617 2024-09-12T18:32:51.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.899+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~5CTJEL5IZ3O0.0 size=71001 2024-09-12T18:32:51.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.907+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=5CTJEL5IZ3O0 tag=ATTD9Q6M5T8V type=write size=1119577 2024-09-12T18:32:51.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.907+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=TXJGOP86ND0J type=write size=528068 2024-09-12T18:32:51.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.911+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=P0DK51322641 type=del 2024-09-12T18:32:51.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.915+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=N73OM84K1C6R type=del size=2237745 2024-09-12T18:32:51.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.919+0000 7f41a072b8c0 1 < completed write operation key=0O97F5ON55TX tag=7ONSXO8UAC85 type=write size=641097 2024-09-12T18:32:51.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.923+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=31BL6MTA21FN type=del size=2649166 2024-09-12T18:32:51.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.923+0000 7f41a072b8c0 1 < completed delete operation key=1JIIRDVMT0B0 tag=8KENQ25M7UPM type=del 2024-09-12T18:32:51.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.927+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=WNWOLYZCCBZC type=del size=4165498 2024-09-12T18:32:51.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.931+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~B77IHOXI2FZK.0 size=1048576 2024-09-12T18:32:51.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.935+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~B77IHOXI2FZK.1 size=1048576 2024-09-12T18:32:51.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.935+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~B77IHOXI2FZK.2 size=361583 2024-09-12T18:32:51.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.939+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=B77IHOXI2FZK tag=2QWDUBR3HTQF type=write size=3507311 2024-09-12T18:32:51.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.943+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=22O0SFEASW4Y type=del size=1027700 2024-09-12T18:32:51.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.947+0000 7f41a072b8c0 1 < canceled operation key=KP2HF4J376EY tag=FKO7AABDYFO0 type=del size=1736634 2024-09-12T18:32:51.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.951+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=870CIO5CUN38 type=del size=1575361 2024-09-12T18:32:51.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.955+0000 7f41a072b8c0 1 < suggested remove operation key=L01GL4WOUIL2 tag=J9S6S5H58A1F type=del 2024-09-12T18:32:51.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.959+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=6UU49TDDUTJN type=del size=2834799 2024-09-12T18:32:51.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.963+0000 7f41a072b8c0 1 < suggested update operation key=0O97F5ON55TX tag=R9SLDIHK0OV8 type=del size=3194997 2024-09-12T18:32:51.967 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.967+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=48WT4E26FM2S type=del size=1693063 2024-09-12T18:32:51.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.967+0000 7f41a072b8c0 1 < canceled part key=_multipart_YCBC1CHWJQC5.2~3F3ILSD5W01I.0 size=1048576 2024-09-12T18:32:51.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.971+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~3F3ILSD5W01I.1 size=1048576 2024-09-12T18:32:51.972 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.971+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~3F3ILSD5W01I.2 size=438612 2024-09-12T18:32:51.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.975+0000 7f41a072b8c0 1 < canceled multipart upload key=YCBC1CHWJQC5 upload=3F3ILSD5W01I tag=LPAV2Z36Y0MY type=write size=3584340 2024-09-12T18:32:51.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.979+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=Y3MM3NA695P4 type=del size=908022 2024-09-12T18:32:51.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.983+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=P79AZTWQH6JL type=del 2024-09-12T18:32:51.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.983+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=NYGT3KB6V1UJ type=write size=875268 2024-09-12T18:32:51.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.987+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~8I86FST10357.0 size=305528 2024-09-12T18:32:51.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.991+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=8I86FST10357 tag=DV880GLQXGV4 type=write size=1354104 2024-09-12T18:32:51.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.995+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=Q5XZ8JNBMOYL type=del size=108568 2024-09-12T18:32:51.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:51.999+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~F6H1OA7OEOUD.0 size=179472 2024-09-12T18:32:52.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.003+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=F6H1OA7OEOUD tag=FY2IMFEA72Y9 type=write size=1228048 2024-09-12T18:32:52.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.007+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=05KB8PWLFBHD type=del size=3774418 2024-09-12T18:32:52.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.011+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~3QXYMYZZ650B.0 size=1048576 2024-09-12T18:32:52.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.011+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~3QXYMYZZ650B.1 size=1048576 2024-09-12T18:32:52.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.015+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~3QXYMYZZ650B.2 size=586547 2024-09-12T18:32:52.021 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.019+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=3QXYMYZZ650B tag=JY1D52LBWTEI type=write size=3732275 2024-09-12T18:32:52.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.023+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=EWRIEA5780ZI type=del size=786894 2024-09-12T18:32:52.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.027+0000 7f41a072b8c0 1 < canceled operation key=C2PRRD3QO9AF tag=ZAXA65MFYJEZ type=del size=3896646 2024-09-12T18:32:52.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.031+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~MHC05GK6ODBX.0 size=919602 2024-09-12T18:32:52.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.031+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=MHC05GK6ODBX tag=0FCFURGKWH86 type=write size=1968178 2024-09-12T18:32:52.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.039+0000 7f41a072b8c0 1 < suggested remove operation key=7B70QWGMH0C0 tag=G0UB6ZQKCYKR type=del 2024-09-12T18:32:52.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.043+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=JDVNO9OSJK73 type=write size=278358 2024-09-12T18:32:52.047 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.047+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~ZDMVSAPOEGHJ.0 size=422041 2024-09-12T18:32:52.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.051+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=ZDMVSAPOEGHJ tag=UFFXJ7DRAHXJ type=write size=1470617 2024-09-12T18:32:52.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.055+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=93BGE5W732F8 type=del size=2089303 2024-09-12T18:32:52.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.055+0000 7f41a072b8c0 1 < completed write operation key=YP72VTCGSHYE tag=TXJGOP86ND0J type=write size=528068 2024-09-12T18:32:52.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.059+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=QACG607V2KEV type=del size=2291755 2024-09-12T18:32:52.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.063+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=N73OM84K1C6R type=del 2024-09-12T18:32:52.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.067+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=LT4E0LLIZJ8L type=write size=244199 2024-09-12T18:32:52.070 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.067+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=31BL6MTA21FN type=del 2024-09-12T18:32:52.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.075+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~AFYV7CRL7DZR.0 size=1048576 2024-09-12T18:32:52.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.079+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~AFYV7CRL7DZR.1 size=805359 2024-09-12T18:32:52.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.079+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=AFYV7CRL7DZR tag=1Y8HZVJAGFKF type=write size=2902511 2024-09-12T18:32:52.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.079+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=WNWOLYZCCBZC type=del 2024-09-12T18:32:52.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.087+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=VC024A9940Q5 type=del size=2871054 2024-09-12T18:32:52.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.091+0000 7f41a072b8c0 1 < suggested update operation key=YCBC1CHWJQC5 tag=22O0SFEASW4Y type=del size=1027700 2024-09-12T18:32:52.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.099+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~3A5DW11TQTLP.0 size=1048576 2024-09-12T18:32:52.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.103+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~3A5DW11TQTLP.1 size=1048576 2024-09-12T18:32:52.106 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.103+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~3A5DW11TQTLP.2 size=374521 2024-09-12T18:32:52.106 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.103+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=3A5DW11TQTLP tag=RV1ZYMJHSX6Q type=write size=3520249 2024-09-12T18:32:52.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.107+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=870CIO5CUN38 type=del 2024-09-12T18:32:52.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.111+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=R31OYG1R8URH type=del size=3518728 2024-09-12T18:32:52.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.115+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=6UU49TDDUTJN type=del 2024-09-12T18:32:52.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.119+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~7AZTPKH926HD.0 size=910490 2024-09-12T18:32:52.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.119+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=7AZTPKH926HD tag=BWQJYVESGDC1 type=write size=1959066 2024-09-12T18:32:52.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.123+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=48WT4E26FM2S type=del 2024-09-12T18:32:52.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.127+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=2KHS0NSPEV5X type=del size=1039471 2024-09-12T18:32:52.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.135+0000 7f41a072b8c0 1 < suggested update operation key=KP2HF4J376EY tag=Y3MM3NA695P4 type=del size=908022 2024-09-12T18:32:52.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.139+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=SVG9YSZVCMBC type=del size=2277608 2024-09-12T18:32:52.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.143+0000 7f41a072b8c0 1 < completed write operation key=GA6P1FACU2EQ tag=NYGT3KB6V1UJ type=write size=875268 2024-09-12T18:32:52.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.147+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=5OZPY4UPKFSN type=del size=2609383 2024-09-12T18:32:52.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.147+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=Q5XZ8JNBMOYL type=del 2024-09-12T18:32:52.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.151+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=JPZFS0BC0DYZ type=del size=1009575 2024-09-12T18:32:52.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.155+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=05KB8PWLFBHD type=del 2024-09-12T18:32:52.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.163+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~A43PKNOYKX3B.0 size=1020080 2024-09-12T18:32:52.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.163+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=A43PKNOYKX3B tag=YE6PRJZB3QY0 type=write size=2068656 2024-09-12T18:32:52.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.167+0000 7f41a072b8c0 1 < suggested update operation key=C2PRRD3QO9AF tag=EWRIEA5780ZI type=del size=786894 2024-09-12T18:32:52.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.171+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=Z0LI9OP2TOGJ type=write size=907014 2024-09-12T18:32:52.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.175+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~MHC05GK6ODBX.0 size=919602 2024-09-12T18:32:52.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.179+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=MHC05GK6ODBX tag=0FCFURGKWH86 type=write size=1968178 2024-09-12T18:32:52.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.183+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=0DFZADTAM5YP type=del size=1422603 2024-09-12T18:32:52.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.183+0000 7f41a072b8c0 1 < completed write operation key=1JIIRDVMT0B0 tag=JDVNO9OSJK73 type=write size=278358 2024-09-12T18:32:52.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.187+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=9W335QOWVWOL type=del size=2161757 2024-09-12T18:32:52.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.191+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=93BGE5W732F8 type=del 2024-09-12T18:32:52.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.195+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=TCCNYZME48IH type=del size=1898277 2024-09-12T18:32:52.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.199+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=QACG607V2KEV type=del 2024-09-12T18:32:52.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.203+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~E1N2EC7D0S4R.0 size=706230 2024-09-12T18:32:52.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.203+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=E1N2EC7D0S4R tag=F8Q468KZF9GJ type=write size=1754806 2024-09-12T18:32:52.207 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.207+0000 7f41a072b8c0 1 < completed write operation key=31T6AP6MUBKL tag=LT4E0LLIZJ8L type=write size=244199 2024-09-12T18:32:52.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.211+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=EQM88B68ZQ0Z type=del size=3726321 2024-09-12T18:32:52.214 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.215+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~AFYV7CRL7DZR.0 size=1048576 2024-09-12T18:32:52.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.215+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~AFYV7CRL7DZR.1 size=805359 2024-09-12T18:32:52.222 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.223+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=AFYV7CRL7DZR tag=1Y8HZVJAGFKF type=write size=2902511 2024-09-12T18:32:52.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.223+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=NSRVJ8GZ69MY type=del size=3572765 2024-09-12T18:32:52.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.227+0000 7f41a072b8c0 -1 < failed to complete operation key=C2PRRD3QO9AF tag=VC024A9940Q5 type=del size=2871054: (22) Invalid argument 2024-09-12T18:32:52.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.231+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=MX6JCCOV0T1L type=del size=229871 2024-09-12T18:32:52.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.235+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~3A5DW11TQTLP.0 size=1048576 2024-09-12T18:32:52.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.239+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~3A5DW11TQTLP.1 size=1048576 2024-09-12T18:32:52.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.243+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~3A5DW11TQTLP.2 size=374521 2024-09-12T18:32:52.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.247+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=3A5DW11TQTLP tag=RV1ZYMJHSX6Q type=write size=3520249 2024-09-12T18:32:52.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.251+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=1MDQQ8E669CV type=write size=932726 2024-09-12T18:32:52.258 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.259+0000 7f41a072b8c0 1 < suggested remove operation key=GQHPUDV5BG1E tag=R31OYG1R8URH type=del 2024-09-12T18:32:52.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.263+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~DJE7RI72SL49.0 size=179118 2024-09-12T18:32:52.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.263+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=DJE7RI72SL49 tag=0A3HQD3D87Z0 type=write size=1227694 2024-09-12T18:32:52.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.267+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~7AZTPKH926HD.0 size=910490 2024-09-12T18:32:52.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.275+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=7AZTPKH926HD tag=BWQJYVESGDC1 type=write size=1959066 2024-09-12T18:32:52.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.279+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~OJ3HUJFI8GMF.0 size=1048576 2024-09-12T18:32:52.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.283+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~OJ3HUJFI8GMF.1 size=1048576 2024-09-12T18:32:52.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.287+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~OJ3HUJFI8GMF.2 size=62963 2024-09-12T18:32:52.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.287+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=OJ3HUJFI8GMF tag=DY3476UHNB3I type=write size=3208691 2024-09-12T18:32:52.290 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.287+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=2KHS0NSPEV5X type=del 2024-09-12T18:32:52.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.291+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=BZ1LASGYESVT type=write size=672588 2024-09-12T18:32:52.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.295+0000 7f41a072b8c0 1 < completed delete operation key=1JIIRDVMT0B0 tag=SVG9YSZVCMBC type=del 2024-09-12T18:32:52.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.299+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=9I47T6M5BAC7 type=del size=2899680 2024-09-12T18:32:52.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.303+0000 7f41a072b8c0 1 < completed delete operation key=NKMA8FG3V3TR tag=5OZPY4UPKFSN type=del 2024-09-12T18:32:52.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.311+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~XDS2N60CAKQF.0 size=1048576 2024-09-12T18:32:52.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.311+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~XDS2N60CAKQF.1 size=1048576 2024-09-12T18:32:52.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.315+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~XDS2N60CAKQF.2 size=568431 2024-09-12T18:32:52.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.315+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=XDS2N60CAKQF tag=SKIO6VCVT02B type=write size=3714159 2024-09-12T18:32:52.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.319+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=JPZFS0BC0DYZ type=del 2024-09-12T18:32:52.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.323+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=T5I34WCJ5JWW type=del size=2922242 2024-09-12T18:32:52.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.327+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~A43PKNOYKX3B.0 size=1020080 2024-09-12T18:32:52.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.331+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=A43PKNOYKX3B tag=YE6PRJZB3QY0 type=write size=2068656 2024-09-12T18:32:52.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.335+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=Z8ZVTNPGYQJB type=del size=129661 2024-09-12T18:32:52.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.339+0000 7f41a072b8c0 1 < completed write operation key=0O97F5ON55TX tag=Z0LI9OP2TOGJ type=write size=907014 2024-09-12T18:32:52.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.343+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=J9DKPWODO79F type=del size=3507420 2024-09-12T18:32:52.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.347+0000 7f41a072b8c0 1 < suggested update operation key=C2PRRD3QO9AF tag=0DFZADTAM5YP type=del size=1422603 2024-09-12T18:32:52.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.351+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=U7DET7L7K19Z type=del size=613710 2024-09-12T18:32:52.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.355+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=9W335QOWVWOL type=del 2024-09-12T18:32:52.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.359+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=YTXLNTPAVYW4 type=write size=128404 2024-09-12T18:32:52.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.363+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=TCCNYZME48IH type=del 2024-09-12T18:32:52.367 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.367+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=AUIJ5XKQ9SZJ type=del size=782226 2024-09-12T18:32:52.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.371+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~E1N2EC7D0S4R.0 size=706230 2024-09-12T18:32:52.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.375+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=E1N2EC7D0S4R tag=F8Q468KZF9GJ type=write size=1754806 2024-09-12T18:32:52.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.379+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=70JZS0HWCJ1S type=write size=825706 2024-09-12T18:32:52.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.383+0000 7f41a072b8c0 1 < suggested remove operation key=5OD9IX408CYO tag=EQM88B68ZQ0Z type=del 2024-09-12T18:32:52.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.387+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=KSGVT3EZCED9 type=del size=3453715 2024-09-12T18:32:52.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.391+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=NSRVJ8GZ69MY type=del 2024-09-12T18:32:52.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.395+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~IR2XTBOIVAAL.0 size=1048576 2024-09-12T18:32:52.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.399+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~IR2XTBOIVAAL.1 size=1048576 2024-09-12T18:32:52.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.403+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~IR2XTBOIVAAL.2 size=907502 2024-09-12T18:32:52.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.403+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=IR2XTBOIVAAL tag=KPHKL3033HKM type=write size=4053230 2024-09-12T18:32:52.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.411+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=MX6JCCOV0T1L type=del 2024-09-12T18:32:52.416 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.415+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~WH87OOS1V0GW.0 size=1048576 2024-09-12T18:32:52.418 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.419+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~WH87OOS1V0GW.1 size=1048576 2024-09-12T18:32:52.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.419+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~WH87OOS1V0GW.2 size=143161 2024-09-12T18:32:52.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.419+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=WH87OOS1V0GW tag=OGMUL8HUTYLX type=write size=3288889 2024-09-12T18:32:52.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.427+0000 7f41a072b8c0 1 < suggested update operation key=GA6P1FACU2EQ tag=1MDQQ8E669CV type=write size=932726 2024-09-12T18:32:52.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.431+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=50JLIEQKES7W type=del size=3218366 2024-09-12T18:32:52.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.435+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~DJE7RI72SL49.0 size=179118 2024-09-12T18:32:52.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.439+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=DJE7RI72SL49 tag=0A3HQD3D87Z0 type=write size=1227694 2024-09-12T18:32:52.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.443+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=6R431XHMX5CA type=del size=2331821 2024-09-12T18:32:52.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.443+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~OJ3HUJFI8GMF.0 size=1048576 2024-09-12T18:32:52.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.443+0000 7f41a072b8c0 1 < canceled part key=_multipart_7B70QWGMH0C0.2~OJ3HUJFI8GMF.1 size=1048576 2024-09-12T18:32:52.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.447+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~OJ3HUJFI8GMF.2 size=62963 2024-09-12T18:32:52.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.451+0000 7f41a072b8c0 1 < canceled multipart upload key=7B70QWGMH0C0 upload=OJ3HUJFI8GMF tag=DY3476UHNB3I type=write size=3208691 2024-09-12T18:32:52.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.459+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~HVFXC0ROUPSA.0 size=398798 2024-09-12T18:32:52.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.459+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=HVFXC0ROUPSA tag=54XQ3ERSNKB7 type=write size=1447374 2024-09-12T18:32:52.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.459+0000 7f41a072b8c0 1 < completed write operation key=7B70QWGMH0C0 tag=BZ1LASGYESVT type=write size=672588 2024-09-12T18:32:52.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.463+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=NUNJ45KP8WHF type=write size=742160 2024-09-12T18:32:52.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.467+0000 7f41a072b8c0 1 < canceled operation key=5JUWC8RXSA5L tag=9I47T6M5BAC7 type=del size=2899680 2024-09-12T18:32:52.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.475+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~39A0GH2ZTGDK.0 size=1048576 2024-09-12T18:32:52.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.475+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~39A0GH2ZTGDK.1 size=1048576 2024-09-12T18:32:52.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.479+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~39A0GH2ZTGDK.2 size=443758 2024-09-12T18:32:52.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.479+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=39A0GH2ZTGDK tag=XCDLT6YUY7PM type=write size=3589486 2024-09-12T18:32:52.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.483+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~XDS2N60CAKQF.0 size=1048576 2024-09-12T18:32:52.485 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.483+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~XDS2N60CAKQF.1 size=1048576 2024-09-12T18:32:52.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.487+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~XDS2N60CAKQF.2 size=568431 2024-09-12T18:32:52.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.491+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=XDS2N60CAKQF tag=SKIO6VCVT02B type=write size=3714159 2024-09-12T18:32:52.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.495+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=B0UT5RAGWA9M type=write size=636099 2024-09-12T18:32:52.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.499+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=T5I34WCJ5JWW type=del 2024-09-12T18:32:52.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~DWMEI4EYUQ7M.0 size=1048576 2024-09-12T18:32:52.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~DWMEI4EYUQ7M.1 size=1048576 2024-09-12T18:32:52.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.511+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~DWMEI4EYUQ7M.2 size=207030 2024-09-12T18:32:52.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.511+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=DWMEI4EYUQ7M tag=5OO098IU5ZWQ type=write size=3352758 2024-09-12T18:32:52.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.515+0000 7f41a072b8c0 1 < completed delete operation key=NKMA8FG3V3TR tag=Z8ZVTNPGYQJB type=del 2024-09-12T18:32:52.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.515+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=ST7OLH2F2HSB type=write size=889706 2024-09-12T18:32:52.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.523+0000 7f41a072b8c0 1 < suggested update operation key=ZACT36ZOC9ES tag=J9DKPWODO79F type=del size=3507420 2024-09-12T18:32:52.527 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.527+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=BKZC0SF836C8 type=del size=1068778 2024-09-12T18:32:52.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.531+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=U7DET7L7K19Z type=del 2024-09-12T18:32:52.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.535+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=6K8L18UWWMCW type=del size=3441050 2024-09-12T18:32:52.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.535+0000 7f41a072b8c0 1 < completed write operation key=58IT2R988AW9 tag=YTXLNTPAVYW4 type=write size=128404 2024-09-12T18:32:52.544 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.543+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~3SLT5XNI511T.0 size=1048576 2024-09-12T18:32:52.547 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.547+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~3SLT5XNI511T.1 size=1048576 2024-09-12T18:32:52.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.547+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~3SLT5XNI511T.2 size=279061 2024-09-12T18:32:52.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.547+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=3SLT5XNI511T tag=IB6GBMEY1GH3 type=write size=3424789 2024-09-12T18:32:52.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.551+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=AUIJ5XKQ9SZJ type=del 2024-09-12T18:32:52.559 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.559+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~7Q0P8HM2ICOY.0 size=1048576 2024-09-12T18:32:52.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.559+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~7Q0P8HM2ICOY.1 size=1048576 2024-09-12T18:32:52.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.563+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~7Q0P8HM2ICOY.2 size=91942 2024-09-12T18:32:52.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.563+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=7Q0P8HM2ICOY tag=TTT4RG6PXAAM type=write size=3237670 2024-09-12T18:32:52.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.567+0000 7f41a072b8c0 1 < completed write operation key=7MRN7L1DTAMO tag=70JZS0HWCJ1S type=write size=825706 2024-09-12T18:32:52.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.571+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=O4RYTN0GL59E type=del size=1349720 2024-09-12T18:32:52.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.575+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=KSGVT3EZCED9 type=del 2024-09-12T18:32:52.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.579+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=0PS0NXIXD74T type=del size=2984315 2024-09-12T18:32:52.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.579+0000 7f41a072b8c0 1 < canceled part key=_multipart_SK3T82EJFZXE.2~IR2XTBOIVAAL.0 size=1048576 2024-09-12T18:32:52.582 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.579+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~IR2XTBOIVAAL.1 size=1048576 2024-09-12T18:32:52.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.583+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~IR2XTBOIVAAL.2 size=907502 2024-09-12T18:32:52.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.591+0000 7f41a072b8c0 1 < canceled multipart upload key=SK3T82EJFZXE upload=IR2XTBOIVAAL tag=KPHKL3033HKM type=write size=4053230 2024-09-12T18:32:52.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.591+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=XTI4F4LCE9Q3 type=del size=3916964 2024-09-12T18:32:52.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.595+0000 7f41a072b8c0 1 < canceled part key=_multipart_295ZC54QRUPD.2~WH87OOS1V0GW.0 size=1048576 2024-09-12T18:32:52.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.595+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~WH87OOS1V0GW.1 size=1048576 2024-09-12T18:32:52.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.595+0000 7f41a072b8c0 1 < canceled part key=_multipart_295ZC54QRUPD.2~WH87OOS1V0GW.2 size=143161 2024-09-12T18:32:52.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.603+0000 7f41a072b8c0 1 < canceled multipart upload key=295ZC54QRUPD upload=WH87OOS1V0GW tag=OGMUL8HUTYLX type=write size=3288889 2024-09-12T18:32:52.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.607+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=KKXN0G4V5M2X type=del size=2051842 2024-09-12T18:32:52.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.607+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=50JLIEQKES7W type=del 2024-09-12T18:32:52.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.611+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=AN8L0VJYI6K9 type=del size=3273784 2024-09-12T18:32:52.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.615+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=6R431XHMX5CA type=del 2024-09-12T18:32:52.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.623+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~X2LQRUF9Q8ZD.0 size=1048576 2024-09-12T18:32:52.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.623+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~X2LQRUF9Q8ZD.1 size=1048576 2024-09-12T18:32:52.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.627+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~X2LQRUF9Q8ZD.2 size=358372 2024-09-12T18:32:52.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.627+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=X2LQRUF9Q8ZD tag=AMEGN4IJLSS9 type=write size=3504100 2024-09-12T18:32:52.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.631+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~HVFXC0ROUPSA.0 size=398798 2024-09-12T18:32:52.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.635+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=HVFXC0ROUPSA tag=54XQ3ERSNKB7 type=write size=1447374 2024-09-12T18:32:52.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.639+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~4JHHVHCVEEUK.0 size=1048576 2024-09-12T18:32:52.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.643+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~4JHHVHCVEEUK.1 size=1048576 2024-09-12T18:32:52.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.643+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~4JHHVHCVEEUK.2 size=615392 2024-09-12T18:32:52.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.643+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=4JHHVHCVEEUK tag=H8LF4GD2GIJ0 type=write size=3761120 2024-09-12T18:32:52.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.647+0000 7f41a072b8c0 1 < completed write operation key=YCBC1CHWJQC5 tag=NUNJ45KP8WHF type=write size=742160 2024-09-12T18:32:52.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.651+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~583B59939GZ8.0 size=986651 2024-09-12T18:32:52.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.651+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=583B59939GZ8 tag=7FRAECA0T493 type=write size=2035227 2024-09-12T18:32:52.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.655+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~39A0GH2ZTGDK.0 size=1048576 2024-09-12T18:32:52.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.659+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~39A0GH2ZTGDK.1 size=1048576 2024-09-12T18:32:52.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.663+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~39A0GH2ZTGDK.2 size=443758 2024-09-12T18:32:52.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.667+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=39A0GH2ZTGDK tag=XCDLT6YUY7PM type=write size=3589486 2024-09-12T18:32:52.672 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.671+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=N6CDVZ7FZ02L type=del size=1489886 2024-09-12T18:32:52.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.675+0000 7f41a072b8c0 1 < completed write operation key=3CGBX19WTMWQ tag=B0UT5RAGWA9M type=write size=636099 2024-09-12T18:32:52.681 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.679+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~F3YPGQWXQBOU.0 size=1048576 2024-09-12T18:32:52.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.683+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~F3YPGQWXQBOU.1 size=1048576 2024-09-12T18:32:52.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.683+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~F3YPGQWXQBOU.2 size=499221 2024-09-12T18:32:52.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.683+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=F3YPGQWXQBOU tag=VGE84QHFAUKG type=write size=3644949 2024-09-12T18:32:52.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.687+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~DWMEI4EYUQ7M.0 size=1048576 2024-09-12T18:32:52.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.691+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~DWMEI4EYUQ7M.1 size=1048576 2024-09-12T18:32:52.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.695+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~DWMEI4EYUQ7M.2 size=207030 2024-09-12T18:32:52.700 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.699+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=DWMEI4EYUQ7M tag=5OO098IU5ZWQ type=write size=3352758 2024-09-12T18:32:52.703 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.703+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=AYAHMUJXZ3MT type=write size=942844 2024-09-12T18:32:52.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.707+0000 7f41a072b8c0 1 < completed write operation key=58IT2R988AW9 tag=ST7OLH2F2HSB type=write size=889706 2024-09-12T18:32:52.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.715+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~1K4CIV5P2VJP.0 size=572522 2024-09-12T18:32:52.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.715+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=1K4CIV5P2VJP tag=KABDZFGCIG19 type=write size=1621098 2024-09-12T18:32:52.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.723+0000 7f41a072b8c0 1 < suggested remove operation key=KP2HF4J376EY tag=BKZC0SF836C8 type=del 2024-09-12T18:32:52.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.727+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=D2RYGL0O12C7 type=del size=2398509 2024-09-12T18:32:52.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.731+0000 7f41a072b8c0 1 < suggested remove operation key=YP72VTCGSHYE tag=6K8L18UWWMCW type=del 2024-09-12T18:32:52.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.735+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=PVA95HVB12I7 type=del size=2966912 2024-09-12T18:32:52.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.739+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~3SLT5XNI511T.0 size=1048576 2024-09-12T18:32:52.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.743+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~3SLT5XNI511T.1 size=1048576 2024-09-12T18:32:52.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.743+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~3SLT5XNI511T.2 size=279061 2024-09-12T18:32:52.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.751+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=3SLT5XNI511T tag=IB6GBMEY1GH3 type=write size=3424789 2024-09-12T18:32:52.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.755+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~D12L1HUFSPTM.0 size=11810 2024-09-12T18:32:52.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.755+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=D12L1HUFSPTM tag=ASQBYJTXGWTN type=write size=1060386 2024-09-12T18:32:52.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.759+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~7Q0P8HM2ICOY.0 size=1048576 2024-09-12T18:32:52.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.763+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~7Q0P8HM2ICOY.1 size=1048576 2024-09-12T18:32:52.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.763+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~7Q0P8HM2ICOY.2 size=91942 2024-09-12T18:32:52.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.771+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=7Q0P8HM2ICOY tag=TTT4RG6PXAAM type=write size=3237670 2024-09-12T18:32:52.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.775+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~Q23VDUIYJ85G.0 size=1048576 2024-09-12T18:32:52.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.779+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~Q23VDUIYJ85G.1 size=1048576 2024-09-12T18:32:52.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.779+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~Q23VDUIYJ85G.2 size=618509 2024-09-12T18:32:52.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.779+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=Q23VDUIYJ85G tag=YTX0V60MQ6JG type=write size=3764237 2024-09-12T18:32:52.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.787+0000 7f41a072b8c0 1 < suggested remove operation key=L01GL4WOUIL2 tag=O4RYTN0GL59E type=del 2024-09-12T18:32:52.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.787+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=LR2CMLIX9WMC type=del size=2372777 2024-09-12T18:32:52.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.791+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=0PS0NXIXD74T type=del 2024-09-12T18:32:52.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.795+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=FIQWI6FJ12SF type=del size=1768312 2024-09-12T18:32:52.798 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.799+0000 7f41a072b8c0 -1 < failed to complete operation key=L01GL4WOUIL2 tag=XTI4F4LCE9Q3 type=del size=3916964: (22) Invalid argument 2024-09-12T18:32:52.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.799+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=SIPZ9OLDIJYQ type=del size=2078486 2024-09-12T18:32:52.804 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.803+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=KKXN0G4V5M2X type=del 2024-09-12T18:32:52.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.807+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~OEAHXRSPASKD.0 size=132026 2024-09-12T18:32:52.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.807+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=OEAHXRSPASKD tag=E090MU8OPMPK type=write size=1180602 2024-09-12T18:32:52.812 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.811+0000 7f41a072b8c0 -1 < failed to complete operation key=L01GL4WOUIL2 tag=AN8L0VJYI6K9 type=del size=3273784: (22) Invalid argument 2024-09-12T18:32:52.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.815+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=ZAYS1GXW3MW8 type=del size=270960 2024-09-12T18:32:52.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.815+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~X2LQRUF9Q8ZD.0 size=1048576 2024-09-12T18:32:52.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.819+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~X2LQRUF9Q8ZD.1 size=1048576 2024-09-12T18:32:52.822 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.819+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~X2LQRUF9Q8ZD.2 size=358372 2024-09-12T18:32:52.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.827+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=X2LQRUF9Q8ZD tag=AMEGN4IJLSS9 type=write size=3504100 2024-09-12T18:32:52.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.827+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=7CB96TV7NA3Z type=del size=2824467 2024-09-12T18:32:52.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.831+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~4JHHVHCVEEUK.0 size=1048576 2024-09-12T18:32:52.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.835+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~4JHHVHCVEEUK.1 size=1048576 2024-09-12T18:32:52.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.839+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~4JHHVHCVEEUK.2 size=615392 2024-09-12T18:32:52.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.843+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=4JHHVHCVEEUK tag=H8LF4GD2GIJ0 type=write size=3761120 2024-09-12T18:32:52.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.843+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=7V9QDTTB6LH8 type=write size=459327 2024-09-12T18:32:52.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.847+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~583B59939GZ8.0 size=986651 2024-09-12T18:32:52.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.851+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=583B59939GZ8 tag=7FRAECA0T493 type=write size=2035227 2024-09-12T18:32:52.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.855+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=JQGH6EZIDDIU type=del size=1024694 2024-09-12T18:32:52.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.859+0000 7f41a072b8c0 1 < canceled operation key=31T6AP6MUBKL tag=N6CDVZ7FZ02L type=del size=1489886 2024-09-12T18:32:52.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.863+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=XXOHRJV77HWO type=del size=3271353 2024-09-12T18:32:52.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.863+0000 7f41a072b8c0 1 < canceled part key=_multipart_GQHPUDV5BG1E.2~F3YPGQWXQBOU.0 size=1048576 2024-09-12T18:32:52.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.867+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~F3YPGQWXQBOU.1 size=1048576 2024-09-12T18:32:52.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.867+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~F3YPGQWXQBOU.2 size=499221 2024-09-12T18:32:52.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.875+0000 7f41a072b8c0 1 < canceled multipart upload key=GQHPUDV5BG1E upload=F3YPGQWXQBOU tag=VGE84QHFAUKG type=write size=3644949 2024-09-12T18:32:52.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.879+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~MUCXV5RWSJBT.0 size=695696 2024-09-12T18:32:52.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.879+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=MUCXV5RWSJBT tag=PGB21ECVW2CG type=write size=1744272 2024-09-12T18:32:52.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.883+0000 7f41a072b8c0 1 < completed write operation key=7MRN7L1DTAMO tag=AYAHMUJXZ3MT type=write size=942844 2024-09-12T18:32:52.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.887+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=2BN2XIGAT7OT type=del size=2380092 2024-09-12T18:32:52.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.891+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~1K4CIV5P2VJP.0 size=572522 2024-09-12T18:32:52.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.895+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=1K4CIV5P2VJP tag=KABDZFGCIG19 type=write size=1621098 2024-09-12T18:32:52.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.899+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=JFFGS90J1NEN type=del size=3846249 2024-09-12T18:32:52.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.903+0000 7f41a072b8c0 1 < suggested remove operation key=1BSAN5TRTZNZ tag=D2RYGL0O12C7 type=del 2024-09-12T18:32:52.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.911+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~YDVV2WYGY717.0 size=1048576 2024-09-12T18:32:52.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.911+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~YDVV2WYGY717.1 size=1048576 2024-09-12T18:32:52.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.915+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~YDVV2WYGY717.2 size=141980 2024-09-12T18:32:52.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.915+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=YDVV2WYGY717 tag=EYBJ20VTBRRJ type=write size=3287708 2024-09-12T18:32:52.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.919+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=PVA95HVB12I7 type=del 2024-09-12T18:32:52.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.919+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=U8RVPHOSM2LE type=del size=3467787 2024-09-12T18:32:52.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.923+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~D12L1HUFSPTM.0 size=11810 2024-09-12T18:32:52.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.931+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=D12L1HUFSPTM tag=ASQBYJTXGWTN type=write size=1060386 2024-09-12T18:32:52.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.931+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=OVYFFB6ASUNK type=del size=834593 2024-09-12T18:32:52.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.935+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~Q23VDUIYJ85G.0 size=1048576 2024-09-12T18:32:52.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.939+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~Q23VDUIYJ85G.1 size=1048576 2024-09-12T18:32:52.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.943+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~Q23VDUIYJ85G.2 size=618509 2024-09-12T18:32:52.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.947+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=Q23VDUIYJ85G tag=YTX0V60MQ6JG type=write size=3764237 2024-09-12T18:32:52.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.955+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~M8H1SU90BTGG.0 size=330155 2024-09-12T18:32:52.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.955+0000 7f41a072b8c0 1 > prepared multipart upload key=VEN0P2P1RZ2S upload=M8H1SU90BTGG tag=I22A72WYP5ZU type=write size=1378731 2024-09-12T18:32:52.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.955+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=LR2CMLIX9WMC type=del 2024-09-12T18:32:52.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.963+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~3QR4B4QZ7GAX.0 size=78107 2024-09-12T18:32:52.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.963+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=3QR4B4QZ7GAX tag=OAWAAFTKB3PP type=write size=1126683 2024-09-12T18:32:52.967 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.967+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=FIQWI6FJ12SF type=del 2024-09-12T18:32:52.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.967+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=RXS9IVMUAIRG type=del size=4182604 2024-09-12T18:32:52.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.971+0000 7f41a072b8c0 1 < completed delete operation key=NKMA8FG3V3TR tag=SIPZ9OLDIJYQ type=del 2024-09-12T18:32:52.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.975+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=3FD2CKKAQGM9 type=del size=2447924 2024-09-12T18:32:52.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.979+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~OEAHXRSPASKD.0 size=132026 2024-09-12T18:32:52.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.983+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=OEAHXRSPASKD tag=E090MU8OPMPK type=write size=1180602 2024-09-12T18:32:52.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.987+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~ZTRP2MZR6G7A.0 size=652899 2024-09-12T18:32:52.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.987+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=ZTRP2MZR6G7A tag=FK1WO37VK1RE type=write size=1701475 2024-09-12T18:32:52.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.991+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=ZAYS1GXW3MW8 type=del 2024-09-12T18:32:52.998 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.995+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~VV8OJUCZ8CCE.0 size=1048576 2024-09-12T18:32:53.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.999+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~VV8OJUCZ8CCE.1 size=248142 2024-09-12T18:32:53.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:52.999+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=VV8OJUCZ8CCE tag=13ZTC2FJNZHD type=write size=2345294 2024-09-12T18:32:53.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.003+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=7CB96TV7NA3Z type=del 2024-09-12T18:32:53.005 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.003+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=L5QTKTC93TJ7 type=del size=722517 2024-09-12T18:32:53.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.007+0000 7f41a072b8c0 1 < completed write operation key=295ZC54QRUPD tag=7V9QDTTB6LH8 type=write size=459327 2024-09-12T18:32:53.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.011+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=DA4Z7WPTJZ6H type=del size=1883556 2024-09-12T18:32:53.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.011+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=JQGH6EZIDDIU type=del 2024-09-12T18:32:53.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.015+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=J2T17B0USO6F type=write size=362601 2024-09-12T18:32:53.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.019+0000 7f41a072b8c0 1 < suggested update operation key=58IT2R988AW9 tag=XXOHRJV77HWO type=del size=3271353 2024-09-12T18:32:53.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.023+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=57UJV4NQU329 type=del size=1868541 2024-09-12T18:32:53.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.027+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~MUCXV5RWSJBT.0 size=695696 2024-09-12T18:32:53.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.031+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=MUCXV5RWSJBT tag=PGB21ECVW2CG type=write size=1744272 2024-09-12T18:32:53.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.035+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=D0YR4O5R06AL type=del size=2151082 2024-09-12T18:32:53.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.035+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=2BN2XIGAT7OT type=del 2024-09-12T18:32:53.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.039+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=AJMU760M37BS type=write size=995262 2024-09-12T18:32:53.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.043+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=JFFGS90J1NEN type=del 2024-09-12T18:32:53.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.047+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=X63PRZZPDWOB type=write size=120170 2024-09-12T18:32:53.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.047+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~YDVV2WYGY717.0 size=1048576 2024-09-12T18:32:53.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.051+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~YDVV2WYGY717.1 size=1048576 2024-09-12T18:32:53.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.051+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~YDVV2WYGY717.2 size=141980 2024-09-12T18:32:53.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.059+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=YDVV2WYGY717 tag=EYBJ20VTBRRJ type=write size=3287708 2024-09-12T18:32:53.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.059+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=3RUG9P2NH8M9 type=del size=3064277 2024-09-12T18:32:53.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.063+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=U8RVPHOSM2LE type=del 2024-09-12T18:32:53.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.067+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=9WP03981WJ0V type=del size=3998249 2024-09-12T18:32:53.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.067+0000 7f41a072b8c0 1 < canceled operation key=295ZC54QRUPD tag=OVYFFB6ASUNK type=del size=834593 2024-09-12T18:32:53.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.071+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=FVE4QFT0F3CA type=del size=3574173 2024-09-12T18:32:53.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.071+0000 7f41a072b8c0 1 < canceled part key=_multipart_VEN0P2P1RZ2S.2~M8H1SU90BTGG.0 size=330155 2024-09-12T18:32:53.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.079+0000 7f41a072b8c0 1 < canceled multipart upload key=VEN0P2P1RZ2S upload=M8H1SU90BTGG tag=I22A72WYP5ZU type=write size=1378731 2024-09-12T18:32:53.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.079+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=ZV9R3NHFAJWD type=write size=525330 2024-09-12T18:32:53.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.083+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~3QR4B4QZ7GAX.0 size=78107 2024-09-12T18:32:53.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.087+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=3QR4B4QZ7GAX tag=OAWAAFTKB3PP type=write size=1126683 2024-09-12T18:32:53.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.091+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=HH5BII8MZYYS type=del size=3364961 2024-09-12T18:32:53.095 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.095+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=RXS9IVMUAIRG type=del 2024-09-12T18:32:53.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.099+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~KN7V9XNBDX45.0 size=1048576 2024-09-12T18:32:53.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.103+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~KN7V9XNBDX45.1 size=293666 2024-09-12T18:32:53.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.103+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=KN7V9XNBDX45 tag=V38W7EPL0Q6Z type=write size=2390818 2024-09-12T18:32:53.106 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.103+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=3FD2CKKAQGM9 type=del 2024-09-12T18:32:53.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.107+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=9XXXPWR3LG65 type=del size=1904707 2024-09-12T18:32:53.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.111+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~ZTRP2MZR6G7A.0 size=652899 2024-09-12T18:32:53.117 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.115+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=ZTRP2MZR6G7A tag=FK1WO37VK1RE type=write size=1701475 2024-09-12T18:32:53.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.123+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~2M2FXG5ITUS2.0 size=174392 2024-09-12T18:32:53.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.123+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=2M2FXG5ITUS2 tag=HVGEU9JKYT31 type=write size=1222968 2024-09-12T18:32:53.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.123+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~VV8OJUCZ8CCE.0 size=1048576 2024-09-12T18:32:53.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.127+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~VV8OJUCZ8CCE.1 size=248142 2024-09-12T18:32:53.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.131+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=VV8OJUCZ8CCE tag=13ZTC2FJNZHD type=write size=2345294 2024-09-12T18:32:53.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.135+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=80ZAD5I5TCYN type=del size=3576935 2024-09-12T18:32:53.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.143+0000 7f41a072b8c0 1 < suggested update operation key=GA6P1FACU2EQ tag=L5QTKTC93TJ7 type=del size=722517 2024-09-12T18:32:53.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.147+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~LWALWJGG2MYF.0 size=1048576 2024-09-12T18:32:53.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.147+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~LWALWJGG2MYF.1 size=387947 2024-09-12T18:32:53.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.147+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=LWALWJGG2MYF tag=QBXOT34CRC41 type=write size=2485099 2024-09-12T18:32:53.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.151+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=DA4Z7WPTJZ6H type=del 2024-09-12T18:32:53.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.155+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=KQCKWCPQYH5M type=del size=1979479 2024-09-12T18:32:53.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.159+0000 7f41a072b8c0 -1 < failed to complete operation key=GA6P1FACU2EQ tag=J2T17B0USO6F type=write size=362601: (22) Invalid argument 2024-09-12T18:32:53.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.159+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=F3WZXM61WW3Z type=del size=657797 2024-09-12T18:32:53.164 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.163+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=57UJV4NQU329 type=del 2024-09-12T18:32:53.170 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.167+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~FZXLGI28DG0H.0 size=817158 2024-09-12T18:32:53.170 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.167+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=FZXLGI28DG0H tag=ZVQQBLERQ6OD type=write size=1865734 2024-09-12T18:32:53.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.171+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=D0YR4O5R06AL type=del 2024-09-12T18:32:53.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.179+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~52BTH4BD2D5I.0 size=1048576 2024-09-12T18:32:53.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.179+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~52BTH4BD2D5I.1 size=1011932 2024-09-12T18:32:53.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.179+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=52BTH4BD2D5I tag=7EKYYZJZCGCX type=write size=3109084 2024-09-12T18:32:53.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.183+0000 7f41a072b8c0 1 < canceled operation key=YP72VTCGSHYE tag=AJMU760M37BS type=write size=995262 2024-09-12T18:32:53.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.187+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~37T5HRGDRMBZ.0 size=1048576 2024-09-12T18:32:53.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.191+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~37T5HRGDRMBZ.1 size=1048576 2024-09-12T18:32:53.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.195+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~37T5HRGDRMBZ.2 size=252801 2024-09-12T18:32:53.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.195+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=37T5HRGDRMBZ tag=FEXI8GODEEXD type=write size=3398529 2024-09-12T18:32:53.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.199+0000 7f41a072b8c0 1 < completed write operation key=SK3T82EJFZXE tag=X63PRZZPDWOB type=write size=120170 2024-09-12T18:32:53.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.203+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~CPXV9HKAW4UU.0 size=1048576 2024-09-12T18:32:53.207 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.207+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~CPXV9HKAW4UU.1 size=1048576 2024-09-12T18:32:53.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.207+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~CPXV9HKAW4UU.2 size=159639 2024-09-12T18:32:53.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.207+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=CPXV9HKAW4UU tag=CD68P4SSYZ01 type=write size=3305367 2024-09-12T18:32:53.213 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.211+0000 7f41a072b8c0 1 < canceled operation key=0O97F5ON55TX tag=3RUG9P2NH8M9 type=del size=3064277 2024-09-12T18:32:53.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.215+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~XIGH1I6MP2QP.0 size=1048576 2024-09-12T18:32:53.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.219+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~XIGH1I6MP2QP.1 size=701991 2024-09-12T18:32:53.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.219+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=XIGH1I6MP2QP tag=4FY83A1E1YTV type=write size=2799143 2024-09-12T18:32:53.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.223+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=9WP03981WJ0V type=del 2024-09-12T18:32:53.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.227+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=35J1N8MP7DPL type=del size=3020942 2024-09-12T18:32:53.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.231+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=FVE4QFT0F3CA type=del 2024-09-12T18:32:53.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.231+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=NPGMTBLSY275 type=del size=1989315 2024-09-12T18:32:53.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.235+0000 7f41a072b8c0 1 < completed write operation key=A6GQZL25YSNL tag=ZV9R3NHFAJWD type=write size=525330 2024-09-12T18:32:53.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.243+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~1ECV1L4145DE.0 size=1048576 2024-09-12T18:32:53.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.243+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~1ECV1L4145DE.1 size=1048576 2024-09-12T18:32:53.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.247+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~1ECV1L4145DE.2 size=517330 2024-09-12T18:32:53.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.247+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=1ECV1L4145DE tag=BWIYET1RFZ8T type=write size=3663058 2024-09-12T18:32:53.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.251+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=HH5BII8MZYYS type=del 2024-09-12T18:32:53.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.255+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~CA5T69FUT7UU.0 size=489548 2024-09-12T18:32:53.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.255+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=CA5T69FUT7UU tag=SS4D911XZYZY type=write size=1538124 2024-09-12T18:32:53.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.259+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~KN7V9XNBDX45.0 size=1048576 2024-09-12T18:32:53.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.259+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~KN7V9XNBDX45.1 size=293666 2024-09-12T18:32:53.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.263+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=KN7V9XNBDX45 tag=V38W7EPL0Q6Z type=write size=2390818 2024-09-12T18:32:53.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.267+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=127ITLIVZC6A type=del size=3246066 2024-09-12T18:32:53.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.271+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=9XXXPWR3LG65 type=del 2024-09-12T18:32:53.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.275+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~9A1DRAPLQ0L2.0 size=1048576 2024-09-12T18:32:53.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.279+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~9A1DRAPLQ0L2.1 size=450455 2024-09-12T18:32:53.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.279+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=9A1DRAPLQ0L2 tag=RAFC65LH89RD type=write size=2547607 2024-09-12T18:32:53.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.279+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~2M2FXG5ITUS2.0 size=174392 2024-09-12T18:32:53.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.283+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=2M2FXG5ITUS2 tag=HVGEU9JKYT31 type=write size=1222968 2024-09-12T18:32:53.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.287+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=WAR65INVC4MN type=del size=4069345 2024-09-12T18:32:53.290 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.287+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=80ZAD5I5TCYN type=del 2024-09-12T18:32:53.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.291+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~NBSYA06C2OQK.0 size=1011513 2024-09-12T18:32:53.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.291+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=NBSYA06C2OQK tag=C2MKBQIK38XK type=write size=2060089 2024-09-12T18:32:53.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.295+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~LWALWJGG2MYF.0 size=1048576 2024-09-12T18:32:53.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.295+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~LWALWJGG2MYF.1 size=387947 2024-09-12T18:32:53.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.299+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=LWALWJGG2MYF tag=QBXOT34CRC41 type=write size=2485099 2024-09-12T18:32:53.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.303+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=F62DPBOYG6T9 type=write size=942681 2024-09-12T18:32:53.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.307+0000 7f41a072b8c0 1 < canceled operation key=GQHPUDV5BG1E tag=KQCKWCPQYH5M type=del size=1979479 2024-09-12T18:32:53.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.311+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=SLGGDE31CZOE type=del size=2949762 2024-09-12T18:32:53.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.315+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=F3WZXM61WW3Z type=del 2024-09-12T18:32:53.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.315+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=8AFPNQ9E4HPG type=del size=126221 2024-09-12T18:32:53.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.319+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~FZXLGI28DG0H.0 size=817158 2024-09-12T18:32:53.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.327+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=FZXLGI28DG0H tag=ZVQQBLERQ6OD type=write size=1865734 2024-09-12T18:32:53.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.331+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~PJIBIIVQ6672.0 size=1048576 2024-09-12T18:32:53.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.335+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~PJIBIIVQ6672.1 size=623742 2024-09-12T18:32:53.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.335+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=PJIBIIVQ6672 tag=0R6IGBM29E9J type=write size=2720894 2024-09-12T18:32:53.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.339+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~52BTH4BD2D5I.0 size=1048576 2024-09-12T18:32:53.341 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.339+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~52BTH4BD2D5I.1 size=1011932 2024-09-12T18:32:53.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.347+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=52BTH4BD2D5I tag=7EKYYZJZCGCX type=write size=3109084 2024-09-12T18:32:53.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.351+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~2XQF9A0SZAQS.0 size=767485 2024-09-12T18:32:53.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.351+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=2XQF9A0SZAQS tag=O0NYNRHEKL7Y type=write size=1816061 2024-09-12T18:32:53.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.355+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~37T5HRGDRMBZ.0 size=1048576 2024-09-12T18:32:53.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.359+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~37T5HRGDRMBZ.1 size=1048576 2024-09-12T18:32:53.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.359+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~37T5HRGDRMBZ.2 size=252801 2024-09-12T18:32:53.367 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.367+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=37T5HRGDRMBZ tag=FEXI8GODEEXD type=write size=3398529 2024-09-12T18:32:53.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.371+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~P4OVSGYDX0GP.0 size=648023 2024-09-12T18:32:53.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.371+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=P4OVSGYDX0GP tag=L952HNJ0ORKC type=write size=1696599 2024-09-12T18:32:53.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.375+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~CPXV9HKAW4UU.0 size=1048576 2024-09-12T18:32:53.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.379+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~CPXV9HKAW4UU.1 size=1048576 2024-09-12T18:32:53.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.379+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~CPXV9HKAW4UU.2 size=159639 2024-09-12T18:32:53.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.387+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=CPXV9HKAW4UU tag=CD68P4SSYZ01 type=write size=3305367 2024-09-12T18:32:53.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.395+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~T2KJF929UE62.0 size=1048576 2024-09-12T18:32:53.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.395+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~T2KJF929UE62.1 size=1048576 2024-09-12T18:32:53.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.399+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~T2KJF929UE62.2 size=606624 2024-09-12T18:32:53.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.399+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=T2KJF929UE62 tag=0V9E4IU5NSDU type=write size=3752352 2024-09-12T18:32:53.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.403+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~XIGH1I6MP2QP.0 size=1048576 2024-09-12T18:32:53.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.407+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~XIGH1I6MP2QP.1 size=701991 2024-09-12T18:32:53.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.411+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=XIGH1I6MP2QP tag=4FY83A1E1YTV type=write size=2799143 2024-09-12T18:32:53.419 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.419+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~KWTFLHC8DYEG.0 size=523055 2024-09-12T18:32:53.419 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.419+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=KWTFLHC8DYEG tag=ANV5T4TEDNOG type=write size=1571631 2024-09-12T18:32:53.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.423+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=35J1N8MP7DPL type=del 2024-09-12T18:32:53.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.423+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=JKVR3OTTCUP4 type=del size=3051236 2024-09-12T18:32:53.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.427+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=NPGMTBLSY275 type=del 2024-09-12T18:32:53.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.431+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=0LJ5S8J2WYA8 type=del size=2991424 2024-09-12T18:32:53.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.435+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~1ECV1L4145DE.0 size=1048576 2024-09-12T18:32:53.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.439+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~1ECV1L4145DE.1 size=1048576 2024-09-12T18:32:53.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.443+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~1ECV1L4145DE.2 size=517330 2024-09-12T18:32:53.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.447+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=1ECV1L4145DE tag=BWIYET1RFZ8T type=write size=3663058 2024-09-12T18:32:53.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.451+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=HHUN33LUKPEO type=del size=780302 2024-09-12T18:32:53.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.455+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~CA5T69FUT7UU.0 size=489548 2024-09-12T18:32:53.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.459+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=CA5T69FUT7UU tag=SS4D911XZYZY type=write size=1538124 2024-09-12T18:32:53.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.463+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=QCXA0185VRCK type=del size=1405678 2024-09-12T18:32:53.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.467+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=127ITLIVZC6A type=del 2024-09-12T18:32:53.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.471+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~MFGJ5HP7PDR3.0 size=1048576 2024-09-12T18:32:53.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.471+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~MFGJ5HP7PDR3.1 size=260200 2024-09-12T18:32:53.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.471+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=MFGJ5HP7PDR3 tag=WGMSLMDPUOR3 type=write size=2357352 2024-09-12T18:32:53.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.475+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~9A1DRAPLQ0L2.0 size=1048576 2024-09-12T18:32:53.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.479+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~9A1DRAPLQ0L2.1 size=450455 2024-09-12T18:32:53.485 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.483+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=9A1DRAPLQ0L2 tag=RAFC65LH89RD type=write size=2547607 2024-09-12T18:32:53.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.487+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=4QWGP63VMBSV type=del size=1199529 2024-09-12T18:32:53.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.491+0000 7f41a072b8c0 1 < suggested remove operation key=A6GQZL25YSNL tag=WAR65INVC4MN type=del 2024-09-12T18:32:53.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.499+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~UL7QOXL4YTMO.0 size=1048576 2024-09-12T18:32:53.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.499+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~UL7QOXL4YTMO.1 size=1048576 2024-09-12T18:32:53.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.503+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~UL7QOXL4YTMO.2 size=500625 2024-09-12T18:32:53.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.503+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=UL7QOXL4YTMO tag=YYHQ93NU4H9M type=write size=3646353 2024-09-12T18:32:53.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.503+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~NBSYA06C2OQK.0 size=1011513 2024-09-12T18:32:53.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.511+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=NBSYA06C2OQK tag=C2MKBQIK38XK type=write size=2060089 2024-09-12T18:32:53.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.515+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~1Q57BPV22Y7P.0 size=1048576 2024-09-12T18:32:53.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.515+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~1Q57BPV22Y7P.1 size=1048576 2024-09-12T18:32:53.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.519+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~1Q57BPV22Y7P.2 size=352020 2024-09-12T18:32:53.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.519+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=1Q57BPV22Y7P tag=7Y3DF3J5R8SU type=write size=3497748 2024-09-12T18:32:53.523 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.523+0000 7f41a072b8c0 1 < completed write operation key=3CGBX19WTMWQ tag=F62DPBOYG6T9 type=write size=942681 2024-09-12T18:32:53.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.527+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=FQ39RA97E5DG type=del size=965513 2024-09-12T18:32:53.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.527+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=SLGGDE31CZOE type=del 2024-09-12T18:32:53.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.535+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~8H9ZI3LKYU2Z.0 size=1048576 2024-09-12T18:32:53.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.535+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~8H9ZI3LKYU2Z.1 size=502187 2024-09-12T18:32:53.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.535+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=8H9ZI3LKYU2Z tag=Z0ORD15SHEBK type=write size=2599339 2024-09-12T18:32:53.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.539+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=8AFPNQ9E4HPG type=del 2024-09-12T18:32:53.544 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.543+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=P0SMZKU4FOQI type=del size=1653480 2024-09-12T18:32:53.547 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.547+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~PJIBIIVQ6672.0 size=1048576 2024-09-12T18:32:53.549 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.547+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~PJIBIIVQ6672.1 size=623742 2024-09-12T18:32:53.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.555+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=PJIBIIVQ6672 tag=0R6IGBM29E9J type=write size=2720894 2024-09-12T18:32:53.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.559+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=NSEUNURQEQHC type=write size=809273 2024-09-12T18:32:53.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.563+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~2XQF9A0SZAQS.0 size=767485 2024-09-12T18:32:53.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.567+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=2XQF9A0SZAQS tag=O0NYNRHEKL7Y type=write size=1816061 2024-09-12T18:32:53.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.571+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=NWRT26FSRHTV type=write size=571737 2024-09-12T18:32:53.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.571+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~P4OVSGYDX0GP.0 size=648023 2024-09-12T18:32:53.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.579+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=P4OVSGYDX0GP tag=L952HNJ0ORKC type=write size=1696599 2024-09-12T18:32:53.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.579+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=P2E4ADWZZ8L2 type=del size=190275 2024-09-12T18:32:53.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.583+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~T2KJF929UE62.0 size=1048576 2024-09-12T18:32:53.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.587+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~T2KJF929UE62.1 size=1048576 2024-09-12T18:32:53.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.587+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~T2KJF929UE62.2 size=606624 2024-09-12T18:32:53.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.591+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=T2KJF929UE62 tag=0V9E4IU5NSDU type=write size=3752352 2024-09-12T18:32:53.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.595+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=BSI6H6BFMTX4 type=del size=664285 2024-09-12T18:32:53.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.599+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~KWTFLHC8DYEG.0 size=523055 2024-09-12T18:32:53.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.603+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=KWTFLHC8DYEG tag=ANV5T4TEDNOG type=write size=1571631 2024-09-12T18:32:53.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.607+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=M3X6QH78WLCJ type=del size=2910559 2024-09-12T18:32:53.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.615+0000 7f41a072b8c0 1 < suggested update operation key=V35A7LK08C7J tag=JKVR3OTTCUP4 type=del size=3051236 2024-09-12T18:32:53.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.619+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~EY6T3D7JLIEJ.0 size=1048576 2024-09-12T18:32:53.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.623+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~EY6T3D7JLIEJ.1 size=1048576 2024-09-12T18:32:53.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.627+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~EY6T3D7JLIEJ.2 size=667073 2024-09-12T18:32:53.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.627+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=EY6T3D7JLIEJ tag=KL0GD8YM1MOZ type=write size=3812801 2024-09-12T18:32:53.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.631+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=0LJ5S8J2WYA8 type=del 2024-09-12T18:32:53.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.635+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~PY7ZHELFTMAF.0 size=1048576 2024-09-12T18:32:53.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.639+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~PY7ZHELFTMAF.1 size=1048576 2024-09-12T18:32:53.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.639+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~PY7ZHELFTMAF.2 size=604662 2024-09-12T18:32:53.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.639+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=PY7ZHELFTMAF tag=XU7N7BFZ0JD2 type=write size=3750390 2024-09-12T18:32:53.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.643+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=HHUN33LUKPEO type=del 2024-09-12T18:32:53.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.647+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=T1IDN2E3RK7Y type=del size=336161 2024-09-12T18:32:53.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.651+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=QCXA0185VRCK type=del 2024-09-12T18:32:53.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.655+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=ML4ZLM7W77HR type=del size=1711117 2024-09-12T18:32:53.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.659+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~MFGJ5HP7PDR3.0 size=1048576 2024-09-12T18:32:53.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.663+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~MFGJ5HP7PDR3.1 size=260200 2024-09-12T18:32:53.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.667+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=MFGJ5HP7PDR3 tag=WGMSLMDPUOR3 type=write size=2357352 2024-09-12T18:32:53.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.671+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~BCCQK5I7I0DC.0 size=1048576 2024-09-12T18:32:53.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.675+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~BCCQK5I7I0DC.1 size=1048576 2024-09-12T18:32:53.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.675+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~BCCQK5I7I0DC.2 size=302366 2024-09-12T18:32:53.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.675+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=BCCQK5I7I0DC tag=YP29AVWMMIN0 type=write size=3448094 2024-09-12T18:32:53.681 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.679+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=4QWGP63VMBSV type=del 2024-09-12T18:32:53.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.687+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~3YQVM66NYMFM.0 size=1048576 2024-09-12T18:32:53.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.687+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~3YQVM66NYMFM.1 size=1048576 2024-09-12T18:32:53.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.691+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~3YQVM66NYMFM.2 size=567191 2024-09-12T18:32:53.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.691+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=3YQVM66NYMFM tag=09IH8GIS38DD type=write size=3712919 2024-09-12T18:32:53.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.695+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~UL7QOXL4YTMO.0 size=1048576 2024-09-12T18:32:53.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.695+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~UL7QOXL4YTMO.1 size=1048576 2024-09-12T18:32:53.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.695+0000 7f41a072b8c0 1 < canceled part key=_multipart_1JIIRDVMT0B0.2~UL7QOXL4YTMO.2 size=500625 2024-09-12T18:32:53.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.699+0000 7f41a072b8c0 1 < canceled multipart upload key=1JIIRDVMT0B0 upload=UL7QOXL4YTMO tag=YYHQ93NU4H9M type=write size=3646353 2024-09-12T18:32:53.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.703+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~QXWG2FCXA9T5.0 size=1048576 2024-09-12T18:32:53.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.707+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~QXWG2FCXA9T5.1 size=1048576 2024-09-12T18:32:53.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.711+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~QXWG2FCXA9T5.2 size=498809 2024-09-12T18:32:53.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.711+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=QXWG2FCXA9T5 tag=EPY2Y1A08NCJ type=write size=3644537 2024-09-12T18:32:53.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.711+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~1Q57BPV22Y7P.0 size=1048576 2024-09-12T18:32:53.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.715+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~1Q57BPV22Y7P.1 size=1048576 2024-09-12T18:32:53.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.719+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~1Q57BPV22Y7P.2 size=352020 2024-09-12T18:32:53.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.723+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=1Q57BPV22Y7P tag=7Y3DF3J5R8SU type=write size=3497748 2024-09-12T18:32:53.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.727+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~GHCHB783FUWB.0 size=1048576 2024-09-12T18:32:53.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.731+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~GHCHB783FUWB.1 size=1048576 2024-09-12T18:32:53.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.731+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~GHCHB783FUWB.2 size=913117 2024-09-12T18:32:53.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.731+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=GHCHB783FUWB tag=O5A7U5DBGXRF type=write size=4058845 2024-09-12T18:32:53.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.735+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=FQ39RA97E5DG type=del 2024-09-12T18:32:53.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.739+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=JLB1L2KIH5C4 type=del size=1786300 2024-09-12T18:32:53.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.743+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~8H9ZI3LKYU2Z.0 size=1048576 2024-09-12T18:32:53.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.743+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~8H9ZI3LKYU2Z.1 size=502187 2024-09-12T18:32:53.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.747+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=8H9ZI3LKYU2Z tag=Z0ORD15SHEBK type=write size=2599339 2024-09-12T18:32:53.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.751+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=PNRWF2Y71DRH type=write size=296546 2024-09-12T18:32:53.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.755+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=P0SMZKU4FOQI type=del 2024-09-12T18:32:53.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.759+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~T1KXZTUM6BB0.0 size=543644 2024-09-12T18:32:53.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.759+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=T1KXZTUM6BB0 tag=N1YQFDM9CCZK type=write size=1592220 2024-09-12T18:32:53.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.763+0000 7f41a072b8c0 1 < completed write operation key=P732C5X0RG8Z tag=NSEUNURQEQHC type=write size=809273 2024-09-12T18:32:53.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.767+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~G7D7YTZV991C.0 size=1048576 2024-09-12T18:32:53.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.771+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~G7D7YTZV991C.1 size=224866 2024-09-12T18:32:53.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.771+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=G7D7YTZV991C tag=WO8YVSKB36ZL type=write size=2322018 2024-09-12T18:32:53.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.771+0000 7f41a072b8c0 1 < completed write operation key=3R9RN03RFRJP tag=NWRT26FSRHTV type=write size=571737 2024-09-12T18:32:53.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.775+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=R81C2296QYCY type=del size=285443 2024-09-12T18:32:53.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.779+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=P2E4ADWZZ8L2 type=del 2024-09-12T18:32:53.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.779+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=VN5OANYVS4F3 type=del size=1190049 2024-09-12T18:32:53.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.783+0000 7f41a072b8c0 -1 < failed to complete operation key=V35A7LK08C7J tag=BSI6H6BFMTX4 type=del size=664285: (22) Invalid argument 2024-09-12T18:32:53.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.787+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=6QHIKXU7D2NS type=del size=3362948 2024-09-12T18:32:53.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.787+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=M3X6QH78WLCJ type=del 2024-09-12T18:32:53.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.795+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~TYFL2LOPF5XM.0 size=1048576 2024-09-12T18:32:53.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.795+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~TYFL2LOPF5XM.1 size=1048576 2024-09-12T18:32:53.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.799+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~TYFL2LOPF5XM.2 size=443476 2024-09-12T18:32:53.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.799+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=TYFL2LOPF5XM tag=F13ERRO3I8AF type=write size=3589204 2024-09-12T18:32:53.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.799+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~EY6T3D7JLIEJ.0 size=1048576 2024-09-12T18:32:53.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.803+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~EY6T3D7JLIEJ.1 size=1048576 2024-09-12T18:32:53.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.803+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~EY6T3D7JLIEJ.2 size=667073 2024-09-12T18:32:53.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.811+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=EY6T3D7JLIEJ tag=KL0GD8YM1MOZ type=write size=3812801 2024-09-12T18:32:53.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.815+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~5RRD41KZ02PS.0 size=1048576 2024-09-12T18:32:53.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.815+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~5RRD41KZ02PS.1 size=36434 2024-09-12T18:32:53.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.815+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=5RRD41KZ02PS tag=RCKBOPVIO1CS type=write size=2133586 2024-09-12T18:32:53.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.819+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~PY7ZHELFTMAF.0 size=1048576 2024-09-12T18:32:53.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.819+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~PY7ZHELFTMAF.1 size=1048576 2024-09-12T18:32:53.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.823+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~PY7ZHELFTMAF.2 size=604662 2024-09-12T18:32:53.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.827+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=PY7ZHELFTMAF tag=XU7N7BFZ0JD2 type=write size=3750390 2024-09-12T18:32:53.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.831+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=X4M4Q42V2VSK type=del size=1099808 2024-09-12T18:32:53.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.831+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=T1IDN2E3RK7Y type=del 2024-09-12T18:32:53.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.835+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=23WYJFG5OY9W type=write size=582125 2024-09-12T18:32:53.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.835+0000 7f41a072b8c0 1 < canceled operation key=GQHPUDV5BG1E tag=ML4ZLM7W77HR type=del size=1711117 2024-09-12T18:32:53.842 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.839+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~9A9KD6764MXD.0 size=1048576 2024-09-12T18:32:53.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.843+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~9A9KD6764MXD.1 size=1048576 2024-09-12T18:32:53.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.843+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~9A9KD6764MXD.2 size=74753 2024-09-12T18:32:53.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.843+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=9A9KD6764MXD tag=FQXNR6SU4CGZ type=write size=3220481 2024-09-12T18:32:53.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.847+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~BCCQK5I7I0DC.0 size=1048576 2024-09-12T18:32:53.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.851+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~BCCQK5I7I0DC.1 size=1048576 2024-09-12T18:32:53.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.855+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~BCCQK5I7I0DC.2 size=302366 2024-09-12T18:32:53.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.859+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=BCCQK5I7I0DC tag=YP29AVWMMIN0 type=write size=3448094 2024-09-12T18:32:53.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.863+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~KCUV8B0Y3MZ4.0 size=1048576 2024-09-12T18:32:53.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.863+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~KCUV8B0Y3MZ4.1 size=1048576 2024-09-12T18:32:53.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.867+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~KCUV8B0Y3MZ4.2 size=492389 2024-09-12T18:32:53.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.867+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=KCUV8B0Y3MZ4 tag=3LX3UH0Q3M7B type=write size=3638117 2024-09-12T18:32:53.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.867+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~3YQVM66NYMFM.0 size=1048576 2024-09-12T18:32:53.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.871+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~3YQVM66NYMFM.1 size=1048576 2024-09-12T18:32:53.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.871+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~3YQVM66NYMFM.2 size=567191 2024-09-12T18:32:53.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.875+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=3YQVM66NYMFM tag=09IH8GIS38DD type=write size=3712919 2024-09-12T18:32:53.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.879+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~0D6GHF8V13UG.0 size=1048576 2024-09-12T18:32:53.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.883+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~0D6GHF8V13UG.1 size=724462 2024-09-12T18:32:53.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.883+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=0D6GHF8V13UG tag=3GR42VQU3QEL type=write size=2821614 2024-09-12T18:32:53.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.887+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~QXWG2FCXA9T5.0 size=1048576 2024-09-12T18:32:53.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.887+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~QXWG2FCXA9T5.1 size=1048576 2024-09-12T18:32:53.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.891+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~QXWG2FCXA9T5.2 size=498809 2024-09-12T18:32:53.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.895+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=QXWG2FCXA9T5 tag=EPY2Y1A08NCJ type=write size=3644537 2024-09-12T18:32:53.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.899+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~GRPIG0AGIU26.0 size=18604 2024-09-12T18:32:53.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.899+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=GRPIG0AGIU26 tag=D78QM3UX09O2 type=write size=1067180 2024-09-12T18:32:53.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.899+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~GHCHB783FUWB.0 size=1048576 2024-09-12T18:32:53.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.903+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~GHCHB783FUWB.1 size=1048576 2024-09-12T18:32:53.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.903+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~GHCHB783FUWB.2 size=913117 2024-09-12T18:32:53.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.907+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=GHCHB783FUWB tag=O5A7U5DBGXRF type=write size=4058845 2024-09-12T18:32:53.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.911+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=37LM2140044G type=del size=446359 2024-09-12T18:32:53.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.915+0000 7f41a072b8c0 1 < suggested update operation key=GA6P1FACU2EQ tag=JLB1L2KIH5C4 type=del size=1786300 2024-09-12T18:32:53.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.919+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~1QFU1HM0TIAV.0 size=691870 2024-09-12T18:32:53.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.919+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=1QFU1HM0TIAV tag=YIR2LBKLNBRV type=write size=1740446 2024-09-12T18:32:53.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.923+0000 7f41a072b8c0 1 < completed write operation key=NKMA8FG3V3TR tag=PNRWF2Y71DRH type=write size=296546 2024-09-12T18:32:53.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.923+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=79UCGNYYE4SI type=del size=2816310 2024-09-12T18:32:53.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.927+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~T1KXZTUM6BB0.0 size=543644 2024-09-12T18:32:53.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.931+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=T1KXZTUM6BB0 tag=N1YQFDM9CCZK type=write size=1592220 2024-09-12T18:32:53.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.931+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~0XO39EAFLWVM.0 size=380320 2024-09-12T18:32:53.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.931+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=0XO39EAFLWVM tag=EBMEX15GLIS7 type=write size=1428896 2024-09-12T18:32:53.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.935+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~G7D7YTZV991C.0 size=1048576 2024-09-12T18:32:53.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.935+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~G7D7YTZV991C.1 size=224866 2024-09-12T18:32:53.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.939+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=G7D7YTZV991C tag=WO8YVSKB36ZL type=write size=2322018 2024-09-12T18:32:53.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.943+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~VIZ5676YQJTF.0 size=1048576 2024-09-12T18:32:53.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.947+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~VIZ5676YQJTF.1 size=1048576 2024-09-12T18:32:53.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.947+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~VIZ5676YQJTF.2 size=10838 2024-09-12T18:32:53.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.947+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=VIZ5676YQJTF tag=HA2U9F9D89U6 type=write size=3156566 2024-09-12T18:32:53.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.951+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=R81C2296QYCY type=del 2024-09-12T18:32:53.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.951+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~RW9HRSHMIWEH.0 size=1048576 2024-09-12T18:32:53.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.955+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~RW9HRSHMIWEH.1 size=1048576 2024-09-12T18:32:53.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.955+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~RW9HRSHMIWEH.2 size=573157 2024-09-12T18:32:53.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.955+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=RW9HRSHMIWEH tag=UD770162YP92 type=write size=3718885 2024-09-12T18:32:53.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.959+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=VN5OANYVS4F3 type=del 2024-09-12T18:32:53.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.963+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~RU3JKZMJQDO4.0 size=428135 2024-09-12T18:32:53.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.963+0000 7f41a072b8c0 1 > prepared multipart upload key=VEN0P2P1RZ2S upload=RU3JKZMJQDO4 tag=EOFJ3SWEPGQ9 type=write size=1476711 2024-09-12T18:32:53.965 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.963+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=6QHIKXU7D2NS type=del 2024-09-12T18:32:53.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.967+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~0YXJ04SIHN1G.0 size=1048576 2024-09-12T18:32:53.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.971+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~0YXJ04SIHN1G.1 size=797337 2024-09-12T18:32:53.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.971+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=0YXJ04SIHN1G tag=E7NG35P0FOPK type=write size=2894489 2024-09-12T18:32:53.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.971+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~TYFL2LOPF5XM.0 size=1048576 2024-09-12T18:32:53.975 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.975+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~TYFL2LOPF5XM.1 size=1048576 2024-09-12T18:32:53.975 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.975+0000 7f41a072b8c0 1 < canceled part key=_multipart_KP2HF4J376EY.2~TYFL2LOPF5XM.2 size=443476 2024-09-12T18:32:53.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.979+0000 7f41a072b8c0 1 < canceled multipart upload key=KP2HF4J376EY upload=TYFL2LOPF5XM tag=F13ERRO3I8AF type=write size=3589204 2024-09-12T18:32:53.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.979+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=6NB55V6Y7BJZ type=del size=173154 2024-09-12T18:32:53.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.983+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~5RRD41KZ02PS.0 size=1048576 2024-09-12T18:32:53.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.983+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~5RRD41KZ02PS.1 size=36434 2024-09-12T18:32:53.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.987+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=5RRD41KZ02PS tag=RCKBOPVIO1CS type=write size=2133586 2024-09-12T18:32:53.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.991+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=7BG3LCLO5ZGG type=del size=4071109 2024-09-12T18:32:53.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.991+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=X4M4Q42V2VSK type=del 2024-09-12T18:32:53.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.995+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=OH3JVJKIQ60N type=del size=4034762 2024-09-12T18:32:53.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:53.999+0000 7f41a072b8c0 1 < suggested update operation key=GA6P1FACU2EQ tag=23WYJFG5OY9W type=write size=582125 2024-09-12T18:32:54.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.003+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~AP61BNO6EH1T.0 size=1048576 2024-09-12T18:32:54.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.003+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~AP61BNO6EH1T.1 size=425549 2024-09-12T18:32:54.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.003+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=AP61BNO6EH1T tag=IGIBQG8DAS2T type=write size=2522701 2024-09-12T18:32:54.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.007+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~9A9KD6764MXD.0 size=1048576 2024-09-12T18:32:54.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.007+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~9A9KD6764MXD.1 size=1048576 2024-09-12T18:32:54.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.007+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~9A9KD6764MXD.2 size=74753 2024-09-12T18:32:54.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.011+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=9A9KD6764MXD tag=FQXNR6SU4CGZ type=write size=3220481 2024-09-12T18:32:54.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.015+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~WBVQYG75U4US.0 size=1048576 2024-09-12T18:32:54.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.019+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~WBVQYG75U4US.1 size=1048576 2024-09-12T18:32:54.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.019+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~WBVQYG75U4US.2 size=83475 2024-09-12T18:32:54.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.019+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=WBVQYG75U4US tag=A39RZ4EPO7ME type=write size=3229203 2024-09-12T18:32:54.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.023+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~KCUV8B0Y3MZ4.0 size=1048576 2024-09-12T18:32:54.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.027+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~KCUV8B0Y3MZ4.1 size=1048576 2024-09-12T18:32:54.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.031+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~KCUV8B0Y3MZ4.2 size=492389 2024-09-12T18:32:54.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.035+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=KCUV8B0Y3MZ4 tag=3LX3UH0Q3M7B type=write size=3638117 2024-09-12T18:32:54.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.039+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~ZWD20XFFBHJ4.0 size=1048576 2024-09-12T18:32:54.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.039+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~ZWD20XFFBHJ4.1 size=1048576 2024-09-12T18:32:54.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.043+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~ZWD20XFFBHJ4.2 size=525815 2024-09-12T18:32:54.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.043+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=ZWD20XFFBHJ4 tag=EEJAY6ZG1A2V type=write size=3671543 2024-09-12T18:32:54.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.043+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~0D6GHF8V13UG.0 size=1048576 2024-09-12T18:32:54.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.047+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~0D6GHF8V13UG.1 size=724462 2024-09-12T18:32:54.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.051+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=0D6GHF8V13UG tag=3GR42VQU3QEL type=write size=2821614 2024-09-12T18:32:54.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.051+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=O7NSOQQPOFN2 type=write size=140853 2024-09-12T18:32:54.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.055+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~GRPIG0AGIU26.0 size=18604 2024-09-12T18:32:54.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.059+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=GRPIG0AGIU26 tag=D78QM3UX09O2 type=write size=1067180 2024-09-12T18:32:54.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.063+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=N082YUOO57S1 type=del size=1889201 2024-09-12T18:32:54.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.063+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=37LM2140044G type=del 2024-09-12T18:32:54.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.067+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~LQL7H60Y65AZ.0 size=308496 2024-09-12T18:32:54.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.067+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=LQL7H60Y65AZ tag=FQOOSBO8163Z type=write size=1357072 2024-09-12T18:32:54.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.071+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~1QFU1HM0TIAV.0 size=691870 2024-09-12T18:32:54.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.075+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=1QFU1HM0TIAV tag=YIR2LBKLNBRV type=write size=1740446 2024-09-12T18:32:54.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.079+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=4WXYW4JPFE81 type=del size=3347911 2024-09-12T18:32:54.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.083+0000 7f41a072b8c0 1 < suggested remove operation key=SK3T82EJFZXE tag=79UCGNYYE4SI type=del 2024-09-12T18:32:54.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.083+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=ENIC8E2TPUOW type=del size=3197155 2024-09-12T18:32:54.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.087+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~0XO39EAFLWVM.0 size=380320 2024-09-12T18:32:54.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.091+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=0XO39EAFLWVM tag=EBMEX15GLIS7 type=write size=1428896 2024-09-12T18:32:54.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.091+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=H5ZBX1DCU204 type=del size=2433815 2024-09-12T18:32:54.095 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.095+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~VIZ5676YQJTF.0 size=1048576 2024-09-12T18:32:54.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.095+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~VIZ5676YQJTF.1 size=1048576 2024-09-12T18:32:54.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.099+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~VIZ5676YQJTF.2 size=10838 2024-09-12T18:32:54.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.103+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=VIZ5676YQJTF tag=HA2U9F9D89U6 type=write size=3156566 2024-09-12T18:32:54.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.107+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=679NVF6D0UW3 type=write size=225077 2024-09-12T18:32:54.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.111+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~RW9HRSHMIWEH.0 size=1048576 2024-09-12T18:32:54.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.111+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~RW9HRSHMIWEH.1 size=1048576 2024-09-12T18:32:54.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.115+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~RW9HRSHMIWEH.2 size=573157 2024-09-12T18:32:54.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.119+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=RW9HRSHMIWEH tag=UD770162YP92 type=write size=3718885 2024-09-12T18:32:54.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.119+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=O17Q0MFUL7B3 type=del size=277420 2024-09-12T18:32:54.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.123+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~RU3JKZMJQDO4.0 size=428135 2024-09-12T18:32:54.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.127+0000 7f41a072b8c0 1 < completed multipart upload key=VEN0P2P1RZ2S upload=RU3JKZMJQDO4 tag=EOFJ3SWEPGQ9 type=write size=1476711 2024-09-12T18:32:54.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.131+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=N5OM68GUMHO0 type=del size=3409017 2024-09-12T18:32:54.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.135+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~0YXJ04SIHN1G.0 size=1048576 2024-09-12T18:32:54.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.135+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~0YXJ04SIHN1G.1 size=797337 2024-09-12T18:32:54.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.139+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=0YXJ04SIHN1G tag=E7NG35P0FOPK type=write size=2894489 2024-09-12T18:32:54.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.143+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=49CGDKR7EGFP type=write size=672168 2024-09-12T18:32:54.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.151+0000 7f41a072b8c0 1 < suggested update operation key=7MRN7L1DTAMO tag=6NB55V6Y7BJZ type=del size=173154 2024-09-12T18:32:54.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.155+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~DGWVSNJKMW9C.0 size=203699 2024-09-12T18:32:54.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.155+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=DGWVSNJKMW9C tag=E1PBSMHDX6TC type=write size=1252275 2024-09-12T18:32:54.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.163+0000 7f41a072b8c0 1 < suggested update operation key=5OD9IX408CYO tag=7BG3LCLO5ZGG type=del size=4071109 2024-09-12T18:32:54.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.163+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=7CAAOEI0D2X9 type=del size=138933 2024-09-12T18:32:54.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.167+0000 7f41a072b8c0 -1 < failed to complete operation key=5OD9IX408CYO tag=OH3JVJKIQ60N type=del size=4034762: (22) Invalid argument 2024-09-12T18:32:54.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.175+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~3CCZ1NA7YLV5.0 size=1048576 2024-09-12T18:32:54.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.175+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~3CCZ1NA7YLV5.1 size=818839 2024-09-12T18:32:54.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.175+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=3CCZ1NA7YLV5 tag=843A8M0VD86R type=write size=2915991 2024-09-12T18:32:54.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.179+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~AP61BNO6EH1T.0 size=1048576 2024-09-12T18:32:54.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.183+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~AP61BNO6EH1T.1 size=425549 2024-09-12T18:32:54.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.187+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=AP61BNO6EH1T tag=IGIBQG8DAS2T type=write size=2522701 2024-09-12T18:32:54.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.191+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=7TXJYGQVO2XJ type=write size=543707 2024-09-12T18:32:54.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.195+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~WBVQYG75U4US.0 size=1048576 2024-09-12T18:32:54.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.195+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~WBVQYG75U4US.1 size=1048576 2024-09-12T18:32:54.200 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.199+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~WBVQYG75U4US.2 size=83475 2024-09-12T18:32:54.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.203+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=WBVQYG75U4US tag=A39RZ4EPO7ME type=write size=3229203 2024-09-12T18:32:54.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.207+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~Q1WKXBCMYP59.0 size=1048576 2024-09-12T18:32:54.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.211+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~Q1WKXBCMYP59.1 size=1048576 2024-09-12T18:32:54.213 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.211+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~Q1WKXBCMYP59.2 size=261368 2024-09-12T18:32:54.214 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.211+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=Q1WKXBCMYP59 tag=XZ4PSNSV69RD type=write size=3407096 2024-09-12T18:32:54.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.215+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~ZWD20XFFBHJ4.0 size=1048576 2024-09-12T18:32:54.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.215+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~ZWD20XFFBHJ4.1 size=1048576 2024-09-12T18:32:54.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.219+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~ZWD20XFFBHJ4.2 size=525815 2024-09-12T18:32:54.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.223+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=ZWD20XFFBHJ4 tag=EEJAY6ZG1A2V type=write size=3671543 2024-09-12T18:32:54.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.227+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=81FQ18AOPK75 type=del size=3616511 2024-09-12T18:32:54.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.227+0000 7f41a072b8c0 1 < completed write operation key=L01GL4WOUIL2 tag=O7NSOQQPOFN2 type=write size=140853 2024-09-12T18:32:54.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.231+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~2IOGFXG2JEZ9.0 size=905285 2024-09-12T18:32:54.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.231+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=2IOGFXG2JEZ9 tag=68VGCFQ1XL90 type=write size=1953861 2024-09-12T18:32:54.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.235+0000 7f41a072b8c0 1 < canceled operation key=58IT2R988AW9 tag=N082YUOO57S1 type=del size=1889201 2024-09-12T18:32:54.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.239+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=2H2TAUNRKWTZ type=del size=3613386 2024-09-12T18:32:54.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.239+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~LQL7H60Y65AZ.0 size=308496 2024-09-12T18:32:54.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.243+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=LQL7H60Y65AZ tag=FQOOSBO8163Z type=write size=1357072 2024-09-12T18:32:54.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.247+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~WSZSMMMEGD6D.0 size=1048576 2024-09-12T18:32:54.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.251+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~WSZSMMMEGD6D.1 size=1048576 2024-09-12T18:32:54.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.251+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~WSZSMMMEGD6D.2 size=209346 2024-09-12T18:32:54.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.251+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=WSZSMMMEGD6D tag=7LT5G3UO15V0 type=write size=3355074 2024-09-12T18:32:54.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.255+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=4WXYW4JPFE81 type=del 2024-09-12T18:32:54.258 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.255+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=73Q05XRVZIGL type=del size=4153667 2024-09-12T18:32:54.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.259+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=ENIC8E2TPUOW type=del 2024-09-12T18:32:54.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.263+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=L6YOCE3LCNIY type=del size=2153005 2024-09-12T18:32:54.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.263+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=H5ZBX1DCU204 type=del 2024-09-12T18:32:54.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.267+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=QJ82PTWR31UV type=del size=3317579 2024-09-12T18:32:54.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.271+0000 7f41a072b8c0 1 < completed write operation key=295ZC54QRUPD tag=679NVF6D0UW3 type=write size=225077 2024-09-12T18:32:54.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.275+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=HVA5I3PSR85Z type=del size=3074695 2024-09-12T18:32:54.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.279+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=O17Q0MFUL7B3 type=del 2024-09-12T18:32:54.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.279+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=NWSUB9Q1XDV0 type=del size=1438050 2024-09-12T18:32:54.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.287+0000 7f41a072b8c0 1 < suggested update operation key=5JUWC8RXSA5L tag=N5OM68GUMHO0 type=del size=3409017 2024-09-12T18:32:54.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.295+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~EHF02JFFRMRQ.0 size=557146 2024-09-12T18:32:54.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.295+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=EHF02JFFRMRQ tag=8SLFAPVUEP36 type=write size=1605722 2024-09-12T18:32:54.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.295+0000 7f41a072b8c0 -1 < failed to complete operation key=5OD9IX408CYO tag=49CGDKR7EGFP type=write size=672168: (22) Invalid argument 2024-09-12T18:32:54.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.303+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~EISZ5I83YUDL.0 size=1048576 2024-09-12T18:32:54.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.307+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~EISZ5I83YUDL.1 size=1048576 2024-09-12T18:32:54.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.307+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~EISZ5I83YUDL.2 size=1004437 2024-09-12T18:32:54.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.307+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=EISZ5I83YUDL tag=8I3DFKJ3K971 type=write size=4150165 2024-09-12T18:32:54.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.311+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~DGWVSNJKMW9C.0 size=203699 2024-09-12T18:32:54.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.315+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=DGWVSNJKMW9C tag=E1PBSMHDX6TC type=write size=1252275 2024-09-12T18:32:54.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.319+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~ZDTK3FXCQXN1.0 size=980902 2024-09-12T18:32:54.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.319+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=ZDTK3FXCQXN1 tag=6UKKTR1VU0GN type=write size=2029478 2024-09-12T18:32:54.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.323+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=7CAAOEI0D2X9 type=del 2024-09-12T18:32:54.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.327+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~Z45M9ZBUU2ZQ.0 size=1048576 2024-09-12T18:32:54.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.331+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~Z45M9ZBUU2ZQ.1 size=222255 2024-09-12T18:32:54.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.331+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=Z45M9ZBUU2ZQ tag=59VNRLM72IIU type=write size=2319407 2024-09-12T18:32:54.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.331+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~3CCZ1NA7YLV5.0 size=1048576 2024-09-12T18:32:54.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.335+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~3CCZ1NA7YLV5.1 size=818839 2024-09-12T18:32:54.341 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.339+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=3CCZ1NA7YLV5 tag=843A8M0VD86R type=write size=2915991 2024-09-12T18:32:54.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.343+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=6POAY5H62EW6 type=del size=1784546 2024-09-12T18:32:54.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.347+0000 7f41a072b8c0 1 < completed write operation key=VEN0P2P1RZ2S tag=7TXJYGQVO2XJ type=write size=543707 2024-09-12T18:32:54.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.351+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~IY1QIWTRURSR.0 size=633184 2024-09-12T18:32:54.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.351+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=IY1QIWTRURSR tag=Q3RKJM4AW8N7 type=write size=1681760 2024-09-12T18:32:54.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.355+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~Q1WKXBCMYP59.0 size=1048576 2024-09-12T18:32:54.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.359+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~Q1WKXBCMYP59.1 size=1048576 2024-09-12T18:32:54.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.363+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~Q1WKXBCMYP59.2 size=261368 2024-09-12T18:32:54.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.367+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=Q1WKXBCMYP59 tag=XZ4PSNSV69RD type=write size=3407096 2024-09-12T18:32:54.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.371+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~RGUBCMD2GPW1.0 size=382937 2024-09-12T18:32:54.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.371+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=RGUBCMD2GPW1 tag=MZKPAQPA694Q type=write size=1431513 2024-09-12T18:32:54.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.375+0000 7f41a072b8c0 1 < canceled operation key=0O97F5ON55TX tag=81FQ18AOPK75 type=del size=3616511 2024-09-12T18:32:54.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.379+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~MZ7Y8LM3ZSLU.0 size=1048576 2024-09-12T18:32:54.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.383+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~MZ7Y8LM3ZSLU.1 size=904711 2024-09-12T18:32:54.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.383+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=MZ7Y8LM3ZSLU tag=JE4A61T8D9LX type=write size=3001863 2024-09-12T18:32:54.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.383+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~2IOGFXG2JEZ9.0 size=905285 2024-09-12T18:32:54.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.387+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=2IOGFXG2JEZ9 tag=68VGCFQ1XL90 type=write size=1953861 2024-09-12T18:32:54.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.395+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~QFKI6H4KSU7A.0 size=1048576 2024-09-12T18:32:54.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.395+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~QFKI6H4KSU7A.1 size=544640 2024-09-12T18:32:54.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.395+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=QFKI6H4KSU7A tag=1E7TQZ4UOVO4 type=write size=2641792 2024-09-12T18:32:54.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.399+0000 7f41a072b8c0 1 < suggested remove operation key=C2PRRD3QO9AF tag=2H2TAUNRKWTZ type=del 2024-09-12T18:32:54.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.407+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~XFFUYYRYY3M6.0 size=1048576 2024-09-12T18:32:54.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.407+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~XFFUYYRYY3M6.1 size=1048576 2024-09-12T18:32:54.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.411+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~XFFUYYRYY3M6.2 size=994504 2024-09-12T18:32:54.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.411+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=XFFUYYRYY3M6 tag=CIS2Y3HRBRKF type=write size=4140232 2024-09-12T18:32:54.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.411+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~WSZSMMMEGD6D.0 size=1048576 2024-09-12T18:32:54.416 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.415+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~WSZSMMMEGD6D.1 size=1048576 2024-09-12T18:32:54.418 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.415+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~WSZSMMMEGD6D.2 size=209346 2024-09-12T18:32:54.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.419+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=WSZSMMMEGD6D tag=7LT5G3UO15V0 type=write size=3355074 2024-09-12T18:32:54.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.427+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~TA1JJGANSLRR.0 size=1048576 2024-09-12T18:32:54.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.427+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~TA1JJGANSLRR.1 size=255249 2024-09-12T18:32:54.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.427+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=TA1JJGANSLRR tag=M3DGV73VWVJR type=write size=2352401 2024-09-12T18:32:54.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.431+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=73Q05XRVZIGL type=del 2024-09-12T18:32:54.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.435+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=ZIT7G3QED8N4 type=del size=974906 2024-09-12T18:32:54.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.435+0000 7f41a072b8c0 1 < completed delete operation key=YP72VTCGSHYE tag=L6YOCE3LCNIY type=del 2024-09-12T18:32:54.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.439+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=8VDZXP51X48X type=del size=2004777 2024-09-12T18:32:54.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.443+0000 7f41a072b8c0 1 < completed delete operation key=3R9RN03RFRJP tag=QJ82PTWR31UV type=del 2024-09-12T18:32:54.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.443+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=0VXGVXXZJIBR type=write size=348684 2024-09-12T18:32:54.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.447+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=HVA5I3PSR85Z type=del 2024-09-12T18:32:54.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.451+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=85ATIYO7A1R7 type=del size=949182 2024-09-12T18:32:54.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.451+0000 7f41a072b8c0 1 < canceled operation key=295ZC54QRUPD tag=NWSUB9Q1XDV0 type=del size=1438050 2024-09-12T18:32:54.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.455+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~Z1F8AN7RBUFJ.0 size=1048576 2024-09-12T18:32:54.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.459+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~Z1F8AN7RBUFJ.1 size=703314 2024-09-12T18:32:54.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.459+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=Z1F8AN7RBUFJ tag=86RZX18120F2 type=write size=2800466 2024-09-12T18:32:54.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.463+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~EHF02JFFRMRQ.0 size=557146 2024-09-12T18:32:54.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.467+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=EHF02JFFRMRQ tag=8SLFAPVUEP36 type=write size=1605722 2024-09-12T18:32:54.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.467+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=UO6YOMNRPRPC type=del size=1033978 2024-09-12T18:32:54.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.471+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~EISZ5I83YUDL.0 size=1048576 2024-09-12T18:32:54.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.471+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~EISZ5I83YUDL.1 size=1048576 2024-09-12T18:32:54.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.475+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~EISZ5I83YUDL.2 size=1004437 2024-09-12T18:32:54.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.479+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=EISZ5I83YUDL tag=8I3DFKJ3K971 type=write size=4150165 2024-09-12T18:32:54.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.483+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=W47QNPEOIZUL type=del size=3504251 2024-09-12T18:32:54.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.483+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~ZDTK3FXCQXN1.0 size=980902 2024-09-12T18:32:54.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.487+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=ZDTK3FXCQXN1 tag=6UKKTR1VU0GN type=write size=2029478 2024-09-12T18:32:54.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.491+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=GDNIBYSVTEIC type=del size=3134987 2024-09-12T18:32:54.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.495+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~Z45M9ZBUU2ZQ.0 size=1048576 2024-09-12T18:32:54.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.495+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~Z45M9ZBUU2ZQ.1 size=222255 2024-09-12T18:32:54.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.499+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=Z45M9ZBUU2ZQ tag=59VNRLM72IIU type=write size=2319407 2024-09-12T18:32:54.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.503+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~LP9GEPCM8MJ1.0 size=1048576 2024-09-12T18:32:54.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~LP9GEPCM8MJ1.1 size=167539 2024-09-12T18:32:54.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.507+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=LP9GEPCM8MJ1 tag=H0VFOTZX2VNO type=write size=2264691 2024-09-12T18:32:54.512 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.511+0000 7f41a072b8c0 1 < suggested update operation key=GA6P1FACU2EQ tag=6POAY5H62EW6 type=del size=1784546 2024-09-12T18:32:54.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.511+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=MM1M0ZPPA47N type=del size=176772 2024-09-12T18:32:54.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.515+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~IY1QIWTRURSR.0 size=633184 2024-09-12T18:32:54.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.519+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=IY1QIWTRURSR tag=Q3RKJM4AW8N7 type=write size=1681760 2024-09-12T18:32:54.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.523+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=PNLFQL9UV2KZ type=del size=2673647 2024-09-12T18:32:54.527 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.527+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~RGUBCMD2GPW1.0 size=382937 2024-09-12T18:32:54.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.531+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=RGUBCMD2GPW1 tag=MZKPAQPA694Q type=write size=1431513 2024-09-12T18:32:54.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.535+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~R6I5IO3N75VL.0 size=1048576 2024-09-12T18:32:54.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.539+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~R6I5IO3N75VL.1 size=1048576 2024-09-12T18:32:54.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.539+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~R6I5IO3N75VL.2 size=159731 2024-09-12T18:32:54.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.539+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=R6I5IO3N75VL tag=VR0OHZZ630IK type=write size=3305459 2024-09-12T18:32:54.543 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.543+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~MZ7Y8LM3ZSLU.0 size=1048576 2024-09-12T18:32:54.545 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.543+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~MZ7Y8LM3ZSLU.1 size=904711 2024-09-12T18:32:54.549 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.547+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=MZ7Y8LM3ZSLU tag=JE4A61T8D9LX type=write size=3001863 2024-09-12T18:32:54.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.551+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=71J7LO2D3XHI type=write size=123675 2024-09-12T18:32:54.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.555+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~QFKI6H4KSU7A.0 size=1048576 2024-09-12T18:32:54.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.555+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~QFKI6H4KSU7A.1 size=544640 2024-09-12T18:32:54.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.563+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=QFKI6H4KSU7A tag=1E7TQZ4UOVO4 type=write size=2641792 2024-09-12T18:32:54.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.567+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~Q4UKBOHKR5O7.0 size=929434 2024-09-12T18:32:54.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.567+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=Q4UKBOHKR5O7 tag=RMHENO1ATSPO type=write size=1978010 2024-09-12T18:32:54.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.567+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~XFFUYYRYY3M6.0 size=1048576 2024-09-12T18:32:54.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.567+0000 7f41a072b8c0 1 < canceled part key=_multipart_0O97F5ON55TX.2~XFFUYYRYY3M6.1 size=1048576 2024-09-12T18:32:54.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.571+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~XFFUYYRYY3M6.2 size=994504 2024-09-12T18:32:54.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.575+0000 7f41a072b8c0 1 < canceled multipart upload key=0O97F5ON55TX upload=XFFUYYRYY3M6 tag=CIS2Y3HRBRKF type=write size=4140232 2024-09-12T18:32:54.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.579+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~SC3U0YXRI0UI.0 size=1048576 2024-09-12T18:32:54.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.583+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~SC3U0YXRI0UI.1 size=661617 2024-09-12T18:32:54.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.583+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=SC3U0YXRI0UI tag=YU1CI85FGTBP type=write size=2758769 2024-09-12T18:32:54.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.583+0000 7f41a072b8c0 1 < canceled part key=_multipart_63BP9QETTAM8.2~TA1JJGANSLRR.0 size=1048576 2024-09-12T18:32:54.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.583+0000 7f41a072b8c0 1 < canceled part key=_multipart_63BP9QETTAM8.2~TA1JJGANSLRR.1 size=255249 2024-09-12T18:32:54.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.587+0000 7f41a072b8c0 1 < canceled multipart upload key=63BP9QETTAM8 upload=TA1JJGANSLRR tag=M3DGV73VWVJR type=write size=2352401 2024-09-12T18:32:54.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.591+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~4TD5B51CLG9V.0 size=1048576 2024-09-12T18:32:54.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.595+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~4TD5B51CLG9V.1 size=1048576 2024-09-12T18:32:54.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.599+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~4TD5B51CLG9V.2 size=149347 2024-09-12T18:32:54.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.599+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=4TD5B51CLG9V tag=VCZ17T39U6IY type=write size=3295075 2024-09-12T18:32:54.601 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.599+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=ZIT7G3QED8N4 type=del 2024-09-12T18:32:54.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.603+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=GSI3OE67LZO7 type=del size=3246322 2024-09-12T18:32:54.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.607+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=8VDZXP51X48X type=del 2024-09-12T18:32:54.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.611+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=6JE96AQ40BFB type=del size=3664028 2024-09-12T18:32:54.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.611+0000 7f41a072b8c0 -1 < failed to complete operation key=GA6P1FACU2EQ tag=0VXGVXXZJIBR type=write size=348684: (22) Invalid argument 2024-09-12T18:32:54.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.619+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~URWXV66A0LFS.0 size=1048576 2024-09-12T18:32:54.621 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.619+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~URWXV66A0LFS.1 size=1048576 2024-09-12T18:32:54.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.623+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~URWXV66A0LFS.2 size=60817 2024-09-12T18:32:54.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.623+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=URWXV66A0LFS tag=HVF6GJLO1FA1 type=write size=3206545 2024-09-12T18:32:54.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.627+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=85ATIYO7A1R7 type=del 2024-09-12T18:32:54.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.631+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=KZR8S1KZZZU7 type=del size=44024 2024-09-12T18:32:54.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.631+0000 7f41a072b8c0 1 < canceled part key=_multipart_1BSAN5TRTZNZ.2~Z1F8AN7RBUFJ.0 size=1048576 2024-09-12T18:32:54.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.631+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~Z1F8AN7RBUFJ.1 size=703314 2024-09-12T18:32:54.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.635+0000 7f41a072b8c0 1 < canceled multipart upload key=1BSAN5TRTZNZ upload=Z1F8AN7RBUFJ tag=86RZX18120F2 type=write size=2800466 2024-09-12T18:32:54.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.639+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=YH4UG0S0JPBL type=del size=3905678 2024-09-12T18:32:54.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.643+0000 7f41a072b8c0 -1 < failed to complete operation key=GA6P1FACU2EQ tag=UO6YOMNRPRPC type=del size=1033978: (22) Invalid argument 2024-09-12T18:32:54.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.647+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=PYZZRU8DDURV type=del size=397339 2024-09-12T18:32:54.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.647+0000 7f41a072b8c0 1 < canceled operation key=P732C5X0RG8Z tag=W47QNPEOIZUL type=del size=3504251 2024-09-12T18:32:54.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.651+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~AJ3XQGRKO7OJ.0 size=449891 2024-09-12T18:32:54.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.651+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=AJ3XQGRKO7OJ tag=S3JC5ZIFC6P6 type=write size=1498467 2024-09-12T18:32:54.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.655+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=GDNIBYSVTEIC type=del 2024-09-12T18:32:54.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.659+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=6TVT1XLNDJO3 type=del size=113791 2024-09-12T18:32:54.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.659+0000 7f41a072b8c0 1 < canceled part key=_multipart_KOLD6WYK30EQ.2~LP9GEPCM8MJ1.0 size=1048576 2024-09-12T18:32:54.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.663+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~LP9GEPCM8MJ1.1 size=167539 2024-09-12T18:32:54.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.667+0000 7f41a072b8c0 1 < canceled multipart upload key=KOLD6WYK30EQ upload=LP9GEPCM8MJ1 tag=H0VFOTZX2VNO type=write size=2264691 2024-09-12T18:32:54.672 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.671+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~A9C9A4SY6F1H.0 size=1048576 2024-09-12T18:32:54.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.671+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~A9C9A4SY6F1H.1 size=1048576 2024-09-12T18:32:54.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.675+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~A9C9A4SY6F1H.2 size=130469 2024-09-12T18:32:54.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.675+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=A9C9A4SY6F1H tag=843P1YJX0TRK type=write size=3276197 2024-09-12T18:32:54.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.679+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=MM1M0ZPPA47N type=del 2024-09-12T18:32:54.681 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.679+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=G1UXYZQSAP1D type=del size=741738 2024-09-12T18:32:54.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.683+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=PNLFQL9UV2KZ type=del 2024-09-12T18:32:54.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.687+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~RHOVTB31ER3R.0 size=1048576 2024-09-12T18:32:54.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.691+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~RHOVTB31ER3R.1 size=1048576 2024-09-12T18:32:54.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.691+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~RHOVTB31ER3R.2 size=484451 2024-09-12T18:32:54.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.691+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=RHOVTB31ER3R tag=XG1FVOI63MKH type=write size=3630179 2024-09-12T18:32:54.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.691+0000 7f41a072b8c0 1 < canceled part key=_multipart_0G0YWIOD3L3I.2~R6I5IO3N75VL.0 size=1048576 2024-09-12T18:32:54.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.695+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~R6I5IO3N75VL.1 size=1048576 2024-09-12T18:32:54.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.695+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~R6I5IO3N75VL.2 size=159731 2024-09-12T18:32:54.703 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.703+0000 7f41a072b8c0 1 < canceled multipart upload key=0G0YWIOD3L3I upload=R6I5IO3N75VL tag=VR0OHZZ630IK type=write size=3305459 2024-09-12T18:32:54.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.703+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=7FJT1YHF5MFQ type=del size=2914100 2024-09-12T18:32:54.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.711+0000 7f41a072b8c0 1 < suggested remove operation key=SK3T82EJFZXE tag=71J7LO2D3XHI type=write 2024-09-12T18:32:54.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.715+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~9KB3781AW2GW.0 size=1048576 2024-09-12T18:32:54.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.719+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~9KB3781AW2GW.1 size=1048576 2024-09-12T18:32:54.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.719+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~9KB3781AW2GW.2 size=38760 2024-09-12T18:32:54.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.719+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=9KB3781AW2GW tag=SLWOTDJ9NPX2 type=write size=3184488 2024-09-12T18:32:54.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.723+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~Q4UKBOHKR5O7.0 size=929434 2024-09-12T18:32:54.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.727+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=Q4UKBOHKR5O7 tag=RMHENO1ATSPO type=write size=1978010 2024-09-12T18:32:54.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.731+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=41DCF58WZXHF type=del size=4102531 2024-09-12T18:32:54.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.731+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~SC3U0YXRI0UI.0 size=1048576 2024-09-12T18:32:54.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.735+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~SC3U0YXRI0UI.1 size=661617 2024-09-12T18:32:54.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.739+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=SC3U0YXRI0UI tag=YU1CI85FGTBP type=write size=2758769 2024-09-12T18:32:54.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.743+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=M99FAJS6EPR5 type=write size=971699 2024-09-12T18:32:54.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.743+0000 7f41a072b8c0 1 < canceled part key=_multipart_295ZC54QRUPD.2~4TD5B51CLG9V.0 size=1048576 2024-09-12T18:32:54.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.743+0000 7f41a072b8c0 1 < canceled part key=_multipart_295ZC54QRUPD.2~4TD5B51CLG9V.1 size=1048576 2024-09-12T18:32:54.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.747+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~4TD5B51CLG9V.2 size=149347 2024-09-12T18:32:54.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.751+0000 7f41a072b8c0 1 < canceled multipart upload key=295ZC54QRUPD upload=4TD5B51CLG9V tag=VCZ17T39U6IY type=write size=3295075 2024-09-12T18:32:54.754 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.751+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=ROK4QOEAEQL4 type=write size=1027975 2024-09-12T18:32:54.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.759+0000 7f41a072b8c0 1 < suggested update operation key=L1VC63PK1R2Y tag=GSI3OE67LZO7 type=del size=3246322 2024-09-12T18:32:54.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.763+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=9YQDFNS8UPRQ type=write size=744043 2024-09-12T18:32:54.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.763+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=6JE96AQ40BFB type=del 2024-09-12T18:32:54.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.771+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~F4BQBVJZWVUN.0 size=1048576 2024-09-12T18:32:54.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.771+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~F4BQBVJZWVUN.1 size=1048576 2024-09-12T18:32:54.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.775+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~F4BQBVJZWVUN.2 size=410158 2024-09-12T18:32:54.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.775+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=F4BQBVJZWVUN tag=BCYL3BCKDZ0W type=write size=3555886 2024-09-12T18:32:54.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.779+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~URWXV66A0LFS.0 size=1048576 2024-09-12T18:32:54.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.783+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~URWXV66A0LFS.1 size=1048576 2024-09-12T18:32:54.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.783+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~URWXV66A0LFS.2 size=60817 2024-09-12T18:32:54.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.791+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=URWXV66A0LFS tag=HVF6GJLO1FA1 type=write size=3206545 2024-09-12T18:32:54.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.795+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~CVWYKTYJFZI0.0 size=1048576 2024-09-12T18:32:54.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.795+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~CVWYKTYJFZI0.1 size=881432 2024-09-12T18:32:54.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.795+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=CVWYKTYJFZI0 tag=KB8MNE1HWMKY type=write size=2978584 2024-09-12T18:32:54.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.803+0000 7f41a072b8c0 1 < suggested update operation key=7MRN7L1DTAMO tag=KZR8S1KZZZU7 type=del size=44024 2024-09-12T18:32:54.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.807+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~XW3T462ULOFR.0 size=1048576 2024-09-12T18:32:54.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.811+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~XW3T462ULOFR.1 size=1048576 2024-09-12T18:32:54.813 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.811+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~XW3T462ULOFR.2 size=295824 2024-09-12T18:32:54.813 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.811+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=XW3T462ULOFR tag=PQUCVFH5363U type=write size=3441552 2024-09-12T18:32:54.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.815+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=YH4UG0S0JPBL type=del 2024-09-12T18:32:54.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.819+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~600AK5DVAC0P.0 size=889337 2024-09-12T18:32:54.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.819+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=600AK5DVAC0P tag=UCO19ZZCPWC2 type=write size=1937913 2024-09-12T18:32:54.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.827+0000 7f41a072b8c0 1 < suggested remove operation key=0O97F5ON55TX tag=PYZZRU8DDURV type=del 2024-09-12T18:32:54.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.827+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=I2LJIWXEEWVP type=del size=193373 2024-09-12T18:32:54.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.831+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~AJ3XQGRKO7OJ.0 size=449891 2024-09-12T18:32:54.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.835+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=AJ3XQGRKO7OJ tag=S3JC5ZIFC6P6 type=write size=1498467 2024-09-12T18:32:54.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.843+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~IF6LRHQ2CW7P.0 size=1048576 2024-09-12T18:32:54.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.843+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~IF6LRHQ2CW7P.1 size=1048576 2024-09-12T18:32:54.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.847+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~IF6LRHQ2CW7P.2 size=543421 2024-09-12T18:32:54.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.847+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=IF6LRHQ2CW7P tag=ZCSWLQ0UDKM8 type=write size=3689149 2024-09-12T18:32:54.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.851+0000 7f41a072b8c0 -1 < failed to complete operation key=0O97F5ON55TX tag=6TVT1XLNDJO3 type=del size=113791: (22) Invalid argument 2024-09-12T18:32:54.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.855+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=GG9F7DE4RQTT type=del size=1966879 2024-09-12T18:32:54.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.855+0000 7f41a072b8c0 1 < canceled part key=_multipart_GA6P1FACU2EQ.2~A9C9A4SY6F1H.0 size=1048576 2024-09-12T18:32:54.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.859+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~A9C9A4SY6F1H.1 size=1048576 2024-09-12T18:32:54.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.859+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~A9C9A4SY6F1H.2 size=130469 2024-09-12T18:32:54.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.863+0000 7f41a072b8c0 1 < canceled multipart upload key=GA6P1FACU2EQ upload=A9C9A4SY6F1H tag=843P1YJX0TRK type=write size=3276197 2024-09-12T18:32:54.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.867+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~UK7X19EU36SC.0 size=1048576 2024-09-12T18:32:54.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.871+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~UK7X19EU36SC.1 size=1048576 2024-09-12T18:32:54.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.871+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~UK7X19EU36SC.2 size=707594 2024-09-12T18:32:54.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.871+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=UK7X19EU36SC tag=4UBVA6I961LE type=write size=3853322 2024-09-12T18:32:54.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.875+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=G1UXYZQSAP1D type=del 2024-09-12T18:32:54.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.879+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=1V3ONX9F7U2N type=del size=1321300 2024-09-12T18:32:54.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.879+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~RHOVTB31ER3R.0 size=1048576 2024-09-12T18:32:54.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.883+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~RHOVTB31ER3R.1 size=1048576 2024-09-12T18:32:54.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.883+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~RHOVTB31ER3R.2 size=484451 2024-09-12T18:32:54.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.891+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=RHOVTB31ER3R tag=XG1FVOI63MKH type=write size=3630179 2024-09-12T18:32:54.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.891+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=PYLV7O44TOQ5 type=del size=1268777 2024-09-12T18:32:54.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.891+0000 7f41a072b8c0 -1 < no bi entry to suggest for operation key=0O97F5ON55TX tag=7FJT1YHF5MFQ type=del size=2914100: (2) No such file or directory 2024-09-12T18:32:54.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.895+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=XW2IAVET33FD type=del size=3000375 2024-09-12T18:32:54.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.899+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~9KB3781AW2GW.0 size=1048576 2024-09-12T18:32:54.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.899+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~9KB3781AW2GW.1 size=1048576 2024-09-12T18:32:54.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.903+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~9KB3781AW2GW.2 size=38760 2024-09-12T18:32:54.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.907+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=9KB3781AW2GW tag=SLWOTDJ9NPX2 type=write size=3184488 2024-09-12T18:32:54.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.911+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=QNWBGIH7RA87 type=del size=164930 2024-09-12T18:32:54.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.911+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=41DCF58WZXHF type=del 2024-09-12T18:32:54.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.915+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=JYLOY35XG4MR type=write size=548184 2024-09-12T18:32:54.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.915+0000 7f41a072b8c0 -1 < failed to complete operation key=7MRN7L1DTAMO tag=M99FAJS6EPR5 type=write size=971699: (22) Invalid argument 2024-09-12T18:32:54.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.919+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=UIEYNBX5A54T type=del size=3782753 2024-09-12T18:32:54.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.927+0000 7f41a072b8c0 1 < suggested remove operation key=1BSAN5TRTZNZ tag=ROK4QOEAEQL4 type=write 2024-09-12T18:32:54.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.927+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=1Z27N4RTFLQU type=write size=812055 2024-09-12T18:32:54.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.931+0000 7f41a072b8c0 1 < completed write operation key=GQHPUDV5BG1E tag=9YQDFNS8UPRQ type=write size=744043 2024-09-12T18:32:54.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.935+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~FPFQ1B5T612P.0 size=1048576 2024-09-12T18:32:54.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.939+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~FPFQ1B5T612P.1 size=294148 2024-09-12T18:32:54.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.939+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=FPFQ1B5T612P tag=G2S7IPL70YU6 type=write size=2391300 2024-09-12T18:32:54.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.943+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~F4BQBVJZWVUN.0 size=1048576 2024-09-12T18:32:54.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.943+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~F4BQBVJZWVUN.1 size=1048576 2024-09-12T18:32:54.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.947+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~F4BQBVJZWVUN.2 size=410158 2024-09-12T18:32:54.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.951+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=F4BQBVJZWVUN tag=BCYL3BCKDZ0W type=write size=3555886 2024-09-12T18:32:54.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.959+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~YVHTRAR6PS1W.0 size=1048576 2024-09-12T18:32:54.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.963+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~YVHTRAR6PS1W.1 size=1048576 2024-09-12T18:32:54.965 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.963+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~YVHTRAR6PS1W.2 size=121463 2024-09-12T18:32:54.965 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.963+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=YVHTRAR6PS1W tag=XVZU581IZ9T7 type=write size=3267191 2024-09-12T18:32:54.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.967+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~CVWYKTYJFZI0.0 size=1048576 2024-09-12T18:32:54.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.971+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~CVWYKTYJFZI0.1 size=881432 2024-09-12T18:32:54.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.975+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=CVWYKTYJFZI0 tag=KB8MNE1HWMKY type=write size=2978584 2024-09-12T18:32:54.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.983+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~0JFQVHL8C4O5.0 size=1048576 2024-09-12T18:32:54.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.983+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~0JFQVHL8C4O5.1 size=1048576 2024-09-12T18:32:54.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.987+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~0JFQVHL8C4O5.2 size=166056 2024-09-12T18:32:54.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.987+0000 7f41a072b8c0 1 > prepared multipart upload key=VEN0P2P1RZ2S upload=0JFQVHL8C4O5 tag=WJ1M1IZ9D0II type=write size=3311784 2024-09-12T18:32:54.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.991+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~XW3T462ULOFR.0 size=1048576 2024-09-12T18:32:54.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.991+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~XW3T462ULOFR.1 size=1048576 2024-09-12T18:32:54.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.995+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~XW3T462ULOFR.2 size=295824 2024-09-12T18:32:55.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:54.999+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=XW3T462ULOFR tag=PQUCVFH5363U type=write size=3441552 2024-09-12T18:32:55.005 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.003+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=1M8Z3XAG7H9M type=del size=2353503 2024-09-12T18:32:55.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.007+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~600AK5DVAC0P.0 size=889337 2024-09-12T18:32:55.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.011+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=600AK5DVAC0P tag=UCO19ZZCPWC2 type=write size=1937913 2024-09-12T18:32:55.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.015+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=V62EBY2V9C0E type=del size=3705384 2024-09-12T18:32:55.021 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.019+0000 7f41a072b8c0 1 < completed delete operation key=NKMA8FG3V3TR tag=I2LJIWXEEWVP type=del 2024-09-12T18:32:55.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.023+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=JL8863QLO3UF type=del size=601242 2024-09-12T18:32:55.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.027+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~IF6LRHQ2CW7P.0 size=1048576 2024-09-12T18:32:55.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.031+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~IF6LRHQ2CW7P.1 size=1048576 2024-09-12T18:32:55.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.031+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~IF6LRHQ2CW7P.2 size=543421 2024-09-12T18:32:55.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.039+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=IF6LRHQ2CW7P tag=ZCSWLQ0UDKM8 type=write size=3689149 2024-09-12T18:32:55.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.043+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~WJI2GL4OFHDH.0 size=246309 2024-09-12T18:32:55.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.043+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=WJI2GL4OFHDH tag=8DCXBWZ6O7RU type=write size=1294885 2024-09-12T18:32:55.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.047+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=GG9F7DE4RQTT type=del 2024-09-12T18:32:55.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.055+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=URO4KRLB9I87 type=del size=271129 2024-09-12T18:32:55.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.059+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~UK7X19EU36SC.0 size=1048576 2024-09-12T18:32:55.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.059+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~UK7X19EU36SC.1 size=1048576 2024-09-12T18:32:55.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.063+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~UK7X19EU36SC.2 size=707594 2024-09-12T18:32:55.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.071+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=UK7X19EU36SC tag=4UBVA6I961LE type=write size=3853322 2024-09-12T18:32:55.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.075+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=6RQJ9VEQX4PZ type=del size=1871890 2024-09-12T18:32:55.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.079+0000 7f41a072b8c0 1 < suggested remove operation key=GQHPUDV5BG1E tag=1V3ONX9F7U2N type=del 2024-09-12T18:32:55.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.087+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~ERLRJXVEKZE8.0 size=1048576 2024-09-12T18:32:55.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.087+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~ERLRJXVEKZE8.1 size=1048576 2024-09-12T18:32:55.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.091+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~ERLRJXVEKZE8.2 size=272661 2024-09-12T18:32:55.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.091+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=ERLRJXVEKZE8 tag=GHQOUFBWL4TG type=write size=3418389 2024-09-12T18:32:55.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.095+0000 7f41a072b8c0 1 < canceled operation key=7MRN7L1DTAMO tag=PYLV7O44TOQ5 type=del size=1268777 2024-09-12T18:32:55.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.099+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=IIKR2NJJX5PY type=del size=4185217 2024-09-12T18:32:55.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.103+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=XW2IAVET33FD type=del 2024-09-12T18:32:55.106 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.103+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=YDQLPXZXQTAR type=write size=465570 2024-09-12T18:32:55.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.107+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=QNWBGIH7RA87 type=del 2024-09-12T18:32:55.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.115+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~AZVURTRBAY7E.0 size=905806 2024-09-12T18:32:55.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.115+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=AZVURTRBAY7E tag=N29VWN1S29BW type=write size=1954382 2024-09-12T18:32:55.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.119+0000 7f41a072b8c0 1 < suggested update operation key=V35A7LK08C7J tag=JYLOY35XG4MR type=write size=548184 2024-09-12T18:32:55.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.127+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~K9E1YS2W25G4.0 size=1048576 2024-09-12T18:32:55.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.127+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~K9E1YS2W25G4.1 size=522304 2024-09-12T18:32:55.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.127+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=K9E1YS2W25G4 tag=STN2CPM4HSKG type=write size=2619456 2024-09-12T18:32:55.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.131+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=UIEYNBX5A54T type=del 2024-09-12T18:32:55.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.135+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=01GKBN71VG0G type=write size=431868 2024-09-12T18:32:55.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.139+0000 7f41a072b8c0 1 < suggested update operation key=1BSAN5TRTZNZ tag=1Z27N4RTFLQU type=write size=812055 2024-09-12T18:32:55.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.143+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=LUFMYMMV2FVX type=del size=2530553 2024-09-12T18:32:55.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.147+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~FPFQ1B5T612P.0 size=1048576 2024-09-12T18:32:55.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.151+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~FPFQ1B5T612P.1 size=294148 2024-09-12T18:32:55.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.155+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=FPFQ1B5T612P tag=G2S7IPL70YU6 type=write size=2391300 2024-09-12T18:32:55.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.159+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=3VNX6V922BQL type=del size=2342786 2024-09-12T18:32:55.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.163+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~YVHTRAR6PS1W.0 size=1048576 2024-09-12T18:32:55.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.167+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~YVHTRAR6PS1W.1 size=1048576 2024-09-12T18:32:55.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.171+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~YVHTRAR6PS1W.2 size=121463 2024-09-12T18:32:55.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.175+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=YVHTRAR6PS1W tag=XVZU581IZ9T7 type=write size=3267191 2024-09-12T18:32:55.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.179+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=8RIDTHBYWTSM type=del size=3716543 2024-09-12T18:32:55.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.183+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~0JFQVHL8C4O5.0 size=1048576 2024-09-12T18:32:55.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.187+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~0JFQVHL8C4O5.1 size=1048576 2024-09-12T18:32:55.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.187+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~0JFQVHL8C4O5.2 size=166056 2024-09-12T18:32:55.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.195+0000 7f41a072b8c0 1 < completed multipart upload key=VEN0P2P1RZ2S upload=0JFQVHL8C4O5 tag=WJ1M1IZ9D0II type=write size=3311784 2024-09-12T18:32:55.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.199+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=AAEF04ZS4JBM type=del size=2715258 2024-09-12T18:32:55.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.199+0000 7f41a072b8c0 1 < canceled operation key=0O97F5ON55TX tag=1M8Z3XAG7H9M type=del size=2353503 2024-09-12T18:32:55.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.203+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=G5L947I2R0HV type=del size=2883310 2024-09-12T18:32:55.212 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.211+0000 7f41a072b8c0 1 < suggested update operation key=7B70QWGMH0C0 tag=V62EBY2V9C0E type=del size=3705384 2024-09-12T18:32:55.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.215+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=EH55UCML4Z2X type=del size=1155777 2024-09-12T18:32:55.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.219+0000 7f41a072b8c0 1 < suggested remove operation key=0O97F5ON55TX tag=JL8863QLO3UF type=del 2024-09-12T18:32:55.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.227+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~OK9UFCEK7BKO.0 size=666869 2024-09-12T18:32:55.228 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.227+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=OK9UFCEK7BKO tag=Y403DZND754M type=write size=1715445 2024-09-12T18:32:55.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.231+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~WJI2GL4OFHDH.0 size=246309 2024-09-12T18:32:55.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.235+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=WJI2GL4OFHDH tag=8DCXBWZ6O7RU type=write size=1294885 2024-09-12T18:32:55.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.239+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=VG0ULY69QCOA type=del size=3409866 2024-09-12T18:32:55.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.243+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=URO4KRLB9I87 type=del 2024-09-12T18:32:55.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.247+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~3ERP08LDVCJ8.0 size=1048576 2024-09-12T18:32:55.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.251+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~3ERP08LDVCJ8.1 size=562511 2024-09-12T18:32:55.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.251+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=3ERP08LDVCJ8 tag=J75AR9HEOGA5 type=write size=2659663 2024-09-12T18:32:55.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.251+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=6RQJ9VEQX4PZ type=del 2024-09-12T18:32:55.258 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.259+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~MYNRJAH00BSI.0 size=1048576 2024-09-12T18:32:55.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.259+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~MYNRJAH00BSI.1 size=71549 2024-09-12T18:32:55.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.259+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=MYNRJAH00BSI tag=121URU5S4CHE type=write size=2168701 2024-09-12T18:32:55.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.263+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~ERLRJXVEKZE8.0 size=1048576 2024-09-12T18:32:55.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.263+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~ERLRJXVEKZE8.1 size=1048576 2024-09-12T18:32:55.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.267+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~ERLRJXVEKZE8.2 size=272661 2024-09-12T18:32:55.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.271+0000 7f41a072b8c0 1 < completed multipart upload key=L01GL4WOUIL2 upload=ERLRJXVEKZE8 tag=GHQOUFBWL4TG type=write size=3418389 2024-09-12T18:32:55.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.275+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=JTWWPR15WZ7N type=del size=1199987 2024-09-12T18:32:55.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.279+0000 7f41a072b8c0 1 < canceled operation key=3R9RN03RFRJP tag=IIKR2NJJX5PY type=del size=4185217 2024-09-12T18:32:55.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.279+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=GOIP5J2HKG1S type=del size=215526 2024-09-12T18:32:55.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.283+0000 7f41a072b8c0 1 < completed write operation key=XLGVEN6DF5EW tag=YDQLPXZXQTAR type=write size=465570 2024-09-12T18:32:55.289 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.287+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~88Z0BIVOZEID.0 size=1048576 2024-09-12T18:32:55.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.291+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~88Z0BIVOZEID.1 size=1048576 2024-09-12T18:32:55.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.291+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~88Z0BIVOZEID.2 size=789133 2024-09-12T18:32:55.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.291+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=88Z0BIVOZEID tag=I5HW3R4G4P1N type=write size=3934861 2024-09-12T18:32:55.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.295+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~AZVURTRBAY7E.0 size=905806 2024-09-12T18:32:55.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.299+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=AZVURTRBAY7E tag=N29VWN1S29BW type=write size=1954382 2024-09-12T18:32:55.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.307+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~B2XDZ41P4TVE.0 size=1048576 2024-09-12T18:32:55.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.307+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~B2XDZ41P4TVE.1 size=1048576 2024-09-12T18:32:55.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.311+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~B2XDZ41P4TVE.2 size=385994 2024-09-12T18:32:55.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.311+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=B2XDZ41P4TVE tag=1TIKCGP5H8TG type=write size=3531722 2024-09-12T18:32:55.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.315+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~K9E1YS2W25G4.0 size=1048576 2024-09-12T18:32:55.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.315+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~K9E1YS2W25G4.1 size=522304 2024-09-12T18:32:55.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.319+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=K9E1YS2W25G4 tag=STN2CPM4HSKG type=write size=2619456 2024-09-12T18:32:55.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.327+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~D26D6ACJEIS0.0 size=1048576 2024-09-12T18:32:55.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.327+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~D26D6ACJEIS0.1 size=1048576 2024-09-12T18:32:55.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.331+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~D26D6ACJEIS0.2 size=698434 2024-09-12T18:32:55.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.331+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=D26D6ACJEIS0 tag=8CFB9BOYZMGZ type=write size=3844162 2024-09-12T18:32:55.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.335+0000 7f41a072b8c0 1 < completed write operation key=NKMA8FG3V3TR tag=01GKBN71VG0G type=write size=431868 2024-09-12T18:32:55.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.339+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=ZN6FTIYNEUR0 type=del size=202881 2024-09-12T18:32:55.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.339+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=LUFMYMMV2FVX type=del 2024-09-12T18:32:55.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.343+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=LJ9ZSCR3D4IV type=del size=3617476 2024-09-12T18:32:55.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.355+0000 7f41a072b8c0 1 < suggested remove operation key=YP72VTCGSHYE tag=3VNX6V922BQL type=del 2024-09-12T18:32:55.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.359+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=X4IESO8CSWW7 type=del size=2292585 2024-09-12T18:32:55.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.359+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=8RIDTHBYWTSM type=del 2024-09-12T18:32:55.365 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.363+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=2H6851G9ELXW type=del size=973506 2024-09-12T18:32:55.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.367+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=AAEF04ZS4JBM type=del 2024-09-12T18:32:55.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.371+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=X2AA8EPOHJ8W type=write size=821482 2024-09-12T18:32:55.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.371+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=G5L947I2R0HV type=del 2024-09-12T18:32:55.377 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.375+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=RAO3YLZZGAM9 type=del size=600045 2024-09-12T18:32:55.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.379+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=EH55UCML4Z2X type=del 2024-09-12T18:32:55.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.383+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=DYNYC1ZOVJCK type=del size=635681 2024-09-12T18:32:55.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.387+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~OK9UFCEK7BKO.0 size=666869 2024-09-12T18:32:55.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.391+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=OK9UFCEK7BKO tag=Y403DZND754M type=write size=1715445 2024-09-12T18:32:55.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.395+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=XSMB7NC115UC type=del size=1203940 2024-09-12T18:32:55.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.399+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=VG0ULY69QCOA type=del 2024-09-12T18:32:55.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.403+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=VGOO7V6TVWIU type=del size=512531 2024-09-12T18:32:55.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.407+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~3ERP08LDVCJ8.0 size=1048576 2024-09-12T18:32:55.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.407+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~3ERP08LDVCJ8.1 size=562511 2024-09-12T18:32:55.415 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.415+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=3ERP08LDVCJ8 tag=J75AR9HEOGA5 type=write size=2659663 2024-09-12T18:32:55.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.419+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~5AE1CXHH7CWH.0 size=1048576 2024-09-12T18:32:55.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.423+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~5AE1CXHH7CWH.1 size=1048576 2024-09-12T18:32:55.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.423+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~5AE1CXHH7CWH.2 size=351638 2024-09-12T18:32:55.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.423+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=5AE1CXHH7CWH tag=5Q5T9GMLCLB3 type=write size=3497366 2024-09-12T18:32:55.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.427+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~MYNRJAH00BSI.0 size=1048576 2024-09-12T18:32:55.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.431+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~MYNRJAH00BSI.1 size=71549 2024-09-12T18:32:55.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.435+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=MYNRJAH00BSI tag=121URU5S4CHE type=write size=2168701 2024-09-12T18:32:55.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.439+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=OQ4LR20O6IPC type=del size=2019040 2024-09-12T18:32:55.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.439+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=JTWWPR15WZ7N type=del 2024-09-12T18:32:55.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.443+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=ACO4XV3KDVXV type=del size=2045761 2024-09-12T18:32:55.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.447+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=GOIP5J2HKG1S type=del 2024-09-12T18:32:55.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.451+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=3CX44BUS7N4S type=write size=304619 2024-09-12T18:32:55.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.455+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~88Z0BIVOZEID.0 size=1048576 2024-09-12T18:32:55.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.455+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~88Z0BIVOZEID.1 size=1048576 2024-09-12T18:32:55.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.459+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~88Z0BIVOZEID.2 size=789133 2024-09-12T18:32:55.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.463+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=88Z0BIVOZEID tag=I5HW3R4G4P1N type=write size=3934861 2024-09-12T18:32:55.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.467+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=6ATN1OV8RRWM type=write size=515338 2024-09-12T18:32:55.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.471+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~B2XDZ41P4TVE.0 size=1048576 2024-09-12T18:32:55.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.475+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~B2XDZ41P4TVE.1 size=1048576 2024-09-12T18:32:55.478 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.475+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~B2XDZ41P4TVE.2 size=385994 2024-09-12T18:32:55.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.483+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=B2XDZ41P4TVE tag=1TIKCGP5H8TG type=write size=3531722 2024-09-12T18:32:55.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.487+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~RLVQN5FDHUHX.0 size=75894 2024-09-12T18:32:55.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.487+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=RLVQN5FDHUHX tag=D13BFZ6TMB5C type=write size=1124470 2024-09-12T18:32:55.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.487+0000 7f41a072b8c0 1 < canceled part key=_multipart_GQHPUDV5BG1E.2~D26D6ACJEIS0.0 size=1048576 2024-09-12T18:32:55.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.491+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~D26D6ACJEIS0.1 size=1048576 2024-09-12T18:32:55.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.495+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~D26D6ACJEIS0.2 size=698434 2024-09-12T18:32:55.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.499+0000 7f41a072b8c0 1 < canceled multipart upload key=GQHPUDV5BG1E upload=D26D6ACJEIS0 tag=8CFB9BOYZMGZ type=write size=3844162 2024-09-12T18:32:55.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.503+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=LCXFCY5UNWFG type=del size=820640 2024-09-12T18:32:55.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.507+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=ZN6FTIYNEUR0 type=del 2024-09-12T18:32:55.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.507+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=ZCCFM2TNIGJ2 type=write size=976861 2024-09-12T18:32:55.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.511+0000 7f41a072b8c0 1 < completed delete operation key=NKMA8FG3V3TR tag=LJ9ZSCR3D4IV type=del 2024-09-12T18:32:55.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.515+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=SJK3AUO1AD64 type=del size=3680000 2024-09-12T18:32:55.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.519+0000 7f41a072b8c0 1 < completed delete operation key=3R9RN03RFRJP tag=X4IESO8CSWW7 type=del 2024-09-12T18:32:55.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.523+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=SI10FNWBW0O4 type=write size=16154 2024-09-12T18:32:55.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.527+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=2H6851G9ELXW type=del 2024-09-12T18:32:55.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.531+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=ULC81KGYIGG0 type=del size=579996 2024-09-12T18:32:55.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.535+0000 7f41a072b8c0 1 < completed write operation key=VEN0P2P1RZ2S tag=X2AA8EPOHJ8W type=write size=821482 2024-09-12T18:32:55.539 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.539+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=YJ3CUVNTKKUA type=del size=3230872 2024-09-12T18:32:55.546 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.543+0000 7f41a072b8c0 1 < suggested update operation key=SK3T82EJFZXE tag=RAO3YLZZGAM9 type=del size=600045 2024-09-12T18:32:55.549 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.547+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=YKF6OVAA0R5K type=del size=3719164 2024-09-12T18:32:55.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.551+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=DYNYC1ZOVJCK type=del 2024-09-12T18:32:55.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.555+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=S580C9XRC6HN type=del size=2760145 2024-09-12T18:32:55.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.559+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=XSMB7NC115UC type=del 2024-09-12T18:32:55.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.563+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=KWWTGSWJ52X0 type=write size=206219 2024-09-12T18:32:55.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.563+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=VGOO7V6TVWIU type=del 2024-09-12T18:32:55.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.567+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=7R165AHX7BNT type=del size=1069209 2024-09-12T18:32:55.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.567+0000 7f41a072b8c0 1 < canceled part key=_multipart_1BSAN5TRTZNZ.2~5AE1CXHH7CWH.0 size=1048576 2024-09-12T18:32:55.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.567+0000 7f41a072b8c0 1 < canceled part key=_multipart_1BSAN5TRTZNZ.2~5AE1CXHH7CWH.1 size=1048576 2024-09-12T18:32:55.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.571+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~5AE1CXHH7CWH.2 size=351638 2024-09-12T18:32:55.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.575+0000 7f41a072b8c0 1 < canceled multipart upload key=1BSAN5TRTZNZ upload=5AE1CXHH7CWH tag=5Q5T9GMLCLB3 type=write size=3497366 2024-09-12T18:32:55.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.579+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~UH2DNJATG4U3.0 size=1048576 2024-09-12T18:32:55.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.583+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~UH2DNJATG4U3.1 size=669241 2024-09-12T18:32:55.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.583+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=UH2DNJATG4U3 tag=E7GYL5BYQHGY type=write size=2766393 2024-09-12T18:32:55.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.587+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=OQ4LR20O6IPC type=del 2024-09-12T18:32:55.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.591+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~JYA5IE8VVLLN.0 size=1048576 2024-09-12T18:32:55.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.591+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~JYA5IE8VVLLN.1 size=785798 2024-09-12T18:32:55.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.591+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=JYA5IE8VVLLN tag=D49PN7E9S0AW type=write size=2882950 2024-09-12T18:32:55.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.595+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=ACO4XV3KDVXV type=del 2024-09-12T18:32:55.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.599+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=BW13TVBP2E07 type=write size=365848 2024-09-12T18:32:55.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.603+0000 7f41a072b8c0 1 < suggested update operation key=L01GL4WOUIL2 tag=3CX44BUS7N4S type=write size=304619 2024-09-12T18:32:55.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.607+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=8JGTYL6ZBOLR type=del size=1638575 2024-09-12T18:32:55.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.615+0000 7f41a072b8c0 1 < suggested update operation key=1BSAN5TRTZNZ tag=6ATN1OV8RRWM type=write size=515338 2024-09-12T18:32:55.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.619+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~5LWXGIFFVT6X.0 size=643953 2024-09-12T18:32:55.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.619+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=5LWXGIFFVT6X tag=7WZN0OPQPSJD type=write size=1692529 2024-09-12T18:32:55.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.623+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~RLVQN5FDHUHX.0 size=75894 2024-09-12T18:32:55.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.631+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=RLVQN5FDHUHX tag=D13BFZ6TMB5C type=write size=1124470 2024-09-12T18:32:55.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.631+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=YAR7S3HBKTOU type=del size=2684198 2024-09-12T18:32:55.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.635+0000 7f41a072b8c0 -1 < failed to complete operation key=1BSAN5TRTZNZ tag=LCXFCY5UNWFG type=del size=820640: (22) Invalid argument 2024-09-12T18:32:55.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.643+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~WMAID5KYMLVQ.0 size=1048576 2024-09-12T18:32:55.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.647+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~WMAID5KYMLVQ.1 size=796547 2024-09-12T18:32:55.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.647+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=WMAID5KYMLVQ tag=R1EZ2XKTYQ03 type=write size=2893699 2024-09-12T18:32:55.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.651+0000 7f41a072b8c0 -1 < failed to complete operation key=1BSAN5TRTZNZ tag=ZCCFM2TNIGJ2 type=write size=976861: (22) Invalid argument 2024-09-12T18:32:55.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.651+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=03TVEF5EIBQZ type=write size=522732 2024-09-12T18:32:55.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.659+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=SJK3AUO1AD64 type=del 2024-09-12T18:32:55.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.667+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~MKRL01H7N5O4.0 size=1048576 2024-09-12T18:32:55.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.667+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~MKRL01H7N5O4.1 size=933264 2024-09-12T18:32:55.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.667+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=MKRL01H7N5O4 tag=1FQWI1LX2HTD type=write size=3030416 2024-09-12T18:32:55.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.671+0000 7f41a072b8c0 1 < completed write operation key=0O97F5ON55TX tag=SI10FNWBW0O4 type=write size=16154 2024-09-12T18:32:55.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.675+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=FA53HDTBZK3G type=write size=270059 2024-09-12T18:32:55.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.679+0000 7f41a072b8c0 1 < canceled operation key=7B70QWGMH0C0 tag=ULC81KGYIGG0 type=del size=579996 2024-09-12T18:32:55.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.683+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~RS23GIX5LOG0.0 size=1048576 2024-09-12T18:32:55.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.687+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~RS23GIX5LOG0.1 size=88548 2024-09-12T18:32:55.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.687+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=RS23GIX5LOG0 tag=P1TZMW5NISDQ type=write size=2185700 2024-09-12T18:32:55.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.695+0000 7f41a072b8c0 1 < suggested remove operation key=YCBC1CHWJQC5 tag=YJ3CUVNTKKUA type=del 2024-09-12T18:32:55.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.699+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=4PDY0J5X5CCW type=del size=1401073 2024-09-12T18:32:55.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.703+0000 7f41a072b8c0 1 < suggested remove operation key=YP72VTCGSHYE tag=YKF6OVAA0R5K type=del 2024-09-12T18:32:55.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.707+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=ZCY71BFE9AT8 type=write size=392120 2024-09-12T18:32:55.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.715+0000 7f41a072b8c0 1 < suggested update operation key=5OD9IX408CYO tag=S580C9XRC6HN type=del size=2760145 2024-09-12T18:32:55.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.719+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=OVZHTG388ADP type=write size=490813 2024-09-12T18:32:55.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.723+0000 7f41a072b8c0 1 < completed write operation key=V35A7LK08C7J tag=KWWTGSWJ52X0 type=write size=206219 2024-09-12T18:32:55.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.727+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~U23S2KNU1FO6.0 size=20380 2024-09-12T18:32:55.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.727+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=U23S2KNU1FO6 tag=VK2T6UNCYBSI type=write size=1068956 2024-09-12T18:32:55.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.731+0000 7f41a072b8c0 1 < canceled operation key=3CGBX19WTMWQ tag=7R165AHX7BNT type=del size=1069209 2024-09-12T18:32:55.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.739+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~UT39FDSB0UV5.0 size=1048576 2024-09-12T18:32:55.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.739+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~UT39FDSB0UV5.1 size=726467 2024-09-12T18:32:55.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.739+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=UT39FDSB0UV5 tag=W01ZY31XC0TZ type=write size=2823619 2024-09-12T18:32:55.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.743+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~UH2DNJATG4U3.0 size=1048576 2024-09-12T18:32:55.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.747+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~UH2DNJATG4U3.1 size=669241 2024-09-12T18:32:55.754 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.751+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=UH2DNJATG4U3 tag=E7GYL5BYQHGY type=write size=2766393 2024-09-12T18:32:55.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.759+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~2W5IS19N9QKL.0 size=185461 2024-09-12T18:32:55.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.759+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=2W5IS19N9QKL tag=15XCO2CYY2JC type=write size=1234037 2024-09-12T18:32:55.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.763+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~JYA5IE8VVLLN.0 size=1048576 2024-09-12T18:32:55.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.767+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~JYA5IE8VVLLN.1 size=785798 2024-09-12T18:32:55.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.771+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=JYA5IE8VVLLN tag=D49PN7E9S0AW type=write size=2882950 2024-09-12T18:32:55.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.775+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=BI1WC0JR33CS type=del size=2555477 2024-09-12T18:32:55.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.779+0000 7f41a072b8c0 1 < canceled operation key=63BP9QETTAM8 tag=BW13TVBP2E07 type=write size=365848 2024-09-12T18:32:55.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.779+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=YF17IH80TNGA type=del size=2089152 2024-09-12T18:32:55.785 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.783+0000 7f41a072b8c0 -1 < failed to complete operation key=YCBC1CHWJQC5 tag=8JGTYL6ZBOLR type=del size=1638575: (22) Invalid argument 2024-09-12T18:32:55.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.787+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=B5UNUG33HJFY type=del size=488992 2024-09-12T18:32:55.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.791+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~5LWXGIFFVT6X.0 size=643953 2024-09-12T18:32:55.798 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.795+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=5LWXGIFFVT6X tag=7WZN0OPQPSJD type=write size=1692529 2024-09-12T18:32:55.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.799+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=430H6F0RFW4P type=del size=1857765 2024-09-12T18:32:55.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.803+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=YAR7S3HBKTOU type=del 2024-09-12T18:32:55.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.807+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=1OBXDRW35JP5 type=del size=1913731 2024-09-12T18:32:55.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.811+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~WMAID5KYMLVQ.0 size=1048576 2024-09-12T18:32:55.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.811+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~WMAID5KYMLVQ.1 size=796547 2024-09-12T18:32:55.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.819+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=WMAID5KYMLVQ tag=R1EZ2XKTYQ03 type=write size=2893699 2024-09-12T18:32:55.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.823+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~6PQBQPQ7UYJZ.0 size=888536 2024-09-12T18:32:55.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.823+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=6PQBQPQ7UYJZ tag=JQDQ6QILBSGA type=write size=1937112 2024-09-12T18:32:55.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.827+0000 7f41a072b8c0 1 < canceled operation key=GC8797KSO47E tag=03TVEF5EIBQZ type=write size=522732 2024-09-12T18:32:55.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.831+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~LLSGEOK9S5AZ.0 size=51799 2024-09-12T18:32:55.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.831+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=LLSGEOK9S5AZ tag=152HJLJA52Q3 type=write size=1100375 2024-09-12T18:32:55.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.835+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~MKRL01H7N5O4.0 size=1048576 2024-09-12T18:32:55.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.839+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~MKRL01H7N5O4.1 size=933264 2024-09-12T18:32:55.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.843+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=MKRL01H7N5O4 tag=1FQWI1LX2HTD type=write size=3030416 2024-09-12T18:32:55.848 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.847+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=7XU3VJSB8M9R type=del size=637806 2024-09-12T18:32:55.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.851+0000 7f41a072b8c0 1 < completed write operation key=0G0YWIOD3L3I tag=FA53HDTBZK3G type=write size=270059 2024-09-12T18:32:55.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.855+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~PRB849GPCNMG.0 size=117465 2024-09-12T18:32:55.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.855+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=PRB849GPCNMG tag=PJ4UO1KKBYS3 type=write size=1166041 2024-09-12T18:32:55.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.859+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~RS23GIX5LOG0.0 size=1048576 2024-09-12T18:32:55.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.863+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~RS23GIX5LOG0.1 size=88548 2024-09-12T18:32:55.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.867+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=RS23GIX5LOG0 tag=P1TZMW5NISDQ type=write size=2185700 2024-09-12T18:32:55.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.871+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=XJL2Q37JRO01 type=del size=922104 2024-09-12T18:32:55.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.871+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=4PDY0J5X5CCW type=del 2024-09-12T18:32:55.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.875+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~XTNH4CGPVZ4M.0 size=1048576 2024-09-12T18:32:55.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.879+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~XTNH4CGPVZ4M.1 size=561737 2024-09-12T18:32:55.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.879+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=XTNH4CGPVZ4M tag=UNFVNNM930PS type=write size=2658889 2024-09-12T18:32:55.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.883+0000 7f41a072b8c0 1 < completed write operation key=C2PRRD3QO9AF tag=ZCY71BFE9AT8 type=write size=392120 2024-09-12T18:32:55.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.887+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~TQRYFNX819S7.0 size=1048576 2024-09-12T18:32:55.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.887+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~TQRYFNX819S7.1 size=1048576 2024-09-12T18:32:55.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.891+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~TQRYFNX819S7.2 size=543808 2024-09-12T18:32:55.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.891+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=TQRYFNX819S7 tag=AWPLYEV09M7U type=write size=3689536 2024-09-12T18:32:55.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.895+0000 7f41a072b8c0 1 < completed write operation key=GQHPUDV5BG1E tag=OVZHTG388ADP type=write size=490813 2024-09-12T18:32:55.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.899+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=EJUXE01EY845 type=del size=2549702 2024-09-12T18:32:55.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.899+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~U23S2KNU1FO6.0 size=20380 2024-09-12T18:32:55.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.907+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=U23S2KNU1FO6 tag=VK2T6UNCYBSI type=write size=1068956 2024-09-12T18:32:55.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.911+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~UGQF5TM35B4A.0 size=949378 2024-09-12T18:32:55.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.911+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=UGQF5TM35B4A tag=V3EB73I14GK9 type=write size=1997954 2024-09-12T18:32:55.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.911+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~UT39FDSB0UV5.0 size=1048576 2024-09-12T18:32:55.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.915+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~UT39FDSB0UV5.1 size=726467 2024-09-12T18:32:55.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.919+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=UT39FDSB0UV5 tag=W01ZY31XC0TZ type=write size=2823619 2024-09-12T18:32:55.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.923+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~7TZLPZPGYPQ2.0 size=1048576 2024-09-12T18:32:55.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.927+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~7TZLPZPGYPQ2.1 size=572595 2024-09-12T18:32:55.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.927+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=7TZLPZPGYPQ2 tag=VWO9HT9LTCY7 type=write size=2669747 2024-09-12T18:32:55.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.927+0000 7f41a072b8c0 1 < canceled part key=_multipart_3CGBX19WTMWQ.2~2W5IS19N9QKL.0 size=185461 2024-09-12T18:32:55.931 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.931+0000 7f41a072b8c0 1 < canceled multipart upload key=3CGBX19WTMWQ upload=2W5IS19N9QKL tag=15XCO2CYY2JC type=write size=1234037 2024-09-12T18:32:55.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.931+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=SE1NJSVI957T type=del size=1168175 2024-09-12T18:32:55.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.935+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=BI1WC0JR33CS type=del 2024-09-12T18:32:55.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.939+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=3IQWN92FRYPX type=del size=771336 2024-09-12T18:32:55.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.939+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=YF17IH80TNGA type=del 2024-09-12T18:32:55.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.943+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~HGXLZH0GNSXE.0 size=1048576 2024-09-12T18:32:55.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.947+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~HGXLZH0GNSXE.1 size=1048576 2024-09-12T18:32:55.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.951+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~HGXLZH0GNSXE.2 size=311137 2024-09-12T18:32:55.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.951+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=HGXLZH0GNSXE tag=44NLWIWM390D type=write size=3456865 2024-09-12T18:32:55.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.951+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=B5UNUG33HJFY type=del 2024-09-12T18:32:55.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.955+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=I71PMU26ZRYC type=del size=3855262 2024-09-12T18:32:55.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.959+0000 7f41a072b8c0 1 < suggested remove operation key=V35A7LK08C7J tag=430H6F0RFW4P type=del 2024-09-12T18:32:55.965 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.963+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~OVT0WF4W4QV4.0 size=1048576 2024-09-12T18:32:55.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.967+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~OVT0WF4W4QV4.1 size=469815 2024-09-12T18:32:55.967 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.967+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=OVT0WF4W4QV4 tag=TYEZP3OT12E3 type=write size=2566967 2024-09-12T18:32:55.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.967+0000 7f41a072b8c0 1 < canceled operation key=KP2HF4J376EY tag=1OBXDRW35JP5 type=del size=1913731 2024-09-12T18:32:55.972 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.971+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=303OILWJAYE9 type=del size=2279266 2024-09-12T18:32:55.975 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.975+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~6PQBQPQ7UYJZ.0 size=888536 2024-09-12T18:32:55.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.979+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=6PQBQPQ7UYJZ tag=JQDQ6QILBSGA type=write size=1937112 2024-09-12T18:32:55.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.983+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~O6HCPO1LQ3ZX.0 size=1048576 2024-09-12T18:32:55.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.983+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~O6HCPO1LQ3ZX.1 size=1048576 2024-09-12T18:32:55.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.987+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~O6HCPO1LQ3ZX.2 size=952257 2024-09-12T18:32:55.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.987+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=O6HCPO1LQ3ZX tag=J0FE98ZFA51R type=write size=4097985 2024-09-12T18:32:55.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.991+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~LLSGEOK9S5AZ.0 size=51799 2024-09-12T18:32:55.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.995+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=LLSGEOK9S5AZ tag=152HJLJA52Q3 type=write size=1100375 2024-09-12T18:32:56.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.999+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~ESIGF1QS6ZB8.0 size=17196 2024-09-12T18:32:56.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:55.999+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=ESIGF1QS6ZB8 tag=MHPOW2YB03DY type=write size=1065772 2024-09-12T18:32:56.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.003+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=7XU3VJSB8M9R type=del 2024-09-12T18:32:56.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.007+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~435SUQXZRFZK.0 size=1048576 2024-09-12T18:32:56.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.007+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~435SUQXZRFZK.1 size=1048576 2024-09-12T18:32:56.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.011+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~435SUQXZRFZK.2 size=195570 2024-09-12T18:32:56.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.011+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=435SUQXZRFZK tag=ORZ2ZFU7AT1N type=write size=3341298 2024-09-12T18:32:56.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.011+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~PRB849GPCNMG.0 size=117465 2024-09-12T18:32:56.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.015+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=PRB849GPCNMG tag=PJ4UO1KKBYS3 type=write size=1166041 2024-09-12T18:32:56.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.019+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=98H9LY0I4ZSP type=del size=444301 2024-09-12T18:32:56.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.023+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=XJL2Q37JRO01 type=del 2024-09-12T18:32:56.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.023+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=SI0SQ0365GHR type=del size=3996956 2024-09-12T18:32:56.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.027+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~XTNH4CGPVZ4M.0 size=1048576 2024-09-12T18:32:56.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.031+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~XTNH4CGPVZ4M.1 size=561737 2024-09-12T18:32:56.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.035+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=XTNH4CGPVZ4M tag=UNFVNNM930PS type=write size=2658889 2024-09-12T18:32:56.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.035+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=2MEF0G22MFLJ type=write size=204506 2024-09-12T18:32:56.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.039+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~TQRYFNX819S7.0 size=1048576 2024-09-12T18:32:56.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.039+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~TQRYFNX819S7.1 size=1048576 2024-09-12T18:32:56.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.039+0000 7f41a072b8c0 1 < canceled part key=_multipart_L01GL4WOUIL2.2~TQRYFNX819S7.2 size=543808 2024-09-12T18:32:56.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.043+0000 7f41a072b8c0 1 < canceled multipart upload key=L01GL4WOUIL2 upload=TQRYFNX819S7 tag=AWPLYEV09M7U type=write size=3689536 2024-09-12T18:32:56.050 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.051+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~KUDBS9VWN0PE.0 size=1048576 2024-09-12T18:32:56.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.051+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~KUDBS9VWN0PE.1 size=1048576 2024-09-12T18:32:56.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.055+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~KUDBS9VWN0PE.2 size=705597 2024-09-12T18:32:56.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.055+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=KUDBS9VWN0PE tag=VLBQMG7JHQB3 type=write size=3851325 2024-09-12T18:32:56.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.055+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=EJUXE01EY845 type=del 2024-09-12T18:32:56.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.059+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=8A20G95WVYP8 type=del size=2741295 2024-09-12T18:32:56.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.063+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~UGQF5TM35B4A.0 size=949378 2024-09-12T18:32:56.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.067+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=UGQF5TM35B4A tag=V3EB73I14GK9 type=write size=1997954 2024-09-12T18:32:56.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.071+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=L7W2J3BC3Y8L type=del size=502499 2024-09-12T18:32:56.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.075+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~7TZLPZPGYPQ2.0 size=1048576 2024-09-12T18:32:56.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.075+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~7TZLPZPGYPQ2.1 size=572595 2024-09-12T18:32:56.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.079+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=7TZLPZPGYPQ2 tag=VWO9HT9LTCY7 type=write size=2669747 2024-09-12T18:32:56.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.083+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=VKV0TOXJPDG3 type=del size=1733080 2024-09-12T18:32:56.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.087+0000 7f41a072b8c0 1 < canceled operation key=KOLD6WYK30EQ tag=SE1NJSVI957T type=del size=1168175 2024-09-12T18:32:56.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.091+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=SR93NCROIG1A type=del size=2188814 2024-09-12T18:32:56.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.095+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=3IQWN92FRYPX type=del 2024-09-12T18:32:56.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.095+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=M2Z9DXHH0FE8 type=del size=3300874 2024-09-12T18:32:56.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.099+0000 7f41a072b8c0 1 < canceled part key=_multipart_7MRN7L1DTAMO.2~HGXLZH0GNSXE.0 size=1048576 2024-09-12T18:32:56.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.099+0000 7f41a072b8c0 1 < canceled part key=_multipart_7MRN7L1DTAMO.2~HGXLZH0GNSXE.1 size=1048576 2024-09-12T18:32:56.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.099+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~HGXLZH0GNSXE.2 size=311137 2024-09-12T18:32:56.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.103+0000 7f41a072b8c0 1 < canceled multipart upload key=7MRN7L1DTAMO upload=HGXLZH0GNSXE tag=44NLWIWM390D type=write size=3456865 2024-09-12T18:32:56.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.107+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~P3IBTZ0S9WAU.0 size=371354 2024-09-12T18:32:56.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.107+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=P3IBTZ0S9WAU tag=UT3VGOQWLTPY type=write size=1419930 2024-09-12T18:32:56.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.111+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=I71PMU26ZRYC type=del 2024-09-12T18:32:56.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.115+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~H9Q8QHM00MSR.0 size=1048576 2024-09-12T18:32:56.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.119+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~H9Q8QHM00MSR.1 size=420661 2024-09-12T18:32:56.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.119+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=H9Q8QHM00MSR tag=162E62G6180H type=write size=2517813 2024-09-12T18:32:56.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.123+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~OVT0WF4W4QV4.0 size=1048576 2024-09-12T18:32:56.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.123+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~OVT0WF4W4QV4.1 size=469815 2024-09-12T18:32:56.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.131+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=OVT0WF4W4QV4 tag=TYEZP3OT12E3 type=write size=2566967 2024-09-12T18:32:56.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.135+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~A5WYY4L513B0.0 size=1048576 2024-09-12T18:32:56.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.135+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~A5WYY4L513B0.1 size=1048576 2024-09-12T18:32:56.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.139+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~A5WYY4L513B0.2 size=117040 2024-09-12T18:32:56.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.139+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=A5WYY4L513B0 tag=NNPP2VGFG68C type=write size=3262768 2024-09-12T18:32:56.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.143+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=303OILWJAYE9 type=del 2024-09-12T18:32:56.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.147+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~E8KDKAECPE2H.0 size=816053 2024-09-12T18:32:56.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.147+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=E8KDKAECPE2H tag=DUPOWR9DKUI5 type=write size=1864629 2024-09-12T18:32:56.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.151+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~O6HCPO1LQ3ZX.0 size=1048576 2024-09-12T18:32:56.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.155+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~O6HCPO1LQ3ZX.1 size=1048576 2024-09-12T18:32:56.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.155+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~O6HCPO1LQ3ZX.2 size=952257 2024-09-12T18:32:56.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.159+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=O6HCPO1LQ3ZX tag=J0FE98ZFA51R type=write size=4097985 2024-09-12T18:32:56.164 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.163+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=58GWI1GXYVKK type=write size=236119 2024-09-12T18:32:56.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.167+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~ESIGF1QS6ZB8.0 size=17196 2024-09-12T18:32:56.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.171+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=ESIGF1QS6ZB8 tag=MHPOW2YB03DY type=write size=1065772 2024-09-12T18:32:56.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.171+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=ZJLYRI10UH4Q type=del size=3239046 2024-09-12T18:32:56.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.175+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~435SUQXZRFZK.0 size=1048576 2024-09-12T18:32:56.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.179+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~435SUQXZRFZK.1 size=1048576 2024-09-12T18:32:56.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.179+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~435SUQXZRFZK.2 size=195570 2024-09-12T18:32:56.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.187+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=435SUQXZRFZK tag=ORZ2ZFU7AT1N type=write size=3341298 2024-09-12T18:32:56.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.187+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=1FZQ01P8QNJV type=write size=527314 2024-09-12T18:32:56.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.191+0000 7f41a072b8c0 1 < completed delete operation key=YP72VTCGSHYE tag=98H9LY0I4ZSP type=del 2024-09-12T18:32:56.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.203+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~23OAL5OKJTSA.0 size=1048576 2024-09-12T18:32:56.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.203+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~23OAL5OKJTSA.1 size=1048576 2024-09-12T18:32:56.207 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.207+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~23OAL5OKJTSA.2 size=61194 2024-09-12T18:32:56.208 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.207+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=23OAL5OKJTSA tag=MTNY4YE85W87 type=write size=3206922 2024-09-12T18:32:56.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.211+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=SI0SQ0365GHR type=del 2024-09-12T18:32:56.214 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.211+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=B19QM0WBTB35 type=del size=1251205 2024-09-12T18:32:56.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.215+0000 7f41a072b8c0 1 < completed write operation key=GC8797KSO47E tag=2MEF0G22MFLJ type=write size=204506 2024-09-12T18:32:56.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.219+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=YSEEHONBCFBY type=del size=1221458 2024-09-12T18:32:56.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.223+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~KUDBS9VWN0PE.0 size=1048576 2024-09-12T18:32:56.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.223+0000 7f41a072b8c0 1 < canceled part key=_multipart_3R9RN03RFRJP.2~KUDBS9VWN0PE.1 size=1048576 2024-09-12T18:32:56.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.223+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~KUDBS9VWN0PE.2 size=705597 2024-09-12T18:32:56.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.231+0000 7f41a072b8c0 1 < canceled multipart upload key=3R9RN03RFRJP upload=KUDBS9VWN0PE tag=VLBQMG7JHQB3 type=write size=3851325 2024-09-12T18:32:56.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.235+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=72UK57Y0VU0Z type=del size=550968 2024-09-12T18:32:56.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.239+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=8A20G95WVYP8 type=del 2024-09-12T18:32:56.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.239+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=Z27UJFG5SVLK type=del size=31231 2024-09-12T18:32:56.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.243+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=L7W2J3BC3Y8L type=del 2024-09-12T18:32:56.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.247+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~IGTZYOWTLEOY.0 size=1048576 2024-09-12T18:32:56.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.251+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~IGTZYOWTLEOY.1 size=64291 2024-09-12T18:32:56.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.251+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=IGTZYOWTLEOY tag=903Q0SXEUFLQ type=write size=2161443 2024-09-12T18:32:56.258 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.255+0000 7f41a072b8c0 1 < suggested remove operation key=1JIIRDVMT0B0 tag=VKV0TOXJPDG3 type=del 2024-09-12T18:32:56.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.259+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=9D8BNK4DA3HI type=write size=851000 2024-09-12T18:32:56.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.263+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=SR93NCROIG1A type=del 2024-09-12T18:32:56.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.267+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~KO9DR6TUC650.0 size=129246 2024-09-12T18:32:56.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.267+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=KO9DR6TUC650 tag=CGE61ER20DGY type=write size=1177822 2024-09-12T18:32:56.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.271+0000 7f41a072b8c0 1 < completed delete operation key=YP72VTCGSHYE tag=M2Z9DXHH0FE8 type=del 2024-09-12T18:32:56.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.275+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~W8WNSKFDQZW0.0 size=159101 2024-09-12T18:32:56.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.275+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=W8WNSKFDQZW0 tag=DQBWUWMQEKHZ type=write size=1207677 2024-09-12T18:32:56.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.279+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~P3IBTZ0S9WAU.0 size=371354 2024-09-12T18:32:56.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.283+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=P3IBTZ0S9WAU tag=UT3VGOQWLTPY type=write size=1419930 2024-09-12T18:32:56.289 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.287+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~BI7ZBPJYHHIK.0 size=1048576 2024-09-12T18:32:56.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.291+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~BI7ZBPJYHHIK.1 size=181442 2024-09-12T18:32:56.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.291+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=BI7ZBPJYHHIK tag=I4J257GOCMW9 type=write size=2278594 2024-09-12T18:32:56.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.291+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~H9Q8QHM00MSR.0 size=1048576 2024-09-12T18:32:56.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.295+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~H9Q8QHM00MSR.1 size=420661 2024-09-12T18:32:56.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.299+0000 7f41a072b8c0 1 < completed multipart upload key=A6GQZL25YSNL upload=H9Q8QHM00MSR tag=162E62G6180H type=write size=2517813 2024-09-12T18:32:56.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.303+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=3NV0RENSWXVW type=del size=2979092 2024-09-12T18:32:56.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.307+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~A5WYY4L513B0.0 size=1048576 2024-09-12T18:32:56.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.307+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~A5WYY4L513B0.1 size=1048576 2024-09-12T18:32:56.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.311+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~A5WYY4L513B0.2 size=117040 2024-09-12T18:32:56.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.315+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=A5WYY4L513B0 tag=NNPP2VGFG68C type=write size=3262768 2024-09-12T18:32:56.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.319+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~P63VIV46ECXF.0 size=1048576 2024-09-12T18:32:56.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.323+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~P63VIV46ECXF.1 size=528167 2024-09-12T18:32:56.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.323+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=P63VIV46ECXF tag=G3F1PCYUITZF type=write size=2625319 2024-09-12T18:32:56.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.327+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~E8KDKAECPE2H.0 size=816053 2024-09-12T18:32:56.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.331+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=E8KDKAECPE2H tag=DUPOWR9DKUI5 type=write size=1864629 2024-09-12T18:32:56.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.335+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~LK1G4YXBUFJW.0 size=1048576 2024-09-12T18:32:56.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.339+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~LK1G4YXBUFJW.1 size=122855 2024-09-12T18:32:56.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.339+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=LK1G4YXBUFJW tag=119LSINAH686 type=write size=2220007 2024-09-12T18:32:56.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.343+0000 7f41a072b8c0 1 < completed write operation key=SK3T82EJFZXE tag=58GWI1GXYVKK type=write size=236119 2024-09-12T18:32:56.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.343+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=KTFSSNAT90XA type=del size=2870429 2024-09-12T18:32:56.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.347+0000 7f41a072b8c0 -1 < failed to complete operation key=1JIIRDVMT0B0 tag=ZJLYRI10UH4Q type=del size=3239046: (22) Invalid argument 2024-09-12T18:32:56.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.351+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=A4DY6KKTC9B1 type=del size=2653639 2024-09-12T18:32:56.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.355+0000 7f41a072b8c0 1 < completed write operation key=GQHPUDV5BG1E tag=1FZQ01P8QNJV type=write size=527314 2024-09-12T18:32:56.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.359+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~HR64A8RKOJKW.0 size=1048576 2024-09-12T18:32:56.363 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.363+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~HR64A8RKOJKW.1 size=888206 2024-09-12T18:32:56.363 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.363+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=HR64A8RKOJKW tag=KG2INIX93LOE type=write size=2985358 2024-09-12T18:32:56.367 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.367+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~23OAL5OKJTSA.0 size=1048576 2024-09-12T18:32:56.369 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.367+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~23OAL5OKJTSA.1 size=1048576 2024-09-12T18:32:56.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.371+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~23OAL5OKJTSA.2 size=61194 2024-09-12T18:32:56.377 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.375+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=23OAL5OKJTSA tag=MTNY4YE85W87 type=write size=3206922 2024-09-12T18:32:56.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.379+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=BHQMZ8XS7DO1 type=del size=1444711 2024-09-12T18:32:56.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.383+0000 7f41a072b8c0 1 < completed delete operation key=NKMA8FG3V3TR tag=B19QM0WBTB35 type=del 2024-09-12T18:32:56.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.387+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=TDQK2XLG4YFA type=del size=2099500 2024-09-12T18:32:56.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.387+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=YSEEHONBCFBY type=del 2024-09-12T18:32:56.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.391+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=KR7OI9J5IQ3N type=del size=498176 2024-09-12T18:32:56.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.395+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=72UK57Y0VU0Z type=del 2024-09-12T18:32:56.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.399+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=P0H04DOLQ4ZN type=write size=30997 2024-09-12T18:32:56.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.403+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=Z27UJFG5SVLK type=del 2024-09-12T18:32:56.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.407+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~FBUMPDCQO4OO.0 size=738603 2024-09-12T18:32:56.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.407+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=FBUMPDCQO4OO tag=EPY1GQX01U1G type=write size=1787179 2024-09-12T18:32:56.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.411+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~IGTZYOWTLEOY.0 size=1048576 2024-09-12T18:32:56.415 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.415+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~IGTZYOWTLEOY.1 size=64291 2024-09-12T18:32:56.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.419+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=IGTZYOWTLEOY tag=903Q0SXEUFLQ type=write size=2161443 2024-09-12T18:32:56.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.427+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~8YT6TRC7VVDG.0 size=1048576 2024-09-12T18:32:56.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.427+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~8YT6TRC7VVDG.1 size=1048576 2024-09-12T18:32:56.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.431+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~8YT6TRC7VVDG.2 size=462812 2024-09-12T18:32:56.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.431+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=8YT6TRC7VVDG tag=JY4KD1HU23SF type=write size=3608540 2024-09-12T18:32:56.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.435+0000 7f41a072b8c0 1 < completed write operation key=ZACT36ZOC9ES tag=9D8BNK4DA3HI type=write size=851000 2024-09-12T18:32:56.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.439+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~VYNDTXJBVDB2.0 size=75677 2024-09-12T18:32:56.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.439+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=VYNDTXJBVDB2 tag=8NP43KX60S7Z type=write size=1124253 2024-09-12T18:32:56.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.443+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~KO9DR6TUC650.0 size=129246 2024-09-12T18:32:56.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.447+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=KO9DR6TUC650 tag=CGE61ER20DGY type=write size=1177822 2024-09-12T18:32:56.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.451+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=TGV9R4UN41IV type=del size=1701871 2024-09-12T18:32:56.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.451+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~W8WNSKFDQZW0.0 size=159101 2024-09-12T18:32:56.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.459+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=W8WNSKFDQZW0 tag=DQBWUWMQEKHZ type=write size=1207677 2024-09-12T18:32:56.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.463+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=2FMUFWH7ZFEM type=del size=1518703 2024-09-12T18:32:56.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.463+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~BI7ZBPJYHHIK.0 size=1048576 2024-09-12T18:32:56.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.467+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~BI7ZBPJYHHIK.1 size=181442 2024-09-12T18:32:56.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.471+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=BI7ZBPJYHHIK tag=I4J257GOCMW9 type=write size=2278594 2024-09-12T18:32:56.478 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.475+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=10Y5ZBW3ZDCV type=del size=3272332 2024-09-12T18:32:56.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.479+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=3NV0RENSWXVW type=del 2024-09-12T18:32:56.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.487+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=1ZBCLNMKIQGG type=del size=2878543 2024-09-12T18:32:56.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.487+0000 7f41a072b8c0 1 < canceled part key=_multipart_3CGBX19WTMWQ.2~P63VIV46ECXF.0 size=1048576 2024-09-12T18:32:56.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.487+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~P63VIV46ECXF.1 size=528167 2024-09-12T18:32:56.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.491+0000 7f41a072b8c0 1 < canceled multipart upload key=3CGBX19WTMWQ upload=P63VIV46ECXF tag=G3F1PCYUITZF type=write size=2625319 2024-09-12T18:32:56.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.495+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=QDXVJWW4LO7P type=del size=1831448 2024-09-12T18:32:56.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.499+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~LK1G4YXBUFJW.0 size=1048576 2024-09-12T18:32:56.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.503+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~LK1G4YXBUFJW.1 size=122855 2024-09-12T18:32:56.508 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.507+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=LK1G4YXBUFJW tag=119LSINAH686 type=write size=2220007 2024-09-12T18:32:56.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.515+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~DO9G7GCTH5I8.0 size=1048576 2024-09-12T18:32:56.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.515+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~DO9G7GCTH5I8.1 size=1048576 2024-09-12T18:32:56.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.519+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~DO9G7GCTH5I8.2 size=424111 2024-09-12T18:32:56.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.519+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=DO9G7GCTH5I8 tag=QJOGD1ROICFL type=write size=3569839 2024-09-12T18:32:56.523 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.523+0000 7f41a072b8c0 1 < completed delete operation key=3R9RN03RFRJP tag=KTFSSNAT90XA type=del 2024-09-12T18:32:56.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.527+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=F0YB3II9FSQP type=del size=1268665 2024-09-12T18:32:56.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.531+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=A4DY6KKTC9B1 type=del 2024-09-12T18:32:56.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.535+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=L3UPXN651UW9 type=del size=317962 2024-09-12T18:32:56.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.535+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~HR64A8RKOJKW.0 size=1048576 2024-09-12T18:32:56.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.539+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~HR64A8RKOJKW.1 size=888206 2024-09-12T18:32:56.547 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.547+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=HR64A8RKOJKW tag=KG2INIX93LOE type=write size=2985358 2024-09-12T18:32:56.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.551+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=R0YXODMN4V29 type=del size=377662 2024-09-12T18:32:56.555 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.555+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=BHQMZ8XS7DO1 type=del 2024-09-12T18:32:56.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.559+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=82TZSDCRKHL2 type=del size=3741582 2024-09-12T18:32:56.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.559+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=TDQK2XLG4YFA type=del 2024-09-12T18:32:56.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.567+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=2K2JSESZYR8X type=del size=2285694 2024-09-12T18:32:56.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.571+0000 7f41a072b8c0 1 < suggested update operation key=YCBC1CHWJQC5 tag=KR7OI9J5IQ3N type=del size=498176 2024-09-12T18:32:56.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.579+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~E9PBP8QK7CTV.0 size=1048576 2024-09-12T18:32:56.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.583+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~E9PBP8QK7CTV.1 size=5080 2024-09-12T18:32:56.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.583+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=E9PBP8QK7CTV tag=1QJ2J5XHSIZZ type=write size=2102232 2024-09-12T18:32:56.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.583+0000 7f41a072b8c0 1 < completed write operation key=1BSAN5TRTZNZ tag=P0H04DOLQ4ZN type=write size=30997 2024-09-12T18:32:56.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.591+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~CIB9CLBX844U.0 size=1048576 2024-09-12T18:32:56.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.595+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~CIB9CLBX844U.1 size=288701 2024-09-12T18:32:56.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.595+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=CIB9CLBX844U tag=MJBCXZKXV1B7 type=write size=2385853 2024-09-12T18:32:56.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.595+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~FBUMPDCQO4OO.0 size=738603 2024-09-12T18:32:56.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.603+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=FBUMPDCQO4OO tag=EPY1GQX01U1G type=write size=1787179 2024-09-12T18:32:56.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.607+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=N7GB8KULLAVJ type=write size=162199 2024-09-12T18:32:56.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.611+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~8YT6TRC7VVDG.0 size=1048576 2024-09-12T18:32:56.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.611+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~8YT6TRC7VVDG.1 size=1048576 2024-09-12T18:32:56.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.615+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~8YT6TRC7VVDG.2 size=462812 2024-09-12T18:32:56.621 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.619+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=8YT6TRC7VVDG tag=JY4KD1HU23SF type=write size=3608540 2024-09-12T18:32:56.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.627+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~W60D5GJCDFIR.0 size=669666 2024-09-12T18:32:56.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.627+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=W60D5GJCDFIR tag=YTHCKI1BZPL6 type=write size=1718242 2024-09-12T18:32:56.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.631+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~VYNDTXJBVDB2.0 size=75677 2024-09-12T18:32:56.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.635+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=VYNDTXJBVDB2 tag=8NP43KX60S7Z type=write size=1124253 2024-09-12T18:32:56.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.639+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=DHZ6SD3XO9R3 type=del size=4116897 2024-09-12T18:32:56.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.643+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=TGV9R4UN41IV type=del 2024-09-12T18:32:56.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.647+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~FVHNJM6QTMOX.0 size=1048576 2024-09-12T18:32:56.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.651+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~FVHNJM6QTMOX.1 size=336486 2024-09-12T18:32:56.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.651+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=FVHNJM6QTMOX tag=J160NNB1M673 type=write size=2433638 2024-09-12T18:32:56.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.655+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=2FMUFWH7ZFEM type=del 2024-09-12T18:32:56.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.659+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~M20JA6IFCQCR.0 size=1048576 2024-09-12T18:32:56.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.663+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~M20JA6IFCQCR.1 size=71307 2024-09-12T18:32:56.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.663+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=M20JA6IFCQCR tag=QCXWB0KD6V5L type=write size=2168459 2024-09-12T18:32:56.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.671+0000 7f41a072b8c0 1 < suggested remove operation key=P732C5X0RG8Z tag=10Y5ZBW3ZDCV type=del 2024-09-12T18:32:56.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.675+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~0PUSE43CXA3Z.0 size=1048576 2024-09-12T18:32:56.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.679+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~0PUSE43CXA3Z.1 size=1048576 2024-09-12T18:32:56.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.679+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~0PUSE43CXA3Z.2 size=621544 2024-09-12T18:32:56.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.679+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=0PUSE43CXA3Z tag=WS9T5HCGDRQ3 type=write size=3767272 2024-09-12T18:32:56.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.683+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=1ZBCLNMKIQGG type=del 2024-09-12T18:32:56.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.691+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~64I17TNFRUY4.0 size=1048576 2024-09-12T18:32:56.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.691+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~64I17TNFRUY4.1 size=1048576 2024-09-12T18:32:56.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.695+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~64I17TNFRUY4.2 size=998992 2024-09-12T18:32:56.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.695+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=64I17TNFRUY4 tag=X7LP6GOBHMHM type=write size=4144720 2024-09-12T18:32:56.700 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.699+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=QDXVJWW4LO7P type=del 2024-09-12T18:32:56.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.703+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~5ONBR1WU5LAU.0 size=482797 2024-09-12T18:32:56.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.703+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=5ONBR1WU5LAU tag=583FI6CWOPMB type=write size=1531373 2024-09-12T18:32:56.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.707+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~DO9G7GCTH5I8.0 size=1048576 2024-09-12T18:32:56.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.711+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~DO9G7GCTH5I8.1 size=1048576 2024-09-12T18:32:56.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.711+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~DO9G7GCTH5I8.2 size=424111 2024-09-12T18:32:56.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.719+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=DO9G7GCTH5I8 tag=QJOGD1ROICFL type=write size=3569839 2024-09-12T18:32:56.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.719+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=3D5HWVZFDYW7 type=del size=2285984 2024-09-12T18:32:56.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.727+0000 7f41a072b8c0 1 < suggested remove operation key=GC8797KSO47E tag=F0YB3II9FSQP type=del 2024-09-12T18:32:56.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.735+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~OCVG004Z2BG2.0 size=933571 2024-09-12T18:32:56.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.735+0000 7f41a072b8c0 1 > prepared multipart upload key=VEN0P2P1RZ2S upload=OCVG004Z2BG2 tag=SHL0RTKIKSDP type=write size=1982147 2024-09-12T18:32:56.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.739+0000 7f41a072b8c0 1 < suggested update operation key=58IT2R988AW9 tag=L3UPXN651UW9 type=del size=317962 2024-09-12T18:32:56.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.743+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=6IX26Z26ZNBB type=del size=2601378 2024-09-12T18:32:56.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.747+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=R0YXODMN4V29 type=del 2024-09-12T18:32:56.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.751+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=2F0EXSTD0ZHY type=del size=3270227 2024-09-12T18:32:56.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.755+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=82TZSDCRKHL2 type=del 2024-09-12T18:32:56.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.759+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~52YPCSPUTM29.0 size=754820 2024-09-12T18:32:56.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.759+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=52YPCSPUTM29 tag=5Z2IWTSPQ1V4 type=write size=1803396 2024-09-12T18:32:56.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.767+0000 7f41a072b8c0 1 < suggested remove operation key=A6GQZL25YSNL tag=2K2JSESZYR8X type=del 2024-09-12T18:32:56.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.771+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=806DQGP2AQ1P type=del size=3089296 2024-09-12T18:32:56.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.775+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~E9PBP8QK7CTV.0 size=1048576 2024-09-12T18:32:56.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.775+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~E9PBP8QK7CTV.1 size=5080 2024-09-12T18:32:56.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.783+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=E9PBP8QK7CTV tag=1QJ2J5XHSIZZ type=write size=2102232 2024-09-12T18:32:56.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.787+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=53J33SIY6YQN type=del size=896213 2024-09-12T18:32:56.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.791+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~CIB9CLBX844U.0 size=1048576 2024-09-12T18:32:56.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.791+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~CIB9CLBX844U.1 size=288701 2024-09-12T18:32:56.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.799+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=CIB9CLBX844U tag=MJBCXZKXV1B7 type=write size=2385853 2024-09-12T18:32:56.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.803+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~EFNFACTJ52SL.0 size=1048576 2024-09-12T18:32:56.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.807+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~EFNFACTJ52SL.1 size=1048576 2024-09-12T18:32:56.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.811+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~EFNFACTJ52SL.2 size=767283 2024-09-12T18:32:56.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.811+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=EFNFACTJ52SL tag=9I80BFS8AP0X type=write size=3913011 2024-09-12T18:32:56.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.815+0000 7f41a072b8c0 1 < suggested remove operation key=1JIIRDVMT0B0 tag=N7GB8KULLAVJ type=write 2024-09-12T18:32:56.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.819+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=5WCU2EX4CQT4 type=del size=3905181 2024-09-12T18:32:56.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.823+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~W60D5GJCDFIR.0 size=669666 2024-09-12T18:32:56.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.827+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=W60D5GJCDFIR tag=YTHCKI1BZPL6 type=write size=1718242 2024-09-12T18:32:56.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.831+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=HADIZL1OFQB6 type=del size=1162549 2024-09-12T18:32:56.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.835+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=DHZ6SD3XO9R3 type=del 2024-09-12T18:32:56.840 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.839+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~3NXYMKFL8B4D.0 size=1048576 2024-09-12T18:32:56.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.843+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~3NXYMKFL8B4D.1 size=853247 2024-09-12T18:32:56.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.843+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=3NXYMKFL8B4D tag=6V0MQDQK5F7Y type=write size=2950399 2024-09-12T18:32:56.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.843+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~FVHNJM6QTMOX.0 size=1048576 2024-09-12T18:32:56.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.847+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~FVHNJM6QTMOX.1 size=336486 2024-09-12T18:32:56.855 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.855+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=FVHNJM6QTMOX tag=J160NNB1M673 type=write size=2433638 2024-09-12T18:32:56.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.859+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~9FPQAMFF755E.0 size=419818 2024-09-12T18:32:56.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.859+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=9FPQAMFF755E tag=4L23BO94C895 type=write size=1468394 2024-09-12T18:32:56.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.863+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~M20JA6IFCQCR.0 size=1048576 2024-09-12T18:32:56.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.867+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~M20JA6IFCQCR.1 size=71307 2024-09-12T18:32:56.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.871+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=M20JA6IFCQCR tag=QCXWB0KD6V5L type=write size=2168459 2024-09-12T18:32:56.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.875+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~U39DFD9KGX5O.0 size=1048576 2024-09-12T18:32:56.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.879+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~U39DFD9KGX5O.1 size=589383 2024-09-12T18:32:56.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.879+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=U39DFD9KGX5O tag=QO7809KZUFRN type=write size=2686535 2024-09-12T18:32:56.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.883+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~0PUSE43CXA3Z.0 size=1048576 2024-09-12T18:32:56.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.883+0000 7f41a072b8c0 1 < canceled part key=_multipart_L1VC63PK1R2Y.2~0PUSE43CXA3Z.1 size=1048576 2024-09-12T18:32:56.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.883+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~0PUSE43CXA3Z.2 size=621544 2024-09-12T18:32:56.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.891+0000 7f41a072b8c0 1 < canceled multipart upload key=L1VC63PK1R2Y upload=0PUSE43CXA3Z tag=WS9T5HCGDRQ3 type=write size=3767272 2024-09-12T18:32:56.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.895+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~8S3Y61OH2U17.0 size=1048576 2024-09-12T18:32:56.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.899+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~8S3Y61OH2U17.1 size=11003 2024-09-12T18:32:56.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.899+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=8S3Y61OH2U17 tag=HF39KBC6HUEB type=write size=2108155 2024-09-12T18:32:56.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.899+0000 7f41a072b8c0 1 < canceled part key=_multipart_GC8797KSO47E.2~64I17TNFRUY4.0 size=1048576 2024-09-12T18:32:56.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.903+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~64I17TNFRUY4.1 size=1048576 2024-09-12T18:32:56.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.903+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~64I17TNFRUY4.2 size=998992 2024-09-12T18:32:56.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.911+0000 7f41a072b8c0 1 < canceled multipart upload key=GC8797KSO47E upload=64I17TNFRUY4 tag=X7LP6GOBHMHM type=write size=4144720 2024-09-12T18:32:56.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.911+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=NWDQF0VEKZ7L type=del size=918723 2024-09-12T18:32:56.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.915+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~5ONBR1WU5LAU.0 size=482797 2024-09-12T18:32:56.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.919+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=5ONBR1WU5LAU tag=583FI6CWOPMB type=write size=1531373 2024-09-12T18:32:56.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.923+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=1FKBYAG104CN type=del size=3143255 2024-09-12T18:32:56.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.927+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=3D5HWVZFDYW7 type=del 2024-09-12T18:32:56.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.931+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=B9CPQ7UBWNM2 type=write size=522591 2024-09-12T18:32:56.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.935+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~OCVG004Z2BG2.0 size=933571 2024-09-12T18:32:56.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.939+0000 7f41a072b8c0 1 < completed multipart upload key=VEN0P2P1RZ2S upload=OCVG004Z2BG2 tag=SHL0RTKIKSDP type=write size=1982147 2024-09-12T18:32:56.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.943+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=XVCRNOP3A8EQ type=del size=3890976 2024-09-12T18:32:56.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.947+0000 7f41a072b8c0 1 < canceled operation key=295ZC54QRUPD tag=6IX26Z26ZNBB type=del size=2601378 2024-09-12T18:32:56.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.947+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=3HH6LSINGPMN type=del size=3413022 2024-09-12T18:32:56.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.951+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=2F0EXSTD0ZHY type=del 2024-09-12T18:32:56.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.959+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~9D19IA3GQJ7Y.0 size=248049 2024-09-12T18:32:56.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.959+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=9D19IA3GQJ7Y tag=WXZZPNTG1WJ3 type=write size=1296625 2024-09-12T18:32:56.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.959+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~52YPCSPUTM29.0 size=754820 2024-09-12T18:32:56.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.967+0000 7f41a072b8c0 1 < completed multipart upload key=A6GQZL25YSNL upload=52YPCSPUTM29 tag=5Z2IWTSPQ1V4 type=write size=1803396 2024-09-12T18:32:56.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.967+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=5T2CJZKRHY30 type=del size=1869391 2024-09-12T18:32:56.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.975+0000 7f41a072b8c0 1 < suggested remove operation key=3R9RN03RFRJP tag=806DQGP2AQ1P type=del 2024-09-12T18:32:56.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.979+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=YJP7SLR2Y6JR type=del size=3700719 2024-09-12T18:32:56.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.983+0000 7f41a072b8c0 1 < suggested update operation key=C2PRRD3QO9AF tag=53J33SIY6YQN type=del size=896213 2024-09-12T18:32:56.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.987+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=BRZ5B4PJMPI9 type=del size=3589004 2024-09-12T18:32:56.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.991+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~EFNFACTJ52SL.0 size=1048576 2024-09-12T18:32:56.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.995+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~EFNFACTJ52SL.1 size=1048576 2024-09-12T18:32:56.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:56.995+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~EFNFACTJ52SL.2 size=767283 2024-09-12T18:32:57.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.003+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=EFNFACTJ52SL tag=9I80BFS8AP0X type=write size=3913011 2024-09-12T18:32:57.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.007+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~SWY19QA3M9MN.0 size=1048576 2024-09-12T18:32:57.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.011+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~SWY19QA3M9MN.1 size=351171 2024-09-12T18:32:57.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.011+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=SWY19QA3M9MN tag=799UZ024T1GT type=write size=2448323 2024-09-12T18:32:57.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.015+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=5WCU2EX4CQT4 type=del 2024-09-12T18:32:57.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.015+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=U3Y0UJIEU4HG type=del size=3545131 2024-09-12T18:32:57.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.019+0000 7f41a072b8c0 -1 < failed to complete operation key=3R9RN03RFRJP tag=HADIZL1OFQB6 type=del size=1162549: (22) Invalid argument 2024-09-12T18:32:57.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.027+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~SMHGAWT7FYZM.0 size=1048576 2024-09-12T18:32:57.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.031+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~SMHGAWT7FYZM.1 size=1048576 2024-09-12T18:32:57.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.031+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~SMHGAWT7FYZM.2 size=205817 2024-09-12T18:32:57.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.031+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=SMHGAWT7FYZM tag=IXX8MKZCGV09 type=write size=3351545 2024-09-12T18:32:57.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.035+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~3NXYMKFL8B4D.0 size=1048576 2024-09-12T18:32:57.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.035+0000 7f41a072b8c0 1 < canceled part key=_multipart_GQHPUDV5BG1E.2~3NXYMKFL8B4D.1 size=853247 2024-09-12T18:32:57.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.043+0000 7f41a072b8c0 1 < canceled multipart upload key=GQHPUDV5BG1E upload=3NXYMKFL8B4D tag=6V0MQDQK5F7Y type=write size=2950399 2024-09-12T18:32:57.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.043+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=GB2ZUIT3W9R9 type=del size=4057902 2024-09-12T18:32:57.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.047+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~9FPQAMFF755E.0 size=419818 2024-09-12T18:32:57.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.055+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=9FPQAMFF755E tag=4L23BO94C895 type=write size=1468394 2024-09-12T18:32:57.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.063+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~WTAH071GBAIW.0 size=1048576 2024-09-12T18:32:57.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.063+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~WTAH071GBAIW.1 size=817662 2024-09-12T18:32:57.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.063+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=WTAH071GBAIW tag=TUFOI7T8OS8X type=write size=2914814 2024-09-12T18:32:57.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.067+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~U39DFD9KGX5O.0 size=1048576 2024-09-12T18:32:57.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.067+0000 7f41a072b8c0 1 < canceled part key=_multipart_KP2HF4J376EY.2~U39DFD9KGX5O.1 size=589383 2024-09-12T18:32:57.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.071+0000 7f41a072b8c0 1 < canceled multipart upload key=KP2HF4J376EY upload=U39DFD9KGX5O tag=QO7809KZUFRN type=write size=2686535 2024-09-12T18:32:57.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.075+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=80TP4NEEQ7MT type=del size=3423354 2024-09-12T18:32:57.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.079+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~8S3Y61OH2U17.0 size=1048576 2024-09-12T18:32:57.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.083+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~8S3Y61OH2U17.1 size=11003 2024-09-12T18:32:57.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.087+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=8S3Y61OH2U17 tag=HF39KBC6HUEB type=write size=2108155 2024-09-12T18:32:57.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.095+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~IC65RWBP244W.0 size=163773 2024-09-12T18:32:57.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.095+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=IC65RWBP244W tag=UC7ZG9O7F55U type=write size=1212349 2024-09-12T18:32:57.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.099+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=NWDQF0VEKZ7L type=del 2024-09-12T18:32:57.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.103+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=UEKPQ1L0OY9Z type=del size=198738 2024-09-12T18:32:57.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.107+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=1FKBYAG104CN type=del 2024-09-12T18:32:57.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.111+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~EQ3C1ZLOARLJ.0 size=1048576 2024-09-12T18:32:57.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.115+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~EQ3C1ZLOARLJ.1 size=1048576 2024-09-12T18:32:57.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.119+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~EQ3C1ZLOARLJ.2 size=540064 2024-09-12T18:32:57.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.119+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=EQ3C1ZLOARLJ tag=HKDO11I8S0FH type=write size=3685792 2024-09-12T18:32:57.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.119+0000 7f41a072b8c0 1 < completed write operation key=0O97F5ON55TX tag=B9CPQ7UBWNM2 type=write size=522591 2024-09-12T18:32:57.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.127+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~XM2NKWJ3QE0A.0 size=1048576 2024-09-12T18:32:57.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.131+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~XM2NKWJ3QE0A.1 size=1048576 2024-09-12T18:32:57.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.131+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~XM2NKWJ3QE0A.2 size=239388 2024-09-12T18:32:57.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.131+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=XM2NKWJ3QE0A tag=ZWVDRLIWW6EY type=write size=3385116 2024-09-12T18:32:57.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.135+0000 7f41a072b8c0 -1 < failed to complete operation key=C2PRRD3QO9AF tag=XVCRNOP3A8EQ type=del size=3890976: (22) Invalid argument 2024-09-12T18:32:57.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.143+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~WOS8YQO3BQX9.0 size=910880 2024-09-12T18:32:57.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.143+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=WOS8YQO3BQX9 tag=1HSKLOS4GVNV type=write size=1959456 2024-09-12T18:32:57.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.143+0000 7f41a072b8c0 -1 < failed to complete operation key=C2PRRD3QO9AF tag=3HH6LSINGPMN type=del size=3413022: (22) Invalid argument 2024-09-12T18:32:57.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.147+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=WGP4ZFDX7S09 type=del size=2622643 2024-09-12T18:32:57.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.151+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~9D19IA3GQJ7Y.0 size=248049 2024-09-12T18:32:57.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.159+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=9D19IA3GQJ7Y tag=WXZZPNTG1WJ3 type=write size=1296625 2024-09-12T18:32:57.164 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.163+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~D7D00XUKH64M.0 size=1048576 2024-09-12T18:32:57.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.163+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~D7D00XUKH64M.1 size=1048576 2024-09-12T18:32:57.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.167+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~D7D00XUKH64M.2 size=676993 2024-09-12T18:32:57.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.167+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=D7D00XUKH64M tag=G2OZ78VCBUB7 type=write size=3822721 2024-09-12T18:32:57.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.175+0000 7f41a072b8c0 1 < suggested update operation key=P732C5X0RG8Z tag=5T2CJZKRHY30 type=del size=1869391 2024-09-12T18:32:57.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.179+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~61B5E1H8B4WG.0 size=1048576 2024-09-12T18:32:57.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.179+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~61B5E1H8B4WG.1 size=261841 2024-09-12T18:32:57.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.179+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=61B5E1H8B4WG tag=MJFFQJAJIVLN type=write size=2358993 2024-09-12T18:32:57.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.187+0000 7f41a072b8c0 1 < suggested remove operation key=7MRN7L1DTAMO tag=YJP7SLR2Y6JR type=del 2024-09-12T18:32:57.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.191+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=6RTIJWXJU9RJ type=del size=121162 2024-09-12T18:32:57.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.191+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=BRZ5B4PJMPI9 type=del 2024-09-12T18:32:57.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.195+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=0DMK0GRDZBK4 type=del size=4150092 2024-09-12T18:32:57.200 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.199+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~SWY19QA3M9MN.0 size=1048576 2024-09-12T18:32:57.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.203+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~SWY19QA3M9MN.1 size=351171 2024-09-12T18:32:57.208 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.207+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=SWY19QA3M9MN tag=799UZ024T1GT type=write size=2448323 2024-09-12T18:32:57.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.211+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=291X2K0HA0I1 type=del size=624509 2024-09-12T18:32:57.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.215+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=U3Y0UJIEU4HG type=del 2024-09-12T18:32:57.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.219+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~GDMSINU1HRAH.0 size=1048576 2024-09-12T18:32:57.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.223+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~GDMSINU1HRAH.1 size=335076 2024-09-12T18:32:57.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.223+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=GDMSINU1HRAH tag=RFE2ZYP800Y3 type=write size=2432228 2024-09-12T18:32:57.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.223+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~SMHGAWT7FYZM.0 size=1048576 2024-09-12T18:32:57.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.227+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~SMHGAWT7FYZM.1 size=1048576 2024-09-12T18:32:57.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.231+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~SMHGAWT7FYZM.2 size=205817 2024-09-12T18:32:57.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.235+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=SMHGAWT7FYZM tag=IXX8MKZCGV09 type=write size=3351545 2024-09-12T18:32:57.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.239+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=29C62SJWRJMS type=del size=488769 2024-09-12T18:32:57.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.243+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=GB2ZUIT3W9R9 type=del 2024-09-12T18:32:57.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.243+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=7RB88LFRYKE2 type=del size=2195249 2024-09-12T18:32:57.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.247+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~WTAH071GBAIW.0 size=1048576 2024-09-12T18:32:57.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.251+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~WTAH071GBAIW.1 size=817662 2024-09-12T18:32:57.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.255+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=WTAH071GBAIW tag=TUFOI7T8OS8X type=write size=2914814 2024-09-12T18:32:57.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.259+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~SS641X93QV28.0 size=1048576 2024-09-12T18:32:57.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.263+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~SS641X93QV28.1 size=1048576 2024-09-12T18:32:57.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.267+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~SS641X93QV28.2 size=612061 2024-09-12T18:32:57.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.267+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=SS641X93QV28 tag=N80072DT37W5 type=write size=3757789 2024-09-12T18:32:57.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.271+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=80TP4NEEQ7MT type=del 2024-09-12T18:32:57.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.271+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=0K6D9BOCVWCK type=del size=1436862 2024-09-12T18:32:57.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.275+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~IC65RWBP244W.0 size=163773 2024-09-12T18:32:57.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.279+0000 7f41a072b8c0 1 < completed multipart upload key=A6GQZL25YSNL upload=IC65RWBP244W tag=UC7ZG9O7F55U type=write size=1212349 2024-09-12T18:32:57.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.283+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=Y8LV3GBVUHHK type=del size=3004493 2024-09-12T18:32:57.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.287+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=UEKPQ1L0OY9Z type=del 2024-09-12T18:32:57.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.291+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=0U2PKMFHMMJO type=write size=918893 2024-09-12T18:32:57.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.295+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~EQ3C1ZLOARLJ.0 size=1048576 2024-09-12T18:32:57.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.295+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~EQ3C1ZLOARLJ.1 size=1048576 2024-09-12T18:32:57.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.299+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~EQ3C1ZLOARLJ.2 size=540064 2024-09-12T18:32:57.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.303+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=EQ3C1ZLOARLJ tag=HKDO11I8S0FH type=write size=3685792 2024-09-12T18:32:57.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.307+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=0E2K92Z00RVW type=del size=2295682 2024-09-12T18:32:57.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.307+0000 7f41a072b8c0 1 < canceled part key=_multipart_1JIIRDVMT0B0.2~XM2NKWJ3QE0A.0 size=1048576 2024-09-12T18:32:57.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.311+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~XM2NKWJ3QE0A.1 size=1048576 2024-09-12T18:32:57.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.311+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~XM2NKWJ3QE0A.2 size=239388 2024-09-12T18:32:57.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.319+0000 7f41a072b8c0 1 < canceled multipart upload key=1JIIRDVMT0B0 upload=XM2NKWJ3QE0A tag=ZWVDRLIWW6EY type=write size=3385116 2024-09-12T18:32:57.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.323+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=6HR8183BY5YJ type=del size=1468114 2024-09-12T18:32:57.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.323+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~WOS8YQO3BQX9.0 size=910880 2024-09-12T18:32:57.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.331+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=WOS8YQO3BQX9 tag=1HSKLOS4GVNV type=write size=1959456 2024-09-12T18:32:57.334 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.335+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=52IHMU4LONAH type=write size=1004592 2024-09-12T18:32:57.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.335+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=WGP4ZFDX7S09 type=del 2024-09-12T18:32:57.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.339+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=NUOYM7DN70RQ type=del size=440297 2024-09-12T18:32:57.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.343+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~D7D00XUKH64M.0 size=1048576 2024-09-12T18:32:57.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.347+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~D7D00XUKH64M.1 size=1048576 2024-09-12T18:32:57.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.347+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~D7D00XUKH64M.2 size=676993 2024-09-12T18:32:57.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.351+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=D7D00XUKH64M tag=G2OZ78VCBUB7 type=write size=3822721 2024-09-12T18:32:57.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.355+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=6EPRGDVO8WH3 type=write size=926788 2024-09-12T18:32:57.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.359+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~61B5E1H8B4WG.0 size=1048576 2024-09-12T18:32:57.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.359+0000 7f41a072b8c0 1 < canceled part key=_multipart_1JIIRDVMT0B0.2~61B5E1H8B4WG.1 size=261841 2024-09-12T18:32:57.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.363+0000 7f41a072b8c0 1 < canceled multipart upload key=1JIIRDVMT0B0 upload=61B5E1H8B4WG tag=MJFFQJAJIVLN type=write size=2358993 2024-09-12T18:32:57.370 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.367+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~OVZ6LMFB6UT9.0 size=1048576 2024-09-12T18:32:57.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.371+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~OVZ6LMFB6UT9.1 size=538080 2024-09-12T18:32:57.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.371+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=OVZ6LMFB6UT9 tag=PQ9FNH1HTUV9 type=write size=2635232 2024-09-12T18:32:57.375 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.375+0000 7f41a072b8c0 1 < canceled operation key=3CGBX19WTMWQ tag=6RTIJWXJU9RJ type=del size=121162 2024-09-12T18:32:57.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.379+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=WV9VOI7V4F2W type=del size=2648961 2024-09-12T18:32:57.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.383+0000 7f41a072b8c0 1 < completed delete operation key=3R9RN03RFRJP tag=0DMK0GRDZBK4 type=del 2024-09-12T18:32:57.388 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.387+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=6ME5BRR4FYL8 type=del size=1542590 2024-09-12T18:32:57.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.391+0000 7f41a072b8c0 1 < suggested remove operation key=GQHPUDV5BG1E tag=291X2K0HA0I1 type=del 2024-09-12T18:32:57.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.395+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=MR5RXRCDHMD0 type=del size=4147577 2024-09-12T18:32:57.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.399+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~GDMSINU1HRAH.0 size=1048576 2024-09-12T18:32:57.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.403+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~GDMSINU1HRAH.1 size=335076 2024-09-12T18:32:57.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.407+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=GDMSINU1HRAH tag=RFE2ZYP800Y3 type=write size=2432228 2024-09-12T18:32:57.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.411+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=0MZQWG4T02ZT type=del size=1115817 2024-09-12T18:32:57.415 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.415+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=29C62SJWRJMS type=del 2024-09-12T18:32:57.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.415+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=ER7991W6R3ES type=del size=1337927 2024-09-12T18:32:57.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.419+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=7RB88LFRYKE2 type=del 2024-09-12T18:32:57.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.423+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=ES1AZXNSTV6D type=del size=471214 2024-09-12T18:32:57.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.427+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~SS641X93QV28.0 size=1048576 2024-09-12T18:32:57.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.427+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~SS641X93QV28.1 size=1048576 2024-09-12T18:32:57.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.427+0000 7f41a072b8c0 1 < canceled part key=_multipart_SK3T82EJFZXE.2~SS641X93QV28.2 size=612061 2024-09-12T18:32:57.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.435+0000 7f41a072b8c0 1 < canceled multipart upload key=SK3T82EJFZXE upload=SS641X93QV28 tag=N80072DT37W5 type=write size=3757789 2024-09-12T18:32:57.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.439+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~OCVPGP91X3XT.0 size=1048576 2024-09-12T18:32:57.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.443+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~OCVPGP91X3XT.1 size=1048576 2024-09-12T18:32:57.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.443+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~OCVPGP91X3XT.2 size=672996 2024-09-12T18:32:57.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.443+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=OCVPGP91X3XT tag=JAMCAV4QDVX5 type=write size=3818724 2024-09-12T18:32:57.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.451+0000 7f41a072b8c0 1 < suggested update operation key=A6GQZL25YSNL tag=0K6D9BOCVWCK type=del size=1436862 2024-09-12T18:32:57.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.459+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~83OSSED95K4T.0 size=585492 2024-09-12T18:32:57.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.459+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=83OSSED95K4T tag=0QUJOZU24LLE type=write size=1634068 2024-09-12T18:32:57.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.463+0000 7f41a072b8c0 1 < canceled operation key=5OD9IX408CYO tag=Y8LV3GBVUHHK type=del size=3004493 2024-09-12T18:32:57.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.463+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=358OAW2V0UC6 type=write size=150492 2024-09-12T18:32:57.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.467+0000 7f41a072b8c0 -1 < failed to complete operation key=A6GQZL25YSNL tag=0U2PKMFHMMJO type=write size=918893: (22) Invalid argument 2024-09-12T18:32:57.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.475+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~VYX2EXI1SPAJ.0 size=558808 2024-09-12T18:32:57.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.475+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=VYX2EXI1SPAJ tag=MA43RJ6AM56U type=write size=1607384 2024-09-12T18:32:57.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.479+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=0E2K92Z00RVW type=del 2024-09-12T18:32:57.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.483+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~B2EVI4PNTDUT.0 size=1048576 2024-09-12T18:32:57.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.487+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~B2EVI4PNTDUT.1 size=1048576 2024-09-12T18:32:57.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.491+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~B2EVI4PNTDUT.2 size=882601 2024-09-12T18:32:57.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.491+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=B2EVI4PNTDUT tag=THYV1ORR7W87 type=write size=4028329 2024-09-12T18:32:57.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.491+0000 7f41a072b8c0 -1 < failed to complete operation key=A6GQZL25YSNL tag=6HR8183BY5YJ type=del size=1468114: (22) Invalid argument 2024-09-12T18:32:57.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.499+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~00EUM9FH686G.0 size=1048576 2024-09-12T18:32:57.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.503+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~00EUM9FH686G.1 size=1048576 2024-09-12T18:32:57.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.503+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~00EUM9FH686G.2 size=162979 2024-09-12T18:32:57.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.503+0000 7f41a072b8c0 1 > prepared multipart upload key=VEN0P2P1RZ2S upload=00EUM9FH686G tag=E9K9UARGPS3O type=write size=3308707 2024-09-12T18:32:57.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.507+0000 7f41a072b8c0 -1 < failed to complete operation key=GQHPUDV5BG1E tag=52IHMU4LONAH type=write size=1004592: (22) Invalid argument 2024-09-12T18:32:57.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.511+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=R1DBALYYZ8VW type=del size=3214589 2024-09-12T18:32:57.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.515+0000 7f41a072b8c0 1 < canceled operation key=L01GL4WOUIL2 tag=NUOYM7DN70RQ type=del size=440297 2024-09-12T18:32:57.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.519+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=7QGUHGCGZCBP type=del size=1495559 2024-09-12T18:32:57.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.523+0000 7f41a072b8c0 1 < suggested update operation key=XLGVEN6DF5EW tag=6EPRGDVO8WH3 type=write size=926788 2024-09-12T18:32:57.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.531+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~HYWXS1Q2R3S6.0 size=1048576 2024-09-12T18:32:57.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.531+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~HYWXS1Q2R3S6.1 size=767015 2024-09-12T18:32:57.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.531+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=HYWXS1Q2R3S6 tag=G0EB34KTGM1A type=write size=2864167 2024-09-12T18:32:57.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.535+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~OVZ6LMFB6UT9.0 size=1048576 2024-09-12T18:32:57.539 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.539+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~OVZ6LMFB6UT9.1 size=538080 2024-09-12T18:32:57.545 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.543+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=OVZ6LMFB6UT9 tag=PQ9FNH1HTUV9 type=write size=2635232 2024-09-12T18:32:57.548 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.547+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=KJEKF4BY4D1O type=del size=1500381 2024-09-12T18:32:57.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.551+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=WV9VOI7V4F2W type=del 2024-09-12T18:32:57.555 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.555+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=SQDULO7QFTP8 type=del size=431996 2024-09-12T18:32:57.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.555+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=6ME5BRR4FYL8 type=del 2024-09-12T18:32:57.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.559+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=GEIBBX7Q0MR1 type=del size=493227 2024-09-12T18:32:57.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.563+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=MR5RXRCDHMD0 type=del 2024-09-12T18:32:57.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.567+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=E3U2KI3QF730 type=del size=2203336 2024-09-12T18:32:57.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.571+0000 7f41a072b8c0 1 < completed delete operation key=NKMA8FG3V3TR tag=0MZQWG4T02ZT type=del 2024-09-12T18:32:57.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.575+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=P5VX5RYK321N type=del size=3094098 2024-09-12T18:32:57.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.579+0000 7f41a072b8c0 1 < suggested update operation key=VEN0P2P1RZ2S tag=ER7991W6R3ES type=del size=1337927 2024-09-12T18:32:57.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.587+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~57LFYB0AFQYW.0 size=725235 2024-09-12T18:32:57.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.587+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=57LFYB0AFQYW tag=13JTM3NJEJGT type=write size=1773811 2024-09-12T18:32:57.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.587+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=ES1AZXNSTV6D type=del 2024-09-12T18:32:57.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.595+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~4G56JZDM8JL5.0 size=422641 2024-09-12T18:32:57.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.595+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=4G56JZDM8JL5 tag=TJLAEV8P3P08 type=write size=1471217 2024-09-12T18:32:57.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.599+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~OCVPGP91X3XT.0 size=1048576 2024-09-12T18:32:57.602 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.603+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~OCVPGP91X3XT.1 size=1048576 2024-09-12T18:32:57.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.603+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~OCVPGP91X3XT.2 size=672996 2024-09-12T18:32:57.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.611+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=OCVPGP91X3XT tag=JAMCAV4QDVX5 type=write size=3818724 2024-09-12T18:32:57.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.611+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=RWTV34ONRHSC type=del size=697394 2024-09-12T18:32:57.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.615+0000 7f41a072b8c0 1 < canceled part key=_multipart_58IT2R988AW9.2~83OSSED95K4T.0 size=585492 2024-09-12T18:32:57.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.619+0000 7f41a072b8c0 1 < canceled multipart upload key=58IT2R988AW9 upload=83OSSED95K4T tag=0QUJOZU24LLE type=write size=1634068 2024-09-12T18:32:57.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.627+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~9JSYPCMNIXRL.0 size=1048576 2024-09-12T18:32:57.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.627+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~9JSYPCMNIXRL.1 size=1048576 2024-09-12T18:32:57.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.631+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~9JSYPCMNIXRL.2 size=185442 2024-09-12T18:32:57.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.631+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=9JSYPCMNIXRL tag=ZJCCDNW8DQB1 type=write size=3331170 2024-09-12T18:32:57.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.635+0000 7f41a072b8c0 1 < suggested remove operation key=SK3T82EJFZXE tag=358OAW2V0UC6 type=write 2024-09-12T18:32:57.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.639+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=33GG4CU3FWCB type=write size=865005 2024-09-12T18:32:57.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.643+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~VYX2EXI1SPAJ.0 size=558808 2024-09-12T18:32:57.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.651+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=VYX2EXI1SPAJ tag=MA43RJ6AM56U type=write size=1607384 2024-09-12T18:32:57.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.651+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=BXTMOQT3ILO0 type=del size=2066212 2024-09-12T18:32:57.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.655+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~B2EVI4PNTDUT.0 size=1048576 2024-09-12T18:32:57.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.659+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~B2EVI4PNTDUT.1 size=1048576 2024-09-12T18:32:57.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.663+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~B2EVI4PNTDUT.2 size=882601 2024-09-12T18:32:57.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.667+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=B2EVI4PNTDUT tag=THYV1ORR7W87 type=write size=4028329 2024-09-12T18:32:57.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.671+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=GCX2EH8RJNTG type=del size=587421 2024-09-12T18:32:57.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.675+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~00EUM9FH686G.0 size=1048576 2024-09-12T18:32:57.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.675+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~00EUM9FH686G.1 size=1048576 2024-09-12T18:32:57.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.679+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~00EUM9FH686G.2 size=162979 2024-09-12T18:32:57.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.683+0000 7f41a072b8c0 1 < completed multipart upload key=VEN0P2P1RZ2S upload=00EUM9FH686G tag=E9K9UARGPS3O type=write size=3308707 2024-09-12T18:32:57.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.695+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~AG1MKR1H1L3M.0 size=948069 2024-09-12T18:32:57.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.695+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=AG1MKR1H1L3M tag=1VLIA99ICH4V type=write size=1996645 2024-09-12T18:32:57.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.699+0000 7f41a072b8c0 1 < suggested update operation key=63BP9QETTAM8 tag=R1DBALYYZ8VW type=del size=3214589 2024-09-12T18:32:57.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.707+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~ARF4WB8232PO.0 size=1048576 2024-09-12T18:32:57.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.711+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~ARF4WB8232PO.1 size=310362 2024-09-12T18:32:57.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.711+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=ARF4WB8232PO tag=XYKWXYCWS74E type=write size=2407514 2024-09-12T18:32:57.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.715+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=7QGUHGCGZCBP type=del 2024-09-12T18:32:57.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.719+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~Q5COHGJ9JZF4.0 size=1048576 2024-09-12T18:32:57.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.723+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~Q5COHGJ9JZF4.1 size=879058 2024-09-12T18:32:57.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.723+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=Q5COHGJ9JZF4 tag=DVH4WFJWQSCD type=write size=2976210 2024-09-12T18:32:57.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.727+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~HYWXS1Q2R3S6.0 size=1048576 2024-09-12T18:32:57.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.727+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~HYWXS1Q2R3S6.1 size=767015 2024-09-12T18:32:57.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.735+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=HYWXS1Q2R3S6 tag=G0EB34KTGM1A type=write size=2864167 2024-09-12T18:32:57.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.739+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=6R9RURRE5LT0 type=del size=1869857 2024-09-12T18:32:57.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.743+0000 7f41a072b8c0 1 < canceled operation key=0G0YWIOD3L3I tag=KJEKF4BY4D1O type=del size=1500381 2024-09-12T18:32:57.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.747+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=PUXFHMXYERG2 type=del size=4123829 2024-09-12T18:32:57.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.747+0000 7f41a072b8c0 -1 < failed to complete operation key=63BP9QETTAM8 tag=SQDULO7QFTP8 type=del size=431996: (22) Invalid argument 2024-09-12T18:32:57.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.751+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=M9M5NAQJ6NL9 type=del size=4112092 2024-09-12T18:32:57.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.755+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=GEIBBX7Q0MR1 type=del 2024-09-12T18:32:57.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.763+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~9GWXQX7LNJLL.0 size=1048576 2024-09-12T18:32:57.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.763+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~9GWXQX7LNJLL.1 size=1048576 2024-09-12T18:32:57.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.767+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~9GWXQX7LNJLL.2 size=587385 2024-09-12T18:32:57.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.767+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=9GWXQX7LNJLL tag=PNJ0XOGK35ON type=write size=3733113 2024-09-12T18:32:57.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.771+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=E3U2KI3QF730 type=del 2024-09-12T18:32:57.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.775+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~TNAK83RP1TFY.0 size=1048576 2024-09-12T18:32:57.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.779+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~TNAK83RP1TFY.1 size=745509 2024-09-12T18:32:57.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.779+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=TNAK83RP1TFY tag=0ZDZKYTQJAZ0 type=write size=2842661 2024-09-12T18:32:57.785 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.783+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=P5VX5RYK321N type=del 2024-09-12T18:32:57.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.787+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=JN1H15WX69NJ type=del size=2710079 2024-09-12T18:32:57.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.791+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~57LFYB0AFQYW.0 size=725235 2024-09-12T18:32:57.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.795+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=57LFYB0AFQYW tag=13JTM3NJEJGT type=write size=1773811 2024-09-12T18:32:57.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.803+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~KONP4ANTA30S.0 size=1048576 2024-09-12T18:32:57.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.803+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~KONP4ANTA30S.1 size=1048576 2024-09-12T18:32:57.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.807+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~KONP4ANTA30S.2 size=482679 2024-09-12T18:32:57.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.807+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=KONP4ANTA30S tag=94V8LXS2VGLP type=write size=3628407 2024-09-12T18:32:57.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.811+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~4G56JZDM8JL5.0 size=422641 2024-09-12T18:32:57.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.815+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=4G56JZDM8JL5 tag=TJLAEV8P3P08 type=write size=1471217 2024-09-12T18:32:57.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.823+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~ZXF2E0JOM6SH.0 size=1048576 2024-09-12T18:32:57.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.823+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~ZXF2E0JOM6SH.1 size=365559 2024-09-12T18:32:57.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.823+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=ZXF2E0JOM6SH tag=7FFXC5GA3MQW type=write size=2462711 2024-09-12T18:32:57.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.827+0000 7f41a072b8c0 1 < canceled operation key=58IT2R988AW9 tag=RWTV34ONRHSC type=del size=697394 2024-09-12T18:32:57.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.831+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=ILUA7DTI5NZY type=write size=57314 2024-09-12T18:32:57.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.835+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~9JSYPCMNIXRL.0 size=1048576 2024-09-12T18:32:57.840 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.839+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~9JSYPCMNIXRL.1 size=1048576 2024-09-12T18:32:57.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.843+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~9JSYPCMNIXRL.2 size=185442 2024-09-12T18:32:57.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.847+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=9JSYPCMNIXRL tag=ZJCCDNW8DQB1 type=write size=3331170 2024-09-12T18:32:57.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.851+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=5PBN2CCQDFBD type=del size=992184 2024-09-12T18:32:57.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.855+0000 7f41a072b8c0 1 < canceled operation key=VEN0P2P1RZ2S tag=33GG4CU3FWCB type=write size=865005 2024-09-12T18:32:57.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.859+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=MH1A1BKWRED9 type=write size=868301 2024-09-12T18:32:57.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.863+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=BXTMOQT3ILO0 type=del 2024-09-12T18:32:57.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.871+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~793PZC76QNL1.0 size=1048576 2024-09-12T18:32:57.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.871+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~793PZC76QNL1.1 size=1048576 2024-09-12T18:32:57.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.875+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~793PZC76QNL1.2 size=450100 2024-09-12T18:32:57.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.875+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=793PZC76QNL1 tag=WB299KWNU6XM type=write size=3595828 2024-09-12T18:32:57.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.879+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=GCX2EH8RJNTG type=del 2024-09-12T18:32:57.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.883+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=IP7ISO9DGERO type=del size=1370596 2024-09-12T18:32:57.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.887+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~AG1MKR1H1L3M.0 size=948069 2024-09-12T18:32:57.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.891+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=AG1MKR1H1L3M tag=1VLIA99ICH4V type=write size=1996645 2024-09-12T18:32:57.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.895+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=ZM3UM43PQZYM type=write size=789083 2024-09-12T18:32:57.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.899+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~ARF4WB8232PO.0 size=1048576 2024-09-12T18:32:57.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.899+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~ARF4WB8232PO.1 size=310362 2024-09-12T18:32:57.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.907+0000 7f41a072b8c0 1 < completed multipart upload key=A6GQZL25YSNL upload=ARF4WB8232PO tag=XYKWXYCWS74E type=write size=2407514 2024-09-12T18:32:57.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.911+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=Y4LF5JXTAY1I type=del size=1198237 2024-09-12T18:32:57.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.911+0000 7f41a072b8c0 1 < canceled part key=_multipart_ZACT36ZOC9ES.2~Q5COHGJ9JZF4.0 size=1048576 2024-09-12T18:32:57.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.911+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~Q5COHGJ9JZF4.1 size=879058 2024-09-12T18:32:57.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.919+0000 7f41a072b8c0 1 < canceled multipart upload key=ZACT36ZOC9ES upload=Q5COHGJ9JZF4 tag=DVH4WFJWQSCD type=write size=2976210 2024-09-12T18:32:57.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.923+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=YDADW3IL3D4H type=del size=438445 2024-09-12T18:32:57.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.923+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=6R9RURRE5LT0 type=del 2024-09-12T18:32:57.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.927+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=FAPHN4YQKIW4 type=write size=358479 2024-09-12T18:32:57.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.931+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=PUXFHMXYERG2 type=del 2024-09-12T18:32:57.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.939+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~2B6C3QEWAK0X.0 size=1048576 2024-09-12T18:32:57.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.939+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~2B6C3QEWAK0X.1 size=376393 2024-09-12T18:32:57.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.939+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=2B6C3QEWAK0X tag=JBEO35I4U62Z type=write size=2473545 2024-09-12T18:32:57.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.943+0000 7f41a072b8c0 1 < completed delete operation key=YP72VTCGSHYE tag=M9M5NAQJ6NL9 type=del 2024-09-12T18:32:57.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.947+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~JWT46YPN82BV.0 size=1048576 2024-09-12T18:32:57.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.951+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~JWT46YPN82BV.1 size=1048576 2024-09-12T18:32:57.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.951+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~JWT46YPN82BV.2 size=331592 2024-09-12T18:32:57.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.951+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=JWT46YPN82BV tag=VQ0KKFXYC59J type=write size=3477320 2024-09-12T18:32:57.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.955+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~9GWXQX7LNJLL.0 size=1048576 2024-09-12T18:32:57.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.955+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~9GWXQX7LNJLL.1 size=1048576 2024-09-12T18:32:57.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.959+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~9GWXQX7LNJLL.2 size=587385 2024-09-12T18:32:57.965 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.963+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=9GWXQX7LNJLL tag=PNJ0XOGK35ON type=write size=3733113 2024-09-12T18:32:57.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.971+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~01TGHRYY2N7I.0 size=1048576 2024-09-12T18:32:57.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.971+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~01TGHRYY2N7I.1 size=1048576 2024-09-12T18:32:57.975 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.975+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~01TGHRYY2N7I.2 size=310894 2024-09-12T18:32:57.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.975+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=01TGHRYY2N7I tag=OXBAJ9Z2HB23 type=write size=3456622 2024-09-12T18:32:57.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.979+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~TNAK83RP1TFY.0 size=1048576 2024-09-12T18:32:57.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.979+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~TNAK83RP1TFY.1 size=745509 2024-09-12T18:32:57.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.983+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=TNAK83RP1TFY tag=0ZDZKYTQJAZ0 type=write size=2842661 2024-09-12T18:32:57.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.991+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~1D0C9IB0IQCY.0 size=1048576 2024-09-12T18:32:57.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.995+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~1D0C9IB0IQCY.1 size=1048576 2024-09-12T18:32:57.998 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.999+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~1D0C9IB0IQCY.2 size=875052 2024-09-12T18:32:57.998 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:57.999+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=1D0C9IB0IQCY tag=UR8GM9B1RJBX type=write size=4020780 2024-09-12T18:32:58.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.003+0000 7f41a072b8c0 1 < suggested remove operation key=KOLD6WYK30EQ tag=JN1H15WX69NJ type=del 2024-09-12T18:32:58.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.007+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=CAJKWNZ3ZZQA type=write size=952363 2024-09-12T18:32:58.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.011+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~KONP4ANTA30S.0 size=1048576 2024-09-12T18:32:58.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.011+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~KONP4ANTA30S.1 size=1048576 2024-09-12T18:32:58.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.015+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~KONP4ANTA30S.2 size=482679 2024-09-12T18:32:58.021 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.019+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=KONP4ANTA30S tag=94V8LXS2VGLP type=write size=3628407 2024-09-12T18:32:58.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.023+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~AAJMF8VQV9YA.0 size=1048576 2024-09-12T18:32:58.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.027+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~AAJMF8VQV9YA.1 size=366607 2024-09-12T18:32:58.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.027+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=AAJMF8VQV9YA tag=DYUBKXTD26R4 type=write size=2463759 2024-09-12T18:32:58.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.031+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~ZXF2E0JOM6SH.0 size=1048576 2024-09-12T18:32:58.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.031+0000 7f41a072b8c0 1 < canceled part key=_multipart_YCBC1CHWJQC5.2~ZXF2E0JOM6SH.1 size=365559 2024-09-12T18:32:58.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.035+0000 7f41a072b8c0 1 < canceled multipart upload key=YCBC1CHWJQC5 upload=ZXF2E0JOM6SH tag=7FFXC5GA3MQW type=write size=2462711 2024-09-12T18:32:58.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.039+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=ZDTHVTBSZTSZ type=del size=1689116 2024-09-12T18:32:58.047 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.047+0000 7f41a072b8c0 1 < suggested remove operation key=63BP9QETTAM8 tag=ILUA7DTI5NZY type=write 2024-09-12T18:32:58.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.051+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~PB7FYPG8E8JN.0 size=230539 2024-09-12T18:32:58.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.051+0000 7f41a072b8c0 1 > prepared multipart upload key=VEN0P2P1RZ2S upload=PB7FYPG8E8JN tag=HRWE5XDBUVJ1 type=write size=1279115 2024-09-12T18:32:58.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.055+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=5PBN2CCQDFBD type=del 2024-09-12T18:32:58.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.059+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=4QXZT3EWT61N type=del size=785709 2024-09-12T18:32:58.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.067+0000 7f41a072b8c0 1 < suggested remove operation key=GC8797KSO47E tag=MH1A1BKWRED9 type=write 2024-09-12T18:32:58.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.075+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~NTL3JPKRXWHE.0 size=1048576 2024-09-12T18:32:58.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.075+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~NTL3JPKRXWHE.1 size=660222 2024-09-12T18:32:58.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.075+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=NTL3JPKRXWHE tag=KBIA5MPVLMUF type=write size=2757374 2024-09-12T18:32:58.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.079+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~793PZC76QNL1.0 size=1048576 2024-09-12T18:32:58.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.079+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~793PZC76QNL1.1 size=1048576 2024-09-12T18:32:58.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.083+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~793PZC76QNL1.2 size=450100 2024-09-12T18:32:58.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.087+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=793PZC76QNL1 tag=WB299KWNU6XM type=write size=3595828 2024-09-12T18:32:58.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.091+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=H2H9PWJIE4GQ type=del size=2953252 2024-09-12T18:32:58.095 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.095+0000 7f41a072b8c0 -1 < failed to complete operation key=GC8797KSO47E tag=IP7ISO9DGERO type=del size=1370596: (22) Invalid argument 2024-09-12T18:32:58.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.095+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=VBNG43D1FPUW type=del size=908538 2024-09-12T18:32:58.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.099+0000 7f41a072b8c0 1 < completed write operation key=VEN0P2P1RZ2S tag=ZM3UM43PQZYM type=write size=789083 2024-09-12T18:32:58.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.103+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=SV0VBESWWYJT type=write size=65709 2024-09-12T18:32:58.106 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.107+0000 7f41a072b8c0 1 < completed delete operation key=3R9RN03RFRJP tag=Y4LF5JXTAY1I type=del 2024-09-12T18:32:58.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.111+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~KQWTKGT31NTU.0 size=1048576 2024-09-12T18:32:58.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.111+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~KQWTKGT31NTU.1 size=421725 2024-09-12T18:32:58.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.111+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=KQWTKGT31NTU tag=KY6AWIC7LWPX type=write size=2518877 2024-09-12T18:32:58.117 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.115+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=YDADW3IL3D4H type=del 2024-09-12T18:32:58.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.119+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=LYPA0705GCJV type=write size=530817 2024-09-12T18:32:58.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.123+0000 7f41a072b8c0 1 < completed write operation key=SK3T82EJFZXE tag=FAPHN4YQKIW4 type=write size=358479 2024-09-12T18:32:58.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.127+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~MOPIZK0OVK78.0 size=1048576 2024-09-12T18:32:58.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.131+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~MOPIZK0OVK78.1 size=639956 2024-09-12T18:32:58.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.131+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=MOPIZK0OVK78 tag=1YXFIQQG7178 type=write size=2737108 2024-09-12T18:32:58.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.135+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~2B6C3QEWAK0X.0 size=1048576 2024-09-12T18:32:58.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.135+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~2B6C3QEWAK0X.1 size=376393 2024-09-12T18:32:58.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.139+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=2B6C3QEWAK0X tag=JBEO35I4U62Z type=write size=2473545 2024-09-12T18:32:58.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.143+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=VN32H3LMJ38Y type=del size=2265376 2024-09-12T18:32:58.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.147+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~JWT46YPN82BV.0 size=1048576 2024-09-12T18:32:58.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.151+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~JWT46YPN82BV.1 size=1048576 2024-09-12T18:32:58.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.151+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~JWT46YPN82BV.2 size=331592 2024-09-12T18:32:58.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.159+0000 7f41a072b8c0 1 < completed multipart upload key=L01GL4WOUIL2 upload=JWT46YPN82BV tag=VQ0KKFXYC59J type=write size=3477320 2024-09-12T18:32:58.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.163+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=KMKIZ5Q38NYA type=del size=2389804 2024-09-12T18:32:58.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.163+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~01TGHRYY2N7I.0 size=1048576 2024-09-12T18:32:58.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.167+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~01TGHRYY2N7I.1 size=1048576 2024-09-12T18:32:58.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.167+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~01TGHRYY2N7I.2 size=310894 2024-09-12T18:32:58.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.171+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=01TGHRYY2N7I tag=OXBAJ9Z2HB23 type=write size=3456622 2024-09-12T18:32:58.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.175+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~4BYGN7152JGL.0 size=1048576 2024-09-12T18:32:58.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.179+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~4BYGN7152JGL.1 size=1048576 2024-09-12T18:32:58.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.179+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~4BYGN7152JGL.2 size=372114 2024-09-12T18:32:58.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.179+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=4BYGN7152JGL tag=H3L4FAMMXNTE type=write size=3517842 2024-09-12T18:32:58.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.183+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~1D0C9IB0IQCY.0 size=1048576 2024-09-12T18:32:58.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.183+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~1D0C9IB0IQCY.1 size=1048576 2024-09-12T18:32:58.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.187+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~1D0C9IB0IQCY.2 size=875052 2024-09-12T18:32:58.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.191+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=1D0C9IB0IQCY tag=UR8GM9B1RJBX type=write size=4020780 2024-09-12T18:32:58.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.191+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=XPBR2CNXLSFX type=del size=2095388 2024-09-12T18:32:58.196 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.195+0000 7f41a072b8c0 1 < canceled operation key=295ZC54QRUPD tag=CAJKWNZ3ZZQA type=write size=952363 2024-09-12T18:32:58.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.199+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=399Y8L3AFJR6 type=del size=2607843 2024-09-12T18:32:58.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.199+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~AAJMF8VQV9YA.0 size=1048576 2024-09-12T18:32:58.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.203+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~AAJMF8VQV9YA.1 size=366607 2024-09-12T18:32:58.207 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.207+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=AAJMF8VQV9YA tag=DYUBKXTD26R4 type=write size=2463759 2024-09-12T18:32:58.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.211+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~RB2B3JINWTMW.0 size=525650 2024-09-12T18:32:58.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.211+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=RB2B3JINWTMW tag=IWUMO02Q0U4Z type=write size=1574226 2024-09-12T18:32:58.214 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.211+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=ZDTHVTBSZTSZ type=del 2024-09-12T18:32:58.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.219+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~G2WBPBWN1WST.0 size=294216 2024-09-12T18:32:58.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.219+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=G2WBPBWN1WST tag=JWPUI1ONPSVL type=write size=1342792 2024-09-12T18:32:58.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.219+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~PB7FYPG8E8JN.0 size=230539 2024-09-12T18:32:58.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.223+0000 7f41a072b8c0 1 < completed multipart upload key=VEN0P2P1RZ2S upload=PB7FYPG8E8JN tag=HRWE5XDBUVJ1 type=write size=1279115 2024-09-12T18:32:58.228 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.227+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=774GFONHMIJ6 type=del size=3232829 2024-09-12T18:32:58.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.231+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=4QXZT3EWT61N type=del 2024-09-12T18:32:58.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.235+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~04JUCWFOJXNX.0 size=1048576 2024-09-12T18:32:58.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.239+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~04JUCWFOJXNX.1 size=530616 2024-09-12T18:32:58.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.239+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=04JUCWFOJXNX tag=Z2DP1PE2UR67 type=write size=2627768 2024-09-12T18:32:58.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.239+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~NTL3JPKRXWHE.0 size=1048576 2024-09-12T18:32:58.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.243+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~NTL3JPKRXWHE.1 size=660222 2024-09-12T18:32:58.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.247+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=NTL3JPKRXWHE tag=KBIA5MPVLMUF type=write size=2757374 2024-09-12T18:32:58.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.251+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~F3DQGSOKV0LJ.0 size=1048576 2024-09-12T18:32:58.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.255+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~F3DQGSOKV0LJ.1 size=1048576 2024-09-12T18:32:58.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.259+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~F3DQGSOKV0LJ.2 size=1026171 2024-09-12T18:32:58.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.259+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=F3DQGSOKV0LJ tag=9XS7OEJKE05Z type=write size=4171899 2024-09-12T18:32:58.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.263+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=H2H9PWJIE4GQ type=del 2024-09-12T18:32:58.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.267+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=ODX30GCVTRBM type=del size=723642 2024-09-12T18:32:58.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.267+0000 7f41a072b8c0 1 < canceled operation key=5JUWC8RXSA5L tag=VBNG43D1FPUW type=del size=908538 2024-09-12T18:32:58.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.271+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=T9OBIDVY6L7P type=del size=3999922 2024-09-12T18:32:58.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.275+0000 7f41a072b8c0 1 < completed write operation key=VEN0P2P1RZ2S tag=SV0VBESWWYJT type=write size=65709 2024-09-12T18:32:58.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.279+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~RO3YXHC4GY2F.0 size=1048576 2024-09-12T18:32:58.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.279+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~RO3YXHC4GY2F.1 size=425057 2024-09-12T18:32:58.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.279+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=RO3YXHC4GY2F tag=RSKFWKPP255X type=write size=2522209 2024-09-12T18:32:58.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.279+0000 7f41a072b8c0 1 < canceled part key=_multipart_KP2HF4J376EY.2~KQWTKGT31NTU.0 size=1048576 2024-09-12T18:32:58.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.283+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~KQWTKGT31NTU.1 size=421725 2024-09-12T18:32:58.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.287+0000 7f41a072b8c0 1 < canceled multipart upload key=KP2HF4J376EY upload=KQWTKGT31NTU tag=KY6AWIC7LWPX type=write size=2518877 2024-09-12T18:32:58.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.291+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=3WP7NF9V5DAI type=del size=2137807 2024-09-12T18:32:58.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.291+0000 7f41a072b8c0 1 < completed write operation key=ZACT36ZOC9ES tag=LYPA0705GCJV type=write size=530817 2024-09-12T18:32:58.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.295+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=EX14O96T6WKO type=del size=2783870 2024-09-12T18:32:58.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.299+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~MOPIZK0OVK78.0 size=1048576 2024-09-12T18:32:58.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.299+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~MOPIZK0OVK78.1 size=639956 2024-09-12T18:32:58.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.303+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=MOPIZK0OVK78 tag=1YXFIQQG7178 type=write size=2737108 2024-09-12T18:32:58.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.311+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~1VKHHJI5HMOA.0 size=1048576 2024-09-12T18:32:58.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.311+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~1VKHHJI5HMOA.1 size=238350 2024-09-12T18:32:58.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.311+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=1VKHHJI5HMOA tag=JX854QVHKK2R type=write size=2335502 2024-09-12T18:32:58.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.315+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=VN32H3LMJ38Y type=del 2024-09-12T18:32:58.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.315+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=Z5RN306T98IM type=del size=3867649 2024-09-12T18:32:58.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.319+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=KMKIZ5Q38NYA type=del 2024-09-12T18:32:58.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.323+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~YJ7KXNHMF686.0 size=110294 2024-09-12T18:32:58.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.323+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=YJ7KXNHMF686 tag=0XH12G882CZR type=write size=1158870 2024-09-12T18:32:58.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.327+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~4BYGN7152JGL.0 size=1048576 2024-09-12T18:32:58.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.327+0000 7f41a072b8c0 1 < canceled part key=_multipart_5JUWC8RXSA5L.2~4BYGN7152JGL.1 size=1048576 2024-09-12T18:32:58.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.331+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~4BYGN7152JGL.2 size=372114 2024-09-12T18:32:58.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.335+0000 7f41a072b8c0 1 < canceled multipart upload key=5JUWC8RXSA5L upload=4BYGN7152JGL tag=H3L4FAMMXNTE type=write size=3517842 2024-09-12T18:32:58.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.335+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=0LFG97GIY0TS type=del size=280109 2024-09-12T18:32:58.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.343+0000 7f41a072b8c0 1 < suggested remove operation key=A6GQZL25YSNL tag=XPBR2CNXLSFX type=del 2024-09-12T18:32:58.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.343+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=96WISRCOEMRU type=del size=3865946 2024-09-12T18:32:58.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.347+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=399Y8L3AFJR6 type=del 2024-09-12T18:32:58.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.351+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=BWVS86UVVYDX type=write size=914212 2024-09-12T18:32:58.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.355+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~RB2B3JINWTMW.0 size=525650 2024-09-12T18:32:58.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.359+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=RB2B3JINWTMW tag=IWUMO02Q0U4Z type=write size=1574226 2024-09-12T18:32:58.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.359+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=W3GTS9393RZJ type=del size=3337501 2024-09-12T18:32:58.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.363+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~G2WBPBWN1WST.0 size=294216 2024-09-12T18:32:58.369 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.367+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=G2WBPBWN1WST tag=JWPUI1ONPSVL type=write size=1342792 2024-09-12T18:32:58.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.375+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~8JE4G654N0GY.0 size=880806 2024-09-12T18:32:58.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.375+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=8JE4G654N0GY tag=MCFG3AH5DAE1 type=write size=1929382 2024-09-12T18:32:58.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.379+0000 7f41a072b8c0 1 < suggested update operation key=GC8797KSO47E tag=774GFONHMIJ6 type=del size=3232829 2024-09-12T18:32:58.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.383+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=O5U1HOSROB3U type=del size=282701 2024-09-12T18:32:58.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.383+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~04JUCWFOJXNX.0 size=1048576 2024-09-12T18:32:58.388 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.387+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~04JUCWFOJXNX.1 size=530616 2024-09-12T18:32:58.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.391+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=04JUCWFOJXNX tag=Z2DP1PE2UR67 type=write size=2627768 2024-09-12T18:32:58.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.395+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~FZI9PPXNNFTW.0 size=701195 2024-09-12T18:32:58.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.395+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=FZI9PPXNNFTW tag=D3AS9UOFZMDC type=write size=1749771 2024-09-12T18:32:58.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.399+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~F3DQGSOKV0LJ.0 size=1048576 2024-09-12T18:32:58.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.399+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~F3DQGSOKV0LJ.1 size=1048576 2024-09-12T18:32:58.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.403+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~F3DQGSOKV0LJ.2 size=1026171 2024-09-12T18:32:58.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.407+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=F3DQGSOKV0LJ tag=9XS7OEJKE05Z type=write size=4171899 2024-09-12T18:32:58.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.411+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~8OBJKK5OKCSM.0 size=1048576 2024-09-12T18:32:58.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.411+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~8OBJKK5OKCSM.1 size=1048576 2024-09-12T18:32:58.416 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.415+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~8OBJKK5OKCSM.2 size=1031791 2024-09-12T18:32:58.416 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.415+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=8OBJKK5OKCSM tag=CLBT94KEVZ3N type=write size=4177519 2024-09-12T18:32:58.419 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.419+0000 7f41a072b8c0 1 < canceled operation key=KP2HF4J376EY tag=ODX30GCVTRBM type=del size=723642 2024-09-12T18:32:58.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.423+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~F7JAXZ8KXATA.0 size=49295 2024-09-12T18:32:58.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.423+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=F7JAXZ8KXATA tag=SPLCGNM48WSK type=write size=1097871 2024-09-12T18:32:58.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.423+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=T9OBIDVY6L7P type=del 2024-09-12T18:32:58.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.427+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~IDPBX5X2AKGH.0 size=1048576 2024-09-12T18:32:58.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.431+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~IDPBX5X2AKGH.1 size=1048576 2024-09-12T18:32:58.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.431+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~IDPBX5X2AKGH.2 size=101227 2024-09-12T18:32:58.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.431+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=IDPBX5X2AKGH tag=I0CNETRLK93B type=write size=3246955 2024-09-12T18:32:58.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.435+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~RO3YXHC4GY2F.0 size=1048576 2024-09-12T18:32:58.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.435+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~RO3YXHC4GY2F.1 size=425057 2024-09-12T18:32:58.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.439+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=RO3YXHC4GY2F tag=RSKFWKPP255X type=write size=2522209 2024-09-12T18:32:58.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.447+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~5II2OP8HH9U8.0 size=1048576 2024-09-12T18:32:58.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.447+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~5II2OP8HH9U8.1 size=910337 2024-09-12T18:32:58.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.447+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=5II2OP8HH9U8 tag=SCUOC20OR9MD type=write size=3007489 2024-09-12T18:32:58.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.451+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=3WP7NF9V5DAI type=del 2024-09-12T18:32:58.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.451+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=3BOTJR1C9HN1 type=write size=156960 2024-09-12T18:32:58.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.455+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=EX14O96T6WKO type=del 2024-09-12T18:32:58.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.459+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~Z7KU1PZ3I814.0 size=1048576 2024-09-12T18:32:58.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.463+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~Z7KU1PZ3I814.1 size=937128 2024-09-12T18:32:58.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.463+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=Z7KU1PZ3I814 tag=91BXF4FA071I type=write size=3034280 2024-09-12T18:32:58.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.463+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~1VKHHJI5HMOA.0 size=1048576 2024-09-12T18:32:58.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.463+0000 7f41a072b8c0 1 < canceled part key=_multipart_0G0YWIOD3L3I.2~1VKHHJI5HMOA.1 size=238350 2024-09-12T18:32:58.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.467+0000 7f41a072b8c0 1 < canceled multipart upload key=0G0YWIOD3L3I upload=1VKHHJI5HMOA tag=JX854QVHKK2R type=write size=2335502 2024-09-12T18:32:58.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.471+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~YP9000C7FNS7.0 size=1027722 2024-09-12T18:32:58.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.471+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=YP9000C7FNS7 tag=0E5H8RFXCPQN type=write size=2076298 2024-09-12T18:32:58.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.475+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=Z5RN306T98IM type=del 2024-09-12T18:32:58.478 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.479+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=9YZ72DS1AGSR type=write size=587171 2024-09-12T18:32:58.481 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.479+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~YJ7KXNHMF686.0 size=110294 2024-09-12T18:32:58.485 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.483+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=YJ7KXNHMF686 tag=0XH12G882CZR type=write size=1158870 2024-09-12T18:32:58.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.487+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~N1KW26D3HHT0.0 size=1048576 2024-09-12T18:32:58.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.491+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~N1KW26D3HHT0.1 size=540706 2024-09-12T18:32:58.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.491+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=N1KW26D3HHT0 tag=WQQL0MCG5U6Q type=write size=2637858 2024-09-12T18:32:58.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.491+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=0LFG97GIY0TS type=del 2024-09-12T18:32:58.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.495+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=QDN6D805TLEH type=write size=287529 2024-09-12T18:32:58.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.499+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=96WISRCOEMRU type=del 2024-09-12T18:32:58.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.503+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~FYIGULLHDMVL.0 size=1048576 2024-09-12T18:32:58.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~FYIGULLHDMVL.1 size=1048576 2024-09-12T18:32:58.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~FYIGULLHDMVL.2 size=112566 2024-09-12T18:32:58.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.507+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=FYIGULLHDMVL tag=2G0BVOC9841Z type=write size=3258294 2024-09-12T18:32:58.512 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.511+0000 7f41a072b8c0 1 < completed write operation key=A6GQZL25YSNL tag=BWVS86UVVYDX type=write size=914212 2024-09-12T18:32:58.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.515+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=L2WDFHGAKPBK type=del size=1107461 2024-09-12T18:32:58.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.515+0000 7f41a072b8c0 1 < canceled operation key=KP2HF4J376EY tag=W3GTS9393RZJ type=del size=3337501 2024-09-12T18:32:58.522 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.519+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~D92VIUGX8KUW.0 size=1048576 2024-09-12T18:32:58.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.523+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~D92VIUGX8KUW.1 size=1048576 2024-09-12T18:32:58.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.523+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~D92VIUGX8KUW.2 size=394833 2024-09-12T18:32:58.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.523+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=D92VIUGX8KUW tag=39MNHW0E6VW7 type=write size=3540561 2024-09-12T18:32:58.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.527+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~8JE4G654N0GY.0 size=880806 2024-09-12T18:32:58.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.531+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=8JE4G654N0GY tag=MCFG3AH5DAE1 type=write size=1929382 2024-09-12T18:32:58.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.535+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=W4FY9QPGFTHE type=write size=578942 2024-09-12T18:32:58.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.535+0000 7f41a072b8c0 1 < completed delete operation key=3R9RN03RFRJP tag=O5U1HOSROB3U type=del 2024-09-12T18:32:58.544 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.543+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~Z0B44WP6HBR2.0 size=226770 2024-09-12T18:32:58.544 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.543+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=Z0B44WP6HBR2 tag=7WRSJT1KTW3F type=write size=1275346 2024-09-12T18:32:58.547 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.547+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~FZI9PPXNNFTW.0 size=701195 2024-09-12T18:32:58.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.551+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=FZI9PPXNNFTW tag=D3AS9UOFZMDC type=write size=1749771 2024-09-12T18:32:58.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.555+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=1G8H789628R3 type=del size=3837300 2024-09-12T18:32:58.559 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.559+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~8OBJKK5OKCSM.0 size=1048576 2024-09-12T18:32:58.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.559+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~8OBJKK5OKCSM.1 size=1048576 2024-09-12T18:32:58.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.559+0000 7f41a072b8c0 1 < canceled part key=_multipart_31T6AP6MUBKL.2~8OBJKK5OKCSM.2 size=1031791 2024-09-12T18:32:58.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.567+0000 7f41a072b8c0 1 < canceled multipart upload key=31T6AP6MUBKL upload=8OBJKK5OKCSM tag=CLBT94KEVZ3N type=write size=4177519 2024-09-12T18:32:58.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.567+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=E76780I0VOML type=write size=434117 2024-09-12T18:32:58.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.571+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~F7JAXZ8KXATA.0 size=49295 2024-09-12T18:32:58.577 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.575+0000 7f41a072b8c0 1 < completed multipart upload key=L01GL4WOUIL2 upload=F7JAXZ8KXATA tag=SPLCGNM48WSK type=write size=1097871 2024-09-12T18:32:58.582 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.579+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~75ALDABNUPBW.0 size=1048576 2024-09-12T18:32:58.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.583+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~75ALDABNUPBW.1 size=1048576 2024-09-12T18:32:58.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.583+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~75ALDABNUPBW.2 size=781651 2024-09-12T18:32:58.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.583+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=75ALDABNUPBW tag=Q69V86Y081TR type=write size=3927379 2024-09-12T18:32:58.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.587+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~IDPBX5X2AKGH.0 size=1048576 2024-09-12T18:32:58.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.591+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~IDPBX5X2AKGH.1 size=1048576 2024-09-12T18:32:58.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.591+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~IDPBX5X2AKGH.2 size=101227 2024-09-12T18:32:58.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.595+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=IDPBX5X2AKGH tag=I0CNETRLK93B type=write size=3246955 2024-09-12T18:32:58.601 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.599+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=CKZDE302RVX7 type=del size=433645 2024-09-12T18:32:58.604 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.603+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~5II2OP8HH9U8.0 size=1048576 2024-09-12T18:32:58.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.607+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~5II2OP8HH9U8.1 size=910337 2024-09-12T18:32:58.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.611+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=5II2OP8HH9U8 tag=SCUOC20OR9MD type=write size=3007489 2024-09-12T18:32:58.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.615+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=T7VISAGY7Y4J type=del size=3678607 2024-09-12T18:32:58.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.615+0000 7f41a072b8c0 1 < completed write operation key=P732C5X0RG8Z tag=3BOTJR1C9HN1 type=write size=156960 2024-09-12T18:32:58.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.623+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~3PIUO6JJDGO3.0 size=1048576 2024-09-12T18:32:58.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.627+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~3PIUO6JJDGO3.1 size=1048576 2024-09-12T18:32:58.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.627+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~3PIUO6JJDGO3.2 size=731680 2024-09-12T18:32:58.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.627+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=3PIUO6JJDGO3 tag=T2R899OQYO38 type=write size=3877408 2024-09-12T18:32:58.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.631+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~Z7KU1PZ3I814.0 size=1048576 2024-09-12T18:32:58.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.635+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~Z7KU1PZ3I814.1 size=937128 2024-09-12T18:32:58.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.639+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=Z7KU1PZ3I814 tag=91BXF4FA071I type=write size=3034280 2024-09-12T18:32:58.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.643+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=3LLHZK11NLMT type=del size=95186 2024-09-12T18:32:58.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.643+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~YP9000C7FNS7.0 size=1027722 2024-09-12T18:32:58.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.647+0000 7f41a072b8c0 1 < completed multipart upload key=A6GQZL25YSNL upload=YP9000C7FNS7 tag=0E5H8RFXCPQN type=write size=2076298 2024-09-12T18:32:58.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.655+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~51NVOIPBD3PT.0 size=417242 2024-09-12T18:32:58.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.655+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=51NVOIPBD3PT tag=IGGH66NCX9U0 type=write size=1465818 2024-09-12T18:32:58.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.663+0000 7f41a072b8c0 1 < suggested remove operation key=295ZC54QRUPD tag=9YZ72DS1AGSR type=write 2024-09-12T18:32:58.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.667+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~E66C7804BOYY.0 size=979992 2024-09-12T18:32:58.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.667+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=E66C7804BOYY tag=V3YQ96OMEOPD type=write size=2028568 2024-09-12T18:32:58.672 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.671+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~N1KW26D3HHT0.0 size=1048576 2024-09-12T18:32:58.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.675+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~N1KW26D3HHT0.1 size=540706 2024-09-12T18:32:58.681 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.679+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=N1KW26D3HHT0 tag=WQQL0MCG5U6Q type=write size=2637858 2024-09-12T18:32:58.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.687+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~RLYC70NHQY3H.0 size=904675 2024-09-12T18:32:58.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.687+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=RLYC70NHQY3H tag=YO7DU6D7QCLT type=write size=1953251 2024-09-12T18:32:58.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.687+0000 7f41a072b8c0 1 < completed write operation key=GC8797KSO47E tag=QDN6D805TLEH type=write size=287529 2024-09-12T18:32:58.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.695+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~8LLLFJKY0VZS.0 size=363965 2024-09-12T18:32:58.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.695+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=8LLLFJKY0VZS tag=260AVOUN5RQ8 type=write size=1412541 2024-09-12T18:32:58.697 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.695+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~FYIGULLHDMVL.0 size=1048576 2024-09-12T18:32:58.700 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.699+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~FYIGULLHDMVL.1 size=1048576 2024-09-12T18:32:58.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.703+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~FYIGULLHDMVL.2 size=112566 2024-09-12T18:32:58.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.707+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=FYIGULLHDMVL tag=2G0BVOC9841Z type=write size=3258294 2024-09-12T18:32:58.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.711+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=Y4LVWY00UYEU type=del size=98738 2024-09-12T18:32:58.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.711+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=L2WDFHGAKPBK type=del 2024-09-12T18:32:58.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.719+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~NYF6RTA4G1ZY.0 size=1048576 2024-09-12T18:32:58.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.719+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~NYF6RTA4G1ZY.1 size=648609 2024-09-12T18:32:58.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.719+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=NYF6RTA4G1ZY tag=Q85S0Z2T332B type=write size=2745761 2024-09-12T18:32:58.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.723+0000 7f41a072b8c0 1 < canceled part key=_multipart_3CGBX19WTMWQ.2~D92VIUGX8KUW.0 size=1048576 2024-09-12T18:32:58.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.723+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~D92VIUGX8KUW.1 size=1048576 2024-09-12T18:32:58.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.727+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~D92VIUGX8KUW.2 size=394833 2024-09-12T18:32:58.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.731+0000 7f41a072b8c0 1 < canceled multipart upload key=3CGBX19WTMWQ upload=D92VIUGX8KUW tag=39MNHW0E6VW7 type=write size=3540561 2024-09-12T18:32:58.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.735+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~VL0Z9G9NF0FT.0 size=1048576 2024-09-12T18:32:58.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.739+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~VL0Z9G9NF0FT.1 size=1048576 2024-09-12T18:32:58.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.739+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~VL0Z9G9NF0FT.2 size=334905 2024-09-12T18:32:58.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.739+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=VL0Z9G9NF0FT tag=SL4TARSAU8UA type=write size=3480633 2024-09-12T18:32:58.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.743+0000 7f41a072b8c0 1 < canceled operation key=0G0YWIOD3L3I tag=W4FY9QPGFTHE type=write size=578942 2024-09-12T18:32:58.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.747+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=34IY5NU16FVO type=del size=1819894 2024-09-12T18:32:58.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.751+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~Z0B44WP6HBR2.0 size=226770 2024-09-12T18:32:58.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.755+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=Z0B44WP6HBR2 tag=7WRSJT1KTW3F type=write size=1275346 2024-09-12T18:32:58.759 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.759+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=7G7BOKI2SKSX type=del size=3746022 2024-09-12T18:32:58.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.763+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=1G8H789628R3 type=del 2024-09-12T18:32:58.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.771+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~0HBPUEI2TUTI.0 size=632308 2024-09-12T18:32:58.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.771+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=0HBPUEI2TUTI tag=O38MZOX3EFFT type=write size=1680884 2024-09-12T18:32:58.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.775+0000 7f41a072b8c0 1 < completed write operation key=C2PRRD3QO9AF tag=E76780I0VOML type=write size=434117 2024-09-12T18:32:58.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.775+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=86P0AE052WWM type=write size=624001 2024-09-12T18:32:58.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.779+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~75ALDABNUPBW.0 size=1048576 2024-09-12T18:32:58.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.783+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~75ALDABNUPBW.1 size=1048576 2024-09-12T18:32:58.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.783+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~75ALDABNUPBW.2 size=781651 2024-09-12T18:32:58.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.791+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=75ALDABNUPBW tag=Q69V86Y081TR type=write size=3927379 2024-09-12T18:32:58.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.791+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=CRY3PBDAWZ92 type=del size=3254693 2024-09-12T18:32:58.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.795+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=CKZDE302RVX7 type=del 2024-09-12T18:32:58.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.799+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~H93IHPHCJUZA.0 size=1048576 2024-09-12T18:32:58.804 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.803+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~H93IHPHCJUZA.1 size=423022 2024-09-12T18:32:58.804 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.803+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=H93IHPHCJUZA tag=NSSBW224SJAG type=write size=2520174 2024-09-12T18:32:58.807 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.807+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=T7VISAGY7Y4J type=del 2024-09-12T18:32:58.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.807+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=TYFDMYEZ3219 type=del size=1089893 2024-09-12T18:32:58.812 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.811+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~3PIUO6JJDGO3.0 size=1048576 2024-09-12T18:32:58.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.815+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~3PIUO6JJDGO3.1 size=1048576 2024-09-12T18:32:58.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.815+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~3PIUO6JJDGO3.2 size=731680 2024-09-12T18:32:58.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.819+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=3PIUO6JJDGO3 tag=T2R899OQYO38 type=write size=3877408 2024-09-12T18:32:58.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.827+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~ISJRHY9P6FTS.0 size=857744 2024-09-12T18:32:58.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.827+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=ISJRHY9P6FTS tag=VQHPL8LRVEE4 type=write size=1906320 2024-09-12T18:32:58.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.827+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=3LLHZK11NLMT type=del 2024-09-12T18:32:58.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.835+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~6LBOEDU1G41F.0 size=1048576 2024-09-12T18:32:58.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.835+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~6LBOEDU1G41F.1 size=1048576 2024-09-12T18:32:58.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.839+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~6LBOEDU1G41F.2 size=82741 2024-09-12T18:32:58.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.839+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=6LBOEDU1G41F tag=BR3P8W678LWA type=write size=3228469 2024-09-12T18:32:58.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.839+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~51NVOIPBD3PT.0 size=417242 2024-09-12T18:32:58.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.847+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=51NVOIPBD3PT tag=IGGH66NCX9U0 type=write size=1465818 2024-09-12T18:32:58.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.851+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~TS9MTFEJEZVN.0 size=1048576 2024-09-12T18:32:58.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.851+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~TS9MTFEJEZVN.1 size=1048576 2024-09-12T18:32:58.856 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.855+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~TS9MTFEJEZVN.2 size=438375 2024-09-12T18:32:58.856 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.855+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=TS9MTFEJEZVN tag=CUXFPSI3HF2G type=write size=3584103 2024-09-12T18:32:58.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.859+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~E66C7804BOYY.0 size=979992 2024-09-12T18:32:58.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.863+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=E66C7804BOYY tag=V3YQ96OMEOPD type=write size=2028568 2024-09-12T18:32:58.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.867+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~2UWR10Y97XIC.0 size=1048576 2024-09-12T18:32:58.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.871+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~2UWR10Y97XIC.1 size=1048576 2024-09-12T18:32:58.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.871+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~2UWR10Y97XIC.2 size=113479 2024-09-12T18:32:58.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.871+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=2UWR10Y97XIC tag=WYA16YLP05CU type=write size=3259207 2024-09-12T18:32:58.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.875+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~RLYC70NHQY3H.0 size=904675 2024-09-12T18:32:58.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.879+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=RLYC70NHQY3H tag=YO7DU6D7QCLT type=write size=1953251 2024-09-12T18:32:58.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.883+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=VXMYWUHTNDNC type=del size=1782222 2024-09-12T18:32:58.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.887+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~8LLLFJKY0VZS.0 size=363965 2024-09-12T18:32:58.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.891+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=8LLLFJKY0VZS tag=260AVOUN5RQ8 type=write size=1412541 2024-09-12T18:32:58.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.895+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~8BQHGZZSSB0R.0 size=124567 2024-09-12T18:32:58.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.895+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=8BQHGZZSSB0R tag=04K0B405ZL4U type=write size=1173143 2024-09-12T18:32:58.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.899+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=Y4LVWY00UYEU type=del 2024-09-12T18:32:58.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.903+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~JUIMU9IBMWRQ.0 size=1048576 2024-09-12T18:32:58.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.903+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~JUIMU9IBMWRQ.1 size=130571 2024-09-12T18:32:58.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.903+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=JUIMU9IBMWRQ tag=Z3TDJKQ5DF5N type=write size=2227723 2024-09-12T18:32:58.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.907+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~NYF6RTA4G1ZY.0 size=1048576 2024-09-12T18:32:58.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.911+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~NYF6RTA4G1ZY.1 size=648609 2024-09-12T18:32:58.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.915+0000 7f41a072b8c0 1 < completed multipart upload key=A6GQZL25YSNL upload=NYF6RTA4G1ZY tag=Q85S0Z2T332B type=write size=2745761 2024-09-12T18:32:58.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.919+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~QJMZZPRZ0LT7.0 size=1048576 2024-09-12T18:32:58.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.923+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~QJMZZPRZ0LT7.1 size=666292 2024-09-12T18:32:58.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.923+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=QJMZZPRZ0LT7 tag=WNO0ZKTW6L5I type=write size=2763444 2024-09-12T18:32:58.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.923+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~VL0Z9G9NF0FT.0 size=1048576 2024-09-12T18:32:58.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.927+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~VL0Z9G9NF0FT.1 size=1048576 2024-09-12T18:32:58.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.927+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~VL0Z9G9NF0FT.2 size=334905 2024-09-12T18:32:58.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.935+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=VL0Z9G9NF0FT tag=SL4TARSAU8UA type=write size=3480633 2024-09-12T18:32:58.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.935+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=JSZ1CV9KNUXY type=del size=3017529 2024-09-12T18:32:58.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.939+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=34IY5NU16FVO type=del 2024-09-12T18:32:58.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.943+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=RBWXSBVK3P5L type=del size=3654142 2024-09-12T18:32:58.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.943+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=7G7BOKI2SKSX type=del 2024-09-12T18:32:58.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.951+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~I8JP3KA9VQZK.0 size=766841 2024-09-12T18:32:58.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.951+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=I8JP3KA9VQZK tag=QK3MVK1H89FF type=write size=1815417 2024-09-12T18:32:58.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.955+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~0HBPUEI2TUTI.0 size=632308 2024-09-12T18:32:58.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.959+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=0HBPUEI2TUTI tag=O38MZOX3EFFT type=write size=1680884 2024-09-12T18:32:58.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.963+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=A55Y93NB7I2J type=del size=3628417 2024-09-12T18:32:58.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.963+0000 7f41a072b8c0 1 < canceled operation key=7B70QWGMH0C0 tag=86P0AE052WWM type=write size=624001 2024-09-12T18:32:58.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.967+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=7VWD14Y4R3HZ type=del size=807503 2024-09-12T18:32:58.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.971+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=CRY3PBDAWZ92 type=del 2024-09-12T18:32:58.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.975+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~C0MWMA0GJZXY.0 size=1048576 2024-09-12T18:32:58.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.979+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~C0MWMA0GJZXY.1 size=1048576 2024-09-12T18:32:58.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.983+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~C0MWMA0GJZXY.2 size=807128 2024-09-12T18:32:58.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.983+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=C0MWMA0GJZXY tag=MF7HZC442Q5G type=write size=3952856 2024-09-12T18:32:58.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.983+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~H93IHPHCJUZA.0 size=1048576 2024-09-12T18:32:58.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.983+0000 7f41a072b8c0 1 < canceled part key=_multipart_295ZC54QRUPD.2~H93IHPHCJUZA.1 size=423022 2024-09-12T18:32:58.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.987+0000 7f41a072b8c0 1 < canceled multipart upload key=295ZC54QRUPD upload=H93IHPHCJUZA tag=NSSBW224SJAG type=write size=2520174 2024-09-12T18:32:58.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.991+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=4T4TV7FKCEZJ type=del size=4163181 2024-09-12T18:32:58.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.995+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=TYFDMYEZ3219 type=del 2024-09-12T18:32:59.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.999+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~175N2W2PG58N.0 size=1048576 2024-09-12T18:32:59.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:58.999+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~175N2W2PG58N.1 size=1048576 2024-09-12T18:32:59.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.003+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~175N2W2PG58N.2 size=299219 2024-09-12T18:32:59.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.003+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=175N2W2PG58N tag=Y7EW4ZJT8P8S type=write size=3444947 2024-09-12T18:32:59.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.007+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~ISJRHY9P6FTS.0 size=857744 2024-09-12T18:32:59.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.011+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=ISJRHY9P6FTS tag=VQHPL8LRVEE4 type=write size=1906320 2024-09-12T18:32:59.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.015+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~HESMH3WU6WSK.0 size=387194 2024-09-12T18:32:59.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.015+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=HESMH3WU6WSK tag=30U12UJTTHYF type=write size=1435770 2024-09-12T18:32:59.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.015+0000 7f41a072b8c0 1 < canceled part key=_multipart_58IT2R988AW9.2~6LBOEDU1G41F.0 size=1048576 2024-09-12T18:32:59.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.019+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~6LBOEDU1G41F.1 size=1048576 2024-09-12T18:32:59.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.023+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~6LBOEDU1G41F.2 size=82741 2024-09-12T18:32:59.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.031+0000 7f41a072b8c0 1 < canceled multipart upload key=58IT2R988AW9 upload=6LBOEDU1G41F tag=BR3P8W678LWA type=write size=3228469 2024-09-12T18:32:59.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.035+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=F9BQHXG1BJGH type=write size=91189 2024-09-12T18:32:59.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.035+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~TS9MTFEJEZVN.0 size=1048576 2024-09-12T18:32:59.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.039+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~TS9MTFEJEZVN.1 size=1048576 2024-09-12T18:32:59.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.039+0000 7f41a072b8c0 1 < canceled part key=_multipart_7B70QWGMH0C0.2~TS9MTFEJEZVN.2 size=438375 2024-09-12T18:32:59.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.043+0000 7f41a072b8c0 1 < canceled multipart upload key=7B70QWGMH0C0 upload=TS9MTFEJEZVN tag=CUXFPSI3HF2G type=write size=3584103 2024-09-12T18:32:59.047 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.047+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=LSMV2GB07ZO5 type=del size=2047155 2024-09-12T18:32:59.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.047+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~2UWR10Y97XIC.0 size=1048576 2024-09-12T18:32:59.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.051+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~2UWR10Y97XIC.1 size=1048576 2024-09-12T18:32:59.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.051+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~2UWR10Y97XIC.2 size=113479 2024-09-12T18:32:59.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.055+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=2UWR10Y97XIC tag=WYA16YLP05CU type=write size=3259207 2024-09-12T18:32:59.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.059+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=E43S8YS3GHOO type=del size=2691873 2024-09-12T18:32:59.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.063+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=VXMYWUHTNDNC type=del 2024-09-12T18:32:59.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.063+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=RWR5OSTQM3II type=del size=1778789 2024-09-12T18:32:59.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.067+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~8BQHGZZSSB0R.0 size=124567 2024-09-12T18:32:59.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.071+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=8BQHGZZSSB0R tag=04K0B405ZL4U type=write size=1173143 2024-09-12T18:32:59.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.075+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~9P4YTL8P32VV.0 size=1048576 2024-09-12T18:32:59.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.079+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~9P4YTL8P32VV.1 size=1048576 2024-09-12T18:32:59.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.083+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~9P4YTL8P32VV.2 size=643562 2024-09-12T18:32:59.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.083+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=9P4YTL8P32VV tag=9AGF65RCZM3T type=write size=3789290 2024-09-12T18:32:59.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.083+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~JUIMU9IBMWRQ.0 size=1048576 2024-09-12T18:32:59.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.087+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~JUIMU9IBMWRQ.1 size=130571 2024-09-12T18:32:59.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.091+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=JUIMU9IBMWRQ tag=Z3TDJKQ5DF5N type=write size=2227723 2024-09-12T18:32:59.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.091+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=IATOTM4NVIJ5 type=del size=900999 2024-09-12T18:32:59.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.095+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~QJMZZPRZ0LT7.0 size=1048576 2024-09-12T18:32:59.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.099+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~QJMZZPRZ0LT7.1 size=666292 2024-09-12T18:32:59.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.103+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=QJMZZPRZ0LT7 tag=WNO0ZKTW6L5I type=write size=2763444 2024-09-12T18:32:59.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.107+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~VA2TB5CMFIEG.0 size=1048576 2024-09-12T18:32:59.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.107+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~VA2TB5CMFIEG.1 size=887917 2024-09-12T18:32:59.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.107+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=VA2TB5CMFIEG tag=ZI5KI24574WI type=write size=2985069 2024-09-12T18:32:59.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.115+0000 7f41a072b8c0 1 < suggested update operation key=YCBC1CHWJQC5 tag=JSZ1CV9KNUXY type=del size=3017529 2024-09-12T18:32:59.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.115+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=77ZE7N2PIPTG type=write size=671737 2024-09-12T18:32:59.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.119+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=RBWXSBVK3P5L type=del 2024-09-12T18:32:59.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.123+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=YAVM3XYFZSMO type=del size=1631719 2024-09-12T18:32:59.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.127+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~I8JP3KA9VQZK.0 size=766841 2024-09-12T18:32:59.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.131+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=I8JP3KA9VQZK tag=QK3MVK1H89FF type=write size=1815417 2024-09-12T18:32:59.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.131+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=83PD181UFH1M type=del size=144412 2024-09-12T18:32:59.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.135+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=A55Y93NB7I2J type=del 2024-09-12T18:32:59.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.139+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=RIEA01Y6C125 type=write size=571596 2024-09-12T18:32:59.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.139+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=7VWD14Y4R3HZ type=del 2024-09-12T18:32:59.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.143+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=8OY3USU0Z4AI type=del size=2536878 2024-09-12T18:32:59.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.147+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~C0MWMA0GJZXY.0 size=1048576 2024-09-12T18:32:59.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.147+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~C0MWMA0GJZXY.1 size=1048576 2024-09-12T18:32:59.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.151+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~C0MWMA0GJZXY.2 size=807128 2024-09-12T18:32:59.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.155+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=C0MWMA0GJZXY tag=MF7HZC442Q5G type=write size=3952856 2024-09-12T18:32:59.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.159+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=IQK7BJ8QDH93 type=del size=1373611 2024-09-12T18:32:59.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.159+0000 7f41a072b8c0 1 < completed delete operation key=3R9RN03RFRJP tag=4T4TV7FKCEZJ type=del 2024-09-12T18:32:59.164 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.163+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=0PO76ZPPNYZM type=write size=741798 2024-09-12T18:32:59.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.167+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~175N2W2PG58N.0 size=1048576 2024-09-12T18:32:59.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.167+0000 7f41a072b8c0 1 < canceled part key=_multipart_GC8797KSO47E.2~175N2W2PG58N.1 size=1048576 2024-09-12T18:32:59.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.167+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~175N2W2PG58N.2 size=299219 2024-09-12T18:32:59.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.171+0000 7f41a072b8c0 1 < canceled multipart upload key=GC8797KSO47E upload=175N2W2PG58N tag=Y7EW4ZJT8P8S type=write size=3444947 2024-09-12T18:32:59.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.175+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~24M47W6HTL8O.0 size=1048576 2024-09-12T18:32:59.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.179+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~24M47W6HTL8O.1 size=737877 2024-09-12T18:32:59.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.179+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=24M47W6HTL8O tag=XDP3D2RFSOVQ type=write size=2835029 2024-09-12T18:32:59.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.179+0000 7f41a072b8c0 1 < canceled part key=_multipart_GC8797KSO47E.2~HESMH3WU6WSK.0 size=387194 2024-09-12T18:32:59.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.183+0000 7f41a072b8c0 1 < canceled multipart upload key=GC8797KSO47E upload=HESMH3WU6WSK tag=30U12UJTTHYF type=write size=1435770 2024-09-12T18:32:59.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.187+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=HZ6TJLIJXNV0 type=del size=3645812 2024-09-12T18:32:59.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.187+0000 7f41a072b8c0 1 < completed write operation key=1JIIRDVMT0B0 tag=F9BQHXG1BJGH type=write size=91189 2024-09-12T18:32:59.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.191+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=N6ONMSEIJ9YH type=del size=1026643 2024-09-12T18:32:59.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.191+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=LSMV2GB07ZO5 type=del 2024-09-12T18:32:59.196 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.195+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=RQV6XGHEARP7 type=del size=7708 2024-09-12T18:32:59.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.195+0000 7f41a072b8c0 -1 < failed to complete operation key=YCBC1CHWJQC5 tag=E43S8YS3GHOO type=del size=2691873: (22) Invalid argument 2024-09-12T18:32:59.200 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.199+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=7NT3ZKN38I19 type=del size=1943025 2024-09-12T18:32:59.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.203+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=RWR5OSTQM3II type=del 2024-09-12T18:32:59.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.203+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=TLLQC0ZD3PMR type=del size=1404155 2024-09-12T18:32:59.207 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.207+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~9P4YTL8P32VV.0 size=1048576 2024-09-12T18:32:59.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.207+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~9P4YTL8P32VV.1 size=1048576 2024-09-12T18:32:59.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.211+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~9P4YTL8P32VV.2 size=643562 2024-09-12T18:32:59.214 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.215+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=9P4YTL8P32VV tag=9AGF65RCZM3T type=write size=3789290 2024-09-12T18:32:59.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.215+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~HJ07YWHNXNYW.0 size=1048576 2024-09-12T18:32:59.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.219+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~HJ07YWHNXNYW.1 size=1048576 2024-09-12T18:32:59.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.219+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~HJ07YWHNXNYW.2 size=739694 2024-09-12T18:32:59.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.219+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=HJ07YWHNXNYW tag=T8755GP17EUR type=write size=3885422 2024-09-12T18:32:59.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.223+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=IATOTM4NVIJ5 type=del 2024-09-12T18:32:59.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.227+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~8SR2SPA5XMRU.0 size=404013 2024-09-12T18:32:59.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.227+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=8SR2SPA5XMRU tag=XGJWNCB8FREI type=write size=1452589 2024-09-12T18:32:59.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.227+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~VA2TB5CMFIEG.0 size=1048576 2024-09-12T18:32:59.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.231+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~VA2TB5CMFIEG.1 size=887917 2024-09-12T18:32:59.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.235+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=VA2TB5CMFIEG tag=ZI5KI24574WI type=write size=2985069 2024-09-12T18:32:59.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.235+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=SA5OK4WUH2YK type=write size=82951 2024-09-12T18:32:59.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.239+0000 7f41a072b8c0 1 < completed write operation key=1BSAN5TRTZNZ tag=77ZE7N2PIPTG type=write size=671737 2024-09-12T18:32:59.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.243+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=LBSFQTLRMIMJ type=write size=577883 2024-09-12T18:32:59.247 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.247+0000 7f41a072b8c0 1 < suggested update operation key=295ZC54QRUPD tag=YAVM3XYFZSMO type=del size=1631719 2024-09-12T18:32:59.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.247+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=G1QG5SRMMNDK type=del size=2034838 2024-09-12T18:32:59.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.251+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=83PD181UFH1M type=del 2024-09-12T18:32:59.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.255+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~24DGDLXYPCM7.0 size=1048576 2024-09-12T18:32:59.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.255+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~24DGDLXYPCM7.1 size=1048576 2024-09-12T18:32:59.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.259+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~24DGDLXYPCM7.2 size=525141 2024-09-12T18:32:59.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.259+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=24DGDLXYPCM7 tag=P31MJHGHR3BC type=write size=3670869 2024-09-12T18:32:59.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.263+0000 7f41a072b8c0 1 < completed write operation key=VEN0P2P1RZ2S tag=RIEA01Y6C125 type=write size=571596 2024-09-12T18:32:59.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.267+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=OYROU6DESK0C type=del size=2239825 2024-09-12T18:32:59.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.267+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=8OY3USU0Z4AI type=del 2024-09-12T18:32:59.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.271+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=U3IB4YX5PZ0Q type=del size=2301333 2024-09-12T18:32:59.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.271+0000 7f41a072b8c0 1 < completed delete operation key=1JIIRDVMT0B0 tag=IQK7BJ8QDH93 type=del 2024-09-12T18:32:59.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.275+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~JY0SF7LU1TLP.0 size=1048576 2024-09-12T18:32:59.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.279+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~JY0SF7LU1TLP.1 size=457677 2024-09-12T18:32:59.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.279+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=JY0SF7LU1TLP tag=JYAI60GZRIW1 type=write size=2554829 2024-09-12T18:32:59.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.279+0000 7f41a072b8c0 1 < completed write operation key=63BP9QETTAM8 tag=0PO76ZPPNYZM type=write size=741798 2024-09-12T18:32:59.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.283+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=43MZ7BPTORPZ type=write size=670135 2024-09-12T18:32:59.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.283+0000 7f41a072b8c0 1 < canceled part key=_multipart_0G0YWIOD3L3I.2~24M47W6HTL8O.0 size=1048576 2024-09-12T18:32:59.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.287+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~24M47W6HTL8O.1 size=737877 2024-09-12T18:32:59.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.291+0000 7f41a072b8c0 1 < canceled multipart upload key=0G0YWIOD3L3I upload=24M47W6HTL8O tag=XDP3D2RFSOVQ type=write size=2835029 2024-09-12T18:32:59.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.295+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=HDU9XXAHL5SS type=del size=366915 2024-09-12T18:32:59.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.299+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=HZ6TJLIJXNV0 type=del 2024-09-12T18:32:59.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.299+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=OTF2NIXCBGWC type=del size=3278928 2024-09-12T18:32:59.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.303+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=N6ONMSEIJ9YH type=del 2024-09-12T18:32:59.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.307+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=VD3JGJSEKV3W type=del size=1295274 2024-09-12T18:32:59.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.311+0000 7f41a072b8c0 1 < suggested update operation key=YP72VTCGSHYE tag=RQV6XGHEARP7 type=del size=7708 2024-09-12T18:32:59.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.315+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~HHDO62VTXHWW.0 size=1048576 2024-09-12T18:32:59.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.319+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~HHDO62VTXHWW.1 size=1048576 2024-09-12T18:32:59.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.323+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~HHDO62VTXHWW.2 size=28960 2024-09-12T18:32:59.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.323+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=HHDO62VTXHWW tag=OM4IBPTUWD42 type=write size=3174688 2024-09-12T18:32:59.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.323+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=7NT3ZKN38I19 type=del 2024-09-12T18:32:59.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.331+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~5CYIC2AYQ4SJ.0 size=1048576 2024-09-12T18:32:59.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.331+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~5CYIC2AYQ4SJ.1 size=883158 2024-09-12T18:32:59.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.331+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=5CYIC2AYQ4SJ tag=23LWYEOGYRGF type=write size=2980310 2024-09-12T18:32:59.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.335+0000 7f41a072b8c0 1 < canceled operation key=A6GQZL25YSNL tag=TLLQC0ZD3PMR type=del size=1404155 2024-09-12T18:32:59.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.339+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=K6JTCIEUV3KN type=del size=2444839 2024-09-12T18:32:59.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.339+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~HJ07YWHNXNYW.0 size=1048576 2024-09-12T18:32:59.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.343+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~HJ07YWHNXNYW.1 size=1048576 2024-09-12T18:32:59.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.347+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~HJ07YWHNXNYW.2 size=739694 2024-09-12T18:32:59.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.351+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=HJ07YWHNXNYW tag=T8755GP17EUR type=write size=3885422 2024-09-12T18:32:59.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.355+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~23RP86CI87Z5.0 size=868293 2024-09-12T18:32:59.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.355+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=23RP86CI87Z5 tag=DGKP33CHSQPA type=write size=1916869 2024-09-12T18:32:59.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.355+0000 7f41a072b8c0 1 < canceled part key=_multipart_7MRN7L1DTAMO.2~8SR2SPA5XMRU.0 size=404013 2024-09-12T18:32:59.363 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.363+0000 7f41a072b8c0 1 < canceled multipart upload key=7MRN7L1DTAMO upload=8SR2SPA5XMRU tag=XGJWNCB8FREI type=write size=1452589 2024-09-12T18:32:59.366 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.363+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=35HKCU9O5FTV type=del size=3108724 2024-09-12T18:32:59.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.367+0000 7f41a072b8c0 1 < completed write operation key=KP2HF4J376EY tag=SA5OK4WUH2YK type=write size=82951 2024-09-12T18:32:59.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.371+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=CL1F2OL27Q0A type=del size=2608601 2024-09-12T18:32:59.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.375+0000 7f41a072b8c0 1 < completed write operation key=5JUWC8RXSA5L tag=LBSFQTLRMIMJ type=write size=577883 2024-09-12T18:32:59.377 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.375+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=RLOCLAOBS994 type=del size=3228497 2024-09-12T18:32:59.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.379+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=G1QG5SRMMNDK type=del 2024-09-12T18:32:59.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.383+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=G25BXJ7KRL6T type=del size=1081805 2024-09-12T18:32:59.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.383+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~24DGDLXYPCM7.0 size=1048576 2024-09-12T18:32:59.388 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.387+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~24DGDLXYPCM7.1 size=1048576 2024-09-12T18:32:59.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.391+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~24DGDLXYPCM7.2 size=525141 2024-09-12T18:32:59.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.395+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=24DGDLXYPCM7 tag=P31MJHGHR3BC type=write size=3670869 2024-09-12T18:32:59.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.399+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=SSI2YSUWFRXM type=del size=3093782 2024-09-12T18:32:59.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.399+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=OYROU6DESK0C type=del 2024-09-12T18:32:59.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.407+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~3SUENN1QAIIR.0 size=1048576 2024-09-12T18:32:59.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.407+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~3SUENN1QAIIR.1 size=734825 2024-09-12T18:32:59.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.407+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=3SUENN1QAIIR tag=UTWA12ZYJTII type=write size=2831977 2024-09-12T18:32:59.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.411+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=U3IB4YX5PZ0Q type=del 2024-09-12T18:32:59.419 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.419+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~QWT1HYD12SXJ.0 size=1048576 2024-09-12T18:32:59.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.419+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~QWT1HYD12SXJ.1 size=529914 2024-09-12T18:32:59.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.419+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=QWT1HYD12SXJ tag=8OB630OI5I25 type=write size=2627066 2024-09-12T18:32:59.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.423+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~JY0SF7LU1TLP.0 size=1048576 2024-09-12T18:32:59.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.427+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~JY0SF7LU1TLP.1 size=457677 2024-09-12T18:32:59.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.431+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=JY0SF7LU1TLP tag=JYAI60GZRIW1 type=write size=2554829 2024-09-12T18:32:59.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.435+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=QNQZNPYUF1GR type=del size=4018370 2024-09-12T18:32:59.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.439+0000 7f41a072b8c0 1 < completed write operation key=31T6AP6MUBKL tag=43MZ7BPTORPZ type=write size=670135 2024-09-12T18:32:59.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.443+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~9NX04YEBPX4D.0 size=1048576 2024-09-12T18:32:59.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.447+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~9NX04YEBPX4D.1 size=948023 2024-09-12T18:32:59.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.447+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=9NX04YEBPX4D tag=405DPI5CCRHS type=write size=3045175 2024-09-12T18:32:59.450 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.451+0000 7f41a072b8c0 -1 < failed to complete operation key=YP72VTCGSHYE tag=HDU9XXAHL5SS type=del size=366915: (22) Invalid argument 2024-09-12T18:32:59.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.451+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=F9Z23T02K99T type=del size=3780759 2024-09-12T18:32:59.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.459+0000 7f41a072b8c0 1 < suggested remove operation key=0G0YWIOD3L3I tag=OTF2NIXCBGWC type=del 2024-09-12T18:32:59.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.463+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~DY91JM7CC6ZW.0 size=1048576 2024-09-12T18:32:59.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.467+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~DY91JM7CC6ZW.1 size=1048576 2024-09-12T18:32:59.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.467+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~DY91JM7CC6ZW.2 size=879586 2024-09-12T18:32:59.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.467+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=DY91JM7CC6ZW tag=97RTODF85EO3 type=write size=4025314 2024-09-12T18:32:59.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.471+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=VD3JGJSEKV3W type=del 2024-09-12T18:32:59.478 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.479+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~X473CW4JCBZR.0 size=1048576 2024-09-12T18:32:59.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.479+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~X473CW4JCBZR.1 size=1048576 2024-09-12T18:32:59.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.483+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~X473CW4JCBZR.2 size=751490 2024-09-12T18:32:59.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.483+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=X473CW4JCBZR tag=7FYKNNWK318S type=write size=3897218 2024-09-12T18:32:59.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.483+0000 7f41a072b8c0 1 < canceled part key=_multipart_KP2HF4J376EY.2~HHDO62VTXHWW.0 size=1048576 2024-09-12T18:32:59.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.483+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~HHDO62VTXHWW.1 size=1048576 2024-09-12T18:32:59.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.487+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~HHDO62VTXHWW.2 size=28960 2024-09-12T18:32:59.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.491+0000 7f41a072b8c0 1 < canceled multipart upload key=KP2HF4J376EY upload=HHDO62VTXHWW tag=OM4IBPTUWD42 type=write size=3174688 2024-09-12T18:32:59.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.495+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=DTGDM8USJF8S type=del size=3301321 2024-09-12T18:32:59.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.499+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~5CYIC2AYQ4SJ.0 size=1048576 2024-09-12T18:32:59.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.503+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~5CYIC2AYQ4SJ.1 size=883158 2024-09-12T18:32:59.508 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.507+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=5CYIC2AYQ4SJ tag=23LWYEOGYRGF type=write size=2980310 2024-09-12T18:32:59.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.511+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=L22QR4U5PSQK type=del size=3899925 2024-09-12T18:32:59.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.515+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=K6JTCIEUV3KN type=del 2024-09-12T18:32:59.523 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.519+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~QC62V43A1JIJ.0 size=1048576 2024-09-12T18:32:59.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.523+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~QC62V43A1JIJ.1 size=908616 2024-09-12T18:32:59.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.523+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=QC62V43A1JIJ tag=C17P2RO4QGG7 type=write size=3005768 2024-09-12T18:32:59.527 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.527+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~23RP86CI87Z5.0 size=868293 2024-09-12T18:32:59.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.531+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=23RP86CI87Z5 tag=DGKP33CHSQPA type=write size=1916869 2024-09-12T18:32:59.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.535+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=0WI4BPKICTNP type=del size=4033318 2024-09-12T18:32:59.545 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.543+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=35HKCU9O5FTV type=del 2024-09-12T18:32:59.549 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.547+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=O2B2ZK7N2EVJ type=del size=2201886 2024-09-12T18:32:59.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.551+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=CL1F2OL27Q0A type=del 2024-09-12T18:32:59.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.555+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=8OVSISFQPJRG type=del size=1719368 2024-09-12T18:32:59.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.559+0000 7f41a072b8c0 1 < suggested remove operation key=KOLD6WYK30EQ tag=RLOCLAOBS994 type=del 2024-09-12T18:32:59.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.567+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~BGOVQ71VDILV.0 size=1048576 2024-09-12T18:32:59.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.571+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~BGOVQ71VDILV.1 size=1048576 2024-09-12T18:32:59.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.571+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~BGOVQ71VDILV.2 size=560815 2024-09-12T18:32:59.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.571+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=BGOVQ71VDILV tag=DFXBSUVUW85I type=write size=3706543 2024-09-12T18:32:59.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.575+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=G25BXJ7KRL6T type=del 2024-09-12T18:32:59.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.579+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=7IZF580YAJYQ type=del size=32905 2024-09-12T18:32:59.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.583+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=SSI2YSUWFRXM type=del 2024-09-12T18:32:59.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.587+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=F3E8SRT89V0Y type=del size=2825084 2024-09-12T18:32:59.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.587+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~3SUENN1QAIIR.0 size=1048576 2024-09-12T18:32:59.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.591+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~3SUENN1QAIIR.1 size=734825 2024-09-12T18:32:59.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.595+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=3SUENN1QAIIR tag=UTWA12ZYJTII type=write size=2831977 2024-09-12T18:32:59.604 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.603+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~MO1C7SNMTIBT.0 size=1048576 2024-09-12T18:32:59.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.607+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~MO1C7SNMTIBT.1 size=378669 2024-09-12T18:32:59.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.607+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=MO1C7SNMTIBT tag=1TMKNA3FX4RU type=write size=2475821 2024-09-12T18:32:59.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.607+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~QWT1HYD12SXJ.0 size=1048576 2024-09-12T18:32:59.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.611+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~QWT1HYD12SXJ.1 size=529914 2024-09-12T18:32:59.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.615+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=QWT1HYD12SXJ tag=8OB630OI5I25 type=write size=2627066 2024-09-12T18:32:59.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.623+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~Z44LXQXBJ39P.0 size=116002 2024-09-12T18:32:59.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.623+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=Z44LXQXBJ39P tag=6467TBQFDK5M type=write size=1164578 2024-09-12T18:32:59.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.627+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=QNQZNPYUF1GR type=del 2024-09-12T18:32:59.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.631+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=MKJDKGN20L7V type=del size=3443946 2024-09-12T18:32:59.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.635+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~9NX04YEBPX4D.0 size=1048576 2024-09-12T18:32:59.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.639+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~9NX04YEBPX4D.1 size=948023 2024-09-12T18:32:59.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.643+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=9NX04YEBPX4D tag=405DPI5CCRHS type=write size=3045175 2024-09-12T18:32:59.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.647+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=SD2P3AA1Y2O3 type=del size=1266610 2024-09-12T18:32:59.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.651+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=F9Z23T02K99T type=del 2024-09-12T18:32:59.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.655+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~GMB47RGF4QSO.0 size=1048576 2024-09-12T18:32:59.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.659+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~GMB47RGF4QSO.1 size=1048576 2024-09-12T18:32:59.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.663+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~GMB47RGF4QSO.2 size=175438 2024-09-12T18:32:59.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.663+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=GMB47RGF4QSO tag=H3XFGGFF73D8 type=write size=3321166 2024-09-12T18:32:59.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.667+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~DY91JM7CC6ZW.0 size=1048576 2024-09-12T18:32:59.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.671+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~DY91JM7CC6ZW.1 size=1048576 2024-09-12T18:32:59.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.671+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~DY91JM7CC6ZW.2 size=879586 2024-09-12T18:32:59.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.679+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=DY91JM7CC6ZW tag=97RTODF85EO3 type=write size=4025314 2024-09-12T18:32:59.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.683+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=PFBKB1YXR1U8 type=del size=1423430 2024-09-12T18:32:59.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.687+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~X473CW4JCBZR.0 size=1048576 2024-09-12T18:32:59.690 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.691+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~X473CW4JCBZR.1 size=1048576 2024-09-12T18:32:59.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.691+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~X473CW4JCBZR.2 size=751490 2024-09-12T18:32:59.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.699+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=X473CW4JCBZR tag=7FYKNNWK318S type=write size=3897218 2024-09-12T18:32:59.703 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.703+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=9E0D7NU64EXM type=del size=3507982 2024-09-12T18:32:59.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.707+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=DTGDM8USJF8S type=del 2024-09-12T18:32:59.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.711+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~7265R98TPJIO.0 size=391791 2024-09-12T18:32:59.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.711+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=7265R98TPJIO tag=LG918IN8WI1X type=write size=1440367 2024-09-12T18:32:59.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.715+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=L22QR4U5PSQK type=del 2024-09-12T18:32:59.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.719+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=PW1I0VWQ3SJA type=del size=2446681 2024-09-12T18:32:59.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.723+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~QC62V43A1JIJ.0 size=1048576 2024-09-12T18:32:59.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.727+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~QC62V43A1JIJ.1 size=908616 2024-09-12T18:32:59.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.731+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=QC62V43A1JIJ tag=C17P2RO4QGG7 type=write size=3005768 2024-09-12T18:32:59.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.735+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=LWI80WVBGE80 type=write size=41800 2024-09-12T18:32:59.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.739+0000 7f41a072b8c0 1 < suggested update operation key=5JUWC8RXSA5L tag=0WI4BPKICTNP type=del size=4033318 2024-09-12T18:32:59.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.747+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~17B1C197DXLA.0 size=1048576 2024-09-12T18:32:59.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.751+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~17B1C197DXLA.1 size=1048576 2024-09-12T18:32:59.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.751+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~17B1C197DXLA.2 size=509216 2024-09-12T18:32:59.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.751+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=17B1C197DXLA tag=2U2GPMQM4FGH type=write size=3654944 2024-09-12T18:32:59.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.759+0000 7f41a072b8c0 1 < suggested update operation key=YP72VTCGSHYE tag=O2B2ZK7N2EVJ type=del size=2201886 2024-09-12T18:32:59.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.767+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~XNICUNZ87HYF.0 size=1048576 2024-09-12T18:32:59.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.767+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~XNICUNZ87HYF.1 size=149334 2024-09-12T18:32:59.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.767+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=XNICUNZ87HYF tag=HMO49RM4DEOS type=write size=2246486 2024-09-12T18:32:59.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.771+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=8OVSISFQPJRG type=del 2024-09-12T18:32:59.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.775+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=UM2EXD0JW374 type=del size=3035011 2024-09-12T18:32:59.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.779+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~BGOVQ71VDILV.0 size=1048576 2024-09-12T18:32:59.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.779+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~BGOVQ71VDILV.1 size=1048576 2024-09-12T18:32:59.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.783+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~BGOVQ71VDILV.2 size=560815 2024-09-12T18:32:59.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.791+0000 7f41a072b8c0 1 < completed multipart upload key=L01GL4WOUIL2 upload=BGOVQ71VDILV tag=DFXBSUVUW85I type=write size=3706543 2024-09-12T18:32:59.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.791+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=V4NN73RYB0WJ type=del size=2013798 2024-09-12T18:32:59.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.795+0000 7f41a072b8c0 1 < completed delete operation key=3R9RN03RFRJP tag=7IZF580YAJYQ type=del 2024-09-12T18:32:59.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.799+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=4ILMK6B2GJ3A type=del size=2065635 2024-09-12T18:32:59.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.803+0000 7f41a072b8c0 1 < canceled operation key=3CGBX19WTMWQ tag=F3E8SRT89V0Y type=del size=2825084 2024-09-12T18:32:59.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.811+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~XXAN727JR9KO.0 size=1048576 2024-09-12T18:32:59.813 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.811+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~XXAN727JR9KO.1 size=1048576 2024-09-12T18:32:59.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.815+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~XXAN727JR9KO.2 size=925216 2024-09-12T18:32:59.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.815+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=XXAN727JR9KO tag=7B26G2SQ5U7Z type=write size=4070944 2024-09-12T18:32:59.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.819+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~MO1C7SNMTIBT.0 size=1048576 2024-09-12T18:32:59.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.823+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~MO1C7SNMTIBT.1 size=378669 2024-09-12T18:32:59.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.827+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=MO1C7SNMTIBT tag=1TMKNA3FX4RU type=write size=2475821 2024-09-12T18:32:59.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.831+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~JBCO2EVPO9G8.0 size=1048576 2024-09-12T18:32:59.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.835+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~JBCO2EVPO9G8.1 size=656113 2024-09-12T18:32:59.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.835+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=JBCO2EVPO9G8 tag=0Z5TPLJ05UUN type=write size=2753265 2024-09-12T18:32:59.837 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.835+0000 7f41a072b8c0 1 < canceled part key=_multipart_ZACT36ZOC9ES.2~Z44LXQXBJ39P.0 size=116002 2024-09-12T18:32:59.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.839+0000 7f41a072b8c0 1 < canceled multipart upload key=ZACT36ZOC9ES upload=Z44LXQXBJ39P tag=6467TBQFDK5M type=write size=1164578 2024-09-12T18:32:59.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.843+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=H5CJX3TTLEAR type=write size=83328 2024-09-12T18:32:59.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.851+0000 7f41a072b8c0 1 < suggested remove operation key=5OD9IX408CYO tag=MKJDKGN20L7V type=del 2024-09-12T18:32:59.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.859+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~TOQJTSIX6MCJ.0 size=1048576 2024-09-12T18:32:59.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.863+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~TOQJTSIX6MCJ.1 size=530978 2024-09-12T18:32:59.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.863+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=TOQJTSIX6MCJ tag=YI8Q0CC5EYKZ type=write size=2628130 2024-09-12T18:32:59.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.867+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=SD2P3AA1Y2O3 type=del 2024-09-12T18:32:59.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.867+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=QMMNUOFWG0U9 type=write size=949825 2024-09-12T18:32:59.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.871+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~GMB47RGF4QSO.0 size=1048576 2024-09-12T18:32:59.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.875+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~GMB47RGF4QSO.1 size=1048576 2024-09-12T18:32:59.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.875+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~GMB47RGF4QSO.2 size=175438 2024-09-12T18:32:59.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.883+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=GMB47RGF4QSO tag=H3XFGGFF73D8 type=write size=3321166 2024-09-12T18:32:59.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.883+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=Z2JJXIIDZXK0 type=del size=3757385 2024-09-12T18:32:59.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.887+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=PFBKB1YXR1U8 type=del 2024-09-12T18:32:59.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.891+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~YUUSH0Q3J4N0.0 size=1048576 2024-09-12T18:32:59.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.895+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~YUUSH0Q3J4N0.1 size=1048576 2024-09-12T18:32:59.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.895+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~YUUSH0Q3J4N0.2 size=962169 2024-09-12T18:32:59.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.895+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=YUUSH0Q3J4N0 tag=SLQRWSJY2HQ5 type=write size=4107897 2024-09-12T18:32:59.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.899+0000 7f41a072b8c0 -1 < failed to complete operation key=5JUWC8RXSA5L tag=9E0D7NU64EXM type=del size=3507982: (22) Invalid argument 2024-09-12T18:32:59.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.903+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~PSWFLBAK11MR.0 size=1048576 2024-09-12T18:32:59.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.903+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~PSWFLBAK11MR.1 size=1048576 2024-09-12T18:32:59.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.907+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~PSWFLBAK11MR.2 size=702201 2024-09-12T18:32:59.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.907+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=PSWFLBAK11MR tag=G9T2PYTSHYWA type=write size=3847929 2024-09-12T18:32:59.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.911+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~7265R98TPJIO.0 size=391791 2024-09-12T18:32:59.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.915+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=7265R98TPJIO tag=LG918IN8WI1X type=write size=1440367 2024-09-12T18:32:59.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.915+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=4V3T8YC732A1 type=write size=325431 2024-09-12T18:32:59.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.919+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=PW1I0VWQ3SJA type=del 2024-09-12T18:32:59.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.923+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=GK32KNNR19WJ type=del size=2514677 2024-09-12T18:32:59.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.927+0000 7f41a072b8c0 1 < completed write operation key=VEN0P2P1RZ2S tag=LWI80WVBGE80 type=write size=41800 2024-09-12T18:32:59.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.927+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=7OYZJ4F7DQMI type=del size=1872643 2024-09-12T18:32:59.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.931+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~17B1C197DXLA.0 size=1048576 2024-09-12T18:32:59.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.935+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~17B1C197DXLA.1 size=1048576 2024-09-12T18:32:59.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.935+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~17B1C197DXLA.2 size=509216 2024-09-12T18:32:59.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.939+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=17B1C197DXLA tag=2U2GPMQM4FGH type=write size=3654944 2024-09-12T18:32:59.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.947+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~8ZAOJZF3ZNC8.0 size=1048576 2024-09-12T18:32:59.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.947+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~8ZAOJZF3ZNC8.1 size=1048576 2024-09-12T18:32:59.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.951+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~8ZAOJZF3ZNC8.2 size=878886 2024-09-12T18:32:59.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.951+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=8ZAOJZF3ZNC8 tag=9K5DXDAY0U9O type=write size=4024614 2024-09-12T18:32:59.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.955+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~XNICUNZ87HYF.0 size=1048576 2024-09-12T18:32:59.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.955+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~XNICUNZ87HYF.1 size=149334 2024-09-12T18:32:59.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:32:59.963+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=XNICUNZ87HYF tag=HMO49RM4DEOS type=write size=2246486 2024-09-12T18:33:00.170 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.167+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=SAYVUPPWD36F type=del size=846481 2024-09-12T18:33:00.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.175+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=UM2EXD0JW374 type=del 2024-09-12T18:33:00.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.175+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=GE8G6TAQEBGD type=write size=841695 2024-09-12T18:33:00.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.183+0000 7f41a072b8c0 1 < suggested update operation key=0O97F5ON55TX tag=V4NN73RYB0WJ type=del size=2013798 2024-09-12T18:33:00.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.187+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=YUDPUDH6AUCR type=del size=3011652 2024-09-12T18:33:00.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.191+0000 7f41a072b8c0 -1 < failed to complete operation key=0O97F5ON55TX tag=4ILMK6B2GJ3A type=del size=2065635: (22) Invalid argument 2024-09-12T18:33:00.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.195+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=899IPQDMD1NG type=del size=2319324 2024-09-12T18:33:00.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.199+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~XXAN727JR9KO.0 size=1048576 2024-09-12T18:33:00.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.203+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~XXAN727JR9KO.1 size=1048576 2024-09-12T18:33:00.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.203+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~XXAN727JR9KO.2 size=925216 2024-09-12T18:33:00.213 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.211+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=XXAN727JR9KO tag=7B26G2SQ5U7Z type=write size=4070944 2024-09-12T18:33:00.219 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.219+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~U28OB0IDU70I.0 size=1048576 2024-09-12T18:33:00.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.223+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~U28OB0IDU70I.1 size=1048576 2024-09-12T18:33:00.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.223+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~U28OB0IDU70I.2 size=509366 2024-09-12T18:33:00.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.223+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=U28OB0IDU70I tag=2PGPVV01KIF0 type=write size=3655094 2024-09-12T18:33:00.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.227+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~JBCO2EVPO9G8.0 size=1048576 2024-09-12T18:33:00.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.227+0000 7f41a072b8c0 1 < canceled part key=_multipart_GC8797KSO47E.2~JBCO2EVPO9G8.1 size=656113 2024-09-12T18:33:00.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.235+0000 7f41a072b8c0 1 < canceled multipart upload key=GC8797KSO47E upload=JBCO2EVPO9G8 tag=0Z5TPLJ05UUN type=write size=2753265 2024-09-12T18:33:00.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.239+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=DCZ9ZZ7TDPO8 type=del size=3820334 2024-09-12T18:33:00.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.243+0000 7f41a072b8c0 1 < completed write operation key=A6GQZL25YSNL tag=H5CJX3TTLEAR type=write size=83328 2024-09-12T18:33:00.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.247+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=3ABTF2S4Z07M type=del size=4089382 2024-09-12T18:33:00.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.251+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~TOQJTSIX6MCJ.0 size=1048576 2024-09-12T18:33:00.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.255+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~TOQJTSIX6MCJ.1 size=530978 2024-09-12T18:33:00.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.259+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=TOQJTSIX6MCJ tag=YI8Q0CC5EYKZ type=write size=2628130 2024-09-12T18:33:00.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.263+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=W79RZD7375L6 type=write size=705351 2024-09-12T18:33:00.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.267+0000 7f41a072b8c0 1 < completed write operation key=5JUWC8RXSA5L tag=QMMNUOFWG0U9 type=write size=949825 2024-09-12T18:33:00.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.271+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=0WHTO2CYBIO0 type=del size=2572561 2024-09-12T18:33:00.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.275+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=Z2JJXIIDZXK0 type=del 2024-09-12T18:33:00.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.279+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=42DSSLJCBCLZ type=del size=777284 2024-09-12T18:33:00.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.283+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~YUUSH0Q3J4N0.0 size=1048576 2024-09-12T18:33:00.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.283+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~YUUSH0Q3J4N0.1 size=1048576 2024-09-12T18:33:00.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.287+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~YUUSH0Q3J4N0.2 size=962169 2024-09-12T18:33:00.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.291+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=YUUSH0Q3J4N0 tag=SLQRWSJY2HQ5 type=write size=4107897 2024-09-12T18:33:00.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.299+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~637S74R5IBIZ.0 size=1048576 2024-09-12T18:33:00.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.303+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~637S74R5IBIZ.1 size=152422 2024-09-12T18:33:00.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.303+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=637S74R5IBIZ tag=UP7Y27BF7KBD type=write size=2249574 2024-09-12T18:33:00.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.307+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~PSWFLBAK11MR.0 size=1048576 2024-09-12T18:33:00.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.311+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~PSWFLBAK11MR.1 size=1048576 2024-09-12T18:33:00.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.311+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~PSWFLBAK11MR.2 size=702201 2024-09-12T18:33:00.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.319+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=PSWFLBAK11MR tag=G9T2PYTSHYWA type=write size=3847929 2024-09-12T18:33:00.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.323+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=411A5GAMCSS6 type=del size=3810478 2024-09-12T18:33:00.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.331+0000 7f41a072b8c0 1 < suggested update operation key=31T6AP6MUBKL tag=4V3T8YC732A1 type=write size=325431 2024-09-12T18:33:00.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.335+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=0E6QLU5BHFXP type=del size=2674489 2024-09-12T18:33:00.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.339+0000 7f41a072b8c0 1 < canceled operation key=XLGVEN6DF5EW tag=GK32KNNR19WJ type=del size=2514677 2024-09-12T18:33:00.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.343+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=XWBHHA0RMGWC type=del size=3186227 2024-09-12T18:33:00.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.347+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=7OYZJ4F7DQMI type=del 2024-09-12T18:33:00.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.347+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=EUOW1N5CNLYY type=write size=607543 2024-09-12T18:33:00.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.351+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~8ZAOJZF3ZNC8.0 size=1048576 2024-09-12T18:33:00.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.355+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~8ZAOJZF3ZNC8.1 size=1048576 2024-09-12T18:33:00.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.359+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~8ZAOJZF3ZNC8.2 size=878886 2024-09-12T18:33:00.366 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.363+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=8ZAOJZF3ZNC8 tag=9K5DXDAY0U9O type=write size=4024614 2024-09-12T18:33:00.369 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.367+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=JIMZTL3ASSJJ type=del size=3894682 2024-09-12T18:33:00.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.375+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=SAYVUPPWD36F type=del 2024-09-12T18:33:00.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.379+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=YXWT419VQZJX type=del size=2666306 2024-09-12T18:33:00.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.387+0000 7f41a072b8c0 1 < suggested remove operation key=0G0YWIOD3L3I tag=GE8G6TAQEBGD type=write 2024-09-12T18:33:00.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.395+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~ROTLMEFU53NO.0 size=967089 2024-09-12T18:33:00.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.395+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=ROTLMEFU53NO tag=7FO8ENL11GUY type=write size=2015665 2024-09-12T18:33:00.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.403+0000 7f41a072b8c0 1 < suggested update operation key=L01GL4WOUIL2 tag=YUDPUDH6AUCR type=del size=3011652 2024-09-12T18:33:00.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.407+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=1SL008FTNM38 type=del size=1083380 2024-09-12T18:33:00.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.411+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=899IPQDMD1NG type=del 2024-09-12T18:33:00.418 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.415+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~ZAFCHMJ09L2D.0 size=1048576 2024-09-12T18:33:00.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.419+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~ZAFCHMJ09L2D.1 size=641651 2024-09-12T18:33:00.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.419+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=ZAFCHMJ09L2D tag=GQ5GD7HEOR4S type=write size=2738803 2024-09-12T18:33:00.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.423+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~U28OB0IDU70I.0 size=1048576 2024-09-12T18:33:00.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.427+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~U28OB0IDU70I.1 size=1048576 2024-09-12T18:33:00.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.427+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~U28OB0IDU70I.2 size=509366 2024-09-12T18:33:00.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.431+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=U28OB0IDU70I tag=2PGPVV01KIF0 type=write size=3655094 2024-09-12T18:33:00.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.435+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=WV5K18SE13IH type=del size=2616586 2024-09-12T18:33:00.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.439+0000 7f41a072b8c0 1 < completed delete operation key=3R9RN03RFRJP tag=DCZ9ZZ7TDPO8 type=del 2024-09-12T18:33:00.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.447+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~DFUZ0LANMERV.0 size=53582 2024-09-12T18:33:00.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.447+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=DFUZ0LANMERV tag=1VUTTWTT6NDX type=write size=1102158 2024-09-12T18:33:00.450 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.447+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=3ABTF2S4Z07M type=del 2024-09-12T18:33:00.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.451+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=JI1RKQH2WPF9 type=del size=1734563 2024-09-12T18:33:00.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.455+0000 7f41a072b8c0 1 < completed write operation key=ZACT36ZOC9ES tag=W79RZD7375L6 type=write size=705351 2024-09-12T18:33:00.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.459+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=W0EYPS2F4PKA type=del size=4092794 2024-09-12T18:33:00.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.467+0000 7f41a072b8c0 1 < suggested remove operation key=1JIIRDVMT0B0 tag=0WHTO2CYBIO0 type=del 2024-09-12T18:33:00.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.467+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=HMWNLL0ZB6OI type=del size=2135865 2024-09-12T18:33:00.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.471+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=42DSSLJCBCLZ type=del 2024-09-12T18:33:00.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.479+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~3V4Z9K10F0DP.0 size=1048576 2024-09-12T18:33:00.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.483+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~3V4Z9K10F0DP.1 size=497959 2024-09-12T18:33:00.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.483+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=3V4Z9K10F0DP tag=W5AWG3CB8FWZ type=write size=2595111 2024-09-12T18:33:00.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.487+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~637S74R5IBIZ.0 size=1048576 2024-09-12T18:33:00.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.487+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~637S74R5IBIZ.1 size=152422 2024-09-12T18:33:00.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.495+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=637S74R5IBIZ tag=UP7Y27BF7KBD type=write size=2249574 2024-09-12T18:33:00.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.499+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=56TC1KOE6FW7 type=del size=4095110 2024-09-12T18:33:00.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.499+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=411A5GAMCSS6 type=del 2024-09-12T18:33:00.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.503+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=RAGM1ENSGD22 type=del size=628066 2024-09-12T18:33:00.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.507+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=0E6QLU5BHFXP type=del 2024-09-12T18:33:00.512 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.511+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=LEL787PJ17PD type=del size=1987678 2024-09-12T18:33:00.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.519+0000 7f41a072b8c0 1 < suggested remove operation key=KP2HF4J376EY tag=XWBHHA0RMGWC type=del 2024-09-12T18:33:00.522 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.523+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=UN24W23UJ4ER type=del size=3402307 2024-09-12T18:33:00.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.527+0000 7f41a072b8c0 -1 < failed to complete operation key=1JIIRDVMT0B0 tag=EUOW1N5CNLYY type=write size=607543: (22) Invalid argument 2024-09-12T18:33:00.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.527+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=G1I1NQXIECWF type=write size=482308 2024-09-12T18:33:00.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.531+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=JIMZTL3ASSJJ type=del 2024-09-12T18:33:00.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.535+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=HQUAQNRMCBZ5 type=del size=915297 2024-09-12T18:33:00.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.539+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=YXWT419VQZJX type=del 2024-09-12T18:33:00.547 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.547+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~HG0GYDS9KCP0.0 size=1048576 2024-09-12T18:33:00.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.547+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~HG0GYDS9KCP0.1 size=1048576 2024-09-12T18:33:00.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.551+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~HG0GYDS9KCP0.2 size=1018955 2024-09-12T18:33:00.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.551+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=HG0GYDS9KCP0 tag=33C27Y677PBR type=write size=4164683 2024-09-12T18:33:00.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.555+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~ROTLMEFU53NO.0 size=967089 2024-09-12T18:33:00.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.559+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=ROTLMEFU53NO tag=7FO8ENL11GUY type=write size=2015665 2024-09-12T18:33:00.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.567+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~P799ZZYEN3U2.0 size=1048576 2024-09-12T18:33:00.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.567+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~P799ZZYEN3U2.1 size=1048576 2024-09-12T18:33:00.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.571+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~P799ZZYEN3U2.2 size=924495 2024-09-12T18:33:00.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.571+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=P799ZZYEN3U2 tag=ES1W4OGYXAKH type=write size=4070223 2024-09-12T18:33:00.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.575+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=1SL008FTNM38 type=del 2024-09-12T18:33:00.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.579+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=TSGHSS6B8VK1 type=del size=1261296 2024-09-12T18:33:00.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.579+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~ZAFCHMJ09L2D.0 size=1048576 2024-09-12T18:33:00.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.583+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~ZAFCHMJ09L2D.1 size=641651 2024-09-12T18:33:00.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.587+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=ZAFCHMJ09L2D tag=GQ5GD7HEOR4S type=write size=2738803 2024-09-12T18:33:00.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.591+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=E63VPSVI53VT type=write size=99321 2024-09-12T18:33:00.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.599+0000 7f41a072b8c0 1 < suggested remove operation key=C2PRRD3QO9AF tag=WV5K18SE13IH type=del 2024-09-12T18:33:00.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.603+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~1R2JHRN0ENKQ.0 size=475801 2024-09-12T18:33:00.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.603+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=1R2JHRN0ENKQ tag=AAFTAC56LJI2 type=write size=1524377 2024-09-12T18:33:00.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.607+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~DFUZ0LANMERV.0 size=53582 2024-09-12T18:33:00.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.611+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=DFUZ0LANMERV tag=1VUTTWTT6NDX type=write size=1102158 2024-09-12T18:33:00.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.615+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~BU1HYX3HLM12.0 size=808974 2024-09-12T18:33:00.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.615+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=BU1HYX3HLM12 tag=HE4FVZ953J14 type=write size=1857550 2024-09-12T18:33:00.621 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.619+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=JI1RKQH2WPF9 type=del 2024-09-12T18:33:00.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.623+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=IAL608QT83A0 type=del size=288786 2024-09-12T18:33:00.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.627+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=W0EYPS2F4PKA type=del 2024-09-12T18:33:00.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.627+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=WJB1LRHWUDDU type=del size=1818823 2024-09-12T18:33:00.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.631+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=HMWNLL0ZB6OI type=del 2024-09-12T18:33:00.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.639+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~RMKQKBTEYQE8.0 size=518347 2024-09-12T18:33:00.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.639+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=RMKQKBTEYQE8 tag=0KP6R16YLCLL type=write size=1566923 2024-09-12T18:33:00.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.639+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~3V4Z9K10F0DP.0 size=1048576 2024-09-12T18:33:00.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.639+0000 7f41a072b8c0 1 < canceled part key=_multipart_GA6P1FACU2EQ.2~3V4Z9K10F0DP.1 size=497959 2024-09-12T18:33:00.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.647+0000 7f41a072b8c0 1 < canceled multipart upload key=GA6P1FACU2EQ upload=3V4Z9K10F0DP tag=W5AWG3CB8FWZ type=write size=2595111 2024-09-12T18:33:00.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.651+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=1OHIBJEBPAAE type=del size=1448868 2024-09-12T18:33:00.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.651+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=56TC1KOE6FW7 type=del 2024-09-12T18:33:00.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.659+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~PC77BVS1SSEG.0 size=1048576 2024-09-12T18:33:00.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.663+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~PC77BVS1SSEG.1 size=417670 2024-09-12T18:33:00.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.663+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=PC77BVS1SSEG tag=I18ZK5IOUV7B type=write size=2514822 2024-09-12T18:33:00.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.667+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=RAGM1ENSGD22 type=del 2024-09-12T18:33:00.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.667+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=RTLDCCT9ACVD type=del size=466413 2024-09-12T18:33:00.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.671+0000 7f41a072b8c0 -1 < failed to complete operation key=KP2HF4J376EY tag=LEL787PJ17PD type=del size=1987678: (22) Invalid argument 2024-09-12T18:33:00.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.675+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=I48M3LPFB543 type=del size=2378341 2024-09-12T18:33:00.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.679+0000 7f41a072b8c0 1 < completed delete operation key=YP72VTCGSHYE tag=UN24W23UJ4ER type=del 2024-09-12T18:33:00.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.683+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=XDTZS928PRMR type=del size=2129581 2024-09-12T18:33:00.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.687+0000 7f41a072b8c0 1 < completed write operation key=ZACT36ZOC9ES tag=G1I1NQXIECWF type=write size=482308 2024-09-12T18:33:00.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.691+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=1G1FW3X9FJHJ type=del size=494224 2024-09-12T18:33:00.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.699+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=HQUAQNRMCBZ5 type=del 2024-09-12T18:33:00.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.699+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=QW6I2R7TYDWV type=del size=3598782 2024-09-12T18:33:00.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.703+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~HG0GYDS9KCP0.0 size=1048576 2024-09-12T18:33:00.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.707+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~HG0GYDS9KCP0.1 size=1048576 2024-09-12T18:33:00.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.707+0000 7f41a072b8c0 1 < canceled part key=_multipart_GA6P1FACU2EQ.2~HG0GYDS9KCP0.2 size=1018955 2024-09-12T18:33:00.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.715+0000 7f41a072b8c0 1 < canceled multipart upload key=GA6P1FACU2EQ upload=HG0GYDS9KCP0 tag=33C27Y677PBR type=write size=4164683 2024-09-12T18:33:00.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.719+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=5EDKF3TP1TD4 type=write size=283505 2024-09-12T18:33:00.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.719+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~P799ZZYEN3U2.0 size=1048576 2024-09-12T18:33:00.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.723+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~P799ZZYEN3U2.1 size=1048576 2024-09-12T18:33:00.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.727+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~P799ZZYEN3U2.2 size=924495 2024-09-12T18:33:00.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.731+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=P799ZZYEN3U2 tag=ES1W4OGYXAKH type=write size=4070223 2024-09-12T18:33:00.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.739+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~RKSNNLDLRTHQ.0 size=1048576 2024-09-12T18:33:00.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.739+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~RKSNNLDLRTHQ.1 size=1048576 2024-09-12T18:33:00.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.743+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~RKSNNLDLRTHQ.2 size=224112 2024-09-12T18:33:00.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.743+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=RKSNNLDLRTHQ tag=H6E1SWMYJL0M type=write size=3369840 2024-09-12T18:33:00.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.747+0000 7f41a072b8c0 1 < completed delete operation key=NKMA8FG3V3TR tag=TSGHSS6B8VK1 type=del 2024-09-12T18:33:00.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.747+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=3T0AI2VMJGK4 type=del size=1052093 2024-09-12T18:33:00.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.751+0000 7f41a072b8c0 1 < completed write operation key=5OD9IX408CYO tag=E63VPSVI53VT type=write size=99321 2024-09-12T18:33:00.759 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.759+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~ZMSE4224NO8C.0 size=17239 2024-09-12T18:33:00.759 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.759+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=ZMSE4224NO8C tag=V6FB02H0P25Z type=write size=1065815 2024-09-12T18:33:00.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.763+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~1R2JHRN0ENKQ.0 size=475801 2024-09-12T18:33:00.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.767+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=1R2JHRN0ENKQ tag=AAFTAC56LJI2 type=write size=1524377 2024-09-12T18:33:00.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.771+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~KFGWPJA5H44M.0 size=1035024 2024-09-12T18:33:00.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.771+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=KFGWPJA5H44M tag=ESN19WVGOF5B type=write size=2083600 2024-09-12T18:33:00.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.775+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~BU1HYX3HLM12.0 size=808974 2024-09-12T18:33:00.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.783+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=BU1HYX3HLM12 tag=HE4FVZ953J14 type=write size=1857550 2024-09-12T18:33:00.785 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.783+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=BJBLCUQTD3ZM type=del size=1959770 2024-09-12T18:33:00.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.787+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=IAL608QT83A0 type=del 2024-09-12T18:33:00.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.791+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~B8NE93O8Y43H.0 size=1048576 2024-09-12T18:33:00.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.795+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~B8NE93O8Y43H.1 size=1048576 2024-09-12T18:33:00.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.799+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~B8NE93O8Y43H.2 size=648072 2024-09-12T18:33:00.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.799+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=B8NE93O8Y43H tag=ENPCXEYWOJ2L type=write size=3793800 2024-09-12T18:33:00.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.799+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=WJB1LRHWUDDU type=del 2024-09-12T18:33:00.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.807+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~IVHFD2HN5OU4.0 size=1048576 2024-09-12T18:33:00.812 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.807+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~IVHFD2HN5OU4.1 size=592123 2024-09-12T18:33:00.812 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.811+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=IVHFD2HN5OU4 tag=I4V9EUQ86GB1 type=write size=2689275 2024-09-12T18:33:00.813 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.811+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~RMKQKBTEYQE8.0 size=518347 2024-09-12T18:33:00.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.819+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=RMKQKBTEYQE8 tag=0KP6R16YLCLL type=write size=1566923 2024-09-12T18:33:00.822 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.819+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=3P0K46AG3NGN type=del size=3613592 2024-09-12T18:33:00.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.823+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=1OHIBJEBPAAE type=del 2024-09-12T18:33:00.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.827+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=6E2P80YV7H00 type=del size=1659449 2024-09-12T18:33:00.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.831+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~PC77BVS1SSEG.0 size=1048576 2024-09-12T18:33:00.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.835+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~PC77BVS1SSEG.1 size=417670 2024-09-12T18:33:00.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.839+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=PC77BVS1SSEG tag=I18ZK5IOUV7B type=write size=2514822 2024-09-12T18:33:00.842 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.839+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=EV69CRLX6077 type=del size=3064113 2024-09-12T18:33:00.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.847+0000 7f41a072b8c0 1 < suggested remove operation key=GC8797KSO47E tag=RTLDCCT9ACVD type=del 2024-09-12T18:33:00.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.851+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=KFQPH7MYEC10 type=write size=1020684 2024-09-12T18:33:00.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.851+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=I48M3LPFB543 type=del 2024-09-12T18:33:00.855 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.855+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=ENEA2H2ATANZ type=del size=1157785 2024-09-12T18:33:00.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.859+0000 7f41a072b8c0 1 < suggested remove operation key=58IT2R988AW9 tag=XDTZS928PRMR type=del 2024-09-12T18:33:00.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.867+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~CC7ZL40E8NR8.0 size=375968 2024-09-12T18:33:00.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.867+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=CC7ZL40E8NR8 tag=3INI8OW8PQPC type=write size=1424544 2024-09-12T18:33:00.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.871+0000 7f41a072b8c0 1 < suggested update operation key=P732C5X0RG8Z tag=1G1FW3X9FJHJ type=del size=494224 2024-09-12T18:33:00.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.875+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=DQZEW0BEFJAF type=del size=287364 2024-09-12T18:33:00.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.883+0000 7f41a072b8c0 1 < suggested remove operation key=63BP9QETTAM8 tag=QW6I2R7TYDWV type=del 2024-09-12T18:33:00.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.887+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=PVBQMKPMW7TX type=del size=2673744 2024-09-12T18:33:00.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.887+0000 7f41a072b8c0 1 < canceled operation key=YCBC1CHWJQC5 tag=5EDKF3TP1TD4 type=write size=283505 2024-09-12T18:33:00.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.895+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~9DAC0HIG2B8N.0 size=1048576 2024-09-12T18:33:00.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.895+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~9DAC0HIG2B8N.1 size=994420 2024-09-12T18:33:00.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.895+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=9DAC0HIG2B8N tag=6I3Z53C00HNT type=write size=3091572 2024-09-12T18:33:00.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.895+0000 7f41a072b8c0 1 < canceled part key=_multipart_GQHPUDV5BG1E.2~RKSNNLDLRTHQ.0 size=1048576 2024-09-12T18:33:00.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.899+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~RKSNNLDLRTHQ.1 size=1048576 2024-09-12T18:33:00.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.899+0000 7f41a072b8c0 1 < canceled part key=_multipart_GQHPUDV5BG1E.2~RKSNNLDLRTHQ.2 size=224112 2024-09-12T18:33:00.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.903+0000 7f41a072b8c0 1 < canceled multipart upload key=GQHPUDV5BG1E upload=RKSNNLDLRTHQ tag=H6E1SWMYJL0M type=write size=3369840 2024-09-12T18:33:00.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.911+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~ZAY4VKWH2GKF.0 size=1048576 2024-09-12T18:33:00.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.911+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~ZAY4VKWH2GKF.1 size=827266 2024-09-12T18:33:00.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.911+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=ZAY4VKWH2GKF tag=RP1IJ6PBPQ9L type=write size=2924418 2024-09-12T18:33:00.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.915+0000 7f41a072b8c0 1 < completed delete operation key=YP72VTCGSHYE tag=3T0AI2VMJGK4 type=del 2024-09-12T18:33:00.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.919+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=MN2Q4V25ZNZZ type=del size=1072182 2024-09-12T18:33:00.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.919+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~ZMSE4224NO8C.0 size=17239 2024-09-12T18:33:00.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.923+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=ZMSE4224NO8C tag=V6FB02H0P25Z type=write size=1065815 2024-09-12T18:33:00.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.927+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=73EZ4C0KFH0R type=del size=3864497 2024-09-12T18:33:00.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.931+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~KFGWPJA5H44M.0 size=1035024 2024-09-12T18:33:00.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.935+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=KFGWPJA5H44M tag=ESN19WVGOF5B type=write size=2083600 2024-09-12T18:33:00.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.939+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=TW0UI41R150C type=del size=3086713 2024-09-12T18:33:00.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.943+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=BJBLCUQTD3ZM type=del 2024-09-12T18:33:00.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.947+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~MCHWNQRVPLZ5.0 size=709372 2024-09-12T18:33:00.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.947+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=MCHWNQRVPLZ5 tag=P7T0FRSZ0DK6 type=write size=1757948 2024-09-12T18:33:00.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.951+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~B8NE93O8Y43H.0 size=1048576 2024-09-12T18:33:00.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.951+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~B8NE93O8Y43H.1 size=1048576 2024-09-12T18:33:00.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.955+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~B8NE93O8Y43H.2 size=648072 2024-09-12T18:33:00.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.959+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=B8NE93O8Y43H tag=ENPCXEYWOJ2L type=write size=3793800 2024-09-12T18:33:00.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.963+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=APCZY567VNZA type=write size=508686 2024-09-12T18:33:00.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.963+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~IVHFD2HN5OU4.0 size=1048576 2024-09-12T18:33:00.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.967+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~IVHFD2HN5OU4.1 size=592123 2024-09-12T18:33:00.972 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.971+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=IVHFD2HN5OU4 tag=I4V9EUQ86GB1 type=write size=2689275 2024-09-12T18:33:00.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.975+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~Q8PJ8J5TFNS1.0 size=1048576 2024-09-12T18:33:00.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.979+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~Q8PJ8J5TFNS1.1 size=741768 2024-09-12T18:33:00.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.979+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=Q8PJ8J5TFNS1 tag=ULW64DVWC1WK type=write size=2838920 2024-09-12T18:33:00.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.983+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=3P0K46AG3NGN type=del 2024-09-12T18:33:00.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.987+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~QJCMU6PI2W0L.0 size=1048576 2024-09-12T18:33:00.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.991+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~QJCMU6PI2W0L.1 size=557089 2024-09-12T18:33:00.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.991+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=QJCMU6PI2W0L tag=2R1I88LC8A6C type=write size=2654241 2024-09-12T18:33:00.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.991+0000 7f41a072b8c0 1 < canceled operation key=KP2HF4J376EY tag=6E2P80YV7H00 type=del size=1659449 2024-09-12T18:33:00.998 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.995+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~0KD7I2JD7ASX.0 size=1048576 2024-09-12T18:33:01.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.999+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~0KD7I2JD7ASX.1 size=283648 2024-09-12T18:33:01.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:00.999+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=0KD7I2JD7ASX tag=3RLNOL515HHE type=write size=2380800 2024-09-12T18:33:01.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.003+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=EV69CRLX6077 type=del 2024-09-12T18:33:01.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.007+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~R4L9NUQVLVMV.0 size=1048576 2024-09-12T18:33:01.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.007+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~R4L9NUQVLVMV.1 size=1048576 2024-09-12T18:33:01.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.011+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~R4L9NUQVLVMV.2 size=961534 2024-09-12T18:33:01.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.011+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=R4L9NUQVLVMV tag=OG8WM9CIT2TA type=write size=4107262 2024-09-12T18:33:01.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.015+0000 7f41a072b8c0 1 < canceled operation key=3CGBX19WTMWQ tag=KFQPH7MYEC10 type=write size=1020684 2024-09-12T18:33:01.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.019+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~2JH8VK8OTDX5.0 size=1048576 2024-09-12T18:33:01.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.023+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~2JH8VK8OTDX5.1 size=879301 2024-09-12T18:33:01.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.023+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=2JH8VK8OTDX5 tag=UJU1FAZQ1WKR type=write size=2976453 2024-09-12T18:33:01.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.023+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=ENEA2H2ATANZ type=del 2024-09-12T18:33:01.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.027+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=4CVCHNMQPV39 type=del size=1768290 2024-09-12T18:33:01.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.031+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~CC7ZL40E8NR8.0 size=375968 2024-09-12T18:33:01.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.035+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=CC7ZL40E8NR8 tag=3INI8OW8PQPC type=write size=1424544 2024-09-12T18:33:01.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.039+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~D6VJ6L5XATXA.0 size=1048576 2024-09-12T18:33:01.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.039+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~D6VJ6L5XATXA.1 size=982805 2024-09-12T18:33:01.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.039+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=D6VJ6L5XATXA tag=4I1OQIS1DS1L type=write size=3079957 2024-09-12T18:33:01.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.043+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=DQZEW0BEFJAF type=del 2024-09-12T18:33:01.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.047+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~FH2D2EPBSZQ8.0 size=1048576 2024-09-12T18:33:01.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.051+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~FH2D2EPBSZQ8.1 size=105472 2024-09-12T18:33:01.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.051+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=FH2D2EPBSZQ8 tag=G5S4OE8ZHRJ0 type=write size=2202624 2024-09-12T18:33:01.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.051+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=PVBQMKPMW7TX type=del 2024-09-12T18:33:01.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.055+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=GE0Z6VV5TDEM type=del size=3057266 2024-09-12T18:33:01.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.059+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~9DAC0HIG2B8N.0 size=1048576 2024-09-12T18:33:01.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.059+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~9DAC0HIG2B8N.1 size=994420 2024-09-12T18:33:01.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.063+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=9DAC0HIG2B8N tag=6I3Z53C00HNT type=write size=3091572 2024-09-12T18:33:01.070 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.071+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~3NQ4D5TMMJAM.0 size=1048576 2024-09-12T18:33:01.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.071+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~3NQ4D5TMMJAM.1 size=559408 2024-09-12T18:33:01.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.071+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=3NQ4D5TMMJAM tag=G02I0BW4KF5B type=write size=2656560 2024-09-12T18:33:01.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.075+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~ZAY4VKWH2GKF.0 size=1048576 2024-09-12T18:33:01.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.075+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~ZAY4VKWH2GKF.1 size=827266 2024-09-12T18:33:01.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.079+0000 7f41a072b8c0 1 < completed multipart upload key=L01GL4WOUIL2 upload=ZAY4VKWH2GKF tag=RP1IJ6PBPQ9L type=write size=2924418 2024-09-12T18:33:01.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.083+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=Q5UV96AA7OBT type=del size=2682373 2024-09-12T18:33:01.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.083+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=MN2Q4V25ZNZZ type=del 2024-09-12T18:33:01.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.087+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=0ZXIJP2IP31X type=del size=1565791 2024-09-12T18:33:01.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.091+0000 7f41a072b8c0 1 < canceled operation key=7B70QWGMH0C0 tag=73EZ4C0KFH0R type=del size=3864497 2024-09-12T18:33:01.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.095+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~REOQ3EUF9ZAO.0 size=759069 2024-09-12T18:33:01.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.095+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=REOQ3EUF9ZAO tag=4AC3SFXMSHUT type=write size=1807645 2024-09-12T18:33:01.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.099+0000 7f41a072b8c0 1 < suggested remove operation key=KP2HF4J376EY tag=TW0UI41R150C type=del 2024-09-12T18:33:01.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.103+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=755Y7LSXKDYN type=del size=3540970 2024-09-12T18:33:01.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.107+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~MCHWNQRVPLZ5.0 size=709372 2024-09-12T18:33:01.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.111+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=MCHWNQRVPLZ5 tag=P7T0FRSZ0DK6 type=write size=1757948 2024-09-12T18:33:01.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.115+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=7XGU9ROUME28 type=del size=2810893 2024-09-12T18:33:01.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.119+0000 7f41a072b8c0 1 < completed write operation key=L01GL4WOUIL2 tag=APCZY567VNZA type=write size=508686 2024-09-12T18:33:01.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.123+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~HDK1U4G05FW1.0 size=1048576 2024-09-12T18:33:01.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.127+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~HDK1U4G05FW1.1 size=364267 2024-09-12T18:33:01.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.127+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=HDK1U4G05FW1 tag=AZBZ5AVQATPP type=write size=2461419 2024-09-12T18:33:01.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.131+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~Q8PJ8J5TFNS1.0 size=1048576 2024-09-12T18:33:01.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.131+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~Q8PJ8J5TFNS1.1 size=741768 2024-09-12T18:33:01.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.135+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=Q8PJ8J5TFNS1 tag=ULW64DVWC1WK type=write size=2838920 2024-09-12T18:33:01.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.143+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~RIWN97NKSI6K.0 size=694453 2024-09-12T18:33:01.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.143+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=RIWN97NKSI6K tag=MDLDMV6TA32T type=write size=1743029 2024-09-12T18:33:01.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.143+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~QJCMU6PI2W0L.0 size=1048576 2024-09-12T18:33:01.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.147+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~QJCMU6PI2W0L.1 size=557089 2024-09-12T18:33:01.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.151+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=QJCMU6PI2W0L tag=2R1I88LC8A6C type=write size=2654241 2024-09-12T18:33:01.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.159+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~AUXTYIONXVK0.0 size=1048576 2024-09-12T18:33:01.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.159+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~AUXTYIONXVK0.1 size=812799 2024-09-12T18:33:01.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.159+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=AUXTYIONXVK0 tag=B1H7VWT89296 type=write size=2909951 2024-09-12T18:33:01.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.167+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~0KD7I2JD7ASX.0 size=1048576 2024-09-12T18:33:01.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.167+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~0KD7I2JD7ASX.1 size=283648 2024-09-12T18:33:01.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.171+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=0KD7I2JD7ASX tag=3RLNOL515HHE type=write size=2380800 2024-09-12T18:33:01.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.175+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=J8RYJ1DIGF3K type=del size=3749329 2024-09-12T18:33:01.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.179+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~R4L9NUQVLVMV.0 size=1048576 2024-09-12T18:33:01.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.179+0000 7f41a072b8c0 1 < canceled part key=_multipart_1BSAN5TRTZNZ.2~R4L9NUQVLVMV.1 size=1048576 2024-09-12T18:33:01.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.179+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~R4L9NUQVLVMV.2 size=961534 2024-09-12T18:33:01.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.187+0000 7f41a072b8c0 1 < canceled multipart upload key=1BSAN5TRTZNZ upload=R4L9NUQVLVMV tag=OG8WM9CIT2TA type=write size=4107262 2024-09-12T18:33:01.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.187+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=RDDGDDZQ5HY6 type=write size=669858 2024-09-12T18:33:01.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.191+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~2JH8VK8OTDX5.0 size=1048576 2024-09-12T18:33:01.196 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.195+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~2JH8VK8OTDX5.1 size=879301 2024-09-12T18:33:01.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.199+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=2JH8VK8OTDX5 tag=UJU1FAZQ1WKR type=write size=2976453 2024-09-12T18:33:01.207 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.207+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~ZAH1XEDQ61NG.0 size=1048576 2024-09-12T18:33:01.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.207+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~ZAH1XEDQ61NG.1 size=555500 2024-09-12T18:33:01.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.207+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=ZAH1XEDQ61NG tag=1A8QD356K8WZ type=write size=2652652 2024-09-12T18:33:01.213 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.211+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=4CVCHNMQPV39 type=del 2024-09-12T18:33:01.222 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.215+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=3WYT8G234O6Z type=del size=3152586 2024-09-12T18:33:01.222 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.215+0000 7f41a072b8c0 1 < canceled part key=_multipart_KOLD6WYK30EQ.2~D6VJ6L5XATXA.0 size=1048576 2024-09-12T18:33:01.222 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.219+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~D6VJ6L5XATXA.1 size=982805 2024-09-12T18:33:01.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.223+0000 7f41a072b8c0 1 < canceled multipart upload key=KOLD6WYK30EQ upload=D6VJ6L5XATXA tag=4I1OQIS1DS1L type=write size=3079957 2024-09-12T18:33:01.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.231+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~VJIF2DWAH59U.0 size=1048576 2024-09-12T18:33:01.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.235+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~VJIF2DWAH59U.1 size=749899 2024-09-12T18:33:01.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.235+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=VJIF2DWAH59U tag=1UDXN6POKMAA type=write size=2847051 2024-09-12T18:33:01.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.239+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~FH2D2EPBSZQ8.0 size=1048576 2024-09-12T18:33:01.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.239+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~FH2D2EPBSZQ8.1 size=105472 2024-09-12T18:33:01.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.251+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=FH2D2EPBSZQ8 tag=G5S4OE8ZHRJ0 type=write size=2202624 2024-09-12T18:33:01.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.255+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=W4SSHPJVXI29 type=del size=1617652 2024-09-12T18:33:01.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.259+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=GE0Z6VV5TDEM type=del 2024-09-12T18:33:01.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.263+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=ATGKILW87ZY4 type=del size=715865 2024-09-12T18:33:01.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.263+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~3NQ4D5TMMJAM.0 size=1048576 2024-09-12T18:33:01.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.267+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~3NQ4D5TMMJAM.1 size=559408 2024-09-12T18:33:01.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.275+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=3NQ4D5TMMJAM tag=G02I0BW4KF5B type=write size=2656560 2024-09-12T18:33:01.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.275+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=JOM63TGFFP1T type=del size=1919676 2024-09-12T18:33:01.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.279+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=Q5UV96AA7OBT type=del 2024-09-12T18:33:01.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.283+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=BE0LV33O5GBX type=del size=1767293 2024-09-12T18:33:01.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.287+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=0ZXIJP2IP31X type=del 2024-09-12T18:33:01.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.295+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~YUXNF5PWI50X.0 size=1048576 2024-09-12T18:33:01.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.295+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~YUXNF5PWI50X.1 size=154643 2024-09-12T18:33:01.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.295+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=YUXNF5PWI50X tag=392B05ATB62C type=write size=2251795 2024-09-12T18:33:01.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.303+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~REOQ3EUF9ZAO.0 size=759069 2024-09-12T18:33:01.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.307+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=REOQ3EUF9ZAO tag=4AC3SFXMSHUT type=write size=1807645 2024-09-12T18:33:01.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.315+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~4B19FCPR1DVC.0 size=709706 2024-09-12T18:33:01.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.315+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=4B19FCPR1DVC tag=TAVVC97TJARI type=write size=1758282 2024-09-12T18:33:01.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.315+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=755Y7LSXKDYN type=del 2024-09-12T18:33:01.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.319+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=0ZD94C3091RQ type=del size=3359895 2024-09-12T18:33:01.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.327+0000 7f41a072b8c0 1 < suggested update operation key=XLGVEN6DF5EW tag=7XGU9ROUME28 type=del size=2810893 2024-09-12T18:33:01.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.331+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=6B67OY9J3KG8 type=del size=3329455 2024-09-12T18:33:01.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.335+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~HDK1U4G05FW1.0 size=1048576 2024-09-12T18:33:01.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.339+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~HDK1U4G05FW1.1 size=364267 2024-09-12T18:33:01.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.343+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=HDK1U4G05FW1 tag=AZBZ5AVQATPP type=write size=2461419 2024-09-12T18:33:01.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.347+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=3OFSO48OFUFS type=del size=1245100 2024-09-12T18:33:01.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.351+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~RIWN97NKSI6K.0 size=694453 2024-09-12T18:33:01.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.359+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=RIWN97NKSI6K tag=MDLDMV6TA32T type=write size=1743029 2024-09-12T18:33:01.366 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.363+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~7OO4UK7RZGHZ.0 size=1048576 2024-09-12T18:33:01.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.367+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~7OO4UK7RZGHZ.1 size=1048576 2024-09-12T18:33:01.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.371+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~7OO4UK7RZGHZ.2 size=839984 2024-09-12T18:33:01.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.371+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=7OO4UK7RZGHZ tag=RT8YE5SBO692 type=write size=3985712 2024-09-12T18:33:01.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.375+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~AUXTYIONXVK0.0 size=1048576 2024-09-12T18:33:01.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.379+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~AUXTYIONXVK0.1 size=812799 2024-09-12T18:33:01.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.383+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=AUXTYIONXVK0 tag=B1H7VWT89296 type=write size=2909951 2024-09-12T18:33:01.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.391+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~R5ZOCBIGBVY8.0 size=1048576 2024-09-12T18:33:01.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.391+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~R5ZOCBIGBVY8.1 size=152711 2024-09-12T18:33:01.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.391+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=R5ZOCBIGBVY8 tag=K1A228ELXD6J type=write size=2249863 2024-09-12T18:33:01.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.395+0000 7f41a072b8c0 1 < completed delete operation key=YP72VTCGSHYE tag=J8RYJ1DIGF3K type=del 2024-09-12T18:33:01.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.399+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=KE2JYJIG6JDK type=del size=819321 2024-09-12T18:33:01.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.399+0000 7f41a072b8c0 1 < completed write operation key=0G0YWIOD3L3I tag=RDDGDDZQ5HY6 type=write size=669858 2024-09-12T18:33:01.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.403+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=VK98MH36LVMO type=del size=3558617 2024-09-12T18:33:01.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.407+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~ZAH1XEDQ61NG.0 size=1048576 2024-09-12T18:33:01.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.407+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~ZAH1XEDQ61NG.1 size=555500 2024-09-12T18:33:01.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.415+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=ZAH1XEDQ61NG tag=1A8QD356K8WZ type=write size=2652652 2024-09-12T18:33:01.419 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.419+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~S2ORW99JBXK0.0 size=482737 2024-09-12T18:33:01.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.419+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=S2ORW99JBXK0 tag=W2GWGALXEG6P type=write size=1531313 2024-09-12T18:33:01.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.423+0000 7f41a072b8c0 1 < suggested update operation key=GA6P1FACU2EQ tag=3WYT8G234O6Z type=del size=3152586 2024-09-12T18:33:01.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.431+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~IXT2J3A01B1J.0 size=942860 2024-09-12T18:33:01.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.431+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=IXT2J3A01B1J tag=KH68E0QYV4ZR type=write size=1991436 2024-09-12T18:33:01.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.431+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~VJIF2DWAH59U.0 size=1048576 2024-09-12T18:33:01.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.435+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~VJIF2DWAH59U.1 size=749899 2024-09-12T18:33:01.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.439+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=VJIF2DWAH59U tag=1UDXN6POKMAA type=write size=2847051 2024-09-12T18:33:01.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.443+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=SOMNIAWB06AZ type=del size=2577026 2024-09-12T18:33:01.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.451+0000 7f41a072b8c0 1 < suggested remove operation key=GQHPUDV5BG1E tag=W4SSHPJVXI29 type=del 2024-09-12T18:33:01.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.451+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=MCZUBXK0V85S type=write size=137435 2024-09-12T18:33:01.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.455+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=ATGKILW87ZY4 type=del 2024-09-12T18:33:01.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.459+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=LFCYUX2VQYA8 type=del size=3135231 2024-09-12T18:33:01.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.463+0000 7f41a072b8c0 1 < completed delete operation key=YP72VTCGSHYE tag=JOM63TGFFP1T type=del 2024-09-12T18:33:01.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.467+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=RFDP69VRXX8X type=write size=706430 2024-09-12T18:33:01.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.471+0000 7f41a072b8c0 1 < suggested remove operation key=58IT2R988AW9 tag=BE0LV33O5GBX type=del 2024-09-12T18:33:01.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.475+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=72KLIQV502PE type=write size=921724 2024-09-12T18:33:01.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.479+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~YUXNF5PWI50X.0 size=1048576 2024-09-12T18:33:01.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.479+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~YUXNF5PWI50X.1 size=154643 2024-09-12T18:33:01.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.487+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=YUXNF5PWI50X tag=392B05ATB62C type=write size=2251795 2024-09-12T18:33:01.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.487+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=4UYLTNB3K50V type=del size=3889970 2024-09-12T18:33:01.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.487+0000 7f41a072b8c0 1 < canceled part key=_multipart_P732C5X0RG8Z.2~4B19FCPR1DVC.0 size=709706 2024-09-12T18:33:01.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.495+0000 7f41a072b8c0 1 < canceled multipart upload key=P732C5X0RG8Z upload=4B19FCPR1DVC tag=TAVVC97TJARI type=write size=1758282 2024-09-12T18:33:01.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.499+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~86MPNREYIFJX.0 size=1048576 2024-09-12T18:33:01.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.499+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~86MPNREYIFJX.1 size=1020138 2024-09-12T18:33:01.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.499+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=86MPNREYIFJX tag=35B17ZFIO2GB type=write size=3117290 2024-09-12T18:33:01.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.503+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=0ZD94C3091RQ type=del 2024-09-12T18:33:01.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~6AWJEVPWEGH2.0 size=1048576 2024-09-12T18:33:01.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.511+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~6AWJEVPWEGH2.1 size=1048576 2024-09-12T18:33:01.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.511+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~6AWJEVPWEGH2.2 size=144145 2024-09-12T18:33:01.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.511+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=6AWJEVPWEGH2 tag=BDG313FVNYGZ type=write size=3289873 2024-09-12T18:33:01.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.519+0000 7f41a072b8c0 1 < suggested update operation key=5OD9IX408CYO tag=6B67OY9J3KG8 type=del size=3329455 2024-09-12T18:33:01.523 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.523+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=EEEKHRGS3AM7 type=del size=1010115 2024-09-12T18:33:01.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.523+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=3OFSO48OFUFS type=del 2024-09-12T18:33:01.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.527+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=4C3KKWTCIWD2 type=del size=3770939 2024-09-12T18:33:01.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.527+0000 7f41a072b8c0 1 < canceled part key=_multipart_63BP9QETTAM8.2~7OO4UK7RZGHZ.0 size=1048576 2024-09-12T18:33:01.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.531+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~7OO4UK7RZGHZ.1 size=1048576 2024-09-12T18:33:01.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.535+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~7OO4UK7RZGHZ.2 size=839984 2024-09-12T18:33:01.539 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.539+0000 7f41a072b8c0 1 < canceled multipart upload key=63BP9QETTAM8 upload=7OO4UK7RZGHZ tag=RT8YE5SBO692 type=write size=3985712 2024-09-12T18:33:01.545 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.543+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~BUMJ96T5Z379.0 size=1048576 2024-09-12T18:33:01.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.551+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~BUMJ96T5Z379.1 size=224667 2024-09-12T18:33:01.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.551+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=BUMJ96T5Z379 tag=9F5ONY2G1G4Z type=write size=2321819 2024-09-12T18:33:01.555 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.555+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~R5ZOCBIGBVY8.0 size=1048576 2024-09-12T18:33:01.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.555+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~R5ZOCBIGBVY8.1 size=152711 2024-09-12T18:33:01.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.563+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=R5ZOCBIGBVY8 tag=K1A228ELXD6J type=write size=2249863 2024-09-12T18:33:01.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.567+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~2RT797TU8WQC.0 size=1048576 2024-09-12T18:33:01.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.571+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~2RT797TU8WQC.1 size=253029 2024-09-12T18:33:01.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.571+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=2RT797TU8WQC tag=YQSWV3RRXPMB type=write size=2350181 2024-09-12T18:33:01.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.575+0000 7f41a072b8c0 1 < canceled operation key=1JIIRDVMT0B0 tag=KE2JYJIG6JDK type=del size=819321 2024-09-12T18:33:01.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.575+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=HHEQF8FBYX16 type=del size=3553323 2024-09-12T18:33:01.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.579+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=VK98MH36LVMO type=del 2024-09-12T18:33:01.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.583+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=WB2AKUZLSI6F type=del size=2599490 2024-09-12T18:33:01.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.583+0000 7f41a072b8c0 1 < canceled part key=_multipart_V35A7LK08C7J.2~S2ORW99JBXK0.0 size=482737 2024-09-12T18:33:01.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.587+0000 7f41a072b8c0 1 < canceled multipart upload key=V35A7LK08C7J upload=S2ORW99JBXK0 tag=W2GWGALXEG6P type=write size=1531313 2024-09-12T18:33:01.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.591+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=LI5HUH2ZD55U type=del size=2223854 2024-09-12T18:33:01.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.595+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~IXT2J3A01B1J.0 size=942860 2024-09-12T18:33:01.601 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.599+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=IXT2J3A01B1J tag=KH68E0QYV4ZR type=write size=1991436 2024-09-12T18:33:01.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.603+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=EOMMPK4PUQMM type=del size=1580712 2024-09-12T18:33:01.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.607+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=SOMNIAWB06AZ type=del 2024-09-12T18:33:01.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.611+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~U5VGXY8U72S3.0 size=1048576 2024-09-12T18:33:01.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.611+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~U5VGXY8U72S3.1 size=815972 2024-09-12T18:33:01.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.611+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=U5VGXY8U72S3 tag=OY9NMQZY82KX type=write size=2913124 2024-09-12T18:33:01.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.615+0000 7f41a072b8c0 1 < completed write operation key=GC8797KSO47E tag=MCZUBXK0V85S type=write size=137435 2024-09-12T18:33:01.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.619+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=CJMW98796K78 type=del size=1313079 2024-09-12T18:33:01.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.623+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=LFCYUX2VQYA8 type=del 2024-09-12T18:33:01.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.627+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~TQEMR0NRUZ8P.0 size=1048576 2024-09-12T18:33:01.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.631+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~TQEMR0NRUZ8P.1 size=1048576 2024-09-12T18:33:01.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.631+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~TQEMR0NRUZ8P.2 size=592380 2024-09-12T18:33:01.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.631+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=TQEMR0NRUZ8P tag=DZUBOC9DHJV0 type=write size=3738108 2024-09-12T18:33:01.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.635+0000 7f41a072b8c0 1 < completed write operation key=GC8797KSO47E tag=RFDP69VRXX8X type=write size=706430 2024-09-12T18:33:01.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.639+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~Y00VVL3K9WQL.0 size=1048576 2024-09-12T18:33:01.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.643+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~Y00VVL3K9WQL.1 size=1048576 2024-09-12T18:33:01.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.647+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~Y00VVL3K9WQL.2 size=311096 2024-09-12T18:33:01.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.647+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=Y00VVL3K9WQL tag=4N7YBNGKUF98 type=write size=3456824 2024-09-12T18:33:01.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.647+0000 7f41a072b8c0 1 < completed write operation key=YP72VTCGSHYE tag=72KLIQV502PE type=write size=921724 2024-09-12T18:33:01.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.651+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=LA2M5RO70I0A type=del size=3576765 2024-09-12T18:33:01.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.655+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=4UYLTNB3K50V type=del 2024-09-12T18:33:01.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.659+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=BV6GIE1IOOBU type=write size=1010327 2024-09-12T18:33:01.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.659+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~86MPNREYIFJX.0 size=1048576 2024-09-12T18:33:01.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.663+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~86MPNREYIFJX.1 size=1020138 2024-09-12T18:33:01.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.667+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=86MPNREYIFJX tag=35B17ZFIO2GB type=write size=3117290 2024-09-12T18:33:01.672 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.671+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=7F9C4P0O1PH3 type=del size=1867707 2024-09-12T18:33:01.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.675+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~6AWJEVPWEGH2.0 size=1048576 2024-09-12T18:33:01.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.675+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~6AWJEVPWEGH2.1 size=1048576 2024-09-12T18:33:01.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.679+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~6AWJEVPWEGH2.2 size=144145 2024-09-12T18:33:01.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.683+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=6AWJEVPWEGH2 tag=BDG313FVNYGZ type=write size=3289873 2024-09-12T18:33:01.690 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.691+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~24M9OYJZSBKA.0 size=1048576 2024-09-12T18:33:01.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.691+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~24M9OYJZSBKA.1 size=351601 2024-09-12T18:33:01.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.691+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=24M9OYJZSBKA tag=Q2SKRWHUC127 type=write size=2448753 2024-09-12T18:33:01.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.699+0000 7f41a072b8c0 1 < suggested remove operation key=31T6AP6MUBKL tag=EEEKHRGS3AM7 type=del 2024-09-12T18:33:01.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.703+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~XPFAXKRP38PS.0 size=1048576 2024-09-12T18:33:01.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.707+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~XPFAXKRP38PS.1 size=209750 2024-09-12T18:33:01.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.707+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=XPFAXKRP38PS tag=6WY7E4BH3K1E type=write size=2306902 2024-09-12T18:33:01.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.711+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=4C3KKWTCIWD2 type=del 2024-09-12T18:33:01.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.715+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~SSATS0WN9A3A.0 size=926119 2024-09-12T18:33:01.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.715+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=SSATS0WN9A3A tag=KMA4SLAZMGE2 type=write size=1974695 2024-09-12T18:33:01.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.719+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~BUMJ96T5Z379.0 size=1048576 2024-09-12T18:33:01.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.719+0000 7f41a072b8c0 1 < canceled part key=_multipart_295ZC54QRUPD.2~BUMJ96T5Z379.1 size=224667 2024-09-12T18:33:01.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.723+0000 7f41a072b8c0 1 < canceled multipart upload key=295ZC54QRUPD upload=BUMJ96T5Z379 tag=9F5ONY2G1G4Z type=write size=2321819 2024-09-12T18:33:01.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.727+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=XGU5PMM7UTQG type=del size=1740825 2024-09-12T18:33:01.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.727+0000 7f41a072b8c0 1 < canceled part key=_multipart_31T6AP6MUBKL.2~2RT797TU8WQC.0 size=1048576 2024-09-12T18:33:01.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.731+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~2RT797TU8WQC.1 size=253029 2024-09-12T18:33:01.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.735+0000 7f41a072b8c0 1 < canceled multipart upload key=31T6AP6MUBKL upload=2RT797TU8WQC tag=YQSWV3RRXPMB type=write size=2350181 2024-09-12T18:33:01.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.739+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=91N9Q2OY456O type=del size=4055940 2024-09-12T18:33:01.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.743+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=HHEQF8FBYX16 type=del 2024-09-12T18:33:01.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.743+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=KPBFXTAWBFAJ type=del size=1879668 2024-09-12T18:33:01.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.747+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=WB2AKUZLSI6F type=del 2024-09-12T18:33:01.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.751+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=05XJC7X4J4XB type=del size=680693 2024-09-12T18:33:01.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.755+0000 7f41a072b8c0 1 < suggested remove operation key=YP72VTCGSHYE tag=LI5HUH2ZD55U type=del 2024-09-12T18:33:01.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.759+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=6KPHOG1NHDTM type=write size=71185 2024-09-12T18:33:01.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.763+0000 7f41a072b8c0 1 < completed delete operation key=3R9RN03RFRJP tag=EOMMPK4PUQMM type=del 2024-09-12T18:33:01.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.767+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~2SBFV9SG490D.0 size=1048576 2024-09-12T18:33:01.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.771+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~2SBFV9SG490D.1 size=88882 2024-09-12T18:33:01.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.771+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=2SBFV9SG490D tag=TRPEWQKM1RGT type=write size=2186034 2024-09-12T18:33:01.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.775+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~U5VGXY8U72S3.0 size=1048576 2024-09-12T18:33:01.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.775+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~U5VGXY8U72S3.1 size=815972 2024-09-12T18:33:01.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.779+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=U5VGXY8U72S3 tag=OY9NMQZY82KX type=write size=2913124 2024-09-12T18:33:01.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.787+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~92NB5ZX73T24.0 size=1048576 2024-09-12T18:33:01.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.787+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~92NB5ZX73T24.1 size=1048576 2024-09-12T18:33:01.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.791+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~92NB5ZX73T24.2 size=785889 2024-09-12T18:33:01.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.791+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=92NB5ZX73T24 tag=D8VR3G491UHW type=write size=3931617 2024-09-12T18:33:01.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.791+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=CJMW98796K78 type=del 2024-09-12T18:33:01.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.795+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=CB6OUB4APJ74 type=del size=3217982 2024-09-12T18:33:01.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.799+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~TQEMR0NRUZ8P.0 size=1048576 2024-09-12T18:33:01.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.799+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~TQEMR0NRUZ8P.1 size=1048576 2024-09-12T18:33:01.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.803+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~TQEMR0NRUZ8P.2 size=592380 2024-09-12T18:33:01.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.807+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=TQEMR0NRUZ8P tag=DZUBOC9DHJV0 type=write size=3738108 2024-09-12T18:33:01.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.811+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=O6DS2EEQDI2W type=del size=1955988 2024-09-12T18:33:01.813 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.811+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~Y00VVL3K9WQL.0 size=1048576 2024-09-12T18:33:01.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.815+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~Y00VVL3K9WQL.1 size=1048576 2024-09-12T18:33:01.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.815+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~Y00VVL3K9WQL.2 size=311096 2024-09-12T18:33:01.822 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.823+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=Y00VVL3K9WQL tag=4N7YBNGKUF98 type=write size=3456824 2024-09-12T18:33:01.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.827+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~0UXPOX76ONTD.0 size=1048576 2024-09-12T18:33:01.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.831+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~0UXPOX76ONTD.1 size=302540 2024-09-12T18:33:01.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.831+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=0UXPOX76ONTD tag=E8IL21S5WRWY type=write size=2399692 2024-09-12T18:33:01.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.835+0000 7f41a072b8c0 1 < canceled operation key=P732C5X0RG8Z tag=LA2M5RO70I0A type=del size=3576765 2024-09-12T18:33:01.840 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.839+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~9W1NHNBEG4OH.0 size=1048576 2024-09-12T18:33:01.842 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.839+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~9W1NHNBEG4OH.1 size=1048576 2024-09-12T18:33:01.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.843+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~9W1NHNBEG4OH.2 size=977668 2024-09-12T18:33:01.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.843+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=9W1NHNBEG4OH tag=IJ428EQECXIT type=write size=4123396 2024-09-12T18:33:01.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.847+0000 7f41a072b8c0 1 < completed write operation key=1BSAN5TRTZNZ tag=BV6GIE1IOOBU type=write size=1010327 2024-09-12T18:33:01.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.847+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=PH73E6COLBC4 type=write size=311152 2024-09-12T18:33:01.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.851+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=7F9C4P0O1PH3 type=del 2024-09-12T18:33:01.856 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.855+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~D19CZ5P77MVL.0 size=1048576 2024-09-12T18:33:01.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.859+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~D19CZ5P77MVL.1 size=1001466 2024-09-12T18:33:01.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.859+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=D19CZ5P77MVL tag=E5X7V5XP6FWY type=write size=3098618 2024-09-12T18:33:01.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.859+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~24M9OYJZSBKA.0 size=1048576 2024-09-12T18:33:01.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.863+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~24M9OYJZSBKA.1 size=351601 2024-09-12T18:33:01.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.867+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=24M9OYJZSBKA tag=Q2SKRWHUC127 type=write size=2448753 2024-09-12T18:33:01.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.871+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=Q57T1NXLTK02 type=write size=222580 2024-09-12T18:33:01.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.875+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~XPFAXKRP38PS.0 size=1048576 2024-09-12T18:33:01.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.875+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~XPFAXKRP38PS.1 size=209750 2024-09-12T18:33:01.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.879+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=XPFAXKRP38PS tag=6WY7E4BH3K1E type=write size=2306902 2024-09-12T18:33:01.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.883+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=XLFN4WP2XXCB type=del size=1108085 2024-09-12T18:33:01.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.887+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~SSATS0WN9A3A.0 size=926119 2024-09-12T18:33:01.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.891+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=SSATS0WN9A3A tag=KMA4SLAZMGE2 type=write size=1974695 2024-09-12T18:33:01.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.895+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~7G0F85HR3EDD.0 size=1048576 2024-09-12T18:33:01.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.895+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~7G0F85HR3EDD.1 size=999971 2024-09-12T18:33:01.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.895+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=7G0F85HR3EDD tag=NE7KBLU68A4E type=write size=3097123 2024-09-12T18:33:01.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.899+0000 7f41a072b8c0 1 < suggested remove operation key=C2PRRD3QO9AF tag=XGU5PMM7UTQG type=del 2024-09-12T18:33:01.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.903+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~40V9HN2KI9JG.0 size=51627 2024-09-12T18:33:01.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.903+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=40V9HN2KI9JG tag=OFNE7O9GV1QK type=write size=1100203 2024-09-12T18:33:01.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.907+0000 7f41a072b8c0 1 < canceled operation key=3R9RN03RFRJP tag=91N9Q2OY456O type=del size=4055940 2024-09-12T18:33:01.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.911+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=6YICNQ28R2A6 type=del size=470791 2024-09-12T18:33:01.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.911+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=KPBFXTAWBFAJ type=del 2024-09-12T18:33:01.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.915+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~K18UQYXGFF07.0 size=131472 2024-09-12T18:33:01.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.915+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=K18UQYXGFF07 tag=B7WCZ3SKC1FA type=write size=1180048 2024-09-12T18:33:01.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.919+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=05XJC7X4J4XB type=del 2024-09-12T18:33:01.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.923+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~LXEN449XR2S5.0 size=1007450 2024-09-12T18:33:01.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.923+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=LXEN449XR2S5 tag=5TVWJ65UIQTE type=write size=2056026 2024-09-12T18:33:01.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.927+0000 7f41a072b8c0 1 < completed write operation key=V35A7LK08C7J tag=6KPHOG1NHDTM type=write size=71185 2024-09-12T18:33:01.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.927+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=X66DELCRR61V type=del size=3703702 2024-09-12T18:33:01.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.931+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~2SBFV9SG490D.0 size=1048576 2024-09-12T18:33:01.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.931+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~2SBFV9SG490D.1 size=88882 2024-09-12T18:33:01.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.939+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=2SBFV9SG490D tag=TRPEWQKM1RGT type=write size=2186034 2024-09-12T18:33:01.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.943+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~DXV81IDCL2JL.0 size=552487 2024-09-12T18:33:01.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.943+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=DXV81IDCL2JL tag=UGZFZWF4PNXE type=write size=1601063 2024-09-12T18:33:01.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.943+0000 7f41a072b8c0 1 < canceled part key=_multipart_63BP9QETTAM8.2~92NB5ZX73T24.0 size=1048576 2024-09-12T18:33:01.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.947+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~92NB5ZX73T24.1 size=1048576 2024-09-12T18:33:01.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.947+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~92NB5ZX73T24.2 size=785889 2024-09-12T18:33:01.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.955+0000 7f41a072b8c0 1 < canceled multipart upload key=63BP9QETTAM8 upload=92NB5ZX73T24 tag=D8VR3G491UHW type=write size=3931617 2024-09-12T18:33:01.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.955+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=5FMK6W9KAZ7K type=write size=826788 2024-09-12T18:33:01.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.959+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=CB6OUB4APJ74 type=del 2024-09-12T18:33:01.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.963+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=BJ7J6SXS4J83 type=del size=1289160 2024-09-12T18:33:01.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.967+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=O6DS2EEQDI2W type=del 2024-09-12T18:33:01.974 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.971+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~PTIDVRKQ9MSJ.0 size=1048576 2024-09-12T18:33:01.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.975+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~PTIDVRKQ9MSJ.1 size=798968 2024-09-12T18:33:01.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.975+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=PTIDVRKQ9MSJ tag=O2LL3BFC9Z1A type=write size=2896120 2024-09-12T18:33:01.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.979+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~0UXPOX76ONTD.0 size=1048576 2024-09-12T18:33:01.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.983+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~0UXPOX76ONTD.1 size=302540 2024-09-12T18:33:01.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.987+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=0UXPOX76ONTD tag=E8IL21S5WRWY type=write size=2399692 2024-09-12T18:33:01.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.991+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=SO2URYZOTF5F type=del size=1218746 2024-09-12T18:33:01.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.991+0000 7f41a072b8c0 1 < canceled part key=_multipart_L01GL4WOUIL2.2~9W1NHNBEG4OH.0 size=1048576 2024-09-12T18:33:01.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.995+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~9W1NHNBEG4OH.1 size=1048576 2024-09-12T18:33:01.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:01.995+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~9W1NHNBEG4OH.2 size=977668 2024-09-12T18:33:02.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.003+0000 7f41a072b8c0 1 < canceled multipart upload key=L01GL4WOUIL2 upload=9W1NHNBEG4OH tag=IJ428EQECXIT type=write size=4123396 2024-09-12T18:33:02.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.007+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~L4VN049FML4V.0 size=530784 2024-09-12T18:33:02.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.007+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=L4VN049FML4V tag=U818TJMGEOS0 type=write size=1579360 2024-09-12T18:33:02.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.015+0000 7f41a072b8c0 1 < suggested remove operation key=GQHPUDV5BG1E tag=PH73E6COLBC4 type=write 2024-09-12T18:33:02.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.019+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=ALD0ISX9AC1J type=del size=791140 2024-09-12T18:33:02.021 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.019+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~D19CZ5P77MVL.0 size=1048576 2024-09-12T18:33:02.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.023+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~D19CZ5P77MVL.1 size=1001466 2024-09-12T18:33:02.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.031+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=D19CZ5P77MVL tag=E5X7V5XP6FWY type=write size=3098618 2024-09-12T18:33:02.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.031+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=XWAWBCNJG6WU type=del size=2805304 2024-09-12T18:33:02.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.039+0000 7f41a072b8c0 1 < suggested update operation key=63BP9QETTAM8 tag=Q57T1NXLTK02 type=write size=222580 2024-09-12T18:33:02.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.043+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=VO6LJNG42CFD type=write size=1034540 2024-09-12T18:33:02.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.047+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=XLFN4WP2XXCB type=del 2024-09-12T18:33:02.050 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.051+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=BTJSNB776WT5 type=write size=471008 2024-09-12T18:33:02.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.051+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~7G0F85HR3EDD.0 size=1048576 2024-09-12T18:33:02.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.055+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~7G0F85HR3EDD.1 size=999971 2024-09-12T18:33:02.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.059+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=7G0F85HR3EDD tag=NE7KBLU68A4E type=write size=3097123 2024-09-12T18:33:02.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.063+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=QL6LD7O020VI type=del size=3330876 2024-09-12T18:33:02.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.067+0000 7f41a072b8c0 1 < canceled part key=_multipart_YP72VTCGSHYE.2~40V9HN2KI9JG.0 size=51627 2024-09-12T18:33:02.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.071+0000 7f41a072b8c0 1 < canceled multipart upload key=YP72VTCGSHYE upload=40V9HN2KI9JG tag=OFNE7O9GV1QK type=write size=1100203 2024-09-12T18:33:02.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.075+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=G3F6AQUUAFU3 type=write size=791925 2024-09-12T18:33:02.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.083+0000 7f41a072b8c0 1 < suggested update operation key=1BSAN5TRTZNZ tag=6YICNQ28R2A6 type=del size=470791 2024-09-12T18:33:02.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.087+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=L7LTYH08TY6S type=write size=266799 2024-09-12T18:33:02.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.091+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~K18UQYXGFF07.0 size=131472 2024-09-12T18:33:02.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.095+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=K18UQYXGFF07 tag=B7WCZ3SKC1FA type=write size=1180048 2024-09-12T18:33:02.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.099+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=EPH3L603IQU8 type=del size=264095 2024-09-12T18:33:02.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.107+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~LXEN449XR2S5.0 size=1007450 2024-09-12T18:33:02.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.111+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=LXEN449XR2S5 tag=5TVWJ65UIQTE type=write size=2056026 2024-09-12T18:33:02.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.119+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~M3KOBCSVBGBV.0 size=763824 2024-09-12T18:33:02.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.119+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=M3KOBCSVBGBV tag=2Z28JSN9PVN9 type=write size=1812400 2024-09-12T18:33:02.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.123+0000 7f41a072b8c0 1 < suggested remove operation key=1JIIRDVMT0B0 tag=X66DELCRR61V type=del 2024-09-12T18:33:02.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.127+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=B8O8Z0FZ7T75 type=del size=1141124 2024-09-12T18:33:02.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.131+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~DXV81IDCL2JL.0 size=552487 2024-09-12T18:33:02.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.135+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=DXV81IDCL2JL tag=UGZFZWF4PNXE type=write size=1601063 2024-09-12T18:33:02.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.139+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=P1Q2DJBFKVY2 type=del size=82967 2024-09-12T18:33:02.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.143+0000 7f41a072b8c0 1 < completed write operation key=ZACT36ZOC9ES tag=5FMK6W9KAZ7K type=write size=826788 2024-09-12T18:33:02.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.143+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=FIZ6PO2KD1MY type=del size=3350304 2024-09-12T18:33:02.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.147+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=BJ7J6SXS4J83 type=del 2024-09-12T18:33:02.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.151+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=AF1O37T33C6Z type=write size=339544 2024-09-12T18:33:02.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.155+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~PTIDVRKQ9MSJ.0 size=1048576 2024-09-12T18:33:02.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.155+0000 7f41a072b8c0 1 < canceled part key=_multipart_7MRN7L1DTAMO.2~PTIDVRKQ9MSJ.1 size=798968 2024-09-12T18:33:02.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.159+0000 7f41a072b8c0 1 < canceled multipart upload key=7MRN7L1DTAMO upload=PTIDVRKQ9MSJ tag=O2LL3BFC9Z1A type=write size=2896120 2024-09-12T18:33:02.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.163+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=D0LJEN0D39JV type=del size=1533783 2024-09-12T18:33:02.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.167+0000 7f41a072b8c0 1 < canceled operation key=YP72VTCGSHYE tag=SO2URYZOTF5F type=del size=1218746 2024-09-12T18:33:02.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.171+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=L0L95FL7IWPW type=del size=2276062 2024-09-12T18:33:02.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.175+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~L4VN049FML4V.0 size=530784 2024-09-12T18:33:02.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.179+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=L4VN049FML4V tag=U818TJMGEOS0 type=write size=1579360 2024-09-12T18:33:02.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.183+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~6HZRGC1KLL5H.0 size=1048576 2024-09-12T18:33:02.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.187+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~6HZRGC1KLL5H.1 size=1048576 2024-09-12T18:33:02.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.187+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~6HZRGC1KLL5H.2 size=907190 2024-09-12T18:33:02.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.187+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=6HZRGC1KLL5H tag=FXS3TNH0E03X type=write size=4052918 2024-09-12T18:33:02.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.191+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=ALD0ISX9AC1J type=del 2024-09-12T18:33:02.196 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.195+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~M1AV6A9H47YO.0 size=1048576 2024-09-12T18:33:02.200 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.199+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~M1AV6A9H47YO.1 size=603582 2024-09-12T18:33:02.200 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.199+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=M1AV6A9H47YO tag=H38RKM0MLWEP type=write size=2700734 2024-09-12T18:33:02.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.199+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=XWAWBCNJG6WU type=del 2024-09-12T18:33:02.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.207+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~QO5HCZNCCAKI.0 size=889259 2024-09-12T18:33:02.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.207+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=QO5HCZNCCAKI tag=2GWEKCO0YMB3 type=write size=1937835 2024-09-12T18:33:02.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.207+0000 7f41a072b8c0 1 < completed write operation key=63BP9QETTAM8 tag=VO6LJNG42CFD type=write size=1034540 2024-09-12T18:33:02.212 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.211+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=0GIXL3NHWJKL type=del size=4092032 2024-09-12T18:33:02.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.215+0000 7f41a072b8c0 1 < suggested update operation key=L1VC63PK1R2Y tag=BTJSNB776WT5 type=write size=471008 2024-09-12T18:33:02.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.223+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~8HHUL68HRZFA.0 size=1048576 2024-09-12T18:33:02.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.223+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~8HHUL68HRZFA.1 size=94089 2024-09-12T18:33:02.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.223+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=8HHUL68HRZFA tag=79LXCSW7IVLB type=write size=2191241 2024-09-12T18:33:02.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.227+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=QL6LD7O020VI type=del 2024-09-12T18:33:02.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.231+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=K4Z8WFDNMGJ0 type=del size=3640796 2024-09-12T18:33:02.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.235+0000 7f41a072b8c0 1 < completed write operation key=3R9RN03RFRJP tag=G3F6AQUUAFU3 type=write size=791925 2024-09-12T18:33:02.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.239+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=JXB3KT3Z1IQ5 type=del size=2334675 2024-09-12T18:33:02.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.243+0000 7f41a072b8c0 1 < canceled operation key=58IT2R988AW9 tag=L7LTYH08TY6S type=write size=266799 2024-09-12T18:33:02.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.247+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~H63VB8GCKY0C.0 size=1048576 2024-09-12T18:33:02.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.247+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~H63VB8GCKY0C.1 size=683304 2024-09-12T18:33:02.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.247+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=H63VB8GCKY0C tag=NF9PHZ6H0VBP type=write size=2780456 2024-09-12T18:33:02.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.251+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=EPH3L603IQU8 type=del 2024-09-12T18:33:02.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.255+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=YFVWUFFSNWCG type=del size=63039 2024-09-12T18:33:02.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.259+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~M3KOBCSVBGBV.0 size=763824 2024-09-12T18:33:02.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.263+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=M3KOBCSVBGBV tag=2Z28JSN9PVN9 type=write size=1812400 2024-09-12T18:33:02.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.267+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=FKAMLPYU6QX8 type=del size=884996 2024-09-12T18:33:02.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.271+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=B8O8Z0FZ7T75 type=del 2024-09-12T18:33:02.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.271+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=LFOIRGJL8ALQ type=del size=1154017 2024-09-12T18:33:02.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.279+0000 7f41a072b8c0 1 < suggested remove operation key=V35A7LK08C7J tag=P1Q2DJBFKVY2 type=del 2024-09-12T18:33:02.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.283+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=5YA93BXZZLPD type=write size=882683 2024-09-12T18:33:02.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.283+0000 7f41a072b8c0 1 < canceled operation key=YCBC1CHWJQC5 tag=FIZ6PO2KD1MY type=del size=3350304 2024-09-12T18:33:02.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.291+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~LCYL6UGBZAJT.0 size=1048576 2024-09-12T18:33:02.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.291+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~LCYL6UGBZAJT.1 size=1048576 2024-09-12T18:33:02.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.295+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~LCYL6UGBZAJT.2 size=833996 2024-09-12T18:33:02.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.295+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=LCYL6UGBZAJT tag=TIKJ12ZADCAF type=write size=3979724 2024-09-12T18:33:02.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.299+0000 7f41a072b8c0 1 < canceled operation key=5JUWC8RXSA5L tag=AF1O37T33C6Z type=write size=339544 2024-09-12T18:33:02.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.303+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~DRGSJSF77RFT.0 size=1048576 2024-09-12T18:33:02.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.307+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~DRGSJSF77RFT.1 size=60790 2024-09-12T18:33:02.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.307+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=DRGSJSF77RFT tag=M7MNC6CRAMN3 type=write size=2157942 2024-09-12T18:33:02.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.315+0000 7f41a072b8c0 1 < suggested update operation key=3R9RN03RFRJP tag=D0LJEN0D39JV type=del size=1533783 2024-09-12T18:33:02.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.319+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~8QP9P5669IUD.0 size=1048576 2024-09-12T18:33:02.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.323+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~8QP9P5669IUD.1 size=224011 2024-09-12T18:33:02.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.323+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=8QP9P5669IUD tag=I5Q6XRHU20UA type=write size=2321163 2024-09-12T18:33:02.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.327+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=L0L95FL7IWPW type=del 2024-09-12T18:33:02.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.327+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=R750YOMK8PHA type=write size=430311 2024-09-12T18:33:02.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.331+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~6HZRGC1KLL5H.0 size=1048576 2024-09-12T18:33:02.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.335+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~6HZRGC1KLL5H.1 size=1048576 2024-09-12T18:33:02.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.339+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~6HZRGC1KLL5H.2 size=907190 2024-09-12T18:33:02.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.343+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=6HZRGC1KLL5H tag=FXS3TNH0E03X type=write size=4052918 2024-09-12T18:33:02.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.347+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=23IT3YH5OTBT type=del size=3261179 2024-09-12T18:33:02.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.347+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~M1AV6A9H47YO.0 size=1048576 2024-09-12T18:33:02.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.351+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~M1AV6A9H47YO.1 size=603582 2024-09-12T18:33:02.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.355+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=M1AV6A9H47YO tag=H38RKM0MLWEP type=write size=2700734 2024-09-12T18:33:02.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.359+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=PN8913BP9FZO type=del size=712670 2024-09-12T18:33:02.363 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.363+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~QO5HCZNCCAKI.0 size=889259 2024-09-12T18:33:02.369 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.367+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=QO5HCZNCCAKI tag=2GWEKCO0YMB3 type=write size=1937835 2024-09-12T18:33:02.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.375+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~X8FFDHHC8FIV.0 size=599333 2024-09-12T18:33:02.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.375+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=X8FFDHHC8FIV tag=AA2X83V8NK66 type=write size=1647909 2024-09-12T18:33:02.377 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.375+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=0GIXL3NHWJKL type=del 2024-09-12T18:33:02.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.383+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~UJMZXTEOZCN0.0 size=1048576 2024-09-12T18:33:02.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.387+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~UJMZXTEOZCN0.1 size=1048576 2024-09-12T18:33:02.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.387+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~UJMZXTEOZCN0.2 size=660192 2024-09-12T18:33:02.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.387+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=UJMZXTEOZCN0 tag=H0RJH4V3G9GW type=write size=3805920 2024-09-12T18:33:02.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.391+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~8HHUL68HRZFA.0 size=1048576 2024-09-12T18:33:02.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.399+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~8HHUL68HRZFA.1 size=94089 2024-09-12T18:33:02.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.403+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=8HHUL68HRZFA tag=79LXCSW7IVLB type=write size=2191241 2024-09-12T18:33:02.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.403+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=PNC02BD2P1Y0 type=del size=25697 2024-09-12T18:33:02.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.407+0000 7f41a072b8c0 1 < completed delete operation key=1JIIRDVMT0B0 tag=K4Z8WFDNMGJ0 type=del 2024-09-12T18:33:02.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.411+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=KWRMX4XNR3OX type=del size=1243043 2024-09-12T18:33:02.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.415+0000 7f41a072b8c0 1 < suggested remove operation key=KP2HF4J376EY tag=JXB3KT3Z1IQ5 type=del 2024-09-12T18:33:02.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.423+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~GH82CAG72JPJ.0 size=1048576 2024-09-12T18:33:02.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.423+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~GH82CAG72JPJ.1 size=1048576 2024-09-12T18:33:02.427 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.427+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~GH82CAG72JPJ.2 size=252217 2024-09-12T18:33:02.427 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.427+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=GH82CAG72JPJ tag=BKG2Z3QIVV1C type=write size=3397945 2024-09-12T18:33:02.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.431+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~H63VB8GCKY0C.0 size=1048576 2024-09-12T18:33:02.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.431+0000 7f41a072b8c0 1 < canceled part key=_multipart_5OD9IX408CYO.2~H63VB8GCKY0C.1 size=683304 2024-09-12T18:33:02.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.435+0000 7f41a072b8c0 1 < canceled multipart upload key=5OD9IX408CYO upload=H63VB8GCKY0C tag=NF9PHZ6H0VBP type=write size=2780456 2024-09-12T18:33:02.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.439+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~1O0WSAS3A2HH.0 size=1048576 2024-09-12T18:33:02.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.443+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~1O0WSAS3A2HH.1 size=635103 2024-09-12T18:33:02.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.443+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=1O0WSAS3A2HH tag=1PANX22CEXJH type=write size=2732255 2024-09-12T18:33:02.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.447+0000 7f41a072b8c0 1 < canceled operation key=XLGVEN6DF5EW tag=YFVWUFFSNWCG type=del size=63039 2024-09-12T18:33:02.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.447+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=6NPYI14IYVXP type=del size=3575600 2024-09-12T18:33:02.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.451+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=FKAMLPYU6QX8 type=del 2024-09-12T18:33:02.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.455+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=9I3OX4SSQHIH type=del size=654524 2024-09-12T18:33:02.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.459+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=LFOIRGJL8ALQ type=del 2024-09-12T18:33:02.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.463+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~2714E5LO20YT.0 size=1048576 2024-09-12T18:33:02.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.467+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~2714E5LO20YT.1 size=1048576 2024-09-12T18:33:02.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.467+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~2714E5LO20YT.2 size=962645 2024-09-12T18:33:02.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.467+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=2714E5LO20YT tag=A7GXM2W6MQJ4 type=write size=4108373 2024-09-12T18:33:02.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.471+0000 7f41a072b8c0 1 < completed write operation key=SK3T82EJFZXE tag=5YA93BXZZLPD type=write size=882683 2024-09-12T18:33:02.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.475+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~GEH2NDCNTZZW.0 size=610646 2024-09-12T18:33:02.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.475+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=GEH2NDCNTZZW tag=N83K9AL2DCJC type=write size=1659222 2024-09-12T18:33:02.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.479+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~LCYL6UGBZAJT.0 size=1048576 2024-09-12T18:33:02.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.483+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~LCYL6UGBZAJT.1 size=1048576 2024-09-12T18:33:02.485 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.483+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~LCYL6UGBZAJT.2 size=833996 2024-09-12T18:33:02.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.487+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=LCYL6UGBZAJT tag=TIKJ12ZADCAF type=write size=3979724 2024-09-12T18:33:02.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.495+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~H29QZ08P1WOG.0 size=1048576 2024-09-12T18:33:02.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.499+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~H29QZ08P1WOG.1 size=1048576 2024-09-12T18:33:02.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.499+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~H29QZ08P1WOG.2 size=492267 2024-09-12T18:33:02.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.499+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=H29QZ08P1WOG tag=K08ITAIXO1DB type=write size=3637995 2024-09-12T18:33:02.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.503+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~DRGSJSF77RFT.0 size=1048576 2024-09-12T18:33:02.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.507+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~DRGSJSF77RFT.1 size=60790 2024-09-12T18:33:02.512 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.511+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=DRGSJSF77RFT tag=M7MNC6CRAMN3 type=write size=2157942 2024-09-12T18:33:02.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.515+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=26VGN77WJOYZ type=del size=1815114 2024-09-12T18:33:02.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.519+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~8QP9P5669IUD.0 size=1048576 2024-09-12T18:33:02.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.519+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~8QP9P5669IUD.1 size=224011 2024-09-12T18:33:02.527 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.527+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=8QP9P5669IUD tag=I5Q6XRHU20UA type=write size=2321163 2024-09-12T18:33:02.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.531+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=VFIPSBF5PO9K type=del size=3739829 2024-09-12T18:33:02.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.531+0000 7f41a072b8c0 1 < completed write operation key=NKMA8FG3V3TR tag=R750YOMK8PHA type=write size=430311 2024-09-12T18:33:02.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.539+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~700GSTE6XRYP.0 size=1048576 2024-09-12T18:33:02.542 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.543+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~700GSTE6XRYP.1 size=1048576 2024-09-12T18:33:02.545 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.543+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~700GSTE6XRYP.2 size=411618 2024-09-12T18:33:02.545 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.543+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=700GSTE6XRYP tag=TSV333RTD3LW type=write size=3557346 2024-09-12T18:33:02.548 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.547+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=23IT3YH5OTBT type=del 2024-09-12T18:33:02.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.555+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~VX0PXGGX1BS0.0 size=1048576 2024-09-12T18:33:02.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.555+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~VX0PXGGX1BS0.1 size=890383 2024-09-12T18:33:02.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.555+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=VX0PXGGX1BS0 tag=A3E8PT6PYIO8 type=write size=2987535 2024-09-12T18:33:02.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.559+0000 7f41a072b8c0 1 < completed delete operation key=1JIIRDVMT0B0 tag=PN8913BP9FZO type=del 2024-09-12T18:33:02.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.563+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~2QXR5HRDFEWR.0 size=1048576 2024-09-12T18:33:02.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.567+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~2QXR5HRDFEWR.1 size=1048576 2024-09-12T18:33:02.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.571+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~2QXR5HRDFEWR.2 size=599382 2024-09-12T18:33:02.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.571+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=2QXR5HRDFEWR tag=1RJOV362F9OV type=write size=3745110 2024-09-12T18:33:02.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.571+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~X8FFDHHC8FIV.0 size=599333 2024-09-12T18:33:02.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.579+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=X8FFDHHC8FIV tag=AA2X83V8NK66 type=write size=1647909 2024-09-12T18:33:02.582 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.579+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=UP61IBIHQS8A type=del size=2979312 2024-09-12T18:33:02.582 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.583+0000 7f41a072b8c0 1 < canceled part key=_multipart_V35A7LK08C7J.2~UJMZXTEOZCN0.0 size=1048576 2024-09-12T18:33:02.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.583+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~UJMZXTEOZCN0.1 size=1048576 2024-09-12T18:33:02.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.587+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~UJMZXTEOZCN0.2 size=660192 2024-09-12T18:33:02.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.591+0000 7f41a072b8c0 1 < canceled multipart upload key=V35A7LK08C7J upload=UJMZXTEOZCN0 tag=H0RJH4V3G9GW type=write size=3805920 2024-09-12T18:33:02.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.595+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=SAQ8WSZ65K52 type=del size=3626342 2024-09-12T18:33:02.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.599+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=PNC02BD2P1Y0 type=del 2024-09-12T18:33:02.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.603+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~VHDH43WZNG2G.0 size=1048576 2024-09-12T18:33:02.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.607+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~VHDH43WZNG2G.1 size=1048576 2024-09-12T18:33:02.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.607+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~VHDH43WZNG2G.2 size=445850 2024-09-12T18:33:02.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.607+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=VHDH43WZNG2G tag=VL0FYADL0CQJ type=write size=3591578 2024-09-12T18:33:02.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.611+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=KWRMX4XNR3OX type=del 2024-09-12T18:33:02.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.615+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=Z6QVA58HC44V type=del size=3064177 2024-09-12T18:33:02.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.619+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~GH82CAG72JPJ.0 size=1048576 2024-09-12T18:33:02.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.623+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~GH82CAG72JPJ.1 size=1048576 2024-09-12T18:33:02.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.623+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~GH82CAG72JPJ.2 size=252217 2024-09-12T18:33:02.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.631+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=GH82CAG72JPJ tag=BKG2Z3QIVV1C type=write size=3397945 2024-09-12T18:33:02.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.635+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~AC63C355HTMZ.0 size=1048576 2024-09-12T18:33:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.639+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~AC63C355HTMZ.1 size=808749 2024-09-12T18:33:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.639+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=AC63C355HTMZ tag=GE7RRFPJA2OL type=write size=2905901 2024-09-12T18:33:02.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.639+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~1O0WSAS3A2HH.0 size=1048576 2024-09-12T18:33:02.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.643+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~1O0WSAS3A2HH.1 size=635103 2024-09-12T18:33:02.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.647+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=1O0WSAS3A2HH tag=1PANX22CEXJH type=write size=2732255 2024-09-12T18:33:02.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.655+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~5HYG2B2VUWOK.0 size=316856 2024-09-12T18:33:02.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.655+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=5HYG2B2VUWOK tag=ZN96KSOGYPR4 type=write size=1365432 2024-09-12T18:33:02.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.659+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=6NPYI14IYVXP type=del 2024-09-12T18:33:02.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.663+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~LLTMBNDRCXGC.0 size=1048576 2024-09-12T18:33:02.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.667+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~LLTMBNDRCXGC.1 size=1048576 2024-09-12T18:33:02.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.671+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~LLTMBNDRCXGC.2 size=433826 2024-09-12T18:33:02.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.671+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=LLTMBNDRCXGC tag=U7MGPFQFA5GN type=write size=3579554 2024-09-12T18:33:02.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.671+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=9I3OX4SSQHIH type=del 2024-09-12T18:33:02.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.675+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=KRPETIQPV2LB type=del size=3578035 2024-09-12T18:33:02.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.683+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~2714E5LO20YT.0 size=1048576 2024-09-12T18:33:02.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.687+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~2714E5LO20YT.1 size=1048576 2024-09-12T18:33:02.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.691+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~2714E5LO20YT.2 size=962645 2024-09-12T18:33:02.697 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.695+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=2714E5LO20YT tag=A7GXM2W6MQJ4 type=write size=4108373 2024-09-12T18:33:02.703 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.703+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~T0GTZWHFF2Y5.0 size=1048576 2024-09-12T18:33:02.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.703+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~T0GTZWHFF2Y5.1 size=185545 2024-09-12T18:33:02.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.703+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=T0GTZWHFF2Y5 tag=VQV9TSYEB8VS type=write size=2282697 2024-09-12T18:33:02.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.707+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~GEH2NDCNTZZW.0 size=610646 2024-09-12T18:33:02.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.715+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=GEH2NDCNTZZW tag=N83K9AL2DCJC type=write size=1659222 2024-09-12T18:33:02.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.719+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=697MIMPOQVL2 type=del size=1248347 2024-09-12T18:33:02.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.723+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~H29QZ08P1WOG.0 size=1048576 2024-09-12T18:33:02.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.723+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~H29QZ08P1WOG.1 size=1048576 2024-09-12T18:33:02.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.727+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~H29QZ08P1WOG.2 size=492267 2024-09-12T18:33:02.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.731+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=H29QZ08P1WOG tag=K08ITAIXO1DB type=write size=3637995 2024-09-12T18:33:02.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.735+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=VTR101QV2YL0 type=del size=1926246 2024-09-12T18:33:02.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.739+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=26VGN77WJOYZ type=del 2024-09-12T18:33:02.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.743+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=MVUNYGS5K1SG type=del size=4036181 2024-09-12T18:33:02.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.747+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=VFIPSBF5PO9K type=del 2024-09-12T18:33:02.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.751+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=ZM1ODE62SJJ7 type=del size=58371 2024-09-12T18:33:02.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.751+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~700GSTE6XRYP.0 size=1048576 2024-09-12T18:33:02.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.751+0000 7f41a072b8c0 1 < canceled part key=_multipart_GC8797KSO47E.2~700GSTE6XRYP.1 size=1048576 2024-09-12T18:33:02.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.755+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~700GSTE6XRYP.2 size=411618 2024-09-12T18:33:02.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.763+0000 7f41a072b8c0 1 < canceled multipart upload key=GC8797KSO47E upload=700GSTE6XRYP tag=TSV333RTD3LW type=write size=3557346 2024-09-12T18:33:02.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.763+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=ZDCSMJSFVHSV type=del size=2931108 2024-09-12T18:33:02.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.767+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~VX0PXGGX1BS0.0 size=1048576 2024-09-12T18:33:02.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.771+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~VX0PXGGX1BS0.1 size=890383 2024-09-12T18:33:02.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.775+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=VX0PXGGX1BS0 tag=A3E8PT6PYIO8 type=write size=2987535 2024-09-12T18:33:02.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.783+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~0ZKQMMHH9SHK.0 size=505326 2024-09-12T18:33:02.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.783+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=0ZKQMMHH9SHK tag=8DJLROY2KU39 type=write size=1553902 2024-09-12T18:33:02.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.787+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~2QXR5HRDFEWR.0 size=1048576 2024-09-12T18:33:02.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.787+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~2QXR5HRDFEWR.1 size=1048576 2024-09-12T18:33:02.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.787+0000 7f41a072b8c0 1 < canceled part key=_multipart_KP2HF4J376EY.2~2QXR5HRDFEWR.2 size=599382 2024-09-12T18:33:02.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.795+0000 7f41a072b8c0 1 < canceled multipart upload key=KP2HF4J376EY upload=2QXR5HRDFEWR tag=1RJOV362F9OV type=write size=3745110 2024-09-12T18:33:02.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.799+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=9JW2CUNKOLGX type=write size=68644 2024-09-12T18:33:02.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.803+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=UP61IBIHQS8A type=del 2024-09-12T18:33:02.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.807+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~GUM0LLYUNRNH.0 size=1048576 2024-09-12T18:33:02.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.811+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~GUM0LLYUNRNH.1 size=747997 2024-09-12T18:33:02.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.811+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=GUM0LLYUNRNH tag=U78G712WK131 type=write size=2845149 2024-09-12T18:33:02.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.811+0000 7f41a072b8c0 1 < completed delete operation key=YP72VTCGSHYE tag=SAQ8WSZ65K52 type=del 2024-09-12T18:33:02.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.815+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=NW7MUF6LCW1P type=del size=1616214 2024-09-12T18:33:02.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.819+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~VHDH43WZNG2G.0 size=1048576 2024-09-12T18:33:02.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.823+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~VHDH43WZNG2G.1 size=1048576 2024-09-12T18:33:02.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.823+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~VHDH43WZNG2G.2 size=445850 2024-09-12T18:33:02.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.827+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=VHDH43WZNG2G tag=VL0FYADL0CQJ type=write size=3591578 2024-09-12T18:33:02.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.831+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=QA4AMRYIR70W type=del size=1356912 2024-09-12T18:33:02.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.835+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=Z6QVA58HC44V type=del 2024-09-12T18:33:02.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.839+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=T0KCWX1UHDQH type=del size=1066891 2024-09-12T18:33:02.842 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.839+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~AC63C355HTMZ.0 size=1048576 2024-09-12T18:33:02.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.843+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~AC63C355HTMZ.1 size=808749 2024-09-12T18:33:02.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.847+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=AC63C355HTMZ tag=GE7RRFPJA2OL type=write size=2905901 2024-09-12T18:33:02.855 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.855+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~XH7ZNO3GDOXF.0 size=496249 2024-09-12T18:33:02.855 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.855+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=XH7ZNO3GDOXF tag=P4B2HFQN2CCV type=write size=1544825 2024-09-12T18:33:02.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.859+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~5HYG2B2VUWOK.0 size=316856 2024-09-12T18:33:02.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.863+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=5HYG2B2VUWOK tag=ZN96KSOGYPR4 type=write size=1365432 2024-09-12T18:33:02.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.863+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=5GZ6ARGR0A8I type=del size=1016052 2024-09-12T18:33:02.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.867+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~LLTMBNDRCXGC.0 size=1048576 2024-09-12T18:33:02.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.871+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~LLTMBNDRCXGC.1 size=1048576 2024-09-12T18:33:02.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.871+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~LLTMBNDRCXGC.2 size=433826 2024-09-12T18:33:02.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.879+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=LLTMBNDRCXGC tag=U7MGPFQFA5GN type=write size=3579554 2024-09-12T18:33:02.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.883+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~9Q41O3OBK9Q4.0 size=1048576 2024-09-12T18:33:02.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.883+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~9Q41O3OBK9Q4.1 size=1048576 2024-09-12T18:33:02.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.887+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~9Q41O3OBK9Q4.2 size=16705 2024-09-12T18:33:02.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.887+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=9Q41O3OBK9Q4 tag=QNR3UDN3F3UY type=write size=3162433 2024-09-12T18:33:02.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.891+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=KRPETIQPV2LB type=del 2024-09-12T18:33:02.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.895+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~CGUIX7YBD22C.0 size=1048576 2024-09-12T18:33:02.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.895+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~CGUIX7YBD22C.1 size=1048576 2024-09-12T18:33:02.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.899+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~CGUIX7YBD22C.2 size=656965 2024-09-12T18:33:02.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.899+0000 7f41a072b8c0 1 > prepared multipart upload key=VEN0P2P1RZ2S upload=CGUIX7YBD22C tag=SNF9G637WGNQ type=write size=3802693 2024-09-12T18:33:02.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.899+0000 7f41a072b8c0 1 < canceled part key=_multipart_3R9RN03RFRJP.2~T0GTZWHFF2Y5.0 size=1048576 2024-09-12T18:33:02.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.903+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~T0GTZWHFF2Y5.1 size=185545 2024-09-12T18:33:02.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.907+0000 7f41a072b8c0 1 < canceled multipart upload key=3R9RN03RFRJP upload=T0GTZWHFF2Y5 tag=VQV9TSYEB8VS type=write size=2282697 2024-09-12T18:33:02.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.911+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~I2Z6KBZ4LI8H.0 size=1048576 2024-09-12T18:33:02.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.915+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~I2Z6KBZ4LI8H.1 size=888081 2024-09-12T18:33:02.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.915+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=I2Z6KBZ4LI8H tag=NB6N1RHRF12A type=write size=2985233 2024-09-12T18:33:02.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.919+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=697MIMPOQVL2 type=del 2024-09-12T18:33:02.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.919+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=LX1T1GOEQ2H4 type=write size=205788 2024-09-12T18:33:02.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.923+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=VTR101QV2YL0 type=del 2024-09-12T18:33:02.931 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.931+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~0M1WS1QP0KE1.0 size=1048576 2024-09-12T18:33:02.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.931+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~0M1WS1QP0KE1.1 size=1048576 2024-09-12T18:33:02.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.935+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~0M1WS1QP0KE1.2 size=356252 2024-09-12T18:33:02.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.935+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=0M1WS1QP0KE1 tag=42MZ9MDL8X4K type=write size=3501980 2024-09-12T18:33:02.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.939+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=MVUNYGS5K1SG type=del 2024-09-12T18:33:02.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.943+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~WJWI4K7K46E2.0 size=1048576 2024-09-12T18:33:02.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.943+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~WJWI4K7K46E2.1 size=738337 2024-09-12T18:33:02.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.943+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=WJWI4K7K46E2 tag=B9R70D6HFYRN type=write size=2835489 2024-09-12T18:33:02.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.947+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=ZM1ODE62SJJ7 type=del 2024-09-12T18:33:02.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.951+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=OLYVESGSTMJS type=del size=736048 2024-09-12T18:33:02.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.951+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=ZDCSMJSFVHSV type=del 2024-09-12T18:33:02.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.959+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~9AGMLIIML1ZI.0 size=957674 2024-09-12T18:33:02.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.959+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=9AGMLIIML1ZI tag=BFFN3F41273E type=write size=2006250 2024-09-12T18:33:02.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.959+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~0ZKQMMHH9SHK.0 size=505326 2024-09-12T18:33:02.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.967+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=0ZKQMMHH9SHK tag=8DJLROY2KU39 type=write size=1553902 2024-09-12T18:33:02.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.971+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~LBJOG038U4Y2.0 size=969661 2024-09-12T18:33:02.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.971+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=LBJOG038U4Y2 tag=ZGV5X473TA7Q type=write size=2018237 2024-09-12T18:33:02.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.975+0000 7f41a072b8c0 1 < completed write operation key=GC8797KSO47E tag=9JW2CUNKOLGX type=write size=68644 2024-09-12T18:33:02.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.979+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=5AH5CXFNWOZV type=del size=2112176 2024-09-12T18:33:02.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.979+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~GUM0LLYUNRNH.0 size=1048576 2024-09-12T18:33:02.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.979+0000 7f41a072b8c0 1 < canceled part key=_multipart_5JUWC8RXSA5L.2~GUM0LLYUNRNH.1 size=747997 2024-09-12T18:33:02.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.987+0000 7f41a072b8c0 1 < canceled multipart upload key=5JUWC8RXSA5L upload=GUM0LLYUNRNH tag=U78G712WK131 type=write size=2845149 2024-09-12T18:33:02.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.987+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=9UJPLMWIWOKT type=del size=3665523 2024-09-12T18:33:02.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.991+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=NW7MUF6LCW1P type=del 2024-09-12T18:33:02.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.995+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~V7X3FC3IFQFZ.0 size=1024413 2024-09-12T18:33:02.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.995+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=V7X3FC3IFQFZ tag=WZB37VCJE6HY type=write size=2072989 2024-09-12T18:33:02.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.999+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=QA4AMRYIR70W type=del 2024-09-12T18:33:03.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:02.999+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=KCQU8VGZS7LU type=del size=1038698 2024-09-12T18:33:03.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.003+0000 7f41a072b8c0 1 < canceled operation key=GA6P1FACU2EQ tag=T0KCWX1UHDQH type=del size=1066891 2024-09-12T18:33:03.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.007+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=PVPUVQ3WKCUT type=del size=1557330 2024-09-12T18:33:03.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.007+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~XH7ZNO3GDOXF.0 size=496249 2024-09-12T18:33:03.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.011+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=XH7ZNO3GDOXF tag=P4B2HFQN2CCV type=write size=1544825 2024-09-12T18:33:03.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.015+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~FTHI2JD6DWWP.0 size=1048576 2024-09-12T18:33:03.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.019+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~FTHI2JD6DWWP.1 size=995441 2024-09-12T18:33:03.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.019+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=FTHI2JD6DWWP tag=CBTRR23Q4X96 type=write size=3092593 2024-09-12T18:33:03.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.027+0000 7f41a072b8c0 1 < suggested update operation key=P732C5X0RG8Z tag=5GZ6ARGR0A8I type=del size=1016052 2024-09-12T18:33:03.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.031+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~FBRUU434UHDI.0 size=1048576 2024-09-12T18:33:03.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.035+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~FBRUU434UHDI.1 size=72409 2024-09-12T18:33:03.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.035+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=FBRUU434UHDI tag=F7AMMWDVI6LW type=write size=2169561 2024-09-12T18:33:03.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.039+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~9Q41O3OBK9Q4.0 size=1048576 2024-09-12T18:33:03.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.039+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~9Q41O3OBK9Q4.1 size=1048576 2024-09-12T18:33:03.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.043+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~9Q41O3OBK9Q4.2 size=16705 2024-09-12T18:33:03.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.047+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=9Q41O3OBK9Q4 tag=QNR3UDN3F3UY type=write size=3162433 2024-09-12T18:33:03.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.051+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=R65LOWM15W6O type=del size=376394 2024-09-12T18:33:03.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.055+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~CGUIX7YBD22C.0 size=1048576 2024-09-12T18:33:03.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.055+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~CGUIX7YBD22C.1 size=1048576 2024-09-12T18:33:03.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.059+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~CGUIX7YBD22C.2 size=656965 2024-09-12T18:33:03.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.063+0000 7f41a072b8c0 1 < completed multipart upload key=VEN0P2P1RZ2S upload=CGUIX7YBD22C tag=SNF9G637WGNQ type=write size=3802693 2024-09-12T18:33:03.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.067+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=XIXJBX4QLXFW type=del size=4060273 2024-09-12T18:33:03.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.067+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~I2Z6KBZ4LI8H.0 size=1048576 2024-09-12T18:33:03.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.071+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~I2Z6KBZ4LI8H.1 size=888081 2024-09-12T18:33:03.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.075+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=I2Z6KBZ4LI8H tag=NB6N1RHRF12A type=write size=2985233 2024-09-12T18:33:03.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.079+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~DGNMFRSS3SI1.0 size=1048576 2024-09-12T18:33:03.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.083+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~DGNMFRSS3SI1.1 size=1048576 2024-09-12T18:33:03.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.083+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~DGNMFRSS3SI1.2 size=187098 2024-09-12T18:33:03.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.083+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=DGNMFRSS3SI1 tag=JA0PLIW1EWJA type=write size=3332826 2024-09-12T18:33:03.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.087+0000 7f41a072b8c0 1 < completed write operation key=63BP9QETTAM8 tag=LX1T1GOEQ2H4 type=write size=205788 2024-09-12T18:33:03.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.091+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~8AA8UHQMGMQ1.0 size=1039588 2024-09-12T18:33:03.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.091+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=8AA8UHQMGMQ1 tag=PVLXMPDKB664 type=write size=2088164 2024-09-12T18:33:03.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.095+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~0M1WS1QP0KE1.0 size=1048576 2024-09-12T18:33:03.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.095+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~0M1WS1QP0KE1.1 size=1048576 2024-09-12T18:33:03.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.099+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~0M1WS1QP0KE1.2 size=356252 2024-09-12T18:33:03.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.103+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=0M1WS1QP0KE1 tag=42MZ9MDL8X4K type=write size=3501980 2024-09-12T18:33:03.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.103+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=HDWL45XXX2S6 type=del size=3946867 2024-09-12T18:33:03.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.107+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~WJWI4K7K46E2.0 size=1048576 2024-09-12T18:33:03.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.107+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~WJWI4K7K46E2.1 size=738337 2024-09-12T18:33:03.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.115+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=WJWI4K7K46E2 tag=B9R70D6HFYRN type=write size=2835489 2024-09-12T18:33:03.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.119+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~FJVO4SO9TW50.0 size=1048576 2024-09-12T18:33:03.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.119+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~FJVO4SO9TW50.1 size=1048576 2024-09-12T18:33:03.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.123+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~FJVO4SO9TW50.2 size=343503 2024-09-12T18:33:03.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.123+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=FJVO4SO9TW50 tag=7F9PEGVBROJI type=write size=3489231 2024-09-12T18:33:03.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.127+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=OLYVESGSTMJS type=del 2024-09-12T18:33:03.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.131+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~WKEIZIBKQ7QM.0 size=995246 2024-09-12T18:33:03.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.131+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=WKEIZIBKQ7QM tag=61X4L4CPA6HS type=write size=2043822 2024-09-12T18:33:03.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.135+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~9AGMLIIML1ZI.0 size=957674 2024-09-12T18:33:03.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.139+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=9AGMLIIML1ZI tag=BFFN3F41273E type=write size=2006250 2024-09-12T18:33:03.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.143+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=H3QRBL2MRADY type=del size=205308 2024-09-12T18:33:03.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.143+0000 7f41a072b8c0 1 < canceled part key=_multipart_L1VC63PK1R2Y.2~LBJOG038U4Y2.0 size=969661 2024-09-12T18:33:03.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.147+0000 7f41a072b8c0 1 < canceled multipart upload key=L1VC63PK1R2Y upload=LBJOG038U4Y2 tag=ZGV5X473TA7Q type=write size=2018237 2024-09-12T18:33:03.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.151+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=WYUSM1XMXPCN type=del size=358052 2024-09-12T18:33:03.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.155+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=5AH5CXFNWOZV type=del 2024-09-12T18:33:03.158 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.159+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=PT2A2CWZXL2H type=write size=573515 2024-09-12T18:33:03.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.159+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=9UJPLMWIWOKT type=del 2024-09-12T18:33:03.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.163+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=FL2IJNYR5AOD type=del size=1096672 2024-09-12T18:33:03.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.167+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~V7X3FC3IFQFZ.0 size=1024413 2024-09-12T18:33:03.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.171+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=V7X3FC3IFQFZ tag=WZB37VCJE6HY type=write size=2072989 2024-09-12T18:33:03.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.175+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=S0YV806WT877 type=del size=578462 2024-09-12T18:33:03.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.179+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=KCQU8VGZS7LU type=del 2024-09-12T18:33:03.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.183+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=1VI0FHCC5OVR type=del size=1475145 2024-09-12T18:33:03.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.187+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=PVPUVQ3WKCUT type=del 2024-09-12T18:33:03.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.187+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=Y8UPWCSPQZ4J type=del size=203954 2024-09-12T18:33:03.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.191+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~FTHI2JD6DWWP.0 size=1048576 2024-09-12T18:33:03.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.195+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~FTHI2JD6DWWP.1 size=995441 2024-09-12T18:33:03.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.199+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=FTHI2JD6DWWP tag=CBTRR23Q4X96 type=write size=3092593 2024-09-12T18:33:03.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.203+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~VU6KKJX3C5PC.0 size=1048576 2024-09-12T18:33:03.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.203+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~VU6KKJX3C5PC.1 size=1048576 2024-09-12T18:33:03.208 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.207+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~VU6KKJX3C5PC.2 size=879118 2024-09-12T18:33:03.208 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.207+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=VU6KKJX3C5PC tag=69TU4RORF3VS type=write size=4024846 2024-09-12T18:33:03.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.211+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~FBRUU434UHDI.0 size=1048576 2024-09-12T18:33:03.213 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.211+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~FBRUU434UHDI.1 size=72409 2024-09-12T18:33:03.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.215+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=FBRUU434UHDI tag=F7AMMWDVI6LW type=write size=2169561 2024-09-12T18:33:03.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.219+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=9OX0SS10LFXB type=del size=3234281 2024-09-12T18:33:03.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.223+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=R65LOWM15W6O type=del 2024-09-12T18:33:03.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.231+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=UR7XTTGX5HVT type=write size=666630 2024-09-12T18:33:03.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.235+0000 7f41a072b8c0 1 < canceled operation key=ZACT36ZOC9ES tag=XIXJBX4QLXFW type=del size=4060273 2024-09-12T18:33:03.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.235+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=OPC63XQYRR0L type=del size=2038206 2024-09-12T18:33:03.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.239+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~DGNMFRSS3SI1.0 size=1048576 2024-09-12T18:33:03.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.243+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~DGNMFRSS3SI1.1 size=1048576 2024-09-12T18:33:03.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.243+0000 7f41a072b8c0 1 < canceled part key=_multipart_1JIIRDVMT0B0.2~DGNMFRSS3SI1.2 size=187098 2024-09-12T18:33:03.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.247+0000 7f41a072b8c0 1 < canceled multipart upload key=1JIIRDVMT0B0 upload=DGNMFRSS3SI1 tag=JA0PLIW1EWJA type=write size=3332826 2024-09-12T18:33:03.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.251+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=HS1D3K0TE7PS type=del size=2899783 2024-09-12T18:33:03.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.251+0000 7f41a072b8c0 1 < canceled part key=_multipart_GC8797KSO47E.2~8AA8UHQMGMQ1.0 size=1039588 2024-09-12T18:33:03.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.255+0000 7f41a072b8c0 1 < canceled multipart upload key=GC8797KSO47E upload=8AA8UHQMGMQ1 tag=PVLXMPDKB664 type=write size=2088164 2024-09-12T18:33:03.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.259+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=XEWYQB2RSR35 type=del size=385591 2024-09-12T18:33:03.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.263+0000 7f41a072b8c0 1 < canceled operation key=YP72VTCGSHYE tag=HDWL45XXX2S6 type=del size=3946867 2024-09-12T18:33:03.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.267+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=5YG6DTFECHIJ type=del size=86251 2024-09-12T18:33:03.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.271+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~FJVO4SO9TW50.0 size=1048576 2024-09-12T18:33:03.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.271+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~FJVO4SO9TW50.1 size=1048576 2024-09-12T18:33:03.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.275+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~FJVO4SO9TW50.2 size=343503 2024-09-12T18:33:03.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.279+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=FJVO4SO9TW50 tag=7F9PEGVBROJI type=write size=3489231 2024-09-12T18:33:03.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.283+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=BHTKXKOIG0L4 type=del size=2208207 2024-09-12T18:33:03.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.287+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~WKEIZIBKQ7QM.0 size=995246 2024-09-12T18:33:03.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.291+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=WKEIZIBKQ7QM tag=61X4L4CPA6HS type=write size=2043822 2024-09-12T18:33:03.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.295+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=POHYO7VNYIW4 type=del size=3591958 2024-09-12T18:33:03.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.299+0000 7f41a072b8c0 1 < suggested remove operation key=KOLD6WYK30EQ tag=H3QRBL2MRADY type=del 2024-09-12T18:33:03.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.303+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=0P1MPJNZ823H type=del size=3943460 2024-09-12T18:33:03.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.307+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=WYUSM1XMXPCN type=del 2024-09-12T18:33:03.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.307+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=5F8Y48QC1VSL type=write size=575614 2024-09-12T18:33:03.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.311+0000 7f41a072b8c0 1 < canceled operation key=GA6P1FACU2EQ tag=PT2A2CWZXL2H type=write size=573515 2024-09-12T18:33:03.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.315+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~QGM4OID5DSHW.0 size=1048576 2024-09-12T18:33:03.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.319+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~QGM4OID5DSHW.1 size=125333 2024-09-12T18:33:03.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.319+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=QGM4OID5DSHW tag=A0URXU7BMVG0 type=write size=2222485 2024-09-12T18:33:03.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.323+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=FL2IJNYR5AOD type=del 2024-09-12T18:33:03.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.327+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=LY189UBY5LPA type=del size=1737781 2024-09-12T18:33:03.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.327+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=S0YV806WT877 type=del 2024-09-12T18:33:03.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.331+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=XU8Y8V3VOV8T type=del size=2761850 2024-09-12T18:33:03.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.335+0000 7f41a072b8c0 1 < completed delete operation key=1JIIRDVMT0B0 tag=1VI0FHCC5OVR type=del 2024-09-12T18:33:03.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.335+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=J1ZJXSLW14MT type=del size=3598446 2024-09-12T18:33:03.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.343+0000 7f41a072b8c0 1 < suggested update operation key=58IT2R988AW9 tag=Y8UPWCSPQZ4J type=del size=203954 2024-09-12T18:33:03.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.347+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~HCYGL5S6CVL2.0 size=304480 2024-09-12T18:33:03.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.347+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=HCYGL5S6CVL2 tag=T7G35PPBRQ0I type=write size=1353056 2024-09-12T18:33:03.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.351+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~VU6KKJX3C5PC.0 size=1048576 2024-09-12T18:33:03.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.355+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~VU6KKJX3C5PC.1 size=1048576 2024-09-12T18:33:03.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.359+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~VU6KKJX3C5PC.2 size=879118 2024-09-12T18:33:03.366 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.363+0000 7f41a072b8c0 1 < completed multipart upload key=L01GL4WOUIL2 upload=VU6KKJX3C5PC tag=69TU4RORF3VS type=write size=4024846 2024-09-12T18:33:03.369 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.367+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=TP8OW9SDPZWV type=write size=538552 2024-09-12T18:33:03.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.371+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=9OX0SS10LFXB type=del 2024-09-12T18:33:03.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.379+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~9WI934OSJRYJ.0 size=1048576 2024-09-12T18:33:03.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.379+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~9WI934OSJRYJ.1 size=1048576 2024-09-12T18:33:03.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.383+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~9WI934OSJRYJ.2 size=410504 2024-09-12T18:33:03.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.383+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=9WI934OSJRYJ tag=OCKC61SNBMGY type=write size=3556232 2024-09-12T18:33:03.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.387+0000 7f41a072b8c0 1 < completed write operation key=C2PRRD3QO9AF tag=UR7XTTGX5HVT type=write size=666630 2024-09-12T18:33:03.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.387+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=9RXPA18DTEE8 type=write size=480303 2024-09-12T18:33:03.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.391+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=OPC63XQYRR0L type=del 2024-09-12T18:33:03.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.399+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~QY4R8BCYO4X4.0 size=1048576 2024-09-12T18:33:03.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.399+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~QY4R8BCYO4X4.1 size=1048576 2024-09-12T18:33:03.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.403+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~QY4R8BCYO4X4.2 size=1020253 2024-09-12T18:33:03.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.403+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=QY4R8BCYO4X4 tag=GDEFXBTB9I7J type=write size=4165981 2024-09-12T18:33:03.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.407+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=HS1D3K0TE7PS type=del 2024-09-12T18:33:03.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.411+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=I8I0VJEKPLA7 type=del size=949814 2024-09-12T18:33:03.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.411+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=XEWYQB2RSR35 type=del 2024-09-12T18:33:03.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.415+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=7MDD8DUMI6M1 type=del size=3396673 2024-09-12T18:33:03.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.419+0000 7f41a072b8c0 1 < suggested remove operation key=ZACT36ZOC9ES tag=5YG6DTFECHIJ type=del 2024-09-12T18:33:03.427 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.427+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~DLL1B0RDQZPH.0 size=1048576 2024-09-12T18:33:03.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.427+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~DLL1B0RDQZPH.1 size=721080 2024-09-12T18:33:03.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.427+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=DLL1B0RDQZPH tag=5SC5UBY8NPIT type=write size=2818232 2024-09-12T18:33:03.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.431+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=BHTKXKOIG0L4 type=del 2024-09-12T18:33:03.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.435+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=EGXMH8JY6SRU type=del size=3359925 2024-09-12T18:33:03.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.439+0000 7f41a072b8c0 1 < suggested remove operation key=GA6P1FACU2EQ tag=POHYO7VNYIW4 type=del 2024-09-12T18:33:03.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.443+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=JDF1ZGCO65E4 type=del size=1625967 2024-09-12T18:33:03.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.447+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=0P1MPJNZ823H type=del 2024-09-12T18:33:03.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.451+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=02SH4U8HLEB7 type=write size=200064 2024-09-12T18:33:03.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.455+0000 7f41a072b8c0 1 < suggested update operation key=7B70QWGMH0C0 tag=5F8Y48QC1VSL type=write size=575614 2024-09-12T18:33:03.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.459+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=41YH4JEE2TSN type=del size=959478 2024-09-12T18:33:03.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.463+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~QGM4OID5DSHW.0 size=1048576 2024-09-12T18:33:03.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.463+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~QGM4OID5DSHW.1 size=125333 2024-09-12T18:33:03.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.471+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=QGM4OID5DSHW tag=A0URXU7BMVG0 type=write size=2222485 2024-09-12T18:33:03.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.471+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=Y7ST5IHPDH0Q type=del size=1969670 2024-09-12T18:33:03.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.479+0000 7f41a072b8c0 1 < suggested remove operation key=5JUWC8RXSA5L tag=LY189UBY5LPA type=del 2024-09-12T18:33:03.484 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.483+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~18CKX1VSLKLL.0 size=255750 2024-09-12T18:33:03.484 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.483+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=18CKX1VSLKLL tag=3XKWCJ0MA25D type=write size=1304326 2024-09-12T18:33:03.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.487+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=XU8Y8V3VOV8T type=del 2024-09-12T18:33:03.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.491+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=ZGIPRDO5OMI9 type=del size=1204622 2024-09-12T18:33:03.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.491+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=J1ZJXSLW14MT type=del 2024-09-12T18:33:03.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.499+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~47NBBGJ4VFZ0.0 size=1048576 2024-09-12T18:33:03.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.503+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~47NBBGJ4VFZ0.1 size=473258 2024-09-12T18:33:03.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.503+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=47NBBGJ4VFZ0 tag=2GI0Q9NQQ7Q2 type=write size=2570410 2024-09-12T18:33:03.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.503+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~HCYGL5S6CVL2.0 size=304480 2024-09-12T18:33:03.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.515+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=HCYGL5S6CVL2 tag=T7G35PPBRQ0I type=write size=1353056 2024-09-12T18:33:03.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.519+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=KG3IVN12FZXF type=del size=3309107 2024-09-12T18:33:03.522 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.523+0000 7f41a072b8c0 1 < canceled operation key=63BP9QETTAM8 tag=TP8OW9SDPZWV type=write size=538552 2024-09-12T18:33:03.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.523+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=I1WH4MPWIF1D type=del size=72642 2024-09-12T18:33:03.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.531+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~9WI934OSJRYJ.0 size=1048576 2024-09-12T18:33:03.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.535+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~9WI934OSJRYJ.1 size=1048576 2024-09-12T18:33:03.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.535+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~9WI934OSJRYJ.2 size=410504 2024-09-12T18:33:03.543 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.543+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=9WI934OSJRYJ tag=OCKC61SNBMGY type=write size=3556232 2024-09-12T18:33:03.546 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.543+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=GCBJ6IIH187I type=del size=1645964 2024-09-12T18:33:03.548 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.547+0000 7f41a072b8c0 1 < completed write operation key=7MRN7L1DTAMO tag=9RXPA18DTEE8 type=write size=480303 2024-09-12T18:33:03.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.551+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=B2TO50UQ4D15 type=del size=3188026 2024-09-12T18:33:03.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.555+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~QY4R8BCYO4X4.0 size=1048576 2024-09-12T18:33:03.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.555+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~QY4R8BCYO4X4.1 size=1048576 2024-09-12T18:33:03.559 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.559+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~QY4R8BCYO4X4.2 size=1020253 2024-09-12T18:33:03.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.563+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=QY4R8BCYO4X4 tag=GDEFXBTB9I7J type=write size=4165981 2024-09-12T18:33:03.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.567+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=HJ5DEURBU9YY type=write size=430720 2024-09-12T18:33:03.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.567+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=I8I0VJEKPLA7 type=del 2024-09-12T18:33:03.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.571+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=A9SNBGM8VHT3 type=del size=1319801 2024-09-12T18:33:03.577 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.575+0000 7f41a072b8c0 1 < suggested remove operation key=1JIIRDVMT0B0 tag=7MDD8DUMI6M1 type=del 2024-09-12T18:33:03.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.579+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=U1N43YNVP1Q6 type=del size=1559816 2024-09-12T18:33:03.582 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.583+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~DLL1B0RDQZPH.0 size=1048576 2024-09-12T18:33:03.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.583+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~DLL1B0RDQZPH.1 size=721080 2024-09-12T18:33:03.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.587+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=DLL1B0RDQZPH tag=5SC5UBY8NPIT type=write size=2818232 2024-09-12T18:33:03.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.591+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=4L29MVIM0MSI type=write size=329236 2024-09-12T18:33:03.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.595+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=EGXMH8JY6SRU type=del 2024-09-12T18:33:03.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.595+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=UUWVOFQ96TGC type=del size=902722 2024-09-12T18:33:03.604 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.603+0000 7f41a072b8c0 1 < suggested remove operation key=V35A7LK08C7J tag=JDF1ZGCO65E4 type=del 2024-09-12T18:33:03.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.607+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=PW4DNACMM6T0 type=write size=462872 2024-09-12T18:33:03.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.611+0000 7f41a072b8c0 1 < suggested update operation key=3R9RN03RFRJP tag=02SH4U8HLEB7 type=write size=200064 2024-09-12T18:33:03.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.619+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~W85S9OBN5BZK.0 size=382071 2024-09-12T18:33:03.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.619+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=W85S9OBN5BZK tag=BG1Z5B90EV1C type=write size=1430647 2024-09-12T18:33:03.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.619+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=41YH4JEE2TSN type=del 2024-09-12T18:33:03.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.623+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=PY5RITFRQK1K type=del size=4052766 2024-09-12T18:33:03.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.631+0000 7f41a072b8c0 1 < suggested update operation key=0G0YWIOD3L3I tag=Y7ST5IHPDH0Q type=del size=1969670 2024-09-12T18:33:03.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.635+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=IDMQRDHEA0DV type=del size=2154453 2024-09-12T18:33:03.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.635+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~18CKX1VSLKLL.0 size=255750 2024-09-12T18:33:03.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.643+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=18CKX1VSLKLL tag=3XKWCJ0MA25D type=write size=1304326 2024-09-12T18:33:03.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.643+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=ZVP62NV374BP type=del size=1580623 2024-09-12T18:33:03.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.647+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=ZGIPRDO5OMI9 type=del 2024-09-12T18:33:03.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.655+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~NQSN7D0BU0C5.0 size=934979 2024-09-12T18:33:03.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.655+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=NQSN7D0BU0C5 tag=71RFUCGYWJY4 type=write size=1983555 2024-09-12T18:33:03.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.655+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~47NBBGJ4VFZ0.0 size=1048576 2024-09-12T18:33:03.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.659+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~47NBBGJ4VFZ0.1 size=473258 2024-09-12T18:33:03.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.663+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=47NBBGJ4VFZ0 tag=2GI0Q9NQQ7Q2 type=write size=2570410 2024-09-12T18:33:03.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.667+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=VHSD509X7UD5 type=del size=475668 2024-09-12T18:33:03.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.671+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=KG3IVN12FZXF type=del 2024-09-12T18:33:03.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.671+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=K5Y8LP0EMR4L type=del size=1537280 2024-09-12T18:33:03.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.675+0000 7f41a072b8c0 1 < canceled operation key=ZACT36ZOC9ES tag=I1WH4MPWIF1D type=del size=72642 2024-09-12T18:33:03.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.679+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=2N86Y2UEH8VS type=del size=3207287 2024-09-12T18:33:03.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.683+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=GCBJ6IIH187I type=del 2024-09-12T18:33:03.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.683+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=95NGGIB4HX8X type=del size=59056 2024-09-12T18:33:03.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.691+0000 7f41a072b8c0 1 < suggested update operation key=3CGBX19WTMWQ tag=B2TO50UQ4D15 type=del size=3188026 2024-09-12T18:33:03.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.695+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~7NCM40YHE48V.0 size=1048576 2024-09-12T18:33:03.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.699+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~7NCM40YHE48V.1 size=1048576 2024-09-12T18:33:03.700 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.699+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~7NCM40YHE48V.2 size=304411 2024-09-12T18:33:03.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.699+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=7NCM40YHE48V tag=QS2OICD508IN type=write size=3450139 2024-09-12T18:33:03.703 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.703+0000 7f41a072b8c0 1 < canceled operation key=1BSAN5TRTZNZ tag=HJ5DEURBU9YY type=write size=430720 2024-09-12T18:33:03.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.707+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=GT6HORONBHY4 type=write size=411383 2024-09-12T18:33:03.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.711+0000 7f41a072b8c0 1 < suggested remove operation key=7B70QWGMH0C0 tag=A9SNBGM8VHT3 type=del 2024-09-12T18:33:03.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.715+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=VD8YYNG2G1Q9 type=del size=1287472 2024-09-12T18:33:03.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.715+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=U1N43YNVP1Q6 type=del 2024-09-12T18:33:03.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.723+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~YOH8QLFYESRI.0 size=953920 2024-09-12T18:33:03.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.723+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=YOH8QLFYESRI tag=JNUGOW8XMEM0 type=write size=2002496 2024-09-12T18:33:03.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.727+0000 7f41a072b8c0 1 < completed write operation key=KP2HF4J376EY tag=4L29MVIM0MSI type=write size=329236 2024-09-12T18:33:03.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.731+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~0JQXJXE2GR28.0 size=1048576 2024-09-12T18:33:03.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.735+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~0JQXJXE2GR28.1 size=524037 2024-09-12T18:33:03.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.735+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=0JQXJXE2GR28 tag=S32RLXZSEPRH type=write size=2621189 2024-09-12T18:33:03.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.735+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=UUWVOFQ96TGC type=del 2024-09-12T18:33:03.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.743+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~5IE94JTUKWAY.0 size=365149 2024-09-12T18:33:03.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.743+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=5IE94JTUKWAY tag=6SYK5MO0GDJV type=write size=1413725 2024-09-12T18:33:03.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.747+0000 7f41a072b8c0 1 < completed write operation key=58IT2R988AW9 tag=PW4DNACMM6T0 type=write size=462872 2024-09-12T18:33:03.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.751+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~IONYB5YX8LX5.0 size=1048576 2024-09-12T18:33:03.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.755+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~IONYB5YX8LX5.1 size=1048576 2024-09-12T18:33:03.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.759+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~IONYB5YX8LX5.2 size=716725 2024-09-12T18:33:03.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.759+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=IONYB5YX8LX5 tag=X1R1IZ3MTYKZ type=write size=3862453 2024-09-12T18:33:03.759 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.759+0000 7f41a072b8c0 1 < canceled part key=_multipart_GA6P1FACU2EQ.2~W85S9OBN5BZK.0 size=382071 2024-09-12T18:33:03.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.763+0000 7f41a072b8c0 1 < canceled multipart upload key=GA6P1FACU2EQ upload=W85S9OBN5BZK tag=BG1Z5B90EV1C type=write size=1430647 2024-09-12T18:33:03.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.771+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~3M56JQQ709UX.0 size=130403 2024-09-12T18:33:03.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.771+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=3M56JQQ709UX tag=75N34FX1UW02 type=write size=1178979 2024-09-12T18:33:03.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.775+0000 7f41a072b8c0 1 < canceled operation key=0O97F5ON55TX tag=PY5RITFRQK1K type=del size=4052766 2024-09-12T18:33:03.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.775+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=M8BQIZT5UJP4 type=del size=2519151 2024-09-12T18:33:03.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.779+0000 7f41a072b8c0 -1 < failed to complete operation key=7B70QWGMH0C0 tag=IDMQRDHEA0DV type=del size=2154453: (22) Invalid argument 2024-09-12T18:33:03.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.783+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=U4PELU8WRWDJ type=write size=416720 2024-09-12T18:33:03.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.787+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=ZVP62NV374BP type=del 2024-09-12T18:33:03.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.791+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=TFPTEDZOLTL9 type=del size=4014009 2024-09-12T18:33:03.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.791+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~NQSN7D0BU0C5.0 size=934979 2024-09-12T18:33:03.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.799+0000 7f41a072b8c0 1 < completed multipart upload key=L01GL4WOUIL2 upload=NQSN7D0BU0C5 tag=71RFUCGYWJY4 type=write size=1983555 2024-09-12T18:33:03.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.803+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~KBAHRW05UQB0.0 size=1019557 2024-09-12T18:33:03.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.803+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=KBAHRW05UQB0 tag=UL5EQTA3IOV3 type=write size=2068133 2024-09-12T18:33:03.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.807+0000 7f41a072b8c0 1 < canceled operation key=V35A7LK08C7J tag=VHSD509X7UD5 type=del size=475668 2024-09-12T18:33:03.813 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.811+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~0775UEAK5TWB.0 size=1048576 2024-09-12T18:33:03.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.819+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~0775UEAK5TWB.1 size=704868 2024-09-12T18:33:03.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.819+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=0775UEAK5TWB tag=V934I8DTQRV4 type=write size=2802020 2024-09-12T18:33:03.822 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.823+0000 7f41a072b8c0 1 < canceled operation key=KP2HF4J376EY tag=K5Y8LP0EMR4L type=del size=1537280 2024-09-12T18:33:03.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.823+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=5HY0DWPTNY6R type=del size=3222677 2024-09-12T18:33:03.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.827+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=2N86Y2UEH8VS type=del 2024-09-12T18:33:03.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.831+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~QXTNYLM2HGSS.0 size=395025 2024-09-12T18:33:03.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.831+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=QXTNYLM2HGSS tag=THOOKM3528XV type=write size=1443601 2024-09-12T18:33:03.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.835+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=95NGGIB4HX8X type=del 2024-09-12T18:33:03.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.839+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=RM0VQMFJ0TOQ type=del size=1107784 2024-09-12T18:33:03.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.839+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~7NCM40YHE48V.0 size=1048576 2024-09-12T18:33:03.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.843+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~7NCM40YHE48V.1 size=1048576 2024-09-12T18:33:03.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.847+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~7NCM40YHE48V.2 size=304411 2024-09-12T18:33:03.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.851+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=7NCM40YHE48V tag=QS2OICD508IN type=write size=3450139 2024-09-12T18:33:03.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.851+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=EZ3CUCLOWKJ1 type=write size=567626 2024-09-12T18:33:03.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.855+0000 7f41a072b8c0 1 < canceled operation key=YCBC1CHWJQC5 tag=GT6HORONBHY4 type=write size=411383 2024-09-12T18:33:03.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.859+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=ZTZQK5DKU2PQ type=write size=368529 2024-09-12T18:33:03.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.859+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=VD8YYNG2G1Q9 type=del 2024-09-12T18:33:03.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.863+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=WXR41CTFPWFR type=del size=2887484 2024-09-12T18:33:03.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.867+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~YOH8QLFYESRI.0 size=953920 2024-09-12T18:33:03.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.871+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=YOH8QLFYESRI tag=JNUGOW8XMEM0 type=write size=2002496 2024-09-12T18:33:03.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.871+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=LXY9FVNI3PRU type=del size=3090966 2024-09-12T18:33:03.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.875+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~0JQXJXE2GR28.0 size=1048576 2024-09-12T18:33:03.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.875+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~0JQXJXE2GR28.1 size=524037 2024-09-12T18:33:03.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.879+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=0JQXJXE2GR28 tag=S32RLXZSEPRH type=write size=2621189 2024-09-12T18:33:03.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.883+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~90M23DZJ4A49.0 size=1048576 2024-09-12T18:33:03.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.887+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~90M23DZJ4A49.1 size=1048576 2024-09-12T18:33:03.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.891+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~90M23DZJ4A49.2 size=773553 2024-09-12T18:33:03.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.891+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=90M23DZJ4A49 tag=FXWVZE0AT8SV type=write size=3919281 2024-09-12T18:33:03.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.891+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~5IE94JTUKWAY.0 size=365149 2024-09-12T18:33:03.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.895+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=5IE94JTUKWAY tag=6SYK5MO0GDJV type=write size=1413725 2024-09-12T18:33:03.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.899+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=BCC53HT2XD1C type=del size=962548 2024-09-12T18:33:03.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.903+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~IONYB5YX8LX5.0 size=1048576 2024-09-12T18:33:03.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.903+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~IONYB5YX8LX5.1 size=1048576 2024-09-12T18:33:03.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.907+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~IONYB5YX8LX5.2 size=716725 2024-09-12T18:33:03.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.911+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=IONYB5YX8LX5 tag=X1R1IZ3MTYKZ type=write size=3862453 2024-09-12T18:33:03.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.915+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~36VAH9L7U48R.0 size=359579 2024-09-12T18:33:03.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.915+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=36VAH9L7U48R tag=LENMRHXLOV2B type=write size=1408155 2024-09-12T18:33:03.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.915+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~3M56JQQ709UX.0 size=130403 2024-09-12T18:33:03.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.919+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=3M56JQQ709UX tag=75N34FX1UW02 type=write size=1178979 2024-09-12T18:33:03.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.923+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=2GY83KANKG3H type=del size=3240185 2024-09-12T18:33:03.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.927+0000 7f41a072b8c0 1 < completed delete operation key=NKMA8FG3V3TR tag=M8BQIZT5UJP4 type=del 2024-09-12T18:33:03.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.927+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=RKKYNIQRDZ0R type=del size=492154 2024-09-12T18:33:03.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.931+0000 7f41a072b8c0 1 < suggested remove operation key=58IT2R988AW9 tag=U4PELU8WRWDJ type=write 2024-09-12T18:33:03.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.935+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=MVSPW9IRV06I type=write size=827491 2024-09-12T18:33:03.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.935+0000 7f41a072b8c0 1 < completed delete operation key=3R9RN03RFRJP tag=TFPTEDZOLTL9 type=del 2024-09-12T18:33:03.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.939+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=Z8E2V2ZT7NC7 type=del size=2799310 2024-09-12T18:33:03.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.943+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~KBAHRW05UQB0.0 size=1019557 2024-09-12T18:33:03.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.947+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=KBAHRW05UQB0 tag=UL5EQTA3IOV3 type=write size=2068133 2024-09-12T18:33:03.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.951+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~COJU6ZLANIQK.0 size=1048576 2024-09-12T18:33:03.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.951+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~COJU6ZLANIQK.1 size=671168 2024-09-12T18:33:03.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.951+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=COJU6ZLANIQK tag=QGULC6CU90GL type=write size=2768320 2024-09-12T18:33:03.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.955+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~0775UEAK5TWB.0 size=1048576 2024-09-12T18:33:03.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.955+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~0775UEAK5TWB.1 size=704868 2024-09-12T18:33:03.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.959+0000 7f41a072b8c0 1 < completed multipart upload key=L01GL4WOUIL2 upload=0775UEAK5TWB tag=V934I8DTQRV4 type=write size=2802020 2024-09-12T18:33:03.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.963+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=PMZHYANO4KSI type=del size=560686 2024-09-12T18:33:03.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.963+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=5HY0DWPTNY6R type=del 2024-09-12T18:33:03.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.967+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~5784VDQAVCFM.0 size=175141 2024-09-12T18:33:03.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.967+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=5784VDQAVCFM tag=9947JHQPR9B6 type=write size=1223717 2024-09-12T18:33:03.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.971+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~QXTNYLM2HGSS.0 size=395025 2024-09-12T18:33:03.975 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.975+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=QXTNYLM2HGSS tag=THOOKM3528XV type=write size=1443601 2024-09-12T18:33:03.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.975+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=X1KU99A839TX type=del size=2539204 2024-09-12T18:33:03.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.979+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=RM0VQMFJ0TOQ type=del 2024-09-12T18:33:03.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.983+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~RLFKY9ZBQAV5.0 size=1048576 2024-09-12T18:33:03.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.987+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~RLFKY9ZBQAV5.1 size=181993 2024-09-12T18:33:03.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.987+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=RLFKY9ZBQAV5 tag=1RPRWG7FGOA0 type=write size=2279145 2024-09-12T18:33:03.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.987+0000 7f41a072b8c0 1 < completed write operation key=31T6AP6MUBKL tag=EZ3CUCLOWKJ1 type=write size=567626 2024-09-12T18:33:03.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.991+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=MS9NDMGT2J44 type=write size=126202 2024-09-12T18:33:03.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.991+0000 7f41a072b8c0 1 < completed write operation key=31T6AP6MUBKL tag=ZTZQK5DKU2PQ type=write size=368529 2024-09-12T18:33:03.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.995+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=6BSTEHVZ9MGJ type=del size=2257935 2024-09-12T18:33:03.998 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.999+0000 7f41a072b8c0 1 < canceled operation key=GC8797KSO47E tag=WXR41CTFPWFR type=del size=2887484 2024-09-12T18:33:04.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:03.999+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=HWUJHO1WB8AO type=del size=76292 2024-09-12T18:33:04.005 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.003+0000 7f41a072b8c0 1 < suggested update operation key=V35A7LK08C7J tag=LXY9FVNI3PRU type=del size=3090966 2024-09-12T18:33:04.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.007+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=5CPSIPA728HZ type=write size=453265 2024-09-12T18:33:04.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.011+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~90M23DZJ4A49.0 size=1048576 2024-09-12T18:33:04.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.011+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~90M23DZJ4A49.1 size=1048576 2024-09-12T18:33:04.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.015+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~90M23DZJ4A49.2 size=773553 2024-09-12T18:33:04.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.019+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=90M23DZJ4A49 tag=FXWVZE0AT8SV type=write size=3919281 2024-09-12T18:33:04.021 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.019+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=2RN8W4DP0TE4 type=del size=2612170 2024-09-12T18:33:04.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.023+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=BCC53HT2XD1C type=del 2024-09-12T18:33:04.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.027+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~HCRWRJTTITMC.0 size=1048576 2024-09-12T18:33:04.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.031+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~HCRWRJTTITMC.1 size=1048576 2024-09-12T18:33:04.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.031+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~HCRWRJTTITMC.2 size=989014 2024-09-12T18:33:04.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.031+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=HCRWRJTTITMC tag=1FUY8MQHW27C type=write size=4134742 2024-09-12T18:33:04.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.035+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~36VAH9L7U48R.0 size=359579 2024-09-12T18:33:04.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.039+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=36VAH9L7U48R tag=LENMRHXLOV2B type=write size=1408155 2024-09-12T18:33:04.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.039+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=JWFY80THZMG4 type=del size=4032588 2024-09-12T18:33:04.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.043+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=2GY83KANKG3H type=del 2024-09-12T18:33:04.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.051+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~S0OMOEJVR4VU.0 size=1048576 2024-09-12T18:33:04.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.051+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~S0OMOEJVR4VU.1 size=343778 2024-09-12T18:33:04.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.051+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=S0OMOEJVR4VU tag=RVAKT0I268NW type=write size=2440930 2024-09-12T18:33:04.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.055+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=RKKYNIQRDZ0R type=del 2024-09-12T18:33:04.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.059+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=8KDPQEORVXFJ type=del size=2048183 2024-09-12T18:33:04.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.063+0000 7f41a072b8c0 1 < suggested remove operation key=7MRN7L1DTAMO tag=MVSPW9IRV06I type=write 2024-09-12T18:33:04.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.067+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~A7VGD3E2MKYB.0 size=1048576 2024-09-12T18:33:04.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.071+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~A7VGD3E2MKYB.1 size=1048576 2024-09-12T18:33:04.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.075+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~A7VGD3E2MKYB.2 size=659199 2024-09-12T18:33:04.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.075+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=A7VGD3E2MKYB tag=E77VN1ARW9RP type=write size=3804927 2024-09-12T18:33:04.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.075+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=Z8E2V2ZT7NC7 type=del 2024-09-12T18:33:04.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.079+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=JTWMU43AHJW7 type=del size=1183004 2024-09-12T18:33:04.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.083+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~COJU6ZLANIQK.0 size=1048576 2024-09-12T18:33:04.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.083+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~COJU6ZLANIQK.1 size=671168 2024-09-12T18:33:04.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.087+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=COJU6ZLANIQK tag=QGULC6CU90GL type=write size=2768320 2024-09-12T18:33:04.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.091+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=IQ70U7BUYFM8 type=del size=473739 2024-09-12T18:33:04.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.091+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=PMZHYANO4KSI type=del 2024-09-12T18:33:04.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.095+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~G7BLK9ULDDOQ.0 size=1048576 2024-09-12T18:33:04.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.099+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~G7BLK9ULDDOQ.1 size=292466 2024-09-12T18:33:04.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.099+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=G7BLK9ULDDOQ tag=69K5YKQ1USYP type=write size=2389618 2024-09-12T18:33:04.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.103+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~5784VDQAVCFM.0 size=175141 2024-09-12T18:33:04.106 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.107+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=5784VDQAVCFM tag=9947JHQPR9B6 type=write size=1223717 2024-09-12T18:33:04.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.111+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~PYODE7F1SUUT.0 size=1026021 2024-09-12T18:33:04.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.111+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=PYODE7F1SUUT tag=YGJ0AEPZQSJL type=write size=2074597 2024-09-12T18:33:04.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.111+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=X1KU99A839TX type=del 2024-09-12T18:33:04.117 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.115+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=2RS2BJZ3SDG3 type=del size=1776441 2024-09-12T18:33:04.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.119+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~RLFKY9ZBQAV5.0 size=1048576 2024-09-12T18:33:04.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.119+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~RLFKY9ZBQAV5.1 size=181993 2024-09-12T18:33:04.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.123+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=RLFKY9ZBQAV5 tag=1RPRWG7FGOA0 type=write size=2279145 2024-09-12T18:33:04.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.127+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=PISZ7LTB1WMT type=del size=2173927 2024-09-12T18:33:04.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.131+0000 7f41a072b8c0 1 < suggested update operation key=VEN0P2P1RZ2S tag=MS9NDMGT2J44 type=write size=126202 2024-09-12T18:33:04.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.135+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~SIVJ1P6BKKF4.0 size=1048576 2024-09-12T18:33:04.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.139+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~SIVJ1P6BKKF4.1 size=68069 2024-09-12T18:33:04.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.139+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=SIVJ1P6BKKF4 tag=QHDYPP0HDISN type=write size=2165221 2024-09-12T18:33:04.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.143+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=6BSTEHVZ9MGJ type=del 2024-09-12T18:33:04.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.143+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=1WBQ4B470S94 type=del size=2959464 2024-09-12T18:33:04.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.147+0000 7f41a072b8c0 -1 < failed to complete operation key=VEN0P2P1RZ2S tag=HWUJHO1WB8AO type=del size=76292: (22) Invalid argument 2024-09-12T18:33:04.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.151+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~EMPRNWNBVT3M.0 size=1048576 2024-09-12T18:33:04.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.155+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~EMPRNWNBVT3M.1 size=837467 2024-09-12T18:33:04.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.155+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=EMPRNWNBVT3M tag=TLQ1GMI6RJEA type=write size=2934619 2024-09-12T18:33:04.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.155+0000 7f41a072b8c0 1 < completed write operation key=C2PRRD3QO9AF tag=5CPSIPA728HZ type=write size=453265 2024-09-12T18:33:04.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.159+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=4MPLRZE4TIQ2 type=write size=127049 2024-09-12T18:33:04.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.163+0000 7f41a072b8c0 1 < suggested update operation key=GC8797KSO47E tag=2RN8W4DP0TE4 type=del size=2612170 2024-09-12T18:33:04.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.167+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=9ETQY9S773W4 type=del size=342445 2024-09-12T18:33:04.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.171+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~HCRWRJTTITMC.0 size=1048576 2024-09-12T18:33:04.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.171+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~HCRWRJTTITMC.1 size=1048576 2024-09-12T18:33:04.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.175+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~HCRWRJTTITMC.2 size=989014 2024-09-12T18:33:04.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.179+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=HCRWRJTTITMC tag=1FUY8MQHW27C type=write size=4134742 2024-09-12T18:33:04.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.179+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=311J52KVM0IX type=write size=938357 2024-09-12T18:33:04.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.183+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=JWFY80THZMG4 type=del 2024-09-12T18:33:04.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.187+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~AITOTWAZ472M.0 size=1048576 2024-09-12T18:33:04.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.191+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~AITOTWAZ472M.1 size=1048576 2024-09-12T18:33:04.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.191+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~AITOTWAZ472M.2 size=372310 2024-09-12T18:33:04.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.191+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=AITOTWAZ472M tag=18ZK1LDJTLCX type=write size=3518038 2024-09-12T18:33:04.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.195+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~S0OMOEJVR4VU.0 size=1048576 2024-09-12T18:33:04.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.195+0000 7f41a072b8c0 1 < canceled part key=_multipart_3R9RN03RFRJP.2~S0OMOEJVR4VU.1 size=343778 2024-09-12T18:33:04.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.199+0000 7f41a072b8c0 1 < canceled multipart upload key=3R9RN03RFRJP upload=S0OMOEJVR4VU tag=RVAKT0I268NW type=write size=2440930 2024-09-12T18:33:04.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.199+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=HXLZD1GMG713 type=del size=3283632 2024-09-12T18:33:04.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.203+0000 7f41a072b8c0 1 < suggested update operation key=GC8797KSO47E tag=8KDPQEORVXFJ type=del size=2048183 2024-09-12T18:33:04.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.207+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~4J7JR6LKXZP5.0 size=1048576 2024-09-12T18:33:04.212 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.211+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~4J7JR6LKXZP5.1 size=1048576 2024-09-12T18:33:04.213 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.211+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~4J7JR6LKXZP5.2 size=485859 2024-09-12T18:33:04.214 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.211+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=4J7JR6LKXZP5 tag=DBAAGKMNGP0R type=write size=3631587 2024-09-12T18:33:04.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.215+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~A7VGD3E2MKYB.0 size=1048576 2024-09-12T18:33:04.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.219+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~A7VGD3E2MKYB.1 size=1048576 2024-09-12T18:33:04.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.219+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~A7VGD3E2MKYB.2 size=659199 2024-09-12T18:33:04.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.223+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=A7VGD3E2MKYB tag=E77VN1ARW9RP type=write size=3804927 2024-09-12T18:33:04.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.227+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=CTQMOAP0WH2I type=write size=662804 2024-09-12T18:33:04.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.227+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=JTWMU43AHJW7 type=del 2024-09-12T18:33:04.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.231+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=MH0SSZTCBZTB type=del size=2823936 2024-09-12T18:33:04.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.235+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=IQ70U7BUYFM8 type=del 2024-09-12T18:33:04.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.235+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=PLXJVL460155 type=del size=1233027 2024-09-12T18:33:04.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.239+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~G7BLK9ULDDOQ.0 size=1048576 2024-09-12T18:33:04.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.239+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~G7BLK9ULDDOQ.1 size=292466 2024-09-12T18:33:04.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.247+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=G7BLK9ULDDOQ tag=69K5YKQ1USYP type=write size=2389618 2024-09-12T18:33:04.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.247+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=I6FJT45B2IRU type=del size=433229 2024-09-12T18:33:04.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.251+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~PYODE7F1SUUT.0 size=1026021 2024-09-12T18:33:04.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.255+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=PYODE7F1SUUT tag=YGJ0AEPZQSJL type=write size=2074597 2024-09-12T18:33:04.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.255+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=781UM9L855R1 type=write size=606792 2024-09-12T18:33:04.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.259+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=2RS2BJZ3SDG3 type=del 2024-09-12T18:33:04.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.263+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~563AQ4A9HI35.0 size=1048576 2024-09-12T18:33:04.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.267+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~563AQ4A9HI35.1 size=753340 2024-09-12T18:33:04.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.267+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=563AQ4A9HI35 tag=6EIQ02664GG1 type=write size=2850492 2024-09-12T18:33:04.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.267+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=PISZ7LTB1WMT type=del 2024-09-12T18:33:04.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.275+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~LNZE8ECCZYYC.0 size=1048576 2024-09-12T18:33:04.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.275+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~LNZE8ECCZYYC.1 size=930592 2024-09-12T18:33:04.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.275+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=LNZE8ECCZYYC tag=4LYY5KWY7GZK type=write size=3027744 2024-09-12T18:33:04.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.279+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~SIVJ1P6BKKF4.0 size=1048576 2024-09-12T18:33:04.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.279+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~SIVJ1P6BKKF4.1 size=68069 2024-09-12T18:33:04.290 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.291+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=SIVJ1P6BKKF4 tag=QHDYPP0HDISN type=write size=2165221 2024-09-12T18:33:04.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.295+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~Z60AXMREQ4L8.0 size=1048576 2024-09-12T18:33:04.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.295+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~Z60AXMREQ4L8.1 size=1048576 2024-09-12T18:33:04.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.299+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~Z60AXMREQ4L8.2 size=158868 2024-09-12T18:33:04.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.299+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=Z60AXMREQ4L8 tag=4EJS9U2VXOIH type=write size=3304596 2024-09-12T18:33:04.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.299+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=1WBQ4B470S94 type=del 2024-09-12T18:33:04.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.303+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=CS7FAJ1F44BJ type=del size=3648463 2024-09-12T18:33:04.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.307+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~EMPRNWNBVT3M.0 size=1048576 2024-09-12T18:33:04.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.307+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~EMPRNWNBVT3M.1 size=837467 2024-09-12T18:33:04.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.311+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=EMPRNWNBVT3M tag=TLQ1GMI6RJEA type=write size=2934619 2024-09-12T18:33:04.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.315+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=KYQL4BLNBQ92 type=del size=2570681 2024-09-12T18:33:04.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.315+0000 7f41a072b8c0 1 < completed write operation key=1BSAN5TRTZNZ tag=4MPLRZE4TIQ2 type=write size=127049 2024-09-12T18:33:04.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.319+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=7USVGO8O8WHR type=del size=712548 2024-09-12T18:33:04.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.319+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=9ETQY9S773W4 type=del 2024-09-12T18:33:04.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.323+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~YJ7Y9GD5SXYV.0 size=1048576 2024-09-12T18:33:04.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.327+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~YJ7Y9GD5SXYV.1 size=1048576 2024-09-12T18:33:04.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.327+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~YJ7Y9GD5SXYV.2 size=768553 2024-09-12T18:33:04.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.327+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=YJ7Y9GD5SXYV tag=D4CNB1CT580K type=write size=3914281 2024-09-12T18:33:04.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.331+0000 7f41a072b8c0 1 < suggested remove operation key=A6GQZL25YSNL tag=311J52KVM0IX type=write 2024-09-12T18:33:04.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.335+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=MXYTO8EV4Y5U type=del size=626647 2024-09-12T18:33:04.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.335+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~AITOTWAZ472M.0 size=1048576 2024-09-12T18:33:04.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.339+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~AITOTWAZ472M.1 size=1048576 2024-09-12T18:33:04.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.339+0000 7f41a072b8c0 1 < canceled part key=_multipart_58IT2R988AW9.2~AITOTWAZ472M.2 size=372310 2024-09-12T18:33:04.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.343+0000 7f41a072b8c0 1 < canceled multipart upload key=58IT2R988AW9 upload=AITOTWAZ472M tag=18ZK1LDJTLCX type=write size=3518038 2024-09-12T18:33:04.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.347+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=DSLJYQFK0YBQ type=del size=438827 2024-09-12T18:33:04.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.351+0000 7f41a072b8c0 -1 < failed to complete operation key=A6GQZL25YSNL tag=HXLZD1GMG713 type=del size=3283632: (22) Invalid argument 2024-09-12T18:33:04.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.355+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=LO0UQ2AWL4J2 type=del size=1093719 2024-09-12T18:33:04.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.355+0000 7f41a072b8c0 1 < canceled part key=_multipart_3R9RN03RFRJP.2~4J7JR6LKXZP5.0 size=1048576 2024-09-12T18:33:04.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.355+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~4J7JR6LKXZP5.1 size=1048576 2024-09-12T18:33:04.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.359+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~4J7JR6LKXZP5.2 size=485859 2024-09-12T18:33:04.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.363+0000 7f41a072b8c0 1 < canceled multipart upload key=3R9RN03RFRJP upload=4J7JR6LKXZP5 tag=DBAAGKMNGP0R type=write size=3631587 2024-09-12T18:33:04.369 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.367+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~8IL20EPJUCM5.0 size=1048576 2024-09-12T18:33:04.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.371+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~8IL20EPJUCM5.1 size=106033 2024-09-12T18:33:04.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.371+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=8IL20EPJUCM5 tag=NWYAJ2JNTO7R type=write size=2203185 2024-09-12T18:33:04.377 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.375+0000 7f41a072b8c0 1 < suggested update operation key=3R9RN03RFRJP tag=CTQMOAP0WH2I type=write size=662804 2024-09-12T18:33:04.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.379+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=XLO2P61RS601 type=del size=1543024 2024-09-12T18:33:04.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.383+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=MH0SSZTCBZTB type=del 2024-09-12T18:33:04.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.383+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=5B4BHRKD65Q7 type=del size=2395631 2024-09-12T18:33:04.388 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.387+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=PLXJVL460155 type=del 2024-09-12T18:33:04.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.391+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~XDO5W2DOCBE3.0 size=1048576 2024-09-12T18:33:04.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.395+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~XDO5W2DOCBE3.1 size=752092 2024-09-12T18:33:04.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.395+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=XDO5W2DOCBE3 tag=7TME90TAGJ5V type=write size=2849244 2024-09-12T18:33:04.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.399+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=I6FJT45B2IRU type=del 2024-09-12T18:33:04.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.399+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=5JWGS95A23IY type=del size=465212 2024-09-12T18:33:04.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.403+0000 7f41a072b8c0 1 < completed write operation key=3CGBX19WTMWQ tag=781UM9L855R1 type=write size=606792 2024-09-12T18:33:04.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.407+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=MR052XXU51NK type=del size=3584977 2024-09-12T18:33:04.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.411+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~563AQ4A9HI35.0 size=1048576 2024-09-12T18:33:04.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.411+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~563AQ4A9HI35.1 size=753340 2024-09-12T18:33:04.418 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.419+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=563AQ4A9HI35 tag=6EIQ02664GG1 type=write size=2850492 2024-09-12T18:33:04.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.419+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=380HFLXVHC66 type=del size=638036 2024-09-12T18:33:04.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.423+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~LNZE8ECCZYYC.0 size=1048576 2024-09-12T18:33:04.427 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.427+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~LNZE8ECCZYYC.1 size=930592 2024-09-12T18:33:04.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.431+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=LNZE8ECCZYYC tag=4LYY5KWY7GZK type=write size=3027744 2024-09-12T18:33:04.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.435+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=M4H3507B0DGM type=del size=1657632 2024-09-12T18:33:04.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.439+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~Z60AXMREQ4L8.0 size=1048576 2024-09-12T18:33:04.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.439+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~Z60AXMREQ4L8.1 size=1048576 2024-09-12T18:33:04.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.443+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~Z60AXMREQ4L8.2 size=158868 2024-09-12T18:33:04.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.447+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=Z60AXMREQ4L8 tag=4EJS9U2VXOIH type=write size=3304596 2024-09-12T18:33:04.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.451+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=HK358DQ99KG2 type=write size=221894 2024-09-12T18:33:04.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.455+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=CS7FAJ1F44BJ type=del 2024-09-12T18:33:04.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.459+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~G1D7FDQGI50Y.0 size=1048576 2024-09-12T18:33:04.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.463+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~G1D7FDQGI50Y.1 size=650448 2024-09-12T18:33:04.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.463+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=G1D7FDQGI50Y tag=PM94A20J3YDD type=write size=2747600 2024-09-12T18:33:04.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.463+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=KYQL4BLNBQ92 type=del 2024-09-12T18:33:04.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.467+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=MCL934UPZH63 type=del size=3327859 2024-09-12T18:33:04.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.471+0000 7f41a072b8c0 -1 < failed to complete operation key=A6GQZL25YSNL tag=7USVGO8O8WHR type=del size=712548: (22) Invalid argument 2024-09-12T18:33:04.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.475+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=ZSHSKAS49P87 type=del size=833316 2024-09-12T18:33:04.478 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.479+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~YJ7Y9GD5SXYV.0 size=1048576 2024-09-12T18:33:04.481 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.479+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~YJ7Y9GD5SXYV.1 size=1048576 2024-09-12T18:33:04.481 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.479+0000 7f41a072b8c0 1 < canceled part key=_multipart_C2PRRD3QO9AF.2~YJ7Y9GD5SXYV.2 size=768553 2024-09-12T18:33:04.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.483+0000 7f41a072b8c0 1 < canceled multipart upload key=C2PRRD3QO9AF upload=YJ7Y9GD5SXYV tag=D4CNB1CT580K type=write size=3914281 2024-09-12T18:33:04.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.487+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=Y7GXSNE9OX3K type=del size=3353663 2024-09-12T18:33:04.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.495+0000 7f41a072b8c0 1 < suggested remove operation key=YCBC1CHWJQC5 tag=MXYTO8EV4Y5U type=del 2024-09-12T18:33:04.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.495+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=9JGJIEB780XF type=del size=1623506 2024-09-12T18:33:04.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.499+0000 7f41a072b8c0 1 < completed delete operation key=YP72VTCGSHYE tag=DSLJYQFK0YBQ type=del 2024-09-12T18:33:04.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~WI426S1QZ0T3.0 size=1048576 2024-09-12T18:33:04.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~WI426S1QZ0T3.1 size=1041034 2024-09-12T18:33:04.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.507+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=WI426S1QZ0T3 tag=J7V5N8BRTPPS type=write size=3138186 2024-09-12T18:33:04.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.511+0000 7f41a072b8c0 -1 < failed to complete operation key=3R9RN03RFRJP tag=LO0UQ2AWL4J2 type=del size=1093719: (22) Invalid argument 2024-09-12T18:33:04.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.515+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=493H37O2XSG2 type=write size=806461 2024-09-12T18:33:04.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.519+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~8IL20EPJUCM5.0 size=1048576 2024-09-12T18:33:04.522 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.519+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~8IL20EPJUCM5.1 size=106033 2024-09-12T18:33:04.527 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.527+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=8IL20EPJUCM5 tag=NWYAJ2JNTO7R type=write size=2203185 2024-09-12T18:33:04.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.531+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=VU365NW2NMTS type=write size=414371 2024-09-12T18:33:04.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.535+0000 7f41a072b8c0 1 < suggested update operation key=L1VC63PK1R2Y tag=XLO2P61RS601 type=del size=1543024 2024-09-12T18:33:04.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.539+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=C2DJS8UL1PP7 type=del size=2364087 2024-09-12T18:33:04.543 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.543+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=5B4BHRKD65Q7 type=del 2024-09-12T18:33:04.547 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.547+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=GV2Z3SHXO1L1 type=del size=2620472 2024-09-12T18:33:04.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.551+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~XDO5W2DOCBE3.0 size=1048576 2024-09-12T18:33:04.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.551+0000 7f41a072b8c0 1 < canceled part key=_multipart_7B70QWGMH0C0.2~XDO5W2DOCBE3.1 size=752092 2024-09-12T18:33:04.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.555+0000 7f41a072b8c0 1 < canceled multipart upload key=7B70QWGMH0C0 upload=XDO5W2DOCBE3 tag=7TME90TAGJ5V type=write size=2849244 2024-09-12T18:33:04.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.563+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=YQA3SYACAFC5 type=del size=3976946 2024-09-12T18:33:04.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.567+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=5JWGS95A23IY type=del 2024-09-12T18:33:04.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.571+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=RTBKE8LN1XV6 type=del size=2357274 2024-09-12T18:33:04.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.575+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=MR052XXU51NK type=del 2024-09-12T18:33:04.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.579+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=PB6H9RA34TFX type=del size=637559 2024-09-12T18:33:04.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.583+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=380HFLXVHC66 type=del 2024-09-12T18:33:04.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.587+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=5L8DNTM3S2KI type=write size=567689 2024-09-12T18:33:04.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.591+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=M4H3507B0DGM type=del 2024-09-12T18:33:04.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.591+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=DX2VZQLJOJKC type=del size=1854715 2024-09-12T18:33:04.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.595+0000 7f41a072b8c0 1 < completed write operation key=1BSAN5TRTZNZ tag=HK358DQ99KG2 type=write size=221894 2024-09-12T18:33:04.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.603+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~16FRGEPOUDFW.0 size=47947 2024-09-12T18:33:04.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.603+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=16FRGEPOUDFW tag=VK8XLSKL0YBU type=write size=1096523 2024-09-12T18:33:04.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.607+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~G1D7FDQGI50Y.0 size=1048576 2024-09-12T18:33:04.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.607+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~G1D7FDQGI50Y.1 size=650448 2024-09-12T18:33:04.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.615+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=G1D7FDQGI50Y tag=PM94A20J3YDD type=write size=2747600 2024-09-12T18:33:04.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.619+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=BNWFIQOKR5QL type=write size=598127 2024-09-12T18:33:04.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.619+0000 7f41a072b8c0 1 < canceled operation key=VEN0P2P1RZ2S tag=MCL934UPZH63 type=del size=3327859 2024-09-12T18:33:04.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.627+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~JTQQCBWM7FU4.0 size=683694 2024-09-12T18:33:04.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.627+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=JTQQCBWM7FU4 tag=0XRS92GDUR31 type=write size=1732270 2024-09-12T18:33:04.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.631+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=ZSHSKAS49P87 type=del 2024-09-12T18:33:04.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.635+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~UV1JUGMUVQF7.0 size=1048576 2024-09-12T18:33:04.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.639+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~UV1JUGMUVQF7.1 size=1048576 2024-09-12T18:33:04.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.643+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~UV1JUGMUVQF7.2 size=670304 2024-09-12T18:33:04.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.643+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=UV1JUGMUVQF7 tag=NWI4PBKN2MM2 type=write size=3816032 2024-09-12T18:33:04.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.643+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=Y7GXSNE9OX3K type=del 2024-09-12T18:33:04.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.651+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~WAHO1BZ1BWS1.0 size=644245 2024-09-12T18:33:04.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.651+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=WAHO1BZ1BWS1 tag=VYPD5MGQ17WR type=write size=1692821 2024-09-12T18:33:04.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.655+0000 7f41a072b8c0 -1 < failed to complete operation key=L1VC63PK1R2Y tag=9JGJIEB780XF type=del size=1623506: (22) Invalid argument 2024-09-12T18:33:04.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.659+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=XA2TKYGW2732 type=write size=562387 2024-09-12T18:33:04.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.659+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~WI426S1QZ0T3.0 size=1048576 2024-09-12T18:33:04.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.659+0000 7f41a072b8c0 1 < canceled part key=_multipart_NKMA8FG3V3TR.2~WI426S1QZ0T3.1 size=1041034 2024-09-12T18:33:04.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.667+0000 7f41a072b8c0 1 < canceled multipart upload key=NKMA8FG3V3TR upload=WI426S1QZ0T3 tag=J7V5N8BRTPPS type=write size=3138186 2024-09-12T18:33:04.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.675+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~2RJ35O8HOW04.0 size=1048576 2024-09-12T18:33:04.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.675+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~2RJ35O8HOW04.1 size=1048576 2024-09-12T18:33:04.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.679+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~2RJ35O8HOW04.2 size=467319 2024-09-12T18:33:04.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.679+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=2RJ35O8HOW04 tag=CD55WY2J1G6R type=write size=3613047 2024-09-12T18:33:04.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.683+0000 7f41a072b8c0 1 < completed write operation key=5JUWC8RXSA5L tag=493H37O2XSG2 type=write size=806461 2024-09-12T18:33:04.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.687+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=YOLCBRJHXXI9 type=del size=1875339 2024-09-12T18:33:04.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.691+0000 7f41a072b8c0 1 < completed write operation key=XLGVEN6DF5EW tag=VU365NW2NMTS type=write size=414371 2024-09-12T18:33:04.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.695+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=U163OJO5CD9W type=del size=2094514 2024-09-12T18:33:04.700 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.699+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=C2DJS8UL1PP7 type=del 2024-09-12T18:33:04.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.707+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~IVGKXU627K16.0 size=1048576 2024-09-12T18:33:04.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.707+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~IVGKXU627K16.1 size=1048576 2024-09-12T18:33:04.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.711+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~IVGKXU627K16.2 size=94736 2024-09-12T18:33:04.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.711+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=IVGKXU627K16 tag=4RLL3998NIIH type=write size=3240464 2024-09-12T18:33:04.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.715+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=GV2Z3SHXO1L1 type=del 2024-09-12T18:33:04.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.719+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=8LPOTZ3T46K6 type=write size=674938 2024-09-12T18:33:04.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.727+0000 7f41a072b8c0 1 < suggested remove operation key=YP72VTCGSHYE tag=YQA3SYACAFC5 type=del 2024-09-12T18:33:04.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.731+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~WRJ2UDHYTY1C.0 size=1048576 2024-09-12T18:33:04.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.735+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~WRJ2UDHYTY1C.1 size=1048576 2024-09-12T18:33:04.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.739+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~WRJ2UDHYTY1C.2 size=686652 2024-09-12T18:33:04.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.739+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=WRJ2UDHYTY1C tag=R6UUMCJSDAZH type=write size=3832380 2024-09-12T18:33:04.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.743+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=RTBKE8LN1XV6 type=del 2024-09-12T18:33:04.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.747+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~6D05Z6JUFU9B.0 size=1048576 2024-09-12T18:33:04.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.751+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~6D05Z6JUFU9B.1 size=508853 2024-09-12T18:33:04.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.751+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=6D05Z6JUFU9B tag=4IZ2LMJEP23I type=write size=2606005 2024-09-12T18:33:04.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.759+0000 7f41a072b8c0 1 < suggested update operation key=5OD9IX408CYO tag=PB6H9RA34TFX type=del size=637559 2024-09-12T18:33:04.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.763+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=R91CD6YDR2LO type=del size=2370410 2024-09-12T18:33:04.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.767+0000 7f41a072b8c0 1 < completed write operation key=P732C5X0RG8Z tag=5L8DNTM3S2KI type=write size=567689 2024-09-12T18:33:04.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.775+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~YTMGVIZUDCEJ.0 size=1048576 2024-09-12T18:33:04.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.775+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~YTMGVIZUDCEJ.1 size=701918 2024-09-12T18:33:04.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.775+0000 7f41a072b8c0 1 > prepared multipart upload key=VEN0P2P1RZ2S upload=YTMGVIZUDCEJ tag=8KZCDVFBDA00 type=write size=2799070 2024-09-12T18:33:04.785 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.783+0000 7f41a072b8c0 1 < suggested remove operation key=7MRN7L1DTAMO tag=DX2VZQLJOJKC type=del 2024-09-12T18:33:04.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.791+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~QHX73UYN1GZP.0 size=1048576 2024-09-12T18:33:04.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.795+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~QHX73UYN1GZP.1 size=817031 2024-09-12T18:33:04.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.795+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=QHX73UYN1GZP tag=7RGP8DAMJX1U type=write size=2914183 2024-09-12T18:33:04.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.799+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~16FRGEPOUDFW.0 size=47947 2024-09-12T18:33:04.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.803+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=16FRGEPOUDFW tag=VK8XLSKL0YBU type=write size=1096523 2024-09-12T18:33:04.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.807+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=6XD6IPQWF683 type=del size=301897 2024-09-12T18:33:04.812 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.811+0000 7f41a072b8c0 1 < completed write operation key=KP2HF4J376EY tag=BNWFIQOKR5QL type=write size=598127 2024-09-12T18:33:04.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.815+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=BVGWF6ZNOY5X type=write size=693774 2024-09-12T18:33:04.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.819+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~JTQQCBWM7FU4.0 size=683694 2024-09-12T18:33:04.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.823+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=JTQQCBWM7FU4 tag=0XRS92GDUR31 type=write size=1732270 2024-09-12T18:33:04.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.831+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~09LQ1CBI0XLQ.0 size=673676 2024-09-12T18:33:04.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.831+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=09LQ1CBI0XLQ tag=43V89OOI76QY type=write size=1722252 2024-09-12T18:33:04.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.831+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~UV1JUGMUVQF7.0 size=1048576 2024-09-12T18:33:04.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.835+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~UV1JUGMUVQF7.1 size=1048576 2024-09-12T18:33:04.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.839+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~UV1JUGMUVQF7.2 size=670304 2024-09-12T18:33:04.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.843+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=UV1JUGMUVQF7 tag=NWI4PBKN2MM2 type=write size=3816032 2024-09-12T18:33:04.848 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.847+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=MX58YK71Z7UM type=del size=2372654 2024-09-12T18:33:04.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.851+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~WAHO1BZ1BWS1.0 size=644245 2024-09-12T18:33:04.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.855+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=WAHO1BZ1BWS1 tag=VYPD5MGQ17WR type=write size=1692821 2024-09-12T18:33:04.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.859+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=LNTR2LP50M7K type=del size=2674485 2024-09-12T18:33:04.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.863+0000 7f41a072b8c0 1 < completed write operation key=58IT2R988AW9 tag=XA2TKYGW2732 type=write size=562387 2024-09-12T18:33:04.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.867+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=B5NLJYRF3T46 type=write size=725892 2024-09-12T18:33:04.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.867+0000 7f41a072b8c0 1 < canceled part key=_multipart_V35A7LK08C7J.2~2RJ35O8HOW04.0 size=1048576 2024-09-12T18:33:04.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.871+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~2RJ35O8HOW04.1 size=1048576 2024-09-12T18:33:04.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.871+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~2RJ35O8HOW04.2 size=467319 2024-09-12T18:33:04.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.879+0000 7f41a072b8c0 1 < canceled multipart upload key=V35A7LK08C7J upload=2RJ35O8HOW04 tag=CD55WY2J1G6R type=write size=3613047 2024-09-12T18:33:04.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.883+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~Y3IZUBC34UBN.0 size=1048576 2024-09-12T18:33:04.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.887+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~Y3IZUBC34UBN.1 size=1048576 2024-09-12T18:33:04.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.891+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~Y3IZUBC34UBN.2 size=377123 2024-09-12T18:33:04.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.891+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=Y3IZUBC34UBN tag=WO6H3V98DJSB type=write size=3522851 2024-09-12T18:33:04.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.895+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=YOLCBRJHXXI9 type=del 2024-09-12T18:33:04.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.899+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=QRNUCTAF945H type=write size=157555 2024-09-12T18:33:04.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.903+0000 7f41a072b8c0 1 < suggested update operation key=ZACT36ZOC9ES tag=U163OJO5CD9W type=del size=2094514 2024-09-12T18:33:04.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.907+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=XHQ4VGWW4LZK type=del size=1715495 2024-09-12T18:33:04.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.911+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~IVGKXU627K16.0 size=1048576 2024-09-12T18:33:04.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.915+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~IVGKXU627K16.1 size=1048576 2024-09-12T18:33:04.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.915+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~IVGKXU627K16.2 size=94736 2024-09-12T18:33:04.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.923+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=IVGKXU627K16 tag=4RLL3998NIIH type=write size=3240464 2024-09-12T18:33:04.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.923+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=690V00O7GHGO type=del size=989677 2024-09-12T18:33:04.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.927+0000 7f41a072b8c0 1 < completed write operation key=1BSAN5TRTZNZ tag=8LPOTZ3T46K6 type=write size=674938 2024-09-12T18:33:04.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.931+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=44AS4TZZU9SR type=del size=3176965 2024-09-12T18:33:04.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.935+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~WRJ2UDHYTY1C.0 size=1048576 2024-09-12T18:33:04.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.935+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~WRJ2UDHYTY1C.1 size=1048576 2024-09-12T18:33:04.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.939+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~WRJ2UDHYTY1C.2 size=686652 2024-09-12T18:33:04.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.943+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=WRJ2UDHYTY1C tag=R6UUMCJSDAZH type=write size=3832380 2024-09-12T18:33:04.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.947+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=DCBNFVQRW0BL type=del size=3961581 2024-09-12T18:33:04.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.951+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~6D05Z6JUFU9B.0 size=1048576 2024-09-12T18:33:04.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.951+0000 7f41a072b8c0 1 < canceled part key=_multipart_P732C5X0RG8Z.2~6D05Z6JUFU9B.1 size=508853 2024-09-12T18:33:04.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.955+0000 7f41a072b8c0 1 < canceled multipart upload key=P732C5X0RG8Z upload=6D05Z6JUFU9B tag=4IZ2LMJEP23I type=write size=2606005 2024-09-12T18:33:04.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.959+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=VDV3N32IHXMK type=del size=3774964 2024-09-12T18:33:04.967 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.967+0000 7f41a072b8c0 1 < suggested update operation key=GQHPUDV5BG1E tag=R91CD6YDR2LO type=del size=2370410 2024-09-12T18:33:04.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.971+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~LDAK561YTJO4.0 size=211456 2024-09-12T18:33:04.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.971+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=LDAK561YTJO4 tag=9AN1IRFUDKUO type=write size=1260032 2024-09-12T18:33:04.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.975+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~YTMGVIZUDCEJ.0 size=1048576 2024-09-12T18:33:04.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.979+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~YTMGVIZUDCEJ.1 size=701918 2024-09-12T18:33:04.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.983+0000 7f41a072b8c0 1 < completed multipart upload key=VEN0P2P1RZ2S upload=YTMGVIZUDCEJ tag=8KZCDVFBDA00 type=write size=2799070 2024-09-12T18:33:04.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.987+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=O7CHDELJOSEL type=write size=147587 2024-09-12T18:33:04.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.991+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~QHX73UYN1GZP.0 size=1048576 2024-09-12T18:33:04.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.995+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~QHX73UYN1GZP.1 size=817031 2024-09-12T18:33:05.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:04.999+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=QHX73UYN1GZP tag=7RGP8DAMJX1U type=write size=2914183 2024-09-12T18:33:05.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.003+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=VPLVP3Y65K3Z type=del size=2116186 2024-09-12T18:33:05.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.011+0000 7f41a072b8c0 1 < suggested remove operation key=31T6AP6MUBKL tag=6XD6IPQWF683 type=del 2024-09-12T18:33:05.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.011+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=MSQMYUJ4R1R0 type=del size=2006252 2024-09-12T18:33:05.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.015+0000 7f41a072b8c0 1 < completed write operation key=7MRN7L1DTAMO tag=BVGWF6ZNOY5X type=write size=693774 2024-09-12T18:33:05.021 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.019+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=T08EQK97XPXW type=write size=737662 2024-09-12T18:33:05.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.023+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~09LQ1CBI0XLQ.0 size=673676 2024-09-12T18:33:05.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.031+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=09LQ1CBI0XLQ tag=43V89OOI76QY type=write size=1722252 2024-09-12T18:33:05.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.035+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~OAIHFUQGNFS8.0 size=1048576 2024-09-12T18:33:05.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.039+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~OAIHFUQGNFS8.1 size=1048576 2024-09-12T18:33:05.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.043+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~OAIHFUQGNFS8.2 size=362643 2024-09-12T18:33:05.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.043+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=OAIHFUQGNFS8 tag=HCJ24MW0H3D5 type=write size=3508371 2024-09-12T18:33:05.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.047+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=MX58YK71Z7UM type=del 2024-09-12T18:33:05.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.047+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=SZQZYK0SD7NH type=write size=19499 2024-09-12T18:33:05.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.051+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=LNTR2LP50M7K type=del 2024-09-12T18:33:05.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.055+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=IT0362CO8VV2 type=del size=3204088 2024-09-12T18:33:05.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.059+0000 7f41a072b8c0 1 < canceled operation key=3R9RN03RFRJP tag=B5NLJYRF3T46 type=write size=725892 2024-09-12T18:33:05.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.063+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=5EV27QFHN3AY type=del size=772472 2024-09-12T18:33:05.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.067+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~Y3IZUBC34UBN.0 size=1048576 2024-09-12T18:33:05.070 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.067+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~Y3IZUBC34UBN.1 size=1048576 2024-09-12T18:33:05.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.071+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~Y3IZUBC34UBN.2 size=377123 2024-09-12T18:33:05.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.079+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=Y3IZUBC34UBN tag=WO6H3V98DJSB type=write size=3522851 2024-09-12T18:33:05.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.079+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=FOFG2IIWJPL3 type=del size=3843965 2024-09-12T18:33:05.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.083+0000 7f41a072b8c0 1 < canceled operation key=0G0YWIOD3L3I tag=QRNUCTAF945H type=write size=157555 2024-09-12T18:33:05.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.087+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=449JX1DPKGJO type=write size=135651 2024-09-12T18:33:05.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.091+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=XHQ4VGWW4LZK type=del 2024-09-12T18:33:05.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.095+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=GSCQKN1KSJZU type=del size=2752890 2024-09-12T18:33:05.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.099+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=690V00O7GHGO type=del 2024-09-12T18:33:05.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.099+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=UA8TH3VAY1I4 type=del size=1740073 2024-09-12T18:33:05.106 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.103+0000 7f41a072b8c0 1 < canceled operation key=P732C5X0RG8Z tag=44AS4TZZU9SR type=del size=3176965 2024-09-12T18:33:05.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.107+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=HFI07ZRALVFS type=del size=2149841 2024-09-12T18:33:05.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.111+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=DCBNFVQRW0BL type=del 2024-09-12T18:33:05.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.115+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=7IFUIMTZUPHS type=del size=2654376 2024-09-12T18:33:05.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.119+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=VDV3N32IHXMK type=del 2024-09-12T18:33:05.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.123+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=UDKRG95DY6IU type=write size=20957 2024-09-12T18:33:05.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.123+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~LDAK561YTJO4.0 size=211456 2024-09-12T18:33:05.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.131+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=LDAK561YTJO4 tag=9AN1IRFUDKUO type=write size=1260032 2024-09-12T18:33:05.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.135+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=ZHD2WP6IBM9C type=del size=1797416 2024-09-12T18:33:05.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.139+0000 7f41a072b8c0 1 < completed write operation key=3R9RN03RFRJP tag=O7CHDELJOSEL type=write size=147587 2024-09-12T18:33:05.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.139+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=21XYYB4NQ7IM type=write size=1044226 2024-09-12T18:33:05.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.147+0000 7f41a072b8c0 1 < suggested update operation key=5JUWC8RXSA5L tag=VPLVP3Y65K3Z type=del size=2116186 2024-09-12T18:33:05.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.155+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~Q9L7HOV947IS.0 size=1048576 2024-09-12T18:33:05.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.155+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~Q9L7HOV947IS.1 size=1048576 2024-09-12T18:33:05.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.159+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~Q9L7HOV947IS.2 size=83620 2024-09-12T18:33:05.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.159+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=Q9L7HOV947IS tag=L0CG1XRMKA8Q type=write size=3229348 2024-09-12T18:33:05.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.163+0000 7f41a072b8c0 1 < canceled operation key=58IT2R988AW9 tag=MSQMYUJ4R1R0 type=del size=2006252 2024-09-12T18:33:05.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.167+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~F7DEK44LVHOF.0 size=1048576 2024-09-12T18:33:05.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.171+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~F7DEK44LVHOF.1 size=1048576 2024-09-12T18:33:05.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.175+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~F7DEK44LVHOF.2 size=222585 2024-09-12T18:33:05.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.175+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=F7DEK44LVHOF tag=HNSQ4G5K3ZQC type=write size=3368313 2024-09-12T18:33:05.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.179+0000 7f41a072b8c0 1 < completed write operation key=31T6AP6MUBKL tag=T08EQK97XPXW type=write size=737662 2024-09-12T18:33:05.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.183+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=0SN1WZ3LLNKF type=del size=1530554 2024-09-12T18:33:05.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.183+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~OAIHFUQGNFS8.0 size=1048576 2024-09-12T18:33:05.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.187+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~OAIHFUQGNFS8.1 size=1048576 2024-09-12T18:33:05.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.191+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~OAIHFUQGNFS8.2 size=362643 2024-09-12T18:33:05.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.195+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=OAIHFUQGNFS8 tag=HCJ24MW0H3D5 type=write size=3508371 2024-09-12T18:33:05.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.199+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=BJLLG1ZFXZU4 type=write size=377923 2024-09-12T18:33:05.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.203+0000 7f41a072b8c0 1 < completed write operation key=31T6AP6MUBKL tag=SZQZYK0SD7NH type=write size=19499 2024-09-12T18:33:05.212 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.211+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=EXSSA46H8Y89 type=write size=53775 2024-09-12T18:33:05.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.215+0000 7f41a072b8c0 1 < canceled operation key=5OD9IX408CYO tag=IT0362CO8VV2 type=del size=3204088 2024-09-12T18:33:05.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.219+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~EZCMON7903FA.0 size=1048576 2024-09-12T18:33:05.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.223+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~EZCMON7903FA.1 size=1048576 2024-09-12T18:33:05.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.227+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~EZCMON7903FA.2 size=950280 2024-09-12T18:33:05.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.227+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=EZCMON7903FA tag=ANZ4L4EY6QK3 type=write size=4096008 2024-09-12T18:33:05.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.227+0000 7f41a072b8c0 1 < canceled operation key=GA6P1FACU2EQ tag=5EV27QFHN3AY type=del size=772472 2024-09-12T18:33:05.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.231+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=U0IVHR3WXCUB type=del size=1117100 2024-09-12T18:33:05.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.235+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=FOFG2IIWJPL3 type=del 2024-09-12T18:33:05.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.239+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=0QZW30EWV7QC type=del size=1704866 2024-09-12T18:33:05.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.243+0000 7f41a072b8c0 1 < suggested remove operation key=P732C5X0RG8Z tag=449JX1DPKGJO type=write 2024-09-12T18:33:05.247 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.247+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=W3YO55ICGG0Z type=write size=683040 2024-09-12T18:33:05.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.247+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=GSCQKN1KSJZU type=del 2024-09-12T18:33:05.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.251+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=1V0QZSBANXJG type=del size=4012370 2024-09-12T18:33:05.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.255+0000 7f41a072b8c0 1 < completed delete operation key=NKMA8FG3V3TR tag=UA8TH3VAY1I4 type=del 2024-09-12T18:33:05.258 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.259+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=UI1PLAB5K7WY type=del size=2902138 2024-09-12T18:33:05.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.259+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=HFI07ZRALVFS type=del 2024-09-12T18:33:05.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.263+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=AP49SM1BHX9Z type=write size=814398 2024-09-12T18:33:05.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.267+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=7IFUIMTZUPHS type=del 2024-09-12T18:33:05.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.271+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~SH5PQXEYXI6E.0 size=1048576 2024-09-12T18:33:05.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.275+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~SH5PQXEYXI6E.1 size=257002 2024-09-12T18:33:05.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.275+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=SH5PQXEYXI6E tag=ZW015VFD4R67 type=write size=2354154 2024-09-12T18:33:05.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.275+0000 7f41a072b8c0 1 < completed write operation key=7B70QWGMH0C0 tag=UDKRG95DY6IU type=write size=20957 2024-09-12T18:33:05.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.283+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~UR31JWSE4HZ0.0 size=1048576 2024-09-12T18:33:05.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.283+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~UR31JWSE4HZ0.1 size=612106 2024-09-12T18:33:05.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.283+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=UR31JWSE4HZ0 tag=QE5JY291PKTS type=write size=2709258 2024-09-12T18:33:05.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.287+0000 7f41a072b8c0 1 < canceled operation key=295ZC54QRUPD tag=ZHD2WP6IBM9C type=del size=1797416 2024-09-12T18:33:05.290 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.287+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=A2Z8HHMUXCC6 type=del size=3121737 2024-09-12T18:33:05.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.291+0000 7f41a072b8c0 1 < completed write operation key=1BSAN5TRTZNZ tag=21XYYB4NQ7IM type=write size=1044226 2024-09-12T18:33:05.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.299+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~2NKKUWIJR9P1.0 size=1048576 2024-09-12T18:33:05.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.299+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~2NKKUWIJR9P1.1 size=1048576 2024-09-12T18:33:05.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.303+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~2NKKUWIJR9P1.2 size=187693 2024-09-12T18:33:05.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.303+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=2NKKUWIJR9P1 tag=R2A1O903Y821 type=write size=3333421 2024-09-12T18:33:05.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.307+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~Q9L7HOV947IS.0 size=1048576 2024-09-12T18:33:05.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.311+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~Q9L7HOV947IS.1 size=1048576 2024-09-12T18:33:05.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.311+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~Q9L7HOV947IS.2 size=83620 2024-09-12T18:33:05.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.319+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=Q9L7HOV947IS tag=L0CG1XRMKA8Q type=write size=3229348 2024-09-12T18:33:05.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.319+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=BEBOV5J0Y6VV type=del size=4089756 2024-09-12T18:33:05.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.323+0000 7f41a072b8c0 1 < canceled part key=_multipart_L01GL4WOUIL2.2~F7DEK44LVHOF.0 size=1048576 2024-09-12T18:33:05.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.323+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~F7DEK44LVHOF.1 size=1048576 2024-09-12T18:33:05.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.323+0000 7f41a072b8c0 1 < canceled part key=_multipart_L01GL4WOUIL2.2~F7DEK44LVHOF.2 size=222585 2024-09-12T18:33:05.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.331+0000 7f41a072b8c0 1 < canceled multipart upload key=L01GL4WOUIL2 upload=F7DEK44LVHOF tag=HNSQ4G5K3ZQC type=write size=3368313 2024-09-12T18:33:05.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.335+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=8CZ0ZVR1X793 type=del size=902529 2024-09-12T18:33:05.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.335+0000 7f41a072b8c0 1 < completed delete operation key=1JIIRDVMT0B0 tag=0SN1WZ3LLNKF type=del 2024-09-12T18:33:05.341 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.339+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=PHNOVCYEMTAD type=del size=427079 2024-09-12T18:33:05.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.343+0000 7f41a072b8c0 1 < canceled operation key=YCBC1CHWJQC5 tag=BJLLG1ZFXZU4 type=write size=377923 2024-09-12T18:33:05.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.351+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~2PYDK7VKBCV8.0 size=1048576 2024-09-12T18:33:05.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.351+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~2PYDK7VKBCV8.1 size=1048576 2024-09-12T18:33:05.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.355+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~2PYDK7VKBCV8.2 size=43194 2024-09-12T18:33:05.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.355+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=2PYDK7VKBCV8 tag=OO4ADAJ7O684 type=write size=3188922 2024-09-12T18:33:05.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.359+0000 7f41a072b8c0 1 < completed write operation key=SK3T82EJFZXE tag=EXSSA46H8Y89 type=write size=53775 2024-09-12T18:33:05.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.363+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=3J9UQQYPXSB7 type=del size=634309 2024-09-12T18:33:05.366 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.363+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~EZCMON7903FA.0 size=1048576 2024-09-12T18:33:05.366 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.363+0000 7f41a072b8c0 1 < canceled part key=_multipart_5OD9IX408CYO.2~EZCMON7903FA.1 size=1048576 2024-09-12T18:33:05.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.367+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~EZCMON7903FA.2 size=950280 2024-09-12T18:33:05.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.371+0000 7f41a072b8c0 1 < canceled multipart upload key=5OD9IX408CYO upload=EZCMON7903FA tag=ANZ4L4EY6QK3 type=write size=4096008 2024-09-12T18:33:05.377 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.375+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=QPSEPHJBUZ2A type=del size=3994519 2024-09-12T18:33:05.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.383+0000 7f41a072b8c0 1 < suggested update operation key=VEN0P2P1RZ2S tag=U0IVHR3WXCUB type=del size=1117100 2024-09-12T18:33:05.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.387+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=ANMXS7H41H7K type=write size=534880 2024-09-12T18:33:05.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.391+0000 7f41a072b8c0 1 < suggested update operation key=0O97F5ON55TX tag=0QZW30EWV7QC type=del size=1704866 2024-09-12T18:33:05.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.399+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~1WOG4O9PNRZ8.0 size=979155 2024-09-12T18:33:05.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.399+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=1WOG4O9PNRZ8 tag=5T5A3DUR8LDX type=write size=2027731 2024-09-12T18:33:05.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.399+0000 7f41a072b8c0 1 < completed write operation key=63BP9QETTAM8 tag=W3YO55ICGG0Z type=write size=683040 2024-09-12T18:33:05.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.407+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~61FU037GLZ67.0 size=1048576 2024-09-12T18:33:05.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.411+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~61FU037GLZ67.1 size=1048576 2024-09-12T18:33:05.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.411+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~61FU037GLZ67.2 size=430549 2024-09-12T18:33:05.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.411+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=61FU037GLZ67 tag=P9IM8XRFSY8H type=write size=3576277 2024-09-12T18:33:05.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.415+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=1V0QZSBANXJG type=del 2024-09-12T18:33:05.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.423+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~NXCUM9UOQ0YT.0 size=1048576 2024-09-12T18:33:05.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.423+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~NXCUM9UOQ0YT.1 size=755878 2024-09-12T18:33:05.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.423+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=NXCUM9UOQ0YT tag=QF6YRXPIJZRZ type=write size=2853030 2024-09-12T18:33:05.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.427+0000 7f41a072b8c0 1 < canceled operation key=31T6AP6MUBKL tag=UI1PLAB5K7WY type=del size=2902138 2024-09-12T18:33:05.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.435+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~5LH1S33ZFVD8.0 size=1048576 2024-09-12T18:33:05.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.435+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~5LH1S33ZFVD8.1 size=1048576 2024-09-12T18:33:05.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.439+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~5LH1S33ZFVD8.2 size=210010 2024-09-12T18:33:05.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.439+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=5LH1S33ZFVD8 tag=2KSNSDIMH0KW type=write size=3355738 2024-09-12T18:33:05.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.443+0000 7f41a072b8c0 1 < completed write operation key=3R9RN03RFRJP tag=AP49SM1BHX9Z type=write size=814398 2024-09-12T18:33:05.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.447+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=T18QUGI2BUXE type=del size=3952843 2024-09-12T18:33:05.450 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.451+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~SH5PQXEYXI6E.0 size=1048576 2024-09-12T18:33:05.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.451+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~SH5PQXEYXI6E.1 size=257002 2024-09-12T18:33:05.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.459+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=SH5PQXEYXI6E tag=ZW015VFD4R67 type=write size=2354154 2024-09-12T18:33:05.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.463+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~PZO5KZSB35O7.0 size=1048576 2024-09-12T18:33:05.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.467+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~PZO5KZSB35O7.1 size=243838 2024-09-12T18:33:05.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.467+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=PZO5KZSB35O7 tag=GPO8AKMZU4SB type=write size=2340990 2024-09-12T18:33:05.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.471+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~UR31JWSE4HZ0.0 size=1048576 2024-09-12T18:33:05.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.475+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~UR31JWSE4HZ0.1 size=612106 2024-09-12T18:33:05.481 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.479+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=UR31JWSE4HZ0 tag=QE5JY291PKTS type=write size=2709258 2024-09-12T18:33:05.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.487+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~AHMCGRJ36N1U.0 size=1048576 2024-09-12T18:33:05.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.491+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~AHMCGRJ36N1U.1 size=930423 2024-09-12T18:33:05.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.491+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=AHMCGRJ36N1U tag=OM0UEVJ6WKC0 type=write size=3027575 2024-09-12T18:33:05.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.499+0000 7f41a072b8c0 1 < suggested update operation key=295ZC54QRUPD tag=A2Z8HHMUXCC6 type=del size=3121737 2024-09-12T18:33:05.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.499+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=CQVSAKL1KBSK type=write size=972628 2024-09-12T18:33:05.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.503+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~2NKKUWIJR9P1.0 size=1048576 2024-09-12T18:33:05.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.507+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~2NKKUWIJR9P1.1 size=1048576 2024-09-12T18:33:05.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.515+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~2NKKUWIJR9P1.2 size=187693 2024-09-12T18:33:05.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.519+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=2NKKUWIJR9P1 tag=R2A1O903Y821 type=write size=3333421 2024-09-12T18:33:05.523 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.523+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=I7V9S67DK4LI type=del size=2439229 2024-09-12T18:33:05.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.527+0000 7f41a072b8c0 1 < suggested update operation key=5JUWC8RXSA5L tag=BEBOV5J0Y6VV type=del size=4089756 2024-09-12T18:33:05.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.531+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=FF5ADHYUMIKL type=write size=808556 2024-09-12T18:33:05.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.535+0000 7f41a072b8c0 -1 < failed to complete operation key=5JUWC8RXSA5L tag=8CZ0ZVR1X793 type=del size=902529: (22) Invalid argument 2024-09-12T18:33:05.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.539+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=B7I8QEHJAVOL type=write size=783180 2024-09-12T18:33:05.546 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.543+0000 7f41a072b8c0 1 < suggested update operation key=YP72VTCGSHYE tag=PHNOVCYEMTAD type=del size=427079 2024-09-12T18:33:05.549 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.547+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=74SE1I6OOW7Z type=del size=2907637 2024-09-12T18:33:05.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.551+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~2PYDK7VKBCV8.0 size=1048576 2024-09-12T18:33:05.555 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.555+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~2PYDK7VKBCV8.1 size=1048576 2024-09-12T18:33:05.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.555+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~2PYDK7VKBCV8.2 size=43194 2024-09-12T18:33:05.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.563+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=2PYDK7VKBCV8 tag=OO4ADAJ7O684 type=write size=3188922 2024-09-12T18:33:05.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.567+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=42SFMVSTYLSQ type=del size=4082082 2024-09-12T18:33:05.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.567+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=3J9UQQYPXSB7 type=del 2024-09-12T18:33:05.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.571+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=2D2JB7SPV3D2 type=write size=356568 2024-09-12T18:33:05.577 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.575+0000 7f41a072b8c0 1 < canceled operation key=L01GL4WOUIL2 tag=QPSEPHJBUZ2A type=del size=3994519 2024-09-12T18:33:05.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.579+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=Y5X0EJPBDXSC type=del size=303551 2024-09-12T18:33:05.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.583+0000 7f41a072b8c0 1 < completed write operation key=L1VC63PK1R2Y tag=ANMXS7H41H7K type=write size=534880 2024-09-12T18:33:05.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.587+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=0ITAU6C3IBE9 type=del size=3005794 2024-09-12T18:33:05.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.591+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~1WOG4O9PNRZ8.0 size=979155 2024-09-12T18:33:05.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.595+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=1WOG4O9PNRZ8 tag=5T5A3DUR8LDX type=write size=2027731 2024-09-12T18:33:05.602 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.599+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~GJ9HM13ND03E.0 size=1048576 2024-09-12T18:33:05.604 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.603+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~GJ9HM13ND03E.1 size=203205 2024-09-12T18:33:05.604 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.603+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=GJ9HM13ND03E tag=B24F0581MD03 type=write size=2300357 2024-09-12T18:33:05.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.607+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~61FU037GLZ67.0 size=1048576 2024-09-12T18:33:05.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.611+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~61FU037GLZ67.1 size=1048576 2024-09-12T18:33:05.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.611+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~61FU037GLZ67.2 size=430549 2024-09-12T18:33:05.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.619+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=61FU037GLZ67 tag=P9IM8XRFSY8H type=write size=3576277 2024-09-12T18:33:05.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.623+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=H914AUBUIZ7D type=del size=3979652 2024-09-12T18:33:05.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.623+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~NXCUM9UOQ0YT.0 size=1048576 2024-09-12T18:33:05.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.627+0000 7f41a072b8c0 1 < canceled part key=_multipart_1JIIRDVMT0B0.2~NXCUM9UOQ0YT.1 size=755878 2024-09-12T18:33:05.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.631+0000 7f41a072b8c0 1 < canceled multipart upload key=1JIIRDVMT0B0 upload=NXCUM9UOQ0YT tag=QF6YRXPIJZRZ type=write size=2853030 2024-09-12T18:33:05.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.635+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~3XE5BLO30ENK.0 size=173125 2024-09-12T18:33:05.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.635+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=3XE5BLO30ENK tag=R3TBFZ1D90PO type=write size=1221701 2024-09-12T18:33:05.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.639+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~5LH1S33ZFVD8.0 size=1048576 2024-09-12T18:33:05.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.643+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~5LH1S33ZFVD8.1 size=1048576 2024-09-12T18:33:05.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.647+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~5LH1S33ZFVD8.2 size=210010 2024-09-12T18:33:05.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.651+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=5LH1S33ZFVD8 tag=2KSNSDIMH0KW type=write size=3355738 2024-09-12T18:33:05.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.655+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=V1EC3J4FQ4AU type=write size=901247 2024-09-12T18:33:05.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.659+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=T18QUGI2BUXE type=del 2024-09-12T18:33:05.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.659+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=9PWDN5OBGSFC type=del size=3859060 2024-09-12T18:33:05.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.663+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~PZO5KZSB35O7.0 size=1048576 2024-09-12T18:33:05.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.667+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~PZO5KZSB35O7.1 size=243838 2024-09-12T18:33:05.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.671+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=PZO5KZSB35O7 tag=GPO8AKMZU4SB type=write size=2340990 2024-09-12T18:33:05.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.675+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=S6M5Y0ZDXLM4 type=del size=1522218 2024-09-12T18:33:05.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.679+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~AHMCGRJ36N1U.0 size=1048576 2024-09-12T18:33:05.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.683+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~AHMCGRJ36N1U.1 size=930423 2024-09-12T18:33:05.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.687+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=AHMCGRJ36N1U tag=OM0UEVJ6WKC0 type=write size=3027575 2024-09-12T18:33:05.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.691+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~5BFQ8FBAP788.0 size=1048576 2024-09-12T18:33:05.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.695+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~5BFQ8FBAP788.1 size=918879 2024-09-12T18:33:05.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.695+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=5BFQ8FBAP788 tag=YOZ3QQJ97SL0 type=write size=3016031 2024-09-12T18:33:05.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.699+0000 7f41a072b8c0 1 < completed write operation key=KOLD6WYK30EQ tag=CQVSAKL1KBSK type=write size=972628 2024-09-12T18:33:05.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.699+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=UYS7BQHQ347E type=del size=1188866 2024-09-12T18:33:05.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.703+0000 7f41a072b8c0 -1 < failed to complete operation key=5JUWC8RXSA5L tag=I7V9S67DK4LI type=del size=2439229: (22) Invalid argument 2024-09-12T18:33:05.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.707+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=UATOMX48N9E2 type=del size=3564697 2024-09-12T18:33:05.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.711+0000 7f41a072b8c0 1 < suggested remove operation key=5OD9IX408CYO tag=FF5ADHYUMIKL type=write 2024-09-12T18:33:05.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.719+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~3G0MPJY8V062.0 size=1048576 2024-09-12T18:33:05.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.723+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~3G0MPJY8V062.1 size=1048576 2024-09-12T18:33:05.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.723+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~3G0MPJY8V062.2 size=607030 2024-09-12T18:33:05.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.723+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=3G0MPJY8V062 tag=XPMRZ1NY8U2I type=write size=3752758 2024-09-12T18:33:05.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.727+0000 7f41a072b8c0 1 < completed write operation key=P732C5X0RG8Z tag=B7I8QEHJAVOL type=write size=783180 2024-09-12T18:33:05.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.731+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=JT48GJTCLOAZ type=del size=1879794 2024-09-12T18:33:05.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.735+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=74SE1I6OOW7Z type=del 2024-09-12T18:33:05.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.739+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~IS05V0C0DDSR.0 size=1048576 2024-09-12T18:33:05.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.743+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~IS05V0C0DDSR.1 size=1048576 2024-09-12T18:33:05.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.747+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~IS05V0C0DDSR.2 size=629251 2024-09-12T18:33:05.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.747+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=IS05V0C0DDSR tag=2W0X9WRYOF5W type=write size=3774979 2024-09-12T18:33:05.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.751+0000 7f41a072b8c0 1 < suggested update operation key=L01GL4WOUIL2 tag=42SFMVSTYLSQ type=del size=4082082 2024-09-12T18:33:05.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.755+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~X51URDM9MC5J.0 size=920724 2024-09-12T18:33:05.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.755+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=X51URDM9MC5J tag=6NV3VM0DIF9M type=write size=1969300 2024-09-12T18:33:05.761 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.759+0000 7f41a072b8c0 1 < completed write operation key=0O97F5ON55TX tag=2D2JB7SPV3D2 type=write size=356568 2024-09-12T18:33:05.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.763+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=8CEHWEVBH703 type=del size=3541595 2024-09-12T18:33:05.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.767+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=Y5X0EJPBDXSC type=del 2024-09-12T18:33:05.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.771+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~2L1AAWF3Q1KT.0 size=1048576 2024-09-12T18:33:05.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.775+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~2L1AAWF3Q1KT.1 size=595721 2024-09-12T18:33:05.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.775+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=2L1AAWF3Q1KT tag=TLGNU9UIL0JW type=write size=2692873 2024-09-12T18:33:05.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.779+0000 7f41a072b8c0 1 < completed delete operation key=NKMA8FG3V3TR tag=0ITAU6C3IBE9 type=del 2024-09-12T18:33:05.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.787+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~JMN4P4R5G2N5.0 size=1048576 2024-09-12T18:33:05.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.787+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~JMN4P4R5G2N5.1 size=22139 2024-09-12T18:33:05.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.787+0000 7f41a072b8c0 1 > prepared multipart upload key=VEN0P2P1RZ2S upload=JMN4P4R5G2N5 tag=3VLJGJJBUYUJ type=write size=2119291 2024-09-12T18:33:05.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.791+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~GJ9HM13ND03E.0 size=1048576 2024-09-12T18:33:05.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.795+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~GJ9HM13ND03E.1 size=203205 2024-09-12T18:33:05.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.799+0000 7f41a072b8c0 1 < completed multipart upload key=A6GQZL25YSNL upload=GJ9HM13ND03E tag=B24F0581MD03 type=write size=2300357 2024-09-12T18:33:05.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.803+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=NQWSZESQ791R type=del size=3208348 2024-09-12T18:33:05.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.807+0000 7f41a072b8c0 1 < canceled operation key=0G0YWIOD3L3I tag=H914AUBUIZ7D type=del size=3979652 2024-09-12T18:33:05.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.807+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=L8JLLQJ1NJQS type=write size=200125 2024-09-12T18:33:05.813 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.811+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~3XE5BLO30ENK.0 size=173125 2024-09-12T18:33:05.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.819+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=3XE5BLO30ENK tag=R3TBFZ1D90PO type=write size=1221701 2024-09-12T18:33:05.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.823+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=GU0OVLD9O3WK type=del size=3886001 2024-09-12T18:33:05.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.827+0000 7f41a072b8c0 1 < suggested update operation key=YP72VTCGSHYE tag=V1EC3J4FQ4AU type=write size=901247 2024-09-12T18:33:05.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.835+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~XYAAVOUSTUUE.0 size=1048576 2024-09-12T18:33:05.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.835+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~XYAAVOUSTUUE.1 size=185930 2024-09-12T18:33:05.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.835+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=XYAAVOUSTUUE tag=A4UPAD9D92GC type=write size=2283082 2024-09-12T18:33:05.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.839+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=9PWDN5OBGSFC type=del 2024-09-12T18:33:05.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.843+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=UW5FZ579P10Z type=del size=3303460 2024-09-12T18:33:05.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.847+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=S6M5Y0ZDXLM4 type=del 2024-09-12T18:33:05.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.851+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=ISF3OF74QWHI type=del size=3319045 2024-09-12T18:33:05.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.851+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~5BFQ8FBAP788.0 size=1048576 2024-09-12T18:33:05.856 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.855+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~5BFQ8FBAP788.1 size=918879 2024-09-12T18:33:05.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.863+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=5BFQ8FBAP788 tag=YOZ3QQJ97SL0 type=write size=3016031 2024-09-12T18:33:05.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.867+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~KUFUPVVGSI0L.0 size=256842 2024-09-12T18:33:05.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.867+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=KUFUPVVGSI0L tag=QWIIE3PRREEM type=write size=1305418 2024-09-12T18:33:05.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.871+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=UYS7BQHQ347E type=del 2024-09-12T18:33:05.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.871+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=GMMUJAS8WK82 type=del size=820513 2024-09-12T18:33:05.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.875+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=UATOMX48N9E2 type=del 2024-09-12T18:33:05.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.879+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=C7ZIMTHSV3J3 type=write size=996741 2024-09-12T18:33:05.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.879+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~3G0MPJY8V062.0 size=1048576 2024-09-12T18:33:05.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.883+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~3G0MPJY8V062.1 size=1048576 2024-09-12T18:33:05.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.887+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~3G0MPJY8V062.2 size=607030 2024-09-12T18:33:05.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.891+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=3G0MPJY8V062 tag=XPMRZ1NY8U2I type=write size=3752758 2024-09-12T18:33:05.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.891+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=R4VVF0Q2FGZ5 type=del size=4167982 2024-09-12T18:33:05.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.895+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=JT48GJTCLOAZ type=del 2024-09-12T18:33:05.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.895+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=J43H8NHQA81M type=del size=2279690 2024-09-12T18:33:05.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.899+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~IS05V0C0DDSR.0 size=1048576 2024-09-12T18:33:05.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.899+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~IS05V0C0DDSR.1 size=1048576 2024-09-12T18:33:05.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.899+0000 7f41a072b8c0 1 < canceled part key=_multipart_KOLD6WYK30EQ.2~IS05V0C0DDSR.2 size=629251 2024-09-12T18:33:05.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.903+0000 7f41a072b8c0 1 < canceled multipart upload key=KOLD6WYK30EQ upload=IS05V0C0DDSR tag=2W0X9WRYOF5W type=write size=3774979 2024-09-12T18:33:05.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.907+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=K7PH197TMCRG type=del size=3491156 2024-09-12T18:33:05.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.907+0000 7f41a072b8c0 1 < canceled part key=_multipart_L01GL4WOUIL2.2~X51URDM9MC5J.0 size=920724 2024-09-12T18:33:05.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.911+0000 7f41a072b8c0 1 < canceled multipart upload key=L01GL4WOUIL2 upload=X51URDM9MC5J tag=6NV3VM0DIF9M type=write size=1969300 2024-09-12T18:33:05.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.915+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~YOQHTDU9P4IQ.0 size=1048576 2024-09-12T18:33:05.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.919+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~YOQHTDU9P4IQ.1 size=387211 2024-09-12T18:33:05.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.919+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=YOQHTDU9P4IQ tag=1GF2OT355SRX type=write size=2484363 2024-09-12T18:33:05.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.919+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=8CEHWEVBH703 type=del 2024-09-12T18:33:05.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.927+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~6764VO7ZK1XG.0 size=585494 2024-09-12T18:33:05.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.927+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=6764VO7ZK1XG tag=G4ARJA1WO8ON type=write size=1634070 2024-09-12T18:33:05.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.927+0000 7f41a072b8c0 1 < canceled part key=_multipart_3R9RN03RFRJP.2~2L1AAWF3Q1KT.0 size=1048576 2024-09-12T18:33:05.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.927+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~2L1AAWF3Q1KT.1 size=595721 2024-09-12T18:33:05.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.931+0000 7f41a072b8c0 1 < canceled multipart upload key=3R9RN03RFRJP upload=2L1AAWF3Q1KT tag=TLGNU9UIL0JW type=write size=2692873 2024-09-12T18:33:05.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.939+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~W3Y4Z1YWPIRM.0 size=221178 2024-09-12T18:33:05.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.939+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=W3Y4Z1YWPIRM tag=VS3DGS72Q429 type=write size=1269754 2024-09-12T18:33:05.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.939+0000 7f41a072b8c0 1 < canceled part key=_multipart_VEN0P2P1RZ2S.2~JMN4P4R5G2N5.0 size=1048576 2024-09-12T18:33:05.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.939+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~JMN4P4R5G2N5.1 size=22139 2024-09-12T18:33:05.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.943+0000 7f41a072b8c0 1 < canceled multipart upload key=VEN0P2P1RZ2S upload=JMN4P4R5G2N5 tag=3VLJGJJBUYUJ type=write size=2119291 2024-09-12T18:33:05.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.947+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=BZRABACKAKRV type=write size=426355 2024-09-12T18:33:05.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.951+0000 7f41a072b8c0 1 < suggested update operation key=XLGVEN6DF5EW tag=NQWSZESQ791R type=del size=3208348 2024-09-12T18:33:05.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.955+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=AIK7767V8ZJ8 type=write size=658867 2024-09-12T18:33:05.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.955+0000 7f41a072b8c0 1 < completed write operation key=L1VC63PK1R2Y tag=L8JLLQJ1NJQS type=write size=200125 2024-09-12T18:33:05.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.959+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=0IYLSM4M3MI2 type=write size=657365 2024-09-12T18:33:05.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.963+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=GU0OVLD9O3WK type=del 2024-09-12T18:33:05.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.967+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~LY3D36EFRXPF.0 size=1048576 2024-09-12T18:33:05.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.967+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~LY3D36EFRXPF.1 size=739402 2024-09-12T18:33:05.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.967+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=LY3D36EFRXPF tag=Z3V3CQENVXX9 type=write size=2836554 2024-09-12T18:33:05.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.971+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~XYAAVOUSTUUE.0 size=1048576 2024-09-12T18:33:05.972 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.971+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~XYAAVOUSTUUE.1 size=185930 2024-09-12T18:33:05.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.975+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=XYAAVOUSTUUE tag=A4UPAD9D92GC type=write size=2283082 2024-09-12T18:33:05.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.979+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=7YR56FB7FPZ2 type=del size=4100370 2024-09-12T18:33:05.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.979+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=UW5FZ579P10Z type=del 2024-09-12T18:33:05.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.983+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~UR4T1DF6N5ED.0 size=1048576 2024-09-12T18:33:05.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.987+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~UR4T1DF6N5ED.1 size=196565 2024-09-12T18:33:05.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.987+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=UR4T1DF6N5ED tag=JTJN7MOI8A2V type=write size=2293717 2024-09-12T18:33:05.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.991+0000 7f41a072b8c0 1 < suggested remove operation key=7B70QWGMH0C0 tag=ISF3OF74QWHI type=del 2024-09-12T18:33:05.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.995+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=V9668TFEBJMY type=del size=2316090 2024-09-12T18:33:06.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:05.999+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~KUFUPVVGSI0L.0 size=256842 2024-09-12T18:33:06.005 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.003+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=KUFUPVVGSI0L tag=QWIIE3PRREEM type=write size=1305418 2024-09-12T18:33:06.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.007+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=7Y0K3V4L37UG type=del size=2012955 2024-09-12T18:33:06.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.011+0000 7f41a072b8c0 -1 < failed to complete operation key=XLGVEN6DF5EW tag=GMMUJAS8WK82 type=del size=820513: (22) Invalid argument 2024-09-12T18:33:06.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.011+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=Y9K69J555VFG type=del size=2588458 2024-09-12T18:33:06.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.015+0000 7f41a072b8c0 1 < completed write operation key=P732C5X0RG8Z tag=C7ZIMTHSV3J3 type=write size=996741 2024-09-12T18:33:06.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.015+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=1XDLQZMVA38T type=del size=562348 2024-09-12T18:33:06.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.019+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=R4VVF0Q2FGZ5 type=del 2024-09-12T18:33:06.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.023+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=VNFV1INSCG6R type=del size=2492068 2024-09-12T18:33:06.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.023+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=J43H8NHQA81M type=del 2024-09-12T18:33:06.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.027+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~8D5SP2T0DFT9.0 size=958921 2024-09-12T18:33:06.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.027+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=8D5SP2T0DFT9 tag=P2Q9WSWAB6UH type=write size=2007497 2024-09-12T18:33:06.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.031+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=K7PH197TMCRG type=del 2024-09-12T18:33:06.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.035+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~G52V59SOWK1G.0 size=1048576 2024-09-12T18:33:06.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.039+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~G52V59SOWK1G.1 size=424395 2024-09-12T18:33:06.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.039+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=G52V59SOWK1G tag=A0WK4DFSFLUB type=write size=2521547 2024-09-12T18:33:06.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.039+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~YOQHTDU9P4IQ.0 size=1048576 2024-09-12T18:33:06.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.043+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~YOQHTDU9P4IQ.1 size=387211 2024-09-12T18:33:06.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.047+0000 7f41a072b8c0 1 < completed multipart upload key=A6GQZL25YSNL upload=YOQHTDU9P4IQ tag=1GF2OT355SRX type=write size=2484363 2024-09-12T18:33:06.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.047+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=KLKJ670FEKK0 type=write size=281845 2024-09-12T18:33:06.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.051+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~6764VO7ZK1XG.0 size=585494 2024-09-12T18:33:06.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.055+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=6764VO7ZK1XG tag=G4ARJA1WO8ON type=write size=1634070 2024-09-12T18:33:06.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.059+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~KS3JZG5C29D5.0 size=1048576 2024-09-12T18:33:06.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.063+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~KS3JZG5C29D5.1 size=1048576 2024-09-12T18:33:06.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.067+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~KS3JZG5C29D5.2 size=838845 2024-09-12T18:33:06.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.067+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=KS3JZG5C29D5 tag=FBLX3MYYJ25Z type=write size=3984573 2024-09-12T18:33:06.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.071+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~W3Y4Z1YWPIRM.0 size=221178 2024-09-12T18:33:06.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.075+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=W3Y4Z1YWPIRM tag=VS3DGS72Q429 type=write size=1269754 2024-09-12T18:33:06.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.075+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=L81TRGIGRX5M type=del size=4040701 2024-09-12T18:33:06.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.079+0000 7f41a072b8c0 1 < completed write operation key=1JIIRDVMT0B0 tag=BZRABACKAKRV type=write size=426355 2024-09-12T18:33:06.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.083+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=ZIZ29B9IDHIA type=del size=3466371 2024-09-12T18:33:06.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.083+0000 7f41a072b8c0 1 < completed write operation key=0G0YWIOD3L3I tag=AIK7767V8ZJ8 type=write size=658867 2024-09-12T18:33:06.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.087+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=AI6NSPAHYAU4 type=del size=606033 2024-09-12T18:33:06.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.091+0000 7f41a072b8c0 1 < completed write operation key=YCBC1CHWJQC5 tag=0IYLSM4M3MI2 type=write size=657365 2024-09-12T18:33:06.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.091+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=MGRRR90CSVEO type=write size=59110 2024-09-12T18:33:06.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.095+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~LY3D36EFRXPF.0 size=1048576 2024-09-12T18:33:06.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.099+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~LY3D36EFRXPF.1 size=739402 2024-09-12T18:33:06.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.103+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=LY3D36EFRXPF tag=Z3V3CQENVXX9 type=write size=2836554 2024-09-12T18:33:06.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.107+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~PKZ8CQC3D58B.0 size=1048576 2024-09-12T18:33:06.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.107+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~PKZ8CQC3D58B.1 size=1048576 2024-09-12T18:33:06.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.111+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~PKZ8CQC3D58B.2 size=682469 2024-09-12T18:33:06.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.111+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=PKZ8CQC3D58B tag=3NIVZGDG8QYP type=write size=3828197 2024-09-12T18:33:06.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.115+0000 7f41a072b8c0 1 < canceled operation key=5OD9IX408CYO tag=7YR56FB7FPZ2 type=del size=4100370 2024-09-12T18:33:06.117 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.115+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=1PFCQAVT22KM type=del size=252534 2024-09-12T18:33:06.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.119+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~UR4T1DF6N5ED.0 size=1048576 2024-09-12T18:33:06.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.119+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~UR4T1DF6N5ED.1 size=196565 2024-09-12T18:33:06.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.127+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=UR4T1DF6N5ED tag=JTJN7MOI8A2V type=write size=2293717 2024-09-12T18:33:06.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.127+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=P09TVN1MRX9A type=del size=1708727 2024-09-12T18:33:06.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.131+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=V9668TFEBJMY type=del 2024-09-12T18:33:06.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.131+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=OLGOTJJDBA88 type=del size=32793 2024-09-12T18:33:06.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.139+0000 7f41a072b8c0 1 < suggested update operation key=L1VC63PK1R2Y tag=7Y0K3V4L37UG type=del size=2012955 2024-09-12T18:33:06.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.139+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=PDV6H1GO6XLY type=del size=649980 2024-09-12T18:33:06.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.143+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=Y9K69J555VFG type=del 2024-09-12T18:33:06.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.147+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~EBF7X4P0LKEN.0 size=6360 2024-09-12T18:33:06.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.147+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=EBF7X4P0LKEN tag=MXRX6TE2OTZ0 type=write size=1054936 2024-09-12T18:33:06.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.151+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=1XDLQZMVA38T type=del 2024-09-12T18:33:06.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.155+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~CKDXMLQST1EN.0 size=1048576 2024-09-12T18:33:06.158 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.155+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~CKDXMLQST1EN.1 size=866541 2024-09-12T18:33:06.158 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.155+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=CKDXMLQST1EN tag=7E3F7V20QL0O type=write size=2963693 2024-09-12T18:33:06.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.159+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=VNFV1INSCG6R type=del 2024-09-12T18:33:06.164 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.163+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=7C4ITVVDG6MI type=del size=2565962 2024-09-12T18:33:06.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.167+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~8D5SP2T0DFT9.0 size=958921 2024-09-12T18:33:06.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.171+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=8D5SP2T0DFT9 tag=P2Q9WSWAB6UH type=write size=2007497 2024-09-12T18:33:06.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.175+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~9V1A5DEC3H8C.0 size=1048576 2024-09-12T18:33:06.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.179+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~9V1A5DEC3H8C.1 size=1048576 2024-09-12T18:33:06.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.179+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~9V1A5DEC3H8C.2 size=237817 2024-09-12T18:33:06.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.179+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=9V1A5DEC3H8C tag=KS23HLPIHTXG type=write size=3383545 2024-09-12T18:33:06.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.183+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~G52V59SOWK1G.0 size=1048576 2024-09-12T18:33:06.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.183+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~G52V59SOWK1G.1 size=424395 2024-09-12T18:33:06.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.187+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=G52V59SOWK1G tag=A0WK4DFSFLUB type=write size=2521547 2024-09-12T18:33:06.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.191+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~R7KQAXGB9IJB.0 size=1048576 2024-09-12T18:33:06.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.191+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~R7KQAXGB9IJB.1 size=1048576 2024-09-12T18:33:06.196 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.195+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~R7KQAXGB9IJB.2 size=268281 2024-09-12T18:33:06.196 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.195+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=R7KQAXGB9IJB tag=BQFWFMA4R8SL type=write size=3414009 2024-09-12T18:33:06.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.199+0000 7f41a072b8c0 1 < completed write operation key=GA6P1FACU2EQ tag=KLKJ670FEKK0 type=write size=281845 2024-09-12T18:33:06.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.203+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~JGSBTXBV1957.0 size=1048576 2024-09-12T18:33:06.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.203+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~JGSBTXBV1957.1 size=1048576 2024-09-12T18:33:06.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.207+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~JGSBTXBV1957.2 size=110725 2024-09-12T18:33:06.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.207+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=JGSBTXBV1957 tag=Z86SCV20O3AI type=write size=3256453 2024-09-12T18:33:06.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.207+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~KS3JZG5C29D5.0 size=1048576 2024-09-12T18:33:06.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.211+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~KS3JZG5C29D5.1 size=1048576 2024-09-12T18:33:06.213 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.211+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~KS3JZG5C29D5.2 size=838845 2024-09-12T18:33:06.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.215+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=KS3JZG5C29D5 tag=FBLX3MYYJ25Z type=write size=3984573 2024-09-12T18:33:06.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.219+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~Q2EUTH0A08AI.0 size=1048576 2024-09-12T18:33:06.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.223+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~Q2EUTH0A08AI.1 size=909218 2024-09-12T18:33:06.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.223+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=Q2EUTH0A08AI tag=4XZKFURVQ48X type=write size=3006370 2024-09-12T18:33:06.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.227+0000 7f41a072b8c0 1 < suggested remove operation key=5OD9IX408CYO tag=L81TRGIGRX5M type=del 2024-09-12T18:33:06.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.231+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=00L7AXPQJ1N7 type=del size=1213706 2024-09-12T18:33:06.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.231+0000 7f41a072b8c0 1 < completed delete operation key=YP72VTCGSHYE tag=ZIZ29B9IDHIA type=del 2024-09-12T18:33:06.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.235+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=5Q13617EV9KW type=del size=2671684 2024-09-12T18:33:06.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.235+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=AI6NSPAHYAU4 type=del 2024-09-12T18:33:06.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.239+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=NLJGLXZBEEXR type=del size=3149261 2024-09-12T18:33:06.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.243+0000 7f41a072b8c0 1 < completed write operation key=0O97F5ON55TX tag=MGRRR90CSVEO type=write size=59110 2024-09-12T18:33:06.247 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.247+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~YF32W5264U63.0 size=609027 2024-09-12T18:33:06.247 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.247+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=YF32W5264U63 tag=PYU08MA76N33 type=write size=1657603 2024-09-12T18:33:06.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.247+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~PKZ8CQC3D58B.0 size=1048576 2024-09-12T18:33:06.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.251+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~PKZ8CQC3D58B.1 size=1048576 2024-09-12T18:33:06.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.251+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~PKZ8CQC3D58B.2 size=682469 2024-09-12T18:33:06.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.255+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=PKZ8CQC3D58B tag=3NIVZGDG8QYP type=write size=3828197 2024-09-12T18:33:06.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.259+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=2YDZWZWPZC6J type=write size=101311 2024-09-12T18:33:06.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.263+0000 7f41a072b8c0 1 < suggested update operation key=58IT2R988AW9 tag=1PFCQAVT22KM type=del size=252534 2024-09-12T18:33:06.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.267+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=2DPG8EPAZZV1 type=write size=940103 2024-09-12T18:33:06.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.267+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=P09TVN1MRX9A type=del 2024-09-12T18:33:06.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.271+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~ZD6TKQH4KMEI.0 size=1048576 2024-09-12T18:33:06.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.275+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~ZD6TKQH4KMEI.1 size=351801 2024-09-12T18:33:06.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.275+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=ZD6TKQH4KMEI tag=VQ78DT03YQNK type=write size=2448953 2024-09-12T18:33:06.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.275+0000 7f41a072b8c0 1 < canceled operation key=A6GQZL25YSNL tag=OLGOTJJDBA88 type=del size=32793 2024-09-12T18:33:06.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.279+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=3I6NNMV7UPVJ type=del size=590178 2024-09-12T18:33:06.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.283+0000 7f41a072b8c0 1 < suggested remove operation key=31T6AP6MUBKL tag=PDV6H1GO6XLY type=del 2024-09-12T18:33:06.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.287+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=VHDAA02U8VJ1 type=del size=2016459 2024-09-12T18:33:06.290 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.287+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~EBF7X4P0LKEN.0 size=6360 2024-09-12T18:33:06.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.295+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=EBF7X4P0LKEN tag=MXRX6TE2OTZ0 type=write size=1054936 2024-09-12T18:33:06.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.303+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=BSUJS52ZQZ38 type=write size=283089 2024-09-12T18:33:06.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.307+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~CKDXMLQST1EN.0 size=1048576 2024-09-12T18:33:06.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.311+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~CKDXMLQST1EN.1 size=866541 2024-09-12T18:33:06.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.315+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=CKDXMLQST1EN tag=7E3F7V20QL0O type=write size=2963693 2024-09-12T18:33:06.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.319+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=98WO2TVNSBUY type=write size=629327 2024-09-12T18:33:06.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.323+0000 7f41a072b8c0 1 < completed delete operation key=1JIIRDVMT0B0 tag=7C4ITVVDG6MI type=del 2024-09-12T18:33:06.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.327+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=K883FGOQRUAA type=del size=1077129 2024-09-12T18:33:06.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.327+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~9V1A5DEC3H8C.0 size=1048576 2024-09-12T18:33:06.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.331+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~9V1A5DEC3H8C.1 size=1048576 2024-09-12T18:33:06.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.335+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~9V1A5DEC3H8C.2 size=237817 2024-09-12T18:33:06.341 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.339+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=9V1A5DEC3H8C tag=KS23HLPIHTXG type=write size=3383545 2024-09-12T18:33:06.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.347+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~U9UM8BZ4SVME.0 size=1048576 2024-09-12T18:33:06.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.347+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~U9UM8BZ4SVME.1 size=1014226 2024-09-12T18:33:06.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.347+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=U9UM8BZ4SVME tag=SBSAN37ZH258 type=write size=3111378 2024-09-12T18:33:06.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.351+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~R7KQAXGB9IJB.0 size=1048576 2024-09-12T18:33:06.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.355+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~R7KQAXGB9IJB.1 size=1048576 2024-09-12T18:33:06.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.355+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~R7KQAXGB9IJB.2 size=268281 2024-09-12T18:33:06.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.363+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=R7KQAXGB9IJB tag=BQFWFMA4R8SL type=write size=3414009 2024-09-12T18:33:06.367 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.367+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=9UY5M95K4WYM type=del size=4028696 2024-09-12T18:33:06.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.371+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~JGSBTXBV1957.0 size=1048576 2024-09-12T18:33:06.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.371+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~JGSBTXBV1957.1 size=1048576 2024-09-12T18:33:06.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.375+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~JGSBTXBV1957.2 size=110725 2024-09-12T18:33:06.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.379+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=JGSBTXBV1957 tag=Z86SCV20O3AI type=write size=3256453 2024-09-12T18:33:06.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.383+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=5DE2D2N5G6AZ type=write size=564216 2024-09-12T18:33:06.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.387+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~Q2EUTH0A08AI.0 size=1048576 2024-09-12T18:33:06.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.387+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~Q2EUTH0A08AI.1 size=909218 2024-09-12T18:33:06.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.395+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=Q2EUTH0A08AI tag=4XZKFURVQ48X type=write size=3006370 2024-09-12T18:33:06.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.399+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~GK0AY17GHEKJ.0 size=1030592 2024-09-12T18:33:06.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.399+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=GK0AY17GHEKJ tag=24ZYJAEHKOBL type=write size=2079168 2024-09-12T18:33:06.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.407+0000 7f41a072b8c0 1 < suggested update operation key=L1VC63PK1R2Y tag=00L7AXPQJ1N7 type=del size=1213706 2024-09-12T18:33:06.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.411+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~D2ZZEM1YSJ3M.0 size=1048576 2024-09-12T18:33:06.416 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.415+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~D2ZZEM1YSJ3M.1 size=1048576 2024-09-12T18:33:06.419 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.419+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~D2ZZEM1YSJ3M.2 size=907796 2024-09-12T18:33:06.419 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.419+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=D2ZZEM1YSJ3M tag=K95IC5F0VER3 type=write size=4053524 2024-09-12T18:33:06.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.423+0000 7f41a072b8c0 1 < suggested update operation key=0G0YWIOD3L3I tag=5Q13617EV9KW type=del size=2671684 2024-09-12T18:33:06.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.427+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=MVFTXIQOV7SU type=del size=3961205 2024-09-12T18:33:06.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.431+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=NLJGLXZBEEXR type=del 2024-09-12T18:33:06.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.435+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~GECNNDS5X6U1.0 size=1048576 2024-09-12T18:33:06.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.439+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~GECNNDS5X6U1.1 size=425519 2024-09-12T18:33:06.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.439+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=GECNNDS5X6U1 tag=7O3MY1TPW70F type=write size=2522671 2024-09-12T18:33:06.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.443+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~YF32W5264U63.0 size=609027 2024-09-12T18:33:06.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.447+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=YF32W5264U63 tag=PYU08MA76N33 type=write size=1657603 2024-09-12T18:33:06.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.455+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~Z7Z1ALAXT0NJ.0 size=1048576 2024-09-12T18:33:06.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.459+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~Z7Z1ALAXT0NJ.1 size=210723 2024-09-12T18:33:06.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.459+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=Z7Z1ALAXT0NJ tag=A3YRXQK4MHL0 type=write size=2307875 2024-09-12T18:33:06.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.463+0000 7f41a072b8c0 1 < completed write operation key=A6GQZL25YSNL tag=2YDZWZWPZC6J type=write size=101311 2024-09-12T18:33:06.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.463+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=46BXWDB8BVG9 type=del size=93406 2024-09-12T18:33:06.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.467+0000 7f41a072b8c0 1 < completed write operation key=SK3T82EJFZXE tag=2DPG8EPAZZV1 type=write size=940103 2024-09-12T18:33:06.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.471+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=8BMV0BSYDHO0 type=write size=316106 2024-09-12T18:33:06.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.475+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~ZD6TKQH4KMEI.0 size=1048576 2024-09-12T18:33:06.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.479+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~ZD6TKQH4KMEI.1 size=351801 2024-09-12T18:33:06.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.483+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=ZD6TKQH4KMEI tag=VQ78DT03YQNK type=write size=2448953 2024-09-12T18:33:06.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.491+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~ZG130IXAXC9F.0 size=1048576 2024-09-12T18:33:06.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.491+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~ZG130IXAXC9F.1 size=370807 2024-09-12T18:33:06.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.491+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=ZG130IXAXC9F tag=0DNOBSN0LIJB type=write size=2467959 2024-09-12T18:33:06.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.495+0000 7f41a072b8c0 1 < canceled operation key=P732C5X0RG8Z tag=3I6NNMV7UPVJ type=del size=590178 2024-09-12T18:33:06.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.503+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~YI47VJBQHL6I.0 size=1048576 2024-09-12T18:33:06.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~YI47VJBQHL6I.1 size=1048576 2024-09-12T18:33:06.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~YI47VJBQHL6I.2 size=34836 2024-09-12T18:33:06.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.507+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=YI47VJBQHL6I tag=PTJM57MODXKR type=write size=3180564 2024-09-12T18:33:06.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.511+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=VHDAA02U8VJ1 type=del 2024-09-12T18:33:06.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.515+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=NIK31ILU320F type=del size=2124166 2024-09-12T18:33:06.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.523+0000 7f41a072b8c0 1 < suggested update operation key=58IT2R988AW9 tag=BSUJS52ZQZ38 type=write size=283089 2024-09-12T18:33:06.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.527+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=YQZX7C3C2XQW type=write size=565696 2024-09-12T18:33:06.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.527+0000 7f41a072b8c0 1 < completed write operation key=GA6P1FACU2EQ tag=98WO2TVNSBUY type=write size=629327 2024-09-12T18:33:06.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.531+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=H1J8T7J2UQSS type=del size=3525884 2024-09-12T18:33:06.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.535+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=K883FGOQRUAA type=del 2024-09-12T18:33:06.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.539+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=W9YRS3M6BYG3 type=del size=3120111 2024-09-12T18:33:06.545 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.543+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~U9UM8BZ4SVME.0 size=1048576 2024-09-12T18:33:06.547 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.547+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~U9UM8BZ4SVME.1 size=1014226 2024-09-12T18:33:06.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.551+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=U9UM8BZ4SVME tag=SBSAN37ZH258 type=write size=3111378 2024-09-12T18:33:06.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.555+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~UN9SAWNOYKVO.0 size=1048576 2024-09-12T18:33:06.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.559+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~UN9SAWNOYKVO.1 size=50638 2024-09-12T18:33:06.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.559+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=UN9SAWNOYKVO tag=MW9D3P52PP02 type=write size=2147790 2024-09-12T18:33:06.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.563+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=9UY5M95K4WYM type=del 2024-09-12T18:33:06.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.567+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=50TJEJPWEDNI type=del size=2401337 2024-09-12T18:33:06.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.567+0000 7f41a072b8c0 1 < completed write operation key=VEN0P2P1RZ2S tag=5DE2D2N5G6AZ type=write size=564216 2024-09-12T18:33:06.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.575+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~8F2TS15M0V9P.0 size=1048576 2024-09-12T18:33:06.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.575+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~8F2TS15M0V9P.1 size=384541 2024-09-12T18:33:06.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.575+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=8F2TS15M0V9P tag=OJDMAC5QDDNH type=write size=2481693 2024-09-12T18:33:06.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.579+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~GK0AY17GHEKJ.0 size=1030592 2024-09-12T18:33:06.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.587+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=GK0AY17GHEKJ tag=24ZYJAEHKOBL type=write size=2079168 2024-09-12T18:33:06.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.591+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~ZN5B30F3ZAAB.0 size=1048576 2024-09-12T18:33:06.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.595+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~ZN5B30F3ZAAB.1 size=991144 2024-09-12T18:33:06.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.595+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=ZN5B30F3ZAAB tag=8HQDQAZBD6U5 type=write size=3088296 2024-09-12T18:33:06.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.595+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~D2ZZEM1YSJ3M.0 size=1048576 2024-09-12T18:33:06.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.599+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~D2ZZEM1YSJ3M.1 size=1048576 2024-09-12T18:33:06.602 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.603+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~D2ZZEM1YSJ3M.2 size=907796 2024-09-12T18:33:06.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.611+0000 7f41a072b8c0 1 < completed multipart upload key=A6GQZL25YSNL upload=D2ZZEM1YSJ3M tag=K95IC5F0VER3 type=write size=4053524 2024-09-12T18:33:06.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.615+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=JNAP3E45ZMJ1 type=del size=586387 2024-09-12T18:33:06.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.619+0000 7f41a072b8c0 1 < suggested update operation key=7MRN7L1DTAMO tag=MVFTXIQOV7SU type=del size=3961205 2024-09-12T18:33:06.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.623+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=NMG1PT16L3PK type=del size=2779874 2024-09-12T18:33:06.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.627+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~GECNNDS5X6U1.0 size=1048576 2024-09-12T18:33:06.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.627+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~GECNNDS5X6U1.1 size=425519 2024-09-12T18:33:06.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.631+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=GECNNDS5X6U1 tag=7O3MY1TPW70F type=write size=2522671 2024-09-12T18:33:06.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.635+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=PPYQ0SF5GPIO type=del size=2168437 2024-09-12T18:33:06.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.639+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~Z7Z1ALAXT0NJ.0 size=1048576 2024-09-12T18:33:06.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.639+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~Z7Z1ALAXT0NJ.1 size=210723 2024-09-12T18:33:06.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.647+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=Z7Z1ALAXT0NJ tag=A3YRXQK4MHL0 type=write size=2307875 2024-09-12T18:33:06.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.647+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=2WM7ATUWEH6N type=del size=2656553 2024-09-12T18:33:06.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.655+0000 7f41a072b8c0 1 < suggested remove operation key=V35A7LK08C7J tag=46BXWDB8BVG9 type=del 2024-09-12T18:33:06.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.659+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=KDP3IWXZF5J5 type=del size=4191185 2024-09-12T18:33:06.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.663+0000 7f41a072b8c0 1 < completed write operation key=0G0YWIOD3L3I tag=8BMV0BSYDHO0 type=write size=316106 2024-09-12T18:33:06.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.667+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~NSGNJ0PSD0GU.0 size=1048576 2024-09-12T18:33:06.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.671+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~NSGNJ0PSD0GU.1 size=1048576 2024-09-12T18:33:06.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.671+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~NSGNJ0PSD0GU.2 size=3538 2024-09-12T18:33:06.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.671+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=NSGNJ0PSD0GU tag=EU7WSTCX0S56 type=write size=3149266 2024-09-12T18:33:06.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.675+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~ZG130IXAXC9F.0 size=1048576 2024-09-12T18:33:06.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.675+0000 7f41a072b8c0 1 < canceled part key=_multipart_0O97F5ON55TX.2~ZG130IXAXC9F.1 size=370807 2024-09-12T18:33:06.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.683+0000 7f41a072b8c0 1 < canceled multipart upload key=0O97F5ON55TX upload=ZG130IXAXC9F tag=0DNOBSN0LIJB type=write size=2467959 2024-09-12T18:33:06.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.687+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~K2B9FEXAU37J.0 size=87714 2024-09-12T18:33:06.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.687+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=K2B9FEXAU37J tag=86315VFBP9SF type=write size=1136290 2024-09-12T18:33:06.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.691+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~YI47VJBQHL6I.0 size=1048576 2024-09-12T18:33:06.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.691+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~YI47VJBQHL6I.1 size=1048576 2024-09-12T18:33:06.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.695+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~YI47VJBQHL6I.2 size=34836 2024-09-12T18:33:06.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.699+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=YI47VJBQHL6I tag=PTJM57MODXKR type=write size=3180564 2024-09-12T18:33:06.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.707+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~J1JQTL4D5DVX.0 size=1048576 2024-09-12T18:33:06.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.711+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~J1JQTL4D5DVX.1 size=1016662 2024-09-12T18:33:06.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.711+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=J1JQTL4D5DVX tag=IU685A9N5FZO type=write size=3113814 2024-09-12T18:33:06.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.711+0000 7f41a072b8c0 -1 < failed to complete operation key=V35A7LK08C7J tag=NIK31ILU320F type=del size=2124166: (22) Invalid argument 2024-09-12T18:33:06.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.715+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=S1DB2WR32ISN type=del size=2166326 2024-09-12T18:33:06.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.719+0000 7f41a072b8c0 1 < completed write operation key=5JUWC8RXSA5L tag=YQZX7C3C2XQW type=write size=565696 2024-09-12T18:33:06.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.723+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=R64KOP37BW7R type=del size=1597041 2024-09-12T18:33:06.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.727+0000 7f41a072b8c0 1 < canceled operation key=GC8797KSO47E tag=H1J8T7J2UQSS type=del size=3525884 2024-09-12T18:33:06.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.731+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~ARFHIJZKPRLT.0 size=67766 2024-09-12T18:33:06.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.731+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=ARFHIJZKPRLT tag=5IVLC04P7J94 type=write size=1116342 2024-09-12T18:33:06.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.735+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=W9YRS3M6BYG3 type=del 2024-09-12T18:33:06.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.739+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=SMWMTY8N7VXQ type=write size=467363 2024-09-12T18:33:06.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.743+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~UN9SAWNOYKVO.0 size=1048576 2024-09-12T18:33:06.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.743+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~UN9SAWNOYKVO.1 size=50638 2024-09-12T18:33:06.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.751+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=UN9SAWNOYKVO tag=MW9D3P52PP02 type=write size=2147790 2024-09-12T18:33:06.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.755+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~ERFQLZZQ4R6W.0 size=1048576 2024-09-12T18:33:06.759 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.759+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~ERFQLZZQ4R6W.1 size=298925 2024-09-12T18:33:06.759 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.759+0000 7f41a072b8c0 1 > prepared multipart upload key=VEN0P2P1RZ2S upload=ERFQLZZQ4R6W tag=Z7YHM79MADRC type=write size=2396077 2024-09-12T18:33:06.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.763+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=50TJEJPWEDNI type=del 2024-09-12T18:33:06.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.767+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~VWUK3RXQKQJF.0 size=1048576 2024-09-12T18:33:06.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.771+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~VWUK3RXQKQJF.1 size=1048576 2024-09-12T18:33:06.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.771+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~VWUK3RXQKQJF.2 size=826257 2024-09-12T18:33:06.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.771+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=VWUK3RXQKQJF tag=YZ019TRLJRZE type=write size=3971985 2024-09-12T18:33:06.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.771+0000 7f41a072b8c0 1 < canceled part key=_multipart_V35A7LK08C7J.2~8F2TS15M0V9P.0 size=1048576 2024-09-12T18:33:06.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.775+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~8F2TS15M0V9P.1 size=384541 2024-09-12T18:33:06.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.779+0000 7f41a072b8c0 1 < canceled multipart upload key=V35A7LK08C7J upload=8F2TS15M0V9P tag=OJDMAC5QDDNH type=write size=2481693 2024-09-12T18:33:06.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.787+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~6HY9NKZ8HN9R.0 size=1048576 2024-09-12T18:33:06.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.787+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~6HY9NKZ8HN9R.1 size=1048576 2024-09-12T18:33:06.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.791+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~6HY9NKZ8HN9R.2 size=688090 2024-09-12T18:33:06.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.791+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=6HY9NKZ8HN9R tag=N35SQ58OBWKR type=write size=3833818 2024-09-12T18:33:06.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.795+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~ZN5B30F3ZAAB.0 size=1048576 2024-09-12T18:33:06.798 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.795+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~ZN5B30F3ZAAB.1 size=991144 2024-09-12T18:33:06.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.803+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=ZN5B30F3ZAAB tag=8HQDQAZBD6U5 type=write size=3088296 2024-09-12T18:33:06.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.807+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~BEMBBRLFF1X7.0 size=1048576 2024-09-12T18:33:06.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.811+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~BEMBBRLFF1X7.1 size=1048576 2024-09-12T18:33:06.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.811+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~BEMBBRLFF1X7.2 size=837234 2024-09-12T18:33:06.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.811+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=BEMBBRLFF1X7 tag=OVTSMQHQCR8Z type=write size=3982962 2024-09-12T18:33:06.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.815+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=JNAP3E45ZMJ1 type=del 2024-09-12T18:33:06.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.823+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~F6442TEBSCY9.0 size=1048576 2024-09-12T18:33:06.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.823+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~F6442TEBSCY9.1 size=1028360 2024-09-12T18:33:06.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.823+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=F6442TEBSCY9 tag=8OF5XH269PAL type=write size=3125512 2024-09-12T18:33:06.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.827+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=NMG1PT16L3PK type=del 2024-09-12T18:33:06.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.831+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=483FVQONWCTR type=del size=1277734 2024-09-12T18:33:06.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.835+0000 7f41a072b8c0 1 < canceled operation key=5JUWC8RXSA5L tag=PPYQ0SF5GPIO type=del size=2168437 2024-09-12T18:33:06.842 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.839+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~9H1WKP02Y3F0.0 size=1048576 2024-09-12T18:33:06.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.843+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~9H1WKP02Y3F0.1 size=1048576 2024-09-12T18:33:06.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.847+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~9H1WKP02Y3F0.2 size=75587 2024-09-12T18:33:06.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.847+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=9H1WKP02Y3F0 tag=VAB0MEKHXQ5D type=write size=3221315 2024-09-12T18:33:06.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.851+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=2WM7ATUWEH6N type=del 2024-09-12T18:33:06.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.851+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=KI0J9I8SO8AH type=del size=992545 2024-09-12T18:33:06.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.855+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=KDP3IWXZF5J5 type=del 2024-09-12T18:33:06.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.863+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~HGC51WKWRH62.0 size=329941 2024-09-12T18:33:06.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.863+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=HGC51WKWRH62 tag=OP9JW270V6TF type=write size=1378517 2024-09-12T18:33:06.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.863+0000 7f41a072b8c0 1 < canceled part key=_multipart_3CGBX19WTMWQ.2~NSGNJ0PSD0GU.0 size=1048576 2024-09-12T18:33:06.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.867+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~NSGNJ0PSD0GU.1 size=1048576 2024-09-12T18:33:06.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.867+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~NSGNJ0PSD0GU.2 size=3538 2024-09-12T18:33:06.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.875+0000 7f41a072b8c0 1 < canceled multipart upload key=3CGBX19WTMWQ upload=NSGNJ0PSD0GU tag=EU7WSTCX0S56 type=write size=3149266 2024-09-12T18:33:06.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.875+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=6KL9DKDIF4D7 type=del size=318422 2024-09-12T18:33:06.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.879+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~K2B9FEXAU37J.0 size=87714 2024-09-12T18:33:06.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.887+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=K2B9FEXAU37J tag=86315VFBP9SF type=write size=1136290 2024-09-12T18:33:06.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.891+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~488F8QNMOU3A.0 size=656208 2024-09-12T18:33:06.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.891+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=488F8QNMOU3A tag=HNCM02LV29MZ type=write size=1704784 2024-09-12T18:33:06.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.895+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~J1JQTL4D5DVX.0 size=1048576 2024-09-12T18:33:06.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.899+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~J1JQTL4D5DVX.1 size=1016662 2024-09-12T18:33:06.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.907+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=J1JQTL4D5DVX tag=IU685A9N5FZO type=write size=3113814 2024-09-12T18:33:06.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.911+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~L45RFBG9Z5K3.0 size=1048576 2024-09-12T18:33:06.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.915+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~L45RFBG9Z5K3.1 size=707975 2024-09-12T18:33:06.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.915+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=L45RFBG9Z5K3 tag=TSVKCHBOG2KY type=write size=2805127 2024-09-12T18:33:06.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.919+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=S1DB2WR32ISN type=del 2024-09-12T18:33:06.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.919+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=GS737BJ9K5DH type=del size=10095 2024-09-12T18:33:06.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.923+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=R64KOP37BW7R type=del 2024-09-12T18:33:06.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.927+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=XRZ9MD3KHAXS type=del size=1506966 2024-09-12T18:33:06.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.931+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~ARFHIJZKPRLT.0 size=67766 2024-09-12T18:33:06.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.935+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=ARFHIJZKPRLT tag=5IVLC04P7J94 type=write size=1116342 2024-09-12T18:33:06.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.943+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~H312FPXNY8EJ.0 size=1048576 2024-09-12T18:33:06.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.943+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~H312FPXNY8EJ.1 size=1048576 2024-09-12T18:33:06.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.947+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~H312FPXNY8EJ.2 size=675877 2024-09-12T18:33:06.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.947+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=H312FPXNY8EJ tag=5YUWP93UO03J type=write size=3821605 2024-09-12T18:33:06.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.951+0000 7f41a072b8c0 1 < completed write operation key=V35A7LK08C7J tag=SMWMTY8N7VXQ type=write size=467363 2024-09-12T18:33:06.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.955+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~YCTLTQC21OY2.0 size=690856 2024-09-12T18:33:06.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.955+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=YCTLTQC21OY2 tag=VVT0ZHH3FGRG type=write size=1739432 2024-09-12T18:33:06.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.959+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~ERFQLZZQ4R6W.0 size=1048576 2024-09-12T18:33:06.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.963+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~ERFQLZZQ4R6W.1 size=298925 2024-09-12T18:33:06.967 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.967+0000 7f41a072b8c0 1 < completed multipart upload key=VEN0P2P1RZ2S upload=ERFQLZZQ4R6W tag=Z7YHM79MADRC type=write size=2396077 2024-09-12T18:33:06.972 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.971+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~C9I37S4FVZV2.0 size=1048576 2024-09-12T18:33:06.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.975+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~C9I37S4FVZV2.1 size=954086 2024-09-12T18:33:06.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.975+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=C9I37S4FVZV2 tag=C306S7QUL63K type=write size=3051238 2024-09-12T18:33:06.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.975+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~VWUK3RXQKQJF.0 size=1048576 2024-09-12T18:33:06.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.979+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~VWUK3RXQKQJF.1 size=1048576 2024-09-12T18:33:06.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.979+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~VWUK3RXQKQJF.2 size=826257 2024-09-12T18:33:06.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.987+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=VWUK3RXQKQJF tag=YZ019TRLJRZE type=write size=3971985 2024-09-12T18:33:06.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.987+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=ETYBQQ7TRVAZ type=del size=3300335 2024-09-12T18:33:06.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.991+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~6HY9NKZ8HN9R.0 size=1048576 2024-09-12T18:33:06.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.995+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~6HY9NKZ8HN9R.1 size=1048576 2024-09-12T18:33:06.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.995+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~6HY9NKZ8HN9R.2 size=688090 2024-09-12T18:33:07.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:06.999+0000 7f41a072b8c0 1 < completed multipart upload key=L01GL4WOUIL2 upload=6HY9NKZ8HN9R tag=N35SQ58OBWKR type=write size=3833818 2024-09-12T18:33:07.005 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.003+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=106Z9YPKGABJ type=del size=1624324 2024-09-12T18:33:07.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.007+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~BEMBBRLFF1X7.0 size=1048576 2024-09-12T18:33:07.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.007+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~BEMBBRLFF1X7.1 size=1048576 2024-09-12T18:33:07.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.011+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~BEMBBRLFF1X7.2 size=837234 2024-09-12T18:33:07.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.015+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=BEMBBRLFF1X7 tag=OVTSMQHQCR8Z type=write size=3982962 2024-09-12T18:33:07.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.019+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=X3RK5FJ4DD0J type=write size=674827 2024-09-12T18:33:07.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.023+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~F6442TEBSCY9.0 size=1048576 2024-09-12T18:33:07.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.023+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~F6442TEBSCY9.1 size=1028360 2024-09-12T18:33:07.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.027+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=F6442TEBSCY9 tag=8OF5XH269PAL type=write size=3125512 2024-09-12T18:33:07.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.031+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~57F5CAAW4RG2.0 size=1048576 2024-09-12T18:33:07.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.035+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~57F5CAAW4RG2.1 size=1009786 2024-09-12T18:33:07.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.035+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=57F5CAAW4RG2 tag=ZK417EDD4QGO type=write size=3106938 2024-09-12T18:33:07.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.039+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=483FVQONWCTR type=del 2024-09-12T18:33:07.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.039+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=G6G38KR12MD5 type=del size=2302469 2024-09-12T18:33:07.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.043+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~9H1WKP02Y3F0.0 size=1048576 2024-09-12T18:33:07.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.047+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~9H1WKP02Y3F0.1 size=1048576 2024-09-12T18:33:07.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.047+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~9H1WKP02Y3F0.2 size=75587 2024-09-12T18:33:07.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.051+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=9H1WKP02Y3F0 tag=VAB0MEKHXQ5D type=write size=3221315 2024-09-12T18:33:07.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.055+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=FTCB43GVS90J type=del size=2917221 2024-09-12T18:33:07.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.055+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=KI0J9I8SO8AH type=del 2024-09-12T18:33:07.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.059+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=UKBHJGOQ48NF type=del size=3421736 2024-09-12T18:33:07.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.063+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~HGC51WKWRH62.0 size=329941 2024-09-12T18:33:07.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.067+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=HGC51WKWRH62 tag=OP9JW270V6TF type=write size=1378517 2024-09-12T18:33:07.070 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.071+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~34FBW7IHIFLR.0 size=91825 2024-09-12T18:33:07.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.071+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=34FBW7IHIFLR tag=DEK43OPN7D29 type=write size=1140401 2024-09-12T18:33:07.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.071+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=6KL9DKDIF4D7 type=del 2024-09-12T18:33:07.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.075+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~4DYN7KBVY3OW.0 size=1048576 2024-09-12T18:33:07.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.079+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~4DYN7KBVY3OW.1 size=1048576 2024-09-12T18:33:07.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.079+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~4DYN7KBVY3OW.2 size=924538 2024-09-12T18:33:07.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.079+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=4DYN7KBVY3OW tag=7MJYR9O6K7NF type=write size=4070266 2024-09-12T18:33:07.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.083+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~488F8QNMOU3A.0 size=656208 2024-09-12T18:33:07.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.087+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=488F8QNMOU3A tag=HNCM02LV29MZ type=write size=1704784 2024-09-12T18:33:07.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.091+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~CV4NZ1AFUCLC.0 size=1048576 2024-09-12T18:33:07.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.095+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~CV4NZ1AFUCLC.1 size=309285 2024-09-12T18:33:07.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.095+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=CV4NZ1AFUCLC tag=T9J5O1J1U4JY type=write size=2406437 2024-09-12T18:33:07.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.095+0000 7f41a072b8c0 1 < canceled part key=_multipart_YP72VTCGSHYE.2~L45RFBG9Z5K3.0 size=1048576 2024-09-12T18:33:07.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.099+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~L45RFBG9Z5K3.1 size=707975 2024-09-12T18:33:07.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.103+0000 7f41a072b8c0 1 < canceled multipart upload key=YP72VTCGSHYE upload=L45RFBG9Z5K3 tag=TSVKCHBOG2KY type=write size=2805127 2024-09-12T18:33:07.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.107+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~286PLBAXPDQI.0 size=347108 2024-09-12T18:33:07.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.107+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=286PLBAXPDQI tag=ZJ9Q060CU53V type=write size=1395684 2024-09-12T18:33:07.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.111+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=GS737BJ9K5DH type=del 2024-09-12T18:33:07.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.111+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=VSZQXTZUAVYO type=del size=3478298 2024-09-12T18:33:07.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.115+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=XRZ9MD3KHAXS type=del 2024-09-12T18:33:07.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.119+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=28Q7EQDBUUO5 type=del size=1252846 2024-09-12T18:33:07.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.119+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~H312FPXNY8EJ.0 size=1048576 2024-09-12T18:33:07.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.123+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~H312FPXNY8EJ.1 size=1048576 2024-09-12T18:33:07.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.123+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~H312FPXNY8EJ.2 size=675877 2024-09-12T18:33:07.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.127+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=H312FPXNY8EJ tag=5YUWP93UO03J type=write size=3821605 2024-09-12T18:33:07.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.131+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=4671IYTQ7AVF type=write size=611632 2024-09-12T18:33:07.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.131+0000 7f41a072b8c0 1 < canceled part key=_multipart_3CGBX19WTMWQ.2~YCTLTQC21OY2.0 size=690856 2024-09-12T18:33:07.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.135+0000 7f41a072b8c0 1 < canceled multipart upload key=3CGBX19WTMWQ upload=YCTLTQC21OY2 tag=VVT0ZHH3FGRG type=write size=1739432 2024-09-12T18:33:07.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.139+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=I3CIPGWU799A type=del size=2667199 2024-09-12T18:33:07.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.139+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~C9I37S4FVZV2.0 size=1048576 2024-09-12T18:33:07.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.143+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~C9I37S4FVZV2.1 size=954086 2024-09-12T18:33:07.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.147+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=C9I37S4FVZV2 tag=C306S7QUL63K type=write size=3051238 2024-09-12T18:33:07.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.155+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=ZD4SXXPOGL18 type=del size=1392137 2024-09-12T18:33:07.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.159+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=ETYBQQ7TRVAZ type=del 2024-09-12T18:33:07.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.159+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=TJTVCAPCB1BS type=del size=552035 2024-09-12T18:33:07.164 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.163+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=106Z9YPKGABJ type=del 2024-09-12T18:33:07.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.167+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~1QI7KCG8H2KU.0 size=1048576 2024-09-12T18:33:07.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.171+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~1QI7KCG8H2KU.1 size=267560 2024-09-12T18:33:07.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.171+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=1QI7KCG8H2KU tag=5Q94TWOKQON9 type=write size=2364712 2024-09-12T18:33:07.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.175+0000 7f41a072b8c0 1 < suggested update operation key=0G0YWIOD3L3I tag=X3RK5FJ4DD0J type=write size=674827 2024-09-12T18:33:07.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.179+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~TTIEB2OUT930.0 size=696843 2024-09-12T18:33:07.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.179+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=TTIEB2OUT930 tag=1LSW2XQH2K9W type=write size=1745419 2024-09-12T18:33:07.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.183+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~57F5CAAW4RG2.0 size=1048576 2024-09-12T18:33:07.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.183+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~57F5CAAW4RG2.1 size=1009786 2024-09-12T18:33:07.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.187+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=57F5CAAW4RG2 tag=ZK417EDD4QGO type=write size=3106938 2024-09-12T18:33:07.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.191+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=H4KA49W2XA1V type=write size=587773 2024-09-12T18:33:07.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.195+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=G6G38KR12MD5 type=del 2024-09-12T18:33:07.196 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.195+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=C0TNP7DS69DW type=del size=3637329 2024-09-12T18:33:07.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.199+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=FTCB43GVS90J type=del 2024-09-12T18:33:07.200 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.199+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=BUA7946TRPXU type=del size=2803789 2024-09-12T18:33:07.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.203+0000 7f41a072b8c0 1 < suggested update operation key=GQHPUDV5BG1E tag=UKBHJGOQ48NF type=del size=3421736 2024-09-12T18:33:07.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.203+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=7GNBCQNMKJ5T type=del size=2200656 2024-09-12T18:33:07.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.203+0000 7f41a072b8c0 1 < canceled part key=_multipart_0G0YWIOD3L3I.2~34FBW7IHIFLR.0 size=91825 2024-09-12T18:33:07.208 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.207+0000 7f41a072b8c0 1 < canceled multipart upload key=0G0YWIOD3L3I upload=34FBW7IHIFLR tag=DEK43OPN7D29 type=write size=1140401 2024-09-12T18:33:07.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.211+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=287K42SCULDY type=write size=934288 2024-09-12T18:33:07.212 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.211+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~4DYN7KBVY3OW.0 size=1048576 2024-09-12T18:33:07.214 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.211+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~4DYN7KBVY3OW.1 size=1048576 2024-09-12T18:33:07.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.215+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~4DYN7KBVY3OW.2 size=924538 2024-09-12T18:33:07.219 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.219+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=4DYN7KBVY3OW tag=7MJYR9O6K7NF type=write size=4070266 2024-09-12T18:33:07.222 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.223+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~0ZKG4FAED4DI.0 size=641969 2024-09-12T18:33:07.222 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.223+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=0ZKG4FAED4DI tag=Q1Z9AA8APNHS type=write size=1690545 2024-09-12T18:33:07.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.223+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~CV4NZ1AFUCLC.0 size=1048576 2024-09-12T18:33:07.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.223+0000 7f41a072b8c0 1 < canceled part key=_multipart_3R9RN03RFRJP.2~CV4NZ1AFUCLC.1 size=309285 2024-09-12T18:33:07.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.227+0000 7f41a072b8c0 1 < canceled multipart upload key=3R9RN03RFRJP upload=CV4NZ1AFUCLC tag=T9J5O1J1U4JY type=write size=2406437 2024-09-12T18:33:07.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.231+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~N0RGFUVGW1ZU.0 size=1048576 2024-09-12T18:33:07.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.231+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~N0RGFUVGW1ZU.1 size=1048576 2024-09-12T18:33:07.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.231+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~N0RGFUVGW1ZU.2 size=436801 2024-09-12T18:33:07.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.231+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=N0RGFUVGW1ZU tag=6RKZS1KQ8E8A type=write size=3582529 2024-09-12T18:33:07.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.235+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~286PLBAXPDQI.0 size=347108 2024-09-12T18:33:07.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.239+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=286PLBAXPDQI tag=ZJ9Q060CU53V type=write size=1395684 2024-09-12T18:33:07.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.239+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=M2UQ8ZSIK337 type=del size=319977 2024-09-12T18:33:07.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.243+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=VSZQXTZUAVYO type=del 2024-09-12T18:33:07.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.247+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~PE3FPAGM7PAV.0 size=1048576 2024-09-12T18:33:07.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.247+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~PE3FPAGM7PAV.1 size=1048576 2024-09-12T18:33:07.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.247+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~PE3FPAGM7PAV.2 size=663687 2024-09-12T18:33:07.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.247+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=PE3FPAGM7PAV tag=KSVNZ5TJZEUF type=write size=3809415 2024-09-12T18:33:07.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.251+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=28Q7EQDBUUO5 type=del 2024-09-12T18:33:07.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.251+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=7OBI1QM2JIDU type=del size=3434495 2024-09-12T18:33:07.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.255+0000 7f41a072b8c0 1 < completed write operation key=C2PRRD3QO9AF tag=4671IYTQ7AVF type=write size=611632 2024-09-12T18:33:07.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.259+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~WWEJAP2Y4CIV.0 size=578658 2024-09-12T18:33:07.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.259+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=WWEJAP2Y4CIV tag=BVYYZATIQ92R type=write size=1627234 2024-09-12T18:33:07.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.263+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=I3CIPGWU799A type=del 2024-09-12T18:33:07.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.263+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=QP8E9U93Z9BW type=del size=597084 2024-09-12T18:33:07.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.267+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=ZD4SXXPOGL18 type=del 2024-09-12T18:33:07.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.267+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=61XZ1S37ED47 type=del size=2807263 2024-09-12T18:33:07.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.271+0000 7f41a072b8c0 1 < canceled operation key=31T6AP6MUBKL tag=TJTVCAPCB1BS type=del size=552035 2024-09-12T18:33:07.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.271+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=VXTXNCF1FEE1 type=del size=3498234 2024-09-12T18:33:07.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.275+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~1QI7KCG8H2KU.0 size=1048576 2024-09-12T18:33:07.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.275+0000 7f41a072b8c0 1 < canceled part key=_multipart_31T6AP6MUBKL.2~1QI7KCG8H2KU.1 size=267560 2024-09-12T18:33:07.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.275+0000 7f41a072b8c0 1 < canceled multipart upload key=31T6AP6MUBKL upload=1QI7KCG8H2KU tag=5Q94TWOKQON9 type=write size=2364712 2024-09-12T18:33:07.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.279+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~IAE22ZHSX1F1.0 size=1048576 2024-09-12T18:33:07.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.283+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~IAE22ZHSX1F1.1 size=1048576 2024-09-12T18:33:07.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.283+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~IAE22ZHSX1F1.2 size=619234 2024-09-12T18:33:07.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.283+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=IAE22ZHSX1F1 tag=W9R0QIIMYJRB type=write size=3764962 2024-09-12T18:33:07.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.287+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~TTIEB2OUT930.0 size=696843 2024-09-12T18:33:07.290 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.287+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=TTIEB2OUT930 tag=1LSW2XQH2K9W type=write size=1745419 2024-09-12T18:33:07.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.291+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=I55QISELXO27 type=del size=2753646 2024-09-12T18:33:07.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.295+0000 7f41a072b8c0 1 < completed write operation key=YCBC1CHWJQC5 tag=H4KA49W2XA1V type=write size=587773 2024-09-12T18:33:07.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.299+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~Q7I4E779HLD2.0 size=1048576 2024-09-12T18:33:07.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.299+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~Q7I4E779HLD2.1 size=1048576 2024-09-12T18:33:07.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.303+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~Q7I4E779HLD2.2 size=956592 2024-09-12T18:33:07.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.303+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=Q7I4E779HLD2 tag=ORFXISXWUAY1 type=write size=4102320 2024-09-12T18:33:07.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.303+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=C0TNP7DS69DW type=del 2024-09-12T18:33:07.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.307+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=IRHP1ENJZW4Y type=write size=484164 2024-09-12T18:33:07.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.311+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=BUA7946TRPXU type=del 2024-09-12T18:33:07.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.315+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=BRPNY4AIMJ1M type=del size=1146812 2024-09-12T18:33:07.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.315+0000 7f41a072b8c0 1 < completed delete operation key=3R9RN03RFRJP tag=7GNBCQNMKJ5T type=del 2024-09-12T18:33:07.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.323+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~00IS5X0U6GRP.0 size=1048576 2024-09-12T18:33:07.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.323+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~00IS5X0U6GRP.1 size=69381 2024-09-12T18:33:07.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.323+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=00IS5X0U6GRP tag=0Z4ZI0DR1T3U type=write size=2166533 2024-09-12T18:33:07.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.327+0000 7f41a072b8c0 1 < completed write operation key=GQHPUDV5BG1E tag=287K42SCULDY type=write size=934288 2024-09-12T18:33:07.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.327+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=F7C0XI0KBEBC type=del size=2406006 2024-09-12T18:33:07.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.331+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~0ZKG4FAED4DI.0 size=641969 2024-09-12T18:33:07.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.335+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=0ZKG4FAED4DI tag=Q1Z9AA8APNHS type=write size=1690545 2024-09-12T18:33:07.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.339+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=U9UQAZPEIEZ0 type=del size=98547 2024-09-12T18:33:07.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.339+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~N0RGFUVGW1ZU.0 size=1048576 2024-09-12T18:33:07.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.343+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~N0RGFUVGW1ZU.1 size=1048576 2024-09-12T18:33:07.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.347+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~N0RGFUVGW1ZU.2 size=436801 2024-09-12T18:33:07.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.351+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=N0RGFUVGW1ZU tag=6RKZS1KQ8E8A type=write size=3582529 2024-09-12T18:33:07.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.351+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=MSJOSYX9Z5O1 type=write size=402349 2024-09-12T18:33:07.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.359+0000 7f41a072b8c0 1 < suggested update operation key=3CGBX19WTMWQ tag=M2UQ8ZSIK337 type=del size=319977 2024-09-12T18:33:07.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.359+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=3IN3PV9SN9LS type=del size=1122013 2024-09-12T18:33:07.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.363+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~PE3FPAGM7PAV.0 size=1048576 2024-09-12T18:33:07.369 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.367+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~PE3FPAGM7PAV.1 size=1048576 2024-09-12T18:33:07.370 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.367+0000 7f41a072b8c0 1 < canceled part key=_multipart_P732C5X0RG8Z.2~PE3FPAGM7PAV.2 size=663687 2024-09-12T18:33:07.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.375+0000 7f41a072b8c0 1 < canceled multipart upload key=P732C5X0RG8Z upload=PE3FPAGM7PAV tag=KSVNZ5TJZEUF type=write size=3809415 2024-09-12T18:33:07.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.379+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~761X2TEY9UK7.0 size=1048576 2024-09-12T18:33:07.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.383+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~761X2TEY9UK7.1 size=1048576 2024-09-12T18:33:07.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.383+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~761X2TEY9UK7.2 size=1044532 2024-09-12T18:33:07.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.383+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=761X2TEY9UK7 tag=MHTQHLI5NR28 type=write size=4190260 2024-09-12T18:33:07.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.387+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=7OBI1QM2JIDU type=del 2024-09-12T18:33:07.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.391+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~LKBD1Y6I5FWL.0 size=1023881 2024-09-12T18:33:07.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.391+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=LKBD1Y6I5FWL tag=YRWQXNRTGVK4 type=write size=2072457 2024-09-12T18:33:07.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.395+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~WWEJAP2Y4CIV.0 size=578658 2024-09-12T18:33:07.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.399+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=WWEJAP2Y4CIV tag=BVYYZATIQ92R type=write size=1627234 2024-09-12T18:33:07.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.399+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=ZE3D0IQRHH5C type=del size=2301579 2024-09-12T18:33:07.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.403+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=QP8E9U93Z9BW type=del 2024-09-12T18:33:07.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.403+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=REN7SRMMA7ZO type=del size=622533 2024-09-12T18:33:07.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.407+0000 7f41a072b8c0 -1 < failed to complete operation key=3CGBX19WTMWQ tag=61XZ1S37ED47 type=del size=2807263: (22) Invalid argument 2024-09-12T18:33:07.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.411+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~G1O3RGTR87A0.0 size=1048576 2024-09-12T18:33:07.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.411+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~G1O3RGTR87A0.1 size=1048576 2024-09-12T18:33:07.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.411+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~G1O3RGTR87A0.2 size=166626 2024-09-12T18:33:07.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.411+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=G1O3RGTR87A0 tag=R6UOLY7UXXU4 type=write size=3312354 2024-09-12T18:33:07.416 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.415+0000 7f41a072b8c0 1 < canceled operation key=C2PRRD3QO9AF tag=VXTXNCF1FEE1 type=del size=3498234 2024-09-12T18:33:07.418 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.415+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=RK6MDQ874C5X type=del size=1866016 2024-09-12T18:33:07.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.419+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~IAE22ZHSX1F1.0 size=1048576 2024-09-12T18:33:07.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.423+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~IAE22ZHSX1F1.1 size=1048576 2024-09-12T18:33:07.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.423+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~IAE22ZHSX1F1.2 size=619234 2024-09-12T18:33:07.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.427+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=IAE22ZHSX1F1 tag=W9R0QIIMYJRB type=write size=3764962 2024-09-12T18:33:07.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.435+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~VNWWFQZ1RHG5.0 size=30810 2024-09-12T18:33:07.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.435+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=VNWWFQZ1RHG5 tag=0ZJ6R9JV1OQA type=write size=1079386 2024-09-12T18:33:07.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.435+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=I55QISELXO27 type=del 2024-09-12T18:33:07.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.439+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=O40ADUT1A7DU type=del size=485543 2024-09-12T18:33:07.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.443+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~Q7I4E779HLD2.0 size=1048576 2024-09-12T18:33:07.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.443+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~Q7I4E779HLD2.1 size=1048576 2024-09-12T18:33:07.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.447+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~Q7I4E779HLD2.2 size=956592 2024-09-12T18:33:07.450 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.451+0000 7f41a072b8c0 1 < completed multipart upload key=L01GL4WOUIL2 upload=Q7I4E779HLD2 tag=ORFXISXWUAY1 type=write size=4102320 2024-09-12T18:33:07.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.451+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=EB5BIOZGZ7TR type=del size=1448026 2024-09-12T18:33:07.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.455+0000 7f41a072b8c0 1 < canceled operation key=VEN0P2P1RZ2S tag=IRHP1ENJZW4Y type=write size=484164 2024-09-12T18:33:07.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.455+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=8LSY7WAQRA3O type=del size=3866443 2024-09-12T18:33:07.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.459+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=BRPNY4AIMJ1M type=del 2024-09-12T18:33:07.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.463+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=IJNA9HOC1YIB type=del size=2515958 2024-09-12T18:33:07.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.463+0000 7f41a072b8c0 1 < canceled part key=_multipart_A6GQZL25YSNL.2~00IS5X0U6GRP.0 size=1048576 2024-09-12T18:33:07.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.463+0000 7f41a072b8c0 1 < canceled part key=_multipart_A6GQZL25YSNL.2~00IS5X0U6GRP.1 size=69381 2024-09-12T18:33:07.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.467+0000 7f41a072b8c0 1 < canceled multipart upload key=A6GQZL25YSNL upload=00IS5X0U6GRP tag=0Z4ZI0DR1T3U type=write size=2166533 2024-09-12T18:33:07.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.471+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~8RC1851ZA03M.0 size=832078 2024-09-12T18:33:07.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.471+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=8RC1851ZA03M tag=8CFFJXB1XU0U type=write size=1880654 2024-09-12T18:33:07.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.475+0000 7f41a072b8c0 1 < suggested remove operation key=5OD9IX408CYO tag=F7C0XI0KBEBC type=del 2024-09-12T18:33:07.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.479+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~E7422PBV9K3I.0 size=1048576 2024-09-12T18:33:07.481 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.479+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~E7422PBV9K3I.1 size=1048576 2024-09-12T18:33:07.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.483+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~E7422PBV9K3I.2 size=301977 2024-09-12T18:33:07.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.483+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=E7422PBV9K3I tag=ZC31XCF9O0MY type=write size=3447705 2024-09-12T18:33:07.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.483+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=U9UQAZPEIEZ0 type=del 2024-09-12T18:33:07.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.491+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~Z1ILFJ9MILGY.0 size=12474 2024-09-12T18:33:07.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.491+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=Z1ILFJ9MILGY tag=TFT1V4XG4GJZ type=write size=1061050 2024-09-12T18:33:07.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.491+0000 7f41a072b8c0 1 < completed write operation key=L01GL4WOUIL2 tag=MSJOSYX9Z5O1 type=write size=402349 2024-09-12T18:33:07.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.495+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=M5N5674VF60V type=del size=3460033 2024-09-12T18:33:07.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.499+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=3IN3PV9SN9LS type=del 2024-09-12T18:33:07.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.499+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=WLHGH9KGEX19 type=del size=3343570 2024-09-12T18:33:07.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.503+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~761X2TEY9UK7.0 size=1048576 2024-09-12T18:33:07.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.503+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~761X2TEY9UK7.1 size=1048576 2024-09-12T18:33:07.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.507+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~761X2TEY9UK7.2 size=1044532 2024-09-12T18:33:07.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.511+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=761X2TEY9UK7 tag=MHTQHLI5NR28 type=write size=4190260 2024-09-12T18:33:07.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.511+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=SPXAQ9QZKP5V type=write size=914427 2024-09-12T18:33:07.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.511+0000 7f41a072b8c0 1 < canceled part key=_multipart_3R9RN03RFRJP.2~LKBD1Y6I5FWL.0 size=1023881 2024-09-12T18:33:07.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.515+0000 7f41a072b8c0 1 < canceled multipart upload key=3R9RN03RFRJP upload=LKBD1Y6I5FWL tag=YRWQXNRTGVK4 type=write size=2072457 2024-09-12T18:33:07.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.519+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=7PK4RGRFREQI type=del size=1075528 2024-09-12T18:33:07.523 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.523+0000 7f41a072b8c0 -1 < failed to complete operation key=5OD9IX408CYO tag=ZE3D0IQRHH5C type=del size=2301579: (22) Invalid argument 2024-09-12T18:33:07.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.523+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=6DW1W76L6GA7 type=del size=3436363 2024-09-12T18:33:07.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.527+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=REN7SRMMA7ZO type=del 2024-09-12T18:33:07.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.531+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=JMQEF2ILSBO5 type=del size=2893951 2024-09-12T18:33:07.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.531+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~G1O3RGTR87A0.0 size=1048576 2024-09-12T18:33:07.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.535+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~G1O3RGTR87A0.1 size=1048576 2024-09-12T18:33:07.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.535+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~G1O3RGTR87A0.2 size=166626 2024-09-12T18:33:07.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.539+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=G1O3RGTR87A0 tag=R6UOLY7UXXU4 type=write size=3312354 2024-09-12T18:33:07.545 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.543+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~S9ZFXJWH6ZWY.0 size=396158 2024-09-12T18:33:07.546 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.543+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=S9ZFXJWH6ZWY tag=VBR9QCY38IJT type=write size=1444734 2024-09-12T18:33:07.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.547+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=RK6MDQ874C5X type=del 2024-09-12T18:33:07.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.551+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=01XLBFM7GP8Y type=del size=628567 2024-09-12T18:33:07.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.551+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~VNWWFQZ1RHG5.0 size=30810 2024-09-12T18:33:07.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.555+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=VNWWFQZ1RHG5 tag=0ZJ6R9JV1OQA type=write size=1079386 2024-09-12T18:33:07.559 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.559+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=MOPR8MFOS61Y type=del size=3904504 2024-09-12T18:33:07.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.563+0000 7f41a072b8c0 1 < suggested update operation key=V35A7LK08C7J tag=O40ADUT1A7DU type=del size=485543 2024-09-12T18:33:07.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.567+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~Z10W2VZI3BRB.0 size=1048576 2024-09-12T18:33:07.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.567+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~Z10W2VZI3BRB.1 size=1048576 2024-09-12T18:33:07.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.571+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~Z10W2VZI3BRB.2 size=74907 2024-09-12T18:33:07.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.571+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=Z10W2VZI3BRB tag=YT6W4SLVQHR5 type=write size=3220635 2024-09-12T18:33:07.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.575+0000 7f41a072b8c0 1 < suggested remove operation key=3R9RN03RFRJP tag=EB5BIOZGZ7TR type=del 2024-09-12T18:33:07.577 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.575+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=RC6K1Y8V0ECB type=write size=90847 2024-09-12T18:33:07.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.579+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=8LSY7WAQRA3O type=del 2024-09-12T18:33:07.582 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.583+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=6SW6PII3JQBX type=del size=653825 2024-09-12T18:33:07.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.583+0000 7f41a072b8c0 -1 < failed to complete operation key=V35A7LK08C7J tag=IJNA9HOC1YIB type=del size=2515958: (22) Invalid argument 2024-09-12T18:33:07.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.587+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~U6ZJG2JY1YLL.0 size=1048576 2024-09-12T18:33:07.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.591+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~U6ZJG2JY1YLL.1 size=115162 2024-09-12T18:33:07.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.591+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=U6ZJG2JY1YLL tag=X179PNQ8G4XO type=write size=2212314 2024-09-12T18:33:07.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.595+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~8RC1851ZA03M.0 size=832078 2024-09-12T18:33:07.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.599+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=8RC1851ZA03M tag=8CFFJXB1XU0U type=write size=1880654 2024-09-12T18:33:07.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.603+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~EKTLSDSRK1GS.0 size=1048576 2024-09-12T18:33:07.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.607+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~EKTLSDSRK1GS.1 size=1048576 2024-09-12T18:33:07.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.607+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~EKTLSDSRK1GS.2 size=865761 2024-09-12T18:33:07.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.607+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=EKTLSDSRK1GS tag=46TZZ1D2Y9QO type=write size=4011489 2024-09-12T18:33:07.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.607+0000 7f41a072b8c0 1 < canceled part key=_multipart_C2PRRD3QO9AF.2~E7422PBV9K3I.0 size=1048576 2024-09-12T18:33:07.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.611+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~E7422PBV9K3I.1 size=1048576 2024-09-12T18:33:07.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.611+0000 7f41a072b8c0 1 < canceled part key=_multipart_C2PRRD3QO9AF.2~E7422PBV9K3I.2 size=301977 2024-09-12T18:33:07.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.615+0000 7f41a072b8c0 1 < canceled multipart upload key=C2PRRD3QO9AF upload=E7422PBV9K3I tag=ZC31XCF9O0MY type=write size=3447705 2024-09-12T18:33:07.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.615+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=BBZ3AHRBQ9EN type=del size=3410370 2024-09-12T18:33:07.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.615+0000 7f41a072b8c0 1 < canceled part key=_multipart_YP72VTCGSHYE.2~Z1ILFJ9MILGY.0 size=12474 2024-09-12T18:33:07.621 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.619+0000 7f41a072b8c0 1 < canceled multipart upload key=YP72VTCGSHYE upload=Z1ILFJ9MILGY tag=TFT1V4XG4GJZ type=write size=1061050 2024-09-12T18:33:07.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.623+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=D1HL7S1E801A type=del size=966804 2024-09-12T18:33:07.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.627+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=M5N5674VF60V type=del 2024-09-12T18:33:07.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.631+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~RMK8A1YHEW4U.0 size=394748 2024-09-12T18:33:07.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.631+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=RMK8A1YHEW4U tag=OYDR6D084SND type=write size=1443324 2024-09-12T18:33:07.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.631+0000 7f41a072b8c0 -1 < no bi entry to suggest for operation key=3R9RN03RFRJP tag=WLHGH9KGEX19 type=del size=3343570: (2) No such file or directory 2024-09-12T18:33:07.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.635+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~2RWDU12K8BEL.0 size=1048576 2024-09-12T18:33:07.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.635+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~2RWDU12K8BEL.1 size=1048576 2024-09-12T18:33:07.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.639+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~2RWDU12K8BEL.2 size=167842 2024-09-12T18:33:07.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.639+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=2RWDU12K8BEL tag=HK13843B9X1C type=write size=3313570 2024-09-12T18:33:07.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.643+0000 7f41a072b8c0 1 < completed write operation key=L01GL4WOUIL2 tag=SPXAQ9QZKP5V type=write size=914427 2024-09-12T18:33:07.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.643+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=Y91KS6LOLJYQ type=write size=363856 2024-09-12T18:33:07.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.647+0000 7f41a072b8c0 1 < suggested update operation key=5OD9IX408CYO tag=7PK4RGRFREQI type=del size=1075528 2024-09-12T18:33:07.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.651+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=H9IXY2I2U672 type=del size=2810296 2024-09-12T18:33:07.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.655+0000 7f41a072b8c0 1 < suggested update operation key=31T6AP6MUBKL tag=6DW1W76L6GA7 type=del size=3436363 2024-09-12T18:33:07.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.659+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~OXUTSNN7CANR.0 size=1048576 2024-09-12T18:33:07.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.663+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~OXUTSNN7CANR.1 size=1048576 2024-09-12T18:33:07.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.663+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~OXUTSNN7CANR.2 size=780484 2024-09-12T18:33:07.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.663+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=OXUTSNN7CANR tag=8BY1MDOPXFOR type=write size=3926212 2024-09-12T18:33:07.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.667+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=JMQEF2ILSBO5 type=del 2024-09-12T18:33:07.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.671+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=FKZJFBU7GU4E type=del size=2509264 2024-09-12T18:33:07.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.671+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~S9ZFXJWH6ZWY.0 size=396158 2024-09-12T18:33:07.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.675+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=S9ZFXJWH6ZWY tag=VBR9QCY38IJT type=write size=1444734 2024-09-12T18:33:07.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.679+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~WZCAL1195L5R.0 size=1048576 2024-09-12T18:33:07.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.683+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~WZCAL1195L5R.1 size=775547 2024-09-12T18:33:07.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.683+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=WZCAL1195L5R tag=Z3RGW1UNZ1XB type=write size=2872699 2024-09-12T18:33:07.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.687+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=01XLBFM7GP8Y type=del 2024-09-12T18:33:07.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.687+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=ZCF1NWQK7R2O type=write size=41025 2024-09-12T18:33:07.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.691+0000 7f41a072b8c0 1 < canceled operation key=P732C5X0RG8Z tag=MOPR8MFOS61Y type=del size=3904504 2024-09-12T18:33:07.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.695+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~W29VX9CDKJ06.0 size=1048576 2024-09-12T18:33:07.697 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.695+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~W29VX9CDKJ06.1 size=1048576 2024-09-12T18:33:07.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.699+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~W29VX9CDKJ06.2 size=344433 2024-09-12T18:33:07.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.699+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=W29VX9CDKJ06 tag=Z99OEASMXVXW type=write size=3490161 2024-09-12T18:33:07.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.699+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~Z10W2VZI3BRB.0 size=1048576 2024-09-12T18:33:07.703 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.703+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~Z10W2VZI3BRB.1 size=1048576 2024-09-12T18:33:07.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.703+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~Z10W2VZI3BRB.2 size=74907 2024-09-12T18:33:07.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.711+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=Z10W2VZI3BRB tag=YT6W4SLVQHR5 type=write size=3220635 2024-09-12T18:33:07.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.711+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=0TGK73OH5YUW type=del size=1241256 2024-09-12T18:33:07.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.715+0000 7f41a072b8c0 1 < suggested update operation key=SK3T82EJFZXE tag=RC6K1Y8V0ECB type=write size=90847 2024-09-12T18:33:07.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.719+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=WI0BOKJVX2N8 type=del size=3341537 2024-09-12T18:33:07.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.723+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=6SW6PII3JQBX type=del 2024-09-12T18:33:07.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.723+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=78EK1PEU8IPZ type=del size=3768010 2024-09-12T18:33:07.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.727+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~U6ZJG2JY1YLL.0 size=1048576 2024-09-12T18:33:07.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.727+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~U6ZJG2JY1YLL.1 size=115162 2024-09-12T18:33:07.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.731+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=U6ZJG2JY1YLL tag=X179PNQ8G4XO type=write size=2212314 2024-09-12T18:33:07.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.735+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=5VG4MTBKGHM1 type=write size=267222 2024-09-12T18:33:07.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.739+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~EKTLSDSRK1GS.0 size=1048576 2024-09-12T18:33:07.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.739+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~EKTLSDSRK1GS.1 size=1048576 2024-09-12T18:33:07.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.743+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~EKTLSDSRK1GS.2 size=865761 2024-09-12T18:33:07.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.747+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=EKTLSDSRK1GS tag=46TZZ1D2Y9QO type=write size=4011489 2024-09-12T18:33:07.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.747+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=S1HO5W6UPZY0 type=del size=3922056 2024-09-12T18:33:07.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.751+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=BBZ3AHRBQ9EN type=del 2024-09-12T18:33:07.754 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.755+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=Q0L9RIYKOJ42 type=del size=1688385 2024-09-12T18:33:07.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.755+0000 7f41a072b8c0 -1 < failed to complete operation key=5OD9IX408CYO tag=D1HL7S1E801A type=del size=966804: (22) Invalid argument 2024-09-12T18:33:07.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.759+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=UDEEPPQ3TIPH type=del size=1388385 2024-09-12T18:33:07.761 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.759+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~RMK8A1YHEW4U.0 size=394748 2024-09-12T18:33:07.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.763+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=RMK8A1YHEW4U tag=OYDR6D084SND type=write size=1443324 2024-09-12T18:33:07.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.767+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~HKGUKPGYHPGY.0 size=1048576 2024-09-12T18:33:07.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.771+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~HKGUKPGYHPGY.1 size=1048576 2024-09-12T18:33:07.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.771+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~HKGUKPGYHPGY.2 size=238068 2024-09-12T18:33:07.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.771+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=HKGUKPGYHPGY tag=RZWIP5WBPNHF type=write size=3383796 2024-09-12T18:33:07.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.775+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~2RWDU12K8BEL.0 size=1048576 2024-09-12T18:33:07.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.779+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~2RWDU12K8BEL.1 size=1048576 2024-09-12T18:33:07.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.779+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~2RWDU12K8BEL.2 size=167842 2024-09-12T18:33:07.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.783+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=2RWDU12K8BEL tag=HK13843B9X1C type=write size=3313570 2024-09-12T18:33:07.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.783+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=9MH2SI1OPQD3 type=del size=1525465 2024-09-12T18:33:07.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.787+0000 7f41a072b8c0 1 < completed write operation key=YCBC1CHWJQC5 tag=Y91KS6LOLJYQ type=write size=363856 2024-09-12T18:33:07.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.791+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=REP1GRZCKGYK type=del size=209614 2024-09-12T18:33:07.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.791+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=H9IXY2I2U672 type=del 2024-09-12T18:33:07.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.795+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=0SPS1WX4MDTB type=del size=2840130 2024-09-12T18:33:07.798 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.795+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~OXUTSNN7CANR.0 size=1048576 2024-09-12T18:33:07.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.799+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~OXUTSNN7CANR.1 size=1048576 2024-09-12T18:33:07.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.803+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~OXUTSNN7CANR.2 size=780484 2024-09-12T18:33:07.807 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.807+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=OXUTSNN7CANR tag=8BY1MDOPXFOR type=write size=3926212 2024-09-12T18:33:07.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.811+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~D2WNIIS8WJVI.0 size=102291 2024-09-12T18:33:07.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.811+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=D2WNIIS8WJVI tag=KSE00UHAML6C type=write size=1150867 2024-09-12T18:33:07.813 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.811+0000 7f41a072b8c0 1 < completed delete operation key=1JIIRDVMT0B0 tag=FKZJFBU7GU4E type=del 2024-09-12T18:33:07.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.815+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~BZNXEMQZ4TVQ.0 size=954766 2024-09-12T18:33:07.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.815+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=BZNXEMQZ4TVQ tag=J17HP8XLPU7S type=write size=2003342 2024-09-12T18:33:07.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.823+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~WZCAL1195L5R.0 size=1048576 2024-09-12T18:33:07.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.823+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~WZCAL1195L5R.1 size=775547 2024-09-12T18:33:07.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.827+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=WZCAL1195L5R tag=Z3RGW1UNZ1XB type=write size=2872699 2024-09-12T18:33:07.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.831+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~WJJ9I2P3UB3X.0 size=89211 2024-09-12T18:33:07.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.831+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=WJJ9I2P3UB3X tag=CTZJU77X0YTJ type=write size=1137787 2024-09-12T18:33:07.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.835+0000 7f41a072b8c0 1 < completed write operation key=GC8797KSO47E tag=ZCF1NWQK7R2O type=write size=41025 2024-09-12T18:33:07.837 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.835+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=WLY9GWI0G09Z type=write size=991323 2024-09-12T18:33:07.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.839+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~W29VX9CDKJ06.0 size=1048576 2024-09-12T18:33:07.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.839+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~W29VX9CDKJ06.1 size=1048576 2024-09-12T18:33:07.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.843+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~W29VX9CDKJ06.2 size=344433 2024-09-12T18:33:07.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.847+0000 7f41a072b8c0 1 < completed multipart upload key=L01GL4WOUIL2 upload=W29VX9CDKJ06 tag=Z99OEASMXVXW type=write size=3490161 2024-09-12T18:33:07.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.851+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~CKMUAX2G0ASV.0 size=123349 2024-09-12T18:33:07.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.851+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=CKMUAX2G0ASV tag=MIRCA5KHXFME type=write size=1171925 2024-09-12T18:33:07.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.851+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=0TGK73OH5YUW type=del 2024-09-12T18:33:07.855 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.855+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=ARB8CAGG5R9G type=write size=612302 2024-09-12T18:33:07.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.855+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=WI0BOKJVX2N8 type=del 2024-09-12T18:33:07.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.859+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=TWUFWA2ZLETW type=del size=747776 2024-09-12T18:33:07.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.863+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=78EK1PEU8IPZ type=del 2024-09-12T18:33:07.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.867+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~L40ZUHI9HT5W.0 size=548696 2024-09-12T18:33:07.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.867+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=L40ZUHI9HT5W tag=MX8ZXJ9T5JX8 type=write size=1597272 2024-09-12T18:33:07.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.867+0000 7f41a072b8c0 1 < completed write operation key=1JIIRDVMT0B0 tag=5VG4MTBKGHM1 type=write size=267222 2024-09-12T18:33:07.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.871+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=R01TK8GURX4K type=write size=653949 2024-09-12T18:33:07.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.875+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=S1HO5W6UPZY0 type=del 2024-09-12T18:33:07.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.879+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~JK6VFTFF0IES.0 size=1048576 2024-09-12T18:33:07.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.883+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~JK6VFTFF0IES.1 size=391228 2024-09-12T18:33:07.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.883+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=JK6VFTFF0IES tag=BVRZFIV5SX9D type=write size=2488380 2024-09-12T18:33:07.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.883+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=Q0L9RIYKOJ42 type=del 2024-09-12T18:33:07.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.887+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=Y1Z8XQFPY17T type=write size=454997 2024-09-12T18:33:07.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.887+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=UDEEPPQ3TIPH type=del 2024-09-12T18:33:07.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.891+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=Z8X41N90TJGP type=del size=2460643 2024-09-12T18:33:07.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.891+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~HKGUKPGYHPGY.0 size=1048576 2024-09-12T18:33:07.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.895+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~HKGUKPGYHPGY.1 size=1048576 2024-09-12T18:33:07.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.895+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~HKGUKPGYHPGY.2 size=238068 2024-09-12T18:33:07.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.903+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=HKGUKPGYHPGY tag=RZWIP5WBPNHF type=write size=3383796 2024-09-12T18:33:07.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.907+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~PSKL9RNU4KM3.0 size=1048576 2024-09-12T18:33:07.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.907+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~PSKL9RNU4KM3.1 size=1048576 2024-09-12T18:33:07.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.907+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~PSKL9RNU4KM3.2 size=426799 2024-09-12T18:33:07.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.907+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=PSKL9RNU4KM3 tag=R6T6DPIUMXZR type=write size=3572527 2024-09-12T18:33:07.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.911+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=9MH2SI1OPQD3 type=del 2024-09-12T18:33:07.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.915+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~86KI3L3Z0DYA.0 size=890861 2024-09-12T18:33:07.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.915+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=86KI3L3Z0DYA tag=5JTE8VO5ABJX type=write size=1939437 2024-09-12T18:33:07.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.919+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=REP1GRZCKGYK type=del 2024-09-12T18:33:07.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.923+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~S63V32AXVPYR.0 size=1048576 2024-09-12T18:33:07.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.923+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~S63V32AXVPYR.1 size=56996 2024-09-12T18:33:07.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.923+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=S63V32AXVPYR tag=1EEK4L1X4BGK type=write size=2154148 2024-09-12T18:33:07.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.927+0000 7f41a072b8c0 1 < canceled operation key=GC8797KSO47E tag=0SPS1WX4MDTB type=del size=2840130 2024-09-12T18:33:07.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.927+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=83Q05WPPEU3C type=write size=885757 2024-09-12T18:33:07.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.931+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~D2WNIIS8WJVI.0 size=102291 2024-09-12T18:33:07.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.935+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=D2WNIIS8WJVI tag=KSE00UHAML6C type=write size=1150867 2024-09-12T18:33:07.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.939+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~PNPX00J72QDC.0 size=1048576 2024-09-12T18:33:07.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.939+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~PNPX00J72QDC.1 size=32340 2024-09-12T18:33:07.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.939+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=PNPX00J72QDC tag=XWXW1ATCSSVG type=write size=2129492 2024-09-12T18:33:07.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.943+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~BZNXEMQZ4TVQ.0 size=954766 2024-09-12T18:33:07.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.943+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=BZNXEMQZ4TVQ tag=J17HP8XLPU7S type=write size=2003342 2024-09-12T18:33:07.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.947+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=VOJWTREPQ92W type=write size=647107 2024-09-12T18:33:07.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.951+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~WJJ9I2P3UB3X.0 size=89211 2024-09-12T18:33:07.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.955+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=WJJ9I2P3UB3X tag=CTZJU77X0YTJ type=write size=1137787 2024-09-12T18:33:07.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.955+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=WO3FI6Q21RR4 type=del size=3195550 2024-09-12T18:33:07.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.959+0000 7f41a072b8c0 1 < completed write operation key=GA6P1FACU2EQ tag=WLY9GWI0G09Z type=write size=991323 2024-09-12T18:33:07.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.963+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~WESVRPBXQIFH.0 size=1048576 2024-09-12T18:33:07.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.963+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~WESVRPBXQIFH.1 size=639080 2024-09-12T18:33:07.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.963+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=WESVRPBXQIFH tag=9HEIUYG9Z2I5 type=write size=2736232 2024-09-12T18:33:07.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.967+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~CKMUAX2G0ASV.0 size=123349 2024-09-12T18:33:07.972 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.971+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=CKMUAX2G0ASV tag=MIRCA5KHXFME type=write size=1171925 2024-09-12T18:33:07.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.975+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~ZMFSI8F8C8YM.0 size=1048576 2024-09-12T18:33:07.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.975+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~ZMFSI8F8C8YM.1 size=626010 2024-09-12T18:33:07.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.975+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=ZMFSI8F8C8YM tag=5ZPU4VO0V9QR type=write size=2723162 2024-09-12T18:33:07.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.979+0000 7f41a072b8c0 1 < completed write operation key=58IT2R988AW9 tag=ARB8CAGG5R9G type=write size=612302 2024-09-12T18:33:07.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.983+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~KPR9BPS2Q8WN.0 size=865042 2024-09-12T18:33:07.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.983+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=KPR9BPS2Q8WN tag=I0E41E3LC8LH type=write size=1913618 2024-09-12T18:33:07.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.987+0000 7f41a072b8c0 1 < canceled operation key=VEN0P2P1RZ2S tag=TWUFWA2ZLETW type=del size=747776 2024-09-12T18:33:07.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.991+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~2VAEH79A7TWB.0 size=1048576 2024-09-12T18:33:07.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.991+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~2VAEH79A7TWB.1 size=1048576 2024-09-12T18:33:07.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.995+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~2VAEH79A7TWB.2 size=65667 2024-09-12T18:33:07.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.995+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=2VAEH79A7TWB tag=J4N95CKQFCYK type=write size=3211395 2024-09-12T18:33:07.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:07.999+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~L40ZUHI9HT5W.0 size=548696 2024-09-12T18:33:08.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.003+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=L40ZUHI9HT5W tag=MX8ZXJ9T5JX8 type=write size=1597272 2024-09-12T18:33:08.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.007+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=OYVXID9HPI1F type=del size=955908 2024-09-12T18:33:08.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.007+0000 7f41a072b8c0 1 < completed write operation key=XLGVEN6DF5EW tag=R01TK8GURX4K type=write size=653949 2024-09-12T18:33:08.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.015+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~LX9ZDWHDS3P2.0 size=1048576 2024-09-12T18:33:08.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.015+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~LX9ZDWHDS3P2.1 size=635844 2024-09-12T18:33:08.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.015+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=LX9ZDWHDS3P2 tag=0GPTPPFHAMQG type=write size=2732996 2024-09-12T18:33:08.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.015+0000 7f41a072b8c0 1 < canceled part key=_multipart_SK3T82EJFZXE.2~JK6VFTFF0IES.0 size=1048576 2024-09-12T18:33:08.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.019+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~JK6VFTFF0IES.1 size=391228 2024-09-12T18:33:08.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.023+0000 7f41a072b8c0 1 < canceled multipart upload key=SK3T82EJFZXE upload=JK6VFTFF0IES tag=BVRZFIV5SX9D type=write size=2488380 2024-09-12T18:33:08.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.027+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~DWVOK9PYDROW.0 size=1048576 2024-09-12T18:33:08.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.027+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~DWVOK9PYDROW.1 size=1048576 2024-09-12T18:33:08.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.031+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~DWVOK9PYDROW.2 size=222258 2024-09-12T18:33:08.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.031+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=DWVOK9PYDROW tag=T2NITX8QOT27 type=write size=3367986 2024-09-12T18:33:08.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.035+0000 7f41a072b8c0 1 < completed write operation key=7MRN7L1DTAMO tag=Y1Z8XQFPY17T type=write size=454997 2024-09-12T18:33:08.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.035+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=2JGRR7NWRL2F type=write size=924294 2024-09-12T18:33:08.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.039+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=Z8X41N90TJGP type=del 2024-09-12T18:33:08.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.047+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~D4AIP8QR6I1J.0 size=1048576 2024-09-12T18:33:08.050 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.051+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~D4AIP8QR6I1J.1 size=1048576 2024-09-12T18:33:08.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.051+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~D4AIP8QR6I1J.2 size=62336 2024-09-12T18:33:08.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.051+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=D4AIP8QR6I1J tag=KPSL7YP87OJC type=write size=3208064 2024-09-12T18:33:08.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.055+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~PSKL9RNU4KM3.0 size=1048576 2024-09-12T18:33:08.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.055+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~PSKL9RNU4KM3.1 size=1048576 2024-09-12T18:33:08.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.059+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~PSKL9RNU4KM3.2 size=426799 2024-09-12T18:33:08.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.063+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=PSKL9RNU4KM3 tag=R6T6DPIUMXZR type=write size=3572527 2024-09-12T18:33:08.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.067+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~JE1OZVBGX5CQ.0 size=1048576 2024-09-12T18:33:08.070 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.067+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~JE1OZVBGX5CQ.1 size=373491 2024-09-12T18:33:08.070 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.067+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=JE1OZVBGX5CQ tag=J7OJ42XW8D28 type=write size=2470643 2024-09-12T18:33:08.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.071+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~86KI3L3Z0DYA.0 size=890861 2024-09-12T18:33:08.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.075+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=86KI3L3Z0DYA tag=5JTE8VO5ABJX type=write size=1939437 2024-09-12T18:33:08.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.079+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~N7PR8PXA103S.0 size=1048576 2024-09-12T18:33:08.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.083+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~N7PR8PXA103S.1 size=518379 2024-09-12T18:33:08.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.083+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=N7PR8PXA103S tag=N5NW0P4VUHLP type=write size=2615531 2024-09-12T18:33:08.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.087+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~S63V32AXVPYR.0 size=1048576 2024-09-12T18:33:08.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.087+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~S63V32AXVPYR.1 size=56996 2024-09-12T18:33:08.095 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.095+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=S63V32AXVPYR tag=1EEK4L1X4BGK type=write size=2154148 2024-09-12T18:33:08.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.095+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=SFBTNT52JGA9 type=del size=855340 2024-09-12T18:33:08.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.099+0000 7f41a072b8c0 1 < completed write operation key=5JUWC8RXSA5L tag=83Q05WPPEU3C type=write size=885757 2024-09-12T18:33:08.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.103+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=CU9178R6MLRK type=write size=515561 2024-09-12T18:33:08.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.107+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~PNPX00J72QDC.0 size=1048576 2024-09-12T18:33:08.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.107+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~PNPX00J72QDC.1 size=32340 2024-09-12T18:33:08.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.115+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=PNPX00J72QDC tag=XWXW1ATCSSVG type=write size=2129492 2024-09-12T18:33:08.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.115+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=P9E1RPWRGXO0 type=del size=2442739 2024-09-12T18:33:08.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.123+0000 7f41a072b8c0 1 < suggested update operation key=YCBC1CHWJQC5 tag=VOJWTREPQ92W type=write size=647107 2024-09-12T18:33:08.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.127+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=R35M0VU604DA type=write size=290041 2024-09-12T18:33:08.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.127+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=WO3FI6Q21RR4 type=del 2024-09-12T18:33:08.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.135+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~5QQY6I34Z4V1.0 size=1048576 2024-09-12T18:33:08.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.135+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~5QQY6I34Z4V1.1 size=1048576 2024-09-12T18:33:08.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.139+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~5QQY6I34Z4V1.2 size=815286 2024-09-12T18:33:08.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.139+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=5QQY6I34Z4V1 tag=Q8TLRKU7UHSY type=write size=3961014 2024-09-12T18:33:08.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.139+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~WESVRPBXQIFH.0 size=1048576 2024-09-12T18:33:08.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.143+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~WESVRPBXQIFH.1 size=639080 2024-09-12T18:33:08.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.147+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=WESVRPBXQIFH tag=9HEIUYG9Z2I5 type=write size=2736232 2024-09-12T18:33:08.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.151+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=FVDHBSYO0N1J type=del size=3698783 2024-09-12T18:33:08.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.155+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~ZMFSI8F8C8YM.0 size=1048576 2024-09-12T18:33:08.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.155+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~ZMFSI8F8C8YM.1 size=626010 2024-09-12T18:33:08.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.163+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=ZMFSI8F8C8YM tag=5ZPU4VO0V9QR type=write size=2723162 2024-09-12T18:33:08.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.167+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~YJ9CVIL2Y4TB.0 size=792678 2024-09-12T18:33:08.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.167+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=YJ9CVIL2Y4TB tag=HV4HUDA5Q6D3 type=write size=1841254 2024-09-12T18:33:08.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.167+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~KPR9BPS2Q8WN.0 size=865042 2024-09-12T18:33:08.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.171+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=KPR9BPS2Q8WN tag=I0E41E3LC8LH type=write size=1913618 2024-09-12T18:33:08.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.175+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=HR64TUGC93JQ type=del size=2612854 2024-09-12T18:33:08.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.179+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~2VAEH79A7TWB.0 size=1048576 2024-09-12T18:33:08.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.183+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~2VAEH79A7TWB.1 size=1048576 2024-09-12T18:33:08.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.183+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~2VAEH79A7TWB.2 size=65667 2024-09-12T18:33:08.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.187+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=2VAEH79A7TWB tag=J4N95CKQFCYK type=write size=3211395 2024-09-12T18:33:08.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.195+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~HVC19Q70THPQ.0 size=1048576 2024-09-12T18:33:08.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.195+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~HVC19Q70THPQ.1 size=672122 2024-09-12T18:33:08.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.195+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=HVC19Q70THPQ tag=BHTWIJ0VXW0H type=write size=2769274 2024-09-12T18:33:08.200 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.199+0000 7f41a072b8c0 1 < canceled operation key=3CGBX19WTMWQ tag=OYVXID9HPI1F type=del size=955908 2024-09-12T18:33:08.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.203+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~FZQAOC9SMNEU.0 size=1048576 2024-09-12T18:33:08.208 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.207+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~FZQAOC9SMNEU.1 size=981124 2024-09-12T18:33:08.208 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.207+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=FZQAOC9SMNEU tag=V1UJ0E6SMR84 type=write size=3078276 2024-09-12T18:33:08.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.211+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~LX9ZDWHDS3P2.0 size=1048576 2024-09-12T18:33:08.213 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.211+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~LX9ZDWHDS3P2.1 size=635844 2024-09-12T18:33:08.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.215+0000 7f41a072b8c0 1 < completed multipart upload key=1BSAN5TRTZNZ upload=LX9ZDWHDS3P2 tag=0GPTPPFHAMQG type=write size=2732996 2024-09-12T18:33:08.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.223+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~TOB0K1TJTUZF.0 size=1048576 2024-09-12T18:33:08.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.223+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~TOB0K1TJTUZF.1 size=1048576 2024-09-12T18:33:08.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.227+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~TOB0K1TJTUZF.2 size=485757 2024-09-12T18:33:08.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.227+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=TOB0K1TJTUZF tag=2RZCI8ACBTM3 type=write size=3631485 2024-09-12T18:33:08.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.231+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~DWVOK9PYDROW.0 size=1048576 2024-09-12T18:33:08.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.231+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~DWVOK9PYDROW.1 size=1048576 2024-09-12T18:33:08.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.235+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~DWVOK9PYDROW.2 size=222258 2024-09-12T18:33:08.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.239+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=DWVOK9PYDROW tag=T2NITX8QOT27 type=write size=3367986 2024-09-12T18:33:08.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.243+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~MJ7NL3XQEERX.0 size=667280 2024-09-12T18:33:08.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.243+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=MJ7NL3XQEERX tag=GOM6E6UPMEXF type=write size=1715856 2024-09-12T18:33:08.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.247+0000 7f41a072b8c0 1 < suggested update operation key=31T6AP6MUBKL tag=2JGRR7NWRL2F type=write size=924294 2024-09-12T18:33:08.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.251+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~9T33K0U87DYD.0 size=1048576 2024-09-12T18:33:08.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.255+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~9T33K0U87DYD.1 size=1048576 2024-09-12T18:33:08.258 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.255+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~9T33K0U87DYD.2 size=492398 2024-09-12T18:33:08.258 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.255+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=9T33K0U87DYD tag=2JBTXRMJBW7E type=write size=3638126 2024-09-12T18:33:08.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.259+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~D4AIP8QR6I1J.0 size=1048576 2024-09-12T18:33:08.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.263+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~D4AIP8QR6I1J.1 size=1048576 2024-09-12T18:33:08.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.263+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~D4AIP8QR6I1J.2 size=62336 2024-09-12T18:33:08.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.267+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=D4AIP8QR6I1J tag=KPSL7YP87OJC type=write size=3208064 2024-09-12T18:33:08.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.271+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~Q57XOKJ29TDE.0 size=768431 2024-09-12T18:33:08.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.271+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=Q57XOKJ29TDE tag=8Y7PIE1FFPSQ type=write size=1817007 2024-09-12T18:33:08.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.275+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~JE1OZVBGX5CQ.0 size=1048576 2024-09-12T18:33:08.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.279+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~JE1OZVBGX5CQ.1 size=373491 2024-09-12T18:33:08.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.283+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=JE1OZVBGX5CQ tag=J7OJ42XW8D28 type=write size=2470643 2024-09-12T18:33:08.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.283+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=7FQO6HOZ9VLC type=del size=3775507 2024-09-12T18:33:08.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.287+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~N7PR8PXA103S.0 size=1048576 2024-09-12T18:33:08.290 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.287+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~N7PR8PXA103S.1 size=518379 2024-09-12T18:33:08.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.299+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=N7PR8PXA103S tag=N5NW0P4VUHLP type=write size=2615531 2024-09-12T18:33:08.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.299+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=HB9XJAVII2C5 type=del size=3159493 2024-09-12T18:33:08.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.303+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=SFBTNT52JGA9 type=del 2024-09-12T18:33:08.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.303+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=UL89HHU0K826 type=del size=285112 2024-09-12T18:33:08.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.311+0000 7f41a072b8c0 1 < suggested remove operation key=3R9RN03RFRJP tag=CU9178R6MLRK type=write 2024-09-12T18:33:08.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.311+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=800VH0Z500AT type=del size=749960 2024-09-12T18:33:08.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.319+0000 7f41a072b8c0 1 < suggested remove operation key=0G0YWIOD3L3I tag=P9E1RPWRGXO0 type=del 2024-09-12T18:33:08.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.323+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~159027QP6JFS.0 size=1048576 2024-09-12T18:33:08.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.323+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~159027QP6JFS.1 size=469635 2024-09-12T18:33:08.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.323+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=159027QP6JFS tag=UNL8J15TL36K type=write size=2566787 2024-09-12T18:33:08.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.331+0000 7f41a072b8c0 1 < suggested remove operation key=58IT2R988AW9 tag=R35M0VU604DA type=write 2024-09-12T18:33:08.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.331+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=Y9W77V9X9QTN type=del size=2597336 2024-09-12T18:33:08.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.335+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~5QQY6I34Z4V1.0 size=1048576 2024-09-12T18:33:08.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.339+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~5QQY6I34Z4V1.1 size=1048576 2024-09-12T18:33:08.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.343+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~5QQY6I34Z4V1.2 size=815286 2024-09-12T18:33:08.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.347+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=5QQY6I34Z4V1 tag=Q8TLRKU7UHSY type=write size=3961014 2024-09-12T18:33:08.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.351+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=SNDSMT90EWGT type=del size=4008289 2024-09-12T18:33:08.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.355+0000 7f41a072b8c0 1 < suggested remove operation key=YCBC1CHWJQC5 tag=FVDHBSYO0N1J type=del 2024-09-12T18:33:08.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.359+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=6JJGQTD8OR4O type=write size=505816 2024-09-12T18:33:08.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.363+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~YJ9CVIL2Y4TB.0 size=792678 2024-09-12T18:33:08.369 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.367+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=YJ9CVIL2Y4TB tag=HV4HUDA5Q6D3 type=write size=1841254 2024-09-12T18:33:08.375 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.375+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~A43OA4PPW7SZ.0 size=1048576 2024-09-12T18:33:08.377 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.375+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~A43OA4PPW7SZ.1 size=1048576 2024-09-12T18:33:08.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.379+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~A43OA4PPW7SZ.2 size=181006 2024-09-12T18:33:08.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.379+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=A43OA4PPW7SZ tag=LBB2JSKFZH6S type=write size=3326734 2024-09-12T18:33:08.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.383+0000 7f41a072b8c0 -1 < failed to complete operation key=31T6AP6MUBKL tag=HR64TUGC93JQ type=del size=2612854: (22) Invalid argument 2024-09-12T18:33:08.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.383+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=D619IUDRH359 type=del size=2987297 2024-09-12T18:33:08.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.387+0000 7f41a072b8c0 1 < canceled part key=_multipart_5JUWC8RXSA5L.2~HVC19Q70THPQ.0 size=1048576 2024-09-12T18:33:08.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.387+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~HVC19Q70THPQ.1 size=672122 2024-09-12T18:33:08.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.391+0000 7f41a072b8c0 1 < canceled multipart upload key=5JUWC8RXSA5L upload=HVC19Q70THPQ tag=BHTWIJ0VXW0H type=write size=2769274 2024-09-12T18:33:08.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.395+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=744G0ZXPIB22 type=del size=914501 2024-09-12T18:33:08.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.399+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~FZQAOC9SMNEU.0 size=1048576 2024-09-12T18:33:08.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.403+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~FZQAOC9SMNEU.1 size=981124 2024-09-12T18:33:08.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.407+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=FZQAOC9SMNEU tag=V1UJ0E6SMR84 type=write size=3078276 2024-09-12T18:33:08.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.411+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=TXA4AUY5HOGC type=del size=4101309 2024-09-12T18:33:08.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.415+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~TOB0K1TJTUZF.0 size=1048576 2024-09-12T18:33:08.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.415+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~TOB0K1TJTUZF.1 size=1048576 2024-09-12T18:33:08.419 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.419+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~TOB0K1TJTUZF.2 size=485757 2024-09-12T18:33:08.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.423+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=TOB0K1TJTUZF tag=2RZCI8ACBTM3 type=write size=3631485 2024-09-12T18:33:08.427 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.427+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=LMLJYPRM3Y0V type=del size=1221140 2024-09-12T18:33:08.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.431+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~MJ7NL3XQEERX.0 size=667280 2024-09-12T18:33:08.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.435+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=MJ7NL3XQEERX tag=GOM6E6UPMEXF type=write size=1715856 2024-09-12T18:33:08.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.439+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~S9RK0WI84PYX.0 size=360595 2024-09-12T18:33:08.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.439+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=S9RK0WI84PYX tag=NQXP7CEVJ0GD type=write size=1409171 2024-09-12T18:33:08.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.443+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~9T33K0U87DYD.0 size=1048576 2024-09-12T18:33:08.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.443+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~9T33K0U87DYD.1 size=1048576 2024-09-12T18:33:08.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.447+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~9T33K0U87DYD.2 size=492398 2024-09-12T18:33:08.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.451+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=9T33K0U87DYD tag=2JBTXRMJBW7E type=write size=3638126 2024-09-12T18:33:08.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.459+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~QPJJNL2R99LW.0 size=1048576 2024-09-12T18:33:08.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.459+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~QPJJNL2R99LW.1 size=114162 2024-09-12T18:33:08.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.459+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=QPJJNL2R99LW tag=KJW24WC9OF5R type=write size=2211314 2024-09-12T18:33:08.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.463+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~Q57XOKJ29TDE.0 size=768431 2024-09-12T18:33:08.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.471+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=Q57XOKJ29TDE tag=8Y7PIE1FFPSQ type=write size=1817007 2024-09-12T18:33:08.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.475+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~XZD2CUWDWA5E.0 size=499284 2024-09-12T18:33:08.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.475+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=XZD2CUWDWA5E tag=6OIKT5YJ98NO type=write size=1547860 2024-09-12T18:33:08.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.479+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=7FQO6HOZ9VLC type=del 2024-09-12T18:33:08.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.483+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=X6KQJG372FGR type=del size=3203377 2024-09-12T18:33:08.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.487+0000 7f41a072b8c0 1 < suggested update operation key=58IT2R988AW9 tag=HB9XJAVII2C5 type=del size=3159493 2024-09-12T18:33:08.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.495+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~N91TP0W5L3ZB.0 size=833421 2024-09-12T18:33:08.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.495+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=N91TP0W5L3ZB tag=7HHXXP57PKC3 type=write size=1881997 2024-09-12T18:33:08.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.499+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=UL89HHU0K826 type=del 2024-09-12T18:33:08.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.499+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=6I6BIBE5HJML type=del size=691311 2024-09-12T18:33:08.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.503+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=800VH0Z500AT type=del 2024-09-12T18:33:08.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.507+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=UDG1D54ITIW8 type=del size=3763742 2024-09-12T18:33:08.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.511+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~159027QP6JFS.0 size=1048576 2024-09-12T18:33:08.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.511+0000 7f41a072b8c0 1 < canceled part key=_multipart_0O97F5ON55TX.2~159027QP6JFS.1 size=469635 2024-09-12T18:33:08.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.515+0000 7f41a072b8c0 1 < canceled multipart upload key=0O97F5ON55TX upload=159027QP6JFS tag=UNL8J15TL36K type=write size=2566787 2024-09-12T18:33:08.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.519+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=0GQXYOSMM0DE type=del size=123889 2024-09-12T18:33:08.523 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.523+0000 7f41a072b8c0 -1 < failed to complete operation key=58IT2R988AW9 tag=Y9W77V9X9QTN type=del size=2597336: (22) Invalid argument 2024-09-12T18:33:08.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.527+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~UWOUEVJJBUMK.0 size=152078 2024-09-12T18:33:08.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.527+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=UWOUEVJJBUMK tag=XEKJ7ZBGLWB1 type=write size=1200654 2024-09-12T18:33:08.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.531+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=SNDSMT90EWGT type=del 2024-09-12T18:33:08.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.535+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=VH8411XQQ351 type=write size=1047003 2024-09-12T18:33:08.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.539+0000 7f41a072b8c0 1 < suggested remove operation key=3CGBX19WTMWQ tag=6JJGQTD8OR4O type=write 2024-09-12T18:33:08.547 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.547+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~JTGM97ACZR9P.0 size=519489 2024-09-12T18:33:08.547 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.547+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=JTGM97ACZR9P tag=IBVH7PVI56CU type=write size=1568065 2024-09-12T18:33:08.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.551+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~A43OA4PPW7SZ.0 size=1048576 2024-09-12T18:33:08.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.551+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~A43OA4PPW7SZ.1 size=1048576 2024-09-12T18:33:08.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.555+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~A43OA4PPW7SZ.2 size=181006 2024-09-12T18:33:08.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.559+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=A43OA4PPW7SZ tag=LBB2JSKFZH6S type=write size=3326734 2024-09-12T18:33:08.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.567+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~IIP9KI4EUNQY.0 size=238145 2024-09-12T18:33:08.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.567+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=IIP9KI4EUNQY tag=KCUXBWYV2T19 type=write size=1286721 2024-09-12T18:33:08.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.567+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=D619IUDRH359 type=del 2024-09-12T18:33:08.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.575+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~EOKT9J4GRANR.0 size=1048576 2024-09-12T18:33:08.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.583+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~EOKT9J4GRANR.1 size=1048576 2024-09-12T18:33:08.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.587+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~EOKT9J4GRANR.2 size=993915 2024-09-12T18:33:08.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.587+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=EOKT9J4GRANR tag=W1O319VWD8YZ type=write size=4139643 2024-09-12T18:33:08.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.587+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=744G0ZXPIB22 type=del 2024-09-12T18:33:08.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.591+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=K4VGP32RCN1S type=del size=1812343 2024-09-12T18:33:08.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.595+0000 7f41a072b8c0 1 < canceled operation key=YCBC1CHWJQC5 tag=TXA4AUY5HOGC type=del size=4101309 2024-09-12T18:33:08.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.599+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=CNMR2YOJ1LD8 type=del size=642984 2024-09-12T18:33:08.602 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.603+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=LMLJYPRM3Y0V type=del 2024-09-12T18:33:08.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.603+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=HAENTD3IKBLS type=del size=2368590 2024-09-12T18:33:08.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.607+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~S9RK0WI84PYX.0 size=360595 2024-09-12T18:33:08.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.615+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=S9RK0WI84PYX tag=NQXP7CEVJ0GD type=write size=1409171 2024-09-12T18:33:08.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.619+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~OM00WGGMY6WG.0 size=1048576 2024-09-12T18:33:08.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.623+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~OM00WGGMY6WG.1 size=675684 2024-09-12T18:33:08.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.623+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=OM00WGGMY6WG tag=IH0UNZT91MKE type=write size=2772836 2024-09-12T18:33:08.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.623+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~QPJJNL2R99LW.0 size=1048576 2024-09-12T18:33:08.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.627+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~QPJJNL2R99LW.1 size=114162 2024-09-12T18:33:08.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.635+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=QPJJNL2R99LW tag=KJW24WC9OF5R type=write size=2211314 2024-09-12T18:33:08.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.639+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~36NK28F486SD.0 size=1048576 2024-09-12T18:33:08.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.643+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~36NK28F486SD.1 size=498165 2024-09-12T18:33:08.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.643+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=36NK28F486SD tag=1L3Q5FME5OCU type=write size=2595317 2024-09-12T18:33:08.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.647+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~XZD2CUWDWA5E.0 size=499284 2024-09-12T18:33:08.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.651+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=XZD2CUWDWA5E tag=6OIKT5YJ98NO type=write size=1547860 2024-09-12T18:33:08.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.655+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=G6M0SZHT94LC type=del size=674058 2024-09-12T18:33:08.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.655+0000 7f41a072b8c0 -1 < failed to complete operation key=58IT2R988AW9 tag=X6KQJG372FGR type=del size=3203377: (22) Invalid argument 2024-09-12T18:33:08.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.659+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=06JFGVE162NL type=del size=2278485 2024-09-12T18:33:08.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.663+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~N91TP0W5L3ZB.0 size=833421 2024-09-12T18:33:08.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.667+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=N91TP0W5L3ZB tag=7HHXXP57PKC3 type=write size=1881997 2024-09-12T18:33:08.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.675+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~R9CCPIPS7F4H.0 size=1048576 2024-09-12T18:33:08.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.675+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~R9CCPIPS7F4H.1 size=118995 2024-09-12T18:33:08.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.675+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=R9CCPIPS7F4H tag=2BSIVR5JEHPP type=write size=2216147 2024-09-12T18:33:08.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.679+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=6I6BIBE5HJML type=del 2024-09-12T18:33:08.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.683+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~5JTG10L4906Y.0 size=1048576 2024-09-12T18:33:08.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.687+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~5JTG10L4906Y.1 size=1048576 2024-09-12T18:33:08.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.691+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~5JTG10L4906Y.2 size=65248 2024-09-12T18:33:08.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.691+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=5JTG10L4906Y tag=EO52ARTD1Z26 type=write size=3210976 2024-09-12T18:33:08.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.691+0000 7f41a072b8c0 1 < completed delete operation key=YP72VTCGSHYE tag=UDG1D54ITIW8 type=del 2024-09-12T18:33:08.697 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.695+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=MUQ91R6IKIAK type=del size=3988337 2024-09-12T18:33:08.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.699+0000 7f41a072b8c0 1 < completed delete operation key=KP2HF4J376EY tag=0GQXYOSMM0DE type=del 2024-09-12T18:33:08.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.707+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~3ERLGEFN27ZK.0 size=1048576 2024-09-12T18:33:08.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.707+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~3ERLGEFN27ZK.1 size=1048576 2024-09-12T18:33:08.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.711+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~3ERLGEFN27ZK.2 size=644433 2024-09-12T18:33:08.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.711+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=3ERLGEFN27ZK tag=ZK73BSKE4ON0 type=write size=3790161 2024-09-12T18:33:08.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.715+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~UWOUEVJJBUMK.0 size=152078 2024-09-12T18:33:08.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.719+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=UWOUEVJJBUMK tag=XEKJ7ZBGLWB1 type=write size=1200654 2024-09-12T18:33:08.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.723+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=FKGRIASLMIG4 type=del size=685232 2024-09-12T18:33:08.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.727+0000 7f41a072b8c0 1 < completed write operation key=GA6P1FACU2EQ tag=VH8411XQQ351 type=write size=1047003 2024-09-12T18:33:08.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.731+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=S2IH64NRL6GA type=write size=51298 2024-09-12T18:33:08.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.731+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~JTGM97ACZR9P.0 size=519489 2024-09-12T18:33:08.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.735+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=JTGM97ACZR9P tag=IBVH7PVI56CU type=write size=1568065 2024-09-12T18:33:08.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.739+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=XJOLHJSB61XQ type=del size=1002051 2024-09-12T18:33:08.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.743+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~IIP9KI4EUNQY.0 size=238145 2024-09-12T18:33:08.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.747+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=IIP9KI4EUNQY tag=KCUXBWYV2T19 type=write size=1286721 2024-09-12T18:33:08.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.751+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=PMFMQKXOL2NJ type=del size=434306 2024-09-12T18:33:08.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.755+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~EOKT9J4GRANR.0 size=1048576 2024-09-12T18:33:08.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.755+0000 7f41a072b8c0 1 < canceled part key=_multipart_GA6P1FACU2EQ.2~EOKT9J4GRANR.1 size=1048576 2024-09-12T18:33:08.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.755+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~EOKT9J4GRANR.2 size=993915 2024-09-12T18:33:08.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.763+0000 7f41a072b8c0 1 < canceled multipart upload key=GA6P1FACU2EQ upload=EOKT9J4GRANR tag=W1O319VWD8YZ type=write size=4139643 2024-09-12T18:33:08.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.767+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~4FNDM0A60F8W.0 size=1048576 2024-09-12T18:33:08.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.771+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~4FNDM0A60F8W.1 size=1048576 2024-09-12T18:33:08.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.771+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~4FNDM0A60F8W.2 size=462502 2024-09-12T18:33:08.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.771+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=4FNDM0A60F8W tag=9O3KU4WF8ELA type=write size=3608230 2024-09-12T18:33:08.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.775+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=K4VGP32RCN1S type=del 2024-09-12T18:33:08.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.779+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~BCVB4E2AWCQD.0 size=925380 2024-09-12T18:33:08.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.779+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=BCVB4E2AWCQD tag=0R0QMSAVJPS5 type=write size=1973956 2024-09-12T18:33:08.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.783+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=CNMR2YOJ1LD8 type=del 2024-09-12T18:33:08.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.787+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=65EX0NFFBMK3 type=del size=1152133 2024-09-12T18:33:08.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.787+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=HAENTD3IKBLS type=del 2024-09-12T18:33:08.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.795+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~2ZCSLZR4PBFM.0 size=1048576 2024-09-12T18:33:08.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.795+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~2ZCSLZR4PBFM.1 size=1048576 2024-09-12T18:33:08.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.799+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~2ZCSLZR4PBFM.2 size=5773 2024-09-12T18:33:08.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.799+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=2ZCSLZR4PBFM tag=O5N39C5BOXCQ type=write size=3151501 2024-09-12T18:33:08.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.799+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~OM00WGGMY6WG.0 size=1048576 2024-09-12T18:33:08.804 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.803+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~OM00WGGMY6WG.1 size=675684 2024-09-12T18:33:08.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.807+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=OM00WGGMY6WG tag=IH0UNZT91MKE type=write size=2772836 2024-09-12T18:33:08.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.815+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~6ZCZYGUIQ5T8.0 size=1048576 2024-09-12T18:33:08.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.815+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~6ZCZYGUIQ5T8.1 size=316722 2024-09-12T18:33:08.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.815+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=6ZCZYGUIQ5T8 tag=Q6AIANWL5NON type=write size=2413874 2024-09-12T18:33:08.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.819+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~36NK28F486SD.0 size=1048576 2024-09-12T18:33:08.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.823+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~36NK28F486SD.1 size=498165 2024-09-12T18:33:08.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.827+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=36NK28F486SD tag=1L3Q5FME5OCU type=write size=2595317 2024-09-12T18:33:08.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.831+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=Z640NS8G6W8I type=del size=2053017 2024-09-12T18:33:08.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.831+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=G6M0SZHT94LC type=del 2024-09-12T18:33:08.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.835+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=AOOVRVQN0BW0 type=write size=264667 2024-09-12T18:33:08.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.839+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=06JFGVE162NL type=del 2024-09-12T18:33:08.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.843+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~FMI6Q2UGCUG6.0 size=125021 2024-09-12T18:33:08.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.843+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=FMI6Q2UGCUG6 tag=ZFWQCVQ348AF type=write size=1173597 2024-09-12T18:33:08.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.847+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~R9CCPIPS7F4H.0 size=1048576 2024-09-12T18:33:08.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.847+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~R9CCPIPS7F4H.1 size=118995 2024-09-12T18:33:08.855 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.855+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=R9CCPIPS7F4H tag=2BSIVR5JEHPP type=write size=2216147 2024-09-12T18:33:08.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.859+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~U9TMM7YBASUI.0 size=1048576 2024-09-12T18:33:08.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.863+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~U9TMM7YBASUI.1 size=1048576 2024-09-12T18:33:08.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.867+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~U9TMM7YBASUI.2 size=664624 2024-09-12T18:33:08.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.867+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=U9TMM7YBASUI tag=FE2081VBGGCJ type=write size=3810352 2024-09-12T18:33:08.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.871+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~5JTG10L4906Y.0 size=1048576 2024-09-12T18:33:08.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.871+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~5JTG10L4906Y.1 size=1048576 2024-09-12T18:33:08.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.875+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~5JTG10L4906Y.2 size=65248 2024-09-12T18:33:08.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.879+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=5JTG10L4906Y tag=EO52ARTD1Z26 type=write size=3210976 2024-09-12T18:33:08.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.879+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=3VVAAS53KZ25 type=write size=1034630 2024-09-12T18:33:08.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.883+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=MUQ91R6IKIAK type=del 2024-09-12T18:33:08.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.887+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=0YB858N3S4XG type=del size=3236132 2024-09-12T18:33:08.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.887+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~3ERLGEFN27ZK.0 size=1048576 2024-09-12T18:33:08.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.891+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~3ERLGEFN27ZK.1 size=1048576 2024-09-12T18:33:08.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.895+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~3ERLGEFN27ZK.2 size=644433 2024-09-12T18:33:08.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.899+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=3ERLGEFN27ZK tag=ZK73BSKE4ON0 type=write size=3790161 2024-09-12T18:33:08.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.899+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=CE50DNXRCZ7I type=del size=2377730 2024-09-12T18:33:08.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.907+0000 7f41a072b8c0 1 < suggested update operation key=31T6AP6MUBKL tag=FKGRIASLMIG4 type=del size=685232 2024-09-12T18:33:08.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.907+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=A1EPUDEQ4PBI type=del size=2729273 2024-09-12T18:33:08.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.915+0000 7f41a072b8c0 1 < suggested update operation key=KP2HF4J376EY tag=S2IH64NRL6GA type=write size=51298 2024-09-12T18:33:08.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.915+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=1HI554ZSESKM type=del size=682564 2024-09-12T18:33:08.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.919+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=XJOLHJSB61XQ type=del 2024-09-12T18:33:08.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.919+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=TWHEJPMPX5L8 type=del size=3578500 2024-09-12T18:33:08.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.923+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=PMFMQKXOL2NJ type=del 2024-09-12T18:33:08.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.923+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=FK63HXETEZ2J type=write size=711608 2024-09-12T18:33:08.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.927+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~4FNDM0A60F8W.0 size=1048576 2024-09-12T18:33:08.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.931+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~4FNDM0A60F8W.1 size=1048576 2024-09-12T18:33:08.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.931+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~4FNDM0A60F8W.2 size=462502 2024-09-12T18:33:08.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.935+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=4FNDM0A60F8W tag=9O3KU4WF8ELA type=write size=3608230 2024-09-12T18:33:08.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.939+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=GPIQI4JKVLCB type=del size=1621903 2024-09-12T18:33:08.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.943+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~BCVB4E2AWCQD.0 size=925380 2024-09-12T18:33:08.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.947+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=BCVB4E2AWCQD tag=0R0QMSAVJPS5 type=write size=1973956 2024-09-12T18:33:08.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.951+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~72I33V50KQHU.0 size=917773 2024-09-12T18:33:08.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.951+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=72I33V50KQHU tag=9XZV69ST23WL type=write size=1966349 2024-09-12T18:33:08.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.951+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=65EX0NFFBMK3 type=del 2024-09-12T18:33:08.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.959+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~YX3R010YQGR6.0 size=1048576 2024-09-12T18:33:08.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.959+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~YX3R010YQGR6.1 size=1048576 2024-09-12T18:33:08.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.963+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~YX3R010YQGR6.2 size=1022366 2024-09-12T18:33:08.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.963+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=YX3R010YQGR6 tag=GMZ22VS9O8WJ type=write size=4168094 2024-09-12T18:33:08.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.967+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~2ZCSLZR4PBFM.0 size=1048576 2024-09-12T18:33:08.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.971+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~2ZCSLZR4PBFM.1 size=1048576 2024-09-12T18:33:08.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.971+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~2ZCSLZR4PBFM.2 size=5773 2024-09-12T18:33:08.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.975+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=2ZCSLZR4PBFM tag=O5N39C5BOXCQ type=write size=3151501 2024-09-12T18:33:08.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.983+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~Y0EJ9LEXEG54.0 size=429444 2024-09-12T18:33:08.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.983+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=Y0EJ9LEXEG54 tag=RA3743F2D5R6 type=write size=1478020 2024-09-12T18:33:08.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.983+0000 7f41a072b8c0 1 < canceled part key=_multipart_P732C5X0RG8Z.2~6ZCZYGUIQ5T8.0 size=1048576 2024-09-12T18:33:08.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.983+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~6ZCZYGUIQ5T8.1 size=316722 2024-09-12T18:33:08.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.987+0000 7f41a072b8c0 1 < canceled multipart upload key=P732C5X0RG8Z upload=6ZCZYGUIQ5T8 tag=Q6AIANWL5NON type=write size=2413874 2024-09-12T18:33:08.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.991+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~KK0LZE9I3SZY.0 size=1048576 2024-09-12T18:33:08.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.995+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~KK0LZE9I3SZY.1 size=1048576 2024-09-12T18:33:08.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.995+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~KK0LZE9I3SZY.2 size=859794 2024-09-12T18:33:08.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.995+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=KK0LZE9I3SZY tag=T4H3CO6O6S0X type=write size=4005522 2024-09-12T18:33:09.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:08.999+0000 7f41a072b8c0 1 < suggested update operation key=NKMA8FG3V3TR tag=Z640NS8G6W8I type=del size=2053017 2024-09-12T18:33:09.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.003+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=DYYQPNTBFU1F type=write size=314281 2024-09-12T18:33:09.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.007+0000 7f41a072b8c0 1 < completed write operation key=63BP9QETTAM8 tag=AOOVRVQN0BW0 type=write size=264667 2024-09-12T18:33:09.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.007+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=G078ANZISVJ9 type=write size=21097 2024-09-12T18:33:09.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.011+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~FMI6Q2UGCUG6.0 size=125021 2024-09-12T18:33:09.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.015+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=FMI6Q2UGCUG6 tag=ZFWQCVQ348AF type=write size=1173597 2024-09-12T18:33:09.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.019+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=PYOHMPK65I09 type=del size=1935754 2024-09-12T18:33:09.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.023+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~U9TMM7YBASUI.0 size=1048576 2024-09-12T18:33:09.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.023+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~U9TMM7YBASUI.1 size=1048576 2024-09-12T18:33:09.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.027+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~U9TMM7YBASUI.2 size=664624 2024-09-12T18:33:09.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.031+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=U9TMM7YBASUI tag=FE2081VBGGCJ type=write size=3810352 2024-09-12T18:33:09.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.035+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~7I1FAPORN9C9.0 size=1048576 2024-09-12T18:33:09.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.039+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~7I1FAPORN9C9.1 size=1048576 2024-09-12T18:33:09.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.039+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~7I1FAPORN9C9.2 size=617810 2024-09-12T18:33:09.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.039+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=7I1FAPORN9C9 tag=XRP9ZDXPOH1N type=write size=3763538 2024-09-12T18:33:09.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.043+0000 7f41a072b8c0 1 < completed write operation key=YP72VTCGSHYE tag=3VVAAS53KZ25 type=write size=1034630 2024-09-12T18:33:09.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.047+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=7B6INZ3G69E7 type=del size=412813 2024-09-12T18:33:09.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.047+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=0YB858N3S4XG type=del 2024-09-12T18:33:09.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.051+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~BJJU66KK2HIG.0 size=611405 2024-09-12T18:33:09.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.051+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=BJJU66KK2HIG tag=OVB9JU96V3JZ type=write size=1659981 2024-09-12T18:33:09.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.055+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=CE50DNXRCZ7I type=del 2024-09-12T18:33:09.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.059+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~VBHO8QKYZ33U.0 size=1048576 2024-09-12T18:33:09.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.063+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~VBHO8QKYZ33U.1 size=393855 2024-09-12T18:33:09.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.063+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=VBHO8QKYZ33U tag=0PP3HBD3P5Z9 type=write size=2491007 2024-09-12T18:33:09.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.067+0000 7f41a072b8c0 1 < suggested remove operation key=0G0YWIOD3L3I tag=A1EPUDEQ4PBI type=del 2024-09-12T18:33:09.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.071+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~FXFKO88O0FW3.0 size=1048576 2024-09-12T18:33:09.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.075+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~FXFKO88O0FW3.1 size=152704 2024-09-12T18:33:09.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.075+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=FXFKO88O0FW3 tag=3B8FADN0KHJE type=write size=2249856 2024-09-12T18:33:09.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.079+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=1HI554ZSESKM type=del 2024-09-12T18:33:09.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.083+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=EC4BYK093HPI type=write size=39224 2024-09-12T18:33:09.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.083+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=TWHEJPMPX5L8 type=del 2024-09-12T18:33:09.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.087+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=23IAK6V0B80O type=del size=1959592 2024-09-12T18:33:09.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.091+0000 7f41a072b8c0 1 < completed write operation key=L01GL4WOUIL2 tag=FK63HXETEZ2J type=write size=711608 2024-09-12T18:33:09.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.095+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=JCRVABU3HDI7 type=del size=1724750 2024-09-12T18:33:09.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.095+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=GPIQI4JKVLCB type=del 2024-09-12T18:33:09.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.099+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=0OP9JMVU3IP0 type=del size=2818250 2024-09-12T18:33:09.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.103+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~72I33V50KQHU.0 size=917773 2024-09-12T18:33:09.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.111+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=72I33V50KQHU tag=9XZV69ST23WL type=write size=1966349 2024-09-12T18:33:09.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.115+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=VA47AT9C7O2O type=write size=872925 2024-09-12T18:33:09.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.115+0000 7f41a072b8c0 1 < canceled part key=_multipart_ZACT36ZOC9ES.2~YX3R010YQGR6.0 size=1048576 2024-09-12T18:33:09.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.119+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~YX3R010YQGR6.1 size=1048576 2024-09-12T18:33:09.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.123+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~YX3R010YQGR6.2 size=1022366 2024-09-12T18:33:09.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.127+0000 7f41a072b8c0 1 < canceled multipart upload key=ZACT36ZOC9ES upload=YX3R010YQGR6 tag=GMZ22VS9O8WJ type=write size=4168094 2024-09-12T18:33:09.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.131+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=40YKBLPVTAR5 type=del size=1230862 2024-09-12T18:33:09.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.135+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~Y0EJ9LEXEG54.0 size=429444 2024-09-12T18:33:09.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.139+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=Y0EJ9LEXEG54 tag=RA3743F2D5R6 type=write size=1478020 2024-09-12T18:33:09.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.147+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~0YAX072GCOE1.0 size=1048576 2024-09-12T18:33:09.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.151+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~0YAX072GCOE1.1 size=1041287 2024-09-12T18:33:09.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.151+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=0YAX072GCOE1 tag=OXIVT1BH3DDB type=write size=3138439 2024-09-12T18:33:09.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.151+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~KK0LZE9I3SZY.0 size=1048576 2024-09-12T18:33:09.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.155+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~KK0LZE9I3SZY.1 size=1048576 2024-09-12T18:33:09.158 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.155+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~KK0LZE9I3SZY.2 size=859794 2024-09-12T18:33:09.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.163+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=KK0LZE9I3SZY tag=T4H3CO6O6S0X type=write size=4005522 2024-09-12T18:33:09.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.167+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~VU9A6TQIEOZ1.0 size=841015 2024-09-12T18:33:09.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.167+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=VU9A6TQIEOZ1 tag=01SMDO8BPG6B type=write size=1889591 2024-09-12T18:33:09.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.171+0000 7f41a072b8c0 1 < completed write operation key=5OD9IX408CYO tag=DYYQPNTBFU1F type=write size=314281 2024-09-12T18:33:09.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.175+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=SAAK17T11HMV type=del size=2690519 2024-09-12T18:33:09.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.183+0000 7f41a072b8c0 1 < suggested update operation key=7MRN7L1DTAMO tag=G078ANZISVJ9 type=write size=21097 2024-09-12T18:33:09.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.187+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~1Z6R31M7R2UA.0 size=1048576 2024-09-12T18:33:09.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.191+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~1Z6R31M7R2UA.1 size=799664 2024-09-12T18:33:09.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.191+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=1Z6R31M7R2UA tag=0ZRIFAZ06OYE type=write size=2896816 2024-09-12T18:33:09.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.195+0000 7f41a072b8c0 1 < suggested update operation key=V35A7LK08C7J tag=PYOHMPK65I09 type=del size=1935754 2024-09-12T18:33:09.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.195+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=KQ3F0HHSVYMS type=del size=926151 2024-09-12T18:33:09.200 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.199+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~7I1FAPORN9C9.0 size=1048576 2024-09-12T18:33:09.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.203+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~7I1FAPORN9C9.1 size=1048576 2024-09-12T18:33:09.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.203+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~7I1FAPORN9C9.2 size=617810 2024-09-12T18:33:09.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.207+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=7I1FAPORN9C9 tag=XRP9ZDXPOH1N type=write size=3763538 2024-09-12T18:33:09.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.215+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~01KGZU000S44.0 size=1048576 2024-09-12T18:33:09.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.215+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~01KGZU000S44.1 size=1048576 2024-09-12T18:33:09.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.219+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~01KGZU000S44.2 size=534673 2024-09-12T18:33:09.219 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.219+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=01KGZU000S44 tag=0FKSBJQLIEAM type=write size=3680401 2024-09-12T18:33:09.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.219+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=7B6INZ3G69E7 type=del 2024-09-12T18:33:09.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.223+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=7GFAMGP5ESRY type=del size=1370186 2024-09-12T18:33:09.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.227+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~BJJU66KK2HIG.0 size=611405 2024-09-12T18:33:09.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.231+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=BJJU66KK2HIG tag=OVB9JU96V3JZ type=write size=1659981 2024-09-12T18:33:09.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.235+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=PNJ7JCI6T3GY type=del size=3666615 2024-09-12T18:33:09.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.235+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~VBHO8QKYZ33U.0 size=1048576 2024-09-12T18:33:09.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.239+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~VBHO8QKYZ33U.1 size=393855 2024-09-12T18:33:09.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.243+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=VBHO8QKYZ33U tag=0PP3HBD3P5Z9 type=write size=2491007 2024-09-12T18:33:09.247 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.247+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=4R6C7T5196WD type=del size=759230 2024-09-12T18:33:09.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.247+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~FXFKO88O0FW3.0 size=1048576 2024-09-12T18:33:09.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.251+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~FXFKO88O0FW3.1 size=152704 2024-09-12T18:33:09.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.255+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=FXFKO88O0FW3 tag=3B8FADN0KHJE type=write size=2249856 2024-09-12T18:33:09.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.259+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=1XSRVPQ7EVBX type=del size=2502537 2024-09-12T18:33:09.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.263+0000 7f41a072b8c0 1 < completed write operation key=KP2HF4J376EY tag=EC4BYK093HPI type=write size=39224 2024-09-12T18:33:09.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.263+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=QJEX71QT0P64 type=del size=2586727 2024-09-12T18:33:09.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.267+0000 7f41a072b8c0 1 < canceled operation key=YP72VTCGSHYE tag=23IAK6V0B80O type=del size=1959592 2024-09-12T18:33:09.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.271+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~K2XH39F5UIP1.0 size=1008484 2024-09-12T18:33:09.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.271+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=K2XH39F5UIP1 tag=0NDM9BVAGKU5 type=write size=2057060 2024-09-12T18:33:09.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.275+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=JCRVABU3HDI7 type=del 2024-09-12T18:33:09.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.279+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=7GKARQ5YW1I8 type=del size=3356784 2024-09-12T18:33:09.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.283+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=0OP9JMVU3IP0 type=del 2024-09-12T18:33:09.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.287+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~JBNBRYA01EWQ.0 size=656346 2024-09-12T18:33:09.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.287+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=JBNBRYA01EWQ tag=TUUBYJ5G3T9O type=write size=1704922 2024-09-12T18:33:09.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.291+0000 7f41a072b8c0 1 < completed write operation key=5JUWC8RXSA5L tag=VA47AT9C7O2O type=write size=872925 2024-09-12T18:33:09.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.291+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=QWTGXNPO3FX3 type=write size=656188 2024-09-12T18:33:09.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.299+0000 7f41a072b8c0 1 < suggested remove operation key=VEN0P2P1RZ2S tag=40YKBLPVTAR5 type=del 2024-09-12T18:33:09.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.299+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=BFUK8KM1DF3J type=del size=2957651 2024-09-12T18:33:09.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.303+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~0YAX072GCOE1.0 size=1048576 2024-09-12T18:33:09.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.307+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~0YAX072GCOE1.1 size=1041287 2024-09-12T18:33:09.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.311+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=0YAX072GCOE1 tag=OXIVT1BH3DDB type=write size=3138439 2024-09-12T18:33:09.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.315+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=0VKACXFMU5GZ type=del size=737177 2024-09-12T18:33:09.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.315+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~VU9A6TQIEOZ1.0 size=841015 2024-09-12T18:33:09.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.323+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=VU9A6TQIEOZ1 tag=01SMDO8BPG6B type=write size=1889591 2024-09-12T18:33:09.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.323+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=SKYO1HEJS8IO type=del size=3137471 2024-09-12T18:33:09.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.327+0000 7f41a072b8c0 1 < completed delete operation key=1JIIRDVMT0B0 tag=SAAK17T11HMV type=del 2024-09-12T18:33:09.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.331+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=HJE9G1DT59AY type=del size=492397 2024-09-12T18:33:09.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.335+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~1Z6R31M7R2UA.0 size=1048576 2024-09-12T18:33:09.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.335+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~1Z6R31M7R2UA.1 size=799664 2024-09-12T18:33:09.341 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.339+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=1Z6R31M7R2UA tag=0ZRIFAZ06OYE type=write size=2896816 2024-09-12T18:33:09.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.347+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~AHVNPJPAWZMX.0 size=1048576 2024-09-12T18:33:09.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.347+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~AHVNPJPAWZMX.1 size=170788 2024-09-12T18:33:09.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.347+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=AHVNPJPAWZMX tag=PF4VS5DZEFRR type=write size=2267940 2024-09-12T18:33:09.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.355+0000 7f41a072b8c0 1 < suggested update operation key=58IT2R988AW9 tag=KQ3F0HHSVYMS type=del size=926151 2024-09-12T18:33:09.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.359+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~JKMFY83MZTXM.0 size=306101 2024-09-12T18:33:09.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.359+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=JKMFY83MZTXM tag=E178VG588EM6 type=write size=1354677 2024-09-12T18:33:09.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.363+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~01KGZU000S44.0 size=1048576 2024-09-12T18:33:09.366 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.367+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~01KGZU000S44.1 size=1048576 2024-09-12T18:33:09.366 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.367+0000 7f41a072b8c0 1 < canceled part key=_multipart_31T6AP6MUBKL.2~01KGZU000S44.2 size=534673 2024-09-12T18:33:09.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.371+0000 7f41a072b8c0 1 < canceled multipart upload key=31T6AP6MUBKL upload=01KGZU000S44 tag=0FKSBJQLIEAM type=write size=3680401 2024-09-12T18:33:09.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.379+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~FVT2KKOEXSOZ.0 size=783381 2024-09-12T18:33:09.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.379+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=FVT2KKOEXSOZ tag=MYDA08OZ8KMC type=write size=1831957 2024-09-12T18:33:09.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.383+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=7GFAMGP5ESRY type=del 2024-09-12T18:33:09.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.387+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=RNVCLIUXYBO0 type=del size=620677 2024-09-12T18:33:09.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.395+0000 7f41a072b8c0 1 < suggested remove operation key=A6GQZL25YSNL tag=PNJ7JCI6T3GY type=del 2024-09-12T18:33:09.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.403+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=Y19J9I043483 type=write size=424346 2024-09-12T18:33:09.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.407+0000 7f41a072b8c0 1 < canceled operation key=3R9RN03RFRJP tag=4R6C7T5196WD type=del size=759230 2024-09-12T18:33:09.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.407+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=ZIJJ82HCLHMD type=del size=1573097 2024-09-12T18:33:09.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.415+0000 7f41a072b8c0 1 < suggested remove operation key=7B70QWGMH0C0 tag=1XSRVPQ7EVBX type=del 2024-09-12T18:33:09.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.419+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=D3EJJIVJ47P3 type=del size=1859342 2024-09-12T18:33:09.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.423+0000 7f41a072b8c0 1 < canceled operation key=L1VC63PK1R2Y tag=QJEX71QT0P64 type=del size=2586727 2024-09-12T18:33:09.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.431+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~4EE7BOT7WBUH.0 size=348568 2024-09-12T18:33:09.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.431+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=4EE7BOT7WBUH tag=AXP4FR4Z7OMY type=write size=1397144 2024-09-12T18:33:09.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.435+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~K2XH39F5UIP1.0 size=1008484 2024-09-12T18:33:09.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.443+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=K2XH39F5UIP1 tag=0NDM9BVAGKU5 type=write size=2057060 2024-09-12T18:33:09.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.447+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~3GK3Z9QEHFL5.0 size=745303 2024-09-12T18:33:09.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.447+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=3GK3Z9QEHFL5 tag=SC5FZ73UG076 type=write size=1793879 2024-09-12T18:33:09.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.455+0000 7f41a072b8c0 1 < suggested remove operation key=1JIIRDVMT0B0 tag=7GKARQ5YW1I8 type=del 2024-09-12T18:33:09.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.459+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=FM555MGRDFFB type=write size=727207 2024-09-12T18:33:09.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.463+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~JBNBRYA01EWQ.0 size=656346 2024-09-12T18:33:09.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.467+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=JBNBRYA01EWQ tag=TUUBYJ5G3T9O type=write size=1704922 2024-09-12T18:33:09.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.471+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=0775LGP5547Q type=del size=1077774 2024-09-12T18:33:09.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.475+0000 7f41a072b8c0 1 < completed write operation key=L1VC63PK1R2Y tag=QWTGXNPO3FX3 type=write size=656188 2024-09-12T18:33:09.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.479+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=F10180BPN3FD type=write size=163695 2024-09-12T18:33:09.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.479+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=BFUK8KM1DF3J type=del 2024-09-12T18:33:09.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.487+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~0S13HYO4J29O.0 size=1048576 2024-09-12T18:33:09.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.491+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~0S13HYO4J29O.1 size=1048576 2024-09-12T18:33:09.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.491+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~0S13HYO4J29O.2 size=337187 2024-09-12T18:33:09.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.491+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=0S13HYO4J29O tag=KVUT5TYPFGGI type=write size=3482915 2024-09-12T18:33:09.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.499+0000 7f41a072b8c0 1 < suggested update operation key=ZACT36ZOC9ES tag=0VKACXFMU5GZ type=del size=737177 2024-09-12T18:33:09.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.503+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~JSVMF1D0FO6A.0 size=1048576 2024-09-12T18:33:09.508 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~JSVMF1D0FO6A.1 size=546204 2024-09-12T18:33:09.508 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.507+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=JSVMF1D0FO6A tag=NYTKW0D4B5TQ type=write size=2643356 2024-09-12T18:33:09.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.511+0000 7f41a072b8c0 1 < completed delete operation key=C2PRRD3QO9AF tag=SKYO1HEJS8IO type=del 2024-09-12T18:33:09.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.515+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=E4A718PL0SL7 type=del size=1128457 2024-09-12T18:33:09.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.515+0000 7f41a072b8c0 1 < canceled operation key=L01GL4WOUIL2 tag=HJE9G1DT59AY type=del size=492397 2024-09-12T18:33:09.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.519+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=FS6QA1F8X77P type=del size=1394312 2024-09-12T18:33:09.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.523+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~AHVNPJPAWZMX.0 size=1048576 2024-09-12T18:33:09.527 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.527+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~AHVNPJPAWZMX.1 size=170788 2024-09-12T18:33:09.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.531+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=AHVNPJPAWZMX tag=PF4VS5DZEFRR type=write size=2267940 2024-09-12T18:33:09.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.535+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=DM09NKPDA4IX type=del size=1934565 2024-09-12T18:33:09.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.535+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~JKMFY83MZTXM.0 size=306101 2024-09-12T18:33:09.543 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.543+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=JKMFY83MZTXM tag=E178VG588EM6 type=write size=1354677 2024-09-12T18:33:09.545 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.543+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=MVJ8117Q23SG type=del size=1205024 2024-09-12T18:33:09.549 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.547+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~FVT2KKOEXSOZ.0 size=783381 2024-09-12T18:33:09.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.551+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=FVT2KKOEXSOZ tag=MYDA08OZ8KMC type=write size=1831957 2024-09-12T18:33:09.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.555+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=6XCRXNW2CFX0 type=del size=75371 2024-09-12T18:33:09.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.559+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=RNVCLIUXYBO0 type=del 2024-09-12T18:33:09.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.563+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=QLPXMEYAGFKH type=write size=131010 2024-09-12T18:33:09.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.567+0000 7f41a072b8c0 1 < completed write operation key=YP72VTCGSHYE tag=Y19J9I043483 type=write size=424346 2024-09-12T18:33:09.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.571+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~8UQGGLK4B66F.0 size=193011 2024-09-12T18:33:09.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.571+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=8UQGGLK4B66F tag=WCNR9RQ0GI82 type=write size=1241587 2024-09-12T18:33:09.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.575+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=ZIJJ82HCLHMD type=del 2024-09-12T18:33:09.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.579+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=PKB3J4BV6JV5 type=del size=1033205 2024-09-12T18:33:09.582 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.583+0000 7f41a072b8c0 1 < canceled operation key=31T6AP6MUBKL tag=D3EJJIVJ47P3 type=del size=1859342 2024-09-12T18:33:09.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.583+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=VVYQ60928MQ5 type=write size=1011319 2024-09-12T18:33:09.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.587+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~4EE7BOT7WBUH.0 size=348568 2024-09-12T18:33:09.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.591+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=4EE7BOT7WBUH tag=AXP4FR4Z7OMY type=write size=1397144 2024-09-12T18:33:09.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.599+0000 7f41a072b8c0 1 > prepared part key=_multipart_VEN0P2P1RZ2S.2~24QK2H2R7A89.0 size=218918 2024-09-12T18:33:09.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.599+0000 7f41a072b8c0 1 > prepared multipart upload key=VEN0P2P1RZ2S upload=24QK2H2R7A89 tag=K8YV14P7U2EU type=write size=1267494 2024-09-12T18:33:09.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.599+0000 7f41a072b8c0 1 < canceled part key=_multipart_5JUWC8RXSA5L.2~3GK3Z9QEHFL5.0 size=745303 2024-09-12T18:33:09.604 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.603+0000 7f41a072b8c0 1 < canceled multipart upload key=5JUWC8RXSA5L upload=3GK3Z9QEHFL5 tag=SC5FZ73UG076 type=write size=1793879 2024-09-12T18:33:09.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.607+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~JJSBR6WBQPNQ.0 size=164685 2024-09-12T18:33:09.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.607+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=JJSBR6WBQPNQ tag=ERX8423PDV03 type=write size=1213261 2024-09-12T18:33:09.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.615+0000 7f41a072b8c0 1 < suggested update operation key=GC8797KSO47E tag=FM555MGRDFFB type=write size=727207 2024-09-12T18:33:09.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.619+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=HNLJ3HUSTDZK type=del size=3735975 2024-09-12T18:33:09.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.623+0000 7f41a072b8c0 1 < suggested update operation key=YP72VTCGSHYE tag=0775LGP5547Q type=del size=1077774 2024-09-12T18:33:09.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.627+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=2VUZ4P5P9CHY type=del size=1290522 2024-09-12T18:33:09.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.635+0000 7f41a072b8c0 1 < suggested update operation key=7MRN7L1DTAMO tag=F10180BPN3FD type=write size=163695 2024-09-12T18:33:09.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.639+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=0DUGANHKRYRK type=del size=2977501 2024-09-12T18:33:09.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.639+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~0S13HYO4J29O.0 size=1048576 2024-09-12T18:33:09.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.643+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~0S13HYO4J29O.1 size=1048576 2024-09-12T18:33:09.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.647+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~0S13HYO4J29O.2 size=337187 2024-09-12T18:33:09.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.651+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=0S13HYO4J29O tag=KVUT5TYPFGGI type=write size=3482915 2024-09-12T18:33:09.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.655+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~WCNCBIGHAX9U.0 size=1031894 2024-09-12T18:33:09.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.655+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=WCNCBIGHAX9U tag=DSIUQCWOVUGD type=write size=2080470 2024-09-12T18:33:09.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.659+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~JSVMF1D0FO6A.0 size=1048576 2024-09-12T18:33:09.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.659+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~JSVMF1D0FO6A.1 size=546204 2024-09-12T18:33:09.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.667+0000 7f41a072b8c0 1 < completed multipart upload key=A6GQZL25YSNL upload=JSVMF1D0FO6A tag=NYTKW0D4B5TQ type=write size=2643356 2024-09-12T18:33:09.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.667+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=XMY9OB2UBWBD type=del size=1619549 2024-09-12T18:33:09.672 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.671+0000 7f41a072b8c0 1 < canceled operation key=1JIIRDVMT0B0 tag=E4A718PL0SL7 type=del size=1128457 2024-09-12T18:33:09.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.675+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=31OZ4HD47WZQ type=del size=2843661 2024-09-12T18:33:09.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.679+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=FS6QA1F8X77P type=del 2024-09-12T18:33:09.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.683+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=4R1N4LYPLKWQ type=del size=3685699 2024-09-12T18:33:09.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.687+0000 7f41a072b8c0 1 < suggested update operation key=5OD9IX408CYO tag=DM09NKPDA4IX type=del size=1934565 2024-09-12T18:33:09.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.691+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=7UCJESDGP41X type=write size=126952 2024-09-12T18:33:09.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.695+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=MVJ8117Q23SG type=del 2024-09-12T18:33:09.697 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.695+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=EDWES4Z945US type=write size=847833 2024-09-12T18:33:09.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.699+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=6XCRXNW2CFX0 type=del 2024-09-12T18:33:09.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.711+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~4L58IVZ9Q4PJ.0 size=1048576 2024-09-12T18:33:09.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.711+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~4L58IVZ9Q4PJ.1 size=1048576 2024-09-12T18:33:09.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.715+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~4L58IVZ9Q4PJ.2 size=165498 2024-09-12T18:33:09.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.715+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=4L58IVZ9Q4PJ tag=HX8MHKTNFRJ0 type=write size=3311226 2024-09-12T18:33:09.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.719+0000 7f41a072b8c0 -1 < failed to complete operation key=YP72VTCGSHYE tag=QLPXMEYAGFKH type=write size=131010: (22) Invalid argument 2024-09-12T18:33:09.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.719+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=LXVRO3FQVIQB type=del size=2855957 2024-09-12T18:33:09.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.723+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~8UQGGLK4B66F.0 size=193011 2024-09-12T18:33:09.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.731+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=8UQGGLK4B66F tag=WCNR9RQ0GI82 type=write size=1241587 2024-09-12T18:33:09.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.731+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=Z8GIULE97680 type=write size=521201 2024-09-12T18:33:09.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.735+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=PKB3J4BV6JV5 type=del 2024-09-12T18:33:09.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.739+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=MSKMGWBZASA0 type=del size=730983 2024-09-12T18:33:09.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.743+0000 7f41a072b8c0 1 < completed write operation key=C2PRRD3QO9AF tag=VVYQ60928MQ5 type=write size=1011319 2024-09-12T18:33:09.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.751+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~YW2K7SJQL77Q.0 size=1048576 2024-09-12T18:33:09.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.751+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~YW2K7SJQL77Q.1 size=350251 2024-09-12T18:33:09.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.751+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=YW2K7SJQL77Q tag=3N854D91MZQ8 type=write size=2447403 2024-09-12T18:33:09.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.755+0000 7f41a072b8c0 1 < completed part key=_multipart_VEN0P2P1RZ2S.2~24QK2H2R7A89.0 size=218918 2024-09-12T18:33:09.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.759+0000 7f41a072b8c0 1 < completed multipart upload key=VEN0P2P1RZ2S upload=24QK2H2R7A89 tag=K8YV14P7U2EU type=write size=1267494 2024-09-12T18:33:09.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.763+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=OZGTTKRR7IVP type=del size=612089 2024-09-12T18:33:09.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.767+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~JJSBR6WBQPNQ.0 size=164685 2024-09-12T18:33:09.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.775+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=JJSBR6WBQPNQ tag=ERX8423PDV03 type=write size=1213261 2024-09-12T18:33:09.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.779+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=8T7BKEITUG73 type=del size=2895694 2024-09-12T18:33:09.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.779+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=HNLJ3HUSTDZK type=del 2024-09-12T18:33:09.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.787+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~OBZYDCRW73BB.0 size=1048576 2024-09-12T18:33:09.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.787+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~OBZYDCRW73BB.1 size=1048576 2024-09-12T18:33:09.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.791+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~OBZYDCRW73BB.2 size=525266 2024-09-12T18:33:09.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.791+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=OBZYDCRW73BB tag=AQ4RATPBH2FV type=write size=3670994 2024-09-12T18:33:09.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.795+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=2VUZ4P5P9CHY type=del 2024-09-12T18:33:09.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.799+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=7G1TAEAPVFH6 type=write size=1037707 2024-09-12T18:33:09.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.803+0000 7f41a072b8c0 1 < canceled operation key=L1VC63PK1R2Y tag=0DUGANHKRYRK type=del size=2977501 2024-09-12T18:33:09.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.807+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~0EH7RCPPM8AK.0 size=674532 2024-09-12T18:33:09.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.807+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=0EH7RCPPM8AK tag=70IGEC7A469Y type=write size=1723108 2024-09-12T18:33:09.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.811+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~WCNCBIGHAX9U.0 size=1031894 2024-09-12T18:33:09.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.815+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=WCNCBIGHAX9U tag=DSIUQCWOVUGD type=write size=2080470 2024-09-12T18:33:09.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.819+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~9H4M5TTDZUED.0 size=1048576 2024-09-12T18:33:09.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.823+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~9H4M5TTDZUED.1 size=486920 2024-09-12T18:33:09.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.823+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=9H4M5TTDZUED tag=JSKQR8RE9YO0 type=write size=2584072 2024-09-12T18:33:09.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.823+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=XMY9OB2UBWBD type=del 2024-09-12T18:33:09.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.827+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=DR47493M6I5D type=del size=213687 2024-09-12T18:33:09.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.831+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=31OZ4HD47WZQ type=del 2024-09-12T18:33:09.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.835+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=HI506RX8I9O9 type=write size=857009 2024-09-12T18:33:09.837 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.835+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=4R1N4LYPLKWQ type=del 2024-09-12T18:33:09.842 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.843+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~GG37IR6YRWS2.0 size=1048576 2024-09-12T18:33:09.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.843+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~GG37IR6YRWS2.1 size=1048576 2024-09-12T18:33:09.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.847+0000 7f41a072b8c0 1 > prepared part key=_multipart_1BSAN5TRTZNZ.2~GG37IR6YRWS2.2 size=710645 2024-09-12T18:33:09.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.847+0000 7f41a072b8c0 1 > prepared multipart upload key=1BSAN5TRTZNZ upload=GG37IR6YRWS2 tag=3O4ZUWVR852G type=write size=3856373 2024-09-12T18:33:09.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.851+0000 7f41a072b8c0 1 < completed write operation key=P732C5X0RG8Z tag=7UCJESDGP41X type=write size=126952 2024-09-12T18:33:09.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.851+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=TFR9BCEHEZ6Q type=del size=782239 2024-09-12T18:33:09.856 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.855+0000 7f41a072b8c0 1 < completed write operation key=58IT2R988AW9 tag=EDWES4Z945US type=write size=847833 2024-09-12T18:33:09.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.859+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=4HUZKAMT4V8G type=write size=418606 2024-09-12T18:33:09.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.863+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~4L58IVZ9Q4PJ.0 size=1048576 2024-09-12T18:33:09.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.863+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~4L58IVZ9Q4PJ.1 size=1048576 2024-09-12T18:33:09.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.867+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~4L58IVZ9Q4PJ.2 size=165498 2024-09-12T18:33:09.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.871+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=4L58IVZ9Q4PJ tag=HX8MHKTNFRJ0 type=write size=3311226 2024-09-12T18:33:09.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.875+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=NRCSQ008S50D type=del size=1245258 2024-09-12T18:33:09.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.883+0000 7f41a072b8c0 1 < suggested update operation key=C2PRRD3QO9AF tag=LXVRO3FQVIQB type=del size=2855957 2024-09-12T18:33:09.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.887+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~2ER1OT38C54R.0 size=1048576 2024-09-12T18:33:09.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.891+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~2ER1OT38C54R.1 size=328884 2024-09-12T18:33:09.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.891+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=2ER1OT38C54R tag=8UFLZ40OG4F6 type=write size=2426036 2024-09-12T18:33:09.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.891+0000 7f41a072b8c0 1 < completed write operation key=YP72VTCGSHYE tag=Z8GIULE97680 type=write size=521201 2024-09-12T18:33:09.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.895+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=0509A5W93U0J type=write size=743458 2024-09-12T18:33:09.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.899+0000 7f41a072b8c0 1 < suggested remove operation key=31T6AP6MUBKL tag=MSKMGWBZASA0 type=del 2024-09-12T18:33:09.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.903+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=0GNCGRFDKHWT type=del size=1767336 2024-09-12T18:33:09.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.903+0000 7f41a072b8c0 1 < canceled part key=_multipart_V35A7LK08C7J.2~YW2K7SJQL77Q.0 size=1048576 2024-09-12T18:33:09.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.907+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~YW2K7SJQL77Q.1 size=350251 2024-09-12T18:33:09.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.911+0000 7f41a072b8c0 1 < canceled multipart upload key=V35A7LK08C7J upload=YW2K7SJQL77Q tag=3N854D91MZQ8 type=write size=2447403 2024-09-12T18:33:09.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.915+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~V6E92V7MHONV.0 size=1048576 2024-09-12T18:33:09.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.919+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~V6E92V7MHONV.1 size=962060 2024-09-12T18:33:09.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.919+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=V6E92V7MHONV tag=YCRKYYD7UB99 type=write size=3059212 2024-09-12T18:33:09.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.919+0000 7f41a072b8c0 -1 < failed to complete operation key=C2PRRD3QO9AF tag=OZGTTKRR7IVP type=del size=612089: (22) Invalid argument 2024-09-12T18:33:09.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.923+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=J3MW95PCW5BD type=del size=3073308 2024-09-12T18:33:09.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.927+0000 7f41a072b8c0 1 < canceled operation key=V35A7LK08C7J tag=8T7BKEITUG73 type=del size=2895694 2024-09-12T18:33:09.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.927+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=T7P57ONUF14G type=del size=351033 2024-09-12T18:33:09.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.931+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~OBZYDCRW73BB.0 size=1048576 2024-09-12T18:33:09.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.935+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~OBZYDCRW73BB.1 size=1048576 2024-09-12T18:33:09.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.935+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~OBZYDCRW73BB.2 size=525266 2024-09-12T18:33:09.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.939+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=OBZYDCRW73BB tag=AQ4RATPBH2FV type=write size=3670994 2024-09-12T18:33:09.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.943+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=PZ88Q92VOR8B type=del size=4167502 2024-09-12T18:33:09.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.947+0000 7f41a072b8c0 1 < completed write operation key=L1VC63PK1R2Y tag=7G1TAEAPVFH6 type=write size=1037707 2024-09-12T18:33:09.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.951+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~XB4ULGEX6GFR.0 size=232440 2024-09-12T18:33:09.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.951+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=XB4ULGEX6GFR tag=9SY08TADS3J4 type=write size=1281016 2024-09-12T18:33:09.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.955+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~0EH7RCPPM8AK.0 size=674532 2024-09-12T18:33:09.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.959+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=0EH7RCPPM8AK tag=70IGEC7A469Y type=write size=1723108 2024-09-12T18:33:09.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.959+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=0M29HP1XWHSL type=write size=885720 2024-09-12T18:33:09.965 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.963+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~9H4M5TTDZUED.0 size=1048576 2024-09-12T18:33:09.965 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.963+0000 7f41a072b8c0 1 < canceled part key=_multipart_V35A7LK08C7J.2~9H4M5TTDZUED.1 size=486920 2024-09-12T18:33:09.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.967+0000 7f41a072b8c0 1 < canceled multipart upload key=V35A7LK08C7J upload=9H4M5TTDZUED tag=JSKQR8RE9YO0 type=write size=2584072 2024-09-12T18:33:09.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.971+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=S0G3L2BUN4DH type=del size=486640 2024-09-12T18:33:09.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.979+0000 7f41a072b8c0 1 < suggested remove operation key=L1VC63PK1R2Y tag=DR47493M6I5D type=del 2024-09-12T18:33:09.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.983+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=A9N1C5SQR77O type=del size=2401284 2024-09-12T18:33:09.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.983+0000 7f41a072b8c0 1 < completed write operation key=1BSAN5TRTZNZ tag=HI506RX8I9O9 type=write size=857009 2024-09-12T18:33:09.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.995+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~1AFTXCU5MTBP.0 size=1048576 2024-09-12T18:33:09.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.995+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~1AFTXCU5MTBP.1 size=934420 2024-09-12T18:33:09.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.995+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=1AFTXCU5MTBP tag=XQPZZP1090J0 type=write size=3031572 2024-09-12T18:33:09.998 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.995+0000 7f41a072b8c0 1 < canceled part key=_multipart_1BSAN5TRTZNZ.2~GG37IR6YRWS2.0 size=1048576 2024-09-12T18:33:10.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:09.999+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~GG37IR6YRWS2.1 size=1048576 2024-09-12T18:33:10.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.003+0000 7f41a072b8c0 1 < completed part key=_multipart_1BSAN5TRTZNZ.2~GG37IR6YRWS2.2 size=710645 2024-09-12T18:33:10.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.007+0000 7f41a072b8c0 1 < canceled multipart upload key=1BSAN5TRTZNZ upload=GG37IR6YRWS2 tag=3O4ZUWVR852G type=write size=3856373 2024-09-12T18:33:10.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.007+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=ILCL9FNXLZO5 type=del size=2122930 2024-09-12T18:33:10.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.011+0000 7f41a072b8c0 1 < suggested update operation key=C2PRRD3QO9AF tag=TFR9BCEHEZ6Q type=del size=782239 2024-09-12T18:33:10.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.015+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~OSXMRWV0VLU0.0 size=1048576 2024-09-12T18:33:10.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.019+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~OSXMRWV0VLU0.1 size=544490 2024-09-12T18:33:10.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.019+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=OSXMRWV0VLU0 tag=F53PA3EWNH2O type=write size=2641642 2024-09-12T18:33:10.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.019+0000 7f41a072b8c0 1 < completed write operation key=63BP9QETTAM8 tag=4HUZKAMT4V8G type=write size=418606 2024-09-12T18:33:10.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.023+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=UK1OHLJ6MZLI type=write size=1015116 2024-09-12T18:33:10.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.027+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=NRCSQ008S50D type=del 2024-09-12T18:33:10.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.027+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=V0ZW2M1A1YO0 type=del size=1683838 2024-09-12T18:33:10.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.031+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~2ER1OT38C54R.0 size=1048576 2024-09-12T18:33:10.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.031+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~2ER1OT38C54R.1 size=328884 2024-09-12T18:33:10.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.035+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=2ER1OT38C54R tag=8UFLZ40OG4F6 type=write size=2426036 2024-09-12T18:33:10.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.039+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~Z2IPFF292BSF.0 size=1048576 2024-09-12T18:33:10.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.039+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~Z2IPFF292BSF.1 size=1048576 2024-09-12T18:33:10.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.043+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~Z2IPFF292BSF.2 size=646570 2024-09-12T18:33:10.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.043+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=Z2IPFF292BSF tag=2KVBNCT243H0 type=write size=3792298 2024-09-12T18:33:10.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.043+0000 7f41a072b8c0 1 < completed write operation key=GA6P1FACU2EQ tag=0509A5W93U0J type=write size=743458 2024-09-12T18:33:10.050 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.047+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~GNZFOOS9RT94.0 size=64710 2024-09-12T18:33:10.050 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.047+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=GNZFOOS9RT94 tag=3H4OK1Y6SK63 type=write size=1113286 2024-09-12T18:33:10.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.051+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=0GNCGRFDKHWT type=del 2024-09-12T18:33:10.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.055+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~U283JDPW5QMM.0 size=106336 2024-09-12T18:33:10.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.055+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=U283JDPW5QMM tag=0M9HMEU11QGX type=write size=1154912 2024-09-12T18:33:10.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.059+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~V6E92V7MHONV.0 size=1048576 2024-09-12T18:33:10.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.059+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~V6E92V7MHONV.1 size=962060 2024-09-12T18:33:10.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.063+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=V6E92V7MHONV tag=YCRKYYD7UB99 type=write size=3059212 2024-09-12T18:33:10.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.067+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~DY0MX6MC7XF3.0 size=485466 2024-09-12T18:33:10.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.067+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=DY0MX6MC7XF3 tag=11XPX4NJMNIQ type=write size=1534042 2024-09-12T18:33:10.070 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.071+0000 7f41a072b8c0 -1 < failed to complete operation key=L1VC63PK1R2Y tag=J3MW95PCW5BD type=del size=3073308: (22) Invalid argument 2024-09-12T18:33:10.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.071+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=OKTA8M9630KN type=del size=1011257 2024-09-12T18:33:10.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.075+0000 7f41a072b8c0 1 < suggested remove operation key=YP72VTCGSHYE tag=T7P57ONUF14G type=del 2024-09-12T18:33:10.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.079+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=BC1T80RW7EX0 type=del size=1874448 2024-09-12T18:33:10.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.079+0000 7f41a072b8c0 1 < completed delete operation key=NKMA8FG3V3TR tag=PZ88Q92VOR8B type=del 2024-09-12T18:33:10.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.083+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~75ZPY8PH4B5D.0 size=1048576 2024-09-12T18:33:10.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.087+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~75ZPY8PH4B5D.1 size=947636 2024-09-12T18:33:10.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.087+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=75ZPY8PH4B5D tag=QZ0FSGAEO3EJ type=write size=3044788 2024-09-12T18:33:10.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.087+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~XB4ULGEX6GFR.0 size=232440 2024-09-12T18:33:10.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.091+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=XB4ULGEX6GFR tag=9SY08TADS3J4 type=write size=1281016 2024-09-12T18:33:10.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.095+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~OD682W78I8VN.0 size=1048576 2024-09-12T18:33:10.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.099+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~OD682W78I8VN.1 size=561523 2024-09-12T18:33:10.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.099+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=OD682W78I8VN tag=K1RIEE353I49 type=write size=2658675 2024-09-12T18:33:10.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.099+0000 7f41a072b8c0 1 < completed write operation key=GC8797KSO47E tag=0M29HP1XWHSL type=write size=885720 2024-09-12T18:33:10.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.103+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=QD47PYV5BIVE type=del size=2991210 2024-09-12T18:33:10.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.103+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=S0G3L2BUN4DH type=del 2024-09-12T18:33:10.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.107+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=0OXQHMTUA3R3 type=write size=367631 2024-09-12T18:33:10.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.111+0000 7f41a072b8c0 1 < suggested remove operation key=31T6AP6MUBKL tag=A9N1C5SQR77O type=del 2024-09-12T18:33:10.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.115+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~30AQ70B46K6H.0 size=1048576 2024-09-12T18:33:10.117 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.115+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~30AQ70B46K6H.1 size=1048576 2024-09-12T18:33:10.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.119+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~30AQ70B46K6H.2 size=481182 2024-09-12T18:33:10.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.119+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=30AQ70B46K6H tag=NKXS9393LA54 type=write size=3626910 2024-09-12T18:33:10.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.119+0000 7f41a072b8c0 1 < canceled part key=_multipart_P732C5X0RG8Z.2~1AFTXCU5MTBP.0 size=1048576 2024-09-12T18:33:10.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.119+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~1AFTXCU5MTBP.1 size=934420 2024-09-12T18:33:10.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.123+0000 7f41a072b8c0 1 < canceled multipart upload key=P732C5X0RG8Z upload=1AFTXCU5MTBP tag=XQPZZP1090J0 type=write size=3031572 2024-09-12T18:33:10.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.127+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=EET8BUYV25S2 type=del size=1526947 2024-09-12T18:33:10.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.131+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=ILCL9FNXLZO5 type=del 2024-09-12T18:33:10.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.131+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=XBZV34MH7AKP type=write size=623620 2024-09-12T18:33:10.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.131+0000 7f41a072b8c0 1 < canceled part key=_multipart_5JUWC8RXSA5L.2~OSXMRWV0VLU0.0 size=1048576 2024-09-12T18:33:10.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.135+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~OSXMRWV0VLU0.1 size=544490 2024-09-12T18:33:10.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.139+0000 7f41a072b8c0 1 < canceled multipart upload key=5JUWC8RXSA5L upload=OSXMRWV0VLU0 tag=F53PA3EWNH2O type=write size=2641642 2024-09-12T18:33:10.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.139+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=L6RH6LI31X63 type=write size=433184 2024-09-12T18:33:10.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.143+0000 7f41a072b8c0 1 < completed write operation key=L01GL4WOUIL2 tag=UK1OHLJ6MZLI type=write size=1015116 2024-09-12T18:33:10.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.147+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~UJNMUYMH8LK0.0 size=320909 2024-09-12T18:33:10.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.147+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=UJNMUYMH8LK0 tag=KWJ59HITZ3HO type=write size=1369485 2024-09-12T18:33:10.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.151+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=V0ZW2M1A1YO0 type=del 2024-09-12T18:33:10.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.155+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~EAZDS5KM73PP.0 size=1048576 2024-09-12T18:33:10.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.155+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~EAZDS5KM73PP.1 size=484518 2024-09-12T18:33:10.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.155+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=EAZDS5KM73PP tag=ESSE8MBU874J type=write size=2581670 2024-09-12T18:33:10.158 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.159+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~Z2IPFF292BSF.0 size=1048576 2024-09-12T18:33:10.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.159+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~Z2IPFF292BSF.1 size=1048576 2024-09-12T18:33:10.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.163+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~Z2IPFF292BSF.2 size=646570 2024-09-12T18:33:10.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.167+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=Z2IPFF292BSF tag=2KVBNCT243H0 type=write size=3792298 2024-09-12T18:33:10.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.167+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=EJ8RZYUMDZDD type=del size=4105352 2024-09-12T18:33:10.170 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.171+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~GNZFOOS9RT94.0 size=64710 2024-09-12T18:33:10.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.175+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=GNZFOOS9RT94 tag=3H4OK1Y6SK63 type=write size=1113286 2024-09-12T18:33:10.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.175+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=52G2N1KET21F type=del size=560665 2024-09-12T18:33:10.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.179+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~U283JDPW5QMM.0 size=106336 2024-09-12T18:33:10.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.179+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=U283JDPW5QMM tag=0M9HMEU11QGX type=write size=1154912 2024-09-12T18:33:10.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.187+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~UHNKHDR89OID.0 size=681093 2024-09-12T18:33:10.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.187+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=UHNKHDR89OID tag=F3Y0MMCPJXHT type=write size=1729669 2024-09-12T18:33:10.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.187+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~DY0MX6MC7XF3.0 size=485466 2024-09-12T18:33:10.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.191+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=DY0MX6MC7XF3 tag=11XPX4NJMNIQ type=write size=1534042 2024-09-12T18:33:10.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.195+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=FRHHZA5W4QLO type=del size=1997922 2024-09-12T18:33:10.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.199+0000 7f41a072b8c0 1 < suggested remove operation key=5JUWC8RXSA5L tag=OKTA8M9630KN type=del 2024-09-12T18:33:10.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.199+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=KGKHTI2JDBID type=del size=1716609 2024-09-12T18:33:10.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.207+0000 7f41a072b8c0 1 < suggested update operation key=L1VC63PK1R2Y tag=BC1T80RW7EX0 type=del size=1874448 2024-09-12T18:33:10.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.211+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=MZ3O2A5C7CR5 type=del size=791617 2024-09-12T18:33:10.213 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.211+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~75ZPY8PH4B5D.0 size=1048576 2024-09-12T18:33:10.213 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.211+0000 7f41a072b8c0 1 < canceled part key=_multipart_3CGBX19WTMWQ.2~75ZPY8PH4B5D.1 size=947636 2024-09-12T18:33:10.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.215+0000 7f41a072b8c0 1 < canceled multipart upload key=3CGBX19WTMWQ upload=75ZPY8PH4B5D tag=QZ0FSGAEO3EJ type=write size=3044788 2024-09-12T18:33:10.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.219+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~U1YX5OSCKHW4.0 size=459165 2024-09-12T18:33:10.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.219+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=U1YX5OSCKHW4 tag=LTGL8O511AYV type=write size=1507741 2024-09-12T18:33:10.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.223+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~OD682W78I8VN.0 size=1048576 2024-09-12T18:33:10.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.223+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~OD682W78I8VN.1 size=561523 2024-09-12T18:33:10.228 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.227+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=OD682W78I8VN tag=K1RIEE353I49 type=write size=2658675 2024-09-12T18:33:10.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.231+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~ZFAYCB0GZYFK.0 size=583284 2024-09-12T18:33:10.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.231+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=ZFAYCB0GZYFK tag=XQW5XC6FRUJD type=write size=1631860 2024-09-12T18:33:10.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.235+0000 7f41a072b8c0 1 < suggested remove operation key=58IT2R988AW9 tag=QD47PYV5BIVE type=del 2024-09-12T18:33:10.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.239+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=NYGJKUDXLQQD type=del size=3612208 2024-09-12T18:33:10.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.239+0000 7f41a072b8c0 -1 < no bi entry to suggest for operation key=5JUWC8RXSA5L tag=0OXQHMTUA3R3 type=write size=367631: (2) No such file or directory 2024-09-12T18:33:10.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.243+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=DGRUE45IB4DT type=del size=1135272 2024-09-12T18:33:10.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.243+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~30AQ70B46K6H.0 size=1048576 2024-09-12T18:33:10.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.243+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~30AQ70B46K6H.1 size=1048576 2024-09-12T18:33:10.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.247+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~30AQ70B46K6H.2 size=481182 2024-09-12T18:33:10.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.251+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=30AQ70B46K6H tag=NKXS9393LA54 type=write size=3626910 2024-09-12T18:33:10.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.255+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=1LUQ0MA1488F type=del size=498676 2024-09-12T18:33:10.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.255+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=EET8BUYV25S2 type=del 2024-09-12T18:33:10.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.259+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~C6HFYSKVGPSM.0 size=1048576 2024-09-12T18:33:10.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.263+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~C6HFYSKVGPSM.1 size=1048576 2024-09-12T18:33:10.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.263+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~C6HFYSKVGPSM.2 size=1013220 2024-09-12T18:33:10.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.263+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=C6HFYSKVGPSM tag=5TK137576PE8 type=write size=4158948 2024-09-12T18:33:10.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.267+0000 7f41a072b8c0 1 < completed write operation key=P732C5X0RG8Z tag=XBZV34MH7AKP type=write size=623620 2024-09-12T18:33:10.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.267+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=B5HAHDAY2MVM type=del size=494484 2024-09-12T18:33:10.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.271+0000 7f41a072b8c0 -1 < failed to complete operation key=58IT2R988AW9 tag=L6RH6LI31X63 type=write size=433184: (22) Invalid argument 2024-09-12T18:33:10.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.275+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~ZWA51VV8CM3U.0 size=1048576 2024-09-12T18:33:10.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.275+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~ZWA51VV8CM3U.1 size=838026 2024-09-12T18:33:10.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.275+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=ZWA51VV8CM3U tag=8932OV11ZMKY type=write size=2935178 2024-09-12T18:33:10.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.279+0000 7f41a072b8c0 1 < completed part key=_multipart_7B70QWGMH0C0.2~UJNMUYMH8LK0.0 size=320909 2024-09-12T18:33:10.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.283+0000 7f41a072b8c0 1 < completed multipart upload key=7B70QWGMH0C0 upload=UJNMUYMH8LK0 tag=KWJ59HITZ3HO type=write size=1369485 2024-09-12T18:33:10.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.283+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=U0DGX61CWT53 type=write size=556522 2024-09-12T18:33:10.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.287+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~EAZDS5KM73PP.0 size=1048576 2024-09-12T18:33:10.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.287+0000 7f41a072b8c0 1 < canceled part key=_multipart_58IT2R988AW9.2~EAZDS5KM73PP.1 size=484518 2024-09-12T18:33:10.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.291+0000 7f41a072b8c0 1 < canceled multipart upload key=58IT2R988AW9 upload=EAZDS5KM73PP tag=ESSE8MBU874J type=write size=2581670 2024-09-12T18:33:10.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.295+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~PP74RP21YTP1.0 size=1048576 2024-09-12T18:33:10.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.295+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~PP74RP21YTP1.1 size=1048576 2024-09-12T18:33:10.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.295+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~PP74RP21YTP1.2 size=598581 2024-09-12T18:33:10.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.295+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=PP74RP21YTP1 tag=P8JOSP35YB73 type=write size=3744309 2024-09-12T18:33:10.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.299+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=EJ8RZYUMDZDD type=del 2024-09-12T18:33:10.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.299+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=RQ1LPI5BRDIA type=write size=29384 2024-09-12T18:33:10.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.303+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=52G2N1KET21F type=del 2024-09-12T18:33:10.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.303+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=R0WRL80FTRGK type=del size=3860310 2024-09-12T18:33:10.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.307+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~UHNKHDR89OID.0 size=681093 2024-09-12T18:33:10.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.311+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=UHNKHDR89OID tag=F3Y0MMCPJXHT type=write size=1729669 2024-09-12T18:33:10.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.311+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=PK43YY5JMLH0 type=del size=2511301 2024-09-12T18:33:10.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.315+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=FRHHZA5W4QLO type=del 2024-09-12T18:33:10.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.315+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=TX7Y9G97H7TJ type=del size=271214 2024-09-12T18:33:10.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.319+0000 7f41a072b8c0 1 < completed delete operation key=1JIIRDVMT0B0 tag=KGKHTI2JDBID type=del 2024-09-12T18:33:10.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.323+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=4UFP2UVIVQRE type=del size=4086586 2024-09-12T18:33:10.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.323+0000 7f41a072b8c0 -1 < failed to complete operation key=58IT2R988AW9 tag=MZ3O2A5C7CR5 type=del size=791617: (22) Invalid argument 2024-09-12T18:33:10.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.327+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~TAWR612033GE.0 size=1048576 2024-09-12T18:33:10.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.331+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~TAWR612033GE.1 size=1048576 2024-09-12T18:33:10.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.331+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~TAWR612033GE.2 size=433114 2024-09-12T18:33:10.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.331+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=TAWR612033GE tag=WLO348G4RT4O type=write size=3578842 2024-09-12T18:33:10.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.335+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~U1YX5OSCKHW4.0 size=459165 2024-09-12T18:33:10.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.339+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=U1YX5OSCKHW4 tag=LTGL8O511AYV type=write size=1507741 2024-09-12T18:33:10.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.343+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~PPY0Q0UBO7HP.0 size=1010513 2024-09-12T18:33:10.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.343+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=PPY0Q0UBO7HP tag=SR1E1B387S8K type=write size=2059089 2024-09-12T18:33:10.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.343+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~ZFAYCB0GZYFK.0 size=583284 2024-09-12T18:33:10.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.347+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=ZFAYCB0GZYFK tag=XQW5XC6FRUJD type=write size=1631860 2024-09-12T18:33:10.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.351+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=Y17TVWN5EC52 type=del size=3001371 2024-09-12T18:33:10.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.351+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=NYGJKUDXLQQD type=del 2024-09-12T18:33:10.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.355+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=AV5G4BNO9I93 type=write size=96678 2024-09-12T18:33:10.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.355+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=DGRUE45IB4DT type=del 2024-09-12T18:33:10.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.359+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=9KM0J9ZJSXNC type=del size=2395929 2024-09-12T18:33:10.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.359+0000 7f41a072b8c0 1 < completed delete operation key=NKMA8FG3V3TR tag=1LUQ0MA1488F type=del 2024-09-12T18:33:10.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.363+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=O5MQYOYULK1W type=del size=1655503 2024-09-12T18:33:10.366 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.367+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~C6HFYSKVGPSM.0 size=1048576 2024-09-12T18:33:10.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.367+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~C6HFYSKVGPSM.1 size=1048576 2024-09-12T18:33:10.370 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.371+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~C6HFYSKVGPSM.2 size=1013220 2024-09-12T18:33:10.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.371+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=C6HFYSKVGPSM tag=5TK137576PE8 type=write size=4158948 2024-09-12T18:33:10.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.375+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~L53HH3PHPU9P.0 size=1048576 2024-09-12T18:33:10.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.379+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~L53HH3PHPU9P.1 size=1048576 2024-09-12T18:33:10.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.379+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~L53HH3PHPU9P.2 size=249447 2024-09-12T18:33:10.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.379+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=L53HH3PHPU9P tag=4PHFDSDH57NO type=write size=3395175 2024-09-12T18:33:10.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.383+0000 7f41a072b8c0 1 < suggested remove operation key=GC8797KSO47E tag=B5HAHDAY2MVM type=del 2024-09-12T18:33:10.388 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.387+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~3E0W53WFDQSX.0 size=1048576 2024-09-12T18:33:10.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.391+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~3E0W53WFDQSX.1 size=1048576 2024-09-12T18:33:10.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.391+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~3E0W53WFDQSX.2 size=590767 2024-09-12T18:33:10.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.391+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=3E0W53WFDQSX tag=2A4ERLWNR6QB type=write size=3736495 2024-09-12T18:33:10.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.391+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~ZWA51VV8CM3U.0 size=1048576 2024-09-12T18:33:10.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.395+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~ZWA51VV8CM3U.1 size=838026 2024-09-12T18:33:10.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.399+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=ZWA51VV8CM3U tag=8932OV11ZMKY type=write size=2935178 2024-09-12T18:33:10.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.403+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~UAB7K37Y6BG3.0 size=262860 2024-09-12T18:33:10.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.403+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=UAB7K37Y6BG3 tag=6ZLJ3ZJUPNOD type=write size=1311436 2024-09-12T18:33:10.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.403+0000 7f41a072b8c0 1 < completed write operation key=ZACT36ZOC9ES tag=U0DGX61CWT53 type=write size=556522 2024-09-12T18:33:10.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.407+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=JM5SJK0O6SB8 type=del size=2301528 2024-09-12T18:33:10.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.411+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~PP74RP21YTP1.0 size=1048576 2024-09-12T18:33:10.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.411+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~PP74RP21YTP1.1 size=1048576 2024-09-12T18:33:10.415 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.415+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~PP74RP21YTP1.2 size=598581 2024-09-12T18:33:10.419 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.419+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=PP74RP21YTP1 tag=P8JOSP35YB73 type=write size=3744309 2024-09-12T18:33:10.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.419+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=6107NBZ65OMD type=del size=757342 2024-09-12T18:33:10.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.423+0000 7f41a072b8c0 1 < completed write operation key=3CGBX19WTMWQ tag=RQ1LPI5BRDIA type=write size=29384 2024-09-12T18:33:10.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.423+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=YY51LZHGJ1F8 type=del size=2557107 2024-09-12T18:33:10.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.427+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=R0WRL80FTRGK type=del 2024-09-12T18:33:10.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.427+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=LI7SLLU9T5MU type=write size=928792 2024-09-12T18:33:10.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.431+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=PK43YY5JMLH0 type=del 2024-09-12T18:33:10.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.435+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=0YWCJDH6MBZI type=del size=3542833 2024-09-12T18:33:10.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.435+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=TX7Y9G97H7TJ type=del 2024-09-12T18:33:10.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.439+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~V6J19C7QHLHC.0 size=1048576 2024-09-12T18:33:10.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.439+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~V6J19C7QHLHC.1 size=1048576 2024-09-12T18:33:10.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.443+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~V6J19C7QHLHC.2 size=868492 2024-09-12T18:33:10.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.443+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=V6J19C7QHLHC tag=1WX9QDMY0LS3 type=write size=4014220 2024-09-12T18:33:10.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.443+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=4UFP2UVIVQRE type=del 2024-09-12T18:33:10.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.447+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=D303XWBBQ0BR type=del size=1039064 2024-09-12T18:33:10.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.447+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~TAWR612033GE.0 size=1048576 2024-09-12T18:33:10.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.451+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~TAWR612033GE.1 size=1048576 2024-09-12T18:33:10.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.451+0000 7f41a072b8c0 1 < canceled part key=_multipart_0O97F5ON55TX.2~TAWR612033GE.2 size=433114 2024-09-12T18:33:10.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.455+0000 7f41a072b8c0 1 < canceled multipart upload key=0O97F5ON55TX upload=TAWR612033GE tag=WLO348G4RT4O type=write size=3578842 2024-09-12T18:33:10.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.459+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~49LRUT2X272M.0 size=1048576 2024-09-12T18:33:10.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.459+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~49LRUT2X272M.1 size=1048576 2024-09-12T18:33:10.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.459+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~49LRUT2X272M.2 size=813086 2024-09-12T18:33:10.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.459+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=49LRUT2X272M tag=HAGF0NQ8OB75 type=write size=3958814 2024-09-12T18:33:10.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.463+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~PPY0Q0UBO7HP.0 size=1010513 2024-09-12T18:33:10.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.467+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=PPY0Q0UBO7HP tag=SR1E1B387S8K type=write size=2059089 2024-09-12T18:33:10.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.471+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=KL7BZYS9BOL5 type=write size=81049 2024-09-12T18:33:10.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.475+0000 7f41a072b8c0 1 < suggested update operation key=VEN0P2P1RZ2S tag=Y17TVWN5EC52 type=del size=3001371 2024-09-12T18:33:10.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.475+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=QU0JC1PO05E5 type=del size=1416795 2024-09-12T18:33:10.481 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.479+0000 7f41a072b8c0 1 < suggested update operation key=ZACT36ZOC9ES tag=AV5G4BNO9I93 type=write size=96678 2024-09-12T18:33:10.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.483+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=DIGHL48WKCY9 type=del size=374789 2024-09-12T18:33:10.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.483+0000 7f41a072b8c0 1 < completed delete operation key=SK3T82EJFZXE tag=9KM0J9ZJSXNC type=del 2024-09-12T18:33:10.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.487+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=PJ5UCDOYUNRX type=del size=3507380 2024-09-12T18:33:10.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.487+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=O5MQYOYULK1W type=del 2024-09-12T18:33:10.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.491+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=Z6F6KJJCMC0Z type=del size=2993672 2024-09-12T18:33:10.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.491+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~L53HH3PHPU9P.0 size=1048576 2024-09-12T18:33:10.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.495+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~L53HH3PHPU9P.1 size=1048576 2024-09-12T18:33:10.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.495+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~L53HH3PHPU9P.2 size=249447 2024-09-12T18:33:10.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.499+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=L53HH3PHPU9P tag=4PHFDSDH57NO type=write size=3395175 2024-09-12T18:33:10.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.503+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~816IG8MLZYVK.0 size=1048576 2024-09-12T18:33:10.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~816IG8MLZYVK.1 size=1048576 2024-09-12T18:33:10.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~816IG8MLZYVK.2 size=914800 2024-09-12T18:33:10.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.507+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=816IG8MLZYVK tag=E371ZM4CGI9P type=write size=4060528 2024-09-12T18:33:10.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.511+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~3E0W53WFDQSX.0 size=1048576 2024-09-12T18:33:10.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.511+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~3E0W53WFDQSX.1 size=1048576 2024-09-12T18:33:10.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.515+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~3E0W53WFDQSX.2 size=590767 2024-09-12T18:33:10.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.519+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=3E0W53WFDQSX tag=2A4ERLWNR6QB type=write size=3736495 2024-09-12T18:33:10.523 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.523+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~OGPC7EJJNOX3.0 size=1048576 2024-09-12T18:33:10.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.523+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~OGPC7EJJNOX3.1 size=1048576 2024-09-12T18:33:10.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.527+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~OGPC7EJJNOX3.2 size=272497 2024-09-12T18:33:10.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.527+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=OGPC7EJJNOX3 tag=736I5U7IBC94 type=write size=3418225 2024-09-12T18:33:10.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.527+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~UAB7K37Y6BG3.0 size=262860 2024-09-12T18:33:10.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.531+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=UAB7K37Y6BG3 tag=6ZLJ3ZJUPNOD type=write size=1311436 2024-09-12T18:33:10.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.535+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~EMZHYB0P4CE4.0 size=1048576 2024-09-12T18:33:10.539 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.539+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~EMZHYB0P4CE4.1 size=1048576 2024-09-12T18:33:10.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.539+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~EMZHYB0P4CE4.2 size=1002059 2024-09-12T18:33:10.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.539+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=EMZHYB0P4CE4 tag=KK6Q1K3VW9MY type=write size=4147787 2024-09-12T18:33:10.545 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.543+0000 7f41a072b8c0 1 < suggested update operation key=KOLD6WYK30EQ tag=JM5SJK0O6SB8 type=del size=2301528 2024-09-12T18:33:10.548 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.547+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=C88X4SYW5673 type=del size=578802 2024-09-12T18:33:10.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.551+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=6107NBZ65OMD type=del 2024-09-12T18:33:10.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.555+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~YNLS6E3LXVM8.0 size=1048576 2024-09-12T18:33:10.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.555+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~YNLS6E3LXVM8.1 size=837564 2024-09-12T18:33:10.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.555+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=YNLS6E3LXVM8 tag=5T72JQE17WB1 type=write size=2934716 2024-09-12T18:33:10.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.559+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=YY51LZHGJ1F8 type=del 2024-09-12T18:33:10.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.559+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~Q8OD34BKYQ87.0 size=1048576 2024-09-12T18:33:10.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.563+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~Q8OD34BKYQ87.1 size=1048576 2024-09-12T18:33:10.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.563+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~Q8OD34BKYQ87.2 size=971910 2024-09-12T18:33:10.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.563+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=Q8OD34BKYQ87 tag=C1ZY9PKMDRAM type=write size=4117638 2024-09-12T18:33:10.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.567+0000 7f41a072b8c0 1 < completed write operation key=P732C5X0RG8Z tag=LI7SLLU9T5MU type=write size=928792 2024-09-12T18:33:10.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.567+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=RQKNMD6U55NB type=write size=511362 2024-09-12T18:33:10.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.571+0000 7f41a072b8c0 1 < canceled operation key=C2PRRD3QO9AF tag=0YWCJDH6MBZI type=del size=3542833 2024-09-12T18:33:10.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.575+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~E8YOOQ3ONX16.0 size=1048576 2024-09-12T18:33:10.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.575+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~E8YOOQ3ONX16.1 size=634337 2024-09-12T18:33:10.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.575+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=E8YOOQ3ONX16 tag=355WXHB7DFG5 type=write size=2731489 2024-09-12T18:33:10.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.579+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~V6J19C7QHLHC.0 size=1048576 2024-09-12T18:33:10.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.579+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~V6J19C7QHLHC.1 size=1048576 2024-09-12T18:33:10.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.579+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~V6J19C7QHLHC.2 size=868492 2024-09-12T18:33:10.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.583+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=V6J19C7QHLHC tag=1WX9QDMY0LS3 type=write size=4014220 2024-09-12T18:33:10.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.587+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~YV982ATIC281.0 size=467540 2024-09-12T18:33:10.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.587+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=YV982ATIC281 tag=4LDDQ0M1W9MF type=write size=1516116 2024-09-12T18:33:10.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.591+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=D303XWBBQ0BR type=del 2024-09-12T18:33:10.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.591+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~ZHDXLBZG6HVR.0 size=1048576 2024-09-12T18:33:10.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.595+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~ZHDXLBZG6HVR.1 size=1048576 2024-09-12T18:33:10.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.595+0000 7f41a072b8c0 1 > prepared part key=_multipart_GQHPUDV5BG1E.2~ZHDXLBZG6HVR.2 size=337303 2024-09-12T18:33:10.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.595+0000 7f41a072b8c0 1 > prepared multipart upload key=GQHPUDV5BG1E upload=ZHDXLBZG6HVR tag=0VWHV686Q42V type=write size=3483031 2024-09-12T18:33:10.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.595+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~49LRUT2X272M.0 size=1048576 2024-09-12T18:33:10.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.599+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~49LRUT2X272M.1 size=1048576 2024-09-12T18:33:10.601 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.599+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~49LRUT2X272M.2 size=813086 2024-09-12T18:33:10.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.607+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=49LRUT2X272M tag=HAGF0NQ8OB75 type=write size=3958814 2024-09-12T18:33:10.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.607+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=6NI0UQQ7RFKC type=del size=4004118 2024-09-12T18:33:10.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.611+0000 7f41a072b8c0 1 < completed write operation key=295ZC54QRUPD tag=KL7BZYS9BOL5 type=write size=81049 2024-09-12T18:33:10.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.611+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=VCLQ60SDG1IZ type=del size=3927354 2024-09-12T18:33:10.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.615+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=QU0JC1PO05E5 type=del 2024-09-12T18:33:10.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.615+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=4QWTJJNVHD4R type=del size=1146140 2024-09-12T18:33:10.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.619+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=DIGHL48WKCY9 type=del 2024-09-12T18:33:10.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.619+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=H5E5CFHA5LX1 type=del size=3409061 2024-09-12T18:33:10.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.623+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=PJ5UCDOYUNRX type=del 2024-09-12T18:33:10.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.627+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~CJ7VZGCGORVA.0 size=1048576 2024-09-12T18:33:10.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.627+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~CJ7VZGCGORVA.1 size=1048576 2024-09-12T18:33:10.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.631+0000 7f41a072b8c0 1 > prepared part key=_multipart_KP2HF4J376EY.2~CJ7VZGCGORVA.2 size=737046 2024-09-12T18:33:10.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.631+0000 7f41a072b8c0 1 > prepared multipart upload key=KP2HF4J376EY upload=CJ7VZGCGORVA tag=CLX16JXLL8FB type=write size=3882774 2024-09-12T18:33:10.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.635+0000 7f41a072b8c0 1 < suggested remove operation key=V35A7LK08C7J tag=Z6F6KJJCMC0Z type=del 2024-09-12T18:33:10.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.635+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=16IO5ZP4DM1P type=del size=1651690 2024-09-12T18:33:10.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.639+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~816IG8MLZYVK.0 size=1048576 2024-09-12T18:33:10.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.639+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~816IG8MLZYVK.1 size=1048576 2024-09-12T18:33:10.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.643+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~816IG8MLZYVK.2 size=914800 2024-09-12T18:33:10.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.647+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=816IG8MLZYVK tag=E371ZM4CGI9P type=write size=4060528 2024-09-12T18:33:10.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.651+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~BLKWAL26HWE3.0 size=1048576 2024-09-12T18:33:10.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.655+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~BLKWAL26HWE3.1 size=159878 2024-09-12T18:33:10.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.655+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=BLKWAL26HWE3 tag=5X201NUG3RDE type=write size=2257030 2024-09-12T18:33:10.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.655+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~OGPC7EJJNOX3.0 size=1048576 2024-09-12T18:33:10.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.659+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~OGPC7EJJNOX3.1 size=1048576 2024-09-12T18:33:10.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.659+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~OGPC7EJJNOX3.2 size=272497 2024-09-12T18:33:10.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.663+0000 7f41a072b8c0 1 < completed multipart upload key=L01GL4WOUIL2 upload=OGPC7EJJNOX3 tag=736I5U7IBC94 type=write size=3418225 2024-09-12T18:33:10.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.667+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=GDPO1EEX4O7G type=del size=2124465 2024-09-12T18:33:10.672 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.671+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~EMZHYB0P4CE4.0 size=1048576 2024-09-12T18:33:10.672 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.671+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~EMZHYB0P4CE4.1 size=1048576 2024-09-12T18:33:10.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.671+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~EMZHYB0P4CE4.2 size=1002059 2024-09-12T18:33:10.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.679+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=EMZHYB0P4CE4 tag=KK6Q1K3VW9MY type=write size=4147787 2024-09-12T18:33:10.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.679+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=BDK67IE9VLW9 type=del size=2633275 2024-09-12T18:33:10.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.683+0000 7f41a072b8c0 1 < suggested update operation key=A6GQZL25YSNL tag=C88X4SYW5673 type=del size=578802 2024-09-12T18:33:10.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.687+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=1ECAELDE4A71 type=del size=3101309 2024-09-12T18:33:10.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.687+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~YNLS6E3LXVM8.0 size=1048576 2024-09-12T18:33:10.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.691+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~YNLS6E3LXVM8.1 size=837564 2024-09-12T18:33:10.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.695+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=YNLS6E3LXVM8 tag=5T72JQE17WB1 type=write size=2934716 2024-09-12T18:33:10.697 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.695+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=AIJKLT9W9WRJ type=del size=3206297 2024-09-12T18:33:10.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.699+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~Q8OD34BKYQ87.0 size=1048576 2024-09-12T18:33:10.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.699+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~Q8OD34BKYQ87.1 size=1048576 2024-09-12T18:33:10.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.703+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~Q8OD34BKYQ87.2 size=971910 2024-09-12T18:33:10.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.707+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=Q8OD34BKYQ87 tag=C1ZY9PKMDRAM type=write size=4117638 2024-09-12T18:33:10.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.707+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=M6TTWXEUECOY type=del size=587023 2024-09-12T18:33:10.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.711+0000 7f41a072b8c0 1 < completed write operation key=63BP9QETTAM8 tag=RQKNMD6U55NB type=write size=511362 2024-09-12T18:33:10.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.711+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=PNDXF3YRZ8F2 type=del size=850813 2024-09-12T18:33:10.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.715+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~E8YOOQ3ONX16.0 size=1048576 2024-09-12T18:33:10.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.715+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~E8YOOQ3ONX16.1 size=634337 2024-09-12T18:33:10.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.719+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=E8YOOQ3ONX16 tag=355WXHB7DFG5 type=write size=2731489 2024-09-12T18:33:10.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.723+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=SBEUOTELFE6Z type=del size=3244778 2024-09-12T18:33:10.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.723+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~YV982ATIC281.0 size=467540 2024-09-12T18:33:10.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.727+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=YV982ATIC281 tag=4LDDQ0M1W9MF type=write size=1516116 2024-09-12T18:33:10.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.731+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~ZF8V64IJGN0N.0 size=1048576 2024-09-12T18:33:10.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.735+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~ZF8V64IJGN0N.1 size=239862 2024-09-12T18:33:10.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.735+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=ZF8V64IJGN0N tag=8ESQPRMMEFEY type=write size=2337014 2024-09-12T18:33:10.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.735+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~ZHDXLBZG6HVR.0 size=1048576 2024-09-12T18:33:10.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.739+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~ZHDXLBZG6HVR.1 size=1048576 2024-09-12T18:33:10.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.739+0000 7f41a072b8c0 1 < completed part key=_multipart_GQHPUDV5BG1E.2~ZHDXLBZG6HVR.2 size=337303 2024-09-12T18:33:10.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.743+0000 7f41a072b8c0 1 < completed multipart upload key=GQHPUDV5BG1E upload=ZHDXLBZG6HVR tag=0VWHV686Q42V type=write size=3483031 2024-09-12T18:33:10.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.747+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=2HE8KQLFEL5U type=del size=2034025 2024-09-12T18:33:10.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.751+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=6NI0UQQ7RFKC type=del 2024-09-12T18:33:10.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.751+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=3RE0USD9YGET type=del size=2745824 2024-09-12T18:33:10.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.755+0000 7f41a072b8c0 1 < completed delete operation key=5JUWC8RXSA5L tag=VCLQ60SDG1IZ type=del 2024-09-12T18:33:10.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.755+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=F9KKV3NHYGAR type=del size=1294754 2024-09-12T18:33:10.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.759+0000 7f41a072b8c0 1 < canceled operation key=63BP9QETTAM8 tag=4QWTJJNVHD4R type=del size=1146140 2024-09-12T18:33:10.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.763+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~T2YSXHX3U2QS.0 size=1048576 2024-09-12T18:33:10.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.767+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~T2YSXHX3U2QS.1 size=499388 2024-09-12T18:33:10.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.767+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=T2YSXHX3U2QS tag=Q9RVUH9XVL9T type=write size=2596540 2024-09-12T18:33:10.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.771+0000 7f41a072b8c0 1 < suggested remove operation key=L1VC63PK1R2Y tag=H5E5CFHA5LX1 type=del 2024-09-12T18:33:10.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.771+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=B9PRJ6EO6BOZ type=del size=2202932 2024-09-12T18:33:10.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.775+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~CJ7VZGCGORVA.0 size=1048576 2024-09-12T18:33:10.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.779+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~CJ7VZGCGORVA.1 size=1048576 2024-09-12T18:33:10.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.779+0000 7f41a072b8c0 1 < completed part key=_multipart_KP2HF4J376EY.2~CJ7VZGCGORVA.2 size=737046 2024-09-12T18:33:10.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.783+0000 7f41a072b8c0 1 < completed multipart upload key=KP2HF4J376EY upload=CJ7VZGCGORVA tag=CLX16JXLL8FB type=write size=3882774 2024-09-12T18:33:10.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.787+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~X38J6LYSI3U7.0 size=1048576 2024-09-12T18:33:10.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.787+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~X38J6LYSI3U7.1 size=153744 2024-09-12T18:33:10.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.787+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=X38J6LYSI3U7 tag=BQ2S631HR0F2 type=write size=2250896 2024-09-12T18:33:10.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.791+0000 7f41a072b8c0 -1 < failed to complete operation key=A6GQZL25YSNL tag=16IO5ZP4DM1P type=del size=1651690: (22) Invalid argument 2024-09-12T18:33:10.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.795+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~SVKLQKUWI06N.0 size=1048576 2024-09-12T18:33:10.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.795+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~SVKLQKUWI06N.1 size=1048576 2024-09-12T18:33:10.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.799+0000 7f41a072b8c0 1 > prepared part key=_multipart_3R9RN03RFRJP.2~SVKLQKUWI06N.2 size=608461 2024-09-12T18:33:10.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.799+0000 7f41a072b8c0 1 > prepared multipart upload key=3R9RN03RFRJP upload=SVKLQKUWI06N tag=COHTA6OPUVGK type=write size=3754189 2024-09-12T18:33:10.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.799+0000 7f41a072b8c0 1 < canceled part key=_multipart_GA6P1FACU2EQ.2~BLKWAL26HWE3.0 size=1048576 2024-09-12T18:33:10.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.799+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~BLKWAL26HWE3.1 size=159878 2024-09-12T18:33:10.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.803+0000 7f41a072b8c0 1 < canceled multipart upload key=GA6P1FACU2EQ upload=BLKWAL26HWE3 tag=5X201NUG3RDE type=write size=2257030 2024-09-12T18:33:10.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.807+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=LQV79DKC5ECX type=write size=838039 2024-09-12T18:33:10.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.811+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=GDPO1EEX4O7G type=del 2024-09-12T18:33:10.813 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.811+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=1O9AN09ZI30W type=del size=2705623 2024-09-12T18:33:10.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.819+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=BDK67IE9VLW9 type=del 2024-09-12T18:33:10.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.823+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~0TBH1LMZJ2YE.0 size=1048576 2024-09-12T18:33:10.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.823+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~0TBH1LMZJ2YE.1 size=1048576 2024-09-12T18:33:10.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.827+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~0TBH1LMZJ2YE.2 size=436230 2024-09-12T18:33:10.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.827+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=0TBH1LMZJ2YE tag=YDZOFKOK8126 type=write size=3581958 2024-09-12T18:33:10.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.831+0000 7f41a072b8c0 1 < suggested remove operation key=5JUWC8RXSA5L tag=1ECAELDE4A71 type=del 2024-09-12T18:33:10.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.831+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=5MY2CU8D15W5 type=del size=275476 2024-09-12T18:33:10.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.835+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=AIJKLT9W9WRJ type=del 2024-09-12T18:33:10.837 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.835+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=9VUHXVRBHO5W type=del size=1722425 2024-09-12T18:33:10.840 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.839+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=M6TTWXEUECOY type=del 2024-09-12T18:33:10.842 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.843+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=PE1MTSG7MTC6 type=del size=54767 2024-09-12T18:33:10.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.843+0000 7f41a072b8c0 1 < canceled operation key=GA6P1FACU2EQ tag=PNDXF3YRZ8F2 type=del size=850813 2024-09-12T18:33:10.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.847+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=XTMWYKJNVXDI type=del size=995990 2024-09-12T18:33:10.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.851+0000 7f41a072b8c0 1 < suggested remove operation key=7MRN7L1DTAMO tag=SBEUOTELFE6Z type=del 2024-09-12T18:33:10.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.851+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=1CHTILABEOY9 type=del size=2739672 2024-09-12T18:33:10.856 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.855+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~ZF8V64IJGN0N.0 size=1048576 2024-09-12T18:33:10.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.855+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~ZF8V64IJGN0N.1 size=239862 2024-09-12T18:33:10.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.859+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=ZF8V64IJGN0N tag=8ESQPRMMEFEY type=write size=2337014 2024-09-12T18:33:10.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.863+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~K9SZK507OS3C.0 size=797779 2024-09-12T18:33:10.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.863+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=K9SZK507OS3C tag=1PL54Z9Y7PGB type=write size=1846355 2024-09-12T18:33:10.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.867+0000 7f41a072b8c0 1 < canceled operation key=P732C5X0RG8Z tag=2HE8KQLFEL5U type=del size=2034025 2024-09-12T18:33:10.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.871+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~UAZWMAVIAUAK.0 size=1048576 2024-09-12T18:33:10.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.871+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~UAZWMAVIAUAK.1 size=1048576 2024-09-12T18:33:10.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.875+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~UAZWMAVIAUAK.2 size=723193 2024-09-12T18:33:10.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.875+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=UAZWMAVIAUAK tag=BK129M1B8504 type=write size=3868921 2024-09-12T18:33:10.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.875+0000 7f41a072b8c0 1 < completed delete operation key=YP72VTCGSHYE tag=3RE0USD9YGET type=del 2024-09-12T18:33:10.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.879+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=QQ40CF0E5ZOK type=del size=778180 2024-09-12T18:33:10.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.879+0000 7f41a072b8c0 -1 < no bi entry to suggest for operation key=L1VC63PK1R2Y tag=F9KKV3NHYGAR type=del size=1294754: (2) No such file or directory 2024-09-12T18:33:10.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.879+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=MPCJ6Q6IGPH3 type=del size=3456578 2024-09-12T18:33:10.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.883+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~T2YSXHX3U2QS.0 size=1048576 2024-09-12T18:33:10.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.883+0000 7f41a072b8c0 1 < completed part key=_multipart_58IT2R988AW9.2~T2YSXHX3U2QS.1 size=499388 2024-09-12T18:33:10.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.887+0000 7f41a072b8c0 1 < completed multipart upload key=58IT2R988AW9 upload=T2YSXHX3U2QS tag=Q9RVUH9XVL9T type=write size=2596540 2024-09-12T18:33:10.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.891+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~AZ8UUG9FP6QE.0 size=316743 2024-09-12T18:33:10.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.891+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=AZ8UUG9FP6QE tag=6W8ZDX80ZPGH type=write size=1365319 2024-09-12T18:33:10.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.895+0000 7f41a072b8c0 1 < suggested remove operation key=5OD9IX408CYO tag=B9PRJ6EO6BOZ type=del 2024-09-12T18:33:10.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.899+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=G4BQFPE4YCIM type=del size=3801394 2024-09-12T18:33:10.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.903+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~X38J6LYSI3U7.0 size=1048576 2024-09-12T18:33:10.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.903+0000 7f41a072b8c0 1 < canceled part key=_multipart_7MRN7L1DTAMO.2~X38J6LYSI3U7.1 size=153744 2024-09-12T18:33:10.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.903+0000 7f41a072b8c0 1 < canceled multipart upload key=7MRN7L1DTAMO upload=X38J6LYSI3U7 tag=BQ2S631HR0F2 type=write size=2250896 2024-09-12T18:33:10.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.907+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=PDHK8PWX31LO type=del size=1770293 2024-09-12T18:33:10.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.911+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~SVKLQKUWI06N.0 size=1048576 2024-09-12T18:33:10.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.911+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~SVKLQKUWI06N.1 size=1048576 2024-09-12T18:33:10.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.911+0000 7f41a072b8c0 1 < completed part key=_multipart_3R9RN03RFRJP.2~SVKLQKUWI06N.2 size=608461 2024-09-12T18:33:10.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.915+0000 7f41a072b8c0 1 < completed multipart upload key=3R9RN03RFRJP upload=SVKLQKUWI06N tag=COHTA6OPUVGK type=write size=3754189 2024-09-12T18:33:10.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.919+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=NABNZOSPE4AR type=del size=756254 2024-09-12T18:33:10.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.923+0000 7f41a072b8c0 1 < completed write operation key=KOLD6WYK30EQ tag=LQV79DKC5ECX type=write size=838039 2024-09-12T18:33:10.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.923+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~YJA1Q4MYZD5S.0 size=1048576 2024-09-12T18:33:10.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.927+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~YJA1Q4MYZD5S.1 size=1048576 2024-09-12T18:33:10.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.927+0000 7f41a072b8c0 1 > prepared part key=_multipart_0O97F5ON55TX.2~YJA1Q4MYZD5S.2 size=490067 2024-09-12T18:33:10.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.927+0000 7f41a072b8c0 1 > prepared multipart upload key=0O97F5ON55TX upload=YJA1Q4MYZD5S tag=RLJYQ7WCFS5H type=write size=3635795 2024-09-12T18:33:10.931 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.931+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=1O9AN09ZI30W type=del 2024-09-12T18:33:10.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.931+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=6MV9VOXHLHIC type=del size=888299 2024-09-12T18:33:10.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.935+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~0TBH1LMZJ2YE.0 size=1048576 2024-09-12T18:33:10.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.939+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~0TBH1LMZJ2YE.1 size=1048576 2024-09-12T18:33:10.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.939+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~0TBH1LMZJ2YE.2 size=436230 2024-09-12T18:33:10.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.943+0000 7f41a072b8c0 1 < completed multipart upload key=5JUWC8RXSA5L upload=0TBH1LMZJ2YE tag=YDZOFKOK8126 type=write size=3581958 2024-09-12T18:33:10.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.947+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~GV9QNBPYI97O.0 size=1048576 2024-09-12T18:33:10.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.951+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~GV9QNBPYI97O.1 size=1048576 2024-09-12T18:33:10.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.951+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~GV9QNBPYI97O.2 size=927568 2024-09-12T18:33:10.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.951+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=GV9QNBPYI97O tag=P1SU0GQKRW31 type=write size=4073296 2024-09-12T18:33:10.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.955+0000 7f41a072b8c0 1 < suggested remove operation key=NKMA8FG3V3TR tag=5MY2CU8D15W5 type=del 2024-09-12T18:33:10.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.959+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~7G492R6GWQA1.0 size=1048576 2024-09-12T18:33:10.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.963+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~7G492R6GWQA1.1 size=1048576 2024-09-12T18:33:10.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.963+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~7G492R6GWQA1.2 size=431966 2024-09-12T18:33:10.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.963+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=7G492R6GWQA1 tag=BQ8U7JUBOI5P type=write size=3577694 2024-09-12T18:33:10.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.967+0000 7f41a072b8c0 1 < suggested update operation key=7B70QWGMH0C0 tag=9VUHXVRBHO5W type=del size=1722425 2024-09-12T18:33:10.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.971+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=LFBMRVZENIXA type=del size=4010174 2024-09-12T18:33:10.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.971+0000 7f41a072b8c0 -1 < failed to complete operation key=NKMA8FG3V3TR tag=PE1MTSG7MTC6 type=del size=54767: (22) Invalid argument 2024-09-12T18:33:10.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.975+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~4F0DS73S9AF7.0 size=1048576 2024-09-12T18:33:10.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.979+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~4F0DS73S9AF7.1 size=1048576 2024-09-12T18:33:10.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.979+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~4F0DS73S9AF7.2 size=751803 2024-09-12T18:33:10.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.979+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=4F0DS73S9AF7 tag=2NV3P8TPDEGF type=write size=3897531 2024-09-12T18:33:10.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.983+0000 7f41a072b8c0 1 < suggested remove operation key=V35A7LK08C7J tag=XTMWYKJNVXDI type=del 2024-09-12T18:33:10.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.987+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=Y9OA6ISQE2EP type=del size=1205674 2024-09-12T18:33:10.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.987+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=1CHTILABEOY9 type=del 2024-09-12T18:33:10.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.991+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~XVZNKYOHJ9UF.0 size=1048576 2024-09-12T18:33:10.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.995+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~XVZNKYOHJ9UF.1 size=257986 2024-09-12T18:33:10.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.995+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=XVZNKYOHJ9UF tag=EDS9K216APMX type=write size=2355138 2024-09-12T18:33:10.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.995+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~K9SZK507OS3C.0 size=797779 2024-09-12T18:33:11.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:10.999+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=K9SZK507OS3C tag=1PL54Z9Y7PGB type=write size=1846355 2024-09-12T18:33:11.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.003+0000 7f41a072b8c0 1 > prepared operation key=C2PRRD3QO9AF tag=43HKC8QA4NFE type=write size=592934 2024-09-12T18:33:11.005 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.003+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~UAZWMAVIAUAK.0 size=1048576 2024-09-12T18:33:11.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.007+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~UAZWMAVIAUAK.1 size=1048576 2024-09-12T18:33:11.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.007+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~UAZWMAVIAUAK.2 size=723193 2024-09-12T18:33:11.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.011+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=UAZWMAVIAUAK tag=BK129M1B8504 type=write size=3868921 2024-09-12T18:33:11.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.015+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~44E9FGCU3GEU.0 size=852910 2024-09-12T18:33:11.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.015+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=44E9FGCU3GEU tag=UNFKRBYRN031 type=write size=1901486 2024-09-12T18:33:11.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.019+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=QQ40CF0E5ZOK type=del 2024-09-12T18:33:11.021 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.019+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=YI8FFADO10FT type=del size=888458 2024-09-12T18:33:11.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.023+0000 7f41a072b8c0 -1 < no bi entry to suggest for operation key=V35A7LK08C7J tag=MPCJ6Q6IGPH3 type=del size=3456578: (2) No such file or directory 2024-09-12T18:33:11.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.027+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~8QL2VEFQ2I0K.0 size=1048576 2024-09-12T18:33:11.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.031+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~8QL2VEFQ2I0K.1 size=639629 2024-09-12T18:33:11.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.031+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=8QL2VEFQ2I0K tag=7NKQJHHUNEI0 type=write size=2736781 2024-09-12T18:33:11.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.031+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~AZ8UUG9FP6QE.0 size=316743 2024-09-12T18:33:11.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.035+0000 7f41a072b8c0 1 < completed multipart upload key=A6GQZL25YSNL upload=AZ8UUG9FP6QE tag=6W8ZDX80ZPGH type=write size=1365319 2024-09-12T18:33:11.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.039+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~94MH9P3DO1WA.0 size=163852 2024-09-12T18:33:11.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.039+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=94MH9P3DO1WA tag=0LNMKAX4XWBN type=write size=1212428 2024-09-12T18:33:11.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.043+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=G4BQFPE4YCIM type=del 2024-09-12T18:33:11.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.043+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=FTSP0PSDAIIN type=del size=446546 2024-09-12T18:33:11.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.047+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=PDHK8PWX31LO type=del 2024-09-12T18:33:11.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.051+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~3GKJ08WH21MJ.0 size=1048576 2024-09-12T18:33:11.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.051+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~3GKJ08WH21MJ.1 size=1048576 2024-09-12T18:33:11.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.055+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~3GKJ08WH21MJ.2 size=233089 2024-09-12T18:33:11.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.055+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=3GKJ08WH21MJ tag=59YHGEPJYD60 type=write size=3378817 2024-09-12T18:33:11.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.055+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=NABNZOSPE4AR type=del 2024-09-12T18:33:11.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.059+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=I5ML2YM8TM8R type=del size=3381799 2024-09-12T18:33:11.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.063+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~YJA1Q4MYZD5S.0 size=1048576 2024-09-12T18:33:11.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.063+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~YJA1Q4MYZD5S.1 size=1048576 2024-09-12T18:33:11.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.063+0000 7f41a072b8c0 1 < completed part key=_multipart_0O97F5ON55TX.2~YJA1Q4MYZD5S.2 size=490067 2024-09-12T18:33:11.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.067+0000 7f41a072b8c0 1 < completed multipart upload key=0O97F5ON55TX upload=YJA1Q4MYZD5S tag=RLJYQ7WCFS5H type=write size=3635795 2024-09-12T18:33:11.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.071+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=SEEQ3CP3VVQX type=write size=1031928 2024-09-12T18:33:11.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.071+0000 7f41a072b8c0 1 < completed delete operation key=YCBC1CHWJQC5 tag=6MV9VOXHLHIC type=del 2024-09-12T18:33:11.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.075+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=IIK3HYCXJF0F type=del size=1863951 2024-09-12T18:33:11.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.079+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~GV9QNBPYI97O.0 size=1048576 2024-09-12T18:33:11.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.079+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~GV9QNBPYI97O.1 size=1048576 2024-09-12T18:33:11.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.083+0000 7f41a072b8c0 1 < completed part key=_multipart_GA6P1FACU2EQ.2~GV9QNBPYI97O.2 size=927568 2024-09-12T18:33:11.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.083+0000 7f41a072b8c0 1 < completed multipart upload key=GA6P1FACU2EQ upload=GV9QNBPYI97O tag=P1SU0GQKRW31 type=write size=4073296 2024-09-12T18:33:11.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.087+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=K476Z66CVYWB type=del size=627977 2024-09-12T18:33:11.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.091+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~7G492R6GWQA1.0 size=1048576 2024-09-12T18:33:11.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.091+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~7G492R6GWQA1.1 size=1048576 2024-09-12T18:33:11.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.095+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~7G492R6GWQA1.2 size=431966 2024-09-12T18:33:11.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.099+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=7G492R6GWQA1 tag=BQ8U7JUBOI5P type=write size=3577694 2024-09-12T18:33:11.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.099+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=NF2P94Y6ZPNQ type=del size=2798700 2024-09-12T18:33:11.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.103+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=LFBMRVZENIXA type=del 2024-09-12T18:33:11.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.107+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~WX7MLTYTWYHX.0 size=1048576 2024-09-12T18:33:11.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.107+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~WX7MLTYTWYHX.1 size=1048576 2024-09-12T18:33:11.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.111+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~WX7MLTYTWYHX.2 size=925237 2024-09-12T18:33:11.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.111+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=WX7MLTYTWYHX tag=XIYVCT9ZH6P3 type=write size=4070965 2024-09-12T18:33:11.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.111+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~4F0DS73S9AF7.0 size=1048576 2024-09-12T18:33:11.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.115+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~4F0DS73S9AF7.1 size=1048576 2024-09-12T18:33:11.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.115+0000 7f41a072b8c0 1 < canceled part key=_multipart_P732C5X0RG8Z.2~4F0DS73S9AF7.2 size=751803 2024-09-12T18:33:11.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.119+0000 7f41a072b8c0 1 < canceled multipart upload key=P732C5X0RG8Z upload=4F0DS73S9AF7 tag=2NV3P8TPDEGF type=write size=3897531 2024-09-12T18:33:11.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.119+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=J0KWB24SAEAH type=write size=742742 2024-09-12T18:33:11.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.123+0000 7f41a072b8c0 1 < completed delete operation key=L01GL4WOUIL2 tag=Y9OA6ISQE2EP type=del 2024-09-12T18:33:11.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.123+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=GQCPUIFBYCIW type=del size=3692419 2024-09-12T18:33:11.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.127+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~XVZNKYOHJ9UF.0 size=1048576 2024-09-12T18:33:11.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.127+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~XVZNKYOHJ9UF.1 size=257986 2024-09-12T18:33:11.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.131+0000 7f41a072b8c0 1 < completed multipart upload key=A6GQZL25YSNL upload=XVZNKYOHJ9UF tag=EDS9K216APMX type=write size=2355138 2024-09-12T18:33:11.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.135+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=M8O3SU9DUIG3 type=del size=2075017 2024-09-12T18:33:11.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.135+0000 7f41a072b8c0 1 < completed write operation key=C2PRRD3QO9AF tag=43HKC8QA4NFE type=write size=592934 2024-09-12T18:33:11.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.139+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=J00KCUH15KT9 type=del size=2858527 2024-09-12T18:33:11.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.139+0000 7f41a072b8c0 1 < canceled part key=_multipart_5OD9IX408CYO.2~44E9FGCU3GEU.0 size=852910 2024-09-12T18:33:11.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.139+0000 7f41a072b8c0 1 < canceled multipart upload key=5OD9IX408CYO upload=44E9FGCU3GEU tag=UNFKRBYRN031 type=write size=1901486 2024-09-12T18:33:11.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.143+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=NTUIMSMX75V7 type=del size=3583676 2024-09-12T18:33:11.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.147+0000 7f41a072b8c0 1 < suggested update operation key=KOLD6WYK30EQ tag=YI8FFADO10FT type=del size=888458 2024-09-12T18:33:11.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.147+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=EB4ME6U084T1 type=del size=284585 2024-09-12T18:33:11.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.151+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~8QL2VEFQ2I0K.0 size=1048576 2024-09-12T18:33:11.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.151+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~8QL2VEFQ2I0K.1 size=639629 2024-09-12T18:33:11.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.155+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=8QL2VEFQ2I0K tag=7NKQJHHUNEI0 type=write size=2736781 2024-09-12T18:33:11.158 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.159+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=B65ZODK2BNGR type=del size=2106947 2024-09-12T18:33:11.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.159+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~94MH9P3DO1WA.0 size=163852 2024-09-12T18:33:11.164 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.163+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=94MH9P3DO1WA tag=0LNMKAX4XWBN type=write size=1212428 2024-09-12T18:33:11.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.167+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=1IUH6DQR6Y8Q type=del size=130751 2024-09-12T18:33:11.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.167+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=FTSP0PSDAIIN type=del 2024-09-12T18:33:11.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.171+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~RDQU1O20QBDC.0 size=1048576 2024-09-12T18:33:11.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.171+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~RDQU1O20QBDC.1 size=1048576 2024-09-12T18:33:11.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.175+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~RDQU1O20QBDC.2 size=976481 2024-09-12T18:33:11.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.175+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=RDQU1O20QBDC tag=T8UF7ABYIYPA type=write size=4122209 2024-09-12T18:33:11.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.175+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~3GKJ08WH21MJ.0 size=1048576 2024-09-12T18:33:11.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.179+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~3GKJ08WH21MJ.1 size=1048576 2024-09-12T18:33:11.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.179+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~3GKJ08WH21MJ.2 size=233089 2024-09-12T18:33:11.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.183+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=3GKJ08WH21MJ tag=59YHGEPJYD60 type=write size=3378817 2024-09-12T18:33:11.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.187+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~F0DW3TX36VG3.0 size=1048576 2024-09-12T18:33:11.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.187+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~F0DW3TX36VG3.1 size=1048576 2024-09-12T18:33:11.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.191+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~F0DW3TX36VG3.2 size=159276 2024-09-12T18:33:11.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.191+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=F0DW3TX36VG3 tag=UD2VCAB6UA53 type=write size=3305004 2024-09-12T18:33:11.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.191+0000 7f41a072b8c0 -1 < failed to complete operation key=KOLD6WYK30EQ tag=I5ML2YM8TM8R type=del size=3381799: (22) Invalid argument 2024-09-12T18:33:11.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.195+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=OR02Q88ODIQD type=write size=285750 2024-09-12T18:33:11.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.195+0000 7f41a072b8c0 1 < completed write operation key=1BSAN5TRTZNZ tag=SEEQ3CP3VVQX type=write size=1031928 2024-09-12T18:33:11.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.199+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=C14LSOBMOPM1 type=del size=760171 2024-09-12T18:33:11.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.203+0000 7f41a072b8c0 1 < suggested update operation key=63BP9QETTAM8 tag=IIK3HYCXJF0F type=del size=1863951 2024-09-12T18:33:11.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.203+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=C1HDF677GEHJ type=del size=4133075 2024-09-12T18:33:11.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.207+0000 7f41a072b8c0 1 < suggested remove operation key=SK3T82EJFZXE tag=K476Z66CVYWB type=del 2024-09-12T18:33:11.214 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.211+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~3ELAZ7XQUVGD.0 size=1048576 2024-09-12T18:33:11.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.215+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~3ELAZ7XQUVGD.1 size=1048576 2024-09-12T18:33:11.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.215+0000 7f41a072b8c0 1 > prepared part key=_multipart_YCBC1CHWJQC5.2~3ELAZ7XQUVGD.2 size=368197 2024-09-12T18:33:11.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.215+0000 7f41a072b8c0 1 > prepared multipart upload key=YCBC1CHWJQC5 upload=3ELAZ7XQUVGD tag=BKCLJ45P6PX3 type=write size=3513925 2024-09-12T18:33:11.222 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.223+0000 7f41a072b8c0 1 < suggested update operation key=VEN0P2P1RZ2S tag=NF2P94Y6ZPNQ type=del size=2798700 2024-09-12T18:33:11.228 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.227+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=ZVCBS1VK35PI type=del size=3366188 2024-09-12T18:33:11.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.231+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~WX7MLTYTWYHX.0 size=1048576 2024-09-12T18:33:11.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.231+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~WX7MLTYTWYHX.1 size=1048576 2024-09-12T18:33:11.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.235+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~WX7MLTYTWYHX.2 size=925237 2024-09-12T18:33:11.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.239+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=WX7MLTYTWYHX tag=XIYVCT9ZH6P3 type=write size=4070965 2024-09-12T18:33:11.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.243+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~LP7NOTKDZSWP.0 size=1048576 2024-09-12T18:33:11.247 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.247+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~LP7NOTKDZSWP.1 size=1048576 2024-09-12T18:33:11.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.247+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~LP7NOTKDZSWP.2 size=479520 2024-09-12T18:33:11.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.247+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=LP7NOTKDZSWP tag=OIXKRK3634QC type=write size=3625248 2024-09-12T18:33:11.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.251+0000 7f41a072b8c0 1 < completed write operation key=A6GQZL25YSNL tag=J0KWB24SAEAH type=write size=742742 2024-09-12T18:33:11.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.251+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=4YGSF0QNVMG2 type=del size=2096390 2024-09-12T18:33:11.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.255+0000 7f41a072b8c0 1 < canceled operation key=0G0YWIOD3L3I tag=GQCPUIFBYCIW type=del size=3692419 2024-09-12T18:33:11.258 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.255+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=DBSWSGIGM1B4 type=del size=2934076 2024-09-12T18:33:11.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.263+0000 7f41a072b8c0 1 < suggested update operation key=NKMA8FG3V3TR tag=M8O3SU9DUIG3 type=del size=2075017 2024-09-12T18:33:11.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.267+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~K9D4OB70OE4V.0 size=1048576 2024-09-12T18:33:11.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.267+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~K9D4OB70OE4V.1 size=93131 2024-09-12T18:33:11.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.267+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=K9D4OB70OE4V tag=I1HW0LA5NEG3 type=write size=2190283 2024-09-12T18:33:11.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.271+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=J00KCUH15KT9 type=del 2024-09-12T18:33:11.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.271+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=HUZN6BFCRB7V type=del size=772359 2024-09-12T18:33:11.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.275+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=NTUIMSMX75V7 type=del 2024-09-12T18:33:11.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.275+0000 7f41a072b8c0 1 > prepared operation key=0O97F5ON55TX tag=703OIJZXTWB0 type=del size=1984783 2024-09-12T18:33:11.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.279+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=EB4ME6U084T1 type=del 2024-09-12T18:33:11.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.283+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=B8O4XLWP60KT type=del size=3540353 2024-09-12T18:33:11.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.283+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=B65ZODK2BNGR type=del 2024-09-12T18:33:11.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.287+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=TOZI21QDPMHR type=write size=489163 2024-09-12T18:33:11.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.291+0000 7f41a072b8c0 1 < suggested remove operation key=58IT2R988AW9 tag=1IUH6DQR6Y8Q type=del 2024-09-12T18:33:11.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.295+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~4LKZWROBVBVU.0 size=1048576 2024-09-12T18:33:11.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.295+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~4LKZWROBVBVU.1 size=1048576 2024-09-12T18:33:11.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.299+0000 7f41a072b8c0 1 > prepared part key=_multipart_295ZC54QRUPD.2~4LKZWROBVBVU.2 size=917785 2024-09-12T18:33:11.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.299+0000 7f41a072b8c0 1 > prepared multipart upload key=295ZC54QRUPD upload=4LKZWROBVBVU tag=VWUNAU8AFV5D type=write size=4063513 2024-09-12T18:33:11.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.299+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~RDQU1O20QBDC.0 size=1048576 2024-09-12T18:33:11.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.303+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~RDQU1O20QBDC.1 size=1048576 2024-09-12T18:33:11.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.303+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~RDQU1O20QBDC.2 size=976481 2024-09-12T18:33:11.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.307+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=RDQU1O20QBDC tag=T8UF7ABYIYPA type=write size=4122209 2024-09-12T18:33:11.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.307+0000 7f41a072b8c0 1 > prepared operation key=XLGVEN6DF5EW tag=684ZVJGXUPLX type=del size=3371602 2024-09-12T18:33:11.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.311+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~F0DW3TX36VG3.0 size=1048576 2024-09-12T18:33:11.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.311+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~F0DW3TX36VG3.1 size=1048576 2024-09-12T18:33:11.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.315+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~F0DW3TX36VG3.2 size=159276 2024-09-12T18:33:11.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.319+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=F0DW3TX36VG3 tag=UD2VCAB6UA53 type=write size=3305004 2024-09-12T18:33:11.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.319+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=RTW16O2GZ676 type=write size=849782 2024-09-12T18:33:11.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.323+0000 7f41a072b8c0 -1 < failed to complete operation key=VEN0P2P1RZ2S tag=OR02Q88ODIQD type=write size=285750: (22) Invalid argument 2024-09-12T18:33:11.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.323+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=4ST5JY556MC0 type=del size=3958592 2024-09-12T18:33:11.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.327+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=C14LSOBMOPM1 type=del 2024-09-12T18:33:11.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.327+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=YF83K89PV7QQ type=write size=142751 2024-09-12T18:33:11.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.331+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=C1HDF677GEHJ type=del 2024-09-12T18:33:11.334 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.331+0000 7f41a072b8c0 1 > prepared operation key=GQHPUDV5BG1E tag=2E8554CMC4HZ type=del size=105985 2024-09-12T18:33:11.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.335+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~3ELAZ7XQUVGD.0 size=1048576 2024-09-12T18:33:11.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.335+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~3ELAZ7XQUVGD.1 size=1048576 2024-09-12T18:33:11.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.339+0000 7f41a072b8c0 1 < completed part key=_multipart_YCBC1CHWJQC5.2~3ELAZ7XQUVGD.2 size=368197 2024-09-12T18:33:11.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.343+0000 7f41a072b8c0 1 < completed multipart upload key=YCBC1CHWJQC5 upload=3ELAZ7XQUVGD tag=BKCLJ45P6PX3 type=write size=3513925 2024-09-12T18:33:11.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.347+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~PQJPEOGVCKF6.0 size=1048576 2024-09-12T18:33:11.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.347+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~PQJPEOGVCKF6.1 size=1048576 2024-09-12T18:33:11.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.351+0000 7f41a072b8c0 1 > prepared part key=_multipart_V35A7LK08C7J.2~PQJPEOGVCKF6.2 size=834025 2024-09-12T18:33:11.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.351+0000 7f41a072b8c0 1 > prepared multipart upload key=V35A7LK08C7J upload=PQJPEOGVCKF6 tag=M39H8QSAAD7H type=write size=3979753 2024-09-12T18:33:11.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.355+0000 7f41a072b8c0 1 < suggested update operation key=1BSAN5TRTZNZ tag=ZVCBS1VK35PI type=del size=3366188 2024-09-12T18:33:11.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.355+0000 7f41a072b8c0 1 > prepared operation key=SK3T82EJFZXE tag=0LLMZ24E1IE0 type=write size=828058 2024-09-12T18:33:11.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.359+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~LP7NOTKDZSWP.0 size=1048576 2024-09-12T18:33:11.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.359+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~LP7NOTKDZSWP.1 size=1048576 2024-09-12T18:33:11.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.363+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~LP7NOTKDZSWP.2 size=479520 2024-09-12T18:33:11.366 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.367+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=LP7NOTKDZSWP tag=OIXKRK3634QC type=write size=3625248 2024-09-12T18:33:11.369 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.367+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=0KG0H84XSC67 type=del size=420527 2024-09-12T18:33:11.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.371+0000 7f41a072b8c0 1 < completed delete operation key=GC8797KSO47E tag=4YGSF0QNVMG2 type=del 2024-09-12T18:33:11.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.371+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=1QWKQI74LW1E type=del size=3015044 2024-09-12T18:33:11.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.375+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=DBSWSGIGM1B4 type=del 2024-09-12T18:33:11.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.379+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~GOC8HG9F0G6B.0 size=1048576 2024-09-12T18:33:11.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.379+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~GOC8HG9F0G6B.1 size=365486 2024-09-12T18:33:11.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.379+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=GOC8HG9F0G6B tag=69417NISYYMO type=write size=2462638 2024-09-12T18:33:11.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.383+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~K9D4OB70OE4V.0 size=1048576 2024-09-12T18:33:11.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.387+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~K9D4OB70OE4V.1 size=93131 2024-09-12T18:33:11.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.391+0000 7f41a072b8c0 1 < completed multipart upload key=NKMA8FG3V3TR upload=K9D4OB70OE4V tag=I1HW0LA5NEG3 type=write size=2190283 2024-09-12T18:33:11.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.391+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=DX5XPVTHXEXI type=del size=2522642 2024-09-12T18:33:11.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.395+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=HUZN6BFCRB7V type=del 2024-09-12T18:33:11.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.395+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=0CWD0SND5GKS type=write size=4495 2024-09-12T18:33:11.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.399+0000 7f41a072b8c0 1 < completed delete operation key=0O97F5ON55TX tag=703OIJZXTWB0 type=del 2024-09-12T18:33:11.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.399+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=IFFP7S7L4E43 type=del size=373131 2024-09-12T18:33:11.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.403+0000 7f41a072b8c0 1 < suggested remove operation key=P732C5X0RG8Z tag=B8O4XLWP60KT type=del 2024-09-12T18:33:11.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.407+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=8TFU3JYDN25Y type=del size=690531 2024-09-12T18:33:11.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.411+0000 7f41a072b8c0 1 < completed write operation key=7B70QWGMH0C0 tag=TOZI21QDPMHR type=write size=489163 2024-09-12T18:33:11.415 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.415+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~L30UTSNN3WIF.0 size=743365 2024-09-12T18:33:11.416 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.415+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=L30UTSNN3WIF tag=OIO4CCRO2JQ3 type=write size=1791941 2024-09-12T18:33:11.418 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.419+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~4LKZWROBVBVU.0 size=1048576 2024-09-12T18:33:11.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.419+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~4LKZWROBVBVU.1 size=1048576 2024-09-12T18:33:11.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.423+0000 7f41a072b8c0 1 < completed part key=_multipart_295ZC54QRUPD.2~4LKZWROBVBVU.2 size=917785 2024-09-12T18:33:11.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.427+0000 7f41a072b8c0 1 < completed multipart upload key=295ZC54QRUPD upload=4LKZWROBVBVU tag=VWUNAU8AFV5D type=write size=4063513 2024-09-12T18:33:11.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.431+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~PBR0KZCAVON3.0 size=475615 2024-09-12T18:33:11.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.431+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=PBR0KZCAVON3 tag=WT7EO9QYFKLD type=write size=1524191 2024-09-12T18:33:11.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.435+0000 7f41a072b8c0 1 < completed delete operation key=XLGVEN6DF5EW tag=684ZVJGXUPLX type=del 2024-09-12T18:33:11.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.435+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=5UFE5OVX5FHB type=del size=1657037 2024-09-12T18:33:11.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.439+0000 7f41a072b8c0 1 < completed write operation key=0G0YWIOD3L3I tag=RTW16O2GZ676 type=write size=849782 2024-09-12T18:33:11.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.443+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=7LBGUA5UU38X type=del size=454090 2024-09-12T18:33:11.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.447+0000 7f41a072b8c0 1 < canceled operation key=SK3T82EJFZXE tag=4ST5JY556MC0 type=del size=3958592 2024-09-12T18:33:11.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.451+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~21YTRJ2HZ5VP.0 size=1048576 2024-09-12T18:33:11.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.451+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~21YTRJ2HZ5VP.1 size=1048576 2024-09-12T18:33:11.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.455+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~21YTRJ2HZ5VP.2 size=337046 2024-09-12T18:33:11.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.455+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=21YTRJ2HZ5VP tag=0F4RQ7FGCXDL type=write size=3482774 2024-09-12T18:33:11.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.455+0000 7f41a072b8c0 1 < completed write operation key=L01GL4WOUIL2 tag=YF83K89PV7QQ type=write size=142751 2024-09-12T18:33:11.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.459+0000 7f41a072b8c0 1 > prepared operation key=295ZC54QRUPD tag=90OMTDBF06AJ type=del size=1550376 2024-09-12T18:33:11.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.463+0000 7f41a072b8c0 1 < completed delete operation key=GQHPUDV5BG1E tag=2E8554CMC4HZ type=del 2024-09-12T18:33:11.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.463+0000 7f41a072b8c0 1 > prepared operation key=1BSAN5TRTZNZ tag=0MDYLS36ZM3L type=del size=3831854 2024-09-12T18:33:11.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.467+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~PQJPEOGVCKF6.0 size=1048576 2024-09-12T18:33:11.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.467+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~PQJPEOGVCKF6.1 size=1048576 2024-09-12T18:33:11.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.471+0000 7f41a072b8c0 1 < completed part key=_multipart_V35A7LK08C7J.2~PQJPEOGVCKF6.2 size=834025 2024-09-12T18:33:11.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.475+0000 7f41a072b8c0 1 < completed multipart upload key=V35A7LK08C7J upload=PQJPEOGVCKF6 tag=M39H8QSAAD7H type=write size=3979753 2024-09-12T18:33:11.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.479+0000 7f41a072b8c0 1 > prepared part key=_multipart_5OD9IX408CYO.2~1RD1DUVYNLXD.0 size=293542 2024-09-12T18:33:11.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.479+0000 7f41a072b8c0 1 > prepared multipart upload key=5OD9IX408CYO upload=1RD1DUVYNLXD tag=J31Y7U81F3S6 type=write size=1342118 2024-09-12T18:33:11.481 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.479+0000 7f41a072b8c0 1 < completed write operation key=SK3T82EJFZXE tag=0LLMZ24E1IE0 type=write size=828058 2024-09-12T18:33:11.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.487+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~2BVZWSXYGIFU.0 size=1048576 2024-09-12T18:33:11.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.487+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~2BVZWSXYGIFU.1 size=1048576 2024-09-12T18:33:11.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.487+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~2BVZWSXYGIFU.2 size=151320 2024-09-12T18:33:11.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.487+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=2BVZWSXYGIFU tag=40NPP1AN6ALP type=write size=3297048 2024-09-12T18:33:11.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.491+0000 7f41a072b8c0 1 < completed delete operation key=KOLD6WYK30EQ tag=0KG0H84XSC67 type=del 2024-09-12T18:33:11.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.495+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~CU163HEMJA9P.0 size=1048576 2024-09-12T18:33:11.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.499+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~CU163HEMJA9P.1 size=940559 2024-09-12T18:33:11.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.499+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=CU163HEMJA9P tag=EMT4V8FSLWDG type=write size=3037711 2024-09-12T18:33:11.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.499+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=1QWKQI74LW1E type=del 2024-09-12T18:33:11.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~QUH4A2NTY65G.0 size=1048576 2024-09-12T18:33:11.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.507+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~QUH4A2NTY65G.1 size=1048576 2024-09-12T18:33:11.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.511+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~QUH4A2NTY65G.2 size=27743 2024-09-12T18:33:11.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.511+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=QUH4A2NTY65G tag=2MF5PKDN2PKW type=write size=3173471 2024-09-12T18:33:11.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.511+0000 7f41a072b8c0 1 < completed part key=_multipart_NKMA8FG3V3TR.2~GOC8HG9F0G6B.0 size=1048576 2024-09-12T18:33:11.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.511+0000 7f41a072b8c0 1 < canceled part key=_multipart_NKMA8FG3V3TR.2~GOC8HG9F0G6B.1 size=365486 2024-09-12T18:33:11.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.515+0000 7f41a072b8c0 1 < canceled multipart upload key=NKMA8FG3V3TR upload=GOC8HG9F0G6B tag=69417NISYYMO type=write size=2462638 2024-09-12T18:33:11.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.519+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=1EDN5VCUGX6H type=del size=2185071 2024-09-12T18:33:11.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.523+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=DX5XPVTHXEXI type=del 2024-09-12T18:33:11.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.527+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=UQRMG5SRK1SQ type=write size=191360 2024-09-12T18:33:11.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.527+0000 7f41a072b8c0 1 < completed write operation key=5OD9IX408CYO tag=0CWD0SND5GKS type=write size=4495 2024-09-12T18:33:11.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.531+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=KZYSEDGV3RCQ type=del size=2398663 2024-09-12T18:33:11.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.535+0000 7f41a072b8c0 1 < completed delete operation key=3R9RN03RFRJP tag=IFFP7S7L4E43 type=del 2024-09-12T18:33:11.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.539+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~LFQ0SEK6H551.0 size=1048576 2024-09-12T18:33:11.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.539+0000 7f41a072b8c0 1 > prepared part key=_multipart_L01GL4WOUIL2.2~LFQ0SEK6H551.1 size=231323 2024-09-12T18:33:11.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.539+0000 7f41a072b8c0 1 > prepared multipart upload key=L01GL4WOUIL2 upload=LFQ0SEK6H551 tag=J7JCV36Q1JKN type=write size=2328475 2024-09-12T18:33:11.545 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.543+0000 7f41a072b8c0 1 < suggested remove operation key=3R9RN03RFRJP tag=8TFU3JYDN25Y type=del 2024-09-12T18:33:11.548 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.547+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=8AYS4NHQ0Q0B type=write size=555222 2024-09-12T18:33:11.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.551+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~L30UTSNN3WIF.0 size=743365 2024-09-12T18:33:11.555 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.555+0000 7f41a072b8c0 1 < completed multipart upload key=YP72VTCGSHYE upload=L30UTSNN3WIF tag=OIO4CCRO2JQ3 type=write size=1791941 2024-09-12T18:33:11.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.555+0000 7f41a072b8c0 1 > prepared operation key=YP72VTCGSHYE tag=EONXPI6PO991 type=del size=1558947 2024-09-12T18:33:11.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.559+0000 7f41a072b8c0 1 < completed part key=_multipart_ZACT36ZOC9ES.2~PBR0KZCAVON3.0 size=475615 2024-09-12T18:33:11.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.563+0000 7f41a072b8c0 1 < completed multipart upload key=ZACT36ZOC9ES upload=PBR0KZCAVON3 tag=WT7EO9QYFKLD type=write size=1524191 2024-09-12T18:33:11.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.567+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=9BRP5BE55Z1D type=del size=1015017 2024-09-12T18:33:11.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.571+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=5UFE5OVX5FHB type=del 2024-09-12T18:33:11.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.575+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=2MI4E0X64S9Z type=del size=3845371 2024-09-12T18:33:11.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.579+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=7LBGUA5UU38X type=del 2024-09-12T18:33:11.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.579+0000 7f41a072b8c0 1 > prepared operation key=3R9RN03RFRJP tag=XN1RA106A5FT type=del size=3832847 2024-09-12T18:33:11.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.583+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~21YTRJ2HZ5VP.0 size=1048576 2024-09-12T18:33:11.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.587+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~21YTRJ2HZ5VP.1 size=1048576 2024-09-12T18:33:11.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.587+0000 7f41a072b8c0 1 < canceled part key=_multipart_0G0YWIOD3L3I.2~21YTRJ2HZ5VP.2 size=337046 2024-09-12T18:33:11.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.591+0000 7f41a072b8c0 1 < canceled multipart upload key=0G0YWIOD3L3I upload=21YTRJ2HZ5VP tag=0F4RQ7FGCXDL type=write size=3482774 2024-09-12T18:33:11.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.595+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=UVVE3OT5P65V type=del size=3465501 2024-09-12T18:33:11.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.599+0000 7f41a072b8c0 1 < completed delete operation key=295ZC54QRUPD tag=90OMTDBF06AJ type=del 2024-09-12T18:33:11.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.603+0000 7f41a072b8c0 1 > prepared part key=_multipart_7MRN7L1DTAMO.2~KIN61CCLU3J5.0 size=447148 2024-09-12T18:33:11.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.603+0000 7f41a072b8c0 1 > prepared multipart upload key=7MRN7L1DTAMO upload=KIN61CCLU3J5 tag=NKTGNDX9JHJ9 type=write size=1495724 2024-09-12T18:33:11.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.603+0000 7f41a072b8c0 1 < completed delete operation key=1BSAN5TRTZNZ tag=0MDYLS36ZM3L type=del 2024-09-12T18:33:11.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.611+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~T8IKJEDDOTR0.0 size=1048576 2024-09-12T18:33:11.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.611+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~T8IKJEDDOTR0.1 size=1048576 2024-09-12T18:33:11.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.615+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~T8IKJEDDOTR0.2 size=274966 2024-09-12T18:33:11.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.615+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=T8IKJEDDOTR0 tag=ST3ADT8OV0HX type=write size=3420694 2024-09-12T18:33:11.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.615+0000 7f41a072b8c0 1 < completed part key=_multipart_5OD9IX408CYO.2~1RD1DUVYNLXD.0 size=293542 2024-09-12T18:33:11.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.623+0000 7f41a072b8c0 1 < completed multipart upload key=5OD9IX408CYO upload=1RD1DUVYNLXD tag=J31Y7U81F3S6 type=write size=1342118 2024-09-12T18:33:11.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.627+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~8FVK4YEMVDU8.0 size=693427 2024-09-12T18:33:11.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.627+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=8FVK4YEMVDU8 tag=WD3C4VNEGOI8 type=write size=1742003 2024-09-12T18:33:11.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.631+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~2BVZWSXYGIFU.0 size=1048576 2024-09-12T18:33:11.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.631+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~2BVZWSXYGIFU.1 size=1048576 2024-09-12T18:33:11.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.635+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~2BVZWSXYGIFU.2 size=151320 2024-09-12T18:33:11.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.639+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=2BVZWSXYGIFU tag=40NPP1AN6ALP type=write size=3297048 2024-09-12T18:33:11.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.643+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=8FKGRF5EDYX0 type=del size=3323779 2024-09-12T18:33:11.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.647+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~CU163HEMJA9P.0 size=1048576 2024-09-12T18:33:11.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.647+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~CU163HEMJA9P.1 size=940559 2024-09-12T18:33:11.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.655+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=CU163HEMJA9P tag=EMT4V8FSLWDG type=write size=3037711 2024-09-12T18:33:11.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.655+0000 7f41a072b8c0 1 > prepared operation key=GA6P1FACU2EQ tag=YOPVM7JEG08X type=del size=1690597 2024-09-12T18:33:11.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.659+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~QUH4A2NTY65G.0 size=1048576 2024-09-12T18:33:11.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.659+0000 7f41a072b8c0 1 < canceled part key=_multipart_A6GQZL25YSNL.2~QUH4A2NTY65G.1 size=1048576 2024-09-12T18:33:11.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.663+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~QUH4A2NTY65G.2 size=27743 2024-09-12T18:33:11.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.667+0000 7f41a072b8c0 1 < canceled multipart upload key=A6GQZL25YSNL upload=QUH4A2NTY65G tag=2MF5PKDN2PKW type=write size=3173471 2024-09-12T18:33:11.672 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.671+0000 7f41a072b8c0 1 > prepared operation key=L01GL4WOUIL2 tag=X0KSKIFBSD6P type=write size=949969 2024-09-12T18:33:11.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.675+0000 7f41a072b8c0 1 < suggested update operation key=L01GL4WOUIL2 tag=1EDN5VCUGX6H type=del size=2185071 2024-09-12T18:33:11.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.683+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~9JYECGMLS431.0 size=1048576 2024-09-12T18:33:11.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.683+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~9JYECGMLS431.1 size=1048576 2024-09-12T18:33:11.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.687+0000 7f41a072b8c0 1 > prepared part key=_multipart_5JUWC8RXSA5L.2~9JYECGMLS431.2 size=920592 2024-09-12T18:33:11.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.687+0000 7f41a072b8c0 1 > prepared multipart upload key=5JUWC8RXSA5L upload=9JYECGMLS431 tag=NK7OVOO8ST8S type=write size=4066320 2024-09-12T18:33:11.690 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.691+0000 7f41a072b8c0 1 < completed write operation key=NKMA8FG3V3TR tag=UQRMG5SRK1SQ type=write size=191360 2024-09-12T18:33:11.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.691+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=H77693D2AS73 type=del size=2857577 2024-09-12T18:33:11.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.703+0000 7f41a072b8c0 1 < suggested remove operation key=YCBC1CHWJQC5 tag=KZYSEDGV3RCQ type=del 2024-09-12T18:33:11.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.703+0000 7f41a072b8c0 1 > prepared operation key=KP2HF4J376EY tag=VGD3D4YQXYPW type=del size=3582581 2024-09-12T18:33:11.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.707+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~LFQ0SEK6H551.0 size=1048576 2024-09-12T18:33:11.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.711+0000 7f41a072b8c0 1 < completed part key=_multipart_L01GL4WOUIL2.2~LFQ0SEK6H551.1 size=231323 2024-09-12T18:33:11.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.715+0000 7f41a072b8c0 1 < completed multipart upload key=L01GL4WOUIL2 upload=LFQ0SEK6H551 tag=J7JCV36Q1JKN type=write size=2328475 2024-09-12T18:33:11.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.719+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=YJUFYA03DKSJ type=del size=3992523 2024-09-12T18:33:11.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.727+0000 7f41a072b8c0 1 < suggested update operation key=NKMA8FG3V3TR tag=8AYS4NHQ0Q0B type=write size=555222 2024-09-12T18:33:11.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.731+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~R1VH3QJGCKTN.0 size=1048576 2024-09-12T18:33:11.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.735+0000 7f41a072b8c0 1 > prepared part key=_multipart_A6GQZL25YSNL.2~R1VH3QJGCKTN.1 size=848247 2024-09-12T18:33:11.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.735+0000 7f41a072b8c0 1 > prepared multipart upload key=A6GQZL25YSNL upload=R1VH3QJGCKTN tag=DDNMV357R7LV type=write size=2945399 2024-09-12T18:33:11.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.739+0000 7f41a072b8c0 1 < completed delete operation key=YP72VTCGSHYE tag=EONXPI6PO991 type=del 2024-09-12T18:33:11.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.739+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=0ODR1E7OLG44 type=del size=3967160 2024-09-12T18:33:11.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.743+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=9BRP5BE55Z1D type=del 2024-09-12T18:33:11.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.751+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~6NT0NXS3H6XE.0 size=1048576 2024-09-12T18:33:11.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.751+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~6NT0NXS3H6XE.1 size=1048576 2024-09-12T18:33:11.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.755+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~6NT0NXS3H6XE.2 size=222698 2024-09-12T18:33:11.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.755+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=6NT0NXS3H6XE tag=DXFCD90PNYVS type=write size=3368426 2024-09-12T18:33:11.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.755+0000 7f41a072b8c0 -1 < no bi entry to suggest for operation key=YCBC1CHWJQC5 tag=2MI4E0X64S9Z type=del size=3845371: (2) No such file or directory 2024-09-12T18:33:11.759 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.759+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=1I1K003CM47U type=write size=771418 2024-09-12T18:33:11.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.763+0000 7f41a072b8c0 1 < suggested update operation key=3R9RN03RFRJP tag=XN1RA106A5FT type=del size=3832847 2024-09-12T18:33:11.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.767+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=QH1YVAD3DNTV type=write size=218868 2024-09-12T18:33:11.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.771+0000 7f41a072b8c0 -1 < failed to complete operation key=NKMA8FG3V3TR tag=UVVE3OT5P65V type=del size=3465501: (22) Invalid argument 2024-09-12T18:33:11.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.775+0000 7f41a072b8c0 1 > prepared operation key=ZACT36ZOC9ES tag=3GDT7ZOF69SI type=del size=1294152 2024-09-12T18:33:11.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.779+0000 7f41a072b8c0 1 < completed part key=_multipart_7MRN7L1DTAMO.2~KIN61CCLU3J5.0 size=447148 2024-09-12T18:33:11.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.783+0000 7f41a072b8c0 1 < completed multipart upload key=7MRN7L1DTAMO upload=KIN61CCLU3J5 tag=NKTGNDX9JHJ9 type=write size=1495724 2024-09-12T18:33:11.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.787+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=QVDJHJVYGFB1 type=del size=1842864 2024-09-12T18:33:11.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.791+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~T8IKJEDDOTR0.0 size=1048576 2024-09-12T18:33:11.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.791+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~T8IKJEDDOTR0.1 size=1048576 2024-09-12T18:33:11.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.795+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~T8IKJEDDOTR0.2 size=274966 2024-09-12T18:33:11.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.799+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=T8IKJEDDOTR0 tag=ST3ADT8OV0HX type=write size=3420694 2024-09-12T18:33:11.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.803+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=53QFJN7UACNV type=del size=2594870 2024-09-12T18:33:11.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.807+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~8FVK4YEMVDU8.0 size=693427 2024-09-12T18:33:11.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.811+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=8FVK4YEMVDU8 tag=WD3C4VNEGOI8 type=write size=1742003 2024-09-12T18:33:11.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.815+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~Y1JN99GL94YC.0 size=1048576 2024-09-12T18:33:11.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.819+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~Y1JN99GL94YC.1 size=262562 2024-09-12T18:33:11.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.819+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=Y1JN99GL94YC tag=F8HGGZVY8J81 type=write size=2359714 2024-09-12T18:33:11.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.823+0000 7f41a072b8c0 1 < suggested update operation key=VEN0P2P1RZ2S tag=8FKGRF5EDYX0 type=del size=3323779 2024-09-12T18:33:11.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.827+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~4S8ZG62DH8JT.0 size=438600 2024-09-12T18:33:11.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.827+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=4S8ZG62DH8JT tag=HZ0W4PO2BLZE type=write size=1487176 2024-09-12T18:33:11.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.831+0000 7f41a072b8c0 1 < completed delete operation key=GA6P1FACU2EQ tag=YOPVM7JEG08X type=del 2024-09-12T18:33:11.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.835+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=MBQUN0UB1D45 type=del size=1764523 2024-09-12T18:33:11.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.839+0000 7f41a072b8c0 -1 < failed to complete operation key=L01GL4WOUIL2 tag=X0KSKIFBSD6P type=write size=949969: (22) Invalid argument 2024-09-12T18:33:11.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.839+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=CP2X7NX2TBKB type=del size=3334942 2024-09-12T18:33:11.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.843+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~9JYECGMLS431.0 size=1048576 2024-09-12T18:33:11.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.843+0000 7f41a072b8c0 1 < canceled part key=_multipart_5JUWC8RXSA5L.2~9JYECGMLS431.1 size=1048576 2024-09-12T18:33:11.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.847+0000 7f41a072b8c0 1 < completed part key=_multipart_5JUWC8RXSA5L.2~9JYECGMLS431.2 size=920592 2024-09-12T18:33:11.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.851+0000 7f41a072b8c0 1 < canceled multipart upload key=5JUWC8RXSA5L upload=9JYECGMLS431 tag=NK7OVOO8ST8S type=write size=4066320 2024-09-12T18:33:11.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.851+0000 7f41a072b8c0 1 > prepared operation key=63BP9QETTAM8 tag=LG21X5F9J7FG type=del size=3997824 2024-09-12T18:33:11.856 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.855+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=H77693D2AS73 type=del 2024-09-12T18:33:11.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.859+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=EVS8KFEHWPUM type=write size=996734 2024-09-12T18:33:11.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.863+0000 7f41a072b8c0 1 < suggested remove operation key=KP2HF4J376EY tag=VGD3D4YQXYPW type=del 2024-09-12T18:33:11.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.867+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=U4159UXJ4M2L type=del size=3677394 2024-09-12T18:33:11.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.867+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=YJUFYA03DKSJ type=del 2024-09-12T18:33:11.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.871+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~9HN1S64Z3FOO.0 size=80294 2024-09-12T18:33:11.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.871+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=9HN1S64Z3FOO tag=MRD2EAZMTZHZ type=write size=1128870 2024-09-12T18:33:11.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.875+0000 7f41a072b8c0 1 < completed part key=_multipart_A6GQZL25YSNL.2~R1VH3QJGCKTN.0 size=1048576 2024-09-12T18:33:11.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.875+0000 7f41a072b8c0 1 < canceled part key=_multipart_A6GQZL25YSNL.2~R1VH3QJGCKTN.1 size=848247 2024-09-12T18:33:11.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.879+0000 7f41a072b8c0 1 < canceled multipart upload key=A6GQZL25YSNL upload=R1VH3QJGCKTN tag=DDNMV357R7LV type=write size=2945399 2024-09-12T18:33:11.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.879+0000 7f41a072b8c0 1 > prepared operation key=31T6AP6MUBKL tag=YRH7IVDMRHNW type=del size=1561026 2024-09-12T18:33:11.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.883+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=0ODR1E7OLG44 type=del 2024-09-12T18:33:11.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.887+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=8XR6T7H80I63 type=del size=1572190 2024-09-12T18:33:11.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.887+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~6NT0NXS3H6XE.0 size=1048576 2024-09-12T18:33:11.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.891+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~6NT0NXS3H6XE.1 size=1048576 2024-09-12T18:33:11.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.891+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~6NT0NXS3H6XE.2 size=222698 2024-09-12T18:33:11.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.895+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=6NT0NXS3H6XE tag=DXFCD90PNYVS type=write size=3368426 2024-09-12T18:33:11.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.903+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~7EZ5VTWPS5O9.0 size=1048576 2024-09-12T18:33:11.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.903+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~7EZ5VTWPS5O9.1 size=1048576 2024-09-12T18:33:11.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.903+0000 7f41a072b8c0 1 > prepared part key=_multipart_1JIIRDVMT0B0.2~7EZ5VTWPS5O9.2 size=34797 2024-09-12T18:33:11.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.903+0000 7f41a072b8c0 1 > prepared multipart upload key=1JIIRDVMT0B0 upload=7EZ5VTWPS5O9 tag=OF8D5K4BV4ET type=write size=3180525 2024-09-12T18:33:11.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.907+0000 7f41a072b8c0 1 < completed write operation key=KOLD6WYK30EQ tag=1I1K003CM47U type=write size=771418 2024-09-12T18:33:11.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.911+0000 7f41a072b8c0 1 > prepared operation key=7MRN7L1DTAMO tag=0347QRX0TUZC type=del size=3283527 2024-09-12T18:33:11.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.911+0000 7f41a072b8c0 1 < completed write operation key=7MRN7L1DTAMO tag=QH1YVAD3DNTV type=write size=218868 2024-09-12T18:33:11.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.915+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~2YT4JR090KG3.0 size=1048576 2024-09-12T18:33:11.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.919+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~2YT4JR090KG3.1 size=1048576 2024-09-12T18:33:11.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.919+0000 7f41a072b8c0 1 > prepared part key=_multipart_L1VC63PK1R2Y.2~2YT4JR090KG3.2 size=796632 2024-09-12T18:33:11.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.919+0000 7f41a072b8c0 1 > prepared multipart upload key=L1VC63PK1R2Y upload=2YT4JR090KG3 tag=G0YFEZRL284K type=write size=3942360 2024-09-12T18:33:11.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.923+0000 7f41a072b8c0 1 < completed delete operation key=ZACT36ZOC9ES tag=3GDT7ZOF69SI type=del 2024-09-12T18:33:11.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.927+0000 7f41a072b8c0 1 > prepared part key=_multipart_63BP9QETTAM8.2~9BDPXKWV31GS.0 size=39986 2024-09-12T18:33:11.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.927+0000 7f41a072b8c0 1 > prepared multipart upload key=63BP9QETTAM8 upload=9BDPXKWV31GS tag=CUI4UKSQW4ZG type=write size=1088562 2024-09-12T18:33:11.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.931+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=QVDJHJVYGFB1 type=del 2024-09-12T18:33:11.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.931+0000 7f41a072b8c0 1 > prepared operation key=GC8797KSO47E tag=5I51YINK5XAN type=del size=1729713 2024-09-12T18:33:11.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.935+0000 7f41a072b8c0 1 < completed delete operation key=1JIIRDVMT0B0 tag=53QFJN7UACNV type=del 2024-09-12T18:33:11.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.935+0000 7f41a072b8c0 1 > prepared operation key=KOLD6WYK30EQ tag=2U0FR6ZEJKD7 type=write size=753979 2024-09-12T18:33:11.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.939+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~Y1JN99GL94YC.0 size=1048576 2024-09-12T18:33:11.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.939+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~Y1JN99GL94YC.1 size=262562 2024-09-12T18:33:11.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.943+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=Y1JN99GL94YC tag=F8HGGZVY8J81 type=write size=2359714 2024-09-12T18:33:11.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.947+0000 7f41a072b8c0 1 > prepared operation key=V35A7LK08C7J tag=LEZS55I0LTSY type=del size=1633160 2024-09-12T18:33:11.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.947+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~4S8ZG62DH8JT.0 size=438600 2024-09-12T18:33:11.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.951+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=4S8ZG62DH8JT tag=HZ0W4PO2BLZE type=write size=1487176 2024-09-12T18:33:11.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.959+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=IOB170UIGA4M type=del size=182099 2024-09-12T18:33:11.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.963+0000 7f41a072b8c0 1 < suggested remove operation key=0G0YWIOD3L3I tag=MBQUN0UB1D45 type=del 2024-09-12T18:33:11.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.967+0000 7f41a072b8c0 1 > prepared operation key=A6GQZL25YSNL tag=XGNFBB6NWXW8 type=del size=1242957 2024-09-12T18:33:11.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.967+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=CP2X7NX2TBKB type=del 2024-09-12T18:33:11.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.971+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~P7RIO0SDNE11.0 size=1048576 2024-09-12T18:33:11.975 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.975+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~P7RIO0SDNE11.1 size=1048576 2024-09-12T18:33:11.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.975+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~P7RIO0SDNE11.2 size=362809 2024-09-12T18:33:11.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.975+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=P7RIO0SDNE11 tag=DIZITF12PGTO type=write size=3508537 2024-09-12T18:33:11.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.979+0000 7f41a072b8c0 1 < completed delete operation key=63BP9QETTAM8 tag=LG21X5F9J7FG type=del 2024-09-12T18:33:11.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.983+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~ADPGLX9BPXD2.0 size=1048576 2024-09-12T18:33:11.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.983+0000 7f41a072b8c0 1 > prepared part key=_multipart_SK3T82EJFZXE.2~ADPGLX9BPXD2.1 size=781926 2024-09-12T18:33:11.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.983+0000 7f41a072b8c0 1 > prepared multipart upload key=SK3T82EJFZXE upload=ADPGLX9BPXD2 tag=0X2EZFU2B2YL type=write size=2879078 2024-09-12T18:33:11.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.987+0000 7f41a072b8c0 1 < suggested remove operation key=GC8797KSO47E tag=EVS8KFEHWPUM type=write 2024-09-12T18:33:11.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.995+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~PH2VSW5SWV4Z.0 size=1048576 2024-09-12T18:33:11.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.995+0000 7f41a072b8c0 1 > prepared part key=_multipart_P732C5X0RG8Z.2~PH2VSW5SWV4Z.1 size=472400 2024-09-12T18:33:11.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.995+0000 7f41a072b8c0 1 > prepared multipart upload key=P732C5X0RG8Z upload=PH2VSW5SWV4Z tag=NJMX2RKIPCQK type=write size=2569552 2024-09-12T18:33:11.998 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.999+0000 7f41a072b8c0 1 < completed delete operation key=5OD9IX408CYO tag=U4159UXJ4M2L type=del 2024-09-12T18:33:12.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:11.999+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=O76Q8HE3IL0M type=del size=2175880 2024-09-12T18:33:12.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.003+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~9HN1S64Z3FOO.0 size=80294 2024-09-12T18:33:12.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.007+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=9HN1S64Z3FOO tag=MRD2EAZMTZHZ type=write size=1128870 2024-09-12T18:33:12.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.011+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~78GVBJ9HWM2I.0 size=1048576 2024-09-12T18:33:12.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.011+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~78GVBJ9HWM2I.1 size=185484 2024-09-12T18:33:12.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.011+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=78GVBJ9HWM2I tag=0UOJEUPTDKJP type=write size=2282636 2024-09-12T18:33:12.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.015+0000 7f41a072b8c0 1 < completed delete operation key=31T6AP6MUBKL tag=YRH7IVDMRHNW type=del 2024-09-12T18:33:12.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.015+0000 7f41a072b8c0 1 > prepared operation key=7B70QWGMH0C0 tag=EHZO5ADLI33Y type=del size=1833173 2024-09-12T18:33:12.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.019+0000 7f41a072b8c0 1 < completed delete operation key=VEN0P2P1RZ2S tag=8XR6T7H80I63 type=del 2024-09-12T18:33:12.021 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.019+0000 7f41a072b8c0 1 > prepared operation key=YCBC1CHWJQC5 tag=P8355B0WT1KZ type=write size=446763 2024-09-12T18:33:12.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.023+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~7EZ5VTWPS5O9.0 size=1048576 2024-09-12T18:33:12.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.023+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~7EZ5VTWPS5O9.1 size=1048576 2024-09-12T18:33:12.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.027+0000 7f41a072b8c0 1 < completed part key=_multipart_1JIIRDVMT0B0.2~7EZ5VTWPS5O9.2 size=34797 2024-09-12T18:33:12.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.031+0000 7f41a072b8c0 1 < completed multipart upload key=1JIIRDVMT0B0 upload=7EZ5VTWPS5O9 tag=OF8D5K4BV4ET type=write size=3180525 2024-09-12T18:33:12.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.035+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~GJXNH9448R5C.0 size=623416 2024-09-12T18:33:12.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.035+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=GJXNH9448R5C tag=5IRZLOUFAKWB type=write size=1671992 2024-09-12T18:33:12.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.035+0000 7f41a072b8c0 1 < completed delete operation key=7MRN7L1DTAMO tag=0347QRX0TUZC type=del 2024-09-12T18:33:12.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.039+0000 7f41a072b8c0 1 > prepared part key=_multipart_C2PRRD3QO9AF.2~BXQE3UTZ3471.0 size=668604 2024-09-12T18:33:12.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.039+0000 7f41a072b8c0 1 > prepared multipart upload key=C2PRRD3QO9AF upload=BXQE3UTZ3471 tag=0X2MDU86VXO9 type=write size=1717180 2024-09-12T18:33:12.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.043+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~2YT4JR090KG3.0 size=1048576 2024-09-12T18:33:12.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.043+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~2YT4JR090KG3.1 size=1048576 2024-09-12T18:33:12.047 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.047+0000 7f41a072b8c0 1 < completed part key=_multipart_L1VC63PK1R2Y.2~2YT4JR090KG3.2 size=796632 2024-09-12T18:33:12.050 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.051+0000 7f41a072b8c0 1 < completed multipart upload key=L1VC63PK1R2Y upload=2YT4JR090KG3 tag=G0YFEZRL284K type=write size=3942360 2024-09-12T18:33:12.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.055+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~3RBRZDVPKY35.0 size=1048576 2024-09-12T18:33:12.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.055+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~3RBRZDVPKY35.1 size=1048576 2024-09-12T18:33:12.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.059+0000 7f41a072b8c0 1 > prepared part key=_multipart_YP72VTCGSHYE.2~3RBRZDVPKY35.2 size=293237 2024-09-12T18:33:12.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.059+0000 7f41a072b8c0 1 > prepared multipart upload key=YP72VTCGSHYE upload=3RBRZDVPKY35 tag=U26ANISTQUVR type=write size=3438965 2024-09-12T18:33:12.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.059+0000 7f41a072b8c0 1 < completed part key=_multipart_63BP9QETTAM8.2~9BDPXKWV31GS.0 size=39986 2024-09-12T18:33:12.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.063+0000 7f41a072b8c0 1 < completed multipart upload key=63BP9QETTAM8 upload=9BDPXKWV31GS tag=CUI4UKSQW4ZG type=write size=1088562 2024-09-12T18:33:12.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.067+0000 7f41a072b8c0 1 > prepared operation key=1JIIRDVMT0B0 tag=5WW68EM3WO2J type=del size=673240 2024-09-12T18:33:12.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.067+0000 7f41a072b8c0 -1 < failed to complete operation key=GC8797KSO47E tag=5I51YINK5XAN type=del size=1729713: (22) Invalid argument 2024-09-12T18:33:12.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.071+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~LXQBG9YZWTPL.0 size=1048576 2024-09-12T18:33:12.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.075+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~LXQBG9YZWTPL.1 size=1048576 2024-09-12T18:33:12.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.075+0000 7f41a072b8c0 1 > prepared part key=_multipart_XLGVEN6DF5EW.2~LXQBG9YZWTPL.2 size=33957 2024-09-12T18:33:12.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.075+0000 7f41a072b8c0 1 > prepared multipart upload key=XLGVEN6DF5EW upload=LXQBG9YZWTPL tag=58A4SWFMC328 type=write size=3179685 2024-09-12T18:33:12.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.079+0000 7f41a072b8c0 1 < completed write operation key=KOLD6WYK30EQ tag=2U0FR6ZEJKD7 type=write size=753979 2024-09-12T18:33:12.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.083+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~PH84JIJPZEBK.0 size=1048576 2024-09-12T18:33:12.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.083+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~PH84JIJPZEBK.1 size=1048576 2024-09-12T18:33:12.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.087+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~PH84JIJPZEBK.2 size=656179 2024-09-12T18:33:12.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.087+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=PH84JIJPZEBK tag=1CSU87791KIK type=write size=3801907 2024-09-12T18:33:12.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.087+0000 7f41a072b8c0 1 < completed delete operation key=V35A7LK08C7J tag=LEZS55I0LTSY type=del 2024-09-12T18:33:12.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.091+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~IOIHPGNQ8CHI.0 size=1048576 2024-09-12T18:33:12.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.095+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~IOIHPGNQ8CHI.1 size=1048576 2024-09-12T18:33:12.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.095+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~IOIHPGNQ8CHI.2 size=453997 2024-09-12T18:33:12.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.095+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=IOIHPGNQ8CHI tag=EF0320YUOF0Z type=write size=3599725 2024-09-12T18:33:12.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.099+0000 7f41a072b8c0 1 < suggested remove operation key=NKMA8FG3V3TR tag=IOB170UIGA4M type=del 2024-09-12T18:33:12.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.103+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=EBOW300WBCWI type=del size=1752463 2024-09-12T18:33:12.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.103+0000 7f41a072b8c0 1 < completed delete operation key=A6GQZL25YSNL tag=XGNFBB6NWXW8 type=del 2024-09-12T18:33:12.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.107+0000 7f41a072b8c0 1 > prepared part key=_multipart_0G0YWIOD3L3I.2~PHAND98J79W3.0 size=757421 2024-09-12T18:33:12.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.107+0000 7f41a072b8c0 1 > prepared multipart upload key=0G0YWIOD3L3I upload=PHAND98J79W3 tag=FSBJ0YSHNL3L type=write size=1805997 2024-09-12T18:33:12.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.111+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~P7RIO0SDNE11.0 size=1048576 2024-09-12T18:33:12.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.111+0000 7f41a072b8c0 1 < canceled part key=_multipart_P732C5X0RG8Z.2~P7RIO0SDNE11.1 size=1048576 2024-09-12T18:33:12.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.111+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~P7RIO0SDNE11.2 size=362809 2024-09-12T18:33:12.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.115+0000 7f41a072b8c0 1 < canceled multipart upload key=P732C5X0RG8Z upload=P7RIO0SDNE11 tag=DIZITF12PGTO type=write size=3508537 2024-09-12T18:33:12.117 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.115+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=D93KMCOWFGWF type=write size=209003 2024-09-12T18:33:12.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.119+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~ADPGLX9BPXD2.0 size=1048576 2024-09-12T18:33:12.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.119+0000 7f41a072b8c0 1 < completed part key=_multipart_SK3T82EJFZXE.2~ADPGLX9BPXD2.1 size=781926 2024-09-12T18:33:12.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.123+0000 7f41a072b8c0 1 < completed multipart upload key=SK3T82EJFZXE upload=ADPGLX9BPXD2 tag=0X2EZFU2B2YL type=write size=2879078 2024-09-12T18:33:12.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.127+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=0NQ2UUBEV2MF type=del size=1144780 2024-09-12T18:33:12.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.127+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~PH2VSW5SWV4Z.0 size=1048576 2024-09-12T18:33:12.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.131+0000 7f41a072b8c0 1 < completed part key=_multipart_P732C5X0RG8Z.2~PH2VSW5SWV4Z.1 size=472400 2024-09-12T18:33:12.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.135+0000 7f41a072b8c0 1 < completed multipart upload key=P732C5X0RG8Z upload=PH2VSW5SWV4Z tag=NJMX2RKIPCQK type=write size=2569552 2024-09-12T18:33:12.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.135+0000 7f41a072b8c0 1 > prepared operation key=58IT2R988AW9 tag=AF2QW1JCOC5G type=del size=2884336 2024-09-12T18:33:12.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.139+0000 7f41a072b8c0 1 < suggested remove operation key=YCBC1CHWJQC5 tag=O76Q8HE3IL0M type=del 2024-09-12T18:33:12.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.143+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~E3TIQVNPU0FW.0 size=995666 2024-09-12T18:33:12.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.143+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=E3TIQVNPU0FW tag=B84XMFZI0N1N type=write size=2044242 2024-09-12T18:33:12.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.147+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~78GVBJ9HWM2I.0 size=1048576 2024-09-12T18:33:12.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.147+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~78GVBJ9HWM2I.1 size=185484 2024-09-12T18:33:12.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.151+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=78GVBJ9HWM2I tag=0UOJEUPTDKJP type=write size=2282636 2024-09-12T18:33:12.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.155+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~VYO5QOY02AF2.0 size=1048576 2024-09-12T18:33:12.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.155+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~VYO5QOY02AF2.1 size=1048576 2024-09-12T18:33:12.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.159+0000 7f41a072b8c0 1 > prepared part key=_multipart_KOLD6WYK30EQ.2~VYO5QOY02AF2.2 size=479878 2024-09-12T18:33:12.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.159+0000 7f41a072b8c0 1 > prepared multipart upload key=KOLD6WYK30EQ upload=VYO5QOY02AF2 tag=QOJ3D4D308O3 type=write size=3625606 2024-09-12T18:33:12.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.163+0000 7f41a072b8c0 1 < completed delete operation key=7B70QWGMH0C0 tag=EHZO5ADLI33Y type=del 2024-09-12T18:33:12.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.163+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=V9U2XZO5XLSN type=del size=154131 2024-09-12T18:33:12.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.167+0000 7f41a072b8c0 -1 < failed to complete operation key=YCBC1CHWJQC5 tag=P8355B0WT1KZ type=write size=446763: (22) Invalid argument 2024-09-12T18:33:12.170 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.171+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=2PTVNGF20R5K type=del size=3579474 2024-09-12T18:33:12.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.171+0000 7f41a072b8c0 1 < completed part key=_multipart_31T6AP6MUBKL.2~GJXNH9448R5C.0 size=623416 2024-09-12T18:33:12.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.175+0000 7f41a072b8c0 1 < completed multipart upload key=31T6AP6MUBKL upload=GJXNH9448R5C tag=5IRZLOUFAKWB type=write size=1671992 2024-09-12T18:33:12.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.179+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=E3MWX0QQSVW5 type=del size=2157812 2024-09-12T18:33:12.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.183+0000 7f41a072b8c0 1 < completed part key=_multipart_C2PRRD3QO9AF.2~BXQE3UTZ3471.0 size=668604 2024-09-12T18:33:12.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.187+0000 7f41a072b8c0 1 < completed multipart upload key=C2PRRD3QO9AF upload=BXQE3UTZ3471 tag=0X2MDU86VXO9 type=write size=1717180 2024-09-12T18:33:12.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.195+0000 7f41a072b8c0 1 > prepared part key=_multipart_3CGBX19WTMWQ.2~3SDTPSRPVI20.0 size=959189 2024-09-12T18:33:12.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.195+0000 7f41a072b8c0 1 > prepared multipart upload key=3CGBX19WTMWQ upload=3SDTPSRPVI20 tag=SJNPY4VX1Y0U type=write size=2007765 2024-09-12T18:33:12.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.195+0000 7f41a072b8c0 1 < completed part key=_multipart_YP72VTCGSHYE.2~3RBRZDVPKY35.0 size=1048576 2024-09-12T18:33:12.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.195+0000 7f41a072b8c0 1 < canceled part key=_multipart_YP72VTCGSHYE.2~3RBRZDVPKY35.1 size=1048576 2024-09-12T18:33:12.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.195+0000 7f41a072b8c0 1 < canceled part key=_multipart_YP72VTCGSHYE.2~3RBRZDVPKY35.2 size=293237 2024-09-12T18:33:12.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.199+0000 7f41a072b8c0 1 < canceled multipart upload key=YP72VTCGSHYE upload=3RBRZDVPKY35 tag=U26ANISTQUVR type=write size=3438965 2024-09-12T18:33:12.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.203+0000 7f41a072b8c0 1 > prepared operation key=0G0YWIOD3L3I tag=G2HXPRTGIBSO type=del size=1247477 2024-09-12T18:33:12.208 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.207+0000 7f41a072b8c0 1 < canceled operation key=1JIIRDVMT0B0 tag=5WW68EM3WO2J type=del size=673240 2024-09-12T18:33:12.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.211+0000 7f41a072b8c0 1 > prepared operation key=L1VC63PK1R2Y tag=XVV8LMQXBB38 type=del size=2340421 2024-09-12T18:33:12.214 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.211+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~LXQBG9YZWTPL.0 size=1048576 2024-09-12T18:33:12.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.215+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~LXQBG9YZWTPL.1 size=1048576 2024-09-12T18:33:12.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.215+0000 7f41a072b8c0 1 < completed part key=_multipart_XLGVEN6DF5EW.2~LXQBG9YZWTPL.2 size=33957 2024-09-12T18:33:12.222 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.223+0000 7f41a072b8c0 1 < completed multipart upload key=XLGVEN6DF5EW upload=LXQBG9YZWTPL tag=58A4SWFMC328 type=write size=3179685 2024-09-12T18:33:12.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.227+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~A0F7WQ2DUP7H.0 size=1048576 2024-09-12T18:33:12.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.227+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~A0F7WQ2DUP7H.1 size=1048576 2024-09-12T18:33:12.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.231+0000 7f41a072b8c0 1 > prepared part key=_multipart_58IT2R988AW9.2~A0F7WQ2DUP7H.2 size=854680 2024-09-12T18:33:12.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.231+0000 7f41a072b8c0 1 > prepared multipart upload key=58IT2R988AW9 upload=A0F7WQ2DUP7H tag=VYKI396W43TC type=write size=4000408 2024-09-12T18:33:12.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.235+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~PH84JIJPZEBK.0 size=1048576 2024-09-12T18:33:12.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.235+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~PH84JIJPZEBK.1 size=1048576 2024-09-12T18:33:12.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.239+0000 7f41a072b8c0 1 < completed part key=_multipart_GC8797KSO47E.2~PH84JIJPZEBK.2 size=656179 2024-09-12T18:33:12.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.243+0000 7f41a072b8c0 1 < completed multipart upload key=GC8797KSO47E upload=PH84JIJPZEBK tag=1CSU87791KIK type=write size=3801907 2024-09-12T18:33:12.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.247+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=Q3R5IZOBD644 type=write size=99858 2024-09-12T18:33:12.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.247+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~IOIHPGNQ8CHI.0 size=1048576 2024-09-12T18:33:12.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.251+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~IOIHPGNQ8CHI.1 size=1048576 2024-09-12T18:33:12.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.251+0000 7f41a072b8c0 1 < canceled part key=_multipart_0G0YWIOD3L3I.2~IOIHPGNQ8CHI.2 size=453997 2024-09-12T18:33:12.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.255+0000 7f41a072b8c0 1 < canceled multipart upload key=0G0YWIOD3L3I upload=IOIHPGNQ8CHI tag=EF0320YUOF0Z type=write size=3599725 2024-09-12T18:33:12.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.259+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~BF592K6FN2LU.0 size=1048576 2024-09-12T18:33:12.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.263+0000 7f41a072b8c0 1 > prepared part key=_multipart_GA6P1FACU2EQ.2~BF592K6FN2LU.1 size=474568 2024-09-12T18:33:12.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.263+0000 7f41a072b8c0 1 > prepared multipart upload key=GA6P1FACU2EQ upload=BF592K6FN2LU tag=7C5OL0KGYL01 type=write size=2571720 2024-09-12T18:33:12.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.263+0000 7f41a072b8c0 1 < canceled operation key=NKMA8FG3V3TR tag=EBOW300WBCWI type=del size=1752463 2024-09-12T18:33:12.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.267+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=ERT41RM2C2JN type=del size=2078755 2024-09-12T18:33:12.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.271+0000 7f41a072b8c0 1 < completed part key=_multipart_0G0YWIOD3L3I.2~PHAND98J79W3.0 size=757421 2024-09-12T18:33:12.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.275+0000 7f41a072b8c0 1 < completed multipart upload key=0G0YWIOD3L3I upload=PHAND98J79W3 tag=FSBJ0YSHNL3L type=write size=1805997 2024-09-12T18:33:12.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.279+0000 7f41a072b8c0 1 > prepared part key=_multipart_ZACT36ZOC9ES.2~QSKZ04W46WPR.0 size=328144 2024-09-12T18:33:12.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.279+0000 7f41a072b8c0 1 > prepared multipart upload key=ZACT36ZOC9ES upload=QSKZ04W46WPR tag=ITS9RWU3UQDD type=write size=1376720 2024-09-12T18:33:12.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.279+0000 7f41a072b8c0 1 < completed write operation key=5OD9IX408CYO tag=D93KMCOWFGWF type=write size=209003 2024-09-12T18:33:12.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.287+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~YEIUKEKVTCYB.0 size=1048576 2024-09-12T18:33:12.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.287+0000 7f41a072b8c0 1 > prepared part key=_multipart_31T6AP6MUBKL.2~YEIUKEKVTCYB.1 size=85839 2024-09-12T18:33:12.289 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.287+0000 7f41a072b8c0 1 > prepared multipart upload key=31T6AP6MUBKL upload=YEIUKEKVTCYB tag=BUPPJGN068GS type=write size=2182991 2024-09-12T18:33:12.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.291+0000 7f41a072b8c0 1 < completed delete operation key=P732C5X0RG8Z tag=0NQ2UUBEV2MF type=del 2024-09-12T18:33:12.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.291+0000 7f41a072b8c0 1 > prepared operation key=5OD9IX408CYO tag=7DKDZBICJR1H type=del size=605064 2024-09-12T18:33:12.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.295+0000 7f41a072b8c0 1 < completed delete operation key=58IT2R988AW9 tag=AF2QW1JCOC5G type=del 2024-09-12T18:33:12.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.299+0000 7f41a072b8c0 1 > prepared operation key=VEN0P2P1RZ2S tag=J1IIW3OITU05 type=del size=3481974 2024-09-12T18:33:12.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.303+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~E3TIQVNPU0FW.0 size=995666 2024-09-12T18:33:12.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.307+0000 7f41a072b8c0 1 < completed multipart upload key=KOLD6WYK30EQ upload=E3TIQVNPU0FW tag=B84XMFZI0N1N type=write size=2044242 2024-09-12T18:33:12.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.307+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=OU12FF956PPO type=del size=1484537 2024-09-12T18:33:12.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.311+0000 7f41a072b8c0 1 < canceled part key=_multipart_KOLD6WYK30EQ.2~VYO5QOY02AF2.0 size=1048576 2024-09-12T18:33:12.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.311+0000 7f41a072b8c0 1 < completed part key=_multipart_KOLD6WYK30EQ.2~VYO5QOY02AF2.1 size=1048576 2024-09-12T18:33:12.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.311+0000 7f41a072b8c0 1 < canceled part key=_multipart_KOLD6WYK30EQ.2~VYO5QOY02AF2.2 size=479878 2024-09-12T18:33:12.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.315+0000 7f41a072b8c0 1 < canceled multipart upload key=KOLD6WYK30EQ upload=VYO5QOY02AF2 tag=QOJ3D4D308O3 type=write size=3625606 2024-09-12T18:33:12.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.319+0000 7f41a072b8c0 1 > prepared operation key=3CGBX19WTMWQ tag=LRZ2QAVFH0O7 type=del size=375031 2024-09-12T18:33:12.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.323+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=V9U2XZO5XLSN type=del 2024-09-12T18:33:12.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.323+0000 7f41a072b8c0 1 > prepared operation key=5JUWC8RXSA5L tag=R2EZ31BVIEJF type=del size=3658913 2024-09-12T18:33:12.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.327+0000 7f41a072b8c0 1 < completed delete operation key=3CGBX19WTMWQ tag=2PTVNGF20R5K type=del 2024-09-12T18:33:12.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.331+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~UC5SCB7H2F3W.0 size=1048576 2024-09-12T18:33:12.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.335+0000 7f41a072b8c0 1 > prepared part key=_multipart_7B70QWGMH0C0.2~UC5SCB7H2F3W.1 size=316471 2024-09-12T18:33:12.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.335+0000 7f41a072b8c0 1 > prepared multipart upload key=7B70QWGMH0C0 upload=UC5SCB7H2F3W tag=MAUPJM9FJ9BW type=write size=2413623 2024-09-12T18:33:12.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.339+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=E3MWX0QQSVW5 type=del 2024-09-12T18:33:12.341 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.339+0000 7f41a072b8c0 1 > prepared operation key=P732C5X0RG8Z tag=XRSDDEBXH2BM type=del size=626822 2024-09-12T18:33:12.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.343+0000 7f41a072b8c0 1 < completed part key=_multipart_3CGBX19WTMWQ.2~3SDTPSRPVI20.0 size=959189 2024-09-12T18:33:12.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.347+0000 7f41a072b8c0 1 < completed multipart upload key=3CGBX19WTMWQ upload=3SDTPSRPVI20 tag=SJNPY4VX1Y0U type=write size=2007765 2024-09-12T18:33:12.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.351+0000 7f41a072b8c0 1 > prepared operation key=NKMA8FG3V3TR tag=UMQAKL3Z1M31 type=del size=2514704 2024-09-12T18:33:12.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.355+0000 7f41a072b8c0 1 < completed delete operation key=0G0YWIOD3L3I tag=G2HXPRTGIBSO type=del 2024-09-12T18:33:12.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.359+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~X38YS1687T9G.0 size=1048576 2024-09-12T18:33:12.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.363+0000 7f41a072b8c0 1 > prepared part key=_multipart_NKMA8FG3V3TR.2~X38YS1687T9G.1 size=73729 2024-09-12T18:33:12.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.363+0000 7f41a072b8c0 1 > prepared multipart upload key=NKMA8FG3V3TR upload=X38YS1687T9G tag=JK5P4GCKM4R2 type=write size=2170881 2024-09-12T18:33:12.365 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.363+0000 7f41a072b8c0 1 < completed delete operation key=L1VC63PK1R2Y tag=XVV8LMQXBB38 type=del 2024-09-12T18:33:12.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.371+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~ZAWFST3GZ3L1.0 size=1048576 2024-09-12T18:33:12.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.371+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~ZAWFST3GZ3L1.1 size=1048576 2024-09-12T18:33:12.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.375+0000 7f41a072b8c0 1 > prepared part key=_multipart_GC8797KSO47E.2~ZAWFST3GZ3L1.2 size=612469 2024-09-12T18:33:12.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:33:12.375+0000 7f41a072b8c0 1 > prepared multipart upload key=GC8797KSO47E upload=ZAWFST3GZ3L1 tag=GR8UBWGAW0CO type=write size=3758197 2024-09-12T18:33:12.377 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] cls_rgw_stats.simulate (22249 ms) 2024-09-12T18:33:12.377 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 1 test from cls_rgw_stats (22250 ms total) 2024-09-12T18:33:12.377 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:33:12.377 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:33:13.200 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 1 test from 1 test suite ran. (24960 ms total) 2024-09-12T18:33:13.200 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 1 test. 2024-09-12T18:33:13.209 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:33:13.209 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:33:13.263 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T18:33:13.264 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T18:33:13.265 DEBUG:teuthology.orchestra.run.smithi111:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T18:33:13.332 INFO:tasks.workunit.client.0.smithi111.stdout:Running main() from gmock_main.cc 2024-09-12T18:33:13.333 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T18:33:13.333 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:33:15.230 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 31 tests from CmpOmap 2024-09-12T18:33:15.230 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T18:33:15.265 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (36 ms) 2024-09-12T18:33:15.266 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T18:33:15.284 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (18 ms) 2024-09-12T18:33:15.284 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T18:33:15.291 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (8 ms) 2024-09-12T18:33:15.292 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T18:33:15.298 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (7 ms) 2024-09-12T18:33:15.298 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T18:33:15.312 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_vals_str (13 ms) 2024-09-12T18:33:15.312 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T18:33:15.328 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_vals_u64 (16 ms) 2024-09-12T18:33:15.328 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T18:33:15.335 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (8 ms) 2024-09-12T18:33:15.335 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T18:33:15.344 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (8 ms) 2024-09-12T18:33:15.344 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T18:33:15.354 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (11 ms) 2024-09-12T18:33:15.355 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T18:33:15.366 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (11 ms) 2024-09-12T18:33:15.366 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T18:33:15.367 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (2 ms) 2024-09-12T18:33:15.367 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T18:33:15.368 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-12T18:33:15.368 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T18:33:15.387 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (18 ms) 2024-09-12T18:33:15.387 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T18:33:15.405 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (19 ms) 2024-09-12T18:33:15.406 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T18:33:15.422 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (16 ms) 2024-09-12T18:33:15.422 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T18:33:15.438 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (16 ms) 2024-09-12T18:33:15.438 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T18:33:15.458 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_set_vals_str (21 ms) 2024-09-12T18:33:15.458 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T18:33:15.481 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (22 ms) 2024-09-12T18:33:15.481 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T18:33:15.488 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (8 ms) 2024-09-12T18:33:15.489 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T18:33:15.495 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (6 ms) 2024-09-12T18:33:15.495 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T18:33:15.497 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (3 ms) 2024-09-12T18:33:15.498 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T18:33:15.501 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-09-12T18:33:15.501 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T18:33:15.516 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (16 ms) 2024-09-12T18:33:15.516 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T18:33:15.533 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (16 ms) 2024-09-12T18:33:15.533 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T18:33:15.551 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (18 ms) 2024-09-12T18:33:15.551 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T18:33:15.573 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (23 ms) 2024-09-12T18:33:15.574 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T18:33:15.580 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (6 ms) 2024-09-12T18:33:15.580 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T18:33:15.586 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-09-12T18:33:15.586 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T18:33:15.589 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (2 ms) 2024-09-12T18:33:15.589 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T18:33:15.592 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-12T18:33:15.592 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T18:33:15.609 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (19 ms) 2024-09-12T18:33:15.610 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 31 tests from CmpOmap (380 ms total) 2024-09-12T18:33:15.610 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:33:15.610 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:33:16.233 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 31 tests from 1 test suite ran. (2901 ms total) 2024-09-12T18:33:16.233 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 31 tests. 2024-09-12T18:33:16.240 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:33:16.240 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:33:16.298 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T18:33:16.300 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T18:33:16.300 DEBUG:teuthology.orchestra.run.smithi111:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T18:33:16.365 INFO:tasks.workunit.client.0.smithi111.stdout:Running main() from gmock_main.cc 2024-09-12T18:33:16.365 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T18:33:16.365 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:33:16.365 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T18:33:16.366 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T18:33:19.266 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2898 ms) 2024-09-12T18:33:19.266 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T18:33:22.341 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3078 ms) 2024-09-12T18:33:22.342 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T18:33:25.385 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.Reserve (3044 ms) 2024-09-12T18:33:25.386 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T18:33:28.403 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3017 ms) 2024-09-12T18:33:28.403 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T18:33:32.513 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.Commit (4110 ms) 2024-09-12T18:33:32.513 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T18:33:36.559 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.Stats (4046 ms) 2024-09-12T18:33:36.559 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T18:33:40.598 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4038 ms) 2024-09-12T18:33:40.598 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T18:33:43.659 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.Abort (3063 ms) 2024-09-12T18:33:43.660 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T18:33:46.691 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.ReserveError (3032 ms) 2024-09-12T18:33:46.692 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T18:33:49.729 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.CommitError (3037 ms) 2024-09-12T18:33:49.729 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T18:33:52.790 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.AbortError (3052 ms) 2024-09-12T18:33:52.790 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T18:33:55.834 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3053 ms) 2024-09-12T18:33:55.835 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T18:33:58.876 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3042 ms) 2024-09-12T18:33:58.877 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T18:34:01.941 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3064 ms) 2024-09-12T18:34:01.941 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T18:34:04.990 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3049 ms) 2024-09-12T18:34:04.990 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T18:34:08.030 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3040 ms) 2024-09-12T18:34:08.030 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T18:34:11.086 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3050 ms) 2024-09-12T18:34:11.086 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T18:34:14.110 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.Cleanup (3022 ms) 2024-09-12T18:34:14.110 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T18:34:26.160 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.MultiProducer (12058 ms) 2024-09-12T18:34:26.160 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T18:34:31.222 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5063 ms) 2024-09-12T18:34:31.222 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T18:34:44.353 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13131 ms) 2024-09-12T18:34:44.353 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T18:34:50.384 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6031 ms) 2024-09-12T18:34:50.384 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T18:35:00.466 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (10078 ms) 2024-09-12T18:35:00.466 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T18:35:10.527 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10065 ms) 2024-09-12T18:35:10.528 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 24 tests from TestCls2PCQueue (114162 ms total) 2024-09-12T18:35:10.528 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:35:10.528 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:35:10.528 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 24 tests from 1 test suite ran. (114163 ms total) 2024-09-12T18:35:10.528 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 24 tests. 2024-09-12T18:35:10.535 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:35:10.535 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:35:10.590 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T18:35:10.592 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T18:35:10.592 DEBUG:teuthology.orchestra.run.smithi111:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T18:35:10.666 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:35:10.666 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:35:10.666 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T18:35:10.666 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:35:12.559 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 4 tests from ClsAccount 2024-09-12T18:35:12.559 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsAccount.add 2024-09-12T18:35:12.604 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsAccount.add (45 ms) 2024-09-12T18:35:12.604 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsAccount.get 2024-09-12T18:35:12.627 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsAccount.get (23 ms) 2024-09-12T18:35:12.627 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsAccount.rm 2024-09-12T18:35:12.643 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsAccount.rm (16 ms) 2024-09-12T18:35:12.643 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] ClsAccount.list 2024-09-12T18:35:12.686 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] ClsAccount.list (43 ms) 2024-09-12T18:35:12.686 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 4 tests from ClsAccount (127 ms total) 2024-09-12T18:35:12.686 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:35:12.687 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:35:13.573 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 4 tests from 1 test suite ran. (2907 ms total) 2024-09-12T18:35:13.573 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 4 tests. 2024-09-12T18:35:13.577 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:35:13.577 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:35:13.634 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T18:35:13.635 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T18:35:13.635 DEBUG:teuthology.orchestra.run.smithi111:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T18:35:13.711 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:35:13.711 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:35:13.712 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T18:35:13.712 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:35:15.630 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T18:35:15.630 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T18:35:15.644 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] rgw_gc_log.init_existing_queue (14 ms) 2024-09-12T18:35:15.644 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T18:35:15.649 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] rgw_gc_log.init_existing_omap (5 ms) 2024-09-12T18:35:15.649 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T18:35:15.656 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (7 ms) 2024-09-12T18:35:15.656 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T18:35:15.658 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-09-12T18:35:15.659 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T18:35:15.662 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] rgw_gc_log.defer1_after_init (4 ms) 2024-09-12T18:35:15.662 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T18:35:15.665 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-12T18:35:15.665 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 6 tests from rgw_gc_log (36 ms total) 2024-09-12T18:35:15.665 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:35:15.665 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:35:16.611 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 6 tests from 1 test suite ran. (2899 ms total) 2024-09-12T18:35:16.611 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 6 tests. 2024-09-12T18:35:16.616 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:35:16.617 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:35:16.670 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T18:35:16.672 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T18:35:16.672 DEBUG:teuthology.orchestra.run.smithi111:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T18:35:16.745 INFO:tasks.workunit.client.0.smithi111.stdout:Running main() from gmock_main.cc 2024-09-12T18:35:16.745 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T18:35:16.745 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:35:16.745 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T18:35:16.745 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T18:35:16.745 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj 2024-09-12T18:35:16.745 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj 2024-09-12T18:35:16.745 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: _obj ns= i= 2024-09-12T18:35:16.745 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj 2024-09-12T18:35:16.745 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj 2024-09-12T18:35:16.745 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: _obj ns= i= 2024-09-12T18:35:16.746 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj 2024-09-12T18:35:16.746 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj 2024-09-12T18:35:16.746 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: _obj ns= i= 2024-09-12T18:35:16.746 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.746 INFO:tasks.workunit.client.0.smithi111.stdout: "obj1": { 2024-09-12T18:35:16.746 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.747 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.747 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.747 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.747 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.747 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.748 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.748 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.748 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.748 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.748 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.748 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.748 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.748 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.748 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.748 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.748 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.748 INFO:tasks.workunit.client.0.smithi111.stdout: "obj2": { 2024-09-12T18:35:16.748 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.749 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.749 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.749 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.749 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.749 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.749 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.749 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.749 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.749 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.749 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.749 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.749 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.749 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.749 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.750 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.750 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.750 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3": { 2024-09-12T18:35:16.750 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.750 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.750 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.750 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.750 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.750 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.750 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.750 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.750 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.750 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.750 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.751 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.751 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.751 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.751 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.751 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.751 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.751 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3-2": { 2024-09-12T18:35:16.751 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.751 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.751 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.751 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.751 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.751 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.752 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.752 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.752 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.752 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.752 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.752 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.752 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.752 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.752 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.752 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.752 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.752 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.752 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj 2024-09-12T18:35:16.752 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj 2024-09-12T18:35:16.753 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: _obj ns=ns i= 2024-09-12T18:35:16.753 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj 2024-09-12T18:35:16.753 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj 2024-09-12T18:35:16.753 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: _obj ns=ns i= 2024-09-12T18:35:16.753 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj 2024-09-12T18:35:16.753 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj 2024-09-12T18:35:16.753 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: _obj ns=ns i= 2024-09-12T18:35:16.753 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.753 INFO:tasks.workunit.client.0.smithi111.stdout: "obj1": { 2024-09-12T18:35:16.753 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.753 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.753 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.753 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.754 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.754 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.754 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.754 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.754 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.754 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.754 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.754 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.754 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.754 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.754 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.754 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.754 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.755 INFO:tasks.workunit.client.0.smithi111.stdout: "obj2": { 2024-09-12T18:35:16.755 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.755 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.755 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.755 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.755 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.755 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.755 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.755 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.755 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.755 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.755 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.755 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.755 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.756 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.756 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.756 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.756 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.756 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3": { 2024-09-12T18:35:16.756 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.756 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.756 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.756 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.756 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.756 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.756 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.756 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.757 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.757 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.757 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.757 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.757 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.757 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.757 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.757 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.757 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.757 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3-2": { 2024-09-12T18:35:16.757 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.757 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.757 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.757 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.758 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.758 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.758 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.758 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.758 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.758 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.758 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.758 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.758 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.758 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.758 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.758 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.758 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.758 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.759 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj[v1] 2024-09-12T18:35:16.759 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj[v1] 2024-09-12T18:35:16.759 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: _obj ns= i=v1 2024-09-12T18:35:16.759 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj[v1] 2024-09-12T18:35:16.759 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj[v1] 2024-09-12T18:35:16.759 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: _obj ns= i=v1 2024-09-12T18:35:16.759 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj[v1] 2024-09-12T18:35:16.759 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj[v1] 2024-09-12T18:35:16.759 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: _obj ns= i=v1 2024-09-12T18:35:16.759 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.759 INFO:tasks.workunit.client.0.smithi111.stdout: "obj1": { 2024-09-12T18:35:16.759 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.759 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.759 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.760 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.760 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.760 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.760 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.760 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.760 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.760 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.760 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.760 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.760 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.760 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "v1", 2024-09-12T18:35:16.760 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.760 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.760 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.761 INFO:tasks.workunit.client.0.smithi111.stdout: "obj2": { 2024-09-12T18:35:16.761 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.761 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.761 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.761 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.761 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.761 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.761 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.761 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.761 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.761 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.761 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.761 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.761 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.762 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "v1", 2024-09-12T18:35:16.762 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.762 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.762 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.762 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3": { 2024-09-12T18:35:16.762 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.762 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.762 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.762 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.762 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.762 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.762 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.762 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.762 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.763 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.763 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.763 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.763 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.763 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.763 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.763 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.763 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.763 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3-2": { 2024-09-12T18:35:16.763 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.763 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.763 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.763 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.763 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.764 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.764 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.764 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.764 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.764 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.764 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.764 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.764 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.764 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "v1", 2024-09-12T18:35:16.764 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.764 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.764 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.764 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.764 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj[v1] 2024-09-12T18:35:16.765 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj[v1] 2024-09-12T18:35:16.765 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: _obj ns=ns i=v1 2024-09-12T18:35:16.765 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj[v1] 2024-09-12T18:35:16.765 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj[v1] 2024-09-12T18:35:16.765 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: _obj ns=ns i=v1 2024-09-12T18:35:16.765 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj[v1] 2024-09-12T18:35:16.765 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: _obj[v1] 2024-09-12T18:35:16.765 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: _obj ns=ns i=v1 2024-09-12T18:35:16.765 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.765 INFO:tasks.workunit.client.0.smithi111.stdout: "obj1": { 2024-09-12T18:35:16.765 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.765 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.765 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.766 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.766 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.766 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.766 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.766 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.766 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.766 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.766 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.766 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.766 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.766 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "v1", 2024-09-12T18:35:16.766 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.766 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.766 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.767 INFO:tasks.workunit.client.0.smithi111.stdout: "obj2": { 2024-09-12T18:35:16.767 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.767 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.767 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.767 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.767 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.767 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.767 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.767 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.767 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.767 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.767 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.767 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.767 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.768 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "v1", 2024-09-12T18:35:16.768 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.768 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.768 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.768 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3": { 2024-09-12T18:35:16.768 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.768 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.768 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.768 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.768 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.768 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.768 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.768 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.768 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3-2": { 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.769 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.770 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.770 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.770 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.770 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.770 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.770 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.770 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_obj", 2024-09-12T18:35:16.770 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "v1", 2024-09-12T18:35:16.770 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.770 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.770 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.770 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.770 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T18:35:16.770 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T18:35:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj 2024-09-12T18:35:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj 2024-09-12T18:35:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: obj ns= i= 2024-09-12T18:35:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj 2024-09-12T18:35:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj 2024-09-12T18:35:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: obj ns= i= 2024-09-12T18:35:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj 2024-09-12T18:35:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj 2024-09-12T18:35:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: obj ns= i= 2024-09-12T18:35:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.771 INFO:tasks.workunit.client.0.smithi111.stdout: "obj1": { 2024-09-12T18:35:16.771 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.771 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.771 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.772 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.772 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.772 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.772 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.772 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.772 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.772 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.772 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.772 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.772 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.772 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.772 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.772 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.773 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.773 INFO:tasks.workunit.client.0.smithi111.stdout: "obj2": { 2024-09-12T18:35:16.773 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.773 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.773 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.773 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.773 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.773 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.773 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.773 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.773 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.773 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.773 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.773 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.774 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.774 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.774 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.774 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.774 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.774 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3": { 2024-09-12T18:35:16.774 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.774 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.774 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.774 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.774 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.774 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.774 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.774 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.775 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.775 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.775 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.775 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.775 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.775 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.775 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.775 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.775 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.775 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3-2": { 2024-09-12T18:35:16.775 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.775 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.775 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.775 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.776 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.776 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.776 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.776 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.776 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.776 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.776 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.776 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.776 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.776 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.776 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.776 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.776 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.777 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.777 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj 2024-09-12T18:35:16.777 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj 2024-09-12T18:35:16.777 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: obj ns=ns i= 2024-09-12T18:35:16.777 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj 2024-09-12T18:35:16.777 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj 2024-09-12T18:35:16.777 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: obj ns=ns i= 2024-09-12T18:35:16.777 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj 2024-09-12T18:35:16.777 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj 2024-09-12T18:35:16.777 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: obj ns=ns i= 2024-09-12T18:35:16.777 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.777 INFO:tasks.workunit.client.0.smithi111.stdout: "obj1": { 2024-09-12T18:35:16.777 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.778 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.778 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.778 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.778 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.778 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.778 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.778 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.778 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.778 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.778 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.778 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.778 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.778 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.778 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.779 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.779 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.779 INFO:tasks.workunit.client.0.smithi111.stdout: "obj2": { 2024-09-12T18:35:16.779 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.779 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.779 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.779 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.779 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.779 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.779 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.779 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.779 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.779 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.779 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.780 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.780 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.780 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.780 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.780 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.780 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.780 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3": { 2024-09-12T18:35:16.780 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.780 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.781 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.781 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.781 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.781 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.781 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.781 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.781 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.781 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.781 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.781 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.781 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.782 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.782 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.782 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.782 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.782 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3-2": { 2024-09-12T18:35:16.782 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.782 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.782 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.782 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.782 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.782 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.782 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.782 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.782 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.783 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.783 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.783 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.783 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.783 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.783 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.783 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.783 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.783 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.783 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj[v1] 2024-09-12T18:35:16.783 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj[v1] 2024-09-12T18:35:16.783 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: obj ns= i=v1 2024-09-12T18:35:16.783 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj[v1] 2024-09-12T18:35:16.784 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj[v1] 2024-09-12T18:35:16.784 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: obj ns= i=v1 2024-09-12T18:35:16.784 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj[v1] 2024-09-12T18:35:16.784 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj[v1] 2024-09-12T18:35:16.784 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: obj ns= i=v1 2024-09-12T18:35:16.784 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.784 INFO:tasks.workunit.client.0.smithi111.stdout: "obj1": { 2024-09-12T18:35:16.784 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.784 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.784 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.784 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.784 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.784 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.784 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.785 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.785 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.785 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.785 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.785 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.785 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.785 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "v1", 2024-09-12T18:35:16.785 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.785 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.785 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.785 INFO:tasks.workunit.client.0.smithi111.stdout: "obj2": { 2024-09-12T18:35:16.785 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.785 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.785 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.786 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.786 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.786 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.786 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.786 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.786 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.786 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.786 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.786 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.786 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.786 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "v1", 2024-09-12T18:35:16.786 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.786 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.786 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.787 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3": { 2024-09-12T18:35:16.787 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.787 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.787 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.787 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.787 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.787 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.787 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.787 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.787 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.787 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.787 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.787 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.788 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.788 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.788 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.788 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.788 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.788 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3-2": { 2024-09-12T18:35:16.788 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.788 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.788 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.788 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.788 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.789 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.789 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.789 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.789 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.789 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.789 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.789 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.789 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.789 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "v1", 2024-09-12T18:35:16.789 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.789 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.789 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.789 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.789 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj[v1] 2024-09-12T18:35:16.790 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj[v1] 2024-09-12T18:35:16.790 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: obj ns=ns i=v1 2024-09-12T18:35:16.790 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj[v1] 2024-09-12T18:35:16.790 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj[v1] 2024-09-12T18:35:16.790 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: obj ns=ns i=v1 2024-09-12T18:35:16.790 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj[v1] 2024-09-12T18:35:16.790 INFO:tasks.workunit.client.0.smithi111.stdout:parsed: obj[v1] 2024-09-12T18:35:16.790 INFO:tasks.workunit.client.0.smithi111.stdout:stripped: obj ns=ns i=v1 2024-09-12T18:35:16.790 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.791 INFO:tasks.workunit.client.0.smithi111.stdout: "obj1": { 2024-09-12T18:35:16.791 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.791 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.791 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.791 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.791 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.791 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.791 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.791 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.791 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.791 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.791 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.792 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.792 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.792 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "v1", 2024-09-12T18:35:16.792 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.792 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.792 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.792 INFO:tasks.workunit.client.0.smithi111.stdout: "obj2": { 2024-09-12T18:35:16.792 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.792 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.792 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.792 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.792 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.792 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.792 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.793 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.793 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.793 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.793 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.793 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.793 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.793 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "v1", 2024-09-12T18:35:16.793 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.793 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.793 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.793 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3": { 2024-09-12T18:35:16.793 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.793 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.793 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.794 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.794 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.794 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.794 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.794 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.794 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.794 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.794 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.794 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.794 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.795 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.795 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.795 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.795 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.795 INFO:tasks.workunit.client.0.smithi111.stdout: "obj3-2": { 2024-09-12T18:35:16.795 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.795 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.795 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.795 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.795 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.795 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.795 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.795 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.795 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.796 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.796 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.796 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.796 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "obj", 2024-09-12T18:35:16.796 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "v1", 2024-09-12T18:35:16.796 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.796 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.796 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.796 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.796 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T18:35:16.796 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T18:35:16.796 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.796 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.797 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.797 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.797 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.797 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.797 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.797 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.797 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.797 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.797 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.797 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.797 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.797 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.797 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.797 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.798 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.798 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.798 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.798 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.798 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.798 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.798 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.798 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.798 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.798 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.798 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.798 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.798 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.798 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.799 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.799 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.799 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.799 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.799 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.799 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": "default-placement.data", 2024-09-12T18:35:16.799 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker_myobj", 2024-09-12T18:35:16.799 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.799 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.799 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.799 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.799 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.799 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.799 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.800 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.800 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.800 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.800 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.800 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.800 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.800 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.800 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.800 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.800 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.800 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.800 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.800 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.801 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.801 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.801 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.801 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.801 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.801 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.801 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.801 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.801 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.801 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.802 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.802 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.802 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.802 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.802 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.802 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.802 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.802 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.802 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.802 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.802 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.802 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.802 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.802 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.803 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.803 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.803 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.803 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.803 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.803 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.803 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.803 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.803 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.803 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.803 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.803 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.803 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.803 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.804 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.804 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker_myobj", 2024-09-12T18:35:16.804 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.804 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.804 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.804 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.804 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.804 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.804 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.804 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.804 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.804 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.804 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.805 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.805 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.805 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.805 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.805 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.805 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.805 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.805 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.805 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.805 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.805 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.805 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.805 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.805 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.806 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.806 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.806 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.806 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.806 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.806 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.806 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.806 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.806 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.806 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.806 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.806 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.806 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.806 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.807 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.807 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.807 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.807 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.807 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.807 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.807 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.807 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.807 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.807 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.807 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.807 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.807 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.807 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.808 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.808 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.808 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.808 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.808 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.808 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": "default-placement.data", 2024-09-12T18:35:16.808 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns_myobj", 2024-09-12T18:35:16.808 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.808 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.808 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.808 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.808 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.808 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.809 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.809 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.809 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.809 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.809 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.809 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.809 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.809 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.809 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.809 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.809 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.809 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.809 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.809 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.810 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.810 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.810 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.810 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.810 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.810 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.810 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.810 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.810 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.810 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.810 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.810 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.810 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.810 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.811 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.812 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.812 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.812 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.812 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.813 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.813 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.813 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.813 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.813 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.813 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.813 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.813 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.813 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.813 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.813 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.813 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.813 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.813 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.814 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.814 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.814 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.814 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.814 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.814 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.814 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns_myobj", 2024-09-12T18:35:16.814 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.814 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.814 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.814 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.814 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.814 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.814 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.815 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.815 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.815 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.815 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.815 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.815 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.815 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.815 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.815 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.815 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.815 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.815 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.815 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.815 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.816 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.816 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.816 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.816 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.816 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.816 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.816 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.816 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.816 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.816 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.816 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.816 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.816 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.816 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.817 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.817 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.817 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.817 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.817 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.817 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.817 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.817 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.817 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.817 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.817 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.817 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.817 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.817 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.818 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.818 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.818 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.818 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.818 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.818 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.818 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.818 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.818 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.818 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": "default-placement.data", 2024-09-12T18:35:16.818 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__:inst_myobj", 2024-09-12T18:35:16.818 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.818 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.818 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.819 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.819 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.819 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.819 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.819 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.819 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.819 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.819 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.819 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.819 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.819 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.819 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.819 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.819 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.820 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.820 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.820 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.820 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.820 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.820 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.820 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.820 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.820 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.820 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.820 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.820 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.820 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.821 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.821 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.821 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.821 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.821 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.821 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.821 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.821 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.821 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.821 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.821 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.821 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.821 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.821 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.822 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.822 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.822 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.822 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.822 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.822 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.822 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.822 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.822 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.822 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.822 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.822 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.822 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.822 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__:inst_myobj", 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.823 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.824 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.824 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.824 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.824 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.824 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.824 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.824 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.824 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.824 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.824 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.824 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.824 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.824 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.825 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.825 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.825 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.825 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.825 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.825 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.825 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.825 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.825 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.825 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.825 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.825 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.825 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.825 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.826 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.826 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.826 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.826 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.826 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.826 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.826 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.826 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.826 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.826 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.826 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.826 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.826 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.827 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.827 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.827 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.827 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.827 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.827 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": "default-placement.data", 2024-09-12T18:35:16.827 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T18:35:16.827 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.827 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.827 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.827 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.827 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.827 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.827 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.828 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.828 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.828 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.828 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.828 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.828 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.828 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.828 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.828 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.828 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.828 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.828 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.828 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.829 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.829 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.829 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.829 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.829 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.829 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.829 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.829 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.829 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.829 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.829 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.829 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.829 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.830 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.830 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.830 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.830 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.830 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.830 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.830 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.830 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.830 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.830 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.830 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.830 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.830 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.831 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.831 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.831 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.831 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.831 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.831 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.831 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.831 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.831 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.831 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.831 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.831 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.831 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.831 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T18:35:16.832 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.832 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.832 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.832 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.832 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.832 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.832 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.832 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.832 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.832 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.832 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.832 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.833 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.833 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.833 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.833 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.833 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.833 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.833 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.833 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.833 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.833 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.833 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.833 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.833 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.833 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.834 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.834 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.834 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.834 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.834 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.834 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.834 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.834 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.834 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.834 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.834 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.834 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.834 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.834 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.835 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.835 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.835 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.835 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.835 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.835 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.835 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.835 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.835 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.835 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.835 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.835 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.835 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.836 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.836 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.836 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.836 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.836 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.836 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": "default-placement.data", 2024-09-12T18:35:16.836 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker___myobj", 2024-09-12T18:35:16.836 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj" 2024-09-12T18:35:16.836 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.836 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.836 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.836 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.836 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.836 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.837 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.837 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.837 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.837 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.837 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.837 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.837 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.837 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.837 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.837 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.837 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.837 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.837 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.838 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.838 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.838 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.838 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.838 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.838 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.838 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.838 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.838 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.838 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.838 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.838 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.838 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.838 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.839 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.839 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.839 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.839 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.839 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.839 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.839 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.839 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.839 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.839 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.839 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.839 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.839 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.839 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.840 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.840 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.840 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.840 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.840 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.840 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.840 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.840 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.840 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.840 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.840 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.840 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker___myobj", 2024-09-12T18:35:16.840 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj" 2024-09-12T18:35:16.841 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.841 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.841 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.841 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.841 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.841 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.841 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.841 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.841 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.841 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.841 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.841 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.841 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.842 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.842 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.842 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.842 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.842 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.842 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.842 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.842 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.842 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.842 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.842 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.842 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.842 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.842 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.843 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.844 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.844 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.844 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.844 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.844 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.844 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.844 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.844 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.844 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.844 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.844 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.844 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.844 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.845 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.845 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.845 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": "default-placement.data", 2024-09-12T18:35:16.845 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns__myobj", 2024-09-12T18:35:16.845 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.845 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.845 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.845 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.845 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.845 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.845 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.845 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.846 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.846 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.846 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.846 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.846 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.846 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.846 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.846 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.846 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.846 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.846 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.846 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.846 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.846 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.847 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.848 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.848 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.848 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.848 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.848 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.848 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.848 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.848 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.848 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.848 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.848 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.848 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.848 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.848 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.849 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.849 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.849 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.849 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.849 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.849 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.849 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.849 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.849 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns__myobj", 2024-09-12T18:35:16.849 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.849 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.850 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.850 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.850 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.850 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.850 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.850 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.850 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.850 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.850 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.850 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.850 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.850 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.850 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.850 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.851 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.851 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.851 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.851 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.851 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.851 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.851 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.851 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.851 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.851 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.851 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.851 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.851 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.851 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.852 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.852 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.852 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.852 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.852 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.852 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.852 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.852 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.852 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.852 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.852 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.852 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.852 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.852 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.853 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.853 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.853 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.853 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.853 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.853 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.853 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.853 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.853 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.853 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.853 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.853 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.853 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.853 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": "default-placement.data", 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__:inst__myobj", 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj" 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.854 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.855 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.855 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.855 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.855 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.855 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.855 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.855 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.855 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.855 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.855 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.855 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.855 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.855 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.855 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.856 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.856 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.856 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.856 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.856 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.856 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.856 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.856 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.856 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.856 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.856 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.856 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.856 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.857 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.857 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.857 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.857 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.857 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.857 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.857 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.857 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.857 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.857 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.857 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.857 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.857 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.857 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.858 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.858 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.858 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.858 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.858 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.858 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__:inst__myobj", 2024-09-12T18:35:16.858 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj" 2024-09-12T18:35:16.858 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.858 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.858 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.858 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.858 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.858 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.858 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.859 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.859 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.859 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.859 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.859 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.859 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.859 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.859 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.859 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.859 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.859 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.859 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.859 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.859 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.860 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.860 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.860 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.860 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.860 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.860 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.860 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.860 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.860 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.860 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.860 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.860 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.860 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.860 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.861 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.861 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.861 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.861 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.861 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.861 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.861 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.861 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.861 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.861 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.861 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.861 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.861 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.862 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.862 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.862 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.862 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.862 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.862 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.862 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.862 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.862 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.862 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": "default-placement.data", 2024-09-12T18:35:16.862 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T18:35:16.862 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.862 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.862 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.863 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.863 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.863 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.863 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.863 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.863 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.863 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.863 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.863 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.863 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.863 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.863 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.863 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.863 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.864 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.864 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.864 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.864 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.864 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.864 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.864 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.864 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.864 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.864 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.864 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.864 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.864 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.865 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.865 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.865 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.865 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.865 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.865 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.865 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.865 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.865 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.865 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.865 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.865 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.865 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.865 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.866 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.866 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.866 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.866 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.866 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.866 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.866 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.866 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.866 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.866 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.866 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.866 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.866 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.866 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.867 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.868 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.868 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.868 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.868 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.868 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.868 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.868 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.868 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.868 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.868 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.868 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.868 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.868 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.869 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.870 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.870 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.870 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.870 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.870 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.870 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.870 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.870 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.870 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.870 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.870 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.870 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.870 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.870 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.871 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.871 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.871 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.871 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": "default-placement.data", 2024-09-12T18:35:16.871 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker___myobj_", 2024-09-12T18:35:16.871 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj_" 2024-09-12T18:35:16.871 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.871 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.871 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.871 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.871 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.871 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.872 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.872 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.872 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.872 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.872 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.872 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.872 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.872 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.872 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.872 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.872 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.872 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.872 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.872 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.873 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.873 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.873 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.873 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.873 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.873 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.873 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.873 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.873 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.873 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.873 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.873 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.873 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.873 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.874 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.874 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.874 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.874 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.874 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.874 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.874 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.874 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.874 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.874 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.874 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.874 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.874 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.874 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.875 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.875 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.875 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.875 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.875 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.875 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.875 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.875 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.875 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.875 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.875 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker___myobj_", 2024-09-12T18:35:16.875 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj_" 2024-09-12T18:35:16.875 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.875 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.876 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.876 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.876 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.876 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.876 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.876 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.876 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.876 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.876 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.876 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.876 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.876 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.876 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.876 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.877 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.878 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.878 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.878 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.878 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.878 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.878 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.878 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.878 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.878 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.878 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.878 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.878 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.878 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.878 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": "default-placement.data", 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns__myobj_", 2024-09-12T18:35:16.879 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.880 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.880 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.880 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.880 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.880 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.880 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.880 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.880 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.880 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.880 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.880 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.880 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.880 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.881 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.881 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.881 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.881 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.881 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.881 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.881 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.882 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.882 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.882 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.882 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.882 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.882 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.882 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.882 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.882 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.882 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.882 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.882 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.882 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.882 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.883 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.883 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.883 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.883 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.883 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.883 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.883 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.883 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.883 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.883 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.883 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.883 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.883 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.883 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.884 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.884 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.884 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.884 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.884 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.884 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.884 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.884 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.884 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.884 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.884 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns__myobj_", 2024-09-12T18:35:16.884 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.884 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.885 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.885 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.885 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.885 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.885 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.885 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.885 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.885 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.885 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.885 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.885 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.885 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.885 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.885 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.886 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.886 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.886 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.886 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.886 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.886 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.886 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.886 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.886 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.886 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.886 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.886 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.886 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.886 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.887 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.887 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.887 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.887 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.887 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.887 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.887 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.887 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.887 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.887 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.887 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.887 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.887 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.887 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.888 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.888 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.888 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.888 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.888 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.888 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.888 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.888 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.888 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.888 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.888 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.888 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.888 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.888 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.889 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": "default-placement.data", 2024-09-12T18:35:16.889 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T18:35:16.889 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj_" 2024-09-12T18:35:16.889 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.889 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.889 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.889 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.889 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.889 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.889 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.889 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.889 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.889 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.890 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.890 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.890 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.890 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.890 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.890 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.890 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.890 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.890 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.890 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.890 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.891 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.891 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.891 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.891 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.891 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.891 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.891 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.891 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.891 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.892 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.892 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.892 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.892 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.892 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.892 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.892 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.892 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.892 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.892 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.893 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.893 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.893 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.893 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.893 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.893 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.893 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.893 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.893 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.893 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.893 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.894 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.894 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.894 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.894 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.894 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.895 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.895 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.895 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T18:35:16.895 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj_" 2024-09-12T18:35:16.895 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.895 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.895 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.895 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.895 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.895 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.895 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.895 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.896 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.896 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.896 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.896 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.896 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.896 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.896 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.896 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.896 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.896 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.896 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.896 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.896 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.897 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.897 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.897 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.897 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.897 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.897 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.897 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.897 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.897 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.897 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.897 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.897 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.897 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.897 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.898 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.899 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.899 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.899 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.899 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.899 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.899 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.899 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.899 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": "default-placement.data", 2024-09-12T18:35:16.899 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T18:35:16.899 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.899 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.900 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.900 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.900 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.900 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.900 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "test", 2024-09-12T18:35:16.900 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.900 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.900 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.900 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.900 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": "", 2024-09-12T18:35:16.900 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.900 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": "" 2024-09-12T18:35:16.900 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.901 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.901 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.901 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.901 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.901 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.901 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.901 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.901 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.901 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.901 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.902 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.902 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.902 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.902 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.902 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.902 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.902 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.902 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.902 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.902 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.902 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.902 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.902 INFO:tasks.workunit.client.0.smithi111.stdout: "obj": { 2024-09-12T18:35:16.902 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.903 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.903 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.903 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.903 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.903 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.903 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.903 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.903 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.903 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.903 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.903 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.903 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.903 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.903 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.904 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.904 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.904 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.904 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.904 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.904 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.904 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T18:35:16.904 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.904 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.904 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.904 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.904 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.904 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.905 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.905 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.905 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.905 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.905 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.905 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.905 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.905 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.905 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.905 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.905 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.905 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.905 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.906 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.906 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.906 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.906 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.906 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-12T18:35:16.906 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T18:35:16.906 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.906 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.906 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.906 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker_myobj", 2024-09-12T18:35:16.906 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.906 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.906 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.907 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.907 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.907 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.907 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.907 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.907 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.907 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.907 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.907 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.907 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.907 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.907 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.907 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.907 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.908 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.908 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.908 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.908 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.908 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.908 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.908 INFO:tasks.workunit.client.0.smithi111.stdout:raw=.data-pool:marker_myobj 2024-09-12T18:35:16.908 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.908 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj2": { 2024-09-12T18:35:16.908 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.908 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker_myobj", 2024-09-12T18:35:16.908 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.908 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.908 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.909 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.909 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj2": { 2024-09-12T18:35:16.909 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.909 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.909 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.909 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.909 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.909 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.909 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.909 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.909 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.909 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.909 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout:raw2=.data-pool:marker_myobj 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns_myobj", 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.910 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.911 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.911 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.911 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.911 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.911 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.911 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.911 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.911 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.911 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.911 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.911 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.911 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.911 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.912 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.912 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.912 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.912 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.912 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.912 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.912 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.912 INFO:tasks.workunit.client.0.smithi111.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T18:35:16.912 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.912 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj2": { 2024-09-12T18:35:16.912 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.912 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns_myobj", 2024-09-12T18:35:16.912 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.912 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.913 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.913 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.913 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj2": { 2024-09-12T18:35:16.913 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.913 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.913 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.913 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.913 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.913 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.913 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.913 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.913 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.913 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.913 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.914 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.914 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.914 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.914 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.914 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.914 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.914 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.914 INFO:tasks.workunit.client.0.smithi111.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T18:35:16.914 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.914 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.914 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.914 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__:inst_myobj", 2024-09-12T18:35:16.914 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.914 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.915 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.915 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.915 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.915 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.915 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.915 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.915 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.915 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.915 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.915 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.915 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.915 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.915 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.916 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.916 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.916 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.916 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.916 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.916 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.916 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.916 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.916 INFO:tasks.workunit.client.0.smithi111.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T18:35:16.916 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.916 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj2": { 2024-09-12T18:35:16.916 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.916 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__:inst_myobj", 2024-09-12T18:35:16.916 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.917 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.917 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.917 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.917 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj2": { 2024-09-12T18:35:16.917 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.917 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.917 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.917 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.917 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.917 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.917 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.917 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.918 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.918 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.918 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.918 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.918 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.918 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.918 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.918 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.918 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.918 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.918 INFO:tasks.workunit.client.0.smithi111.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T18:35:16.918 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.918 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.918 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.919 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T18:35:16.919 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.919 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.919 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.919 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.919 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.919 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.919 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.919 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.919 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.919 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.919 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.919 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.919 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.920 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.920 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.920 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.920 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.920 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.920 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.920 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.920 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.920 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.920 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.920 INFO:tasks.workunit.client.0.smithi111.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T18:35:16.920 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.921 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj2": { 2024-09-12T18:35:16.921 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.921 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T18:35:16.921 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.921 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.921 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.921 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.921 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj2": { 2024-09-12T18:35:16.921 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.921 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.921 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.921 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.921 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.921 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.922 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.922 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.922 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.922 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.922 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.922 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.922 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "myobj", 2024-09-12T18:35:16.922 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.922 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.922 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.922 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.922 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.922 INFO:tasks.workunit.client.0.smithi111.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T18:35:16.922 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.923 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.923 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.923 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker___myobj", 2024-09-12T18:35:16.923 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj" 2024-09-12T18:35:16.923 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.923 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.923 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.923 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.924 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.924 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.924 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.924 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.924 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.924 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.924 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.924 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.924 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.924 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.924 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.924 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.925 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.925 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.925 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.925 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.925 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.925 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.925 INFO:tasks.workunit.client.0.smithi111.stdout:raw=.data-pool:marker___myobj 2024-09-12T18:35:16.925 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.925 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj2": { 2024-09-12T18:35:16.925 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.925 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker___myobj", 2024-09-12T18:35:16.925 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj" 2024-09-12T18:35:16.925 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.925 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.926 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.926 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj2": { 2024-09-12T18:35:16.926 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.926 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.926 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.926 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.926 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.926 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.926 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.926 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.927 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.927 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.927 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.927 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.927 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.927 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.927 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.927 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.927 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.927 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.927 INFO:tasks.workunit.client.0.smithi111.stdout:raw2=.data-pool:marker___myobj 2024-09-12T18:35:16.927 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.927 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.928 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.928 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns__myobj", 2024-09-12T18:35:16.928 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.928 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.928 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.928 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.928 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.928 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.928 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.928 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.928 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.928 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.928 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.929 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.929 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.929 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.929 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.929 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.929 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.929 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.929 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.929 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.929 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.929 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.929 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.929 INFO:tasks.workunit.client.0.smithi111.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T18:35:16.929 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.930 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj2": { 2024-09-12T18:35:16.930 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.930 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns__myobj", 2024-09-12T18:35:16.930 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.930 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.930 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.930 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.930 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj2": { 2024-09-12T18:35:16.930 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.930 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.930 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.930 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.930 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.930 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.931 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.931 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.931 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.931 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.931 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.931 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.931 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.931 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.931 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.931 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.931 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.931 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.931 INFO:tasks.workunit.client.0.smithi111.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T18:35:16.932 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.932 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.932 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.932 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__:inst__myobj", 2024-09-12T18:35:16.932 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj" 2024-09-12T18:35:16.932 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.932 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.932 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.932 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.932 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.932 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.932 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.933 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.933 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.933 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.933 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.933 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.933 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.933 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.933 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.933 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.933 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.933 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.933 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.934 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.934 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.934 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.934 INFO:tasks.workunit.client.0.smithi111.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T18:35:16.934 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.934 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj2": { 2024-09-12T18:35:16.934 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.934 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__:inst__myobj", 2024-09-12T18:35:16.934 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj" 2024-09-12T18:35:16.934 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.934 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.934 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.934 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj2": { 2024-09-12T18:35:16.935 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.935 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.935 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.935 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.935 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.935 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.935 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.935 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.935 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.935 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.935 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.935 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.935 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.936 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.936 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.936 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.936 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.936 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.936 INFO:tasks.workunit.client.0.smithi111.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T18:35:16.936 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.936 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.936 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.936 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T18:35:16.936 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.936 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.937 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.937 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.937 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.937 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.937 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.937 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.937 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.937 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.937 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.937 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.937 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.937 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.937 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.937 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.938 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.938 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.938 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.938 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.938 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.938 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.938 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.938 INFO:tasks.workunit.client.0.smithi111.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T18:35:16.938 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.938 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj2": { 2024-09-12T18:35:16.938 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.938 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T18:35:16.938 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.938 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.939 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.939 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.939 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj2": { 2024-09-12T18:35:16.939 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.939 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.939 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.939 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.939 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.939 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.939 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.939 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.939 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.939 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.939 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.940 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.940 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj", 2024-09-12T18:35:16.940 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.940 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.940 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.940 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.940 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.940 INFO:tasks.workunit.client.0.smithi111.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T18:35:16.940 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.940 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.940 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.940 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker___myobj_", 2024-09-12T18:35:16.940 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj_" 2024-09-12T18:35:16.941 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.941 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.941 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.941 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.941 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.941 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.941 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.941 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.941 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.941 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.941 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.942 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.942 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.942 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.942 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.942 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.942 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.942 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.942 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.942 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.942 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.942 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.942 INFO:tasks.workunit.client.0.smithi111.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T18:35:16.942 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.942 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj2": { 2024-09-12T18:35:16.943 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.943 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker___myobj_", 2024-09-12T18:35:16.943 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj_" 2024-09-12T18:35:16.943 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.943 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.943 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.943 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj2": { 2024-09-12T18:35:16.943 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.943 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.943 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.943 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.943 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.943 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.943 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.944 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.944 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.944 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.944 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.944 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.944 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.944 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.944 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.944 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.944 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.944 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.944 INFO:tasks.workunit.client.0.smithi111.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T18:35:16.944 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.944 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.945 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.945 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns__myobj_", 2024-09-12T18:35:16.945 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.945 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.945 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.945 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.945 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.945 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.945 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.945 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.945 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.945 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.945 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.946 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.946 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.946 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.946 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.946 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.946 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.946 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.946 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.946 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.946 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.946 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.946 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.946 INFO:tasks.workunit.client.0.smithi111.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T18:35:16.947 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.947 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj2": { 2024-09-12T18:35:16.947 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.947 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns__myobj_", 2024-09-12T18:35:16.947 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.947 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.947 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.947 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.947 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj2": { 2024-09-12T18:35:16.947 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.947 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.947 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.947 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.947 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.948 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.948 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.948 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.948 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.948 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.948 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.948 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.948 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.948 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "", 2024-09-12T18:35:16.948 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.948 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.948 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.949 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.949 INFO:tasks.workunit.client.0.smithi111.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T18:35:16.949 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.949 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.949 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.949 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T18:35:16.949 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj_" 2024-09-12T18:35:16.949 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.949 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.949 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.949 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.949 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.950 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.950 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.950 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.950 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.950 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.950 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.950 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.950 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.950 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.950 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.950 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.950 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.950 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.951 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.951 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.951 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.951 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.951 INFO:tasks.workunit.client.0.smithi111.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T18:35:16.951 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.951 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj2": { 2024-09-12T18:35:16.951 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.951 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T18:35:16.951 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "marker__myobj_" 2024-09-12T18:35:16.951 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.951 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.951 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.951 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj2": { 2024-09-12T18:35:16.952 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.952 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.952 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.952 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.952 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.952 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.952 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.952 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.952 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.952 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.953 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.953 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.953 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.953 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.953 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "" 2024-09-12T18:35:16.953 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.953 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.953 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.953 INFO:tasks.workunit.client.0.smithi111.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T18:35:16.953 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.953 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj": { 2024-09-12T18:35:16.953 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.953 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T18:35:16.953 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.954 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.954 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.954 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.954 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj": { 2024-09-12T18:35:16.954 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.954 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.954 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.954 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.954 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.955 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.955 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.955 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.955 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.955 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.955 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.955 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.955 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.955 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.955 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.955 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.955 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.955 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.955 INFO:tasks.workunit.client.0.smithi111.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T18:35:16.956 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.956 INFO:tasks.workunit.client.0.smithi111.stdout: "raw_obj2": { 2024-09-12T18:35:16.956 INFO:tasks.workunit.client.0.smithi111.stdout: "pool": ".data-pool", 2024-09-12T18:35:16.956 INFO:tasks.workunit.client.0.smithi111.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T18:35:16.956 INFO:tasks.workunit.client.0.smithi111.stdout: "loc": "" 2024-09-12T18:35:16.956 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.956 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.956 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:16.956 INFO:tasks.workunit.client.0.smithi111.stdout: "new_obj2": { 2024-09-12T18:35:16.956 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket": { 2024-09-12T18:35:16.956 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "ebtest", 2024-09-12T18:35:16.956 INFO:tasks.workunit.client.0.smithi111.stdout: "marker": "marker", 2024-09-12T18:35:16.956 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_id": "bucket-id", 2024-09-12T18:35:16.956 INFO:tasks.workunit.client.0.smithi111.stdout: "tenant": "", 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout: "explicit_placement": { 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout: "data_pool": ".data-pool", 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout: "data_extra_pool": "", 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout: "index_pool": ".index-pool" 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout: "key": { 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout: "name": "_myobj_", 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout: "instance": "inst", 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout: "ns": "ns" 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T18:35:16.957 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T18:35:16.958 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T18:35:16.958 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:35:16.958 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:35:16.958 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T18:35:16.958 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 4 tests. 2024-09-12T18:35:16.958 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:35:16.958 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:35:16.973 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T18:35:16.974 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T18:35:16.974 DEBUG:teuthology.orchestra.run.smithi111:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T18:35:17.078 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:35:17.078 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:35:17.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.146+0000 7f1bf798e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:17.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.146+0000 7f1bf798e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:17.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.146+0000 7f1bf798e9c0 20 realm 2024-09-12T18:35:17.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.146+0000 7f1bf798e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:17.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.146+0000 7f1bf798e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:17.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.146+0000 7f1bf798e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:35:17.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.146+0000 7f1bf798e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:17.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.146+0000 7f1bf798e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:17.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.146+0000 7f1bf798e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:17.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.150+0000 7f1bf798e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:35:17.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.150+0000 7f1bf798e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:17.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.150+0000 7f1bf798e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:35:17.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.150+0000 7f1bf798e9c0 20 searching for the correct realm 2024-09-12T18:35:17.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.158+0000 7f1bf5c95640 0 -- 172.21.15.111:0/3706058727 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f1bec027040 msgr2=0x7f1bec063e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:35:17.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.374+0000 7f1bf4c93640 0 -- 172.21.15.111:0/3706058727 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f1bf00dc910 msgr2=0x7f1bf00c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:35:17.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.590+0000 7f1bf798e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:35:17.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.590+0000 7f1bf798e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:35:17.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.590+0000 7f1bf798e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:35:17.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.590+0000 7f1bf798e9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:35:17.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.590+0000 7f1bf798e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:35:17.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.590+0000 7f1bf798e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:35:17.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.590+0000 7f1bf798e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:17.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.590+0000 7f1bf798e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:17.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.590+0000 7f1bf798e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:17.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:35:17.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:17.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:35:17.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 20 zone default found 2024-09-12T18:35:17.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 4 Realm: () 2024-09-12T18:35:17.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:35:17.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:35:17.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:35:17.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 20 zonegroup default 2024-09-12T18:35:17.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:17.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:17.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:17.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:17.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:17.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:17.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 20 started sync module instance, tier type = 2024-09-12T18:35:17.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.594+0000 7f1bf798e9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:35:17.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.626+0000 7f1bf798e9c0 20 add_watcher() i=0 2024-09-12T18:35:17.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.626+0000 7f1bf798e9c0 20 add_watcher() i=1 2024-09-12T18:35:17.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.626+0000 7f1bf798e9c0 20 add_watcher() i=2 2024-09-12T18:35:17.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.626+0000 7f1bf798e9c0 20 add_watcher() i=3 2024-09-12T18:35:17.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.626+0000 7f1bf798e9c0 20 add_watcher() i=4 2024-09-12T18:35:17.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.626+0000 7f1bf798e9c0 20 add_watcher() i=5 2024-09-12T18:35:17.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.626+0000 7f1bf798e9c0 20 add_watcher() i=6 2024-09-12T18:35:17.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.626+0000 7f1bf798e9c0 20 add_watcher() i=7 2024-09-12T18:35:17.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.626+0000 7f1bf798e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:35:17.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.630+0000 7f1aab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:35:17.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:35:17.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:35:17.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 5 note: GC not initialized 2024-09-12T18:35:17.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1aaa7e4640 20 reqs_thread_entry: start 2024-09-12T18:35:17.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:35:17.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 20 Filter name: none 2024-09-12T18:35:17.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1a1bfff640 20 reqs_thread_entry: start 2024-09-12T18:35:17.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T18:35:17.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:17.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:17.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T18:35:17.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T18:35:17.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T18:35:17.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:17.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:17.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T18:35:17.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T18:35:17.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 10 cache get: name=default.rgw.meta+users.keys+KWN4OiJnEOEFfy63cgwRonAyBXg= : miss 2024-09-12T18:35:17.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:35:17.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:35:17.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 10 cache put: name=default.rgw.meta+users.keys+KWN4OiJnEOEFfy63cgwRonAyBXg= info.flags=0x0 2024-09-12T18:35:17.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 10 adding default.rgw.meta+users.keys+KWN4OiJnEOEFfy63cgwRonAyBXg= to cache LRU end 2024-09-12T18:35:17.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 10 cache get: name=default.rgw.meta+users.keys+KWN4OiJnEOEFfy63cgwRonAyBXg= : hit (negative entry) 2024-09-12T18:35:17.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.634+0000 7f1bf798e9c0 10 cache get: name=default.rgw.meta+users.keys+KWN4OiJnEOEFfy63cgwRonAyBXg= : hit (negative entry) 2024-09-12T18:35:17.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.638+0000 7f1bf798e9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T18:35:17.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.638+0000 7f1bf798e9c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T18:35:17.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.638+0000 7f1bf798e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T18:35:17.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.638+0000 7f1ad8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791297 cookie 93854035089248 notifier 5315 bl.length()=697 2024-09-12T18:35:17.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.638+0000 7f1ad8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T18:35:17.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.638+0000 7f1ad8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T18:35:17.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.642+0000 7f1bf798e9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T18:35:17.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.642+0000 7f1bf798e9c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T18:35:17.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.642+0000 7f1bf798e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T18:35:17.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.642+0000 7f1ac7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791296 cookie 93854035093184 notifier 5315 bl.length()=194 2024-09-12T18:35:17.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.642+0000 7f1ac7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T18:35:17.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.642+0000 7f1ac7fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T18:35:17.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.646+0000 7f1bf798e9c0 10 cache put: name=default.rgw.meta+users.keys+KWN4OiJnEOEFfy63cgwRonAyBXg= info.flags=0x7 2024-09-12T18:35:17.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.646+0000 7f1bf798e9c0 10 moving default.rgw.meta+users.keys+KWN4OiJnEOEFfy63cgwRonAyBXg= to cache LRU end 2024-09-12T18:35:17.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.646+0000 7f1bf798e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:KWN4OiJnEOEFfy63cgwRonAyBXg=, ofs0, ns] 2024-09-12T18:35:17.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.650+0000 7f1ad8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791297 cookie 93854035093184 notifier 5315 bl.length()=203 2024-09-12T18:35:17.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.650+0000 7f1ad8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KWN4OiJnEOEFfy63cgwRonAyBXg= info.flags=0x7 2024-09-12T18:35:17.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.650+0000 7f1ad8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KWN4OiJnEOEFfy63cgwRonAyBXg= to cache LRU end 2024-09-12T18:35:17.651 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:35:17.651 INFO:tasks.workunit.client.0.smithi111.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T18:35:17.651 INFO:tasks.workunit.client.0.smithi111.stdout: "display_name": "librgw test user", 2024-09-12T18:35:17.651 INFO:tasks.workunit.client.0.smithi111.stdout: "email": "librgw@example.com", 2024-09-12T18:35:17.651 INFO:tasks.workunit.client.0.smithi111.stdout: "suspended": 0, 2024-09-12T18:35:17.651 INFO:tasks.workunit.client.0.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:35:17.651 INFO:tasks.workunit.client.0.smithi111.stdout: "subusers": [], 2024-09-12T18:35:17.651 INFO:tasks.workunit.client.0.smithi111.stdout: "keys": [ 2024-09-12T18:35:17.652 INFO:tasks.workunit.client.0.smithi111.stdout: { 2024-09-12T18:35:17.652 INFO:tasks.workunit.client.0.smithi111.stdout: "user": "ceph-test-librgw-file", 2024-09-12T18:35:17.652 INFO:tasks.workunit.client.0.smithi111.stdout: "access_key": "KWN4OiJnEOEFfy63cgwRonAyBXg=", 2024-09-12T18:35:17.652 INFO:tasks.workunit.client.0.smithi111.stdout: "secret_key": "+PgfTaV/Qg0oGTAi52821F4M+oi8QArauCplqNr6LZkJM78jOB0Q+g==", 2024-09-12T18:35:17.652 INFO:tasks.workunit.client.0.smithi111.stdout: "active": true, 2024-09-12T18:35:17.652 INFO:tasks.workunit.client.0.smithi111.stdout: "create_date": "2024-09-12T18:35:17.639960Z" 2024-09-12T18:35:17.652 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:35:17.652 INFO:tasks.workunit.client.0.smithi111.stdout: ], 2024-09-12T18:35:17.652 INFO:tasks.workunit.client.0.smithi111.stdout: "swift_keys": [], 2024-09-12T18:35:17.652 INFO:tasks.workunit.client.0.smithi111.stdout: "caps": [], 2024-09-12T18:35:17.652 INFO:tasks.workunit.client.0.smithi111.stdout: "op_mask": "read, write, delete", 2024-09-12T18:35:17.652 INFO:tasks.workunit.client.0.smithi111.stdout: "default_placement": "", 2024-09-12T18:35:17.652 INFO:tasks.workunit.client.0.smithi111.stdout: "default_storage_class": "", 2024-09-12T18:35:17.652 INFO:tasks.workunit.client.0.smithi111.stdout: "placement_tags": [], 2024-09-12T18:35:17.653 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_quota": { 2024-09-12T18:35:17.653 INFO:tasks.workunit.client.0.smithi111.stdout: "enabled": false, 2024-09-12T18:35:17.653 INFO:tasks.workunit.client.0.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:35:17.653 INFO:tasks.workunit.client.0.smithi111.stdout: "max_size": -1, 2024-09-12T18:35:17.653 INFO:tasks.workunit.client.0.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:35:17.653 INFO:tasks.workunit.client.0.smithi111.stdout: "max_objects": -1 2024-09-12T18:35:17.653 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:17.653 INFO:tasks.workunit.client.0.smithi111.stdout: "user_quota": { 2024-09-12T18:35:17.653 INFO:tasks.workunit.client.0.smithi111.stdout: "enabled": false, 2024-09-12T18:35:17.653 INFO:tasks.workunit.client.0.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:35:17.653 INFO:tasks.workunit.client.0.smithi111.stdout: "max_size": -1, 2024-09-12T18:35:17.653 INFO:tasks.workunit.client.0.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:35:17.653 INFO:tasks.workunit.client.0.smithi111.stdout: "max_objects": -1 2024-09-12T18:35:17.653 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:35:17.654 INFO:tasks.workunit.client.0.smithi111.stdout: "temp_url_keys": [], 2024-09-12T18:35:17.654 INFO:tasks.workunit.client.0.smithi111.stdout: "type": "rgw", 2024-09-12T18:35:17.654 INFO:tasks.workunit.client.0.smithi111.stdout: "mfa_ids": [], 2024-09-12T18:35:17.654 INFO:tasks.workunit.client.0.smithi111.stdout: "account_id": "", 2024-09-12T18:35:17.654 INFO:tasks.workunit.client.0.smithi111.stdout: "path": "/", 2024-09-12T18:35:17.654 INFO:tasks.workunit.client.0.smithi111.stdout: "create_date": "2024-09-12T18:35:17.639934Z", 2024-09-12T18:35:17.654 INFO:tasks.workunit.client.0.smithi111.stdout: "tags": [], 2024-09-12T18:35:17.654 INFO:tasks.workunit.client.0.smithi111.stdout: "group_ids": [] 2024-09-12T18:35:17.654 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:35:17.654 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:35:17.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.650+0000 7f1aab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:35:17.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.654+0000 7f1bf798e9c0 20 remove_watcher() i=0 2024-09-12T18:35:17.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.654+0000 7f1bf798e9c0 2 removed watcher, disabling cache 2024-09-12T18:35:17.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.658+0000 7f1bf798e9c0 20 remove_watcher() i=1 2024-09-12T18:35:17.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.662+0000 7f1bf798e9c0 20 remove_watcher() i=2 2024-09-12T18:35:17.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.662+0000 7f1bf798e9c0 20 remove_watcher() i=3 2024-09-12T18:35:17.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.666+0000 7f1bf798e9c0 20 remove_watcher() i=4 2024-09-12T18:35:17.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.666+0000 7f1bf798e9c0 20 remove_watcher() i=5 2024-09-12T18:35:17.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.666+0000 7f1bf798e9c0 20 remove_watcher() i=6 2024-09-12T18:35:17.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:17.670+0000 7f1bf798e9c0 20 remove_watcher() i=7 2024-09-12T18:35:17.684 INFO:tasks.workunit.client.0.smithi111.stdout:phase 1.1 2024-09-12T18:35:17.703 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T18:35:17.703 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:35:17.703 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 24 tests from LibRGW 2024-09-12T18:35:17.704 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.INIT 2024-09-12T18:35:17.715 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:35:17.715 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:35:18.416 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.INIT (713 ms) 2024-09-12T18:35:18.416 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T18:35:18.418 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T18:35:18.418 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T18:35:18.418 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T18:35:18.418 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T18:35:18.436 INFO:tasks.workunit.client.0.smithi111.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T18:35:18.443 INFO:tasks.workunit.client.0.smithi111.stdout:creating: nfsroot:foo/f1 2024-09-12T18:35:18.449 INFO:tasks.workunit.client.0.smithi111.stdout:creating: nfsroot:foo/f2 2024-09-12T18:35:18.454 INFO:tasks.workunit.client.0.smithi111.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T18:35:18.459 INFO:tasks.workunit.client.0.smithi111.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T18:35:18.464 INFO:tasks.workunit.client.0.smithi111.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T18:35:18.470 INFO:tasks.workunit.client.0.smithi111.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T18:35:18.474 INFO:tasks.workunit.client.0.smithi111.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T18:35:18.481 INFO:tasks.workunit.client.0.smithi111.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T18:35:18.487 INFO:tasks.workunit.client.0.smithi111.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T18:35:18.493 INFO:tasks.workunit.client.0.smithi111.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T18:35:18.499 INFO:tasks.workunit.client.0.smithi111.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T18:35:18.504 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SETUP_HIER1 (87 ms) 2024-09-12T18:35:18.505 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T18:35:18.775 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SETUP_DIRS1 (271 ms) 2024-09-12T18:35:18.775 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T18:35:18.775 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T18:35:18.776 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T18:35:18.822 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (46 ms) 2024-09-12T18:35:18.822 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T18:35:18.924 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (103 ms) 2024-09-12T18:35:18.925 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T18:35:18.925 INFO:tasks.workunit.client.0.smithi111.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T18:35:18.940 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (15 ms) 2024-09-12T18:35:18.940 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T18:35:18.940 INFO:tasks.workunit.client.0.smithi111.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T18:35:18.957 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (17 ms) 2024-09-12T18:35:18.957 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T18:35:18.957 INFO:tasks.workunit.client.0.smithi111.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T18:35:18.957 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T18:35:18.957 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T18:35:18.957 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T18:35:18.957 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T18:35:18.957 INFO:tasks.workunit.client.0.smithi111.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T18:35:18.957 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T18:35:18.958 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T18:35:18.958 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T18:35:18.958 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T18:35:18.958 INFO:tasks.workunit.client.0.smithi111.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T18:35:18.958 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T18:35:18.958 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T18:35:18.958 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T18:35:18.958 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T18:35:18.958 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T18:35:18.958 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T18:35:18.958 INFO:tasks.workunit.client.0.smithi111.stdout:read back objects in /bdirs1/dir_0 2024-09-12T18:35:18.958 INFO:tasks.workunit.client.0.smithi111.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T18:35:18.960 INFO:tasks.workunit.client.0.smithi111.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T18:35:18.960 INFO:tasks.workunit.client.0.smithi111.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T18:35:18.963 INFO:tasks.workunit.client.0.smithi111.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T18:35:18.963 INFO:tasks.workunit.client.0.smithi111.stdout:read back objects in /bdirs1/dir_1 2024-09-12T18:35:18.963 INFO:tasks.workunit.client.0.smithi111.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T18:35:18.965 INFO:tasks.workunit.client.0.smithi111.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T18:35:18.965 INFO:tasks.workunit.client.0.smithi111.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T18:35:18.968 INFO:tasks.workunit.client.0.smithi111.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T18:35:18.968 INFO:tasks.workunit.client.0.smithi111.stdout:read back objects in /bdirs1/dir_2 2024-09-12T18:35:18.968 INFO:tasks.workunit.client.0.smithi111.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T18:35:18.971 INFO:tasks.workunit.client.0.smithi111.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T18:35:18.971 INFO:tasks.workunit.client.0.smithi111.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T18:35:18.973 INFO:tasks.workunit.client.0.smithi111.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T18:35:18.974 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.READ_DIRS1 (17 ms) 2024-09-12T18:35:18.974 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T18:35:19.194 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.READF_SETUP1 (221 ms) 2024-09-12T18:35:19.195 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T18:35:19.195 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T18:35:19.195 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T18:35:19.195 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T18:35:19.195 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T18:35:19.196 INFO:tasks.workunit.client.0.smithi111.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T18:35:19.196 INFO:tasks.workunit.client.0.smithi111.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T18:35:19.196 INFO:tasks.workunit.client.0.smithi111.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T18:35:19.196 INFO:tasks.workunit.client.0.smithi111.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T18:35:19.196 INFO:tasks.workunit.client.0.smithi111.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T18:35:19.196 INFO:tasks.workunit.client.0.smithi111.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T18:35:19.197 INFO:tasks.workunit.client.0.smithi111.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T18:35:19.197 INFO:tasks.workunit.client.0.smithi111.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T18:35:19.197 INFO:tasks.workunit.client.0.smithi111.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T18:35:19.197 INFO:tasks.workunit.client.0.smithi111.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T18:35:19.197 INFO:tasks.workunit.client.0.smithi111.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T18:35:19.197 INFO:tasks.workunit.client.0.smithi111.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T18:35:19.198 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T18:35:19.198 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T18:35:19.209 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T18:35:19.210 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T18:35:19.216 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T18:35:19.219 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T18:35:19.225 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T18:35:19.226 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T18:35:19.228 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T18:35:19.229 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T18:35:19.230 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T18:35:19.230 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T18:35:19.231 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T18:35:19.235 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T18:35:19.235 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T18:35:19.235 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T18:35:19.235 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo (foo): DIR 2024-09-12T18:35:19.235 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot (nfsroot): DIR 2024-09-12T18:35:19.236 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.HIER1 (40 ms) 2024-09-12T18:35:19.236 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T18:35:19.236 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T18:35:19.236 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T18:35:19.236 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T18:35:19.236 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T18:35:19.236 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T18:35:19.236 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T18:35:19.236 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T18:35:19.236 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T18:35:19.237 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T18:35:19.237 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T18:35:19.237 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T18:35:19.237 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T18:35:19.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:19.234+0000 7f55bb4cca80 -1 shutting down 2024-09-12T18:35:19.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:19.238+0000 7f549521e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57572, si_uid : 1000, si_addr0x3e80000e0e4, si_status0 2024-09-12T18:35:48.627 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SHUTDOWN (29391 ms) 2024-09-12T18:35:48.627 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 24 tests from LibRGW (30923 ms total) 2024-09-12T18:35:48.627 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:35:48.627 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:35:48.627 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 24 tests from 1 test suite ran. (30923 ms total) 2024-09-12T18:35:48.627 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 24 tests. 2024-09-12T18:35:48.641 INFO:tasks.workunit.client.0.smithi111.stdout:phase 1.2 2024-09-12T18:35:48.663 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T18:35:48.663 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:35:48.664 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 24 tests from LibRGW 2024-09-12T18:35:48.664 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.INIT 2024-09-12T18:35:48.673 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:35:48.673 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:35:49.460 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.INIT (796 ms) 2024-09-12T18:35:49.460 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T18:35:49.462 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T18:35:49.462 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T18:35:49.462 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T18:35:49.462 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T18:35:49.462 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T18:35:49.462 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T18:35:49.462 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T18:35:49.462 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T18:35:49.462 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T18:35:49.462 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T18:35:49.463 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T18:35:49.463 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T18:35:49.463 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T18:35:49.463 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T18:35:49.463 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T18:35:49.463 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T18:35:49.463 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T18:35:49.463 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T18:35:49.463 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T18:35:49.463 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T18:35:49.463 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T18:35:49.463 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T18:35:49.463 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T18:35:49.464 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T18:35:49.464 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T18:35:49.464 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T18:35:49.464 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T18:35:49.464 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T18:35:49.464 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T18:35:49.464 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T18:35:49.464 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T18:35:49.464 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T18:35:49.464 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T18:35:49.464 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T18:35:49.464 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T18:35:49.464 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T18:35:49.464 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T18:35:49.465 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T18:35:49.465 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T18:35:49.465 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T18:35:49.465 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T18:35:49.465 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T18:35:49.465 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T18:35:49.465 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T18:35:49.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:49.461+0000 7fd310f18a80 -1 shutting down 2024-09-12T18:35:49.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:35:49.461+0000 7fd1eac6a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58219, si_uid : 1000, si_addr0x3e80000e36b, si_status0 2024-09-12T18:36:19.524 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SHUTDOWN (30062 ms) 2024-09-12T18:36:19.524 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 24 tests from LibRGW (30859 ms total) 2024-09-12T18:36:19.524 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:36:19.524 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:36:19.524 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 24 tests from 1 test suite ran. (30860 ms total) 2024-09-12T18:36:19.524 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 24 tests. 2024-09-12T18:36:19.538 INFO:tasks.workunit.client.0.smithi111.stdout:phase 1.3 2024-09-12T18:36:19.561 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T18:36:19.562 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:36:19.562 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 24 tests from LibRGW 2024-09-12T18:36:19.562 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.INIT 2024-09-12T18:36:19.574 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:36:19.574 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:36:20.116 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.INIT (554 ms) 2024-09-12T18:36:20.116 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T18:36:20.118 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T18:36:20.118 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T18:36:20.118 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T18:36:20.118 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T18:36:20.127 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SETUP_HIER1 (9 ms) 2024-09-12T18:36:20.127 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T18:36:20.220 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SETUP_DIRS1 (93 ms) 2024-09-12T18:36:20.221 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T18:36:20.221 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T18:36:20.221 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T18:36:20.221 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T18:36:20.221 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T18:36:20.221 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T18:36:20.221 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T18:36:20.221 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T18:36:20.221 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T18:36:20.221 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T18:36:20.221 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T18:36:20.221 INFO:tasks.workunit.client.0.smithi111.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T18:36:20.222 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T18:36:20.222 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T18:36:20.222 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T18:36:20.222 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T18:36:20.222 INFO:tasks.workunit.client.0.smithi111.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T18:36:20.222 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T18:36:20.222 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T18:36:20.222 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T18:36:20.222 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T18:36:20.222 INFO:tasks.workunit.client.0.smithi111.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T18:36:20.222 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T18:36:20.222 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T18:36:20.222 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T18:36:20.223 INFO:tasks.workunit.client.0.smithi111.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T18:36:20.223 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T18:36:20.223 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T18:36:20.223 INFO:tasks.workunit.client.0.smithi111.stdout:read back objects in /bdirs1/dir_0 2024-09-12T18:36:20.223 INFO:tasks.workunit.client.0.smithi111.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T18:36:20.224 INFO:tasks.workunit.client.0.smithi111.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T18:36:20.224 INFO:tasks.workunit.client.0.smithi111.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T18:36:20.226 INFO:tasks.workunit.client.0.smithi111.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T18:36:20.226 INFO:tasks.workunit.client.0.smithi111.stdout:read back objects in /bdirs1/dir_1 2024-09-12T18:36:20.226 INFO:tasks.workunit.client.0.smithi111.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T18:36:20.228 INFO:tasks.workunit.client.0.smithi111.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T18:36:20.229 INFO:tasks.workunit.client.0.smithi111.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T18:36:20.232 INFO:tasks.workunit.client.0.smithi111.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T18:36:20.232 INFO:tasks.workunit.client.0.smithi111.stdout:read back objects in /bdirs1/dir_2 2024-09-12T18:36:20.232 INFO:tasks.workunit.client.0.smithi111.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T18:36:20.234 INFO:tasks.workunit.client.0.smithi111.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T18:36:20.234 INFO:tasks.workunit.client.0.smithi111.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T18:36:20.237 INFO:tasks.workunit.client.0.smithi111.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T18:36:20.237 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.READ_DIRS1 (17 ms) 2024-09-12T18:36:20.237 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T18:36:20.237 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T18:36:20.237 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T18:36:20.237 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T18:36:20.237 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T18:36:20.237 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T18:36:20.237 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T18:36:20.237 INFO:tasks.workunit.client.0.smithi111.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T18:36:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T18:36:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T18:36:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T18:36:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T18:36:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T18:36:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T18:36:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T18:36:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T18:36:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T18:36:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T18:36:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T18:36:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T18:36:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T18:36:20.252 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T18:36:20.254 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T18:36:20.262 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T18:36:20.265 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T18:36:20.272 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T18:36:20.273 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T18:36:20.274 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T18:36:20.275 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T18:36:20.276 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T18:36:20.276 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T18:36:20.278 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T18:36:20.285 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T18:36:20.285 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T18:36:20.285 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T18:36:20.285 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot/foo (foo): DIR 2024-09-12T18:36:20.285 INFO:tasks.workunit.client.0.smithi111.stdout:/nfsroot (nfsroot): DIR 2024-09-12T18:36:20.285 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.HIER1 (45 ms) 2024-09-12T18:36:20.285 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T18:36:20.285 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T18:36:20.285 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T18:36:20.285 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T18:36:20.285 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T18:36:20.286 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T18:36:20.286 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T18:36:20.286 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T18:36:20.286 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T18:36:20.286 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T18:36:20.286 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T18:36:20.286 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T18:36:20.286 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T18:36:20.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:36:20.284+0000 7f2cc897ba80 -1 shutting down 2024-09-12T18:36:20.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:36:20.288+0000 7f2ba26cd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58864, si_uid : 1000, si_addr0x3e80000e5f0, si_status0 2024-09-12T18:36:50.219 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SHUTDOWN (29936 ms) 2024-09-12T18:36:50.219 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 24 tests from LibRGW (30656 ms total) 2024-09-12T18:36:50.220 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:36:50.220 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:36:50.220 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 24 tests from 1 test suite ran. (30656 ms total) 2024-09-12T18:36:50.220 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 24 tests. 2024-09-12T18:36:50.233 INFO:tasks.workunit.client.0.smithi111.stdout:phase 2.1 2024-09-12T18:36:50.255 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T18:36:50.255 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:36:50.255 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 9 tests from LibRGW 2024-09-12T18:36:50.255 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.INIT 2024-09-12T18:36:50.266 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:36:50.266 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:36:50.805 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.INIT (550 ms) 2024-09-12T18:36:50.805 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T18:36:50.806 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T18:36:50.806 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T18:36:50.819 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CREATE_BUCKET (14 ms) 2024-09-12T18:36:50.820 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T18:36:50.820 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T18:36:50.820 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T18:36:50.836 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave0 2024-09-12T18:36:50.853 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave1 2024-09-12T18:36:50.866 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave2 2024-09-12T18:36:50.880 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave3 2024-09-12T18:36:50.896 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave4 2024-09-12T18:36:50.909 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave5 2024-09-12T18:36:50.926 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave6 2024-09-12T18:36:50.942 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave7 2024-09-12T18:36:50.957 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave8 2024-09-12T18:36:50.975 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave9 2024-09-12T18:36:50.975 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (155 ms) 2024-09-12T18:36:50.975 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T18:36:51.610 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (635 ms) 2024-09-12T18:36:51.610 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T18:36:51.610 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T18:36:51.610 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T18:36:51.610 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T18:36:51.610 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T18:36:51.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:36:51.612+0000 7f9f28b9ea80 -1 shutting down 2024-09-12T18:36:51.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:36:51.612+0000 7f9e028f0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59509, si_uid : 1000, si_addr0x3e80000e875, si_status0 2024-09-12T18:37:21.144 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SHUTDOWN (29534 ms) 2024-09-12T18:37:21.144 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 9 tests from LibRGW (30889 ms total) 2024-09-12T18:37:21.145 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:37:21.145 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:37:21.145 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 9 tests from 1 test suite ran. (30889 ms total) 2024-09-12T18:37:21.145 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 9 tests. 2024-09-12T18:37:21.157 INFO:tasks.workunit.client.0.smithi111.stdout:phase 2.2 2024-09-12T18:37:21.179 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T18:37:21.179 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:37:21.179 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 9 tests from LibRGW 2024-09-12T18:37:21.179 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.INIT 2024-09-12T18:37:21.190 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:37:21.190 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:37:21.769 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.INIT (590 ms) 2024-09-12T18:37:21.769 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T18:37:21.770 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T18:37:21.770 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T18:37:21.770 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T18:37:21.770 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T18:37:21.815 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.DELETE_BUCKET (45 ms) 2024-09-12T18:37:21.816 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T18:37:21.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave0 2024-09-12T18:37:21.848 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave1 2024-09-12T18:37:21.863 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave2 2024-09-12T18:37:21.878 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave3 2024-09-12T18:37:21.895 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave4 2024-09-12T18:37:21.909 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave5 2024-09-12T18:37:21.925 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave6 2024-09-12T18:37:21.943 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave7 2024-09-12T18:37:21.958 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave8 2024-09-12T18:37:21.975 INFO:tasks.workunit.client.0.smithi111.stdout:created: sorrydave9 2024-09-12T18:37:21.975 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (161 ms) 2024-09-12T18:37:21.976 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T18:37:22.621 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (645 ms) 2024-09-12T18:37:22.621 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T18:37:22.621 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T18:37:22.621 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T18:37:22.621 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T18:37:22.621 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T18:37:22.621 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:37:22.619+0000 7f8745682a80 -1 shutting down 2024-09-12T18:37:22.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:37:22.623+0000 7f861f3d4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60155, si_uid : 1000, si_addr0x3e80000eafb, si_status0 2024-09-12T18:37:51.782 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SHUTDOWN (29161 ms) 2024-09-12T18:37:51.782 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 9 tests from LibRGW (30603 ms total) 2024-09-12T18:37:51.783 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:37:51.783 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:37:51.783 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 9 tests from 1 test suite ran. (30603 ms total) 2024-09-12T18:37:51.783 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 9 tests. 2024-09-12T18:37:51.795 INFO:tasks.workunit.client.0.smithi111.stdout:phase 3.1 2024-09-12T18:37:52.142 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T18:37:52.142 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:37:52.142 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 13 tests from LibRGW 2024-09-12T18:37:52.142 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.INIT 2024-09-12T18:37:52.152 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:37:52.152 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:37:52.456 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.INIT (314 ms) 2024-09-12T18:37:52.456 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T18:37:52.457 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T18:37:52.457 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T18:37:52.472 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CREATE_BUCKET (15 ms) 2024-09-12T18:37:52.472 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T18:37:52.476 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T18:37:52.476 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T18:37:52.480 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T18:37:52.480 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T18:37:52.992 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LARGE1 (512 ms) 2024-09-12T18:37:52.992 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T18:37:53.070 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LARGE2 (78 ms) 2024-09-12T18:37:53.071 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T18:37:53.071 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T18:37:53.071 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T18:37:53.071 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T18:37:53.071 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T18:37:53.071 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T18:37:53.071 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T18:37:53.071 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T18:37:53.071 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T18:37:53.071 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T18:37:53.071 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T18:37:53.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:37:53.071+0000 7f10e8780a80 -1 shutting down 2024-09-12T18:37:53.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:37:53.075+0000 7f0fc24d2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60800, si_uid : 1000, si_addr0x3e80000ed80, si_status0 2024-09-12T18:38:22.697 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SHUTDOWN (29626 ms) 2024-09-12T18:38:22.697 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 13 tests from LibRGW (30555 ms total) 2024-09-12T18:38:22.698 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:38:22.698 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:38:22.698 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 13 tests from 1 test suite ran. (30555 ms total) 2024-09-12T18:38:22.698 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 13 tests. 2024-09-12T18:38:22.715 INFO:tasks.workunit.client.0.smithi111.stdout:phase 3.2 2024-09-12T18:38:23.048 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T18:38:23.048 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:38:23.048 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 13 tests from LibRGW 2024-09-12T18:38:23.048 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.INIT 2024-09-12T18:38:23.058 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:38:23.058 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:38:23.641 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.INIT (592 ms) 2024-09-12T18:38:23.641 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T18:38:23.642 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T18:38:23.642 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T18:38:23.642 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T18:38:23.642 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T18:38:23.650 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-09-12T18:38:23.650 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T18:38:23.655 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (5 ms) 2024-09-12T18:38:23.655 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T18:38:23.721 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LARGE1 (66 ms) 2024-09-12T18:38:23.721 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T18:38:23.721 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T18:38:23.721 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T18:38:23.721 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T18:38:23.721 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T18:38:23.728 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.DELETE_OBJECT (7 ms) 2024-09-12T18:38:23.728 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T18:38:23.780 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.DELETE_BUCKET (53 ms) 2024-09-12T18:38:23.781 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T18:38:23.781 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T18:38:23.781 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T18:38:23.781 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T18:38:23.781 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T18:38:23.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:38:23.778+0000 7fc50f4afa80 -1 shutting down 2024-09-12T18:38:23.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:38:23.782+0000 7fc3e9201640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61445, si_uid : 1000, si_addr0x3e80000f005, si_status0 2024-09-12T18:38:53.843 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SHUTDOWN (30062 ms) 2024-09-12T18:38:53.843 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 13 tests from LibRGW (30795 ms total) 2024-09-12T18:38:53.843 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:38:53.844 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:38:53.844 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 13 tests from 1 test suite ran. (30795 ms total) 2024-09-12T18:38:53.844 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 13 tests. 2024-09-12T18:38:53.860 INFO:tasks.workunit.client.0.smithi111.stdout:phase 4.1 2024-09-12T18:38:53.883 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T18:38:53.883 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:38:53.884 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 11 tests from LibRGW 2024-09-12T18:38:53.884 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T18:38:53.884 INFO:tasks.workunit.client.0.smithi111.stdout:read i1: 64001 2024-09-12T18:38:53.884 INFO:tasks.workunit.client.0.smithi111.stdout:read s1: blunderbuss 2024-09-12T18:38:53.884 INFO:tasks.workunit.client.0.smithi111.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T18:38:53.884 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.INIT 2024-09-12T18:38:53.898 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:38:53.898 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:38:54.438 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.INIT (555 ms) 2024-09-12T18:38:54.439 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T18:38:54.440 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T18:38:54.440 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T18:38:54.469 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (29 ms) 2024-09-12T18:38:54.469 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T18:38:55.826 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_0 2024-09-12T18:38:55.826 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_1 2024-09-12T18:38:55.826 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_2 2024-09-12T18:38:55.827 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_3 2024-09-12T18:38:55.827 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_4 2024-09-12T18:38:55.827 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_5 2024-09-12T18:38:55.827 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_6 2024-09-12T18:38:55.827 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_7 2024-09-12T18:38:55.827 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_8 2024-09-12T18:38:55.827 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_9 2024-09-12T18:38:55.827 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_10 2024-09-12T18:38:55.827 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_11 2024-09-12T18:38:55.827 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_12 2024-09-12T18:38:55.827 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_13 2024-09-12T18:38:55.828 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_14 2024-09-12T18:38:55.828 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_15 2024-09-12T18:38:55.828 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_16 2024-09-12T18:38:55.828 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_17 2024-09-12T18:38:55.828 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_18 2024-09-12T18:38:55.828 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_19 2024-09-12T18:38:55.828 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_20 2024-09-12T18:38:55.828 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_21 2024-09-12T18:38:55.828 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_22 2024-09-12T18:38:55.828 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_23 2024-09-12T18:38:55.828 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_24 2024-09-12T18:38:55.828 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_25 2024-09-12T18:38:55.828 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_26 2024-09-12T18:38:55.829 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_27 2024-09-12T18:38:55.829 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_28 2024-09-12T18:38:55.829 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_29 2024-09-12T18:38:55.829 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_30 2024-09-12T18:38:55.829 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_31 2024-09-12T18:38:55.829 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_32 2024-09-12T18:38:55.829 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_33 2024-09-12T18:38:55.829 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_34 2024-09-12T18:38:55.829 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_35 2024-09-12T18:38:55.829 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_36 2024-09-12T18:38:55.829 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_37 2024-09-12T18:38:55.829 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_38 2024-09-12T18:38:55.829 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_39 2024-09-12T18:38:55.830 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_40 2024-09-12T18:38:55.830 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_41 2024-09-12T18:38:55.830 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_42 2024-09-12T18:38:55.830 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_43 2024-09-12T18:38:55.830 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_44 2024-09-12T18:38:55.830 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_45 2024-09-12T18:38:55.830 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_46 2024-09-12T18:38:55.830 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_47 2024-09-12T18:38:55.830 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_48 2024-09-12T18:38:55.830 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_49 2024-09-12T18:38:55.830 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_50 2024-09-12T18:38:55.830 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_51 2024-09-12T18:38:55.830 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_52 2024-09-12T18:38:55.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_53 2024-09-12T18:38:55.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_54 2024-09-12T18:38:55.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_55 2024-09-12T18:38:55.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_56 2024-09-12T18:38:55.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_57 2024-09-12T18:38:55.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_58 2024-09-12T18:38:55.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_59 2024-09-12T18:38:55.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_60 2024-09-12T18:38:55.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_61 2024-09-12T18:38:55.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_62 2024-09-12T18:38:55.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_63 2024-09-12T18:38:55.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_64 2024-09-12T18:38:55.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_65 2024-09-12T18:38:55.831 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_66 2024-09-12T18:38:55.832 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_67 2024-09-12T18:38:55.832 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_68 2024-09-12T18:38:55.832 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_69 2024-09-12T18:38:55.832 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_70 2024-09-12T18:38:55.832 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_71 2024-09-12T18:38:55.832 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_72 2024-09-12T18:38:55.832 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_73 2024-09-12T18:38:55.832 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_74 2024-09-12T18:38:55.832 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_75 2024-09-12T18:38:55.832 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_76 2024-09-12T18:38:55.832 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_77 2024-09-12T18:38:55.832 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_78 2024-09-12T18:38:55.832 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_79 2024-09-12T18:38:55.833 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_80 2024-09-12T18:38:55.833 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_81 2024-09-12T18:38:55.833 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_82 2024-09-12T18:38:55.833 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_83 2024-09-12T18:38:55.833 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_84 2024-09-12T18:38:55.833 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_85 2024-09-12T18:38:55.833 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_86 2024-09-12T18:38:55.833 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_87 2024-09-12T18:38:55.833 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_88 2024-09-12T18:38:55.833 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_89 2024-09-12T18:38:55.833 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_90 2024-09-12T18:38:55.833 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_91 2024-09-12T18:38:55.833 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_92 2024-09-12T18:38:55.834 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_93 2024-09-12T18:38:55.834 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_94 2024-09-12T18:38:55.834 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_95 2024-09-12T18:38:55.834 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_96 2024-09-12T18:38:55.834 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_97 2024-09-12T18:38:55.834 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_98 2024-09-12T18:38:55.834 INFO:tasks.workunit.client.0.smithi111.stdout:created: dmarker:f_99 2024-09-12T18:38:55.834 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1357 ms) 2024-09-12T18:38:55.834 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T18:38:55.835 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T18:38:55.835 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T18:38:55.835 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T18:38:55.835 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T18:38:55.835 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T18:38:55.835 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T18:38:55.836 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T18:38:55.836 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T18:38:55.836 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T18:38:55.836 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T18:38:55.836 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T18:38:55.836 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T18:38:55.836 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T18:38:55.836 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T18:38:55.836 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T18:38:55.836 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T18:38:55.837 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T18:38:55.837 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T18:38:55.837 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T18:38:55.837 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T18:38:55.837 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T18:38:55.837 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T18:38:55.837 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T18:38:55.837 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T18:38:55.837 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T18:38:55.837 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T18:38:55.837 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T18:38:55.837 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T18:38:55.838 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T18:38:55.838 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T18:38:55.838 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T18:38:55.838 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T18:38:55.838 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T18:38:55.838 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T18:38:55.838 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T18:38:55.838 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T18:38:55.838 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T18:38:55.838 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T18:38:55.838 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T18:38:55.839 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T18:38:55.839 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T18:38:55.839 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T18:38:55.839 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T18:38:55.839 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T18:38:55.839 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T18:38:55.839 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T18:38:55.839 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T18:38:55.839 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T18:38:55.839 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T18:38:55.839 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T18:38:55.839 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T18:38:55.839 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T18:38:55.839 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T18:38:55.840 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T18:38:55.840 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T18:38:55.840 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T18:38:55.840 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T18:38:55.840 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T18:38:55.840 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T18:38:55.840 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T18:38:55.840 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T18:38:55.840 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T18:38:55.840 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T18:38:55.840 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T18:38:55.840 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T18:38:55.840 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T18:38:55.841 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T18:38:55.841 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T18:38:55.841 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T18:38:55.841 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T18:38:55.841 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T18:38:55.841 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T18:38:55.841 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T18:38:55.841 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T18:38:55.841 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T18:38:55.841 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T18:38:55.841 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T18:38:55.841 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T18:38:55.841 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T18:38:55.841 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T18:38:55.842 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T18:38:55.842 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T18:38:55.842 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T18:38:55.842 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T18:38:55.842 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T18:38:55.842 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T18:38:55.842 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T18:38:55.842 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T18:38:55.842 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T18:38:55.842 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T18:38:55.842 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T18:38:55.842 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T18:38:55.843 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T18:38:55.843 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T18:38:55.843 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T18:38:55.843 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T18:38:55.843 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T18:38:55.843 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T18:38:55.843 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T18:38:55.843 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T18:38:55.843 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T18:38:55.843 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T18:38:55.843 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_READDIR (7 ms) 2024-09-12T18:38:55.843 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T18:38:55.844 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T18:38:55.844 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T18:38:55.844 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T18:38:55.844 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T18:38:55.845 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T18:38:55.845 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T18:38:55.845 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T18:38:55.845 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T18:38:55.845 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T18:38:55.845 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T18:38:55.845 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T18:38:55.845 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T18:38:55.845 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T18:38:55.845 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T18:38:55.845 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T18:38:55.845 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T18:38:55.845 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T18:38:55.846 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T18:38:55.846 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T18:38:55.846 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T18:38:55.846 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T18:38:55.846 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T18:38:55.846 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T18:38:55.846 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T18:38:55.846 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T18:38:55.846 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T18:38:55.846 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T18:38:55.846 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T18:38:55.846 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T18:38:55.846 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T18:38:55.846 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T18:38:55.847 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T18:38:55.847 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T18:38:55.847 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T18:38:55.847 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T18:38:55.847 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T18:38:55.847 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T18:38:55.847 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T18:38:55.847 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T18:38:55.847 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T18:38:55.847 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T18:38:55.847 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T18:38:55.847 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T18:38:55.847 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T18:38:55.848 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T18:38:55.848 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T18:38:55.848 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T18:38:55.848 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T18:38:55.848 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T18:38:55.848 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T18:38:55.848 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T18:38:55.848 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T18:38:55.848 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T18:38:55.848 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T18:38:55.848 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T18:38:55.848 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T18:38:55.849 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T18:38:55.849 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T18:38:55.849 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T18:38:55.849 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T18:38:55.849 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T18:38:55.849 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T18:38:55.849 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T18:38:55.849 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T18:38:55.849 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T18:38:55.849 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T18:38:55.849 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T18:38:55.849 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T18:38:55.849 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T18:38:55.849 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T18:38:55.850 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T18:38:55.850 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T18:38:55.850 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T18:38:55.850 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T18:38:55.850 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T18:38:55.850 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T18:38:55.850 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T18:38:55.850 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T18:38:55.850 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T18:38:55.850 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T18:38:55.850 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T18:38:55.850 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T18:38:55.850 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T18:38:55.850 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T18:38:55.851 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T18:38:55.851 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T18:38:55.851 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T18:38:55.851 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T18:38:55.851 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T18:38:55.851 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T18:38:55.851 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T18:38:55.851 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T18:38:55.851 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T18:38:55.851 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T18:38:55.851 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T18:38:55.851 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T18:38:55.851 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T18:38:55.852 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T18:38:55.852 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T18:38:55.852 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T18:38:55.852 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-12T18:38:55.852 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T18:38:55.852 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T18:38:55.852 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T18:38:55.852 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T18:38:55.852 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T18:38:55.852 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T18:38:55.852 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T18:38:55.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:38:55.833+0000 7f91629d5a80 -1 shutting down 2024-09-12T18:38:55.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:38:55.841+0000 7f903c727640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62090, si_uid : 1000, si_addr0x3e80000f28a, si_status0 2024-09-12T18:39:24.748 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SHUTDOWN (28910 ms) 2024-09-12T18:39:24.749 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 11 tests from LibRGW (30864 ms total) 2024-09-12T18:39:24.749 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:39:24.749 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:39:24.749 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 11 tests from 1 test suite ran. (30864 ms total) 2024-09-12T18:39:24.749 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 11 tests. 2024-09-12T18:39:24.762 INFO:tasks.workunit.client.0.smithi111.stdout:phase 4.2 2024-09-12T18:39:24.786 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T18:39:24.786 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:39:24.786 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 11 tests from LibRGW 2024-09-12T18:39:24.786 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T18:39:24.786 INFO:tasks.workunit.client.0.smithi111.stdout:read i1: 64001 2024-09-12T18:39:24.786 INFO:tasks.workunit.client.0.smithi111.stdout:read s1: blunderbuss 2024-09-12T18:39:24.786 INFO:tasks.workunit.client.0.smithi111.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T18:39:24.786 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.INIT 2024-09-12T18:39:24.796 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:39:24.796 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:39:25.547 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.INIT (762 ms) 2024-09-12T18:39:25.547 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T18:39:25.549 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T18:39:25.549 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T18:39:25.562 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (13 ms) 2024-09-12T18:39:25.562 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T18:39:25.562 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T18:39:25.562 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T18:39:25.562 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T18:39:25.562 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T18:39:25.565 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T18:39:25.565 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T18:39:25.565 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T18:39:25.565 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T18:39:25.565 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T18:39:25.565 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T18:39:25.565 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T18:39:25.566 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T18:39:25.566 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T18:39:25.566 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T18:39:25.566 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T18:39:25.566 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T18:39:25.566 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T18:39:25.566 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T18:39:25.566 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T18:39:25.566 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T18:39:25.566 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T18:39:25.566 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T18:39:25.566 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T18:39:25.567 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T18:39:25.567 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T18:39:25.567 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T18:39:25.567 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T18:39:25.567 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T18:39:25.567 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T18:39:25.568 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T18:39:25.568 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T18:39:25.568 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T18:39:25.568 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T18:39:25.568 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T18:39:25.568 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T18:39:25.568 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T18:39:25.568 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T18:39:25.568 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T18:39:25.569 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T18:39:25.569 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T18:39:25.569 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T18:39:25.569 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T18:39:25.569 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T18:39:25.569 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T18:39:25.569 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T18:39:25.569 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T18:39:25.569 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T18:39:25.569 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T18:39:25.569 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T18:39:25.569 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T18:39:25.569 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T18:39:25.570 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T18:39:25.570 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T18:39:25.570 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T18:39:25.570 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T18:39:25.570 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T18:39:25.570 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T18:39:25.570 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T18:39:25.570 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T18:39:25.570 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T18:39:25.570 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T18:39:25.570 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T18:39:25.570 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T18:39:25.570 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T18:39:25.570 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T18:39:25.571 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T18:39:25.571 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T18:39:25.571 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T18:39:25.571 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T18:39:25.571 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T18:39:25.571 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T18:39:25.571 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T18:39:25.571 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T18:39:25.571 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T18:39:25.571 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T18:39:25.571 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T18:39:25.571 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T18:39:25.572 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T18:39:25.572 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T18:39:25.572 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T18:39:25.572 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T18:39:25.572 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T18:39:25.572 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T18:39:25.572 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T18:39:25.572 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T18:39:25.572 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T18:39:25.572 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T18:39:25.572 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T18:39:25.572 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T18:39:25.572 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T18:39:25.573 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T18:39:25.573 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T18:39:25.573 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T18:39:25.573 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T18:39:25.573 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T18:39:25.573 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T18:39:25.573 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T18:39:25.573 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T18:39:25.573 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T18:39:25.573 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T18:39:25.573 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T18:39:25.573 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T18:39:25.573 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T18:39:25.573 INFO:tasks.workunit.client.0.smithi111.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T18:39:25.574 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-12T18:39:25.574 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T18:39:25.574 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T18:39:25.574 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T18:39:25.574 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T18:39:25.574 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T18:39:25.574 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T18:39:25.574 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T18:39:25.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:39:25.561+0000 7f912d323a80 -1 shutting down 2024-09-12T18:39:25.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:39:25.565+0000 7f9007075640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62736, si_uid : 1000, si_addr0x3e80000f510, si_status0 2024-09-12T18:39:55.874 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SHUTDOWN (30308 ms) 2024-09-12T18:39:55.874 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 11 tests from LibRGW (31088 ms total) 2024-09-12T18:39:55.874 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:39:55.874 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:39:55.874 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 11 tests from 1 test suite ran. (31088 ms total) 2024-09-12T18:39:55.874 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 11 tests. 2024-09-12T18:39:55.884 INFO:tasks.workunit.client.0.smithi111.stdout:phase 5.1 2024-09-12T18:39:55.919 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T18:39:55.919 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:39:55.919 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 19 tests from LibRGW 2024-09-12T18:39:55.919 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.INIT 2024-09-12T18:39:55.930 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:39:55.930 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:39:56.486 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.INIT (568 ms) 2024-09-12T18:39:56.487 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T18:39:56.488 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T18:39:56.488 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T18:39:56.504 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CREATE_BUCKET (15 ms) 2024-09-12T18:39:56.504 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T18:39:56.510 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T18:39:56.510 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T18:39:56.510 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T18:39:56.510 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T18:39:56.513 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T18:39:56.513 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T18:39:56.513 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T18:39:56.513 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T18:39:56.521 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.PUT_OBJECT (8 ms) 2024-09-12T18:39:56.521 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T18:39:56.524 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.GET_OBJECT (3 ms) 2024-09-12T18:39:56.524 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T18:39:56.524 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T18:39:56.524 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T18:39:56.524 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T18:39:56.524 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T18:39:56.524 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T18:39:56.524 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.READV 2024-09-12T18:39:56.524 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T18:39:56.524 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T18:39:56.525 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T18:39:56.525 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T18:39:56.525 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T18:39:56.525 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T18:39:56.525 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T18:39:56.525 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T18:39:56.525 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T18:39:56.525 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T18:39:56.525 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T18:39:56.525 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T18:39:56.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:39:56.524+0000 7fca5e80ea80 -1 shutting down 2024-09-12T18:39:56.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:39:56.528+0000 7fc938560640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63381, si_uid : 1000, si_addr0x3e80000f795, si_status0 2024-09-12T18:40:26.496 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SHUTDOWN (29972 ms) 2024-09-12T18:40:26.496 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 19 tests from LibRGW (30577 ms total) 2024-09-12T18:40:26.496 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:40:26.496 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:40:26.496 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 19 tests from 1 test suite ran. (30577 ms total) 2024-09-12T18:40:26.496 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 19 tests. 2024-09-12T18:40:26.507 INFO:tasks.workunit.client.0.smithi111.stdout:phase 5.2 2024-09-12T18:40:26.541 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T18:40:26.542 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:40:26.542 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 19 tests from LibRGW 2024-09-12T18:40:26.542 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.INIT 2024-09-12T18:40:26.550 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:40:26.550 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:40:27.522 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.INIT (980 ms) 2024-09-12T18:40:27.522 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T18:40:27.523 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T18:40:27.523 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T18:40:27.523 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T18:40:27.524 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T18:40:27.537 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (14 ms) 2024-09-12T18:40:27.537 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T18:40:27.537 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T18:40:27.537 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T18:40:27.538 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T18:40:27.538 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T18:40:27.538 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T18:40:27.538 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T18:40:27.538 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T18:40:27.538 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T18:40:27.538 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T18:40:27.538 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T18:40:27.538 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T18:40:27.538 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T18:40:27.538 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T18:40:27.538 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T18:40:27.538 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T18:40:27.539 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.READV 2024-09-12T18:40:27.539 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T18:40:27.539 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T18:40:27.539 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T18:40:27.539 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T18:40:27.547 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.DELETE_OBJECT (9 ms) 2024-09-12T18:40:27.547 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T18:40:27.596 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.DELETE_BUCKET (49 ms) 2024-09-12T18:40:27.596 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T18:40:27.596 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T18:40:27.596 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T18:40:27.596 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T18:40:27.596 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T18:40:27.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:40:27.595+0000 7f09ffd87a80 -1 shutting down 2024-09-12T18:40:27.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:40:27.599+0000 7f08d9ad9640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64026, si_uid : 1000, si_addr0x3e80000fa1a, si_status0 2024-09-12T18:40:57.575 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SHUTDOWN (29978 ms) 2024-09-12T18:40:57.575 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 19 tests from LibRGW (31033 ms total) 2024-09-12T18:40:57.575 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:40:57.575 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:40:57.575 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 19 tests from 1 test suite ran. (31033 ms total) 2024-09-12T18:40:57.576 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 19 tests. 2024-09-12T18:40:57.588 INFO:tasks.workunit.client.0.smithi111.stdout:phase 6.1 2024-09-12T18:40:57.610 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T18:40:57.611 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment set-up. 2024-09-12T18:40:57.611 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 10 tests from LibRGW 2024-09-12T18:40:57.611 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.INIT 2024-09-12T18:40:57.619 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:40:57.619 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:40:58.172 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.INIT (561 ms) 2024-09-12T18:40:58.172 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T18:40:58.173 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T18:40:58.173 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T18:40:58.207 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CREATE_BUCKETS (34 ms) 2024-09-12T18:40:58.207 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T18:40:58.218 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (10 ms) 2024-09-12T18:40:58.218 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T18:40:58.250 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.TOPDIR_RENAME (32 ms) 2024-09-12T18:40:58.250 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T18:40:58.293 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SUBDIR_RENAME (43 ms) 2024-09-12T18:40:58.293 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T18:40:58.343 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (50 ms) 2024-09-12T18:40:58.343 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T18:40:58.343 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T18:40:58.343 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T18:40:58.343 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T18:40:58.343 INFO:tasks.workunit.client.0.smithi111.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T18:40:58.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:40:58.343+0000 7f74360d7a80 -1 shutting down 2024-09-12T18:40:58.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:40:58.343+0000 7f730fe29640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64672, si_uid : 1000, si_addr0x3e80000fca0, si_status0 2024-09-12T18:41:28.298 INFO:tasks.workunit.client.0.smithi111.stdout:[ OK ] LibRGW.SHUTDOWN (29955 ms) 2024-09-12T18:41:28.298 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] 10 tests from LibRGW (30687 ms total) 2024-09-12T18:41:28.298 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:41:28.298 INFO:tasks.workunit.client.0.smithi111.stdout:[----------] Global test environment tear-down 2024-09-12T18:41:28.298 INFO:tasks.workunit.client.0.smithi111.stdout:[==========] 10 tests from 1 test suite ran. (30687 ms total) 2024-09-12T18:41:28.298 INFO:tasks.workunit.client.0.smithi111.stdout:[ PASSED ] 10 tests. 2024-09-12T18:41:28.309 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:41:28.309 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:41:28.325 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T18:41:28.326 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T18:41:28.326 DEBUG:teuthology.orchestra.run.smithi111:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T18:41:28.375 INFO:tasks.workunit.client.0.smithi111.stderr:+ [ -z ] 2024-09-12T18:41:28.375 INFO:tasks.workunit.client.0.smithi111.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T18:41:28.375 INFO:tasks.workunit.client.0.smithi111.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T18:41:28.375 INFO:tasks.workunit.client.0.smithi111.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-12T18:41:28.416 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:41:28.416 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:41:28.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.458+0000 7f8f22fed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:41:28.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.462+0000 7f8f22fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:41:28.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.462+0000 7f8f22fed9c0 20 realm 2024-09-12T18:41:28.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.462+0000 7f8f22fed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:41:28.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.462+0000 7f8f22fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:41:28.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.462+0000 7f8f22fed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:41:28.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.462+0000 7f8f22fed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:41:28.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.462+0000 7f8f22fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:41:28.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.462+0000 7f8f22fed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:41:28.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.466+0000 7f8f22fed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:41:28.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.466+0000 7f8f22fed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:41:28.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.466+0000 7f8f22fed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:41:28.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.466+0000 7f8f22fed9c0 20 searching for the correct realm 2024-09-12T18:41:28.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.470+0000 7f8f202f2640 0 -- 172.21.15.111:0/1918064244 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f8f10028040 msgr2=0x7f8f10019420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:41:28.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.474+0000 7f8f20af3640 0 -- 172.21.15.111:0/1918064244 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f8f180c4030 msgr2=0x7f8f1812a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:41:28.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:41:28.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:41:28.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:41:28.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:41:28.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:41:28.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:41:28.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:41:28.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:41:28.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:41:28.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:41:28.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:41:28.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:41:28.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 zone default found 2024-09-12T18:41:28.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 4 Realm: () 2024-09-12T18:41:28.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:41:28.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:41:28.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:41:28.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 zonegroup default 2024-09-12T18:41:28.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:41:28.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:41:28.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:41:28.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:41:28.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.486+0000 7f8f22fed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:41:28.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.490+0000 7f8f22fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:41:28.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.490+0000 7f8f22fed9c0 20 started sync module instance, tier type = 2024-09-12T18:41:28.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.490+0000 7f8f22fed9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:41:28.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.502+0000 7f8f22fed9c0 20 add_watcher() i=0 2024-09-12T18:41:28.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.502+0000 7f8f22fed9c0 20 add_watcher() i=1 2024-09-12T18:41:28.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.502+0000 7f8f22fed9c0 20 add_watcher() i=2 2024-09-12T18:41:28.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.502+0000 7f8f22fed9c0 20 add_watcher() i=3 2024-09-12T18:41:28.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.502+0000 7f8f22fed9c0 20 add_watcher() i=4 2024-09-12T18:41:28.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.502+0000 7f8f22fed9c0 20 add_watcher() i=5 2024-09-12T18:41:28.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.502+0000 7f8f22fed9c0 20 add_watcher() i=6 2024-09-12T18:41:28.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.506+0000 7f8f22fed9c0 20 add_watcher() i=7 2024-09-12T18:41:28.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.506+0000 7f8f22fed9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:41:28.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.506+0000 7f8dd6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:41:28.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:41:28.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:41:28.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 5 note: GC not initialized 2024-09-12T18:41:28.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8dd5fe3640 20 reqs_thread_entry: start 2024-09-12T18:41:28.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:41:28.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 20 Filter name: none 2024-09-12T18:41:28.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8d477fe640 20 reqs_thread_entry: start 2024-09-12T18:41:28.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T18:41:28.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:41:28.512 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:41:28.512 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T18:41:28.512 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T18:41:28.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T18:41:28.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:41:28.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:41:28.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T18:41:28.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T18:41:28.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T18:41:28.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:41:28.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:41:28.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T18:41:28.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T18:41:28.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T18:41:28.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T18:41:28.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T18:41:28.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T18:41:28.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8f22fed9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T18:41:28.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8df7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791303 cookie 94103170409104 notifier 5844 bl.length()=677 2024-09-12T18:41:28.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8df7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T18:41:28.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.510+0000 7f8df7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T18:41:28.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.514+0000 7f8f22fed9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T18:41:28.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.514+0000 7f8f22fed9c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T18:41:28.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.514+0000 7f8f22fed9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T18:41:28.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.514+0000 7f8df7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791303 cookie 94103170419440 notifier 5844 bl.length()=187 2024-09-12T18:41:28.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.514+0000 7f8df7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T18:41:28.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.514+0000 7f8df7fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T18:41:28.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.518+0000 7f8f22fed9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T18:41:28.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.518+0000 7f8f22fed9c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T18:41:28.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.518+0000 7f8f22fed9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T18:41:28.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.518+0000 7f8df77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791304 cookie 94103170419440 notifier 5844 bl.length()=197 2024-09-12T18:41:28.522 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.518+0000 7f8df77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T18:41:28.522 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.518+0000 7f8df77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T18:41:28.523 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:41:28.523 INFO:tasks.workunit.client.0.smithi111.stdout: "user_id": "ceph-test-maven", 2024-09-12T18:41:28.523 INFO:tasks.workunit.client.0.smithi111.stdout: "display_name": "maven test user", 2024-09-12T18:41:28.523 INFO:tasks.workunit.client.0.smithi111.stdout: "email": "sigv4@example.com", 2024-09-12T18:41:28.523 INFO:tasks.workunit.client.0.smithi111.stdout: "suspended": 0, 2024-09-12T18:41:28.523 INFO:tasks.workunit.client.0.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:41:28.523 INFO:tasks.workunit.client.0.smithi111.stdout: "subusers": [], 2024-09-12T18:41:28.523 INFO:tasks.workunit.client.0.smithi111.stdout: "keys": [ 2024-09-12T18:41:28.523 INFO:tasks.workunit.client.0.smithi111.stdout: { 2024-09-12T18:41:28.523 INFO:tasks.workunit.client.0.smithi111.stdout: "user": "ceph-test-maven", 2024-09-12T18:41:28.523 INFO:tasks.workunit.client.0.smithi111.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T18:41:28.523 INFO:tasks.workunit.client.0.smithi111.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T18:41:28.523 INFO:tasks.workunit.client.0.smithi111.stdout: "active": true, 2024-09-12T18:41:28.524 INFO:tasks.workunit.client.0.smithi111.stdout: "create_date": "2024-09-12T18:41:28.514849Z" 2024-09-12T18:41:28.524 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:41:28.524 INFO:tasks.workunit.client.0.smithi111.stdout: ], 2024-09-12T18:41:28.524 INFO:tasks.workunit.client.0.smithi111.stdout: "swift_keys": [], 2024-09-12T18:41:28.524 INFO:tasks.workunit.client.0.smithi111.stdout: "caps": [], 2024-09-12T18:41:28.524 INFO:tasks.workunit.client.0.smithi111.stdout: "op_mask": "read, write, delete", 2024-09-12T18:41:28.524 INFO:tasks.workunit.client.0.smithi111.stdout: "default_placement": "", 2024-09-12T18:41:28.524 INFO:tasks.workunit.client.0.smithi111.stdout: "default_storage_class": "", 2024-09-12T18:41:28.524 INFO:tasks.workunit.client.0.smithi111.stdout: "placement_tags": [], 2024-09-12T18:41:28.524 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_quota": { 2024-09-12T18:41:28.524 INFO:tasks.workunit.client.0.smithi111.stdout: "enabled": false, 2024-09-12T18:41:28.524 INFO:tasks.workunit.client.0.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:41:28.524 INFO:tasks.workunit.client.0.smithi111.stdout: "max_size": -1, 2024-09-12T18:41:28.524 INFO:tasks.workunit.client.0.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: "max_objects": -1 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: "user_quota": { 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: "enabled": false, 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: "max_size": -1, 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: "max_objects": -1 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: "temp_url_keys": [], 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: "type": "rgw", 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: "mfa_ids": [], 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: "account_id": "", 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: "path": "/", 2024-09-12T18:41:28.525 INFO:tasks.workunit.client.0.smithi111.stdout: "create_date": "2024-09-12T18:41:28.514836Z", 2024-09-12T18:41:28.526 INFO:tasks.workunit.client.0.smithi111.stdout: "tags": [], 2024-09-12T18:41:28.526 INFO:tasks.workunit.client.0.smithi111.stdout: "group_ids": [] 2024-09-12T18:41:28.526 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:41:28.526 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:41:28.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.522+0000 7f8dd6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:41:28.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.526+0000 7f8f22fed9c0 20 remove_watcher() i=0 2024-09-12T18:41:28.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.526+0000 7f8f22fed9c0 2 removed watcher, disabling cache 2024-09-12T18:41:28.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.530+0000 7f8f22fed9c0 20 remove_watcher() i=1 2024-09-12T18:41:28.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.530+0000 7f8f22fed9c0 20 remove_watcher() i=2 2024-09-12T18:41:28.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.534+0000 7f8f22fed9c0 20 remove_watcher() i=3 2024-09-12T18:41:28.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.534+0000 7f8f22fed9c0 20 remove_watcher() i=4 2024-09-12T18:41:28.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.534+0000 7f8f22fed9c0 20 remove_watcher() i=5 2024-09-12T18:41:28.539 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.538+0000 7f8f22fed9c0 20 remove_watcher() i=6 2024-09-12T18:41:28.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:41:28.538+0000 7f8f22fed9c0 20 remove_watcher() i=7 2024-09-12T18:41:28.556 INFO:tasks.workunit.client.0.smithi111.stderr:+ [ -z ] 2024-09-12T18:41:28.557 INFO:tasks.workunit.client.0.smithi111.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-12T18:41:28.557 INFO:tasks.workunit.client.0.smithi111.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-12T18:41:28.557 INFO:tasks.workunit.client.0.smithi111.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi111.front.sepia.ceph.com:443 2024-09-12T18:41:28.557 INFO:tasks.workunit.client.0.smithi111.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-12T18:41:28.557 INFO:tasks.workunit.client.0.smithi111.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T18:41:28.557 INFO:tasks.workunit.client.0.smithi111.stderr:+ ./mvnw clean package 2024-09-12T18:41:28.560 INFO:tasks.workunit.client.0.smithi111.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T18:41:31.243 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Scanning for projects... 2024-09-12T18:41:31.406 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T18:41:31.507 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 54 kB/s) 2024-09-12T18:41:31.522 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T18:41:31.556 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.4 MB/s) 2024-09-12T18:41:31.569 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T18:41:31.590 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/77 kB Progress (1): 32/77 kB Progress (1): 49/77 kB Progress (1): 65/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.5 MB/s) 2024-09-12T18:41:31.628 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:31.628 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T18:41:31.628 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Building jcksum 1.0 2024-09-12T18:41:31.628 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] from pom.xml 2024-09-12T18:41:31.628 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T18:41:31.629 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T18:41:31.645 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-12T18:41:31.655 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T18:41:31.670 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-12T18:41:31.674 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T18:41:31.690 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-12T18:41:31.696 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T18:41:31.710 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.4 MB/s) 2024-09-12T18:41:31.723 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T18:41:31.739 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-12T18:41:31.747 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T18:41:31.762 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-12T18:41:31.765 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T18:41:31.780 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-12T18:41:31.783 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T18:41:31.798 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-09-12T18:41:31.804 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T18:41:31.819 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-12T18:41:31.827 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T18:41:31.842 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-12T18:41:31.851 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T18:41:31.867 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 577 kB/s) 2024-09-12T18:41:31.877 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T18:41:31.896 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.5 MB/s) 2024-09-12T18:41:31.905 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T18:41:31.922 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-09-12T18:41:31.925 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T18:41:31.944 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.4/22 kB Progress (1): 18/22 kB Progress (1): 19/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.2 MB/s) 2024-09-12T18:41:31.947 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T18:41:31.963 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.9 MB/s) 2024-09-12T18:41:31.970 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T18:41:31.986 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-12T18:41:31.995 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T18:41:32.011 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 352 kB/s) 2024-09-12T18:41:32.016 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T18:41:32.033 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-12T18:41:32.042 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T18:41:32.056 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 451 kB/s) 2024-09-12T18:41:32.059 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T18:41:32.074 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 660 kB/s) 2024-09-12T18:41:32.077 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T18:41:32.093 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-12T18:41:32.097 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T18:41:32.113 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.3 MB/s) 2024-09-12T18:41:32.121 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T18:41:32.137 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.7 MB/s) 2024-09-12T18:41:32.157 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T18:41:32.172 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-12T18:41:32.174 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T18:41:32.193 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.1 MB/s) 2024-09-12T18:41:32.199 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T18:41:32.216 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 15/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-09-12T18:41:32.228 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T18:41:32.244 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 236 kB/s) 2024-09-12T18:41:32.249 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T18:41:32.264 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 97 kB/s) 2024-09-12T18:41:32.266 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T18:41:32.283 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 131 kB/s) 2024-09-12T18:41:32.289 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T18:41:32.306 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 227 kB/s) 2024-09-12T18:41:32.312 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T18:41:32.328 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 201 kB/s) 2024-09-12T18:41:32.334 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T18:41:32.350 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 645 kB/s) 2024-09-12T18:41:32.357 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T18:41:32.372 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-12T18:41:32.376 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T18:41:32.393 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 239 kB/s) 2024-09-12T18:41:32.399 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T18:41:32.415 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 307 kB/s) 2024-09-12T18:41:32.420 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T18:41:32.434 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-12T18:41:32.437 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T18:41:32.452 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 256 kB/s) 2024-09-12T18:41:32.454 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T18:41:32.469 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 920 kB/s) 2024-09-12T18:41:32.474 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T18:41:32.489 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 245 kB/s) 2024-09-12T18:41:32.495 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T18:41:32.511 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 153 kB/s) 2024-09-12T18:41:32.516 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T18:41:32.531 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 194 kB/s) 2024-09-12T18:41:32.536 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T18:41:32.551 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 463 kB/s) 2024-09-12T18:41:32.556 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T18:41:32.571 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 364 kB/s) 2024-09-12T18:41:32.576 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T18:41:32.592 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 218 kB/s) 2024-09-12T18:41:32.597 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T18:41:32.612 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 293 kB/s) 2024-09-12T18:41:32.615 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T18:41:32.630 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 150 kB/s) 2024-09-12T18:41:32.635 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T18:41:32.651 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 429 kB/s) 2024-09-12T18:41:32.656 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T18:41:32.671 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 404 kB/s) 2024-09-12T18:41:32.678 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T18:41:32.694 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 186 kB/s) 2024-09-12T18:41:32.699 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T18:41:32.715 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 232 kB/s) 2024-09-12T18:41:32.721 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T18:41:32.736 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-12T18:41:32.738 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T18:41:32.753 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 118 kB/s) 2024-09-12T18:41:32.759 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T18:41:32.774 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 441 kB/s) 2024-09-12T18:41:32.777 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T18:41:32.791 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.2 MB/s) 2024-09-12T18:41:32.794 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T18:41:32.809 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-12T18:41:32.813 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T18:41:32.828 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-12T18:41:32.833 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T18:41:32.847 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-12T18:41:32.850 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T18:41:32.864 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 878 kB/s) 2024-09-12T18:41:32.869 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T18:41:32.885 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 931 kB/s) 2024-09-12T18:41:32.888 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T18:41:32.904 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/68 kB Progress (1): 32/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.0 MB/s) 2024-09-12T18:41:32.918 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T18:41:32.933 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.0 MB/s) 2024-09-12T18:41:32.939 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T18:41:32.954 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.0 MB/s) 2024-09-12T18:41:32.957 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T18:41:32.973 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.7 MB/s) 2024-09-12T18:41:32.980 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T18:41:32.994 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.3 MB/s) 2024-09-12T18:41:32.998 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T18:41:33.013 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.3 MB/s) 2024-09-12T18:41:33.016 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T18:41:33.032 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.9 MB/s) 2024-09-12T18:41:33.040 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T18:41:33.055 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 256 kB/s) 2024-09-12T18:41:33.057 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T18:41:33.081 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 575 kB/s) 2024-09-12T18:41:33.085 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T18:41:33.100 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T18:41:33.103 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T18:41:33.117 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 212 kB/s) 2024-09-12T18:41:33.120 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T18:41:33.135 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-12T18:41:33.138 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T18:41:33.152 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 189 kB/s) 2024-09-12T18:41:33.155 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T18:41:33.170 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 102 kB/s) 2024-09-12T18:41:33.173 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T18:41:33.188 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 201 kB/s) 2024-09-12T18:41:33.191 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T18:41:33.206 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-12T18:41:33.208 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T18:41:33.226 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 178 kB/s) 2024-09-12T18:41:33.233 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T18:41:33.249 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 64 kB/s) 2024-09-12T18:41:33.257 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T18:41:33.275 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 54 kB/s) 2024-09-12T18:41:33.281 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T18:41:33.298 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 191 kB/s) 2024-09-12T18:41:33.304 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T18:41:33.322 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 168 kB/s) 2024-09-12T18:41:33.326 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T18:41:33.342 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-12T18:41:33.346 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T18:41:33.362 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-12T18:41:33.366 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T18:41:33.382 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-12T18:41:33.435 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T18:41:33.547 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 29 MB/s) 2024-09-12T18:41:33.550 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T18:41:33.550 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T18:41:33.550 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T18:41:33.550 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T18:41:33.551 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T18:41:33.583 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/98 kB Progress (1): 33/98 kB Progress (1): 49/98 kB Progress (1): 66/98 kB Progress (1): 82/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 2.8 MB/s) 2024-09-12T18:41:33.583 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T18:41:33.597 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 349 kB/s) 2024-09-12T18:41:33.597 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T18:41:33.610 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (1): 5.5/16 kB Progress (1): 6.9/16 kB Progress (1): 8.3/16 kB Progress (1): 9.7/16 kB Progress (2): 9.7/16 kB | 1.4/49 kB Progress (2): 11/16 kB | 1.4/49 kB Progress (2): 11/16 kB | 2.8/49 kB Progress (2): 12/16 kB | 2.8/49 kB Progress (2): 12/16 kB | 4.1/49 kB Progress (2): 12/16 kB | 5.5/49 kB Progress (2): 14/16 kB | 5.5/49 kB Progress (2): 14/16 kB | 6.9/49 kB Progress (2): 15/16 kB | 6.9/49 kB Progress (2): 15/16 kB | 8.3/49 kB Progress (2): 16 kB | 8.3/49 kB Progress (2): 16 kB | 9.7/49 kB Progress (2): 16 kB | 11/49 kB Progress (2): 16 kB | 12/49 kB Progress (2): 16 kB | 14/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 259 kB/s) 2024-09-12T18:41:33.611 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 15/49 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T18:41:33.626 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/49 kB Progress (2): 16/49 kB | 16/782 kB Progress (2): 18/49 kB | 16/782 kB Progress (2): 18/49 kB | 33/782 kB Progress (2): 18/49 kB | 49/782 kB Progress (2): 19/49 kB | 49/782 kB Progress (2): 19/49 kB | 66/782 kB Progress (2): 21/49 kB | 66/782 kB Progress (2): 21/49 kB | 82/782 kB Progress (2): 21/49 kB | 98/782 kB Progress (2): 22/49 kB | 98/782 kB Progress (2): 23/49 kB | 98/782 kB Progress (2): 23/49 kB | 115/782 kB Progress (2): 25/49 kB | 115/782 kB Progress (2): 26/49 kB | 115/782 kB Progress (2): 26/49 kB | 131/782 kB Progress (2): 27/49 kB | 131/782 kB Progress (2): 29/49 kB | 131/782 kB Progress (2): 29/49 kB | 147/782 kB Progress (2): 29/49 kB | 164/782 kB Progress (2): 30/49 kB | 164/782 kB Progress (2): 32/49 kB | 164/782 kB Progress (2): 32/49 kB | 180/782 kB Progress (2): 32/49 kB | 197/782 kB Progress (2): 33/49 kB | 197/782 kB Progress (2): 34/49 kB | 197/782 kB Progress (2): 34/49 kB | 213/782 kB Progress (2): 34/49 kB | 229/782 kB Progress (2): 34/49 kB | 246/782 kB Progress (2): 34/49 kB | 262/782 kB Progress (2): 36/49 kB | 262/782 kB Progress (2): 37/49 kB | 262/782 kB Progress (2): 37/49 kB | 278/782 kB Progress (2): 37/49 kB | 295/782 kB Progress (2): 37/49 kB | 311/782 kB Progress (2): 38/49 kB | 311/782 kB Progress (2): 38/49 kB | 328/782 kB Progress (2): 38/49 kB | 344/782 kB Progress (2): 38/49 kB | 360/782 kB Progress (2): 38/49 kB | 377/782 kB Progress (2): 38/49 kB | 393/782 kB Progress (3): 38/49 kB | 393/782 kB | 1.4/71 kB Progress (3): 38/49 kB | 393/782 kB | 2.8/71 kB Progress (3): 38/49 kB | 410/782 kB | 2.8/71 kB Progress (3): 38/49 kB | 410/782 kB | 4.1/71 kB Progress (3): 38/49 kB | 410/782 kB | 5.5/71 kB Progress (3): 38/49 kB | 426/782 kB | 5.5/71 kB Progress (4): 38/49 kB | 426/782 kB | 5.5/71 kB | 1.4/35 kB Progress (4): 38/49 kB | 426/782 kB | 6.9/71 kB | 1.4/35 kB Progress (4): 38/49 kB | 426/782 kB | 6.9/71 kB | 2.8/35 kB Progress (4): 38/49 kB | 426/782 kB | 8.3/71 kB | 2.8/35 kB Progress (4): 38/49 kB | 426/782 kB | 8.3/71 kB | 4.1/35 kB Progress (4): 38/49 kB | 426/782 kB | 9.7/71 kB | 4.1/35 kB Progress (4): 38/49 kB | 426/782 kB | 9.7/71 kB | 5.5/35 kB Progress (4): 38/49 kB | 426/782 kB | 11/71 kB | 5.5/35 kB Progress (4): 40/49 kB | 426/782 kB | 11/71 kB | 5.5/35 kB Progress (4): 40/49 kB | 442/782 kB | 11/71 kB | 5.5/35 kB Progress (4): 41/49 kB | 442/782 kB | 11/71 kB | 5.5/35 kB Progress (4): 41/49 kB | 442/782 kB | 12/71 kB | 5.5/35 kB Progress (4): 41/49 kB | 442/782 kB | 12/71 kB | 6.9/35 kB Progress (4): 41/49 kB | 442/782 kB | 14/71 kB | 6.9/35 kB Progress (4): 43/49 kB | 442/782 kB | 14/71 kB | 6.9/35 kB Progress (4): 43/49 kB | 442/782 kB | 15/71 kB | 6.9/35 kB Progress (4): 43/49 kB | 442/782 kB | 15/71 kB | 8.3/35 kB Progress (4): 43/49 kB | 459/782 kB | 15/71 kB | 8.3/35 kB Progress (4): 43/49 kB | 459/782 kB | 15/71 kB | 9.7/35 kB Progress (4): 43/49 kB | 459/782 kB | 16/71 kB | 9.7/35 kB Progress (4): 44/49 kB | 459/782 kB | 16/71 kB | 9.7/35 kB Progress (4): 44/49 kB | 459/782 kB | 16/71 kB | 11/35 kB Progress (4): 45/49 kB | 459/782 kB | 16/71 kB | 11/35 kB Progress (4): 45/49 kB | 475/782 kB | 16/71 kB | 11/35 kB Progress (4): 45/49 kB | 475/782 kB | 16/71 kB | 12/35 kB Progress (4): 47/49 kB | 475/782 kB | 16/71 kB | 12/35 kB Progress (4): 47/49 kB | 475/782 kB | 32/71 kB | 12/35 kB Progress (4): 47/49 kB | 475/782 kB | 32/71 kB | 14/35 kB Progress (4): 48/49 kB | 475/782 kB | 32/71 kB | 14/35 kB Progress (4): 48/49 kB | 491/782 kB | 32/71 kB | 14/35 kB Progress (4): 48/49 kB | 491/782 kB | 32/71 kB | 15/35 kB Progress (4): 49 kB | 491/782 kB | 32/71 kB | 15/35 kB Progress (4): 49 kB | 491/782 kB | 32/71 kB | 17/35 kB Progress (4): 49 kB | 491/782 kB | 32/71 kB | 18/35 kB Progress (4): 49 kB | 508/782 kB | 32/71 kB | 18/35 kB Progress (4): 49 kB | 508/782 kB | 32/71 kB | 19/35 kB Progress (4): 49 kB | 508/782 kB | 32/71 kB | 21/35 kB Progress (4): 49 kB | 524/782 kB | 32/71 kB | 21/35 kB Progress (4): 49 kB | 524/782 kB | 32/71 kB | 22/35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 665 kB/s) 2024-09-12T18:41:33.626 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (3): 524/782 kB | 32/71 kB | 23/35 kB Progress (4): 524/782 kB | 32/71 kB | 23/35 kB | 1.4/11 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T18:41:33.627 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (4): 524/782 kB | 32/71 kB | 25/35 kB | 1.4/11 kB Progress (4): 541/782 kB | 32/71 kB | 25/35 kB | 1.4/11 kB Progress (4): 541/782 kB | 32/71 kB | 26/35 kB | 1.4/11 kB Progress (4): 541/782 kB | 32/71 kB | 26/35 kB | 2.8/11 kB Progress (4): 541/782 kB | 32/71 kB | 28/35 kB | 2.8/11 kB Progress (4): 541/782 kB | 32/71 kB | 28/35 kB | 4.1/11 kB Progress (4): 557/782 kB | 32/71 kB | 28/35 kB | 4.1/11 kB Progress (4): 557/782 kB | 32/71 kB | 29/35 kB | 4.1/11 kB Progress (4): 557/782 kB | 32/71 kB | 30/35 kB | 4.1/11 kB Progress (4): 557/782 kB | 32/71 kB | 30/35 kB | 5.5/11 kB Progress (4): 557/782 kB | 32/71 kB | 32/35 kB | 5.5/11 kB Progress (4): 557/782 kB | 32/71 kB | 32/35 kB | 6.9/11 kB Progress (4): 573/782 kB | 32/71 kB | 32/35 kB | 6.9/11 kB Progress (4): 573/782 kB | 32/71 kB | 33/35 kB | 6.9/11 kB Progress (4): 573/782 kB | 32/71 kB | 34/35 kB | 6.9/11 kB Progress (4): 573/782 kB | 32/71 kB | 35 kB | 6.9/11 kB Progress (4): 573/782 kB | 32/71 kB | 35 kB | 8.3/11 kB Progress (4): 590/782 kB | 32/71 kB | 35 kB | 8.3/11 kB Progress (4): 590/782 kB | 32/71 kB | 35 kB | 9.7/11 kB Progress (4): 606/782 kB | 32/71 kB | 35 kB | 9.7/11 kB Progress (4): 606/782 kB | 32/71 kB | 35 kB | 11/11 kB Progress (4): 606/782 kB | 32/71 kB | 35 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 451 kB/s) 2024-09-12T18:41:33.627 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (3): 623/782 kB | 32/71 kB | 11 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T18:41:33.627 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (3): 639/782 kB | 32/71 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 150 kB/s) 2024-09-12T18:41:33.628 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T18:41:33.632 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 655/782 kB | 32/71 kB Progress (2): 672/782 kB | 32/71 kB Progress (2): 688/782 kB | 32/71 kB Progress (2): 704/782 kB | 32/71 kB Progress (2): 721/782 kB | 32/71 kB Progress (2): 737/782 kB | 32/71 kB Progress (2): 737/782 kB | 49/71 kB Progress (2): 754/782 kB | 49/71 kB Progress (2): 770/782 kB | 49/71 kB Progress (2): 782 kB | 49/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 9.7 MB/s) 2024-09-12T18:41:33.632 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T18:41:33.635 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 65/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 820 kB/s) 2024-09-12T18:41:33.635 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T18:41:33.649 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (1): 49/205 kB Progress (2): 49/205 kB | 1.4/30 kB Progress (2): 49/205 kB | 2.8/30 kB Progress (2): 49/205 kB | 4.1/30 kB Progress (2): 49/205 kB | 5.5/30 kB Progress (2): 49/205 kB | 6.9/30 kB Progress (2): 49/205 kB | 8.3/30 kB Progress (2): 49/205 kB | 9.7/30 kB Progress (2): 49/205 kB | 11/30 kB Progress (3): 49/205 kB | 11/30 kB | 16/81 kB Progress (3): 66/205 kB | 11/30 kB | 16/81 kB Progress (3): 66/205 kB | 12/30 kB | 16/81 kB Progress (3): 66/205 kB | 14/30 kB | 16/81 kB Progress (3): 66/205 kB | 15/30 kB | 16/81 kB Progress (3): 66/205 kB | 15/30 kB | 33/81 kB Progress (3): 66/205 kB | 17/30 kB | 33/81 kB Progress (3): 66/205 kB | 18/30 kB | 33/81 kB Progress (3): 66/205 kB | 19/30 kB | 33/81 kB Progress (3): 66/205 kB | 21/30 kB | 33/81 kB Progress (3): 66/205 kB | 22/30 kB | 33/81 kB Progress (3): 66/205 kB | 23/30 kB | 33/81 kB Progress (3): 66/205 kB | 23/30 kB | 49/81 kB Progress (3): 66/205 kB | 25/30 kB | 49/81 kB Progress (3): 66/205 kB | 26/30 kB | 49/81 kB Progress (3): 66/205 kB | 28/30 kB | 49/81 kB Progress (3): 66/205 kB | 29/30 kB | 49/81 kB Progress (3): 66/205 kB | 30 kB | 49/81 kB Progress (4): 66/205 kB | 30 kB | 49/81 kB | 16/798 kB Progress (4): 66/205 kB | 30 kB | 49/81 kB | 33/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 315 kB/s) 2024-09-12T18:41:33.649 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T18:41:33.653 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (3): 66/205 kB | 49/81 kB | 49/798 kB Progress (3): 66/205 kB | 49/81 kB | 62/798 kB Progress (3): 66/205 kB | 49/81 kB | 78/798 kB Progress (3): 66/205 kB | 49/81 kB | 95/798 kB Progress (3): 66/205 kB | 49/81 kB | 111/798 kB Progress (3): 66/205 kB | 49/81 kB | 128/798 kB Progress (3): 66/205 kB | 49/81 kB | 144/798 kB Progress (4): 66/205 kB | 49/81 kB | 144/798 kB | 13 kB Progress (4): 66/205 kB | 49/81 kB | 160/798 kB | 13 kB Progress (4): 66/205 kB | 49/81 kB | 177/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 134 kB/s) 2024-09-12T18:41:33.653 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T18:41:33.658 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (3): 66/205 kB | 49/81 kB | 193/798 kB Progress (3): 82/205 kB | 49/81 kB | 193/798 kB Progress (3): 82/205 kB | 49/81 kB | 209/798 kB Progress (3): 98/205 kB | 49/81 kB | 209/798 kB Progress (3): 98/205 kB | 49/81 kB | 226/798 kB Progress (3): 98/205 kB | 49/81 kB | 242/798 kB Progress (3): 115/205 kB | 49/81 kB | 242/798 kB Progress (3): 115/205 kB | 49/81 kB | 259/798 kB Progress (3): 115/205 kB | 49/81 kB | 275/798 kB Progress (3): 129/205 kB | 49/81 kB | 275/798 kB Progress (3): 129/205 kB | 49/81 kB | 291/798 kB Progress (3): 129/205 kB | 49/81 kB | 308/798 kB Progress (3): 129/205 kB | 64/81 kB | 308/798 kB Progress (3): 146/205 kB | 64/81 kB | 308/798 kB Progress (3): 146/205 kB | 64/81 kB | 324/798 kB Progress (3): 162/205 kB | 64/81 kB | 324/798 kB Progress (3): 162/205 kB | 64/81 kB | 341/798 kB Progress (3): 162/205 kB | 64/81 kB | 357/798 kB Progress (3): 179/205 kB | 64/81 kB | 357/798 kB Progress (3): 179/205 kB | 64/81 kB | 373/798 kB Progress (3): 179/205 kB | 80/81 kB | 373/798 kB Progress (3): 179/205 kB | 81 kB | 373/798 kB Progress (3): 179/205 kB | 81 kB | 390/798 kB Progress (3): 179/205 kB | 81 kB | 406/798 kB Progress (3): 195/205 kB | 81 kB | 406/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 767 kB/s) 2024-09-12T18:41:33.658 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T18:41:33.659 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 205 kB | 406/798 kB Progress (2): 205 kB | 422/798 kB Progress (2): 205 kB | 439/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.9 MB/s) 2024-09-12T18:41:33.659 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T18:41:33.669 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 455/798 kB Progress (1): 472/798 kB Progress (1): 488/798 kB Progress (1): 504/798 kB Progress (1): 521/798 kB Progress (1): 537/798 kB Progress (1): 554/798 kB Progress (1): 570/798 kB Progress (1): 586/798 kB Progress (1): 603/798 kB Progress (1): 619/798 kB Progress (1): 635/798 kB Progress (1): 652/798 kB Progress (1): 668/798 kB Progress (1): 685/798 kB Progress (2): 685/798 kB | 15/182 kB Progress (2): 701/798 kB | 15/182 kB Progress (2): 717/798 kB | 15/182 kB Progress (2): 734/798 kB | 15/182 kB Progress (2): 750/798 kB | 15/182 kB Progress (2): 750/798 kB | 31/182 kB Progress (2): 766/798 kB | 31/182 kB Progress (2): 783/798 kB | 31/182 kB Progress (2): 798 kB | 31/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.9 MB/s) 2024-09-12T18:41:33.669 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 48/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T18:41:33.676 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 48/182 kB | 16/151 kB Progress (2): 48/182 kB | 33/151 kB Progress (2): 48/182 kB | 49/151 kB Progress (2): 48/182 kB | 62/151 kB Progress (2): 48/182 kB | 79/151 kB Progress (2): 48/182 kB | 95/151 kB Progress (2): 48/182 kB | 111/151 kB Progress (3): 48/182 kB | 111/151 kB | 16/30 kB Progress (3): 48/182 kB | 111/151 kB | 30 kB Progress (4): 48/182 kB | 111/151 kB | 30 kB | 16/27 kB Progress (4): 48/182 kB | 111/151 kB | 30 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 244 kB/s) 2024-09-12T18:41:33.677 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T18:41:33.677 INFO:tasks.workunit.client.0.smithi111.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 222 kB/s) 2024-09-12T18:41:33.677 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T18:41:33.682 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 64/182 kB | 111/151 kB Progress (2): 81/182 kB | 111/151 kB Progress (2): 94/182 kB | 111/151 kB Progress (2): 111/182 kB | 111/151 kB Progress (2): 111/182 kB | 128/151 kB Progress (2): 127/182 kB | 128/151 kB Progress (2): 127/182 kB | 144/151 kB Progress (2): 127/182 kB | 151 kB Progress (2): 143/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-12T18:41:33.682 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T18:41:33.684 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 160/182 kB Progress (1): 176/182 kB Progress (1): 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.4 MB/s) 2024-09-12T18:41:33.684 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T18:41:33.691 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/385 kB Progress (1): 33/385 kB Progress (1): 49/385 kB Progress (1): 65/385 kB Progress (1): 82/385 kB Progress (1): 98/385 kB Progress (1): 114/385 kB Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (1): 164/385 kB Progress (1): 180/385 kB Progress (1): 196/385 kB Progress (1): 213/385 kB Progress (1): 229/385 kB Progress (1): 245/385 kB Progress (2): 245/385 kB | 13 kB Progress (2): 262/385 kB | 13 kB Progress (2): 278/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 95 kB/s) 2024-09-12T18:41:33.691 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T18:41:33.694 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 278/385 kB | 16/75 kB Progress (2): 295/385 kB | 16/75 kB Progress (2): 311/385 kB | 16/75 kB Progress (2): 311/385 kB | 33/75 kB Progress (2): 327/385 kB | 33/75 kB Progress (2): 327/385 kB | 49/75 kB Progress (2): 344/385 kB | 49/75 kB Progress (2): 360/385 kB | 49/75 kB Progress (2): 360/385 kB | 66/75 kB Progress (2): 376/385 kB | 66/75 kB Progress (2): 385 kB | 66/75 kB Progress (2): 385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.7 MB/s) 2024-09-12T18:41:33.694 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T18:41:33.694 INFO:tasks.workunit.client.0.smithi111.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 525 kB/s) 2024-09-12T18:41:33.695 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T18:41:33.725 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/780 kB Progress (1): 33/780 kB Progress (1): 49/780 kB Progress (1): 65/780 kB Progress (1): 81/780 kB Progress (1): 97/780 kB Progress (1): 114/780 kB Progress (1): 130/780 kB Progress (1): 147/780 kB Progress (1): 163/780 kB Progress (1): 179/780 kB Progress (1): 196/780 kB Progress (1): 212/780 kB Progress (2): 212/780 kB | 16/329 kB Progress (2): 229/780 kB | 16/329 kB Progress (2): 229/780 kB | 33/329 kB Progress (2): 245/780 kB | 33/329 kB Progress (2): 245/780 kB | 49/329 kB Progress (2): 245/780 kB | 66/329 kB Progress (2): 261/780 kB | 66/329 kB Progress (2): 261/780 kB | 82/329 kB Progress (2): 261/780 kB | 98/329 kB Progress (2): 261/780 kB | 115/329 kB Progress (2): 261/780 kB | 131/329 kB Progress (2): 261/780 kB | 147/329 kB Progress (2): 261/780 kB | 164/329 kB Progress (2): 261/780 kB | 180/329 kB Progress (2): 261/780 kB | 197/329 kB Progress (3): 261/780 kB | 197/329 kB | 16/501 kB Progress (3): 261/780 kB | 213/329 kB | 16/501 kB Progress (3): 261/780 kB | 213/329 kB | 33/501 kB Progress (3): 261/780 kB | 213/329 kB | 49/501 kB Progress (3): 261/780 kB | 229/329 kB | 49/501 kB Progress (3): 261/780 kB | 229/329 kB | 66/501 kB Progress (3): 261/780 kB | 246/329 kB | 66/501 kB Progress (3): 261/780 kB | 246/329 kB | 82/501 kB Progress (3): 278/780 kB | 246/329 kB | 82/501 kB Progress (3): 278/780 kB | 256/329 kB | 82/501 kB Progress (3): 278/780 kB | 256/329 kB | 98/501 kB Progress (4): 278/780 kB | 256/329 kB | 98/501 kB | 16/41 kB Progress (4): 294/780 kB | 256/329 kB | 98/501 kB | 16/41 kB Progress (4): 294/780 kB | 256/329 kB | 115/501 kB | 16/41 kB Progress (4): 294/780 kB | 272/329 kB | 115/501 kB | 16/41 kB Progress (4): 294/780 kB | 272/329 kB | 115/501 kB | 33/41 kB Progress (5): 294/780 kB | 272/329 kB | 115/501 kB | 33/41 kB | 16/354 kB Progress (5): 294/780 kB | 272/329 kB | 131/501 kB | 33/41 kB | 16/354 kB Progress (5): 294/780 kB | 289/329 kB | 131/501 kB | 33/41 kB | 16/354 kB Progress (5): 294/780 kB | 289/329 kB | 131/501 kB | 41 kB | 16/354 kB Progress (5): 310/780 kB | 289/329 kB | 131/501 kB | 41 kB | 16/354 kB Progress (5): 310/780 kB | 289/329 kB | 131/501 kB | 41 kB | 32/354 kB Progress (5): 310/780 kB | 289/329 kB | 147/501 kB | 41 kB | 32/354 kB Progress (5): 310/780 kB | 305/329 kB | 147/501 kB | 41 kB | 32/354 kB Progress (5): 310/780 kB | 305/329 kB | 147/501 kB | 41 kB | 49/354 kB Progress (5): 327/780 kB | 305/329 kB | 147/501 kB | 41 kB | 49/354 kB Progress (5): 327/780 kB | 321/329 kB | 147/501 kB | 41 kB | 49/354 kB Progress (5): 327/780 kB | 321/329 kB | 164/501 kB | 41 kB | 49/354 kB Progress (5): 327/780 kB | 321/329 kB | 164/501 kB | 41 kB | 65/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 242 kB/s) 2024-09-12T18:41:33.725 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (4): 327/780 kB | 329 kB | 164/501 kB | 65/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T18:41:33.725 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (4): 327/780 kB | 329 kB | 180/501 kB | 65/354 kB Progress (4): 327/780 kB | 329 kB | 180/501 kB | 81/354 kB Progress (4): 343/780 kB | 329 kB | 180/501 kB | 81/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.9 MB/s) 2024-09-12T18:41:33.726 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (3): 343/780 kB | 197/501 kB | 81/354 kB Progress (3): 343/780 kB | 197/501 kB | 98/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T18:41:33.732 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (3): 360/780 kB | 197/501 kB | 98/354 kB Progress (3): 360/780 kB | 197/501 kB | 114/354 kB Progress (3): 360/780 kB | 213/501 kB | 114/354 kB Progress (3): 360/780 kB | 213/501 kB | 130/354 kB Progress (3): 360/780 kB | 229/501 kB | 130/354 kB Progress (3): 376/780 kB | 229/501 kB | 130/354 kB Progress (3): 376/780 kB | 229/501 kB | 147/354 kB Progress (3): 376/780 kB | 246/501 kB | 147/354 kB Progress (3): 376/780 kB | 246/501 kB | 163/354 kB Progress (3): 376/780 kB | 262/501 kB | 163/354 kB Progress (3): 392/780 kB | 262/501 kB | 163/354 kB Progress (3): 392/780 kB | 262/501 kB | 180/354 kB Progress (3): 392/780 kB | 279/501 kB | 180/354 kB Progress (3): 392/780 kB | 279/501 kB | 196/354 kB Progress (3): 392/780 kB | 295/501 kB | 196/354 kB Progress (3): 409/780 kB | 295/501 kB | 196/354 kB Progress (3): 409/780 kB | 295/501 kB | 212/354 kB Progress (3): 409/780 kB | 311/501 kB | 212/354 kB Progress (3): 409/780 kB | 311/501 kB | 229/354 kB Progress (3): 409/780 kB | 328/501 kB | 229/354 kB Progress (3): 425/780 kB | 328/501 kB | 229/354 kB Progress (3): 425/780 kB | 328/501 kB | 245/354 kB Progress (3): 425/780 kB | 344/501 kB | 245/354 kB Progress (3): 442/780 kB | 344/501 kB | 245/354 kB Progress (3): 442/780 kB | 344/501 kB | 262/354 kB Progress (3): 442/780 kB | 360/501 kB | 262/354 kB Progress (3): 442/780 kB | 360/501 kB | 278/354 kB Progress (3): 458/780 kB | 360/501 kB | 278/354 kB Progress (3): 458/780 kB | 377/501 kB | 278/354 kB Progress (3): 458/780 kB | 377/501 kB | 294/354 kB Progress (3): 458/780 kB | 393/501 kB | 294/354 kB Progress (3): 474/780 kB | 393/501 kB | 294/354 kB Progress (3): 474/780 kB | 393/501 kB | 311/354 kB Progress (3): 474/780 kB | 410/501 kB | 311/354 kB Progress (3): 491/780 kB | 410/501 kB | 311/354 kB Progress (3): 491/780 kB | 410/501 kB | 327/354 kB Progress (3): 491/780 kB | 426/501 kB | 327/354 kB Progress (3): 491/780 kB | 426/501 kB | 343/354 kB Progress (3): 507/780 kB | 426/501 kB | 343/354 kB Progress (3): 507/780 kB | 442/501 kB | 343/354 kB Progress (3): 507/780 kB | 442/501 kB | 354 kB Progress (3): 523/780 kB | 442/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.0 MB/s) 2024-09-12T18:41:33.732 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T18:41:33.736 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 540/780 kB | 442/501 kB Progress (2): 556/780 kB | 442/501 kB Progress (2): 573/780 kB | 442/501 kB Progress (2): 589/780 kB | 442/501 kB Progress (2): 605/780 kB | 442/501 kB Progress (2): 622/780 kB | 442/501 kB Progress (2): 622/780 kB | 459/501 kB Progress (2): 622/780 kB | 475/501 kB Progress (2): 638/780 kB | 475/501 kB Progress (2): 638/780 kB | 492/501 kB Progress (2): 638/780 kB | 501 kB Progress (2): 655/780 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.8 MB/s) 2024-09-12T18:41:33.736 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 671/780 kB Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T18:41:33.740 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 687/780 kB Progress (1): 704/780 kB Progress (1): 720/780 kB Progress (1): 736/780 kB Progress (1): 753/780 kB Progress (1): 769/780 kB Progress (1): 780 kB Progress (2): 780 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.2 MB/s) 2024-09-12T18:41:33.740 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T18:41:33.741 INFO:tasks.workunit.client.0.smithi111.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 34 kB/s) 2024-09-12T18:41:33.741 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T18:41:33.750 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/586 kB Progress (1): 31/586 kB Progress (1): 48/586 kB Progress (1): 64/586 kB Progress (1): 81/586 kB Progress (1): 97/586 kB Progress (1): 113/586 kB Progress (1): 130/586 kB Progress (1): 146/586 kB Progress (1): 162/586 kB Progress (1): 179/586 kB Progress (1): 195/586 kB Progress (1): 212/586 kB Progress (1): 228/586 kB Progress (1): 244/586 kB Progress (1): 261/586 kB Progress (1): 277/586 kB Progress (1): 294/586 kB Progress (1): 310/586 kB Progress (1): 326/586 kB Progress (1): 343/586 kB Progress (1): 359/586 kB Progress (1): 375/586 kB Progress (1): 392/586 kB Progress (1): 408/586 kB Progress (1): 425/586 kB Progress (1): 441/586 kB Progress (1): 457/586 kB Progress (1): 474/586 kB Progress (1): 490/586 kB Progress (1): 507/586 kB Progress (1): 523/586 kB Progress (1): 539/586 kB Progress (1): 556/586 kB Progress (1): 572/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.0 MB/s) 2024-09-12T18:41:33.750 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T18:41:33.753 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/211 kB Progress (1): 33/211 kB Progress (1): 49/211 kB Progress (1): 65/211 kB Progress (1): 81/211 kB Progress (1): 98/211 kB Progress (1): 114/211 kB Progress (1): 131/211 kB Progress (1): 147/211 kB Progress (1): 163/211 kB Progress (1): 180/211 kB Progress (2): 180/211 kB | 14 kB Progress (2): 196/211 kB | 14 kB Progress (2): 211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 72 kB/s) 2024-09-12T18:41:33.754 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T18:41:33.754 INFO:tasks.workunit.client.0.smithi111.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.1 MB/s) 2024-09-12T18:41:33.754 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T18:41:33.757 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 34 kB/s) 2024-09-12T18:41:33.757 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T18:41:33.762 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/106 kB Progress (1): 33/106 kB Progress (1): 49/106 kB Progress (1): 66/106 kB Progress (1): 81/106 kB Progress (1): 98/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 511 kB/s) 2024-09-12T18:41:33.762 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T18:41:33.772 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 79/245 kB Progress (1): 95/245 kB Progress (1): 112/245 kB Progress (1): 128/245 kB Progress (1): 145/245 kB Progress (1): 161/245 kB Progress (1): 177/245 kB Progress (1): 194/245 kB Progress (1): 210/245 kB Progress (1): 226/245 kB Progress (2): 226/245 kB | 15 kB Progress (3): 226/245 kB | 15 kB | 16/205 kB Progress (3): 243/245 kB | 15 kB | 16/205 kB Progress (3): 245 kB | 15 kB | 16/205 kB Progress (3): 245 kB | 15 kB | 33/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 71 kB/s) 2024-09-12T18:41:33.772 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T18:41:33.772 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 245 kB | 49/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.1 MB/s) 2024-09-12T18:41:33.772 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T18:41:33.774 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 66/205 kB Progress (1): 82/205 kB Progress (1): 98/205 kB Progress (1): 115/205 kB Progress (1): 131/205 kB Progress (1): 147/205 kB Progress (1): 164/205 kB Progress (1): 180/205 kB Progress (2): 180/205 kB | 16/16 kB Progress (2): 197/205 kB | 16/16 kB Progress (2): 197/205 kB | 16 kB Progress (2): 205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 935 kB/s) 2024-09-12T18:41:33.774 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T18:41:33.774 INFO:tasks.workunit.client.0.smithi111.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 75 kB/s) 2024-09-12T18:41:33.774 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T18:41:33.779 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 28 kB/s) 2024-09-12T18:41:33.786 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Progress (2): 23 kB | 16/24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 98 kB/s) 2024-09-12T18:41:33.786 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 104 kB/s) 2024-09-12T18:41:33.789 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 74 kB/s) 2024-09-12T18:41:33.795 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 766 kB/s) 2024-09-12T18:41:33.831 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:33.831 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T18:41:33.842 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T18:41:33.859 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 343 kB/s) 2024-09-12T18:41:33.863 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T18:41:33.880 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 300 kB/s) 2024-09-12T18:41:33.884 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T18:41:33.900 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/43 kB Progress (1): 32/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.5 MB/s) 2024-09-12T18:41:33.909 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T18:41:33.926 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 839 kB/s) 2024-09-12T18:41:33.934 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T18:41:33.955 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 98/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 7.3 MB/s) 2024-09-12T18:41:33.955 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T18:41:33.975 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 63/215 kB Progress (1): 80/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 129/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-09-12T18:41:34.051 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:34.051 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T18:41:34.059 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T18:41:34.078 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 133 kB/s) 2024-09-12T18:41:34.081 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T18:41:34.101 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.2 MB/s) 2024-09-12T18:41:34.106 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T18:41:34.123 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 548 kB/s) 2024-09-12T18:41:34.127 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T18:41:34.143 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.6 MB/s) 2024-09-12T18:41:34.150 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T18:41:34.166 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 377 kB/s) 2024-09-12T18:41:34.170 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T18:41:34.185 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 215 kB/s) 2024-09-12T18:41:34.192 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T18:41:34.207 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-12T18:41:34.210 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T18:41:34.225 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 183 kB/s) 2024-09-12T18:41:34.228 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T18:41:34.242 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 940 kB/s) 2024-09-12T18:41:34.245 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T18:41:34.261 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 214 kB/s) 2024-09-12T18:41:34.262 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T18:41:34.277 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-12T18:41:34.280 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T18:41:34.297 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 558 kB/s) 2024-09-12T18:41:34.298 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T18:41:34.313 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-12T18:41:34.317 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T18:41:34.332 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-12T18:41:34.339 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T18:41:34.359 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-12T18:41:34.359 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T18:41:34.371 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.0 MB/s) 2024-09-12T18:41:34.378 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T18:41:34.392 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-12T18:41:34.398 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T18:41:34.415 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.0 MB/s) 2024-09-12T18:41:34.415 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T18:41:34.416 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T18:41:34.416 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T18:41:34.416 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T18:41:34.416 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T18:41:34.430 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/55 kB Progress (2): 2.5 kB | 33/55 kB Progress (2): 2.5 kB | 49/55 kB Progress (2): 2.5 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 178 kB/s) 2024-09-12T18:41:34.431 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 55 kB | 16/269 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T18:41:34.431 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (3): 55 kB | 16/269 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.4 MB/s) 2024-09-12T18:41:34.431 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T18:41:34.432 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (3): 16/269 kB | 16/41 kB | 8.5 kB Progress (3): 33/269 kB | 16/41 kB | 8.5 kB Progress (3): 33/269 kB | 33/41 kB | 8.5 kB Progress (3): 49/269 kB | 33/41 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-12T18:41:34.432 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 49/269 kB | 41 kB Progress (2): 62/269 kB | 41 kB Progress (2): 78/269 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.6 MB/s) 2024-09-12T18:41:34.436 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 95/269 kB Progress (1): 111/269 kB Progress (1): 127/269 kB Progress (1): 144/269 kB Progress (1): 160/269 kB Progress (1): 177/269 kB Progress (1): 193/269 kB Progress (1): 209/269 kB Progress (1): 226/269 kB Progress (1): 242/269 kB Progress (1): 258/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-09-12T18:41:34.453 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/587 kB Progress (2): 16/587 kB | 16/327 kB Progress (2): 33/587 kB | 16/327 kB Progress (2): 33/587 kB | 33/327 kB Progress (2): 49/587 kB | 33/327 kB Progress (2): 66/587 kB | 33/327 kB Progress (2): 66/587 kB | 49/327 kB Progress (2): 82/587 kB | 49/327 kB Progress (2): 82/587 kB | 65/327 kB Progress (2): 98/587 kB | 65/327 kB Progress (2): 115/587 kB | 65/327 kB Progress (2): 115/587 kB | 81/327 kB Progress (2): 131/587 kB | 81/327 kB Progress (2): 131/587 kB | 98/327 kB Progress (2): 147/587 kB | 98/327 kB Progress (2): 164/587 kB | 98/327 kB Progress (2): 164/587 kB | 114/327 kB Progress (2): 180/587 kB | 114/327 kB Progress (2): 197/587 kB | 114/327 kB Progress (2): 197/587 kB | 130/327 kB Progress (2): 213/587 kB | 130/327 kB Progress (2): 213/587 kB | 147/327 kB Progress (2): 229/587 kB | 147/327 kB Progress (2): 246/587 kB | 147/327 kB Progress (2): 246/587 kB | 163/327 kB Progress (2): 262/587 kB | 163/327 kB Progress (2): 262/587 kB | 179/327 kB Progress (2): 279/587 kB | 179/327 kB Progress (2): 295/587 kB | 179/327 kB Progress (2): 295/587 kB | 196/327 kB Progress (2): 311/587 kB | 196/327 kB Progress (2): 311/587 kB | 212/327 kB Progress (2): 328/587 kB | 212/327 kB Progress (2): 344/587 kB | 212/327 kB Progress (2): 344/587 kB | 229/327 kB Progress (2): 360/587 kB | 229/327 kB Progress (2): 360/587 kB | 245/327 kB Progress (2): 377/587 kB | 245/327 kB Progress (2): 393/587 kB | 245/327 kB Progress (2): 393/587 kB | 261/327 kB Progress (2): 410/587 kB | 261/327 kB Progress (2): 410/587 kB | 278/327 kB Progress (2): 426/587 kB | 278/327 kB Progress (2): 442/587 kB | 278/327 kB Progress (2): 442/587 kB | 294/327 kB Progress (2): 459/587 kB | 294/327 kB Progress (2): 459/587 kB | 311/327 kB Progress (2): 475/587 kB | 311/327 kB Progress (2): 492/587 kB | 311/327 kB Progress (2): 492/587 kB | 327/327 kB Progress (2): 492/587 kB | 327 kB Progress (2): 508/587 kB | 327 kB Progress (2): 524/587 kB | 327 kB Progress (2): 541/587 kB | 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.8 MB/s) 2024-09-12T18:41:34.456 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 557/587 kB Progress (1): 573/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 15 MB/s) 2024-09-12T18:41:34.492 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T18:41:34.493 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:34.494 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T18:41:34.497 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T18:41:34.511 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 339 kB/s) 2024-09-12T18:41:34.513 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T18:41:34.527 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-12T18:41:34.530 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T18:41:34.544 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-12T18:41:34.546 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T18:41:34.561 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-12T18:41:34.564 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T18:41:34.579 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 58 kB/s) 2024-09-12T18:41:34.581 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T18:41:34.595 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-12T18:41:34.597 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T18:41:34.612 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T18:41:34.615 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T18:41:34.630 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-12T18:41:34.632 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T18:41:34.646 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-12T18:41:34.650 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T18:41:34.664 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-12T18:41:34.667 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T18:41:34.681 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 806 kB/s) 2024-09-12T18:41:34.684 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T18:41:34.698 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.2 MB/s) 2024-09-12T18:41:34.700 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T18:41:34.715 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 438 kB/s) 2024-09-12T18:41:34.718 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T18:41:34.733 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-12T18:41:34.735 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T18:41:34.749 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 559 kB/s) 2024-09-12T18:41:34.751 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T18:41:34.766 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 191 kB/s) 2024-09-12T18:41:34.769 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T18:41:34.783 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-12T18:41:34.785 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T18:41:34.800 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 81 kB/s) 2024-09-12T18:41:34.803 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T18:41:34.817 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-12T18:41:34.819 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T18:41:34.833 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-12T18:41:34.835 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T18:41:34.849 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-12T18:41:34.852 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T18:41:34.867 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-12T18:41:34.869 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T18:41:34.885 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-12T18:41:34.892 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T18:41:34.906 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-09-12T18:41:34.907 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T18:41:34.907 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T18:41:34.908 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T18:41:34.908 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T18:41:34.908 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T18:41:34.924 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/122 kB Progress (3): 4.2 kB | 16/122 kB | 16/55 kB Progress (3): 4.2 kB | 32/122 kB | 16/55 kB Progress (4): 4.2 kB | 32/122 kB | 16/55 kB | 16/27 kB Progress (4): 4.2 kB | 49/122 kB | 16/55 kB | 16/27 kB Progress (4): 4.2 kB | 49/122 kB | 33/55 kB | 16/27 kB Progress (5): 4.2 kB | 49/122 kB | 33/55 kB | 16/27 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 263 kB/s) 2024-09-12T18:41:34.924 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (4): 65/122 kB | 33/55 kB | 16/27 kB | 16/334 kB Progress (4): 65/122 kB | 33/55 kB | 27 kB | 16/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T18:41:34.924 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (4): 65/122 kB | 49/55 kB | 27 kB | 16/334 kB Progress (4): 65/122 kB | 49/55 kB | 27 kB | 33/334 kB Progress (4): 81/122 kB | 49/55 kB | 27 kB | 33/334 kB Progress (4): 81/122 kB | 55 kB | 27 kB | 33/334 kB Progress (4): 81/122 kB | 55 kB | 27 kB | 49/334 kB Progress (4): 98/122 kB | 55 kB | 27 kB | 49/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.7 MB/s) 2024-09-12T18:41:34.924 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (3): 98/122 kB | 55 kB | 65/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T18:41:34.924 INFO:tasks.workunit.client.0.smithi111.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.2 MB/s) 2024-09-12T18:41:34.925 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 114/122 kB | 65/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T18:41:34.925 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 114/122 kB | 81/334 kB Progress (2): 122 kB | 81/334 kB Progress (2): 122 kB | 98/334 kB Progress (2): 122 kB | 114/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.8 MB/s) 2024-09-12T18:41:34.930 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 130/334 kB Progress (1): 147/334 kB Progress (1): 163/334 kB Progress (1): 180/334 kB Progress (1): 196/334 kB Progress (1): 212/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 261/334 kB Progress (1): 278/334 kB Progress (1): 294/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 15 MB/s) 2024-09-12T18:41:34.938 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.7 kB Progress (2): 4.7 kB | 16/267 kB Progress (2): 4.7 kB | 32/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 155 kB/s) 2024-09-12T18:41:34.938 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 32/267 kB | 16/23 kB Progress (2): 49/267 kB | 16/23 kB Progress (2): 49/267 kB | 23 kB Progress (2): 65/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 735 kB/s) 2024-09-12T18:41:34.942 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (1): 147/267 kB Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.6 MB/s) 2024-09-12T18:41:35.062 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T18:41:35.063 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T18:41:36.209 INFO:tasks.workunit.client.0.smithi111.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T18:41:36.209 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:36.209 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T18:41:36.212 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T18:41:36.212 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:36.212 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T18:41:36.217 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T18:41:36.217 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T18:41:36.465 INFO:tasks.workunit.client.0.smithi111.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T18:41:36.465 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:36.465 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T18:41:36.472 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T18:41:36.487 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-12T18:41:36.490 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T18:41:36.504 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-12T18:41:36.507 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T18:41:36.521 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 233 kB/s) 2024-09-12T18:41:36.526 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T18:41:36.541 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-12T18:41:36.545 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T18:41:36.559 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-12T18:41:36.564 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T18:41:36.579 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-12T18:41:36.582 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T18:41:36.596 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 117 kB/s) 2024-09-12T18:41:36.601 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T18:41:36.616 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 146 kB/s) 2024-09-12T18:41:36.617 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T18:41:36.632 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-12T18:41:36.635 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T18:41:36.649 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-12T18:41:36.652 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T18:41:36.667 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-12T18:41:36.671 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T18:41:36.686 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 157 kB/s) 2024-09-12T18:41:36.688 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T18:41:36.703 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-12T18:41:36.706 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T18:41:36.722 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 15/37 kB Progress (1): 31/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.3 MB/s) 2024-09-12T18:41:36.725 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T18:41:36.739 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-12T18:41:36.744 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T18:41:36.757 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 577 kB/s) 2024-09-12T18:41:36.759 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T18:41:36.780 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.3 MB/s) 2024-09-12T18:41:36.784 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T18:41:36.799 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-12T18:41:36.804 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T18:41:36.818 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-12T18:41:36.822 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T18:41:36.836 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 200 kB/s) 2024-09-12T18:41:36.839 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T18:41:36.854 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 103 kB/s) 2024-09-12T18:41:36.855 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T18:41:36.870 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 204 kB/s) 2024-09-12T18:41:36.872 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T18:41:36.889 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.2 MB/s) 2024-09-12T18:41:36.891 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T18:41:36.905 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 451 kB/s) 2024-09-12T18:41:36.908 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T18:41:36.922 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-12T18:41:36.924 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T18:41:36.938 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 228 kB/s) 2024-09-12T18:41:36.939 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T18:41:36.952 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-12T18:41:36.954 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T18:41:36.969 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 560 kB/s) 2024-09-12T18:41:36.972 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T18:41:36.986 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 138 kB/s) 2024-09-12T18:41:36.990 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T18:41:37.004 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 149 kB/s) 2024-09-12T18:41:37.009 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T18:41:37.023 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-12T18:41:37.027 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T18:41:37.043 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-12T18:41:37.045 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T18:41:37.060 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-12T18:41:37.063 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T18:41:37.077 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-12T18:41:37.079 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T18:41:37.093 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-12T18:41:37.095 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T18:41:37.109 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-12T18:41:37.110 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T18:41:37.124 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.3 MB/s) 2024-09-12T18:41:37.127 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T18:41:37.141 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.3 MB/s) 2024-09-12T18:41:37.143 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T18:41:37.157 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 987 kB/s) 2024-09-12T18:41:37.161 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T18:41:37.178 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 42 kB/s) 2024-09-12T18:41:37.180 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T18:41:37.194 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-12T18:41:37.197 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T18:41:37.211 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-12T18:41:37.213 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T18:41:37.226 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-12T18:41:37.230 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T18:41:37.244 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-12T18:41:37.246 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T18:41:37.260 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 158 kB/s) 2024-09-12T18:41:37.262 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T18:41:37.275 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-12T18:41:37.278 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T18:41:37.291 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-12T18:41:37.293 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T18:41:37.307 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-12T18:41:37.309 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T18:41:37.322 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-12T18:41:37.325 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T18:41:37.339 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-12T18:41:37.340 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T18:41:37.354 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 407 kB/s) 2024-09-12T18:41:37.356 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T18:41:37.370 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 524 kB/s) 2024-09-12T18:41:37.371 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T18:41:37.385 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-12T18:41:37.388 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T18:41:37.402 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-12T18:41:37.406 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T18:41:37.420 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-12T18:41:37.422 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T18:41:37.437 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.6 MB/s) 2024-09-12T18:41:37.441 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T18:41:37.455 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-12T18:41:37.457 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T18:41:37.471 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-12T18:41:37.473 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T18:41:37.487 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-12T18:41:37.489 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T18:41:37.503 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-12T18:41:37.504 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T18:41:37.520 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.9 MB/s) 2024-09-12T18:41:37.522 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T18:41:37.535 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 169 kB/s) 2024-09-12T18:41:37.542 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T18:41:37.565 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 15 MB/s) 2024-09-12T18:41:37.565 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T18:41:37.565 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T18:41:37.566 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T18:41:37.566 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T18:41:37.566 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T18:41:37.581 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/118 kB Progress (1): 33/118 kB Progress (1): 49/118 kB Progress (1): 64/118 kB Progress (2): 64/118 kB | 14 kB Progress (2): 81/118 kB | 14 kB Progress (3): 81/118 kB | 14 kB | 16/171 kB Progress (3): 97/118 kB | 14 kB | 16/171 kB Progress (3): 113/118 kB | 14 kB | 16/171 kB Progress (3): 113/118 kB | 14 kB | 31/171 kB Progress (3): 118 kB | 14 kB | 31/171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 799 kB/s) 2024-09-12T18:41:37.581 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T18:41:37.581 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (3): 118 kB | 31/171 kB | 16/26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.9 MB/s) 2024-09-12T18:41:37.581 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T18:41:37.583 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 48/171 kB | 16/26 kB Progress (2): 48/171 kB | 26 kB Progress (2): 64/171 kB | 26 kB Progress (2): 77/171 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.4 MB/s) 2024-09-12T18:41:37.583 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T18:41:37.583 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 93/171 kB Progress (2): 93/171 kB | 2.7/8.2 kB Progress (2): 93/171 kB | 4.1/8.2 kB Progress (2): 109/171 kB | 4.1/8.2 kB Progress (2): 109/171 kB | 5.5/8.2 kB Progress (2): 109/171 kB | 8.2 kB Progress (2): 126/171 kB | 8.2 kB Progress (2): 142/171 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 430 kB/s) 2024-09-12T18:41:37.584 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T18:41:37.584 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 158/171 kB Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 8.5 MB/s) 2024-09-12T18:41:37.584 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T18:41:37.598 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/136 kB Progress (2): 16/136 kB | 16/61 kB Progress (2): 33/136 kB | 16/61 kB Progress (2): 49/136 kB | 16/61 kB Progress (2): 49/136 kB | 32/61 kB Progress (2): 66/136 kB | 32/61 kB Progress (2): 66/136 kB | 49/61 kB Progress (2): 82/136 kB | 49/61 kB Progress (2): 82/136 kB | 61 kB Progress (3): 82/136 kB | 61 kB | 16/146 kB Progress (3): 98/136 kB | 61 kB | 16/146 kB Progress (3): 115/136 kB | 61 kB | 16/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.9 MB/s) 2024-09-12T18:41:37.598 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 115/136 kB | 32/146 kB Progress (2): 131/136 kB | 32/146 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T18:41:37.598 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 136 kB | 32/146 kB Progress (3): 136 kB | 32/146 kB | 15/501 kB Progress (4): 136 kB | 32/146 kB | 15/501 kB | 16/58 kB Progress (4): 136 kB | 49/146 kB | 15/501 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.3 MB/s) 2024-09-12T18:41:37.598 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T18:41:37.598 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (3): 49/146 kB | 15/501 kB | 33/58 kB Progress (3): 49/146 kB | 31/501 kB | 33/58 kB Progress (3): 65/146 kB | 31/501 kB | 33/58 kB Progress (3): 65/146 kB | 31/501 kB | 49/58 kB Progress (3): 65/146 kB | 48/501 kB | 49/58 kB Progress (3): 65/146 kB | 48/501 kB | 58 kB Progress (3): 81/146 kB | 48/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.7 MB/s) 2024-09-12T18:41:37.599 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 81/146 kB | 64/501 kB Progress (2): 98/146 kB | 64/501 kB Progress (2): 98/146 kB | 77/501 kB Progress (2): 98/146 kB | 93/501 kB Progress (2): 114/146 kB | 93/501 kB Progress (2): 114/146 kB | 110/501 kB Progress (2): 130/146 kB | 110/501 kB Progress (2): 130/146 kB | 126/501 kB Progress (2): 146 kB | 126/501 kB Progress (2): 146 kB | 143/501 kB Progress (2): 146 kB | 159/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.1 MB/s) 2024-09-12T18:41:37.606 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 175/501 kB Progress (1): 192/501 kB Progress (1): 208/501 kB Progress (1): 224/501 kB Progress (1): 241/501 kB Progress (1): 257/501 kB Progress (1): 274/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 310/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 392/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 474/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 12 MB/s) 2024-09-12T18:41:37.612 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (2): 66/124 kB | 0/2.4 MB Progress (2): 82/124 kB | 0/2.4 MB Progress (2): 82/124 kB | 0/2.4 MB Progress (2): 98/124 kB | 0/2.4 MB Progress (2): 98/124 kB | 0/2.4 MB Progress (2): 98/124 kB | 0.1/2.4 MB Progress (2): 115/124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.6 MB/s) 2024-09-12T18:41:37.646 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 30 MB/s) 2024-09-12T18:41:37.758 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:37.758 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T18:41:37.760 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T18:41:37.775 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-12T18:41:37.777 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T18:41:37.791 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 326 kB/s) 2024-09-12T18:41:37.793 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T18:41:37.807 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-12T18:41:37.810 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T18:41:37.825 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-12T18:41:37.827 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T18:41:37.841 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-12T18:41:37.844 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T18:41:37.858 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-12T18:41:37.861 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T18:41:37.876 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 376 kB/s) 2024-09-12T18:41:37.879 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T18:41:37.894 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-12T18:41:37.897 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T18:41:37.914 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.1 MB/s) 2024-09-12T18:41:37.918 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T18:41:37.932 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-12T18:41:37.934 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T18:41:37.948 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-12T18:41:37.952 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T18:41:37.966 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-12T18:41:37.969 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T18:41:37.984 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-12T18:41:37.993 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T18:41:38.008 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.3 MB/s) 2024-09-12T18:41:38.009 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T18:41:38.009 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T18:41:38.009 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T18:41:38.010 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T18:41:38.010 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T18:41:38.024 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/26 kB Progress (2): 16/26 kB | 15/211 kB Progress (3): 16/26 kB | 15/211 kB | 16/58 kB Progress (4): 16/26 kB | 15/211 kB | 16/58 kB | 0/1.0 MB Progress (4): 26 kB | 15/211 kB | 16/58 kB | 0/1.0 MB Progress (4): 26 kB | 31/211 kB | 16/58 kB | 0/1.0 MB Progress (4): 26 kB | 31/211 kB | 33/58 kB | 0/1.0 MB Progress (4): 26 kB | 31/211 kB | 33/58 kB | 0/1.0 MB Progress (5): 26 kB | 31/211 kB | 33/58 kB | 0/1.0 MB | 15/79 kB Progress (5): 26 kB | 48/211 kB | 33/58 kB | 0/1.0 MB | 15/79 kB Progress (5): 26 kB | 48/211 kB | 49/58 kB | 0/1.0 MB | 15/79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.7 MB/s) 2024-09-12T18:41:38.025 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T18:41:38.025 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (4): 64/211 kB | 49/58 kB | 0/1.0 MB | 15/79 kB Progress (4): 64/211 kB | 58 kB | 0/1.0 MB | 15/79 kB Progress (4): 81/211 kB | 58 kB | 0/1.0 MB | 15/79 kB Progress (4): 97/211 kB | 58 kB | 0/1.0 MB | 15/79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.9 MB/s) 2024-09-12T18:41:38.026 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T18:41:38.028 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (3): 113/211 kB | 0/1.0 MB | 15/79 kB Progress (3): 130/211 kB | 0/1.0 MB | 15/79 kB Progress (3): 146/211 kB | 0/1.0 MB | 15/79 kB Progress (3): 162/211 kB | 0/1.0 MB | 15/79 kB Progress (3): 179/211 kB | 0/1.0 MB | 15/79 kB Progress (3): 179/211 kB | 0/1.0 MB | 15/79 kB Progress (3): 179/211 kB | 0/1.0 MB | 31/79 kB Progress (3): 179/211 kB | 0.1/1.0 MB | 31/79 kB Progress (3): 195/211 kB | 0.1/1.0 MB | 31/79 kB Progress (3): 195/211 kB | 0.1/1.0 MB | 48/79 kB Progress (3): 195/211 kB | 0.1/1.0 MB | 48/79 kB Progress (3): 211 kB | 0.1/1.0 MB | 48/79 kB Progress (3): 211 kB | 0.1/1.0 MB | 64/79 kB Progress (3): 211 kB | 0.1/1.0 MB | 64/79 kB Progress (3): 211 kB | 0.1/1.0 MB | 79 kB Progress (3): 211 kB | 0.1/1.0 MB | 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-12T18:41:38.028 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 0.1/1.0 MB | 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.2 MB/s) 2024-09-12T18:41:38.041 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (2): 0.8/1.0 MB | 16/116 kB Progress (2): 0.8/1.0 MB | 16/116 kB Progress (2): 0.8/1.0 MB | 33/116 kB Progress (2): 0.8/1.0 MB | 33/116 kB Progress (2): 0.8/1.0 MB | 37/116 kB Progress (2): 0.9/1.0 MB | 37/116 kB Progress (2): 0.9/1.0 MB | 53/116 kB Progress (2): 0.9/1.0 MB | 53/116 kB Progress (2): 0.9/1.0 MB | 69/116 kB Progress (2): 0.9/1.0 MB | 69/116 kB Progress (2): 0.9/1.0 MB | 86/116 kB Progress (3): 0.9/1.0 MB | 86/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 86/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 102/116 kB | 16/267 kB Progress (3): 0.9/1.0 MB | 102/116 kB | 33/267 kB Progress (3): 0.9/1.0 MB | 102/116 kB | 33/267 kB Progress (3): 0.9/1.0 MB | 116 kB | 33/267 kB Progress (3): 0.9/1.0 MB | 116 kB | 49/267 kB Progress (3): 0.9/1.0 MB | 116 kB | 63/267 kB Progress (3): 0.9/1.0 MB | 116 kB | 63/267 kB Progress (3): 0.9/1.0 MB | 116 kB | 79/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.7 MB/s) 2024-09-12T18:41:38.042 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 0.9/1.0 MB | 79/267 kB Progress (2): 0.9/1.0 MB | 96/267 kB Progress (2): 1.0/1.0 MB | 96/267 kB Progress (2): 1.0/1.0 MB | 112/267 kB Progress (2): 1.0/1.0 MB | 112/267 kB Progress (2): 1.0/1.0 MB | 128/267 kB Progress (2): 1.0/1.0 MB | 128/267 kB Progress (2): 1.0/1.0 MB | 145/267 kB Progress (2): 1.0/1.0 MB | 145/267 kB Progress (2): 1.0/1.0 MB | 161/267 kB Progress (2): 1.0 MB | 161/267 kB Progress (2): 1.0 MB | 178/267 kB Progress (2): 1.0 MB | 194/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 32 MB/s) 2024-09-12T18:41:38.043 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 210/267 kB Progress (1): 227/267 kB Progress (1): 243/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.9 MB/s) 2024-09-12T18:41:38.204 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T18:41:38.232 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T18:41:38.232 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] BUILD SUCCESS 2024-09-12T18:41:38.232 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T18:41:38.233 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Total time: 7.009 s 2024-09-12T18:41:38.233 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Finished at: 2024-09-12T18:41:38Z 2024-09-12T18:41:38.233 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T18:41:38.263 INFO:tasks.workunit.client.0.smithi111.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T18:41:38.269 INFO:tasks.workunit.client.0.smithi111.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T18:41:39.477 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Scanning for projects... 2024-09-12T18:41:39.580 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:39.580 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T18:41:39.580 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Building jcksum 1.0 2024-09-12T18:41:39.580 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] from pom.xml 2024-09-12T18:41:39.581 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T18:41:39.958 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:39.959 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T18:41:40.110 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T18:41:40.111 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:40.111 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T18:41:40.237 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T18:41:40.238 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:40.238 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T18:41:40.240 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T18:41:40.240 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:40.240 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T18:41:40.247 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T18:41:40.247 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:40.247 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T18:41:40.519 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T18:41:40.741 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T18:41:40.952 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 21 kB/s) 2024-09-12T18:41:40.961 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T18:41:40.982 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 119 kB/s) 2024-09-12T18:41:40.990 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T18:41:41.009 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 148 kB/s) 2024-09-12T18:41:41.015 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T18:41:41.032 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 168 kB/s) 2024-09-12T18:41:41.035 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T18:41:41.053 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 169 kB/s) 2024-09-12T18:41:41.057 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T18:41:41.073 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-12T18:41:41.076 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T18:41:41.091 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-12T18:41:41.098 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T18:41:41.122 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-09-12T18:41:41.124 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T18:41:41.124 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T18:41:41.124 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T18:41:41.124 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T18:41:41.125 INFO:tasks.workunit.client.0.smithi111.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T18:41:41.167 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 16/189 kB Progress (1): 33/189 kB Progress (1): 49/189 kB Progress (1): 66/189 kB Progress (1): 79/189 kB Progress (1): 96/189 kB Progress (1): 112/189 kB Progress (1): 128/189 kB Progress (1): 145/189 kB Progress (1): 161/189 kB Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 4.3 MB/s) 2024-09-12T18:41:41.180 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/169 kB Progress (3): 1.4/7.7 kB | 1.4/169 kB | 1.4/18 kB Progress (3): 2.8/7.7 kB | 1.4/169 kB | 1.4/18 kB Progress (4): 2.8/7.7 kB | 1.4/169 kB | 1.4/18 kB | 1.4/103 kB Progress (4): 2.8/7.7 kB | 1.4/169 kB | 2.8/18 kB | 1.4/103 kB Progress (4): 2.8/7.7 kB | 2.8/169 kB | 2.8/18 kB | 1.4/103 kB Progress (4): 2.8/7.7 kB | 2.8/169 kB | 4.1/18 kB | 1.4/103 kB Progress (4): 2.8/7.7 kB | 2.8/169 kB | 4.1/18 kB | 2.8/103 kB Progress (4): 4.1/7.7 kB | 2.8/169 kB | 4.1/18 kB | 2.8/103 kB Progress (4): 4.1/7.7 kB | 2.8/169 kB | 4.1/18 kB | 4.1/103 kB Progress (4): 4.1/7.7 kB | 2.8/169 kB | 5.5/18 kB | 4.1/103 kB Progress (4): 4.1/7.7 kB | 4.1/169 kB | 5.5/18 kB | 4.1/103 kB Progress (4): 4.1/7.7 kB | 4.1/169 kB | 6.9/18 kB | 4.1/103 kB Progress (4): 4.1/7.7 kB | 4.1/169 kB | 6.9/18 kB | 5.5/103 kB Progress (4): 5.5/7.7 kB | 4.1/169 kB | 6.9/18 kB | 5.5/103 kB Progress (4): 5.5/7.7 kB | 4.1/169 kB | 6.9/18 kB | 6.9/103 kB Progress (4): 5.5/7.7 kB | 4.1/169 kB | 8.3/18 kB | 6.9/103 kB Progress (4): 5.5/7.7 kB | 5.5/169 kB | 8.3/18 kB | 6.9/103 kB Progress (4): 5.5/7.7 kB | 5.5/169 kB | 9.7/18 kB | 6.9/103 kB Progress (4): 5.5/7.7 kB | 5.5/169 kB | 9.7/18 kB | 8.3/103 kB Progress (4): 6.9/7.7 kB | 5.5/169 kB | 9.7/18 kB | 8.3/103 kB Progress (4): 6.9/7.7 kB | 5.5/169 kB | 9.7/18 kB | 9.7/103 kB Progress (4): 6.9/7.7 kB | 5.5/169 kB | 11/18 kB | 9.7/103 kB Progress (4): 6.9/7.7 kB | 6.9/169 kB | 11/18 kB | 9.7/103 kB Progress (4): 6.9/7.7 kB | 6.9/169 kB | 12/18 kB | 9.7/103 kB Progress (4): 6.9/7.7 kB | 6.9/169 kB | 12/18 kB | 11/103 kB Progress (4): 7.7 kB | 6.9/169 kB | 12/18 kB | 11/103 kB Progress (4): 7.7 kB | 6.9/169 kB | 12/18 kB | 12/103 kB Progress (4): 7.7 kB | 6.9/169 kB | 14/18 kB | 12/103 kB Progress (4): 7.7 kB | 8.3/169 kB | 14/18 kB | 12/103 kB Progress (4): 7.7 kB | 8.3/169 kB | 15/18 kB | 12/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 137 kB/s) 2024-09-12T18:41:41.182 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (3): 8.3/169 kB | 15/18 kB | 14/103 kB Progress (3): 8.3/169 kB | 16/18 kB | 14/103 kB Progress (3): 9.7/169 kB | 16/18 kB | 14/103 kB Progress (3): 9.7/169 kB | 17/18 kB | 14/103 kB Progress (3): 9.7/169 kB | 17/18 kB | 15/103 kB Progress (3): 9.7/169 kB | 18 kB | 15/103 kB Progress (3): 11/169 kB | 18 kB | 15/103 kB Progress (3): 11/169 kB | 18 kB | 16/103 kB Progress (3): 12/169 kB | 18 kB | 16/103 kB Progress (3): 12/169 kB | 18 kB | 18/103 kB Progress (3): 14/169 kB | 18 kB | 18/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 288 kB/s) 2024-09-12T18:41:41.198 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (2): 15/169 kB | 18/103 kB Progress (2): 15/169 kB | 19/103 kB Progress (2): 17/169 kB | 19/103 kB Progress (2): 17/169 kB | 21/103 kB Progress (2): 18/169 kB | 21/103 kB Progress (2): 18/169 kB | 22/103 kB Progress (2): 19/169 kB | 22/103 kB Progress (2): 19/169 kB | 23/103 kB Progress (2): 21/169 kB | 23/103 kB Progress (2): 21/169 kB | 25/103 kB Progress (2): 22/169 kB | 25/103 kB Progress (2): 22/169 kB | 26/103 kB Progress (2): 23/169 kB | 26/103 kB Progress (2): 23/169 kB | 27/103 kB Progress (2): 25/169 kB | 27/103 kB Progress (2): 25/169 kB | 29/103 kB Progress (2): 26/169 kB | 29/103 kB Progress (2): 26/169 kB | 30/103 kB Progress (2): 28/169 kB | 30/103 kB Progress (2): 28/169 kB | 32/103 kB Progress (2): 29/169 kB | 32/103 kB Progress (2): 29/169 kB | 33/103 kB Progress (2): 30/169 kB | 33/103 kB Progress (2): 30/169 kB | 34/103 kB Progress (2): 32/169 kB | 34/103 kB Progress (2): 32/169 kB | 36/103 kB Progress (2): 33/169 kB | 36/103 kB Progress (2): 33/169 kB | 37/103 kB Progress (2): 34/169 kB | 37/103 kB Progress (2): 34/169 kB | 38/103 kB Progress (2): 36/169 kB | 38/103 kB Progress (2): 36/169 kB | 40/103 kB Progress (2): 37/169 kB | 40/103 kB Progress (2): 37/169 kB | 41/103 kB Progress (2): 39/169 kB | 41/103 kB Progress (2): 39/169 kB | 43/103 kB Progress (2): 40/169 kB | 43/103 kB Progress (2): 40/169 kB | 44/103 kB Progress (2): 41/169 kB | 44/103 kB Progress (2): 41/169 kB | 45/103 kB Progress (2): 43/169 kB | 45/103 kB Progress (2): 43/169 kB | 47/103 kB Progress (2): 44/169 kB | 47/103 kB Progress (2): 44/169 kB | 48/103 kB Progress (2): 46/169 kB | 48/103 kB Progress (2): 46/169 kB | 49/103 kB Progress (2): 47/169 kB | 49/103 kB Progress (2): 47/169 kB | 51/103 kB Progress (2): 48/169 kB | 51/103 kB Progress (2): 48/169 kB | 52/103 kB Progress (2): 49/169 kB | 52/103 kB Progress (2): 49/169 kB | 54/103 kB Progress (2): 49/169 kB | 55/103 kB Progress (2): 66/169 kB | 55/103 kB Progress (2): 66/169 kB | 56/103 kB Progress (2): 66/169 kB | 58/103 kB Progress (2): 66/169 kB | 59/103 kB Progress (2): 66/169 kB | 61/103 kB Progress (2): 66/169 kB | 62/103 kB Progress (2): 66/169 kB | 62/103 kB Progress (2): 66/169 kB | 79/103 kB Progress (2): 66/169 kB | 95/103 kB Progress (2): 66/169 kB | 103 kB Progress (2): 82/169 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.4 MB/s) 2024-09-12T18:41:41.210 INFO:tasks.workunit.client.0.smithi111.stdout:Progress (1): 98/169 kB Progress (1): 115/169 kB Progress (1): 131/169 kB Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.9 MB/s) 2024-09-12T18:41:41.226 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:41.226 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] ------------------------------------------------------- 2024-09-12T18:41:41.226 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] T E S T S 2024-09-12T18:41:41.226 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] ------------------------------------------------------- 2024-09-12T18:41:41.841 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T18:41:41.923 INFO:tasks.workunit.client.0.smithi111.stdout:PutObjects.java: starting test run: 2024-09-12T18:41:41.923 INFO:tasks.workunit.client.0.smithi111.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T18:41:41.923 INFO:tasks.workunit.client.0.smithi111.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T18:41:41.924 INFO:tasks.workunit.client.0.smithi111.stdout: EndpointUrl=https://smithi111.front.sepia.ceph.com:443 2024-09-12T18:41:41.924 INFO:tasks.workunit.client.0.smithi111.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T18:41:42.120 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: Environment Variables Read 2024-09-12T18:41:42.422 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: S3 Client Initialized 2024-09-12T18:41:42.422 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: Generating File 2024-09-12T18:41:42.422 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: File Generated 2024-09-12T18:41:42.422 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: Generating File 2024-09-12T18:41:42.422 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: File Generated 2024-09-12T18:41:42.423 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: Generating File 2024-09-12T18:41:42.423 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: File Generated 2024-09-12T18:41:42.423 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: Generating File 2024-09-12T18:41:42.423 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: File Generated 2024-09-12T18:41:42.423 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: Generating File 2024-09-12T18:41:42.423 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: File Generated 2024-09-12T18:41:42.423 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: Generating File 2024-09-12T18:41:42.423 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: File Generated 2024-09-12T18:41:42.423 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: Generated Big Files 2024-09-12T18:41:42.806 INFO:tasks.workunit.client.0.smithi111.stdout:HeadBucketResponse() 2024-09-12T18:41:42.806 INFO:tasks.workunit.client.0.smithi111.stdout:sheik is ready 2024-09-12T18:41:42.806 INFO:tasks.workunit.client.0.smithi111.stdout:DEBUG: Test Bucket Created 2024-09-12T18:41:42.834 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T18:41:43.032 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T18:41:43.035 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T18:41:43.135 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T18:41:43.236 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T18:41:43.336 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T18:41:43.436 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T18:41:43.536 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T18:41:43.737 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T18:41:43.837 INFO:tasks.workunit.client.0.smithi111.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T18:41:46.041 INFO:tasks.workunit.client.0.smithi111.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T18:41:46.545 INFO:tasks.workunit.client.0.smithi111.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T18:41:49.924 INFO:tasks.workunit.client.0.smithi111.stdout:arg: file-0b 2024-09-12T18:41:49.925 INFO:tasks.workunit.client.0.smithi111.stdout:arg: file-8b 2024-09-12T18:41:49.926 INFO:tasks.workunit.client.0.smithi111.stdout:arg: file-200b 2024-09-12T18:41:49.927 INFO:tasks.workunit.client.0.smithi111.stdout:arg: file-21983b 2024-09-12T18:41:49.928 INFO:tasks.workunit.client.0.smithi111.stdout:arg: file-5519b 2024-09-12T18:41:49.929 INFO:tasks.workunit.client.0.smithi111.stdout:arg: file-204329b 2024-09-12T18:41:49.930 INFO:tasks.workunit.client.0.smithi111.stdout:arg: file-256k 2024-09-12T18:41:49.931 INFO:tasks.workunit.client.0.smithi111.stdout:arg: file-1m 2024-09-12T18:41:49.932 INFO:tasks.workunit.client.0.smithi111.stdout:arg: file-1038757b 2024-09-12T18:41:49.952 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T18:41:49.976 INFO:tasks.workunit.client.0.smithi111.stdout:PutObjectResponse 2024-09-12T18:41:50.044 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T18:41:50.044 INFO:tasks.workunit.client.0.smithi111.stdout:PutObjectResponse 2024-09-12T18:41:50.052 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T18:41:50.117 INFO:tasks.workunit.client.0.smithi111.stdout:PutObjectResponse 2024-09-12T18:41:50.153 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T18:41:50.153 INFO:tasks.workunit.client.0.smithi111.stdout:PutObjectResponse 2024-09-12T18:41:50.253 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T18:41:50.254 INFO:tasks.workunit.client.0.smithi111.stdout:PutObjectResponse 2024-09-12T18:41:50.353 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T18:41:50.354 INFO:tasks.workunit.client.0.smithi111.stdout:PutObjectResponse 2024-09-12T18:41:50.437 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T18:41:50.437 INFO:tasks.workunit.client.0.smithi111.stdout:PutObjectResponse 2024-09-12T18:41:50.453 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T18:41:50.553 INFO:tasks.workunit.client.0.smithi111.stdout:PutObjectResponse 2024-09-12T18:41:50.654 INFO:tasks.workunit.client.0.smithi111.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T18:41:50.709 INFO:tasks.workunit.client.0.smithi111.stdout:PutObjectResponse 2024-09-12T18:41:50.754 INFO:tasks.workunit.client.0.smithi111.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T18:41:51.355 INFO:tasks.workunit.client.0.smithi111.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T18:41:51.956 INFO:tasks.workunit.client.0.smithi111.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T18:41:56.472 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.59 s -- in io.ceph.jcksum.PutObjects 2024-09-12T18:41:56.503 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:56.503 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Results: 2024-09-12T18:41:56.503 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:56.503 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T18:41:56.504 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] 2024-09-12T18:41:56.505 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T18:41:56.505 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] BUILD SUCCESS 2024-09-12T18:41:56.506 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T18:41:56.507 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Total time: 17.051 s 2024-09-12T18:41:56.507 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] Finished at: 2024-09-12T18:41:56Z 2024-09-12T18:41:56.507 INFO:tasks.workunit.client.0.smithi111.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T18:41:56.551 INFO:tasks.workunit.client.0.smithi111.stderr:+ exit 2024-09-12T18:41:56.551 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:41:56.551 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:41:56.606 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T18:41:56.607 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:41:56.983 DEBUG:teuthology.parallel:result is None 2024-09-12T18:41:56.983 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:41:56.996 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:41:56.996 DEBUG:teuthology.orchestra.run.smithi111:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:41:57.043 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:41:57.043 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T18:41:57.055 INFO:tasks.workunit:Pulling workunits from ref d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T18:41:57.055 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T18:41:57.055 DEBUG:teuthology.orchestra.run.smithi111:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:41:57.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:41:57.091 INFO:teuthology.orchestra.run.smithi111.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T18:41:57.091 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:41:57.139 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T18:41:57.139 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T18:41:57.191 INFO:tasks.workunit:timeout=3h 2024-09-12T18:41:57.191 INFO:tasks.workunit:cleanup=True 2024-09-12T18:41:57.192 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T18:41:57.241 INFO:tasks.workunit.client.0.smithi111.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:42:54.768 INFO:tasks.workunit.client.0.smithi111.stderr:Note: switching to 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'. 2024-09-12T18:42:54.769 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:42:54.769 INFO:tasks.workunit.client.0.smithi111.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:42:54.769 INFO:tasks.workunit.client.0.smithi111.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:42:54.769 INFO:tasks.workunit.client.0.smithi111.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:42:54.769 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:42:54.769 INFO:tasks.workunit.client.0.smithi111.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:42:54.770 INFO:tasks.workunit.client.0.smithi111.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:42:54.770 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:42:54.770 INFO:tasks.workunit.client.0.smithi111.stderr: git switch -c 2024-09-12T18:42:54.770 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:42:54.770 INFO:tasks.workunit.client.0.smithi111.stderr:Or undo this operation with: 2024-09-12T18:42:54.770 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:42:54.770 INFO:tasks.workunit.client.0.smithi111.stderr: git switch - 2024-09-12T18:42:54.770 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:42:54.770 INFO:tasks.workunit.client.0.smithi111.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:42:54.770 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:42:54.770 INFO:tasks.workunit.client.0.smithi111.stderr:HEAD is now at d011c522bb1 cls/rgw: duplicate reshard checks in all cls_rgw write operations 2024-09-12T18:42:54.776 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:42:54.824 INFO:tasks.workunit.client.0.smithi111.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:42:54.827 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:42:54.827 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:42:54.878 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:42:54.927 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:42:54.972 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:42:54.974 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:42:54.974 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:42:55.017 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:42:55.020 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:42:55.021 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:42:55.068 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T18:42:55.070 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T18:42:55.071 DEBUG:teuthology.orchestra.run.smithi111:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T18:42:55.123 INFO:tasks.workunit.client.0.smithi111.stdout:INFO: fully qualified domain name: smithi111.front.sepia.ceph.com 2024-09-12T18:42:55.123 INFO:tasks.workunit.client.0.smithi111.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T18:42:55.124 INFO:tasks.workunit.client.0.smithi111.stdout:== TESTING VERSIONED BUCKET == 2024-09-12T18:42:58.430 INFO:tasks.workunit.client.0.smithi111.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T18:42:58.629 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting pip 2024-09-12T18:42:58.635 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T18:42:58.672 INFO:tasks.workunit.client.0.smithi111.stdout:Installing collected packages: pip 2024-09-12T18:42:58.672 INFO:tasks.workunit.client.0.smithi111.stdout: Attempting uninstall: pip 2024-09-12T18:42:58.672 INFO:tasks.workunit.client.0.smithi111.stdout: Found existing installation: pip 22.0.2 2024-09-12T18:42:58.932 INFO:tasks.workunit.client.0.smithi111.stdout: Uninstalling pip-22.0.2: 2024-09-12T18:42:58.938 INFO:tasks.workunit.client.0.smithi111.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T18:42:59.685 INFO:tasks.workunit.client.0.smithi111.stdout:Successfully installed pip-24.2 2024-09-12T18:43:00.714 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting boto3 2024-09-12T18:43:00.716 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T18:43:01.212 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T18:43:01.213 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T18:43:01.268 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T18:43:01.269 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T18:43:01.315 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T18:43:01.316 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T18:43:01.369 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:43:01.370 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T18:43:01.467 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:43:01.468 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T18:43:01.662 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:43:01.663 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T18:43:01.666 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T18:43:01.668 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T18:43:01.677 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T18:43:01.678 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T18:43:01.680 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T18:43:01.681 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T18:43:01.682 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T18:43:01.750 INFO:tasks.workunit.client.0.smithi111.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T18:43:02.734 INFO:tasks.workunit.client.0.smithi111.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T18:43:03.506 INFO:tasks.workunit.client.0.smithi111.stdout:INFO: creating user 2024-09-12T18:43:03.643 INFO:tasks.workunit.client.0.smithi111.stdout:{ 2024-09-12T18:43:03.644 INFO:tasks.workunit.client.0.smithi111.stdout: "user_id": "testid", 2024-09-12T18:43:03.644 INFO:tasks.workunit.client.0.smithi111.stdout: "display_name": "M. Tester", 2024-09-12T18:43:03.644 INFO:tasks.workunit.client.0.smithi111.stdout: "email": "tester@ceph.com", 2024-09-12T18:43:03.644 INFO:tasks.workunit.client.0.smithi111.stdout: "suspended": 0, 2024-09-12T18:43:03.644 INFO:tasks.workunit.client.0.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:43:03.644 INFO:tasks.workunit.client.0.smithi111.stdout: "subusers": [], 2024-09-12T18:43:03.644 INFO:tasks.workunit.client.0.smithi111.stdout: "keys": [ 2024-09-12T18:43:03.644 INFO:tasks.workunit.client.0.smithi111.stdout: { 2024-09-12T18:43:03.644 INFO:tasks.workunit.client.0.smithi111.stdout: "user": "testid", 2024-09-12T18:43:03.644 INFO:tasks.workunit.client.0.smithi111.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T18:43:03.644 INFO:tasks.workunit.client.0.smithi111.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T18:43:03.644 INFO:tasks.workunit.client.0.smithi111.stdout: "active": true, 2024-09-12T18:43:03.645 INFO:tasks.workunit.client.0.smithi111.stdout: "create_date": "2024-09-12T18:43:03.636073Z" 2024-09-12T18:43:03.645 INFO:tasks.workunit.client.0.smithi111.stdout: } 2024-09-12T18:43:03.645 INFO:tasks.workunit.client.0.smithi111.stdout: ], 2024-09-12T18:43:03.645 INFO:tasks.workunit.client.0.smithi111.stdout: "swift_keys": [], 2024-09-12T18:43:03.645 INFO:tasks.workunit.client.0.smithi111.stdout: "caps": [], 2024-09-12T18:43:03.645 INFO:tasks.workunit.client.0.smithi111.stdout: "op_mask": "read, write, delete", 2024-09-12T18:43:03.645 INFO:tasks.workunit.client.0.smithi111.stdout: "default_placement": "", 2024-09-12T18:43:03.645 INFO:tasks.workunit.client.0.smithi111.stdout: "default_storage_class": "", 2024-09-12T18:43:03.645 INFO:tasks.workunit.client.0.smithi111.stdout: "placement_tags": [], 2024-09-12T18:43:03.645 INFO:tasks.workunit.client.0.smithi111.stdout: "bucket_quota": { 2024-09-12T18:43:03.645 INFO:tasks.workunit.client.0.smithi111.stdout: "enabled": false, 2024-09-12T18:43:03.645 INFO:tasks.workunit.client.0.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:43:03.645 INFO:tasks.workunit.client.0.smithi111.stdout: "max_size": -1, 2024-09-12T18:43:03.646 INFO:tasks.workunit.client.0.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:43:03.646 INFO:tasks.workunit.client.0.smithi111.stdout: "max_objects": -1 2024-09-12T18:43:03.646 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:43:03.646 INFO:tasks.workunit.client.0.smithi111.stdout: "user_quota": { 2024-09-12T18:43:03.646 INFO:tasks.workunit.client.0.smithi111.stdout: "enabled": false, 2024-09-12T18:43:03.646 INFO:tasks.workunit.client.0.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:43:03.646 INFO:tasks.workunit.client.0.smithi111.stdout: "max_size": -1, 2024-09-12T18:43:03.646 INFO:tasks.workunit.client.0.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:43:03.646 INFO:tasks.workunit.client.0.smithi111.stdout: "max_objects": -1 2024-09-12T18:43:03.646 INFO:tasks.workunit.client.0.smithi111.stdout: }, 2024-09-12T18:43:03.646 INFO:tasks.workunit.client.0.smithi111.stdout: "temp_url_keys": [], 2024-09-12T18:43:03.646 INFO:tasks.workunit.client.0.smithi111.stdout: "type": "rgw", 2024-09-12T18:43:03.646 INFO:tasks.workunit.client.0.smithi111.stdout: "mfa_ids": [], 2024-09-12T18:43:03.646 INFO:tasks.workunit.client.0.smithi111.stdout: "account_id": "", 2024-09-12T18:43:03.647 INFO:tasks.workunit.client.0.smithi111.stdout: "path": "/", 2024-09-12T18:43:03.647 INFO:tasks.workunit.client.0.smithi111.stdout: "create_date": "2024-09-12T18:43:03.636063Z", 2024-09-12T18:43:03.647 INFO:tasks.workunit.client.0.smithi111.stdout: "tags": [], 2024-09-12T18:43:03.647 INFO:tasks.workunit.client.0.smithi111.stdout: "group_ids": [] 2024-09-12T18:43:03.647 INFO:tasks.workunit.client.0.smithi111.stdout:} 2024-09-12T18:43:03.647 INFO:tasks.workunit.client.0.smithi111.stdout: 2024-09-12T18:43:07.770 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:07.770 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:07.799 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:07.799 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:07.831 INFO:tasks.workunit.client.0.smithi111.stderr:5+0 records in 2024-09-12T18:43:07.832 INFO:tasks.workunit.client.0.smithi111.stderr:5+0 records out 2024-09-12T18:43:07.832 INFO:tasks.workunit.client.0.smithi111.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.022713 s, 231 MB/s 2024-09-12T18:43:07.836 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:07.836 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:07.922 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:07.922 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:08.045 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:08.045 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:08.165 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:08.165 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:08.296 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:08.296 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:08.438 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:08.438 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:08.583 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:08.583 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:08.726 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:08.726 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:08.872 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:08.873 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:09.015 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:09.016 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:09.158 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:09.158 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:09.306 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:09.306 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:09.454 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:09.454 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:09.603 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:09.603 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:09.735 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:43:09.735 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:43:09.823 INFO:tasks.workunit.client.0.smithi111.stdout:bucket nams is reupload-bkt-115433 2024-09-12T18:43:09.823 INFO:tasks.workunit.client.0.smithi111.stdout:endpoint is https://smithi111.front.sepia.ceph.com:443 2024-09-12T18:43:09.823 INFO:tasks.workunit.client.0.smithi111.stdout:start UploadId=2~FIvFOm1HN772qEYeHwBao9ygX9b-QwZ 2024-09-12T18:43:09.823 INFO:tasks.workunit.client.0.smithi111.stdout:phase 1 uploaded part {'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 1} 2024-09-12T18:43:09.823 INFO:tasks.workunit.client.0.smithi111.stdout:phase 1 uploaded part {'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 2} 2024-09-12T18:43:09.823 INFO:tasks.workunit.client.0.smithi111.stdout:phase 2 uploaded part {'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 1} 2024-09-12T18:43:09.823 INFO:tasks.workunit.client.0.smithi111.stdout:phase 2 uploaded part {'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 1} 2024-09-12T18:43:09.824 INFO:tasks.workunit.client.0.smithi111.stdout:phase 2 uploaded part {'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 1} 2024-09-12T18:43:09.824 INFO:tasks.workunit.client.0.smithi111.stdout:phase 2 uploaded part {'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 1} 2024-09-12T18:43:09.824 INFO:tasks.workunit.client.0.smithi111.stdout:phase 2 uploaded part {'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 1} 2024-09-12T18:43:09.824 INFO:tasks.workunit.client.0.smithi111.stdout:phase 2 uploaded part {'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 1} 2024-09-12T18:43:09.824 INFO:tasks.workunit.client.0.smithi111.stdout:phase 2 uploaded part {'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 1} 2024-09-12T18:43:09.824 INFO:tasks.workunit.client.0.smithi111.stdout:phase 2 uploaded part {'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 1} 2024-09-12T18:43:09.824 INFO:tasks.workunit.client.0.smithi111.stdout:phase 2 uploaded part {'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 1} 2024-09-12T18:43:09.824 INFO:tasks.workunit.client.0.smithi111.stdout:phase 2 uploaded part {'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 1} 2024-09-12T18:43:09.824 INFO:tasks.workunit.client.0.smithi111.stdout:phase 2 uploaded part {'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 1} 2024-09-12T18:43:09.824 INFO:tasks.workunit.client.0.smithi111.stdout:completing multipart upload, parts=[{'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 1}, {'ETag': '"9e706d234c9377be9915218d18dd20d8"', 'PartNumber': 2}] 2024-09-12T18:43:11.407 INFO:tasks.workunit.client.0.smithi111.stdout:radosgw-admin bucket radoslist: 2024-09-12T18:43:11.407 INFO:tasks.workunit.client.0.smithi111.stdout:97c2b296-1395-4700-8053-4f06c4c86557.4689.3__:M-OoskpSuIE2-ibp3SLlyikFuogOObg_mpu_test4 2024-09-12T18:43:11.407 INFO:tasks.workunit.client.0.smithi111.stdout:97c2b296-1395-4700-8053-4f06c4c86557.4689.3_mpu_test4 2024-09-12T18:43:11.407 INFO:tasks.workunit.client.0.smithi111.stdout:97c2b296-1395-4700-8053-4f06c4c86557.4689.3__multipart_mpu_test4.0C2K7TAMYEC1kk9qujpq-5JxrUzff1ms.1 2024-09-12T18:43:11.407 INFO:tasks.workunit.client.0.smithi111.stdout:97c2b296-1395-4700-8053-4f06c4c86557.4689.3__multipart_mpu_test4.2~FIvFOm1HN772qEYeHwBao9ygX9b-QwZ.2 2024-09-12T18:43:11.407 INFO:tasks.workunit.client.0.smithi111.stdout:97c2b296-1395-4700-8053-4f06c4c86557.4689.3__shadow_mpu_test4.0C2K7TAMYEC1kk9qujpq-5JxrUzff1ms.1_1 2024-09-12T18:43:11.407 INFO:tasks.workunit.client.0.smithi111.stdout:97c2b296-1395-4700-8053-4f06c4c86557.4689.3__shadow_mpu_test4.2~FIvFOm1HN772qEYeHwBao9ygX9b-QwZ.2_1 2024-09-12T18:43:11.496 INFO:tasks.workunit.client.0.smithi111.stdout:rados ls: 2024-09-12T18:43:11.496 INFO:tasks.workunit.client.0.smithi111.stdout:97c2b296-1395-4700-8053-4f06c4c86557.4689.3__:M-OoskpSuIE2-ibp3SLlyikFuogOObg_mpu_test4 2024-09-12T18:43:11.496 INFO:tasks.workunit.client.0.smithi111.stdout:97c2b296-1395-4700-8053-4f06c4c86557.4689.3_mpu_test4 2024-09-12T18:43:11.497 INFO:tasks.workunit.client.0.smithi111.stdout:97c2b296-1395-4700-8053-4f06c4c86557.4689.3__multipart_mpu_test4.0C2K7TAMYEC1kk9qujpq-5JxrUzff1ms.1 2024-09-12T18:43:11.497 INFO:tasks.workunit.client.0.smithi111.stdout:97c2b296-1395-4700-8053-4f06c4c86557.4689.3__multipart_mpu_test4.2~FIvFOm1HN772qEYeHwBao9ygX9b-QwZ.2 2024-09-12T18:43:11.497 INFO:tasks.workunit.client.0.smithi111.stdout:97c2b296-1395-4700-8053-4f06c4c86557.4689.3__shadow_mpu_test4.0C2K7TAMYEC1kk9qujpq-5JxrUzff1ms.1_1 2024-09-12T18:43:11.497 INFO:tasks.workunit.client.0.smithi111.stdout:97c2b296-1395-4700-8053-4f06c4c86557.4689.3__shadow_mpu_test4.2~FIvFOm1HN772qEYeHwBao9ygX9b-QwZ.2_1 2024-09-12T18:43:11.509 INFO:tasks.workunit.client.0.smithi111.stdout:== PASSED == 2024-09-12T18:43:11.509 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:43:11.510 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:43:11.561 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T18:43:11.562 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:43:11.961 DEBUG:teuthology.parallel:result is None 2024-09-12T18:43:11.962 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:43:11.975 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:43:11.975 DEBUG:teuthology.orchestra.run.smithi111:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:43:12.023 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:43:12.023 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T18:43:12.047 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T18:43:12.048 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T18:43:12.048 INFO:tasks.ragweed:Using branch 'wip-cls-rgw-busy-resharding' for ragweed 2024-09-12T18:43:12.048 DEBUG:teuthology.orchestra.run.smithi111:> git clone -b wip-cls-rgw-busy-resharding https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T18:43:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T18:43:12.128 INFO:teuthology.orchestra.run.smithi111.stderr:fatal: Remote branch wip-cls-rgw-busy-resharding not found in upstream origin 2024-09-12T18:43:12.129 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-12T18:43:12.130 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-12T18:43:12.131 DEBUG:teuthology.orchestra.run.smithi111:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T18:43:12.175 INFO:teuthology.orchestra.run.smithi111.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T18:43:12.360 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T18:43:12.360 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T18:43:12.360 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key BRYTXJVKFNZAGOPJYJHB --secret Xf22wBI/x5qdNtKTnIcUvs6KhT+NaJGxlG8H29Zok1nXe56s2mmBKQ== --email ragweed.client.0+test@test.test --system false 2024-09-12T18:43:12.451 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:43:12.451 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:43:12.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.491+0000 7f97c166e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.491+0000 7f97c166e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:12.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.491+0000 7f97c166e9c0 20 realm 2024-09-12T18:43:12.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.491+0000 7f97c166e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.491+0000 7f97c166e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:12.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.491+0000 7f97c166e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:43:12.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.491+0000 7f97c166e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.491+0000 7f97c166e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:12.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.491+0000 7f97c166e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.495+0000 7f97c166e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:43:12.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.495+0000 7f97c166e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.495+0000 7f97c166e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:43:12.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.495+0000 7f97c166e9c0 20 searching for the correct realm 2024-09-12T18:43:12.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.499+0000 7f97bf975640 0 -- 172.21.15.111:0/4231299884 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f97b4003b90 msgr2=0x7f97b410f4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:43:12.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.507+0000 7f97be973640 0 -- 172.21.15.111:0/4231299884 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f97b8010b60 msgr2=0x7f97b80648a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:43:12.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.723+0000 7f97c166e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:43:12.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.723+0000 7f97c166e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:43:12.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.723+0000 7f97c166e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:43:12.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.723+0000 7f97c166e9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:43:12.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.723+0000 7f97c166e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:43:12.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.723+0000 7f97c166e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:43:12.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.723+0000 7f97c166e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.723+0000 7f97c166e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:12.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.723+0000 7f97c166e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.727+0000 7f97c166e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:43:12.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.727+0000 7f97c166e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.727+0000 7f97c166e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:43:12.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.727+0000 7f97c166e9c0 20 zone default found 2024-09-12T18:43:12.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.727+0000 7f97c166e9c0 4 Realm: () 2024-09-12T18:43:12.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.727+0000 7f97c166e9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:43:12.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.727+0000 7f97c166e9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:43:12.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.727+0000 7f97c166e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:43:12.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.727+0000 7f97c166e9c0 20 zonegroup default 2024-09-12T18:43:12.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.727+0000 7f97c166e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.727+0000 7f97c166e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:12.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.727+0000 7f97c166e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.727+0000 7f97c166e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:12.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.727+0000 7f97c166e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.731+0000 7f97c166e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:12.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.731+0000 7f97c166e9c0 20 started sync module instance, tier type = 2024-09-12T18:43:12.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.731+0000 7f97c166e9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:43:12.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.751+0000 7f97c166e9c0 20 add_watcher() i=0 2024-09-12T18:43:12.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.751+0000 7f97c166e9c0 20 add_watcher() i=1 2024-09-12T18:43:12.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.751+0000 7f97c166e9c0 20 add_watcher() i=2 2024-09-12T18:43:12.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.751+0000 7f97c166e9c0 20 add_watcher() i=3 2024-09-12T18:43:12.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.751+0000 7f97c166e9c0 20 add_watcher() i=4 2024-09-12T18:43:12.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.751+0000 7f97c166e9c0 20 add_watcher() i=5 2024-09-12T18:43:12.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.751+0000 7f97c166e9c0 20 add_watcher() i=6 2024-09-12T18:43:12.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.755+0000 7f97c166e9c0 20 add_watcher() i=7 2024-09-12T18:43:12.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.755+0000 7f97c166e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:43:12.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.755+0000 7f9675fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:43:12.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.755+0000 7f97c166e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:43:12.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.755+0000 7f97c166e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:43:12.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 5 note: GC not initialized 2024-09-12T18:43:12.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f9674fe1640 20 reqs_thread_entry: start 2024-09-12T18:43:12.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:43:12.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 20 Filter name: none 2024-09-12T18:43:12.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f95ee7fc640 20 reqs_thread_entry: start 2024-09-12T18:43:12.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T18:43:12.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:12.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T18:43:12.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T18:43:12.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T18:43:12.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:12.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T18:43:12.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T18:43:12.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 10 cache get: name=default.rgw.meta+users.keys+BRYTXJVKFNZAGOPJYJHB : miss 2024-09-12T18:43:12.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:12.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 10 cache put: name=default.rgw.meta+users.keys+BRYTXJVKFNZAGOPJYJHB info.flags=0x0 2024-09-12T18:43:12.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 10 adding default.rgw.meta+users.keys+BRYTXJVKFNZAGOPJYJHB to cache LRU end 2024-09-12T18:43:12.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 10 cache get: name=default.rgw.meta+users.keys+BRYTXJVKFNZAGOPJYJHB : hit (negative entry) 2024-09-12T18:43:12.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.759+0000 7f97c166e9c0 10 cache get: name=default.rgw.meta+users.keys+BRYTXJVKFNZAGOPJYJHB : hit (negative entry) 2024-09-12T18:43:12.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.763+0000 7f97c166e9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T18:43:12.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.763+0000 7f97c166e9c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T18:43:12.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.763+0000 7f97c166e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T18:43:12.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.767+0000 7f96a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693206 cookie 94912189142512 notifier 5645 bl.length()=675 2024-09-12T18:43:12.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.767+0000 7f96a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T18:43:12.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.767+0000 7f96a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T18:43:12.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.771+0000 7f97c166e9c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T18:43:12.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.771+0000 7f97c166e9c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T18:43:12.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.771+0000 7f97c166e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T18:43:12.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.771+0000 7f96a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693193 cookie 94912189140096 notifier 5645 bl.length()=202 2024-09-12T18:43:12.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.771+0000 7f96a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T18:43:12.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.771+0000 7f96a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T18:43:12.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.775+0000 7f97c166e9c0 10 cache put: name=default.rgw.meta+users.keys+BRYTXJVKFNZAGOPJYJHB info.flags=0x7 2024-09-12T18:43:12.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.775+0000 7f97c166e9c0 10 moving default.rgw.meta+users.keys+BRYTXJVKFNZAGOPJYJHB to cache LRU end 2024-09-12T18:43:12.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.775+0000 7f97c166e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:BRYTXJVKFNZAGOPJYJHB, ofs0, ns] 2024-09-12T18:43:12.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.775+0000 7f96a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693234 cookie 94912189135472 notifier 5645 bl.length()=190 2024-09-12T18:43:12.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.775+0000 7f96a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BRYTXJVKFNZAGOPJYJHB info.flags=0x7 2024-09-12T18:43:12.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.775+0000 7f96a2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BRYTXJVKFNZAGOPJYJHB to cache LRU end 2024-09-12T18:43:12.779 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:43:12.779 INFO:teuthology.orchestra.run.smithi111.stdout: "user_id": "ragweed.client.0", 2024-09-12T18:43:12.779 INFO:teuthology.orchestra.run.smithi111.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T18:43:12.779 INFO:teuthology.orchestra.run.smithi111.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T18:43:12.779 INFO:teuthology.orchestra.run.smithi111.stdout: "suspended": 0, 2024-09-12T18:43:12.779 INFO:teuthology.orchestra.run.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:43:12.779 INFO:teuthology.orchestra.run.smithi111.stdout: "subusers": [], 2024-09-12T18:43:12.779 INFO:teuthology.orchestra.run.smithi111.stdout: "keys": [ 2024-09-12T18:43:12.779 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:43:12.779 INFO:teuthology.orchestra.run.smithi111.stdout: "user": "ragweed.client.0", 2024-09-12T18:43:12.779 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "BRYTXJVKFNZAGOPJYJHB", 2024-09-12T18:43:12.779 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "Xf22wBI/x5qdNtKTnIcUvs6KhT+NaJGxlG8H29Zok1nXe56s2mmBKQ==", 2024-09-12T18:43:12.780 INFO:teuthology.orchestra.run.smithi111.stdout: "active": true, 2024-09-12T18:43:12.780 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:43:12.764729Z" 2024-09-12T18:43:12.780 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:43:12.780 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:43:12.780 INFO:teuthology.orchestra.run.smithi111.stdout: "swift_keys": [], 2024-09-12T18:43:12.780 INFO:teuthology.orchestra.run.smithi111.stdout: "caps": [], 2024-09-12T18:43:12.780 INFO:teuthology.orchestra.run.smithi111.stdout: "op_mask": "read, write, delete", 2024-09-12T18:43:12.780 INFO:teuthology.orchestra.run.smithi111.stdout: "default_placement": "", 2024-09-12T18:43:12.780 INFO:teuthology.orchestra.run.smithi111.stdout: "default_storage_class": "", 2024-09-12T18:43:12.780 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_tags": [], 2024-09-12T18:43:12.780 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2024-09-12T18:43:12.780 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:43:12.780 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:43:12.780 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:43:12.781 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:43:12.781 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:43:12.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:43:12.781 INFO:teuthology.orchestra.run.smithi111.stdout: "user_quota": { 2024-09-12T18:43:12.781 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:43:12.781 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:43:12.781 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:43:12.781 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:43:12.781 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:43:12.781 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:43:12.781 INFO:teuthology.orchestra.run.smithi111.stdout: "temp_url_keys": [], 2024-09-12T18:43:12.781 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "rgw", 2024-09-12T18:43:12.781 INFO:teuthology.orchestra.run.smithi111.stdout: "mfa_ids": [], 2024-09-12T18:43:12.782 INFO:teuthology.orchestra.run.smithi111.stdout: "account_id": "", 2024-09-12T18:43:12.782 INFO:teuthology.orchestra.run.smithi111.stdout: "path": "/", 2024-09-12T18:43:12.782 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:43:12.764701Z", 2024-09-12T18:43:12.782 INFO:teuthology.orchestra.run.smithi111.stdout: "tags": [], 2024-09-12T18:43:12.782 INFO:teuthology.orchestra.run.smithi111.stdout: "group_ids": [] 2024-09-12T18:43:12.782 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:43:12.782 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:43:12.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.779+0000 7f9675fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:43:12.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.783+0000 7f97c166e9c0 20 remove_watcher() i=0 2024-09-12T18:43:12.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.783+0000 7f97c166e9c0 2 removed watcher, disabling cache 2024-09-12T18:43:12.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.787+0000 7f97c166e9c0 20 remove_watcher() i=1 2024-09-12T18:43:12.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.787+0000 7f97c166e9c0 20 remove_watcher() i=2 2024-09-12T18:43:12.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.791+0000 7f97c166e9c0 20 remove_watcher() i=3 2024-09-12T18:43:12.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.791+0000 7f97c166e9c0 20 remove_watcher() i=4 2024-09-12T18:43:12.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.795+0000 7f97c166e9c0 20 remove_watcher() i=5 2024-09-12T18:43:12.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.795+0000 7f97c166e9c0 20 remove_watcher() i=6 2024-09-12T18:43:12.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.799+0000 7f97c166e9c0 20 remove_watcher() i=7 2024-09-12T18:43:12.817 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T18:43:12.818 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key YEQTDYYERGFPYGJKGAES --secret +sjc/Fi8gVAYcULMYaouiNa0SqQpyjJnUUbJeNoHmNnt6T3Ds1Juog== --email sysuser.client.0+test@test.test --system true 2024-09-12T18:43:12.863 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:43:12.863 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:43:12.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.903+0000 7fe9065d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.907+0000 7fe9065d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:12.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.907+0000 7fe9065d49c0 20 realm 2024-09-12T18:43:12.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.907+0000 7fe9065d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.907+0000 7fe9065d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:12.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.907+0000 7fe9065d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:43:12.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.907+0000 7fe9065d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.907+0000 7fe9065d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:12.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.907+0000 7fe9065d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.907+0000 7fe9065d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:43:12.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.907+0000 7fe9065d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:12.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.907+0000 7fe9065d49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:43:12.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.907+0000 7fe9065d49c0 20 searching for the correct realm 2024-09-12T18:43:12.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:12.911+0000 7fe9038d9640 0 -- 172.21.15.111:0/577620334 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7fe8ec019040 msgr2=0x7fe8ec027400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:43:13.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.123+0000 7fe9040da640 0 -- 172.21.15.111:0/577620334 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fe8fc06ec20 msgr2=0x7fe8fc07c0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:43:13.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:43:13.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:43:13.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:43:13.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:43:13.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:43:13.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:43:13.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:13.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:13.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:13.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:43:13.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:13.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:43:13.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 zone default found 2024-09-12T18:43:13.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 4 Realm: () 2024-09-12T18:43:13.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:43:13.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:43:13.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:43:13.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 zonegroup default 2024-09-12T18:43:13.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:13.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:13.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.143+0000 7fe9065d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:13.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.147+0000 7fe9065d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:13.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.147+0000 7fe9065d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:13.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.147+0000 7fe9065d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:13.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.147+0000 7fe9065d49c0 20 started sync module instance, tier type = 2024-09-12T18:43:13.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.147+0000 7fe9065d49c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:43:13.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.167+0000 7fe9065d49c0 20 add_watcher() i=0 2024-09-12T18:43:13.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.167+0000 7fe9065d49c0 20 add_watcher() i=1 2024-09-12T18:43:13.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.167+0000 7fe9065d49c0 20 add_watcher() i=2 2024-09-12T18:43:13.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.167+0000 7fe9065d49c0 20 add_watcher() i=3 2024-09-12T18:43:13.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.167+0000 7fe9065d49c0 20 add_watcher() i=4 2024-09-12T18:43:13.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.167+0000 7fe9065d49c0 20 add_watcher() i=5 2024-09-12T18:43:13.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.167+0000 7fe9065d49c0 20 add_watcher() i=6 2024-09-12T18:43:13.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.171+0000 7fe9065d49c0 20 add_watcher() i=7 2024-09-12T18:43:13.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.171+0000 7fe9065d49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:43:13.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe7b67f4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:43:13.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:43:13.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:43:13.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 5 note: GC not initialized 2024-09-12T18:43:13.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe7b57f2640 20 reqs_thread_entry: start 2024-09-12T18:43:13.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 20 init_complete bucket index max shards: 11 2024-09-12T18:43:13.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 20 Filter name: none 2024-09-12T18:43:13.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe72effd640 20 reqs_thread_entry: start 2024-09-12T18:43:13.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T18:43:13.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:13.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:13.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T18:43:13.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T18:43:13.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T18:43:13.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:13.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:13.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T18:43:13.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T18:43:13.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 10 cache get: name=default.rgw.meta+users.keys+YEQTDYYERGFPYGJKGAES : miss 2024-09-12T18:43:13.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.175+0000 7fe9065d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:13.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.179+0000 7fe9065d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:13.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.179+0000 7fe9065d49c0 10 cache put: name=default.rgw.meta+users.keys+YEQTDYYERGFPYGJKGAES info.flags=0x0 2024-09-12T18:43:13.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.179+0000 7fe9065d49c0 10 adding default.rgw.meta+users.keys+YEQTDYYERGFPYGJKGAES to cache LRU end 2024-09-12T18:43:13.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.179+0000 7fe9065d49c0 10 cache get: name=default.rgw.meta+users.keys+YEQTDYYERGFPYGJKGAES : hit (negative entry) 2024-09-12T18:43:13.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.179+0000 7fe9065d49c0 10 cache get: name=default.rgw.meta+users.keys+YEQTDYYERGFPYGJKGAES : hit (negative entry) 2024-09-12T18:43:13.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.179+0000 7fe9065d49c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T18:43:13.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.179+0000 7fe9065d49c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T18:43:13.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.179+0000 7fe9065d49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T18:43:13.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.183+0000 7fe7daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693194 cookie 94855591854160 notifier 5660 bl.length()=675 2024-09-12T18:43:13.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.183+0000 7fe7daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T18:43:13.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.183+0000 7fe7daffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T18:43:13.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.187+0000 7fe9065d49c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T18:43:13.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.187+0000 7fe9065d49c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T18:43:13.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.187+0000 7fe9065d49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T18:43:13.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.187+0000 7fe7daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693207 cookie 94855591857792 notifier 5660 bl.length()=202 2024-09-12T18:43:13.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.187+0000 7fe7daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T18:43:13.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.187+0000 7fe7daffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T18:43:13.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.191+0000 7fe9065d49c0 10 cache put: name=default.rgw.meta+users.keys+YEQTDYYERGFPYGJKGAES info.flags=0x7 2024-09-12T18:43:13.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.191+0000 7fe9065d49c0 10 moving default.rgw.meta+users.keys+YEQTDYYERGFPYGJKGAES to cache LRU end 2024-09-12T18:43:13.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.191+0000 7fe9065d49c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:YEQTDYYERGFPYGJKGAES, ofs0, ns] 2024-09-12T18:43:13.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.191+0000 7fe7daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693247 cookie 94855591860992 notifier 5660 bl.length()=190 2024-09-12T18:43:13.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.191+0000 7fe7daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YEQTDYYERGFPYGJKGAES info.flags=0x7 2024-09-12T18:43:13.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.191+0000 7fe7daffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YEQTDYYERGFPYGJKGAES to cache LRU end 2024-09-12T18:43:13.193 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:43:13.193 INFO:teuthology.orchestra.run.smithi111.stdout: "user_id": "sysuser.client.0", 2024-09-12T18:43:13.193 INFO:teuthology.orchestra.run.smithi111.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T18:43:13.193 INFO:teuthology.orchestra.run.smithi111.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T18:43:13.193 INFO:teuthology.orchestra.run.smithi111.stdout: "suspended": 0, 2024-09-12T18:43:13.193 INFO:teuthology.orchestra.run.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:43:13.193 INFO:teuthology.orchestra.run.smithi111.stdout: "subusers": [], 2024-09-12T18:43:13.193 INFO:teuthology.orchestra.run.smithi111.stdout: "keys": [ 2024-09-12T18:43:13.193 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:43:13.194 INFO:teuthology.orchestra.run.smithi111.stdout: "user": "sysuser.client.0", 2024-09-12T18:43:13.194 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "YEQTDYYERGFPYGJKGAES", 2024-09-12T18:43:13.194 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "+sjc/Fi8gVAYcULMYaouiNa0SqQpyjJnUUbJeNoHmNnt6T3Ds1Juog==", 2024-09-12T18:43:13.194 INFO:teuthology.orchestra.run.smithi111.stdout: "active": true, 2024-09-12T18:43:13.194 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:43:13.181644Z" 2024-09-12T18:43:13.194 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:43:13.194 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:43:13.194 INFO:teuthology.orchestra.run.smithi111.stdout: "swift_keys": [], 2024-09-12T18:43:13.194 INFO:teuthology.orchestra.run.smithi111.stdout: "caps": [], 2024-09-12T18:43:13.194 INFO:teuthology.orchestra.run.smithi111.stdout: "op_mask": "read, write, delete", 2024-09-12T18:43:13.194 INFO:teuthology.orchestra.run.smithi111.stdout: "system": true, 2024-09-12T18:43:13.194 INFO:teuthology.orchestra.run.smithi111.stdout: "default_placement": "", 2024-09-12T18:43:13.194 INFO:teuthology.orchestra.run.smithi111.stdout: "default_storage_class": "", 2024-09-12T18:43:13.194 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_tags": [], 2024-09-12T18:43:13.195 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2024-09-12T18:43:13.195 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:43:13.195 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:43:13.195 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:43:13.195 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:43:13.195 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:43:13.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:43:13.195 INFO:teuthology.orchestra.run.smithi111.stdout: "user_quota": { 2024-09-12T18:43:13.195 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:43:13.195 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:43:13.195 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:43:13.195 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:43:13.195 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:43:13.195 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:43:13.196 INFO:teuthology.orchestra.run.smithi111.stdout: "temp_url_keys": [], 2024-09-12T18:43:13.196 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "rgw", 2024-09-12T18:43:13.196 INFO:teuthology.orchestra.run.smithi111.stdout: "mfa_ids": [], 2024-09-12T18:43:13.196 INFO:teuthology.orchestra.run.smithi111.stdout: "account_id": "", 2024-09-12T18:43:13.196 INFO:teuthology.orchestra.run.smithi111.stdout: "path": "/", 2024-09-12T18:43:13.196 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:43:13.181604Z", 2024-09-12T18:43:13.196 INFO:teuthology.orchestra.run.smithi111.stdout: "tags": [], 2024-09-12T18:43:13.196 INFO:teuthology.orchestra.run.smithi111.stdout: "group_ids": [] 2024-09-12T18:43:13.196 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:43:13.196 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:43:13.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.191+0000 7fe7b67f4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:43:13.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.195+0000 7fe9065d49c0 20 remove_watcher() i=0 2024-09-12T18:43:13.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.195+0000 7fe9065d49c0 2 removed watcher, disabling cache 2024-09-12T18:43:13.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.199+0000 7fe9065d49c0 20 remove_watcher() i=1 2024-09-12T18:43:13.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.199+0000 7fe9065d49c0 20 remove_watcher() i=2 2024-09-12T18:43:13.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.203+0000 7fe9065d49c0 20 remove_watcher() i=3 2024-09-12T18:43:13.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.207+0000 7fe9065d49c0 20 remove_watcher() i=4 2024-09-12T18:43:13.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.207+0000 7fe9065d49c0 20 remove_watcher() i=5 2024-09-12T18:43:13.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.207+0000 7fe9065d49c0 20 remove_watcher() i=6 2024-09-12T18:43:13.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:13.211+0000 7fe9065d49c0 20 remove_watcher() i=7 2024-09-12T18:43:13.227 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T18:43:13.228 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:43:13.228 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T18:43:13.234 INFO:tasks.ragweed:Configuring boto... 2024-09-12T18:43:13.234 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:43:13.234 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T18:43:13.281 DEBUG:teuthology.orchestra.run.smithi111:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T18:43:13.468 INFO:teuthology.orchestra.run.smithi111.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T18:43:13.646 INFO:teuthology.orchestra.run.smithi111.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T18:43:14.268 INFO:teuthology.orchestra.run.smithi111.stdout:py installdeps: -rrequirements.txt 2024-09-12T18:43:17.046 INFO:teuthology.orchestra.run.smithi111.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T18:43:21.349 INFO:teuthology.orchestra.run.smithi111.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=1c779efafec7fb2b4e6c160ae817978c58b593d34847c1818d724d7397e16bf4,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-12T18:43:21.350 INFO:teuthology.orchestra.run.smithi111.stdout:py run-test-pre: PYTHONHASHSEED='251501888' 2024-09-12T18:43:21.350 INFO:teuthology.orchestra.run.smithi111.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T18:43:21.511 INFO:teuthology.orchestra.run.smithi111.stdout:============================= test session starts ============================== 2024-09-12T18:43:21.512 INFO:teuthology.orchestra.run.smithi111.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T18:43:21.512 INFO:teuthology.orchestra.run.smithi111.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T18:43:21.512 INFO:teuthology.orchestra.run.smithi111.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-12T18:43:21.677 INFO:teuthology.orchestra.run.smithi111.stdout:collecting ... collected 9 items 2024-09-12T18:43:21.677 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:43:23.861 INFO:teuthology.orchestra.run.smithi111.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T18:43:25.032 INFO:teuthology.orchestra.run.smithi111.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T18:43:26.046 INFO:teuthology.orchestra.run.smithi111.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T18:43:27.168 INFO:teuthology.orchestra.run.smithi111.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T18:43:28.484 INFO:teuthology.orchestra.run.smithi111.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T18:43:35.025 INFO:teuthology.orchestra.run.smithi111.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T18:43:37.387 INFO:teuthology.orchestra.run.smithi111.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T18:43:40.502 INFO:teuthology.orchestra.run.smithi111.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T18:43:45.244 INFO:teuthology.orchestra.run.smithi111.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T18:43:45.244 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:43:45.244 INFO:teuthology.orchestra.run.smithi111.stdout:=============================== warnings summary =============================== 2024-09-12T18:43:45.244 INFO:teuthology.orchestra.run.smithi111.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T18:43:45.245 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T18:43:45.245 INFO:teuthology.orchestra.run.smithi111.stdout: import imp 2024-09-12T18:43:45.245 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:43:45.245 INFO:teuthology.orchestra.run.smithi111.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-12T18:43:45.245 INFO:teuthology.orchestra.run.smithi111.stdout:======================== 9 passed, 1 warning in 23.73s ========================= 2024-09-12T18:43:45.291 INFO:teuthology.orchestra.run.smithi111.stdout:___________________________________ summary ____________________________________ 2024-09-12T18:43:45.292 INFO:teuthology.orchestra.run.smithi111.stdout: py: commands succeeded 2024-09-12T18:43:45.292 INFO:teuthology.orchestra.run.smithi111.stdout: congratulations :) 2024-09-12T18:43:45.311 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T18:43:45.311 DEBUG:teuthology.orchestra.run.smithi111:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T18:43:45.316 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T18:43:45.394 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:43:45.394 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:43:45.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.430+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.434+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:45.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.434+0000 7fb90d8099c0 20 realm 2024-09-12T18:43:45.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.434+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.434+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:45.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.434+0000 7fb90d8099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:43:45.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.434+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.434+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:45.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.434+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.434+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:43:45.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.434+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.438+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:43:45.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.438+0000 7fb90d8099c0 20 searching for the correct realm 2024-09-12T18:43:45.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.442+0000 7fb90bb10640 0 -- 172.21.15.111:0/255048185 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fb8f4122350 msgr2=0x7fb8f40f7550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:43:45.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.450+0000 7fb903fff640 0 -- 172.21.15.111:0/255048185 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fb904067fa0 msgr2=0x7fb9040818b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:43:45.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.666+0000 7fb90d8099c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:43:45.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.666+0000 7fb90d8099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:43:45.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.666+0000 7fb90d8099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:43:45.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.666+0000 7fb90d8099c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:43:45.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.666+0000 7fb90d8099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:43:45.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.666+0000 7fb90d8099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:43:45.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.666+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.666+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:45.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.666+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.666+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:43:45.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.666+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:43:45.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 20 zone default found 2024-09-12T18:43:45.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 4 Realm: () 2024-09-12T18:43:45.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:43:45.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:43:45.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:43:45.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 20 zonegroup default 2024-09-12T18:43:45.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:45.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:45.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:45.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 20 started sync module instance, tier type = 2024-09-12T18:43:45.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.670+0000 7fb90d8099c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:43:45.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.694+0000 7fb90d8099c0 20 add_watcher() i=0 2024-09-12T18:43:45.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.694+0000 7fb90d8099c0 20 add_watcher() i=1 2024-09-12T18:43:45.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.694+0000 7fb90d8099c0 20 add_watcher() i=2 2024-09-12T18:43:45.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.694+0000 7fb90d8099c0 20 add_watcher() i=3 2024-09-12T18:43:45.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.694+0000 7fb90d8099c0 20 add_watcher() i=4 2024-09-12T18:43:45.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.694+0000 7fb90d8099c0 20 add_watcher() i=5 2024-09-12T18:43:45.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.694+0000 7fb90d8099c0 20 add_watcher() i=6 2024-09-12T18:43:45.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.698+0000 7fb90d8099c0 20 add_watcher() i=7 2024-09-12T18:43:45.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.698+0000 7fb90d8099c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:43:45.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.702+0000 7fb7c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:43:45.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.702+0000 7fb90d8099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:43:45.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.702+0000 7fb90d8099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:43:45.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.794+0000 7fb7c0fe1640 20 reqs_thread_entry: start 2024-09-12T18:43:45.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.794+0000 7fb90d8099c0 20 init_complete bucket index max shards: 11 2024-09-12T18:43:45.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.794+0000 7fb90d8099c0 20 Filter name: none 2024-09-12T18:43:45.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.794+0000 7fb73a7fc640 20 reqs_thread_entry: start 2024-09-12T18:43:45.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.794+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T18:43:45.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.794+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.794+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T18:43:45.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.794+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T18:43:45.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.794+0000 7fb90d8099c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T18:43:45.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.794+0000 7fb90d8099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:43:45.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.794+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:97c2b296-1395-4700-8053-4f06c4c86557.4689.4 : miss 2024-09-12T18:43:45.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.794+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.798+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T18:43:45.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.798+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:97c2b296-1395-4700-8053-4f06c4c86557.4689.4 info.flags=0x17 2024-09-12T18:43:45.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.798+0000 7fb90d8099c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:97c2b296-1395-4700-8053-4f06c4c86557.4689.4 to cache LRU end 2024-09-12T18:43:45.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.798+0000 7fb90d8099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:43:45.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.798+0000 7fb90d8099c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:43:45.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.798+0000 7fb90d8099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:97c2b296-1395-4700-8053-4f06c4c86557.4689.4 2024-09-12T18:43:45.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.798+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T18:43:45.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.798+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T18:43:45.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.798+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T18:43:45.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.802+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T18:43:45.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.802+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T18:43:45.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.802+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T18:43:45.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.802+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T18:43:45.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.802+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T18:43:45.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.802+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T18:43:45.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.806+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc00e730 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.806+0000 7fb90d8099c0 10 manifest: total_size = 7745 2024-09-12T18:43:45.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.806+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.13874924481329359078 2024-09-12T18:43:45.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.806+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc00e730 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.806+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ffa68 2024-09-12T18:43:45.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.806+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.4.1 2024-09-12T18:43:45.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.810+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:45.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.810+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=7745 stripe_ofs=7745 part_ofs=0 rule->part_size=0 2024-09-12T18:43:45.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.810+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.13874924481329359078 2024-09-12T18:43:45.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.810+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:45.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.810+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.I3mL-_69j0w4scucwPjprJZtr9d36x8_0 2024-09-12T18:43:45.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.810+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:43:45.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.810+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:45.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.810+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.13874924481329359078 2024-09-12T18:43:45.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.814+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T18:43:45.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.814+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc00e730 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.814+0000 7fb90d8099c0 10 manifest: total_size = 7503 2024-09-12T18:43:45.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.814+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.10861553196272963716 2024-09-12T18:43:45.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.814+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc00e730 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.814+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ffa68 2024-09-12T18:43:45.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.814+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.4.2 2024-09-12T18:43:45.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.818+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:45.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.818+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=7503 stripe_ofs=7503 part_ofs=0 rule->part_size=0 2024-09-12T18:43:45.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.818+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.10861553196272963716 2024-09-12T18:43:45.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.818+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:45.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.818+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.chIyMEQxs16rp4fcm6rD5Ur1dCtGEtn_0 2024-09-12T18:43:45.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.818+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:43:45.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.818+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:45.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.818+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.10861553196272963716 2024-09-12T18:43:45.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.822+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T18:43:45.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.822+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc00e730 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.822+0000 7fb90d8099c0 10 manifest: total_size = 15949 2024-09-12T18:43:45.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.822+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.4436011339451854060 2024-09-12T18:43:45.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.822+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc00e730 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.822+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ffa68 2024-09-12T18:43:45.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.822+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.4.2 2024-09-12T18:43:45.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:45.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=15949 stripe_ofs=15949 part_ofs=0 rule->part_size=0 2024-09-12T18:43:45.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4436011339451854060 2024-09-12T18:43:45.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:45.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.tFPWNzZW4SSE6MqMikEGpdtOUUP-h2Y_0 2024-09-12T18:43:45.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:43:45.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:45.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4436011339451854060 2024-09-12T18:43:45.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T18:43:45.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc00e730 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb90d8099c0 10 manifest: total_size = 7685 2024-09-12T18:43:45.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.7655713617634948146 2024-09-12T18:43:45.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc00e730 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ffa68 2024-09-12T18:43:45.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.826+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.4.3 2024-09-12T18:43:45.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.834+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:45.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.834+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=7685 stripe_ofs=7685 part_ofs=0 rule->part_size=0 2024-09-12T18:43:45.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.834+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.7655713617634948146 2024-09-12T18:43:45.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.834+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:45.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.834+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.PjJ_IFEA5VEUHNBC002XghQjpSPlqQ1_0 2024-09-12T18:43:45.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.834+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:43:45.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.834+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:45.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.834+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.7655713617634948146 2024-09-12T18:43:45.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.834+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc00e730 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.838+0000 7fb90d8099c0 10 manifest: total_size = 13115 2024-09-12T18:43:45.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.838+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.2035632215276871814 2024-09-12T18:43:45.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.838+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc00e730 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.838+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ffa68 2024-09-12T18:43:45.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.838+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.4.4 2024-09-12T18:43:45.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.838+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T18:43:45.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.842+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:45.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.842+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=13115 stripe_ofs=13115 part_ofs=0 rule->part_size=0 2024-09-12T18:43:45.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.842+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.2035632215276871814 2024-09-12T18:43:45.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.842+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:45.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.842+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.7JytkotfHIa-hE6YjchQWgt3m4jy5md_0 2024-09-12T18:43:45.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.842+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:43:45.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.842+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:45.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.842+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.2035632215276871814 2024-09-12T18:43:45.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.846+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T18:43:45.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.846+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc00e730 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.846+0000 7fb90d8099c0 10 manifest: total_size = 5184 2024-09-12T18:43:45.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.846+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.9734402158279401980 2024-09-12T18:43:45.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.846+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc00e730 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.846+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ffa68 2024-09-12T18:43:45.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.846+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.4.4 2024-09-12T18:43:45.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.850+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:45.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.850+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5184 stripe_ofs=5184 part_ofs=0 rule->part_size=0 2024-09-12T18:43:45.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.850+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.9734402158279401980 2024-09-12T18:43:45.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.850+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:45.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.850+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.3V-VjH9GBUKiJAW_8Y1yRVdhP0UVxkP_0 2024-09-12T18:43:45.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.850+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:43:45.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.850+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:45.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.850+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.9734402158279401980 2024-09-12T18:43:45.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.854+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T18:43:45.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.854+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc00e730 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.854+0000 7fb90d8099c0 10 manifest: total_size = 4903 2024-09-12T18:43:45.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.854+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.4945388497565080860 2024-09-12T18:43:45.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.854+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc00e730 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.854+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ffa68 2024-09-12T18:43:45.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.854+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.4.5 2024-09-12T18:43:45.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.858+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:45.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.858+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4903 stripe_ofs=4903 part_ofs=0 rule->part_size=0 2024-09-12T18:43:45.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.858+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4945388497565080860 2024-09-12T18:43:45.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.858+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:45.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.858+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.G6k5tBL3NB13bfVggqwu0-9nF0Epb5E_0 2024-09-12T18:43:45.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.858+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:43:45.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.858+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:45.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.858+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4945388497565080860 2024-09-12T18:43:45.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.862+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T18:43:45.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.862+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be085450 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.862+0000 7fb90d8099c0 10 manifest: total_size = 5173 2024-09-12T18:43:45.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.862+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.10644876349128241786 2024-09-12T18:43:45.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.862+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be085450 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.862+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ffa68 2024-09-12T18:43:45.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.862+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.4.7 2024-09-12T18:43:45.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:45.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5173 stripe_ofs=5173 part_ofs=0 rule->part_size=0 2024-09-12T18:43:45.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.10644876349128241786 2024-09-12T18:43:45.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:45.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.IyTyPxS_xskb6zYrmSBjsPGXefFcsb0_0 2024-09-12T18:43:45.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:43:45.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:45.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.10644876349128241786 2024-09-12T18:43:45.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T18:43:45.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be085450 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb90d8099c0 10 manifest: total_size = 8753 2024-09-12T18:43:45.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.17950753458456230350 2024-09-12T18:43:45.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be085450 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ffa68 2024-09-12T18:43:45.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.870+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.4.8 2024-09-12T18:43:45.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.874+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:45.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.874+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=8753 stripe_ofs=8753 part_ofs=0 rule->part_size=0 2024-09-12T18:43:45.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.874+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.17950753458456230350 2024-09-12T18:43:45.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.874+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:45.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.874+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.VNV_0a6SD15fQgCmHm9XFkDIdNMeGSA_0 2024-09-12T18:43:45.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.874+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:43:45.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.874+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:45.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.874+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.17950753458456230350 2024-09-12T18:43:45.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.878+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T18:43:45.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.878+0000 7fb90d8099c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:43:45.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.878+0000 7fb90d8099c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:43:45.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.882+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:43:45.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.882+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:43:45.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.882+0000 7fb90d8099c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:43:45.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.882+0000 7fb90d8099c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:43:45.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.882+0000 7fb90d8099c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[97c2b296-1395-4700-8053-4f06c4c86557.4689.4])"; uploads.size()=0; is_truncated=0 2024-09-12T18:43:45.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.886+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T18:43:45.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.886+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.886+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T18:43:45.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.886+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T18:43:45.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.886+0000 7fb90d8099c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T18:43:45.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.890+0000 7fb90d8099c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T18:43:45.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.890+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T18:43:45.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.890+0000 7fb7ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94187525837232 notifier 5690 bl.length()=162 2024-09-12T18:43:45.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.894+0000 7fb90d8099c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:97c2b296-1395-4700-8053-4f06c4c86557.4689.4 from cache 2024-09-12T18:43:45.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.894+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:97c2b296-1395-4700-8053-4f06c4c86557.4689.4, ofs0, ns] 2024-09-12T18:43:45.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.894+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94187525846400 notifier 5690 bl.length()=219 2024-09-12T18:43:45.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.902+0000 7fb90d8099c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/97c2b296-1395-4700-8053-4f06c4c86557.4689.4 : miss 2024-09-12T18:43:45.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.902+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.906+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:45.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.906+0000 7fb90d8099c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/97c2b296-1395-4700-8053-4f06c4c86557.4689.4 info.flags=0x0 2024-09-12T18:43:45.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.906+0000 7fb90d8099c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/97c2b296-1395-4700-8053-4f06c4c86557.4689.4 to cache LRU end 2024-09-12T18:43:45.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.906+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.11 : miss 2024-09-12T18:43:45.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.906+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.910+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T18:43:45.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.910+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.11 info.flags=0x17 2024-09-12T18:43:45.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.910+0000 7fb90d8099c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.11 to cache LRU end 2024-09-12T18:43:45.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.910+0000 7fb90d8099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:43:45.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.910+0000 7fb90d8099c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:43:45.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.910+0000 7fb90d8099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.11 2024-09-12T18:43:45.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.918+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo 2024-09-12T18:43:45.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.918+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0fe930 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.918+0000 7fb90d8099c0 10 manifest: total_size = 74198 2024-09-12T18:43:45.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.918+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.412243260172553343 2024-09-12T18:43:45.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.918+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0fe930 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55a9be0ffa68 s->prefetch_data=0 2024-09-12T18:43:45.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.918+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ffa68 2024-09-12T18:43:45.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.918+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.11.10 2024-09-12T18:43:45.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T18:43:45.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-12T18:43:45.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T18:43:45.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T18:43:45.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-12T18:43:45.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T18:43:45.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T18:43:45.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-12T18:43:45.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T18:43:45.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T18:43:45.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-12T18:43:45.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T18:43:45.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.412243260172553343 2024-09-12T18:43:45.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:45.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.11__multipart_foo.2~hL1ofrm3bhwQV2qm2fTjISDy8gg_4bX.1 2024-09-12T18:43:45.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-12T18:43:45.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.11__multipart_foo.2~hL1ofrm3bhwQV2qm2fTjISDy8gg_4bX.2 2024-09-12T18:43:45.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-09-12T18:43:45.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.11__multipart_foo.2~hL1ofrm3bhwQV2qm2fTjISDy8gg_4bX.3 2024-09-12T18:43:45.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-09-12T18:43:45.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.11__multipart_foo.2~hL1ofrm3bhwQV2qm2fTjISDy8gg_4bX.4 2024-09-12T18:43:45.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1083 2024-09-12T18:43:45.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:45.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.922+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.412243260172553343 2024-09-12T18:43:45.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.926+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-12T18:43:45.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.926+0000 7fb90d8099c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:43:45.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.926+0000 7fb90d8099c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:43:45.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.930+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:43:45.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.930+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:43:45.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.930+0000 7fb90d8099c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:43:45.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.930+0000 7fb90d8099c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:43:45.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.930+0000 7fb90d8099c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[97c2b296-1395-4700-8053-4f06c4c86557.4689.11])"; uploads.size()=0; is_truncated=0 2024-09-12T18:43:45.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.930+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T18:43:45.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.930+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.934+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T18:43:45.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.934+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T18:43:45.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.934+0000 7fb90d8099c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T18:43:45.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.938+0000 7fb90d8099c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T18:43:45.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.938+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T18:43:45.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.938+0000 7fb7ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497018 cookie 94187525841600 notifier 5690 bl.length()=191 2024-09-12T18:43:45.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.942+0000 7fb90d8099c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.11 from cache 2024-09-12T18:43:45.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.942+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.11, ofs0, ns] 2024-09-12T18:43:45.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.942+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497026 cookie 94187525855104 notifier 5690 bl.length()=249 2024-09-12T18:43:45.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.946+0000 7fb90d8099c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.11 : miss 2024-09-12T18:43:45.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.946+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.946+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:45.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.946+0000 7fb90d8099c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.11 info.flags=0x0 2024-09-12T18:43:45.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.946+0000 7fb90d8099c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.11 to cache LRU end 2024-09-12T18:43:45.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.950+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.12 : miss 2024-09-12T18:43:45.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.950+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.954+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T18:43:45.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.954+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.12 info.flags=0x17 2024-09-12T18:43:45.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.954+0000 7fb90d8099c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.12 to cache LRU end 2024-09-12T18:43:45.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.954+0000 7fb90d8099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:43:45.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.954+0000 7fb90d8099c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:43:45.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.954+0000 7fb90d8099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.12 2024-09-12T18:43:45.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.962+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo 2024-09-12T18:43:45.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.962+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be084290 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55a9be082d08 s->prefetch_data=0 2024-09-12T18:43:45.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.962+0000 7fb90d8099c0 10 manifest: total_size = 26075 2024-09-12T18:43:45.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.962+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.12989435964327582621 2024-09-12T18:43:45.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.962+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be084290 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55a9be082d08 s->prefetch_data=0 2024-09-12T18:43:45.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.962+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be082d08 2024-09-12T18:43:45.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.962+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.12.10 2024-09-12T18:43:45.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=7665 rules.size()=4 2024-09-12T18:43:45.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7665 2024-09-12T18:43:45.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=7665 stripe_ofs=7665 part_ofs=7665 rule->part_size=7674 2024-09-12T18:43:45.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=4 2024-09-12T18:43:45.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4201969 part_ofs=7665 rule->part_size=7674 2024-09-12T18:43:45.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=15339 stripe_ofs=15339 part_ofs=15339 rule->part_size=7669 2024-09-12T18:43:45.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=7669 rules.size()=4 2024-09-12T18:43:45.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4209643 part_ofs=15339 rule->part_size=7669 2024-09-12T18:43:45.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=23008 stripe_ofs=23008 part_ofs=23008 rule->part_size=3067 2024-09-12T18:43:45.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-12T18:43:45.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4217312 part_ofs=23008 rule->part_size=3067 2024-09-12T18:43:45.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=26075 stripe_ofs=26075 part_ofs=26075 rule->part_size=3067 2024-09-12T18:43:45.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.12989435964327582621 2024-09-12T18:43:45.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:45.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.12__multipart_foo.2~lR0Sc3bxqIybbFtuqFsdIgwi6ycObkT.1 2024-09-12T18:43:45.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T18:43:45.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.12__multipart_foo.2~lR0Sc3bxqIybbFtuqFsdIgwi6ycObkT.2 2024-09-12T18:43:45.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T18:43:45.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.12__multipart_foo.2~lR0Sc3bxqIybbFtuqFsdIgwi6ycObkT.3 2024-09-12T18:43:45.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T18:43:45.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.12__multipart_foo.2~lR0Sc3bxqIybbFtuqFsdIgwi6ycObkT.4 2024-09-12T18:43:45.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T18:43:45.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:45.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.966+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.12989435964327582621 2024-09-12T18:43:45.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.970+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T18:43:45.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.974+0000 7fb90d8099c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:43:45.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.974+0000 7fb90d8099c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:43:45.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.974+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:43:45.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.974+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:43:45.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.974+0000 7fb90d8099c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:43:45.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.974+0000 7fb90d8099c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:43:45.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.974+0000 7fb90d8099c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[97c2b296-1395-4700-8053-4f06c4c86557.4689.12])"; uploads.size()=0; is_truncated=0 2024-09-12T18:43:45.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.978+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T18:43:45.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.978+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.982+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T18:43:45.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.982+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T18:43:45.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.982+0000 7fb90d8099c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T18:43:45.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.982+0000 7fb90d8099c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T18:43:45.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.982+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T18:43:45.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.986+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496976 cookie 94187525843904 notifier 5690 bl.length()=198 2024-09-12T18:43:45.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.986+0000 7fb90d8099c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.12 from cache 2024-09-12T18:43:45.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.986+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.12, ofs0, ns] 2024-09-12T18:43:45.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.990+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496970 cookie 94187525848704 notifier 5690 bl.length()=256 2024-09-12T18:43:45.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.994+0000 7fb90d8099c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.12 : miss 2024-09-12T18:43:45.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.994+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:45.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.998+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:45.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.998+0000 7fb90d8099c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.12 info.flags=0x0 2024-09-12T18:43:45.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:45.998+0000 7fb90d8099c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.12 to cache LRU end 2024-09-12T18:43:46.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.002+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.10 : miss 2024-09-12T18:43:46.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.002+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.002+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T18:43:46.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.002+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.10 info.flags=0x17 2024-09-12T18:43:46.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.002+0000 7fb90d8099c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.10 to cache LRU end 2024-09-12T18:43:46.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.002+0000 7fb90d8099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:43:46.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.002+0000 7fb90d8099c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:43:46.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.002+0000 7fb90d8099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.10 2024-09-12T18:43:46.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.010+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo[jGTqIdMQL0L5JsrNFrDEK0QNeO-kErH] 2024-09-12T18:43:46.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.010+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.10.10 2024-09-12T18:43:46.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.010+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be1002f0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55a9be0aba98 s->prefetch_data=0 2024-09-12T18:43:46.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.010+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to lnkeiwgpnuwwmjnxbh8iwnakpppo64sn 2024-09-12T18:43:46.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.010+0000 7fb90d8099c0 20 get_obj_state_impl: setting s->olh_tag to mrvyvfxsbfwnn0mz1vo9j0fbye2fojos 2024-09-12T18:43:46.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.010+0000 7fb90d8099c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mrvyvfxsbfwnn0mz1vo9j0fbye2fojos 2024-09-12T18:43:46.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.014+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.10.10 2024-09-12T18:43:46.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.014+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.10.10 2024-09-12T18:43:46.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.014+0000 7fb90d8099c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T18:43:46.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.014+0000 7fb90d8099c0 20 olh_log_entry: epoch=3 op=3 key=foo[jGTqIdMQL0L5JsrNFrDEK0QNeO-kErH] 2024-09-12T18:43:46.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.014+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be1002f0 obj=test-client.0-r-test-multipart-index-versioning.1:_:jGTqIdMQL0L5JsrNFrDEK0QNeO-kErH_foo state=0x55a9be0a4188 s->prefetch_data=0 2024-09-12T18:43:46.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.018+0000 7fb90d8099c0 10 manifest: total_size = 1667 2024-09-12T18:43:46.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.018+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.9631380537803902259 2024-09-12T18:43:46.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.018+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be1002f0 obj=test-client.0-r-test-multipart-index-versioning.1:_:jGTqIdMQL0L5JsrNFrDEK0QNeO-kErH_foo state=0x55a9be0a4188 s->prefetch_data=0 2024-09-12T18:43:46.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.018+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0a4188 2024-09-12T18:43:46.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.018+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.10.10 2024-09-12T18:43:46.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T18:43:46.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T18:43:46.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T18:43:46.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T18:43:46.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T18:43:46.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T18:43:46.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T18:43:46.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2024-09-12T18:43:46.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T18:43:46.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T18:43:46.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2024-09-12T18:43:46.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T18:43:46.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.9631380537803902259 2024-09-12T18:43:46.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.10__multipart_foo.2~4tGtHc2T3u2Bqstf8KCRKLsgYzD1bWs.1 2024-09-12T18:43:46.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T18:43:46.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.10__multipart_foo.2~4tGtHc2T3u2Bqstf8KCRKLsgYzD1bWs.2 2024-09-12T18:43:46.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T18:43:46.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.10__multipart_foo.2~4tGtHc2T3u2Bqstf8KCRKLsgYzD1bWs.3 2024-09-12T18:43:46.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T18:43:46.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.10__multipart_foo.2~4tGtHc2T3u2Bqstf8KCRKLsgYzD1bWs.4 2024-09-12T18:43:46.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T18:43:46.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.9631380537803902259 2024-09-12T18:43:46.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.022+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo[jGTqIdMQL0L5JsrNFrDEK0QNeO-kErH] 2024-09-12T18:43:46.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.026+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be1002f0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55a9be0aba98 s->prefetch_data=0 2024-09-12T18:43:46.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.030+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.10.10 2024-09-12T18:43:46.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.030+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.10.10 2024-09-12T18:43:46.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.030+0000 7fb90d8099c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:43:46.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.030+0000 7fb90d8099c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:43:46.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.034+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:43:46.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.034+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:43:46.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.034+0000 7fb90d8099c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:43:46.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.034+0000 7fb90d8099c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:43:46.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.034+0000 7fb90d8099c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[97c2b296-1395-4700-8053-4f06c4c86557.4689.10])"; uploads.size()=0; is_truncated=0 2024-09-12T18:43:46.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.034+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T18:43:46.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.034+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.038+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T18:43:46.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.038+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T18:43:46.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.038+0000 7fb90d8099c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T18:43:46.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.038+0000 7fb90d8099c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T18:43:46.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.038+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T18:43:46.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.038+0000 7fb7ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496977 cookie 94187525843904 notifier 5690 bl.length()=193 2024-09-12T18:43:46.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.042+0000 7fb90d8099c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.10 from cache 2024-09-12T18:43:46.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.042+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.10, ofs0, ns] 2024-09-12T18:43:46.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.042+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 94187525841600 notifier 5690 bl.length()=251 2024-09-12T18:43:46.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.046+0000 7fb90d8099c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.10 : miss 2024-09-12T18:43:46.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.046+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.050+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:46.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.050+0000 7fb90d8099c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.10 info.flags=0x0 2024-09-12T18:43:46.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.050+0000 7fb90d8099c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.10 to cache LRU end 2024-09-12T18:43:46.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.054+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.9 : miss 2024-09-12T18:43:46.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.054+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.054+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:43:46.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.054+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.9 info.flags=0x17 2024-09-12T18:43:46.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.054+0000 7fb90d8099c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.9 to cache LRU end 2024-09-12T18:43:46.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.054+0000 7fb90d8099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:43:46.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.054+0000 7fb90d8099c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:43:46.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.054+0000 7fb90d8099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.9 2024-09-12T18:43:46.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.062+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo 2024-09-12T18:43:46.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.062+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9bde66170 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.062+0000 7fb90d8099c0 10 manifest: total_size = 886297 2024-09-12T18:43:46.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.062+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.15184175931974354589 2024-09-12T18:43:46.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.062+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9bde66170 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.062+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be085a78 2024-09-12T18:43:46.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.062+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.9.10 2024-09-12T18:43:46.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:43:46.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T18:43:46.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T18:43:46.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:43:46.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T18:43:46.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T18:43:46.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T18:43:46.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-12T18:43:46.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T18:43:46.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T18:43:46.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-12T18:43:46.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T18:43:46.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15184175931974354589 2024-09-12T18:43:46.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.9__multipart_foo.2~3FiBQEkZhKVXIbyUqi2_BmYiHz_FSSB.1 2024-09-12T18:43:46.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-12T18:43:46.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.9__multipart_foo.2~3FiBQEkZhKVXIbyUqi2_BmYiHz_FSSB.2 2024-09-12T18:43:46.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-09-12T18:43:46.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.9__multipart_foo.2~3FiBQEkZhKVXIbyUqi2_BmYiHz_FSSB.3 2024-09-12T18:43:46.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2024-09-12T18:43:46.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.9__multipart_foo.2~3FiBQEkZhKVXIbyUqi2_BmYiHz_FSSB.4 2024-09-12T18:43:46.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2024-09-12T18:43:46.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15184175931974354589 2024-09-12T18:43:46.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:43:46.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.070+0000 7fb90d8099c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:43:46.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.074+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T18:43:46.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.074+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:43:46.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.074+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:43:46.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.074+0000 7fb90d8099c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:43:46.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.074+0000 7fb90d8099c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:43:46.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.074+0000 7fb90d8099c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[97c2b296-1395-4700-8053-4f06c4c86557.4689.9])"; uploads.size()=0; is_truncated=0 2024-09-12T18:43:46.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.078+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T18:43:46.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.078+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.078+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T18:43:46.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.078+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T18:43:46.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.078+0000 7fb90d8099c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T18:43:46.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.082+0000 7fb90d8099c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T18:43:46.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.082+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T18:43:46.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.082+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 94187525846400 notifier 5690 bl.length()=183 2024-09-12T18:43:46.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.086+0000 7fb90d8099c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.9 from cache 2024-09-12T18:43:46.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.086+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.9, ofs0, ns] 2024-09-12T18:43:46.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.086+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496978 cookie 94187525843904 notifier 5690 bl.length()=240 2024-09-12T18:43:46.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.094+0000 7fb90d8099c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.9 : miss 2024-09-12T18:43:46.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.094+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.094+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:46.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.094+0000 7fb90d8099c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.9 info.flags=0x0 2024-09-12T18:43:46.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.094+0000 7fb90d8099c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.9 to cache LRU end 2024-09-12T18:43:46.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.098+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.15 : miss 2024-09-12T18:43:46.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.098+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.098+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:43:46.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.098+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.15 info.flags=0x17 2024-09-12T18:43:46.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.098+0000 7fb90d8099c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.15 to cache LRU end 2024-09-12T18:43:46.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.098+0000 7fb90d8099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:43:46.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.098+0000 7fb90d8099c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:43:46.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.098+0000 7fb90d8099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.15 2024-09-12T18:43:46.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.102+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T18:43:46.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.102+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T18:43:46.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.102+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T18:43:46.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.102+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T18:43:46.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.102+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T18:43:46.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.102+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T18:43:46.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.106+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T18:43:46.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.106+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T18:43:46.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.106+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T18:43:46.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.106+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T18:43:46.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.106+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T18:43:46.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.106+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T18:43:46.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.106+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be101670 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.110+0000 7fb90d8099c0 10 manifest: total_size = 5242880 2024-09-12T18:43:46.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.110+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to _CJVbb-wBt_bbMEEbTVpwSx8ocCPWiB4 2024-09-12T18:43:46.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.110+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be101670 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.110+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be085a78 2024-09-12T18:43:46.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.110+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.15.0 2024-09-12T18:43:46.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.114+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.114+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.114+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.114+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.114+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: _CJVbb-wBt_bbMEEbTVpwSx8ocCPWiB4 2024-09-12T18:43:46.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.114+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.114+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.YTH8zyZeBBRZZ-hFmzc5XvysVUFPE6R_0 2024-09-12T18:43:46.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.114+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T18:43:46.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.114+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.YTH8zyZeBBRZZ-hFmzc5XvysVUFPE6R_1 2024-09-12T18:43:46.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.114+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T18:43:46.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.114+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.114+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _CJVbb-wBt_bbMEEbTVpwSx8ocCPWiB4 2024-09-12T18:43:46.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.114+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T18:43:46.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.118+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.118+0000 7fb90d8099c0 10 manifest: total_size = 5242880 2024-09-12T18:43:46.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.118+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to _imIDvnmyCzijw1tDN7SR3at7REs3umT 2024-09-12T18:43:46.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.118+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.118+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be085a78 2024-09-12T18:43:46.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.118+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.15.2 2024-09-12T18:43:46.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.122+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.122+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.122+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.122+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.122+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: _imIDvnmyCzijw1tDN7SR3at7REs3umT 2024-09-12T18:43:46.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.122+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.122+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.mPUaACFMhbTugBGLjAT2n8NONSk8RIJ_0 2024-09-12T18:43:46.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.122+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T18:43:46.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.122+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.mPUaACFMhbTugBGLjAT2n8NONSk8RIJ_1 2024-09-12T18:43:46.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.122+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T18:43:46.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.122+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.122+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _imIDvnmyCzijw1tDN7SR3at7REs3umT 2024-09-12T18:43:46.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.126+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T18:43:46.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.126+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb904022660 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.126+0000 7fb90d8099c0 10 manifest: total_size = 5242880 2024-09-12T18:43:46.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.126+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.17346819871101230521 2024-09-12T18:43:46.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.126+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb904022660 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.126+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be085a78 2024-09-12T18:43:46.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.126+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.15.3 2024-09-12T18:43:46.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.134+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.134+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.134+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.134+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.134+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.17346819871101230521 2024-09-12T18:43:46.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.134+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.134+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.Y4MpRgpPAyfI4cyGIXy4x-hg4TkkO7A_0 2024-09-12T18:43:46.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.134+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T18:43:46.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.134+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.Y4MpRgpPAyfI4cyGIXy4x-hg4TkkO7A_1 2024-09-12T18:43:46.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.134+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T18:43:46.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.134+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.134+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.17346819871101230521 2024-09-12T18:43:46.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.134+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T18:43:46.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.134+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.138+0000 7fb90d8099c0 10 manifest: total_size = 5242880 2024-09-12T18:43:46.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.138+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to _VGXttEkkC-yUPigoHW2KQkQursDReyb 2024-09-12T18:43:46.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.138+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.138+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be085a78 2024-09-12T18:43:46.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.138+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.15.5 2024-09-12T18:43:46.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.142+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.142+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.142+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.142+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.142+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: _VGXttEkkC-yUPigoHW2KQkQursDReyb 2024-09-12T18:43:46.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.142+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.142+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.hGjant0gTw1yHueKUg9qX4h-paOqNUo_0 2024-09-12T18:43:46.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.142+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T18:43:46.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.142+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.hGjant0gTw1yHueKUg9qX4h-paOqNUo_1 2024-09-12T18:43:46.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.142+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T18:43:46.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.142+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.142+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _VGXttEkkC-yUPigoHW2KQkQursDReyb 2024-09-12T18:43:46.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.142+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T18:43:46.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.146+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.146+0000 7fb90d8099c0 10 manifest: total_size = 5242880 2024-09-12T18:43:46.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.146+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to _qSR2d7u-D8M3ESrSiKbpmADuACNndcG 2024-09-12T18:43:46.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.146+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.146+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be085a78 2024-09-12T18:43:46.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.146+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.15.5 2024-09-12T18:43:46.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.150+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.150+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.150+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.150+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.150+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: _qSR2d7u-D8M3ESrSiKbpmADuACNndcG 2024-09-12T18:43:46.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.150+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.150+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.vZeeAt51myeq0foZu-jvBhvK0F7rLmN_0 2024-09-12T18:43:46.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.150+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T18:43:46.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.150+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.vZeeAt51myeq0foZu-jvBhvK0F7rLmN_1 2024-09-12T18:43:46.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.150+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T18:43:46.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.150+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.150+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _qSR2d7u-D8M3ESrSiKbpmADuACNndcG 2024-09-12T18:43:46.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.154+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T18:43:46.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.154+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4126120 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.158+0000 7fb90d8099c0 10 manifest: total_size = 5242880 2024-09-12T18:43:46.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.158+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.1826251127256592324 2024-09-12T18:43:46.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.158+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4126120 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.158+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be085a78 2024-09-12T18:43:46.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.158+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.15.5 2024-09-12T18:43:46.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.162+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.162+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.162+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.162+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.162+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.1826251127256592324 2024-09-12T18:43:46.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.162+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.162+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.qIk5xFPB23EAiHqTmrezm1m3WIMEb8z_0 2024-09-12T18:43:46.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.162+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T18:43:46.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.162+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.qIk5xFPB23EAiHqTmrezm1m3WIMEb8z_1 2024-09-12T18:43:46.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.162+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 560 2024-09-12T18:43:46.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.162+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.162+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.1826251127256592324 2024-09-12T18:43:46.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.166+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T18:43:46.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.166+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4126120 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.166+0000 7fb90d8099c0 10 manifest: total_size = 5242880 2024-09-12T18:43:46.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.166+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to _vnjH3ZPfejjmAPc3Kf-XBkTNeSfI90s 2024-09-12T18:43:46.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.166+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4126120 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.166+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be085a78 2024-09-12T18:43:46.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.166+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.15.7 2024-09-12T18:43:46.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.170+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.170+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.170+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.170+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.170+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: _vnjH3ZPfejjmAPc3Kf-XBkTNeSfI90s 2024-09-12T18:43:46.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.170+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.170+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.Jb-kA52M7HsuyN0Kb-wcvdsxvBpsKLr_0 2024-09-12T18:43:46.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.170+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T18:43:46.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.170+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.Jb-kA52M7HsuyN0Kb-wcvdsxvBpsKLr_1 2024-09-12T18:43:46.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.170+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T18:43:46.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.170+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.170+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _vnjH3ZPfejjmAPc3Kf-XBkTNeSfI90s 2024-09-12T18:43:46.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.174+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T18:43:46.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.174+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.174+0000 7fb90d8099c0 10 manifest: total_size = 5242880 2024-09-12T18:43:46.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.174+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.11835019199715828503 2024-09-12T18:43:46.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.174+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.174+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be085a78 2024-09-12T18:43:46.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.174+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.15.7 2024-09-12T18:43:46.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.182+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.182+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.182+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.182+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.182+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.11835019199715828503 2024-09-12T18:43:46.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.182+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.182+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.roO8KZwuOubh2yQeho0penm6GMSIEB2_0 2024-09-12T18:43:46.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.182+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T18:43:46.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.182+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.roO8KZwuOubh2yQeho0penm6GMSIEB2_1 2024-09-12T18:43:46.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.182+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T18:43:46.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.182+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.182+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.11835019199715828503 2024-09-12T18:43:46.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.186+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T18:43:46.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.186+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.186+0000 7fb90d8099c0 10 manifest: total_size = 5242880 2024-09-12T18:43:46.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.186+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.7716383947879138431 2024-09-12T18:43:46.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.186+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.186+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be085a78 2024-09-12T18:43:46.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.186+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.15.7 2024-09-12T18:43:46.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.190+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.190+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.190+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.190+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.190+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.7716383947879138431 2024-09-12T18:43:46.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.190+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.190+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.qIk5xFPB23EAiHqTmrezm1m3WIMEb8z_0 2024-09-12T18:43:46.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.190+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T18:43:46.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.190+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.qIk5xFPB23EAiHqTmrezm1m3WIMEb8z_1 2024-09-12T18:43:46.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.190+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 560 2024-09-12T18:43:46.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.190+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.190+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.7716383947879138431 2024-09-12T18:43:46.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.194+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T18:43:46.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.194+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb904022660 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.194+0000 7fb90d8099c0 10 manifest: total_size = 5242880 2024-09-12T18:43:46.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.194+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.8605850082400200395 2024-09-12T18:43:46.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.194+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb904022660 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.194+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be085a78 2024-09-12T18:43:46.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.194+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.15.8 2024-09-12T18:43:46.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.202+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.202+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.202+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.202+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.202+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.8605850082400200395 2024-09-12T18:43:46.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.202+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.202+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.roO8KZwuOubh2yQeho0penm6GMSIEB2_0 2024-09-12T18:43:46.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.202+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T18:43:46.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.202+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.roO8KZwuOubh2yQeho0penm6GMSIEB2_1 2024-09-12T18:43:46.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.202+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T18:43:46.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.202+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.202+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.8605850082400200395 2024-09-12T18:43:46.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.206+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T18:43:46.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.206+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc06d480 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.206+0000 7fb90d8099c0 10 manifest: total_size = 5242880 2024-09-12T18:43:46.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.206+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to _iBL88CqYZGIp6TVuhAHEPKDrhxJkZc9 2024-09-12T18:43:46.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.206+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8fc06d480 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.206+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be085a78 2024-09-12T18:43:46.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.206+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.15.8 2024-09-12T18:43:46.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.214+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.214+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.214+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.214+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.214+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: _iBL88CqYZGIp6TVuhAHEPKDrhxJkZc9 2024-09-12T18:43:46.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.214+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.214+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.9VUf1WRSgC3eqD9m1aSvTUqwiArowek_0 2024-09-12T18:43:46.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.214+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T18:43:46.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.214+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.9VUf1WRSgC3eqD9m1aSvTUqwiArowek_1 2024-09-12T18:43:46.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.214+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T18:43:46.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.214+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.214+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _iBL88CqYZGIp6TVuhAHEPKDrhxJkZc9 2024-09-12T18:43:46.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.218+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T18:43:46.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.218+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0830b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.218+0000 7fb90d8099c0 10 manifest: total_size = 5242880 2024-09-12T18:43:46.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.218+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.10555273284301631574 2024-09-12T18:43:46.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.218+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0830b0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55a9be085a78 s->prefetch_data=0 2024-09-12T18:43:46.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.218+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be085a78 2024-09-12T18:43:46.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.218+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.15.9 2024-09-12T18:43:46.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.222+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.222+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.222+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.222+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.222+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.10555273284301631574 2024-09-12T18:43:46.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.222+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.222+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.Y4MpRgpPAyfI4cyGIXy4x-hg4TkkO7A_0 2024-09-12T18:43:46.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.222+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T18:43:46.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.226+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.Y4MpRgpPAyfI4cyGIXy4x-hg4TkkO7A_1 2024-09-12T18:43:46.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.226+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T18:43:46.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.226+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.226+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.10555273284301631574 2024-09-12T18:43:46.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.226+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T18:43:46.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.230+0000 7fb90d8099c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:43:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.230+0000 7fb90d8099c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:43:46.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.230+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:43:46.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.230+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:43:46.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.230+0000 7fb90d8099c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:43:46.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.230+0000 7fb90d8099c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:43:46.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.230+0000 7fb90d8099c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[97c2b296-1395-4700-8053-4f06c4c86557.4689.15])"; uploads.size()=0; is_truncated=0 2024-09-12T18:43:46.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.234+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T18:43:46.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.234+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.234+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T18:43:46.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.234+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T18:43:46.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.238+0000 7fb90d8099c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T18:43:46.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.238+0000 7fb90d8099c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T18:43:46.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.238+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T18:43:46.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.238+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496979 cookie 94187525843904 notifier 5690 bl.length()=189 2024-09-12T18:43:46.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.242+0000 7fb90d8099c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.15 from cache 2024-09-12T18:43:46.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.242+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.15, ofs0, ns] 2024-09-12T18:43:46.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.246+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497020 cookie 94187525841600 notifier 5690 bl.length()=247 2024-09-12T18:43:46.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.254+0000 7fb90d8099c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.15 : miss 2024-09-12T18:43:46.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.254+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.254+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:46.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.254+0000 7fb90d8099c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.15 info.flags=0x0 2024-09-12T18:43:46.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.254+0000 7fb90d8099c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.15 to cache LRU end 2024-09-12T18:43:46.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.258+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.16 : miss 2024-09-12T18:43:46.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.258+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.262+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T18:43:46.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.262+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.16 info.flags=0x17 2024-09-12T18:43:46.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.262+0000 7fb90d8099c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.16 to cache LRU end 2024-09-12T18:43:46.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.262+0000 7fb90d8099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:43:46.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.262+0000 7fb90d8099c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:43:46.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.262+0000 7fb90d8099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.16 2024-09-12T18:43:46.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.262+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T18:43:46.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.266+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T18:43:46.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.266+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T18:43:46.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.266+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T18:43:46.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.266+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T18:43:46.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.266+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T18:43:46.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.270+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T18:43:46.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.270+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T18:43:46.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.270+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T18:43:46.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.270+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T18:43:46.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.270+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T18:43:46.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.274+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T18:43:46.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.274+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4126120 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.274+0000 7fb90d8099c0 10 manifest: total_size = 11534336 2024-09-12T18:43:46.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.274+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to _iUDcryP0VOZOLGQeJHA5BHmSY3daT5U 2024-09-12T18:43:46.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.274+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4126120 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.274+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ab2f8 2024-09-12T18:43:46.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.274+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.16.0 2024-09-12T18:43:46.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: _iUDcryP0VOZOLGQeJHA5BHmSY3daT5U 2024-09-12T18:43:46.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.rsjGqy_2gw3uq-WBJ5cP5XMUhCivtOm_0 2024-09-12T18:43:46.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T18:43:46.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.rsjGqy_2gw3uq-WBJ5cP5XMUhCivtOm_1 2024-09-12T18:43:46.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T18:43:46.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.rsjGqy_2gw3uq-WBJ5cP5XMUhCivtOm_2 2024-09-12T18:43:46.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T18:43:46.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _iUDcryP0VOZOLGQeJHA5BHmSY3daT5U 2024-09-12T18:43:46.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.282+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T18:43:46.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.286+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be086470 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.286+0000 7fb90d8099c0 10 manifest: total_size = 11534336 2024-09-12T18:43:46.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.286+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to _4dDMAjImfSZoXcw3d_29pC92he3yWXY 2024-09-12T18:43:46.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.286+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be086470 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.286+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ab2f8 2024-09-12T18:43:46.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.286+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.16.2 2024-09-12T18:43:46.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: _4dDMAjImfSZoXcw3d_29pC92he3yWXY 2024-09-12T18:43:46.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.ma88JgYYdCYmcbuzfn8CfG-FagfiCm5_0 2024-09-12T18:43:46.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T18:43:46.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.ma88JgYYdCYmcbuzfn8CfG-FagfiCm5_1 2024-09-12T18:43:46.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T18:43:46.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.ma88JgYYdCYmcbuzfn8CfG-FagfiCm5_2 2024-09-12T18:43:46.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T18:43:46.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.290+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _4dDMAjImfSZoXcw3d_29pC92he3yWXY 2024-09-12T18:43:46.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.294+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T18:43:46.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.294+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4004050 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.298+0000 7fb90d8099c0 10 manifest: total_size = 11534336 2024-09-12T18:43:46.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.298+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.16381898703241342418 2024-09-12T18:43:46.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.298+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4004050 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.298+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ab2f8 2024-09-12T18:43:46.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.298+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.16.3 2024-09-12T18:43:46.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:43:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:43:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16381898703241342418 2024-09-12T18:43:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.1 2024-09-12T18:43:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T18:43:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.1_1 2024-09-12T18:43:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T18:43:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.2 2024-09-12T18:43:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T18:43:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.2_1 2024-09-12T18:43:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T18:43:46.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.3 2024-09-12T18:43:46.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T18:43:46.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.302+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16381898703241342418 2024-09-12T18:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.306+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T18:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.306+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be087630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.306+0000 7fb90d8099c0 10 manifest: total_size = 11534336 2024-09-12T18:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.306+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to _cyw4VwB132CupC299p72sl42t408iwN 2024-09-12T18:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.306+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be087630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.306+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ab2f8 2024-09-12T18:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.306+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.16.5 2024-09-12T18:43:46.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: _cyw4VwB132CupC299p72sl42t408iwN 2024-09-12T18:43:46.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.bB2uHQ1V8mj0xAzuUO2UqxnsSVs9WZc_0 2024-09-12T18:43:46.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T18:43:46.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.bB2uHQ1V8mj0xAzuUO2UqxnsSVs9WZc_1 2024-09-12T18:43:46.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T18:43:46.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.bB2uHQ1V8mj0xAzuUO2UqxnsSVs9WZc_2 2024-09-12T18:43:46.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T18:43:46.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _cyw4VwB132CupC299p72sl42t408iwN 2024-09-12T18:43:46.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T18:43:46.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.314+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be087630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.318+0000 7fb90d8099c0 10 manifest: total_size = 11534336 2024-09-12T18:43:46.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.318+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to _IQuOAEFCjfsFRJvTbRp3yDEyUOOJFQm 2024-09-12T18:43:46.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.318+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be087630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.318+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ab2f8 2024-09-12T18:43:46.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.318+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.16.5 2024-09-12T18:43:46.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: _IQuOAEFCjfsFRJvTbRp3yDEyUOOJFQm 2024-09-12T18:43:46.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.NhMcRFLc3BWHsmXcOOZ52hjd_8p5gNq_0 2024-09-12T18:43:46.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T18:43:46.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.NhMcRFLc3BWHsmXcOOZ52hjd_8p5gNq_1 2024-09-12T18:43:46.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T18:43:46.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.NhMcRFLc3BWHsmXcOOZ52hjd_8p5gNq_2 2024-09-12T18:43:46.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T18:43:46.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.322+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _IQuOAEFCjfsFRJvTbRp3yDEyUOOJFQm 2024-09-12T18:43:46.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.326+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T18:43:46.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.326+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb9040673d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.326+0000 7fb90d8099c0 10 manifest: total_size = 11534336 2024-09-12T18:43:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.326+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.2681203772670160822 2024-09-12T18:43:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.326+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb9040673d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.326+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ab2f8 2024-09-12T18:43:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.326+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.16.5 2024-09-12T18:43:46.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:43:46.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:43:46.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.2681203772670160822 2024-09-12T18:43:46.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.1 2024-09-12T18:43:46.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T18:43:46.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.1_1 2024-09-12T18:43:46.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 626 2024-09-12T18:43:46.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.2 2024-09-12T18:43:46.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 890 2024-09-12T18:43:46.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.2_1 2024-09-12T18:43:46.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1152 2024-09-12T18:43:46.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.3 2024-09-12T18:43:46.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1416 2024-09-12T18:43:46.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.334+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.2681203772670160822 2024-09-12T18:43:46.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.338+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T18:43:46.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.338+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be100ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.338+0000 7fb90d8099c0 10 manifest: total_size = 11534336 2024-09-12T18:43:46.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.338+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to _LEMFb6wkFSNBpO7-vYn0BIOJ45GwbOj 2024-09-12T18:43:46.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.338+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be100ea0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.338+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ab2f8 2024-09-12T18:43:46.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.338+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.16.7 2024-09-12T18:43:46.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: _LEMFb6wkFSNBpO7-vYn0BIOJ45GwbOj 2024-09-12T18:43:46.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.ajsYEmMg6QmMEu3oYQzjFkcJ2KpCWh__0 2024-09-12T18:43:46.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T18:43:46.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.ajsYEmMg6QmMEu3oYQzjFkcJ2KpCWh__1 2024-09-12T18:43:46.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T18:43:46.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.ajsYEmMg6QmMEu3oYQzjFkcJ2KpCWh__2 2024-09-12T18:43:46.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-12T18:43:46.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.346+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _LEMFb6wkFSNBpO7-vYn0BIOJ45GwbOj 2024-09-12T18:43:46.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.350+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T18:43:46.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.350+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb9040673d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.350+0000 7fb90d8099c0 10 manifest: total_size = 11534336 2024-09-12T18:43:46.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.350+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.10937224087767340409 2024-09-12T18:43:46.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.350+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb9040673d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.350+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ab2f8 2024-09-12T18:43:46.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.350+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.16.7 2024-09-12T18:43:46.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:43:46.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:43:46.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.10937224087767340409 2024-09-12T18:43:46.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.1 2024-09-12T18:43:46.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T18:43:46.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.1_1 2024-09-12T18:43:46.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T18:43:46.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.2 2024-09-12T18:43:46.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T18:43:46.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.2_1 2024-09-12T18:43:46.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T18:43:46.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.3 2024-09-12T18:43:46.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T18:43:46.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.10937224087767340409 2024-09-12T18:43:46.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0833a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.358+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T18:43:46.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.362+0000 7fb90d8099c0 10 manifest: total_size = 11534336 2024-09-12T18:43:46.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.362+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.5544350876923637088 2024-09-12T18:43:46.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.362+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0833a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.362+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ab2f8 2024-09-12T18:43:46.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.362+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.16.7 2024-09-12T18:43:46.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:43:46.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:43:46.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.5544350876923637088 2024-09-12T18:43:46.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.1 2024-09-12T18:43:46.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T18:43:46.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.1_1 2024-09-12T18:43:46.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 626 2024-09-12T18:43:46.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.2 2024-09-12T18:43:46.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 890 2024-09-12T18:43:46.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.2_1 2024-09-12T18:43:46.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1152 2024-09-12T18:43:46.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.3 2024-09-12T18:43:46.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1416 2024-09-12T18:43:46.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.366+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.5544350876923637088 2024-09-12T18:43:46.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.370+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T18:43:46.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.370+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be087630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.374+0000 7fb90d8099c0 10 manifest: total_size = 11534336 2024-09-12T18:43:46.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.374+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.7634965542007028196 2024-09-12T18:43:46.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.374+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be087630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.374+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ab2f8 2024-09-12T18:43:46.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.374+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.16.8 2024-09-12T18:43:46.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:43:46.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:43:46.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.7634965542007028196 2024-09-12T18:43:46.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.1 2024-09-12T18:43:46.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T18:43:46.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.1_1 2024-09-12T18:43:46.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T18:43:46.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.2 2024-09-12T18:43:46.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T18:43:46.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.2_1 2024-09-12T18:43:46.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T18:43:46.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.3 2024-09-12T18:43:46.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T18:43:46.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.378+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.7634965542007028196 2024-09-12T18:43:46.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.382+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T18:43:46.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.382+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9bde6cba0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.382+0000 7fb90d8099c0 10 manifest: total_size = 11534336 2024-09-12T18:43:46.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.382+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to _G7ERP6jvbpXmSG3ht0CpvREp2ikDLmq 2024-09-12T18:43:46.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.382+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9bde6cba0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.382+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ab2f8 2024-09-12T18:43:46.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.382+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.16.8 2024-09-12T18:43:46.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: _G7ERP6jvbpXmSG3ht0CpvREp2ikDLmq 2024-09-12T18:43:46.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.uoACddA2ptWJfuYX3cm0k6QLCRGK08H_0 2024-09-12T18:43:46.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T18:43:46.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.uoACddA2ptWJfuYX3cm0k6QLCRGK08H_1 2024-09-12T18:43:46.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T18:43:46.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.uoACddA2ptWJfuYX3cm0k6QLCRGK08H_2 2024-09-12T18:43:46.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T18:43:46.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.390+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _G7ERP6jvbpXmSG3ht0CpvREp2ikDLmq 2024-09-12T18:43:46.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.394+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T18:43:46.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.394+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9bde6cba0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.394+0000 7fb90d8099c0 10 manifest: total_size = 11534336 2024-09-12T18:43:46.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.394+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.3341280490876601415 2024-09-12T18:43:46.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.394+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9bde6cba0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55a9be0ab2f8 s->prefetch_data=0 2024-09-12T18:43:46.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.394+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0ab2f8 2024-09-12T18:43:46.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.394+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.16.9 2024-09-12T18:43:46.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:43:46.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:43:46.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.3341280490876601415 2024-09-12T18:43:46.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.1 2024-09-12T18:43:46.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T18:43:46.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.1_1 2024-09-12T18:43:46.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T18:43:46.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.2 2024-09-12T18:43:46.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T18:43:46.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.2_1 2024-09-12T18:43:46.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T18:43:46.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.3 2024-09-12T18:43:46.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T18:43:46.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.398+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.3341280490876601415 2024-09-12T18:43:46.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.402+0000 7fb90d8099c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:43:46.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.402+0000 7fb90d8099c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:43:46.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.402+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T18:43:46.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.406+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:43:46.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.406+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:43:46.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.406+0000 7fb90d8099c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:43:46.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.406+0000 7fb90d8099c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:43:46.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.406+0000 7fb90d8099c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[97c2b296-1395-4700-8053-4f06c4c86557.4689.16])"; uploads.size()=0; is_truncated=0 2024-09-12T18:43:46.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.410+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T18:43:46.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.410+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.410+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T18:43:46.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.410+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T18:43:46.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.410+0000 7fb90d8099c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T18:43:46.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.414+0000 7fb90d8099c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T18:43:46.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.414+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T18:43:46.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.414+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496971 cookie 94187525848704 notifier 5690 bl.length()=199 2024-09-12T18:43:46.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.418+0000 7fb90d8099c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.16 from cache 2024-09-12T18:43:46.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.418+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.16, ofs0, ns] 2024-09-12T18:43:46.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.422+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 94187525846400 notifier 5690 bl.length()=257 2024-09-12T18:43:46.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.430+0000 7fb90d8099c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.16 : miss 2024-09-12T18:43:46.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.430+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.430+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:46.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.430+0000 7fb90d8099c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.16 info.flags=0x0 2024-09-12T18:43:46.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.430+0000 7fb90d8099c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.16 to cache LRU end 2024-09-12T18:43:46.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.434+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.14 : miss 2024-09-12T18:43:46.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.434+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.438+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T18:43:46.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.438+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.14 info.flags=0x17 2024-09-12T18:43:46.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.438+0000 7fb90d8099c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.14 to cache LRU end 2024-09-12T18:43:46.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.438+0000 7fb90d8099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:43:46.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.438+0000 7fb90d8099c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:43:46.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.438+0000 7fb90d8099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.14 2024-09-12T18:43:46.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.442+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T18:43:46.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.442+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T18:43:46.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.446+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T18:43:46.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.450+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4004050 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55a9be09c9c8 s->prefetch_data=0 2024-09-12T18:43:46.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.450+0000 7fb90d8099c0 10 manifest: total_size = 11534336 2024-09-12T18:43:46.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.450+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.2478200505443123963 2024-09-12T18:43:46.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.450+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4004050 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55a9be09c9c8 s->prefetch_data=0 2024-09-12T18:43:46.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.450+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be09c9c8 2024-09-12T18:43:46.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.450+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.14.3 2024-09-12T18:43:46.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:43:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:43:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.2478200505443123963 2024-09-12T18:43:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-FROZEN.2~gHqLahp_LPmQbcIw8EU_nX5y8k0bx8N.1 2024-09-12T18:43:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T18:43:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.14__shadow_foo-FROZEN.2~gHqLahp_LPmQbcIw8EU_nX5y8k0bx8N.1_1 2024-09-12T18:43:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T18:43:46.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-FROZEN.2~gHqLahp_LPmQbcIw8EU_nX5y8k0bx8N.2 2024-09-12T18:43:46.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T18:43:46.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.14__shadow_foo-FROZEN.2~gHqLahp_LPmQbcIw8EU_nX5y8k0bx8N.2_1 2024-09-12T18:43:46.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T18:43:46.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-FROZEN.2~gHqLahp_LPmQbcIw8EU_nX5y8k0bx8N.3 2024-09-12T18:43:46.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T18:43:46.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.458+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.2478200505443123963 2024-09-12T18:43:46.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.462+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T18:43:46.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.462+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4126120 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55a9be09c9c8 s->prefetch_data=0 2024-09-12T18:43:46.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.462+0000 7fb90d8099c0 10 manifest: total_size = 1087 2024-09-12T18:43:46.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.462+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.1109016895622183734 2024-09-12T18:43:46.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.462+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4126120 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55a9be09c9c8 s->prefetch_data=0 2024-09-12T18:43:46.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.462+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be09c9c8 2024-09-12T18:43:46.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.462+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.14.5 2024-09-12T18:43:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T18:43:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T18:43:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T18:43:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T18:43:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T18:43:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T18:43:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T18:43:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=55 2024-09-12T18:43:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T18:43:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.1109016895622183734 2024-09-12T18:43:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-STANDARD.2~usqWn5HZbNYxA4LMI-ZTH1nIItKxz4Y.1 2024-09-12T18:43:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T18:43:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-STANDARD.2~usqWn5HZbNYxA4LMI-ZTH1nIItKxz4Y.2 2024-09-12T18:43:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T18:43:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-STANDARD.2~usqWn5HZbNYxA4LMI-ZTH1nIItKxz4Y.3 2024-09-12T18:43:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T18:43:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.1109016895622183734 2024-09-12T18:43:46.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T18:43:46.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.470+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb904022660 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55a9be09c9c8 s->prefetch_data=0 2024-09-12T18:43:46.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.474+0000 7fb90d8099c0 10 manifest: total_size = 11534336 2024-09-12T18:43:46.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.474+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.6382250405923912766 2024-09-12T18:43:46.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.474+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb904022660 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55a9be09c9c8 s->prefetch_data=0 2024-09-12T18:43:46.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.474+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be09c9c8 2024-09-12T18:43:46.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.474+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.14.7 2024-09-12T18:43:46.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T18:43:46.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T18:43:46.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T18:43:46.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T18:43:46.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T18:43:46.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T18:43:46.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.6382250405923912766 2024-09-12T18:43:46.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-LUKEWARM.2~UQ-6sdKtsHlprUJsDuy2lqp1927Qndm.1 2024-09-12T18:43:46.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T18:43:46.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.14__shadow_foo-LUKEWARM.2~UQ-6sdKtsHlprUJsDuy2lqp1927Qndm.1_1 2024-09-12T18:43:46.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T18:43:46.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-LUKEWARM.2~UQ-6sdKtsHlprUJsDuy2lqp1927Qndm.2 2024-09-12T18:43:46.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T18:43:46.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.14__shadow_foo-LUKEWARM.2~UQ-6sdKtsHlprUJsDuy2lqp1927Qndm.2_1 2024-09-12T18:43:46.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T18:43:46.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-LUKEWARM.2~UQ-6sdKtsHlprUJsDuy2lqp1927Qndm.3 2024-09-12T18:43:46.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T18:43:46.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.478+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.6382250405923912766 2024-09-12T18:43:46.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.482+0000 7fb90d8099c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:43:46.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.482+0000 7fb90d8099c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:43:46.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.482+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T18:43:46.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.486+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:43:46.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.486+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:43:46.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.486+0000 7fb90d8099c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:43:46.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.486+0000 7fb90d8099c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:43:46.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.486+0000 7fb90d8099c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[97c2b296-1395-4700-8053-4f06c4c86557.4689.14])"; uploads.size()=0; is_truncated=0 2024-09-12T18:43:46.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.490+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T18:43:46.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.490+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.490+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T18:43:46.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.490+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T18:43:46.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.490+0000 7fb90d8099c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T18:43:46.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.494+0000 7fb90d8099c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T18:43:46.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.494+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T18:43:46.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.494+0000 7fb7ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497027 cookie 94187525852400 notifier 5690 bl.length()=194 2024-09-12T18:43:46.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.498+0000 7fb90d8099c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.14 from cache 2024-09-12T18:43:46.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.498+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.14, ofs0, ns] 2024-09-12T18:43:46.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.498+0000 7fb7ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496995 cookie 94187525846400 notifier 5690 bl.length()=252 2024-09-12T18:43:46.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.506+0000 7fb90d8099c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.14 : miss 2024-09-12T18:43:46.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.506+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.506+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:46.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.506+0000 7fb90d8099c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.14 info.flags=0x0 2024-09-12T18:43:46.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.506+0000 7fb90d8099c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.14 to cache LRU end 2024-09-12T18:43:46.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.514+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.13 : miss 2024-09-12T18:43:46.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.514+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.514+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T18:43:46.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.514+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.13 info.flags=0x17 2024-09-12T18:43:46.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.514+0000 7fb90d8099c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.13 to cache LRU end 2024-09-12T18:43:46.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.514+0000 7fb90d8099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:43:46.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.514+0000 7fb90d8099c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:43:46.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.514+0000 7fb90d8099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.13 2024-09-12T18:43:46.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.518+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T18:43:46.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.522+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T18:43:46.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.522+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T18:43:46.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.526+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0ff140 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55a9be0a0438 s->prefetch_data=0 2024-09-12T18:43:46.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.526+0000 7fb90d8099c0 10 manifest: total_size = 10485760 2024-09-12T18:43:46.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.526+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.4798136523961795867 2024-09-12T18:43:46.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.526+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0ff140 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55a9be0a0438 s->prefetch_data=0 2024-09-12T18:43:46.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.526+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0a0438 2024-09-12T18:43:46.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.526+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.13.3 2024-09-12T18:43:46.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4798136523961795867 2024-09-12T18:43:46.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.13__shadow_.hJ-9029EWPBPwZWYAOgaUpOfvA1DJNW_0 2024-09-12T18:43:46.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T18:43:46.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.13__shadow_.hJ-9029EWPBPwZWYAOgaUpOfvA1DJNW_1 2024-09-12T18:43:46.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T18:43:46.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.13__shadow_.hJ-9029EWPBPwZWYAOgaUpOfvA1DJNW_2 2024-09-12T18:43:46.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 811 2024-09-12T18:43:46.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.534+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.4798136523961795867 2024-09-12T18:43:46.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.538+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0ac380 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55a9be0a0438 s->prefetch_data=0 2024-09-12T18:43:46.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.538+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T18:43:46.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.538+0000 7fb90d8099c0 10 manifest: total_size = 3312 2024-09-12T18:43:46.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.538+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.2604881477715841574 2024-09-12T18:43:46.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.538+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0ac380 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55a9be0a0438 s->prefetch_data=0 2024-09-12T18:43:46.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.538+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0a0438 2024-09-12T18:43:46.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.538+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.13.5 2024-09-12T18:43:46.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.546+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.546+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=3312 stripe_ofs=3312 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.546+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.2604881477715841574 2024-09-12T18:43:46.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.546+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.546+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.13__shadow_.FQAojOZylJJfJzEtqU1vYlFJ3QhbL_L_0 2024-09-12T18:43:46.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.546+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T18:43:46.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.546+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.546+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.2604881477715841574 2024-09-12T18:43:46.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.546+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T18:43:46.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.546+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0ac380 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55a9be0a0438 s->prefetch_data=0 2024-09-12T18:43:46.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.550+0000 7fb90d8099c0 10 manifest: total_size = 10485760 2024-09-12T18:43:46.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.550+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.12380210283015916960 2024-09-12T18:43:46.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.550+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0ac380 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55a9be0a0438 s->prefetch_data=0 2024-09-12T18:43:46.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.550+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0a0438 2024-09-12T18:43:46.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.550+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.13.7 2024-09-12T18:43:46.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.12380210283015916960 2024-09-12T18:43:46.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.13__shadow_.Gwl8CJmcLcKBmFQsMHZM52yHLFQ9P-U_0 2024-09-12T18:43:46.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T18:43:46.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.13__shadow_.Gwl8CJmcLcKBmFQsMHZM52yHLFQ9P-U_1 2024-09-12T18:43:46.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T18:43:46.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.13__shadow_.Gwl8CJmcLcKBmFQsMHZM52yHLFQ9P-U_2 2024-09-12T18:43:46.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 818 2024-09-12T18:43:46.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.554+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.12380210283015916960 2024-09-12T18:43:46.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.558+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T18:43:46.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.558+0000 7fb90d8099c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:43:46.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.558+0000 7fb90d8099c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:43:46.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.562+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:43:46.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.562+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:43:46.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.562+0000 7fb90d8099c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:43:46.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.562+0000 7fb90d8099c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:43:46.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.562+0000 7fb90d8099c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[97c2b296-1395-4700-8053-4f06c4c86557.4689.13])"; uploads.size()=0; is_truncated=0 2024-09-12T18:43:46.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.566+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T18:43:46.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.566+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.566+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T18:43:46.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.566+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T18:43:46.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.566+0000 7fb90d8099c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T18:43:46.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.570+0000 7fb90d8099c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T18:43:46.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.570+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T18:43:46.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.570+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496980 cookie 94187525843904 notifier 5690 bl.length()=184 2024-09-12T18:43:46.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.574+0000 7fb90d8099c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.13 from cache 2024-09-12T18:43:46.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.574+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.13, ofs0, ns] 2024-09-12T18:43:46.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.578+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496972 cookie 94187525848704 notifier 5690 bl.length()=242 2024-09-12T18:43:46.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.582+0000 7fb90d8099c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.13 : miss 2024-09-12T18:43:46.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.582+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.582+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:46.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.582+0000 7fb90d8099c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.13 info.flags=0x0 2024-09-12T18:43:46.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.582+0000 7fb90d8099c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.13 to cache LRU end 2024-09-12T18:43:46.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.590+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.6 : miss 2024-09-12T18:43:46.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.590+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.590+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T18:43:46.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.590+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.6 info.flags=0x17 2024-09-12T18:43:46.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.590+0000 7fb90d8099c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.6 to cache LRU end 2024-09-12T18:43:46.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.590+0000 7fb90d8099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:43:46.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.590+0000 7fb90d8099c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:43:46.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.590+0000 7fb90d8099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.6 2024-09-12T18:43:46.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.594+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T18:43:46.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.594+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T18:43:46.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.598+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got __ 2024-09-12T18:43:46.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.598+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got obj 2024-09-12T18:43:46.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.602+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55a9be0a1c78 s->prefetch_data=0 2024-09-12T18:43:46.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.602+0000 7fb90d8099c0 10 manifest: total_size = 0 2024-09-12T18:43:46.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.602+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.17860789729518506988 2024-09-12T18:43:46.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.602+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55a9be0a1c78 s->prefetch_data=0 2024-09-12T18:43:46.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.602+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0a1c78 2024-09-12T18:43:46.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.602+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.6.2 2024-09-12T18:43:46.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.610+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55a9be0a61a8 s->prefetch_data=0 2024-09-12T18:43:46.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.610+0000 7fb90d8099c0 10 manifest: total_size = 0 2024-09-12T18:43:46.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.610+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.17692508624017998411 2024-09-12T18:43:46.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.610+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55a9be0a61a8 s->prefetch_data=0 2024-09-12T18:43:46.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.610+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0a61a8 2024-09-12T18:43:46.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.610+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.6.3 2024-09-12T18:43:46.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.610+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=___ 2024-09-12T18:43:46.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.614+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55a9bde748f8 s->prefetch_data=0 2024-09-12T18:43:46.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.618+0000 7fb90d8099c0 10 manifest: total_size = 0 2024-09-12T18:43:46.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.618+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.13914181944967846050 2024-09-12T18:43:46.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.618+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55a9bde748f8 s->prefetch_data=0 2024-09-12T18:43:46.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.618+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9bde748f8 2024-09-12T18:43:46.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.618+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.6.6 2024-09-12T18:43:46.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.618+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T18:43:46.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.622+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb904087fc0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55a9bde748f8 s->prefetch_data=0 2024-09-12T18:43:46.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.626+0000 7fb90d8099c0 10 manifest: total_size = 0 2024-09-12T18:43:46.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.626+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.13597758443456156959 2024-09-12T18:43:46.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.626+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb904087fc0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55a9bde748f8 s->prefetch_data=0 2024-09-12T18:43:46.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.626+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9bde748f8 2024-09-12T18:43:46.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.626+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.6.8 2024-09-12T18:43:46.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.626+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=__ 2024-09-12T18:43:46.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.630+0000 7fb90d8099c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:43:46.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.630+0000 7fb90d8099c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:43:46.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.634+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=obj 2024-09-12T18:43:46.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.634+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:43:46.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.634+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:43:46.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.634+0000 7fb90d8099c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:43:46.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.634+0000 7fb90d8099c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:43:46.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.634+0000 7fb90d8099c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[97c2b296-1395-4700-8053-4f06c4c86557.4689.6])"; uploads.size()=0; is_truncated=0 2024-09-12T18:43:46.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.638+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T18:43:46.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.638+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.642+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T18:43:46.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.642+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T18:43:46.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.642+0000 7fb90d8099c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T18:43:46.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.646+0000 7fb90d8099c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T18:43:46.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.646+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T18:43:46.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.646+0000 7fb7ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497021 cookie 94187525841600 notifier 5690 bl.length()=181 2024-09-12T18:43:46.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.650+0000 7fb90d8099c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.6 from cache 2024-09-12T18:43:46.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.650+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:97c2b296-1395-4700-8053-4f06c4c86557.4689.6, ofs0, ns] 2024-09-12T18:43:46.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.650+0000 7fb7ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496974 cookie 94187525859616 notifier 5690 bl.length()=238 2024-09-12T18:43:46.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.658+0000 7fb90d8099c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.6 : miss 2024-09-12T18:43:46.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.658+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.658+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:46.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.658+0000 7fb90d8099c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.6 info.flags=0x0 2024-09-12T18:43:46.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.658+0000 7fb90d8099c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/97c2b296-1395-4700-8053-4f06c4c86557.4689.6 to cache LRU end 2024-09-12T18:43:46.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.666+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:97c2b296-1395-4700-8053-4f06c4c86557.4689.7 : miss 2024-09-12T18:43:46.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.666+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.666+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T18:43:46.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.666+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:97c2b296-1395-4700-8053-4f06c4c86557.4689.7 info.flags=0x17 2024-09-12T18:43:46.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.666+0000 7fb90d8099c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:97c2b296-1395-4700-8053-4f06c4c86557.4689.7 to cache LRU end 2024-09-12T18:43:46.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.666+0000 7fb90d8099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:43:46.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.666+0000 7fb90d8099c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:43:46.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.666+0000 7fb90d8099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:97c2b296-1395-4700-8053-4f06c4c86557.4689.7 2024-09-12T18:43:46.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.670+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T18:43:46.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.670+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T18:43:46.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.674+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got __ 2024-09-12T18:43:46.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.674+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got obj 2024-09-12T18:43:46.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.678+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4004050 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55a9be0a2568 s->prefetch_data=0 2024-09-12T18:43:46.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.678+0000 7fb90d8099c0 10 manifest: total_size = 524288 2024-09-12T18:43:46.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.678+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.7751574808022068934 2024-09-12T18:43:46.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.678+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4004050 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55a9be0a2568 s->prefetch_data=0 2024-09-12T18:43:46.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.678+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0a2568 2024-09-12T18:43:46.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.678+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.7.2 2024-09-12T18:43:46.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.682+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.682+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.682+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.7751574808022068934 2024-09-12T18:43:46.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.682+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.682+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.7__shadow_.VmvdontdF2c6bd8hPQiqPPw9QJA9MNm_0 2024-09-12T18:43:46.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.682+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:43:46.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.682+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.682+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.7751574808022068934 2024-09-12T18:43:46.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.686+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=___ 2024-09-12T18:43:46.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.686+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4004050 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55a9be0a2568 s->prefetch_data=0 2024-09-12T18:43:46.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.686+0000 7fb90d8099c0 10 manifest: total_size = 38 2024-09-12T18:43:46.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.686+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.11381257314695194615 2024-09-12T18:43:46.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.686+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4004050 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55a9be0a2568 s->prefetch_data=0 2024-09-12T18:43:46.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.686+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0a2568 2024-09-12T18:43:46.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.686+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.7.3 2024-09-12T18:43:46.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.694+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.694+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.694+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.11381257314695194615 2024-09-12T18:43:46.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.694+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.694+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.7__shadow_.DPUJXObMKImaZG2JGugPuY_Ylohpaws_0 2024-09-12T18:43:46.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.694+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:43:46.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.694+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.694+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.11381257314695194615 2024-09-12T18:43:46.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.698+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T18:43:46.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.698+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4004050 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55a9be0a2568 s->prefetch_data=0 2024-09-12T18:43:46.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.698+0000 7fb90d8099c0 10 manifest: total_size = 24595 2024-09-12T18:43:46.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.698+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.5219436195127772713 2024-09-12T18:43:46.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.698+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4004050 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55a9be0a2568 s->prefetch_data=0 2024-09-12T18:43:46.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.698+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0a2568 2024-09-12T18:43:46.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.698+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.7.6 2024-09-12T18:43:46.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.706+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.706+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.706+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.5219436195127772713 2024-09-12T18:43:46.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.706+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.706+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.7__shadow_.RhekEOUAt7cnqAO1TA8hovqUKcm_ngn_0 2024-09-12T18:43:46.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.706+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:43:46.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.706+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.706+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.5219436195127772713 2024-09-12T18:43:46.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.710+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55a9be0a2568 s->prefetch_data=0 2024-09-12T18:43:46.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.710+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=__ 2024-09-12T18:43:46.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.710+0000 7fb90d8099c0 10 manifest: total_size = 527 2024-09-12T18:43:46.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.710+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.16354581876849887707 2024-09-12T18:43:46.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.710+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55a9be0a2568 s->prefetch_data=0 2024-09-12T18:43:46.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.710+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9be0a2568 2024-09-12T18:43:46.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.710+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.7.8 2024-09-12T18:43:46.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.714+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.714+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.714+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16354581876849887707 2024-09-12T18:43:46.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.714+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.714+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.7__shadow_.Hz0cHw9DgtVDSbEzUh6bEyzazGDVEFz_0 2024-09-12T18:43:46.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.714+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:43:46.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.714+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.714+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.16354581876849887707 2024-09-12T18:43:46.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.718+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=obj 2024-09-12T18:43:46.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.718+0000 7fb90d8099c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:43:46.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.718+0000 7fb90d8099c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:43:46.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.722+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:43:46.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.722+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:43:46.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.722+0000 7fb90d8099c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:43:46.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.722+0000 7fb90d8099c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:43:46.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.722+0000 7fb90d8099c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[97c2b296-1395-4700-8053-4f06c4c86557.4689.7])"; uploads.size()=0; is_truncated=0 2024-09-12T18:43:46.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.726+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T18:43:46.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.726+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.726+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T18:43:46.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.726+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T18:43:46.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.726+0000 7fb90d8099c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T18:43:46.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.730+0000 7fb90d8099c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T18:43:46.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.730+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T18:43:46.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.730+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497022 cookie 94187525841600 notifier 5690 bl.length()=181 2024-09-12T18:43:46.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.734+0000 7fb90d8099c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:97c2b296-1395-4700-8053-4f06c4c86557.4689.7 from cache 2024-09-12T18:43:46.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.734+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:97c2b296-1395-4700-8053-4f06c4c86557.4689.7, ofs0, ns] 2024-09-12T18:43:46.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.734+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496975 cookie 94187525859616 notifier 5690 bl.length()=238 2024-09-12T18:43:46.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.742+0000 7fb90d8099c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/97c2b296-1395-4700-8053-4f06c4c86557.4689.7 : miss 2024-09-12T18:43:46.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.742+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.742+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:46.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.742+0000 7fb90d8099c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/97c2b296-1395-4700-8053-4f06c4c86557.4689.7 info.flags=0x0 2024-09-12T18:43:46.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.742+0000 7fb90d8099c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/97c2b296-1395-4700-8053-4f06c4c86557.4689.7 to cache LRU end 2024-09-12T18:43:46.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.750+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:97c2b296-1395-4700-8053-4f06c4c86557.4689.8 : miss 2024-09-12T18:43:46.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.750+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.750+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T18:43:46.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.750+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:97c2b296-1395-4700-8053-4f06c4c86557.4689.8 info.flags=0x17 2024-09-12T18:43:46.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.750+0000 7fb90d8099c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:97c2b296-1395-4700-8053-4f06c4c86557.4689.8 to cache LRU end 2024-09-12T18:43:46.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.750+0000 7fb90d8099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:43:46.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.750+0000 7fb90d8099c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T18:43:46.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.750+0000 7fb90d8099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:97c2b296-1395-4700-8053-4f06c4c86557.4689.8 2024-09-12T18:43:46.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.754+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T18:43:46.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.754+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T18:43:46.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.758+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got __ 2024-09-12T18:43:46.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.758+0000 7fb90d8099c0 10 cls_bucket_list_unordered: got obj 2024-09-12T18:43:46.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.762+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0a9d90 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55a9bde738e8 s->prefetch_data=0 2024-09-12T18:43:46.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.762+0000 7fb90d8099c0 10 manifest: total_size = 49187 2024-09-12T18:43:46.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.762+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.6955954007360262663 2024-09-12T18:43:46.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.762+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0a9d90 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55a9bde738e8 s->prefetch_data=0 2024-09-12T18:43:46.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.762+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9bde738e8 2024-09-12T18:43:46.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.762+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.8.2 2024-09-12T18:43:46.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.766+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.766+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.766+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.6955954007360262663 2024-09-12T18:43:46.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.766+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.766+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.8__shadow_.nc6DTQw241e0Vy1xNT9JgfWKU8lmPG7_0 2024-09-12T18:43:46.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.766+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:43:46.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.766+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.766+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.6955954007360262663 2024-09-12T18:43:46.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.770+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T18:43:46.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.770+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0ff140 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55a9bde738e8 s->prefetch_data=0 2024-09-12T18:43:46.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.774+0000 7fb90d8099c0 10 manifest: total_size = 49187 2024-09-12T18:43:46.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.774+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.15274418099378329378 2024-09-12T18:43:46.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.774+0000 7fb90d8099c0 20 get_obj_state: octx=0x55a9be0ff140 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55a9bde738e8 s->prefetch_data=0 2024-09-12T18:43:46.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.774+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9bde738e8 2024-09-12T18:43:46.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.774+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.8.3 2024-09-12T18:43:46.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.778+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.778+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.778+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15274418099378329378 2024-09-12T18:43:46.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.778+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.778+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.8__shadow_.pzVRk5FnsO4V9dVoXssjZm6K9qNuBVF_0 2024-09-12T18:43:46.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.778+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:43:46.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.778+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.778+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.15274418099378329378 2024-09-12T18:43:46.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.782+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T18:43:46.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.782+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55a9bde738e8 s->prefetch_data=0 2024-09-12T18:43:46.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.786+0000 7fb90d8099c0 10 manifest: total_size = 4134 2024-09-12T18:43:46.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.786+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.8358101813561783202 2024-09-12T18:43:46.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.786+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb8f4125c30 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55a9bde738e8 s->prefetch_data=0 2024-09-12T18:43:46.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.786+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9bde738e8 2024-09-12T18:43:46.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.786+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.8.6 2024-09-12T18:43:46.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.790+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.790+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.790+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.8358101813561783202 2024-09-12T18:43:46.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.790+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.790+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.8__shadow_.O9a_wHa6BOr8OI2Kir1tN18gGESbDhn_0 2024-09-12T18:43:46.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.790+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T18:43:46.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.790+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.790+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.8358101813561783202 2024-09-12T18:43:46.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.794+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb9040673d0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55a9bde738e8 s->prefetch_data=0 2024-09-12T18:43:46.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.794+0000 7fb7eeffd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T18:43:46.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.794+0000 7fb90d8099c0 10 manifest: total_size = 4134 2024-09-12T18:43:46.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.794+0000 7fb90d8099c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.12984744036617568023 2024-09-12T18:43:46.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.794+0000 7fb90d8099c0 20 get_obj_state: octx=0x7fb9040673d0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55a9bde738e8 s->prefetch_data=0 2024-09-12T18:43:46.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.794+0000 7fb90d8099c0 20 prepare_atomic_modification: state is not atomic. state=0x55a9bde738e8 2024-09-12T18:43:46.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.794+0000 7fb90d8099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.8.8 2024-09-12T18:43:46.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.798+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:43:46.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.798+0000 7fb90d8099c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T18:43:46.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.798+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.12984744036617568023 2024-09-12T18:43:46.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.798+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T18:43:46.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.798+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 97c2b296-1395-4700-8053-4f06c4c86557.4689.8__shadow_.-SVnn2sBgDJ84RfAK7noD8_SrSH25g2_0 2024-09-12T18:43:46.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.798+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T18:43:46.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.798+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T18:43:46.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.798+0000 7fb90d8099c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 97c2b296-1395-4700-8053-4f06c4c86557.4689.12984744036617568023 2024-09-12T18:43:46.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.802+0000 7fb7ee7fc640 20 handle_completion(): completion ok for obj=obj 2024-09-12T18:43:46.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.802+0000 7fb90d8099c0 20 list_objects_ordered: starting attempt 1 2024-09-12T18:43:46.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.802+0000 7fb90d8099c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T18:43:46.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.806+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T18:43:46.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.806+0000 7fb90d8099c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T18:43:46.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.806+0000 7fb90d8099c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T18:43:46.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.806+0000 7fb90d8099c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T18:43:46.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.806+0000 7fb90d8099c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[97c2b296-1395-4700-8053-4f06c4c86557.4689.8])"; uploads.size()=0; is_truncated=0 2024-09-12T18:43:46.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.810+0000 7fb90d8099c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T18:43:46.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.810+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.810+0000 7fb90d8099c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T18:43:46.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.810+0000 7fb90d8099c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T18:43:46.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.810+0000 7fb90d8099c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T18:43:46.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.814+0000 7fb90d8099c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T18:43:46.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.814+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T18:43:46.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.814+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497023 cookie 94187525841600 notifier 5690 bl.length()=181 2024-09-12T18:43:46.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.818+0000 7fb90d8099c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:97c2b296-1395-4700-8053-4f06c4c86557.4689.8 from cache 2024-09-12T18:43:46.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.818+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:97c2b296-1395-4700-8053-4f06c4c86557.4689.8, ofs0, ns] 2024-09-12T18:43:46.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.822+0000 7fb7ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496976 cookie 94187525859616 notifier 5690 bl.length()=238 2024-09-12T18:43:46.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.826+0000 7fb90d8099c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/97c2b296-1395-4700-8053-4f06c4c86557.4689.8 : miss 2024-09-12T18:43:46.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.826+0000 7fb90d8099c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:46.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.830+0000 7fb90d8099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:46.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.830+0000 7fb90d8099c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/97c2b296-1395-4700-8053-4f06c4c86557.4689.8 info.flags=0x0 2024-09-12T18:43:46.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.830+0000 7fb90d8099c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/97c2b296-1395-4700-8053-4f06c4c86557.4689.8 to cache LRU end 2024-09-12T18:43:46.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.834+0000 7fb90d8099c0 10 removing key index: BRYTXJVKFNZAGOPJYJHB 2024-09-12T18:43:46.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.838+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:BRYTXJVKFNZAGOPJYJHB, ofs0, ns] 2024-09-12T18:43:46.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.838+0000 7fb7ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497024 cookie 94187525841600 notifier 5690 bl.length()=170 2024-09-12T18:43:46.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.838+0000 7fb90d8099c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T18:43:46.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.842+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T18:43:46.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.842+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496981 cookie 94187525843904 notifier 5690 bl.length()=182 2024-09-12T18:43:46.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.842+0000 7fb90d8099c0 10 removing user buckets index 2024-09-12T18:43:46.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.846+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T18:43:46.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.846+0000 7fb7eeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497028 cookie 94187525852400 notifier 5690 bl.length()=173 2024-09-12T18:43:46.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.846+0000 7fb90d8099c0 10 removing user index: ragweed.client.0 2024-09-12T18:43:46.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.850+0000 7fb90d8099c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T18:43:46.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.850+0000 7fb90d8099c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T18:43:46.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.850+0000 7fb7ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 94187525846400 notifier 5690 bl.length()=165 2024-09-12T18:43:46.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.854+0000 7fb7c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:43:46.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.862+0000 7fb90d8099c0 20 remove_watcher() i=0 2024-09-12T18:43:46.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.862+0000 7fb90d8099c0 2 removed watcher, disabling cache 2024-09-12T18:43:46.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.862+0000 7fb90d8099c0 20 remove_watcher() i=1 2024-09-12T18:43:46.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.866+0000 7fb90d8099c0 20 remove_watcher() i=2 2024-09-12T18:43:46.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.866+0000 7fb90d8099c0 20 remove_watcher() i=3 2024-09-12T18:43:46.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.870+0000 7fb90d8099c0 20 remove_watcher() i=4 2024-09-12T18:43:46.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.874+0000 7fb90d8099c0 20 remove_watcher() i=5 2024-09-12T18:43:46.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.874+0000 7fb90d8099c0 20 remove_watcher() i=6 2024-09-12T18:43:46.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:46.878+0000 7fb90d8099c0 20 remove_watcher() i=7 2024-09-12T18:43:46.899 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T18:43:46.976 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:43:46.976 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:43:47.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.014+0000 7fe960ea19c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:47.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.018+0000 7fe960ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:47.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.018+0000 7fe960ea19c0 20 realm 2024-09-12T18:43:47.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.018+0000 7fe960ea19c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:47.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.018+0000 7fe960ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:47.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.018+0000 7fe960ea19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:43:47.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.018+0000 7fe960ea19c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:47.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.018+0000 7fe960ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:47.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.018+0000 7fe960ea19c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:47.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.018+0000 7fe960ea19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:43:47.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.018+0000 7fe960ea19c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:47.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.022+0000 7fe960ea19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:43:47.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.022+0000 7fe960ea19c0 20 searching for the correct realm 2024-09-12T18:43:47.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.022+0000 7fe95e1a6640 0 -- 172.21.15.111:0/482828624 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7fe950119790 msgr2=0x7fe950105570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:43:47.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.234+0000 7fe95e9a7640 0 -- 172.21.15.111:0/482828624 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x557aa4dfbb90 msgr2=0x7fe95802a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:43:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.250+0000 7fe960ea19c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:43:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.250+0000 7fe960ea19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:43:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.250+0000 7fe960ea19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:43:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.250+0000 7fe960ea19c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:43:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.250+0000 7fe960ea19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:43:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.250+0000 7fe960ea19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:43:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.250+0000 7fe960ea19c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.254+0000 7fe960ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.254+0000 7fe960ea19c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.254+0000 7fe960ea19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:43:47.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.254+0000 7fe960ea19c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:47.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.254+0000 7fe960ea19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:43:47.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.254+0000 7fe960ea19c0 20 zone default found 2024-09-12T18:43:47.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.254+0000 7fe960ea19c0 4 Realm: () 2024-09-12T18:43:47.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.254+0000 7fe960ea19c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:43:47.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.254+0000 7fe960ea19c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:43:47.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.254+0000 7fe960ea19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:43:47.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.254+0000 7fe960ea19c0 20 zonegroup default 2024-09-12T18:43:47.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.254+0000 7fe960ea19c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:47.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.254+0000 7fe960ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:47.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.254+0000 7fe960ea19c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:47.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.258+0000 7fe960ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:47.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.258+0000 7fe960ea19c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:47.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.258+0000 7fe960ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:43:47.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.258+0000 7fe960ea19c0 20 started sync module instance, tier type = 2024-09-12T18:43:47.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.258+0000 7fe960ea19c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:43:47.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.282+0000 7fe960ea19c0 20 add_watcher() i=0 2024-09-12T18:43:47.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.282+0000 7fe960ea19c0 20 add_watcher() i=1 2024-09-12T18:43:47.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.282+0000 7fe960ea19c0 20 add_watcher() i=2 2024-09-12T18:43:47.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.282+0000 7fe960ea19c0 20 add_watcher() i=3 2024-09-12T18:43:47.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.282+0000 7fe960ea19c0 20 add_watcher() i=4 2024-09-12T18:43:47.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.282+0000 7fe960ea19c0 20 add_watcher() i=5 2024-09-12T18:43:47.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.282+0000 7fe960ea19c0 20 add_watcher() i=6 2024-09-12T18:43:47.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.282+0000 7fe960ea19c0 20 add_watcher() i=7 2024-09-12T18:43:47.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.282+0000 7fe960ea19c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:43:47.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.286+0000 7fe8157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:43:47.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.286+0000 7fe960ea19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:43:47.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.286+0000 7fe960ea19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:43:47.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.378+0000 7fe78ffff640 20 reqs_thread_entry: start 2024-09-12T18:43:47.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.378+0000 7fe960ea19c0 20 init_complete bucket index max shards: 11 2024-09-12T18:43:47.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.378+0000 7fe960ea19c0 20 Filter name: none 2024-09-12T18:43:47.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.378+0000 7fe78dffb640 20 reqs_thread_entry: start 2024-09-12T18:43:47.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.378+0000 7fe960ea19c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T18:43:47.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.378+0000 7fe960ea19c0 20 rados->read ofs=0 len=0 2024-09-12T18:43:47.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.378+0000 7fe960ea19c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T18:43:47.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.378+0000 7fe960ea19c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T18:43:47.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.378+0000 7fe960ea19c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T18:43:47.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.378+0000 7fe960ea19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:43:47.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.382+0000 7fe960ea19c0 10 removing key index: YEQTDYYERGFPYGJKGAES 2024-09-12T18:43:47.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.382+0000 7fe960ea19c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.keys:YEQTDYYERGFPYGJKGAES, ofs0, ns] 2024-09-12T18:43:47.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.382+0000 7fe8427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497029 cookie 93985241908768 notifier 5705 bl.length()=170 2024-09-12T18:43:47.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.386+0000 7fe960ea19c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T18:43:47.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.386+0000 7fe960ea19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T18:43:47.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.386+0000 7fe8427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 93985241903824 notifier 5705 bl.length()=182 2024-09-12T18:43:47.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.390+0000 7fe960ea19c0 10 removing user buckets index 2024-09-12T18:43:47.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.390+0000 7fe960ea19c0 10 removing user index: sysuser.client.0 2024-09-12T18:43:47.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.394+0000 7fe960ea19c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T18:43:47.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.394+0000 7fe960ea19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T18:43:47.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.394+0000 7fe8427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496982 cookie 93985241896672 notifier 5705 bl.length()=165 2024-09-12T18:43:47.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.398+0000 7fe8157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:43:47.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.402+0000 7fe960ea19c0 20 remove_watcher() i=0 2024-09-12T18:43:47.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.402+0000 7fe960ea19c0 2 removed watcher, disabling cache 2024-09-12T18:43:47.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.402+0000 7fe960ea19c0 20 remove_watcher() i=1 2024-09-12T18:43:47.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.406+0000 7fe960ea19c0 20 remove_watcher() i=2 2024-09-12T18:43:47.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.410+0000 7fe960ea19c0 20 remove_watcher() i=3 2024-09-12T18:43:47.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.410+0000 7fe960ea19c0 20 remove_watcher() i=4 2024-09-12T18:43:47.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.414+0000 7fe960ea19c0 20 remove_watcher() i=5 2024-09-12T18:43:47.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.414+0000 7fe960ea19c0 20 remove_watcher() i=6 2024-09-12T18:43:47.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:43:47.418+0000 7fe960ea19c0 20 remove_watcher() i=7 2024-09-12T18:43:47.436 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T18:43:47.437 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T18:43:47.534 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T18:43:47.545 INFO:tasks.workunit:Pulling workunits from ref d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T18:43:47.546 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T18:43:47.546 DEBUG:teuthology.orchestra.run.smithi111:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:43:47.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T18:43:47.551 INFO:teuthology.orchestra.run.smithi111.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T18:43:47.552 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:43:47.600 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T18:43:47.600 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T18:43:47.648 INFO:tasks.workunit:timeout=3h 2024-09-12T18:43:47.648 INFO:tasks.workunit:cleanup=True 2024-09-12T18:43:47.649 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T18:43:47.698 INFO:tasks.workunit.client.0.smithi111.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T18:44:45.904 INFO:tasks.workunit.client.0.smithi111.stderr:Note: switching to 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'. 2024-09-12T18:44:45.904 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:44:45.904 INFO:tasks.workunit.client.0.smithi111.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T18:44:45.904 INFO:tasks.workunit.client.0.smithi111.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T18:44:45.904 INFO:tasks.workunit.client.0.smithi111.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T18:44:45.904 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:44:45.904 INFO:tasks.workunit.client.0.smithi111.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T18:44:45.905 INFO:tasks.workunit.client.0.smithi111.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T18:44:45.905 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:44:45.905 INFO:tasks.workunit.client.0.smithi111.stderr: git switch -c 2024-09-12T18:44:45.905 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:44:45.905 INFO:tasks.workunit.client.0.smithi111.stderr:Or undo this operation with: 2024-09-12T18:44:45.905 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:44:45.905 INFO:tasks.workunit.client.0.smithi111.stderr: git switch - 2024-09-12T18:44:45.905 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:44:45.905 INFO:tasks.workunit.client.0.smithi111.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T18:44:45.905 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:44:45.905 INFO:tasks.workunit.client.0.smithi111.stderr:HEAD is now at d011c522bb1 cls/rgw: duplicate reshard checks in all cls_rgw write operations 2024-09-12T18:44:45.911 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T18:44:45.958 INFO:tasks.workunit.client.0.smithi111.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T18:44:45.961 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:44:45.961 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T18:44:46.019 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T18:44:46.075 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T18:44:46.161 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T18:44:46.163 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:44:46.163 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T18:44:46.206 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T18:44:46.210 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:44:46.210 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T18:44:46.257 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T18:44:46.258 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T18:44:46.259 DEBUG:teuthology.orchestra.run.smithi111:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T18:44:46.314 INFO:tasks.workunit.client.0.smithi111.stderr:+ ulimit -c 0 2024-09-12T18:44:46.314 INFO:tasks.workunit.client.0.smithi111.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T18:44:46.315 INFO:tasks.workunit.client.0.smithi111.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:44:46.315 INFO:tasks.workunit.client.0.smithi111.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:44:49.255 INFO:tasks.workunit.client.0.smithi111.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T18:44:49.255 INFO:tasks.workunit.client.0.smithi111.stderr:++ deactivate nondestructive 2024-09-12T18:44:49.255 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n '' ']' 2024-09-12T18:44:49.255 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n '' ']' 2024-09-12T18:44:49.255 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:44:49.255 INFO:tasks.workunit.client.0.smithi111.stderr:++ hash -r 2024-09-12T18:44:49.255 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n '' ']' 2024-09-12T18:44:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:++ unset VIRTUAL_ENV 2024-09-12T18:44:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T18:44:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T18:44:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T18:44:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:++ export VIRTUAL_ENV 2024-09-12T18:44:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:44:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:44:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:++ export PATH 2024-09-12T18:44:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n '' ']' 2024-09-12T18:44:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -z '' ']' 2024-09-12T18:44:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T18:44:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:++ PS1='(rgw) ' 2024-09-12T18:44:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:++ export PS1 2024-09-12T18:44:49.257 INFO:tasks.workunit.client.0.smithi111.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T18:44:49.257 INFO:tasks.workunit.client.0.smithi111.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T18:44:49.257 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:44:49.257 INFO:tasks.workunit.client.0.smithi111.stderr:++ hash -r 2024-09-12T18:44:49.257 INFO:tasks.workunit.client.0.smithi111.stderr:+ pip install pip --upgrade 2024-09-12T18:44:49.617 INFO:tasks.workunit.client.0.smithi111.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T18:44:49.827 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting pip 2024-09-12T18:44:49.833 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T18:44:49.868 INFO:tasks.workunit.client.0.smithi111.stdout:Installing collected packages: pip 2024-09-12T18:44:49.868 INFO:tasks.workunit.client.0.smithi111.stdout: Attempting uninstall: pip 2024-09-12T18:44:49.868 INFO:tasks.workunit.client.0.smithi111.stdout: Found existing installation: pip 22.0.2 2024-09-12T18:44:50.140 INFO:tasks.workunit.client.0.smithi111.stdout: Uninstalling pip-22.0.2: 2024-09-12T18:44:50.146 INFO:tasks.workunit.client.0.smithi111.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T18:44:51.154 INFO:tasks.workunit.client.0.smithi111.stdout:Successfully installed pip-24.2 2024-09-12T18:44:51.227 INFO:tasks.workunit.client.0.smithi111.stderr:+ pip install boto3 2024-09-12T18:44:52.217 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting boto3 2024-09-12T18:44:52.218 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T18:44:52.733 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T18:44:52.734 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T18:44:52.791 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T18:44:52.792 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T18:44:52.845 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T18:44:52.846 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T18:44:52.897 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:44:52.898 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T18:44:52.977 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:44:52.978 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T18:44:53.110 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T18:44:53.111 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T18:44:53.114 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T18:44:53.116 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T18:44:53.126 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T18:44:53.127 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T18:44:53.128 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T18:44:53.130 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T18:44:53.131 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T18:44:53.198 INFO:tasks.workunit.client.0.smithi111.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T18:44:54.282 INFO:tasks.workunit.client.0.smithi111.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T18:44:54.479 INFO:tasks.workunit.client.0.smithi111.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T18:44:54.620 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T18:44:54.659 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:44:54.659 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:44:54.703 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.697+0000 7f20e3b3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:44:54.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.701+0000 7f20e3b3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:44:54.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.701+0000 7f20e3b3b9c0 20 realm 2024-09-12T18:44:54.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.701+0000 7f20e3b3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:44:54.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.701+0000 7f20e3b3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:44:54.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.701+0000 7f20e3b3b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:44:54.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.701+0000 7f20e3b3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:44:54.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.701+0000 7f20e3b3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:44:54.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.701+0000 7f20e3b3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:44:54.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.701+0000 7f20e3b3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:44:54.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.701+0000 7f20e3b3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:44:54.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.701+0000 7f20e3b3b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:44:54.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.701+0000 7f20e3b3b9c0 20 searching for the correct realm 2024-09-12T18:44:54.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.709+0000 7f20e1e42640 0 -- 172.21.15.111:0/2645368442 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x564bed9a54b0 msgr2=0x564bed9a78a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:44:54.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.713+0000 7f20e0e40640 0 -- 172.21.15.111:0/2645368442 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f20dc0fb2b0 msgr2=0x7f20dc1126b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:44:54.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:44:54.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:44:54.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:44:54.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:44:54.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:44:54.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:44:54.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:44:54.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:44:54.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:44:54.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:44:54.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:44:54.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:44:54.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 zone default found 2024-09-12T18:44:54.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 4 Realm: () 2024-09-12T18:44:54.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:44:54.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:44:54.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:44:54.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 zonegroup default 2024-09-12T18:44:54.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.721+0000 7f20e3b3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:44:54.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.725+0000 7f20e3b3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:44:54.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.725+0000 7f20e3b3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:44:54.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.725+0000 7f20e3b3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:44:54.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.725+0000 7f20e3b3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:44:54.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.725+0000 7f20e3b3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:44:54.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.725+0000 7f20e3b3b9c0 20 started sync module instance, tier type = 2024-09-12T18:44:54.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.725+0000 7f20e3b3b9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:44:54.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f20e3b3b9c0 20 add_watcher() i=0 2024-09-12T18:44:54.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f20e3b3b9c0 20 add_watcher() i=1 2024-09-12T18:44:54.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f20e3b3b9c0 20 add_watcher() i=2 2024-09-12T18:44:54.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f20e3b3b9c0 20 add_watcher() i=3 2024-09-12T18:44:54.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f20e3b3b9c0 20 add_watcher() i=4 2024-09-12T18:44:54.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f20e3b3b9c0 20 add_watcher() i=5 2024-09-12T18:44:54.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f20e3b3b9c0 20 add_watcher() i=6 2024-09-12T18:44:54.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f20e3b3b9c0 20 add_watcher() i=7 2024-09-12T18:44:54.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f20e3b3b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:44:54.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f1f97fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:44:54.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f20e3b3b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:44:54.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f20e3b3b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:44:54.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f20e3b3b9c0 5 note: GC not initialized 2024-09-12T18:44:54.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f1f96fe5640 20 reqs_thread_entry: start 2024-09-12T18:44:54.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f20e3b3b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:44:54.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.741+0000 7f20e3b3b9c0 20 Filter name: none 2024-09-12T18:44:54.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f1f94fe1640 20 reqs_thread_entry: start 2024-09-12T18:44:54.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T18:44:54.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:44:54.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:44:54.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T18:44:54.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T18:44:54.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T18:44:54.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:44:54.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:44:54.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T18:44:54.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T18:44:54.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T18:44:54.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T18:44:54.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T18:44:54.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T18:44:54.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f20e3b3b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-12T18:44:54.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f1fc4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431622 cookie 94884108887488 notifier 6042 bl.length()=569 2024-09-12T18:44:54.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f1fc4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T18:44:54.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.745+0000 7f1fc4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T18:44:54.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.749+0000 7f20e3b3b9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T18:44:54.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.749+0000 7f20e3b3b9c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T18:44:54.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.749+0000 7f20e3b3b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T18:44:54.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.749+0000 7f1fc4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 94884108883856 notifier 6042 bl.length()=180 2024-09-12T18:44:54.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.749+0000 7f1fc4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T18:44:54.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.749+0000 7f1fc4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T18:44:54.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.749+0000 7f1f97fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:44:54.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.753+0000 7f20e3b3b9c0 20 remove_watcher() i=0 2024-09-12T18:44:54.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.753+0000 7f20e3b3b9c0 2 removed watcher, disabling cache 2024-09-12T18:44:54.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.757+0000 7f20e3b3b9c0 20 remove_watcher() i=1 2024-09-12T18:44:54.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.757+0000 7f20e3b3b9c0 20 remove_watcher() i=2 2024-09-12T18:44:54.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.761+0000 7f20e3b3b9c0 20 remove_watcher() i=3 2024-09-12T18:44:54.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.761+0000 7f20e3b3b9c0 20 remove_watcher() i=4 2024-09-12T18:44:54.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.761+0000 7f20e3b3b9c0 20 remove_watcher() i=5 2024-09-12T18:44:54.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.765+0000 7f20e3b3b9c0 20 remove_watcher() i=6 2024-09-12T18:44:54.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:44:54.765+0000 7f20e3b3b9c0 20 remove_watcher() i=7 2024-09-12T18:45:11.100 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:11.100 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:11.152 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:11.152 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:11.181 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:11.181 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:11.211 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:11.211 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:11.224 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:11.224 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:11.276 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:11.276 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:11.321 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard add 2024-09-12T18:45:11.321 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:11.322 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:45:11.354 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:11.354 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:11.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.397+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.397+0000 7f3e97a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:11.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.397+0000 7f3e97a5a9c0 20 realm 2024-09-12T18:45:11.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.397+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.397+0000 7f3e97a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:11.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.397+0000 7f3e97a5a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:11.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.397+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.397+0000 7f3e97a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:11.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.397+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.401+0000 7f3e97a5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:11.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.401+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.401+0000 7f3e97a5a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:11.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.401+0000 7f3e97a5a9c0 20 searching for the correct realm 2024-09-12T18:45:11.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.405+0000 7f3e94d5f640 0 -- 172.21.15.111:0/1035184063 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f3e8802fb20 msgr2=0x7f3e8801d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:11.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.621+0000 7f3e95560640 0 -- 172.21.15.111:0/1035184063 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f3e900b8020 msgr2=0x7f3e9010f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:11.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.633+0000 7f3e97a5a9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:11.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.633+0000 7f3e97a5a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:11.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.633+0000 7f3e97a5a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:11.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.633+0000 7f3e97a5a9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:11.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.633+0000 7f3e97a5a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:11.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.633+0000 7f3e97a5a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:11.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.633+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:11.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:11.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:11.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 20 zone default found 2024-09-12T18:45:11.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 4 Realm: () 2024-09-12T18:45:11.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:11.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:11.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:11.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 20 zonegroup default 2024-09-12T18:45:11.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:11.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:11.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.637+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.641+0000 7f3e97a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:11.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.641+0000 7f3e97a5a9c0 20 started sync module instance, tier type = 2024-09-12T18:45:11.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.641+0000 7f3e97a5a9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:11.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.661+0000 7f3e97a5a9c0 20 add_watcher() i=0 2024-09-12T18:45:11.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.661+0000 7f3e97a5a9c0 20 add_watcher() i=1 2024-09-12T18:45:11.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.661+0000 7f3e97a5a9c0 20 add_watcher() i=2 2024-09-12T18:45:11.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.661+0000 7f3e97a5a9c0 20 add_watcher() i=3 2024-09-12T18:45:11.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.661+0000 7f3e97a5a9c0 20 add_watcher() i=4 2024-09-12T18:45:11.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.661+0000 7f3e97a5a9c0 20 add_watcher() i=5 2024-09-12T18:45:11.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.661+0000 7f3e97a5a9c0 20 add_watcher() i=6 2024-09-12T18:45:11.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.665+0000 7f3e97a5a9c0 20 add_watcher() i=7 2024-09-12T18:45:11.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.665+0000 7f3e97a5a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:11.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.669+0000 7f3d4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:11.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.669+0000 7f3e97a5a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:11.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.669+0000 7f3e97a5a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:11.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.669+0000 7f3e97a5a9c0 5 note: GC not initialized 2024-09-12T18:45:11.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.669+0000 7f3d4a7e4640 20 reqs_thread_entry: start 2024-09-12T18:45:11.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.669+0000 7f3e97a5a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:11.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.669+0000 7f3e97a5a9c0 20 Filter name: none 2024-09-12T18:45:11.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.669+0000 7f3cbbfff640 20 reqs_thread_entry: start 2024-09-12T18:45:11.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.669+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.669+0000 7f3e97a5a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:45:11.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.669+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.673+0000 7f3e97a5a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:45:11.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.673+0000 7f3e97a5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:11.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.673+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.673+0000 7f3e97a5a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:45:11.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.673+0000 7f3e97a5a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.673+0000 7f3e97a5a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:45:11.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.673+0000 7f3e97a5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:11.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.677+0000 7f3d4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:11.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.681+0000 7f3e97a5a9c0 20 remove_watcher() i=0 2024-09-12T18:45:11.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.681+0000 7f3e97a5a9c0 2 removed watcher, disabling cache 2024-09-12T18:45:11.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.685+0000 7f3e97a5a9c0 20 remove_watcher() i=1 2024-09-12T18:45:11.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.685+0000 7f3e97a5a9c0 20 remove_watcher() i=2 2024-09-12T18:45:11.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.689+0000 7f3e97a5a9c0 20 remove_watcher() i=3 2024-09-12T18:45:11.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.689+0000 7f3e97a5a9c0 20 remove_watcher() i=4 2024-09-12T18:45:11.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.693+0000 7f3e97a5a9c0 20 remove_watcher() i=5 2024-09-12T18:45:11.697 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.693+0000 7f3e97a5a9c0 20 remove_watcher() i=6 2024-09-12T18:45:11.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.693+0000 7f3e97a5a9c0 20 remove_watcher() i=7 2024-09-12T18:45:11.715 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:11.715 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:45:11.715 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: a-bucket id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T18:45:11.716 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:11.716 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-12T18:45:11.749 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:11.749 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:11.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.789+0000 7f6cc16119c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.789+0000 7f6cc16119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:11.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.789+0000 7f6cc16119c0 20 realm 2024-09-12T18:45:11.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.789+0000 7f6cc16119c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.789+0000 7f6cc16119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:11.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.789+0000 7f6cc16119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:11.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.789+0000 7f6cc16119c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.789+0000 7f6cc16119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:11.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.789+0000 7f6cc16119c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.793+0000 7f6cc16119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:11.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.793+0000 7f6cc16119c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:11.798 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.793+0000 7f6cc16119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:11.798 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.793+0000 7f6cc16119c0 20 searching for the correct realm 2024-09-12T18:45:11.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.797+0000 7f6cbf918640 0 -- 172.21.15.111:0/3555931464 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f6cb402c040 msgr2=0x7f6cb4072040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:11.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:11.805+0000 7f6cbe916640 0 -- 172.21.15.111:0/3555931464 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f6cb80ac9d0 msgr2=0x7f6cb8100040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:12.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:12.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:12.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:12.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:12.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:12.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:12.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:12.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:12.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 zone default found 2024-09-12T18:45:12.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 4 Realm: () 2024-09-12T18:45:12.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:12.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:12.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:12.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 zonegroup default 2024-09-12T18:45:12.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.025+0000 7f6cc16119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.029+0000 7f6cc16119c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.029+0000 7f6cc16119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.029+0000 7f6cc16119c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.029+0000 7f6cc16119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.029+0000 7f6cc16119c0 20 started sync module instance, tier type = 2024-09-12T18:45:12.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.029+0000 7f6cc16119c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:12.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.053+0000 7f6cc16119c0 20 add_watcher() i=0 2024-09-12T18:45:12.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.053+0000 7f6cc16119c0 20 add_watcher() i=1 2024-09-12T18:45:12.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.053+0000 7f6cc16119c0 20 add_watcher() i=2 2024-09-12T18:45:12.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.053+0000 7f6cc16119c0 20 add_watcher() i=3 2024-09-12T18:45:12.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.053+0000 7f6cc16119c0 20 add_watcher() i=4 2024-09-12T18:45:12.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.053+0000 7f6cc16119c0 20 add_watcher() i=5 2024-09-12T18:45:12.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.053+0000 7f6cc16119c0 20 add_watcher() i=6 2024-09-12T18:45:12.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.053+0000 7f6cc16119c0 20 add_watcher() i=7 2024-09-12T18:45:12.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.053+0000 7f6cc16119c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:12.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.057+0000 7f6b75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:12.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.057+0000 7f6cc16119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:12.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.057+0000 7f6cc16119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:12.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 5 note: GC not initialized 2024-09-12T18:45:12.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6b74fe1640 20 reqs_thread_entry: start 2024-09-12T18:45:12.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:12.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 20 Filter name: none 2024-09-12T18:45:12.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6aee7fc640 20 reqs_thread_entry: start 2024-09-12T18:45:12.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:45:12.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:45:12.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:45:12.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:45:12.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:45:12.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:45:12.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:12.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:12.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:45:12.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:12.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.061+0000 7f6cc16119c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:45:12.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.065+0000 7f6b75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:12.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.073+0000 7f6cc16119c0 20 remove_watcher() i=0 2024-09-12T18:45:12.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.073+0000 7f6cc16119c0 2 removed watcher, disabling cache 2024-09-12T18:45:12.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.073+0000 7f6cc16119c0 20 remove_watcher() i=1 2024-09-12T18:45:12.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.077+0000 7f6cc16119c0 20 remove_watcher() i=2 2024-09-12T18:45:12.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.077+0000 7f6cc16119c0 20 remove_watcher() i=3 2024-09-12T18:45:12.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.081+0000 7f6cc16119c0 20 remove_watcher() i=4 2024-09-12T18:45:12.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.081+0000 7f6cc16119c0 20 remove_watcher() i=5 2024-09-12T18:45:12.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.085+0000 7f6cc16119c0 20 remove_watcher() i=6 2024-09-12T18:45:12.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.085+0000 7f6cc16119c0 20 remove_watcher() i=7 2024-09-12T18:45:12.107 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin reshard list 2024-09-12T18:45:12.134 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:12.134 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:12.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.173+0000 7ff6680739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.173+0000 7ff6680739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.173+0000 7ff6680739c0 20 realm 2024-09-12T18:45:12.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.173+0000 7ff6680739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.177+0000 7ff6680739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.177+0000 7ff6680739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:12.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.177+0000 7ff6680739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.177+0000 7ff6680739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.177+0000 7ff6680739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.177+0000 7ff6680739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:12.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.177+0000 7ff6680739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.177+0000 7ff6680739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:12.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.177+0000 7ff6680739c0 20 searching for the correct realm 2024-09-12T18:45:12.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.185+0000 7ff66637a640 0 -- 172.21.15.111:0/3103107357 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x55c5b48ab740 msgr2=0x55c5b48adb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:12.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.189+0000 7ff665378640 0 -- 172.21.15.111:0/3103107357 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7ff65801b900 msgr2=0x7ff65802d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:12.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:12.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:12.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:12.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:12.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:12.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:12.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:12.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:12.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 zone default found 2024-09-12T18:45:12.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 4 Realm: () 2024-09-12T18:45:12.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:12.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:12.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:12.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 zonegroup default 2024-09-12T18:45:12.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.197+0000 7ff6680739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.201+0000 7ff6680739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.201+0000 7ff6680739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.201+0000 7ff6680739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.201+0000 7ff6680739c0 20 started sync module instance, tier type = 2024-09-12T18:45:12.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.201+0000 7ff6680739c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:12.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.217+0000 7ff6680739c0 20 add_watcher() i=0 2024-09-12T18:45:12.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.217+0000 7ff6680739c0 20 add_watcher() i=1 2024-09-12T18:45:12.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.217+0000 7ff6680739c0 20 add_watcher() i=2 2024-09-12T18:45:12.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.217+0000 7ff6680739c0 20 add_watcher() i=3 2024-09-12T18:45:12.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.217+0000 7ff6680739c0 20 add_watcher() i=4 2024-09-12T18:45:12.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.217+0000 7ff6680739c0 20 add_watcher() i=5 2024-09-12T18:45:12.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.217+0000 7ff6680739c0 20 add_watcher() i=6 2024-09-12T18:45:12.222 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.217+0000 7ff6680739c0 20 add_watcher() i=7 2024-09-12T18:45:12.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.217+0000 7ff6680739c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:12.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.221+0000 7ff5177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:12.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.221+0000 7ff6680739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:12.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.221+0000 7ff6680739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:12.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.221+0000 7ff6680739c0 5 note: GC not initialized 2024-09-12T18:45:12.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.221+0000 7ff5167fc640 20 reqs_thread_entry: start 2024-09-12T18:45:12.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.221+0000 7ff6680739c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:12.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.221+0000 7ff6680739c0 20 Filter name: none 2024-09-12T18:45:12.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.221+0000 7ff487fff640 20 reqs_thread_entry: start 2024-09-12T18:45:12.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.233+0000 7ff5177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:12.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.237+0000 7ff6680739c0 20 remove_watcher() i=0 2024-09-12T18:45:12.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.237+0000 7ff6680739c0 2 removed watcher, disabling cache 2024-09-12T18:45:12.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.241+0000 7ff6680739c0 20 remove_watcher() i=1 2024-09-12T18:45:12.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.241+0000 7ff6680739c0 20 remove_watcher() i=2 2024-09-12T18:45:12.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.245+0000 7ff6680739c0 20 remove_watcher() i=3 2024-09-12T18:45:12.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.245+0000 7ff6680739c0 20 remove_watcher() i=4 2024-09-12T18:45:12.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.249+0000 7ff6680739c0 20 remove_watcher() i=5 2024-09-12T18:45:12.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.249+0000 7ff6680739c0 20 remove_watcher() i=6 2024-09-12T18:45:12.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.249+0000 7ff6680739c0 20 remove_watcher() i=7 2024-09-12T18:45:12.268 INFO:tasks.workunit.client.0.smithi111.stderr:bucket name a-bucket 2024-09-12T18:45:12.268 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard process 2024-09-12T18:45:12.268 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:12.268 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin reshard process 2024-09-12T18:45:12.292 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:12.292 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:12.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.329+0000 7fe68565d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.333+0000 7fe68565d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.333+0000 7fe68565d9c0 20 realm 2024-09-12T18:45:12.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.333+0000 7fe68565d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.333+0000 7fe68565d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.333+0000 7fe68565d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:12.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.333+0000 7fe68565d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.333+0000 7fe68565d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.333+0000 7fe68565d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.333+0000 7fe68565d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:12.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.333+0000 7fe68565d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.337+0000 7fe68565d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:12.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.337+0000 7fe68565d9c0 20 searching for the correct realm 2024-09-12T18:45:12.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.341+0000 7fe683163640 0 -- 172.21.15.111:0/4139241081 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fe67c0d6060 msgr2=0x7fe67c0fbe80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:12.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.345+0000 7fe682962640 0 -- 172.21.15.111:0/4139241081 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fe67c0fd410 msgr2=0x7fe67c112980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:45:12.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:12.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:12.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:12.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:12.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:12.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:12.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:12.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:12.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 zone default found 2024-09-12T18:45:12.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 4 Realm: () 2024-09-12T18:45:12.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:12.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:12.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:12.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 zonegroup default 2024-09-12T18:45:12.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.565+0000 7fe68565d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.569+0000 7fe68565d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.569+0000 7fe68565d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.569+0000 7fe68565d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:12.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.569+0000 7fe68565d9c0 20 started sync module instance, tier type = 2024-09-12T18:45:12.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.569+0000 7fe68565d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:12.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.589+0000 7fe68565d9c0 20 add_watcher() i=0 2024-09-12T18:45:12.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.589+0000 7fe68565d9c0 20 add_watcher() i=1 2024-09-12T18:45:12.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.589+0000 7fe68565d9c0 20 add_watcher() i=2 2024-09-12T18:45:12.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.589+0000 7fe68565d9c0 20 add_watcher() i=3 2024-09-12T18:45:12.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.589+0000 7fe68565d9c0 20 add_watcher() i=4 2024-09-12T18:45:12.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.589+0000 7fe68565d9c0 20 add_watcher() i=5 2024-09-12T18:45:12.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.589+0000 7fe68565d9c0 20 add_watcher() i=6 2024-09-12T18:45:12.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.593+0000 7fe68565d9c0 20 add_watcher() i=7 2024-09-12T18:45:12.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.593+0000 7fe68565d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:12.601 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.597+0000 7fe539fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:12.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.597+0000 7fe68565d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:12.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.597+0000 7fe68565d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:12.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.597+0000 7fe68565d9c0 5 note: GC not initialized 2024-09-12T18:45:12.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.597+0000 7fe538fe1640 20 reqs_thread_entry: start 2024-09-12T18:45:12.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.597+0000 7fe68565d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:12.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.597+0000 7fe68565d9c0 20 Filter name: none 2024-09-12T18:45:12.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.597+0000 7fe4b27fc640 20 reqs_thread_entry: start 2024-09-12T18:45:12.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.597+0000 7fe68565d9c0 20 processing logshard = reshard.0000000000 2024-09-12T18:45:12.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.605+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T18:45:12.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.605+0000 7fe68565d9c0 20 processing logshard = reshard.0000000001 2024-09-12T18:45:12.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.609+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T18:45:12.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.609+0000 7fe68565d9c0 20 processing logshard = reshard.0000000002 2024-09-12T18:45:12.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.617+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T18:45:12.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.617+0000 7fe68565d9c0 20 processing logshard = reshard.0000000003 2024-09-12T18:45:12.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.621+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T18:45:12.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.621+0000 7fe68565d9c0 20 processing logshard = reshard.0000000004 2024-09-12T18:45:12.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.629+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T18:45:12.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.629+0000 7fe68565d9c0 20 processing logshard = reshard.0000000005 2024-09-12T18:45:12.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.633+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T18:45:12.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.633+0000 7fe68565d9c0 20 processing logshard = reshard.0000000006 2024-09-12T18:45:12.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.633+0000 7fe68565d9c0 20 process_entry resharding a-bucket 2024-09-12T18:45:12.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.633+0000 7fe68565d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:45:12.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.633+0000 7fe68565d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.637+0000 7fe68565d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:45:12.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.637+0000 7fe68565d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T18:45:12.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.637+0000 7fe68565d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:45:12.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.637+0000 7fe68565d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:45:12.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.637+0000 7fe68565d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:12.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.637+0000 7fe68565d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:45:12.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.637+0000 7fe68565d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:12.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.637+0000 7fe68565d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:12.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.637+0000 7fe68565d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:45:12.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.637+0000 7fe68565d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:12.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.637+0000 7fe68565d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:45:12.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.649+0000 7fe68565d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:12.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.649+0000 7fe68565d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:12.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.649+0000 7fe68565d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:12.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.649+0000 7fe68565d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:45:12.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.649+0000 7fe566ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431625 cookie 94526346491296 notifier 5786 bl.length()=827 2024-09-12T18:45:12.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.649+0000 7fe566ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:12.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.649+0000 7fe566ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:12.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.649+0000 7fe566ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:12.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.649+0000 7fe68565d9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:45:12.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.649+0000 7fe68565d9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:45:12.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.649+0000 7fe68565d9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:45:12.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.649+0000 7fe68565d9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:45:12.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.0 2024-09-12T18:45:12.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.0 2024-09-12T18:45:12.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.1 2024-09-12T18:45:12.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.1 2024-09-12T18:45:12.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.2 2024-09-12T18:45:12.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.2 2024-09-12T18:45:12.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.3 2024-09-12T18:45:12.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.3 2024-09-12T18:45:12.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.4 2024-09-12T18:45:12.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.4 2024-09-12T18:45:12.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.5 2024-09-12T18:45:12.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.5 2024-09-12T18:45:12.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.6 2024-09-12T18:45:12.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.6 2024-09-12T18:45:12.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.7 2024-09-12T18:45:12.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.7 2024-09-12T18:45:12.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.8 2024-09-12T18:45:12.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.8 2024-09-12T18:45:12.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.9 2024-09-12T18:45:12.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.9 2024-09-12T18:45:12.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.10 2024-09-12T18:45:12.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.10 2024-09-12T18:45:12.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.11 2024-09-12T18:45:12.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.11 2024-09-12T18:45:12.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.0 2024-09-12T18:45:12.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1 2024-09-12T18:45:12.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.661+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2 2024-09-12T18:45:12.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.665+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3 2024-09-12T18:45:12.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.665+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.4 2024-09-12T18:45:12.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.665+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.5 2024-09-12T18:45:12.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.665+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.6 2024-09-12T18:45:12.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.669+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.7 2024-09-12T18:45:12.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.669+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.8 2024-09-12T18:45:12.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.669+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.9 2024-09-12T18:45:12.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.669+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.10 2024-09-12T18:45:12.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.673+0000 7fe68565d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:45:12.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.673+0000 7fe68565d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:45:12.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.673+0000 7fe68565d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:12.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.673+0000 7fe68565d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:12.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.673+0000 7fe68565d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:12.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.673+0000 7fe68565d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:45:12.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.673+0000 7fe5667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431626 cookie 94526346491296 notifier 5786 bl.length()=827 2024-09-12T18:45:12.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.673+0000 7fe5667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:12.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.673+0000 7fe5667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:12.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.673+0000 7fe5667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:12.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.673+0000 7fe68565d9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:45:12.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.673+0000 7fe68565d9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:45:12.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.673+0000 7fe68565d9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:45:12.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.673+0000 7fe68565d9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:45:12.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.681+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.0 2024-09-12T18:45:12.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.681+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1 2024-09-12T18:45:12.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.681+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2 2024-09-12T18:45:12.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.681+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3 2024-09-12T18:45:12.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.681+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.4 2024-09-12T18:45:12.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.685+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.5 2024-09-12T18:45:12.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.685+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.6 2024-09-12T18:45:12.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.685+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.7 2024-09-12T18:45:12.690 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.685+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.8 2024-09-12T18:45:12.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.685+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.9 2024-09-12T18:45:12.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.685+0000 7fe68565d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.10 2024-09-12T18:45:12.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.689+0000 7fe68565d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:45:12.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.689+0000 7fe68565d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:45:12.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.689+0000 7fe68565d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:12.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.689+0000 7fe68565d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:12.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.689+0000 7fe68565d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:12.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.689+0000 7fe68565d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:45:12.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.689+0000 7fe566ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 94526346491296 notifier 5786 bl.length()=795 2024-09-12T18:45:12.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.689+0000 7fe566ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:12.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.689+0000 7fe566ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:12.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.689+0000 7fe566ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:12.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.689+0000 7fe68565d9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:45:12.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.689+0000 7fe68565d9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:45:12.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.689+0000 7fe68565d9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:45:12.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.689+0000 7fe68565d9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:45:12.700 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.697+0000 7fe68565d9c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-12T18:45:12.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.697+0000 7fe68565d9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T18:45:12.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.701+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T18:45:12.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.701+0000 7fe68565d9c0 20 processing logshard = reshard.0000000007 2024-09-12T18:45:12.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.709+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T18:45:12.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.709+0000 7fe68565d9c0 20 processing logshard = reshard.0000000008 2024-09-12T18:45:12.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.713+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T18:45:12.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.713+0000 7fe68565d9c0 20 processing logshard = reshard.0000000009 2024-09-12T18:45:12.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.721+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T18:45:12.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.721+0000 7fe68565d9c0 20 processing logshard = reshard.0000000010 2024-09-12T18:45:12.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.725+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T18:45:12.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.725+0000 7fe68565d9c0 20 processing logshard = reshard.0000000011 2024-09-12T18:45:12.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.729+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T18:45:12.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.729+0000 7fe68565d9c0 20 processing logshard = reshard.0000000012 2024-09-12T18:45:12.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.737+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T18:45:12.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.737+0000 7fe68565d9c0 20 processing logshard = reshard.0000000013 2024-09-12T18:45:12.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.741+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T18:45:12.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.741+0000 7fe68565d9c0 20 processing logshard = reshard.0000000014 2024-09-12T18:45:12.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.745+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T18:45:12.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.745+0000 7fe68565d9c0 20 processing logshard = reshard.0000000015 2024-09-12T18:45:12.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.753+0000 7fe68565d9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T18:45:12.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.753+0000 7fe539fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:12.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.757+0000 7fe68565d9c0 20 remove_watcher() i=0 2024-09-12T18:45:12.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.757+0000 7fe68565d9c0 2 removed watcher, disabling cache 2024-09-12T18:45:12.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.761+0000 7fe68565d9c0 20 remove_watcher() i=1 2024-09-12T18:45:12.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.765+0000 7fe68565d9c0 20 remove_watcher() i=2 2024-09-12T18:45:12.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.765+0000 7fe68565d9c0 20 remove_watcher() i=3 2024-09-12T18:45:12.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.769+0000 7fe68565d9c0 20 remove_watcher() i=4 2024-09-12T18:45:12.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.769+0000 7fe68565d9c0 20 remove_watcher() i=5 2024-09-12T18:45:12.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.773+0000 7fe68565d9c0 20 remove_watcher() i=6 2024-09-12T18:45:12.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:12.773+0000 7fe68565d9c0 20 remove_watcher() i=7 2024-09-12T18:45:17.803 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:45:17.836 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:17.836 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:17.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:17.876+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:17.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:17.880+0000 7f346d7bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:17.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:17.880+0000 7f346d7bb9c0 20 realm 2024-09-12T18:45:17.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:17.880+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:17.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:17.880+0000 7f346d7bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:17.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:17.880+0000 7f346d7bb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:17.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:17.880+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:17.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:17.880+0000 7f346d7bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:17.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:17.880+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:17.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:17.880+0000 7f346d7bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:17.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:17.880+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:17.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:17.880+0000 7f346d7bb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:17.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:17.880+0000 7f346d7bb9c0 20 searching for the correct realm 2024-09-12T18:45:17.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:17.884+0000 7f346bac2640 0 -- 172.21.15.111:0/155295585 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f3460018070 msgr2=0x7f346004f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:18.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.100+0000 7f346aac0640 0 -- 172.21.15.111:0/155295585 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f3464031070 msgr2=0x7f3464058930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:18.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.316+0000 7f346d7bb9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:18.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.316+0000 7f346d7bb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:18.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.316+0000 7f346d7bb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:18.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.316+0000 7f346d7bb9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:18.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.316+0000 7f346d7bb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:18.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.316+0000 7f346d7bb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:18.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.316+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:18.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:18.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:18.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 20 zone default found 2024-09-12T18:45:18.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 4 Realm: () 2024-09-12T18:45:18.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:18.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:18.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:18.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 20 zonegroup default 2024-09-12T18:45:18.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:18.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:18.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.320+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.324+0000 7f346d7bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:18.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.324+0000 7f346d7bb9c0 20 started sync module instance, tier type = 2024-09-12T18:45:18.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.324+0000 7f346d7bb9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:18.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.344+0000 7f346d7bb9c0 20 add_watcher() i=0 2024-09-12T18:45:18.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.344+0000 7f346d7bb9c0 20 add_watcher() i=1 2024-09-12T18:45:18.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.344+0000 7f346d7bb9c0 20 add_watcher() i=2 2024-09-12T18:45:18.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.344+0000 7f346d7bb9c0 20 add_watcher() i=3 2024-09-12T18:45:18.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.344+0000 7f346d7bb9c0 20 add_watcher() i=4 2024-09-12T18:45:18.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.344+0000 7f346d7bb9c0 20 add_watcher() i=5 2024-09-12T18:45:18.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.344+0000 7f346d7bb9c0 20 add_watcher() i=6 2024-09-12T18:45:18.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.348+0000 7f346d7bb9c0 20 add_watcher() i=7 2024-09-12T18:45:18.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.348+0000 7f346d7bb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:18.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.352+0000 7f3321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:18.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.352+0000 7f346d7bb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:18.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.352+0000 7f346d7bb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:18.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.352+0000 7f346d7bb9c0 5 note: GC not initialized 2024-09-12T18:45:18.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.352+0000 7f3320fe1640 20 reqs_thread_entry: start 2024-09-12T18:45:18.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.356+0000 7f346d7bb9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:18.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.356+0000 7f346d7bb9c0 20 Filter name: none 2024-09-12T18:45:18.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.356+0000 7f329a7fc640 20 reqs_thread_entry: start 2024-09-12T18:45:18.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.356+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.356+0000 7f346d7bb9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:45:18.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.356+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.356+0000 7f346d7bb9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:45:18.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.356+0000 7f346d7bb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:18.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.356+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.363 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.356+0000 7f346d7bb9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:45:18.363 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.356+0000 7f346d7bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.360+0000 7f346d7bb9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:45:18.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.360+0000 7f346d7bb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:18.367 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.360+0000 7f3321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:18.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.368+0000 7f346d7bb9c0 20 remove_watcher() i=0 2024-09-12T18:45:18.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.368+0000 7f346d7bb9c0 2 removed watcher, disabling cache 2024-09-12T18:45:18.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.368+0000 7f346d7bb9c0 20 remove_watcher() i=1 2024-09-12T18:45:18.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.372+0000 7f346d7bb9c0 20 remove_watcher() i=2 2024-09-12T18:45:18.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.372+0000 7f346d7bb9c0 20 remove_watcher() i=3 2024-09-12T18:45:18.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.376+0000 7f346d7bb9c0 20 remove_watcher() i=4 2024-09-12T18:45:18.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.376+0000 7f346d7bb9c0 20 remove_watcher() i=5 2024-09-12T18:45:18.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.380+0000 7f346d7bb9c0 20 remove_watcher() i=6 2024-09-12T18:45:18.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.380+0000 7f346d7bb9c0 20 remove_watcher() i=7 2024-09-12T18:45:18.401 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:18.401 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:45:18.401 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: a-bucket id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T18:45:18.401 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:18.401 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard add non empty bucket 2024-09-12T18:45:18.401 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:18.406 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:18.406 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:18.419 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:18.419 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:18.431 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:18.432 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:18.442 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:18.442 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:18.454 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:18.454 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:18.465 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:18.465 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:18.477 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:18.477 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:18.487 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:18.487 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:18.494 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:45:18.523 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:18.523 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:18.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.560+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.560+0000 7f99afd059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:18.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.560+0000 7f99afd059c0 20 realm 2024-09-12T18:45:18.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.560+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.564+0000 7f99afd059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:18.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.564+0000 7f99afd059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:18.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.564+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.564+0000 7f99afd059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:18.570 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.564+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.564+0000 7f99afd059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:18.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.564+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.564+0000 7f99afd059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:18.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.564+0000 7f99afd059c0 20 searching for the correct realm 2024-09-12T18:45:18.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.568+0000 7f99ad80b640 0 -- 172.21.15.111:0/2076244172 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f99a80e4b60 msgr2=0x7f99a80dd420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:18.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.576+0000 7f99ad00a640 0 -- 172.21.15.111:0/2076244172 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f99a80f3910 msgr2=0x7f99a80aa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:45:18.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.792+0000 7f99afd059c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:18.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.792+0000 7f99afd059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:18.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.792+0000 7f99afd059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:18.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.792+0000 7f99afd059c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:18.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.792+0000 7f99afd059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:18.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.792+0000 7f99afd059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:18.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.792+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.792+0000 7f99afd059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:18.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.792+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.796+0000 7f99afd059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:18.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.796+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.796+0000 7f99afd059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:18.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.796+0000 7f99afd059c0 20 zone default found 2024-09-12T18:45:18.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.796+0000 7f99afd059c0 4 Realm: () 2024-09-12T18:45:18.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.796+0000 7f99afd059c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:18.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.796+0000 7f99afd059c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:18.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.796+0000 7f99afd059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:18.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.796+0000 7f99afd059c0 20 zonegroup default 2024-09-12T18:45:18.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.796+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.796+0000 7f99afd059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:18.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.796+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.796+0000 7f99afd059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:18.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.796+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.800+0000 7f99afd059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:18.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.800+0000 7f99afd059c0 20 started sync module instance, tier type = 2024-09-12T18:45:18.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.800+0000 7f99afd059c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:18.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.824+0000 7f99afd059c0 20 add_watcher() i=0 2024-09-12T18:45:18.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.824+0000 7f99afd059c0 20 add_watcher() i=1 2024-09-12T18:45:18.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.824+0000 7f99afd059c0 20 add_watcher() i=2 2024-09-12T18:45:18.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.824+0000 7f99afd059c0 20 add_watcher() i=3 2024-09-12T18:45:18.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.824+0000 7f99afd059c0 20 add_watcher() i=4 2024-09-12T18:45:18.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.824+0000 7f99afd059c0 20 add_watcher() i=5 2024-09-12T18:45:18.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.824+0000 7f99afd059c0 20 add_watcher() i=6 2024-09-12T18:45:18.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.824+0000 7f99afd059c0 20 add_watcher() i=7 2024-09-12T18:45:18.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.824+0000 7f99afd059c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:18.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.828+0000 7f985f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:18.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.832+0000 7f99afd059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:18.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.832+0000 7f99afd059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:18.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.832+0000 7f99afd059c0 5 note: GC not initialized 2024-09-12T18:45:18.837 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.832+0000 7f985e7fc640 20 reqs_thread_entry: start 2024-09-12T18:45:18.837 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.832+0000 7f99afd059c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:18.837 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.832+0000 7f99afd059c0 20 Filter name: none 2024-09-12T18:45:18.837 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.832+0000 7f97cffff640 20 reqs_thread_entry: start 2024-09-12T18:45:18.837 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.832+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.832+0000 7f99afd059c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:45:18.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.832+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.832+0000 7f99afd059c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:45:18.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.832+0000 7f99afd059c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:18.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.832+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.840 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.836+0000 7f99afd059c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:45:18.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.836+0000 7f99afd059c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.836+0000 7f99afd059c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:45:18.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.836+0000 7f99afd059c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:18.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.840+0000 7f985f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:18.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.844+0000 7f99afd059c0 20 remove_watcher() i=0 2024-09-12T18:45:18.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.844+0000 7f99afd059c0 2 removed watcher, disabling cache 2024-09-12T18:45:18.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.844+0000 7f99afd059c0 20 remove_watcher() i=1 2024-09-12T18:45:18.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.848+0000 7f99afd059c0 20 remove_watcher() i=2 2024-09-12T18:45:18.856 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.852+0000 7f99afd059c0 20 remove_watcher() i=3 2024-09-12T18:45:18.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.852+0000 7f99afd059c0 20 remove_watcher() i=4 2024-09-12T18:45:18.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.856+0000 7f99afd059c0 20 remove_watcher() i=5 2024-09-12T18:45:18.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.856+0000 7f99afd059c0 20 remove_watcher() i=6 2024-09-12T18:45:18.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.856+0000 7f99afd059c0 20 remove_watcher() i=7 2024-09-12T18:45:18.879 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:18.879 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:45:18.880 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: a-bucket id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-12T18:45:18.880 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:18.880 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-12T18:45:18.909 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:18.909 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:18.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.948+0000 7f111be769c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.948+0000 7f111be769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:18.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.948+0000 7f111be769c0 20 realm 2024-09-12T18:45:18.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.948+0000 7f111be769c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.948+0000 7f111be769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:18.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.948+0000 7f111be769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:18.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.948+0000 7f111be769c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.948+0000 7f111be769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:18.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.948+0000 7f111be769c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.952+0000 7f111be769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:18.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.952+0000 7f111be769c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:18.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.952+0000 7f111be769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:18.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.952+0000 7f111be769c0 20 searching for the correct realm 2024-09-12T18:45:18.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.956+0000 7f111997c640 0 -- 172.21.15.111:0/688483583 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f110c031040 msgr2=0x7f110c01b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:18.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:18.964+0000 7f111917b640 0 -- 172.21.15.111:0/688483583 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f110c053040 msgr2=0x7f110c03c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:19.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.180+0000 7f111be769c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:19.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.180+0000 7f111be769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:19.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.180+0000 7f111be769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:19.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.180+0000 7f111be769c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:19.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.180+0000 7f111be769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:19.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.180+0000 7f111be769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:19.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.180+0000 7f111be769c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.180+0000 7f111be769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.180+0000 7f111be769c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:19.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:19.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 20 zone default found 2024-09-12T18:45:19.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 4 Realm: () 2024-09-12T18:45:19.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:19.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:19.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:19.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 20 zonegroup default 2024-09-12T18:45:19.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 20 started sync module instance, tier type = 2024-09-12T18:45:19.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.184+0000 7f111be769c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:19.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.208+0000 7f111be769c0 20 add_watcher() i=0 2024-09-12T18:45:19.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.208+0000 7f111be769c0 20 add_watcher() i=1 2024-09-12T18:45:19.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.208+0000 7f111be769c0 20 add_watcher() i=2 2024-09-12T18:45:19.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.208+0000 7f111be769c0 20 add_watcher() i=3 2024-09-12T18:45:19.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.208+0000 7f111be769c0 20 add_watcher() i=4 2024-09-12T18:45:19.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.208+0000 7f111be769c0 20 add_watcher() i=5 2024-09-12T18:45:19.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.208+0000 7f111be769c0 20 add_watcher() i=6 2024-09-12T18:45:19.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.212+0000 7f111be769c0 20 add_watcher() i=7 2024-09-12T18:45:19.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.212+0000 7f111be769c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:19.222 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.216+0000 7f0fcb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:19.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.216+0000 7f111be769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:19.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.216+0000 7f111be769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:19.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.216+0000 7f111be769c0 5 note: GC not initialized 2024-09-12T18:45:19.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.216+0000 7f0fca7fc640 20 reqs_thread_entry: start 2024-09-12T18:45:19.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.216+0000 7f111be769c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:19.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f111be769c0 20 Filter name: none 2024-09-12T18:45:19.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f0f3bfff640 20 reqs_thread_entry: start 2024-09-12T18:45:19.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f111be769c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:45:19.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f111be769c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f111be769c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:45:19.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f111be769c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:45:19.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f111be769c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:45:19.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f111be769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:45:19.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f111be769c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f111be769c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:45:19.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f111be769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:19.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f111be769c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:19.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f111be769c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:45:19.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f111be769c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:19.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.220+0000 7f111be769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:45:19.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.224+0000 7f0fcb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:19.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.228+0000 7f111be769c0 20 remove_watcher() i=0 2024-09-12T18:45:19.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.228+0000 7f111be769c0 2 removed watcher, disabling cache 2024-09-12T18:45:19.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.232+0000 7f111be769c0 20 remove_watcher() i=1 2024-09-12T18:45:19.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.236+0000 7f111be769c0 20 remove_watcher() i=2 2024-09-12T18:45:19.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.236+0000 7f111be769c0 20 remove_watcher() i=3 2024-09-12T18:45:19.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.240+0000 7f111be769c0 20 remove_watcher() i=4 2024-09-12T18:45:19.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.240+0000 7f111be769c0 20 remove_watcher() i=5 2024-09-12T18:45:19.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.244+0000 7f111be769c0 20 remove_watcher() i=6 2024-09-12T18:45:19.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.244+0000 7f111be769c0 20 remove_watcher() i=7 2024-09-12T18:45:19.266 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin reshard list 2024-09-12T18:45:19.290 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:19.290 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:19.334 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.328+0000 7f2b8ffed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.332+0000 7f2b8ffed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.332+0000 7f2b8ffed9c0 20 realm 2024-09-12T18:45:19.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.332+0000 7f2b8ffed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.332+0000 7f2b8ffed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.332+0000 7f2b8ffed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:19.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.332+0000 7f2b8ffed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.332+0000 7f2b8ffed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.332+0000 7f2b8ffed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.332+0000 7f2b8ffed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:19.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.332+0000 7f2b8ffed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.332+0000 7f2b8ffed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:19.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.332+0000 7f2b8ffed9c0 20 searching for the correct realm 2024-09-12T18:45:19.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.340+0000 7f2b8e2f4640 0 -- 172.21.15.111:0/1045217392 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x55e7c7c860e0 msgr2=0x55e7c7c884d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:45:19.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.344+0000 7f2b8d2f2640 0 -- 172.21.15.111:0/1045217392 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f2b800d8900 msgr2=0x7f2b800aa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:19.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.560+0000 7f2b8ffed9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:19.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.560+0000 7f2b8ffed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:19.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.560+0000 7f2b8ffed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:19.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.560+0000 7f2b8ffed9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:19.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.560+0000 7f2b8ffed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:19.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.560+0000 7f2b8ffed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:19.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.560+0000 7f2b8ffed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.560+0000 7f2b8ffed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.560+0000 7f2b8ffed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:19.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:19.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 20 zone default found 2024-09-12T18:45:19.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 4 Realm: () 2024-09-12T18:45:19.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:19.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:19.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:19.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 20 zonegroup default 2024-09-12T18:45:19.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 20 started sync module instance, tier type = 2024-09-12T18:45:19.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.564+0000 7f2b8ffed9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:19.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.588+0000 7f2b8ffed9c0 20 add_watcher() i=0 2024-09-12T18:45:19.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.588+0000 7f2b8ffed9c0 20 add_watcher() i=1 2024-09-12T18:45:19.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.588+0000 7f2b8ffed9c0 20 add_watcher() i=2 2024-09-12T18:45:19.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.588+0000 7f2b8ffed9c0 20 add_watcher() i=3 2024-09-12T18:45:19.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.588+0000 7f2b8ffed9c0 20 add_watcher() i=4 2024-09-12T18:45:19.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.588+0000 7f2b8ffed9c0 20 add_watcher() i=5 2024-09-12T18:45:19.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.588+0000 7f2b8ffed9c0 20 add_watcher() i=6 2024-09-12T18:45:19.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.592+0000 7f2b8ffed9c0 20 add_watcher() i=7 2024-09-12T18:45:19.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.592+0000 7f2b8ffed9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:19.602 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.596+0000 7f2a3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:19.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.596+0000 7f2b8ffed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:19.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.596+0000 7f2b8ffed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:19.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.596+0000 7f2b8ffed9c0 5 note: GC not initialized 2024-09-12T18:45:19.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.596+0000 7f2a3e7fc640 20 reqs_thread_entry: start 2024-09-12T18:45:19.604 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.596+0000 7f2b8ffed9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:19.604 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.600+0000 7f2b8ffed9c0 20 Filter name: none 2024-09-12T18:45:19.604 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.600+0000 7f29affff640 20 reqs_thread_entry: start 2024-09-12T18:45:19.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.612+0000 7f2a3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:19.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.616+0000 7f2b8ffed9c0 20 remove_watcher() i=0 2024-09-12T18:45:19.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.616+0000 7f2b8ffed9c0 2 removed watcher, disabling cache 2024-09-12T18:45:19.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.620+0000 7f2b8ffed9c0 20 remove_watcher() i=1 2024-09-12T18:45:19.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.620+0000 7f2b8ffed9c0 20 remove_watcher() i=2 2024-09-12T18:45:19.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.624+0000 7f2b8ffed9c0 20 remove_watcher() i=3 2024-09-12T18:45:19.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.624+0000 7f2b8ffed9c0 20 remove_watcher() i=4 2024-09-12T18:45:19.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.628+0000 7f2b8ffed9c0 20 remove_watcher() i=5 2024-09-12T18:45:19.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.628+0000 7f2b8ffed9c0 20 remove_watcher() i=6 2024-09-12T18:45:19.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.628+0000 7f2b8ffed9c0 20 remove_watcher() i=7 2024-09-12T18:45:19.652 INFO:tasks.workunit.client.0.smithi111.stderr:bucket name a-bucket 2024-09-12T18:45:19.652 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard process non empty bucket 2024-09-12T18:45:19.652 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:19.653 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin reshard process 2024-09-12T18:45:19.682 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:19.682 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:19.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.720+0000 7f87e69109c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.724+0000 7f87e69109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.724+0000 7f87e69109c0 20 realm 2024-09-12T18:45:19.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.724+0000 7f87e69109c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.724+0000 7f87e69109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.724+0000 7f87e69109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:19.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.724+0000 7f87e69109c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.724+0000 7f87e69109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.724+0000 7f87e69109c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.724+0000 7f87e69109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:19.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.724+0000 7f87e69109c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.724+0000 7f87e69109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:19.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.724+0000 7f87e69109c0 20 searching for the correct realm 2024-09-12T18:45:19.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.732+0000 7f87e4416640 0 -- 172.21.15.111:0/2118459085 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f87dc067580 msgr2=0x7f87dc03ba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:19.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.736+0000 7f87e3c15640 0 -- 172.21.15.111:0/2118459085 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f87dc07db00 msgr2=0x7f87dc0656f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:19.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.952+0000 7f87e69109c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:19.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.952+0000 7f87e69109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:19.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.952+0000 7f87e69109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:19.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.952+0000 7f87e69109c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:19.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.952+0000 7f87e69109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:19.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.952+0000 7f87e69109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:19.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.952+0000 7f87e69109c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.952+0000 7f87e69109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.952+0000 7f87e69109c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.952+0000 7f87e69109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:19.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.952+0000 7f87e69109c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:19.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 20 zone default found 2024-09-12T18:45:19.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 4 Realm: () 2024-09-12T18:45:19.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:19.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:19.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:19.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 20 zonegroup default 2024-09-12T18:45:19.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:19.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:19.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 20 started sync module instance, tier type = 2024-09-12T18:45:19.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.956+0000 7f87e69109c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:19.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.980+0000 7f87e69109c0 20 add_watcher() i=0 2024-09-12T18:45:19.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.980+0000 7f87e69109c0 20 add_watcher() i=1 2024-09-12T18:45:19.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.980+0000 7f87e69109c0 20 add_watcher() i=2 2024-09-12T18:45:19.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.980+0000 7f87e69109c0 20 add_watcher() i=3 2024-09-12T18:45:19.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.980+0000 7f87e69109c0 20 add_watcher() i=4 2024-09-12T18:45:19.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.980+0000 7f87e69109c0 20 add_watcher() i=5 2024-09-12T18:45:19.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.980+0000 7f87e69109c0 20 add_watcher() i=6 2024-09-12T18:45:19.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.980+0000 7f87e69109c0 20 add_watcher() i=7 2024-09-12T18:45:19.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.980+0000 7f87e69109c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:19.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.984+0000 7f869afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:19.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.984+0000 7f87e69109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:19.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.984+0000 7f87e69109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:19.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.984+0000 7f87e69109c0 5 note: GC not initialized 2024-09-12T18:45:19.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.988+0000 7f8699fdb640 20 reqs_thread_entry: start 2024-09-12T18:45:19.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.988+0000 7f87e69109c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:19.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.988+0000 7f87e69109c0 20 Filter name: none 2024-09-12T18:45:19.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.988+0000 7f860b7fe640 20 reqs_thread_entry: start 2024-09-12T18:45:19.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.988+0000 7f87e69109c0 20 processing logshard = reshard.0000000000 2024-09-12T18:45:20.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.996+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T18:45:20.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:19.996+0000 7f87e69109c0 20 processing logshard = reshard.0000000001 2024-09-12T18:45:20.005 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.000+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T18:45:20.005 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.000+0000 7f87e69109c0 20 processing logshard = reshard.0000000002 2024-09-12T18:45:20.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.004+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T18:45:20.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.004+0000 7f87e69109c0 20 processing logshard = reshard.0000000003 2024-09-12T18:45:20.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.008+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T18:45:20.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.008+0000 7f87e69109c0 20 processing logshard = reshard.0000000004 2024-09-12T18:45:20.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.016+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T18:45:20.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.016+0000 7f87e69109c0 20 processing logshard = reshard.0000000005 2024-09-12T18:45:20.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.024+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T18:45:20.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.024+0000 7f87e69109c0 20 processing logshard = reshard.0000000006 2024-09-12T18:45:20.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.024+0000 7f87e69109c0 20 process_entry resharding a-bucket 2024-09-12T18:45:20.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.024+0000 7f87e69109c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:45:20.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.024+0000 7f87e69109c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.028+0000 7f87e69109c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:45:20.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.028+0000 7f87e69109c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T18:45:20.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.028+0000 7f87e69109c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:45:20.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.028+0000 7f87e69109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:45:20.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.028+0000 7f87e69109c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.028+0000 7f87e69109c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:45:20.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.028+0000 7f87e69109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:20.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.028+0000 7f87e69109c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:20.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.028+0000 7f87e69109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:45:20.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.028+0000 7f87e69109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:20.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.028+0000 7f87e69109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:45:20.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.040+0000 7f87e69109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:20.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.040+0000 7f87e69109c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:20.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.040+0000 7f87e69109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:20.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.040+0000 7f87e69109c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:45:20.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.040+0000 7f86bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431628 cookie 94585187641520 notifier 5870 bl.length()=827 2024-09-12T18:45:20.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.040+0000 7f86bb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:20.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.040+0000 7f86bb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:20.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.040+0000 7f86bb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:20.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.044+0000 7f87e69109c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:45:20.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.044+0000 7f87e69109c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:45:20.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.044+0000 7f87e69109c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:45:20.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.044+0000 7f87e69109c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:45:20.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:45:20.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:45:20.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:45:20.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:45:20.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:45:20.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:45:20.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:45:20.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:45:20.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:45:20.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:45:20.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:45:20.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:45:20.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:45:20.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:45:20.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:45:20.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:45:20.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:45:20.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:45:20.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:45:20.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:45:20.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:45:20.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:45:20.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:45:20.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:45:20.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:45:20.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:45:20.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.0 2024-09-12T18:45:20.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.0 2024-09-12T18:45:20.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.1 2024-09-12T18:45:20.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.052+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.1 2024-09-12T18:45:20.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.056+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.2 2024-09-12T18:45:20.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.056+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.2 2024-09-12T18:45:20.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.056+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.3 2024-09-12T18:45:20.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.056+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.3 2024-09-12T18:45:20.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.056+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.4 2024-09-12T18:45:20.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.056+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.4 2024-09-12T18:45:20.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.060+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.5 2024-09-12T18:45:20.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.060+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.5 2024-09-12T18:45:20.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.060+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.6 2024-09-12T18:45:20.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.060+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.6 2024-09-12T18:45:20.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.060+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.7 2024-09-12T18:45:20.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.060+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.7 2024-09-12T18:45:20.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.060+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.8 2024-09-12T18:45:20.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.060+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.8 2024-09-12T18:45:20.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.060+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.9 2024-09-12T18:45:20.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.060+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.9 2024-09-12T18:45:20.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.064+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.10 2024-09-12T18:45:20.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.064+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.10 2024-09-12T18:45:20.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.064+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.11 2024-09-12T18:45:20.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.064+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.11 2024-09-12T18:45:20.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.068+0000 7f87e69109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:45:20.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.068+0000 7f87e69109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:45:20.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.072+0000 7f87e69109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:20.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.072+0000 7f87e69109c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:20.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.072+0000 7f87e69109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:20.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.072+0000 7f87e69109c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:45:20.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.072+0000 7f86bb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431629 cookie 94585187641520 notifier 5870 bl.length()=827 2024-09-12T18:45:20.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.072+0000 7f86bb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:20.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.072+0000 7f86bb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:20.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.072+0000 7f86bb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:20.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.072+0000 7f87e69109c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:45:20.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.072+0000 7f87e69109c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:45:20.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.072+0000 7f87e69109c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:45:20.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.072+0000 7f87e69109c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:45:20.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.076+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.0 2024-09-12T18:45:20.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.076+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.0 2024-09-12T18:45:20.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.076+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.1 2024-09-12T18:45:20.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.076+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.1 2024-09-12T18:45:20.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.076+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.2 2024-09-12T18:45:20.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.076+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.2 2024-09-12T18:45:20.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.080+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.3 2024-09-12T18:45:20.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.080+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.3 2024-09-12T18:45:20.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.080+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.4 2024-09-12T18:45:20.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.080+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.4 2024-09-12T18:45:20.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.080+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.5 2024-09-12T18:45:20.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.080+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.5 2024-09-12T18:45:20.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.080+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.6 2024-09-12T18:45:20.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.080+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.6 2024-09-12T18:45:20.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.080+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.7 2024-09-12T18:45:20.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.080+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.7 2024-09-12T18:45:20.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.080+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.8 2024-09-12T18:45:20.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.080+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.8 2024-09-12T18:45:20.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.084+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.9 2024-09-12T18:45:20.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.084+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.9 2024-09-12T18:45:20.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.084+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.10 2024-09-12T18:45:20.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.084+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.10 2024-09-12T18:45:20.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.084+0000 7f87e69109c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.11 2024-09-12T18:45:20.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.084+0000 7f87e69109c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.1.11 2024-09-12T18:45:20.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.084+0000 7f87e69109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:45:20.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.084+0000 7f87e69109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:45:20.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.084+0000 7f87e69109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:20.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.084+0000 7f87e69109c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:20.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.084+0000 7f87e69109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:20.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.084+0000 7f87e69109c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:45:20.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.088+0000 7f86baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 94585187641520 notifier 5870 bl.length()=795 2024-09-12T18:45:20.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.088+0000 7f86baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:45:20.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.088+0000 7f86baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:45:20.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.088+0000 7f86baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:45:20.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.088+0000 7f87e69109c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:45:20.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.088+0000 7f87e69109c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:45:20.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.088+0000 7f87e69109c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:45:20.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.088+0000 7f87e69109c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:45:20.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.092+0000 7f87e69109c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-12T18:45:20.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.092+0000 7f87e69109c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T18:45:20.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.100+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T18:45:20.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.100+0000 7f87e69109c0 20 processing logshard = reshard.0000000007 2024-09-12T18:45:20.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.104+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T18:45:20.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.104+0000 7f87e69109c0 20 processing logshard = reshard.0000000008 2024-09-12T18:45:20.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.108+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T18:45:20.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.108+0000 7f87e69109c0 20 processing logshard = reshard.0000000009 2024-09-12T18:45:20.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.116+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T18:45:20.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.116+0000 7f87e69109c0 20 processing logshard = reshard.0000000010 2024-09-12T18:45:20.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.120+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T18:45:20.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.120+0000 7f87e69109c0 20 processing logshard = reshard.0000000011 2024-09-12T18:45:20.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.124+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T18:45:20.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.124+0000 7f87e69109c0 20 processing logshard = reshard.0000000012 2024-09-12T18:45:20.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.132+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T18:45:20.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.132+0000 7f87e69109c0 20 processing logshard = reshard.0000000013 2024-09-12T18:45:20.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.140+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T18:45:20.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.140+0000 7f87e69109c0 20 processing logshard = reshard.0000000014 2024-09-12T18:45:20.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.144+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T18:45:20.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.144+0000 7f87e69109c0 20 processing logshard = reshard.0000000015 2024-09-12T18:45:20.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.148+0000 7f87e69109c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T18:45:20.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.152+0000 7f869afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:20.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.156+0000 7f87e69109c0 20 remove_watcher() i=0 2024-09-12T18:45:20.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.156+0000 7f87e69109c0 2 removed watcher, disabling cache 2024-09-12T18:45:20.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.160+0000 7f87e69109c0 20 remove_watcher() i=1 2024-09-12T18:45:20.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.160+0000 7f87e69109c0 20 remove_watcher() i=2 2024-09-12T18:45:20.170 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.164+0000 7f87e69109c0 20 remove_watcher() i=3 2024-09-12T18:45:20.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.168+0000 7f87e69109c0 20 remove_watcher() i=4 2024-09-12T18:45:20.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.168+0000 7f87e69109c0 20 remove_watcher() i=5 2024-09-12T18:45:20.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.172+0000 7f87e69109c0 20 remove_watcher() i=6 2024-09-12T18:45:20.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.172+0000 7f87e69109c0 20 remove_watcher() i=7 2024-09-12T18:45:20.196 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:45:20.228 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:20.228 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:20.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.268+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.272+0000 7f0974ce49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:20.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.272+0000 7f0974ce49c0 20 realm 2024-09-12T18:45:20.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.272+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.272+0000 7f0974ce49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:20.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.272+0000 7f0974ce49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:20.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.272+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.272+0000 7f0974ce49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:20.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.272+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.272+0000 7f0974ce49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:20.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.272+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.272+0000 7f0974ce49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:20.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.272+0000 7f0974ce49c0 20 searching for the correct realm 2024-09-12T18:45:20.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.276+0000 7f0971fe9640 0 -- 172.21.15.111:0/366992218 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f096c01e040 msgr2=0x7f096c042400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:20.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.492+0000 7f09727ea640 0 -- 172.21.15.111:0/366992218 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f0964018070 msgr2=0x7f09640769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:20.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:20.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:20.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:20.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:20.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:20.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:20.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:20.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:20.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:20.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 zone default found 2024-09-12T18:45:20.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 4 Realm: () 2024-09-12T18:45:20.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:20.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:20.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:20.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 zonegroup default 2024-09-12T18:45:20.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.508+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.512+0000 7f0974ce49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:20.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.512+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.512+0000 7f0974ce49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:20.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.512+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.512+0000 7f0974ce49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:20.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.512+0000 7f0974ce49c0 20 started sync module instance, tier type = 2024-09-12T18:45:20.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.512+0000 7f0974ce49c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:20.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.536+0000 7f0974ce49c0 20 add_watcher() i=0 2024-09-12T18:45:20.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.536+0000 7f0974ce49c0 20 add_watcher() i=1 2024-09-12T18:45:20.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.536+0000 7f0974ce49c0 20 add_watcher() i=2 2024-09-12T18:45:20.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.536+0000 7f0974ce49c0 20 add_watcher() i=3 2024-09-12T18:45:20.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.536+0000 7f0974ce49c0 20 add_watcher() i=4 2024-09-12T18:45:20.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.536+0000 7f0974ce49c0 20 add_watcher() i=5 2024-09-12T18:45:20.542 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.536+0000 7f0974ce49c0 20 add_watcher() i=6 2024-09-12T18:45:20.543 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.536+0000 7f0974ce49c0 20 add_watcher() i=7 2024-09-12T18:45:20.544 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.536+0000 7f0974ce49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:20.548 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.540+0000 7f0828fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:20.549 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.544+0000 7f0974ce49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:20.549 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.544+0000 7f0974ce49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:20.549 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.544+0000 7f0974ce49c0 5 note: GC not initialized 2024-09-12T18:45:20.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.544+0000 7f07a37fe640 20 reqs_thread_entry: start 2024-09-12T18:45:20.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.544+0000 7f0974ce49c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:20.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.544+0000 7f0974ce49c0 20 Filter name: none 2024-09-12T18:45:20.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.544+0000 7f07a17fa640 20 reqs_thread_entry: start 2024-09-12T18:45:20.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.544+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.544+0000 7f0974ce49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:45:20.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.544+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.548+0000 7f0974ce49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:45:20.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.548+0000 7f0974ce49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:20.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.548+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.548+0000 7f0974ce49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:45:20.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.548+0000 7f0974ce49c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:20.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.548+0000 7f0974ce49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:45:20.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.548+0000 7f0974ce49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:20.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.552+0000 7f0828fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:20.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.556+0000 7f0974ce49c0 20 remove_watcher() i=0 2024-09-12T18:45:20.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.556+0000 7f0974ce49c0 2 removed watcher, disabling cache 2024-09-12T18:45:20.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.560+0000 7f0974ce49c0 20 remove_watcher() i=1 2024-09-12T18:45:20.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.560+0000 7f0974ce49c0 20 remove_watcher() i=2 2024-09-12T18:45:20.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.564+0000 7f0974ce49c0 20 remove_watcher() i=3 2024-09-12T18:45:20.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.564+0000 7f0974ce49c0 20 remove_watcher() i=4 2024-09-12T18:45:20.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.568+0000 7f0974ce49c0 20 remove_watcher() i=5 2024-09-12T18:45:20.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.568+0000 7f0974ce49c0 20 remove_watcher() i=6 2024-09-12T18:45:20.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:20.572+0000 7f0974ce49c0 20 remove_watcher() i=7 2024-09-12T18:45:20.593 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:20.597 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:45:20.597 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: a-bucket id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T18:45:20.597 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:20.597 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T18:45:20.597 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:20.598 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.598 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.621 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.621 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.668 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.668 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.686 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.687 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.706 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.706 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.725 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.725 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.743 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.744 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.763 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.763 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.782 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.782 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.802 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.802 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.821 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.821 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.840 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.840 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.859 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.859 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.877 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.877 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.897 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.897 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.917 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.918 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.936 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.936 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.957 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.957 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.977 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.977 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:20.995 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:20.995 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:21.014 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:21.014 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:21.033 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:21.033 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:21.049 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:45:21.081 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:21.082 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:21.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.120+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.124+0000 7fa65cd989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.124+0000 7fa65cd989c0 20 realm 2024-09-12T18:45:21.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.124+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.124+0000 7fa65cd989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.124+0000 7fa65cd989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:21.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.124+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.124+0000 7fa65cd989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.124+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.124+0000 7fa65cd989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:21.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.124+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.124+0000 7fa65cd989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:21.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.124+0000 7fa65cd989c0 20 searching for the correct realm 2024-09-12T18:45:21.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.132+0000 7fa65a89e640 0 -- 172.21.15.111:0/57183471 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fa654040b00 msgr2=0x7fa65402a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:21.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.136+0000 7fa65a09d640 0 -- 172.21.15.111:0/57183471 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fa654050920 msgr2=0x7fa65400f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:21.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:21.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:21.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:21.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:21.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:21.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:21.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:21.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:21.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 zone default found 2024-09-12T18:45:21.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 4 Realm: () 2024-09-12T18:45:21.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:21.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:21.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:21.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 zonegroup default 2024-09-12T18:45:21.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.352+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.356+0000 7fa65cd989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.356+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.356+0000 7fa65cd989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.356+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.356+0000 7fa65cd989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.356+0000 7fa65cd989c0 20 started sync module instance, tier type = 2024-09-12T18:45:21.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.356+0000 7fa65cd989c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:21.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.380+0000 7fa65cd989c0 20 add_watcher() i=0 2024-09-12T18:45:21.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.380+0000 7fa65cd989c0 20 add_watcher() i=1 2024-09-12T18:45:21.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.380+0000 7fa65cd989c0 20 add_watcher() i=2 2024-09-12T18:45:21.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.380+0000 7fa65cd989c0 20 add_watcher() i=3 2024-09-12T18:45:21.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.380+0000 7fa65cd989c0 20 add_watcher() i=4 2024-09-12T18:45:21.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.380+0000 7fa65cd989c0 20 add_watcher() i=5 2024-09-12T18:45:21.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.380+0000 7fa65cd989c0 20 add_watcher() i=6 2024-09-12T18:45:21.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.380+0000 7fa65cd989c0 20 add_watcher() i=7 2024-09-12T18:45:21.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.380+0000 7fa65cd989c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:21.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.384+0000 7fa5117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:21.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.388+0000 7fa65cd989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:21.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.388+0000 7fa65cd989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:21.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.388+0000 7fa65cd989c0 5 note: GC not initialized 2024-09-12T18:45:21.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.388+0000 7fa48bfff640 20 reqs_thread_entry: start 2024-09-12T18:45:21.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.388+0000 7fa65cd989c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:21.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.388+0000 7fa65cd989c0 20 Filter name: none 2024-09-12T18:45:21.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.388+0000 7fa489ffb640 20 reqs_thread_entry: start 2024-09-12T18:45:21.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.388+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.388+0000 7fa65cd989c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:45:21.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.388+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.388+0000 7fa65cd989c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:45:21.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.388+0000 7fa65cd989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:21.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.388+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.392+0000 7fa65cd989c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:45:21.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.392+0000 7fa65cd989c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.392+0000 7fa65cd989c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:45:21.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.392+0000 7fa65cd989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:21.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.396+0000 7fa5117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:21.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.400+0000 7fa65cd989c0 20 remove_watcher() i=0 2024-09-12T18:45:21.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.400+0000 7fa65cd989c0 2 removed watcher, disabling cache 2024-09-12T18:45:21.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.400+0000 7fa65cd989c0 20 remove_watcher() i=1 2024-09-12T18:45:21.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.404+0000 7fa65cd989c0 20 remove_watcher() i=2 2024-09-12T18:45:21.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.404+0000 7fa65cd989c0 20 remove_watcher() i=3 2024-09-12T18:45:21.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.408+0000 7fa65cd989c0 20 remove_watcher() i=4 2024-09-12T18:45:21.415 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.408+0000 7fa65cd989c0 20 remove_watcher() i=5 2024-09-12T18:45:21.416 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.412+0000 7fa65cd989c0 20 remove_watcher() i=6 2024-09-12T18:45:21.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.412+0000 7fa65cd989c0 20 remove_watcher() i=7 2024-09-12T18:45:21.433 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:21.433 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:45:21.433 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-init-index id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:45:21.433 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:21.433 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T18:45:21.466 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:21.466 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:21.512 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.504+0000 7fee241f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.508+0000 7fee241f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.508+0000 7fee241f89c0 20 realm 2024-09-12T18:45:21.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.508+0000 7fee241f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.508+0000 7fee241f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.508+0000 7fee241f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:21.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.508+0000 7fee241f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.508+0000 7fee241f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.508+0000 7fee241f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.508+0000 7fee241f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:21.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.508+0000 7fee241f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.512+0000 7fee241f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:21.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.512+0000 7fee241f89c0 20 searching for the correct realm 2024-09-12T18:45:21.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.512+0000 7fee214fd640 0 -- 172.21.15.111:0/53819316 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7fee140c9410 msgr2=0x7fee140c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:21.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.724+0000 7fee21cfe640 0 -- 172.21.15.111:0/53819316 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fee1c070070 msgr2=0x7fee1c05cd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:21.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.740+0000 7fee241f89c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:21.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.740+0000 7fee241f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:21.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.740+0000 7fee241f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:21.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.740+0000 7fee241f89c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:21.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.740+0000 7fee241f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:21.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.740+0000 7fee241f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:21.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.740+0000 7fee241f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:21.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:21.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 zone default found 2024-09-12T18:45:21.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 4 Realm: () 2024-09-12T18:45:21.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:21.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:21.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:21.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 zonegroup default 2024-09-12T18:45:21.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 started sync module instance, tier type = 2024-09-12T18:45:21.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.748+0000 7fee241f89c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:21.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.768+0000 7fee241f89c0 20 add_watcher() i=0 2024-09-12T18:45:21.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.768+0000 7fee241f89c0 20 add_watcher() i=1 2024-09-12T18:45:21.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.768+0000 7fee241f89c0 20 add_watcher() i=2 2024-09-12T18:45:21.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.768+0000 7fee241f89c0 20 add_watcher() i=3 2024-09-12T18:45:21.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.768+0000 7fee241f89c0 20 add_watcher() i=4 2024-09-12T18:45:21.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.768+0000 7fee241f89c0 20 add_watcher() i=5 2024-09-12T18:45:21.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.768+0000 7fee241f89c0 20 add_watcher() i=6 2024-09-12T18:45:21.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.768+0000 7fee241f89c0 20 add_watcher() i=7 2024-09-12T18:45:21.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.768+0000 7fee241f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:21.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.772+0000 7fecd7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:21.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.772+0000 7fee241f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:21.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.772+0000 7fee241f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:21.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.772+0000 7fee241f89c0 5 note: GC not initialized 2024-09-12T18:45:21.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.772+0000 7fecd6fe5640 20 reqs_thread_entry: start 2024-09-12T18:45:21.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.772+0000 7fee241f89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:21.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.772+0000 7fee241f89c0 20 Filter name: none 2024-09-12T18:45:21.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.772+0000 7fecd4fe1640 20 reqs_thread_entry: start 2024-09-12T18:45:21.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.772+0000 7fee241f89c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T18:45:21.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.772+0000 7fee241f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.776+0000 7fee241f89c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:45:21.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.776+0000 7fee241f89c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T18:45:21.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.776+0000 7fee241f89c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T18:45:21.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.776+0000 7fee241f89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 : miss 2024-09-12T18:45:21.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.776+0000 7fee241f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.776+0000 7fee241f89c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:45:21.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.776+0000 7fee241f89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 info.flags=0x17 2024-09-12T18:45:21.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.776+0000 7fee241f89c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 to cache LRU end 2024-09-12T18:45:21.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.776+0000 7fee241f89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:45:21.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.776+0000 7fee241f89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:21.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.776+0000 7fee241f89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 2024-09-12T18:45:21.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.784+0000 7fee241f89c0 -1 Injecting error=-5 at location=init_index 2024-09-12T18:45:21.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.784+0000 7fee241f89c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T18:45:21.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.784+0000 7fecd7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:21.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.788+0000 7fee241f89c0 20 remove_watcher() i=0 2024-09-12T18:45:21.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.788+0000 7fee241f89c0 2 removed watcher, disabling cache 2024-09-12T18:45:21.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.788+0000 7fee241f89c0 20 remove_watcher() i=1 2024-09-12T18:45:21.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.792+0000 7fee241f89c0 20 remove_watcher() i=2 2024-09-12T18:45:21.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.792+0000 7fee241f89c0 20 remove_watcher() i=3 2024-09-12T18:45:21.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.796+0000 7fee241f89c0 20 remove_watcher() i=4 2024-09-12T18:45:21.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.796+0000 7fee241f89c0 20 remove_watcher() i=5 2024-09-12T18:45:21.804 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.800+0000 7fee241f89c0 20 remove_watcher() i=6 2024-09-12T18:45:21.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.800+0000 7fee241f89c0 20 remove_watcher() i=7 2024-09-12T18:45:21.821 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:45:21.848 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:21.849 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:21.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.896+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.896+0000 7f7f3ed329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.896+0000 7f7f3ed329c0 20 realm 2024-09-12T18:45:21.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.896+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.896+0000 7f7f3ed329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.896+0000 7f7f3ed329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:21.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.896+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.896+0000 7f7f3ed329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.896+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.900+0000 7f7f3ed329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:21.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.900+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.900+0000 7f7f3ed329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:21.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.900+0000 7f7f3ed329c0 20 searching for the correct realm 2024-09-12T18:45:21.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.904+0000 7f7f3d039640 0 -- 172.21.15.111:0/813792441 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x561f7a1bfb20 msgr2=0x561f7a1c1f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:21.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.912+0000 7f7f3c037640 0 -- 172.21.15.111:0/813792441 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f7f3403a3f0 msgr2=0x7f7f3403a850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:21.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:21.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:21.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:21.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:21.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:21.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:21.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:21.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:21.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 zone default found 2024-09-12T18:45:21.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 4 Realm: () 2024-09-12T18:45:21.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:21.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:21.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:21.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 zonegroup default 2024-09-12T18:45:21.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.920+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.924+0000 7f7f3ed329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.924+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.924+0000 7f7f3ed329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:21.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.924+0000 7f7f3ed329c0 20 started sync module instance, tier type = 2024-09-12T18:45:21.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.924+0000 7f7f3ed329c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:21.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.940+0000 7f7f3ed329c0 20 add_watcher() i=0 2024-09-12T18:45:21.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.940+0000 7f7f3ed329c0 20 add_watcher() i=1 2024-09-12T18:45:21.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.940+0000 7f7f3ed329c0 20 add_watcher() i=2 2024-09-12T18:45:21.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.940+0000 7f7f3ed329c0 20 add_watcher() i=3 2024-09-12T18:45:21.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.940+0000 7f7f3ed329c0 20 add_watcher() i=4 2024-09-12T18:45:21.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.940+0000 7f7f3ed329c0 20 add_watcher() i=5 2024-09-12T18:45:21.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.940+0000 7f7f3ed329c0 20 add_watcher() i=6 2024-09-12T18:45:21.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.940+0000 7f7f3ed329c0 20 add_watcher() i=7 2024-09-12T18:45:21.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.940+0000 7f7f3ed329c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:21.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.940+0000 7f7df37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:21.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:21.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:21.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 5 note: GC not initialized 2024-09-12T18:45:21.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7df27e4640 20 reqs_thread_entry: start 2024-09-12T18:45:21.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:21.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 20 Filter name: none 2024-09-12T18:45:21.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7debfff640 20 reqs_thread_entry: start 2024-09-12T18:45:21.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:45:21.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:45:21.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:21.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:45:21.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:21.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:45:21.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.944+0000 7f7f3ed329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:21.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.948+0000 7f7df37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:21.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.952+0000 7f7f3ed329c0 20 remove_watcher() i=0 2024-09-12T18:45:21.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.952+0000 7f7f3ed329c0 2 removed watcher, disabling cache 2024-09-12T18:45:21.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.956+0000 7f7f3ed329c0 20 remove_watcher() i=1 2024-09-12T18:45:21.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.956+0000 7f7f3ed329c0 20 remove_watcher() i=2 2024-09-12T18:45:21.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.960+0000 7f7f3ed329c0 20 remove_watcher() i=3 2024-09-12T18:45:21.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.960+0000 7f7f3ed329c0 20 remove_watcher() i=4 2024-09-12T18:45:21.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.964+0000 7f7f3ed329c0 20 remove_watcher() i=5 2024-09-12T18:45:21.965 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.964+0000 7f7f3ed329c0 20 remove_watcher() i=6 2024-09-12T18:45:21.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:21.964+0000 7f7f3ed329c0 20 remove_watcher() i=7 2024-09-12T18:45:21.980 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:21.980 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:45:21.981 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-init-index id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:45:21.981 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:21.982 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:21.982 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:21.992 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:21.992 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:22.037 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:45:22.074 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:22.074 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:22.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.116+0000 7f025f9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.120+0000 7f025f9ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:22.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.120+0000 7f025f9ab9c0 20 realm 2024-09-12T18:45:22.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.120+0000 7f025f9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.120+0000 7f025f9ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:22.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.120+0000 7f025f9ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:22.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.120+0000 7f025f9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.120+0000 7f025f9ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:22.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.120+0000 7f025f9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.120+0000 7f025f9ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:22.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.120+0000 7f025f9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.120+0000 7f025f9ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:22.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.120+0000 7f025f9ab9c0 20 searching for the correct realm 2024-09-12T18:45:22.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.124+0000 7f025ccb0640 0 -- 172.21.15.111:0/4290382685 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f0248008040 msgr2=0x7f02480223f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:22.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.340+0000 7f025d4b1640 0 -- 172.21.15.111:0/4290382685 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f024c003cc0 msgr2=0x7f0258039480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:22.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:22.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:22.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:22.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:22.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:22.356 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:22.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:22.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:22.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:22.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 zone default found 2024-09-12T18:45:22.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 4 Realm: () 2024-09-12T18:45:22.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:22.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:22.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:22.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 zonegroup default 2024-09-12T18:45:22.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:22.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.356+0000 7f025f9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.360+0000 7f025f9ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:22.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.360+0000 7f025f9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.360+0000 7f025f9ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:22.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.360+0000 7f025f9ab9c0 20 started sync module instance, tier type = 2024-09-12T18:45:22.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.360+0000 7f025f9ab9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:22.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.384+0000 7f025f9ab9c0 20 add_watcher() i=0 2024-09-12T18:45:22.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.384+0000 7f025f9ab9c0 20 add_watcher() i=1 2024-09-12T18:45:22.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.384+0000 7f025f9ab9c0 20 add_watcher() i=2 2024-09-12T18:45:22.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.384+0000 7f025f9ab9c0 20 add_watcher() i=3 2024-09-12T18:45:22.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.384+0000 7f025f9ab9c0 20 add_watcher() i=4 2024-09-12T18:45:22.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.384+0000 7f025f9ab9c0 20 add_watcher() i=5 2024-09-12T18:45:22.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.384+0000 7f025f9ab9c0 20 add_watcher() i=6 2024-09-12T18:45:22.388 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.384+0000 7f025f9ab9c0 20 add_watcher() i=7 2024-09-12T18:45:22.388 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.384+0000 7f025f9ab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:22.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.388+0000 7f01137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:22.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:22.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:22.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 5 note: GC not initialized 2024-09-12T18:45:22.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f01127e4640 20 reqs_thread_entry: start 2024-09-12T18:45:22.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:22.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 20 Filter name: none 2024-09-12T18:45:22.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f0083fff640 20 reqs_thread_entry: start 2024-09-12T18:45:22.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T18:45:22.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:45:22.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T18:45:22.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T18:45:22.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 : miss 2024-09-12T18:45:22.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:45:22.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 info.flags=0x17 2024-09-12T18:45:22.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 to cache LRU end 2024-09-12T18:45:22.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:45:22.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:22.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.392+0000 7f025f9ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 2024-09-12T18:45:22.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.404+0000 7f025f9ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 info.flags=0x17 2024-09-12T18:45:22.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.404+0000 7f025f9ab9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 to cache LRU end 2024-09-12T18:45:22.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.404+0000 7f025f9ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:22.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.404+0000 7f025f9ab9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19, ofs0, ns] 2024-09-12T18:45:22.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.404+0000 7f0140ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431592 cookie 93882774679232 notifier 5948 bl.length()=911 2024-09-12T18:45:22.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.404+0000 7f0140ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 info.flags=0x17 2024-09-12T18:45:22.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.404+0000 7f0140ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 to cache LRU end 2024-09-12T18:45:22.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.404+0000 7f0140ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:22.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.408+0000 7f025f9ab9c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.19]): orig_sources= new_sources= 2024-09-12T18:45:22.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.408+0000 7f025f9ab9c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.19]): potential sources added=[] removed=[] 2024-09-12T18:45:22.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.408+0000 7f025f9ab9c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.19]): orig_dests= new_dests= 2024-09-12T18:45:22.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.408+0000 7f025f9ab9c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.19]): potential dests added=[] removed=[] 2024-09-12T18:45:22.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.0 2024-09-12T18:45:22.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.0 2024-09-12T18:45:22.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.1 2024-09-12T18:45:22.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.1 2024-09-12T18:45:22.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.2 2024-09-12T18:45:22.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.2 2024-09-12T18:45:22.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.3 2024-09-12T18:45:22.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.3 2024-09-12T18:45:22.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.4 2024-09-12T18:45:22.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.4 2024-09-12T18:45:22.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.5 2024-09-12T18:45:22.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.5 2024-09-12T18:45:22.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.6 2024-09-12T18:45:22.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.6 2024-09-12T18:45:22.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.7 2024-09-12T18:45:22.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.7 2024-09-12T18:45:22.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.8 2024-09-12T18:45:22.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.8 2024-09-12T18:45:22.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.9 2024-09-12T18:45:22.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.9 2024-09-12T18:45:22.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.10 2024-09-12T18:45:22.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.10 2024-09-12T18:45:22.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.11 2024-09-12T18:45:22.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1.11 2024-09-12T18:45:22.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.0 2024-09-12T18:45:22.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1 2024-09-12T18:45:22.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.2 2024-09-12T18:45:22.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.420+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.3 2024-09-12T18:45:22.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.424+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.4 2024-09-12T18:45:22.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.424+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.5 2024-09-12T18:45:22.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.424+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.6 2024-09-12T18:45:22.427 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.424+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.7 2024-09-12T18:45:22.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.428+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.8 2024-09-12T18:45:22.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.428+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.9 2024-09-12T18:45:22.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.428+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.10 2024-09-12T18:45:22.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.436+0000 7f025f9ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 : hit (requested=0x17, cached=0x17) 2024-09-12T18:45:22.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.436+0000 7f025f9ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 2024-09-12T18:45:22.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.436+0000 7f025f9ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 info.flags=0x17 2024-09-12T18:45:22.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.436+0000 7f025f9ab9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 to cache LRU end 2024-09-12T18:45:22.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.436+0000 7f025f9ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:22.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.436+0000 7f025f9ab9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19, ofs0, ns] 2024-09-12T18:45:22.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.436+0000 7f0140ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 93882774679232 notifier 5948 bl.length()=911 2024-09-12T18:45:22.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.436+0000 7f0140ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 info.flags=0x17 2024-09-12T18:45:22.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.436+0000 7f0140ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 to cache LRU end 2024-09-12T18:45:22.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.436+0000 7f0140ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:22.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.440+0000 7f025f9ab9c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.19]): orig_sources= new_sources= 2024-09-12T18:45:22.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.440+0000 7f025f9ab9c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.19]): potential sources added=[] removed=[] 2024-09-12T18:45:22.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.440+0000 7f025f9ab9c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.19]): orig_dests= new_dests= 2024-09-12T18:45:22.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.440+0000 7f025f9ab9c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.19]): potential dests added=[] removed=[] 2024-09-12T18:45:22.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.444+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.0 2024-09-12T18:45:22.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.444+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.1 2024-09-12T18:45:22.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.448+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.2 2024-09-12T18:45:22.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.448+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.3 2024-09-12T18:45:22.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.448+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.4 2024-09-12T18:45:22.450 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.448+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.5 2024-09-12T18:45:22.450 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.448+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.6 2024-09-12T18:45:22.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.448+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.7 2024-09-12T18:45:22.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.452+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.8 2024-09-12T18:45:22.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.452+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.9 2024-09-12T18:45:22.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.452+0000 7f025f9ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.19.10 2024-09-12T18:45:22.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.452+0000 7f025f9ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 : hit (requested=0x17, cached=0x17) 2024-09-12T18:45:22.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.452+0000 7f025f9ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 2024-09-12T18:45:22.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.456+0000 7f025f9ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 info.flags=0x17 2024-09-12T18:45:22.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.456+0000 7f025f9ab9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 to cache LRU end 2024-09-12T18:45:22.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.456+0000 7f025f9ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:22.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.456+0000 7f025f9ab9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19, ofs0, ns] 2024-09-12T18:45:22.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.456+0000 7f012ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 93882774679232 notifier 5948 bl.length()=879 2024-09-12T18:45:22.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.456+0000 7f012ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 info.flags=0x17 2024-09-12T18:45:22.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.456+0000 7f012ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.19 to cache LRU end 2024-09-12T18:45:22.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.456+0000 7f012ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:22.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.456+0000 7f025f9ab9c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.19]): orig_sources= new_sources= 2024-09-12T18:45:22.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.456+0000 7f025f9ab9c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.19]): potential sources added=[] removed=[] 2024-09-12T18:45:22.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.456+0000 7f025f9ab9c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.19]): orig_dests= new_dests= 2024-09-12T18:45:22.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.456+0000 7f025f9ab9c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.19]): potential dests added=[] removed=[] 2024-09-12T18:45:22.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.464+0000 7f025f9ab9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T18:45:22.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.464+0000 7f01137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:22.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.472+0000 7f025f9ab9c0 20 remove_watcher() i=0 2024-09-12T18:45:22.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.472+0000 7f025f9ab9c0 2 removed watcher, disabling cache 2024-09-12T18:45:22.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.472+0000 7f025f9ab9c0 20 remove_watcher() i=1 2024-09-12T18:45:22.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.476+0000 7f025f9ab9c0 20 remove_watcher() i=2 2024-09-12T18:45:22.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.476+0000 7f025f9ab9c0 20 remove_watcher() i=3 2024-09-12T18:45:22.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.480+0000 7f025f9ab9c0 20 remove_watcher() i=4 2024-09-12T18:45:22.483 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.480+0000 7f025f9ab9c0 20 remove_watcher() i=5 2024-09-12T18:45:22.484 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.484+0000 7f025f9ab9c0 20 remove_watcher() i=6 2024-09-12T18:45:22.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.484+0000 7f025f9ab9c0 20 remove_watcher() i=7 2024-09-12T18:45:22.503 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:45:22.533 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:22.533 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:22.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.576+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.580+0000 7f433570b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:22.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.580+0000 7f433570b9c0 20 realm 2024-09-12T18:45:22.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.580+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.580+0000 7f433570b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:22.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.580+0000 7f433570b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:22.582 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.580+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.582 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.580+0000 7f433570b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:22.582 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.580+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.580+0000 7f433570b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:22.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.580+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.584+0000 7f433570b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:22.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.584+0000 7f433570b9c0 20 searching for the correct realm 2024-09-12T18:45:22.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.588+0000 7f4333a12640 0 -- 172.21.15.111:0/201364007 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f4328034060 msgr2=0x7f4328065520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:45:22.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.596+0000 7f4332a10640 0 -- 172.21.15.111:0/201364007 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f432c017070 msgr2=0x7f432c040920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:45:22.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.812+0000 7f433570b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:22.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.812+0000 7f433570b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:22.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.812+0000 7f433570b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:22.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.812+0000 7f433570b9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:22.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.812+0000 7f433570b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:22.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.812+0000 7f433570b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:22.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.812+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.812+0000 7f433570b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:22.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.812+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.812+0000 7f433570b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:22.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.812+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:22.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 20 zone default found 2024-09-12T18:45:22.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 4 Realm: () 2024-09-12T18:45:22.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:22.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:22.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:22.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 20 zonegroup default 2024-09-12T18:45:22.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:22.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:22.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.822 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:22.822 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 20 started sync module instance, tier type = 2024-09-12T18:45:22.822 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.816+0000 7f433570b9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:22.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.840+0000 7f433570b9c0 20 add_watcher() i=0 2024-09-12T18:45:22.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.840+0000 7f433570b9c0 20 add_watcher() i=1 2024-09-12T18:45:22.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.840+0000 7f433570b9c0 20 add_watcher() i=2 2024-09-12T18:45:22.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.840+0000 7f433570b9c0 20 add_watcher() i=3 2024-09-12T18:45:22.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.840+0000 7f433570b9c0 20 add_watcher() i=4 2024-09-12T18:45:22.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.840+0000 7f433570b9c0 20 add_watcher() i=5 2024-09-12T18:45:22.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.840+0000 7f433570b9c0 20 add_watcher() i=6 2024-09-12T18:45:22.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.844+0000 7f433570b9c0 20 add_watcher() i=7 2024-09-12T18:45:22.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.844+0000 7f433570b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:22.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.848+0000 7f41e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:22.856 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.848+0000 7f433570b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:22.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.848+0000 7f433570b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:22.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.848+0000 7f433570b9c0 5 note: GC not initialized 2024-09-12T18:45:22.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.848+0000 7f41e8fe1640 20 reqs_thread_entry: start 2024-09-12T18:45:22.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.848+0000 7f433570b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:22.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.848+0000 7f433570b9c0 20 Filter name: none 2024-09-12T18:45:22.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.852+0000 7f41627fc640 20 reqs_thread_entry: start 2024-09-12T18:45:22.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.852+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.852+0000 7f433570b9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:45:22.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.852+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.852+0000 7f433570b9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:45:22.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.852+0000 7f433570b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:22.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.852+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.852+0000 7f433570b9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:45:22.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.852+0000 7f433570b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:22.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.852+0000 7f433570b9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:45:22.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.852+0000 7f433570b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:22.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.856+0000 7f41e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:22.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.860+0000 7f433570b9c0 20 remove_watcher() i=0 2024-09-12T18:45:22.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.860+0000 7f433570b9c0 2 removed watcher, disabling cache 2024-09-12T18:45:22.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.864+0000 7f433570b9c0 20 remove_watcher() i=1 2024-09-12T18:45:22.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.868+0000 7f433570b9c0 20 remove_watcher() i=2 2024-09-12T18:45:22.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.868+0000 7f433570b9c0 20 remove_watcher() i=3 2024-09-12T18:45:22.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.872+0000 7f433570b9c0 20 remove_watcher() i=4 2024-09-12T18:45:22.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.872+0000 7f433570b9c0 20 remove_watcher() i=5 2024-09-12T18:45:22.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.872+0000 7f433570b9c0 20 remove_watcher() i=6 2024-09-12T18:45:22.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:22.876+0000 7f433570b9c0 20 remove_watcher() i=7 2024-09-12T18:45:22.902 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:22.902 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:45:22.902 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-init-index id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:45:22.902 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:22.903 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:22.903 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:22.910 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:22.910 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:22.955 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:22.955 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.013 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T18:45:23.013 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:23.014 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.014 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.037 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.038 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.083 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.083 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.102 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.102 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.120 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.120 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.138 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.138 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.156 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.156 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.174 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.174 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.192 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.192 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.210 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.210 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.228 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.228 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.245 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.245 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.264 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.264 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.282 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.282 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.300 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.300 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.318 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.318 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.337 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.337 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.356 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.356 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.374 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.374 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.393 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.393 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.414 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.414 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.433 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:23.433 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:23.449 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:45:23.482 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:23.482 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:23.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.528+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.528+0000 7f9e6b86f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:23.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.528+0000 7f9e6b86f9c0 20 realm 2024-09-12T18:45:23.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.528+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.528+0000 7f9e6b86f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:23.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.528+0000 7f9e6b86f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:23.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.528+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.528+0000 7f9e6b86f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:23.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.528+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.532+0000 7f9e6b86f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:23.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.532+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.532+0000 7f9e6b86f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:23.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.532+0000 7f9e6b86f9c0 20 searching for the correct realm 2024-09-12T18:45:23.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.536+0000 7f9e69b76640 0 -- 172.21.15.111:0/1439913734 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f9e5c0d0940 msgr2=0x7f9e5c0db410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:45:23.545 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.544+0000 7f9e63fff640 0 -- 172.21.15.111:0/1439913734 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f9e6406bce0 msgr2=0x7f9e64098040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:45:23.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.760+0000 7f9e6b86f9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:23.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.760+0000 7f9e6b86f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:23.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.760+0000 7f9e6b86f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:23.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.760+0000 7f9e6b86f9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:23.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.760+0000 7f9e6b86f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:23.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.760+0000 7f9e6b86f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:23.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.760+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.760+0000 7f9e6b86f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:23.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.760+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:23.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:23.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 20 zone default found 2024-09-12T18:45:23.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 4 Realm: () 2024-09-12T18:45:23.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:23.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:23.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:23.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 20 zonegroup default 2024-09-12T18:45:23.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:23.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:23.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:23.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 20 started sync module instance, tier type = 2024-09-12T18:45:23.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.764+0000 7f9e6b86f9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:23.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.792+0000 7f9e6b86f9c0 20 add_watcher() i=0 2024-09-12T18:45:23.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.792+0000 7f9e6b86f9c0 20 add_watcher() i=1 2024-09-12T18:45:23.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.792+0000 7f9e6b86f9c0 20 add_watcher() i=2 2024-09-12T18:45:23.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.792+0000 7f9e6b86f9c0 20 add_watcher() i=3 2024-09-12T18:45:23.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.792+0000 7f9e6b86f9c0 20 add_watcher() i=4 2024-09-12T18:45:23.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.792+0000 7f9e6b86f9c0 20 add_watcher() i=5 2024-09-12T18:45:23.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.796+0000 7f9e6b86f9c0 20 add_watcher() i=6 2024-09-12T18:45:23.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.796+0000 7f9e6b86f9c0 20 add_watcher() i=7 2024-09-12T18:45:23.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.796+0000 7f9e6b86f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:23.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.800+0000 7f9d1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:23.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.800+0000 7f9e6b86f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:23.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.800+0000 7f9e6b86f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:23.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.800+0000 7f9e6b86f9c0 5 note: GC not initialized 2024-09-12T18:45:23.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.800+0000 7f9d1e7e4640 20 reqs_thread_entry: start 2024-09-12T18:45:23.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.800+0000 7f9e6b86f9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:23.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.800+0000 7f9e6b86f9c0 20 Filter name: none 2024-09-12T18:45:23.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.800+0000 7f9c8ffff640 20 reqs_thread_entry: start 2024-09-12T18:45:23.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.800+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.800+0000 7f9e6b86f9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:45:23.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.800+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.804 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.804+0000 7f9e6b86f9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:45:23.804 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.804+0000 7f9e6b86f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:23.804 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.804+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.804+0000 7f9e6b86f9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:45:23.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.804+0000 7f9e6b86f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:23.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.804+0000 7f9e6b86f9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:45:23.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.804+0000 7f9e6b86f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:23.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.808+0000 7f9d1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:23.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.812+0000 7f9e6b86f9c0 20 remove_watcher() i=0 2024-09-12T18:45:23.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.812+0000 7f9e6b86f9c0 2 removed watcher, disabling cache 2024-09-12T18:45:23.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.816+0000 7f9e6b86f9c0 20 remove_watcher() i=1 2024-09-12T18:45:23.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.816+0000 7f9e6b86f9c0 20 remove_watcher() i=2 2024-09-12T18:45:23.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.820+0000 7f9e6b86f9c0 20 remove_watcher() i=3 2024-09-12T18:45:23.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.824+0000 7f9e6b86f9c0 20 remove_watcher() i=4 2024-09-12T18:45:23.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.824+0000 7f9e6b86f9c0 20 remove_watcher() i=5 2024-09-12T18:45:23.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.828+0000 7f9e6b86f9c0 20 remove_watcher() i=6 2024-09-12T18:45:23.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:23.828+0000 7f9e6b86f9c0 20 remove_watcher() i=7 2024-09-12T18:45:23.852 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:23.852 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:45:23.852 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-init-index id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:45:23.852 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:23.853 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T18:45:23.893 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:23.893 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:24.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.144+0000 7fa4695519c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.144+0000 7fa4695519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:24.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.144+0000 7fa4695519c0 20 realm 2024-09-12T18:45:24.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.144+0000 7fa4695519c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.144+0000 7fa4695519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:24.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.144+0000 7fa4695519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:24.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.144+0000 7fa4695519c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.144+0000 7fa4695519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:24.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.144+0000 7fa4695519c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.148+0000 7fa4695519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:24.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.148+0000 7fa4695519c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.148+0000 7fa4695519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:24.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.148+0000 7fa4695519c0 20 searching for the correct realm 2024-09-12T18:45:24.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.152+0000 7fa466856640 0 -- 172.21.15.111:0/3379859727 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7fa45c008030 msgr2=0x7fa45c079f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:24.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.160+0000 7fa466856640 0 -- 172.21.15.111:0/3379859727 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7fa330080a80 msgr2=0x7fa330082eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:24.170 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.168+0000 7fa4695519c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:24.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.168+0000 7fa4695519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:24.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.168+0000 7fa4695519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:24.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.168+0000 7fa4695519c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:24.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.168+0000 7fa4695519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:24.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.168+0000 7fa4695519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:24.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.168+0000 7fa4695519c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.168+0000 7fa4695519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:24.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.168+0000 7fa4695519c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.168+0000 7fa4695519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:24.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.168+0000 7fa4695519c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:24.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 20 zone default found 2024-09-12T18:45:24.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 4 Realm: () 2024-09-12T18:45:24.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:24.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:24.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:24.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 20 zonegroup default 2024-09-12T18:45:24.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:24.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:24.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:24.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 20 started sync module instance, tier type = 2024-09-12T18:45:24.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.172+0000 7fa4695519c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:24.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.188+0000 7fa4695519c0 20 add_watcher() i=0 2024-09-12T18:45:24.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.188+0000 7fa4695519c0 20 add_watcher() i=1 2024-09-12T18:45:24.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.188+0000 7fa4695519c0 20 add_watcher() i=2 2024-09-12T18:45:24.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.188+0000 7fa4695519c0 20 add_watcher() i=3 2024-09-12T18:45:24.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.188+0000 7fa4695519c0 20 add_watcher() i=4 2024-09-12T18:45:24.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.188+0000 7fa4695519c0 20 add_watcher() i=5 2024-09-12T18:45:24.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.188+0000 7fa4695519c0 20 add_watcher() i=6 2024-09-12T18:45:24.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.192+0000 7fa4695519c0 20 add_watcher() i=7 2024-09-12T18:45:24.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.192+0000 7fa4695519c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:24.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.192+0000 7fa31dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:24.196 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:24.196 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:24.196 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 5 note: GC not initialized 2024-09-12T18:45:24.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa31cfe1640 20 reqs_thread_entry: start 2024-09-12T18:45:24.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:24.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 20 Filter name: none 2024-09-12T18:45:24.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa2967fc640 20 reqs_thread_entry: start 2024-09-12T18:45:24.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T18:45:24.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:45:24.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T18:45:24.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T18:45:24.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20 : miss 2024-09-12T18:45:24.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:45:24.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20 info.flags=0x17 2024-09-12T18:45:24.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20 to cache LRU end 2024-09-12T18:45:24.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:45:24.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:24.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.196+0000 7fa4695519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20 2024-09-12T18:45:24.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.200+0000 7fa4695519c0 -1 Injecting error=-95 at location=init_index 2024-09-12T18:45:24.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.200+0000 7fa4695519c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T18:45:24.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.208+0000 7fa4695519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20 info.flags=0x17 2024-09-12T18:45:24.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.208+0000 7fa4695519c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20 to cache LRU end 2024-09-12T18:45:24.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.208+0000 7fa4695519c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:24.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.208+0000 7fa4695519c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20, ofs0, ns] 2024-09-12T18:45:24.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.208+0000 7fa34a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431597 cookie 94435275027552 notifier 6002 bl.length()=911 2024-09-12T18:45:24.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.208+0000 7fa34a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20 info.flags=0x17 2024-09-12T18:45:24.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.208+0000 7fa34a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20 to cache LRU end 2024-09-12T18:45:24.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.208+0000 7fa34a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:24.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.208+0000 7fa4695519c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.20]): orig_sources= new_sources= 2024-09-12T18:45:24.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.208+0000 7fa4695519c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.20]): potential sources added=[] removed=[] 2024-09-12T18:45:24.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.208+0000 7fa4695519c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.20]): orig_dests= new_dests= 2024-09-12T18:45:24.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.208+0000 7fa4695519c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.20]): potential dests added=[] removed=[] 2024-09-12T18:45:24.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.0 2024-09-12T18:45:24.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.0 2024-09-12T18:45:24.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.1 2024-09-12T18:45:24.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.1 2024-09-12T18:45:24.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.2 2024-09-12T18:45:24.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.2 2024-09-12T18:45:24.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.3 2024-09-12T18:45:24.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.3 2024-09-12T18:45:24.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.4 2024-09-12T18:45:24.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.4 2024-09-12T18:45:24.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.5 2024-09-12T18:45:24.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.5 2024-09-12T18:45:24.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.6 2024-09-12T18:45:24.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.6 2024-09-12T18:45:24.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.7 2024-09-12T18:45:24.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.7 2024-09-12T18:45:24.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.8 2024-09-12T18:45:24.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.8 2024-09-12T18:45:24.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.9 2024-09-12T18:45:24.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.9 2024-09-12T18:45:24.219 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.10 2024-09-12T18:45:24.219 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.10 2024-09-12T18:45:24.219 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.11 2024-09-12T18:45:24.219 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1.11 2024-09-12T18:45:24.219 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.0 2024-09-12T18:45:24.219 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.1 2024-09-12T18:45:24.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.2 2024-09-12T18:45:24.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.216+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.3 2024-09-12T18:45:24.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.220+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.4 2024-09-12T18:45:24.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.220+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.5 2024-09-12T18:45:24.222 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.220+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.6 2024-09-12T18:45:24.222 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.220+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.7 2024-09-12T18:45:24.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.224+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.8 2024-09-12T18:45:24.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.224+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.9 2024-09-12T18:45:24.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.224+0000 7fa4695519c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.20.10 2024-09-12T18:45:24.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.232+0000 7fa4695519c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20 : hit (requested=0x17, cached=0x17) 2024-09-12T18:45:24.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.232+0000 7fa4695519c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20 2024-09-12T18:45:24.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.236+0000 7fa4695519c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20 info.flags=0x17 2024-09-12T18:45:24.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.236+0000 7fa4695519c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20 to cache LRU end 2024-09-12T18:45:24.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.236+0000 7fa4695519c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:24.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.236+0000 7fa4695519c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20, ofs0, ns] 2024-09-12T18:45:24.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.236+0000 7fa34a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431598 cookie 94435275027552 notifier 6002 bl.length()=879 2024-09-12T18:45:24.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.236+0000 7fa34a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20 info.flags=0x17 2024-09-12T18:45:24.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.236+0000 7fa34a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:97c2b296-1395-4700-8053-4f06c4c86557.4689.20 to cache LRU end 2024-09-12T18:45:24.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.236+0000 7fa34a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:24.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.236+0000 7fa4695519c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.20]): orig_sources= new_sources= 2024-09-12T18:45:24.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.236+0000 7fa4695519c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.20]): potential sources added=[] removed=[] 2024-09-12T18:45:24.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.236+0000 7fa4695519c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.20]): orig_dests= new_dests= 2024-09-12T18:45:24.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.236+0000 7fa4695519c0 20 handle_bi_update(): bucket=:error-at-init-index[97c2b296-1395-4700-8053-4f06c4c86557.4689.20]): potential dests added=[] removed=[] 2024-09-12T18:45:24.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.240+0000 7fa4695519c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T18:45:24.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.244+0000 7fa31dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:24.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.248+0000 7fa4695519c0 20 remove_watcher() i=0 2024-09-12T18:45:24.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.248+0000 7fa4695519c0 2 removed watcher, disabling cache 2024-09-12T18:45:24.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.252+0000 7fa4695519c0 20 remove_watcher() i=1 2024-09-12T18:45:24.258 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.256+0000 7fa4695519c0 20 remove_watcher() i=2 2024-09-12T18:45:24.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.260+0000 7fa4695519c0 20 remove_watcher() i=3 2024-09-12T18:45:24.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.260+0000 7fa4695519c0 20 remove_watcher() i=4 2024-09-12T18:45:24.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.260+0000 7fa4695519c0 20 remove_watcher() i=5 2024-09-12T18:45:24.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.264+0000 7fa4695519c0 20 remove_watcher() i=6 2024-09-12T18:45:24.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.268+0000 7fa4695519c0 20 remove_watcher() i=7 2024-09-12T18:45:24.284 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T18:45:24.311 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:24.311 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:24.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.352+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.356+0000 7f629ab759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:24.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.356+0000 7f629ab759c0 20 realm 2024-09-12T18:45:24.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.356+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.356+0000 7f629ab759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:24.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.356+0000 7f629ab759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:24.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.356+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.356+0000 7f629ab759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:24.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.356+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.356+0000 7f629ab759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:24.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.356+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.360+0000 7f629ab759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:24.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.360+0000 7f629ab759c0 20 searching for the correct realm 2024-09-12T18:45:24.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.364+0000 7f6298e7c640 0 -- 172.21.15.111:0/2166178675 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f6280062e10 msgr2=0x7f6280020ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:24.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.368+0000 7f628fe7a640 0 -- 172.21.15.111:0/2166178675 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f6290038930 msgr2=0x7f629002a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:24.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.584+0000 7f629ab759c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:24.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.584+0000 7f629ab759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:24.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.584+0000 7f629ab759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:24.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.584+0000 7f629ab759c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:24.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.584+0000 7f629ab759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:24.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.584+0000 7f629ab759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:24.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.584+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.584+0000 7f629ab759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:24.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.584+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:24.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:24.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 20 zone default found 2024-09-12T18:45:24.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 4 Realm: () 2024-09-12T18:45:24.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:24.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:24.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:24.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 20 zonegroup default 2024-09-12T18:45:24.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:24.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:24.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.588+0000 7f629ab759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:24.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.592+0000 7f629ab759c0 20 started sync module instance, tier type = 2024-09-12T18:45:24.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.592+0000 7f629ab759c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:24.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.612+0000 7f629ab759c0 20 add_watcher() i=0 2024-09-12T18:45:24.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.612+0000 7f629ab759c0 20 add_watcher() i=1 2024-09-12T18:45:24.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.612+0000 7f629ab759c0 20 add_watcher() i=2 2024-09-12T18:45:24.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.612+0000 7f629ab759c0 20 add_watcher() i=3 2024-09-12T18:45:24.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.612+0000 7f629ab759c0 20 add_watcher() i=4 2024-09-12T18:45:24.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.612+0000 7f629ab759c0 20 add_watcher() i=5 2024-09-12T18:45:24.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.612+0000 7f629ab759c0 20 add_watcher() i=6 2024-09-12T18:45:24.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.616+0000 7f629ab759c0 20 add_watcher() i=7 2024-09-12T18:45:24.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.616+0000 7f629ab759c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:24.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.620+0000 7f614efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:24.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.620+0000 7f629ab759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:24.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.620+0000 7f629ab759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:24.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.620+0000 7f629ab759c0 5 note: GC not initialized 2024-09-12T18:45:24.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.620+0000 7f614dfdb640 20 reqs_thread_entry: start 2024-09-12T18:45:24.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.620+0000 7f629ab759c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:24.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.620+0000 7f629ab759c0 20 Filter name: none 2024-09-12T18:45:24.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.624+0000 7f60bf7fe640 20 reqs_thread_entry: start 2024-09-12T18:45:24.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.624+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.624+0000 7f629ab759c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:45:24.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.624+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.624+0000 7f629ab759c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:45:24.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.624+0000 7f629ab759c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:24.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.624+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.624+0000 7f629ab759c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:45:24.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.624+0000 7f629ab759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:24.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.624+0000 7f629ab759c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:45:24.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.624+0000 7f629ab759c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:24.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.628+0000 7f614efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:24.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.632+0000 7f629ab759c0 20 remove_watcher() i=0 2024-09-12T18:45:24.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.632+0000 7f629ab759c0 2 removed watcher, disabling cache 2024-09-12T18:45:24.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.636+0000 7f629ab759c0 20 remove_watcher() i=1 2024-09-12T18:45:24.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.636+0000 7f629ab759c0 20 remove_watcher() i=2 2024-09-12T18:45:24.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.640+0000 7f629ab759c0 20 remove_watcher() i=3 2024-09-12T18:45:24.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.640+0000 7f629ab759c0 20 remove_watcher() i=4 2024-09-12T18:45:24.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.644+0000 7f629ab759c0 20 remove_watcher() i=5 2024-09-12T18:45:24.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.644+0000 7f629ab759c0 20 remove_watcher() i=6 2024-09-12T18:45:24.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:24.648+0000 7f629ab759c0 20 remove_watcher() i=7 2024-09-12T18:45:24.666 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:24.666 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:45:24.666 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-init-index id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T18:45:24.666 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:24.669 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:24.669 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:24.674 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:24.674 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:24.724 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:24.724 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:24.789 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T18:45:24.789 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:24.792 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:24.792 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:24.815 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:24.815 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:24.864 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:24.864 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:24.883 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:24.883 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:24.902 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:24.902 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:24.921 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:24.921 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:24.940 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:24.940 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:24.959 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:24.959 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:24.981 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:24.981 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:25.000 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:25.000 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:25.019 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:25.019 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:25.038 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:25.038 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:25.058 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:25.058 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:25.077 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:25.077 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:25.097 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:25.097 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:25.116 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:25.116 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:25.136 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:25.136 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:25.154 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:25.154 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:25.173 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:25.173 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:25.192 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:25.192 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:25.211 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:25.211 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:25.230 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:25.230 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:25.248 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T18:45:25.282 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:25.282 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:25.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.324+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.328+0000 7f764df599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:25.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.328+0000 7f764df599c0 20 realm 2024-09-12T18:45:25.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.328+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.328+0000 7f764df599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:25.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.328+0000 7f764df599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:25.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.328+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.328+0000 7f764df599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:25.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.328+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.328+0000 7f764df599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:25.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.328+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.332+0000 7f764df599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:25.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.332+0000 7f764df599c0 20 searching for the correct realm 2024-09-12T18:45:25.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.336+0000 7f764c260640 0 -- 172.21.15.111:0/4045878723 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f763406c290 msgr2=0x7f7634066b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:45:25.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.552+0000 7f764b25e640 0 -- 172.21.15.111:0/4045878723 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f764406dbb0 msgr2=0x7f7644062aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:25.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.768+0000 7f764df599c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:25.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.768+0000 7f764df599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:25.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.768+0000 7f764df599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:25.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.768+0000 7f764df599c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:25.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.768+0000 7f764df599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:25.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.768+0000 7f764df599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:25.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.768+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.768+0000 7f764df599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:25.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.768+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:25.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:25.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 20 zone default found 2024-09-12T18:45:25.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 4 Realm: () 2024-09-12T18:45:25.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:25.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:25.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:25.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 20 zonegroup default 2024-09-12T18:45:25.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:25.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:25.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:25.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 20 started sync module instance, tier type = 2024-09-12T18:45:25.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.772+0000 7f764df599c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:25.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.796+0000 7f764df599c0 20 add_watcher() i=0 2024-09-12T18:45:25.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.796+0000 7f764df599c0 20 add_watcher() i=1 2024-09-12T18:45:25.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.796+0000 7f764df599c0 20 add_watcher() i=2 2024-09-12T18:45:25.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.796+0000 7f764df599c0 20 add_watcher() i=3 2024-09-12T18:45:25.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.796+0000 7f764df599c0 20 add_watcher() i=4 2024-09-12T18:45:25.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.796+0000 7f764df599c0 20 add_watcher() i=5 2024-09-12T18:45:25.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.796+0000 7f764df599c0 20 add_watcher() i=6 2024-09-12T18:45:25.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.800+0000 7f764df599c0 20 add_watcher() i=7 2024-09-12T18:45:25.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.800+0000 7f764df599c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:25.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.804+0000 7f7501fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:25.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.804+0000 7f764df599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:25.807 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.804+0000 7f764df599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:25.807 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.804+0000 7f764df599c0 5 note: GC not initialized 2024-09-12T18:45:25.807 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.804+0000 7f7500fe1640 20 reqs_thread_entry: start 2024-09-12T18:45:25.807 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.804+0000 7f764df599c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:25.807 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.804+0000 7f764df599c0 20 Filter name: none 2024-09-12T18:45:25.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.804+0000 7f747a7fc640 20 reqs_thread_entry: start 2024-09-12T18:45:25.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.808+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.808+0000 7f764df599c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:45:25.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.808+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.808+0000 7f764df599c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:45:25.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.808+0000 7f764df599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:25.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.808+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.808+0000 7f764df599c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:45:25.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.808+0000 7f764df599c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.808+0000 7f764df599c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:45:25.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.808+0000 7f764df599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:25.813 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.812+0000 7f7501fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:25.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.816+0000 7f764df599c0 20 remove_watcher() i=0 2024-09-12T18:45:25.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.816+0000 7f764df599c0 2 removed watcher, disabling cache 2024-09-12T18:45:25.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.820+0000 7f764df599c0 20 remove_watcher() i=1 2024-09-12T18:45:25.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.820+0000 7f764df599c0 20 remove_watcher() i=2 2024-09-12T18:45:25.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.824+0000 7f764df599c0 20 remove_watcher() i=3 2024-09-12T18:45:25.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.824+0000 7f764df599c0 20 remove_watcher() i=4 2024-09-12T18:45:25.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.828+0000 7f764df599c0 20 remove_watcher() i=5 2024-09-12T18:45:25.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.828+0000 7f764df599c0 20 remove_watcher() i=6 2024-09-12T18:45:25.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.828+0000 7f764df599c0 20 remove_watcher() i=7 2024-09-12T18:45:25.847 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:25.848 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:45:25.848 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-init-indext id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:45:25.848 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:25.848 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T18:45:25.880 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:25.880 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:25.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:25.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 realm 2024-09-12T18:45:25.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:25.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:25.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:25.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:25.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:25.931 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:25.931 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 searching for the correct realm 2024-09-12T18:45:25.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:25.932+0000 7f2bfb124640 0 -- 172.21.15.111:0/1902603366 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f2bf00bf030 msgr2=0x7f2bf00fdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:26.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.148+0000 7f2bfa122640 0 -- 172.21.15.111:0/1902603366 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f2bf4023b60 msgr2=0x7f2bf4080040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:26.367 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:26.367 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:26.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:26.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:26.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:26.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:26.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.369 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:26.369 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.370 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:26.370 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 zone default found 2024-09-12T18:45:26.370 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 4 Realm: () 2024-09-12T18:45:26.370 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:26.370 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:26.370 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:26.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 zonegroup default 2024-09-12T18:45:26.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.372+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.372+0000 7f2bfce1d9c0 20 started sync module instance, tier type = 2024-09-12T18:45:26.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.372+0000 7f2bfce1d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:26.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=0 2024-09-12T18:45:26.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=1 2024-09-12T18:45:26.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=2 2024-09-12T18:45:26.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=3 2024-09-12T18:45:26.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=4 2024-09-12T18:45:26.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=5 2024-09-12T18:45:26.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=6 2024-09-12T18:45:26.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.396+0000 7f2bfce1d9c0 20 add_watcher() i=7 2024-09-12T18:45:26.398 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.396+0000 7f2bfce1d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:26.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.400+0000 7f2ab17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:26.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:26.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:26.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 note: GC not initialized 2024-09-12T18:45:26.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2a2bfff640 20 reqs_thread_entry: start 2024-09-12T18:45:26.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:26.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 Filter name: none 2024-09-12T18:45:26.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2a29ffb640 20 reqs_thread_entry: start 2024-09-12T18:45:26.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:45:26.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:45:26.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:45:26.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:45:26.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 : miss 2024-09-12T18:45:26.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:45:26.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 info.flags=0x17 2024-09-12T18:45:26.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 to cache LRU end 2024-09-12T18:45:26.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:45:26.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:26.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 2024-09-12T18:45:26.409 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2bfce1d9c0 time 2024-09-12T18:45:26.409790+0000 2024-09-12T18:45:26.409 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:45:26.412 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:45:26.413 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c006f72eb] 2024-09-12T18:45:26.413 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c006f749f] 2024-09-12T18:45:26.413 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6743a0cc1] 2024-09-12T18:45:26.413 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1421f32) [0x55a674dfdf32] 2024-09-12T18:45:26.413 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6743b5ced] 2024-09-12T18:45:26.413 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:45:26.413 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bff55dd90] 2024-09-12T18:45:26.413 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:45:26.413 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:45:26.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.412+0000 7f2bfce1d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2bfce1d9c0 time 2024-09-12T18:45:26.409790+0000 2024-09-12T18:45:26.413 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:45:26.413 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.414 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:45:26.414 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c006f72eb] 2024-09-12T18:45:26.414 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c006f749f] 2024-09-12T18:45:26.414 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6743a0cc1] 2024-09-12T18:45:26.414 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1421f32) [0x55a674dfdf32] 2024-09-12T18:45:26.414 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6743b5ced] 2024-09-12T18:45:26.414 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:45:26.414 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bff55dd90] 2024-09-12T18:45:26.414 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:45:26.414 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:45:26.414 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.414 INFO:tasks.workunit.client.0.smithi111.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:45:26.414 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f2bfce1d9c0 thread_name:radosgw-admin 2024-09-12T18:45:26.415 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:45:26.416 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2bff576520] 2024-09-12T18:45:26.416 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:45:26.416 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:45:26.416 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:45:26.416 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c006f7345] 2024-09-12T18:45:26.416 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c006f749f] 2024-09-12T18:45:26.416 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6743a0cc1] 2024-09-12T18:45:26.416 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1421f32) [0x55a674dfdf32] 2024-09-12T18:45:26.416 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6743b5ced] 2024-09-12T18:45:26.416 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:45:26.416 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bff55dd90] 2024-09-12T18:45:26.416 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:45:26.417 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:45:26.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.412+0000 7f2bfce1d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:45:26.417 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f2bfce1d9c0 thread_name:radosgw-admin 2024-09-12T18:45:26.417 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.417 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:45:26.417 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2bff576520] 2024-09-12T18:45:26.417 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:45:26.417 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:45:26.417 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:45:26.417 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c006f7345] 2024-09-12T18:45:26.417 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c006f749f] 2024-09-12T18:45:26.417 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6743a0cc1] 2024-09-12T18:45:26.417 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1421f32) [0x55a674dfdf32] 2024-09-12T18:45:26.417 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6743b5ced] 2024-09-12T18:45:26.418 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:45:26.418 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bff55dd90] 2024-09-12T18:45:26.418 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:45:26.418 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:45:26.418 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:45:26.418 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.418 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:45:26.460 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:45:25.900+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.460 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:45:25.900+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.460 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:45:25.900+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.460 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:45:25.900+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.460 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:45:25.900+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.460 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:45:25.900+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.460 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:45:25.900+0000 7f2bfa923640 10 monclient(hunting): handle_auth_done global_id 6041 payload 274 2024-09-12T18:45:26.460 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:45:25.900+0000 7f2bfa923640 10 monclient: _finish_hunting 0 2024-09-12T18:45:26.460 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:45:25.900+0000 7f2bfa923640 1 monclient: found mon.noname-c 2024-09-12T18:45:26.460 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:45:25.900+0000 7f2bfa923640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.461 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.461 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:45:26.461 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: dump: 2024-09-12T18:45:26.461 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.461 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.461 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.461 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.461 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.461 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.461 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.461 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.461 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.461 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.461 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: _finish_auth 0 2024-09-12T18:45:26.462 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: _check_auth_tickets 2024-09-12T18:45:26.462 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:45:26.462 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.462 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:45:26.462 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: dump: 2024-09-12T18:45:26.462 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.462 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.463 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.463 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.463 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.463 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.463 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.463 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.463 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.463 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.463 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 monclient: authenticate success, global_id 6041 2024-09-12T18:45:26.463 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:45:26.463 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 4 set_mon_vals no callback set 2024-09-12T18:45:26.463 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 10 monclient: shutdown 2024-09-12T18:45:26.463 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) unregister_commands rotate-key 2024-09-12T18:45:26.464 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 10 monclient: build_initial_monmap 2024-09-12T18:45:26.464 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:45:26.464 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 10 monclient: monmap: 2024-09-12T18:45:26.464 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:45:26.464 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:45:26.464 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:45:26.464 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:45:26.464 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:45:26.465 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.465 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:45:26.465 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:45:26.465 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:45:26.465 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.465 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding auth protocol: cephx 2024-09-12T18:45:26.465 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding auth protocol: cephx 2024-09-12T18:45:26.465 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding auth protocol: cephx 2024-09-12T18:45:26.465 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: secure 2024-09-12T18:45:26.465 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: crc 2024-09-12T18:45:26.465 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: secure 2024-09-12T18:45:26.465 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: crc 2024-09-12T18:45:26.465 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: secure 2024-09-12T18:45:26.466 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: crc 2024-09-12T18:45:26.466 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: crc 2024-09-12T18:45:26.466 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: secure 2024-09-12T18:45:26.466 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: crc 2024-09-12T18:45:26.466 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: secure 2024-09-12T18:45:26.466 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: crc 2024-09-12T18:45:26.466 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: secure 2024-09-12T18:45:26.466 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.466 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 1 librados: starting msgr at 2024-09-12T18:45:26.466 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 1 librados: starting objecter 2024-09-12T18:45:26.466 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command objecter_requests hook 0x55a676eabdf0 2024-09-12T18:45:26.466 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 1 librados: setting wanted keys 2024-09-12T18:45:26.466 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 1 librados: calling monclient init 2024-09-12T18:45:26.466 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 10 monclient: init 2024-09-12T18:45:26.467 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding auth protocol: cephx 2024-09-12T18:45:26.467 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding auth protocol: cephx 2024-09-12T18:45:26.467 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding auth protocol: cephx 2024-09-12T18:45:26.467 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: secure 2024-09-12T18:45:26.467 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: crc 2024-09-12T18:45:26.467 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: secure 2024-09-12T18:45:26.467 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: crc 2024-09-12T18:45:26.467 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: secure 2024-09-12T18:45:26.467 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: crc 2024-09-12T18:45:26.467 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: crc 2024-09-12T18:45:26.467 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: secure 2024-09-12T18:45:26.467 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: crc 2024-09-12T18:45:26.468 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: secure 2024-09-12T18:45:26.468 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: crc 2024-09-12T18:45:26.468 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: secure 2024-09-12T18:45:26.468 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.468 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.468 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command rotate-key hook 0x55a6770c2b98 2024-09-12T18:45:26.468 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:45:26.468 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:45:26.468 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-b con 0x55a676f73310 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:45:26.468 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-c con 0x55a677008c40 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:45:26.468 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-a con 0x55a67700bb30 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:45:26.468 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.468 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.469 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.469 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:45:26.469 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): authenticate will time out at 2113.044740s 2024-09-12T18:45:26.469 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): get_auth_request con 0x55a677008c40 auth_method 0 2024-09-12T18:45:26.469 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.469 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.469 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.469 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:45:25.904+0000 7f2bfb124640 10 monclient(hunting): get_auth_request con 0x55a67700bb30 auth_method 0 2024-09-12T18:45:26.469 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:45:25.904+0000 7f2bfb124640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.469 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:45:25.904+0000 7f2bfb124640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.469 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:45:25.904+0000 7f2bfb124640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.469 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.469 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.469 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.470 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:45:25.904+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.470 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:45:25.904+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.470 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:45:25.904+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.470 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): handle_auth_done global_id 6044 payload 824 2024-09-12T18:45:26.470 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient: _finish_hunting 0 2024-09-12T18:45:26.470 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:45:25.904+0000 7f2bfa122640 1 monclient: found mon.noname-c 2024-09-12T18:45:26.470 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.470 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:45:25.904+0000 7f2bfa923640 10 monclient: get_auth_request con 0x55a676f73310 auth_method 0 2024-09-12T18:45:26.470 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.470 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:45:26.470 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: dump: 2024-09-12T18:45:26.470 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.470 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.470 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.471 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.471 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.471 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.471 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.471 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.471 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.471 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.471 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: _finish_auth 0 2024-09-12T18:45:26.471 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: _check_auth_tickets 2024-09-12T18:45:26.471 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 5 monclient: authenticate success, global_id 6044 2024-09-12T18:45:26.472 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient: _renew_subs 2024-09-12T18:45:26.472 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.472 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:45:26.472 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.472 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:45:26.472 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: dump: 2024-09-12T18:45:26.472 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.472 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.472 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.472 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.472 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.472 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.472 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.472 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.473 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.473 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.473 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:45:25.904+0000 7f2ae8e09640 4 set_mon_vals no callback set 2024-09-12T18:45:26.473 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient: _renew_subs 2024-09-12T18:45:26.473 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.473 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 1 librados: init done 2024-09-12T18:45:26.473 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:45:25.904+0000 7f2ae7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:45:26.473 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:45:25.904+0000 7f2ae7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:45:26.473 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:45:25.904+0000 7f2ae7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:45:26.473 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:45:25.904+0000 7f2bfa923640 10 monclient: get_auth_request con 0x7f2ae0070ae0 auth_method 0 2024-09-12T18:45:26.473 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:45:25.908+0000 7f2bfb124640 10 monclient: get_auth_request con 0x55a67710a660 auth_method 0 2024-09-12T18:45:26.473 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:45:25.908+0000 7f2bfa923640 10 monclient: get_auth_request con 0x55a67710d610 auth_method 0 2024-09-12T18:45:26.473 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:45:25.908+0000 7f2bfa122640 10 monclient: get_auth_request con 0x55a6771119c0 auth_method 0 2024-09-12T18:45:26.473 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:45:25.912+0000 7f2bfb124640 10 monclient: get_auth_request con 0x55a677110ea0 auth_method 0 2024-09-12T18:45:26.474 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient: build_initial_monmap 2024-09-12T18:45:26.474 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:45:26.474 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient: monmap: 2024-09-12T18:45:26.474 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:45:26.474 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:45:26.474 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:45:26.474 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:45:26.474 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:45:26.474 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.474 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:45:26.474 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:45:26.474 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:45:26.474 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.474 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding auth protocol: cephx 2024-09-12T18:45:26.475 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding auth protocol: cephx 2024-09-12T18:45:26.475 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding auth protocol: cephx 2024-09-12T18:45:26.475 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: secure 2024-09-12T18:45:26.475 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: crc 2024-09-12T18:45:26.475 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: secure 2024-09-12T18:45:26.475 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: crc 2024-09-12T18:45:26.475 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: secure 2024-09-12T18:45:26.475 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: crc 2024-09-12T18:45:26.475 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: crc 2024-09-12T18:45:26.475 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: secure 2024-09-12T18:45:26.475 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: crc 2024-09-12T18:45:26.476 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: secure 2024-09-12T18:45:26.476 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: crc 2024-09-12T18:45:26.476 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: secure 2024-09-12T18:45:26.476 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.476 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a67711d500 EEXIST 2024-09-12T18:45:26.476 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient: init 2024-09-12T18:45:26.476 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding auth protocol: cephx 2024-09-12T18:45:26.476 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding auth protocol: cephx 2024-09-12T18:45:26.476 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding auth protocol: cephx 2024-09-12T18:45:26.476 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: secure 2024-09-12T18:45:26.476 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: crc 2024-09-12T18:45:26.476 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: secure 2024-09-12T18:45:26.476 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: crc 2024-09-12T18:45:26.477 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: secure 2024-09-12T18:45:26.477 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: crc 2024-09-12T18:45:26.477 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: crc 2024-09-12T18:45:26.477 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: secure 2024-09-12T18:45:26.477 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: crc 2024-09-12T18:45:26.477 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: secure 2024-09-12T18:45:26.477 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: crc 2024-09-12T18:45:26.477 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: secure 2024-09-12T18:45:26.477 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.477 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.477 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command rotate-key cmddesc rotate-key hook 0x55a677118b60 EEXIST 2024-09-12T18:45:26.477 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:45:26.477 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:45:26.477 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-b con 0x55a6771416b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:45:26.478 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-c con 0x55a677140fe0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:45:26.478 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-a con 0x55a67713f9c0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:45:26.478 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.478 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.478 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.478 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:45:26.478 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): authenticate will time out at 2113.055855s 2024-09-12T18:45:26.478 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:45:25.912+0000 7f2bfb124640 10 monclient(hunting): get_auth_request con 0x55a677140fe0 auth_method 0 2024-09-12T18:45:26.478 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:45:25.912+0000 7f2bfb124640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.478 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:45:25.912+0000 7f2bfb124640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.478 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:45:25.912+0000 7f2bfb124640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.478 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:45:25.916+0000 7f2bfa923640 10 monclient(hunting): get_auth_request con 0x55a67713f9c0 auth_method 0 2024-09-12T18:45:26.478 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:45:25.916+0000 7f2bfa923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.478 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:45:25.916+0000 7f2bfa923640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.479 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:45:25.916+0000 7f2bfa923640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.479 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:45:25.916+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.479 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:45:25.916+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.479 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:45:25.916+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.479 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:45:25.916+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.479 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:45:25.916+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.479 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:45:25.916+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.479 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:45:25.916+0000 7f2bfa122640 10 monclient(hunting): get_auth_request con 0x55a6771416b0 auth_method 0 2024-09-12T18:45:26.479 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:45:25.916+0000 7f2bfa122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.479 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:45:25.916+0000 7f2bfa122640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.479 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:45:25.916+0000 7f2bfa122640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.479 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:45:25.916+0000 7f2bfb124640 10 monclient(hunting): handle_auth_done global_id 6047 payload 824 2024-09-12T18:45:26.479 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:45:25.916+0000 7f2bfb124640 10 monclient: _finish_hunting 0 2024-09-12T18:45:26.479 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:45:25.916+0000 7f2bfb124640 1 monclient: found mon.noname-c 2024-09-12T18:45:26.480 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:45:25.916+0000 7f2bfb124640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.480 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.480 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:45:26.480 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: dump: 2024-09-12T18:45:26.480 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.480 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.480 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.480 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.480 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.480 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.480 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.480 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.480 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.480 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.481 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: _finish_auth 0 2024-09-12T18:45:26.481 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: _check_auth_tickets 2024-09-12T18:45:26.481 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:45:26.481 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.481 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:45:26.481 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: dump: 2024-09-12T18:45:26.481 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.481 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.481 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.481 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.481 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.481 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.481 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.481 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.482 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.482 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.482 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 monclient: authenticate success, global_id 6047 2024-09-12T18:45:26.482 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:45:25.916+0000 7f2bfb925640 4 set_mon_vals no callback set 2024-09-12T18:45:26.482 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: _renew_subs 2024-09-12T18:45:26.482 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.482 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: _renew_subs 2024-09-12T18:45:26.482 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.482 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:45:26.482 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:45:26.482 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:45:26.482 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:45:25.916+0000 7f2bfa122640 10 monclient: get_auth_request con 0x7f2ad4070a20 auth_method 0 2024-09-12T18:45:26.482 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: get_monmap_and_config 2024-09-12T18:45:26.482 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: build_initial_monmap 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: monmap: 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding auth protocol: cephx 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding auth protocol: cephx 2024-09-12T18:45:26.483 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding auth protocol: cephx 2024-09-12T18:45:26.484 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: secure 2024-09-12T18:45:26.484 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: crc 2024-09-12T18:45:26.484 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: secure 2024-09-12T18:45:26.484 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: crc 2024-09-12T18:45:26.484 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: secure 2024-09-12T18:45:26.484 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: crc 2024-09-12T18:45:26.484 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: crc 2024-09-12T18:45:26.484 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: secure 2024-09-12T18:45:26.484 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: crc 2024-09-12T18:45:26.484 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: secure 2024-09-12T18:45:26.484 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: crc 2024-09-12T18:45:26.484 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: secure 2024-09-12T18:45:26.484 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.485 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: init 2024-09-12T18:45:26.485 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding auth protocol: cephx 2024-09-12T18:45:26.485 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding auth protocol: cephx 2024-09-12T18:45:26.485 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding auth protocol: cephx 2024-09-12T18:45:26.485 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: secure 2024-09-12T18:45:26.485 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: crc 2024-09-12T18:45:26.485 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: secure 2024-09-12T18:45:26.485 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: crc 2024-09-12T18:45:26.485 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: secure 2024-09-12T18:45:26.485 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: crc 2024-09-12T18:45:26.486 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: crc 2024-09-12T18:45:26.486 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: secure 2024-09-12T18:45:26.486 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: crc 2024-09-12T18:45:26.486 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: secure 2024-09-12T18:45:26.486 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: crc 2024-09-12T18:45:26.486 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: secure 2024-09-12T18:45:26.486 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.486 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.486 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdba52bd98 EEXIST 2024-09-12T18:45:26.486 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:45:26.486 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:45:26.486 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-b con 0x55a677195560 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:45:26.486 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-c con 0x55a677190950 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:45:26.486 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-a con 0x55a6771912d0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:45:26.487 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.487 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.487 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.487 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:45:26.487 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): authenticate will time out at 2113.060799s 2024-09-12T18:45:26.487 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): get_auth_request con 0x55a677190950 auth_method 0 2024-09-12T18:45:26.487 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.487 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.487 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.487 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): get_auth_request con 0x55a6771912d0 auth_method 0 2024-09-12T18:45:26.487 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.487 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.487 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.487 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.488 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.488 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.488 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): get_auth_request con 0x55a677195560 auth_method 0 2024-09-12T18:45:26.488 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.488 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.488 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.488 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.488 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.488 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.488 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): handle_auth_done global_id 6050 payload 274 2024-09-12T18:45:26.488 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient: _finish_hunting 0 2024-09-12T18:45:26.488 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:45:25.920+0000 7f2bfb124640 1 monclient: found mon.noname-c 2024-09-12T18:45:26.488 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.489 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.489 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:45:26.489 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: dump: 2024-09-12T18:45:26.489 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.489 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.489 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.489 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.489 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.489 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.489 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.489 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.489 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.489 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.490 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: _finish_auth 0 2024-09-12T18:45:26.490 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:45:26.490 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:45:26.490 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.490 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:45:26.490 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: dump: 2024-09-12T18:45:26.490 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.490 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.490 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.490 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.490 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.490 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.490 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.490 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.491 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.491 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.491 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 monclient: authenticate success, global_id 6050 2024-09-12T18:45:26.491 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:45:26.491 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 4 set_mon_vals no callback set 2024-09-12T18:45:26.491 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: shutdown 2024-09-12T18:45:26.491 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: build_initial_monmap 2024-09-12T18:45:26.491 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:45:26.491 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: monmap: 2024-09-12T18:45:26.491 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:45:26.491 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:45:26.491 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:45:26.491 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:45:26.492 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:45:26.492 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.492 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:45:26.492 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:45:26.492 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:45:26.492 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.492 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding auth protocol: cephx 2024-09-12T18:45:26.492 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding auth protocol: cephx 2024-09-12T18:45:26.492 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding auth protocol: cephx 2024-09-12T18:45:26.492 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: secure 2024-09-12T18:45:26.492 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: crc 2024-09-12T18:45:26.492 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: secure 2024-09-12T18:45:26.492 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: crc 2024-09-12T18:45:26.492 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: secure 2024-09-12T18:45:26.493 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: crc 2024-09-12T18:45:26.493 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: crc 2024-09-12T18:45:26.493 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: secure 2024-09-12T18:45:26.493 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: crc 2024-09-12T18:45:26.493 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: secure 2024-09-12T18:45:26.493 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: crc 2024-09-12T18:45:26.493 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: secure 2024-09-12T18:45:26.493 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.493 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 1 librados: starting msgr at 2024-09-12T18:45:26.493 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 1 librados: starting objecter 2024-09-12T18:45:26.493 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a677188390 EEXIST 2024-09-12T18:45:26.493 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 1 librados: setting wanted keys 2024-09-12T18:45:26.493 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 1 librados: calling monclient init 2024-09-12T18:45:26.494 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: init 2024-09-12T18:45:26.494 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding auth protocol: cephx 2024-09-12T18:45:26.494 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding auth protocol: cephx 2024-09-12T18:45:26.494 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding auth protocol: cephx 2024-09-12T18:45:26.494 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: secure 2024-09-12T18:45:26.494 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: crc 2024-09-12T18:45:26.494 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: secure 2024-09-12T18:45:26.494 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: crc 2024-09-12T18:45:26.494 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: secure 2024-09-12T18:45:26.494 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: crc 2024-09-12T18:45:26.494 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: crc 2024-09-12T18:45:26.494 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: secure 2024-09-12T18:45:26.494 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: crc 2024-09-12T18:45:26.494 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: secure 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: crc 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: secure 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command rotate-key cmddesc rotate-key hook 0x55a677143618 EEXIST 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-b con 0x55a677190950 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-c con 0x55a6771912d0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-a con 0x55a677195560 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:45:26.495 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): authenticate will time out at 2113.063816s 2024-09-12T18:45:26.496 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): get_auth_request con 0x55a6771912d0 auth_method 0 2024-09-12T18:45:26.496 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.496 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.496 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.496 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): get_auth_request con 0x55a677190950 auth_method 0 2024-09-12T18:45:26.496 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.496 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.496 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.496 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.496 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.496 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.496 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): get_auth_request con 0x55a677195560 auth_method 0 2024-09-12T18:45:26.496 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.497 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.497 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.497 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:45:25.924+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.497 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:45:25.924+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.497 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:45:25.924+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.497 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:45:25.924+0000 7f2bfa122640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.497 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:45:25.924+0000 7f2bfa122640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.497 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:45:25.924+0000 7f2bfa122640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.497 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:45:25.924+0000 7f2bfb124640 10 monclient(hunting): handle_auth_done global_id 6053 payload 824 2024-09-12T18:45:26.497 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:45:25.924+0000 7f2bfb124640 10 monclient: _finish_hunting 0 2024-09-12T18:45:26.497 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:45:25.924+0000 7f2bfb124640 1 monclient: found mon.noname-c 2024-09-12T18:45:26.497 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:45:25.924+0000 7f2bfb124640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.497 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.497 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:45:26.498 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: dump: 2024-09-12T18:45:26.498 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.498 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.498 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.498 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.498 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.498 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.498 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.498 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.498 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.498 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.498 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: _finish_auth 0 2024-09-12T18:45:26.498 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: _check_auth_tickets 2024-09-12T18:45:26.499 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:45:26.499 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.499 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:45:26.499 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: dump: 2024-09-12T18:45:26.499 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.499 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.499 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.499 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.499 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.499 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.499 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.499 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.499 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.499 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.500 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:45:25.924+0000 7f2ade7fc640 4 set_mon_vals no callback set 2024-09-12T18:45:26.500 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 5 monclient: authenticate success, global_id 6053 2024-09-12T18:45:26.500 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 10 monclient: _renew_subs 2024-09-12T18:45:26.500 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.500 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 10 monclient: _renew_subs 2024-09-12T18:45:26.500 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.500 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 1 librados: init done 2024-09-12T18:45:26.500 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command cr dump hook 0x55a677186328 2024-09-12T18:45:26.500 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.500 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:45:25.924+0000 7f2adcff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:45:26.500 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:45:25.924+0000 7f2adcff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:45:26.500 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:45:25.924+0000 7f2adcff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:45:26.500 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:45:25.924+0000 7f2bfa122640 10 monclient: get_auth_request con 0x7f2ac4070ae0 auth_method 0 2024-09-12T18:45:26.500 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:45:25.924+0000 7f2bfa923640 10 monclient: get_auth_request con 0x55a6771af120 auth_method 0 2024-09-12T18:45:26.501 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.501 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 realm 2024-09-12T18:45:26.501 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.501 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.501 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:26.501 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.501 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.501 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.501 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:45:25.928+0000 7f2bfa122640 10 monclient: get_auth_request con 0x55a6771b3310 auth_method 0 2024-09-12T18:45:26.501 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:26.501 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.501 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:45:25.928+0000 7f2bfb124640 10 monclient: get_auth_request con 0x55a6771b6b70 auth_method 0 2024-09-12T18:45:26.501 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:26.501 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 searching for the correct realm 2024-09-12T18:45:26.502 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:45:25.928+0000 7f2bfa923640 10 monclient: get_auth_request con 0x7f2bf408f410 auth_method 0 2024-09-12T18:45:26.502 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:45:25.932+0000 7f2bfa122640 10 monclient: get_auth_request con 0x7f2bec037040 auth_method 0 2024-09-12T18:45:26.502 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:45:25.932+0000 7f2bfb124640 10 monclient: get_auth_request con 0x7f2bf00bf030 auth_method 0 2024-09-12T18:45:26.502 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:45:25.932+0000 7f2bfb124640 0 -- 172.21.15.111:0/1902603366 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f2bf00bf030 msgr2=0x7f2bf00fdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:26.502 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:45:26.136+0000 7f2bfb124640 10 monclient: get_auth_request con 0x7f2bf00bf030 auth_method 0 2024-09-12T18:45:26.502 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:45:26.140+0000 7f2bfa923640 10 monclient: get_auth_request con 0x7f2bf4080860 auth_method 0 2024-09-12T18:45:26.502 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:45:26.148+0000 7f2bfa122640 10 monclient: get_auth_request con 0x7f2bf4023b60 auth_method 0 2024-09-12T18:45:26.502 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:45:26.148+0000 7f2bfa122640 0 -- 172.21.15.111:0/1902603366 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f2bf4023b60 msgr2=0x7f2bf4080040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:26.502 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:45:26.352+0000 7f2bfa122640 10 monclient: get_auth_request con 0x7f2bf4023b60 auth_method 0 2024-09-12T18:45:26.502 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:26.502 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:26.502 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:26.502 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:26.503 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:26.503 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:26.503 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.503 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.503 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.503 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:26.503 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.503 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:26.503 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 zone default found 2024-09-12T18:45:26.503 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 4 Realm: () 2024-09-12T18:45:26.503 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:26.503 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:26.503 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:26.503 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 zonegroup default 2024-09-12T18:45:26.504 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.504 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.504 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.504 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.504 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.504 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:45:26.372+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.504 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:45:26.372+0000 7f2bfce1d9c0 20 started sync module instance, tier type = 2024-09-12T18:45:26.504 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:45:26.372+0000 7f2bfce1d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:26.504 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=0 2024-09-12T18:45:26.504 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=1 2024-09-12T18:45:26.504 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=2 2024-09-12T18:45:26.504 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=3 2024-09-12T18:45:26.504 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=4 2024-09-12T18:45:26.504 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=5 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=6 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:45:26.396+0000 7f2bfce1d9c0 20 add_watcher() i=7 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:45:26.396+0000 7f2bfce1d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding auth protocol: cephx 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding auth protocol: cephx 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding auth protocol: cephx 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: secure 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: crc 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: secure 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: crc 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: secure 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: crc 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: crc 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: secure 2024-09-12T18:45:26.505 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: crc 2024-09-12T18:45:26.506 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: secure 2024-09-12T18:45:26.506 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: crc 2024-09-12T18:45:26.506 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: secure 2024-09-12T18:45:26.506 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:45:26.400+0000 7f2ab17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:26.506 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.506 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:26.506 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:26.506 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command cache list hook 0x55a67718bc90 2024-09-12T18:45:26.506 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command cache inspect hook 0x55a67718bc90 2024-09-12T18:45:26.506 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command cache erase hook 0x55a67718bc90 2024-09-12T18:45:26.506 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command cache zap hook 0x55a67718bc90 2024-09-12T18:45:26.506 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 note: GC not initialized 2024-09-12T18:45:26.506 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:45:26.404+0000 7f2a2bfff640 20 reqs_thread_entry: start 2024-09-12T18:45:26.506 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command sync trace show hook 0x7f2bf4005540 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command sync trace history hook 0x7f2bf4005540 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command sync trace active hook 0x7f2bf4005540 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command sync trace active_short hook 0x7f2bf4005540 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 Filter name: none 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:45:26.404+0000 7f2a29ffb640 20 reqs_thread_entry: start 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 : miss 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:45:26.507 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 info.flags=0x17 2024-09-12T18:45:26.508 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 to cache LRU end 2024-09-12T18:45:26.508 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:45:26.508 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:26.508 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 2024-09-12T18:45:26.508 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:45:26.412+0000 7f2bfce1d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2bfce1d9c0 time 2024-09-12T18:45:26.409790+0000 2024-09-12T18:45:26.508 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:45:26.508 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.508 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:45:26.508 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c006f72eb] 2024-09-12T18:45:26.508 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c006f749f] 2024-09-12T18:45:26.508 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6743a0cc1] 2024-09-12T18:45:26.508 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1421f32) [0x55a674dfdf32] 2024-09-12T18:45:26.509 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6743b5ced] 2024-09-12T18:45:26.509 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:45:26.509 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bff55dd90] 2024-09-12T18:45:26.509 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:45:26.509 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:45:26.509 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.509 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:45:26.412+0000 7f2bfce1d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:45:26.509 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f2bfce1d9c0 thread_name:radosgw-admin 2024-09-12T18:45:26.509 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.509 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:45:26.509 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2bff576520] 2024-09-12T18:45:26.509 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:45:26.509 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:45:26.509 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:45:26.510 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c006f7345] 2024-09-12T18:45:26.510 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c006f749f] 2024-09-12T18:45:26.510 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6743a0cc1] 2024-09-12T18:45:26.510 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1421f32) [0x55a674dfdf32] 2024-09-12T18:45:26.510 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6743b5ced] 2024-09-12T18:45:26.510 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:45:26.510 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bff55dd90] 2024-09-12T18:45:26.510 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:45:26.510 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:45:26.510 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:45:26.510 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.510 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:45:26.510 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:45:26.510 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:45:26.511 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:45:26.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:45:26.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:45:26.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:45:26.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:45:26.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:45:26.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:45:26.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:45:26.511 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:45:26.511 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:45:26.511 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:45:26.511 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:45:26.511 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:45:26.511 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:45:26.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:45:26.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:45:26.513 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:45:26.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:45:26.513 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:45:26.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:45:26.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:45:26.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:45:26.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:45:26.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:45:26.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:45:26.513 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:45:26.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:45:26.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:45:26.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:45:26.514 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:45:26.514 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:45:26.514 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:45:26.514 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:45:26.514 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:45:26.514 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:45:26.514 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:45:26.514 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:45:26.514 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:45:26.514 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:45:26.514 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:45:26.514 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:45:26.514 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:45:26.514 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:45:26.515 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:45:26.516 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:45:26.516 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:45:26.516 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:45:26.516 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:45:26.516 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:45:26.516 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:45:26.516 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:45:26.516 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:45:26.516 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:45:26.516 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:45:26.516 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:45:26.516 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:45:26.516 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:45:26.516 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2a29ffb640 / http_manager 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2a2bfff640 / http_manager 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2ab17e2640 / rgw_dt_lg_renew 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2adcff9640 / ms_dispatch 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2ade7fc640 / io_context_pool 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2ae4e01640 / ms_dispatch 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2ae7606640 / ms_dispatch 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2ae8e09640 / io_context_pool 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2bfa122640 / msgr-worker-2 2024-09-12T18:45:26.517 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2bfa923640 / msgr-worker-1 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2bfb124640 / msgr-worker-0 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2bfb925640 / io_context_pool 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2bfce1d9c0 / radosgw-admin 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/log/ceph/ceph-client.admin.83563.log 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:45:25.900+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:45:25.900+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:45:25.900+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:45:25.900+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:45:25.900+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:45:25.900+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.518 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:45:25.900+0000 7f2bfa923640 10 monclient(hunting): handle_auth_done global_id 6041 payload 274 2024-09-12T18:45:26.519 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:45:25.900+0000 7f2bfa923640 10 monclient: _finish_hunting 0 2024-09-12T18:45:26.519 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:45:25.900+0000 7f2bfa923640 1 monclient: found mon.noname-c 2024-09-12T18:45:26.519 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:45:25.900+0000 7f2bfa923640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.519 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.519 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:45:26.519 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: dump: 2024-09-12T18:45:26.519 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.519 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.519 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.519 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.520 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.520 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.520 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.520 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.520 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.520 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.520 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: _finish_auth 0 2024-09-12T18:45:26.520 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: _check_auth_tickets 2024-09-12T18:45:26.520 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:45:26.520 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.520 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:45:26.520 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:45:25.900+0000 7f2ae8e09640 10 monclient: dump: 2024-09-12T18:45:26.520 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.521 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.521 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.521 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.521 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.521 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.521 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.521 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.521 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.521 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.521 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 monclient: authenticate success, global_id 6041 2024-09-12T18:45:26.521 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:45:26.522 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 4 set_mon_vals no callback set 2024-09-12T18:45:26.522 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 10 monclient: shutdown 2024-09-12T18:45:26.522 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) unregister_commands rotate-key 2024-09-12T18:45:26.522 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 10 monclient: build_initial_monmap 2024-09-12T18:45:26.522 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:45:26.522 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 10 monclient: monmap: 2024-09-12T18:45:26.522 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:45:26.522 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:45:26.522 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:45:26.522 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:45:26.522 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:45:26.522 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.522 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:45:26.522 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:45:26.523 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:45:26.523 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.523 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding auth protocol: cephx 2024-09-12T18:45:26.523 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding auth protocol: cephx 2024-09-12T18:45:26.523 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding auth protocol: cephx 2024-09-12T18:45:26.523 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: secure 2024-09-12T18:45:26.523 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: crc 2024-09-12T18:45:26.523 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: secure 2024-09-12T18:45:26.523 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: crc 2024-09-12T18:45:26.523 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: secure 2024-09-12T18:45:26.523 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: crc 2024-09-12T18:45:26.523 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: crc 2024-09-12T18:45:26.523 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: secure 2024-09-12T18:45:26.524 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: crc 2024-09-12T18:45:26.524 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: secure 2024-09-12T18:45:26.524 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: crc 2024-09-12T18:45:26.524 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c7fa0) adding con mode: secure 2024-09-12T18:45:26.524 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.524 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 1 librados: starting msgr at 2024-09-12T18:45:26.524 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 1 librados: starting objecter 2024-09-12T18:45:26.524 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command objecter_requests hook 0x55a676eabdf0 2024-09-12T18:45:26.524 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 1 librados: setting wanted keys 2024-09-12T18:45:26.524 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 1 librados: calling monclient init 2024-09-12T18:45:26.524 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 10 monclient: init 2024-09-12T18:45:26.524 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding auth protocol: cephx 2024-09-12T18:45:26.524 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding auth protocol: cephx 2024-09-12T18:45:26.524 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding auth protocol: cephx 2024-09-12T18:45:26.525 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: secure 2024-09-12T18:45:26.525 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: crc 2024-09-12T18:45:26.525 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: secure 2024-09-12T18:45:26.525 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: crc 2024-09-12T18:45:26.525 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: secure 2024-09-12T18:45:26.525 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: crc 2024-09-12T18:45:26.525 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: crc 2024-09-12T18:45:26.525 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: secure 2024-09-12T18:45:26.525 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: crc 2024-09-12T18:45:26.525 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: secure 2024-09-12T18:45:26.525 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: crc 2024-09-12T18:45:26.525 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:45:25.900+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6770c2a50) adding con mode: secure 2024-09-12T18:45:26.525 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.526 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.526 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command rotate-key hook 0x55a6770c2b98 2024-09-12T18:45:26.526 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:45:26.526 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:45:26.526 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-b con 0x55a676f73310 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:45:26.526 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-c con 0x55a677008c40 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:45:26.526 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-a con 0x55a67700bb30 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:45:26.526 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.526 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.526 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.526 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:45:26.526 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient(hunting): authenticate will time out at 2113.044740s 2024-09-12T18:45:26.526 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): get_auth_request con 0x55a677008c40 auth_method 0 2024-09-12T18:45:26.526 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.527 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.527 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.527 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:45:25.904+0000 7f2bfb124640 10 monclient(hunting): get_auth_request con 0x55a67700bb30 auth_method 0 2024-09-12T18:45:26.527 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:45:25.904+0000 7f2bfb124640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.527 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:45:25.904+0000 7f2bfb124640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.527 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:45:25.904+0000 7f2bfb124640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.527 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.527 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.527 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.527 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:45:25.904+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.527 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:45:25.904+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.527 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:45:25.904+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.527 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient(hunting): handle_auth_done global_id 6044 payload 824 2024-09-12T18:45:26.527 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient: _finish_hunting 0 2024-09-12T18:45:26.528 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:45:25.904+0000 7f2bfa122640 1 monclient: found mon.noname-c 2024-09-12T18:45:26.528 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:45:25.904+0000 7f2bfa122640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.528 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:45:25.904+0000 7f2bfa923640 10 monclient: get_auth_request con 0x55a676f73310 auth_method 0 2024-09-12T18:45:26.528 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.528 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:45:26.528 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: dump: 2024-09-12T18:45:26.528 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.528 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.528 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.528 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.528 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.528 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.528 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.528 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.529 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.529 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.529 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: _finish_auth 0 2024-09-12T18:45:26.529 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: _check_auth_tickets 2024-09-12T18:45:26.529 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 5 monclient: authenticate success, global_id 6044 2024-09-12T18:45:26.532 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient: _renew_subs 2024-09-12T18:45:26.532 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.532 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:45:26.532 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.532 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:45:26.532 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:45:25.904+0000 7f2ae7606640 10 monclient: dump: 2024-09-12T18:45:26.532 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.532 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.532 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.532 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.532 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.533 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.533 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.533 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.533 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.533 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.533 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:45:25.904+0000 7f2ae8e09640 4 set_mon_vals no callback set 2024-09-12T18:45:26.533 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient: _renew_subs 2024-09-12T18:45:26.533 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.533 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:45:25.904+0000 7f2bfce1d9c0 1 librados: init done 2024-09-12T18:45:26.533 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:45:25.904+0000 7f2ae7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:45:26.533 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:45:25.904+0000 7f2ae7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:45:26.533 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:45:25.904+0000 7f2ae7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:45:26.533 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:45:25.904+0000 7f2bfa923640 10 monclient: get_auth_request con 0x7f2ae0070ae0 auth_method 0 2024-09-12T18:45:26.533 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:45:25.908+0000 7f2bfb124640 10 monclient: get_auth_request con 0x55a67710a660 auth_method 0 2024-09-12T18:45:26.534 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:45:25.908+0000 7f2bfa923640 10 monclient: get_auth_request con 0x55a67710d610 auth_method 0 2024-09-12T18:45:26.534 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:45:25.908+0000 7f2bfa122640 10 monclient: get_auth_request con 0x55a6771119c0 auth_method 0 2024-09-12T18:45:26.534 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:45:25.912+0000 7f2bfb124640 10 monclient: get_auth_request con 0x55a677110ea0 auth_method 0 2024-09-12T18:45:26.534 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient: build_initial_monmap 2024-09-12T18:45:26.534 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:45:26.534 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient: monmap: 2024-09-12T18:45:26.534 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:45:26.534 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:45:26.534 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:45:26.534 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:45:26.534 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:45:26.534 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.534 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:45:26.534 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding auth protocol: cephx 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding auth protocol: cephx 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding auth protocol: cephx 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: secure 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: crc 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: secure 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: crc 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: secure 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: crc 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: crc 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: secure 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: crc 2024-09-12T18:45:26.535 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: secure 2024-09-12T18:45:26.536 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: crc 2024-09-12T18:45:26.536 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677119bc0) adding con mode: secure 2024-09-12T18:45:26.536 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.536 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a67711d500 EEXIST 2024-09-12T18:45:26.536 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient: init 2024-09-12T18:45:26.536 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding auth protocol: cephx 2024-09-12T18:45:26.536 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding auth protocol: cephx 2024-09-12T18:45:26.536 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding auth protocol: cephx 2024-09-12T18:45:26.536 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: secure 2024-09-12T18:45:26.536 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: crc 2024-09-12T18:45:26.536 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: secure 2024-09-12T18:45:26.536 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: crc 2024-09-12T18:45:26.536 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: secure 2024-09-12T18:45:26.536 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: crc 2024-09-12T18:45:26.537 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: crc 2024-09-12T18:45:26.537 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: secure 2024-09-12T18:45:26.537 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: crc 2024-09-12T18:45:26.537 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: secure 2024-09-12T18:45:26.537 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: crc 2024-09-12T18:45:26.537 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677118a18) adding con mode: secure 2024-09-12T18:45:26.537 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.537 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.537 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command rotate-key cmddesc rotate-key hook 0x55a677118b60 EEXIST 2024-09-12T18:45:26.537 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:45:26.537 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:45:26.537 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-b con 0x55a6771416b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:45:26.537 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-c con 0x55a677140fe0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:45:26.537 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-a con 0x55a67713f9c0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:45:26.538 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.538 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.538 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.538 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:45:26.538 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:45:25.912+0000 7f2bfce1d9c0 10 monclient(hunting): authenticate will time out at 2113.055855s 2024-09-12T18:45:26.538 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:45:25.912+0000 7f2bfb124640 10 monclient(hunting): get_auth_request con 0x55a677140fe0 auth_method 0 2024-09-12T18:45:26.538 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:45:25.912+0000 7f2bfb124640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.538 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:45:25.912+0000 7f2bfb124640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.538 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:45:25.912+0000 7f2bfb124640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.538 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:45:25.916+0000 7f2bfa923640 10 monclient(hunting): get_auth_request con 0x55a67713f9c0 auth_method 0 2024-09-12T18:45:26.538 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:45:25.916+0000 7f2bfa923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.538 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:45:25.916+0000 7f2bfa923640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.538 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:45:25.916+0000 7f2bfa923640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.538 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:45:25.916+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.539 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:45:25.916+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.539 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:45:25.916+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.539 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:45:25.916+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.539 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:45:25.916+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.539 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:45:25.916+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.539 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:45:25.916+0000 7f2bfa122640 10 monclient(hunting): get_auth_request con 0x55a6771416b0 auth_method 0 2024-09-12T18:45:26.539 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:45:25.916+0000 7f2bfa122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.539 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:45:25.916+0000 7f2bfa122640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.539 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:45:25.916+0000 7f2bfa122640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.539 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:45:25.916+0000 7f2bfb124640 10 monclient(hunting): handle_auth_done global_id 6047 payload 824 2024-09-12T18:45:26.539 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:45:25.916+0000 7f2bfb124640 10 monclient: _finish_hunting 0 2024-09-12T18:45:26.539 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:45:25.916+0000 7f2bfb124640 1 monclient: found mon.noname-c 2024-09-12T18:45:26.539 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:45:25.916+0000 7f2bfb124640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.539 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: dump: 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: _finish_auth 0 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: _check_auth_tickets 2024-09-12T18:45:26.540 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:45:26.541 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.541 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:45:26.541 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 10 monclient: dump: 2024-09-12T18:45:26.541 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.541 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.541 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.541 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.541 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.541 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.541 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.541 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.541 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.541 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.541 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 monclient: authenticate success, global_id 6047 2024-09-12T18:45:26.542 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:45:25.916+0000 7f2bfb925640 4 set_mon_vals no callback set 2024-09-12T18:45:26.542 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: _renew_subs 2024-09-12T18:45:26.542 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.542 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: _renew_subs 2024-09-12T18:45:26.542 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.542 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:45:26.542 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:45:26.542 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:45:25.916+0000 7f2ae4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:45:26.542 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:45:25.916+0000 7f2bfa122640 10 monclient: get_auth_request con 0x7f2ad4070a20 auth_method 0 2024-09-12T18:45:26.542 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: get_monmap_and_config 2024-09-12T18:45:26.542 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: build_initial_monmap 2024-09-12T18:45:26.542 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:45:26.542 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: monmap: 2024-09-12T18:45:26.542 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:45:26.543 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:45:26.543 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:45:26.543 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:45:26.543 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:45:26.543 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.543 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:45:26.543 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:45:26.543 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:45:26.543 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.543 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding auth protocol: cephx 2024-09-12T18:45:26.543 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding auth protocol: cephx 2024-09-12T18:45:26.543 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding auth protocol: cephx 2024-09-12T18:45:26.543 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: secure 2024-09-12T18:45:26.543 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: crc 2024-09-12T18:45:26.544 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: secure 2024-09-12T18:45:26.544 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: crc 2024-09-12T18:45:26.544 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: secure 2024-09-12T18:45:26.544 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: crc 2024-09-12T18:45:26.544 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: crc 2024-09-12T18:45:26.544 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: secure 2024-09-12T18:45:26.544 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: crc 2024-09-12T18:45:26.544 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: secure 2024-09-12T18:45:26.544 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: crc 2024-09-12T18:45:26.544 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677161060) adding con mode: secure 2024-09-12T18:45:26.544 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.544 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 10 monclient: init 2024-09-12T18:45:26.544 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding auth protocol: cephx 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding auth protocol: cephx 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding auth protocol: cephx 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: secure 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: crc 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: secure 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: crc 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: secure 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: crc 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: crc 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: secure 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: crc 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: secure 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: crc 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:45:25.916+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52bc50) adding con mode: secure 2024-09-12T18:45:26.545 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.546 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.546 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command rotate-key cmddesc rotate-key hook 0x7ffdba52bd98 EEXIST 2024-09-12T18:45:26.546 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:45:26.546 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:45:26.546 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-b con 0x55a677195560 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:45:26.546 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-c con 0x55a677190950 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:45:26.546 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-a con 0x55a6771912d0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:45:26.546 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.546 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.546 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.546 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:45:26.546 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): authenticate will time out at 2113.060799s 2024-09-12T18:45:26.546 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): get_auth_request con 0x55a677190950 auth_method 0 2024-09-12T18:45:26.546 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.547 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.547 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.547 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): get_auth_request con 0x55a6771912d0 auth_method 0 2024-09-12T18:45:26.547 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.547 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.547 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.547 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.547 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.547 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.547 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): get_auth_request con 0x55a677195560 auth_method 0 2024-09-12T18:45:26.547 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.547 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.547 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.547 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): handle_auth_done global_id 6050 payload 274 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient: _finish_hunting 0 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:45:25.920+0000 7f2bfb124640 1 monclient: found mon.noname-c 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: dump: 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.548 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.549 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.549 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.549 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.549 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.549 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: _finish_auth 0 2024-09-12T18:45:26.549 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:45:26.549 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:45:26.549 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.549 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:45:26.549 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:45:25.920+0000 7f2ade7fc640 10 monclient: dump: 2024-09-12T18:45:26.549 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.549 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.549 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.549 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.550 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.550 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.550 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.550 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.550 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.550 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.550 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 monclient: authenticate success, global_id 6050 2024-09-12T18:45:26.550 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:45:26.550 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 4 set_mon_vals no callback set 2024-09-12T18:45:26.550 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: shutdown 2024-09-12T18:45:26.550 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: build_initial_monmap 2024-09-12T18:45:26.550 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:45:26.550 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: monmap: 2024-09-12T18:45:26.550 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:45:26.551 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:45:26.551 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:45:26.551 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:45:26.551 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:45:26.551 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.551 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:45:26.551 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:45:26.551 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:45:26.551 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.551 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding auth protocol: cephx 2024-09-12T18:45:26.551 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding auth protocol: cephx 2024-09-12T18:45:26.551 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding auth protocol: cephx 2024-09-12T18:45:26.551 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: secure 2024-09-12T18:45:26.551 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: crc 2024-09-12T18:45:26.552 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: secure 2024-09-12T18:45:26.552 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: crc 2024-09-12T18:45:26.552 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: secure 2024-09-12T18:45:26.552 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: crc 2024-09-12T18:45:26.552 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: crc 2024-09-12T18:45:26.552 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: secure 2024-09-12T18:45:26.552 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: crc 2024-09-12T18:45:26.552 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: secure 2024-09-12T18:45:26.552 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: crc 2024-09-12T18:45:26.552 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a677187ba0) adding con mode: secure 2024-09-12T18:45:26.552 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.552 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 1 librados: starting msgr at 2024-09-12T18:45:26.552 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 1 librados: starting objecter 2024-09-12T18:45:26.553 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a677188390 EEXIST 2024-09-12T18:45:26.553 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 1 librados: setting wanted keys 2024-09-12T18:45:26.553 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 1 librados: calling monclient init 2024-09-12T18:45:26.553 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: init 2024-09-12T18:45:26.553 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding auth protocol: cephx 2024-09-12T18:45:26.553 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding auth protocol: cephx 2024-09-12T18:45:26.553 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding auth protocol: cephx 2024-09-12T18:45:26.553 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: secure 2024-09-12T18:45:26.553 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: crc 2024-09-12T18:45:26.553 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: secure 2024-09-12T18:45:26.553 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: crc 2024-09-12T18:45:26.553 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: secure 2024-09-12T18:45:26.553 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: crc 2024-09-12T18:45:26.554 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: crc 2024-09-12T18:45:26.554 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: secure 2024-09-12T18:45:26.554 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: crc 2024-09-12T18:45:26.554 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: secure 2024-09-12T18:45:26.554 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: crc 2024-09-12T18:45:26.554 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 AuthRegistry(0x55a6771434d0) adding con mode: secure 2024-09-12T18:45:26.554 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.554 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.554 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command rotate-key cmddesc rotate-key hook 0x55a677143618 EEXIST 2024-09-12T18:45:26.554 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:45:26.554 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:45:26.554 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-b con 0x55a677190950 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:45:26.554 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-c con 0x55a6771912d0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:45:26.554 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): picked mon.noname-a con 0x55a677195560 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:45:26.555 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.555 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.555 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:45:26.555 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:45:26.555 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:45:25.920+0000 7f2bfce1d9c0 10 monclient(hunting): authenticate will time out at 2113.063816s 2024-09-12T18:45:26.555 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): get_auth_request con 0x55a6771912d0 auth_method 0 2024-09-12T18:45:26.555 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.555 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.555 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.555 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): get_auth_request con 0x55a677190950 auth_method 0 2024-09-12T18:45:26.555 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.555 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.555 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:45:25.920+0000 7f2bfa122640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.555 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.556 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.556 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:45:25.920+0000 7f2bfb124640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.556 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): get_auth_request con 0x55a677195560 auth_method 0 2024-09-12T18:45:26.556 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:45:26.556 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:45:26.556 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:45:25.920+0000 7f2bfa923640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:45:26.556 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:45:25.924+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.556 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:45:25.924+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.556 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:45:25.924+0000 7f2bfa923640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.556 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:45:25.924+0000 7f2bfa122640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:45:26.556 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:45:25.924+0000 7f2bfa122640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:45:26.556 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:45:25.924+0000 7f2bfa122640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:45:26.556 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:45:25.924+0000 7f2bfb124640 10 monclient(hunting): handle_auth_done global_id 6053 payload 824 2024-09-12T18:45:26.556 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:45:25.924+0000 7f2bfb124640 10 monclient: _finish_hunting 0 2024-09-12T18:45:26.557 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:45:25.924+0000 7f2bfb124640 1 monclient: found mon.noname-c 2024-09-12T18:45:26.557 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:45:25.924+0000 7f2bfb124640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.557 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.557 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:45:26.557 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: dump: 2024-09-12T18:45:26.557 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.557 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.557 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.557 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.557 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.557 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.557 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.557 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.558 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.558 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.558 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: _finish_auth 0 2024-09-12T18:45:26.558 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: _check_auth_tickets 2024-09-12T18:45:26.558 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:45:26.558 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:45:26.558 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:45:26.558 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:45:25.924+0000 7f2adcff9640 10 monclient: dump: 2024-09-12T18:45:26.558 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:45:26.558 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:45:26.558 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.558 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:45:26.558 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:45:26.558 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:45:25.924+0000 7f2ade7fc640 4 set_mon_vals no callback set 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 5 monclient: authenticate success, global_id 6053 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 10 monclient: _renew_subs 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 10 monclient: _renew_subs 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 1 librados: init done 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command cr dump hook 0x55a677186328 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:45:25.924+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:45:25.924+0000 7f2adcff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:45:26.559 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:45:25.924+0000 7f2adcff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:45:26.560 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:45:25.924+0000 7f2adcff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:45:26.560 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:45:25.924+0000 7f2bfa122640 10 monclient: get_auth_request con 0x7f2ac4070ae0 auth_method 0 2024-09-12T18:45:26.560 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:45:25.924+0000 7f2bfa923640 10 monclient: get_auth_request con 0x55a6771af120 auth_method 0 2024-09-12T18:45:26.560 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.560 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 realm 2024-09-12T18:45:26.560 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.560 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.560 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:26.560 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.560 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.560 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.560 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:45:25.928+0000 7f2bfa122640 10 monclient: get_auth_request con 0x55a6771b3310 auth_method 0 2024-09-12T18:45:26.560 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:26.561 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.561 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:45:25.928+0000 7f2bfb124640 10 monclient: get_auth_request con 0x55a6771b6b70 auth_method 0 2024-09-12T18:45:26.561 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:26.561 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:45:25.928+0000 7f2bfce1d9c0 20 searching for the correct realm 2024-09-12T18:45:26.561 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:45:25.928+0000 7f2bfa923640 10 monclient: get_auth_request con 0x7f2bf408f410 auth_method 0 2024-09-12T18:45:26.561 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:45:25.932+0000 7f2bfa122640 10 monclient: get_auth_request con 0x7f2bec037040 auth_method 0 2024-09-12T18:45:26.561 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:45:25.932+0000 7f2bfb124640 10 monclient: get_auth_request con 0x7f2bf00bf030 auth_method 0 2024-09-12T18:45:26.561 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:45:25.932+0000 7f2bfb124640 0 -- 172.21.15.111:0/1902603366 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f2bf00bf030 msgr2=0x7f2bf00fdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:26.561 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:45:26.136+0000 7f2bfb124640 10 monclient: get_auth_request con 0x7f2bf00bf030 auth_method 0 2024-09-12T18:45:26.561 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:45:26.140+0000 7f2bfa923640 10 monclient: get_auth_request con 0x7f2bf4080860 auth_method 0 2024-09-12T18:45:26.561 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:45:26.148+0000 7f2bfa122640 10 monclient: get_auth_request con 0x7f2bf4023b60 auth_method 0 2024-09-12T18:45:26.561 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:45:26.148+0000 7f2bfa122640 0 -- 172.21.15.111:0/1902603366 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f2bf4023b60 msgr2=0x7f2bf4080040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:26.561 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:45:26.352+0000 7f2bfa122640 10 monclient: get_auth_request con 0x7f2bf4023b60 auth_method 0 2024-09-12T18:45:26.561 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:45:26.364+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 zone default found 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 4 Realm: () 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:26.562 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:26.563 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:26.563 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 zonegroup default 2024-09-12T18:45:26.563 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.563 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.563 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.563 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.563 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:45:26.368+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.563 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:45:26.372+0000 7f2bfce1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.563 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:45:26.372+0000 7f2bfce1d9c0 20 started sync module instance, tier type = 2024-09-12T18:45:26.563 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:45:26.372+0000 7f2bfce1d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:26.563 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=0 2024-09-12T18:45:26.563 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=1 2024-09-12T18:45:26.563 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=2 2024-09-12T18:45:26.564 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=3 2024-09-12T18:45:26.564 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=4 2024-09-12T18:45:26.564 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=5 2024-09-12T18:45:26.564 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:45:26.392+0000 7f2bfce1d9c0 20 add_watcher() i=6 2024-09-12T18:45:26.564 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:45:26.396+0000 7f2bfce1d9c0 20 add_watcher() i=7 2024-09-12T18:45:26.564 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:45:26.396+0000 7f2bfce1d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:26.564 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding auth protocol: cephx 2024-09-12T18:45:26.564 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding auth protocol: cephx 2024-09-12T18:45:26.564 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding auth protocol: cephx 2024-09-12T18:45:26.564 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: secure 2024-09-12T18:45:26.564 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: crc 2024-09-12T18:45:26.564 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: secure 2024-09-12T18:45:26.564 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: crc 2024-09-12T18:45:26.564 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: secure 2024-09-12T18:45:26.565 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: crc 2024-09-12T18:45:26.565 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: crc 2024-09-12T18:45:26.565 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: secure 2024-09-12T18:45:26.565 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: crc 2024-09-12T18:45:26.565 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: secure 2024-09-12T18:45:26.565 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: crc 2024-09-12T18:45:26.565 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 AuthRegistry(0x7ffdba52c130) adding con mode: secure 2024-09-12T18:45:26.565 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:45:26.400+0000 7f2ab17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:26.565 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:45:26.565 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:26.565 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:26.565 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command cache list hook 0x55a67718bc90 2024-09-12T18:45:26.565 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command cache inspect hook 0x55a67718bc90 2024-09-12T18:45:26.565 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command cache erase hook 0x55a67718bc90 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command cache zap hook 0x55a67718bc90 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:45:26.400+0000 7f2bfce1d9c0 5 note: GC not initialized 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:45:26.404+0000 7f2a2bfff640 20 reqs_thread_entry: start 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command sync trace show hook 0x7f2bf4005540 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command sync trace history hook 0x7f2bf4005540 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command sync trace active hook 0x7f2bf4005540 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 5 asok(0x55a676eb82b0) register_command sync trace active_short hook 0x7f2bf4005540 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 Filter name: none 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:45:26.404+0000 7f2a29ffb640 20 reqs_thread_entry: start 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:45:26.566 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:45:26.567 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 : miss 2024-09-12T18:45:26.567 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.567 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:45:26.567 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 info.flags=0x17 2024-09-12T18:45:26.567 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 to cache LRU end 2024-09-12T18:45:26.567 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:45:26.567 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:26.567 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:45:26.404+0000 7f2bfce1d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 2024-09-12T18:45:26.567 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:45:26.412+0000 7f2bfce1d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2bfce1d9c0 time 2024-09-12T18:45:26.409790+0000 2024-09-12T18:45:26.567 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:45:26.567 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.567 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:45:26.567 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2c006f72eb] 2024-09-12T18:45:26.567 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c006f749f] 2024-09-12T18:45:26.568 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6743a0cc1] 2024-09-12T18:45:26.568 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1421f32) [0x55a674dfdf32] 2024-09-12T18:45:26.568 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6743b5ced] 2024-09-12T18:45:26.568 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:45:26.568 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bff55dd90] 2024-09-12T18:45:26.568 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:45:26.568 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:45:26.568 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.568 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:45:26.412+0000 7f2bfce1d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:45:26.568 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f2bfce1d9c0 thread_name:radosgw-admin 2024-09-12T18:45:26.568 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.568 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:45:26.568 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2bff576520] 2024-09-12T18:45:26.568 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:45:26.569 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:45:26.569 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:45:26.569 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2c006f7345] 2024-09-12T18:45:26.569 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2c006f749f] 2024-09-12T18:45:26.569 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6743a0cc1] 2024-09-12T18:45:26.569 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1421f32) [0x55a674dfdf32] 2024-09-12T18:45:26.569 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a6743b5ced] 2024-09-12T18:45:26.569 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:45:26.569 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2bff55dd90] 2024-09-12T18:45:26.569 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:45:26.569 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:45:26.569 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:45:26.569 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.569 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:45:26.570 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:45:26.571 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:45:26.571 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:45:26.571 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:45:26.571 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:45:26.571 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:45:26.571 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:45:26.571 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:45:26.571 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:45:26.571 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:45:26.571 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:45:26.571 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:45:26.572 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:45:26.572 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:45:26.572 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:45:26.572 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:45:26.572 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:45:26.572 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:45:26.572 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:45:26.572 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:45:26.572 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:45:26.572 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:45:26.572 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:45:26.572 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:45:26.572 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:45:26.573 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:45:26.574 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:45:26.574 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:45:26.574 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:45:26.574 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:45:26.574 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:45:26.574 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:45:26.574 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:45:26.574 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:45:26.574 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:45:26.574 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:45:26.574 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:45:26.574 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:45:26.574 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:45:26.574 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:45:26.575 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:45:26.576 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:45:26.576 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:45:26.576 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:45:26.576 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:45:26.576 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:45:26.576 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:45:26.576 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:45:26.576 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:45:26.576 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:45:26.576 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:45:26.577 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2a29ffb640 / http_manager 2024-09-12T18:45:26.577 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2a2bfff640 / http_manager 2024-09-12T18:45:26.577 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2ab17e2640 / rgw_dt_lg_renew 2024-09-12T18:45:26.577 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2adcff9640 / ms_dispatch 2024-09-12T18:45:26.577 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2ade7fc640 / io_context_pool 2024-09-12T18:45:26.577 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2ae4e01640 / ms_dispatch 2024-09-12T18:45:26.577 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2ae7606640 / ms_dispatch 2024-09-12T18:45:26.577 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2ae8e09640 / io_context_pool 2024-09-12T18:45:26.577 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2bfa122640 / msgr-worker-2 2024-09-12T18:45:26.577 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2bfa923640 / msgr-worker-1 2024-09-12T18:45:26.577 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2bfb124640 / msgr-worker-0 2024-09-12T18:45:26.577 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2bfb925640 / io_context_pool 2024-09-12T18:45:26.577 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2bfce1d9c0 / radosgw-admin 2024-09-12T18:45:26.577 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:45:26.578 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:45:26.578 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:45:26.416677Z_fa8dade3-7a99-4db0-806e-e03958233666/log 2024-09-12T18:45:26.578 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:45:26.578 INFO:tasks.workunit.client.0.smithi111.stderr:Aborted 2024-09-12T18:45:26.578 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T18:45:26.579 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:26.579 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:26.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.508+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.508+0000 7f51501739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.508+0000 7f51501739c0 20 realm 2024-09-12T18:45:26.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.508+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.508+0000 7f51501739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.508+0000 7f51501739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:26.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.508+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.508+0000 7f51501739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.508+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.512+0000 7f51501739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:26.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.512+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.512+0000 7f51501739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:26.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.512+0000 7f51501739c0 20 searching for the correct realm 2024-09-12T18:45:26.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.516+0000 7f514e47a640 0 -- 172.21.15.111:0/795800781 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f5144101040 msgr2=0x7f5144119aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:45:26.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.524+0000 7f514d478640 0 -- 172.21.15.111:0/795800781 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f5148043930 msgr2=0x7f514800c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:45:26.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.740+0000 7f51501739c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:26.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.740+0000 7f51501739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:26.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.740+0000 7f51501739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:26.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.740+0000 7f51501739c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:26.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.740+0000 7f51501739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:26.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.740+0000 7f51501739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:26.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.740+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:26.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:26.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 20 zone default found 2024-09-12T18:45:26.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 4 Realm: () 2024-09-12T18:45:26.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:26.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:26.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:26.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 20 zonegroup default 2024-09-12T18:45:26.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.744+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.748+0000 7f51501739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.748+0000 7f51501739c0 20 started sync module instance, tier type = 2024-09-12T18:45:26.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.748+0000 7f51501739c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:26.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.772+0000 7f51501739c0 20 add_watcher() i=0 2024-09-12T18:45:26.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.772+0000 7f51501739c0 20 add_watcher() i=1 2024-09-12T18:45:26.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.772+0000 7f51501739c0 20 add_watcher() i=2 2024-09-12T18:45:26.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.772+0000 7f51501739c0 20 add_watcher() i=3 2024-09-12T18:45:26.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.772+0000 7f51501739c0 20 add_watcher() i=4 2024-09-12T18:45:26.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.772+0000 7f51501739c0 20 add_watcher() i=5 2024-09-12T18:45:26.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.772+0000 7f51501739c0 20 add_watcher() i=6 2024-09-12T18:45:26.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.772+0000 7f51501739c0 20 add_watcher() i=7 2024-09-12T18:45:26.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.772+0000 7f51501739c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:26.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.776+0000 7f4fff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:26.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.776+0000 7f51501739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:26.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.776+0000 7f51501739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:26.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.776+0000 7f51501739c0 5 note: GC not initialized 2024-09-12T18:45:26.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.780+0000 7f4ffe7fc640 20 reqs_thread_entry: start 2024-09-12T18:45:26.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.780+0000 7f51501739c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:26.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.780+0000 7f51501739c0 20 Filter name: none 2024-09-12T18:45:26.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.780+0000 7f4f6ffff640 20 reqs_thread_entry: start 2024-09-12T18:45:26.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.780+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.780+0000 7f51501739c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:45:26.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.780+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.780+0000 7f51501739c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:45:26.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.780+0000 7f51501739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:26.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.780+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.780+0000 7f51501739c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:45:26.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.780+0000 7f51501739c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.780+0000 7f51501739c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:45:26.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.780+0000 7f51501739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:26.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.784+0000 7f4fff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:26.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.788+0000 7f51501739c0 20 remove_watcher() i=0 2024-09-12T18:45:26.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.788+0000 7f51501739c0 2 removed watcher, disabling cache 2024-09-12T18:45:26.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.792+0000 7f51501739c0 20 remove_watcher() i=1 2024-09-12T18:45:26.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.792+0000 7f51501739c0 20 remove_watcher() i=2 2024-09-12T18:45:26.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.796+0000 7f51501739c0 20 remove_watcher() i=3 2024-09-12T18:45:26.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.796+0000 7f51501739c0 20 remove_watcher() i=4 2024-09-12T18:45:26.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.800+0000 7f51501739c0 20 remove_watcher() i=5 2024-09-12T18:45:26.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.800+0000 7f51501739c0 20 remove_watcher() i=6 2024-09-12T18:45:26.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.800+0000 7f51501739c0 20 remove_watcher() i=7 2024-09-12T18:45:26.818 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.818 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:45:26.818 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-init-indext id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:45:26.818 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:26.819 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:26.819 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:26.832 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:26.832 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:26.877 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:45:26.912 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:26.912 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:26.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.956+0000 7f44e48b39c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.960+0000 7f44e48b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.960+0000 7f44e48b39c0 20 realm 2024-09-12T18:45:26.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.960+0000 7f44e48b39c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.960+0000 7f44e48b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.960+0000 7f44e48b39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:26.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.960+0000 7f44e48b39c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.960+0000 7f44e48b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:26.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.960+0000 7f44e48b39c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.960+0000 7f44e48b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:26.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.960+0000 7f44e48b39c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:26.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.960+0000 7f44e48b39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:26.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.960+0000 7f44e48b39c0 20 searching for the correct realm 2024-09-12T18:45:26.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:26.964+0000 7f44e2bba640 0 -- 172.21.15.111:0/1810413063 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f44d80be070 msgr2=0x7f44d812baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:27.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.180+0000 7f44e1bb8640 0 -- 172.21.15.111:0/1810413063 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f44dc008040 msgr2=0x7f44dc057440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:45:27.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.396+0000 7f44e48b39c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:27.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.396+0000 7f44e48b39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:27.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.396+0000 7f44e48b39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:27.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.396+0000 7f44e48b39c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:27.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.396+0000 7f44e48b39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:27.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.396+0000 7f44e48b39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:27.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.396+0000 7f44e48b39c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:27.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:27.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:27.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:27.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:27.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:27.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 20 zone default found 2024-09-12T18:45:27.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 4 Realm: () 2024-09-12T18:45:27.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:27.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:27.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:27.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 20 zonegroup default 2024-09-12T18:45:27.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:27.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:27.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:27.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:27.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.400+0000 7f44e48b39c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:27.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.404+0000 7f44e48b39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:27.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.404+0000 7f44e48b39c0 20 started sync module instance, tier type = 2024-09-12T18:45:27.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.404+0000 7f44e48b39c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:27.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.428+0000 7f44e48b39c0 20 add_watcher() i=0 2024-09-12T18:45:27.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.428+0000 7f44e48b39c0 20 add_watcher() i=1 2024-09-12T18:45:27.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.428+0000 7f44e48b39c0 20 add_watcher() i=2 2024-09-12T18:45:27.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.428+0000 7f44e48b39c0 20 add_watcher() i=3 2024-09-12T18:45:27.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.428+0000 7f44e48b39c0 20 add_watcher() i=4 2024-09-12T18:45:27.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.428+0000 7f44e48b39c0 20 add_watcher() i=5 2024-09-12T18:45:27.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.428+0000 7f44e48b39c0 20 add_watcher() i=6 2024-09-12T18:45:27.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.432+0000 7f44e48b39c0 20 add_watcher() i=7 2024-09-12T18:45:27.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.432+0000 7f44e48b39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:27.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.436+0000 7f4398fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:27.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.436+0000 7f44e48b39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:27.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.436+0000 7f44e48b39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:27.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.436+0000 7f44e48b39c0 5 note: GC not initialized 2024-09-12T18:45:27.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.436+0000 7f43137fe640 20 reqs_thread_entry: start 2024-09-12T18:45:27.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.436+0000 7f44e48b39c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:27.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.436+0000 7f44e48b39c0 20 Filter name: none 2024-09-12T18:45:27.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.436+0000 7f43117fa640 20 reqs_thread_entry: start 2024-09-12T18:45:27.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.436+0000 7f44e48b39c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:45:27.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.436+0000 7f44e48b39c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:27.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.440+0000 7f44e48b39c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:45:27.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.440+0000 7f44e48b39c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:45:27.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.440+0000 7f44e48b39c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:45:27.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.440+0000 7f44e48b39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 : miss 2024-09-12T18:45:27.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.440+0000 7f44e48b39c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:27.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.440+0000 7f44e48b39c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:45:27.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.440+0000 7f44e48b39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 info.flags=0x17 2024-09-12T18:45:27.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.440+0000 7f44e48b39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 to cache LRU end 2024-09-12T18:45:27.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.440+0000 7f44e48b39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:45:27.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.440+0000 7f44e48b39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:27.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.440+0000 7f44e48b39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 2024-09-12T18:45:27.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.440+0000 7f44e48b39c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 to be held by another RGW process; skipping for now 2024-09-12T18:45:27.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.440+0000 7f4398fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:27.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.448+0000 7f44e48b39c0 20 remove_watcher() i=0 2024-09-12T18:45:27.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.448+0000 7f44e48b39c0 2 removed watcher, disabling cache 2024-09-12T18:45:27.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.448+0000 7f44e48b39c0 20 remove_watcher() i=1 2024-09-12T18:45:27.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.452+0000 7f44e48b39c0 20 remove_watcher() i=2 2024-09-12T18:45:27.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.452+0000 7f44e48b39c0 20 remove_watcher() i=3 2024-09-12T18:45:27.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.456+0000 7f44e48b39c0 20 remove_watcher() i=4 2024-09-12T18:45:27.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.456+0000 7f44e48b39c0 20 remove_watcher() i=5 2024-09-12T18:45:27.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.460+0000 7f44e48b39c0 20 remove_watcher() i=6 2024-09-12T18:45:27.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:27.460+0000 7f44e48b39c0 20 remove_watcher() i=7 2024-09-12T18:45:27.477 INFO:tasks.workunit.client.0.smithi111.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:45:57.505 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:45:57.543 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:57.543 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:57.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.588+0000 7f0eee3679c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:57.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.588+0000 7f0eee3679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:57.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.588+0000 7f0eee3679c0 20 realm 2024-09-12T18:45:57.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.588+0000 7f0eee3679c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:57.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.588+0000 7f0eee3679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:57.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.588+0000 7f0eee3679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:57.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.588+0000 7f0eee3679c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:57.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.588+0000 7f0eee3679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:57.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.588+0000 7f0eee3679c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:57.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.592+0000 7f0eee3679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:57.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.592+0000 7f0eee3679c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:57.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.592+0000 7f0eee3679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:57.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.592+0000 7f0eee3679c0 20 searching for the correct realm 2024-09-12T18:45:57.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.596+0000 7f0eebe6d640 0 -- 172.21.15.111:0/368561409 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f0ee40d3040 msgr2=0x7f0ee40d3930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:57.604 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.604+0000 7f0eeb66c640 0 -- 172.21.15.111:0/368561409 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f0ee40e6040 msgr2=0x7f0ee40e53b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:57.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.820+0000 7f0eee3679c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:57.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.820+0000 7f0eee3679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:57.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.820+0000 7f0eee3679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:57.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.820+0000 7f0eee3679c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:57.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.820+0000 7f0eee3679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:57.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.820+0000 7f0eee3679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:57.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.820+0000 7f0eee3679c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:57.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.820+0000 7f0eee3679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:57.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.820+0000 7f0eee3679c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:57.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.824+0000 7f0eee3679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:57.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.824+0000 7f0eee3679c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:57.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.824+0000 7f0eee3679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:57.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.824+0000 7f0eee3679c0 20 zone default found 2024-09-12T18:45:57.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.824+0000 7f0eee3679c0 4 Realm: () 2024-09-12T18:45:57.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.824+0000 7f0eee3679c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:57.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.824+0000 7f0eee3679c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:57.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.824+0000 7f0eee3679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:57.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.824+0000 7f0eee3679c0 20 zonegroup default 2024-09-12T18:45:57.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.824+0000 7f0eee3679c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:57.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.824+0000 7f0eee3679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:57.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.824+0000 7f0eee3679c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:57.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.824+0000 7f0eee3679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:57.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.824+0000 7f0eee3679c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:57.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.828+0000 7f0eee3679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:57.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.828+0000 7f0eee3679c0 20 started sync module instance, tier type = 2024-09-12T18:45:57.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.828+0000 7f0eee3679c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:57.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.848+0000 7f0eee3679c0 20 add_watcher() i=0 2024-09-12T18:45:57.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.848+0000 7f0eee3679c0 20 add_watcher() i=1 2024-09-12T18:45:57.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.848+0000 7f0eee3679c0 20 add_watcher() i=2 2024-09-12T18:45:57.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.848+0000 7f0eee3679c0 20 add_watcher() i=3 2024-09-12T18:45:57.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.848+0000 7f0eee3679c0 20 add_watcher() i=4 2024-09-12T18:45:57.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.848+0000 7f0eee3679c0 20 add_watcher() i=5 2024-09-12T18:45:57.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.848+0000 7f0eee3679c0 20 add_watcher() i=6 2024-09-12T18:45:57.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.852+0000 7f0eee3679c0 20 add_watcher() i=7 2024-09-12T18:45:57.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.852+0000 7f0eee3679c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:57.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.856+0000 7f0da1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:57.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.856+0000 7f0eee3679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:57.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.856+0000 7f0eee3679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:57.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.856+0000 7f0eee3679c0 5 note: GC not initialized 2024-09-12T18:45:57.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0da0fe1640 20 reqs_thread_entry: start 2024-09-12T18:45:57.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:57.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 20 Filter name: none 2024-09-12T18:45:57.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0d1a7fc640 20 reqs_thread_entry: start 2024-09-12T18:45:57.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T18:45:57.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:57.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:45:57.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T18:45:57.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T18:45:57.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 : miss 2024-09-12T18:45:57.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:57.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:45:57.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 info.flags=0x17 2024-09-12T18:45:57.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 to cache LRU end 2024-09-12T18:45:57.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:45:57.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:57.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.860+0000 7f0eee3679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 2024-09-12T18:45:57.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.868+0000 7f0eee3679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 info.flags=0x17 2024-09-12T18:45:57.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.868+0000 7f0eee3679c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 to cache LRU end 2024-09-12T18:45:57.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.868+0000 7f0eee3679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:57.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.868+0000 7f0eee3679c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21, ofs0, ns] 2024-09-12T18:45:57.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.872+0000 7f0dcaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431601 cookie 94780877274992 notifier 6468 bl.length()=913 2024-09-12T18:45:57.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.872+0000 7f0dcaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 info.flags=0x17 2024-09-12T18:45:57.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.872+0000 7f0dcaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 to cache LRU end 2024-09-12T18:45:57.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.872+0000 7f0dcaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:57.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.872+0000 7f0eee3679c0 20 handle_bi_update(): bucket=:abort-at-init-indext[97c2b296-1395-4700-8053-4f06c4c86557.4689.21]): orig_sources= new_sources= 2024-09-12T18:45:57.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.872+0000 7f0eee3679c0 20 handle_bi_update(): bucket=:abort-at-init-indext[97c2b296-1395-4700-8053-4f06c4c86557.4689.21]): potential sources added=[] removed=[] 2024-09-12T18:45:57.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.872+0000 7f0eee3679c0 20 handle_bi_update(): bucket=:abort-at-init-indext[97c2b296-1395-4700-8053-4f06c4c86557.4689.21]): orig_dests= new_dests= 2024-09-12T18:45:57.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.872+0000 7f0eee3679c0 20 handle_bi_update(): bucket=:abort-at-init-indext[97c2b296-1395-4700-8053-4f06c4c86557.4689.21]): potential dests added=[] removed=[] 2024-09-12T18:45:57.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.0 2024-09-12T18:45:57.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.0 2024-09-12T18:45:57.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.1 2024-09-12T18:45:57.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.1 2024-09-12T18:45:57.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.2 2024-09-12T18:45:57.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.2 2024-09-12T18:45:57.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.3 2024-09-12T18:45:57.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.3 2024-09-12T18:45:57.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.4 2024-09-12T18:45:57.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.4 2024-09-12T18:45:57.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.5 2024-09-12T18:45:57.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.5 2024-09-12T18:45:57.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.6 2024-09-12T18:45:57.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.6 2024-09-12T18:45:57.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.7 2024-09-12T18:45:57.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.7 2024-09-12T18:45:57.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.8 2024-09-12T18:45:57.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.8 2024-09-12T18:45:57.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.9 2024-09-12T18:45:57.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.9 2024-09-12T18:45:57.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.10 2024-09-12T18:45:57.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.10 2024-09-12T18:45:57.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.11 2024-09-12T18:45:57.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1.11 2024-09-12T18:45:57.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.0 2024-09-12T18:45:57.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.880+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1 2024-09-12T18:45:57.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.884+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.2 2024-09-12T18:45:57.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.884+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.3 2024-09-12T18:45:57.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.884+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.4 2024-09-12T18:45:57.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.888+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.5 2024-09-12T18:45:57.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.888+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.6 2024-09-12T18:45:57.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.888+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.7 2024-09-12T18:45:57.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.888+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.8 2024-09-12T18:45:57.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.892+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.9 2024-09-12T18:45:57.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.892+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.10 2024-09-12T18:45:57.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.896+0000 7f0eee3679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 : hit (requested=0x17, cached=0x17) 2024-09-12T18:45:57.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.896+0000 7f0eee3679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 2024-09-12T18:45:57.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.900+0000 7f0eee3679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 info.flags=0x17 2024-09-12T18:45:57.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.900+0000 7f0eee3679c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 to cache LRU end 2024-09-12T18:45:57.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.900+0000 7f0eee3679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:57.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.900+0000 7f0eee3679c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21, ofs0, ns] 2024-09-12T18:45:57.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.900+0000 7f0dca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431602 cookie 94780877274992 notifier 6468 bl.length()=913 2024-09-12T18:45:57.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.900+0000 7f0dca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 info.flags=0x17 2024-09-12T18:45:57.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.900+0000 7f0dca7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 to cache LRU end 2024-09-12T18:45:57.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.900+0000 7f0dca7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:57.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.900+0000 7f0eee3679c0 20 handle_bi_update(): bucket=:abort-at-init-indext[97c2b296-1395-4700-8053-4f06c4c86557.4689.21]): orig_sources= new_sources= 2024-09-12T18:45:57.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.900+0000 7f0eee3679c0 20 handle_bi_update(): bucket=:abort-at-init-indext[97c2b296-1395-4700-8053-4f06c4c86557.4689.21]): potential sources added=[] removed=[] 2024-09-12T18:45:57.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.900+0000 7f0eee3679c0 20 handle_bi_update(): bucket=:abort-at-init-indext[97c2b296-1395-4700-8053-4f06c4c86557.4689.21]): orig_dests= new_dests= 2024-09-12T18:45:57.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.900+0000 7f0eee3679c0 20 handle_bi_update(): bucket=:abort-at-init-indext[97c2b296-1395-4700-8053-4f06c4c86557.4689.21]): potential dests added=[] removed=[] 2024-09-12T18:45:57.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.908+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.0 2024-09-12T18:45:57.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.908+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.1 2024-09-12T18:45:57.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.908+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.2 2024-09-12T18:45:57.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.908+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.3 2024-09-12T18:45:57.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.912+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.4 2024-09-12T18:45:57.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.912+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.5 2024-09-12T18:45:57.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.912+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.6 2024-09-12T18:45:57.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.912+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.7 2024-09-12T18:45:57.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.912+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.8 2024-09-12T18:45:57.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.912+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.9 2024-09-12T18:45:57.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.912+0000 7f0eee3679c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.21.10 2024-09-12T18:45:57.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.916+0000 7f0eee3679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 : hit (requested=0x17, cached=0x17) 2024-09-12T18:45:57.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.916+0000 7f0eee3679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 2024-09-12T18:45:57.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.916+0000 7f0eee3679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 info.flags=0x17 2024-09-12T18:45:57.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.916+0000 7f0eee3679c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 to cache LRU end 2024-09-12T18:45:57.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.916+0000 7f0eee3679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:57.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.916+0000 7f0eee3679c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21, ofs0, ns] 2024-09-12T18:45:57.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.916+0000 7f0dcaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431603 cookie 94780877274992 notifier 6468 bl.length()=881 2024-09-12T18:45:57.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.916+0000 7f0dcaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 info.flags=0x17 2024-09-12T18:45:57.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.916+0000 7f0dcaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:97c2b296-1395-4700-8053-4f06c4c86557.4689.21 to cache LRU end 2024-09-12T18:45:57.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.916+0000 7f0dcaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:57.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.920+0000 7f0eee3679c0 20 handle_bi_update(): bucket=:abort-at-init-indext[97c2b296-1395-4700-8053-4f06c4c86557.4689.21]): orig_sources= new_sources= 2024-09-12T18:45:57.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.920+0000 7f0eee3679c0 20 handle_bi_update(): bucket=:abort-at-init-indext[97c2b296-1395-4700-8053-4f06c4c86557.4689.21]): potential sources added=[] removed=[] 2024-09-12T18:45:57.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.920+0000 7f0eee3679c0 20 handle_bi_update(): bucket=:abort-at-init-indext[97c2b296-1395-4700-8053-4f06c4c86557.4689.21]): orig_dests= new_dests= 2024-09-12T18:45:57.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.920+0000 7f0eee3679c0 20 handle_bi_update(): bucket=:abort-at-init-indext[97c2b296-1395-4700-8053-4f06c4c86557.4689.21]): potential dests added=[] removed=[] 2024-09-12T18:45:57.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.924+0000 7f0eee3679c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-12T18:45:57.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.928+0000 7f0da1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:57.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.932+0000 7f0eee3679c0 20 remove_watcher() i=0 2024-09-12T18:45:57.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.932+0000 7f0eee3679c0 2 removed watcher, disabling cache 2024-09-12T18:45:57.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.932+0000 7f0eee3679c0 20 remove_watcher() i=1 2024-09-12T18:45:57.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.936+0000 7f0eee3679c0 20 remove_watcher() i=2 2024-09-12T18:45:57.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.936+0000 7f0eee3679c0 20 remove_watcher() i=3 2024-09-12T18:45:57.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.940+0000 7f0eee3679c0 20 remove_watcher() i=4 2024-09-12T18:45:57.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.940+0000 7f0eee3679c0 20 remove_watcher() i=5 2024-09-12T18:45:57.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.944+0000 7f0eee3679c0 20 remove_watcher() i=6 2024-09-12T18:45:57.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:57.944+0000 7f0eee3679c0 20 remove_watcher() i=7 2024-09-12T18:45:57.960 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T18:45:57.988 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:57.989 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:58.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.032+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.032+0000 7f4178a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:58.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.032+0000 7f4178a6d9c0 20 realm 2024-09-12T18:45:58.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.032+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.032+0000 7f4178a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:58.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.032+0000 7f4178a6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:58.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.032+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.032+0000 7f4178a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:58.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.032+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.036+0000 7f4178a6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:58.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.036+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.036+0000 7f4178a6d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:58.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.036+0000 7f4178a6d9c0 20 searching for the correct realm 2024-09-12T18:45:58.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.040+0000 7f4176d74640 0 -- 172.21.15.111:0/3245432636 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f4160092050 msgr2=0x7f41600168c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:58.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.048+0000 7f4176d74640 0 -- 172.21.15.111:0/3245432636 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f4040080a00 msgr2=0x7f4040082e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:58.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.052+0000 7f4178a6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:58.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.052+0000 7f4178a6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:58.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.052+0000 7f4178a6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:58.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.052+0000 7f4178a6d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:58.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.052+0000 7f4178a6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:58.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.052+0000 7f4178a6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:58.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.052+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.052+0000 7f4178a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:58.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.052+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:58.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:58.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 20 zone default found 2024-09-12T18:45:58.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 4 Realm: () 2024-09-12T18:45:58.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:58.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:58.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:58.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 20 zonegroup default 2024-09-12T18:45:58.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:58.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:58.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:58.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 20 started sync module instance, tier type = 2024-09-12T18:45:58.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.056+0000 7f4178a6d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:58.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.072+0000 7f4178a6d9c0 20 add_watcher() i=0 2024-09-12T18:45:58.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.072+0000 7f4178a6d9c0 20 add_watcher() i=1 2024-09-12T18:45:58.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.072+0000 7f4178a6d9c0 20 add_watcher() i=2 2024-09-12T18:45:58.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.072+0000 7f4178a6d9c0 20 add_watcher() i=3 2024-09-12T18:45:58.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.072+0000 7f4178a6d9c0 20 add_watcher() i=4 2024-09-12T18:45:58.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.072+0000 7f4178a6d9c0 20 add_watcher() i=5 2024-09-12T18:45:58.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.072+0000 7f4178a6d9c0 20 add_watcher() i=6 2024-09-12T18:45:58.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.072+0000 7f4178a6d9c0 20 add_watcher() i=7 2024-09-12T18:45:58.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.072+0000 7f4178a6d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:58.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.076+0000 7f402cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:58.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.076+0000 7f4178a6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:58.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.076+0000 7f4178a6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:58.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.076+0000 7f4178a6d9c0 5 note: GC not initialized 2024-09-12T18:45:58.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.076+0000 7f3fa77fe640 20 reqs_thread_entry: start 2024-09-12T18:45:58.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.076+0000 7f4178a6d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:58.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.076+0000 7f4178a6d9c0 20 Filter name: none 2024-09-12T18:45:58.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.076+0000 7f3fa57fa640 20 reqs_thread_entry: start 2024-09-12T18:45:58.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.076+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.076+0000 7f4178a6d9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:45:58.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.080+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.080+0000 7f4178a6d9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:45:58.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.080+0000 7f4178a6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:58.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.080+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.080+0000 7f4178a6d9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T18:45:58.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.080+0000 7f4178a6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.080+0000 7f4178a6d9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T18:45:58.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.080+0000 7f4178a6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:58.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.084+0000 7f402cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:58.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.088+0000 7f4178a6d9c0 20 remove_watcher() i=0 2024-09-12T18:45:58.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.088+0000 7f4178a6d9c0 2 removed watcher, disabling cache 2024-09-12T18:45:58.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.088+0000 7f4178a6d9c0 20 remove_watcher() i=1 2024-09-12T18:45:58.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.092+0000 7f4178a6d9c0 20 remove_watcher() i=2 2024-09-12T18:45:58.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.092+0000 7f4178a6d9c0 20 remove_watcher() i=3 2024-09-12T18:45:58.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.096+0000 7f4178a6d9c0 20 remove_watcher() i=4 2024-09-12T18:45:58.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.096+0000 7f4178a6d9c0 20 remove_watcher() i=5 2024-09-12T18:45:58.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.096+0000 7f4178a6d9c0 20 remove_watcher() i=6 2024-09-12T18:45:58.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.096+0000 7f4178a6d9c0 20 remove_watcher() i=7 2024-09-12T18:45:58.112 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:58.112 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:45:58.113 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-init-indext id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:45:58.113 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:58.114 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.114 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.117 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.117 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.162 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.162 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.211 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T18:45:58.211 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:58.212 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.212 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.233 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.233 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.280 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.280 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.298 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.298 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.317 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.317 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.336 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.337 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.356 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.356 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.376 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.376 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.394 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.394 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.413 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.413 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.431 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.431 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.450 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.450 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.469 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.469 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.491 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.491 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.509 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.509 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.529 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.529 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.549 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.549 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.571 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.571 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.590 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.590 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.609 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.609 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.627 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.627 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.646 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:45:58.647 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:45:58.663 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:45:58.694 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:58.694 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:58.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.740+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.740+0000 7fec3b6a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:58.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.740+0000 7fec3b6a09c0 20 realm 2024-09-12T18:45:58.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.740+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.740+0000 7fec3b6a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:58.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.740+0000 7fec3b6a09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:58.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.740+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.740+0000 7fec3b6a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:58.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.740+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.744+0000 7fec3b6a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:58.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.744+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.744+0000 7fec3b6a09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:58.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.744+0000 7fec3b6a09c0 20 searching for the correct realm 2024-09-12T18:45:58.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.748+0000 7fec391a6640 0 -- 172.21.15.111:0/3794435911 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fec340de400 msgr2=0x7fec340de820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:58.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.756+0000 7fec389a5640 0 -- 172.21.15.111:0/3794435911 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fec340b63d0 msgr2=0x7fec340b6830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:58.975 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.972+0000 7fec3b6a09c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:58.975 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.972+0000 7fec3b6a09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:58.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.972+0000 7fec3b6a09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:58.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.972+0000 7fec3b6a09c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:58.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.972+0000 7fec3b6a09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:58.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.972+0000 7fec3b6a09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:58.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.972+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.972+0000 7fec3b6a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:58.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.972+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.976+0000 7fec3b6a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:58.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.976+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.976+0000 7fec3b6a09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:58.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.976+0000 7fec3b6a09c0 20 zone default found 2024-09-12T18:45:58.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.976+0000 7fec3b6a09c0 4 Realm: () 2024-09-12T18:45:58.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.976+0000 7fec3b6a09c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:58.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.976+0000 7fec3b6a09c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:58.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.976+0000 7fec3b6a09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:58.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.976+0000 7fec3b6a09c0 20 zonegroup default 2024-09-12T18:45:58.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.976+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.976+0000 7fec3b6a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:58.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.976+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.976+0000 7fec3b6a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:58.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.976+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:58.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.980+0000 7fec3b6a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:58.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.980+0000 7fec3b6a09c0 20 started sync module instance, tier type = 2024-09-12T18:45:58.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:58.980+0000 7fec3b6a09c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:59.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.000+0000 7fec3b6a09c0 20 add_watcher() i=0 2024-09-12T18:45:59.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.000+0000 7fec3b6a09c0 20 add_watcher() i=1 2024-09-12T18:45:59.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.000+0000 7fec3b6a09c0 20 add_watcher() i=2 2024-09-12T18:45:59.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.000+0000 7fec3b6a09c0 20 add_watcher() i=3 2024-09-12T18:45:59.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.000+0000 7fec3b6a09c0 20 add_watcher() i=4 2024-09-12T18:45:59.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.000+0000 7fec3b6a09c0 20 add_watcher() i=5 2024-09-12T18:45:59.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.000+0000 7fec3b6a09c0 20 add_watcher() i=6 2024-09-12T18:45:59.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.004+0000 7fec3b6a09c0 20 add_watcher() i=7 2024-09-12T18:45:59.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.004+0000 7fec3b6a09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:59.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.004+0000 7feaeffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:59.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7fec3b6a09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:59.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7fec3b6a09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:59.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7fec3b6a09c0 5 note: GC not initialized 2024-09-12T18:45:59.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7feaeefe5640 20 reqs_thread_entry: start 2024-09-12T18:45:59.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7fec3b6a09c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:59.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7fec3b6a09c0 20 Filter name: none 2024-09-12T18:45:59.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7feaecfe1640 20 reqs_thread_entry: start 2024-09-12T18:45:59.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7fec3b6a09c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:45:59.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7fec3b6a09c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:45:59.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7fec3b6a09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:59.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7fec3b6a09c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:45:59.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.008+0000 7fec3b6a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.012+0000 7fec3b6a09c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:45:59.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.012+0000 7fec3b6a09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:45:59.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.012+0000 7feaeffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:59.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.020+0000 7fec3b6a09c0 20 remove_watcher() i=0 2024-09-12T18:45:59.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.020+0000 7fec3b6a09c0 2 removed watcher, disabling cache 2024-09-12T18:45:59.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.020+0000 7fec3b6a09c0 20 remove_watcher() i=1 2024-09-12T18:45:59.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.024+0000 7fec3b6a09c0 20 remove_watcher() i=2 2024-09-12T18:45:59.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.024+0000 7fec3b6a09c0 20 remove_watcher() i=3 2024-09-12T18:45:59.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.028+0000 7fec3b6a09c0 20 remove_watcher() i=4 2024-09-12T18:45:59.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.028+0000 7fec3b6a09c0 20 remove_watcher() i=5 2024-09-12T18:45:59.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.028+0000 7fec3b6a09c0 20 remove_watcher() i=6 2024-09-12T18:45:59.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.032+0000 7fec3b6a09c0 20 remove_watcher() i=7 2024-09-12T18:45:59.053 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:59.053 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:45:59.053 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-set-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:45:59.053 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:45:59.054 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T18:45:59.093 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:59.093 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:59.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.132+0000 7f07cd5759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.136+0000 7f07cd5759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:59.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.136+0000 7f07cd5759c0 20 realm 2024-09-12T18:45:59.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.136+0000 7f07cd5759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.136+0000 7f07cd5759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:59.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.136+0000 7f07cd5759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:59.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.136+0000 7f07cd5759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.136+0000 7f07cd5759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:59.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.136+0000 7f07cd5759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.136+0000 7f07cd5759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:59.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.136+0000 7f07cd5759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.140+0000 7f07cd5759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:59.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.140+0000 7f07cd5759c0 20 searching for the correct realm 2024-09-12T18:45:59.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.140+0000 7f07cb87c640 0 -- 172.21.15.111:0/676830564 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f07c003b070 msgr2=0x7f07c005cac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:59.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.356+0000 7f07ca87a640 0 -- 172.21.15.111:0/676830564 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f07c4018040 msgr2=0x7f07c4035960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:45:59.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.572+0000 7f07cd5759c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:45:59.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.572+0000 7f07cd5759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:45:59.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.572+0000 7f07cd5759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:45:59.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.572+0000 7f07cd5759c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:45:59.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.572+0000 7f07cd5759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:45:59.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.572+0000 7f07cd5759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:45:59.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.572+0000 7f07cd5759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:59.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.577 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:59.577 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:45:59.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 20 zone default found 2024-09-12T18:45:59.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 4 Realm: () 2024-09-12T18:45:59.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:45:59.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:45:59.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:45:59.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 20 zonegroup default 2024-09-12T18:45:59.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:59.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:59.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.576+0000 7f07cd5759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.580+0000 7f07cd5759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:59.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.580+0000 7f07cd5759c0 20 started sync module instance, tier type = 2024-09-12T18:45:59.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.580+0000 7f07cd5759c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:45:59.604 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.604+0000 7f07cd5759c0 20 add_watcher() i=0 2024-09-12T18:45:59.604 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.604+0000 7f07cd5759c0 20 add_watcher() i=1 2024-09-12T18:45:59.604 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.604+0000 7f07cd5759c0 20 add_watcher() i=2 2024-09-12T18:45:59.604 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.604+0000 7f07cd5759c0 20 add_watcher() i=3 2024-09-12T18:45:59.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.604+0000 7f07cd5759c0 20 add_watcher() i=4 2024-09-12T18:45:59.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.604+0000 7f07cd5759c0 20 add_watcher() i=5 2024-09-12T18:45:59.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.604+0000 7f07cd5759c0 20 add_watcher() i=6 2024-09-12T18:45:59.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.604+0000 7f07cd5759c0 20 add_watcher() i=7 2024-09-12T18:45:59.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.604+0000 7f07cd5759c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:45:59.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.608+0000 7f0681fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:59.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.608+0000 7f07cd5759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:45:59.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.608+0000 7f07cd5759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:45:59.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.608+0000 7f07cd5759c0 5 note: GC not initialized 2024-09-12T18:45:59.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f0680fe1640 20 reqs_thread_entry: start 2024-09-12T18:45:59.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 20 init_complete bucket index max shards: 11 2024-09-12T18:45:59.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 20 Filter name: none 2024-09-12T18:45:59.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f05fa7fc640 20 reqs_thread_entry: start 2024-09-12T18:45:59.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T18:45:59.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:45:59.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T18:45:59.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T18:45:59.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 : miss 2024-09-12T18:45:59.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:45:59.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 info.flags=0x17 2024-09-12T18:45:59.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 to cache LRU end 2024-09-12T18:45:59.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:45:59.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:45:59.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.612+0000 7f07cd5759c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 2024-09-12T18:45:59.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.620+0000 7f07cd5759c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T18:45:59.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.620+0000 7f07cd5759c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T18:45:59.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.632+0000 7f0681fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:45:59.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.636+0000 7f07cd5759c0 20 remove_watcher() i=0 2024-09-12T18:45:59.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.636+0000 7f07cd5759c0 2 removed watcher, disabling cache 2024-09-12T18:45:59.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.636+0000 7f07cd5759c0 20 remove_watcher() i=1 2024-09-12T18:45:59.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.640+0000 7f07cd5759c0 20 remove_watcher() i=2 2024-09-12T18:45:59.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.644+0000 7f07cd5759c0 20 remove_watcher() i=3 2024-09-12T18:45:59.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.644+0000 7f07cd5759c0 20 remove_watcher() i=4 2024-09-12T18:45:59.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.644+0000 7f07cd5759c0 20 remove_watcher() i=5 2024-09-12T18:45:59.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.648+0000 7f07cd5759c0 20 remove_watcher() i=6 2024-09-12T18:45:59.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.648+0000 7f07cd5759c0 20 remove_watcher() i=7 2024-09-12T18:45:59.667 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:45:59.697 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:45:59.697 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:45:59.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.920+0000 7f19d02f7640 0 --2- 172.21.15.111:0/2740521640 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55ef7d2503a0 0x55ef7d3a5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T18:45:59.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.948+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.948+0000 7f19d2ff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:59.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.948+0000 7f19d2ff29c0 20 realm 2024-09-12T18:45:59.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.948+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.948+0000 7f19d2ff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:59.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.948+0000 7f19d2ff29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:45:59.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.948+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.948+0000 7f19d2ff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:45:59.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.948+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.952+0000 7f19d2ff29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:45:59.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.952+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:45:59.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.952+0000 7f19d2ff29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:45:59.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.952+0000 7f19d2ff29c0 20 searching for the correct realm 2024-09-12T18:45:59.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:45:59.952+0000 7f19d0af8640 0 -- 172.21.15.111:0/2214647183 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f19c8042020 msgr2=0x7f19c8069120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:00.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.164+0000 7f19d0af8640 0 -- 172.21.15.111:0/2214647183 >> [v2:172.21.15.153:6808/1571723771,v1:172.21.15.153:6809/1571723771] conn(0x7f19c802d070 msgr2=0x7f19c806ba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:00.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:00.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:00.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:00.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:00.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:00.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:00.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:00.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:00.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:00.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 zone default found 2024-09-12T18:46:00.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 4 Realm: () 2024-09-12T18:46:00.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:00.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:00.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:00.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 zonegroup default 2024-09-12T18:46:00.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:00.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.388+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.392+0000 7f19d2ff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:00.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.392+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.392+0000 7f19d2ff29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:00.393 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.392+0000 7f19d2ff29c0 20 started sync module instance, tier type = 2024-09-12T18:46:00.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.392+0000 7f19d2ff29c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:00.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.416+0000 7f19d2ff29c0 20 add_watcher() i=0 2024-09-12T18:46:00.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.416+0000 7f19d2ff29c0 20 add_watcher() i=1 2024-09-12T18:46:00.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.416+0000 7f19d2ff29c0 20 add_watcher() i=2 2024-09-12T18:46:00.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.416+0000 7f19d2ff29c0 20 add_watcher() i=3 2024-09-12T18:46:00.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.416+0000 7f19d2ff29c0 20 add_watcher() i=4 2024-09-12T18:46:00.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.416+0000 7f19d2ff29c0 20 add_watcher() i=5 2024-09-12T18:46:00.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.416+0000 7f19d2ff29c0 20 add_watcher() i=6 2024-09-12T18:46:00.418 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.416+0000 7f19d2ff29c0 20 add_watcher() i=7 2024-09-12T18:46:00.419 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.416+0000 7f19d2ff29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:00.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.420+0000 7f1886fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:00.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.420+0000 7f19d2ff29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:00.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.420+0000 7f19d2ff29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:00.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.420+0000 7f19d2ff29c0 5 note: GC not initialized 2024-09-12T18:46:00.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.420+0000 7f1885fe3640 20 reqs_thread_entry: start 2024-09-12T18:46:00.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.420+0000 7f19d2ff29c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:00.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.420+0000 7f19d2ff29c0 20 Filter name: none 2024-09-12T18:46:00.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.420+0000 7f17f77fe640 20 reqs_thread_entry: start 2024-09-12T18:46:00.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.420+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.424+0000 7f19d2ff29c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:00.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.424+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.424+0000 7f19d2ff29c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:00.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.424+0000 7f19d2ff29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:00.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.424+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.424+0000 7f19d2ff29c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:00.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.424+0000 7f19d2ff29c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.424+0000 7f19d2ff29c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:00.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.424+0000 7f19d2ff29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:00.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.428+0000 7f1886fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:00.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.432+0000 7f19d2ff29c0 20 remove_watcher() i=0 2024-09-12T18:46:00.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.432+0000 7f19d2ff29c0 2 removed watcher, disabling cache 2024-09-12T18:46:00.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.436+0000 7f19d2ff29c0 20 remove_watcher() i=1 2024-09-12T18:46:00.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.436+0000 7f19d2ff29c0 20 remove_watcher() i=2 2024-09-12T18:46:00.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.440+0000 7f19d2ff29c0 20 remove_watcher() i=3 2024-09-12T18:46:00.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.440+0000 7f19d2ff29c0 20 remove_watcher() i=4 2024-09-12T18:46:00.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.444+0000 7f19d2ff29c0 20 remove_watcher() i=5 2024-09-12T18:46:00.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.444+0000 7f19d2ff29c0 20 remove_watcher() i=6 2024-09-12T18:46:00.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.444+0000 7f19d2ff29c0 20 remove_watcher() i=7 2024-09-12T18:46:00.462 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:00.462 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:46:00.462 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-set-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:46:00.462 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:00.463 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:00.463 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:00.474 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:00.474 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:00.521 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:46:00.557 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:00.557 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:00.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.600+0000 7f514a1c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.604+0000 7f514a1c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:00.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.604+0000 7f514a1c39c0 20 realm 2024-09-12T18:46:00.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.604+0000 7f514a1c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.604+0000 7f514a1c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:00.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.604+0000 7f514a1c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:00.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.604+0000 7f514a1c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.604+0000 7f514a1c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:00.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.604+0000 7f514a1c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.604+0000 7f514a1c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:00.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.604+0000 7f514a1c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.608+0000 7f514a1c39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:00.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.608+0000 7f514a1c39c0 20 searching for the correct realm 2024-09-12T18:46:00.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.612+0000 7f5147cc9640 0 -- 172.21.15.111:0/2370974093 >> [v2:172.21.15.111:6800/2832238944,v1:172.21.15.111:6801/2832238944] conn(0x556a67af0500 msgr2=0x556a67af2970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:00.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.620+0000 7f51484ca640 0 -- 172.21.15.111:0/2370974093 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f513001a040 msgr2=0x7f513007dbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:00.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.624+0000 7f514a1c39c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:00.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.624+0000 7f514a1c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:00.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.624+0000 7f514a1c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:00.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.624+0000 7f514a1c39c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:00.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.624+0000 7f514a1c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:00.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.624+0000 7f514a1c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:00.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.624+0000 7f514a1c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.624+0000 7f514a1c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:00.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.624+0000 7f514a1c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:00.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:00.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 20 zone default found 2024-09-12T18:46:00.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 4 Realm: () 2024-09-12T18:46:00.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:00.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:00.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:00.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 20 zonegroup default 2024-09-12T18:46:00.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:00.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:00.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:00.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 20 started sync module instance, tier type = 2024-09-12T18:46:00.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.628+0000 7f514a1c39c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:00.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.644+0000 7f514a1c39c0 20 add_watcher() i=0 2024-09-12T18:46:00.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.644+0000 7f514a1c39c0 20 add_watcher() i=1 2024-09-12T18:46:00.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.644+0000 7f514a1c39c0 20 add_watcher() i=2 2024-09-12T18:46:00.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.644+0000 7f514a1c39c0 20 add_watcher() i=3 2024-09-12T18:46:00.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.644+0000 7f514a1c39c0 20 add_watcher() i=4 2024-09-12T18:46:00.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.644+0000 7f514a1c39c0 20 add_watcher() i=5 2024-09-12T18:46:00.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.644+0000 7f514a1c39c0 20 add_watcher() i=6 2024-09-12T18:46:00.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.648+0000 7f514a1c39c0 20 add_watcher() i=7 2024-09-12T18:46:00.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.648+0000 7f514a1c39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:00.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.648+0000 7f4ffdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:00.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.648+0000 7f514a1c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:00.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.648+0000 7f514a1c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:00.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.648+0000 7f514a1c39c0 5 note: GC not initialized 2024-09-12T18:46:00.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f4ffcfe1640 20 reqs_thread_entry: start 2024-09-12T18:46:00.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:00.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 20 Filter name: none 2024-09-12T18:46:00.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f4f767fc640 20 reqs_thread_entry: start 2024-09-12T18:46:00.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T18:46:00.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:00.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T18:46:00.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T18:46:00.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 : miss 2024-09-12T18:46:00.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:00.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 info.flags=0x17 2024-09-12T18:46:00.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 to cache LRU end 2024-09-12T18:46:00.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:46:00.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:00.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.652+0000 7f514a1c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 2024-09-12T18:46:00.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.660+0000 7f514a1c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 info.flags=0x17 2024-09-12T18:46:00.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.660+0000 7f514a1c39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 to cache LRU end 2024-09-12T18:46:00.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.660+0000 7f514a1c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:00.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.660+0000 7f514a1c39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22, ofs0, ns] 2024-09-12T18:46:00.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.660+0000 7f50267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431632 cookie 93915494487232 notifier 6558 bl.length()=925 2024-09-12T18:46:00.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.660+0000 7f50267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 info.flags=0x17 2024-09-12T18:46:00.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.660+0000 7f50267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 to cache LRU end 2024-09-12T18:46:00.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.660+0000 7f50267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:00.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.660+0000 7f514a1c39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.22]): orig_sources= new_sources= 2024-09-12T18:46:00.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.660+0000 7f514a1c39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.22]): potential sources added=[] removed=[] 2024-09-12T18:46:00.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.660+0000 7f514a1c39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.22]): orig_dests= new_dests= 2024-09-12T18:46:00.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.660+0000 7f514a1c39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.22]): potential dests added=[] removed=[] 2024-09-12T18:46:00.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.0 2024-09-12T18:46:00.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.0 2024-09-12T18:46:00.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.1 2024-09-12T18:46:00.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.1 2024-09-12T18:46:00.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.2 2024-09-12T18:46:00.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.2 2024-09-12T18:46:00.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.3 2024-09-12T18:46:00.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.3 2024-09-12T18:46:00.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.4 2024-09-12T18:46:00.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.4 2024-09-12T18:46:00.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.5 2024-09-12T18:46:00.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.5 2024-09-12T18:46:00.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.6 2024-09-12T18:46:00.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.6 2024-09-12T18:46:00.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.7 2024-09-12T18:46:00.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.7 2024-09-12T18:46:00.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.8 2024-09-12T18:46:00.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.8 2024-09-12T18:46:00.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.9 2024-09-12T18:46:00.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.9 2024-09-12T18:46:00.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.10 2024-09-12T18:46:00.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.10 2024-09-12T18:46:00.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.11 2024-09-12T18:46:00.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1.11 2024-09-12T18:46:00.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.672+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.0 2024-09-12T18:46:00.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.676+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1 2024-09-12T18:46:00.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.676+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.2 2024-09-12T18:46:00.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.676+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.3 2024-09-12T18:46:00.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.676+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.4 2024-09-12T18:46:00.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.676+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.5 2024-09-12T18:46:00.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.680+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.6 2024-09-12T18:46:00.681 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.680+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.7 2024-09-12T18:46:00.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.680+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.8 2024-09-12T18:46:00.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.680+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.9 2024-09-12T18:46:00.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.684+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.10 2024-09-12T18:46:00.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.688+0000 7f514a1c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 : hit (requested=0x17, cached=0x17) 2024-09-12T18:46:00.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.688+0000 7f514a1c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 2024-09-12T18:46:00.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.692+0000 7f514a1c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 info.flags=0x17 2024-09-12T18:46:00.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.692+0000 7f514a1c39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 to cache LRU end 2024-09-12T18:46:00.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.692+0000 7f514a1c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:00.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.692+0000 7f514a1c39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22, ofs0, ns] 2024-09-12T18:46:00.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.692+0000 7f50267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431633 cookie 93915494487232 notifier 6558 bl.length()=925 2024-09-12T18:46:00.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.692+0000 7f50267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 info.flags=0x17 2024-09-12T18:46:00.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.692+0000 7f50267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 to cache LRU end 2024-09-12T18:46:00.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.692+0000 7f50267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:00.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.692+0000 7f514a1c39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.22]): orig_sources= new_sources= 2024-09-12T18:46:00.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.692+0000 7f514a1c39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.22]): potential sources added=[] removed=[] 2024-09-12T18:46:00.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.692+0000 7f514a1c39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.22]): orig_dests= new_dests= 2024-09-12T18:46:00.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.692+0000 7f514a1c39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.22]): potential dests added=[] removed=[] 2024-09-12T18:46:00.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.700+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.0 2024-09-12T18:46:00.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.700+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.1 2024-09-12T18:46:00.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.700+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.2 2024-09-12T18:46:00.703 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.700+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.3 2024-09-12T18:46:00.703 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.700+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.4 2024-09-12T18:46:00.704 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.704+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.5 2024-09-12T18:46:00.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.704+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.6 2024-09-12T18:46:00.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.704+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.7 2024-09-12T18:46:00.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.704+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.8 2024-09-12T18:46:00.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.704+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.9 2024-09-12T18:46:00.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.708+0000 7f514a1c39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.22.10 2024-09-12T18:46:00.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.708+0000 7f514a1c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 : hit (requested=0x17, cached=0x17) 2024-09-12T18:46:00.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.708+0000 7f514a1c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 2024-09-12T18:46:00.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.708+0000 7f514a1c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 info.flags=0x17 2024-09-12T18:46:00.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.708+0000 7f514a1c39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 to cache LRU end 2024-09-12T18:46:00.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.708+0000 7f514a1c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:00.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.708+0000 7f514a1c39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22, ofs0, ns] 2024-09-12T18:46:00.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.708+0000 7f50267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431634 cookie 93915494487232 notifier 6558 bl.length()=893 2024-09-12T18:46:00.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.708+0000 7f50267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 info.flags=0x17 2024-09-12T18:46:00.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.708+0000 7f50267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.22 to cache LRU end 2024-09-12T18:46:00.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.708+0000 7f50267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:00.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.712+0000 7f514a1c39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.22]): orig_sources= new_sources= 2024-09-12T18:46:00.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.712+0000 7f514a1c39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.22]): potential sources added=[] removed=[] 2024-09-12T18:46:00.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.712+0000 7f514a1c39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.22]): orig_dests= new_dests= 2024-09-12T18:46:00.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.712+0000 7f514a1c39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.22]): potential dests added=[] removed=[] 2024-09-12T18:46:00.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.716+0000 7f514a1c39c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T18:46:00.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.720+0000 7f4ffdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:00.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.724+0000 7f514a1c39c0 20 remove_watcher() i=0 2024-09-12T18:46:00.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.724+0000 7f514a1c39c0 2 removed watcher, disabling cache 2024-09-12T18:46:00.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.724+0000 7f514a1c39c0 20 remove_watcher() i=1 2024-09-12T18:46:00.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.728+0000 7f514a1c39c0 20 remove_watcher() i=2 2024-09-12T18:46:00.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.728+0000 7f514a1c39c0 20 remove_watcher() i=3 2024-09-12T18:46:00.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.732+0000 7f514a1c39c0 20 remove_watcher() i=4 2024-09-12T18:46:00.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.732+0000 7f514a1c39c0 20 remove_watcher() i=5 2024-09-12T18:46:00.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.736+0000 7f514a1c39c0 20 remove_watcher() i=6 2024-09-12T18:46:00.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.736+0000 7f514a1c39c0 20 remove_watcher() i=7 2024-09-12T18:46:00.752 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:46:00.779 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:00.779 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:00.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.820+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.824+0000 7f3b47a3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:00.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.824+0000 7f3b47a3b9c0 20 realm 2024-09-12T18:46:00.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.824+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.824+0000 7f3b47a3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:00.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.824+0000 7f3b47a3b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:00.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.824+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.824+0000 7f3b47a3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:00.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.824+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.824+0000 7f3b47a3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:00.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.824+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:00.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.824+0000 7f3b47a3b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:00.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.824+0000 7f3b47a3b9c0 20 searching for the correct realm 2024-09-12T18:46:00.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.832+0000 7f3b45d42640 0 -- 172.21.15.111:0/784285988 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f3b3c041070 msgr2=0x7f3b3c082050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:00.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:00.836+0000 7f3b44d40640 0 -- 172.21.15.111:0/784285988 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f3b4006c070 msgr2=0x7f3b400616f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:01.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:01.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:01.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:01.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:01.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:01.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:01.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:01.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:01.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:01.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 zone default found 2024-09-12T18:46:01.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 4 Realm: () 2024-09-12T18:46:01.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:01.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:01.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:01.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 zonegroup default 2024-09-12T18:46:01.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.052+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.056+0000 7f3b47a3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:01.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.056+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.056+0000 7f3b47a3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:01.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.056+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.056+0000 7f3b47a3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:01.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.056+0000 7f3b47a3b9c0 20 started sync module instance, tier type = 2024-09-12T18:46:01.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.056+0000 7f3b47a3b9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:01.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.080+0000 7f3b47a3b9c0 20 add_watcher() i=0 2024-09-12T18:46:01.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.080+0000 7f3b47a3b9c0 20 add_watcher() i=1 2024-09-12T18:46:01.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.080+0000 7f3b47a3b9c0 20 add_watcher() i=2 2024-09-12T18:46:01.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.080+0000 7f3b47a3b9c0 20 add_watcher() i=3 2024-09-12T18:46:01.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.080+0000 7f3b47a3b9c0 20 add_watcher() i=4 2024-09-12T18:46:01.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.080+0000 7f3b47a3b9c0 20 add_watcher() i=5 2024-09-12T18:46:01.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.080+0000 7f3b47a3b9c0 20 add_watcher() i=6 2024-09-12T18:46:01.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.084+0000 7f3b47a3b9c0 20 add_watcher() i=7 2024-09-12T18:46:01.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.084+0000 7f3b47a3b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:01.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.088+0000 7f39fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:01.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.088+0000 7f3b47a3b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:01.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.088+0000 7f3b47a3b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:01.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.088+0000 7f3b47a3b9c0 5 note: GC not initialized 2024-09-12T18:46:01.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.088+0000 7f39fa7e4640 20 reqs_thread_entry: start 2024-09-12T18:46:01.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.088+0000 7f3b47a3b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:01.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.088+0000 7f3b47a3b9c0 20 Filter name: none 2024-09-12T18:46:01.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.088+0000 7f396bfff640 20 reqs_thread_entry: start 2024-09-12T18:46:01.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.088+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.088+0000 7f3b47a3b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:01.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.088+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.088+0000 7f3b47a3b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:01.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.088+0000 7f3b47a3b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:01.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.088+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.092+0000 7f3b47a3b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:01.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.092+0000 7f3b47a3b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.092+0000 7f3b47a3b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:01.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.092+0000 7f3b47a3b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:01.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.096+0000 7f39fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:01.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.100+0000 7f3b47a3b9c0 20 remove_watcher() i=0 2024-09-12T18:46:01.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.100+0000 7f3b47a3b9c0 2 removed watcher, disabling cache 2024-09-12T18:46:01.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.100+0000 7f3b47a3b9c0 20 remove_watcher() i=1 2024-09-12T18:46:01.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.104+0000 7f3b47a3b9c0 20 remove_watcher() i=2 2024-09-12T18:46:01.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.104+0000 7f3b47a3b9c0 20 remove_watcher() i=3 2024-09-12T18:46:01.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.108+0000 7f3b47a3b9c0 20 remove_watcher() i=4 2024-09-12T18:46:01.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.108+0000 7f3b47a3b9c0 20 remove_watcher() i=5 2024-09-12T18:46:01.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.112+0000 7f3b47a3b9c0 20 remove_watcher() i=6 2024-09-12T18:46:01.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.112+0000 7f3b47a3b9c0 20 remove_watcher() i=7 2024-09-12T18:46:01.129 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:01.129 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:46:01.129 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-set-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:46:01.129 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:01.132 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.133 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.136 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.136 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.182 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.182 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.236 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T18:46:01.236 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:01.237 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.238 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.257 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.258 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.302 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.302 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.317 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.317 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.337 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.338 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.352 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.352 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.370 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.370 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.389 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.389 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.407 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.407 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.425 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.426 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.446 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.446 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.464 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.464 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.483 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.483 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.504 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.505 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.521 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.522 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.539 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.539 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.557 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.557 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.575 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.575 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.593 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.593 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.611 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.612 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.630 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.630 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.648 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:01.648 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:01.665 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:46:01.698 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:01.698 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:01.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.744+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.744+0000 7fd1ece1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:01.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.744+0000 7fd1ece1b9c0 20 realm 2024-09-12T18:46:01.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.744+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.744+0000 7fd1ece1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:01.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.744+0000 7fd1ece1b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:01.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.744+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.744+0000 7fd1ece1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:01.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.744+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.748+0000 7fd1ece1b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:01.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.748+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.748+0000 7fd1ece1b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:01.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.748+0000 7fd1ece1b9c0 20 searching for the correct realm 2024-09-12T18:46:01.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.752+0000 7fd1eb122640 0 -- 172.21.15.111:0/128585935 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fd1e0008050 msgr2=0x7fd1e0051920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:01.761 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.760+0000 7fd1ea120640 0 -- 172.21.15.111:0/128585935 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fd1e40edb90 msgr2=0x7fd1e411f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:46:01.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.976+0000 7fd1ece1b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:01.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.976+0000 7fd1ece1b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:01.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.976+0000 7fd1ece1b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:01.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.976+0000 7fd1ece1b9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:01.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.976+0000 7fd1ece1b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:01.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.976+0000 7fd1ece1b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:01.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.976+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.976+0000 7fd1ece1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:01.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.976+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.980+0000 7fd1ece1b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:01.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.980+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.980+0000 7fd1ece1b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:01.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.980+0000 7fd1ece1b9c0 20 zone default found 2024-09-12T18:46:01.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.980+0000 7fd1ece1b9c0 4 Realm: () 2024-09-12T18:46:01.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.980+0000 7fd1ece1b9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:01.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.980+0000 7fd1ece1b9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:01.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.980+0000 7fd1ece1b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:01.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.980+0000 7fd1ece1b9c0 20 zonegroup default 2024-09-12T18:46:01.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.980+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.980+0000 7fd1ece1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:01.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.980+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.980+0000 7fd1ece1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:01.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.980+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:01.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.984+0000 7fd1ece1b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:01.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.984+0000 7fd1ece1b9c0 20 started sync module instance, tier type = 2024-09-12T18:46:01.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:01.984+0000 7fd1ece1b9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:02.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.004+0000 7fd1ece1b9c0 20 add_watcher() i=0 2024-09-12T18:46:02.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.004+0000 7fd1ece1b9c0 20 add_watcher() i=1 2024-09-12T18:46:02.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.004+0000 7fd1ece1b9c0 20 add_watcher() i=2 2024-09-12T18:46:02.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.004+0000 7fd1ece1b9c0 20 add_watcher() i=3 2024-09-12T18:46:02.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.004+0000 7fd1ece1b9c0 20 add_watcher() i=4 2024-09-12T18:46:02.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.004+0000 7fd1ece1b9c0 20 add_watcher() i=5 2024-09-12T18:46:02.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.004+0000 7fd1ece1b9c0 20 add_watcher() i=6 2024-09-12T18:46:02.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.008+0000 7fd1ece1b9c0 20 add_watcher() i=7 2024-09-12T18:46:02.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.008+0000 7fd1ece1b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:02.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.008+0000 7fd0a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:02.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.012+0000 7fd1ece1b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:02.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.012+0000 7fd1ece1b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:02.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.012+0000 7fd1ece1b9c0 5 note: GC not initialized 2024-09-12T18:46:02.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.012+0000 7fd01bfff640 20 reqs_thread_entry: start 2024-09-12T18:46:02.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.012+0000 7fd1ece1b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:02.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.012+0000 7fd1ece1b9c0 20 Filter name: none 2024-09-12T18:46:02.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.012+0000 7fd019ffb640 20 reqs_thread_entry: start 2024-09-12T18:46:02.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.012+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.012+0000 7fd1ece1b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:02.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.012+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.012+0000 7fd1ece1b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:02.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.012+0000 7fd1ece1b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:02.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.012+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.016+0000 7fd1ece1b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:02.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.016+0000 7fd1ece1b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.016+0000 7fd1ece1b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:02.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.016+0000 7fd1ece1b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:02.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.016+0000 7fd0a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:02.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.024+0000 7fd1ece1b9c0 20 remove_watcher() i=0 2024-09-12T18:46:02.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.024+0000 7fd1ece1b9c0 2 removed watcher, disabling cache 2024-09-12T18:46:02.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.024+0000 7fd1ece1b9c0 20 remove_watcher() i=1 2024-09-12T18:46:02.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.028+0000 7fd1ece1b9c0 20 remove_watcher() i=2 2024-09-12T18:46:02.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.028+0000 7fd1ece1b9c0 20 remove_watcher() i=3 2024-09-12T18:46:02.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.032+0000 7fd1ece1b9c0 20 remove_watcher() i=4 2024-09-12T18:46:02.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.036+0000 7fd1ece1b9c0 20 remove_watcher() i=5 2024-09-12T18:46:02.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.036+0000 7fd1ece1b9c0 20 remove_watcher() i=6 2024-09-12T18:46:02.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.036+0000 7fd1ece1b9c0 20 remove_watcher() i=7 2024-09-12T18:46:02.058 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:02.058 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:46:02.058 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-set-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:46:02.059 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:02.059 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T18:46:02.095 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:02.095 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:02.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.140+0000 7f50e4fc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.140+0000 7f50e4fc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:02.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.140+0000 7f50e4fc39c0 20 realm 2024-09-12T18:46:02.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.140+0000 7f50e4fc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.140+0000 7f50e4fc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:02.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.140+0000 7f50e4fc39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:02.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.140+0000 7f50e4fc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.140+0000 7f50e4fc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:02.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.140+0000 7f50e4fc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.144+0000 7f50e4fc39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:02.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.144+0000 7f50e4fc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.144+0000 7f50e4fc39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:02.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.144+0000 7f50e4fc39c0 20 searching for the correct realm 2024-09-12T18:46:02.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.148+0000 7f50e32ca640 0 -- 172.21.15.111:0/654190164 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f50d8008050 msgr2=0x7f50d8072ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:02.365 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.364+0000 7f50e22c8640 0 -- 172.21.15.111:0/654190164 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f50dc0631c0 msgr2=0x7f50dc098050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:02.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.580+0000 7f50e4fc39c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:02.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.580+0000 7f50e4fc39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:02.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.580+0000 7f50e4fc39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:02.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.580+0000 7f50e4fc39c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:02.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.580+0000 7f50e4fc39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:02.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.580+0000 7f50e4fc39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:02.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.580+0000 7f50e4fc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.580+0000 7f50e4fc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:02.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:02.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:02.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 20 zone default found 2024-09-12T18:46:02.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 4 Realm: () 2024-09-12T18:46:02.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:02.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:02.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:02.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 20 zonegroup default 2024-09-12T18:46:02.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:02.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:02.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.584+0000 7f50e4fc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.588+0000 7f50e4fc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:02.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.588+0000 7f50e4fc39c0 20 started sync module instance, tier type = 2024-09-12T18:46:02.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.588+0000 7f50e4fc39c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:02.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.608+0000 7f50e4fc39c0 20 add_watcher() i=0 2024-09-12T18:46:02.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.608+0000 7f50e4fc39c0 20 add_watcher() i=1 2024-09-12T18:46:02.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.608+0000 7f50e4fc39c0 20 add_watcher() i=2 2024-09-12T18:46:02.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.608+0000 7f50e4fc39c0 20 add_watcher() i=3 2024-09-12T18:46:02.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.608+0000 7f50e4fc39c0 20 add_watcher() i=4 2024-09-12T18:46:02.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.608+0000 7f50e4fc39c0 20 add_watcher() i=5 2024-09-12T18:46:02.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.608+0000 7f50e4fc39c0 20 add_watcher() i=6 2024-09-12T18:46:02.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.608+0000 7f50e4fc39c0 20 add_watcher() i=7 2024-09-12T18:46:02.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.608+0000 7f50e4fc39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:02.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.612+0000 7f4f997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:02.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.612+0000 7f50e4fc39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:02.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.612+0000 7f50e4fc39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:02.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.612+0000 7f50e4fc39c0 5 note: GC not initialized 2024-09-12T18:46:02.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f4f13fff640 20 reqs_thread_entry: start 2024-09-12T18:46:02.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:02.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 20 Filter name: none 2024-09-12T18:46:02.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f4f11ffb640 20 reqs_thread_entry: start 2024-09-12T18:46:02.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T18:46:02.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:02.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T18:46:02.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T18:46:02.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 : miss 2024-09-12T18:46:02.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:02.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 info.flags=0x17 2024-09-12T18:46:02.621 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 to cache LRU end 2024-09-12T18:46:02.621 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:46:02.621 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:02.621 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.616+0000 7f50e4fc39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 2024-09-12T18:46:02.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.624+0000 7f50e4fc39c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T18:46:02.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.624+0000 7f50e4fc39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 info.flags=0x17 2024-09-12T18:46:02.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.624+0000 7f50e4fc39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 to cache LRU end 2024-09-12T18:46:02.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.624+0000 7f50e4fc39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:02.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.624+0000 7f50e4fc39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23, ofs0, ns] 2024-09-12T18:46:02.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.624+0000 7f4fc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431637 cookie 94220769475120 notifier 6612 bl.length()=925 2024-09-12T18:46:02.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.624+0000 7f4fc67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 info.flags=0x17 2024-09-12T18:46:02.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.624+0000 7f4fc67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 to cache LRU end 2024-09-12T18:46:02.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.624+0000 7f4fc67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:02.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.628+0000 7f50e4fc39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.23]): orig_sources= new_sources= 2024-09-12T18:46:02.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.628+0000 7f50e4fc39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.23]): potential sources added=[] removed=[] 2024-09-12T18:46:02.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.628+0000 7f50e4fc39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.23]): orig_dests= new_dests= 2024-09-12T18:46:02.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.628+0000 7f50e4fc39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.23]): potential dests added=[] removed=[] 2024-09-12T18:46:02.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.0 2024-09-12T18:46:02.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.0 2024-09-12T18:46:02.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.1 2024-09-12T18:46:02.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.1 2024-09-12T18:46:02.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.2 2024-09-12T18:46:02.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.2 2024-09-12T18:46:02.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.3 2024-09-12T18:46:02.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.3 2024-09-12T18:46:02.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.4 2024-09-12T18:46:02.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.4 2024-09-12T18:46:02.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.5 2024-09-12T18:46:02.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.5 2024-09-12T18:46:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.6 2024-09-12T18:46:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.6 2024-09-12T18:46:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.7 2024-09-12T18:46:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.7 2024-09-12T18:46:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.8 2024-09-12T18:46:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.8 2024-09-12T18:46:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.9 2024-09-12T18:46:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.9 2024-09-12T18:46:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.10 2024-09-12T18:46:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.10 2024-09-12T18:46:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.11 2024-09-12T18:46:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1.11 2024-09-12T18:46:02.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.0 2024-09-12T18:46:02.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1 2024-09-12T18:46:02.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.2 2024-09-12T18:46:02.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.636+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.3 2024-09-12T18:46:02.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.640+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.4 2024-09-12T18:46:02.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.640+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.5 2024-09-12T18:46:02.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.640+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.6 2024-09-12T18:46:02.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.640+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.7 2024-09-12T18:46:02.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.644+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.8 2024-09-12T18:46:02.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.644+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.9 2024-09-12T18:46:02.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.644+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.10 2024-09-12T18:46:02.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.648+0000 7f50e4fc39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 : hit (requested=0x17, cached=0x17) 2024-09-12T18:46:02.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.648+0000 7f50e4fc39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 2024-09-12T18:46:02.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.652+0000 7f50e4fc39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 info.flags=0x17 2024-09-12T18:46:02.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.652+0000 7f50e4fc39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 to cache LRU end 2024-09-12T18:46:02.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.652+0000 7f50e4fc39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:02.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.652+0000 7f50e4fc39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23, ofs0, ns] 2024-09-12T18:46:02.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.652+0000 7f4fc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431638 cookie 94220769475120 notifier 6612 bl.length()=925 2024-09-12T18:46:02.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.652+0000 7f4fc67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 info.flags=0x17 2024-09-12T18:46:02.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.652+0000 7f4fc67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 to cache LRU end 2024-09-12T18:46:02.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.652+0000 7f4fc67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:02.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.652+0000 7f50e4fc39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.23]): orig_sources= new_sources= 2024-09-12T18:46:02.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.652+0000 7f50e4fc39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.23]): potential sources added=[] removed=[] 2024-09-12T18:46:02.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.652+0000 7f50e4fc39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.23]): orig_dests= new_dests= 2024-09-12T18:46:02.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.652+0000 7f50e4fc39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.23]): potential dests added=[] removed=[] 2024-09-12T18:46:02.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.660+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.0 2024-09-12T18:46:02.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.660+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.1 2024-09-12T18:46:02.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.660+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.2 2024-09-12T18:46:02.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.660+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.3 2024-09-12T18:46:02.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.660+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.4 2024-09-12T18:46:02.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.660+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.5 2024-09-12T18:46:02.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.664+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.6 2024-09-12T18:46:02.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.664+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.7 2024-09-12T18:46:02.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.664+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.8 2024-09-12T18:46:02.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.664+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.9 2024-09-12T18:46:02.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.664+0000 7f50e4fc39c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.23.10 2024-09-12T18:46:02.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.668+0000 7f50e4fc39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 : hit (requested=0x17, cached=0x17) 2024-09-12T18:46:02.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.668+0000 7f50e4fc39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 2024-09-12T18:46:02.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.668+0000 7f50e4fc39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 info.flags=0x17 2024-09-12T18:46:02.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.668+0000 7f50e4fc39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 to cache LRU end 2024-09-12T18:46:02.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.668+0000 7f50e4fc39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:02.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.668+0000 7f50e4fc39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23, ofs0, ns] 2024-09-12T18:46:02.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.668+0000 7f4fc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431639 cookie 94220769475120 notifier 6612 bl.length()=893 2024-09-12T18:46:02.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.668+0000 7f4fc67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 info.flags=0x17 2024-09-12T18:46:02.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.668+0000 7f4fc67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.23 to cache LRU end 2024-09-12T18:46:02.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.668+0000 7f4fc67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:02.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.668+0000 7f50e4fc39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.23]): orig_sources= new_sources= 2024-09-12T18:46:02.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.668+0000 7f50e4fc39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.23]): potential sources added=[] removed=[] 2024-09-12T18:46:02.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.668+0000 7f50e4fc39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.23]): orig_dests= new_dests= 2024-09-12T18:46:02.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.668+0000 7f50e4fc39c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.23]): potential dests added=[] removed=[] 2024-09-12T18:46:02.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.672+0000 7f50e4fc39c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T18:46:02.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.676+0000 7f4f997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:02.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.680+0000 7f50e4fc39c0 20 remove_watcher() i=0 2024-09-12T18:46:02.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.680+0000 7f50e4fc39c0 2 removed watcher, disabling cache 2024-09-12T18:46:02.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.684+0000 7f50e4fc39c0 20 remove_watcher() i=1 2024-09-12T18:46:02.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.684+0000 7f50e4fc39c0 20 remove_watcher() i=2 2024-09-12T18:46:02.690 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.688+0000 7f50e4fc39c0 20 remove_watcher() i=3 2024-09-12T18:46:02.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.692+0000 7f50e4fc39c0 20 remove_watcher() i=4 2024-09-12T18:46:02.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.692+0000 7f50e4fc39c0 20 remove_watcher() i=5 2024-09-12T18:46:02.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.692+0000 7f50e4fc39c0 20 remove_watcher() i=6 2024-09-12T18:46:02.697 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.696+0000 7f50e4fc39c0 20 remove_watcher() i=7 2024-09-12T18:46:02.717 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T18:46:02.750 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:02.751 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:02.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.792+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.796+0000 7f50a40bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:02.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.796+0000 7f50a40bb9c0 20 realm 2024-09-12T18:46:02.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.796+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.796+0000 7f50a40bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:02.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.796+0000 7f50a40bb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:02.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.796+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.796+0000 7f50a40bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:02.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.796+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.798 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.796+0000 7f50a40bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:02.798 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.796+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:02.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.796+0000 7f50a40bb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:02.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.796+0000 7f50a40bb9c0 20 searching for the correct realm 2024-09-12T18:46:02.804 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.804+0000 7f50a1bc1640 0 -- 172.21.15.111:0/3032492633 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f509c004040 msgr2=0x7f509c0c2930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:02.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:02.808+0000 7f50a13c0640 0 -- 172.21.15.111:0/3032492633 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f509c0de500 msgr2=0x7f509c0de920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:03.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.024+0000 7f50a40bb9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:03.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.024+0000 7f50a40bb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:03.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.024+0000 7f50a40bb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:03.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.024+0000 7f50a40bb9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:03.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.024+0000 7f50a40bb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:03.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.024+0000 7f50a40bb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:03.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.024+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.028+0000 7f50a40bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:03.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.028+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.028+0000 7f50a40bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:03.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.028+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.028+0000 7f50a40bb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:03.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.028+0000 7f50a40bb9c0 20 zone default found 2024-09-12T18:46:03.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.028+0000 7f50a40bb9c0 4 Realm: () 2024-09-12T18:46:03.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.028+0000 7f50a40bb9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:03.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.028+0000 7f50a40bb9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:03.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.028+0000 7f50a40bb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:03.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.028+0000 7f50a40bb9c0 20 zonegroup default 2024-09-12T18:46:03.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.028+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.028+0000 7f50a40bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:03.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.028+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.032+0000 7f50a40bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:03.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.032+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.032+0000 7f50a40bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:03.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.032+0000 7f50a40bb9c0 20 started sync module instance, tier type = 2024-09-12T18:46:03.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.032+0000 7f50a40bb9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:03.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.052+0000 7f50a40bb9c0 20 add_watcher() i=0 2024-09-12T18:46:03.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.052+0000 7f50a40bb9c0 20 add_watcher() i=1 2024-09-12T18:46:03.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.052+0000 7f50a40bb9c0 20 add_watcher() i=2 2024-09-12T18:46:03.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.052+0000 7f50a40bb9c0 20 add_watcher() i=3 2024-09-12T18:46:03.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.052+0000 7f50a40bb9c0 20 add_watcher() i=4 2024-09-12T18:46:03.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.052+0000 7f50a40bb9c0 20 add_watcher() i=5 2024-09-12T18:46:03.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.052+0000 7f50a40bb9c0 20 add_watcher() i=6 2024-09-12T18:46:03.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.056+0000 7f50a40bb9c0 20 add_watcher() i=7 2024-09-12T18:46:03.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.056+0000 7f50a40bb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:03.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.060+0000 7f4f537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:03.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.060+0000 7f50a40bb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:03.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.060+0000 7f50a40bb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:03.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.060+0000 7f50a40bb9c0 5 note: GC not initialized 2024-09-12T18:46:03.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.060+0000 7f4f527fc640 20 reqs_thread_entry: start 2024-09-12T18:46:03.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.060+0000 7f50a40bb9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:03.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.060+0000 7f50a40bb9c0 20 Filter name: none 2024-09-12T18:46:03.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.060+0000 7f4ec3fff640 20 reqs_thread_entry: start 2024-09-12T18:46:03.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.060+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.060+0000 7f50a40bb9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:03.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.060+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.064+0000 7f50a40bb9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:03.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.064+0000 7f50a40bb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:03.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.064+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.064+0000 7f50a40bb9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:03.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.064+0000 7f50a40bb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.064+0000 7f50a40bb9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:03.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.064+0000 7f50a40bb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:03.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.064+0000 7f4f537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:03.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.072+0000 7f50a40bb9c0 20 remove_watcher() i=0 2024-09-12T18:46:03.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.072+0000 7f50a40bb9c0 2 removed watcher, disabling cache 2024-09-12T18:46:03.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.072+0000 7f50a40bb9c0 20 remove_watcher() i=1 2024-09-12T18:46:03.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.076+0000 7f50a40bb9c0 20 remove_watcher() i=2 2024-09-12T18:46:03.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.076+0000 7f50a40bb9c0 20 remove_watcher() i=3 2024-09-12T18:46:03.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.080+0000 7f50a40bb9c0 20 remove_watcher() i=4 2024-09-12T18:46:03.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.080+0000 7f50a40bb9c0 20 remove_watcher() i=5 2024-09-12T18:46:03.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.080+0000 7f50a40bb9c0 20 remove_watcher() i=6 2024-09-12T18:46:03.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.084+0000 7f50a40bb9c0 20 remove_watcher() i=7 2024-09-12T18:46:03.099 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:03.099 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:46:03.099 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-set-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T18:46:03.099 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:03.100 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.100 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.104 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.104 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.150 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.150 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.193 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T18:46:03.193 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:03.194 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.194 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.214 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.214 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.259 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.259 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.278 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.279 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.302 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.302 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.321 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.321 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.339 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.339 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.358 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.358 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.377 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.377 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.396 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.397 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.416 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.417 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.435 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.435 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.454 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.454 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.473 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.473 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.493 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.493 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.512 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.512 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.532 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.532 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.551 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.551 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.571 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.571 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.593 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.594 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.612 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.612 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.630 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:03.630 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:03.647 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T18:46:03.679 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:03.680 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:03.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.724+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.724+0000 7f585f7629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:03.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.724+0000 7f585f7629c0 20 realm 2024-09-12T18:46:03.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.724+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.724+0000 7f585f7629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:03.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.724+0000 7f585f7629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:03.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.724+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.724+0000 7f585f7629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:03.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.724+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.728+0000 7f585f7629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:03.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.728+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.728+0000 7f585f7629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:03.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.728+0000 7f585f7629c0 20 searching for the correct realm 2024-09-12T18:46:03.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.732+0000 7f585d268640 0 -- 172.21.15.111:0/1561358760 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f5858030420 msgr2=0x7f58580308a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:46:03.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.740+0000 7f585ca67640 0 -- 172.21.15.111:0/1561358760 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f5858040040 msgr2=0x7f5858045460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:46:03.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.956+0000 7f585f7629c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:03.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.956+0000 7f585f7629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:03.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.956+0000 7f585f7629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:03.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.956+0000 7f585f7629c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:03.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.956+0000 7f585f7629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:03.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.956+0000 7f585f7629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:03.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.956+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.956+0000 7f585f7629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:03.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.956+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:03.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:03.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 20 zone default found 2024-09-12T18:46:03.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 4 Realm: () 2024-09-12T18:46:03.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:03.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:03.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:03.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 20 zonegroup default 2024-09-12T18:46:03.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:03.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:03.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:03.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 20 started sync module instance, tier type = 2024-09-12T18:46:03.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.960+0000 7f585f7629c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:03.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.984+0000 7f585f7629c0 20 add_watcher() i=0 2024-09-12T18:46:03.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.984+0000 7f585f7629c0 20 add_watcher() i=1 2024-09-12T18:46:03.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.984+0000 7f585f7629c0 20 add_watcher() i=2 2024-09-12T18:46:03.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.984+0000 7f585f7629c0 20 add_watcher() i=3 2024-09-12T18:46:03.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.984+0000 7f585f7629c0 20 add_watcher() i=4 2024-09-12T18:46:03.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.984+0000 7f585f7629c0 20 add_watcher() i=5 2024-09-12T18:46:03.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.984+0000 7f585f7629c0 20 add_watcher() i=6 2024-09-12T18:46:03.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.988+0000 7f585f7629c0 20 add_watcher() i=7 2024-09-12T18:46:03.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.988+0000 7f585f7629c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:03.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.992+0000 7f57137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:03.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.992+0000 7f585f7629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:03.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.992+0000 7f585f7629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:03.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.992+0000 7f585f7629c0 5 note: GC not initialized 2024-09-12T18:46:03.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.992+0000 7f57127e4640 20 reqs_thread_entry: start 2024-09-12T18:46:03.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.996+0000 7f585f7629c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:03.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.996+0000 7f585f7629c0 20 Filter name: none 2024-09-12T18:46:03.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.996+0000 7f5683fff640 20 reqs_thread_entry: start 2024-09-12T18:46:03.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.996+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.998 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.996+0000 7f585f7629c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:03.998 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.996+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:03.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.996+0000 7f585f7629c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:04.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.996+0000 7f585f7629c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:04.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:03.996+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.000+0000 7f585f7629c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:04.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.000+0000 7f585f7629c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.000+0000 7f585f7629c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:04.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.000+0000 7f585f7629c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:04.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.004+0000 7f57137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:04.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.008+0000 7f585f7629c0 20 remove_watcher() i=0 2024-09-12T18:46:04.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.008+0000 7f585f7629c0 2 removed watcher, disabling cache 2024-09-12T18:46:04.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.008+0000 7f585f7629c0 20 remove_watcher() i=1 2024-09-12T18:46:04.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.012+0000 7f585f7629c0 20 remove_watcher() i=2 2024-09-12T18:46:04.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.012+0000 7f585f7629c0 20 remove_watcher() i=3 2024-09-12T18:46:04.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.016+0000 7f585f7629c0 20 remove_watcher() i=4 2024-09-12T18:46:04.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.016+0000 7f585f7629c0 20 remove_watcher() i=5 2024-09-12T18:46:04.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.020+0000 7f585f7629c0 20 remove_watcher() i=6 2024-09-12T18:46:04.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.020+0000 7f585f7629c0 20 remove_watcher() i=7 2024-09-12T18:46:04.037 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.037 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:46:04.038 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-set-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:46:04.038 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.038 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T18:46:04.074 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:04.074 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:04.117 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 realm 2024-09-12T18:46:04.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.116+0000 7fd52e73d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:04.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.120+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:04.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.120+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.120+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:04.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.120+0000 7fd52e73d9c0 20 searching for the correct realm 2024-09-12T18:46:04.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.124+0000 7fd52ca44640 0 -- 172.21.15.111:0/2136067931 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x55e09c47a320 msgr2=0x55e09c47c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:04.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.132+0000 7fd52ba42640 0 -- 172.21.15.111:0/2136067931 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fd52411dbb0 msgr2=0x7fd5240ab7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:04.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:04.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:04.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:04.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:04.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:04.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:04.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:04.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:04.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 zone default found 2024-09-12T18:46:04.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 4 Realm: () 2024-09-12T18:46:04.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:04.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:04.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:04.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 zonegroup default 2024-09-12T18:46:04.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 started sync module instance, tier type = 2024-09-12T18:46:04.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:04.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=0 2024-09-12T18:46:04.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=1 2024-09-12T18:46:04.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=2 2024-09-12T18:46:04.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=3 2024-09-12T18:46:04.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=4 2024-09-12T18:46:04.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=5 2024-09-12T18:46:04.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=6 2024-09-12T18:46:04.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=7 2024-09-12T18:46:04.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.160+0000 7fd52e73d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:04.164 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd3e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:04.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:04.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:04.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 note: GC not initialized 2024-09-12T18:46:04.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd3e1fdb640 20 reqs_thread_entry: start 2024-09-12T18:46:04.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:04.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 Filter name: none 2024-09-12T18:46:04.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd3537fe640 20 reqs_thread_entry: start 2024-09-12T18:46:04.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:46:04.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:04.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:46:04.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:46:04.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 : miss 2024-09-12T18:46:04.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:04.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 info.flags=0x17 2024-09-12T18:46:04.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 to cache LRU end 2024-09-12T18:46:04.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:46:04.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:04.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 2024-09-12T18:46:04.174 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd52e73d9c0 time 2024-09-12T18:46:04.175520+0000 2024-09-12T18:46:04.174 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:46:04.175 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:04.176 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd5320172eb] 2024-09-12T18:46:04.176 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd53201749f] 2024-09-12T18:46:04.176 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e099f5ccc1] 2024-09-12T18:46:04.176 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422078) [0x55e09a9ba078] 2024-09-12T18:46:04.176 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e099f71ced] 2024-09-12T18:46:04.176 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:46:04.176 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd530e7dd90] 2024-09-12T18:46:04.176 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:46:04.176 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:46:04.176 INFO:tasks.workunit.client.0.smithi111.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:46:04.176 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7fd52e73d9c0 thread_name:radosgw-admin 2024-09-12T18:46:04.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.172+0000 7fd52e73d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd52e73d9c0 time 2024-09-12T18:46:04.175520+0000 2024-09-12T18:46:04.177 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:46:04.177 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.177 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:04.177 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd5320172eb] 2024-09-12T18:46:04.177 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd53201749f] 2024-09-12T18:46:04.177 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e099f5ccc1] 2024-09-12T18:46:04.177 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422078) [0x55e09a9ba078] 2024-09-12T18:46:04.177 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e099f71ced] 2024-09-12T18:46:04.177 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:46:04.177 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd530e7dd90] 2024-09-12T18:46:04.177 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:46:04.177 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:46:04.177 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.201 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:04.202 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd530e96520] 2024-09-12T18:46:04.202 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:46:04.202 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:46:04.202 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:46:04.202 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd532017345] 2024-09-12T18:46:04.202 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd53201749f] 2024-09-12T18:46:04.202 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e099f5ccc1] 2024-09-12T18:46:04.202 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422078) [0x55e09a9ba078] 2024-09-12T18:46:04.202 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e099f71ced] 2024-09-12T18:46:04.202 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:46:04.202 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd530e7dd90] 2024-09-12T18:46:04.202 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:46:04.202 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:46:04.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.176+0000 7fd52e73d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:46:04.203 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7fd52e73d9c0 thread_name:radosgw-admin 2024-09-12T18:46:04.203 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.203 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:04.203 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd530e96520] 2024-09-12T18:46:04.203 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:46:04.203 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:46:04.203 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:46:04.203 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd532017345] 2024-09-12T18:46:04.203 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd53201749f] 2024-09-12T18:46:04.203 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e099f5ccc1] 2024-09-12T18:46:04.203 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422078) [0x55e09a9ba078] 2024-09-12T18:46:04.203 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e099f71ced] 2024-09-12T18:46:04.204 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:46:04.204 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd530e7dd90] 2024-09-12T18:46:04.204 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:46:04.204 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:46:04.204 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:46:04.204 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.204 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:46:04.204 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:46:04.092+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.204 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:46:04.092+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.204 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:46:04.092+0000 7fd52e73d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:04.204 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:46:04.092+0000 7fd52e73d9c0 10 monclient(hunting): authenticate will time out at 2151.234383s 2024-09-12T18:46:04.204 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): get_auth_request con 0x55e09c38c370 auth_method 0 2024-09-12T18:46:04.204 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.204 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.205 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.205 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:46:04.092+0000 7fd52ba42640 10 monclient(hunting): get_auth_request con 0x55e09c2435b0 auth_method 0 2024-09-12T18:46:04.205 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:46:04.092+0000 7fd52ba42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.205 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:46:04.092+0000 7fd52ba42640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.205 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:46:04.092+0000 7fd52ba42640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.205 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.205 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.205 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.205 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:46:04.092+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.205 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:46:04.092+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.205 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:46:04.092+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.205 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): handle_auth_done global_id 6657 payload 274 2024-09-12T18:46:04.205 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient: _finish_hunting 0 2024-09-12T18:46:04.205 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:46:04.092+0000 7fd52ca44640 1 monclient: found mon.noname-a 2024-09-12T18:46:04.206 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:46:04.206 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.206 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:46:04.206 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: dump: 2024-09-12T18:46:04.206 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.206 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.206 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.206 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.206 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.206 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.206 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.206 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.206 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.207 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.207 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: _finish_auth 0 2024-09-12T18:46:04.207 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: _check_auth_tickets 2024-09-12T18:46:04.207 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:04.207 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.207 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:46:04.207 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: dump: 2024-09-12T18:46:04.207 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.207 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.207 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.207 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.207 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.207 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.207 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.208 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.208 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.208 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.208 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:46:04.092+0000 7fd52e73d9c0 5 monclient: authenticate success, global_id 6657 2024-09-12T18:46:04.208 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:46:04.092+0000 7fd52e73d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:46:04.208 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:46:04.092+0000 7fd52e73d9c0 4 set_mon_vals no callback set 2024-09-12T18:46:04.208 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: shutdown 2024-09-12T18:46:04.208 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) unregister_commands rotate-key 2024-09-12T18:46:04.208 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:04.208 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:04.208 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: monmap: 2024-09-12T18:46:04.208 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:04.208 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:04.209 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:04.209 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:04.209 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:04.209 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.209 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:04.209 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:04.209 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:04.209 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.209 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding auth protocol: cephx 2024-09-12T18:46:04.209 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding auth protocol: cephx 2024-09-12T18:46:04.209 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding auth protocol: cephx 2024-09-12T18:46:04.209 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: secure 2024-09-12T18:46:04.209 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: crc 2024-09-12T18:46:04.210 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: secure 2024-09-12T18:46:04.210 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: crc 2024-09-12T18:46:04.210 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: secure 2024-09-12T18:46:04.210 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: crc 2024-09-12T18:46:04.210 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: crc 2024-09-12T18:46:04.210 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: secure 2024-09-12T18:46:04.210 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: crc 2024-09-12T18:46:04.210 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: secure 2024-09-12T18:46:04.210 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: crc 2024-09-12T18:46:04.210 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: secure 2024-09-12T18:46:04.210 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.210 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 1 librados: starting msgr at 2024-09-12T18:46:04.210 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 1 librados: starting objecter 2024-09-12T18:46:04.210 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command objecter_requests hook 0x55e09c2124c0 2024-09-12T18:46:04.211 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 1 librados: setting wanted keys 2024-09-12T18:46:04.211 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 1 librados: calling monclient init 2024-09-12T18:46:04.211 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: init 2024-09-12T18:46:04.211 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding auth protocol: cephx 2024-09-12T18:46:04.211 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding auth protocol: cephx 2024-09-12T18:46:04.211 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding auth protocol: cephx 2024-09-12T18:46:04.211 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: secure 2024-09-12T18:46:04.211 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: crc 2024-09-12T18:46:04.211 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: secure 2024-09-12T18:46:04.211 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: crc 2024-09-12T18:46:04.211 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: secure 2024-09-12T18:46:04.211 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: crc 2024-09-12T18:46:04.212 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: crc 2024-09-12T18:46:04.212 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: secure 2024-09-12T18:46:04.212 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: crc 2024-09-12T18:46:04.212 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: secure 2024-09-12T18:46:04.212 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: crc 2024-09-12T18:46:04.212 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: secure 2024-09-12T18:46:04.212 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.212 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.212 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command rotate-key hook 0x55e09c3861b8 2024-09-12T18:46:04.212 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:04.212 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:46:04.212 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e09c23d530 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:04.212 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e09c2435b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:04.213 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e09c38c370 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:04.213 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.213 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.213 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.213 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:04.213 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): authenticate will time out at 2151.237368s 2024-09-12T18:46:04.213 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): get_auth_request con 0x55e09c38c370 auth_method 0 2024-09-12T18:46:04.213 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.213 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.213 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.213 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:46:04.096+0000 7fd52c243640 10 monclient(hunting): get_auth_request con 0x55e09c23d530 auth_method 0 2024-09-12T18:46:04.213 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:46:04.096+0000 7fd52c243640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.213 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:46:04.096+0000 7fd52c243640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.214 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:46:04.096+0000 7fd52c243640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.214 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.214 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.214 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.214 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:46:04.096+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.214 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:46:04.096+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.214 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:46:04.096+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.214 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): handle_auth_done global_id 6281 payload 824 2024-09-12T18:46:04.214 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient: _finish_hunting 0 2024-09-12T18:46:04.214 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:46:04.096+0000 7fd52ca44640 1 monclient: found mon.noname-c 2024-09-12T18:46:04.214 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.215 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.215 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:46:04.215 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: dump: 2024-09-12T18:46:04.215 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.215 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.215 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.215 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.215 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.215 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.215 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.215 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.216 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.216 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.216 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: _finish_auth 0 2024-09-12T18:46:04.216 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: _check_auth_tickets 2024-09-12T18:46:04.216 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:04.216 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.216 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:46:04.216 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: dump: 2024-09-12T18:46:04.216 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.216 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.217 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.217 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.217 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.217 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.217 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.217 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.217 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.217 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.217 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 monclient: authenticate success, global_id 6281 2024-09-12T18:46:04.217 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:46:04.096+0000 7fd41a60c640 4 set_mon_vals no callback set 2024-09-12T18:46:04.217 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: _renew_subs 2024-09-12T18:46:04.217 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.218 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: _renew_subs 2024-09-12T18:46:04.218 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.218 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 1 librados: init done 2024-09-12T18:46:04.218 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:46:04.096+0000 7fd418e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:46:04.218 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:46:04.096+0000 7fd418e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:04.218 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:46:04.096+0000 7fd418e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:04.218 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:46:04.100+0000 7fd52c243640 10 monclient: get_auth_request con 0x7fd414070ae0 auth_method 0 2024-09-12T18:46:04.218 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:46:04.100+0000 7fd52ba42640 10 monclient: get_auth_request con 0x55e09c3ae690 auth_method 0 2024-09-12T18:46:04.218 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:46:04.100+0000 7fd52c243640 10 monclient: get_auth_request con 0x55e09c3d0c60 auth_method 0 2024-09-12T18:46:04.218 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:46:04.100+0000 7fd52ba42640 10 monclient: get_auth_request con 0x55e09c3d4ea0 auth_method 0 2024-09-12T18:46:04.218 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient: get_auth_request con 0x55e09c3d44f0 auth_method 0 2024-09-12T18:46:04.219 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:04.219 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:04.219 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient: monmap: 2024-09-12T18:46:04.219 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:04.219 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:04.219 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:04.219 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:04.219 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:04.219 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.219 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:04.219 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:04.219 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:04.220 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.220 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding auth protocol: cephx 2024-09-12T18:46:04.220 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding auth protocol: cephx 2024-09-12T18:46:04.220 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding auth protocol: cephx 2024-09-12T18:46:04.220 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: secure 2024-09-12T18:46:04.220 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: crc 2024-09-12T18:46:04.220 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: secure 2024-09-12T18:46:04.220 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: crc 2024-09-12T18:46:04.220 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: secure 2024-09-12T18:46:04.220 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: crc 2024-09-12T18:46:04.220 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: crc 2024-09-12T18:46:04.221 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: secure 2024-09-12T18:46:04.221 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: crc 2024-09-12T18:46:04.221 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: secure 2024-09-12T18:46:04.221 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: crc 2024-09-12T18:46:04.221 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: secure 2024-09-12T18:46:04.221 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.221 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e09c3e0a90 EEXIST 2024-09-12T18:46:04.221 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient: init 2024-09-12T18:46:04.221 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding auth protocol: cephx 2024-09-12T18:46:04.221 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding auth protocol: cephx 2024-09-12T18:46:04.221 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding auth protocol: cephx 2024-09-12T18:46:04.222 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: secure 2024-09-12T18:46:04.222 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: crc 2024-09-12T18:46:04.222 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: secure 2024-09-12T18:46:04.222 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: crc 2024-09-12T18:46:04.222 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: secure 2024-09-12T18:46:04.222 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: crc 2024-09-12T18:46:04.222 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: crc 2024-09-12T18:46:04.222 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: secure 2024-09-12T18:46:04.222 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: crc 2024-09-12T18:46:04.222 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: secure 2024-09-12T18:46:04.223 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: crc 2024-09-12T18:46:04.223 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: secure 2024-09-12T18:46:04.223 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.223 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.223 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command rotate-key cmddesc rotate-key hook 0x55e09c3dc0d0 EEXIST 2024-09-12T18:46:04.223 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:04.223 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:46:04.223 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e09c404c40 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:04.223 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e09c404570 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:04.223 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e09c402f50 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:04.224 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.224 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.224 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.224 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:04.224 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): authenticate will time out at 2151.247374s 2024-09-12T18:46:04.224 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): get_auth_request con 0x55e09c404570 auth_method 0 2024-09-12T18:46:04.224 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.224 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.224 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.224 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:46:04.104+0000 7fd52c243640 10 monclient(hunting): get_auth_request con 0x55e09c402f50 auth_method 0 2024-09-12T18:46:04.225 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:46:04.104+0000 7fd52c243640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.225 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:46:04.104+0000 7fd52c243640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.225 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:46:04.104+0000 7fd52c243640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.225 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.225 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.225 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.225 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:46:04.104+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.225 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:46:04.104+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.225 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:46:04.104+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.225 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): handle_auth_done global_id 6284 payload 824 2024-09-12T18:46:04.226 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient: _finish_hunting 0 2024-09-12T18:46:04.226 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:46:04.104+0000 7fd52ca44640 1 monclient: found mon.noname-c 2024-09-12T18:46:04.226 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.226 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.226 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:46:04.226 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: dump: 2024-09-12T18:46:04.226 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.226 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.226 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.226 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.227 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.227 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.227 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.227 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.227 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.227 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.227 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: _finish_auth 0 2024-09-12T18:46:04.227 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:46:04.227 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:04.227 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.227 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:46:04.227 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: dump: 2024-09-12T18:46:04.228 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.228 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.228 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.228 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.228 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.228 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.228 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.228 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.228 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.228 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.228 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:46:04.108+0000 7fd52d245640 4 set_mon_vals no callback set 2024-09-12T18:46:04.229 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 monclient: authenticate success, global_id 6284 2024-09-12T18:46:04.229 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: _renew_subs 2024-09-12T18:46:04.229 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.229 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: _renew_subs 2024-09-12T18:46:04.229 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.229 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:46:04.108+0000 7fd411ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:46:04.229 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:46:04.108+0000 7fd411ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:04.229 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:46:04.108+0000 7fd411ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:04.229 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:46:04.108+0000 7fd52ba42640 10 monclient: get_auth_request con 0x7fd404070a20 auth_method 0 2024-09-12T18:46:04.229 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: get_monmap_and_config 2024-09-12T18:46:04.229 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:04.229 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:04.230 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: monmap: 2024-09-12T18:46:04.230 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:04.230 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:04.230 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:04.230 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:04.230 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:04.230 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.230 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:04.230 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:04.230 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:04.230 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.231 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding auth protocol: cephx 2024-09-12T18:46:04.231 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding auth protocol: cephx 2024-09-12T18:46:04.231 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding auth protocol: cephx 2024-09-12T18:46:04.231 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.231 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.231 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.231 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.231 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.231 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.231 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.231 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.231 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.231 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.232 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.232 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.232 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.232 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: init 2024-09-12T18:46:04.232 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding auth protocol: cephx 2024-09-12T18:46:04.232 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding auth protocol: cephx 2024-09-12T18:46:04.232 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding auth protocol: cephx 2024-09-12T18:46:04.232 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: secure 2024-09-12T18:46:04.232 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: crc 2024-09-12T18:46:04.232 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: secure 2024-09-12T18:46:04.232 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: crc 2024-09-12T18:46:04.232 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: secure 2024-09-12T18:46:04.232 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: crc 2024-09-12T18:46:04.232 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: crc 2024-09-12T18:46:04.233 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: secure 2024-09-12T18:46:04.233 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: crc 2024-09-12T18:46:04.233 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: secure 2024-09-12T18:46:04.233 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: crc 2024-09-12T18:46:04.233 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: secure 2024-09-12T18:46:04.233 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.233 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.233 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc6c2ae128 EEXIST 2024-09-12T18:46:04.233 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:04.233 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:46:04.233 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e09c4524c0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:04.233 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e09c4528a0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:04.234 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e09c454c40 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:04.234 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.234 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.234 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.234 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:04.234 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): authenticate will time out at 2151.251847s 2024-09-12T18:46:04.234 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:46:04.108+0000 7fd52ba42640 10 monclient(hunting): get_auth_request con 0x55e09c4524c0 auth_method 0 2024-09-12T18:46:04.234 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:46:04.108+0000 7fd52ba42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.234 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:46:04.108+0000 7fd52ba42640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.234 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:46:04.108+0000 7fd52ba42640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.234 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): get_auth_request con 0x55e09c454c40 auth_method 0 2024-09-12T18:46:04.234 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.234 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.234 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.235 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.235 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.235 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.235 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.235 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.235 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.235 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_done global_id 6287 payload 274 2024-09-12T18:46:04.235 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient: _finish_hunting 0 2024-09-12T18:46:04.235 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:46:04.112+0000 7fd52ba42640 1 monclient: found mon.noname-c 2024-09-12T18:46:04.235 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.235 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.235 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:46:04.235 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: dump: 2024-09-12T18:46:04.235 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.236 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.236 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.236 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.236 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.236 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.236 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.236 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.236 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.236 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.236 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: _finish_auth 0 2024-09-12T18:46:04.236 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: _check_auth_tickets 2024-09-12T18:46:04.236 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:04.237 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.237 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:46:04.237 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: dump: 2024-09-12T18:46:04.237 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.237 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.237 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.237 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.237 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.237 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.237 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.237 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.237 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.237 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.237 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 monclient: authenticate success, global_id 6287 2024-09-12T18:46:04.238 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:46:04.238 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 4 set_mon_vals no callback set 2024-09-12T18:46:04.238 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: shutdown 2024-09-12T18:46:04.238 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:04.238 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:04.238 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: monmap: 2024-09-12T18:46:04.238 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:04.238 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:04.238 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:04.238 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:04.238 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:04.238 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.238 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:04.239 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:04.239 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:04.239 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.239 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding auth protocol: cephx 2024-09-12T18:46:04.239 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding auth protocol: cephx 2024-09-12T18:46:04.239 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding auth protocol: cephx 2024-09-12T18:46:04.239 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.239 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.239 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.239 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.239 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.239 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.239 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.239 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.240 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.240 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.240 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.240 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.240 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.240 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 1 librados: starting msgr at 2024-09-12T18:46:04.240 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 1 librados: starting objecter 2024-09-12T18:46:04.240 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e09c428740 EEXIST 2024-09-12T18:46:04.240 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 1 librados: setting wanted keys 2024-09-12T18:46:04.240 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 1 librados: calling monclient init 2024-09-12T18:46:04.240 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: init 2024-09-12T18:46:04.240 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding auth protocol: cephx 2024-09-12T18:46:04.240 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding auth protocol: cephx 2024-09-12T18:46:04.241 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding auth protocol: cephx 2024-09-12T18:46:04.241 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: secure 2024-09-12T18:46:04.241 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: crc 2024-09-12T18:46:04.241 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: secure 2024-09-12T18:46:04.241 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: crc 2024-09-12T18:46:04.241 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: secure 2024-09-12T18:46:04.241 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: crc 2024-09-12T18:46:04.241 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: crc 2024-09-12T18:46:04.241 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: secure 2024-09-12T18:46:04.241 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: crc 2024-09-12T18:46:04.241 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: secure 2024-09-12T18:46:04.241 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: crc 2024-09-12T18:46:04.241 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: secure 2024-09-12T18:46:04.242 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.242 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.242 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command rotate-key cmddesc rotate-key hook 0x55e09c406ba8 EEXIST 2024-09-12T18:46:04.242 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:04.242 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:46:04.242 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e09c4524c0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:04.242 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e09c4528a0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:04.242 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e09c454c40 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:04.242 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.242 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.242 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.243 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:04.243 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): authenticate will time out at 2151.254418s 2024-09-12T18:46:04.243 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): get_auth_request con 0x55e09c4524c0 auth_method 0 2024-09-12T18:46:04.243 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.243 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.243 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.243 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): get_auth_request con 0x55e09c454c40 auth_method 0 2024-09-12T18:46:04.243 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.243 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.243 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.243 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.243 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.243 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.244 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.244 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.244 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.244 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_done global_id 6290 payload 824 2024-09-12T18:46:04.244 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient: _finish_hunting 0 2024-09-12T18:46:04.244 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:46:04.112+0000 7fd52ba42640 1 monclient: found mon.noname-c 2024-09-12T18:46:04.244 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.244 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.244 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:46:04.244 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: dump: 2024-09-12T18:46:04.244 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.245 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.245 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.245 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.245 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.245 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.245 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.245 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.245 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.245 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.245 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: _finish_auth 0 2024-09-12T18:46:04.245 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:46:04.245 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:04.246 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.246 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:46:04.246 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: dump: 2024-09-12T18:46:04.246 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.246 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.246 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.246 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.246 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.246 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.246 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.246 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.247 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.247 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.247 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:46:04.112+0000 7fd4037fe640 4 set_mon_vals no callback set 2024-09-12T18:46:04.247 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 monclient: authenticate success, global_id 6290 2024-09-12T18:46:04.247 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: _renew_subs 2024-09-12T18:46:04.247 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.247 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: _renew_subs 2024-09-12T18:46:04.247 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.247 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 1 librados: init done 2024-09-12T18:46:04.247 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command cr dump hook 0x55e09c44c908 2024-09-12T18:46:04.247 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.247 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:46:04.116+0000 7fd401ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:46:04.248 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:46:04.116+0000 7fd401ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:04.248 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:46:04.116+0000 7fd401ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:04.248 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:46:04.116+0000 7fd52ca44640 10 monclient: get_auth_request con 0x7fd3f4070ae0 auth_method 0 2024-09-12T18:46:04.248 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:46:04.116+0000 7fd52c243640 10 monclient: get_auth_request con 0x55e09c4728f0 auth_method 0 2024-09-12T18:46:04.248 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.248 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 realm 2024-09-12T18:46:04.248 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.248 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.248 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:04.248 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.249 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.249 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.249 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:46:04.116+0000 7fd52ba42640 10 monclient: get_auth_request con 0x55e09c476a30 auth_method 0 2024-09-12T18:46:04.249 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:46:04.120+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:04.249 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:46:04.120+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.249 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:46:04.120+0000 7fd52ca44640 10 monclient: get_auth_request con 0x55e09c47a320 auth_method 0 2024-09-12T18:46:04.249 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:46:04.120+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:04.249 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:46:04.120+0000 7fd52e73d9c0 20 searching for the correct realm 2024-09-12T18:46:04.249 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:46:04.120+0000 7fd52c243640 10 monclient: get_auth_request con 0x7fd52412e040 auth_method 0 2024-09-12T18:46:04.249 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:46:04.124+0000 7fd52ba42640 10 monclient: get_auth_request con 0x7fd51c039040 auth_method 0 2024-09-12T18:46:04.249 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:46:04.124+0000 7fd52ca44640 10 monclient: get_auth_request con 0x7fd52001e070 auth_method 0 2024-09-12T18:46:04.250 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:46:04.124+0000 7fd52ca44640 0 -- 172.21.15.111:0/2136067931 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x55e09c47a320 msgr2=0x55e09c47c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:04.250 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:46:04.124+0000 7fd401ffb640 1 client.6290.objecter ms_handle_reset 0x55e09c47a320 session 0x55e09c475ea0 osd.3 2024-09-12T18:46:04.250 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:46:04.124+0000 7fd401ffb640 10 monclient: _renew_subs 2024-09-12T18:46:04.250 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:46:04.124+0000 7fd401ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.250 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:46:04.124+0000 7fd52ca44640 10 monclient: get_auth_request con 0x7fd3f4080a80 auth_method 0 2024-09-12T18:46:04.250 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:46:04.128+0000 7fd52c243640 10 monclient: get_auth_request con 0x7fd5240c9070 auth_method 0 2024-09-12T18:46:04.250 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:46:04.132+0000 7fd52ba42640 10 monclient: get_auth_request con 0x7fd52411dbb0 auth_method 0 2024-09-12T18:46:04.250 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:46:04.132+0000 7fd52ba42640 0 -- 172.21.15.111:0/2136067931 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fd52411dbb0 msgr2=0x7fd5240ab7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:04.250 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:46:04.132+0000 7fd401ffb640 1 client.6290.objecter ms_handle_reset 0x7fd52411dbb0 session 0x7fd5240ade70 osd.0 2024-09-12T18:46:04.250 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:46:04.132+0000 7fd52ba42640 10 monclient: get_auth_request con 0x55e09c47a320 auth_method 0 2024-09-12T18:46:04.250 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:04.250 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:04.251 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:04.251 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:04.251 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:04.251 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:04.251 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.251 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.251 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.251 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:04.251 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.251 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:04.251 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 zone default found 2024-09-12T18:46:04.252 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 4 Realm: () 2024-09-12T18:46:04.252 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:04.252 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:04.252 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:04.252 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 zonegroup default 2024-09-12T18:46:04.252 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.252 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.252 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.252 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.252 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.253 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.253 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 started sync module instance, tier type = 2024-09-12T18:46:04.253 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:04.253 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=0 2024-09-12T18:46:04.253 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=1 2024-09-12T18:46:04.253 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=2 2024-09-12T18:46:04.253 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=3 2024-09-12T18:46:04.253 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=4 2024-09-12T18:46:04.253 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=5 2024-09-12T18:46:04.253 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=6 2024-09-12T18:46:04.253 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=7 2024-09-12T18:46:04.254 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:04.254 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding auth protocol: cephx 2024-09-12T18:46:04.254 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding auth protocol: cephx 2024-09-12T18:46:04.254 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding auth protocol: cephx 2024-09-12T18:46:04.254 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: secure 2024-09-12T18:46:04.254 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: crc 2024-09-12T18:46:04.254 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: secure 2024-09-12T18:46:04.254 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: crc 2024-09-12T18:46:04.254 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: secure 2024-09-12T18:46:04.254 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: crc 2024-09-12T18:46:04.255 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: crc 2024-09-12T18:46:04.255 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: secure 2024-09-12T18:46:04.255 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: crc 2024-09-12T18:46:04.255 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:46:04.164+0000 7fd3e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:04.255 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: secure 2024-09-12T18:46:04.255 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: crc 2024-09-12T18:46:04.255 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: secure 2024-09-12T18:46:04.255 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.255 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:04.255 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:04.256 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command cache list hook 0x55e09c44d930 2024-09-12T18:46:04.256 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command cache inspect hook 0x55e09c44d930 2024-09-12T18:46:04.256 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command cache erase hook 0x55e09c44d930 2024-09-12T18:46:04.256 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command cache zap hook 0x55e09c44d930 2024-09-12T18:46:04.256 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 note: GC not initialized 2024-09-12T18:46:04.256 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:46:04.164+0000 7fd3e1fdb640 20 reqs_thread_entry: start 2024-09-12T18:46:04.256 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command sync trace show hook 0x7fd52000b2f0 2024-09-12T18:46:04.256 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command sync trace history hook 0x7fd52000b2f0 2024-09-12T18:46:04.256 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command sync trace active hook 0x7fd52000b2f0 2024-09-12T18:46:04.256 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command sync trace active_short hook 0x7fd52000b2f0 2024-09-12T18:46:04.257 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:04.257 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 Filter name: none 2024-09-12T18:46:04.257 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:46:04.164+0000 7fd3537fe640 20 reqs_thread_entry: start 2024-09-12T18:46:04.257 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:46:04.257 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.257 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:04.257 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:46:04.257 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:46:04.257 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 : miss 2024-09-12T18:46:04.257 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.258 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:04.258 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 info.flags=0x17 2024-09-12T18:46:04.258 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 to cache LRU end 2024-09-12T18:46:04.258 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:46:04.258 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:04.258 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 2024-09-12T18:46:04.258 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:46:04.172+0000 7fd52e73d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd52e73d9c0 time 2024-09-12T18:46:04.175520+0000 2024-09-12T18:46:04.258 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:46:04.258 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.258 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:04.258 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd5320172eb] 2024-09-12T18:46:04.258 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd53201749f] 2024-09-12T18:46:04.259 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e099f5ccc1] 2024-09-12T18:46:04.259 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422078) [0x55e09a9ba078] 2024-09-12T18:46:04.259 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e099f71ced] 2024-09-12T18:46:04.259 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:46:04.259 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd530e7dd90] 2024-09-12T18:46:04.259 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:46:04.259 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:46:04.259 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.259 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:46:04.176+0000 7fd52e73d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:46:04.259 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7fd52e73d9c0 thread_name:radosgw-admin 2024-09-12T18:46:04.259 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.259 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:04.260 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd530e96520] 2024-09-12T18:46:04.260 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:46:04.260 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:46:04.260 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:46:04.260 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd532017345] 2024-09-12T18:46:04.260 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd53201749f] 2024-09-12T18:46:04.260 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e099f5ccc1] 2024-09-12T18:46:04.260 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422078) [0x55e09a9ba078] 2024-09-12T18:46:04.260 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e099f71ced] 2024-09-12T18:46:04.260 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:46:04.260 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd530e7dd90] 2024-09-12T18:46:04.260 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:46:04.260 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:46:04.261 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:46:04.262 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:46:04.262 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:46:04.262 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:46:04.262 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:46:04.262 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:46:04.262 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:46:04.262 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:46:04.262 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:46:04.262 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:46:04.262 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:46:04.262 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:46:04.262 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:46:04.262 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:46:04.262 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:46:04.263 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:46:04.263 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:46:04.263 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:46:04.263 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:46:04.263 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:46:04.263 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:46:04.263 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:46:04.263 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:46:04.263 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:46:04.263 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:46:04.263 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:46:04.263 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:46:04.263 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:46:04.263 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:46:04.264 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:46:04.265 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:46:04.265 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:46:04.265 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:46:04.265 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:46:04.265 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:46:04.265 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:46:04.265 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:46:04.265 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:46:04.265 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:46:04.265 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:46:04.265 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:46:04.265 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:46:04.265 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:46:04.265 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:46:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:46:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:46:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:46:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:46:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:46:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:46:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:46:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:46:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:46:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:46:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:46:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:46:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:46:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:46:04.267 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:46:04.267 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:46:04.267 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:46:04.267 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:46:04.267 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:46:04.267 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:46:04.267 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:46:04.267 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:46:04.267 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:46:04.267 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:46:04.267 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd3537fe640 / http_manager 2024-09-12T18:46:04.267 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd3e1fdb640 / http_manager 2024-09-12T18:46:04.267 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd3e2fdd640 / rgw_dt_lg_renew 2024-09-12T18:46:04.268 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd401ffb640 / ms_dispatch 2024-09-12T18:46:04.268 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd4037fe640 / io_context_pool 2024-09-12T18:46:04.268 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd411ffb640 / ms_dispatch 2024-09-12T18:46:04.268 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd418e09640 / ms_dispatch 2024-09-12T18:46:04.268 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd41a60c640 / io_context_pool 2024-09-12T18:46:04.268 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd52ba42640 / msgr-worker-2 2024-09-12T18:46:04.268 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd52c243640 / msgr-worker-1 2024-09-12T18:46:04.268 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd52ca44640 / msgr-worker-0 2024-09-12T18:46:04.268 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd52d245640 / io_context_pool 2024-09-12T18:46:04.268 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd52e73d9c0 / radosgw-admin 2024-09-12T18:46:04.268 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:46:04.268 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:46:04.268 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/log/ceph/ceph-client.admin.91823.log 2024-09-12T18:46:04.269 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:46:04.269 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:46:04.269 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:46:04.092+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.269 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:46:04.092+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.269 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:46:04.092+0000 7fd52e73d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:04.269 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:46:04.092+0000 7fd52e73d9c0 10 monclient(hunting): authenticate will time out at 2151.234383s 2024-09-12T18:46:04.269 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): get_auth_request con 0x55e09c38c370 auth_method 0 2024-09-12T18:46:04.269 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.269 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.269 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.269 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:46:04.092+0000 7fd52ba42640 10 monclient(hunting): get_auth_request con 0x55e09c2435b0 auth_method 0 2024-09-12T18:46:04.269 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:46:04.092+0000 7fd52ba42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.269 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:46:04.092+0000 7fd52ba42640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.269 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:46:04.092+0000 7fd52ba42640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.270 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.270 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.270 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.270 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:46:04.092+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.270 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:46:04.092+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.270 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:46:04.092+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.270 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient(hunting): handle_auth_done global_id 6657 payload 274 2024-09-12T18:46:04.270 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient: _finish_hunting 0 2024-09-12T18:46:04.270 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:46:04.092+0000 7fd52ca44640 1 monclient: found mon.noname-a 2024-09-12T18:46:04.270 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:46:04.092+0000 7fd52ca44640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:46:04.270 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.270 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:46:04.270 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: dump: 2024-09-12T18:46:04.271 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.271 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.271 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.271 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.271 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.271 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.271 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.271 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.271 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.271 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.271 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: _finish_auth 0 2024-09-12T18:46:04.271 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: _check_auth_tickets 2024-09-12T18:46:04.271 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:04.271 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.272 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:46:04.272 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:46:04.092+0000 7fd41a60c640 10 monclient: dump: 2024-09-12T18:46:04.272 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.272 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.272 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.272 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.272 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.272 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.272 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.272 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.272 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.272 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.272 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:46:04.092+0000 7fd52e73d9c0 5 monclient: authenticate success, global_id 6657 2024-09-12T18:46:04.272 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:46:04.092+0000 7fd52e73d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:46:04.273 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:46:04.092+0000 7fd52e73d9c0 4 set_mon_vals no callback set 2024-09-12T18:46:04.273 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: shutdown 2024-09-12T18:46:04.273 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) unregister_commands rotate-key 2024-09-12T18:46:04.273 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:04.273 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:04.273 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: monmap: 2024-09-12T18:46:04.273 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:04.273 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:04.273 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:04.273 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:04.273 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:04.273 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.274 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:04.274 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:04.274 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:04.274 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.274 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding auth protocol: cephx 2024-09-12T18:46:04.274 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding auth protocol: cephx 2024-09-12T18:46:04.274 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding auth protocol: cephx 2024-09-12T18:46:04.274 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: secure 2024-09-12T18:46:04.274 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: crc 2024-09-12T18:46:04.274 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: secure 2024-09-12T18:46:04.275 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: crc 2024-09-12T18:46:04.275 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: secure 2024-09-12T18:46:04.275 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: crc 2024-09-12T18:46:04.275 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: crc 2024-09-12T18:46:04.275 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: secure 2024-09-12T18:46:04.275 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: crc 2024-09-12T18:46:04.275 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: secure 2024-09-12T18:46:04.275 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: crc 2024-09-12T18:46:04.275 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c387e60) adding con mode: secure 2024-09-12T18:46:04.275 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.275 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 1 librados: starting msgr at 2024-09-12T18:46:04.275 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 1 librados: starting objecter 2024-09-12T18:46:04.275 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command objecter_requests hook 0x55e09c2124c0 2024-09-12T18:46:04.276 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 1 librados: setting wanted keys 2024-09-12T18:46:04.276 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 1 librados: calling monclient init 2024-09-12T18:46:04.276 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: init 2024-09-12T18:46:04.276 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding auth protocol: cephx 2024-09-12T18:46:04.276 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding auth protocol: cephx 2024-09-12T18:46:04.276 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding auth protocol: cephx 2024-09-12T18:46:04.276 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: secure 2024-09-12T18:46:04.276 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: crc 2024-09-12T18:46:04.276 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: secure 2024-09-12T18:46:04.276 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: crc 2024-09-12T18:46:04.276 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: secure 2024-09-12T18:46:04.277 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: crc 2024-09-12T18:46:04.277 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: crc 2024-09-12T18:46:04.277 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: secure 2024-09-12T18:46:04.277 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: crc 2024-09-12T18:46:04.277 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: secure 2024-09-12T18:46:04.277 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: crc 2024-09-12T18:46:04.277 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c386070) adding con mode: secure 2024-09-12T18:46:04.277 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.277 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.277 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command rotate-key hook 0x55e09c3861b8 2024-09-12T18:46:04.278 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:04.278 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:46:04.278 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e09c23d530 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:04.278 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e09c2435b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:04.278 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e09c38c370 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:04.278 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.278 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.278 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.278 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:04.278 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient(hunting): authenticate will time out at 2151.237368s 2024-09-12T18:46:04.278 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): get_auth_request con 0x55e09c38c370 auth_method 0 2024-09-12T18:46:04.278 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.279 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.279 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.279 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:46:04.096+0000 7fd52c243640 10 monclient(hunting): get_auth_request con 0x55e09c23d530 auth_method 0 2024-09-12T18:46:04.279 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:46:04.096+0000 7fd52c243640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.279 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:46:04.096+0000 7fd52c243640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.279 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:46:04.096+0000 7fd52c243640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.279 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.279 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.279 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.279 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:46:04.096+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.279 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:46:04.096+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.279 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:46:04.096+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.280 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient(hunting): handle_auth_done global_id 6281 payload 824 2024-09-12T18:46:04.280 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient: _finish_hunting 0 2024-09-12T18:46:04.280 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:46:04.096+0000 7fd52ca44640 1 monclient: found mon.noname-c 2024-09-12T18:46:04.280 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:46:04.096+0000 7fd52ca44640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.280 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.280 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:46:04.280 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: dump: 2024-09-12T18:46:04.280 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.280 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.280 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.280 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.281 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.281 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.281 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.281 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.281 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.281 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.281 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: _finish_auth 0 2024-09-12T18:46:04.281 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: _check_auth_tickets 2024-09-12T18:46:04.281 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:04.281 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.281 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:46:04.282 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:46:04.096+0000 7fd418e09640 10 monclient: dump: 2024-09-12T18:46:04.282 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.282 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.282 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.282 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.282 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.282 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.282 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.282 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.282 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.282 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.283 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 5 monclient: authenticate success, global_id 6281 2024-09-12T18:46:04.283 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:46:04.096+0000 7fd41a60c640 4 set_mon_vals no callback set 2024-09-12T18:46:04.283 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: _renew_subs 2024-09-12T18:46:04.283 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.283 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: _renew_subs 2024-09-12T18:46:04.283 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.283 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:46:04.096+0000 7fd52e73d9c0 1 librados: init done 2024-09-12T18:46:04.283 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:46:04.096+0000 7fd418e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:46:04.283 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:46:04.096+0000 7fd418e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:04.283 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:46:04.096+0000 7fd418e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:04.284 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:46:04.100+0000 7fd52c243640 10 monclient: get_auth_request con 0x7fd414070ae0 auth_method 0 2024-09-12T18:46:04.284 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:46:04.100+0000 7fd52ba42640 10 monclient: get_auth_request con 0x55e09c3ae690 auth_method 0 2024-09-12T18:46:04.284 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:46:04.100+0000 7fd52c243640 10 monclient: get_auth_request con 0x55e09c3d0c60 auth_method 0 2024-09-12T18:46:04.284 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:46:04.100+0000 7fd52ba42640 10 monclient: get_auth_request con 0x55e09c3d4ea0 auth_method 0 2024-09-12T18:46:04.284 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient: get_auth_request con 0x55e09c3d44f0 auth_method 0 2024-09-12T18:46:04.284 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:04.284 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:04.284 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient: monmap: 2024-09-12T18:46:04.285 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:04.285 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:04.285 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:04.285 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:04.285 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:04.285 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.285 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:04.285 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:04.285 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:04.285 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.286 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding auth protocol: cephx 2024-09-12T18:46:04.286 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding auth protocol: cephx 2024-09-12T18:46:04.286 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding auth protocol: cephx 2024-09-12T18:46:04.286 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: secure 2024-09-12T18:46:04.286 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: crc 2024-09-12T18:46:04.286 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: secure 2024-09-12T18:46:04.286 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: crc 2024-09-12T18:46:04.286 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: secure 2024-09-12T18:46:04.286 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: crc 2024-09-12T18:46:04.286 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: crc 2024-09-12T18:46:04.286 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: secure 2024-09-12T18:46:04.287 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: crc 2024-09-12T18:46:04.287 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: secure 2024-09-12T18:46:04.287 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: crc 2024-09-12T18:46:04.287 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dd040) adding con mode: secure 2024-09-12T18:46:04.287 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.287 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e09c3e0a90 EEXIST 2024-09-12T18:46:04.287 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient: init 2024-09-12T18:46:04.287 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding auth protocol: cephx 2024-09-12T18:46:04.287 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding auth protocol: cephx 2024-09-12T18:46:04.287 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding auth protocol: cephx 2024-09-12T18:46:04.287 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: secure 2024-09-12T18:46:04.288 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: crc 2024-09-12T18:46:04.288 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: secure 2024-09-12T18:46:04.288 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: crc 2024-09-12T18:46:04.288 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: secure 2024-09-12T18:46:04.288 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: crc 2024-09-12T18:46:04.288 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: crc 2024-09-12T18:46:04.288 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: secure 2024-09-12T18:46:04.288 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: crc 2024-09-12T18:46:04.288 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: secure 2024-09-12T18:46:04.288 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: crc 2024-09-12T18:46:04.288 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c3dbf88) adding con mode: secure 2024-09-12T18:46:04.289 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.289 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.289 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command rotate-key cmddesc rotate-key hook 0x55e09c3dc0d0 EEXIST 2024-09-12T18:46:04.289 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:04.289 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:46:04.289 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e09c404c40 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:04.289 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e09c404570 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:04.289 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e09c402f50 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:04.289 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.289 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.290 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.290 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:04.290 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:46:04.104+0000 7fd52e73d9c0 10 monclient(hunting): authenticate will time out at 2151.247374s 2024-09-12T18:46:04.290 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): get_auth_request con 0x55e09c404570 auth_method 0 2024-09-12T18:46:04.290 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.290 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.290 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.290 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:46:04.104+0000 7fd52c243640 10 monclient(hunting): get_auth_request con 0x55e09c402f50 auth_method 0 2024-09-12T18:46:04.290 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:46:04.104+0000 7fd52c243640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.290 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:46:04.104+0000 7fd52c243640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.290 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:46:04.104+0000 7fd52c243640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.291 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.291 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.291 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.291 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:46:04.104+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.291 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:46:04.104+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.291 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:46:04.104+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.291 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient(hunting): handle_auth_done global_id 6284 payload 824 2024-09-12T18:46:04.291 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient: _finish_hunting 0 2024-09-12T18:46:04.291 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:46:04.104+0000 7fd52ca44640 1 monclient: found mon.noname-c 2024-09-12T18:46:04.291 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:46:04.104+0000 7fd52ca44640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.291 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.291 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:46:04.292 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: dump: 2024-09-12T18:46:04.292 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.292 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.292 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.292 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.292 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.292 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.292 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.292 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.292 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.292 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.292 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: _finish_auth 0 2024-09-12T18:46:04.292 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:46:04.293 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:04.293 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.293 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:46:04.293 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:46:04.108+0000 7fd411ffb640 10 monclient: dump: 2024-09-12T18:46:04.293 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.293 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.293 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.293 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.293 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.293 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.293 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.293 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.293 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.293 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:46:04.108+0000 7fd52d245640 4 set_mon_vals no callback set 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 monclient: authenticate success, global_id 6284 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: _renew_subs 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: _renew_subs 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:46:04.108+0000 7fd411ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:46:04.108+0000 7fd411ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:46:04.108+0000 7fd411ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:46:04.108+0000 7fd52ba42640 10 monclient: get_auth_request con 0x7fd404070a20 auth_method 0 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: get_monmap_and_config 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: monmap: 2024-09-12T18:46:04.294 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:04.295 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:04.295 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:04.295 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:04.295 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:04.295 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.295 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:04.295 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:04.295 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:04.295 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.295 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding auth protocol: cephx 2024-09-12T18:46:04.295 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding auth protocol: cephx 2024-09-12T18:46:04.295 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding auth protocol: cephx 2024-09-12T18:46:04.295 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.296 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.296 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.296 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.296 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.296 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.296 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.296 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.296 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.296 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.296 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.296 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.296 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.296 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: init 2024-09-12T18:46:04.296 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding auth protocol: cephx 2024-09-12T18:46:04.297 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding auth protocol: cephx 2024-09-12T18:46:04.297 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding auth protocol: cephx 2024-09-12T18:46:04.297 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: secure 2024-09-12T18:46:04.297 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: crc 2024-09-12T18:46:04.297 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: secure 2024-09-12T18:46:04.297 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: crc 2024-09-12T18:46:04.297 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: secure 2024-09-12T18:46:04.297 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: crc 2024-09-12T18:46:04.297 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: crc 2024-09-12T18:46:04.297 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: secure 2024-09-12T18:46:04.297 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: crc 2024-09-12T18:46:04.297 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: secure 2024-09-12T18:46:04.297 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: crc 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2adfe0) adding con mode: secure 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc6c2ae128 EEXIST 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e09c4524c0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e09c4528a0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e09c454c40 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:46:04.108+0000 7fd52e73d9c0 10 monclient(hunting): authenticate will time out at 2151.251847s 2024-09-12T18:46:04.298 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:46:04.108+0000 7fd52ba42640 10 monclient(hunting): get_auth_request con 0x55e09c4524c0 auth_method 0 2024-09-12T18:46:04.299 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:46:04.108+0000 7fd52ba42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.299 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:46:04.108+0000 7fd52ba42640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.299 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:46:04.108+0000 7fd52ba42640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.299 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): get_auth_request con 0x55e09c454c40 auth_method 0 2024-09-12T18:46:04.299 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.299 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.299 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.299 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.299 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.299 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.299 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.299 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.299 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.299 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_done global_id 6287 payload 274 2024-09-12T18:46:04.300 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient: _finish_hunting 0 2024-09-12T18:46:04.300 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:46:04.112+0000 7fd52ba42640 1 monclient: found mon.noname-c 2024-09-12T18:46:04.300 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.300 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.300 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:46:04.300 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: dump: 2024-09-12T18:46:04.300 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.300 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.300 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.300 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.300 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.300 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.300 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.301 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.301 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.301 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.301 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: _finish_auth 0 2024-09-12T18:46:04.301 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: _check_auth_tickets 2024-09-12T18:46:04.301 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:04.301 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.301 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:46:04.301 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:46:04.112+0000 7fd4037fe640 10 monclient: dump: 2024-09-12T18:46:04.301 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.301 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.301 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.302 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.302 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.302 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.302 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.302 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.302 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.302 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.302 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 monclient: authenticate success, global_id 6287 2024-09-12T18:46:04.302 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:46:04.302 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 4 set_mon_vals no callback set 2024-09-12T18:46:04.302 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: shutdown 2024-09-12T18:46:04.303 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:04.303 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:04.303 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: monmap: 2024-09-12T18:46:04.303 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:04.303 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:04.303 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:04.303 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:04.303 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:04.303 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.303 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:04.303 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:04.303 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:04.304 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.304 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding auth protocol: cephx 2024-09-12T18:46:04.304 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding auth protocol: cephx 2024-09-12T18:46:04.304 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding auth protocol: cephx 2024-09-12T18:46:04.304 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.304 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.304 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.304 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.304 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.304 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.304 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.304 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.305 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.305 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.305 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: crc 2024-09-12T18:46:04.305 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c423f80) adding con mode: secure 2024-09-12T18:46:04.305 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.305 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 1 librados: starting msgr at 2024-09-12T18:46:04.305 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 1 librados: starting objecter 2024-09-12T18:46:04.305 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e09c428740 EEXIST 2024-09-12T18:46:04.305 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 1 librados: setting wanted keys 2024-09-12T18:46:04.305 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 1 librados: calling monclient init 2024-09-12T18:46:04.305 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: init 2024-09-12T18:46:04.306 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding auth protocol: cephx 2024-09-12T18:46:04.306 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding auth protocol: cephx 2024-09-12T18:46:04.306 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding auth protocol: cephx 2024-09-12T18:46:04.306 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: secure 2024-09-12T18:46:04.306 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: crc 2024-09-12T18:46:04.306 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: secure 2024-09-12T18:46:04.306 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: crc 2024-09-12T18:46:04.306 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: secure 2024-09-12T18:46:04.306 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: crc 2024-09-12T18:46:04.306 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: crc 2024-09-12T18:46:04.307 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: secure 2024-09-12T18:46:04.307 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: crc 2024-09-12T18:46:04.307 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: secure 2024-09-12T18:46:04.307 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: crc 2024-09-12T18:46:04.307 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 AuthRegistry(0x55e09c406a60) adding con mode: secure 2024-09-12T18:46:04.307 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.307 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.307 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command rotate-key cmddesc rotate-key hook 0x55e09c406ba8 EEXIST 2024-09-12T18:46:04.307 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:04.307 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:46:04.308 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e09c4524c0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:04.308 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e09c4528a0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:04.308 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e09c454c40 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:04.308 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.308 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.308 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:04.308 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:04.308 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient(hunting): authenticate will time out at 2151.254418s 2024-09-12T18:46:04.308 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): get_auth_request con 0x55e09c4524c0 auth_method 0 2024-09-12T18:46:04.308 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.308 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.309 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.309 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): get_auth_request con 0x55e09c454c40 auth_method 0 2024-09-12T18:46:04.309 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:04.309 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:04.309 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:04.309 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.309 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.309 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.309 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:04.309 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:04.309 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:46:04.112+0000 7fd52c243640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:04.310 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient(hunting): handle_auth_done global_id 6290 payload 824 2024-09-12T18:46:04.310 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient: _finish_hunting 0 2024-09-12T18:46:04.310 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:46:04.112+0000 7fd52ba42640 1 monclient: found mon.noname-c 2024-09-12T18:46:04.310 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:46:04.112+0000 7fd52ba42640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.310 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.310 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:46:04.310 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: dump: 2024-09-12T18:46:04.310 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.310 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.310 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.311 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.311 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.311 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.311 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.311 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.311 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.311 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.311 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: _finish_auth 0 2024-09-12T18:46:04.311 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:46:04.311 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:04.311 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:04.312 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:46:04.312 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:46:04.112+0000 7fd401ffb640 10 monclient: dump: 2024-09-12T18:46:04.312 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:04.312 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:04.312 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.312 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:04.312 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:04.312 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:04.312 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:04.312 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:04.312 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:04.313 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.313 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:46:04.112+0000 7fd4037fe640 4 set_mon_vals no callback set 2024-09-12T18:46:04.313 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 monclient: authenticate success, global_id 6290 2024-09-12T18:46:04.313 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: _renew_subs 2024-09-12T18:46:04.313 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.313 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: _renew_subs 2024-09-12T18:46:04.313 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.313 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 1 librados: init done 2024-09-12T18:46:04.313 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:46:04.112+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command cr dump hook 0x55e09c44c908 2024-09-12T18:46:04.313 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.313 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:46:04.116+0000 7fd401ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:46:04.314 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:46:04.116+0000 7fd401ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:04.314 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:46:04.116+0000 7fd401ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:04.314 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:46:04.116+0000 7fd52ca44640 10 monclient: get_auth_request con 0x7fd3f4070ae0 auth_method 0 2024-09-12T18:46:04.314 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:46:04.116+0000 7fd52c243640 10 monclient: get_auth_request con 0x55e09c4728f0 auth_method 0 2024-09-12T18:46:04.314 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.314 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 realm 2024-09-12T18:46:04.314 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.314 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.314 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:04.314 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.314 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.314 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:46:04.116+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.315 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:46:04.116+0000 7fd52ba42640 10 monclient: get_auth_request con 0x55e09c476a30 auth_method 0 2024-09-12T18:46:04.315 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:46:04.120+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:04.315 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:46:04.120+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.315 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:46:04.120+0000 7fd52ca44640 10 monclient: get_auth_request con 0x55e09c47a320 auth_method 0 2024-09-12T18:46:04.315 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:46:04.120+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:04.315 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:46:04.120+0000 7fd52e73d9c0 20 searching for the correct realm 2024-09-12T18:46:04.315 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:46:04.120+0000 7fd52c243640 10 monclient: get_auth_request con 0x7fd52412e040 auth_method 0 2024-09-12T18:46:04.315 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:46:04.124+0000 7fd52ba42640 10 monclient: get_auth_request con 0x7fd51c039040 auth_method 0 2024-09-12T18:46:04.315 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:46:04.124+0000 7fd52ca44640 10 monclient: get_auth_request con 0x7fd52001e070 auth_method 0 2024-09-12T18:46:04.315 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:46:04.124+0000 7fd52ca44640 0 -- 172.21.15.111:0/2136067931 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x55e09c47a320 msgr2=0x55e09c47c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:04.315 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:46:04.124+0000 7fd401ffb640 1 client.6290.objecter ms_handle_reset 0x55e09c47a320 session 0x55e09c475ea0 osd.3 2024-09-12T18:46:04.316 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:46:04.124+0000 7fd401ffb640 10 monclient: _renew_subs 2024-09-12T18:46:04.316 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:46:04.124+0000 7fd401ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:04.316 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:46:04.124+0000 7fd52ca44640 10 monclient: get_auth_request con 0x7fd3f4080a80 auth_method 0 2024-09-12T18:46:04.316 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:46:04.128+0000 7fd52c243640 10 monclient: get_auth_request con 0x7fd5240c9070 auth_method 0 2024-09-12T18:46:04.316 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:46:04.132+0000 7fd52ba42640 10 monclient: get_auth_request con 0x7fd52411dbb0 auth_method 0 2024-09-12T18:46:04.316 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:46:04.132+0000 7fd52ba42640 0 -- 172.21.15.111:0/2136067931 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fd52411dbb0 msgr2=0x7fd5240ab7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:04.316 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:46:04.132+0000 7fd401ffb640 1 client.6290.objecter ms_handle_reset 0x7fd52411dbb0 session 0x7fd5240ade70 osd.0 2024-09-12T18:46:04.316 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:46:04.132+0000 7fd52ba42640 10 monclient: get_auth_request con 0x55e09c47a320 auth_method 0 2024-09-12T18:46:04.316 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:04.316 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:04.316 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:04.317 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:04.317 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:04.317 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:04.317 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.317 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.317 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.317 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:04.317 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.317 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:04.317 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 zone default found 2024-09-12T18:46:04.318 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 4 Realm: () 2024-09-12T18:46:04.318 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:04.318 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:04.318 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:04.318 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 zonegroup default 2024-09-12T18:46:04.318 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.318 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.318 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:46:04.140+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.318 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.318 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.318 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.319 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 started sync module instance, tier type = 2024-09-12T18:46:04.319 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:46:04.144+0000 7fd52e73d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:04.319 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=0 2024-09-12T18:46:04.319 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=1 2024-09-12T18:46:04.319 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=2 2024-09-12T18:46:04.319 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=3 2024-09-12T18:46:04.319 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=4 2024-09-12T18:46:04.319 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=5 2024-09-12T18:46:04.319 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=6 2024-09-12T18:46:04.319 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 20 add_watcher() i=7 2024-09-12T18:46:04.319 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:46:04.160+0000 7fd52e73d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:04.319 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding auth protocol: cephx 2024-09-12T18:46:04.319 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding auth protocol: cephx 2024-09-12T18:46:04.320 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding auth protocol: cephx 2024-09-12T18:46:04.320 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: secure 2024-09-12T18:46:04.320 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: crc 2024-09-12T18:46:04.320 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: secure 2024-09-12T18:46:04.320 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: crc 2024-09-12T18:46:04.320 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: secure 2024-09-12T18:46:04.320 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: crc 2024-09-12T18:46:04.320 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: crc 2024-09-12T18:46:04.320 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: secure 2024-09-12T18:46:04.320 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: crc 2024-09-12T18:46:04.320 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:46:04.164+0000 7fd3e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:04.320 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: secure 2024-09-12T18:46:04.320 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: crc 2024-09-12T18:46:04.321 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 AuthRegistry(0x7ffc6c2ae4c0) adding con mode: secure 2024-09-12T18:46:04.321 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:04.321 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:04.321 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:04.321 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command cache list hook 0x55e09c44d930 2024-09-12T18:46:04.321 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command cache inspect hook 0x55e09c44d930 2024-09-12T18:46:04.321 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command cache erase hook 0x55e09c44d930 2024-09-12T18:46:04.321 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command cache zap hook 0x55e09c44d930 2024-09-12T18:46:04.321 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 note: GC not initialized 2024-09-12T18:46:04.321 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:46:04.164+0000 7fd3e1fdb640 20 reqs_thread_entry: start 2024-09-12T18:46:04.321 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command sync trace show hook 0x7fd52000b2f0 2024-09-12T18:46:04.321 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command sync trace history hook 0x7fd52000b2f0 2024-09-12T18:46:04.321 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command sync trace active hook 0x7fd52000b2f0 2024-09-12T18:46:04.321 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 5 asok(0x55e09c17b2b0) register_command sync trace active_short hook 0x7fd52000b2f0 2024-09-12T18:46:04.322 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:04.322 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 Filter name: none 2024-09-12T18:46:04.322 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:46:04.164+0000 7fd3537fe640 20 reqs_thread_entry: start 2024-09-12T18:46:04.322 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:46:04.322 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.322 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:04.322 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:46:04.322 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:46:04.322 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 : miss 2024-09-12T18:46:04.322 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.322 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:04.322 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 info.flags=0x17 2024-09-12T18:46:04.322 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 to cache LRU end 2024-09-12T18:46:04.322 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:46:04.323 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:04.323 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:46:04.164+0000 7fd52e73d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 2024-09-12T18:46:04.323 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:46:04.172+0000 7fd52e73d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd52e73d9c0 time 2024-09-12T18:46:04.175520+0000 2024-09-12T18:46:04.323 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:46:04.323 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.323 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:04.323 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd5320172eb] 2024-09-12T18:46:04.323 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd53201749f] 2024-09-12T18:46:04.323 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e099f5ccc1] 2024-09-12T18:46:04.323 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422078) [0x55e09a9ba078] 2024-09-12T18:46:04.323 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e099f71ced] 2024-09-12T18:46:04.323 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:46:04.324 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd530e7dd90] 2024-09-12T18:46:04.324 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:46:04.324 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:46:04.324 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.324 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:46:04.176+0000 7fd52e73d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:46:04.324 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7fd52e73d9c0 thread_name:radosgw-admin 2024-09-12T18:46:04.324 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.324 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:04.324 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd530e96520] 2024-09-12T18:46:04.324 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:46:04.324 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:46:04.324 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:46:04.324 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd532017345] 2024-09-12T18:46:04.325 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd53201749f] 2024-09-12T18:46:04.325 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e099f5ccc1] 2024-09-12T18:46:04.325 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422078) [0x55e09a9ba078] 2024-09-12T18:46:04.325 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e099f71ced] 2024-09-12T18:46:04.325 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:46:04.325 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd530e7dd90] 2024-09-12T18:46:04.325 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:46:04.325 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:46:04.325 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:46:04.325 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.325 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:46:04.325 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:46:04.325 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:46:04.326 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:46:04.326 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:46:04.326 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:46:04.326 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:46:04.326 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:46:04.326 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:46:04.326 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:46:04.326 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:46:04.326 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:46:04.326 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:46:04.326 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:46:04.326 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:46:04.326 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:46:04.326 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:46:04.327 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:46:04.327 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:46:04.327 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:46:04.327 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:46:04.327 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:46:04.327 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:46:04.327 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:46:04.327 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:46:04.327 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:46:04.327 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:46:04.327 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:46:04.327 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:46:04.327 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:46:04.327 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:46:04.328 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:46:04.328 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:46:04.328 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:46:04.328 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:46:04.328 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:46:04.328 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:46:04.328 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:46:04.328 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:46:04.328 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:46:04.328 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:46:04.328 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:46:04.328 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:46:04.328 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:46:04.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:46:04.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:46:04.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:46:04.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:46:04.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:46:04.329 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:46:04.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:46:04.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:46:04.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:46:04.329 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:46:04.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:46:04.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:46:04.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:46:04.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:46:04.330 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:46:04.330 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:46:04.330 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:46:04.330 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:46:04.330 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:46:04.330 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:46:04.330 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:46:04.330 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:46:04.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:46:04.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:46:04.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:46:04.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:46:04.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:46:04.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:46:04.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:46:04.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:46:04.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:46:04.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:46:04.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:46:04.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:46:04.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:46:04.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:46:04.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:46:04.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:46:04.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:46:04.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:46:04.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:46:04.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:46:04.332 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:46:04.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:46:04.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:46:04.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:46:04.332 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:46:04.332 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:46:04.332 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:46:04.332 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:46:04.332 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd3537fe640 / http_manager 2024-09-12T18:46:04.332 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd3e1fdb640 / http_manager 2024-09-12T18:46:04.332 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd3e2fdd640 / rgw_dt_lg_renew 2024-09-12T18:46:04.332 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd401ffb640 / ms_dispatch 2024-09-12T18:46:04.333 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd4037fe640 / io_context_pool 2024-09-12T18:46:04.333 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd411ffb640 / ms_dispatch 2024-09-12T18:46:04.333 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd418e09640 / ms_dispatch 2024-09-12T18:46:04.333 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd41a60c640 / io_context_pool 2024-09-12T18:46:04.333 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd52ba42640 / msgr-worker-2 2024-09-12T18:46:04.333 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd52c243640 / msgr-worker-1 2024-09-12T18:46:04.333 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd52ca44640 / msgr-worker-0 2024-09-12T18:46:04.333 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd52d245640 / io_context_pool 2024-09-12T18:46:04.333 INFO:tasks.workunit.client.0.smithi111.stderr: 7fd52e73d9c0 / radosgw-admin 2024-09-12T18:46:04.333 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:46:04.333 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:46:04.333 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:46:04.177995Z_f493a313-11d0-4b1a-a7f8-3facdcfe447e/log 2024-09-12T18:46:04.333 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:46:04.334 INFO:tasks.workunit.client.0.smithi111.stderr:Aborted 2024-09-12T18:46:04.334 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T18:46:04.335 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:04.335 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:04.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.252+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.256+0000 7fa17d9009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.256+0000 7fa17d9009c0 20 realm 2024-09-12T18:46:04.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.256+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.256+0000 7fa17d9009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.256+0000 7fa17d9009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:04.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.256+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.256+0000 7fa17d9009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.256+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.256+0000 7fa17d9009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:04.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.256+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.256+0000 7fa17d9009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:04.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.256+0000 7fa17d9009c0 20 searching for the correct realm 2024-09-12T18:46:04.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.260+0000 7fa17bc07640 0 -- 172.21.15.111:0/4054660182 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fa1700634f0 msgr2=0x7fa170061f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:04.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.268+0000 7fa17ac05640 0 -- 172.21.15.111:0/4054660182 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fa1740ce040 msgr2=0x7fa174105940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:04.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.484+0000 7fa17d9009c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:04.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.484+0000 7fa17d9009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:04.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.484+0000 7fa17d9009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:04.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.484+0000 7fa17d9009c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:04.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.484+0000 7fa17d9009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:04.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.484+0000 7fa17d9009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:04.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.484+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.484+0000 7fa17d9009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.484+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.488+0000 7fa17d9009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:04.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.488+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.488+0000 7fa17d9009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:04.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.488+0000 7fa17d9009c0 20 zone default found 2024-09-12T18:46:04.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.488+0000 7fa17d9009c0 4 Realm: () 2024-09-12T18:46:04.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.488+0000 7fa17d9009c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:04.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.488+0000 7fa17d9009c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:04.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.488+0000 7fa17d9009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:04.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.488+0000 7fa17d9009c0 20 zonegroup default 2024-09-12T18:46:04.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.488+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.488+0000 7fa17d9009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.488+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.488+0000 7fa17d9009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.488+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.492+0000 7fa17d9009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.492+0000 7fa17d9009c0 20 started sync module instance, tier type = 2024-09-12T18:46:04.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.492+0000 7fa17d9009c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:04.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.516+0000 7fa17d9009c0 20 add_watcher() i=0 2024-09-12T18:46:04.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.516+0000 7fa17d9009c0 20 add_watcher() i=1 2024-09-12T18:46:04.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.516+0000 7fa17d9009c0 20 add_watcher() i=2 2024-09-12T18:46:04.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.516+0000 7fa17d9009c0 20 add_watcher() i=3 2024-09-12T18:46:04.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.516+0000 7fa17d9009c0 20 add_watcher() i=4 2024-09-12T18:46:04.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.516+0000 7fa17d9009c0 20 add_watcher() i=5 2024-09-12T18:46:04.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.516+0000 7fa17d9009c0 20 add_watcher() i=6 2024-09-12T18:46:04.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.516+0000 7fa17d9009c0 20 add_watcher() i=7 2024-09-12T18:46:04.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.516+0000 7fa17d9009c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:04.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.520+0000 7fa031fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:04.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.524+0000 7fa17d9009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:04.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.524+0000 7fa17d9009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:04.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.524+0000 7fa17d9009c0 5 note: GC not initialized 2024-09-12T18:46:04.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.524+0000 7fa030fe1640 20 reqs_thread_entry: start 2024-09-12T18:46:04.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.524+0000 7fa17d9009c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:04.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.524+0000 7fa17d9009c0 20 Filter name: none 2024-09-12T18:46:04.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.524+0000 7f9faa7fc640 20 reqs_thread_entry: start 2024-09-12T18:46:04.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.524+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.527 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.524+0000 7fa17d9009c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:04.527 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.524+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.528+0000 7fa17d9009c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:04.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.528+0000 7fa17d9009c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:04.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.528+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.528+0000 7fa17d9009c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:04.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.528+0000 7fa17d9009c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.528+0000 7fa17d9009c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:04.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.528+0000 7fa17d9009c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:04.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.532+0000 7fa031fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:04.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.536+0000 7fa17d9009c0 20 remove_watcher() i=0 2024-09-12T18:46:04.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.536+0000 7fa17d9009c0 2 removed watcher, disabling cache 2024-09-12T18:46:04.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.540+0000 7fa17d9009c0 20 remove_watcher() i=1 2024-09-12T18:46:04.542 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.540+0000 7fa17d9009c0 20 remove_watcher() i=2 2024-09-12T18:46:04.544 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.544+0000 7fa17d9009c0 20 remove_watcher() i=3 2024-09-12T18:46:04.547 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.544+0000 7fa17d9009c0 20 remove_watcher() i=4 2024-09-12T18:46:04.548 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.548+0000 7fa17d9009c0 20 remove_watcher() i=5 2024-09-12T18:46:04.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.548+0000 7fa17d9009c0 20 remove_watcher() i=6 2024-09-12T18:46:04.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.548+0000 7fa17d9009c0 20 remove_watcher() i=7 2024-09-12T18:46:04.565 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.566 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:46:04.566 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-set-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:46:04.566 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:04.566 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:04.567 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:04.579 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:04.579 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:04.621 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:46:04.656 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:04.657 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:04.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.700+0000 7f50153449c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.704 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.700+0000 7f50153449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.704 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.700+0000 7f50153449c0 20 realm 2024-09-12T18:46:04.704 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.700+0000 7f50153449c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.704+0000 7f50153449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.704+0000 7f50153449c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:04.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.704+0000 7f50153449c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.704+0000 7f50153449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.704+0000 7f50153449c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.704+0000 7f50153449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:04.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.704+0000 7f50153449c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.704+0000 7f50153449c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:04.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.704+0000 7f50153449c0 20 searching for the correct realm 2024-09-12T18:46:04.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.708+0000 7f501364b640 0 -- 172.21.15.111:0/3281179967 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f50080720b0 msgr2=0x7f500807bc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:04.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.716+0000 7f5012649640 0 -- 172.21.15.111:0/3281179967 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f500c0cf440 msgr2=0x7f500c0cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:04.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.932+0000 7f50153449c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:04.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.932+0000 7f50153449c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:04.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.932+0000 7f50153449c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:04.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.932+0000 7f50153449c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:04.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.932+0000 7f50153449c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:04.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.932+0000 7f50153449c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:04.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.932+0000 7f50153449c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.932+0000 7f50153449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.932+0000 7f50153449c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:04.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:04.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 20 zone default found 2024-09-12T18:46:04.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 4 Realm: () 2024-09-12T18:46:04.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:04.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:04.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:04.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 20 zonegroup default 2024-09-12T18:46:04.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:04.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 20 started sync module instance, tier type = 2024-09-12T18:46:04.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.936+0000 7f50153449c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:04.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.956+0000 7f50153449c0 20 add_watcher() i=0 2024-09-12T18:46:04.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.956+0000 7f50153449c0 20 add_watcher() i=1 2024-09-12T18:46:04.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.956+0000 7f50153449c0 20 add_watcher() i=2 2024-09-12T18:46:04.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.956+0000 7f50153449c0 20 add_watcher() i=3 2024-09-12T18:46:04.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.956+0000 7f50153449c0 20 add_watcher() i=4 2024-09-12T18:46:04.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.956+0000 7f50153449c0 20 add_watcher() i=5 2024-09-12T18:46:04.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.960+0000 7f50153449c0 20 add_watcher() i=6 2024-09-12T18:46:04.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.960+0000 7f50153449c0 20 add_watcher() i=7 2024-09-12T18:46:04.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.960+0000 7f50153449c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:04.965 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.964+0000 7f4ec97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:04.967 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.964+0000 7f50153449c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:04.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.964+0000 7f50153449c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:04.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.964+0000 7f50153449c0 5 note: GC not initialized 2024-09-12T18:46:04.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.964+0000 7f4e43fff640 20 reqs_thread_entry: start 2024-09-12T18:46:04.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.964+0000 7f50153449c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:04.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.964+0000 7f50153449c0 20 Filter name: none 2024-09-12T18:46:04.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.964+0000 7f4e41ffb640 20 reqs_thread_entry: start 2024-09-12T18:46:04.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.964+0000 7f50153449c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:46:04.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.964+0000 7f50153449c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.968+0000 7f50153449c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:04.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.968+0000 7f50153449c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:46:04.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.968+0000 7f50153449c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:46:04.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.968+0000 7f50153449c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 : miss 2024-09-12T18:46:04.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.968+0000 7f50153449c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:04.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.968+0000 7f50153449c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:04.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.968+0000 7f50153449c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 info.flags=0x17 2024-09-12T18:46:04.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.968+0000 7f50153449c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 to cache LRU end 2024-09-12T18:46:04.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.968+0000 7f50153449c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:46:04.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.968+0000 7f50153449c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:04.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.968+0000 7f50153449c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 2024-09-12T18:46:04.972 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.972+0000 7f50153449c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 to be held by another RGW process; skipping for now 2024-09-12T18:46:04.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.972+0000 7f4ec97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:04.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.976+0000 7f50153449c0 20 remove_watcher() i=0 2024-09-12T18:46:04.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.976+0000 7f50153449c0 2 removed watcher, disabling cache 2024-09-12T18:46:04.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.980+0000 7f50153449c0 20 remove_watcher() i=1 2024-09-12T18:46:04.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.984+0000 7f50153449c0 20 remove_watcher() i=2 2024-09-12T18:46:04.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.984+0000 7f50153449c0 20 remove_watcher() i=3 2024-09-12T18:46:04.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.988+0000 7f50153449c0 20 remove_watcher() i=4 2024-09-12T18:46:04.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.988+0000 7f50153449c0 20 remove_watcher() i=5 2024-09-12T18:46:04.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.992+0000 7f50153449c0 20 remove_watcher() i=6 2024-09-12T18:46:04.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:04.992+0000 7f50153449c0 20 remove_watcher() i=7 2024-09-12T18:46:05.018 INFO:tasks.workunit.client.0.smithi111.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:46:35.045 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:46:35.083 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:35.083 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:35.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.127+0000 7f5f015709c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.127+0000 7f5f015709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:35.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.127+0000 7f5f015709c0 20 realm 2024-09-12T18:46:35.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.127+0000 7f5f015709c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.127+0000 7f5f015709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:35.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.127+0000 7f5f015709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:35.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.127+0000 7f5f015709c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.127+0000 7f5f015709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:35.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.127+0000 7f5f015709c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.127+0000 7f5f015709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:35.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.127+0000 7f5f015709c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.131+0000 7f5f015709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:35.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.131+0000 7f5f015709c0 20 searching for the correct realm 2024-09-12T18:46:35.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.135+0000 7f5eff877640 0 -- 172.21.15.111:0/1011490658 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f5ee8017040 msgr2=0x7f5ee809e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:35.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.351+0000 7f5efe875640 0 -- 172.21.15.111:0/1011490658 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f5ef0053930 msgr2=0x7f5ef00423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:35.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.567+0000 7f5f015709c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:35.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.567+0000 7f5f015709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:35.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.567+0000 7f5f015709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:35.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.567+0000 7f5f015709c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:35.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.567+0000 7f5f015709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:35.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.567+0000 7f5f015709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:35.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.567+0000 7f5f015709c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.567+0000 7f5f015709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:35.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.567+0000 7f5f015709c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.571+0000 7f5f015709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:35.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.571+0000 7f5f015709c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.571+0000 7f5f015709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:35.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.571+0000 7f5f015709c0 20 zone default found 2024-09-12T18:46:35.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.571+0000 7f5f015709c0 4 Realm: () 2024-09-12T18:46:35.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.571+0000 7f5f015709c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:35.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.571+0000 7f5f015709c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:35.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.571+0000 7f5f015709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:35.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.571+0000 7f5f015709c0 20 zonegroup default 2024-09-12T18:46:35.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.571+0000 7f5f015709c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.571+0000 7f5f015709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:35.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.571+0000 7f5f015709c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.571+0000 7f5f015709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:35.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.571+0000 7f5f015709c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.575+0000 7f5f015709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:35.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.575+0000 7f5f015709c0 20 started sync module instance, tier type = 2024-09-12T18:46:35.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.575+0000 7f5f015709c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:35.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.599+0000 7f5f015709c0 20 add_watcher() i=0 2024-09-12T18:46:35.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.599+0000 7f5f015709c0 20 add_watcher() i=1 2024-09-12T18:46:35.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.599+0000 7f5f015709c0 20 add_watcher() i=2 2024-09-12T18:46:35.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.599+0000 7f5f015709c0 20 add_watcher() i=3 2024-09-12T18:46:35.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.599+0000 7f5f015709c0 20 add_watcher() i=4 2024-09-12T18:46:35.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.599+0000 7f5f015709c0 20 add_watcher() i=5 2024-09-12T18:46:35.601 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.599+0000 7f5f015709c0 20 add_watcher() i=6 2024-09-12T18:46:35.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.599+0000 7f5f015709c0 20 add_watcher() i=7 2024-09-12T18:46:35.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.599+0000 7f5f015709c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:35.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.603+0000 7f5db5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:35.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.603+0000 7f5f015709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:35.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.603+0000 7f5f015709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:35.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.603+0000 7f5f015709c0 5 note: GC not initialized 2024-09-12T18:46:35.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5db4fe1640 20 reqs_thread_entry: start 2024-09-12T18:46:35.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:35.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 20 Filter name: none 2024-09-12T18:46:35.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5d2e7fc640 20 reqs_thread_entry: start 2024-09-12T18:46:35.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T18:46:35.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:35.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T18:46:35.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T18:46:35.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 : miss 2024-09-12T18:46:35.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:35.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 info.flags=0x17 2024-09-12T18:46:35.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 to cache LRU end 2024-09-12T18:46:35.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:46:35.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:35.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.607+0000 7f5f015709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 2024-09-12T18:46:35.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.619+0000 7f5f015709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 info.flags=0x17 2024-09-12T18:46:35.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.619+0000 7f5f015709c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 to cache LRU end 2024-09-12T18:46:35.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.619+0000 7f5f015709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:35.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.619+0000 7f5f015709c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24, ofs0, ns] 2024-09-12T18:46:35.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.619+0000 7f5de2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431571 cookie 94450900347680 notifier 6726 bl.length()=925 2024-09-12T18:46:35.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.619+0000 7f5de2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 info.flags=0x17 2024-09-12T18:46:35.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.619+0000 7f5de2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 to cache LRU end 2024-09-12T18:46:35.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.619+0000 7f5de2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:35.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.619+0000 7f5f015709c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.24]): orig_sources= new_sources= 2024-09-12T18:46:35.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.619+0000 7f5f015709c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.24]): potential sources added=[] removed=[] 2024-09-12T18:46:35.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.619+0000 7f5f015709c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.24]): orig_dests= new_dests= 2024-09-12T18:46:35.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.619+0000 7f5f015709c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.24]): potential dests added=[] removed=[] 2024-09-12T18:46:35.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.0 2024-09-12T18:46:35.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.0 2024-09-12T18:46:35.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.1 2024-09-12T18:46:35.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.1 2024-09-12T18:46:35.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.2 2024-09-12T18:46:35.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.2 2024-09-12T18:46:35.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.3 2024-09-12T18:46:35.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.3 2024-09-12T18:46:35.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.4 2024-09-12T18:46:35.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.4 2024-09-12T18:46:35.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.5 2024-09-12T18:46:35.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.5 2024-09-12T18:46:35.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.6 2024-09-12T18:46:35.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.6 2024-09-12T18:46:35.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.7 2024-09-12T18:46:35.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.7 2024-09-12T18:46:35.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.8 2024-09-12T18:46:35.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.8 2024-09-12T18:46:35.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.9 2024-09-12T18:46:35.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.9 2024-09-12T18:46:35.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.10 2024-09-12T18:46:35.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.10 2024-09-12T18:46:35.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.11 2024-09-12T18:46:35.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1.11 2024-09-12T18:46:35.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.0 2024-09-12T18:46:35.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1 2024-09-12T18:46:35.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.2 2024-09-12T18:46:35.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.631+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.3 2024-09-12T18:46:35.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.635+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.4 2024-09-12T18:46:35.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.635+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.5 2024-09-12T18:46:35.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.635+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.6 2024-09-12T18:46:35.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.635+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.7 2024-09-12T18:46:35.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.635+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.8 2024-09-12T18:46:35.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.639+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.9 2024-09-12T18:46:35.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.639+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.10 2024-09-12T18:46:35.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.647+0000 7f5f015709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 : hit (requested=0x17, cached=0x17) 2024-09-12T18:46:35.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.647+0000 7f5f015709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 2024-09-12T18:46:35.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.651+0000 7f5f015709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 info.flags=0x17 2024-09-12T18:46:35.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.651+0000 7f5f015709c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 to cache LRU end 2024-09-12T18:46:35.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.651+0000 7f5f015709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:35.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.651+0000 7f5f015709c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24, ofs0, ns] 2024-09-12T18:46:35.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.651+0000 7f5de2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431572 cookie 94450900347680 notifier 6726 bl.length()=925 2024-09-12T18:46:35.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.651+0000 7f5de2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 info.flags=0x17 2024-09-12T18:46:35.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.651+0000 7f5de2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 to cache LRU end 2024-09-12T18:46:35.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.651+0000 7f5de2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:35.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.651+0000 7f5f015709c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.24]): orig_sources= new_sources= 2024-09-12T18:46:35.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.651+0000 7f5f015709c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.24]): potential sources added=[] removed=[] 2024-09-12T18:46:35.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.651+0000 7f5f015709c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.24]): orig_dests= new_dests= 2024-09-12T18:46:35.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.651+0000 7f5f015709c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.24]): potential dests added=[] removed=[] 2024-09-12T18:46:35.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.655+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.0 2024-09-12T18:46:35.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.655+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.1 2024-09-12T18:46:35.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.655+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.2 2024-09-12T18:46:35.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.655+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.3 2024-09-12T18:46:35.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.659+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.4 2024-09-12T18:46:35.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.659+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.5 2024-09-12T18:46:35.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.659+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.6 2024-09-12T18:46:35.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.659+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.7 2024-09-12T18:46:35.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.659+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.8 2024-09-12T18:46:35.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.659+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.9 2024-09-12T18:46:35.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.663+0000 7f5f015709c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.24.10 2024-09-12T18:46:35.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.663+0000 7f5f015709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 : hit (requested=0x17, cached=0x17) 2024-09-12T18:46:35.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.663+0000 7f5f015709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 2024-09-12T18:46:35.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.667+0000 7f5f015709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 info.flags=0x17 2024-09-12T18:46:35.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.667+0000 7f5f015709c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 to cache LRU end 2024-09-12T18:46:35.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.667+0000 7f5f015709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:35.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.667+0000 7f5f015709c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24, ofs0, ns] 2024-09-12T18:46:35.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.667+0000 7f5de27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431573 cookie 94450900347680 notifier 6726 bl.length()=893 2024-09-12T18:46:35.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.667+0000 7f5de27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 info.flags=0x17 2024-09-12T18:46:35.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.667+0000 7f5de27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.24 to cache LRU end 2024-09-12T18:46:35.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.667+0000 7f5de27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:35.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.667+0000 7f5f015709c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.24]): orig_sources= new_sources= 2024-09-12T18:46:35.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.667+0000 7f5f015709c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.24]): potential sources added=[] removed=[] 2024-09-12T18:46:35.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.667+0000 7f5f015709c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.24]): orig_dests= new_dests= 2024-09-12T18:46:35.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.667+0000 7f5f015709c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.24]): potential dests added=[] removed=[] 2024-09-12T18:46:35.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.671+0000 7f5f015709c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T18:46:35.677 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.675+0000 7f5db5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:35.681 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.679+0000 7f5f015709c0 20 remove_watcher() i=0 2024-09-12T18:46:35.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.679+0000 7f5f015709c0 2 removed watcher, disabling cache 2024-09-12T18:46:35.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.679+0000 7f5f015709c0 20 remove_watcher() i=1 2024-09-12T18:46:35.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.683+0000 7f5f015709c0 20 remove_watcher() i=2 2024-09-12T18:46:35.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.687+0000 7f5f015709c0 20 remove_watcher() i=3 2024-09-12T18:46:35.690 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.687+0000 7f5f015709c0 20 remove_watcher() i=4 2024-09-12T18:46:35.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.691+0000 7f5f015709c0 20 remove_watcher() i=5 2024-09-12T18:46:35.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.691+0000 7f5f015709c0 20 remove_watcher() i=6 2024-09-12T18:46:35.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.691+0000 7f5f015709c0 20 remove_watcher() i=7 2024-09-12T18:46:35.714 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T18:46:35.745 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:35.745 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:35.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.787+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.791+0000 7f936a37c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:35.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.791+0000 7f936a37c9c0 20 realm 2024-09-12T18:46:35.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.791+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.791+0000 7f936a37c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:35.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.791+0000 7f936a37c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:35.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.791+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.791+0000 7f936a37c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:35.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.791+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.791+0000 7f936a37c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:35.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.791+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.795+0000 7f936a37c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:35.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.795+0000 7f936a37c9c0 20 searching for the correct realm 2024-09-12T18:46:35.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.799+0000 7f9368683640 0 -- 172.21.15.111:0/2476084656 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x55e0c453c280 msgr2=0x55e0c453e670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:35.807 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.803+0000 7f9367681640 0 -- 172.21.15.111:0/2476084656 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f93580db410 msgr2=0x7f93580db890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:35.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.811+0000 7f936a37c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:35.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.811+0000 7f936a37c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:35.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.811+0000 7f936a37c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:35.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.811+0000 7f936a37c9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:35.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.811+0000 7f936a37c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:35.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.811+0000 7f936a37c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:35.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.811+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.811+0000 7f936a37c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:35.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.811+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:35.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:35.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 20 zone default found 2024-09-12T18:46:35.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 4 Realm: () 2024-09-12T18:46:35.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:35.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:35.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:35.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 20 zonegroup default 2024-09-12T18:46:35.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:35.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:35.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:35.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 20 started sync module instance, tier type = 2024-09-12T18:46:35.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.815+0000 7f936a37c9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:35.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.831+0000 7f936a37c9c0 20 add_watcher() i=0 2024-09-12T18:46:35.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.831+0000 7f936a37c9c0 20 add_watcher() i=1 2024-09-12T18:46:35.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.831+0000 7f936a37c9c0 20 add_watcher() i=2 2024-09-12T18:46:35.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.831+0000 7f936a37c9c0 20 add_watcher() i=3 2024-09-12T18:46:35.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.831+0000 7f936a37c9c0 20 add_watcher() i=4 2024-09-12T18:46:35.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.831+0000 7f936a37c9c0 20 add_watcher() i=5 2024-09-12T18:46:35.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.831+0000 7f936a37c9c0 20 add_watcher() i=6 2024-09-12T18:46:35.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.831+0000 7f936a37c9c0 20 add_watcher() i=7 2024-09-12T18:46:35.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.831+0000 7f936a37c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:35.837 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.835+0000 7f921dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:35.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.835+0000 7f936a37c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:35.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.835+0000 7f936a37c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:35.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.835+0000 7f936a37c9c0 5 note: GC not initialized 2024-09-12T18:46:35.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.835+0000 7f921cfe1640 20 reqs_thread_entry: start 2024-09-12T18:46:35.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.835+0000 7f936a37c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:35.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.835+0000 7f936a37c9c0 20 Filter name: none 2024-09-12T18:46:35.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.835+0000 7f91967fc640 20 reqs_thread_entry: start 2024-09-12T18:46:35.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.835+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.840 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.835+0000 7f936a37c9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:35.840 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.835+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.839+0000 7f936a37c9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:35.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.839+0000 7f936a37c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:35.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.839+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.842 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.839+0000 7f936a37c9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T18:46:35.842 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.839+0000 7f936a37c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:35.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.839+0000 7f936a37c9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T18:46:35.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.839+0000 7f936a37c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:35.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.843+0000 7f921dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:35.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.847+0000 7f936a37c9c0 20 remove_watcher() i=0 2024-09-12T18:46:35.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.847+0000 7f936a37c9c0 2 removed watcher, disabling cache 2024-09-12T18:46:35.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.851+0000 7f936a37c9c0 20 remove_watcher() i=1 2024-09-12T18:46:35.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.851+0000 7f936a37c9c0 20 remove_watcher() i=2 2024-09-12T18:46:35.856 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.855+0000 7f936a37c9c0 20 remove_watcher() i=3 2024-09-12T18:46:35.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.855+0000 7f936a37c9c0 20 remove_watcher() i=4 2024-09-12T18:46:35.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.855+0000 7f936a37c9c0 20 remove_watcher() i=5 2024-09-12T18:46:35.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.859+0000 7f936a37c9c0 20 remove_watcher() i=6 2024-09-12T18:46:35.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:35.859+0000 7f936a37c9c0 20 remove_watcher() i=7 2024-09-12T18:46:35.875 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:35.875 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:46:35.875 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-set-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:46:35.876 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:35.877 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:35.877 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:35.880 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:35.881 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:35.926 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:35.926 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:35.980 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T18:46:35.980 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:35.984 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:35.984 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.009 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.009 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.056 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.056 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.074 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.074 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.094 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.094 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.112 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.112 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.131 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.131 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.150 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.150 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.170 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.170 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.188 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.188 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.206 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.206 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.225 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.225 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.246 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.246 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.313 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.313 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.331 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.331 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.348 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.348 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.367 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.367 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.385 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.385 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.406 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.406 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.425 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.425 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.443 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.443 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.461 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:36.461 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:36.477 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:46:36.509 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:36.509 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:36.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.551+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.555+0000 7f618ab7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:36.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.555+0000 7f618ab7a9c0 20 realm 2024-09-12T18:46:36.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.555+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.555+0000 7f618ab7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:36.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.555+0000 7f618ab7a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:36.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.555+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.555+0000 7f618ab7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:36.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.555+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.555+0000 7f618ab7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:36.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.555+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.559 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.555+0000 7f618ab7a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:36.559 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.555+0000 7f618ab7a9c0 20 searching for the correct realm 2024-09-12T18:46:36.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.559+0000 7f6188e81640 0 -- 172.21.15.111:0/3561252276 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f617c119c90 msgr2=0x7f617c10b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:36.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.567+0000 7f6187e7f640 0 -- 172.21.15.111:0/3561252276 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f618004f410 msgr2=0x7f618004f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:46:36.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.783+0000 7f618ab7a9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:36.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.783+0000 7f618ab7a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:36.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.783+0000 7f618ab7a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:36.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.783+0000 7f618ab7a9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:36.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.783+0000 7f618ab7a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:36.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.783+0000 7f618ab7a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:36.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.783+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:36.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:36.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:36.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 20 zone default found 2024-09-12T18:46:36.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 4 Realm: () 2024-09-12T18:46:36.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:36.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:36.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:36.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 20 zonegroup default 2024-09-12T18:46:36.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:36.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:36.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.787+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.791+0000 7f618ab7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:36.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.791+0000 7f618ab7a9c0 20 started sync module instance, tier type = 2024-09-12T18:46:36.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.791+0000 7f618ab7a9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:36.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.811+0000 7f618ab7a9c0 20 add_watcher() i=0 2024-09-12T18:46:36.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.811+0000 7f618ab7a9c0 20 add_watcher() i=1 2024-09-12T18:46:36.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.811+0000 7f618ab7a9c0 20 add_watcher() i=2 2024-09-12T18:46:36.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.811+0000 7f618ab7a9c0 20 add_watcher() i=3 2024-09-12T18:46:36.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.811+0000 7f618ab7a9c0 20 add_watcher() i=4 2024-09-12T18:46:36.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.811+0000 7f618ab7a9c0 20 add_watcher() i=5 2024-09-12T18:46:36.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.811+0000 7f618ab7a9c0 20 add_watcher() i=6 2024-09-12T18:46:36.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.811+0000 7f618ab7a9c0 20 add_watcher() i=7 2024-09-12T18:46:36.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.811+0000 7f618ab7a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:36.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.815+0000 7f603efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:36.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.819+0000 7f618ab7a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:36.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.819+0000 7f618ab7a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:36.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.819+0000 7f618ab7a9c0 5 note: GC not initialized 2024-09-12T18:46:36.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.819+0000 7f603dfdb640 20 reqs_thread_entry: start 2024-09-12T18:46:36.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.819+0000 7f618ab7a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:36.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.819+0000 7f618ab7a9c0 20 Filter name: none 2024-09-12T18:46:36.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.819+0000 7f5faf7fe640 20 reqs_thread_entry: start 2024-09-12T18:46:36.822 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.819+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.819+0000 7f618ab7a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:36.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.819+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.823+0000 7f618ab7a9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:36.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.823+0000 7f618ab7a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:36.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.823+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.823+0000 7f618ab7a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:36.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.823+0000 7f618ab7a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.823+0000 7f618ab7a9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:36.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.823+0000 7f618ab7a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:36.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.827+0000 7f603efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:36.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.831+0000 7f618ab7a9c0 20 remove_watcher() i=0 2024-09-12T18:46:36.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.831+0000 7f618ab7a9c0 2 removed watcher, disabling cache 2024-09-12T18:46:36.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.835+0000 7f618ab7a9c0 20 remove_watcher() i=1 2024-09-12T18:46:36.840 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.839+0000 7f618ab7a9c0 20 remove_watcher() i=2 2024-09-12T18:46:36.842 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.839+0000 7f618ab7a9c0 20 remove_watcher() i=3 2024-09-12T18:46:36.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.843+0000 7f618ab7a9c0 20 remove_watcher() i=4 2024-09-12T18:46:36.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.843+0000 7f618ab7a9c0 20 remove_watcher() i=5 2024-09-12T18:46:36.848 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.847+0000 7f618ab7a9c0 20 remove_watcher() i=6 2024-09-12T18:46:36.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.847+0000 7f618ab7a9c0 20 remove_watcher() i=7 2024-09-12T18:46:36.867 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:36.868 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:46:36.868 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-trim-reshard-log-entries id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:46:36.868 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:36.868 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T18:46:36.900 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:36.901 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:36.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.943+0000 7f5a43dc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.947+0000 7f5a43dc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:36.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.947+0000 7f5a43dc39c0 20 realm 2024-09-12T18:46:36.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.947+0000 7f5a43dc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.947+0000 7f5a43dc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:36.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.947+0000 7f5a43dc39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:36.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.947+0000 7f5a43dc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.947+0000 7f5a43dc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:36.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.947+0000 7f5a43dc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.947+0000 7f5a43dc39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:36.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.947+0000 7f5a43dc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.947+0000 7f5a43dc39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:36.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.947+0000 7f5a43dc39c0 20 searching for the correct realm 2024-09-12T18:46:36.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.955+0000 7f5a418c9640 0 -- 172.21.15.111:0/281577824 >> [v2:172.21.15.111:6800/2832238944,v1:172.21.15.111:6801/2832238944] conn(0x560abd1ced20 msgr2=0x560abd1d11e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:36.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.959+0000 7f5a420ca640 0 -- 172.21.15.111:0/281577824 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f5a38028020 msgr2=0x7f5a38065330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:36.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:36.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:36.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:36.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:36.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:36.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:36.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:36.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:36.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:36.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 zone default found 2024-09-12T18:46:36.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 4 Realm: () 2024-09-12T18:46:36.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:36.972 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:36.972 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:36.972 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 zonegroup default 2024-09-12T18:46:36.972 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.972 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:36.972 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.967+0000 7f5a43dc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.971+0000 7f5a43dc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:36.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.971+0000 7f5a43dc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.971+0000 7f5a43dc39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:36.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.971+0000 7f5a43dc39c0 20 started sync module instance, tier type = 2024-09-12T18:46:36.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.971+0000 7f5a43dc39c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:36.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.983+0000 7f5a43dc39c0 20 add_watcher() i=0 2024-09-12T18:46:36.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.983+0000 7f5a43dc39c0 20 add_watcher() i=1 2024-09-12T18:46:36.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.983+0000 7f5a43dc39c0 20 add_watcher() i=2 2024-09-12T18:46:36.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.983+0000 7f5a43dc39c0 20 add_watcher() i=3 2024-09-12T18:46:36.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.983+0000 7f5a43dc39c0 20 add_watcher() i=4 2024-09-12T18:46:36.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.983+0000 7f5a43dc39c0 20 add_watcher() i=5 2024-09-12T18:46:36.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.983+0000 7f5a43dc39c0 20 add_watcher() i=6 2024-09-12T18:46:36.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.987+0000 7f5a43dc39c0 20 add_watcher() i=7 2024-09-12T18:46:36.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.987+0000 7f5a43dc39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:36.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.987+0000 7f58f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:36.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.987+0000 7f5a43dc39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:36.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.987+0000 7f5a43dc39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:36.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.987+0000 7f5a43dc39c0 5 note: GC not initialized 2024-09-12T18:46:36.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f58f27fc640 20 reqs_thread_entry: start 2024-09-12T18:46:36.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:36.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 20 Filter name: none 2024-09-12T18:46:36.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5867fff640 20 reqs_thread_entry: start 2024-09-12T18:46:36.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T18:46:36.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:36.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:46:36.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:46:36.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 : miss 2024-09-12T18:46:36.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:36.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:36.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 info.flags=0x17 2024-09-12T18:46:36.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 to cache LRU end 2024-09-12T18:46:36.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:46:36.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:36.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:36.991+0000 7f5a43dc39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 2024-09-12T18:46:37.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.003+0000 7f5a43dc39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 info.flags=0x17 2024-09-12T18:46:37.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.003+0000 7f5a43dc39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 to cache LRU end 2024-09-12T18:46:37.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.003+0000 7f5a43dc39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:37.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.003+0000 7f5a43dc39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25, ofs0, ns] 2024-09-12T18:46:37.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.003+0000 7f5924ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431606 cookie 94604122508976 notifier 6389 bl.length()=939 2024-09-12T18:46:37.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.003+0000 7f5924ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 info.flags=0x17 2024-09-12T18:46:37.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.003+0000 7f5924ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 to cache LRU end 2024-09-12T18:46:37.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.003+0000 7f5924ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:37.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.007+0000 7f5a43dc39c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): orig_sources= new_sources= 2024-09-12T18:46:37.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.007+0000 7f5a43dc39c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): potential sources added=[] removed=[] 2024-09-12T18:46:37.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.007+0000 7f5a43dc39c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): orig_dests= new_dests= 2024-09-12T18:46:37.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.007+0000 7f5a43dc39c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): potential dests added=[] removed=[] 2024-09-12T18:46:37.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.007+0000 7f5a43dc39c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T18:46:37.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.007+0000 7f5a43dc39c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T18:46:37.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.011+0000 7f58f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:37.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.015+0000 7f5a43dc39c0 20 remove_watcher() i=0 2024-09-12T18:46:37.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.015+0000 7f5a43dc39c0 2 removed watcher, disabling cache 2024-09-12T18:46:37.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.015+0000 7f5a43dc39c0 20 remove_watcher() i=1 2024-09-12T18:46:37.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.019+0000 7f5a43dc39c0 20 remove_watcher() i=2 2024-09-12T18:46:37.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.023+0000 7f5a43dc39c0 20 remove_watcher() i=3 2024-09-12T18:46:37.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.023+0000 7f5a43dc39c0 20 remove_watcher() i=4 2024-09-12T18:46:37.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.023+0000 7f5a43dc39c0 20 remove_watcher() i=5 2024-09-12T18:46:37.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.027+0000 7f5a43dc39c0 20 remove_watcher() i=6 2024-09-12T18:46:37.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.027+0000 7f5a43dc39c0 20 remove_watcher() i=7 2024-09-12T18:46:37.043 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:46:37.069 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:37.069 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:37.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.107+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.111+0000 7f7dac6479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:37.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.111+0000 7f7dac6479c0 20 realm 2024-09-12T18:46:37.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.111+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.111+0000 7f7dac6479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:37.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.111+0000 7f7dac6479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:37.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.111+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.111+0000 7f7dac6479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:37.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.111+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.111+0000 7f7dac6479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:37.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.111+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.115+0000 7f7dac6479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:37.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.115+0000 7f7dac6479c0 20 searching for the correct realm 2024-09-12T18:46:37.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.119+0000 7f7daa94e640 0 -- 172.21.15.111:0/524981744 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x558d063f6300 msgr2=0x558d063f86f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:37.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.123+0000 7f7da994c640 0 -- 172.21.15.111:0/524981744 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f7da405c910 msgr2=0x7f7da404f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:37.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.131+0000 7f7dac6479c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:37.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.131+0000 7f7dac6479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:37.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.131+0000 7f7dac6479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:37.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.131+0000 7f7dac6479c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:37.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.131+0000 7f7dac6479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:37.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.131+0000 7f7dac6479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:37.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.131+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.131+0000 7f7dac6479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:37.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.131+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.131+0000 7f7dac6479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:37.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.131+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:37.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 20 zone default found 2024-09-12T18:46:37.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 4 Realm: () 2024-09-12T18:46:37.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:37.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:37.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:37.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 20 zonegroup default 2024-09-12T18:46:37.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:37.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:37.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:37.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 20 started sync module instance, tier type = 2024-09-12T18:46:37.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.135+0000 7f7dac6479c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:37.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.151+0000 7f7dac6479c0 20 add_watcher() i=0 2024-09-12T18:46:37.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.151+0000 7f7dac6479c0 20 add_watcher() i=1 2024-09-12T18:46:37.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.151+0000 7f7dac6479c0 20 add_watcher() i=2 2024-09-12T18:46:37.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.151+0000 7f7dac6479c0 20 add_watcher() i=3 2024-09-12T18:46:37.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.151+0000 7f7dac6479c0 20 add_watcher() i=4 2024-09-12T18:46:37.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.151+0000 7f7dac6479c0 20 add_watcher() i=5 2024-09-12T18:46:37.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.151+0000 7f7dac6479c0 20 add_watcher() i=6 2024-09-12T18:46:37.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.151+0000 7f7dac6479c0 20 add_watcher() i=7 2024-09-12T18:46:37.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.151+0000 7f7dac6479c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:37.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7c60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:37.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7dac6479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:37.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7dac6479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:37.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7dac6479c0 5 note: GC not initialized 2024-09-12T18:46:37.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7bdb7fe640 20 reqs_thread_entry: start 2024-09-12T18:46:37.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7dac6479c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:37.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7dac6479c0 20 Filter name: none 2024-09-12T18:46:37.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7bd97fa640 20 reqs_thread_entry: start 2024-09-12T18:46:37.158 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7dac6479c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:37.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7dac6479c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:46:37.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7dac6479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:37.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7dac6479c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:37.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.155+0000 7f7dac6479c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.159+0000 7f7dac6479c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:46:37.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.159+0000 7f7dac6479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:37.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.159+0000 7f7c60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:37.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.167+0000 7f7dac6479c0 20 remove_watcher() i=0 2024-09-12T18:46:37.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.167+0000 7f7dac6479c0 2 removed watcher, disabling cache 2024-09-12T18:46:37.170 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.167+0000 7f7dac6479c0 20 remove_watcher() i=1 2024-09-12T18:46:37.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.171+0000 7f7dac6479c0 20 remove_watcher() i=2 2024-09-12T18:46:37.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.171+0000 7f7dac6479c0 20 remove_watcher() i=3 2024-09-12T18:46:37.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.175+0000 7f7dac6479c0 20 remove_watcher() i=4 2024-09-12T18:46:37.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.175+0000 7f7dac6479c0 20 remove_watcher() i=5 2024-09-12T18:46:37.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.175+0000 7f7dac6479c0 20 remove_watcher() i=6 2024-09-12T18:46:37.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.175+0000 7f7dac6479c0 20 remove_watcher() i=7 2024-09-12T18:46:37.193 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:37.193 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:46:37.193 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-trim-reshard-log-entries id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:46:37.193 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:37.194 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:37.197 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:37.205 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:37.205 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:37.249 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:46:37.284 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:37.284 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:37.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.327+0000 7f6c08eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.327+0000 7f6c08eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:37.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.327+0000 7f6c08eca9c0 20 realm 2024-09-12T18:46:37.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.327+0000 7f6c08eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.327+0000 7f6c08eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:37.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.327+0000 7f6c08eca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:37.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.327+0000 7f6c08eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.327+0000 7f6c08eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:37.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.327+0000 7f6c08eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.331+0000 7f6c08eca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:37.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.331+0000 7f6c08eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.331+0000 7f6c08eca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:37.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.331+0000 7f6c08eca9c0 20 searching for the correct realm 2024-09-12T18:46:37.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.335+0000 7f6c071d1640 0 -- 172.21.15.111:0/35300198 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f6bfc0cf040 msgr2=0x7f6bfc0e5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:37.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.551+0000 7f6c061cf640 0 -- 172.21.15.111:0/35300198 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f6bf8088100 msgr2=0x7f6bf808f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:37.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.767+0000 7f6c08eca9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:37.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.767+0000 7f6c08eca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:37.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.767+0000 7f6c08eca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:37.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.767+0000 7f6c08eca9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:37.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.767+0000 7f6c08eca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:37.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.767+0000 7f6c08eca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:37.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.767+0000 7f6c08eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.767+0000 7f6c08eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:37.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.767+0000 7f6c08eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:37.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:37.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 20 zone default found 2024-09-12T18:46:37.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 4 Realm: () 2024-09-12T18:46:37.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:37.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:37.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:37.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 20 zonegroup default 2024-09-12T18:46:37.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:37.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:37.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:37.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 20 started sync module instance, tier type = 2024-09-12T18:46:37.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.771+0000 7f6c08eca9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:37.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.795+0000 7f6c08eca9c0 20 add_watcher() i=0 2024-09-12T18:46:37.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.795+0000 7f6c08eca9c0 20 add_watcher() i=1 2024-09-12T18:46:37.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.795+0000 7f6c08eca9c0 20 add_watcher() i=2 2024-09-12T18:46:37.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.795+0000 7f6c08eca9c0 20 add_watcher() i=3 2024-09-12T18:46:37.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.795+0000 7f6c08eca9c0 20 add_watcher() i=4 2024-09-12T18:46:37.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.795+0000 7f6c08eca9c0 20 add_watcher() i=5 2024-09-12T18:46:37.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.799+0000 7f6c08eca9c0 20 add_watcher() i=6 2024-09-12T18:46:37.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.799+0000 7f6c08eca9c0 20 add_watcher() i=7 2024-09-12T18:46:37.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.799+0000 7f6c08eca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:37.807 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.803+0000 7f6abdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:37.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.803+0000 7f6c08eca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:37.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.803+0000 7f6c08eca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:37.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 5 note: GC not initialized 2024-09-12T18:46:37.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6abcfe1640 20 reqs_thread_entry: start 2024-09-12T18:46:37.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:37.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 20 Filter name: none 2024-09-12T18:46:37.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6ab5ffb640 20 reqs_thread_entry: start 2024-09-12T18:46:37.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T18:46:37.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:37.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:46:37.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:46:37.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 : miss 2024-09-12T18:46:37.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:37.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:46:37.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 info.flags=0x17 2024-09-12T18:46:37.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 to cache LRU end 2024-09-12T18:46:37.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:46:37.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:37.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.807+0000 7f6c08eca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 2024-09-12T18:46:37.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.811+0000 7f6c08eca9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:46:37.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.827+0000 7f6c08eca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 info.flags=0x17 2024-09-12T18:46:37.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.827+0000 7f6c08eca9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 to cache LRU end 2024-09-12T18:46:37.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.827+0000 7f6c08eca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:37.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.827+0000 7f6c08eca9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25, ofs0, ns] 2024-09-12T18:46:37.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.827+0000 7f6aea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431607 cookie 94880084081312 notifier 6422 bl.length()=939 2024-09-12T18:46:37.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.827+0000 7f6aea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 info.flags=0x17 2024-09-12T18:46:37.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.827+0000 7f6aea7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 to cache LRU end 2024-09-12T18:46:37.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.827+0000 7f6aea7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:37.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.831+0000 7f6c08eca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): orig_sources= new_sources= 2024-09-12T18:46:37.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.831+0000 7f6c08eca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): potential sources added=[] removed=[] 2024-09-12T18:46:37.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.831+0000 7f6c08eca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): orig_dests= new_dests= 2024-09-12T18:46:37.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.831+0000 7f6c08eca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): potential dests added=[] removed=[] 2024-09-12T18:46:37.842 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.0 2024-09-12T18:46:37.842 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.0 2024-09-12T18:46:37.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.1 2024-09-12T18:46:37.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.1 2024-09-12T18:46:37.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.2 2024-09-12T18:46:37.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.2 2024-09-12T18:46:37.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.3 2024-09-12T18:46:37.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.3 2024-09-12T18:46:37.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.4 2024-09-12T18:46:37.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.4 2024-09-12T18:46:37.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.5 2024-09-12T18:46:37.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.5 2024-09-12T18:46:37.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.6 2024-09-12T18:46:37.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.6 2024-09-12T18:46:37.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.7 2024-09-12T18:46:37.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.7 2024-09-12T18:46:37.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.8 2024-09-12T18:46:37.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.8 2024-09-12T18:46:37.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.9 2024-09-12T18:46:37.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.9 2024-09-12T18:46:37.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.10 2024-09-12T18:46:37.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.10 2024-09-12T18:46:37.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.11 2024-09-12T18:46:37.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2.11 2024-09-12T18:46:37.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.0 2024-09-12T18:46:37.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.839+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.1 2024-09-12T18:46:37.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.843+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2 2024-09-12T18:46:37.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.843+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.3 2024-09-12T18:46:37.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.843+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.4 2024-09-12T18:46:37.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.843+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.5 2024-09-12T18:46:37.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.843+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.6 2024-09-12T18:46:37.848 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.847+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.7 2024-09-12T18:46:37.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.847+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.8 2024-09-12T18:46:37.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.847+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.9 2024-09-12T18:46:37.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.851+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.10 2024-09-12T18:46:37.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.855+0000 7f6c08eca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 : hit (requested=0x17, cached=0x17) 2024-09-12T18:46:37.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.855+0000 7f6c08eca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 2024-09-12T18:46:37.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.859+0000 7f6c08eca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 info.flags=0x17 2024-09-12T18:46:37.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.859+0000 7f6c08eca9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 to cache LRU end 2024-09-12T18:46:37.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.859+0000 7f6c08eca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:37.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.859+0000 7f6c08eca9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25, ofs0, ns] 2024-09-12T18:46:37.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.859+0000 7f6ae9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431608 cookie 94880084081312 notifier 6422 bl.length()=939 2024-09-12T18:46:37.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.859+0000 7f6ae9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 info.flags=0x17 2024-09-12T18:46:37.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.859+0000 7f6ae9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 to cache LRU end 2024-09-12T18:46:37.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.859+0000 7f6ae9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:37.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.863+0000 7f6c08eca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): orig_sources= new_sources= 2024-09-12T18:46:37.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.863+0000 7f6c08eca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): potential sources added=[] removed=[] 2024-09-12T18:46:37.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.863+0000 7f6c08eca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): orig_dests= new_dests= 2024-09-12T18:46:37.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.863+0000 7f6c08eca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): potential dests added=[] removed=[] 2024-09-12T18:46:37.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.867+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.0 2024-09-12T18:46:37.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.867+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.1 2024-09-12T18:46:37.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.867+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.2 2024-09-12T18:46:37.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.867+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.3 2024-09-12T18:46:37.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.867+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.4 2024-09-12T18:46:37.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.871+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.5 2024-09-12T18:46:37.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.871+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.6 2024-09-12T18:46:37.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.871+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.7 2024-09-12T18:46:37.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.871+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.8 2024-09-12T18:46:37.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.871+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.9 2024-09-12T18:46:37.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.871+0000 7f6c08eca9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.25.10 2024-09-12T18:46:37.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.875+0000 7f6c08eca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 : hit (requested=0x17, cached=0x17) 2024-09-12T18:46:37.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.875+0000 7f6c08eca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 2024-09-12T18:46:37.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.875+0000 7f6c08eca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 info.flags=0x17 2024-09-12T18:46:37.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.875+0000 7f6c08eca9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 to cache LRU end 2024-09-12T18:46:37.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.875+0000 7f6c08eca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:37.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.875+0000 7f6c08eca9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25, ofs0, ns] 2024-09-12T18:46:37.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.879+0000 7f6ae9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431609 cookie 94880084081312 notifier 6422 bl.length()=907 2024-09-12T18:46:37.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.879+0000 7f6ae9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 info.flags=0x17 2024-09-12T18:46:37.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.879+0000 7f6ae9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.25 to cache LRU end 2024-09-12T18:46:37.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.879+0000 7f6ae9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:37.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.879+0000 7f6c08eca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): orig_sources= new_sources= 2024-09-12T18:46:37.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.879+0000 7f6c08eca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): potential sources added=[] removed=[] 2024-09-12T18:46:37.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.879+0000 7f6c08eca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): orig_dests= new_dests= 2024-09-12T18:46:37.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.879+0000 7f6c08eca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.25]): potential dests added=[] removed=[] 2024-09-12T18:46:37.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.883+0000 7f6c08eca9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T18:46:37.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.887+0000 7f6abdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:37.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.895+0000 7f6c08eca9c0 20 remove_watcher() i=0 2024-09-12T18:46:37.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.895+0000 7f6c08eca9c0 2 removed watcher, disabling cache 2024-09-12T18:46:37.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.895+0000 7f6c08eca9c0 20 remove_watcher() i=1 2024-09-12T18:46:37.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.899+0000 7f6c08eca9c0 20 remove_watcher() i=2 2024-09-12T18:46:37.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.899+0000 7f6c08eca9c0 20 remove_watcher() i=3 2024-09-12T18:46:37.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.903+0000 7f6c08eca9c0 20 remove_watcher() i=4 2024-09-12T18:46:37.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.903+0000 7f6c08eca9c0 20 remove_watcher() i=5 2024-09-12T18:46:37.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.907+0000 7f6c08eca9c0 20 remove_watcher() i=6 2024-09-12T18:46:37.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:37.907+0000 7f6c08eca9c0 20 remove_watcher() i=7 2024-09-12T18:46:37.932 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:46:37.963 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:37.964 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:38.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.007+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.007+0000 7fa9ff37f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:38.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.007+0000 7fa9ff37f9c0 20 realm 2024-09-12T18:46:38.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.007+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.007+0000 7fa9ff37f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:38.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.007+0000 7fa9ff37f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:38.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.007+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.007+0000 7fa9ff37f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:38.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.007+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.011+0000 7fa9ff37f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:38.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.011+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.011+0000 7fa9ff37f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:38.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.011+0000 7fa9ff37f9c0 20 searching for the correct realm 2024-09-12T18:46:38.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.015+0000 7fa9fce85640 0 -- 172.21.15.111:0/4237209865 >> [v2:172.21.15.111:6800/2832238944,v1:172.21.15.111:6801/2832238944] conn(0x5580f0e01c50 msgr2=0x5580f0e040a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:46:38.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.023+0000 7fa9fc684640 0 -- 172.21.15.111:0/4237209865 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fa9f4106400 msgr2=0x7fa9f40fe930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:38.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:38.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:38.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:38.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:38.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:38.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:38.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:38.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:38.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:38.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 zone default found 2024-09-12T18:46:38.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 4 Realm: () 2024-09-12T18:46:38.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:38.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:38.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:38.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 zonegroup default 2024-09-12T18:46:38.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:38.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.031+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.035+0000 7fa9ff37f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:38.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.035+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.035+0000 7fa9ff37f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:38.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.035+0000 7fa9ff37f9c0 20 started sync module instance, tier type = 2024-09-12T18:46:38.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.035+0000 7fa9ff37f9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:38.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.051+0000 7fa9ff37f9c0 20 add_watcher() i=0 2024-09-12T18:46:38.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.051+0000 7fa9ff37f9c0 20 add_watcher() i=1 2024-09-12T18:46:38.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.051+0000 7fa9ff37f9c0 20 add_watcher() i=2 2024-09-12T18:46:38.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.051+0000 7fa9ff37f9c0 20 add_watcher() i=3 2024-09-12T18:46:38.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.051+0000 7fa9ff37f9c0 20 add_watcher() i=4 2024-09-12T18:46:38.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.051+0000 7fa9ff37f9c0 20 add_watcher() i=5 2024-09-12T18:46:38.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.051+0000 7fa9ff37f9c0 20 add_watcher() i=6 2024-09-12T18:46:38.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.051+0000 7fa9ff37f9c0 20 add_watcher() i=7 2024-09-12T18:46:38.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.051+0000 7fa9ff37f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:38.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.051+0000 7fa8b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:38.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.055+0000 7fa9ff37f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:38.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.055+0000 7fa9ff37f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:38.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.055+0000 7fa9ff37f9c0 5 note: GC not initialized 2024-09-12T18:46:38.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.055+0000 7fa8b1fe3640 20 reqs_thread_entry: start 2024-09-12T18:46:38.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.055+0000 7fa9ff37f9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:38.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.055+0000 7fa9ff37f9c0 20 Filter name: none 2024-09-12T18:46:38.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.055+0000 7fa8237fe640 20 reqs_thread_entry: start 2024-09-12T18:46:38.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.055+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.055+0000 7fa9ff37f9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:38.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.055+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.055+0000 7fa9ff37f9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:38.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.055+0000 7fa9ff37f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:38.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.055+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.059+0000 7fa9ff37f9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:38.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.059+0000 7fa9ff37f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.059+0000 7fa9ff37f9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:38.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.059+0000 7fa9ff37f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:38.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.063+0000 7fa8b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:38.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.067+0000 7fa9ff37f9c0 20 remove_watcher() i=0 2024-09-12T18:46:38.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.067+0000 7fa9ff37f9c0 2 removed watcher, disabling cache 2024-09-12T18:46:38.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.067+0000 7fa9ff37f9c0 20 remove_watcher() i=1 2024-09-12T18:46:38.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.071+0000 7fa9ff37f9c0 20 remove_watcher() i=2 2024-09-12T18:46:38.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.071+0000 7fa9ff37f9c0 20 remove_watcher() i=3 2024-09-12T18:46:38.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.075+0000 7fa9ff37f9c0 20 remove_watcher() i=4 2024-09-12T18:46:38.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.075+0000 7fa9ff37f9c0 20 remove_watcher() i=5 2024-09-12T18:46:38.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.079+0000 7fa9ff37f9c0 20 remove_watcher() i=6 2024-09-12T18:46:38.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.079+0000 7fa9ff37f9c0 20 remove_watcher() i=7 2024-09-12T18:46:38.094 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:38.095 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:46:38.095 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-trim-reshard-log-entries id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:46:38.095 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:38.096 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.096 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.099 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.099 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.150 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.150 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.207 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T18:46:38.208 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:38.209 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.209 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.232 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.232 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.279 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.279 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.298 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.298 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.316 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.316 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.333 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.333 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.354 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.354 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.372 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.372 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.390 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.390 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.408 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.408 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.426 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.426 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.443 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.444 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.462 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.462 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.480 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.480 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.498 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.498 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.516 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.516 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.533 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.533 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.551 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.551 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.570 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.570 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.588 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.588 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.605 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.605 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.625 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:38.628 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:38.642 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:46:38.674 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:38.674 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:38.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.719+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.719+0000 7ff13b7e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:38.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.719+0000 7ff13b7e99c0 20 realm 2024-09-12T18:46:38.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.719+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.719+0000 7ff13b7e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:38.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.719+0000 7ff13b7e99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:38.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.719+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.719+0000 7ff13b7e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:38.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.719+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.723+0000 7ff13b7e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:38.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.723+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.723+0000 7ff13b7e99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:38.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.723+0000 7ff13b7e99c0 20 searching for the correct realm 2024-09-12T18:46:38.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.727+0000 7ff139af0640 0 -- 172.21.15.111:0/3611305988 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7ff1300c1020 msgr2=0x7ff130102930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:38.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.735+0000 7ff138aee640 0 -- 172.21.15.111:0/3611305988 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7ff13406d580 msgr2=0x7ff1340898d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:38.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.951+0000 7ff13b7e99c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:38.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.951+0000 7ff13b7e99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:38.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.951+0000 7ff13b7e99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:38.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.951+0000 7ff13b7e99c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:38.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.951+0000 7ff13b7e99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:38.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.951+0000 7ff13b7e99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:38.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.951+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.951+0000 7ff13b7e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:38.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.951+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:38.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:38.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 20 zone default found 2024-09-12T18:46:38.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 4 Realm: () 2024-09-12T18:46:38.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:38.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:38.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:38.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 20 zonegroup default 2024-09-12T18:46:38.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:38.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:38.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:38.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 20 started sync module instance, tier type = 2024-09-12T18:46:38.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.955+0000 7ff13b7e99c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:38.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.979+0000 7ff13b7e99c0 20 add_watcher() i=0 2024-09-12T18:46:38.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.979+0000 7ff13b7e99c0 20 add_watcher() i=1 2024-09-12T18:46:38.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.979+0000 7ff13b7e99c0 20 add_watcher() i=2 2024-09-12T18:46:38.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.979+0000 7ff13b7e99c0 20 add_watcher() i=3 2024-09-12T18:46:38.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.979+0000 7ff13b7e99c0 20 add_watcher() i=4 2024-09-12T18:46:38.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.979+0000 7ff13b7e99c0 20 add_watcher() i=5 2024-09-12T18:46:38.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.979+0000 7ff13b7e99c0 20 add_watcher() i=6 2024-09-12T18:46:38.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.983+0000 7ff13b7e99c0 20 add_watcher() i=7 2024-09-12T18:46:38.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.983+0000 7ff13b7e99c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:38.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.987+0000 7fefef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:38.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.987+0000 7ff13b7e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:38.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.987+0000 7ff13b7e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:38.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.987+0000 7ff13b7e99c0 5 note: GC not initialized 2024-09-12T18:46:38.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.987+0000 7fefee7e4640 20 reqs_thread_entry: start 2024-09-12T18:46:38.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.987+0000 7ff13b7e99c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:38.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.987+0000 7ff13b7e99c0 20 Filter name: none 2024-09-12T18:46:38.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.987+0000 7fef5ffff640 20 reqs_thread_entry: start 2024-09-12T18:46:38.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.987+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.987+0000 7ff13b7e99c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:38.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.987+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.991+0000 7ff13b7e99c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:38.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.991+0000 7ff13b7e99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:38.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.991+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.991+0000 7ff13b7e99c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:38.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.991+0000 7ff13b7e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:38.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.995+0000 7ff13b7e99c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:38.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.995+0000 7ff13b7e99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:38.999 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:38.995+0000 7fefef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:39.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.003+0000 7ff13b7e99c0 20 remove_watcher() i=0 2024-09-12T18:46:39.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.003+0000 7ff13b7e99c0 2 removed watcher, disabling cache 2024-09-12T18:46:39.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.003+0000 7ff13b7e99c0 20 remove_watcher() i=1 2024-09-12T18:46:39.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.007+0000 7ff13b7e99c0 20 remove_watcher() i=2 2024-09-12T18:46:39.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.007+0000 7ff13b7e99c0 20 remove_watcher() i=3 2024-09-12T18:46:39.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.011+0000 7ff13b7e99c0 20 remove_watcher() i=4 2024-09-12T18:46:39.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.011+0000 7ff13b7e99c0 20 remove_watcher() i=5 2024-09-12T18:46:39.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.015+0000 7ff13b7e99c0 20 remove_watcher() i=6 2024-09-12T18:46:39.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.015+0000 7ff13b7e99c0 20 remove_watcher() i=7 2024-09-12T18:46:39.037 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:39.038 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:46:39.038 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-trim-reshard-log-entries id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:46:39.038 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:39.040 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T18:46:39.074 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:39.074 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:39.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.115+0000 7fc08b23c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.119+0000 7fc08b23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:39.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.119+0000 7fc08b23c9c0 20 realm 2024-09-12T18:46:39.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.119+0000 7fc08b23c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.119+0000 7fc08b23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:39.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.119+0000 7fc08b23c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:39.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.119+0000 7fc08b23c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.119+0000 7fc08b23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:39.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.119+0000 7fc08b23c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.119+0000 7fc08b23c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:39.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.119+0000 7fc08b23c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.119+0000 7fc08b23c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:39.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.123+0000 7fc08b23c9c0 20 searching for the correct realm 2024-09-12T18:46:39.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.127+0000 7fc088d42640 0 -- 172.21.15.111:0/1787399836 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fc0800fe010 msgr2=0x7fc080105910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:39.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.131+0000 7fc088541640 0 -- 172.21.15.111:0/1787399836 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fc080102160 msgr2=0x7fc0801171b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:46:39.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.347+0000 7fc08b23c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:39.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.347+0000 7fc08b23c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:39.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.347+0000 7fc08b23c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:39.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.347+0000 7fc08b23c9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:39.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.347+0000 7fc08b23c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:39.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.347+0000 7fc08b23c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:39.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.347+0000 7fc08b23c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.347+0000 7fc08b23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:39.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.347+0000 7fc08b23c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:39.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:39.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 20 zone default found 2024-09-12T18:46:39.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 4 Realm: () 2024-09-12T18:46:39.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:39.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:39.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:39.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 20 zonegroup default 2024-09-12T18:46:39.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:39.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:39.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:39.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 20 started sync module instance, tier type = 2024-09-12T18:46:39.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.351+0000 7fc08b23c9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:39.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.375+0000 7fc08b23c9c0 20 add_watcher() i=0 2024-09-12T18:46:39.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.375+0000 7fc08b23c9c0 20 add_watcher() i=1 2024-09-12T18:46:39.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.375+0000 7fc08b23c9c0 20 add_watcher() i=2 2024-09-12T18:46:39.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.375+0000 7fc08b23c9c0 20 add_watcher() i=3 2024-09-12T18:46:39.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.375+0000 7fc08b23c9c0 20 add_watcher() i=4 2024-09-12T18:46:39.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.375+0000 7fc08b23c9c0 20 add_watcher() i=5 2024-09-12T18:46:39.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.375+0000 7fc08b23c9c0 20 add_watcher() i=6 2024-09-12T18:46:39.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.379+0000 7fc08b23c9c0 20 add_watcher() i=7 2024-09-12T18:46:39.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.379+0000 7fc08b23c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:39.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.383+0000 7fbf3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:39.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.383+0000 7fc08b23c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:39.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.383+0000 7fc08b23c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:39.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.383+0000 7fc08b23c9c0 5 note: GC not initialized 2024-09-12T18:46:39.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.383+0000 7fbf3dfe3640 20 reqs_thread_entry: start 2024-09-12T18:46:39.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.383+0000 7fc08b23c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:39.388 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.383+0000 7fc08b23c9c0 20 Filter name: none 2024-09-12T18:46:39.388 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.387+0000 7fbeaf7fe640 20 reqs_thread_entry: start 2024-09-12T18:46:39.388 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.387+0000 7fc08b23c9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T18:46:39.388 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.387+0000 7fc08b23c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.387+0000 7fc08b23c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:39.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.387+0000 7fc08b23c9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:46:39.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.387+0000 7fc08b23c9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:46:39.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.387+0000 7fc08b23c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26 : miss 2024-09-12T18:46:39.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.387+0000 7fc08b23c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.387+0000 7fc08b23c9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:39.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.387+0000 7fc08b23c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26 info.flags=0x17 2024-09-12T18:46:39.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.387+0000 7fc08b23c9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26 to cache LRU end 2024-09-12T18:46:39.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.387+0000 7fc08b23c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:46:39.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.387+0000 7fc08b23c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:39.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.387+0000 7fc08b23c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26 2024-09-12T18:46:39.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.399+0000 7fc08b23c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26 info.flags=0x17 2024-09-12T18:46:39.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.399+0000 7fc08b23c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26 to cache LRU end 2024-09-12T18:46:39.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.399+0000 7fc08b23c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:39.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.399+0000 7fc08b23c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26, ofs0, ns] 2024-09-12T18:46:39.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.399+0000 7fbf5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431612 cookie 94357350492272 notifier 6876 bl.length()=939 2024-09-12T18:46:39.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.399+0000 7fbf5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26 info.flags=0x17 2024-09-12T18:46:39.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.399+0000 7fbf5f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26 to cache LRU end 2024-09-12T18:46:39.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.399+0000 7fbf5f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:39.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.399+0000 7fc08b23c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.26]): orig_sources= new_sources= 2024-09-12T18:46:39.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.399+0000 7fc08b23c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.26]): potential sources added=[] removed=[] 2024-09-12T18:46:39.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.399+0000 7fc08b23c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.26]): orig_dests= new_dests= 2024-09-12T18:46:39.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.399+0000 7fc08b23c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.26]): potential dests added=[] removed=[] 2024-09-12T18:46:39.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.399+0000 7fc08b23c9c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T18:46:39.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.399+0000 7fc08b23c9c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T18:46:39.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.0 2024-09-12T18:46:39.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.0 2024-09-12T18:46:39.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.1 2024-09-12T18:46:39.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.1 2024-09-12T18:46:39.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.2 2024-09-12T18:46:39.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.2 2024-09-12T18:46:39.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.3 2024-09-12T18:46:39.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.3 2024-09-12T18:46:39.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.4 2024-09-12T18:46:39.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.4 2024-09-12T18:46:39.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.5 2024-09-12T18:46:39.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.5 2024-09-12T18:46:39.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.6 2024-09-12T18:46:39.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.6 2024-09-12T18:46:39.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.7 2024-09-12T18:46:39.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.7 2024-09-12T18:46:39.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.8 2024-09-12T18:46:39.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.8 2024-09-12T18:46:39.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.9 2024-09-12T18:46:39.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.9 2024-09-12T18:46:39.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.10 2024-09-12T18:46:39.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.10 2024-09-12T18:46:39.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.11 2024-09-12T18:46:39.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1.11 2024-09-12T18:46:39.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.0 2024-09-12T18:46:39.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.1 2024-09-12T18:46:39.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.407+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.2 2024-09-12T18:46:39.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.411+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.3 2024-09-12T18:46:39.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.411+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.4 2024-09-12T18:46:39.414 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.411+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.5 2024-09-12T18:46:39.416 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.411+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.6 2024-09-12T18:46:39.416 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.415+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.7 2024-09-12T18:46:39.417 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.415+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.8 2024-09-12T18:46:39.419 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.415+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.9 2024-09-12T18:46:39.420 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.419+0000 7fc08b23c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.26.10 2024-09-12T18:46:39.427 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.423+0000 7fc08b23c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26 : hit (requested=0x17, cached=0x17) 2024-09-12T18:46:39.427 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.423+0000 7fc08b23c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26 2024-09-12T18:46:39.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.427+0000 7fc08b23c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26 info.flags=0x17 2024-09-12T18:46:39.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.427+0000 7fc08b23c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26 to cache LRU end 2024-09-12T18:46:39.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.427+0000 7fc08b23c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:39.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.427+0000 7fc08b23c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26, ofs0, ns] 2024-09-12T18:46:39.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.427+0000 7fbf5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431613 cookie 94357350492272 notifier 6876 bl.length()=907 2024-09-12T18:46:39.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.427+0000 7fbf5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26 info.flags=0x17 2024-09-12T18:46:39.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.427+0000 7fbf5f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.26 to cache LRU end 2024-09-12T18:46:39.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.427+0000 7fbf5f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:39.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.431+0000 7fc08b23c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.26]): orig_sources= new_sources= 2024-09-12T18:46:39.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.431+0000 7fc08b23c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.26]): potential sources added=[] removed=[] 2024-09-12T18:46:39.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.431+0000 7fc08b23c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.26]): orig_dests= new_dests= 2024-09-12T18:46:39.432 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.431+0000 7fc08b23c9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.26]): potential dests added=[] removed=[] 2024-09-12T18:46:39.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.435+0000 7fc08b23c9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T18:46:39.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.439+0000 7fbf3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:39.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.447+0000 7fc08b23c9c0 20 remove_watcher() i=0 2024-09-12T18:46:39.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.447+0000 7fc08b23c9c0 2 removed watcher, disabling cache 2024-09-12T18:46:39.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.447+0000 7fc08b23c9c0 20 remove_watcher() i=1 2024-09-12T18:46:39.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.451+0000 7fc08b23c9c0 20 remove_watcher() i=2 2024-09-12T18:46:39.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.451+0000 7fc08b23c9c0 20 remove_watcher() i=3 2024-09-12T18:46:39.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.455+0000 7fc08b23c9c0 20 remove_watcher() i=4 2024-09-12T18:46:39.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.455+0000 7fc08b23c9c0 20 remove_watcher() i=5 2024-09-12T18:46:39.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.455+0000 7fc08b23c9c0 20 remove_watcher() i=6 2024-09-12T18:46:39.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.459+0000 7fc08b23c9c0 20 remove_watcher() i=7 2024-09-12T18:46:39.477 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T18:46:39.507 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:39.507 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:39.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.551+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.551+0000 7f314ef379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:39.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.551+0000 7f314ef379c0 20 realm 2024-09-12T18:46:39.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.551+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.551+0000 7f314ef379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:39.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.551+0000 7f314ef379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:39.555 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.551+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.555 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.551+0000 7f314ef379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:39.555 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.551+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.555+0000 7f314ef379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:39.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.555+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.555+0000 7f314ef379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:39.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.555+0000 7f314ef379c0 20 searching for the correct realm 2024-09-12T18:46:39.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.559+0000 7f314d23e640 0 -- 172.21.15.111:0/1930186140 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f3140033070 msgr2=0x7f314001a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:39.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.567+0000 7f314c23c640 0 -- 172.21.15.111:0/1930186140 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f3144002ca0 msgr2=0x7f314411fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:39.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.783+0000 7f314ef379c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:39.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.783+0000 7f314ef379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:39.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.783+0000 7f314ef379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:39.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.783+0000 7f314ef379c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:39.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.783+0000 7f314ef379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:39.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.783+0000 7f314ef379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:39.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.783+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.783+0000 7f314ef379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:39.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.783+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:39.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:39.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 20 zone default found 2024-09-12T18:46:39.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 4 Realm: () 2024-09-12T18:46:39.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:39.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:39.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:39.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 20 zonegroup default 2024-09-12T18:46:39.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:39.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:39.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:39.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 20 started sync module instance, tier type = 2024-09-12T18:46:39.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.787+0000 7f314ef379c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:39.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.815+0000 7f314ef379c0 20 add_watcher() i=0 2024-09-12T18:46:39.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.815+0000 7f314ef379c0 20 add_watcher() i=1 2024-09-12T18:46:39.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.815+0000 7f314ef379c0 20 add_watcher() i=2 2024-09-12T18:46:39.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.815+0000 7f314ef379c0 20 add_watcher() i=3 2024-09-12T18:46:39.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.815+0000 7f314ef379c0 20 add_watcher() i=4 2024-09-12T18:46:39.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.815+0000 7f314ef379c0 20 add_watcher() i=5 2024-09-12T18:46:39.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.815+0000 7f314ef379c0 20 add_watcher() i=6 2024-09-12T18:46:39.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.815+0000 7f314ef379c0 20 add_watcher() i=7 2024-09-12T18:46:39.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.815+0000 7f314ef379c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:39.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.819+0000 7f3002fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:39.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.823+0000 7f314ef379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:39.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.823+0000 7f314ef379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:39.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.823+0000 7f314ef379c0 5 note: GC not initialized 2024-09-12T18:46:39.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.823+0000 7f3001fe3640 20 reqs_thread_entry: start 2024-09-12T18:46:39.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.823+0000 7f314ef379c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:39.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.823+0000 7f314ef379c0 20 Filter name: none 2024-09-12T18:46:39.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.823+0000 7f2f737fe640 20 reqs_thread_entry: start 2024-09-12T18:46:39.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.823+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.823+0000 7f314ef379c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:39.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.823+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.827+0000 7f314ef379c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:39.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.827+0000 7f314ef379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:39.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.827+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.827+0000 7f314ef379c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:39.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.827+0000 7f314ef379c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:39.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.827+0000 7f314ef379c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:39.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.827+0000 7f314ef379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:39.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.831+0000 7f3002fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:39.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.839+0000 7f314ef379c0 20 remove_watcher() i=0 2024-09-12T18:46:39.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.839+0000 7f314ef379c0 2 removed watcher, disabling cache 2024-09-12T18:46:39.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.839+0000 7f314ef379c0 20 remove_watcher() i=1 2024-09-12T18:46:39.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.843+0000 7f314ef379c0 20 remove_watcher() i=2 2024-09-12T18:46:39.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.843+0000 7f314ef379c0 20 remove_watcher() i=3 2024-09-12T18:46:39.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.847+0000 7f314ef379c0 20 remove_watcher() i=4 2024-09-12T18:46:39.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.847+0000 7f314ef379c0 20 remove_watcher() i=5 2024-09-12T18:46:39.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.851+0000 7f314ef379c0 20 remove_watcher() i=6 2024-09-12T18:46:39.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:39.851+0000 7f314ef379c0 20 remove_watcher() i=7 2024-09-12T18:46:39.873 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:39.873 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:46:39.873 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-trim-reshard-log-entries id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T18:46:39.873 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:39.874 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:39.874 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:39.877 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:39.877 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:39.922 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:39.922 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:39.970 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T18:46:39.970 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:39.971 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:39.971 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:39.991 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:39.991 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.040 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.041 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.059 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.059 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.078 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.078 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.097 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.098 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.116 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.116 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.135 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.135 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.154 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.154 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.175 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.175 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.194 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.194 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.213 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.213 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.232 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.232 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.251 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.251 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.273 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.273 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.291 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.291 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.310 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.311 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.330 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.330 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.349 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.349 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.368 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.368 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.388 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.388 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.406 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:40.407 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:40.424 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T18:46:40.457 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:40.457 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:40.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.499+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.499+0000 7efe00e389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:40.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.499+0000 7efe00e389c0 20 realm 2024-09-12T18:46:40.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.499+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.499+0000 7efe00e389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:40.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.499+0000 7efe00e389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:40.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.499+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.499+0000 7efe00e389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:40.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.499+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.503+0000 7efe00e389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:40.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.503+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.503+0000 7efe00e389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:40.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.503+0000 7efe00e389c0 20 searching for the correct realm 2024-09-12T18:46:40.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.507+0000 7efdfe93e640 0 -- 172.21.15.111:0/2064704120 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7efdf8107640 msgr2=0x7efdf80fd5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:40.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.515+0000 7efdfe13d640 0 -- 172.21.15.111:0/2064704120 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7efdf81052c0 msgr2=0x7efdf8123990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:46:40.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.731+0000 7efe00e389c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:40.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.731+0000 7efe00e389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:40.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.731+0000 7efe00e389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:40.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.731+0000 7efe00e389c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:40.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.731+0000 7efe00e389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:40.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.731+0000 7efe00e389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:40.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.731+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.731+0000 7efe00e389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:40.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.731+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:40.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:40.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 20 zone default found 2024-09-12T18:46:40.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 4 Realm: () 2024-09-12T18:46:40.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:40.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:40.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:40.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 20 zonegroup default 2024-09-12T18:46:40.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:40.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:40.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:40.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 20 started sync module instance, tier type = 2024-09-12T18:46:40.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.735+0000 7efe00e389c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:40.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.763+0000 7efe00e389c0 20 add_watcher() i=0 2024-09-12T18:46:40.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.763+0000 7efe00e389c0 20 add_watcher() i=1 2024-09-12T18:46:40.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.763+0000 7efe00e389c0 20 add_watcher() i=2 2024-09-12T18:46:40.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.763+0000 7efe00e389c0 20 add_watcher() i=3 2024-09-12T18:46:40.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.763+0000 7efe00e389c0 20 add_watcher() i=4 2024-09-12T18:46:40.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.763+0000 7efe00e389c0 20 add_watcher() i=5 2024-09-12T18:46:40.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.763+0000 7efe00e389c0 20 add_watcher() i=6 2024-09-12T18:46:40.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.763+0000 7efe00e389c0 20 add_watcher() i=7 2024-09-12T18:46:40.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.763+0000 7efe00e389c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:40.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.767+0000 7efcb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:40.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.771+0000 7efe00e389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:40.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.771+0000 7efe00e389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:40.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.771+0000 7efe00e389c0 5 note: GC not initialized 2024-09-12T18:46:40.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.771+0000 7efc2ffff640 20 reqs_thread_entry: start 2024-09-12T18:46:40.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.771+0000 7efe00e389c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:40.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.771+0000 7efe00e389c0 20 Filter name: none 2024-09-12T18:46:40.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.771+0000 7efc2dffb640 20 reqs_thread_entry: start 2024-09-12T18:46:40.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.771+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.771+0000 7efe00e389c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:40.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.771+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.771+0000 7efe00e389c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:40.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.771+0000 7efe00e389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:40.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.771+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.775+0000 7efe00e389c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:40.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.775+0000 7efe00e389c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.775+0000 7efe00e389c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:40.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.775+0000 7efe00e389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:40.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.779+0000 7efcb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:40.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.783+0000 7efe00e389c0 20 remove_watcher() i=0 2024-09-12T18:46:40.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.783+0000 7efe00e389c0 2 removed watcher, disabling cache 2024-09-12T18:46:40.789 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.787+0000 7efe00e389c0 20 remove_watcher() i=1 2024-09-12T18:46:40.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.787+0000 7efe00e389c0 20 remove_watcher() i=2 2024-09-12T18:46:40.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.791+0000 7efe00e389c0 20 remove_watcher() i=3 2024-09-12T18:46:40.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.791+0000 7efe00e389c0 20 remove_watcher() i=4 2024-09-12T18:46:40.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.795+0000 7efe00e389c0 20 remove_watcher() i=5 2024-09-12T18:46:40.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.795+0000 7efe00e389c0 20 remove_watcher() i=6 2024-09-12T18:46:40.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.799+0000 7efe00e389c0 20 remove_watcher() i=7 2024-09-12T18:46:40.815 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:40.815 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:46:40.815 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-trim-reshard-log-entries id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:46:40.815 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:40.815 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T18:46:40.848 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:40.848 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:40.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.887+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:40.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.891+0000 7f833042b9c0 20 realm 2024-09-12T18:46:40.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:40.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.891+0000 7f833042b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:40.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:40.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:40.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:40.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.895+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:40.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.895+0000 7f833042b9c0 20 searching for the correct realm 2024-09-12T18:46:40.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.899+0000 7f832df31640 0 -- 172.21.15.111:0/2467882799 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f832802e060 msgr2=0x7f83280617a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:40.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:40.903+0000 7f832d730640 0 -- 172.21.15.111:0/2467882799 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f8328087b70 msgr2=0x7f83280871d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:41.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:41.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:41.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:41.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:41.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:41.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:41.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.119+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.119+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.119+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:41.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:41.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 20 zone default found 2024-09-12T18:46:41.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 4 Realm: () 2024-09-12T18:46:41.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:41.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:41.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:41.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 20 zonegroup default 2024-09-12T18:46:41.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 20 started sync module instance, tier type = 2024-09-12T18:46:41.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.123+0000 7f833042b9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:41.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=0 2024-09-12T18:46:41.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=1 2024-09-12T18:46:41.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=2 2024-09-12T18:46:41.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=3 2024-09-12T18:46:41.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=4 2024-09-12T18:46:41.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=5 2024-09-12T18:46:41.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=6 2024-09-12T18:46:41.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.151+0000 7f833042b9c0 20 add_watcher() i=7 2024-09-12T18:46:41.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.151+0000 7f833042b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:41.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.155+0000 7f81df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:41.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.155+0000 7f833042b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:41.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.155+0000 7f833042b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:41.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.155+0000 7f833042b9c0 5 note: GC not initialized 2024-09-12T18:46:41.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.155+0000 7f81de7fc640 20 reqs_thread_entry: start 2024-09-12T18:46:41.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.155+0000 7f833042b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:41.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.155+0000 7f833042b9c0 20 Filter name: none 2024-09-12T18:46:41.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.155+0000 7f814ffff640 20 reqs_thread_entry: start 2024-09-12T18:46:41.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.155+0000 7f833042b9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:46:41.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.155+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.159+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:41.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.159+0000 7f833042b9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:46:41.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.159+0000 7f833042b9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:46:41.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.159+0000 7f833042b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 : miss 2024-09-12T18:46:41.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.159+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.159+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:41.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.159+0000 7f833042b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:46:41.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.159+0000 7f833042b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:46:41.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.159+0000 7f833042b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:46:41.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.159+0000 7f833042b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:41.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.159+0000 7f833042b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 2024-09-12T18:46:41.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.171+0000 7f833042b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:46:41.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.171+0000 7f833042b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:46:41.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.171+0000 7f833042b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:41.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.171+0000 7f833042b9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27, ofs0, ns] 2024-09-12T18:46:41.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.171+0000 7f82117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431580 cookie 94022740726624 notifier 6521 bl.length()=939 2024-09-12T18:46:41.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.171+0000 7f82117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:46:41.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.171+0000 7f82117fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:46:41.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.171+0000 7f82117fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:41.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.171+0000 7f833042b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): orig_sources= new_sources= 2024-09-12T18:46:41.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.171+0000 7f833042b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): potential sources added=[] removed=[] 2024-09-12T18:46:41.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.171+0000 7f833042b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): orig_dests= new_dests= 2024-09-12T18:46:41.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.171+0000 7f833042b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): potential dests added=[] removed=[] 2024-09-12T18:46:41.174 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f833042b9c0 time 2024-09-12T18:46:41.175288+0000 2024-09-12T18:46:41.174 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:46:41.175 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:41.176 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f8333d052eb] 2024-09-12T18:46:41.176 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8333d0549f] 2024-09-12T18:46:41.176 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55835e284cc1] 2024-09-12T18:46:41.176 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422a3e) [0x55835ece2a3e] 2024-09-12T18:46:41.176 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55835e299ced] 2024-09-12T18:46:41.176 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:46:41.176 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8332b6bd90] 2024-09-12T18:46:41.176 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:46:41.176 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:46:41.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.171+0000 7f833042b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f833042b9c0 time 2024-09-12T18:46:41.175288+0000 2024-09-12T18:46:41.176 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:46:41.176 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.177 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:41.177 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f8333d052eb] 2024-09-12T18:46:41.177 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8333d0549f] 2024-09-12T18:46:41.177 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55835e284cc1] 2024-09-12T18:46:41.177 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422a3e) [0x55835ece2a3e] 2024-09-12T18:46:41.177 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55835e299ced] 2024-09-12T18:46:41.177 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:46:41.177 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8332b6bd90] 2024-09-12T18:46:41.177 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:46:41.177 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:46:41.177 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.177 INFO:tasks.workunit.client.0.smithi111.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:46:41.177 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f833042b9c0 thread_name:radosgw-admin 2024-09-12T18:46:41.197 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:41.197 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f8332b84520] 2024-09-12T18:46:41.197 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:46:41.197 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:46:41.197 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:46:41.197 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8333d05345] 2024-09-12T18:46:41.198 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8333d0549f] 2024-09-12T18:46:41.198 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55835e284cc1] 2024-09-12T18:46:41.198 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422a3e) [0x55835ece2a3e] 2024-09-12T18:46:41.198 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55835e299ced] 2024-09-12T18:46:41.198 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:46:41.198 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8332b6bd90] 2024-09-12T18:46:41.198 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:46:41.198 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:46:41.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.175+0000 7f833042b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:46:41.198 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f833042b9c0 thread_name:radosgw-admin 2024-09-12T18:46:41.198 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.198 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:41.198 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f8332b84520] 2024-09-12T18:46:41.199 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:46:41.199 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:46:41.199 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:46:41.199 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8333d05345] 2024-09-12T18:46:41.199 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8333d0549f] 2024-09-12T18:46:41.199 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55835e284cc1] 2024-09-12T18:46:41.199 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422a3e) [0x55835ece2a3e] 2024-09-12T18:46:41.199 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55835e299ced] 2024-09-12T18:46:41.199 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:46:41.199 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8332b6bd90] 2024-09-12T18:46:41.199 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:46:41.199 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:46:41.199 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:46:41.200 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.200 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:46:41.200 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:46:40.867+0000 7f832df31640 10 monclient: _finish_hunting 0 2024-09-12T18:46:41.200 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:46:40.867+0000 7f832df31640 1 monclient: found mon.noname-c 2024-09-12T18:46:41.200 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:46:40.867+0000 7f832df31640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.200 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.200 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:46:41.200 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: dump: 2024-09-12T18:46:41.200 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.200 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.200 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.200 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.200 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.201 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.201 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.201 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.201 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.201 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.201 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: _finish_auth 0 2024-09-12T18:46:41.201 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: _check_auth_tickets 2024-09-12T18:46:41.201 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 monclient: authenticate success, global_id 6509 2024-09-12T18:46:41.201 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:41.201 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.201 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:46:41.202 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: dump: 2024-09-12T18:46:41.202 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.202 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.202 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.202 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.202 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.202 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.202 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.203 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.203 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.203 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.203 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:46:41.203 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:46:40.867+0000 7f833042b9c0 4 set_mon_vals no callback set 2024-09-12T18:46:41.203 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient: shutdown 2024-09-12T18:46:41.203 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 asok(0x55835fdf52b0) unregister_commands rotate-key 2024-09-12T18:46:41.203 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:41.203 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:46:40.867+0000 7f833042b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:41.204 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient: monmap: 2024-09-12T18:46:41.204 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:41.204 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:41.204 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:41.204 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:41.204 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:41.205 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.205 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:41.205 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:41.205 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:41.205 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.205 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding auth protocol: cephx 2024-09-12T18:46:41.205 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding auth protocol: cephx 2024-09-12T18:46:41.205 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding auth protocol: cephx 2024-09-12T18:46:41.205 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: secure 2024-09-12T18:46:41.205 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: crc 2024-09-12T18:46:41.205 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: secure 2024-09-12T18:46:41.205 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: crc 2024-09-12T18:46:41.205 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: secure 2024-09-12T18:46:41.206 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: crc 2024-09-12T18:46:41.206 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: crc 2024-09-12T18:46:41.206 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: secure 2024-09-12T18:46:41.206 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: crc 2024-09-12T18:46:41.206 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: secure 2024-09-12T18:46:41.206 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: crc 2024-09-12T18:46:41.206 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: secure 2024-09-12T18:46:41.206 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:46:40.867+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.206 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:46:40.867+0000 7f833042b9c0 1 librados: starting msgr at 2024-09-12T18:46:41.206 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:46:40.867+0000 7f833042b9c0 1 librados: starting objecter 2024-09-12T18:46:41.206 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command objecter_requests hook 0x55835fd6ec10 2024-09-12T18:46:41.206 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:46:40.867+0000 7f833042b9c0 1 librados: setting wanted keys 2024-09-12T18:46:41.206 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:46:40.867+0000 7f833042b9c0 1 librados: calling monclient init 2024-09-12T18:46:41.206 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient: init 2024-09-12T18:46:41.207 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding auth protocol: cephx 2024-09-12T18:46:41.207 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding auth protocol: cephx 2024-09-12T18:46:41.207 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding auth protocol: cephx 2024-09-12T18:46:41.207 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: secure 2024-09-12T18:46:41.207 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: crc 2024-09-12T18:46:41.207 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: secure 2024-09-12T18:46:41.207 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: crc 2024-09-12T18:46:41.207 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: secure 2024-09-12T18:46:41.207 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: crc 2024-09-12T18:46:41.207 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: crc 2024-09-12T18:46:41.207 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: secure 2024-09-12T18:46:41.207 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: crc 2024-09-12T18:46:41.207 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: secure 2024-09-12T18:46:41.207 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: crc 2024-09-12T18:46:41.208 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: secure 2024-09-12T18:46:41.208 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:46:40.867+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.208 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:46:40.867+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.208 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command rotate-key hook 0x5583600005f8 2024-09-12T18:46:41.208 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:41.208 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:46:41.208 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-c con 0x55835febd820 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:41.208 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-b con 0x55835ff48880 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:41.208 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-a con 0x55835ff48c90 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:41.208 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.208 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.208 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.208 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:41.209 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): authenticate will time out at 2188.011831s 2024-09-12T18:46:41.209 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:46:40.867+0000 7f832df31640 10 monclient(hunting): get_auth_request con 0x55835febd820 auth_method 0 2024-09-12T18:46:41.209 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:46:40.867+0000 7f832df31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.209 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:46:40.867+0000 7f832df31640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.209 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:46:40.867+0000 7f832df31640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.209 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:46:40.867+0000 7f832e732640 10 monclient(hunting): get_auth_request con 0x55835ff48c90 auth_method 0 2024-09-12T18:46:41.209 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:46:40.867+0000 7f832e732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.209 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:46:40.867+0000 7f832e732640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.209 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:46:40.867+0000 7f832e732640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.209 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:46:40.871+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.209 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:46:40.871+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.209 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:46:40.871+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.209 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:46:40.871+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.209 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:46:40.871+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.210 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:46:40.871+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.210 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:46:40.871+0000 7f832df31640 10 monclient(hunting): handle_auth_done global_id 6512 payload 824 2024-09-12T18:46:41.210 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:46:40.871+0000 7f832df31640 10 monclient: _finish_hunting 0 2024-09-12T18:46:41.210 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:46:40.871+0000 7f832df31640 1 monclient: found mon.noname-c 2024-09-12T18:46:41.210 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:46:40.871+0000 7f832df31640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.210 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.210 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:46:41.210 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: dump: 2024-09-12T18:46:41.210 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.210 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.210 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.210 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.210 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.210 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.211 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.211 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.211 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.211 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.211 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: _finish_auth 0 2024-09-12T18:46:41.211 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: _check_auth_tickets 2024-09-12T18:46:41.211 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:41.211 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.211 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:46:41.211 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: dump: 2024-09-12T18:46:41.211 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.211 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.211 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.211 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.212 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.212 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.212 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.212 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.212 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.212 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.212 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:46:40.871+0000 7f833042b9c0 5 monclient: authenticate success, global_id 6512 2024-09-12T18:46:41.212 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:46:40.871+0000 7f821be07640 4 set_mon_vals no callback set 2024-09-12T18:46:41.212 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:46:40.871+0000 7f833042b9c0 10 monclient: _renew_subs 2024-09-12T18:46:41.212 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:46:40.871+0000 7f833042b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.212 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:46:40.871+0000 7f833042b9c0 10 monclient: _renew_subs 2024-09-12T18:46:41.212 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:46:40.871+0000 7f833042b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.212 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:46:40.871+0000 7f833042b9c0 1 librados: init done 2024-09-12T18:46:41.212 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:46:40.871+0000 7f821a604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:46:41.213 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:46:40.871+0000 7f821a604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:41.213 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:46:40.871+0000 7f821a604640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:41.213 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:46:40.871+0000 7f832d730640 10 monclient: get_auth_request con 0x7f8214070b10 auth_method 0 2024-09-12T18:46:41.213 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:46:40.871+0000 7f832e732640 10 monclient: get_auth_request con 0x55836003e9f0 auth_method 0 2024-09-12T18:46:41.213 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:46:40.875+0000 7f832df31640 10 monclient: get_auth_request con 0x55836004aaf0 auth_method 0 2024-09-12T18:46:41.213 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:46:40.875+0000 7f832d730640 10 monclient: get_auth_request con 0x55836004ee50 auth_method 0 2024-09-12T18:46:41.213 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:46:40.875+0000 7f832e732640 10 monclient: get_auth_request con 0x55836004e370 auth_method 0 2024-09-12T18:46:41.213 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:41.213 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:46:40.879+0000 7f833042b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:41.214 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: monmap: 2024-09-12T18:46:41.214 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:41.214 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:41.214 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:41.214 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:41.214 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:41.214 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.214 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:41.214 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:41.214 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:41.214 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.214 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding auth protocol: cephx 2024-09-12T18:46:41.215 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding auth protocol: cephx 2024-09-12T18:46:41.215 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding auth protocol: cephx 2024-09-12T18:46:41.215 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: secure 2024-09-12T18:46:41.215 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: crc 2024-09-12T18:46:41.215 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: secure 2024-09-12T18:46:41.215 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: crc 2024-09-12T18:46:41.215 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: secure 2024-09-12T18:46:41.215 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: crc 2024-09-12T18:46:41.216 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: crc 2024-09-12T18:46:41.216 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: secure 2024-09-12T18:46:41.216 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: crc 2024-09-12T18:46:41.216 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: secure 2024-09-12T18:46:41.216 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: crc 2024-09-12T18:46:41.216 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: secure 2024-09-12T18:46:41.216 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:46:40.879+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.216 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command objecter_requests cmddesc objecter_requests hook 0x55836005a9c0 EEXIST 2024-09-12T18:46:41.216 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: init 2024-09-12T18:46:41.216 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding auth protocol: cephx 2024-09-12T18:46:41.216 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding auth protocol: cephx 2024-09-12T18:46:41.216 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding auth protocol: cephx 2024-09-12T18:46:41.217 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: secure 2024-09-12T18:46:41.217 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: crc 2024-09-12T18:46:41.217 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: secure 2024-09-12T18:46:41.217 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: crc 2024-09-12T18:46:41.217 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: secure 2024-09-12T18:46:41.217 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: crc 2024-09-12T18:46:41.217 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: crc 2024-09-12T18:46:41.217 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: secure 2024-09-12T18:46:41.217 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: crc 2024-09-12T18:46:41.217 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: secure 2024-09-12T18:46:41.217 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: crc 2024-09-12T18:46:41.217 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: secure 2024-09-12T18:46:41.217 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:46:40.879+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.218 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:46:40.879+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.218 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command rotate-key cmddesc rotate-key hook 0x5583600560a0 EEXIST 2024-09-12T18:46:41.218 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:41.218 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:46:41.218 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-c con 0x55836007eb70 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:41.218 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-a con 0x55836007e4a0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:41.218 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-b con 0x55836007ce80 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:41.218 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.218 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.218 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.218 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:41.218 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): authenticate will time out at 2188.022214s 2024-09-12T18:46:41.218 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): get_auth_request con 0x55836007e4a0 auth_method 0 2024-09-12T18:46:41.218 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.219 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.219 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.219 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:46:40.879+0000 7f832d730640 10 monclient(hunting): get_auth_request con 0x55836007eb70 auth_method 0 2024-09-12T18:46:41.219 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:46:40.879+0000 7f832d730640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.219 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:46:40.879+0000 7f832d730640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.219 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:46:40.879+0000 7f832d730640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.219 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.219 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.219 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.219 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:46:40.879+0000 7f832d730640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.219 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:46:40.879+0000 7f832d730640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.219 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:46:40.879+0000 7f832d730640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.219 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:46:40.879+0000 7f832df31640 10 monclient(hunting): get_auth_request con 0x55836007ce80 auth_method 0 2024-09-12T18:46:41.220 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:46:40.879+0000 7f832df31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.220 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:46:40.879+0000 7f832df31640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.220 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:46:40.879+0000 7f832df31640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.220 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): handle_auth_done global_id 6930 payload 824 2024-09-12T18:46:41.220 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient: _finish_hunting 0 2024-09-12T18:46:41.220 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:46:40.879+0000 7f832e732640 1 monclient: found mon.noname-a 2024-09-12T18:46:41.220 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:46:41.220 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.220 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:46:41.220 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: dump: 2024-09-12T18:46:41.220 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.220 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.220 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.221 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.221 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.221 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.221 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.221 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.221 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.221 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.221 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: _finish_auth 0 2024-09-12T18:46:41.221 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: _check_auth_tickets 2024-09-12T18:46:41.221 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:41.221 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.221 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:46:41.221 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: dump: 2024-09-12T18:46:41.222 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.222 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.222 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.222 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.222 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.222 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.222 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.222 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.222 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.222 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.222 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 monclient: authenticate success, global_id 6930 2024-09-12T18:46:41.222 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:46:40.879+0000 7f832ef33640 4 set_mon_vals no callback set 2024-09-12T18:46:41.222 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: _renew_subs 2024-09-12T18:46:41.222 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:46:41.223 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: _renew_subs 2024-09-12T18:46:41.223 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:46:41.223 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:46:40.883+0000 7f82137fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:46:41.223 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:46:40.883+0000 7f82137fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:41.223 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:46:40.883+0000 7f82137fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:41.223 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:46:40.883+0000 7f832d730640 10 monclient: get_auth_request con 0x7f8208070a20 auth_method 0 2024-09-12T18:46:41.223 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: get_monmap_and_config 2024-09-12T18:46:41.223 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:41.223 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:46:40.883+0000 7f833042b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:41.223 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: monmap: 2024-09-12T18:46:41.223 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:41.223 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:41.223 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:41.224 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:41.224 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:41.224 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.224 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:41.224 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:41.224 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:41.224 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.224 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding auth protocol: cephx 2024-09-12T18:46:41.224 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding auth protocol: cephx 2024-09-12T18:46:41.224 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding auth protocol: cephx 2024-09-12T18:46:41.224 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: secure 2024-09-12T18:46:41.224 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: crc 2024-09-12T18:46:41.224 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: secure 2024-09-12T18:46:41.225 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: crc 2024-09-12T18:46:41.225 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: secure 2024-09-12T18:46:41.225 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: crc 2024-09-12T18:46:41.225 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: crc 2024-09-12T18:46:41.225 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: secure 2024-09-12T18:46:41.225 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: crc 2024-09-12T18:46:41.225 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: secure 2024-09-12T18:46:41.225 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: crc 2024-09-12T18:46:41.225 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: secure 2024-09-12T18:46:41.225 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:46:40.883+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.225 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: init 2024-09-12T18:46:41.225 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding auth protocol: cephx 2024-09-12T18:46:41.225 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding auth protocol: cephx 2024-09-12T18:46:41.226 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding auth protocol: cephx 2024-09-12T18:46:41.226 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: secure 2024-09-12T18:46:41.226 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: crc 2024-09-12T18:46:41.226 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: secure 2024-09-12T18:46:41.226 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: crc 2024-09-12T18:46:41.226 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: secure 2024-09-12T18:46:41.226 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: crc 2024-09-12T18:46:41.226 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: crc 2024-09-12T18:46:41.226 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: secure 2024-09-12T18:46:41.226 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: crc 2024-09-12T18:46:41.226 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: secure 2024-09-12T18:46:41.226 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: crc 2024-09-12T18:46:41.226 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: secure 2024-09-12T18:46:41.226 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:46:40.883+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.227 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:46:40.883+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.227 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc0c466e98 EEXIST 2024-09-12T18:46:41.227 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:41.227 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:46:41.227 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-b con 0x5583600d2a00 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:41.227 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-a con 0x5583600a2570 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:41.227 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-c con 0x5583600c3480 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:41.227 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.227 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.227 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.227 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:41.227 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): authenticate will time out at 2188.026616s 2024-09-12T18:46:41.227 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): get_auth_request con 0x5583600a2570 auth_method 0 2024-09-12T18:46:41.228 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.228 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.228 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.228 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.228 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.228 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.228 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:46:40.883+0000 7f832df31640 10 monclient(hunting): get_auth_request con 0x5583600c3480 auth_method 0 2024-09-12T18:46:41.228 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:46:40.883+0000 7f832df31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.228 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:46:40.883+0000 7f832df31640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.228 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:46:40.883+0000 7f832df31640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.228 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:46:40.883+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.228 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:46:40.883+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.228 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:46:40.883+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.229 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): handle_auth_done global_id 6933 payload 274 2024-09-12T18:46:41.229 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient: _finish_hunting 0 2024-09-12T18:46:41.229 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:46:40.883+0000 7f832e732640 1 monclient: found mon.noname-a 2024-09-12T18:46:41.229 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:46:41.229 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.229 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:46:41.229 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: dump: 2024-09-12T18:46:41.229 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.229 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.229 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.229 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.229 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.229 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.230 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.230 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.230 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.230 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.230 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: _finish_auth 0 2024-09-12T18:46:41.230 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: _check_auth_tickets 2024-09-12T18:46:41.230 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:41.230 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.230 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:46:41.230 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: dump: 2024-09-12T18:46:41.230 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.230 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.230 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.230 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.231 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.231 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.231 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.231 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.231 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.231 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.231 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 monclient: authenticate success, global_id 6933 2024-09-12T18:46:41.231 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:46:41.231 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:46:40.883+0000 7f833042b9c0 4 set_mon_vals no callback set 2024-09-12T18:46:41.231 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: shutdown 2024-09-12T18:46:41.231 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:41.231 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:46:40.887+0000 7f833042b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:41.231 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: monmap: 2024-09-12T18:46:41.232 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:41.232 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:41.232 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:41.232 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:41.232 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:41.232 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.232 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:41.232 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:41.232 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:41.232 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.232 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding auth protocol: cephx 2024-09-12T18:46:41.232 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding auth protocol: cephx 2024-09-12T18:46:41.232 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding auth protocol: cephx 2024-09-12T18:46:41.232 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: secure 2024-09-12T18:46:41.233 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: crc 2024-09-12T18:46:41.233 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: secure 2024-09-12T18:46:41.233 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: crc 2024-09-12T18:46:41.233 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: secure 2024-09-12T18:46:41.233 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: crc 2024-09-12T18:46:41.233 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: crc 2024-09-12T18:46:41.233 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: secure 2024-09-12T18:46:41.233 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: crc 2024-09-12T18:46:41.233 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: secure 2024-09-12T18:46:41.233 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: crc 2024-09-12T18:46:41.233 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: secure 2024-09-12T18:46:41.233 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:46:40.887+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.233 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:46:40.887+0000 7f833042b9c0 1 librados: starting msgr at 2024-09-12T18:46:41.234 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:46:40.887+0000 7f833042b9c0 1 librados: starting objecter 2024-09-12T18:46:41.234 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command objecter_requests cmddesc objecter_requests hook 0x55836009e290 EEXIST 2024-09-12T18:46:41.234 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:46:40.887+0000 7f833042b9c0 1 librados: setting wanted keys 2024-09-12T18:46:41.234 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:46:40.887+0000 7f833042b9c0 1 librados: calling monclient init 2024-09-12T18:46:41.234 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: init 2024-09-12T18:46:41.234 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding auth protocol: cephx 2024-09-12T18:46:41.234 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding auth protocol: cephx 2024-09-12T18:46:41.234 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding auth protocol: cephx 2024-09-12T18:46:41.234 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: secure 2024-09-12T18:46:41.234 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: crc 2024-09-12T18:46:41.234 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: secure 2024-09-12T18:46:41.234 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: crc 2024-09-12T18:46:41.234 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: secure 2024-09-12T18:46:41.234 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: crc 2024-09-12T18:46:41.235 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: crc 2024-09-12T18:46:41.235 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: secure 2024-09-12T18:46:41.235 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: crc 2024-09-12T18:46:41.235 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: secure 2024-09-12T18:46:41.235 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: crc 2024-09-12T18:46:41.235 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: secure 2024-09-12T18:46:41.235 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:46:40.887+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.235 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:46:40.887+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.235 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command rotate-key cmddesc rotate-key hook 0x558360080ad8 EEXIST 2024-09-12T18:46:41.235 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:41.235 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:46:41.235 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-b con 0x5583600a2570 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:41.235 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-a con 0x5583600c3480 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:41.235 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-c con 0x5583600d2a00 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:41.236 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.236 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.236 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.236 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:41.236 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): authenticate will time out at 2188.029226s 2024-09-12T18:46:41.236 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:46:40.887+0000 7f832e732640 10 monclient(hunting): get_auth_request con 0x5583600c3480 auth_method 0 2024-09-12T18:46:41.236 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:46:40.887+0000 7f832e732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.236 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:46:40.887+0000 7f832e732640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.236 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:46:40.887+0000 7f832e732640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.236 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): get_auth_request con 0x5583600d2a00 auth_method 0 2024-09-12T18:46:41.236 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.236 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.236 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.237 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.237 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.237 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.237 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:46:40.887+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.237 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:46:40.887+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.237 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:46:40.887+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.237 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:46:40.887+0000 7f832d730640 10 monclient(hunting): get_auth_request con 0x5583600a2570 auth_method 0 2024-09-12T18:46:41.237 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:46:40.887+0000 7f832d730640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.237 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:46:40.887+0000 7f832d730640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.237 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:46:40.887+0000 7f832d730640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.237 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): handle_auth_done global_id 6521 payload 824 2024-09-12T18:46:41.237 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient: _finish_hunting 0 2024-09-12T18:46:41.237 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:46:40.887+0000 7f832df31640 1 monclient: found mon.noname-c 2024-09-12T18:46:41.238 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.238 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.238 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:46:41.238 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: dump: 2024-09-12T18:46:41.238 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.238 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.238 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.238 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.238 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.238 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.238 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.238 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.238 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.238 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.239 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: _finish_auth 0 2024-09-12T18:46:41.239 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:46:41.239 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:41.239 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.239 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:46:41.239 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: dump: 2024-09-12T18:46:41.239 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.239 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.239 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.239 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.239 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.239 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.239 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.240 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.240 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.240 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.240 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:46:40.887+0000 7f82117fa640 4 set_mon_vals no callback set 2024-09-12T18:46:41.240 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 monclient: authenticate success, global_id 6521 2024-09-12T18:46:41.240 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: _renew_subs 2024-09-12T18:46:41.240 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.240 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: _renew_subs 2024-09-12T18:46:41.240 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.240 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:46:40.887+0000 7f833042b9c0 1 librados: init done 2024-09-12T18:46:41.240 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command cr dump hook 0x5583600c0ce8 2024-09-12T18:46:41.240 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:46:40.887+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.240 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:46:40.891+0000 7f81ff7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:46:41.240 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:46:40.891+0000 7f81ff7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:46:40.891+0000 7f81ff7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:46:40.891+0000 7f832d730640 10 monclient: get_auth_request con 0x7f81f8070ae0 auth_method 0 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:46:40.891+0000 7f832e732640 10 monclient: get_auth_request con 0x5583600ec9c0 auth_method 0 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 realm 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:46:40.891+0000 7f833042b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:46:40.891+0000 7f832d730640 10 monclient: get_auth_request con 0x5583600f0c40 auth_method 0 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.241 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:46:40.891+0000 7f832e732640 10 monclient: get_auth_request con 0x5583600f44a0 auth_method 0 2024-09-12T18:46:41.242 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:46:40.895+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:41.242 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:46:40.895+0000 7f833042b9c0 20 searching for the correct realm 2024-09-12T18:46:41.242 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:46:40.895+0000 7f832df31640 10 monclient: get_auth_request con 0x7f832802e060 auth_method 0 2024-09-12T18:46:41.242 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:46:40.895+0000 7f832d730640 10 monclient: get_auth_request con 0x7f8320027030 auth_method 0 2024-09-12T18:46:41.242 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:46:40.895+0000 7f832e732640 10 monclient: get_auth_request con 0x7f83240f0040 auth_method 0 2024-09-12T18:46:41.242 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:46:40.899+0000 7f832df31640 0 -- 172.21.15.111:0/2467882799 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f832802e060 msgr2=0x7f83280617a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:41.242 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:46:40.899+0000 7f81ff7fe640 1 client.6521.objecter ms_handle_reset 0x7f832802e060 session 0x7f8328098040 osd.7 2024-09-12T18:46:41.242 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:46:40.899+0000 7f81ff7fe640 10 monclient: _renew_subs 2024-09-12T18:46:41.242 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:46:40.899+0000 7f81ff7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.242 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:46:40.899+0000 7f832df31640 10 monclient: get_auth_request con 0x7f81f8080a80 auth_method 0 2024-09-12T18:46:41.242 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:46:40.899+0000 7f832df31640 10 monclient: get_auth_request con 0x7f8328018040 auth_method 0 2024-09-12T18:46:41.242 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:46:40.903+0000 7f832d730640 10 monclient: get_auth_request con 0x7f8328087b70 auth_method 0 2024-09-12T18:46:41.242 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:46:40.903+0000 7f832d730640 0 -- 172.21.15.111:0/2467882799 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f8328087b70 msgr2=0x7f83280871d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:41.243 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:46:41.107+0000 7f832d730640 10 monclient: get_auth_request con 0x7f8328087b70 auth_method 0 2024-09-12T18:46:41.243 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:41.243 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:41.243 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:41.243 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:41.243 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:41.243 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:41.243 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.243 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.243 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.243 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:41.243 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.243 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:41.243 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 zone default found 2024-09-12T18:46:41.244 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:46:41.123+0000 7f833042b9c0 4 Realm: () 2024-09-12T18:46:41.244 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:46:41.123+0000 7f833042b9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:41.244 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:46:41.123+0000 7f833042b9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:41.244 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:46:41.123+0000 7f833042b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:41.244 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 zonegroup default 2024-09-12T18:46:41.244 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.244 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.244 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.244 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.244 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.244 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.244 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 started sync module instance, tier type = 2024-09-12T18:46:41.244 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:41.244 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=0 2024-09-12T18:46:41.245 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=1 2024-09-12T18:46:41.245 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=2 2024-09-12T18:46:41.245 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=3 2024-09-12T18:46:41.245 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=4 2024-09-12T18:46:41.245 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=5 2024-09-12T18:46:41.245 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=6 2024-09-12T18:46:41.245 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:46:41.151+0000 7f833042b9c0 20 add_watcher() i=7 2024-09-12T18:46:41.245 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:46:41.151+0000 7f833042b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:41.245 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding auth protocol: cephx 2024-09-12T18:46:41.245 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding auth protocol: cephx 2024-09-12T18:46:41.245 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding auth protocol: cephx 2024-09-12T18:46:41.245 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: secure 2024-09-12T18:46:41.245 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: crc 2024-09-12T18:46:41.246 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: secure 2024-09-12T18:46:41.246 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: crc 2024-09-12T18:46:41.246 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: secure 2024-09-12T18:46:41.246 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: crc 2024-09-12T18:46:41.246 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:46:41.155+0000 7f81df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:41.246 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: crc 2024-09-12T18:46:41.246 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: secure 2024-09-12T18:46:41.246 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: crc 2024-09-12T18:46:41.246 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: secure 2024-09-12T18:46:41.246 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: crc 2024-09-12T18:46:41.246 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: secure 2024-09-12T18:46:41.246 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:46:41.155+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.246 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:46:41.155+0000 7f833042b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:41.246 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:46:41.155+0000 7f833042b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:41.247 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command cache list hook 0x5583600cbd80 2024-09-12T18:46:41.247 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command cache inspect hook 0x5583600cbd80 2024-09-12T18:46:41.247 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command cache erase hook 0x5583600cbd80 2024-09-12T18:46:41.247 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command cache zap hook 0x5583600cbd80 2024-09-12T18:46:41.247 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 note: GC not initialized 2024-09-12T18:46:41.247 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:46:41.155+0000 7f81de7fc640 20 reqs_thread_entry: start 2024-09-12T18:46:41.247 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command sync trace show hook 0x7f8328005440 2024-09-12T18:46:41.247 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command sync trace history hook 0x7f8328005440 2024-09-12T18:46:41.247 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command sync trace active hook 0x7f8328005440 2024-09-12T18:46:41.247 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command sync trace active_short hook 0x7f8328005440 2024-09-12T18:46:41.247 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:46:41.155+0000 7f833042b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:41.247 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:46:41.155+0000 7f833042b9c0 20 Filter name: none 2024-09-12T18:46:41.247 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:46:41.155+0000 7f814ffff640 20 reqs_thread_entry: start 2024-09-12T18:46:41.248 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:46:41.155+0000 7f833042b9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:46:41.248 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:46:41.155+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.248 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:46:41.159+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:41.248 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:46:41.248 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:46:41.248 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 : miss 2024-09-12T18:46:41.248 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:46:41.159+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.248 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:46:41.159+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:41.248 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:46:41.248 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:46:41.248 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:46:41.248 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:41.248 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 2024-09-12T18:46:41.248 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:46:41.171+0000 7f833042b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:46:41.249 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:46:41.171+0000 7f833042b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:46:41.249 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:46:41.171+0000 7f833042b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:41.249 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:46:41.171+0000 7f833042b9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27, ofs0, ns] 2024-09-12T18:46:41.249 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:46:41.171+0000 7f82117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431580 cookie 94022740726624 notifier 6521 bl.length()=939 2024-09-12T18:46:41.249 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:46:41.171+0000 7f82117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:46:41.249 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:46:41.171+0000 7f82117fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:46:41.249 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:46:41.171+0000 7f82117fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:41.249 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:46:41.171+0000 7f833042b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): orig_sources= new_sources= 2024-09-12T18:46:41.249 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:46:41.171+0000 7f833042b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): potential sources added=[] removed=[] 2024-09-12T18:46:41.249 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:46:41.171+0000 7f833042b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): orig_dests= new_dests= 2024-09-12T18:46:41.249 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:46:41.171+0000 7f833042b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): potential dests added=[] removed=[] 2024-09-12T18:46:41.249 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:46:41.171+0000 7f833042b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f833042b9c0 time 2024-09-12T18:46:41.175288+0000 2024-09-12T18:46:41.249 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:46:41.250 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.250 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:41.250 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f8333d052eb] 2024-09-12T18:46:41.250 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8333d0549f] 2024-09-12T18:46:41.250 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55835e284cc1] 2024-09-12T18:46:41.250 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422a3e) [0x55835ece2a3e] 2024-09-12T18:46:41.250 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55835e299ced] 2024-09-12T18:46:41.250 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:46:41.250 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8332b6bd90] 2024-09-12T18:46:41.250 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:46:41.250 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:46:41.250 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.250 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:46:41.175+0000 7f833042b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:46:41.250 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f833042b9c0 thread_name:radosgw-admin 2024-09-12T18:46:41.251 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.251 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:41.251 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f8332b84520] 2024-09-12T18:46:41.251 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:46:41.251 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:46:41.251 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:46:41.251 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8333d05345] 2024-09-12T18:46:41.251 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8333d0549f] 2024-09-12T18:46:41.251 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55835e284cc1] 2024-09-12T18:46:41.251 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422a3e) [0x55835ece2a3e] 2024-09-12T18:46:41.251 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55835e299ced] 2024-09-12T18:46:41.251 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:46:41.251 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8332b6bd90] 2024-09-12T18:46:41.251 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:46:41.252 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:46:41.252 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:46:41.252 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.252 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:46:41.252 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:46:41.252 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:46:41.252 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:46:41.252 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:46:41.252 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:46:41.252 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:46:41.252 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:46:41.252 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:46:41.252 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:46:41.252 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:46:41.253 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:46:41.253 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:46:41.253 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:46:41.253 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:46:41.253 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:46:41.253 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:46:41.253 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:46:41.253 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:46:41.253 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:46:41.253 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:46:41.253 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:46:41.253 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:46:41.253 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:46:41.253 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:46:41.254 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:46:41.254 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:46:41.254 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:46:41.254 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:46:41.254 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:46:41.254 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:46:41.254 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:46:41.254 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:46:41.254 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:46:41.254 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:46:41.254 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:46:41.254 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:46:41.254 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:46:41.254 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:46:41.255 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:46:41.255 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:46:41.255 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:46:41.255 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:46:41.255 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:46:41.255 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:46:41.255 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:46:41.255 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:46:41.255 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:46:41.255 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:46:41.255 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:46:41.255 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:46:41.255 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:46:41.255 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:46:41.256 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:46:41.256 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:46:41.256 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:46:41.256 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:46:41.256 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:46:41.256 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:46:41.256 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:46:41.256 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:46:41.256 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:46:41.256 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:46:41.256 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:46:41.256 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:46:41.256 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:46:41.257 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:46:41.257 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:46:41.257 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:46:41.257 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:46:41.257 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:46:41.257 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:46:41.257 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:46:41.257 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:46:41.257 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:46:41.257 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:46:41.257 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:46:41.257 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:46:41.257 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:46:41.257 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:46:41.258 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:46:41.258 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:46:41.258 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:46:41.258 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:46:41.258 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:46:41.258 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:46:41.258 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:46:41.258 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:46:41.258 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:46:41.258 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:46:41.258 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:46:41.258 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:46:41.258 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:46:41.258 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:46:41.259 INFO:tasks.workunit.client.0.smithi111.stderr: 7f814ffff640 / http_manager 2024-09-12T18:46:41.259 INFO:tasks.workunit.client.0.smithi111.stderr: 7f81de7fc640 / http_manager 2024-09-12T18:46:41.259 INFO:tasks.workunit.client.0.smithi111.stderr: 7f81df7fe640 / rgw_dt_lg_renew 2024-09-12T18:46:41.259 INFO:tasks.workunit.client.0.smithi111.stderr: 7f81ff7fe640 / ms_dispatch 2024-09-12T18:46:41.259 INFO:tasks.workunit.client.0.smithi111.stderr: 7f82117fa640 / io_context_pool 2024-09-12T18:46:41.259 INFO:tasks.workunit.client.0.smithi111.stderr: 7f82137fe640 / ms_dispatch 2024-09-12T18:46:41.259 INFO:tasks.workunit.client.0.smithi111.stderr: 7f821a604640 / ms_dispatch 2024-09-12T18:46:41.259 INFO:tasks.workunit.client.0.smithi111.stderr: 7f821be07640 / io_context_pool 2024-09-12T18:46:41.259 INFO:tasks.workunit.client.0.smithi111.stderr: 7f832d730640 / msgr-worker-2 2024-09-12T18:46:41.259 INFO:tasks.workunit.client.0.smithi111.stderr: 7f832df31640 / msgr-worker-1 2024-09-12T18:46:41.259 INFO:tasks.workunit.client.0.smithi111.stderr: 7f832e732640 / msgr-worker-0 2024-09-12T18:46:41.259 INFO:tasks.workunit.client.0.smithi111.stderr: 7f832ef33640 / io_context_pool 2024-09-12T18:46:41.259 INFO:tasks.workunit.client.0.smithi111.stderr: 7f833042b9c0 / radosgw-admin 2024-09-12T18:46:41.260 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:46:41.260 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:46:41.260 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/log/ceph/ceph-client.admin.100085.log 2024-09-12T18:46:41.260 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:46:41.260 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:46:41.260 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:46:40.867+0000 7f832df31640 10 monclient: _finish_hunting 0 2024-09-12T18:46:41.260 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:46:40.867+0000 7f832df31640 1 monclient: found mon.noname-c 2024-09-12T18:46:41.260 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:46:40.867+0000 7f832df31640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.260 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.260 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:46:41.260 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: dump: 2024-09-12T18:46:41.260 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.260 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.261 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.261 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.261 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.261 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.261 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.261 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.261 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.261 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.261 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: _finish_auth 0 2024-09-12T18:46:41.261 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: _check_auth_tickets 2024-09-12T18:46:41.261 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 monclient: authenticate success, global_id 6509 2024-09-12T18:46:41.261 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:41.261 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:46:40.867+0000 7f821be07640 10 monclient: dump: 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:46:40.867+0000 7f833042b9c0 4 set_mon_vals no callback set 2024-09-12T18:46:41.262 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient: shutdown 2024-09-12T18:46:41.263 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 asok(0x55835fdf52b0) unregister_commands rotate-key 2024-09-12T18:46:41.263 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:41.263 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:46:40.867+0000 7f833042b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:41.263 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient: monmap: 2024-09-12T18:46:41.263 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:41.263 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:41.263 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:41.263 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:41.263 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:41.263 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.263 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:41.263 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:41.263 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:41.263 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.264 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding auth protocol: cephx 2024-09-12T18:46:41.264 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding auth protocol: cephx 2024-09-12T18:46:41.264 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding auth protocol: cephx 2024-09-12T18:46:41.264 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: secure 2024-09-12T18:46:41.264 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: crc 2024-09-12T18:46:41.264 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: secure 2024-09-12T18:46:41.264 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: crc 2024-09-12T18:46:41.264 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: secure 2024-09-12T18:46:41.264 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: crc 2024-09-12T18:46:41.264 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: crc 2024-09-12T18:46:41.264 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: secure 2024-09-12T18:46:41.264 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: crc 2024-09-12T18:46:41.264 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: secure 2024-09-12T18:46:41.265 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: crc 2024-09-12T18:46:41.265 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x558360006040) adding con mode: secure 2024-09-12T18:46:41.265 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:46:40.867+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.265 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:46:40.867+0000 7f833042b9c0 1 librados: starting msgr at 2024-09-12T18:46:41.265 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:46:40.867+0000 7f833042b9c0 1 librados: starting objecter 2024-09-12T18:46:41.265 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command objecter_requests hook 0x55835fd6ec10 2024-09-12T18:46:41.265 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:46:40.867+0000 7f833042b9c0 1 librados: setting wanted keys 2024-09-12T18:46:41.265 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:46:40.867+0000 7f833042b9c0 1 librados: calling monclient init 2024-09-12T18:46:41.265 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient: init 2024-09-12T18:46:41.265 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding auth protocol: cephx 2024-09-12T18:46:41.265 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding auth protocol: cephx 2024-09-12T18:46:41.265 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding auth protocol: cephx 2024-09-12T18:46:41.265 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: secure 2024-09-12T18:46:41.265 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: crc 2024-09-12T18:46:41.266 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: secure 2024-09-12T18:46:41.266 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: crc 2024-09-12T18:46:41.266 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: secure 2024-09-12T18:46:41.266 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: crc 2024-09-12T18:46:41.266 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: crc 2024-09-12T18:46:41.266 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: secure 2024-09-12T18:46:41.266 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: crc 2024-09-12T18:46:41.266 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: secure 2024-09-12T18:46:41.266 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: crc 2024-09-12T18:46:41.266 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 AuthRegistry(0x5583600004b0) adding con mode: secure 2024-09-12T18:46:41.266 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:46:40.867+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.266 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:46:40.867+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.267 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:46:40.867+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command rotate-key hook 0x5583600005f8 2024-09-12T18:46:41.267 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:41.267 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:46:41.267 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-c con 0x55835febd820 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:41.267 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-b con 0x55835ff48880 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:41.267 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-a con 0x55835ff48c90 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:41.267 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.267 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.267 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.267 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:41.267 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:46:40.867+0000 7f833042b9c0 10 monclient(hunting): authenticate will time out at 2188.011831s 2024-09-12T18:46:41.267 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:46:40.867+0000 7f832df31640 10 monclient(hunting): get_auth_request con 0x55835febd820 auth_method 0 2024-09-12T18:46:41.267 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:46:40.867+0000 7f832df31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.267 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:46:40.867+0000 7f832df31640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.268 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:46:40.867+0000 7f832df31640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.268 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:46:40.867+0000 7f832e732640 10 monclient(hunting): get_auth_request con 0x55835ff48c90 auth_method 0 2024-09-12T18:46:41.268 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:46:40.867+0000 7f832e732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.268 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:46:40.867+0000 7f832e732640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.268 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:46:40.867+0000 7f832e732640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.268 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:46:40.871+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.268 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:46:40.871+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.268 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:46:40.871+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.268 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:46:40.871+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.268 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:46:40.871+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.268 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:46:40.871+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.268 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:46:40.871+0000 7f832df31640 10 monclient(hunting): handle_auth_done global_id 6512 payload 824 2024-09-12T18:46:41.268 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:46:40.871+0000 7f832df31640 10 monclient: _finish_hunting 0 2024-09-12T18:46:41.268 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:46:40.871+0000 7f832df31640 1 monclient: found mon.noname-c 2024-09-12T18:46:41.269 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:46:40.871+0000 7f832df31640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.269 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.269 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:46:41.269 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: dump: 2024-09-12T18:46:41.269 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.269 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.269 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.269 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.269 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.269 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.269 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.269 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.269 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: _finish_auth 0 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: _check_auth_tickets 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:46:40.871+0000 7f821a604640 10 monclient: dump: 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.270 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.271 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.271 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.271 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:46:40.871+0000 7f833042b9c0 5 monclient: authenticate success, global_id 6512 2024-09-12T18:46:41.271 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:46:40.871+0000 7f821be07640 4 set_mon_vals no callback set 2024-09-12T18:46:41.271 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:46:40.871+0000 7f833042b9c0 10 monclient: _renew_subs 2024-09-12T18:46:41.271 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:46:40.871+0000 7f833042b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.271 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:46:40.871+0000 7f833042b9c0 10 monclient: _renew_subs 2024-09-12T18:46:41.271 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:46:40.871+0000 7f833042b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.271 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:46:40.871+0000 7f833042b9c0 1 librados: init done 2024-09-12T18:46:41.271 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:46:40.871+0000 7f821a604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:46:41.271 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:46:40.871+0000 7f821a604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:41.271 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:46:40.871+0000 7f821a604640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:41.271 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:46:40.871+0000 7f832d730640 10 monclient: get_auth_request con 0x7f8214070b10 auth_method 0 2024-09-12T18:46:41.271 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:46:40.871+0000 7f832e732640 10 monclient: get_auth_request con 0x55836003e9f0 auth_method 0 2024-09-12T18:46:41.272 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:46:40.875+0000 7f832df31640 10 monclient: get_auth_request con 0x55836004aaf0 auth_method 0 2024-09-12T18:46:41.272 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:46:40.875+0000 7f832d730640 10 monclient: get_auth_request con 0x55836004ee50 auth_method 0 2024-09-12T18:46:41.272 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:46:40.875+0000 7f832e732640 10 monclient: get_auth_request con 0x55836004e370 auth_method 0 2024-09-12T18:46:41.272 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:41.272 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:46:40.879+0000 7f833042b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:41.272 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: monmap: 2024-09-12T18:46:41.272 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:41.272 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:41.272 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:41.272 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:41.272 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:41.272 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.272 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:41.272 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:41.273 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:41.273 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.273 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding auth protocol: cephx 2024-09-12T18:46:41.273 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding auth protocol: cephx 2024-09-12T18:46:41.273 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding auth protocol: cephx 2024-09-12T18:46:41.273 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: secure 2024-09-12T18:46:41.273 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: crc 2024-09-12T18:46:41.273 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: secure 2024-09-12T18:46:41.273 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: crc 2024-09-12T18:46:41.273 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: secure 2024-09-12T18:46:41.273 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: crc 2024-09-12T18:46:41.273 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: crc 2024-09-12T18:46:41.273 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: secure 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: crc 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: secure 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: crc 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360056fd0) adding con mode: secure 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:46:40.879+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command objecter_requests cmddesc objecter_requests hook 0x55836005a9c0 EEXIST 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: init 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding auth protocol: cephx 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding auth protocol: cephx 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding auth protocol: cephx 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: secure 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: crc 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: secure 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: crc 2024-09-12T18:46:41.274 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: secure 2024-09-12T18:46:41.275 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: crc 2024-09-12T18:46:41.275 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: crc 2024-09-12T18:46:41.275 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: secure 2024-09-12T18:46:41.275 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: crc 2024-09-12T18:46:41.275 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: secure 2024-09-12T18:46:41.275 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: crc 2024-09-12T18:46:41.275 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 AuthRegistry(0x558360055f58) adding con mode: secure 2024-09-12T18:46:41.275 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:46:40.879+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.275 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:46:40.879+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.275 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command rotate-key cmddesc rotate-key hook 0x5583600560a0 EEXIST 2024-09-12T18:46:41.275 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:41.275 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:46:41.275 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-c con 0x55836007eb70 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:41.276 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-a con 0x55836007e4a0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:41.276 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-b con 0x55836007ce80 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:41.276 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.276 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.276 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.276 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:41.276 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient(hunting): authenticate will time out at 2188.022214s 2024-09-12T18:46:41.276 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): get_auth_request con 0x55836007e4a0 auth_method 0 2024-09-12T18:46:41.276 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.276 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.276 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.276 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:46:40.879+0000 7f832d730640 10 monclient(hunting): get_auth_request con 0x55836007eb70 auth_method 0 2024-09-12T18:46:41.276 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:46:40.879+0000 7f832d730640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.277 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:46:40.879+0000 7f832d730640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.277 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:46:40.879+0000 7f832d730640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.277 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.277 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.277 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.277 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:46:40.879+0000 7f832d730640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.277 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:46:40.879+0000 7f832d730640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.277 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:46:40.879+0000 7f832d730640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.277 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:46:40.879+0000 7f832df31640 10 monclient(hunting): get_auth_request con 0x55836007ce80 auth_method 0 2024-09-12T18:46:41.277 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:46:40.879+0000 7f832df31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.277 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:46:40.879+0000 7f832df31640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.277 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:46:40.879+0000 7f832df31640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.277 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient(hunting): handle_auth_done global_id 6930 payload 824 2024-09-12T18:46:41.277 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient: _finish_hunting 0 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:46:40.879+0000 7f832e732640 1 monclient: found mon.noname-a 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:46:40.879+0000 7f832e732640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: dump: 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.278 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.279 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: _finish_auth 0 2024-09-12T18:46:41.279 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: _check_auth_tickets 2024-09-12T18:46:41.279 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:41.279 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.279 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:46:41.279 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:46:40.879+0000 7f82137fe640 10 monclient: dump: 2024-09-12T18:46:41.279 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.279 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.279 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.279 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.279 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.279 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.279 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.280 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.280 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.280 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.280 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:46:40.879+0000 7f833042b9c0 5 monclient: authenticate success, global_id 6930 2024-09-12T18:46:41.280 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:46:40.879+0000 7f832ef33640 4 set_mon_vals no callback set 2024-09-12T18:46:41.280 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: _renew_subs 2024-09-12T18:46:41.280 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:46:41.280 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: _renew_subs 2024-09-12T18:46:41.280 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:46:40.879+0000 7f833042b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:46:41.280 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:46:40.883+0000 7f82137fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:46:41.280 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:46:40.883+0000 7f82137fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:41.280 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:46:40.883+0000 7f82137fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:41.280 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:46:40.883+0000 7f832d730640 10 monclient: get_auth_request con 0x7f8208070a20 auth_method 0 2024-09-12T18:46:41.280 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: get_monmap_and_config 2024-09-12T18:46:41.281 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:41.281 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:46:40.883+0000 7f833042b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:41.281 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: monmap: 2024-09-12T18:46:41.281 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:41.281 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:41.281 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:41.281 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:41.281 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:41.281 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.281 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:41.281 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:41.281 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:41.281 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.282 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding auth protocol: cephx 2024-09-12T18:46:41.282 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding auth protocol: cephx 2024-09-12T18:46:41.282 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding auth protocol: cephx 2024-09-12T18:46:41.282 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: secure 2024-09-12T18:46:41.282 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: crc 2024-09-12T18:46:41.282 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: secure 2024-09-12T18:46:41.282 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: crc 2024-09-12T18:46:41.282 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: secure 2024-09-12T18:46:41.282 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: crc 2024-09-12T18:46:41.282 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: crc 2024-09-12T18:46:41.282 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: secure 2024-09-12T18:46:41.283 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: crc 2024-09-12T18:46:41.283 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: secure 2024-09-12T18:46:41.283 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: crc 2024-09-12T18:46:41.283 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x55836009e520) adding con mode: secure 2024-09-12T18:46:41.283 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:46:40.883+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.283 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: init 2024-09-12T18:46:41.283 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding auth protocol: cephx 2024-09-12T18:46:41.283 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding auth protocol: cephx 2024-09-12T18:46:41.283 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding auth protocol: cephx 2024-09-12T18:46:41.283 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: secure 2024-09-12T18:46:41.283 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: crc 2024-09-12T18:46:41.283 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: secure 2024-09-12T18:46:41.284 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: crc 2024-09-12T18:46:41.284 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: secure 2024-09-12T18:46:41.284 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: crc 2024-09-12T18:46:41.284 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: crc 2024-09-12T18:46:41.284 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: secure 2024-09-12T18:46:41.284 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: crc 2024-09-12T18:46:41.284 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: secure 2024-09-12T18:46:41.284 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: crc 2024-09-12T18:46:41.284 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c466d50) adding con mode: secure 2024-09-12T18:46:41.284 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:46:40.883+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.284 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:46:40.883+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.284 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc0c466e98 EEXIST 2024-09-12T18:46:41.284 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:41.284 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:46:41.285 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-b con 0x5583600d2a00 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:41.285 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-a con 0x5583600a2570 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:41.285 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-c con 0x5583600c3480 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:41.285 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.285 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.285 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.285 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:41.285 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient(hunting): authenticate will time out at 2188.026616s 2024-09-12T18:46:41.285 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): get_auth_request con 0x5583600a2570 auth_method 0 2024-09-12T18:46:41.285 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.285 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.285 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.285 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.285 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.286 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.286 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:46:40.883+0000 7f832df31640 10 monclient(hunting): get_auth_request con 0x5583600c3480 auth_method 0 2024-09-12T18:46:41.286 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:46:40.883+0000 7f832df31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.286 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:46:40.883+0000 7f832df31640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.286 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:46:40.883+0000 7f832df31640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.286 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:46:40.883+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.286 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:46:40.883+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.286 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:46:40.883+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.286 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient(hunting): handle_auth_done global_id 6933 payload 274 2024-09-12T18:46:41.286 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient: _finish_hunting 0 2024-09-12T18:46:41.286 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:46:40.883+0000 7f832e732640 1 monclient: found mon.noname-a 2024-09-12T18:46:41.286 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:46:40.883+0000 7f832e732640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:46:41.286 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.287 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:46:41.287 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: dump: 2024-09-12T18:46:41.287 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.287 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.287 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.287 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.287 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.287 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.287 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.287 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.287 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.287 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.287 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: _finish_auth 0 2024-09-12T18:46:41.287 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: _check_auth_tickets 2024-09-12T18:46:41.288 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:41.288 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.288 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:46:41.288 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:46:40.883+0000 7f82117fa640 10 monclient: dump: 2024-09-12T18:46:41.288 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.288 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.288 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.288 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.288 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.288 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.288 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.288 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.288 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.288 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.289 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:46:40.883+0000 7f833042b9c0 5 monclient: authenticate success, global_id 6933 2024-09-12T18:46:41.289 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:46:41.289 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:46:40.883+0000 7f833042b9c0 4 set_mon_vals no callback set 2024-09-12T18:46:41.289 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:46:40.883+0000 7f833042b9c0 10 monclient: shutdown 2024-09-12T18:46:41.289 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: build_initial_monmap 2024-09-12T18:46:41.289 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:46:40.887+0000 7f833042b9c0 1 build_initial for_mkfs: 0 2024-09-12T18:46:41.289 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: monmap: 2024-09-12T18:46:41.289 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:46:41.289 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:46:41.289 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:46:41.289 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:46:41.289 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:46:41.289 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.289 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:46:41.290 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:46:41.290 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:46:41.290 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.290 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding auth protocol: cephx 2024-09-12T18:46:41.290 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding auth protocol: cephx 2024-09-12T18:46:41.290 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding auth protocol: cephx 2024-09-12T18:46:41.290 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: secure 2024-09-12T18:46:41.290 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: crc 2024-09-12T18:46:41.290 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: secure 2024-09-12T18:46:41.290 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: crc 2024-09-12T18:46:41.290 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: secure 2024-09-12T18:46:41.290 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: crc 2024-09-12T18:46:41.290 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: crc 2024-09-12T18:46:41.290 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: secure 2024-09-12T18:46:41.291 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: crc 2024-09-12T18:46:41.291 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: secure 2024-09-12T18:46:41.291 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: crc 2024-09-12T18:46:41.291 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x5583600a35b0) adding con mode: secure 2024-09-12T18:46:41.291 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:46:40.887+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.291 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:46:40.887+0000 7f833042b9c0 1 librados: starting msgr at 2024-09-12T18:46:41.291 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:46:40.887+0000 7f833042b9c0 1 librados: starting objecter 2024-09-12T18:46:41.291 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command objecter_requests cmddesc objecter_requests hook 0x55836009e290 EEXIST 2024-09-12T18:46:41.291 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:46:40.887+0000 7f833042b9c0 1 librados: setting wanted keys 2024-09-12T18:46:41.291 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:46:40.887+0000 7f833042b9c0 1 librados: calling monclient init 2024-09-12T18:46:41.292 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: init 2024-09-12T18:46:41.292 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding auth protocol: cephx 2024-09-12T18:46:41.292 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding auth protocol: cephx 2024-09-12T18:46:41.292 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding auth protocol: cephx 2024-09-12T18:46:41.292 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: secure 2024-09-12T18:46:41.292 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: crc 2024-09-12T18:46:41.292 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: secure 2024-09-12T18:46:41.292 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: crc 2024-09-12T18:46:41.292 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: secure 2024-09-12T18:46:41.292 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: crc 2024-09-12T18:46:41.292 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: crc 2024-09-12T18:46:41.292 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: secure 2024-09-12T18:46:41.292 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: crc 2024-09-12T18:46:41.293 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: secure 2024-09-12T18:46:41.293 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: crc 2024-09-12T18:46:41.293 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 AuthRegistry(0x558360080990) adding con mode: secure 2024-09-12T18:46:41.293 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:46:40.887+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.293 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:46:40.887+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.293 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command rotate-key cmddesc rotate-key hook 0x558360080ad8 EEXIST 2024-09-12T18:46:41.293 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:46:41.293 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:46:41.293 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-b con 0x5583600a2570 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:46:41.293 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-a con 0x5583600c3480 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:46:41.293 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): picked mon.noname-c con 0x5583600d2a00 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:46:41.293 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.293 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.293 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:46:41.294 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:46:41.294 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient(hunting): authenticate will time out at 2188.029226s 2024-09-12T18:46:41.294 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:46:40.887+0000 7f832e732640 10 monclient(hunting): get_auth_request con 0x5583600c3480 auth_method 0 2024-09-12T18:46:41.294 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:46:40.887+0000 7f832e732640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.294 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:46:40.887+0000 7f832e732640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.294 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:46:40.887+0000 7f832e732640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.294 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): get_auth_request con 0x5583600d2a00 auth_method 0 2024-09-12T18:46:41.294 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.294 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.294 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.294 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.294 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.294 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.295 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:46:40.887+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:46:41.295 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:46:40.887+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:46:41.295 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:46:40.887+0000 7f832e732640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:46:41.295 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:46:40.887+0000 7f832d730640 10 monclient(hunting): get_auth_request con 0x5583600a2570 auth_method 0 2024-09-12T18:46:41.295 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:46:40.887+0000 7f832d730640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:46:41.295 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:46:40.887+0000 7f832d730640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:46:41.295 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:46:40.887+0000 7f832d730640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:46:41.295 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient(hunting): handle_auth_done global_id 6521 payload 824 2024-09-12T18:46:41.295 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient: _finish_hunting 0 2024-09-12T18:46:41.295 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:46:40.887+0000 7f832df31640 1 monclient: found mon.noname-c 2024-09-12T18:46:41.295 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:46:40.887+0000 7f832df31640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.295 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.295 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:46:41.295 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: dump: 2024-09-12T18:46:41.296 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.296 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.296 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.296 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.296 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.296 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.296 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.296 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.296 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.296 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.296 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: _finish_auth 0 2024-09-12T18:46:41.296 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: _check_auth_tickets 2024-09-12T18:46:41.296 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T18:46:41.296 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:46:41.297 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:46:41.297 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:46:40.887+0000 7f81ff7fe640 10 monclient: dump: 2024-09-12T18:46:41.297 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:46:41.297 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:46:41.297 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.297 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:46:41.297 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:46:41.297 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:46:41.297 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:46:41.297 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:46:41.297 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:46:41.297 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.297 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:46:40.887+0000 7f82117fa640 4 set_mon_vals no callback set 2024-09-12T18:46:41.297 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 monclient: authenticate success, global_id 6521 2024-09-12T18:46:41.298 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: _renew_subs 2024-09-12T18:46:41.298 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.298 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: _renew_subs 2024-09-12T18:46:41.298 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:46:40.887+0000 7f833042b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.298 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:46:40.887+0000 7f833042b9c0 1 librados: init done 2024-09-12T18:46:41.298 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:46:40.887+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command cr dump hook 0x5583600c0ce8 2024-09-12T18:46:41.298 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:46:40.887+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.298 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:46:40.891+0000 7f81ff7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:46:41.298 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:46:40.891+0000 7f81ff7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:41.298 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:46:40.891+0000 7f81ff7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:46:41.298 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:46:40.891+0000 7f832d730640 10 monclient: get_auth_request con 0x7f81f8070ae0 auth_method 0 2024-09-12T18:46:41.298 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:46:40.891+0000 7f832e732640 10 monclient: get_auth_request con 0x5583600ec9c0 auth_method 0 2024-09-12T18:46:41.298 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.298 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 realm 2024-09-12T18:46:41.299 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.299 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.299 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:46:40.891+0000 7f833042b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:41.299 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.299 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.299 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.299 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:46:40.891+0000 7f832d730640 10 monclient: get_auth_request con 0x5583600f0c40 auth_method 0 2024-09-12T18:46:41.299 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:41.299 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:46:40.891+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.299 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:46:40.891+0000 7f832e732640 10 monclient: get_auth_request con 0x5583600f44a0 auth_method 0 2024-09-12T18:46:41.299 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:46:40.895+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:41.299 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:46:40.895+0000 7f833042b9c0 20 searching for the correct realm 2024-09-12T18:46:41.299 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:46:40.895+0000 7f832df31640 10 monclient: get_auth_request con 0x7f832802e060 auth_method 0 2024-09-12T18:46:41.299 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:46:40.895+0000 7f832d730640 10 monclient: get_auth_request con 0x7f8320027030 auth_method 0 2024-09-12T18:46:41.300 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:46:40.895+0000 7f832e732640 10 monclient: get_auth_request con 0x7f83240f0040 auth_method 0 2024-09-12T18:46:41.300 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:46:40.899+0000 7f832df31640 0 -- 172.21.15.111:0/2467882799 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f832802e060 msgr2=0x7f83280617a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:41.300 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:46:40.899+0000 7f81ff7fe640 1 client.6521.objecter ms_handle_reset 0x7f832802e060 session 0x7f8328098040 osd.7 2024-09-12T18:46:41.300 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:46:40.899+0000 7f81ff7fe640 10 monclient: _renew_subs 2024-09-12T18:46:41.300 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:46:40.899+0000 7f81ff7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:46:41.300 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:46:40.899+0000 7f832df31640 10 monclient: get_auth_request con 0x7f81f8080a80 auth_method 0 2024-09-12T18:46:41.300 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:46:40.899+0000 7f832df31640 10 monclient: get_auth_request con 0x7f8328018040 auth_method 0 2024-09-12T18:46:41.300 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:46:40.903+0000 7f832d730640 10 monclient: get_auth_request con 0x7f8328087b70 auth_method 0 2024-09-12T18:46:41.300 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:46:40.903+0000 7f832d730640 0 -- 172.21.15.111:0/2467882799 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f8328087b70 msgr2=0x7f83280871d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:41.300 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:46:41.107+0000 7f832d730640 10 monclient: get_auth_request con 0x7f8328087b70 auth_method 0 2024-09-12T18:46:41.300 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:41.300 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:41.300 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:41.301 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:41.301 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:41.301 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:41.301 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.301 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.301 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:46:41.119+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.301 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:41.301 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.301 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:41.301 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 zone default found 2024-09-12T18:46:41.301 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:46:41.123+0000 7f833042b9c0 4 Realm: () 2024-09-12T18:46:41.301 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:46:41.123+0000 7f833042b9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:41.301 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:46:41.123+0000 7f833042b9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:41.301 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:46:41.123+0000 7f833042b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:41.302 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 zonegroup default 2024-09-12T18:46:41.302 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.302 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.302 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.302 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.302 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.302 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.302 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 started sync module instance, tier type = 2024-09-12T18:46:41.302 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:46:41.123+0000 7f833042b9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:41.302 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=0 2024-09-12T18:46:41.302 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=1 2024-09-12T18:46:41.302 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=2 2024-09-12T18:46:41.302 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=3 2024-09-12T18:46:41.302 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=4 2024-09-12T18:46:41.303 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=5 2024-09-12T18:46:41.303 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:46:41.147+0000 7f833042b9c0 20 add_watcher() i=6 2024-09-12T18:46:41.303 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:46:41.151+0000 7f833042b9c0 20 add_watcher() i=7 2024-09-12T18:46:41.303 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:46:41.151+0000 7f833042b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:41.303 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding auth protocol: cephx 2024-09-12T18:46:41.303 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding auth protocol: cephx 2024-09-12T18:46:41.303 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding auth protocol: cephx 2024-09-12T18:46:41.303 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: secure 2024-09-12T18:46:41.303 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: crc 2024-09-12T18:46:41.303 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: secure 2024-09-12T18:46:41.303 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: crc 2024-09-12T18:46:41.303 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: secure 2024-09-12T18:46:41.303 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: crc 2024-09-12T18:46:41.303 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:46:41.155+0000 7f81df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:41.304 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: crc 2024-09-12T18:46:41.304 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: secure 2024-09-12T18:46:41.304 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: crc 2024-09-12T18:46:41.304 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: secure 2024-09-12T18:46:41.304 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: crc 2024-09-12T18:46:41.304 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 AuthRegistry(0x7ffc0c467230) adding con mode: secure 2024-09-12T18:46:41.304 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:46:41.155+0000 7f833042b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:46:41.304 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:46:41.155+0000 7f833042b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:41.304 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:46:41.155+0000 7f833042b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:41.304 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command cache list hook 0x5583600cbd80 2024-09-12T18:46:41.304 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command cache inspect hook 0x5583600cbd80 2024-09-12T18:46:41.304 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command cache erase hook 0x5583600cbd80 2024-09-12T18:46:41.304 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command cache zap hook 0x5583600cbd80 2024-09-12T18:46:41.304 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 note: GC not initialized 2024-09-12T18:46:41.305 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:46:41.155+0000 7f81de7fc640 20 reqs_thread_entry: start 2024-09-12T18:46:41.305 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command sync trace show hook 0x7f8328005440 2024-09-12T18:46:41.305 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command sync trace history hook 0x7f8328005440 2024-09-12T18:46:41.305 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command sync trace active hook 0x7f8328005440 2024-09-12T18:46:41.305 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:46:41.155+0000 7f833042b9c0 5 asok(0x55835fdf52b0) register_command sync trace active_short hook 0x7f8328005440 2024-09-12T18:46:41.305 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:46:41.155+0000 7f833042b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:41.305 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:46:41.155+0000 7f833042b9c0 20 Filter name: none 2024-09-12T18:46:41.305 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:46:41.155+0000 7f814ffff640 20 reqs_thread_entry: start 2024-09-12T18:46:41.305 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:46:41.155+0000 7f833042b9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:46:41.305 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:46:41.155+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.305 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:46:41.159+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:41.305 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:46:41.305 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:46:41.305 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 : miss 2024-09-12T18:46:41.306 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:46:41.159+0000 7f833042b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.306 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:46:41.159+0000 7f833042b9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:46:41.306 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:46:41.306 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:46:41.306 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:46:41.306 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:41.306 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:46:41.159+0000 7f833042b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 2024-09-12T18:46:41.306 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:46:41.171+0000 7f833042b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:46:41.306 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:46:41.171+0000 7f833042b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:46:41.306 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:46:41.171+0000 7f833042b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:41.306 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:46:41.171+0000 7f833042b9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27, ofs0, ns] 2024-09-12T18:46:41.306 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:46:41.171+0000 7f82117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431580 cookie 94022740726624 notifier 6521 bl.length()=939 2024-09-12T18:46:41.306 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:46:41.171+0000 7f82117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:46:41.306 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:46:41.171+0000 7f82117fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:46:41.307 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:46:41.171+0000 7f82117fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:41.307 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:46:41.171+0000 7f833042b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): orig_sources= new_sources= 2024-09-12T18:46:41.307 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:46:41.171+0000 7f833042b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): potential sources added=[] removed=[] 2024-09-12T18:46:41.307 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:46:41.171+0000 7f833042b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): orig_dests= new_dests= 2024-09-12T18:46:41.307 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:46:41.171+0000 7f833042b9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): potential dests added=[] removed=[] 2024-09-12T18:46:41.307 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:46:41.171+0000 7f833042b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f833042b9c0 time 2024-09-12T18:46:41.175288+0000 2024-09-12T18:46:41.307 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:46:41.307 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.307 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:41.307 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f8333d052eb] 2024-09-12T18:46:41.307 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8333d0549f] 2024-09-12T18:46:41.307 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55835e284cc1] 2024-09-12T18:46:41.307 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422a3e) [0x55835ece2a3e] 2024-09-12T18:46:41.307 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55835e299ced] 2024-09-12T18:46:41.308 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:46:41.308 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8332b6bd90] 2024-09-12T18:46:41.308 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:46:41.308 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:46:41.308 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.308 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:46:41.175+0000 7f833042b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:46:41.308 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f833042b9c0 thread_name:radosgw-admin 2024-09-12T18:46:41.308 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.308 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:46:41.308 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f8332b84520] 2024-09-12T18:46:41.308 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:46:41.308 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:46:41.308 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8333d05345] 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8333d0549f] 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55835e284cc1] 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422a3e) [0x55835ece2a3e] 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55835e299ced] 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8332b6bd90] 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:46:41.309 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:46:41.310 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:46:41.310 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:46:41.310 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:46:41.310 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:46:41.310 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:46:41.310 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:46:41.310 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:46:41.310 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:46:41.310 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:46:41.310 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:46:41.310 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:46:41.310 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:46:41.310 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:46:41.310 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:46:41.311 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:46:41.312 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:46:41.312 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:46:41.312 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:46:41.312 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:46:41.312 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:46:41.312 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:46:41.312 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:46:41.312 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:46:41.312 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:46:41.312 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:46:41.312 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:46:41.312 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:46:41.312 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:46:41.313 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:46:41.313 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:46:41.313 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:46:41.313 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:46:41.313 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:46:41.313 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:46:41.313 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:46:41.313 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:46:41.313 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:46:41.313 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:46:41.313 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:46:41.313 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:46:41.313 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:46:41.313 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:46:41.314 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:46:41.314 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:46:41.314 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:46:41.314 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:46:41.314 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:46:41.314 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:46:41.314 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:46:41.314 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:46:41.314 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:46:41.314 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:46:41.314 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:46:41.314 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:46:41.314 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:46:41.314 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:46:41.315 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:46:41.315 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:46:41.315 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:46:41.315 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:46:41.315 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:46:41.315 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:46:41.315 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:46:41.315 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:46:41.315 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:46:41.315 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:46:41.315 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:46:41.315 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:46:41.315 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:46:41.315 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:46:41.316 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:46:41.316 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:46:41.316 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:46:41.316 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:46:41.316 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:46:41.316 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:46:41.316 INFO:tasks.workunit.client.0.smithi111.stderr: 7f814ffff640 / http_manager 2024-09-12T18:46:41.316 INFO:tasks.workunit.client.0.smithi111.stderr: 7f81de7fc640 / http_manager 2024-09-12T18:46:41.317 INFO:tasks.workunit.client.0.smithi111.stderr: 7f81df7fe640 / rgw_dt_lg_renew 2024-09-12T18:46:41.317 INFO:tasks.workunit.client.0.smithi111.stderr: 7f81ff7fe640 / ms_dispatch 2024-09-12T18:46:41.317 INFO:tasks.workunit.client.0.smithi111.stderr: 7f82117fa640 / io_context_pool 2024-09-12T18:46:41.317 INFO:tasks.workunit.client.0.smithi111.stderr: 7f82137fe640 / ms_dispatch 2024-09-12T18:46:41.317 INFO:tasks.workunit.client.0.smithi111.stderr: 7f821a604640 / ms_dispatch 2024-09-12T18:46:41.317 INFO:tasks.workunit.client.0.smithi111.stderr: 7f821be07640 / io_context_pool 2024-09-12T18:46:41.317 INFO:tasks.workunit.client.0.smithi111.stderr: 7f832d730640 / msgr-worker-2 2024-09-12T18:46:41.317 INFO:tasks.workunit.client.0.smithi111.stderr: 7f832df31640 / msgr-worker-1 2024-09-12T18:46:41.317 INFO:tasks.workunit.client.0.smithi111.stderr: 7f832e732640 / msgr-worker-0 2024-09-12T18:46:41.317 INFO:tasks.workunit.client.0.smithi111.stderr: 7f832ef33640 / io_context_pool 2024-09-12T18:46:41.317 INFO:tasks.workunit.client.0.smithi111.stderr: 7f833042b9c0 / radosgw-admin 2024-09-12T18:46:41.317 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:46:41.317 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:46:41.317 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:46:41.177770Z_a53697f2-42aa-4850-817a-34a067355a42/log 2024-09-12T18:46:41.318 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:46:41.318 INFO:tasks.workunit.client.0.smithi111.stderr:Aborted 2024-09-12T18:46:41.318 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T18:46:41.319 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:41.319 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:41.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.255+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.255+0000 7f5ce82c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.255+0000 7f5ce82c19c0 20 realm 2024-09-12T18:46:41.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.255+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.259+0000 7f5ce82c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.259+0000 7f5ce82c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:41.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.259+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.259+0000 7f5ce82c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.259+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.259+0000 7f5ce82c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:41.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.259+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.259+0000 7f5ce82c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:41.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.259+0000 7f5ce82c19c0 20 searching for the correct realm 2024-09-12T18:46:41.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.263+0000 7f5ce65c8640 0 -- 172.21.15.111:0/3469910210 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f5cd0034070 msgr2=0x7f5cd0040930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:41.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.271+0000 7f5ce55c6640 0 -- 172.21.15.111:0/3469910210 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f5ce00628e0 msgr2=0x7f5ce0083820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:46:41.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.487+0000 7f5ce82c19c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:41.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.487+0000 7f5ce82c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:41.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.487+0000 7f5ce82c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:41.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.487+0000 7f5ce82c19c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:41.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.487+0000 7f5ce82c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:41.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.487+0000 7f5ce82c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:41.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.487+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.487+0000 7f5ce82c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.487+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.487+0000 7f5ce82c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:41.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.487+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:41.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 20 zone default found 2024-09-12T18:46:41.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 4 Realm: () 2024-09-12T18:46:41.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:41.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:41.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:41.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 20 zonegroup default 2024-09-12T18:46:41.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 20 started sync module instance, tier type = 2024-09-12T18:46:41.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.491+0000 7f5ce82c19c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:41.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.515+0000 7f5ce82c19c0 20 add_watcher() i=0 2024-09-12T18:46:41.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.515+0000 7f5ce82c19c0 20 add_watcher() i=1 2024-09-12T18:46:41.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.515+0000 7f5ce82c19c0 20 add_watcher() i=2 2024-09-12T18:46:41.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.515+0000 7f5ce82c19c0 20 add_watcher() i=3 2024-09-12T18:46:41.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.515+0000 7f5ce82c19c0 20 add_watcher() i=4 2024-09-12T18:46:41.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.515+0000 7f5ce82c19c0 20 add_watcher() i=5 2024-09-12T18:46:41.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.515+0000 7f5ce82c19c0 20 add_watcher() i=6 2024-09-12T18:46:41.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.519+0000 7f5ce82c19c0 20 add_watcher() i=7 2024-09-12T18:46:41.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.519+0000 7f5ce82c19c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:41.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.523+0000 7f5b977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:41.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.523+0000 7f5ce82c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:41.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.523+0000 7f5ce82c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:41.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.523+0000 7f5ce82c19c0 5 note: GC not initialized 2024-09-12T18:46:41.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.523+0000 7f5b967fc640 20 reqs_thread_entry: start 2024-09-12T18:46:41.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.523+0000 7f5ce82c19c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:41.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.523+0000 7f5ce82c19c0 20 Filter name: none 2024-09-12T18:46:41.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.523+0000 7f5b07fff640 20 reqs_thread_entry: start 2024-09-12T18:46:41.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.523+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.523+0000 7f5ce82c19c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:41.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.523+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.523+0000 7f5ce82c19c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:46:41.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.523+0000 7f5ce82c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:41.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.523+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.527+0000 7f5ce82c19c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:41.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.527+0000 7f5ce82c19c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.527+0000 7f5ce82c19c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:46:41.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.527+0000 7f5ce82c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:46:41.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.531+0000 7f5b977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:41.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.535+0000 7f5ce82c19c0 20 remove_watcher() i=0 2024-09-12T18:46:41.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.535+0000 7f5ce82c19c0 2 removed watcher, disabling cache 2024-09-12T18:46:41.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.535+0000 7f5ce82c19c0 20 remove_watcher() i=1 2024-09-12T18:46:41.542 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.539+0000 7f5ce82c19c0 20 remove_watcher() i=2 2024-09-12T18:46:41.544 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.543+0000 7f5ce82c19c0 20 remove_watcher() i=3 2024-09-12T18:46:41.546 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.543+0000 7f5ce82c19c0 20 remove_watcher() i=4 2024-09-12T18:46:41.549 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.547+0000 7f5ce82c19c0 20 remove_watcher() i=5 2024-09-12T18:46:41.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.551+0000 7f5ce82c19c0 20 remove_watcher() i=6 2024-09-12T18:46:41.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.551+0000 7f5ce82c19c0 20 remove_watcher() i=7 2024-09-12T18:46:41.568 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.568 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:46:41.568 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-trim-reshard-log-entries id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:46:41.568 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:46:41.569 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:41.569 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:41.581 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:46:41.581 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:46:41.625 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:46:41.661 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:46:41.662 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:46:41.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.707+0000 7ff03770c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.707+0000 7ff03770c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.707+0000 7ff03770c9c0 20 realm 2024-09-12T18:46:41.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.707+0000 7ff03770c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.707+0000 7ff03770c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.707+0000 7ff03770c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:46:41.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.707+0000 7ff03770c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.707+0000 7ff03770c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:41.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.707+0000 7ff03770c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.711+0000 7ff03770c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:41.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.711+0000 7ff03770c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:41.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.711+0000 7ff03770c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:46:41.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.711+0000 7ff03770c9c0 20 searching for the correct realm 2024-09-12T18:46:41.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.715+0000 7ff035a13640 0 -- 172.21.15.111:0/3280133006 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7ff02c10b600 msgr2=0x7ff02c009ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:41.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:41.931+0000 7ff034a11640 0 -- 172.21.15.111:0/3280133006 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7ff03000e040 msgr2=0x7ff0300267f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:46:42.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.147+0000 7ff03770c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:46:42.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.147+0000 7ff03770c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:46:42.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.147+0000 7ff03770c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:46:42.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.147+0000 7ff03770c9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:46:42.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.147+0000 7ff03770c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:46:42.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.147+0000 7ff03770c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:46:42.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.147+0000 7ff03770c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:42.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.147+0000 7ff03770c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:42.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.147+0000 7ff03770c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:42.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:46:42.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:42.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:46:42.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 20 zone default found 2024-09-12T18:46:42.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 4 Realm: () 2024-09-12T18:46:42.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:46:42.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:46:42.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:46:42.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 20 zonegroup default 2024-09-12T18:46:42.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:42.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:42.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:42.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:42.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:42.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:46:42.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 20 started sync module instance, tier type = 2024-09-12T18:46:42.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.151+0000 7ff03770c9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:46:42.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.175+0000 7ff03770c9c0 20 add_watcher() i=0 2024-09-12T18:46:42.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.175+0000 7ff03770c9c0 20 add_watcher() i=1 2024-09-12T18:46:42.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.175+0000 7ff03770c9c0 20 add_watcher() i=2 2024-09-12T18:46:42.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.175+0000 7ff03770c9c0 20 add_watcher() i=3 2024-09-12T18:46:42.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.175+0000 7ff03770c9c0 20 add_watcher() i=4 2024-09-12T18:46:42.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.175+0000 7ff03770c9c0 20 add_watcher() i=5 2024-09-12T18:46:42.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.175+0000 7ff03770c9c0 20 add_watcher() i=6 2024-09-12T18:46:42.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.179+0000 7ff03770c9c0 20 add_watcher() i=7 2024-09-12T18:46:42.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.179+0000 7ff03770c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:46:42.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.183+0000 7feeeb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:42.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.183+0000 7ff03770c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:46:42.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.183+0000 7ff03770c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:46:42.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.183+0000 7ff03770c9c0 5 note: GC not initialized 2024-09-12T18:46:42.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.183+0000 7feeea7e4640 20 reqs_thread_entry: start 2024-09-12T18:46:42.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:46:42.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 20 Filter name: none 2024-09-12T18:46:42.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7fee5bfff640 20 reqs_thread_entry: start 2024-09-12T18:46:42.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:46:42.188 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:42.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:46:42.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:46:42.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:46:42.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 : miss 2024-09-12T18:46:42.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:46:42.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:46:42.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:46:42.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:46:42.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:46:42.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:46:42.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.187+0000 7ff03770c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 2024-09-12T18:46:42.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.191+0000 7ff03770c9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to be held by another RGW process; skipping for now 2024-09-12T18:46:42.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.191+0000 7feeeb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:46:42.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.195+0000 7ff03770c9c0 20 remove_watcher() i=0 2024-09-12T18:46:42.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.195+0000 7ff03770c9c0 2 removed watcher, disabling cache 2024-09-12T18:46:42.200 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.199+0000 7ff03770c9c0 20 remove_watcher() i=1 2024-09-12T18:46:42.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.199+0000 7ff03770c9c0 20 remove_watcher() i=2 2024-09-12T18:46:42.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.203+0000 7ff03770c9c0 20 remove_watcher() i=3 2024-09-12T18:46:42.207 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.203+0000 7ff03770c9c0 20 remove_watcher() i=4 2024-09-12T18:46:42.208 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.207+0000 7ff03770c9c0 20 remove_watcher() i=5 2024-09-12T18:46:42.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.207+0000 7ff03770c9c0 20 remove_watcher() i=6 2024-09-12T18:46:42.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:46:42.207+0000 7ff03770c9c0 20 remove_watcher() i=7 2024-09-12T18:46:42.226 INFO:tasks.workunit.client.0.smithi111.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:47:12.254 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:47:12.290 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:12.290 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:12.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.334+0000 7f84e815c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.334+0000 7f84e815c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:12.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.334+0000 7f84e815c9c0 20 realm 2024-09-12T18:47:12.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.334+0000 7f84e815c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.334+0000 7f84e815c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:12.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.334+0000 7f84e815c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:12.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.334+0000 7f84e815c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.334+0000 7f84e815c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:12.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.334+0000 7f84e815c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.338+0000 7f84e815c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:12.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.338+0000 7f84e815c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.341 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.338+0000 7f84e815c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:12.341 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.338+0000 7f84e815c9c0 20 searching for the correct realm 2024-09-12T18:47:12.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.342+0000 7f84e5c62640 0 -- 172.21.15.111:0/552215277 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f84e00637b0 msgr2=0x7f84e0062220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:12.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.350+0000 7f84e5461640 0 -- 172.21.15.111:0/552215277 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f84e0096bb0 msgr2=0x7f84e008f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:12.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.566+0000 7f84e815c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:12.571 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.566+0000 7f84e815c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:12.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.566+0000 7f84e815c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:12.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.566+0000 7f84e815c9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:12.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.566+0000 7f84e815c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:12.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.566+0000 7f84e815c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:12.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.566+0000 7f84e815c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.566+0000 7f84e815c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:12.572 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.566+0000 7f84e815c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.570+0000 7f84e815c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:12.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.570+0000 7f84e815c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.570+0000 7f84e815c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:12.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.570+0000 7f84e815c9c0 20 zone default found 2024-09-12T18:47:12.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.570+0000 7f84e815c9c0 4 Realm: () 2024-09-12T18:47:12.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.570+0000 7f84e815c9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:12.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.570+0000 7f84e815c9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:12.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.570+0000 7f84e815c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:12.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.570+0000 7f84e815c9c0 20 zonegroup default 2024-09-12T18:47:12.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.570+0000 7f84e815c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.570+0000 7f84e815c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:12.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.570+0000 7f84e815c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.574+0000 7f84e815c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:12.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.574+0000 7f84e815c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.577 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.574+0000 7f84e815c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:12.577 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.574+0000 7f84e815c9c0 20 started sync module instance, tier type = 2024-09-12T18:47:12.577 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.574+0000 7f84e815c9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:12.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.602+0000 7f84e815c9c0 20 add_watcher() i=0 2024-09-12T18:47:12.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.602+0000 7f84e815c9c0 20 add_watcher() i=1 2024-09-12T18:47:12.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.602+0000 7f84e815c9c0 20 add_watcher() i=2 2024-09-12T18:47:12.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.602+0000 7f84e815c9c0 20 add_watcher() i=3 2024-09-12T18:47:12.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.602+0000 7f84e815c9c0 20 add_watcher() i=4 2024-09-12T18:47:12.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.602+0000 7f84e815c9c0 20 add_watcher() i=5 2024-09-12T18:47:12.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.602+0000 7f84e815c9c0 20 add_watcher() i=6 2024-09-12T18:47:12.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.606+0000 7f84e815c9c0 20 add_watcher() i=7 2024-09-12T18:47:12.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.606+0000 7f84e815c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:12.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.610+0000 7f83977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:12.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.610+0000 7f84e815c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:12.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.610+0000 7f84e815c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:12.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.610+0000 7f84e815c9c0 5 note: GC not initialized 2024-09-12T18:47:12.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.610+0000 7f83967fc640 20 reqs_thread_entry: start 2024-09-12T18:47:12.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.610+0000 7f84e815c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:12.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.610+0000 7f84e815c9c0 20 Filter name: none 2024-09-12T18:47:12.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.610+0000 7f830bfff640 20 reqs_thread_entry: start 2024-09-12T18:47:12.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.610+0000 7f84e815c9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T18:47:12.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.610+0000 7f84e815c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.614+0000 7f84e815c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:47:12.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.614+0000 7f84e815c9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T18:47:12.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.614+0000 7f84e815c9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T18:47:12.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.614+0000 7f84e815c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 : miss 2024-09-12T18:47:12.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.614+0000 7f84e815c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.614+0000 7f84e815c9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T18:47:12.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.614+0000 7f84e815c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:47:12.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.614+0000 7f84e815c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:47:12.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.614+0000 7f84e815c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:47:12.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.614+0000 7f84e815c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:12.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.614+0000 7f84e815c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 2024-09-12T18:47:12.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.618+0000 7f84e815c9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:47:12.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.630+0000 7f84e815c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:47:12.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.630+0000 7f84e815c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:47:12.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.630+0000 7f84e815c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:12.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.630+0000 7f84e815c9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27, ofs0, ns] 2024-09-12T18:47:12.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.630+0000 7f83c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431581 cookie 94112557358944 notifier 6990 bl.length()=939 2024-09-12T18:47:12.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.630+0000 7f83c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:47:12.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.630+0000 7f83c97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:47:12.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.630+0000 7f83c97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:12.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.634+0000 7f84e815c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): orig_sources= new_sources= 2024-09-12T18:47:12.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.634+0000 7f84e815c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): potential sources added=[] removed=[] 2024-09-12T18:47:12.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.634+0000 7f84e815c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): orig_dests= new_dests= 2024-09-12T18:47:12.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.634+0000 7f84e815c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): potential dests added=[] removed=[] 2024-09-12T18:47:12.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.0 2024-09-12T18:47:12.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.0 2024-09-12T18:47:12.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.1 2024-09-12T18:47:12.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.1 2024-09-12T18:47:12.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.2 2024-09-12T18:47:12.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.2 2024-09-12T18:47:12.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.3 2024-09-12T18:47:12.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.3 2024-09-12T18:47:12.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.4 2024-09-12T18:47:12.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.4 2024-09-12T18:47:12.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.5 2024-09-12T18:47:12.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.5 2024-09-12T18:47:12.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.6 2024-09-12T18:47:12.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.6 2024-09-12T18:47:12.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.7 2024-09-12T18:47:12.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.7 2024-09-12T18:47:12.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.8 2024-09-12T18:47:12.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.8 2024-09-12T18:47:12.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.9 2024-09-12T18:47:12.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.9 2024-09-12T18:47:12.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.10 2024-09-12T18:47:12.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.10 2024-09-12T18:47:12.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.11 2024-09-12T18:47:12.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2.11 2024-09-12T18:47:12.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.0 2024-09-12T18:47:12.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.1 2024-09-12T18:47:12.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2 2024-09-12T18:47:12.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.3 2024-09-12T18:47:12.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.642+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.4 2024-09-12T18:47:12.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.646+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.5 2024-09-12T18:47:12.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.646+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.6 2024-09-12T18:47:12.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.646+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.7 2024-09-12T18:47:12.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.646+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.8 2024-09-12T18:47:12.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.646+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.9 2024-09-12T18:47:12.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.650+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.10 2024-09-12T18:47:12.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.658+0000 7f84e815c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:12.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.658+0000 7f84e815c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 2024-09-12T18:47:12.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.658+0000 7f84e815c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:47:12.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.658+0000 7f84e815c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:47:12.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.658+0000 7f84e815c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:12.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.658+0000 7f84e815c9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27, ofs0, ns] 2024-09-12T18:47:12.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.658+0000 7f83c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431582 cookie 94112557358944 notifier 6990 bl.length()=939 2024-09-12T18:47:12.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.658+0000 7f83c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:47:12.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.658+0000 7f83c97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:47:12.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.658+0000 7f83c97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:12.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.658+0000 7f84e815c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): orig_sources= new_sources= 2024-09-12T18:47:12.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.658+0000 7f84e815c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): potential sources added=[] removed=[] 2024-09-12T18:47:12.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.658+0000 7f84e815c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): orig_dests= new_dests= 2024-09-12T18:47:12.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.658+0000 7f84e815c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): potential dests added=[] removed=[] 2024-09-12T18:47:12.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.662+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.0 2024-09-12T18:47:12.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.662+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.1 2024-09-12T18:47:12.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.666+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.2 2024-09-12T18:47:12.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.666+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.3 2024-09-12T18:47:12.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.666+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.4 2024-09-12T18:47:12.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.666+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.5 2024-09-12T18:47:12.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.666+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.6 2024-09-12T18:47:12.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.666+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.7 2024-09-12T18:47:12.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.666+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.8 2024-09-12T18:47:12.672 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.9 2024-09-12T18:47:12.672 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f84e815c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.27.10 2024-09-12T18:47:12.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f84e815c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:12.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f84e815c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 2024-09-12T18:47:12.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f84e815c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:47:12.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f84e815c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:47:12.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f84e815c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:12.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f84e815c9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27, ofs0, ns] 2024-09-12T18:47:12.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f83c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431583 cookie 94112557358944 notifier 6990 bl.length()=907 2024-09-12T18:47:12.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f83c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 info.flags=0x17 2024-09-12T18:47:12.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f83c97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:97c2b296-1395-4700-8053-4f06c4c86557.4689.27 to cache LRU end 2024-09-12T18:47:12.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f83c97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:12.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f84e815c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): orig_sources= new_sources= 2024-09-12T18:47:12.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f84e815c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): potential sources added=[] removed=[] 2024-09-12T18:47:12.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f84e815c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): orig_dests= new_dests= 2024-09-12T18:47:12.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.670+0000 7f84e815c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[97c2b296-1395-4700-8053-4f06c4c86557.4689.27]): potential dests added=[] removed=[] 2024-09-12T18:47:12.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.674+0000 7f84e815c9c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T18:47:12.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.678+0000 7f83977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:12.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.686+0000 7f84e815c9c0 20 remove_watcher() i=0 2024-09-12T18:47:12.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.686+0000 7f84e815c9c0 2 removed watcher, disabling cache 2024-09-12T18:47:12.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.686+0000 7f84e815c9c0 20 remove_watcher() i=1 2024-09-12T18:47:12.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.690+0000 7f84e815c9c0 20 remove_watcher() i=2 2024-09-12T18:47:12.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.690+0000 7f84e815c9c0 20 remove_watcher() i=3 2024-09-12T18:47:12.697 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.694+0000 7f84e815c9c0 20 remove_watcher() i=4 2024-09-12T18:47:12.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.694+0000 7f84e815c9c0 20 remove_watcher() i=5 2024-09-12T18:47:12.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.694+0000 7f84e815c9c0 20 remove_watcher() i=6 2024-09-12T18:47:12.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.698+0000 7f84e815c9c0 20 remove_watcher() i=7 2024-09-12T18:47:12.716 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T18:47:12.747 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:12.747 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:12.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.786+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.790+0000 7efe6d0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:12.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.790+0000 7efe6d0249c0 20 realm 2024-09-12T18:47:12.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.790+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.790+0000 7efe6d0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:12.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.790+0000 7efe6d0249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:12.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.790+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.790+0000 7efe6d0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:12.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.790+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.790+0000 7efe6d0249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:12.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.790+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:12.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.790+0000 7efe6d0249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:12.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.790+0000 7efe6d0249c0 20 searching for the correct realm 2024-09-12T18:47:12.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.794+0000 7efe6b32b640 0 -- 172.21.15.111:0/3779685000 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7efe60008030 msgr2=0x7efe60063730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:12.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:12.802+0000 7efe6a329640 0 -- 172.21.15.111:0/3779685000 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7efe64112bc0 msgr2=0x7efe6411fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:13.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.018+0000 7efe6d0249c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:13.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.018+0000 7efe6d0249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:13.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.018+0000 7efe6d0249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:13.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.018+0000 7efe6d0249c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:13.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.018+0000 7efe6d0249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:13.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.018+0000 7efe6d0249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:13.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.018+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:13.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:13.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:13.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 20 zone default found 2024-09-12T18:47:13.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 4 Realm: () 2024-09-12T18:47:13.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:13.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:13.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:13.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 20 zonegroup default 2024-09-12T18:47:13.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:13.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:13.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.022+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.026+0000 7efe6d0249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:13.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.026+0000 7efe6d0249c0 20 started sync module instance, tier type = 2024-09-12T18:47:13.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.026+0000 7efe6d0249c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:13.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.050+0000 7efe6d0249c0 20 add_watcher() i=0 2024-09-12T18:47:13.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.050+0000 7efe6d0249c0 20 add_watcher() i=1 2024-09-12T18:47:13.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.050+0000 7efe6d0249c0 20 add_watcher() i=2 2024-09-12T18:47:13.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.050+0000 7efe6d0249c0 20 add_watcher() i=3 2024-09-12T18:47:13.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.050+0000 7efe6d0249c0 20 add_watcher() i=4 2024-09-12T18:47:13.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.050+0000 7efe6d0249c0 20 add_watcher() i=5 2024-09-12T18:47:13.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.050+0000 7efe6d0249c0 20 add_watcher() i=6 2024-09-12T18:47:13.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.050+0000 7efe6d0249c0 20 add_watcher() i=7 2024-09-12T18:47:13.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.050+0000 7efe6d0249c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:13.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.054+0000 7efd217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:13.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.058+0000 7efe6d0249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:13.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.058+0000 7efe6d0249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:13.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.058+0000 7efe6d0249c0 5 note: GC not initialized 2024-09-12T18:47:13.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.058+0000 7efc9bfff640 20 reqs_thread_entry: start 2024-09-12T18:47:13.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.058+0000 7efe6d0249c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:13.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.058+0000 7efe6d0249c0 20 Filter name: none 2024-09-12T18:47:13.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.058+0000 7efc99ffb640 20 reqs_thread_entry: start 2024-09-12T18:47:13.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.058+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.058+0000 7efe6d0249c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:47:13.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.058+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.058+0000 7efe6d0249c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:47:13.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.058+0000 7efe6d0249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:13.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.058+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.062+0000 7efe6d0249c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T18:47:13.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.062+0000 7efe6d0249c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.062+0000 7efe6d0249c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T18:47:13.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.062+0000 7efe6d0249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:13.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.066+0000 7efd217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:13.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.070+0000 7efe6d0249c0 20 remove_watcher() i=0 2024-09-12T18:47:13.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.070+0000 7efe6d0249c0 2 removed watcher, disabling cache 2024-09-12T18:47:13.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.074+0000 7efe6d0249c0 20 remove_watcher() i=1 2024-09-12T18:47:13.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.074+0000 7efe6d0249c0 20 remove_watcher() i=2 2024-09-12T18:47:13.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.078+0000 7efe6d0249c0 20 remove_watcher() i=3 2024-09-12T18:47:13.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.078+0000 7efe6d0249c0 20 remove_watcher() i=4 2024-09-12T18:47:13.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.082+0000 7efe6d0249c0 20 remove_watcher() i=5 2024-09-12T18:47:13.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.082+0000 7efe6d0249c0 20 remove_watcher() i=6 2024-09-12T18:47:13.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.082+0000 7efe6d0249c0 20 remove_watcher() i=7 2024-09-12T18:47:13.103 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:13.103 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:47:13.103 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-trim-reshard-log-entries id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:47:13.103 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:13.104 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.104 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.108 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.108 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.154 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.154 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.214 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T18:47:13.214 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:13.216 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.216 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.241 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.241 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.288 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.288 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.308 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.308 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.328 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.328 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.348 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.348 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.368 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.368 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.390 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.390 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.408 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.408 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.426 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.427 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.446 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.446 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.464 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.465 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.483 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.483 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.502 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.502 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.523 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.523 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.541 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.541 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.560 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.560 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.579 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.580 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.598 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.598 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.617 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.617 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.636 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.636 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.655 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:13.655 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:13.673 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T18:47:13.706 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:13.706 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:13.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.750+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.754 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.750+0000 7fb5a8dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:13.754 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.750+0000 7fb5a8dda9c0 20 realm 2024-09-12T18:47:13.754 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.750+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.754 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.750+0000 7fb5a8dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:13.754 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.750+0000 7fb5a8dda9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:13.754 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.750+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.754 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.750+0000 7fb5a8dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:13.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.750+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.754+0000 7fb5a8dda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:13.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.754+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.754+0000 7fb5a8dda9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:13.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.754+0000 7fb5a8dda9c0 20 searching for the correct realm 2024-09-12T18:47:13.761 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.758+0000 7fb5a68e0640 0 -- 172.21.15.111:0/1593529131 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fb5a002c400 msgr2=0x7fb5a002c820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:13.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.762+0000 7fb5a60df640 0 -- 172.21.15.111:0/1593529131 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fb5a00408f0 msgr2=0x7fb5a00203d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:47:13.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.978+0000 7fb5a8dda9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:13.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.978+0000 7fb5a8dda9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:13.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.978+0000 7fb5a8dda9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:13.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.978+0000 7fb5a8dda9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:13.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.978+0000 7fb5a8dda9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:13.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.978+0000 7fb5a8dda9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:13.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.978+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.978+0000 7fb5a8dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:13.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.978+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:13.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:13.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 20 zone default found 2024-09-12T18:47:13.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 4 Realm: () 2024-09-12T18:47:13.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:13.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:13.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:13.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 20 zonegroup default 2024-09-12T18:47:13.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:13.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:13.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:13.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:13.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 20 started sync module instance, tier type = 2024-09-12T18:47:13.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:13.982+0000 7fb5a8dda9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:14.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.006+0000 7fb5a8dda9c0 20 add_watcher() i=0 2024-09-12T18:47:14.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.006+0000 7fb5a8dda9c0 20 add_watcher() i=1 2024-09-12T18:47:14.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.006+0000 7fb5a8dda9c0 20 add_watcher() i=2 2024-09-12T18:47:14.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.006+0000 7fb5a8dda9c0 20 add_watcher() i=3 2024-09-12T18:47:14.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.006+0000 7fb5a8dda9c0 20 add_watcher() i=4 2024-09-12T18:47:14.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.006+0000 7fb5a8dda9c0 20 add_watcher() i=5 2024-09-12T18:47:14.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.006+0000 7fb5a8dda9c0 20 add_watcher() i=6 2024-09-12T18:47:14.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.010+0000 7fb5a8dda9c0 20 add_watcher() i=7 2024-09-12T18:47:14.013 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.010+0000 7fb5a8dda9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:14.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.014+0000 7fb45d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:14.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.014+0000 7fb5a8dda9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:14.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.014+0000 7fb5a8dda9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:14.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.014+0000 7fb5a8dda9c0 5 note: GC not initialized 2024-09-12T18:47:14.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.014+0000 7fb3d7fff640 20 reqs_thread_entry: start 2024-09-12T18:47:14.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.014+0000 7fb5a8dda9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:14.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.014+0000 7fb5a8dda9c0 20 Filter name: none 2024-09-12T18:47:14.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.014+0000 7fb3d5ffb640 20 reqs_thread_entry: start 2024-09-12T18:47:14.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.014+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.018+0000 7fb5a8dda9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:14.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.018+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.021 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.018+0000 7fb5a8dda9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:14.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.018+0000 7fb5a8dda9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:14.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.018+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.018+0000 7fb5a8dda9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:14.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.018+0000 7fb5a8dda9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.018+0000 7fb5a8dda9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:14.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.018+0000 7fb5a8dda9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:14.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.022+0000 7fb45d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:14.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.030+0000 7fb5a8dda9c0 20 remove_watcher() i=0 2024-09-12T18:47:14.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.030+0000 7fb5a8dda9c0 2 removed watcher, disabling cache 2024-09-12T18:47:14.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.030+0000 7fb5a8dda9c0 20 remove_watcher() i=1 2024-09-12T18:47:14.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.034+0000 7fb5a8dda9c0 20 remove_watcher() i=2 2024-09-12T18:47:14.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.034+0000 7fb5a8dda9c0 20 remove_watcher() i=3 2024-09-12T18:47:14.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.038+0000 7fb5a8dda9c0 20 remove_watcher() i=4 2024-09-12T18:47:14.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.038+0000 7fb5a8dda9c0 20 remove_watcher() i=5 2024-09-12T18:47:14.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.038+0000 7fb5a8dda9c0 20 remove_watcher() i=6 2024-09-12T18:47:14.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.042+0000 7fb5a8dda9c0 20 remove_watcher() i=7 2024-09-12T18:47:14.061 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:14.061 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:47:14.061 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-block-writes id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:47:14.061 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:14.062 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T18:47:14.094 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:14.094 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:14.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.134+0000 7f72242a49c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.134+0000 7f72242a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:14.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.134+0000 7f72242a49c0 20 realm 2024-09-12T18:47:14.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.134+0000 7f72242a49c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.134+0000 7f72242a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:14.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.134+0000 7f72242a49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:14.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.134+0000 7f72242a49c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.134+0000 7f72242a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:14.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.134+0000 7f72242a49c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.138+0000 7f72242a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:14.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.138+0000 7f72242a49c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.138+0000 7f72242a49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:14.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.138+0000 7f72242a49c0 20 searching for the correct realm 2024-09-12T18:47:14.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.142+0000 7f72225ab640 0 -- 172.21.15.111:0/1746655018 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f720c118670 msgr2=0x7f720c11d5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:14.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.150+0000 7f72215a9640 0 -- 172.21.15.111:0/1746655018 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f721c008040 msgr2=0x7f721c01b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:14.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.366+0000 7f72242a49c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:14.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.366+0000 7f72242a49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:14.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.366+0000 7f72242a49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:14.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.366+0000 7f72242a49c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:14.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.366+0000 7f72242a49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:14.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.366+0000 7f72242a49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:14.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.366+0000 7f72242a49c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.366+0000 7f72242a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:14.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.366+0000 7f72242a49c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.370+0000 7f72242a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:14.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.370+0000 7f72242a49c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.370+0000 7f72242a49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:14.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.370+0000 7f72242a49c0 20 zone default found 2024-09-12T18:47:14.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.370+0000 7f72242a49c0 4 Realm: () 2024-09-12T18:47:14.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.370+0000 7f72242a49c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:14.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.370+0000 7f72242a49c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:14.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.370+0000 7f72242a49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:14.375 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.370+0000 7f72242a49c0 20 zonegroup default 2024-09-12T18:47:14.375 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.370+0000 7f72242a49c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.375 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.370+0000 7f72242a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:14.375 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.370+0000 7f72242a49c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.370+0000 7f72242a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:14.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.370+0000 7f72242a49c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.374+0000 7f72242a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:14.377 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.374+0000 7f72242a49c0 20 started sync module instance, tier type = 2024-09-12T18:47:14.377 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.374+0000 7f72242a49c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:14.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.394+0000 7f72242a49c0 20 add_watcher() i=0 2024-09-12T18:47:14.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.394+0000 7f72242a49c0 20 add_watcher() i=1 2024-09-12T18:47:14.399 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.394+0000 7f72242a49c0 20 add_watcher() i=2 2024-09-12T18:47:14.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.394+0000 7f72242a49c0 20 add_watcher() i=3 2024-09-12T18:47:14.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.394+0000 7f72242a49c0 20 add_watcher() i=4 2024-09-12T18:47:14.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.394+0000 7f72242a49c0 20 add_watcher() i=5 2024-09-12T18:47:14.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.394+0000 7f72242a49c0 20 add_watcher() i=6 2024-09-12T18:47:14.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.398+0000 7f72242a49c0 20 add_watcher() i=7 2024-09-12T18:47:14.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.398+0000 7f72242a49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:14.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.402+0000 7f70d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:14.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.402+0000 7f72242a49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:14.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.402+0000 7f72242a49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:14.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.402+0000 7f72242a49c0 5 note: GC not initialized 2024-09-12T18:47:14.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.402+0000 7f70d6fe5640 20 reqs_thread_entry: start 2024-09-12T18:47:14.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.402+0000 7f72242a49c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:14.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.402+0000 7f72242a49c0 20 Filter name: none 2024-09-12T18:47:14.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.402+0000 7f70d4fe1640 20 reqs_thread_entry: start 2024-09-12T18:47:14.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.402+0000 7f72242a49c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T18:47:14.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.402+0000 7f72242a49c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.406+0000 7f72242a49c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:14.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.406+0000 7f72242a49c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T18:47:14.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.406+0000 7f72242a49c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T18:47:14.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.406+0000 7f72242a49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 : miss 2024-09-12T18:47:14.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.406+0000 7f72242a49c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.406+0000 7f72242a49c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:14.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.406+0000 7f72242a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 info.flags=0x17 2024-09-12T18:47:14.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.406+0000 7f72242a49c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 to cache LRU end 2024-09-12T18:47:14.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.406+0000 7f72242a49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:47:14.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.406+0000 7f72242a49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:14.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.406+0000 7f72242a49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 2024-09-12T18:47:14.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.418+0000 7f72242a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 info.flags=0x17 2024-09-12T18:47:14.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.418+0000 7f72242a49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 to cache LRU end 2024-09-12T18:47:14.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.418+0000 7f72242a49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:14.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.418+0000 7f72242a49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28, ofs0, ns] 2024-09-12T18:47:14.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.418+0000 7f71057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 94441903567152 notifier 6626 bl.length()=915 2024-09-12T18:47:14.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.418+0000 7f71057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 info.flags=0x17 2024-09-12T18:47:14.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.418+0000 7f71057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 to cache LRU end 2024-09-12T18:47:14.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.418+0000 7f71057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:14.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.422+0000 7f72242a49c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): orig_sources= new_sources= 2024-09-12T18:47:14.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.422+0000 7f72242a49c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): potential sources added=[] removed=[] 2024-09-12T18:47:14.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.422+0000 7f72242a49c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): orig_dests= new_dests= 2024-09-12T18:47:14.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.422+0000 7f72242a49c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): potential dests added=[] removed=[] 2024-09-12T18:47:14.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.0 2024-09-12T18:47:14.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.0 2024-09-12T18:47:14.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.1 2024-09-12T18:47:14.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.1 2024-09-12T18:47:14.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.2 2024-09-12T18:47:14.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.2 2024-09-12T18:47:14.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.3 2024-09-12T18:47:14.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.3 2024-09-12T18:47:14.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.4 2024-09-12T18:47:14.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.4 2024-09-12T18:47:14.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.5 2024-09-12T18:47:14.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.5 2024-09-12T18:47:14.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.6 2024-09-12T18:47:14.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.6 2024-09-12T18:47:14.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.7 2024-09-12T18:47:14.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.7 2024-09-12T18:47:14.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.8 2024-09-12T18:47:14.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.8 2024-09-12T18:47:14.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.9 2024-09-12T18:47:14.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.9 2024-09-12T18:47:14.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.10 2024-09-12T18:47:14.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.10 2024-09-12T18:47:14.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.11 2024-09-12T18:47:14.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.11 2024-09-12T18:47:14.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.0 2024-09-12T18:47:14.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.430+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1 2024-09-12T18:47:14.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.434+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.2 2024-09-12T18:47:14.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.434+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.3 2024-09-12T18:47:14.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.434+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.4 2024-09-12T18:47:14.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.434+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.5 2024-09-12T18:47:14.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.434+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.6 2024-09-12T18:47:14.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.434+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.7 2024-09-12T18:47:14.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.438+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.8 2024-09-12T18:47:14.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.438+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.9 2024-09-12T18:47:14.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.438+0000 7f72242a49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.10 2024-09-12T18:47:14.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.446+0000 7f72242a49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:14.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.446+0000 7f72242a49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 2024-09-12T18:47:14.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.450+0000 7f72242a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 info.flags=0x17 2024-09-12T18:47:14.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.450+0000 7f72242a49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 to cache LRU end 2024-09-12T18:47:14.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.450+0000 7f72242a49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:14.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.450+0000 7f72242a49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28, ofs0, ns] 2024-09-12T18:47:14.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.450+0000 7f7104ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431619 cookie 94441903567152 notifier 6626 bl.length()=915 2024-09-12T18:47:14.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.450+0000 7f7104ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 info.flags=0x17 2024-09-12T18:47:14.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.450+0000 7f7104ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 to cache LRU end 2024-09-12T18:47:14.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.450+0000 7f7104ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:14.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.450+0000 7f72242a49c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): orig_sources= new_sources= 2024-09-12T18:47:14.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.450+0000 7f72242a49c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): potential sources added=[] removed=[] 2024-09-12T18:47:14.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.450+0000 7f72242a49c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): orig_dests= new_dests= 2024-09-12T18:47:14.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.450+0000 7f72242a49c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): potential dests added=[] removed=[] 2024-09-12T18:47:14.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.450+0000 7f72242a49c0 -1 Injecting error=-5 at location=block_writes 2024-09-12T18:47:14.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.450+0000 7f72242a49c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T18:47:14.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.458+0000 7f72242a49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:14.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.458+0000 7f72242a49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 2024-09-12T18:47:14.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.462+0000 7f72242a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 info.flags=0x17 2024-09-12T18:47:14.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.462+0000 7f72242a49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 to cache LRU end 2024-09-12T18:47:14.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.462+0000 7f72242a49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:14.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.462+0000 7f72242a49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28, ofs0, ns] 2024-09-12T18:47:14.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.462+0000 7f71057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 94441903567152 notifier 6626 bl.length()=883 2024-09-12T18:47:14.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.462+0000 7f71057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 info.flags=0x17 2024-09-12T18:47:14.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.462+0000 7f71057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 to cache LRU end 2024-09-12T18:47:14.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.462+0000 7f71057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:14.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.466+0000 7f72242a49c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): orig_sources= new_sources= 2024-09-12T18:47:14.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.466+0000 7f72242a49c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): potential sources added=[] removed=[] 2024-09-12T18:47:14.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.466+0000 7f72242a49c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): orig_dests= new_dests= 2024-09-12T18:47:14.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.466+0000 7f72242a49c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): potential dests added=[] removed=[] 2024-09-12T18:47:14.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.470+0000 7f72242a49c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T18:47:14.478 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.474+0000 7f70d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:14.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.478+0000 7f72242a49c0 20 remove_watcher() i=0 2024-09-12T18:47:14.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.478+0000 7f72242a49c0 2 removed watcher, disabling cache 2024-09-12T18:47:14.485 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.482+0000 7f72242a49c0 20 remove_watcher() i=1 2024-09-12T18:47:14.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.482+0000 7f72242a49c0 20 remove_watcher() i=2 2024-09-12T18:47:14.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.486+0000 7f72242a49c0 20 remove_watcher() i=3 2024-09-12T18:47:14.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.486+0000 7f72242a49c0 20 remove_watcher() i=4 2024-09-12T18:47:14.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.490+0000 7f72242a49c0 20 remove_watcher() i=5 2024-09-12T18:47:14.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.490+0000 7f72242a49c0 20 remove_watcher() i=6 2024-09-12T18:47:14.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.494+0000 7f72242a49c0 20 remove_watcher() i=7 2024-09-12T18:47:14.515 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T18:47:14.547 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:14.547 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:14.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.794+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.798+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:14.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.798+0000 7fbc1bbfe9c0 20 realm 2024-09-12T18:47:14.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.798+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.798+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:14.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.798+0000 7fbc1bbfe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:14.802 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.798+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.798+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:14.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.798+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.804 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.802+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:14.804 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.802+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:14.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.802+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:14.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.802+0000 7fbc1bbfe9c0 20 searching for the correct realm 2024-09-12T18:47:14.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:14.806+0000 7fbc19f05640 0 -- 172.21.15.111:0/3907007976 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fbc100f5040 msgr2=0x7fbc100e03f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:15.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.022+0000 7fbc18f03640 0 -- 172.21.15.111:0/3907007976 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fbc1408b910 msgr2=0x7fbc1406c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:47:15.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:15.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:15.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:15.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:15.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:15.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:15.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:15.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:15.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:15.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 zone default found 2024-09-12T18:47:15.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 4 Realm: () 2024-09-12T18:47:15.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:15.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:15.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:15.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 zonegroup default 2024-09-12T18:47:15.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.238+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.242+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:15.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.242+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.242+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:15.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.242+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.242+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:15.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.242+0000 7fbc1bbfe9c0 20 started sync module instance, tier type = 2024-09-12T18:47:15.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.242+0000 7fbc1bbfe9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:15.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.266+0000 7fbc1bbfe9c0 20 add_watcher() i=0 2024-09-12T18:47:15.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.266+0000 7fbc1bbfe9c0 20 add_watcher() i=1 2024-09-12T18:47:15.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.266+0000 7fbc1bbfe9c0 20 add_watcher() i=2 2024-09-12T18:47:15.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.266+0000 7fbc1bbfe9c0 20 add_watcher() i=3 2024-09-12T18:47:15.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.266+0000 7fbc1bbfe9c0 20 add_watcher() i=4 2024-09-12T18:47:15.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.266+0000 7fbc1bbfe9c0 20 add_watcher() i=5 2024-09-12T18:47:15.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.266+0000 7fbc1bbfe9c0 20 add_watcher() i=6 2024-09-12T18:47:15.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.266+0000 7fbc1bbfe9c0 20 add_watcher() i=7 2024-09-12T18:47:15.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.266+0000 7fbc1bbfe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:15.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.270+0000 7fbacf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:15.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.274+0000 7fbc1bbfe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:15.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.274+0000 7fbc1bbfe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:15.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.274+0000 7fbc1bbfe9c0 5 note: GC not initialized 2024-09-12T18:47:15.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.274+0000 7fbace7e4640 20 reqs_thread_entry: start 2024-09-12T18:47:15.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.274+0000 7fbc1bbfe9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:15.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.274+0000 7fbc1bbfe9c0 20 Filter name: none 2024-09-12T18:47:15.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.274+0000 7fba3ffff640 20 reqs_thread_entry: start 2024-09-12T18:47:15.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.274+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.274+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:15.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.274+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.278+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:15.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.278+0000 7fbc1bbfe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:15.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.278+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.278+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:15.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.278+0000 7fbc1bbfe9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.278+0000 7fbc1bbfe9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:15.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.278+0000 7fbc1bbfe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:15.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.282+0000 7fbacf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:15.290 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.286+0000 7fbc1bbfe9c0 20 remove_watcher() i=0 2024-09-12T18:47:15.290 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.286+0000 7fbc1bbfe9c0 2 removed watcher, disabling cache 2024-09-12T18:47:15.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.290+0000 7fbc1bbfe9c0 20 remove_watcher() i=1 2024-09-12T18:47:15.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.290+0000 7fbc1bbfe9c0 20 remove_watcher() i=2 2024-09-12T18:47:15.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.294+0000 7fbc1bbfe9c0 20 remove_watcher() i=3 2024-09-12T18:47:15.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.294+0000 7fbc1bbfe9c0 20 remove_watcher() i=4 2024-09-12T18:47:15.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.298+0000 7fbc1bbfe9c0 20 remove_watcher() i=5 2024-09-12T18:47:15.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.298+0000 7fbc1bbfe9c0 20 remove_watcher() i=6 2024-09-12T18:47:15.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.302+0000 7fbc1bbfe9c0 20 remove_watcher() i=7 2024-09-12T18:47:15.319 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:15.320 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:47:15.320 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-block-writes id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:47:15.320 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:15.321 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:15.321 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:15.334 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:15.334 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:15.377 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:47:15.413 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:15.413 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:15.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.454+0000 7fb3239fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.458+0000 7fb3239fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:15.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.458+0000 7fb3239fb9c0 20 realm 2024-09-12T18:47:15.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.458+0000 7fb3239fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.458+0000 7fb3239fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:15.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.458+0000 7fb3239fb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:15.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.458+0000 7fb3239fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.458+0000 7fb3239fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:15.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.458+0000 7fb3239fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.458+0000 7fb3239fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:15.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.458+0000 7fb3239fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.458+0000 7fb3239fb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:15.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.458+0000 7fb3239fb9c0 20 searching for the correct realm 2024-09-12T18:47:15.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.466+0000 7fb321501640 0 -- 172.21.15.111:0/2756921937 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fb31c0e3040 msgr2=0x7fb31c0d6420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:15.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.470+0000 7fb320d00640 0 -- 172.21.15.111:0/2756921937 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fb31c0f3410 msgr2=0x7fb31c0f3890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:15.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.686+0000 7fb3239fb9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:15.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.686+0000 7fb3239fb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:15.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.686+0000 7fb3239fb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:15.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.686+0000 7fb3239fb9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:15.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.686+0000 7fb3239fb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:15.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.686+0000 7fb3239fb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:15.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.686+0000 7fb3239fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.686+0000 7fb3239fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:15.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.686+0000 7fb3239fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:15.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:15.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 20 zone default found 2024-09-12T18:47:15.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 4 Realm: () 2024-09-12T18:47:15.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:15.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:15.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:15.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 20 zonegroup default 2024-09-12T18:47:15.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:15.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:15.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:15.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 20 started sync module instance, tier type = 2024-09-12T18:47:15.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.690+0000 7fb3239fb9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:15.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.714+0000 7fb3239fb9c0 20 add_watcher() i=0 2024-09-12T18:47:15.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.714+0000 7fb3239fb9c0 20 add_watcher() i=1 2024-09-12T18:47:15.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.714+0000 7fb3239fb9c0 20 add_watcher() i=2 2024-09-12T18:47:15.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.714+0000 7fb3239fb9c0 20 add_watcher() i=3 2024-09-12T18:47:15.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.714+0000 7fb3239fb9c0 20 add_watcher() i=4 2024-09-12T18:47:15.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.714+0000 7fb3239fb9c0 20 add_watcher() i=5 2024-09-12T18:47:15.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.714+0000 7fb3239fb9c0 20 add_watcher() i=6 2024-09-12T18:47:15.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.718+0000 7fb3239fb9c0 20 add_watcher() i=7 2024-09-12T18:47:15.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.718+0000 7fb3239fb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:15.725 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.722+0000 7fb1d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:15.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.722+0000 7fb3239fb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:15.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.722+0000 7fb3239fb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:15.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.722+0000 7fb3239fb9c0 5 note: GC not initialized 2024-09-12T18:47:15.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.722+0000 7fb1d6fe5640 20 reqs_thread_entry: start 2024-09-12T18:47:15.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.722+0000 7fb3239fb9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:15.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.722+0000 7fb3239fb9c0 20 Filter name: none 2024-09-12T18:47:15.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.722+0000 7fb1d4fe1640 20 reqs_thread_entry: start 2024-09-12T18:47:15.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.722+0000 7fb3239fb9c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T18:47:15.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.722+0000 7fb3239fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.726+0000 7fb3239fb9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:15.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.726+0000 7fb3239fb9c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T18:47:15.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.726+0000 7fb3239fb9c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T18:47:15.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.726+0000 7fb3239fb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 : miss 2024-09-12T18:47:15.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.726+0000 7fb3239fb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.726+0000 7fb3239fb9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:15.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.726+0000 7fb3239fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 info.flags=0x17 2024-09-12T18:47:15.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.726+0000 7fb3239fb9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 to cache LRU end 2024-09-12T18:47:15.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.726+0000 7fb3239fb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:47:15.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.726+0000 7fb3239fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:15.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.726+0000 7fb3239fb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 2024-09-12T18:47:15.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.738+0000 7fb3239fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 info.flags=0x17 2024-09-12T18:47:15.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.738+0000 7fb3239fb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 to cache LRU end 2024-09-12T18:47:15.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.738+0000 7fb3239fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:15.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.738+0000 7fb3239fb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28, ofs0, ns] 2024-09-12T18:47:15.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.738+0000 7fb204ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 94021365069968 notifier 6656 bl.length()=915 2024-09-12T18:47:15.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.738+0000 7fb204ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 info.flags=0x17 2024-09-12T18:47:15.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.738+0000 7fb204ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 to cache LRU end 2024-09-12T18:47:15.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.738+0000 7fb204ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:15.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.742+0000 7fb3239fb9c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): orig_sources= new_sources= 2024-09-12T18:47:15.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.742+0000 7fb3239fb9c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): potential sources added=[] removed=[] 2024-09-12T18:47:15.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.742+0000 7fb3239fb9c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): orig_dests= new_dests= 2024-09-12T18:47:15.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.742+0000 7fb3239fb9c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): potential dests added=[] removed=[] 2024-09-12T18:47:15.754 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.0 2024-09-12T18:47:15.754 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.0 2024-09-12T18:47:15.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.1 2024-09-12T18:47:15.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.1 2024-09-12T18:47:15.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.2 2024-09-12T18:47:15.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.2 2024-09-12T18:47:15.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.3 2024-09-12T18:47:15.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.3 2024-09-12T18:47:15.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.4 2024-09-12T18:47:15.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.4 2024-09-12T18:47:15.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.5 2024-09-12T18:47:15.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.5 2024-09-12T18:47:15.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.6 2024-09-12T18:47:15.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.6 2024-09-12T18:47:15.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.7 2024-09-12T18:47:15.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.7 2024-09-12T18:47:15.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.8 2024-09-12T18:47:15.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.8 2024-09-12T18:47:15.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.9 2024-09-12T18:47:15.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.9 2024-09-12T18:47:15.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.10 2024-09-12T18:47:15.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.10 2024-09-12T18:47:15.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.11 2024-09-12T18:47:15.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1.11 2024-09-12T18:47:15.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.0 2024-09-12T18:47:15.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.750+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1 2024-09-12T18:47:15.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.754+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.2 2024-09-12T18:47:15.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.754+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.3 2024-09-12T18:47:15.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.754+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.4 2024-09-12T18:47:15.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.754+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.5 2024-09-12T18:47:15.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.754+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.6 2024-09-12T18:47:15.759 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.754+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.7 2024-09-12T18:47:15.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.758+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.8 2024-09-12T18:47:15.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.758+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.9 2024-09-12T18:47:15.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.758+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.10 2024-09-12T18:47:15.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.766+0000 7fb3239fb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:15.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.766+0000 7fb3239fb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 2024-09-12T18:47:15.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.770+0000 7fb3239fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 info.flags=0x17 2024-09-12T18:47:15.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.770+0000 7fb3239fb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 to cache LRU end 2024-09-12T18:47:15.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.770+0000 7fb3239fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:15.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.770+0000 7fb3239fb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28, ofs0, ns] 2024-09-12T18:47:15.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.770+0000 7fb204ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431622 cookie 94021365069968 notifier 6656 bl.length()=915 2024-09-12T18:47:15.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.770+0000 7fb204ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 info.flags=0x17 2024-09-12T18:47:15.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.770+0000 7fb204ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 to cache LRU end 2024-09-12T18:47:15.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.770+0000 7fb204ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:15.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.770+0000 7fb3239fb9c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): orig_sources= new_sources= 2024-09-12T18:47:15.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.770+0000 7fb3239fb9c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): potential sources added=[] removed=[] 2024-09-12T18:47:15.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.770+0000 7fb3239fb9c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): orig_dests= new_dests= 2024-09-12T18:47:15.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.770+0000 7fb3239fb9c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): potential dests added=[] removed=[] 2024-09-12T18:47:15.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.774+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.0 2024-09-12T18:47:15.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.778+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.1 2024-09-12T18:47:15.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.778+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.2 2024-09-12T18:47:15.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.778+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.3 2024-09-12T18:47:15.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.778+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.4 2024-09-12T18:47:15.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.778+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.5 2024-09-12T18:47:15.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.778+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.6 2024-09-12T18:47:15.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.778+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.7 2024-09-12T18:47:15.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.782+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.8 2024-09-12T18:47:15.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.782+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.9 2024-09-12T18:47:15.785 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.782+0000 7fb3239fb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.28.10 2024-09-12T18:47:15.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.782+0000 7fb3239fb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:15.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.782+0000 7fb3239fb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 2024-09-12T18:47:15.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.786+0000 7fb3239fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 info.flags=0x17 2024-09-12T18:47:15.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.786+0000 7fb3239fb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 to cache LRU end 2024-09-12T18:47:15.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.786+0000 7fb3239fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:15.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.786+0000 7fb3239fb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28, ofs0, ns] 2024-09-12T18:47:15.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.786+0000 7fb1f3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 94021365069968 notifier 6656 bl.length()=883 2024-09-12T18:47:15.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.786+0000 7fb1f3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 info.flags=0x17 2024-09-12T18:47:15.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.786+0000 7fb1f3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.28 to cache LRU end 2024-09-12T18:47:15.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.786+0000 7fb1f3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:15.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.786+0000 7fb3239fb9c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): orig_sources= new_sources= 2024-09-12T18:47:15.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.786+0000 7fb3239fb9c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): potential sources added=[] removed=[] 2024-09-12T18:47:15.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.786+0000 7fb3239fb9c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): orig_dests= new_dests= 2024-09-12T18:47:15.791 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.786+0000 7fb3239fb9c0 20 handle_bi_update(): bucket=:error-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.28]): potential dests added=[] removed=[] 2024-09-12T18:47:15.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.790+0000 7fb3239fb9c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T18:47:15.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.794+0000 7fb1d7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:15.804 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.802+0000 7fb3239fb9c0 20 remove_watcher() i=0 2024-09-12T18:47:15.804 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.802+0000 7fb3239fb9c0 2 removed watcher, disabling cache 2024-09-12T18:47:15.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.802+0000 7fb3239fb9c0 20 remove_watcher() i=1 2024-09-12T18:47:15.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.806+0000 7fb3239fb9c0 20 remove_watcher() i=2 2024-09-12T18:47:15.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.806+0000 7fb3239fb9c0 20 remove_watcher() i=3 2024-09-12T18:47:15.813 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.810+0000 7fb3239fb9c0 20 remove_watcher() i=4 2024-09-12T18:47:15.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.810+0000 7fb3239fb9c0 20 remove_watcher() i=5 2024-09-12T18:47:15.816 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.814+0000 7fb3239fb9c0 20 remove_watcher() i=6 2024-09-12T18:47:15.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.814+0000 7fb3239fb9c0 20 remove_watcher() i=7 2024-09-12T18:47:15.833 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T18:47:15.863 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:15.863 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:15.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.906+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.906+0000 7f342c7a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:15.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.906+0000 7f342c7a99c0 20 realm 2024-09-12T18:47:15.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.906+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.906+0000 7f342c7a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:15.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.906+0000 7f342c7a99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:15.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.906+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.906+0000 7f342c7a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:15.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.906+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.910+0000 7f342c7a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:15.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.910+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:15.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.910+0000 7f342c7a99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:15.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.910+0000 7f342c7a99c0 20 searching for the correct realm 2024-09-12T18:47:15.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.914+0000 7f342aab0640 0 -- 172.21.15.111:0/2374327986 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f34140ce020 msgr2=0x7f34140fce00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:15.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:15.922+0000 7f3423fff640 0 -- 172.21.15.111:0/2374327986 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f3424079620 msgr2=0x7f34240716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:47:16.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.138+0000 7f342c7a99c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:16.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.138+0000 7f342c7a99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:16.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.138+0000 7f342c7a99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:16.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.138+0000 7f342c7a99c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:16.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.138+0000 7f342c7a99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:16.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.138+0000 7f342c7a99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:16.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.138+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.138+0000 7f342c7a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:16.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.138+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.142+0000 7f342c7a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:16.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.142+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.142+0000 7f342c7a99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:16.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.142+0000 7f342c7a99c0 20 zone default found 2024-09-12T18:47:16.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.142+0000 7f342c7a99c0 4 Realm: () 2024-09-12T18:47:16.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.142+0000 7f342c7a99c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:16.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.142+0000 7f342c7a99c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:16.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.142+0000 7f342c7a99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:16.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.142+0000 7f342c7a99c0 20 zonegroup default 2024-09-12T18:47:16.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.142+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.142+0000 7f342c7a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:16.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.142+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.142+0000 7f342c7a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:16.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.142+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.146+0000 7f342c7a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:16.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.146+0000 7f342c7a99c0 20 started sync module instance, tier type = 2024-09-12T18:47:16.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.146+0000 7f342c7a99c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:16.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.170+0000 7f342c7a99c0 20 add_watcher() i=0 2024-09-12T18:47:16.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.170+0000 7f342c7a99c0 20 add_watcher() i=1 2024-09-12T18:47:16.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.170+0000 7f342c7a99c0 20 add_watcher() i=2 2024-09-12T18:47:16.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.170+0000 7f342c7a99c0 20 add_watcher() i=3 2024-09-12T18:47:16.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.170+0000 7f342c7a99c0 20 add_watcher() i=4 2024-09-12T18:47:16.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.170+0000 7f342c7a99c0 20 add_watcher() i=5 2024-09-12T18:47:16.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.170+0000 7f342c7a99c0 20 add_watcher() i=6 2024-09-12T18:47:16.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.170+0000 7f342c7a99c0 20 add_watcher() i=7 2024-09-12T18:47:16.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.170+0000 7f342c7a99c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:16.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.174+0000 7f32e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:16.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.174+0000 7f342c7a99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:16.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.174+0000 7f342c7a99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:16.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.174+0000 7f342c7a99c0 5 note: GC not initialized 2024-09-12T18:47:16.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.178+0000 7f325b7fe640 20 reqs_thread_entry: start 2024-09-12T18:47:16.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.178+0000 7f342c7a99c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:16.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.178+0000 7f342c7a99c0 20 Filter name: none 2024-09-12T18:47:16.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.178+0000 7f32597fa640 20 reqs_thread_entry: start 2024-09-12T18:47:16.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.178+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.178+0000 7f342c7a99c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:16.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.178+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.178+0000 7f342c7a99c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:16.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.178+0000 7f342c7a99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:16.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.182+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.182+0000 7f342c7a99c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:16.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.182+0000 7f342c7a99c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.182+0000 7f342c7a99c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:16.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.182+0000 7f342c7a99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:16.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.186+0000 7f32e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:16.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.190+0000 7f342c7a99c0 20 remove_watcher() i=0 2024-09-12T18:47:16.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.190+0000 7f342c7a99c0 2 removed watcher, disabling cache 2024-09-12T18:47:16.196 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.194+0000 7f342c7a99c0 20 remove_watcher() i=1 2024-09-12T18:47:16.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.194+0000 7f342c7a99c0 20 remove_watcher() i=2 2024-09-12T18:47:16.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.198+0000 7f342c7a99c0 20 remove_watcher() i=3 2024-09-12T18:47:16.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.198+0000 7f342c7a99c0 20 remove_watcher() i=4 2024-09-12T18:47:16.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.202+0000 7f342c7a99c0 20 remove_watcher() i=5 2024-09-12T18:47:16.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.202+0000 7f342c7a99c0 20 remove_watcher() i=6 2024-09-12T18:47:16.207 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.202+0000 7f342c7a99c0 20 remove_watcher() i=7 2024-09-12T18:47:16.222 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:16.222 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:47:16.222 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-block-writes id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:47:16.222 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:16.224 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.224 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.227 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.228 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.274 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.275 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.331 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T18:47:16.332 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:16.333 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.334 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.360 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.360 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.408 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.408 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.427 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.427 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.446 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.447 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.465 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.465 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.484 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.484 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.503 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.503 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.522 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.522 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.540 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.541 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.559 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.559 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.578 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.578 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.597 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.598 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.618 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.618 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.637 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.637 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.658 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.658 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.677 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.677 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.696 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.696 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.715 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.715 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.734 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.734 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.753 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.753 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.772 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:16.772 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:16.788 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T18:47:16.821 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:16.821 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:16.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.862+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.866+0000 7ff9a808c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:16.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.866+0000 7ff9a808c9c0 20 realm 2024-09-12T18:47:16.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.866+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.866+0000 7ff9a808c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:16.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.866+0000 7ff9a808c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:16.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.866+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.866+0000 7ff9a808c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:16.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.866+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.866+0000 7ff9a808c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:16.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.866+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:16.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.866+0000 7ff9a808c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:16.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.866+0000 7ff9a808c9c0 20 searching for the correct realm 2024-09-12T18:47:16.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.874+0000 7ff9a6393640 0 -- 172.21.15.111:0/351221239 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7ff99c0d1070 msgr2=0x7ff99c0ac980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:16.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:16.878+0000 7ff9a5391640 0 -- 172.21.15.111:0/351221239 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7ff9a0050420 msgr2=0x7ff9a00508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:17.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.094+0000 7ff9a808c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:17.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.094+0000 7ff9a808c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:17.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.094+0000 7ff9a808c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:17.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.094+0000 7ff9a808c9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:17.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.094+0000 7ff9a808c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:17.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.094+0000 7ff9a808c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:17.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.094+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.094+0000 7ff9a808c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:17.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.094+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:17.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:17.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 20 zone default found 2024-09-12T18:47:17.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 4 Realm: () 2024-09-12T18:47:17.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:17.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:17.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:17.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 20 zonegroup default 2024-09-12T18:47:17.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:17.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:17.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:17.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 20 started sync module instance, tier type = 2024-09-12T18:47:17.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.098+0000 7ff9a808c9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:17.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.122+0000 7ff9a808c9c0 20 add_watcher() i=0 2024-09-12T18:47:17.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.122+0000 7ff9a808c9c0 20 add_watcher() i=1 2024-09-12T18:47:17.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.122+0000 7ff9a808c9c0 20 add_watcher() i=2 2024-09-12T18:47:17.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.122+0000 7ff9a808c9c0 20 add_watcher() i=3 2024-09-12T18:47:17.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.122+0000 7ff9a808c9c0 20 add_watcher() i=4 2024-09-12T18:47:17.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.122+0000 7ff9a808c9c0 20 add_watcher() i=5 2024-09-12T18:47:17.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.122+0000 7ff9a808c9c0 20 add_watcher() i=6 2024-09-12T18:47:17.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.122+0000 7ff9a808c9c0 20 add_watcher() i=7 2024-09-12T18:47:17.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.122+0000 7ff9a808c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:17.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.126+0000 7ff8577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:17.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.126+0000 7ff9a808c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:17.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.126+0000 7ff9a808c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:17.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.126+0000 7ff9a808c9c0 5 note: GC not initialized 2024-09-12T18:47:17.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.126+0000 7ff8567fc640 20 reqs_thread_entry: start 2024-09-12T18:47:17.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.126+0000 7ff9a808c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:17.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.126+0000 7ff9a808c9c0 20 Filter name: none 2024-09-12T18:47:17.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.126+0000 7ff7c7fff640 20 reqs_thread_entry: start 2024-09-12T18:47:17.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.126+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.126+0000 7ff9a808c9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:17.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.126+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.130+0000 7ff9a808c9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:17.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.130+0000 7ff9a808c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:17.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.130+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.130+0000 7ff9a808c9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:17.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.130+0000 7ff9a808c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.130+0000 7ff9a808c9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:17.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.130+0000 7ff9a808c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:17.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.134+0000 7ff8577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:17.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.138+0000 7ff9a808c9c0 20 remove_watcher() i=0 2024-09-12T18:47:17.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.138+0000 7ff9a808c9c0 2 removed watcher, disabling cache 2024-09-12T18:47:17.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.138+0000 7ff9a808c9c0 20 remove_watcher() i=1 2024-09-12T18:47:17.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.142+0000 7ff9a808c9c0 20 remove_watcher() i=2 2024-09-12T18:47:17.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.142+0000 7ff9a808c9c0 20 remove_watcher() i=3 2024-09-12T18:47:17.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.146+0000 7ff9a808c9c0 20 remove_watcher() i=4 2024-09-12T18:47:17.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.146+0000 7ff9a808c9c0 20 remove_watcher() i=5 2024-09-12T18:47:17.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.150+0000 7ff9a808c9c0 20 remove_watcher() i=6 2024-09-12T18:47:17.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.150+0000 7ff9a808c9c0 20 remove_watcher() i=7 2024-09-12T18:47:17.168 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:17.169 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:47:17.169 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-block-writes id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:47:17.169 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:17.169 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T18:47:17.202 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:17.202 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:17.247 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.242+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:17.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 realm 2024-09-12T18:47:17.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:17.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.246+0000 7fc0fb4799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:17.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:17.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:17.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:17.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 searching for the correct realm 2024-09-12T18:47:17.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.250+0000 7fc0f9780640 0 -- 172.21.15.111:0/3259162773 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fc0ec090040 msgr2=0x7fc0ec01a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:17.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.870+0000 7fc0f877e640 0 -- 172.21.15.111:0/3259162773 >> [v2:172.21.15.153:6824/2813139034,v1:172.21.15.153:6825/2813139034] conn(0x55ac87033640 msgr2=0x55ac87035a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:17.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:17.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:17.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:17.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:17.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:17.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:17.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:17.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:17.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:17.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 zone default found 2024-09-12T18:47:17.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 4 Realm: () 2024-09-12T18:47:17.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:17.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:17.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:17.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 zonegroup default 2024-09-12T18:47:17.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:17.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:17.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:17.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 started sync module instance, tier type = 2024-09-12T18:47:17.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:17.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=0 2024-09-12T18:47:17.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=1 2024-09-12T18:47:17.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=2 2024-09-12T18:47:17.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=3 2024-09-12T18:47:17.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=4 2024-09-12T18:47:17.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=5 2024-09-12T18:47:17.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.914+0000 7fc0fb4799c0 20 add_watcher() i=6 2024-09-12T18:47:17.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.914+0000 7fc0fb4799c0 20 add_watcher() i=7 2024-09-12T18:47:17.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.914+0000 7fc0fb4799c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:17.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fbfaf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:17.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:17.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:17.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 note: GC not initialized 2024-09-12T18:47:17.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fbfae7e4640 20 reqs_thread_entry: start 2024-09-12T18:47:17.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:17.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 Filter name: none 2024-09-12T18:47:17.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fbfa77fe640 20 reqs_thread_entry: start 2024-09-12T18:47:17.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fc0fb4799c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:47:17.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:17.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fc0fb4799c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:47:17.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fc0fb4799c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:47:17.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fc0fb4799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 : miss 2024-09-12T18:47:17.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:17.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.922+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:17.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:17.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:17.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:47:17.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:17.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 2024-09-12T18:47:17.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.930+0000 7fc0fb4799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:17.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.930+0000 7fc0fb4799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:17.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.930+0000 7fc0fb4799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:17.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.930+0000 7fc0fb4799c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29, ofs0, ns] 2024-09-12T18:47:17.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.930+0000 7fbfcf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431588 cookie 94199487876256 notifier 6707 bl.length()=915 2024-09-12T18:47:17.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.930+0000 7fbfcf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:17.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.930+0000 7fbfcf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:17.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.930+0000 7fbfcf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:17.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.934+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_sources= new_sources= 2024-09-12T18:47:17.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.934+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential sources added=[] removed=[] 2024-09-12T18:47:17.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.934+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_dests= new_dests= 2024-09-12T18:47:17.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.934+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential dests added=[] removed=[] 2024-09-12T18:47:17.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.0 2024-09-12T18:47:17.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.0 2024-09-12T18:47:17.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.1 2024-09-12T18:47:17.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.1 2024-09-12T18:47:17.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.2 2024-09-12T18:47:17.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.2 2024-09-12T18:47:17.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.3 2024-09-12T18:47:17.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.3 2024-09-12T18:47:17.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.4 2024-09-12T18:47:17.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.4 2024-09-12T18:47:17.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.5 2024-09-12T18:47:17.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.5 2024-09-12T18:47:17.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.6 2024-09-12T18:47:17.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.6 2024-09-12T18:47:17.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.7 2024-09-12T18:47:17.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.7 2024-09-12T18:47:17.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.8 2024-09-12T18:47:17.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.8 2024-09-12T18:47:17.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.9 2024-09-12T18:47:17.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.9 2024-09-12T18:47:17.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.10 2024-09-12T18:47:17.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.10 2024-09-12T18:47:17.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.11 2024-09-12T18:47:17.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.11 2024-09-12T18:47:17.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.0 2024-09-12T18:47:17.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.946+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1 2024-09-12T18:47:17.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.946+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2 2024-09-12T18:47:17.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.946+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.3 2024-09-12T18:47:17.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.946+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.4 2024-09-12T18:47:17.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.950+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.5 2024-09-12T18:47:17.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.950+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.6 2024-09-12T18:47:17.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.950+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.7 2024-09-12T18:47:17.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.950+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.8 2024-09-12T18:47:17.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.954+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.9 2024-09-12T18:47:17.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.954+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.10 2024-09-12T18:47:17.965 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:17.965 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 2024-09-12T18:47:17.967 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:17.967 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:17.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:17.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29, ofs0, ns] 2024-09-12T18:47:17.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.966+0000 7fbfcf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94199487876256 notifier 6707 bl.length()=915 2024-09-12T18:47:17.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.966+0000 7fbfcf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:17.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.966+0000 7fbfcf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:17.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.966+0000 7fbfcf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:17.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.966+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_sources= new_sources= 2024-09-12T18:47:17.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.966+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential sources added=[] removed=[] 2024-09-12T18:47:17.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.966+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_dests= new_dests= 2024-09-12T18:47:17.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.966+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential dests added=[] removed=[] 2024-09-12T18:47:17.969 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc0fb4799c0 time 2024-09-12T18:47:17.969754+0000 2024-09-12T18:47:17.969 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:47:17.970 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:17.970 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc0fed532eb] 2024-09-12T18:47:17.970 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc0fed5349f] 2024-09-12T18:47:17.970 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ac845decc1] 2024-09-12T18:47:17.970 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55ac845f3086] 2024-09-12T18:47:17.970 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ac845f46a4] 2024-09-12T18:47:17.970 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:47:17.970 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc0fdbb9d90] 2024-09-12T18:47:17.970 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:47:17.970 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:47:17.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.966+0000 7fc0fb4799c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc0fb4799c0 time 2024-09-12T18:47:17.969754+0000 2024-09-12T18:47:17.970 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:47:17.971 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:17.971 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:17.971 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc0fed532eb] 2024-09-12T18:47:17.971 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc0fed5349f] 2024-09-12T18:47:17.971 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ac845decc1] 2024-09-12T18:47:17.971 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55ac845f3086] 2024-09-12T18:47:17.971 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ac845f46a4] 2024-09-12T18:47:17.971 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:47:17.971 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc0fdbb9d90] 2024-09-12T18:47:17.971 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:47:17.971 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:47:17.971 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:17.971 INFO:tasks.workunit.client.0.smithi111.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:47:17.972 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7fc0fb4799c0 thread_name:radosgw-admin 2024-09-12T18:47:17.989 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:17.990 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc0fdbd2520] 2024-09-12T18:47:17.990 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:47:17.990 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:47:17.990 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:47:17.990 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc0fed53345] 2024-09-12T18:47:17.990 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc0fed5349f] 2024-09-12T18:47:17.990 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ac845decc1] 2024-09-12T18:47:17.990 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55ac845f3086] 2024-09-12T18:47:17.990 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ac845f46a4] 2024-09-12T18:47:17.990 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:47:17.990 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc0fdbb9d90] 2024-09-12T18:47:17.990 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:47:17.991 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:47:17.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:17.966+0000 7fc0fb4799c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:47:17.991 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7fc0fb4799c0 thread_name:radosgw-admin 2024-09-12T18:47:17.991 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:17.991 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:17.991 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc0fdbd2520] 2024-09-12T18:47:17.991 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:47:17.991 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:47:17.991 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:47:17.991 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc0fed53345] 2024-09-12T18:47:17.991 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc0fed5349f] 2024-09-12T18:47:17.991 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ac845decc1] 2024-09-12T18:47:17.991 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55ac845f3086] 2024-09-12T18:47:17.992 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ac845f46a4] 2024-09-12T18:47:17.992 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:47:17.992 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc0fdbb9d90] 2024-09-12T18:47:17.992 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:47:17.992 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:47:17.992 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:47:17.992 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:17.992 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:47:17.992 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: crc 2024-09-12T18:47:17.992 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: secure 2024-09-12T18:47:17.992 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: crc 2024-09-12T18:47:17.992 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: secure 2024-09-12T18:47:17.992 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: crc 2024-09-12T18:47:17.993 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: crc 2024-09-12T18:47:17.993 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: secure 2024-09-12T18:47:17.993 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: crc 2024-09-12T18:47:17.993 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: secure 2024-09-12T18:47:17.993 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: crc 2024-09-12T18:47:17.993 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: secure 2024-09-12T18:47:17.993 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:17.993 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:17.993 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command rotate-key hook 0x55ac86f432e8 2024-09-12T18:47:17.993 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:17.993 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:47:17.993 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-a con 0x55ac86dfe430 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:17.993 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-c con 0x55ac86e01b90 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:17.994 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-b con 0x55ac86e88940 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:17.994 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:17.994 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:17.994 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:17.994 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:17.994 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): authenticate will time out at 2224.366703s 2024-09-12T18:47:17.994 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:47:17.222+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request con 0x55ac86dfe430 auth_method 0 2024-09-12T18:47:17.994 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:47:17.222+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:17.994 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:47:17.222+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:17.994 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:47:17.222+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:17.994 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): get_auth_request con 0x55ac86e01b90 auth_method 0 2024-09-12T18:47:17.994 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:17.994 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:17.995 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:17.995 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:17.995 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:17.995 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:17.995 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:47:17.222+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:17.995 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:47:17.222+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:17.995 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:47:17.222+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:17.995 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): handle_auth_done global_id 6698 payload 824 2024-09-12T18:47:17.995 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient: _finish_hunting 0 2024-09-12T18:47:17.995 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:47:17.222+0000 7fc0f877e640 1 monclient: found mon.noname-c 2024-09-12T18:47:17.995 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:47:17.995 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:17.995 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:47:17.996 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: dump: 2024-09-12T18:47:17.996 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:17.996 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:17.996 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:17.996 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:17.996 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:17.996 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:17.996 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:17.996 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:17.996 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:17.996 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:17.996 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: _finish_auth 0 2024-09-12T18:47:17.996 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: _check_auth_tickets 2024-09-12T18:47:17.997 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:17.997 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:17.997 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:47:17.997 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: dump: 2024-09-12T18:47:17.997 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:17.997 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:17.997 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:17.997 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:17.997 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:17.997 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:17.997 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:17.997 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:17.997 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:17.998 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:17.998 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:47:17.222+0000 7fbfe6e0d640 4 set_mon_vals no callback set 2024-09-12T18:47:17.998 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:47:17.226+0000 7fc0fb4799c0 5 monclient: authenticate success, global_id 6698 2024-09-12T18:47:17.998 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:47:17.226+0000 7fc0fb4799c0 10 monclient: _renew_subs 2024-09-12T18:47:17.998 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:47:17.226+0000 7fc0fb4799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:47:17.998 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:47:17.226+0000 7fc0fb4799c0 10 monclient: _renew_subs 2024-09-12T18:47:17.998 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:47:17.226+0000 7fc0fb4799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:47:17.998 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:47:17.226+0000 7fc0fb4799c0 1 librados: init done 2024-09-12T18:47:17.998 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:47:17.226+0000 7fbfe560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:47:17.998 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:47:17.226+0000 7fbfe560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:17.998 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:47:17.226+0000 7fbfe560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:17.998 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:47:17.226+0000 7fc0f8f7f640 10 monclient: get_auth_request con 0x7fbfe0070ae0 auth_method 0 2024-09-12T18:47:17.999 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:47:17.226+0000 7fc0f9780640 10 monclient: get_auth_request con 0x55ac86f6b610 auth_method 0 2024-09-12T18:47:17.999 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:47:17.226+0000 7fc0f8f7f640 10 monclient: get_auth_request con 0x55ac86f8df80 auth_method 0 2024-09-12T18:47:17.999 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:47:17.230+0000 7fc0f877e640 10 monclient: get_auth_request con 0x55ac86f92170 auth_method 0 2024-09-12T18:47:17.999 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:47:17.230+0000 7fc0f9780640 10 monclient: get_auth_request con 0x55ac86f96390 auth_method 0 2024-09-12T18:47:17.999 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: build_initial_monmap 2024-09-12T18:47:17.999 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 1 build_initial for_mkfs: 0 2024-09-12T18:47:17.999 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: monmap: 2024-09-12T18:47:17.999 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:47:17.999 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:47:17.999 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:47:17.999 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:47:17.999 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:47:17.999 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.000 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:47:18.000 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:47:18.000 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:47:18.000 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.000 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding auth protocol: cephx 2024-09-12T18:47:18.000 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding auth protocol: cephx 2024-09-12T18:47:18.000 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding auth protocol: cephx 2024-09-12T18:47:18.000 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: secure 2024-09-12T18:47:18.000 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: crc 2024-09-12T18:47:18.000 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: secure 2024-09-12T18:47:18.000 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: crc 2024-09-12T18:47:18.000 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: secure 2024-09-12T18:47:18.000 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: crc 2024-09-12T18:47:18.001 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: crc 2024-09-12T18:47:18.001 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: secure 2024-09-12T18:47:18.001 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: crc 2024-09-12T18:47:18.001 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: secure 2024-09-12T18:47:18.001 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: crc 2024-09-12T18:47:18.001 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: secure 2024-09-12T18:47:18.001 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.001 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ac86f9db10 EEXIST 2024-09-12T18:47:18.001 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: init 2024-09-12T18:47:18.001 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding auth protocol: cephx 2024-09-12T18:47:18.001 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding auth protocol: cephx 2024-09-12T18:47:18.001 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding auth protocol: cephx 2024-09-12T18:47:18.001 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: secure 2024-09-12T18:47:18.002 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: crc 2024-09-12T18:47:18.002 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: secure 2024-09-12T18:47:18.002 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: crc 2024-09-12T18:47:18.002 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: secure 2024-09-12T18:47:18.002 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: crc 2024-09-12T18:47:18.002 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: crc 2024-09-12T18:47:18.002 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: secure 2024-09-12T18:47:18.002 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: crc 2024-09-12T18:47:18.002 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: secure 2024-09-12T18:47:18.002 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: crc 2024-09-12T18:47:18.002 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: secure 2024-09-12T18:47:18.002 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.002 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.003 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command rotate-key cmddesc rotate-key hook 0x55ac86f99220 EEXIST 2024-09-12T18:47:18.003 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:18.003 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:47:18.003 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-b con 0x55ac86fc1cc0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:18.003 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-a con 0x55ac86fc15f0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:18.003 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-c con 0x55ac86fbffd0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:18.003 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.003 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.003 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.003 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:18.003 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): authenticate will time out at 2224.378174s 2024-09-12T18:47:18.003 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request con 0x55ac86fbffd0 auth_method 0 2024-09-12T18:47:18.003 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.004 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.004 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.004 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:47:17.234+0000 7fc0f9780640 10 monclient(hunting): get_auth_request con 0x55ac86fc15f0 auth_method 0 2024-09-12T18:47:18.004 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:47:17.234+0000 7fc0f9780640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.004 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:47:17.234+0000 7fc0f9780640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.004 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:47:17.234+0000 7fc0f9780640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.004 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:18.004 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:18.004 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:18.004 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:47:17.234+0000 7fc0f9780640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:18.004 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:47:17.234+0000 7fc0f9780640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:18.004 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:47:17.234+0000 7fc0f9780640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:18.004 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:47:17.234+0000 7fc0f877e640 10 monclient(hunting): get_auth_request con 0x55ac86fc1cc0 auth_method 0 2024-09-12T18:47:18.005 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:47:17.234+0000 7fc0f877e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.005 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:47:17.234+0000 7fc0f877e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.005 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:47:17.234+0000 7fc0f877e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.005 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_done global_id 6701 payload 824 2024-09-12T18:47:18.005 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient: _finish_hunting 0 2024-09-12T18:47:18.005 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 1 monclient: found mon.noname-c 2024-09-12T18:47:18.005 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.005 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:18.005 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:47:18.005 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: dump: 2024-09-12T18:47:18.005 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:18.005 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:18.005 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.006 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.006 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:18.006 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.006 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:18.006 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:18.006 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:18.006 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.006 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: _finish_auth 0 2024-09-12T18:47:18.006 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:47:18.006 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:18.006 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:18.006 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:47:18.006 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: dump: 2024-09-12T18:47:18.006 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:18.007 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:18.007 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.007 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.007 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:18.007 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.007 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:18.007 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:18.007 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:18.007 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.007 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 monclient: authenticate success, global_id 6701 2024-09-12T18:47:18.007 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:47:17.234+0000 7fc0f9f81640 4 set_mon_vals no callback set 2024-09-12T18:47:18.007 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: _renew_subs 2024-09-12T18:47:18.007 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.007 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: _renew_subs 2024-09-12T18:47:18.008 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.008 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:47:17.238+0000 7fbfde7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:47:18.008 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:47:17.238+0000 7fbfde7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:18.008 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:47:17.238+0000 7fbfde7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:18.008 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:47:17.238+0000 7fc0f877e640 10 monclient: get_auth_request con 0x7fbfd0070a20 auth_method 0 2024-09-12T18:47:18.008 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: get_monmap_and_config 2024-09-12T18:47:18.008 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: build_initial_monmap 2024-09-12T18:47:18.008 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 1 build_initial for_mkfs: 0 2024-09-12T18:47:18.008 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: monmap: 2024-09-12T18:47:18.008 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:47:18.008 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:47:18.008 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:47:18.008 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:47:18.008 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:47:18.009 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.009 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:47:18.009 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:47:18.009 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:47:18.009 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.009 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding auth protocol: cephx 2024-09-12T18:47:18.009 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding auth protocol: cephx 2024-09-12T18:47:18.009 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding auth protocol: cephx 2024-09-12T18:47:18.009 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: secure 2024-09-12T18:47:18.009 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: crc 2024-09-12T18:47:18.009 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: secure 2024-09-12T18:47:18.009 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: crc 2024-09-12T18:47:18.009 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: secure 2024-09-12T18:47:18.010 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: crc 2024-09-12T18:47:18.010 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: crc 2024-09-12T18:47:18.010 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: secure 2024-09-12T18:47:18.010 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: crc 2024-09-12T18:47:18.010 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: secure 2024-09-12T18:47:18.010 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: crc 2024-09-12T18:47:18.010 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: secure 2024-09-12T18:47:18.010 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.010 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: init 2024-09-12T18:47:18.010 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding auth protocol: cephx 2024-09-12T18:47:18.010 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding auth protocol: cephx 2024-09-12T18:47:18.010 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding auth protocol: cephx 2024-09-12T18:47:18.010 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: secure 2024-09-12T18:47:18.011 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: crc 2024-09-12T18:47:18.011 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: secure 2024-09-12T18:47:18.011 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: crc 2024-09-12T18:47:18.011 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: secure 2024-09-12T18:47:18.011 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: crc 2024-09-12T18:47:18.011 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: crc 2024-09-12T18:47:18.011 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: secure 2024-09-12T18:47:18.011 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: crc 2024-09-12T18:47:18.011 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: secure 2024-09-12T18:47:18.011 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: crc 2024-09-12T18:47:18.011 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: secure 2024-09-12T18:47:18.011 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.011 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.012 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc0551b5c8 EEXIST 2024-09-12T18:47:18.012 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:18.012 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:47:18.012 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-b con 0x55ac87015a40 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:18.012 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-c con 0x55ac87010e30 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:18.012 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-a con 0x55ac870117b0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:18.012 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.012 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.012 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.012 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:18.012 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): authenticate will time out at 2224.382308s 2024-09-12T18:47:18.012 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): get_auth_request con 0x55ac87010e30 auth_method 0 2024-09-12T18:47:18.012 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.013 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.013 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.013 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:47:17.238+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request con 0x55ac870117b0 auth_method 0 2024-09-12T18:47:18.013 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:47:17.238+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.013 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:47:17.238+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.013 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:47:17.238+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.013 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:18.013 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:18.013 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:18.013 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:47:17.238+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:18.013 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:47:17.238+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:18.013 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:47:17.238+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:18.013 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): handle_auth_done global_id 6704 payload 274 2024-09-12T18:47:18.013 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient: _finish_hunting 0 2024-09-12T18:47:18.014 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:47:17.238+0000 7fc0f9780640 1 monclient: found mon.noname-c 2024-09-12T18:47:18.014 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.014 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:18.014 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:47:18.014 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: dump: 2024-09-12T18:47:18.014 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:18.014 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:18.014 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.014 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.014 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:18.014 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.014 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:18.014 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:18.015 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:18.015 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.015 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: _finish_auth 0 2024-09-12T18:47:18.015 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: _check_auth_tickets 2024-09-12T18:47:18.015 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:18.015 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 monclient: authenticate success, global_id 6704 2024-09-12T18:47:18.015 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: get_monmap_and_config success 2024-09-12T18:47:18.015 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 4 set_mon_vals no callback set 2024-09-12T18:47:18.015 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:18.015 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:47:18.015 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: dump: 2024-09-12T18:47:18.015 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:18.015 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:18.015 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.016 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.016 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:18.016 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.016 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:18.016 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:18.016 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:18.016 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.016 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: shutdown 2024-09-12T18:47:18.016 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: build_initial_monmap 2024-09-12T18:47:18.016 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 1 build_initial for_mkfs: 0 2024-09-12T18:47:18.016 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: monmap: 2024-09-12T18:47:18.016 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:47:18.016 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:47:18.017 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:47:18.017 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:47:18.017 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:47:18.017 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.017 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:47:18.017 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:47:18.017 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:47:18.017 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.017 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding auth protocol: cephx 2024-09-12T18:47:18.017 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding auth protocol: cephx 2024-09-12T18:47:18.017 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding auth protocol: cephx 2024-09-12T18:47:18.017 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: secure 2024-09-12T18:47:18.017 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: crc 2024-09-12T18:47:18.018 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: secure 2024-09-12T18:47:18.018 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: crc 2024-09-12T18:47:18.018 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: secure 2024-09-12T18:47:18.018 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: crc 2024-09-12T18:47:18.018 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: crc 2024-09-12T18:47:18.018 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: secure 2024-09-12T18:47:18.018 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: crc 2024-09-12T18:47:18.018 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: secure 2024-09-12T18:47:18.018 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: crc 2024-09-12T18:47:18.018 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: secure 2024-09-12T18:47:18.018 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.018 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 1 librados: starting msgr at 2024-09-12T18:47:18.019 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 1 librados: starting objecter 2024-09-12T18:47:18.019 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ac86fe7a10 EEXIST 2024-09-12T18:47:18.019 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 1 librados: setting wanted keys 2024-09-12T18:47:18.019 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 1 librados: calling monclient init 2024-09-12T18:47:18.019 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient: init 2024-09-12T18:47:18.019 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding auth protocol: cephx 2024-09-12T18:47:18.019 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding auth protocol: cephx 2024-09-12T18:47:18.019 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding auth protocol: cephx 2024-09-12T18:47:18.019 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: secure 2024-09-12T18:47:18.019 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: crc 2024-09-12T18:47:18.019 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: secure 2024-09-12T18:47:18.019 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: crc 2024-09-12T18:47:18.019 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: secure 2024-09-12T18:47:18.020 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: crc 2024-09-12T18:47:18.020 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: crc 2024-09-12T18:47:18.020 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: secure 2024-09-12T18:47:18.020 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: crc 2024-09-12T18:47:18.020 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: secure 2024-09-12T18:47:18.020 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: crc 2024-09-12T18:47:18.020 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: secure 2024-09-12T18:47:18.020 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.020 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.020 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command rotate-key cmddesc rotate-key hook 0x55ac86fc3c28 EEXIST 2024-09-12T18:47:18.020 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:18.020 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:47:18.020 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-c con 0x55ac87010e30 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:18.021 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-b con 0x55ac870117b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:18.021 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-a con 0x55ac87015a40 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:18.021 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.021 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.021 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.021 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:18.021 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): authenticate will time out at 2224.384937s 2024-09-12T18:47:18.021 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): get_auth_request con 0x55ac87010e30 auth_method 0 2024-09-12T18:47:18.021 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.021 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.021 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.021 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:47:17.242+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request con 0x55ac87015a40 auth_method 0 2024-09-12T18:47:18.021 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:47:17.242+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.022 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:47:17.242+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.022 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:47:17.242+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.022 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:18.022 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:18.022 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:18.022 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:47:17.242+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:18.022 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:47:17.242+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:18.022 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:47:17.242+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:18.022 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): handle_auth_done global_id 6707 payload 824 2024-09-12T18:47:18.022 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient: _finish_hunting 0 2024-09-12T18:47:18.022 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:47:17.242+0000 7fc0f877e640 1 monclient: found mon.noname-c 2024-09-12T18:47:18.022 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.022 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:18.023 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:47:18.023 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: dump: 2024-09-12T18:47:18.023 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:18.023 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:18.023 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.023 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.023 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:18.023 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.023 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:18.023 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:18.023 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:18.023 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.023 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: _finish_auth 0 2024-09-12T18:47:18.024 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:47:18.024 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:18.024 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:18.024 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:47:18.024 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: dump: 2024-09-12T18:47:18.024 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:18.024 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:18.024 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.024 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.024 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:18.024 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.024 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:18.024 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:18.025 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:18.025 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.025 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:47:17.242+0000 7fbfcffff640 4 set_mon_vals no callback set 2024-09-12T18:47:18.025 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 monclient: authenticate success, global_id 6707 2024-09-12T18:47:18.025 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient: _renew_subs 2024-09-12T18:47:18.025 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.025 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient: _renew_subs 2024-09-12T18:47:18.025 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.025 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 1 librados: init done 2024-09-12T18:47:18.025 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command cr dump hook 0x55ac87007c78 2024-09-12T18:47:18.025 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.025 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:47:18.025 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:18.026 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:18.026 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:47:17.242+0000 7fc0f9780640 10 monclient: get_auth_request con 0x7fbfc4070ae0 auth_method 0 2024-09-12T18:47:18.026 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:47:17.246+0000 7fc0f8f7f640 10 monclient: get_auth_request con 0x55ac8702f3b0 auth_method 0 2024-09-12T18:47:18.026 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.026 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 realm 2024-09-12T18:47:18.026 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.026 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.026 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:18.026 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.026 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.026 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.026 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:47:17.246+0000 7fc0f877e640 10 monclient: get_auth_request con 0x55ac87033640 auth_method 0 2024-09-12T18:47:18.026 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:18.027 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.027 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:47:17.246+0000 7fc0f9780640 10 monclient: get_auth_request con 0x55ac87036ec0 auth_method 0 2024-09-12T18:47:18.027 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:18.027 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 searching for the correct realm 2024-09-12T18:47:18.027 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:47:17.250+0000 7fc0f8f7f640 10 monclient: get_auth_request con 0x7fc0f003ab60 auth_method 0 2024-09-12T18:47:18.027 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:47:17.250+0000 7fc0f877e640 10 monclient: get_auth_request con 0x7fc0e80fee90 auth_method 0 2024-09-12T18:47:18.027 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:47:17.250+0000 7fc0f9780640 10 monclient: get_auth_request con 0x7fc0ec090040 auth_method 0 2024-09-12T18:47:18.027 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:47:17.250+0000 7fc0f9780640 0 -- 172.21.15.111:0/3259162773 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fc0ec090040 msgr2=0x7fc0ec01a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:18.027 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:47:17.454+0000 7fc0f9780640 10 monclient: get_auth_request con 0x7fc0ec090040 auth_method 0 2024-09-12T18:47:18.027 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:47:17.858+0000 7fc0f9780640 10 monclient: get_auth_request con 0x7fc0ec090040 auth_method 0 2024-09-12T18:47:18.027 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:47:17.862+0000 7fc0f8f7f640 10 monclient: get_auth_request con 0x7fc0f004a040 auth_method 0 2024-09-12T18:47:18.027 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:47:17.870+0000 7fc0f877e640 0 -- 172.21.15.111:0/3259162773 >> [v2:172.21.15.153:6824/2813139034,v1:172.21.15.153:6825/2813139034] conn(0x55ac87033640 msgr2=0x55ac87035a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:18.027 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:47:17.870+0000 7fbfce7fc640 1 client.6707.objecter ms_handle_reset 0x55ac87033640 session 0x55ac87032fc0 osd.5 2024-09-12T18:47:18.028 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:47:17.870+0000 7fbfce7fc640 10 monclient: _renew_subs 2024-09-12T18:47:18.028 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:47:17.870+0000 7fbfce7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.028 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:47:17.870+0000 7fc0f877e640 10 monclient: get_auth_request con 0x7fbfc4080a80 auth_method 0 2024-09-12T18:47:18.028 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:47:17.870+0000 7fc0f877e640 10 monclient: get_auth_request con 0x7fc0f0032c10 auth_method 0 2024-09-12T18:47:18.028 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:18.028 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:18.028 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:18.028 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:18.028 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:18.028 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:18.028 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.028 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.028 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.028 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:18.029 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.029 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:18.029 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 zone default found 2024-09-12T18:47:18.029 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 4 Realm: () 2024-09-12T18:47:18.029 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:18.029 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:18.029 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:18.029 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 zonegroup default 2024-09-12T18:47:18.029 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.029 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.029 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.029 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.029 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.030 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.030 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 started sync module instance, tier type = 2024-09-12T18:47:18.030 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:18.030 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=0 2024-09-12T18:47:18.030 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=1 2024-09-12T18:47:18.030 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=2 2024-09-12T18:47:18.030 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=3 2024-09-12T18:47:18.030 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=4 2024-09-12T18:47:18.030 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=5 2024-09-12T18:47:18.030 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:47:17.914+0000 7fc0fb4799c0 20 add_watcher() i=6 2024-09-12T18:47:18.030 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:47:17.914+0000 7fc0fb4799c0 20 add_watcher() i=7 2024-09-12T18:47:18.030 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:47:17.914+0000 7fc0fb4799c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:18.030 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding auth protocol: cephx 2024-09-12T18:47:18.030 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding auth protocol: cephx 2024-09-12T18:47:18.031 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding auth protocol: cephx 2024-09-12T18:47:18.031 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: secure 2024-09-12T18:47:18.031 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: crc 2024-09-12T18:47:18.031 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: secure 2024-09-12T18:47:18.031 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:47:17.918+0000 7fbfaf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:18.031 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: crc 2024-09-12T18:47:18.031 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: secure 2024-09-12T18:47:18.031 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: crc 2024-09-12T18:47:18.031 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: crc 2024-09-12T18:47:18.031 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: secure 2024-09-12T18:47:18.031 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: crc 2024-09-12T18:47:18.031 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: secure 2024-09-12T18:47:18.031 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: crc 2024-09-12T18:47:18.032 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: secure 2024-09-12T18:47:18.032 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.032 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:18.032 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:18.032 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command cache list hook 0x55ac87005580 2024-09-12T18:47:18.032 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command cache inspect hook 0x55ac87005580 2024-09-12T18:47:18.032 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command cache erase hook 0x55ac87005580 2024-09-12T18:47:18.032 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command cache zap hook 0x55ac87005580 2024-09-12T18:47:18.032 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 note: GC not initialized 2024-09-12T18:47:18.032 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:47:17.918+0000 7fbfae7e4640 20 reqs_thread_entry: start 2024-09-12T18:47:18.032 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command sync trace show hook 0x7fc0f0004e10 2024-09-12T18:47:18.032 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command sync trace history hook 0x7fc0f0004e10 2024-09-12T18:47:18.032 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command sync trace active hook 0x7fc0f0004e10 2024-09-12T18:47:18.033 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command sync trace active_short hook 0x7fc0f0004e10 2024-09-12T18:47:18.033 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:18.033 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 Filter name: none 2024-09-12T18:47:18.033 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:47:17.918+0000 7fbfa77fe640 20 reqs_thread_entry: start 2024-09-12T18:47:18.033 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:47:18.033 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.033 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:18.033 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:47:18.033 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:47:18.033 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 : miss 2024-09-12T18:47:18.033 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.033 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:47:17.922+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:18.033 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:18.033 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:18.034 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:47:18.034 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:18.034 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 2024-09-12T18:47:18.034 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:47:17.930+0000 7fc0fb4799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:18.034 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:47:17.930+0000 7fc0fb4799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:18.034 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:47:17.930+0000 7fc0fb4799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:18.034 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:47:17.930+0000 7fc0fb4799c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29, ofs0, ns] 2024-09-12T18:47:18.034 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:47:17.930+0000 7fbfcf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431588 cookie 94199487876256 notifier 6707 bl.length()=915 2024-09-12T18:47:18.034 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:47:17.930+0000 7fbfcf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:18.034 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:47:17.930+0000 7fbfcf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:18.034 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:47:17.930+0000 7fbfcf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:18.034 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:47:17.934+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_sources= new_sources= 2024-09-12T18:47:18.034 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:47:17.934+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential sources added=[] removed=[] 2024-09-12T18:47:18.034 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:47:17.934+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_dests= new_dests= 2024-09-12T18:47:18.035 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:47:17.934+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential dests added=[] removed=[] 2024-09-12T18:47:18.035 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.0 2024-09-12T18:47:18.035 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.0 2024-09-12T18:47:18.035 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.1 2024-09-12T18:47:18.035 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.1 2024-09-12T18:47:18.035 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.2 2024-09-12T18:47:18.035 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.2 2024-09-12T18:47:18.035 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.3 2024-09-12T18:47:18.035 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.3 2024-09-12T18:47:18.035 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.4 2024-09-12T18:47:18.035 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.4 2024-09-12T18:47:18.035 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.5 2024-09-12T18:47:18.035 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.5 2024-09-12T18:47:18.036 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.6 2024-09-12T18:47:18.036 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.6 2024-09-12T18:47:18.036 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.7 2024-09-12T18:47:18.036 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.7 2024-09-12T18:47:18.036 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.8 2024-09-12T18:47:18.036 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.8 2024-09-12T18:47:18.036 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.9 2024-09-12T18:47:18.036 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.9 2024-09-12T18:47:18.036 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.10 2024-09-12T18:47:18.036 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.10 2024-09-12T18:47:18.036 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.11 2024-09-12T18:47:18.036 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.11 2024-09-12T18:47:18.036 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.0 2024-09-12T18:47:18.036 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:47:17.946+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1 2024-09-12T18:47:18.037 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:47:17.946+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2 2024-09-12T18:47:18.037 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:47:17.946+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.3 2024-09-12T18:47:18.037 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:47:17.946+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.4 2024-09-12T18:47:18.037 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:47:17.950+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.5 2024-09-12T18:47:18.037 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:47:17.950+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.6 2024-09-12T18:47:18.037 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:47:17.950+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.7 2024-09-12T18:47:18.037 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:47:17.950+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.8 2024-09-12T18:47:18.037 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:47:17.954+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.9 2024-09-12T18:47:18.037 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:47:17.954+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.10 2024-09-12T18:47:18.037 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:18.037 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 2024-09-12T18:47:18.037 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:18.037 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:18.037 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:18.038 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29, ofs0, ns] 2024-09-12T18:47:18.038 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:47:17.966+0000 7fbfcf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94199487876256 notifier 6707 bl.length()=915 2024-09-12T18:47:18.038 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:47:17.966+0000 7fbfcf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:18.038 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:47:17.966+0000 7fbfcf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:18.038 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:47:17.966+0000 7fbfcf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:18.038 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:47:17.966+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_sources= new_sources= 2024-09-12T18:47:18.038 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:47:17.966+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential sources added=[] removed=[] 2024-09-12T18:47:18.038 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:47:17.966+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_dests= new_dests= 2024-09-12T18:47:18.038 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:47:17.966+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential dests added=[] removed=[] 2024-09-12T18:47:18.038 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:47:17.966+0000 7fc0fb4799c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc0fb4799c0 time 2024-09-12T18:47:17.969754+0000 2024-09-12T18:47:18.038 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:47:18.038 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.038 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:18.039 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc0fed532eb] 2024-09-12T18:47:18.039 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc0fed5349f] 2024-09-12T18:47:18.039 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ac845decc1] 2024-09-12T18:47:18.039 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55ac845f3086] 2024-09-12T18:47:18.039 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ac845f46a4] 2024-09-12T18:47:18.039 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:47:18.039 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc0fdbb9d90] 2024-09-12T18:47:18.039 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:47:18.039 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:47:18.039 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.039 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:47:17.966+0000 7fc0fb4799c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:47:18.039 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7fc0fb4799c0 thread_name:radosgw-admin 2024-09-12T18:47:18.039 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.040 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:18.040 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc0fdbd2520] 2024-09-12T18:47:18.040 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:47:18.040 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:47:18.040 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:47:18.040 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc0fed53345] 2024-09-12T18:47:18.040 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc0fed5349f] 2024-09-12T18:47:18.040 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ac845decc1] 2024-09-12T18:47:18.040 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55ac845f3086] 2024-09-12T18:47:18.040 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ac845f46a4] 2024-09-12T18:47:18.040 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:47:18.040 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc0fdbb9d90] 2024-09-12T18:47:18.040 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:47:18.041 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:47:18.041 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:47:18.041 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.041 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:47:18.041 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:47:18.041 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:47:18.041 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:47:18.041 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:47:18.041 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:47:18.041 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:47:18.041 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:47:18.041 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:47:18.041 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:47:18.042 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:47:18.042 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:47:18.042 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:47:18.042 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:47:18.042 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:47:18.042 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:47:18.042 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:47:18.042 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:47:18.042 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:47:18.042 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:47:18.042 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:47:18.042 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:47:18.042 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:47:18.042 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:47:18.043 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:47:18.043 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:47:18.043 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:47:18.043 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:47:18.043 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:47:18.043 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:47:18.043 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:47:18.043 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:47:18.043 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:47:18.043 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:47:18.043 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:47:18.043 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:47:18.043 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:47:18.043 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:47:18.044 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:47:18.044 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:47:18.044 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:47:18.044 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:47:18.044 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:47:18.044 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:47:18.044 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:47:18.044 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:47:18.044 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:47:18.044 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:47:18.044 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:47:18.044 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:47:18.044 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:47:18.044 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:47:18.045 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:47:18.045 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:47:18.045 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:47:18.045 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:47:18.045 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:47:18.045 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:47:18.045 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:47:18.045 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:47:18.045 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:47:18.045 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:47:18.045 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:47:18.045 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:47:18.045 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:47:18.046 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:47:18.046 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:47:18.046 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:47:18.046 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:47:18.046 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:47:18.046 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:47:18.046 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:47:18.046 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:47:18.046 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:47:18.046 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:47:18.046 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:47:18.046 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:47:18.046 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:47:18.046 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:47:18.047 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:47:18.047 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:47:18.047 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:47:18.047 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:47:18.047 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:47:18.047 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:47:18.047 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:47:18.047 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:47:18.047 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:47:18.047 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:47:18.047 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:47:18.047 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:47:18.047 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:47:18.047 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:47:18.048 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:47:18.048 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfa77fe640 / http_manager 2024-09-12T18:47:18.048 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfae7e4640 / http_manager 2024-09-12T18:47:18.048 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfaf7e6640 / rgw_dt_lg_renew 2024-09-12T18:47:18.048 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfce7fc640 / ms_dispatch 2024-09-12T18:47:18.048 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfcf7fe640 / io_context_pool 2024-09-12T18:47:18.048 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfcffff640 / io_context_pool 2024-09-12T18:47:18.048 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfde7fc640 / ms_dispatch 2024-09-12T18:47:18.048 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfe560a640 / ms_dispatch 2024-09-12T18:47:18.048 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfe6e0d640 / io_context_pool 2024-09-12T18:47:18.048 INFO:tasks.workunit.client.0.smithi111.stderr: 7fc0f877e640 / msgr-worker-2 2024-09-12T18:47:18.048 INFO:tasks.workunit.client.0.smithi111.stderr: 7fc0f8f7f640 / msgr-worker-1 2024-09-12T18:47:18.048 INFO:tasks.workunit.client.0.smithi111.stderr: 7fc0f9780640 / msgr-worker-0 2024-09-12T18:47:18.049 INFO:tasks.workunit.client.0.smithi111.stderr: 7fc0f9f81640 / io_context_pool 2024-09-12T18:47:18.049 INFO:tasks.workunit.client.0.smithi111.stderr: 7fc0fb4799c0 / radosgw-admin 2024-09-12T18:47:18.049 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:47:18.049 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:47:18.049 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/log/ceph/ceph-client.admin.106576.log 2024-09-12T18:47:18.049 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:47:18.049 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:47:18.049 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: crc 2024-09-12T18:47:18.049 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: secure 2024-09-12T18:47:18.049 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: crc 2024-09-12T18:47:18.049 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: secure 2024-09-12T18:47:18.049 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: crc 2024-09-12T18:47:18.049 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: crc 2024-09-12T18:47:18.050 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: secure 2024-09-12T18:47:18.050 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: crc 2024-09-12T18:47:18.050 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: secure 2024-09-12T18:47:18.050 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: crc 2024-09-12T18:47:18.050 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f431a0) adding con mode: secure 2024-09-12T18:47:18.050 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.050 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.050 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command rotate-key hook 0x55ac86f432e8 2024-09-12T18:47:18.050 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:18.050 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:47:18.050 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-a con 0x55ac86dfe430 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:18.050 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-c con 0x55ac86e01b90 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:18.050 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-b con 0x55ac86e88940 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:18.051 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.051 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.051 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.051 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:18.051 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:47:17.222+0000 7fc0fb4799c0 10 monclient(hunting): authenticate will time out at 2224.366703s 2024-09-12T18:47:18.051 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:47:17.222+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request con 0x55ac86dfe430 auth_method 0 2024-09-12T18:47:18.051 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:47:17.222+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.051 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:47:17.222+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.051 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:47:17.222+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.051 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): get_auth_request con 0x55ac86e01b90 auth_method 0 2024-09-12T18:47:18.051 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.051 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.051 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.051 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:18.052 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:18.052 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:18.052 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:47:17.222+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:18.052 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:47:17.222+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:18.052 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:47:17.222+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:18.052 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient(hunting): handle_auth_done global_id 6698 payload 824 2024-09-12T18:47:18.052 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient: _finish_hunting 0 2024-09-12T18:47:18.052 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:47:17.222+0000 7fc0f877e640 1 monclient: found mon.noname-c 2024-09-12T18:47:18.052 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:47:17.222+0000 7fc0f877e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.052 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:18.052 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:47:18.052 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: dump: 2024-09-12T18:47:18.052 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:18.052 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:18.053 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.053 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.053 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:18.053 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.053 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:18.053 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:18.053 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:18.053 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.053 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: _finish_auth 0 2024-09-12T18:47:18.053 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: _check_auth_tickets 2024-09-12T18:47:18.053 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:18.053 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:18.054 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:47:18.054 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:47:17.222+0000 7fbfe560a640 10 monclient: dump: 2024-09-12T18:47:18.054 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:18.054 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:18.054 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.054 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.054 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:18.054 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.054 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:18.054 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:18.054 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:18.054 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.054 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:47:17.222+0000 7fbfe6e0d640 4 set_mon_vals no callback set 2024-09-12T18:47:18.055 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:47:17.226+0000 7fc0fb4799c0 5 monclient: authenticate success, global_id 6698 2024-09-12T18:47:18.055 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:47:17.226+0000 7fc0fb4799c0 10 monclient: _renew_subs 2024-09-12T18:47:18.055 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:47:17.226+0000 7fc0fb4799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.055 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:47:17.226+0000 7fc0fb4799c0 10 monclient: _renew_subs 2024-09-12T18:47:18.055 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:47:17.226+0000 7fc0fb4799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.055 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:47:17.226+0000 7fc0fb4799c0 1 librados: init done 2024-09-12T18:47:18.055 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:47:17.226+0000 7fbfe560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:47:18.055 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:47:17.226+0000 7fbfe560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:18.055 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:47:17.226+0000 7fbfe560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:18.055 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:47:17.226+0000 7fc0f8f7f640 10 monclient: get_auth_request con 0x7fbfe0070ae0 auth_method 0 2024-09-12T18:47:18.055 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:47:17.226+0000 7fc0f9780640 10 monclient: get_auth_request con 0x55ac86f6b610 auth_method 0 2024-09-12T18:47:18.055 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:47:17.226+0000 7fc0f8f7f640 10 monclient: get_auth_request con 0x55ac86f8df80 auth_method 0 2024-09-12T18:47:18.055 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:47:17.230+0000 7fc0f877e640 10 monclient: get_auth_request con 0x55ac86f92170 auth_method 0 2024-09-12T18:47:18.056 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:47:17.230+0000 7fc0f9780640 10 monclient: get_auth_request con 0x55ac86f96390 auth_method 0 2024-09-12T18:47:18.056 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: build_initial_monmap 2024-09-12T18:47:18.056 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 1 build_initial for_mkfs: 0 2024-09-12T18:47:18.056 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: monmap: 2024-09-12T18:47:18.056 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:47:18.056 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:47:18.056 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:47:18.056 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:47:18.056 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:47:18.056 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.056 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:47:18.056 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:47:18.056 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:47:18.056 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.057 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding auth protocol: cephx 2024-09-12T18:47:18.057 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding auth protocol: cephx 2024-09-12T18:47:18.057 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding auth protocol: cephx 2024-09-12T18:47:18.057 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: secure 2024-09-12T18:47:18.057 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: crc 2024-09-12T18:47:18.057 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: secure 2024-09-12T18:47:18.057 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: crc 2024-09-12T18:47:18.057 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: secure 2024-09-12T18:47:18.057 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: crc 2024-09-12T18:47:18.057 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: crc 2024-09-12T18:47:18.057 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: secure 2024-09-12T18:47:18.057 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: crc 2024-09-12T18:47:18.057 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: secure 2024-09-12T18:47:18.058 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: crc 2024-09-12T18:47:18.058 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f9a120) adding con mode: secure 2024-09-12T18:47:18.058 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.058 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ac86f9db10 EEXIST 2024-09-12T18:47:18.058 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: init 2024-09-12T18:47:18.058 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding auth protocol: cephx 2024-09-12T18:47:18.058 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding auth protocol: cephx 2024-09-12T18:47:18.058 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding auth protocol: cephx 2024-09-12T18:47:18.058 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: secure 2024-09-12T18:47:18.058 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: crc 2024-09-12T18:47:18.058 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: secure 2024-09-12T18:47:18.058 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: crc 2024-09-12T18:47:18.058 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: secure 2024-09-12T18:47:18.059 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: crc 2024-09-12T18:47:18.059 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: crc 2024-09-12T18:47:18.059 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: secure 2024-09-12T18:47:18.059 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: crc 2024-09-12T18:47:18.059 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: secure 2024-09-12T18:47:18.059 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: crc 2024-09-12T18:47:18.059 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86f990d8) adding con mode: secure 2024-09-12T18:47:18.059 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.059 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.059 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command rotate-key cmddesc rotate-key hook 0x55ac86f99220 EEXIST 2024-09-12T18:47:18.059 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:18.059 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:47:18.059 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-b con 0x55ac86fc1cc0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:18.059 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-a con 0x55ac86fc15f0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:18.060 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-c con 0x55ac86fbffd0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:18.060 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.060 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.060 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.060 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:18.060 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient(hunting): authenticate will time out at 2224.378174s 2024-09-12T18:47:18.060 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request con 0x55ac86fbffd0 auth_method 0 2024-09-12T18:47:18.060 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.060 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.060 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.060 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:47:17.234+0000 7fc0f9780640 10 monclient(hunting): get_auth_request con 0x55ac86fc15f0 auth_method 0 2024-09-12T18:47:18.060 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:47:17.234+0000 7fc0f9780640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.060 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:47:17.234+0000 7fc0f9780640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.061 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:47:17.234+0000 7fc0f9780640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.061 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:18.061 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:18.061 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:18.061 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:47:17.234+0000 7fc0f9780640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:18.061 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:47:17.234+0000 7fc0f9780640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:18.061 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:47:17.234+0000 7fc0f9780640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:18.061 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:47:17.234+0000 7fc0f877e640 10 monclient(hunting): get_auth_request con 0x55ac86fc1cc0 auth_method 0 2024-09-12T18:47:18.061 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:47:17.234+0000 7fc0f877e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.061 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:47:17.234+0000 7fc0f877e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.061 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:47:17.234+0000 7fc0f877e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.061 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_done global_id 6701 payload 824 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient: _finish_hunting 0 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 1 monclient: found mon.noname-c 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:47:17.234+0000 7fc0f8f7f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: dump: 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:18.062 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: _finish_auth 0 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:47:17.234+0000 7fbfde7fc640 10 monclient: dump: 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:18.063 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:18.064 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:18.064 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.064 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 5 monclient: authenticate success, global_id 6701 2024-09-12T18:47:18.064 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:47:17.234+0000 7fc0f9f81640 4 set_mon_vals no callback set 2024-09-12T18:47:18.064 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: _renew_subs 2024-09-12T18:47:18.064 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.064 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: _renew_subs 2024-09-12T18:47:18.064 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:47:17.234+0000 7fc0fb4799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.064 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:47:17.238+0000 7fbfde7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:47:18.064 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:47:17.238+0000 7fbfde7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:18.064 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:47:17.238+0000 7fbfde7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:18.064 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:47:17.238+0000 7fc0f877e640 10 monclient: get_auth_request con 0x7fbfd0070a20 auth_method 0 2024-09-12T18:47:18.064 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: get_monmap_and_config 2024-09-12T18:47:18.064 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: build_initial_monmap 2024-09-12T18:47:18.065 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 1 build_initial for_mkfs: 0 2024-09-12T18:47:18.065 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: monmap: 2024-09-12T18:47:18.065 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:47:18.065 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:47:18.065 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:47:18.065 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:47:18.065 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:47:18.065 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.065 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:47:18.065 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:47:18.065 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:47:18.065 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.065 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding auth protocol: cephx 2024-09-12T18:47:18.065 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding auth protocol: cephx 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding auth protocol: cephx 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: secure 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: crc 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: secure 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: crc 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: secure 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: crc 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: crc 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: secure 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: crc 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: secure 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: crc 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fe1540) adding con mode: secure 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.066 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: init 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding auth protocol: cephx 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding auth protocol: cephx 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding auth protocol: cephx 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: secure 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: crc 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: secure 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: crc 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: secure 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: crc 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: crc 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: secure 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: crc 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: secure 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: crc 2024-09-12T18:47:18.067 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b480) adding con mode: secure 2024-09-12T18:47:18.068 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.068 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.068 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc0551b5c8 EEXIST 2024-09-12T18:47:18.068 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:18.068 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:47:18.068 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-b con 0x55ac87015a40 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:18.068 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-c con 0x55ac87010e30 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:18.068 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-a con 0x55ac870117b0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:18.068 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.068 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.068 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.068 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:18.068 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient(hunting): authenticate will time out at 2224.382308s 2024-09-12T18:47:18.068 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): get_auth_request con 0x55ac87010e30 auth_method 0 2024-09-12T18:47:18.069 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.069 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.069 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.069 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:47:17.238+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request con 0x55ac870117b0 auth_method 0 2024-09-12T18:47:18.069 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:47:17.238+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.069 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:47:17.238+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.069 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:47:17.238+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.069 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:18.069 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:18.069 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:18.069 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:47:17.238+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:18.069 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:47:17.238+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:18.069 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:47:17.238+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:18.069 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient(hunting): handle_auth_done global_id 6704 payload 274 2024-09-12T18:47:18.070 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient: _finish_hunting 0 2024-09-12T18:47:18.070 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:47:17.238+0000 7fc0f9780640 1 monclient: found mon.noname-c 2024-09-12T18:47:18.070 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:47:17.238+0000 7fc0f9780640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.070 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:18.070 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:47:18.070 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: dump: 2024-09-12T18:47:18.070 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:18.070 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:18.070 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.070 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.070 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:18.070 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.070 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:18.071 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:18.071 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:18.071 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.071 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: _finish_auth 0 2024-09-12T18:47:18.071 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: _check_auth_tickets 2024-09-12T18:47:18.071 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:18.071 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 monclient: authenticate success, global_id 6704 2024-09-12T18:47:18.071 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: get_monmap_and_config success 2024-09-12T18:47:18.071 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 4 set_mon_vals no callback set 2024-09-12T18:47:18.071 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:18.071 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:47:18.071 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:47:17.238+0000 7fbfcffff640 10 monclient: dump: 2024-09-12T18:47:18.071 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:18.071 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:18.072 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.072 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.072 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:18.072 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.072 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:18.072 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:18.072 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:18.072 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.072 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: shutdown 2024-09-12T18:47:18.072 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: build_initial_monmap 2024-09-12T18:47:18.072 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 1 build_initial for_mkfs: 0 2024-09-12T18:47:18.072 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 10 monclient: monmap: 2024-09-12T18:47:18.072 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:47:18.072 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:47:18.073 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:47:18.073 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:47:18.073 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:47:18.073 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.073 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:47:18.073 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:47:18.073 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:47:18.073 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.073 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding auth protocol: cephx 2024-09-12T18:47:18.073 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding auth protocol: cephx 2024-09-12T18:47:18.073 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding auth protocol: cephx 2024-09-12T18:47:18.073 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: secure 2024-09-12T18:47:18.074 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: crc 2024-09-12T18:47:18.074 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: secure 2024-09-12T18:47:18.074 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: crc 2024-09-12T18:47:18.074 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: secure 2024-09-12T18:47:18.074 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: crc 2024-09-12T18:47:18.074 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: crc 2024-09-12T18:47:18.074 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: secure 2024-09-12T18:47:18.074 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: crc 2024-09-12T18:47:18.074 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: secure 2024-09-12T18:47:18.074 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: crc 2024-09-12T18:47:18.074 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:47:17.238+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac87008030) adding con mode: secure 2024-09-12T18:47:18.074 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.074 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 1 librados: starting msgr at 2024-09-12T18:47:18.075 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 1 librados: starting objecter 2024-09-12T18:47:18.075 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command objecter_requests cmddesc objecter_requests hook 0x55ac86fe7a10 EEXIST 2024-09-12T18:47:18.075 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 1 librados: setting wanted keys 2024-09-12T18:47:18.075 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 1 librados: calling monclient init 2024-09-12T18:47:18.075 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient: init 2024-09-12T18:47:18.075 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding auth protocol: cephx 2024-09-12T18:47:18.075 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding auth protocol: cephx 2024-09-12T18:47:18.075 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding auth protocol: cephx 2024-09-12T18:47:18.075 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: secure 2024-09-12T18:47:18.075 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: crc 2024-09-12T18:47:18.075 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: secure 2024-09-12T18:47:18.075 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: crc 2024-09-12T18:47:18.075 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: secure 2024-09-12T18:47:18.075 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: crc 2024-09-12T18:47:18.076 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: crc 2024-09-12T18:47:18.076 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: secure 2024-09-12T18:47:18.076 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: crc 2024-09-12T18:47:18.076 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: secure 2024-09-12T18:47:18.076 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: crc 2024-09-12T18:47:18.076 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 AuthRegistry(0x55ac86fc3ae0) adding con mode: secure 2024-09-12T18:47:18.076 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.076 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.076 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command rotate-key cmddesc rotate-key hook 0x55ac86fc3c28 EEXIST 2024-09-12T18:47:18.076 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:18.076 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:47:18.076 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-c con 0x55ac87010e30 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:18.076 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-b con 0x55ac870117b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:18.077 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): picked mon.noname-a con 0x55ac87015a40 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:18.077 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.077 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.077 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:18.077 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:18.077 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient(hunting): authenticate will time out at 2224.384937s 2024-09-12T18:47:18.077 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): get_auth_request con 0x55ac87010e30 auth_method 0 2024-09-12T18:47:18.077 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.077 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.077 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.077 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:47:17.242+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request con 0x55ac87015a40 auth_method 0 2024-09-12T18:47:18.077 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:47:17.242+0000 7fc0f8f7f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:18.077 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:47:17.242+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:18.078 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:47:17.242+0000 7fc0f8f7f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:18.078 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:18.078 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:18.078 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:18.078 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:47:17.242+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:18.078 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:47:17.242+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:18.078 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:47:17.242+0000 7fc0f8f7f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:18.078 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient(hunting): handle_auth_done global_id 6707 payload 824 2024-09-12T18:47:18.078 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient: _finish_hunting 0 2024-09-12T18:47:18.078 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:47:17.242+0000 7fc0f877e640 1 monclient: found mon.noname-c 2024-09-12T18:47:18.078 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:47:17.242+0000 7fc0f877e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.078 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:18.078 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:47:18.078 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: dump: 2024-09-12T18:47:18.079 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:18.079 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:18.079 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.079 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.079 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:18.079 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.079 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:18.079 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:18.079 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:18.079 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.079 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: _finish_auth 0 2024-09-12T18:47:18.079 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: _check_auth_tickets 2024-09-12T18:47:18.079 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:18.079 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:18.080 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:47:18.080 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 10 monclient: dump: 2024-09-12T18:47:18.080 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:18.080 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:18.080 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.080 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:18.080 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:18.080 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:18.080 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:18.081 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:18.081 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:18.081 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.081 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:47:17.242+0000 7fbfcffff640 4 set_mon_vals no callback set 2024-09-12T18:47:18.081 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 monclient: authenticate success, global_id 6707 2024-09-12T18:47:18.081 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient: _renew_subs 2024-09-12T18:47:18.081 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.081 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient: _renew_subs 2024-09-12T18:47:18.081 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.081 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 1 librados: init done 2024-09-12T18:47:18.081 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command cr dump hook 0x55ac87007c78 2024-09-12T18:47:18.081 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:47:17.242+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.081 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:47:18.082 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:18.082 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:47:17.242+0000 7fbfce7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:18.082 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:47:17.242+0000 7fc0f9780640 10 monclient: get_auth_request con 0x7fbfc4070ae0 auth_method 0 2024-09-12T18:47:18.082 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:47:17.246+0000 7fc0f8f7f640 10 monclient: get_auth_request con 0x55ac8702f3b0 auth_method 0 2024-09-12T18:47:18.082 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.082 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 realm 2024-09-12T18:47:18.082 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.082 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.082 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:18.082 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.082 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.082 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.082 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:47:17.246+0000 7fc0f877e640 10 monclient: get_auth_request con 0x55ac87033640 auth_method 0 2024-09-12T18:47:18.083 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:18.083 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.083 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:47:17.246+0000 7fc0f9780640 10 monclient: get_auth_request con 0x55ac87036ec0 auth_method 0 2024-09-12T18:47:18.083 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:18.083 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:47:17.246+0000 7fc0fb4799c0 20 searching for the correct realm 2024-09-12T18:47:18.083 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:47:17.250+0000 7fc0f8f7f640 10 monclient: get_auth_request con 0x7fc0f003ab60 auth_method 0 2024-09-12T18:47:18.083 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:47:17.250+0000 7fc0f877e640 10 monclient: get_auth_request con 0x7fc0e80fee90 auth_method 0 2024-09-12T18:47:18.083 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:47:17.250+0000 7fc0f9780640 10 monclient: get_auth_request con 0x7fc0ec090040 auth_method 0 2024-09-12T18:47:18.083 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:47:17.250+0000 7fc0f9780640 0 -- 172.21.15.111:0/3259162773 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fc0ec090040 msgr2=0x7fc0ec01a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:18.083 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:47:17.454+0000 7fc0f9780640 10 monclient: get_auth_request con 0x7fc0ec090040 auth_method 0 2024-09-12T18:47:18.083 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:47:17.858+0000 7fc0f9780640 10 monclient: get_auth_request con 0x7fc0ec090040 auth_method 0 2024-09-12T18:47:18.083 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:47:17.862+0000 7fc0f8f7f640 10 monclient: get_auth_request con 0x7fc0f004a040 auth_method 0 2024-09-12T18:47:18.083 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:47:17.870+0000 7fc0f877e640 0 -- 172.21.15.111:0/3259162773 >> [v2:172.21.15.153:6824/2813139034,v1:172.21.15.153:6825/2813139034] conn(0x55ac87033640 msgr2=0x55ac87035a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:18.084 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:47:17.870+0000 7fbfce7fc640 1 client.6707.objecter ms_handle_reset 0x55ac87033640 session 0x55ac87032fc0 osd.5 2024-09-12T18:47:18.084 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:47:17.870+0000 7fbfce7fc640 10 monclient: _renew_subs 2024-09-12T18:47:18.084 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:47:17.870+0000 7fbfce7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:47:18.084 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:47:17.870+0000 7fc0f877e640 10 monclient: get_auth_request con 0x7fbfc4080a80 auth_method 0 2024-09-12T18:47:18.084 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:47:17.870+0000 7fc0f877e640 10 monclient: get_auth_request con 0x7fc0f0032c10 auth_method 0 2024-09-12T18:47:18.084 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:18.084 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:18.084 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:18.084 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:18.084 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:18.084 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:18.084 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.084 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.085 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.085 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:18.085 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.085 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:18.085 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 zone default found 2024-09-12T18:47:18.085 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 4 Realm: () 2024-09-12T18:47:18.085 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:18.085 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:18.085 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:18.085 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 zonegroup default 2024-09-12T18:47:18.085 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.085 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.085 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:47:17.886+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.086 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.086 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.086 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.086 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 started sync module instance, tier type = 2024-09-12T18:47:18.086 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:47:17.890+0000 7fc0fb4799c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:18.086 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=0 2024-09-12T18:47:18.086 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=1 2024-09-12T18:47:18.086 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=2 2024-09-12T18:47:18.086 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=3 2024-09-12T18:47:18.086 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=4 2024-09-12T18:47:18.086 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:47:17.910+0000 7fc0fb4799c0 20 add_watcher() i=5 2024-09-12T18:47:18.086 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:47:17.914+0000 7fc0fb4799c0 20 add_watcher() i=6 2024-09-12T18:47:18.086 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:47:17.914+0000 7fc0fb4799c0 20 add_watcher() i=7 2024-09-12T18:47:18.087 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:47:17.914+0000 7fc0fb4799c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:18.087 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding auth protocol: cephx 2024-09-12T18:47:18.087 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding auth protocol: cephx 2024-09-12T18:47:18.087 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding auth protocol: cephx 2024-09-12T18:47:18.087 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: secure 2024-09-12T18:47:18.087 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: crc 2024-09-12T18:47:18.087 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: secure 2024-09-12T18:47:18.087 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:47:17.918+0000 7fbfaf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:18.087 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: crc 2024-09-12T18:47:18.087 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: secure 2024-09-12T18:47:18.087 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: crc 2024-09-12T18:47:18.087 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: crc 2024-09-12T18:47:18.088 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: secure 2024-09-12T18:47:18.088 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: crc 2024-09-12T18:47:18.088 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: secure 2024-09-12T18:47:18.088 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: crc 2024-09-12T18:47:18.088 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 AuthRegistry(0x7ffc0551b960) adding con mode: secure 2024-09-12T18:47:18.088 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:18.088 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:18.088 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:18.088 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command cache list hook 0x55ac87005580 2024-09-12T18:47:18.088 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command cache inspect hook 0x55ac87005580 2024-09-12T18:47:18.088 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command cache erase hook 0x55ac87005580 2024-09-12T18:47:18.088 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command cache zap hook 0x55ac87005580 2024-09-12T18:47:18.089 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 note: GC not initialized 2024-09-12T18:47:18.089 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:47:17.918+0000 7fbfae7e4640 20 reqs_thread_entry: start 2024-09-12T18:47:18.089 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command sync trace show hook 0x7fc0f0004e10 2024-09-12T18:47:18.089 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command sync trace history hook 0x7fc0f0004e10 2024-09-12T18:47:18.089 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command sync trace active hook 0x7fc0f0004e10 2024-09-12T18:47:18.089 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 5 asok(0x55ac86d362b0) register_command sync trace active_short hook 0x7fc0f0004e10 2024-09-12T18:47:18.089 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:18.089 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 Filter name: none 2024-09-12T18:47:18.089 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:47:17.918+0000 7fbfa77fe640 20 reqs_thread_entry: start 2024-09-12T18:47:18.089 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:47:18.089 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.089 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:18.089 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:47:18.090 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:47:18.090 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 : miss 2024-09-12T18:47:18.090 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:47:17.918+0000 7fc0fb4799c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.090 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:47:17.922+0000 7fc0fb4799c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:18.090 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:18.090 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:18.090 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:47:18.090 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:18.090 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:47:17.922+0000 7fc0fb4799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 2024-09-12T18:47:18.090 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:47:17.930+0000 7fc0fb4799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:18.090 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:47:17.930+0000 7fc0fb4799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:18.090 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:47:17.930+0000 7fc0fb4799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:18.090 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:47:17.930+0000 7fc0fb4799c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29, ofs0, ns] 2024-09-12T18:47:18.091 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:47:17.930+0000 7fbfcf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431588 cookie 94199487876256 notifier 6707 bl.length()=915 2024-09-12T18:47:18.091 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:47:17.930+0000 7fbfcf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:18.091 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:47:17.930+0000 7fbfcf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:18.091 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:47:17.930+0000 7fbfcf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:18.091 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:47:17.934+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_sources= new_sources= 2024-09-12T18:47:18.091 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:47:17.934+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential sources added=[] removed=[] 2024-09-12T18:47:18.091 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:47:17.934+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_dests= new_dests= 2024-09-12T18:47:18.091 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:47:17.934+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential dests added=[] removed=[] 2024-09-12T18:47:18.091 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.0 2024-09-12T18:47:18.091 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.0 2024-09-12T18:47:18.091 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.1 2024-09-12T18:47:18.091 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.1 2024-09-12T18:47:18.091 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.2 2024-09-12T18:47:18.092 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.2 2024-09-12T18:47:18.092 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.3 2024-09-12T18:47:18.092 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.3 2024-09-12T18:47:18.092 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.4 2024-09-12T18:47:18.092 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.4 2024-09-12T18:47:18.092 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.5 2024-09-12T18:47:18.092 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.5 2024-09-12T18:47:18.092 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.6 2024-09-12T18:47:18.092 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.6 2024-09-12T18:47:18.092 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.7 2024-09-12T18:47:18.092 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.7 2024-09-12T18:47:18.092 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.8 2024-09-12T18:47:18.093 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.8 2024-09-12T18:47:18.093 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.9 2024-09-12T18:47:18.093 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.9 2024-09-12T18:47:18.093 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.10 2024-09-12T18:47:18.093 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.10 2024-09-12T18:47:18.093 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.11 2024-09-12T18:47:18.093 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1.11 2024-09-12T18:47:18.093 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:47:17.942+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.0 2024-09-12T18:47:18.093 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:47:17.946+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1 2024-09-12T18:47:18.093 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:47:17.946+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2 2024-09-12T18:47:18.093 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:47:17.946+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.3 2024-09-12T18:47:18.093 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:47:17.946+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.4 2024-09-12T18:47:18.093 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:47:17.950+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.5 2024-09-12T18:47:18.094 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:47:17.950+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.6 2024-09-12T18:47:18.094 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:47:17.950+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.7 2024-09-12T18:47:18.094 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:47:17.950+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.8 2024-09-12T18:47:18.094 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:47:17.954+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.9 2024-09-12T18:47:18.094 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:47:17.954+0000 7fc0fb4799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.10 2024-09-12T18:47:18.094 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:18.094 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 2024-09-12T18:47:18.094 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:18.094 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:18.094 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:18.094 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:47:17.962+0000 7fc0fb4799c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29, ofs0, ns] 2024-09-12T18:47:18.094 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:47:17.966+0000 7fbfcf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94199487876256 notifier 6707 bl.length()=915 2024-09-12T18:47:18.094 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:47:17.966+0000 7fbfcf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:18.095 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:47:17.966+0000 7fbfcf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:18.095 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:47:17.966+0000 7fbfcf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:18.095 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:47:17.966+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_sources= new_sources= 2024-09-12T18:47:18.095 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:47:17.966+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential sources added=[] removed=[] 2024-09-12T18:47:18.095 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:47:17.966+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_dests= new_dests= 2024-09-12T18:47:18.095 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:47:17.966+0000 7fc0fb4799c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential dests added=[] removed=[] 2024-09-12T18:47:18.095 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:47:17.966+0000 7fc0fb4799c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc0fb4799c0 time 2024-09-12T18:47:17.969754+0000 2024-09-12T18:47:18.095 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:47:18.095 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.095 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:18.095 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc0fed532eb] 2024-09-12T18:47:18.095 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc0fed5349f] 2024-09-12T18:47:18.095 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ac845decc1] 2024-09-12T18:47:18.096 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55ac845f3086] 2024-09-12T18:47:18.096 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ac845f46a4] 2024-09-12T18:47:18.096 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:47:18.096 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc0fdbb9d90] 2024-09-12T18:47:18.096 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:47:18.096 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:47:18.096 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.096 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:47:17.966+0000 7fc0fb4799c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:47:18.096 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7fc0fb4799c0 thread_name:radosgw-admin 2024-09-12T18:47:18.096 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.096 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:18.096 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc0fdbd2520] 2024-09-12T18:47:18.096 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:47:18.097 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:47:18.097 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:47:18.097 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc0fed53345] 2024-09-12T18:47:18.097 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc0fed5349f] 2024-09-12T18:47:18.097 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ac845decc1] 2024-09-12T18:47:18.097 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55ac845f3086] 2024-09-12T18:47:18.097 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55ac845f46a4] 2024-09-12T18:47:18.097 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:47:18.097 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc0fdbb9d90] 2024-09-12T18:47:18.097 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:47:18.097 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:47:18.097 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:47:18.097 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.098 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:47:18.098 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:47:18.098 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:47:18.098 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:47:18.098 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:47:18.098 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:47:18.098 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:47:18.098 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:47:18.098 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:47:18.098 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:47:18.098 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:47:18.098 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:47:18.098 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:47:18.099 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:47:18.099 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:47:18.099 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:47:18.099 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:47:18.099 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:47:18.099 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:47:18.099 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:47:18.099 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:47:18.099 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:47:18.099 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:47:18.099 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:47:18.099 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:47:18.099 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:47:18.100 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:47:18.100 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:47:18.100 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:47:18.100 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:47:18.100 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:47:18.100 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:47:18.100 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:47:18.100 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:47:18.100 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:47:18.100 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:47:18.100 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:47:18.100 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:47:18.100 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:47:18.100 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:47:18.101 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:47:18.101 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:47:18.101 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:47:18.101 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:47:18.101 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:47:18.101 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:47:18.101 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:47:18.101 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:47:18.101 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:47:18.101 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:47:18.101 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:47:18.101 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:47:18.101 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:47:18.102 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:47:18.102 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:47:18.102 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:47:18.102 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:47:18.102 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:47:18.102 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:47:18.102 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:47:18.102 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:47:18.102 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:47:18.102 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:47:18.102 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:47:18.102 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:47:18.102 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:47:18.102 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:47:18.103 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:47:18.103 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:47:18.103 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:47:18.103 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:47:18.103 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:47:18.103 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:47:18.103 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:47:18.103 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:47:18.103 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:47:18.103 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:47:18.103 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:47:18.103 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:47:18.103 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:47:18.103 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:47:18.104 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:47:18.104 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:47:18.104 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:47:18.104 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:47:18.104 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:47:18.104 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:47:18.104 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:47:18.104 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:47:18.104 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:47:18.104 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:47:18.104 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:47:18.104 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:47:18.104 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:47:18.104 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfa77fe640 / http_manager 2024-09-12T18:47:18.105 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfae7e4640 / http_manager 2024-09-12T18:47:18.105 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfaf7e6640 / rgw_dt_lg_renew 2024-09-12T18:47:18.105 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfce7fc640 / ms_dispatch 2024-09-12T18:47:18.105 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfcf7fe640 / io_context_pool 2024-09-12T18:47:18.105 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfcffff640 / io_context_pool 2024-09-12T18:47:18.105 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfde7fc640 / ms_dispatch 2024-09-12T18:47:18.105 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfe560a640 / ms_dispatch 2024-09-12T18:47:18.105 INFO:tasks.workunit.client.0.smithi111.stderr: 7fbfe6e0d640 / io_context_pool 2024-09-12T18:47:18.105 INFO:tasks.workunit.client.0.smithi111.stderr: 7fc0f877e640 / msgr-worker-2 2024-09-12T18:47:18.105 INFO:tasks.workunit.client.0.smithi111.stderr: 7fc0f8f7f640 / msgr-worker-1 2024-09-12T18:47:18.105 INFO:tasks.workunit.client.0.smithi111.stderr: 7fc0f9780640 / msgr-worker-0 2024-09-12T18:47:18.105 INFO:tasks.workunit.client.0.smithi111.stderr: 7fc0f9f81640 / io_context_pool 2024-09-12T18:47:18.105 INFO:tasks.workunit.client.0.smithi111.stderr: 7fc0fb4799c0 / radosgw-admin 2024-09-12T18:47:18.105 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:47:18.106 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:47:18.106 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:47:17.972124Z_0a109d89-20d0-47a4-8203-b08f9de9d610/log 2024-09-12T18:47:18.106 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:47:18.106 INFO:tasks.workunit.client.0.smithi111.stderr:Aborted 2024-09-12T18:47:18.106 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T18:47:18.107 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.054+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.054+0000 7f682ad299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.054+0000 7f682ad299c0 20 realm 2024-09-12T18:47:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.054+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.054+0000 7f682ad299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.054+0000 7f682ad299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.054+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.054+0000 7f682ad299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.054+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.058+0000 7f682ad299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.058+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.058+0000 7f682ad299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:18.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.058+0000 7f682ad299c0 20 searching for the correct realm 2024-09-12T18:47:18.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.062+0000 7f682882f640 0 -- 172.21.15.111:0/1842767401 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f68240e0040 msgr2=0x7f68240e1940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:18.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.070+0000 7f6823fff640 0 -- 172.21.15.111:0/1842767401 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f68240f3920 msgr2=0x7f68240df410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:18.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.286+0000 7f682ad299c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:18.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.286+0000 7f682ad299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:18.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.286+0000 7f682ad299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:18.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.286+0000 7f682ad299c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:18.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.286+0000 7f682ad299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:18.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.286+0000 7f682ad299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:18.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.286+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.286+0000 7f682ad299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.286+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:18.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:18.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 20 zone default found 2024-09-12T18:47:18.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 4 Realm: () 2024-09-12T18:47:18.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:18.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:18.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:18.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 20 zonegroup default 2024-09-12T18:47:18.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 20 started sync module instance, tier type = 2024-09-12T18:47:18.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.290+0000 7f682ad299c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:18.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.314+0000 7f682ad299c0 20 add_watcher() i=0 2024-09-12T18:47:18.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.314+0000 7f682ad299c0 20 add_watcher() i=1 2024-09-12T18:47:18.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.314+0000 7f682ad299c0 20 add_watcher() i=2 2024-09-12T18:47:18.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.314+0000 7f682ad299c0 20 add_watcher() i=3 2024-09-12T18:47:18.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.314+0000 7f682ad299c0 20 add_watcher() i=4 2024-09-12T18:47:18.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.314+0000 7f682ad299c0 20 add_watcher() i=5 2024-09-12T18:47:18.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.314+0000 7f682ad299c0 20 add_watcher() i=6 2024-09-12T18:47:18.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.318+0000 7f682ad299c0 20 add_watcher() i=7 2024-09-12T18:47:18.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.318+0000 7f682ad299c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:18.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.322+0000 7f66df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:18.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.322+0000 7f682ad299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:18.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.322+0000 7f682ad299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:18.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.322+0000 7f682ad299c0 5 note: GC not initialized 2024-09-12T18:47:18.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.322+0000 7f66de7e4640 20 reqs_thread_entry: start 2024-09-12T18:47:18.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.322+0000 7f682ad299c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:18.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.322+0000 7f682ad299c0 20 Filter name: none 2024-09-12T18:47:18.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.322+0000 7f66d77fe640 20 reqs_thread_entry: start 2024-09-12T18:47:18.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.322+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.322+0000 7f682ad299c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:18.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.322+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.326+0000 7f682ad299c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T18:47:18.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.326+0000 7f682ad299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:18.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.326+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.326+0000 7f682ad299c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:18.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.326+0000 7f682ad299c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.326+0000 7f682ad299c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T18:47:18.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.326+0000 7f682ad299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:18.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.330+0000 7f66df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:18.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.334+0000 7f682ad299c0 20 remove_watcher() i=0 2024-09-12T18:47:18.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.334+0000 7f682ad299c0 2 removed watcher, disabling cache 2024-09-12T18:47:18.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.338+0000 7f682ad299c0 20 remove_watcher() i=1 2024-09-12T18:47:18.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.338+0000 7f682ad299c0 20 remove_watcher() i=2 2024-09-12T18:47:18.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.342+0000 7f682ad299c0 20 remove_watcher() i=3 2024-09-12T18:47:18.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.342+0000 7f682ad299c0 20 remove_watcher() i=4 2024-09-12T18:47:18.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.346+0000 7f682ad299c0 20 remove_watcher() i=5 2024-09-12T18:47:18.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.346+0000 7f682ad299c0 20 remove_watcher() i=6 2024-09-12T18:47:18.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.346+0000 7f682ad299c0 20 remove_watcher() i=7 2024-09-12T18:47:18.366 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.367 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:47:18.367 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-block-writes id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:47:18.367 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:18.368 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:18.368 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:18.380 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:18.380 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:18.425 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:47:18.459 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:18.460 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:18.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.502+0000 7f9cb0fad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.502+0000 7f9cb0fad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.502+0000 7f9cb0fad9c0 20 realm 2024-09-12T18:47:18.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.502+0000 7f9cb0fad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.502+0000 7f9cb0fad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.502+0000 7f9cb0fad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:18.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.502+0000 7f9cb0fad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.502+0000 7f9cb0fad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.508 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.502+0000 7f9cb0fad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.506+0000 7f9cb0fad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:18.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.506+0000 7f9cb0fad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.506+0000 7f9cb0fad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:18.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.506+0000 7f9cb0fad9c0 20 searching for the correct realm 2024-09-12T18:47:18.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.510+0000 7f9caf2b4640 0 -- 172.21.15.111:0/3153931096 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f9ca40cd040 msgr2=0x7f9ca40ee440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:18.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.518+0000 7f9cae2b2640 0 -- 172.21.15.111:0/3153931096 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f9ca80840c0 msgr2=0x7f9ca808f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:18.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.734+0000 7f9cb0fad9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:18.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.734+0000 7f9cb0fad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:18.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.734+0000 7f9cb0fad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:18.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.734+0000 7f9cb0fad9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:18.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.734+0000 7f9cb0fad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:18.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.734+0000 7f9cb0fad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:18.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.734+0000 7f9cb0fad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.734+0000 7f9cb0fad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.734+0000 7f9cb0fad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.734+0000 7f9cb0fad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:18.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.734+0000 7f9cb0fad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:18.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 20 zone default found 2024-09-12T18:47:18.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 4 Realm: () 2024-09-12T18:47:18.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:18.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:18.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:18.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 20 zonegroup default 2024-09-12T18:47:18.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:18.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 20 started sync module instance, tier type = 2024-09-12T18:47:18.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.738+0000 7f9cb0fad9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:18.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.762+0000 7f9cb0fad9c0 20 add_watcher() i=0 2024-09-12T18:47:18.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.762+0000 7f9cb0fad9c0 20 add_watcher() i=1 2024-09-12T18:47:18.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.762+0000 7f9cb0fad9c0 20 add_watcher() i=2 2024-09-12T18:47:18.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.762+0000 7f9cb0fad9c0 20 add_watcher() i=3 2024-09-12T18:47:18.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.762+0000 7f9cb0fad9c0 20 add_watcher() i=4 2024-09-12T18:47:18.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.762+0000 7f9cb0fad9c0 20 add_watcher() i=5 2024-09-12T18:47:18.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.762+0000 7f9cb0fad9c0 20 add_watcher() i=6 2024-09-12T18:47:18.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.766+0000 7f9cb0fad9c0 20 add_watcher() i=7 2024-09-12T18:47:18.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.766+0000 7f9cb0fad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:18.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.770+0000 7f9b657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:18.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.770+0000 7f9cb0fad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:18.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.770+0000 7f9cb0fad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:18.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.770+0000 7f9cb0fad9c0 5 note: GC not initialized 2024-09-12T18:47:18.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9adffff640 20 reqs_thread_entry: start 2024-09-12T18:47:18.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:18.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 20 Filter name: none 2024-09-12T18:47:18.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9addffb640 20 reqs_thread_entry: start 2024-09-12T18:47:18.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:47:18.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:18.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:47:18.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:47:18.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 : miss 2024-09-12T18:47:18.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:18.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T18:47:18.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:18.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:18.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:47:18.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:18.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 2024-09-12T18:47:18.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.774+0000 7f9cb0fad9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to be held by another RGW process; skipping for now 2024-09-12T18:47:18.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.778+0000 7f9b657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:18.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.782+0000 7f9cb0fad9c0 20 remove_watcher() i=0 2024-09-12T18:47:18.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.782+0000 7f9cb0fad9c0 2 removed watcher, disabling cache 2024-09-12T18:47:18.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.786+0000 7f9cb0fad9c0 20 remove_watcher() i=1 2024-09-12T18:47:18.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.786+0000 7f9cb0fad9c0 20 remove_watcher() i=2 2024-09-12T18:47:18.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.790+0000 7f9cb0fad9c0 20 remove_watcher() i=3 2024-09-12T18:47:18.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.790+0000 7f9cb0fad9c0 20 remove_watcher() i=4 2024-09-12T18:47:18.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.794+0000 7f9cb0fad9c0 20 remove_watcher() i=5 2024-09-12T18:47:18.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.794+0000 7f9cb0fad9c0 20 remove_watcher() i=6 2024-09-12T18:47:18.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:18.794+0000 7f9cb0fad9c0 20 remove_watcher() i=7 2024-09-12T18:47:18.813 INFO:tasks.workunit.client.0.smithi111.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:47:48.830 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:47:48.866 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:48.866 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:48.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:48.910+0000 7fadcdefd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:48.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:48.910+0000 7fadcdefd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:48.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:48.910+0000 7fadcdefd9c0 20 realm 2024-09-12T18:47:48.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:48.910+0000 7fadcdefd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:48.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:48.910+0000 7fadcdefd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:48.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:48.910+0000 7fadcdefd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:48.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:48.910+0000 7fadcdefd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:48.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:48.910+0000 7fadcdefd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:48.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:48.910+0000 7fadcdefd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:48.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:48.914+0000 7fadcdefd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:48.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:48.914+0000 7fadcdefd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:48.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:48.914+0000 7fadcdefd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:48.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:48.914+0000 7fadcdefd9c0 20 searching for the correct realm 2024-09-12T18:47:48.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:48.914+0000 7fadcb202640 0 -- 172.21.15.111:0/2711787607 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7fadbc02a030 msgr2=0x7fadbc0013c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:47:49.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.126+0000 7fadcba03640 0 -- 172.21.15.111:0/2711787607 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fadc40fdc20 msgr2=0x7fadc40fb5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:49.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.142+0000 7fadcdefd9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:49.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.142+0000 7fadcdefd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:49.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.142+0000 7fadcdefd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:49.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.142+0000 7fadcdefd9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:49.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.142+0000 7fadcdefd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:49.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.142+0000 7fadcdefd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:49.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.142+0000 7fadcdefd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.146+0000 7fadcdefd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:49.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.146+0000 7fadcdefd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.146+0000 7fadcdefd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:49.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.146+0000 7fadcdefd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.146+0000 7fadcdefd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:49.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.146+0000 7fadcdefd9c0 20 zone default found 2024-09-12T18:47:49.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.146+0000 7fadcdefd9c0 4 Realm: () 2024-09-12T18:47:49.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.146+0000 7fadcdefd9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:49.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.146+0000 7fadcdefd9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:49.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.146+0000 7fadcdefd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:49.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.146+0000 7fadcdefd9c0 20 zonegroup default 2024-09-12T18:47:49.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.146+0000 7fadcdefd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.146+0000 7fadcdefd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:49.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.146+0000 7fadcdefd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.150+0000 7fadcdefd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:49.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.150+0000 7fadcdefd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.150+0000 7fadcdefd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:49.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.150+0000 7fadcdefd9c0 20 started sync module instance, tier type = 2024-09-12T18:47:49.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.150+0000 7fadcdefd9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:49.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.170+0000 7fadcdefd9c0 20 add_watcher() i=0 2024-09-12T18:47:49.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.170+0000 7fadcdefd9c0 20 add_watcher() i=1 2024-09-12T18:47:49.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.170+0000 7fadcdefd9c0 20 add_watcher() i=2 2024-09-12T18:47:49.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.170+0000 7fadcdefd9c0 20 add_watcher() i=3 2024-09-12T18:47:49.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.170+0000 7fadcdefd9c0 20 add_watcher() i=4 2024-09-12T18:47:49.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.170+0000 7fadcdefd9c0 20 add_watcher() i=5 2024-09-12T18:47:49.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.170+0000 7fadcdefd9c0 20 add_watcher() i=6 2024-09-12T18:47:49.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.174+0000 7fadcdefd9c0 20 add_watcher() i=7 2024-09-12T18:47:49.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.174+0000 7fadcdefd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:49.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.178+0000 7fac81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:49.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.178+0000 7fadcdefd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:49.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.178+0000 7fadcdefd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:49.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.178+0000 7fadcdefd9c0 5 note: GC not initialized 2024-09-12T18:47:49.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.178+0000 7fac80fe1640 20 reqs_thread_entry: start 2024-09-12T18:47:49.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.178+0000 7fadcdefd9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:49.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.178+0000 7fadcdefd9c0 20 Filter name: none 2024-09-12T18:47:49.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.178+0000 7fabfa7fc640 20 reqs_thread_entry: start 2024-09-12T18:47:49.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.178+0000 7fadcdefd9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T18:47:49.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.178+0000 7fadcdefd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.182+0000 7fadcdefd9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:49.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.182+0000 7fadcdefd9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T18:47:49.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.182+0000 7fadcdefd9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T18:47:49.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.182+0000 7fadcdefd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 : miss 2024-09-12T18:47:49.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.182+0000 7fadcdefd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.182+0000 7fadcdefd9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T18:47:49.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.182+0000 7fadcdefd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:49.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.182+0000 7fadcdefd9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:49.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.182+0000 7fadcdefd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:47:49.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.182+0000 7fadcdefd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:49.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.182+0000 7fadcdefd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 2024-09-12T18:47:49.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.182+0000 7fadcdefd9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:47:49.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.198+0000 7fadcdefd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:49.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.198+0000 7fadcdefd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:49.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.198+0000 7fadcdefd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:49.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.198+0000 7fadcdefd9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29, ofs0, ns] 2024-09-12T18:47:49.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.198+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 94730013033824 notifier 7203 bl.length()=915 2024-09-12T18:47:49.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.198+0000 7facaaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:49.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.198+0000 7facaaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:49.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.198+0000 7facaaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:49.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.198+0000 7fadcdefd9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_sources= new_sources= 2024-09-12T18:47:49.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.198+0000 7fadcdefd9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential sources added=[] removed=[] 2024-09-12T18:47:49.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.198+0000 7fadcdefd9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_dests= new_dests= 2024-09-12T18:47:49.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.198+0000 7fadcdefd9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential dests added=[] removed=[] 2024-09-12T18:47:49.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.0 2024-09-12T18:47:49.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.0 2024-09-12T18:47:49.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.1 2024-09-12T18:47:49.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.1 2024-09-12T18:47:49.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.2 2024-09-12T18:47:49.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.2 2024-09-12T18:47:49.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.3 2024-09-12T18:47:49.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.3 2024-09-12T18:47:49.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.4 2024-09-12T18:47:49.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.4 2024-09-12T18:47:49.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.5 2024-09-12T18:47:49.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.5 2024-09-12T18:47:49.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.6 2024-09-12T18:47:49.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.6 2024-09-12T18:47:49.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.7 2024-09-12T18:47:49.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.7 2024-09-12T18:47:49.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.8 2024-09-12T18:47:49.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.8 2024-09-12T18:47:49.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.9 2024-09-12T18:47:49.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.9 2024-09-12T18:47:49.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.10 2024-09-12T18:47:49.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.10 2024-09-12T18:47:49.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.11 2024-09-12T18:47:49.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2.11 2024-09-12T18:47:49.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.0 2024-09-12T18:47:49.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1 2024-09-12T18:47:49.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.210+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2 2024-09-12T18:47:49.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.214+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.3 2024-09-12T18:47:49.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.214+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.4 2024-09-12T18:47:49.219 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.214+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.5 2024-09-12T18:47:49.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.218+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.6 2024-09-12T18:47:49.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.218+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.7 2024-09-12T18:47:49.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.218+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.8 2024-09-12T18:47:49.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.222+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.9 2024-09-12T18:47:49.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.222+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.10 2024-09-12T18:47:49.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.230+0000 7fadcdefd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:49.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.230+0000 7fadcdefd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 2024-09-12T18:47:49.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.230+0000 7fadcdefd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:49.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.230+0000 7fadcdefd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:49.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.230+0000 7fadcdefd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:49.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.230+0000 7fadcdefd9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29, ofs0, ns] 2024-09-12T18:47:49.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.230+0000 7facaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 94730013033824 notifier 7203 bl.length()=915 2024-09-12T18:47:49.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.230+0000 7facaaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:49.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.230+0000 7facaaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:49.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.230+0000 7facaaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:49.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.234+0000 7fadcdefd9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_sources= new_sources= 2024-09-12T18:47:49.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.234+0000 7fadcdefd9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential sources added=[] removed=[] 2024-09-12T18:47:49.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.234+0000 7fadcdefd9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_dests= new_dests= 2024-09-12T18:47:49.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.234+0000 7fadcdefd9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential dests added=[] removed=[] 2024-09-12T18:47:49.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.238+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.0 2024-09-12T18:47:49.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.238+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.1 2024-09-12T18:47:49.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.238+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.2 2024-09-12T18:47:49.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.242+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.3 2024-09-12T18:47:49.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.242+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.4 2024-09-12T18:47:49.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.242+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.5 2024-09-12T18:47:49.247 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.242+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.6 2024-09-12T18:47:49.247 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.242+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.7 2024-09-12T18:47:49.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.246+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.8 2024-09-12T18:47:49.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.246+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.9 2024-09-12T18:47:49.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.246+0000 7fadcdefd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.29.10 2024-09-12T18:47:49.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.246+0000 7fadcdefd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:49.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.246+0000 7fadcdefd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 2024-09-12T18:47:49.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.250+0000 7fadcdefd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:49.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.250+0000 7fadcdefd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:49.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.250+0000 7fadcdefd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:49.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.250+0000 7fadcdefd9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29, ofs0, ns] 2024-09-12T18:47:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.250+0000 7facaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431592 cookie 94730013033824 notifier 7203 bl.length()=883 2024-09-12T18:47:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.250+0000 7facaa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 info.flags=0x17 2024-09-12T18:47:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.250+0000 7facaa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.29 to cache LRU end 2024-09-12T18:47:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.250+0000 7facaa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.250+0000 7fadcdefd9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_sources= new_sources= 2024-09-12T18:47:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.250+0000 7fadcdefd9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential sources added=[] removed=[] 2024-09-12T18:47:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.250+0000 7fadcdefd9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): orig_dests= new_dests= 2024-09-12T18:47:49.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.250+0000 7fadcdefd9c0 20 handle_bi_update(): bucket=:abort-at-block-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.29]): potential dests added=[] removed=[] 2024-09-12T18:47:49.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.258+0000 7fadcdefd9c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T18:47:49.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.262+0000 7fac81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:49.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.266+0000 7fadcdefd9c0 20 remove_watcher() i=0 2024-09-12T18:47:49.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.266+0000 7fadcdefd9c0 2 removed watcher, disabling cache 2024-09-12T18:47:49.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.270+0000 7fadcdefd9c0 20 remove_watcher() i=1 2024-09-12T18:47:49.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.270+0000 7fadcdefd9c0 20 remove_watcher() i=2 2024-09-12T18:47:49.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.274+0000 7fadcdefd9c0 20 remove_watcher() i=3 2024-09-12T18:47:49.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.274+0000 7fadcdefd9c0 20 remove_watcher() i=4 2024-09-12T18:47:49.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.278+0000 7fadcdefd9c0 20 remove_watcher() i=5 2024-09-12T18:47:49.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.278+0000 7fadcdefd9c0 20 remove_watcher() i=6 2024-09-12T18:47:49.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.278+0000 7fadcdefd9c0 20 remove_watcher() i=7 2024-09-12T18:47:49.300 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T18:47:49.330 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:49.330 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:49.377 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.374+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.374+0000 7f097ba819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:49.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.374+0000 7f097ba819c0 20 realm 2024-09-12T18:47:49.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.374+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.374+0000 7f097ba819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:49.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.374+0000 7f097ba819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:49.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.374+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.374+0000 7f097ba819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:49.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.374+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.378+0000 7f097ba819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:49.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.378+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.378+0000 7f097ba819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:49.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.378+0000 7f097ba819c0 20 searching for the correct realm 2024-09-12T18:47:49.385 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.382+0000 7f0979d88640 0 -- 172.21.15.111:0/40479542 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f096401a040 msgr2=0x7f096405d850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:49.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.390+0000 7f0978d86640 0 -- 172.21.15.111:0/40479542 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f097406dbe0 msgr2=0x7f097408b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:49.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.606+0000 7f097ba819c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:49.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.606+0000 7f097ba819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:49.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.606+0000 7f097ba819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:49.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.606+0000 7f097ba819c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:49.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.606+0000 7f097ba819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:49.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.606+0000 7f097ba819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:49.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.606+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.606+0000 7f097ba819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:49.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.606+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:49.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:49.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 20 zone default found 2024-09-12T18:47:49.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 4 Realm: () 2024-09-12T18:47:49.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:49.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:49.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:49.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 20 zonegroup default 2024-09-12T18:47:49.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:49.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:49.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:49.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 20 started sync module instance, tier type = 2024-09-12T18:47:49.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.610+0000 7f097ba819c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:49.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.634+0000 7f097ba819c0 20 add_watcher() i=0 2024-09-12T18:47:49.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.634+0000 7f097ba819c0 20 add_watcher() i=1 2024-09-12T18:47:49.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.634+0000 7f097ba819c0 20 add_watcher() i=2 2024-09-12T18:47:49.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.634+0000 7f097ba819c0 20 add_watcher() i=3 2024-09-12T18:47:49.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.634+0000 7f097ba819c0 20 add_watcher() i=4 2024-09-12T18:47:49.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.634+0000 7f097ba819c0 20 add_watcher() i=5 2024-09-12T18:47:49.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.634+0000 7f097ba819c0 20 add_watcher() i=6 2024-09-12T18:47:49.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.638+0000 7f097ba819c0 20 add_watcher() i=7 2024-09-12T18:47:49.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.638+0000 7f097ba819c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:49.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.642+0000 7f082f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:49.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.642+0000 7f097ba819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:49.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.642+0000 7f097ba819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:49.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.642+0000 7f097ba819c0 5 note: GC not initialized 2024-09-12T18:47:49.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.642+0000 7f082e7e4640 20 reqs_thread_entry: start 2024-09-12T18:47:49.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.642+0000 7f097ba819c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:49.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.642+0000 7f097ba819c0 20 Filter name: none 2024-09-12T18:47:49.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.642+0000 7f079ffff640 20 reqs_thread_entry: start 2024-09-12T18:47:49.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.642+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.646+0000 7f097ba819c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:49.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.646+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.646+0000 7f097ba819c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:49.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.646+0000 7f097ba819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:49.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.646+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.646+0000 7f097ba819c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:47:49.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.646+0000 7f097ba819c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:49.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.646+0000 7f097ba819c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T18:47:49.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.646+0000 7f097ba819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:49.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.650+0000 7f082f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:49.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.654+0000 7f097ba819c0 20 remove_watcher() i=0 2024-09-12T18:47:49.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.654+0000 7f097ba819c0 2 removed watcher, disabling cache 2024-09-12T18:47:49.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.658+0000 7f097ba819c0 20 remove_watcher() i=1 2024-09-12T18:47:49.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.662+0000 7f097ba819c0 20 remove_watcher() i=2 2024-09-12T18:47:49.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.662+0000 7f097ba819c0 20 remove_watcher() i=3 2024-09-12T18:47:49.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.666+0000 7f097ba819c0 20 remove_watcher() i=4 2024-09-12T18:47:49.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.666+0000 7f097ba819c0 20 remove_watcher() i=5 2024-09-12T18:47:49.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.670+0000 7f097ba819c0 20 remove_watcher() i=6 2024-09-12T18:47:49.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:49.670+0000 7f097ba819c0 20 remove_watcher() i=7 2024-09-12T18:47:49.692 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:49.692 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:47:49.692 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-block-writes id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:47:49.692 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:49.693 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:49.693 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:49.697 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:49.697 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:49.742 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:49.742 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:49.796 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T18:47:49.796 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:49.797 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:49.798 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:49.818 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:49.819 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:49.864 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:49.864 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:49.882 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:49.882 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:49.901 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:49.901 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:49.922 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:49.922 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:49.941 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:49.941 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:49.961 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:49.961 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:49.982 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:49.982 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:50.002 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:50.002 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:50.022 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:50.022 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:50.040 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:50.040 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:50.059 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:50.059 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:50.077 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:50.077 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:50.096 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:50.096 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:50.115 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:50.115 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:50.134 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:50.134 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:50.153 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:50.154 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:50.173 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:50.173 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:50.193 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:50.193 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:50.212 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:50.212 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:50.232 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:50.232 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:50.249 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:47:50.282 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:50.282 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:50.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.322+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.326+0000 7f2c157b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:50.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.326+0000 7f2c157b09c0 20 realm 2024-09-12T18:47:50.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.326+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.326+0000 7f2c157b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:50.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.326+0000 7f2c157b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:50.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.326+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.326+0000 7f2c157b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:50.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.326+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.326+0000 7f2c157b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:50.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.326+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.330+0000 7f2c157b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:50.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.330+0000 7f2c157b09c0 20 searching for the correct realm 2024-09-12T18:47:50.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.334+0000 7f2c13ab7640 0 -- 172.21.15.111:0/521215565 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f2c08116280 msgr2=0x7f2c080f7b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:47:50.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.338+0000 7f2c12ab5640 0 -- 172.21.15.111:0/521215565 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f2c0c0995f0 msgr2=0x7f2c0c0976c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:50.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.554+0000 7f2c157b09c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:50.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.554+0000 7f2c157b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:50.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.554+0000 7f2c157b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:50.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.554+0000 7f2c157b09c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:50.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.554+0000 7f2c157b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:50.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.554+0000 7f2c157b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:50.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.554+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.559 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.554+0000 7f2c157b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:50.559 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.554+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.559 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.554+0000 7f2c157b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:50.559 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.554+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:50.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 20 zone default found 2024-09-12T18:47:50.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 4 Realm: () 2024-09-12T18:47:50.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:50.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:50.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:50.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 20 zonegroup default 2024-09-12T18:47:50.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:50.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:50.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:50.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 20 started sync module instance, tier type = 2024-09-12T18:47:50.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.558+0000 7f2c157b09c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:50.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.582+0000 7f2c157b09c0 20 add_watcher() i=0 2024-09-12T18:47:50.585 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.582+0000 7f2c157b09c0 20 add_watcher() i=1 2024-09-12T18:47:50.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.582+0000 7f2c157b09c0 20 add_watcher() i=2 2024-09-12T18:47:50.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.582+0000 7f2c157b09c0 20 add_watcher() i=3 2024-09-12T18:47:50.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.582+0000 7f2c157b09c0 20 add_watcher() i=4 2024-09-12T18:47:50.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.582+0000 7f2c157b09c0 20 add_watcher() i=5 2024-09-12T18:47:50.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.582+0000 7f2c157b09c0 20 add_watcher() i=6 2024-09-12T18:47:50.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.582+0000 7f2c157b09c0 20 add_watcher() i=7 2024-09-12T18:47:50.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.582+0000 7f2c157b09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:50.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.586+0000 7f2ac9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:50.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.590+0000 7f2c157b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:50.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.590+0000 7f2c157b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:50.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.590+0000 7f2c157b09c0 5 note: GC not initialized 2024-09-12T18:47:50.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.590+0000 7f2ac8fe1640 20 reqs_thread_entry: start 2024-09-12T18:47:50.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.590+0000 7f2c157b09c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:50.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.590+0000 7f2c157b09c0 20 Filter name: none 2024-09-12T18:47:50.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.590+0000 7f2a427fc640 20 reqs_thread_entry: start 2024-09-12T18:47:50.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.590+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.590+0000 7f2c157b09c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:50.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.590+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.594+0000 7f2c157b09c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:50.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.594+0000 7f2c157b09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:50.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.594+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.594+0000 7f2c157b09c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:50.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.594+0000 7f2c157b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.594+0000 7f2c157b09c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:50.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.594+0000 7f2c157b09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:50.601 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.598+0000 7f2ac9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:50.606 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.602+0000 7f2c157b09c0 20 remove_watcher() i=0 2024-09-12T18:47:50.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.602+0000 7f2c157b09c0 2 removed watcher, disabling cache 2024-09-12T18:47:50.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.606+0000 7f2c157b09c0 20 remove_watcher() i=1 2024-09-12T18:47:50.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.606+0000 7f2c157b09c0 20 remove_watcher() i=2 2024-09-12T18:47:50.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.610+0000 7f2c157b09c0 20 remove_watcher() i=3 2024-09-12T18:47:50.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.610+0000 7f2c157b09c0 20 remove_watcher() i=4 2024-09-12T18:47:50.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.614+0000 7f2c157b09c0 20 remove_watcher() i=5 2024-09-12T18:47:50.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.614+0000 7f2c157b09c0 20 remove_watcher() i=6 2024-09-12T18:47:50.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.614+0000 7f2c157b09c0 20 remove_watcher() i=7 2024-09-12T18:47:50.634 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:50.634 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:47:50.634 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-commit-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:47:50.634 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:50.635 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T18:47:50.671 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:50.671 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:50.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.714+0000 7f38f83419c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.714+0000 7f38f83419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:50.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.714+0000 7f38f83419c0 20 realm 2024-09-12T18:47:50.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.714+0000 7f38f83419c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.714+0000 7f38f83419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:50.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.714+0000 7f38f83419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:50.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.714+0000 7f38f83419c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.714+0000 7f38f83419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:50.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.714+0000 7f38f83419c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.718+0000 7f38f83419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:50.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.718+0000 7f38f83419c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.718+0000 7f38f83419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:50.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.718+0000 7f38f83419c0 20 searching for the correct realm 2024-09-12T18:47:50.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.718+0000 7f38f5646640 0 -- 172.21.15.111:0/1214745127 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f38e801d060 msgr2=0x7f38e8078470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:50.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.934+0000 7f38f5e47640 0 -- 172.21.15.111:0/1214745127 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f38f0035060 msgr2=0x7f38f0062210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:50.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:50.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:50.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:50.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:50.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:50.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:50.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:50.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:50.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:50.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 zone default found 2024-09-12T18:47:50.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 4 Realm: () 2024-09-12T18:47:50.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:50.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:50.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:50.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 zonegroup default 2024-09-12T18:47:50.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:50.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.950+0000 7f38f83419c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.954+0000 7f38f83419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:50.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.954+0000 7f38f83419c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.954+0000 7f38f83419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:50.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.954+0000 7f38f83419c0 20 started sync module instance, tier type = 2024-09-12T18:47:50.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.954+0000 7f38f83419c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:50.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.974+0000 7f38f83419c0 20 add_watcher() i=0 2024-09-12T18:47:50.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.974+0000 7f38f83419c0 20 add_watcher() i=1 2024-09-12T18:47:50.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.974+0000 7f38f83419c0 20 add_watcher() i=2 2024-09-12T18:47:50.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.974+0000 7f38f83419c0 20 add_watcher() i=3 2024-09-12T18:47:50.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.974+0000 7f38f83419c0 20 add_watcher() i=4 2024-09-12T18:47:50.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.974+0000 7f38f83419c0 20 add_watcher() i=5 2024-09-12T18:47:50.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.974+0000 7f38f83419c0 20 add_watcher() i=6 2024-09-12T18:47:50.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.974+0000 7f38f83419c0 20 add_watcher() i=7 2024-09-12T18:47:50.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.974+0000 7f38f83419c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:50.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.978+0000 7f37a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:50.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.978+0000 7f38f83419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:50.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.978+0000 7f38f83419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:50.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.978+0000 7f38f83419c0 5 note: GC not initialized 2024-09-12T18:47:50.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.978+0000 7f37a67fc640 20 reqs_thread_entry: start 2024-09-12T18:47:50.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:50.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 20 Filter name: none 2024-09-12T18:47:50.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f371bfff640 20 reqs_thread_entry: start 2024-09-12T18:47:50.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T18:47:50.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:50.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T18:47:50.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T18:47:50.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 : miss 2024-09-12T18:47:50.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:50.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:50.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 info.flags=0x17 2024-09-12T18:47:50.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 to cache LRU end 2024-09-12T18:47:50.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:47:50.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:50.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.982+0000 7f38f83419c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 2024-09-12T18:47:50.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.990+0000 7f38f83419c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 info.flags=0x17 2024-09-12T18:47:50.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.990+0000 7f38f83419c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 to cache LRU end 2024-09-12T18:47:50.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.990+0000 7f38f83419c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:50.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.990+0000 7f38f83419c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30, ofs0, ns] 2024-09-12T18:47:50.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.990+0000 7f37d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431576 cookie 94354149367216 notifier 7260 bl.length()=931 2024-09-12T18:47:50.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.990+0000 7f37d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 info.flags=0x17 2024-09-12T18:47:50.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.990+0000 7f37d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 to cache LRU end 2024-09-12T18:47:50.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.990+0000 7f37d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:50.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.994+0000 7f38f83419c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): orig_sources= new_sources= 2024-09-12T18:47:50.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.994+0000 7f38f83419c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): potential sources added=[] removed=[] 2024-09-12T18:47:50.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.994+0000 7f38f83419c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): orig_dests= new_dests= 2024-09-12T18:47:50.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:50.994+0000 7f38f83419c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): potential dests added=[] removed=[] 2024-09-12T18:47:51.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.0 2024-09-12T18:47:51.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.0 2024-09-12T18:47:51.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.1 2024-09-12T18:47:51.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.1 2024-09-12T18:47:51.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.2 2024-09-12T18:47:51.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.2 2024-09-12T18:47:51.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.3 2024-09-12T18:47:51.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.3 2024-09-12T18:47:51.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.4 2024-09-12T18:47:51.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.4 2024-09-12T18:47:51.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.5 2024-09-12T18:47:51.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.5 2024-09-12T18:47:51.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.6 2024-09-12T18:47:51.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.6 2024-09-12T18:47:51.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.7 2024-09-12T18:47:51.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.7 2024-09-12T18:47:51.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.8 2024-09-12T18:47:51.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.8 2024-09-12T18:47:51.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.9 2024-09-12T18:47:51.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.9 2024-09-12T18:47:51.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.10 2024-09-12T18:47:51.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.10 2024-09-12T18:47:51.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.11 2024-09-12T18:47:51.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1.11 2024-09-12T18:47:51.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.0 2024-09-12T18:47:51.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1 2024-09-12T18:47:51.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.006+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2 2024-09-12T18:47:51.012 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.010+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.3 2024-09-12T18:47:51.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.010+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.4 2024-09-12T18:47:51.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.010+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.5 2024-09-12T18:47:51.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.014+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.6 2024-09-12T18:47:51.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.014+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.7 2024-09-12T18:47:51.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.014+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.8 2024-09-12T18:47:51.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.018+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.9 2024-09-12T18:47:51.021 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.018+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.10 2024-09-12T18:47:51.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.026+0000 7f38f83419c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:51.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.026+0000 7f38f83419c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 2024-09-12T18:47:51.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.026+0000 7f38f83419c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 info.flags=0x17 2024-09-12T18:47:51.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.026+0000 7f38f83419c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 to cache LRU end 2024-09-12T18:47:51.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.026+0000 7f38f83419c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:51.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.026+0000 7f38f83419c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30, ofs0, ns] 2024-09-12T18:47:51.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.026+0000 7f37d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431577 cookie 94354149367216 notifier 7260 bl.length()=931 2024-09-12T18:47:51.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.026+0000 7f37d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 info.flags=0x17 2024-09-12T18:47:51.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.026+0000 7f37d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 to cache LRU end 2024-09-12T18:47:51.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.026+0000 7f37d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:51.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.026+0000 7f38f83419c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): orig_sources= new_sources= 2024-09-12T18:47:51.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.026+0000 7f38f83419c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): potential sources added=[] removed=[] 2024-09-12T18:47:51.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.026+0000 7f38f83419c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): orig_dests= new_dests= 2024-09-12T18:47:51.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.026+0000 7f38f83419c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): potential dests added=[] removed=[] 2024-09-12T18:47:51.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.034+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.0 2024-09-12T18:47:51.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.034+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1 2024-09-12T18:47:51.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.034+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2 2024-09-12T18:47:51.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.034+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.3 2024-09-12T18:47:51.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.038+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.4 2024-09-12T18:47:51.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.038+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.5 2024-09-12T18:47:51.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.038+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.6 2024-09-12T18:47:51.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.038+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.7 2024-09-12T18:47:51.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.042+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.8 2024-09-12T18:47:51.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.042+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.9 2024-09-12T18:47:51.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.042+0000 7f38f83419c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.10 2024-09-12T18:47:51.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.042+0000 7f38f83419c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T18:47:51.047 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.042+0000 7f38f83419c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T18:47:51.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.054+0000 7f37a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:51.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.058+0000 7f38f83419c0 20 remove_watcher() i=0 2024-09-12T18:47:51.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.058+0000 7f38f83419c0 2 removed watcher, disabling cache 2024-09-12T18:47:51.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.062+0000 7f38f83419c0 20 remove_watcher() i=1 2024-09-12T18:47:51.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.062+0000 7f38f83419c0 20 remove_watcher() i=2 2024-09-12T18:47:51.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.066+0000 7f38f83419c0 20 remove_watcher() i=3 2024-09-12T18:47:51.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.066+0000 7f38f83419c0 20 remove_watcher() i=4 2024-09-12T18:47:51.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.070+0000 7f38f83419c0 20 remove_watcher() i=5 2024-09-12T18:47:51.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.070+0000 7f38f83419c0 20 remove_watcher() i=6 2024-09-12T18:47:51.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.074+0000 7f38f83419c0 20 remove_watcher() i=7 2024-09-12T18:47:51.096 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:47:51.128 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:51.128 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:51.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.170+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.170+0000 7f4f96d6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:51.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.170+0000 7f4f96d6d9c0 20 realm 2024-09-12T18:47:51.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.170+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.170+0000 7f4f96d6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:51.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.170+0000 7f4f96d6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:51.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.170+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.170+0000 7f4f96d6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:51.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.170+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.174+0000 7f4f96d6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:51.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.174+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.174+0000 7f4f96d6d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:51.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.174+0000 7f4f96d6d9c0 20 searching for the correct realm 2024-09-12T18:47:51.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.178+0000 7f4f94873640 0 -- 172.21.15.111:0/3021297252 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f4f8402f060 msgr2=0x7f4f840903f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:51.189 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.186+0000 7f4f94072640 0 -- 172.21.15.111:0/3021297252 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f4f840885f0 msgr2=0x7f4f8408e1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:47:51.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.402+0000 7f4f96d6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:51.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.402+0000 7f4f96d6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:51.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.402+0000 7f4f96d6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:51.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.402+0000 7f4f96d6d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:51.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.402+0000 7f4f96d6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:51.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.402+0000 7f4f96d6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:51.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.402+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.406+0000 7f4f96d6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:51.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.406+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.406+0000 7f4f96d6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:51.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.406+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.406+0000 7f4f96d6d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:51.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.406+0000 7f4f96d6d9c0 20 zone default found 2024-09-12T18:47:51.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.406+0000 7f4f96d6d9c0 4 Realm: () 2024-09-12T18:47:51.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.406+0000 7f4f96d6d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:51.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.406+0000 7f4f96d6d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:51.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.406+0000 7f4f96d6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:51.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.406+0000 7f4f96d6d9c0 20 zonegroup default 2024-09-12T18:47:51.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.406+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.406+0000 7f4f96d6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:51.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.406+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.410+0000 7f4f96d6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:51.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.410+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.410+0000 7f4f96d6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:51.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.410+0000 7f4f96d6d9c0 20 started sync module instance, tier type = 2024-09-12T18:47:51.413 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.410+0000 7f4f96d6d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:51.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.434+0000 7f4f96d6d9c0 20 add_watcher() i=0 2024-09-12T18:47:51.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.434+0000 7f4f96d6d9c0 20 add_watcher() i=1 2024-09-12T18:47:51.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.434+0000 7f4f96d6d9c0 20 add_watcher() i=2 2024-09-12T18:47:51.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.434+0000 7f4f96d6d9c0 20 add_watcher() i=3 2024-09-12T18:47:51.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.434+0000 7f4f96d6d9c0 20 add_watcher() i=4 2024-09-12T18:47:51.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.434+0000 7f4f96d6d9c0 20 add_watcher() i=5 2024-09-12T18:47:51.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.434+0000 7f4f96d6d9c0 20 add_watcher() i=6 2024-09-12T18:47:51.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.434+0000 7f4f96d6d9c0 20 add_watcher() i=7 2024-09-12T18:47:51.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.434+0000 7f4f96d6d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:51.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.438+0000 7f4e4afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:51.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.438+0000 7f4f96d6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:51.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.438+0000 7f4f96d6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:51.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.442+0000 7f4f96d6d9c0 5 note: GC not initialized 2024-09-12T18:47:51.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.442+0000 7f4e49fe3640 20 reqs_thread_entry: start 2024-09-12T18:47:51.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.442+0000 7f4f96d6d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:51.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.442+0000 7f4f96d6d9c0 20 Filter name: none 2024-09-12T18:47:51.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.442+0000 7f4dbb7fe640 20 reqs_thread_entry: start 2024-09-12T18:47:51.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.442+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.442+0000 7f4f96d6d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:51.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.442+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.442+0000 7f4f96d6d9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:47:51.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.442+0000 7f4f96d6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:51.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.442+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.446+0000 7f4f96d6d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:51.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.446+0000 7f4f96d6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.446+0000 7f4f96d6d9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:47:51.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.446+0000 7f4f96d6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:51.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.450+0000 7f4e4afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:51.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.454+0000 7f4f96d6d9c0 20 remove_watcher() i=0 2024-09-12T18:47:51.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.454+0000 7f4f96d6d9c0 2 removed watcher, disabling cache 2024-09-12T18:47:51.460 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.458+0000 7f4f96d6d9c0 20 remove_watcher() i=1 2024-09-12T18:47:51.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.458+0000 7f4f96d6d9c0 20 remove_watcher() i=2 2024-09-12T18:47:51.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.462+0000 7f4f96d6d9c0 20 remove_watcher() i=3 2024-09-12T18:47:51.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.462+0000 7f4f96d6d9c0 20 remove_watcher() i=4 2024-09-12T18:47:51.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.466+0000 7f4f96d6d9c0 20 remove_watcher() i=5 2024-09-12T18:47:51.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.466+0000 7f4f96d6d9c0 20 remove_watcher() i=6 2024-09-12T18:47:51.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.470+0000 7f4f96d6d9c0 20 remove_watcher() i=7 2024-09-12T18:47:51.489 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:51.489 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:47:51.489 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-commit-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:47:51.490 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:51.491 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:51.491 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:51.507 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:51.507 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:51.554 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:47:51.590 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:51.590 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:51.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.630+0000 7f0bc07929c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.634+0000 7f0bc07929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:51.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.634+0000 7f0bc07929c0 20 realm 2024-09-12T18:47:51.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.634+0000 7f0bc07929c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.634+0000 7f0bc07929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:51.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.634+0000 7f0bc07929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:51.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.634+0000 7f0bc07929c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.634+0000 7f0bc07929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:51.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.634+0000 7f0bc07929c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.634+0000 7f0bc07929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:51.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.634+0000 7f0bc07929c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:51.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.634+0000 7f0bc07929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:51.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.634+0000 7f0bc07929c0 20 searching for the correct realm 2024-09-12T18:47:51.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.638+0000 7f0bbea99640 0 -- 172.21.15.111:0/4218532734 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f0ba8004040 msgr2=0x7f0ba80db920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:51.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:51.854+0000 7f0bbda97640 0 -- 172.21.15.111:0/4218532734 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f0bb00817c0 msgr2=0x7f0bb001ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:52.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.070+0000 7f0bc07929c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:52.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.070+0000 7f0bc07929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:52.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.070+0000 7f0bc07929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:52.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.070+0000 7f0bc07929c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:52.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.070+0000 7f0bc07929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:52.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.070+0000 7f0bc07929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:52.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.070+0000 7f0bc07929c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.070+0000 7f0bc07929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:52.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.070+0000 7f0bc07929c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:52.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:52.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 20 zone default found 2024-09-12T18:47:52.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 4 Realm: () 2024-09-12T18:47:52.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:52.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:52.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:52.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 20 zonegroup default 2024-09-12T18:47:52.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:52.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:52.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:52.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 20 started sync module instance, tier type = 2024-09-12T18:47:52.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.074+0000 7f0bc07929c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:52.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.098+0000 7f0bc07929c0 20 add_watcher() i=0 2024-09-12T18:47:52.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.098+0000 7f0bc07929c0 20 add_watcher() i=1 2024-09-12T18:47:52.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.098+0000 7f0bc07929c0 20 add_watcher() i=2 2024-09-12T18:47:52.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.098+0000 7f0bc07929c0 20 add_watcher() i=3 2024-09-12T18:47:52.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.098+0000 7f0bc07929c0 20 add_watcher() i=4 2024-09-12T18:47:52.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.098+0000 7f0bc07929c0 20 add_watcher() i=5 2024-09-12T18:47:52.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.098+0000 7f0bc07929c0 20 add_watcher() i=6 2024-09-12T18:47:52.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.102+0000 7f0bc07929c0 20 add_watcher() i=7 2024-09-12T18:47:52.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.102+0000 7f0bc07929c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:52.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.106+0000 7f0a74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:52.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.106+0000 7f0bc07929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:52.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.106+0000 7f0bc07929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:52.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.106+0000 7f0bc07929c0 5 note: GC not initialized 2024-09-12T18:47:52.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.106+0000 7f09ef7fe640 20 reqs_thread_entry: start 2024-09-12T18:47:52.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.106+0000 7f0bc07929c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:52.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.106+0000 7f0bc07929c0 20 Filter name: none 2024-09-12T18:47:52.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.106+0000 7f09ed7fa640 20 reqs_thread_entry: start 2024-09-12T18:47:52.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.106+0000 7f0bc07929c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T18:47:52.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.106+0000 7f0bc07929c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.110+0000 7f0bc07929c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:52.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.110+0000 7f0bc07929c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T18:47:52.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.110+0000 7f0bc07929c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T18:47:52.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.110+0000 7f0bc07929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 : miss 2024-09-12T18:47:52.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.110+0000 7f0bc07929c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.110+0000 7f0bc07929c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:47:52.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.110+0000 7f0bc07929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 info.flags=0x17 2024-09-12T18:47:52.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.110+0000 7f0bc07929c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 to cache LRU end 2024-09-12T18:47:52.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.110+0000 7f0bc07929c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:47:52.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.110+0000 7f0bc07929c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:52.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.110+0000 7f0bc07929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 2024-09-12T18:47:52.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.110+0000 7f0bc07929c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:47:52.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.122+0000 7f0bc07929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 info.flags=0x17 2024-09-12T18:47:52.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.122+0000 7f0bc07929c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 to cache LRU end 2024-09-12T18:47:52.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.122+0000 7f0bc07929c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:52.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.122+0000 7f0bc07929c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30, ofs0, ns] 2024-09-12T18:47:52.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.122+0000 7f0aa1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431578 cookie 94322279677712 notifier 6842 bl.length()=931 2024-09-12T18:47:52.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.122+0000 7f0aa1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 info.flags=0x17 2024-09-12T18:47:52.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.122+0000 7f0aa1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 to cache LRU end 2024-09-12T18:47:52.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.122+0000 7f0aa1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:52.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.126+0000 7f0bc07929c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): orig_sources= new_sources= 2024-09-12T18:47:52.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.126+0000 7f0bc07929c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): potential sources added=[] removed=[] 2024-09-12T18:47:52.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.126+0000 7f0bc07929c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): orig_dests= new_dests= 2024-09-12T18:47:52.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.126+0000 7f0bc07929c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): potential dests added=[] removed=[] 2024-09-12T18:47:52.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.0 2024-09-12T18:47:52.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.0 2024-09-12T18:47:52.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.1 2024-09-12T18:47:52.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.1 2024-09-12T18:47:52.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.2 2024-09-12T18:47:52.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.2 2024-09-12T18:47:52.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.3 2024-09-12T18:47:52.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.3 2024-09-12T18:47:52.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.4 2024-09-12T18:47:52.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.4 2024-09-12T18:47:52.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.5 2024-09-12T18:47:52.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.5 2024-09-12T18:47:52.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.6 2024-09-12T18:47:52.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.6 2024-09-12T18:47:52.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.7 2024-09-12T18:47:52.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.7 2024-09-12T18:47:52.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.8 2024-09-12T18:47:52.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.8 2024-09-12T18:47:52.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.9 2024-09-12T18:47:52.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.9 2024-09-12T18:47:52.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.10 2024-09-12T18:47:52.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.10 2024-09-12T18:47:52.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.11 2024-09-12T18:47:52.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2.11 2024-09-12T18:47:52.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.0 2024-09-12T18:47:52.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1 2024-09-12T18:47:52.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2 2024-09-12T18:47:52.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.138+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.3 2024-09-12T18:47:52.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.142+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.4 2024-09-12T18:47:52.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.142+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.5 2024-09-12T18:47:52.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.142+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.6 2024-09-12T18:47:52.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.146+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.7 2024-09-12T18:47:52.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.146+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.8 2024-09-12T18:47:52.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.146+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.9 2024-09-12T18:47:52.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.146+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.10 2024-09-12T18:47:52.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.154+0000 7f0bc07929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:52.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.154+0000 7f0bc07929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 2024-09-12T18:47:52.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.154+0000 7f0bc07929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 info.flags=0x17 2024-09-12T18:47:52.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.154+0000 7f0bc07929c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 to cache LRU end 2024-09-12T18:47:52.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.154+0000 7f0bc07929c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:52.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.154+0000 7f0bc07929c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30, ofs0, ns] 2024-09-12T18:47:52.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.154+0000 7f0aa17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431579 cookie 94322279677712 notifier 6842 bl.length()=931 2024-09-12T18:47:52.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.154+0000 7f0aa17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 info.flags=0x17 2024-09-12T18:47:52.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.154+0000 7f0aa17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 to cache LRU end 2024-09-12T18:47:52.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.154+0000 7f0aa17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:52.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.158+0000 7f0bc07929c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): orig_sources= new_sources= 2024-09-12T18:47:52.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.158+0000 7f0bc07929c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): potential sources added=[] removed=[] 2024-09-12T18:47:52.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.158+0000 7f0bc07929c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): orig_dests= new_dests= 2024-09-12T18:47:52.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.158+0000 7f0bc07929c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): potential dests added=[] removed=[] 2024-09-12T18:47:52.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.162+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.0 2024-09-12T18:47:52.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.162+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.1 2024-09-12T18:47:52.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.166+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.2 2024-09-12T18:47:52.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.166+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.3 2024-09-12T18:47:52.170 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.166+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.4 2024-09-12T18:47:52.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.166+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.5 2024-09-12T18:47:52.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.166+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.6 2024-09-12T18:47:52.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.170+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.7 2024-09-12T18:47:52.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.170+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.8 2024-09-12T18:47:52.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.170+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.9 2024-09-12T18:47:52.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.170+0000 7f0bc07929c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.30.10 2024-09-12T18:47:52.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.170+0000 7f0bc07929c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:52.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.170+0000 7f0bc07929c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 2024-09-12T18:47:52.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.174+0000 7f0bc07929c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 info.flags=0x17 2024-09-12T18:47:52.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.174+0000 7f0bc07929c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 to cache LRU end 2024-09-12T18:47:52.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.174+0000 7f0bc07929c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:52.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.174+0000 7f0bc07929c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30, ofs0, ns] 2024-09-12T18:47:52.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.174+0000 7f0aa1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431580 cookie 94322279677712 notifier 6842 bl.length()=899 2024-09-12T18:47:52.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.174+0000 7f0aa1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 info.flags=0x17 2024-09-12T18:47:52.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.174+0000 7f0aa1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.30 to cache LRU end 2024-09-12T18:47:52.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.174+0000 7f0aa1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:52.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.174+0000 7f0bc07929c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): orig_sources= new_sources= 2024-09-12T18:47:52.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.174+0000 7f0bc07929c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): potential sources added=[] removed=[] 2024-09-12T18:47:52.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.174+0000 7f0bc07929c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): orig_dests= new_dests= 2024-09-12T18:47:52.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.174+0000 7f0bc07929c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.30]): potential dests added=[] removed=[] 2024-09-12T18:47:52.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.182+0000 7f0bc07929c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T18:47:52.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.182+0000 7f0a74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:52.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.190+0000 7f0bc07929c0 20 remove_watcher() i=0 2024-09-12T18:47:52.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.190+0000 7f0bc07929c0 2 removed watcher, disabling cache 2024-09-12T18:47:52.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.190+0000 7f0bc07929c0 20 remove_watcher() i=1 2024-09-12T18:47:52.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.194+0000 7f0bc07929c0 20 remove_watcher() i=2 2024-09-12T18:47:52.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.194+0000 7f0bc07929c0 20 remove_watcher() i=3 2024-09-12T18:47:52.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.198+0000 7f0bc07929c0 20 remove_watcher() i=4 2024-09-12T18:47:52.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.198+0000 7f0bc07929c0 20 remove_watcher() i=5 2024-09-12T18:47:52.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.202+0000 7f0bc07929c0 20 remove_watcher() i=6 2024-09-12T18:47:52.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.202+0000 7f0bc07929c0 20 remove_watcher() i=7 2024-09-12T18:47:52.222 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:47:52.252 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:52.252 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:52.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.294+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.294+0000 7f83bc65d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:52.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.294+0000 7f83bc65d9c0 20 realm 2024-09-12T18:47:52.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.294+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.294+0000 7f83bc65d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:52.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.294+0000 7f83bc65d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:52.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.294+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.294+0000 7f83bc65d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:52.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.294+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.298+0000 7f83bc65d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:52.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.298+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.298+0000 7f83bc65d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:52.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.298+0000 7f83bc65d9c0 20 searching for the correct realm 2024-09-12T18:47:52.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.302+0000 7f83ba964640 0 -- 172.21.15.111:0/2186487957 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f83a40d87c0 msgr2=0x7f83a40ac410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:52.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.518+0000 7f83b9962640 0 -- 172.21.15.111:0/2186487957 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f83b4079970 msgr2=0x7f83b4095960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:52.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.734+0000 7f83bc65d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:52.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.734+0000 7f83bc65d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:52.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.734+0000 7f83bc65d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:52.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.734+0000 7f83bc65d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:52.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.734+0000 7f83bc65d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:52.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.734+0000 7f83bc65d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:52.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.734+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.738+0000 7f83bc65d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:52.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.738+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.738+0000 7f83bc65d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:52.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.738+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.738+0000 7f83bc65d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:52.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.738+0000 7f83bc65d9c0 20 zone default found 2024-09-12T18:47:52.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.738+0000 7f83bc65d9c0 4 Realm: () 2024-09-12T18:47:52.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.738+0000 7f83bc65d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:52.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.738+0000 7f83bc65d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:52.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.738+0000 7f83bc65d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:52.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.738+0000 7f83bc65d9c0 20 zonegroup default 2024-09-12T18:47:52.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.738+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.738+0000 7f83bc65d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:52.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.738+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.742+0000 7f83bc65d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:52.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.742+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.742+0000 7f83bc65d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:52.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.742+0000 7f83bc65d9c0 20 started sync module instance, tier type = 2024-09-12T18:47:52.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.742+0000 7f83bc65d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:52.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.766+0000 7f83bc65d9c0 20 add_watcher() i=0 2024-09-12T18:47:52.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.766+0000 7f83bc65d9c0 20 add_watcher() i=1 2024-09-12T18:47:52.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.766+0000 7f83bc65d9c0 20 add_watcher() i=2 2024-09-12T18:47:52.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.766+0000 7f83bc65d9c0 20 add_watcher() i=3 2024-09-12T18:47:52.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.766+0000 7f83bc65d9c0 20 add_watcher() i=4 2024-09-12T18:47:52.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.766+0000 7f83bc65d9c0 20 add_watcher() i=5 2024-09-12T18:47:52.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.766+0000 7f83bc65d9c0 20 add_watcher() i=6 2024-09-12T18:47:52.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.766+0000 7f83bc65d9c0 20 add_watcher() i=7 2024-09-12T18:47:52.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.766+0000 7f83bc65d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:52.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.770+0000 7f8270fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:52.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.774+0000 7f83bc65d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:52.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.774+0000 7f83bc65d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:52.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.774+0000 7f83bc65d9c0 5 note: GC not initialized 2024-09-12T18:47:52.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.774+0000 7f81eb7fe640 20 reqs_thread_entry: start 2024-09-12T18:47:52.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.774+0000 7f83bc65d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:52.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.774+0000 7f83bc65d9c0 20 Filter name: none 2024-09-12T18:47:52.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.774+0000 7f81e97fa640 20 reqs_thread_entry: start 2024-09-12T18:47:52.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.774+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.774+0000 7f83bc65d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:52.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.774+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.774+0000 7f83bc65d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:52.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.774+0000 7f83bc65d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:52.780 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.774+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.778+0000 7f83bc65d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:52.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.778+0000 7f83bc65d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:52.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.778+0000 7f83bc65d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:52.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.778+0000 7f83bc65d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:52.785 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.782+0000 7f8270fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:52.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.786+0000 7f83bc65d9c0 20 remove_watcher() i=0 2024-09-12T18:47:52.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.786+0000 7f83bc65d9c0 2 removed watcher, disabling cache 2024-09-12T18:47:52.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.790+0000 7f83bc65d9c0 20 remove_watcher() i=1 2024-09-12T18:47:52.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.790+0000 7f83bc65d9c0 20 remove_watcher() i=2 2024-09-12T18:47:52.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.794+0000 7f83bc65d9c0 20 remove_watcher() i=3 2024-09-12T18:47:52.798 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.794+0000 7f83bc65d9c0 20 remove_watcher() i=4 2024-09-12T18:47:52.800 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.798+0000 7f83bc65d9c0 20 remove_watcher() i=5 2024-09-12T18:47:52.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.798+0000 7f83bc65d9c0 20 remove_watcher() i=6 2024-09-12T18:47:52.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:52.798+0000 7f83bc65d9c0 20 remove_watcher() i=7 2024-09-12T18:47:52.817 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:52.818 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:47:52.818 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-commit-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:47:52.818 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:52.819 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:52.819 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:52.823 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:52.823 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:52.870 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:52.870 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:52.923 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T18:47:52.923 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:52.924 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:52.924 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:52.950 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:52.950 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:52.996 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:52.997 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.014 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.014 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.034 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.035 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.052 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.052 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.070 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.070 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.089 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.089 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.106 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.106 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.124 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.124 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.142 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.142 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.160 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.160 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.179 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.179 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.196 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.196 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.214 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.214 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.231 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.232 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.249 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.249 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.267 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.267 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.287 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.288 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.307 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.307 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.325 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.326 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.344 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:53.344 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:53.361 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:47:53.394 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:53.394 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:53.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.434+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.438+0000 7f8431a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:53.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.438+0000 7f8431a9c9c0 20 realm 2024-09-12T18:47:53.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.438+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.438+0000 7f8431a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:53.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.438+0000 7f8431a9c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:53.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.438+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.438+0000 7f8431a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:53.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.438+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.438+0000 7f8431a9c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:53.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.438+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.442+0000 7f8431a9c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:53.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.442+0000 7f8431a9c9c0 20 searching for the correct realm 2024-09-12T18:47:53.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.446+0000 7f842fda3640 0 -- 172.21.15.111:0/3651472152 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f84240db020 msgr2=0x7f84240ee950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:53.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.450+0000 7f842eda1640 0 -- 172.21.15.111:0/3651472152 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f8428018020 msgr2=0x7f8428032410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:53.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.666+0000 7f8431a9c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:53.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.666+0000 7f8431a9c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:53.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.666+0000 7f8431a9c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:53.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.666+0000 7f8431a9c9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:53.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.666+0000 7f8431a9c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:53.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.666+0000 7f8431a9c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:53.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.666+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.666+0000 7f8431a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:53.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.666+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.672 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:53.672 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:53.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 20 zone default found 2024-09-12T18:47:53.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 4 Realm: () 2024-09-12T18:47:53.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:53.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:53.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:53.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 20 zonegroup default 2024-09-12T18:47:53.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:53.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:53.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:53.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 20 started sync module instance, tier type = 2024-09-12T18:47:53.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.670+0000 7f8431a9c9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:53.700 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.694+0000 7f8431a9c9c0 20 add_watcher() i=0 2024-09-12T18:47:53.700 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.694+0000 7f8431a9c9c0 20 add_watcher() i=1 2024-09-12T18:47:53.700 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.694+0000 7f8431a9c9c0 20 add_watcher() i=2 2024-09-12T18:47:53.700 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.694+0000 7f8431a9c9c0 20 add_watcher() i=3 2024-09-12T18:47:53.700 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.694+0000 7f8431a9c9c0 20 add_watcher() i=4 2024-09-12T18:47:53.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.694+0000 7f8431a9c9c0 20 add_watcher() i=5 2024-09-12T18:47:53.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.694+0000 7f8431a9c9c0 20 add_watcher() i=6 2024-09-12T18:47:53.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.698+0000 7f8431a9c9c0 20 add_watcher() i=7 2024-09-12T18:47:53.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.698+0000 7f8431a9c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:53.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.702+0000 7f82e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:53.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.702+0000 7f8431a9c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:53.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.702+0000 7f8431a9c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:53.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.702+0000 7f8431a9c9c0 5 note: GC not initialized 2024-09-12T18:47:53.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.702+0000 7f82e4fe1640 20 reqs_thread_entry: start 2024-09-12T18:47:53.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.702+0000 7f8431a9c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:53.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.706+0000 7f8431a9c9c0 20 Filter name: none 2024-09-12T18:47:53.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.706+0000 7f825e7fc640 20 reqs_thread_entry: start 2024-09-12T18:47:53.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.706+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.706+0000 7f8431a9c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:53.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.706+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.706+0000 7f8431a9c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:53.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.706+0000 7f8431a9c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:53.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.706+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.706+0000 7f8431a9c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:53.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.706+0000 7f8431a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.710+0000 7f8431a9c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:53.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.710+0000 7f8431a9c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:53.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.714+0000 7f82e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:53.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.718+0000 7f8431a9c9c0 20 remove_watcher() i=0 2024-09-12T18:47:53.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.718+0000 7f8431a9c9c0 2 removed watcher, disabling cache 2024-09-12T18:47:53.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.718+0000 7f8431a9c9c0 20 remove_watcher() i=1 2024-09-12T18:47:53.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.722+0000 7f8431a9c9c0 20 remove_watcher() i=2 2024-09-12T18:47:53.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.726+0000 7f8431a9c9c0 20 remove_watcher() i=3 2024-09-12T18:47:53.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.726+0000 7f8431a9c9c0 20 remove_watcher() i=4 2024-09-12T18:47:53.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.730+0000 7f8431a9c9c0 20 remove_watcher() i=5 2024-09-12T18:47:53.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.730+0000 7f8431a9c9c0 20 remove_watcher() i=6 2024-09-12T18:47:53.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.730+0000 7f8431a9c9c0 20 remove_watcher() i=7 2024-09-12T18:47:53.757 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:53.757 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:47:53.757 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-commit-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:47:53.757 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:53.758 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T18:47:53.795 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:53.795 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:53.842 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.838+0000 7fe9d8fdb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.838+0000 7fe9d8fdb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:53.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.838+0000 7fe9d8fdb9c0 20 realm 2024-09-12T18:47:53.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.838+0000 7fe9d8fdb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.838+0000 7fe9d8fdb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:53.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.838+0000 7fe9d8fdb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:53.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.838+0000 7fe9d8fdb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.838+0000 7fe9d8fdb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:53.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.838+0000 7fe9d8fdb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.842+0000 7fe9d8fdb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:53.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.842+0000 7fe9d8fdb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:53.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.842+0000 7fe9d8fdb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:53.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.842+0000 7fe9d8fdb9c0 20 searching for the correct realm 2024-09-12T18:47:53.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:53.846+0000 7fe9d72e2640 0 -- 172.21.15.111:0/4277188693 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fe9c002c040 msgr2=0x7fe9c002c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:54.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.062+0000 7fe9d62e0640 0 -- 172.21.15.111:0/4277188693 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fe9c80e9400 msgr2=0x7fe9c80e9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:47:54.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.278+0000 7fe9d8fdb9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:54.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.278+0000 7fe9d8fdb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:54.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.278+0000 7fe9d8fdb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:54.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.278+0000 7fe9d8fdb9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:54.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.278+0000 7fe9d8fdb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:54.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.278+0000 7fe9d8fdb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:54.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:54.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:54.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:54.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 20 zone default found 2024-09-12T18:47:54.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 4 Realm: () 2024-09-12T18:47:54.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:54.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:54.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:54.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 20 zonegroup default 2024-09-12T18:47:54.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:54.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.282+0000 7fe9d8fdb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.286+0000 7fe9d8fdb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:54.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.286+0000 7fe9d8fdb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.286+0000 7fe9d8fdb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:54.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.286+0000 7fe9d8fdb9c0 20 started sync module instance, tier type = 2024-09-12T18:47:54.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.286+0000 7fe9d8fdb9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:54.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.310+0000 7fe9d8fdb9c0 20 add_watcher() i=0 2024-09-12T18:47:54.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.310+0000 7fe9d8fdb9c0 20 add_watcher() i=1 2024-09-12T18:47:54.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.310+0000 7fe9d8fdb9c0 20 add_watcher() i=2 2024-09-12T18:47:54.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.310+0000 7fe9d8fdb9c0 20 add_watcher() i=3 2024-09-12T18:47:54.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.310+0000 7fe9d8fdb9c0 20 add_watcher() i=4 2024-09-12T18:47:54.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.310+0000 7fe9d8fdb9c0 20 add_watcher() i=5 2024-09-12T18:47:54.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.310+0000 7fe9d8fdb9c0 20 add_watcher() i=6 2024-09-12T18:47:54.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.310+0000 7fe9d8fdb9c0 20 add_watcher() i=7 2024-09-12T18:47:54.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.310+0000 7fe9d8fdb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:54.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.314+0000 7fe88dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:54.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:54.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:54.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 5 note: GC not initialized 2024-09-12T18:47:54.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe88cfe1640 20 reqs_thread_entry: start 2024-09-12T18:47:54.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:54.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 20 Filter name: none 2024-09-12T18:47:54.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe885ffb640 20 reqs_thread_entry: start 2024-09-12T18:47:54.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T18:47:54.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:54.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T18:47:54.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T18:47:54.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 : miss 2024-09-12T18:47:54.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:54.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 info.flags=0x17 2024-09-12T18:47:54.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 to cache LRU end 2024-09-12T18:47:54.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:47:54.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.318+0000 7fe9d8fdb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:54.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.322+0000 7fe9d8fdb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 2024-09-12T18:47:54.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.334+0000 7fe9d8fdb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 info.flags=0x17 2024-09-12T18:47:54.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.334+0000 7fe9d8fdb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 to cache LRU end 2024-09-12T18:47:54.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.334+0000 7fe9d8fdb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:54.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.334+0000 7fe9d8fdb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31, ofs0, ns] 2024-09-12T18:47:54.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.334+0000 7fe8ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431583 cookie 94711131287984 notifier 7347 bl.length()=931 2024-09-12T18:47:54.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.334+0000 7fe8ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 info.flags=0x17 2024-09-12T18:47:54.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.334+0000 7fe8ba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 to cache LRU end 2024-09-12T18:47:54.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.334+0000 7fe8ba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:54.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.334+0000 7fe9d8fdb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.31]): orig_sources= new_sources= 2024-09-12T18:47:54.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.334+0000 7fe9d8fdb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.31]): potential sources added=[] removed=[] 2024-09-12T18:47:54.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.334+0000 7fe9d8fdb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.31]): orig_dests= new_dests= 2024-09-12T18:47:54.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.334+0000 7fe9d8fdb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.31]): potential dests added=[] removed=[] 2024-09-12T18:47:54.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.0 2024-09-12T18:47:54.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.0 2024-09-12T18:47:54.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.1 2024-09-12T18:47:54.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.1 2024-09-12T18:47:54.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.2 2024-09-12T18:47:54.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.2 2024-09-12T18:47:54.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.3 2024-09-12T18:47:54.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.3 2024-09-12T18:47:54.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.4 2024-09-12T18:47:54.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.4 2024-09-12T18:47:54.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.5 2024-09-12T18:47:54.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.5 2024-09-12T18:47:54.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.6 2024-09-12T18:47:54.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.6 2024-09-12T18:47:54.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.7 2024-09-12T18:47:54.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.7 2024-09-12T18:47:54.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.8 2024-09-12T18:47:54.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.8 2024-09-12T18:47:54.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.9 2024-09-12T18:47:54.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.9 2024-09-12T18:47:54.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.10 2024-09-12T18:47:54.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.10 2024-09-12T18:47:54.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.11 2024-09-12T18:47:54.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1.11 2024-09-12T18:47:54.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.0 2024-09-12T18:47:54.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1 2024-09-12T18:47:54.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.342+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.2 2024-09-12T18:47:54.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.346+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.3 2024-09-12T18:47:54.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.346+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.4 2024-09-12T18:47:54.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.346+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.5 2024-09-12T18:47:54.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.346+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.6 2024-09-12T18:47:54.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.346+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.7 2024-09-12T18:47:54.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.350+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.8 2024-09-12T18:47:54.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.350+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.9 2024-09-12T18:47:54.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.350+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.10 2024-09-12T18:47:54.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.358+0000 7fe9d8fdb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:54.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.358+0000 7fe9d8fdb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 2024-09-12T18:47:54.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.362+0000 7fe9d8fdb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 info.flags=0x17 2024-09-12T18:47:54.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.362+0000 7fe9d8fdb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 to cache LRU end 2024-09-12T18:47:54.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.362+0000 7fe9d8fdb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:54.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.362+0000 7fe9d8fdb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31, ofs0, ns] 2024-09-12T18:47:54.365 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.362+0000 7fe8b9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431584 cookie 94711131287984 notifier 7347 bl.length()=931 2024-09-12T18:47:54.365 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.362+0000 7fe8b9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 info.flags=0x17 2024-09-12T18:47:54.365 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.362+0000 7fe8b9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 to cache LRU end 2024-09-12T18:47:54.365 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.362+0000 7fe8b9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:54.365 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.362+0000 7fe9d8fdb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.31]): orig_sources= new_sources= 2024-09-12T18:47:54.365 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.362+0000 7fe9d8fdb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.31]): potential sources added=[] removed=[] 2024-09-12T18:47:54.365 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.362+0000 7fe9d8fdb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.31]): orig_dests= new_dests= 2024-09-12T18:47:54.365 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.362+0000 7fe9d8fdb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.31]): potential dests added=[] removed=[] 2024-09-12T18:47:54.370 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.366+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.0 2024-09-12T18:47:54.370 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.366+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.1 2024-09-12T18:47:54.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.366+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.2 2024-09-12T18:47:54.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.366+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.3 2024-09-12T18:47:54.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.370+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.4 2024-09-12T18:47:54.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.370+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.5 2024-09-12T18:47:54.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.370+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.6 2024-09-12T18:47:54.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.370+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.7 2024-09-12T18:47:54.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.370+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.8 2024-09-12T18:47:54.375 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.370+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.9 2024-09-12T18:47:54.375 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.370+0000 7fe9d8fdb9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.31.10 2024-09-12T18:47:54.377 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.374+0000 7fe9d8fdb9c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T18:47:54.377 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.374+0000 7fe9d8fdb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:54.377 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.374+0000 7fe9d8fdb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 2024-09-12T18:47:54.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.378+0000 7fe9d8fdb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 info.flags=0x17 2024-09-12T18:47:54.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.378+0000 7fe9d8fdb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 to cache LRU end 2024-09-12T18:47:54.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.378+0000 7fe9d8fdb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:54.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.378+0000 7fe9d8fdb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31, ofs0, ns] 2024-09-12T18:47:54.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.378+0000 7fe8b9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 94711131287984 notifier 7347 bl.length()=899 2024-09-12T18:47:54.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.378+0000 7fe8b9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 info.flags=0x17 2024-09-12T18:47:54.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.378+0000 7fe8b9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.31 to cache LRU end 2024-09-12T18:47:54.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.378+0000 7fe8b9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:54.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.378+0000 7fe9d8fdb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.31]): orig_sources= new_sources= 2024-09-12T18:47:54.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.378+0000 7fe9d8fdb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.31]): potential sources added=[] removed=[] 2024-09-12T18:47:54.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.378+0000 7fe9d8fdb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.31]): orig_dests= new_dests= 2024-09-12T18:47:54.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.378+0000 7fe9d8fdb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.31]): potential dests added=[] removed=[] 2024-09-12T18:47:54.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.382+0000 7fe9d8fdb9c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T18:47:54.389 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.386+0000 7fe88dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:54.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.390+0000 7fe9d8fdb9c0 20 remove_watcher() i=0 2024-09-12T18:47:54.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.390+0000 7fe9d8fdb9c0 2 removed watcher, disabling cache 2024-09-12T18:47:54.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.394+0000 7fe9d8fdb9c0 20 remove_watcher() i=1 2024-09-12T18:47:54.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.394+0000 7fe9d8fdb9c0 20 remove_watcher() i=2 2024-09-12T18:47:54.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.398+0000 7fe9d8fdb9c0 20 remove_watcher() i=3 2024-09-12T18:47:54.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.398+0000 7fe9d8fdb9c0 20 remove_watcher() i=4 2024-09-12T18:47:54.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.402+0000 7fe9d8fdb9c0 20 remove_watcher() i=5 2024-09-12T18:47:54.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.402+0000 7fe9d8fdb9c0 20 remove_watcher() i=6 2024-09-12T18:47:54.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.402+0000 7fe9d8fdb9c0 20 remove_watcher() i=7 2024-09-12T18:47:54.425 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T18:47:54.456 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:54.456 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:54.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.498+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.498+0000 7fbf7a8949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:54.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.498+0000 7fbf7a8949c0 20 realm 2024-09-12T18:47:54.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.498+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.498+0000 7fbf7a8949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:54.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.498+0000 7fbf7a8949c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:54.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.498+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.498+0000 7fbf7a8949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:54.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.498+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.502+0000 7fbf7a8949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:54.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.502+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.502+0000 7fbf7a8949c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:54.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.502+0000 7fbf7a8949c0 20 searching for the correct realm 2024-09-12T18:47:54.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.506+0000 7fbf78b9b640 0 -- 172.21.15.111:0/1517165589 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fbf6c017020 msgr2=0x7fbf6c06db50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:54.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.722+0000 7fbf77b99640 0 -- 172.21.15.111:0/1517165589 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fbf70046930 msgr2=0x7fbf700353d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:54.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.938+0000 7fbf7a8949c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:54.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.938+0000 7fbf7a8949c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:54.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.938+0000 7fbf7a8949c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:54.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.938+0000 7fbf7a8949c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:54.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.938+0000 7fbf7a8949c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:54.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.938+0000 7fbf7a8949c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:54.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.938+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.938+0000 7fbf7a8949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:54.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.938+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.938+0000 7fbf7a8949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:54.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.938+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:54.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 20 zone default found 2024-09-12T18:47:54.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 4 Realm: () 2024-09-12T18:47:54.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:54.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:54.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:54.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 20 zonegroup default 2024-09-12T18:47:54.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:54.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:54.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:54.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 20 started sync module instance, tier type = 2024-09-12T18:47:54.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.942+0000 7fbf7a8949c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:54.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.966+0000 7fbf7a8949c0 20 add_watcher() i=0 2024-09-12T18:47:54.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.966+0000 7fbf7a8949c0 20 add_watcher() i=1 2024-09-12T18:47:54.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.966+0000 7fbf7a8949c0 20 add_watcher() i=2 2024-09-12T18:47:54.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.966+0000 7fbf7a8949c0 20 add_watcher() i=3 2024-09-12T18:47:54.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.966+0000 7fbf7a8949c0 20 add_watcher() i=4 2024-09-12T18:47:54.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.966+0000 7fbf7a8949c0 20 add_watcher() i=5 2024-09-12T18:47:54.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.966+0000 7fbf7a8949c0 20 add_watcher() i=6 2024-09-12T18:47:54.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.970+0000 7fbf7a8949c0 20 add_watcher() i=7 2024-09-12T18:47:54.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.970+0000 7fbf7a8949c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:54.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.974+0000 7fbe2e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:54.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.974+0000 7fbf7a8949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:54.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.974+0000 7fbf7a8949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:54.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.974+0000 7fbf7a8949c0 5 note: GC not initialized 2024-09-12T18:47:54.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.974+0000 7fbe2d7e2640 20 reqs_thread_entry: start 2024-09-12T18:47:54.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.974+0000 7fbf7a8949c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:54.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.974+0000 7fbf7a8949c0 20 Filter name: none 2024-09-12T18:47:54.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.974+0000 7fbd9effd640 20 reqs_thread_entry: start 2024-09-12T18:47:54.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.974+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.978+0000 7fbf7a8949c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:54.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.978+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.978+0000 7fbf7a8949c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:54.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.978+0000 7fbf7a8949c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:54.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.978+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.978+0000 7fbf7a8949c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:54.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.978+0000 7fbf7a8949c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:54.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.982+0000 7fbf7a8949c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:54.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.982+0000 7fbf7a8949c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:54.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.986+0000 7fbe2e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:54.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.990+0000 7fbf7a8949c0 20 remove_watcher() i=0 2024-09-12T18:47:54.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.990+0000 7fbf7a8949c0 2 removed watcher, disabling cache 2024-09-12T18:47:54.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.990+0000 7fbf7a8949c0 20 remove_watcher() i=1 2024-09-12T18:47:54.998 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.994+0000 7fbf7a8949c0 20 remove_watcher() i=2 2024-09-12T18:47:55.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.994+0000 7fbf7a8949c0 20 remove_watcher() i=3 2024-09-12T18:47:55.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:54.998+0000 7fbf7a8949c0 20 remove_watcher() i=4 2024-09-12T18:47:55.005 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.002+0000 7fbf7a8949c0 20 remove_watcher() i=5 2024-09-12T18:47:55.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.002+0000 7fbf7a8949c0 20 remove_watcher() i=6 2024-09-12T18:47:55.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.006+0000 7fbf7a8949c0 20 remove_watcher() i=7 2024-09-12T18:47:55.024 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:55.025 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:47:55.025 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-commit-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T18:47:55.025 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:55.026 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.026 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.030 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.030 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.074 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.074 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.130 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T18:47:55.130 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:55.132 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.132 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.156 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.156 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.204 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.204 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.223 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.223 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.243 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.243 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.261 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.261 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.280 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.280 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.299 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.299 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.318 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.318 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.337 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.338 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.357 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.357 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.378 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.378 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.397 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.398 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.416 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.416 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.435 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.435 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.455 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.455 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.474 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.474 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.492 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.492 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.511 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.511 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.531 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.531 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.551 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.551 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.570 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:47:55.587 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T18:47:55.618 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:55.619 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:55.664 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.658+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.662+0000 7fe6f82d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:55.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.662+0000 7fe6f82d19c0 20 realm 2024-09-12T18:47:55.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.662+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.662+0000 7fe6f82d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:55.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.662+0000 7fe6f82d19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:55.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.662+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.662+0000 7fe6f82d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:55.666 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.662+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.667 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.662+0000 7fe6f82d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:55.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.662+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.668 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.666+0000 7fe6f82d19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:55.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.666+0000 7fe6f82d19c0 20 searching for the correct realm 2024-09-12T18:47:55.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.670+0000 7fe6f65d8640 0 -- 172.21.15.111:0/999050746 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fe6ec049060 msgr2=0x7fe6ec09e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:55.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.674+0000 7fe6f55d6640 0 -- 172.21.15.111:0/999050746 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fe6e8044410 msgr2=0x7fe6e8044890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:55.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.890+0000 7fe6f82d19c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:55.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.890+0000 7fe6f82d19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:55.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.890+0000 7fe6f82d19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:55.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.890+0000 7fe6f82d19c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:55.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.890+0000 7fe6f82d19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:55.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.890+0000 7fe6f82d19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:55.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.890+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.890+0000 7fe6f82d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:55.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.890+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.890+0000 7fe6f82d19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:55.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.890+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:55.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 20 zone default found 2024-09-12T18:47:55.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 4 Realm: () 2024-09-12T18:47:55.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:55.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:55.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:55.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 20 zonegroup default 2024-09-12T18:47:55.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:55.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:55.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:55.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 20 started sync module instance, tier type = 2024-09-12T18:47:55.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.894+0000 7fe6f82d19c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:55.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.918+0000 7fe6f82d19c0 20 add_watcher() i=0 2024-09-12T18:47:55.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.918+0000 7fe6f82d19c0 20 add_watcher() i=1 2024-09-12T18:47:55.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.918+0000 7fe6f82d19c0 20 add_watcher() i=2 2024-09-12T18:47:55.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.918+0000 7fe6f82d19c0 20 add_watcher() i=3 2024-09-12T18:47:55.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.918+0000 7fe6f82d19c0 20 add_watcher() i=4 2024-09-12T18:47:55.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.918+0000 7fe6f82d19c0 20 add_watcher() i=5 2024-09-12T18:47:55.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.918+0000 7fe6f82d19c0 20 add_watcher() i=6 2024-09-12T18:47:55.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.918+0000 7fe6f82d19c0 20 add_watcher() i=7 2024-09-12T18:47:55.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.918+0000 7fe6f82d19c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:55.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.922+0000 7fe5a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:55.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.922+0000 7fe6f82d19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:55.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.922+0000 7fe6f82d19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:55.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.922+0000 7fe6f82d19c0 5 note: GC not initialized 2024-09-12T18:47:55.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.922+0000 7fe5a67fc640 20 reqs_thread_entry: start 2024-09-12T18:47:55.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.922+0000 7fe6f82d19c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:55.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.922+0000 7fe6f82d19c0 20 Filter name: none 2024-09-12T18:47:55.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.922+0000 7fe517fff640 20 reqs_thread_entry: start 2024-09-12T18:47:55.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.922+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.926+0000 7fe6f82d19c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:55.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.926+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.926+0000 7fe6f82d19c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:55.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.926+0000 7fe6f82d19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:55.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.926+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.926+0000 7fe6f82d19c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:55.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.926+0000 7fe6f82d19c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:55.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.926+0000 7fe6f82d19c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:55.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.926+0000 7fe6f82d19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:55.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.930+0000 7fe5a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:55.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.934+0000 7fe6f82d19c0 20 remove_watcher() i=0 2024-09-12T18:47:55.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.934+0000 7fe6f82d19c0 2 removed watcher, disabling cache 2024-09-12T18:47:55.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.934+0000 7fe6f82d19c0 20 remove_watcher() i=1 2024-09-12T18:47:55.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.938+0000 7fe6f82d19c0 20 remove_watcher() i=2 2024-09-12T18:47:55.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.942+0000 7fe6f82d19c0 20 remove_watcher() i=3 2024-09-12T18:47:55.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.942+0000 7fe6f82d19c0 20 remove_watcher() i=4 2024-09-12T18:47:55.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.942+0000 7fe6f82d19c0 20 remove_watcher() i=5 2024-09-12T18:47:55.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.946+0000 7fe6f82d19c0 20 remove_watcher() i=6 2024-09-12T18:47:55.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:55.946+0000 7fe6f82d19c0 20 remove_watcher() i=7 2024-09-12T18:47:55.966 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:55.966 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:47:55.966 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-commit-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:47:55.966 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:55.966 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T18:47:55.999 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:55.999 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:56.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.038+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.042+0000 7f248076e9c0 20 realm 2024-09-12T18:47:56.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.042+0000 7f248076e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:56.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.047 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:56.047 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.046+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:56.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.046+0000 7f248076e9c0 20 searching for the correct realm 2024-09-12T18:47:56.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.050+0000 7f247e274640 0 -- 172.21.15.111:0/4062124839 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f2478032040 msgr2=0x7f2478032930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:47:56.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.058+0000 7f247da73640 0 -- 172.21.15.111:0/4062124839 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f24780243f0 msgr2=0x7f2478024850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:47:56.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:56.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:56.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:56.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:56.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:56.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:56.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.281 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:56.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:56.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 zone default found 2024-09-12T18:47:56.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 4 Realm: () 2024-09-12T18:47:56.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:56.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:56.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:56.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 zonegroup default 2024-09-12T18:47:56.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.282+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.282+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.282+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.282+0000 7f248076e9c0 20 started sync module instance, tier type = 2024-09-12T18:47:56.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.282+0000 7f248076e9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:56.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=0 2024-09-12T18:47:56.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=1 2024-09-12T18:47:56.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=2 2024-09-12T18:47:56.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=3 2024-09-12T18:47:56.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=4 2024-09-12T18:47:56.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=5 2024-09-12T18:47:56.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=6 2024-09-12T18:47:56.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.306+0000 7f248076e9c0 20 add_watcher() i=7 2024-09-12T18:47:56.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.306+0000 7f248076e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:56.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f2334fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:56.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:56.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:56.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f248076e9c0 5 note: GC not initialized 2024-09-12T18:47:56.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f22af7fe640 20 reqs_thread_entry: start 2024-09-12T18:47:56.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f248076e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:56.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f248076e9c0 20 Filter name: none 2024-09-12T18:47:56.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f22ad7fa640 20 reqs_thread_entry: start 2024-09-12T18:47:56.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f248076e9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T18:47:56.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:56.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f248076e9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T18:47:56.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f248076e9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T18:47:56.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f248076e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 : miss 2024-09-12T18:47:56.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.314+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:56.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.314+0000 7f248076e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.314+0000 7f248076e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.314+0000 7f248076e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:47:56.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.314+0000 7f248076e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.314+0000 7f248076e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 2024-09-12T18:47:56.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.326+0000 7f248076e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.326+0000 7f248076e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.326+0000 7f248076e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.326+0000 7f248076e9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32, ofs0, ns] 2024-09-12T18:47:56.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.326+0000 7f23617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431642 cookie 93852045131408 notifier 7404 bl.length()=931 2024-09-12T18:47:56.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.326+0000 7f23617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.326+0000 7f23617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.326+0000 7f23617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.326+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_sources= new_sources= 2024-09-12T18:47:56.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.326+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential sources added=[] removed=[] 2024-09-12T18:47:56.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.326+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_dests= new_dests= 2024-09-12T18:47:56.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.326+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential dests added=[] removed=[] 2024-09-12T18:47:56.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.0 2024-09-12T18:47:56.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.0 2024-09-12T18:47:56.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.1 2024-09-12T18:47:56.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.1 2024-09-12T18:47:56.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.2 2024-09-12T18:47:56.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.2 2024-09-12T18:47:56.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.3 2024-09-12T18:47:56.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.3 2024-09-12T18:47:56.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.4 2024-09-12T18:47:56.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.4 2024-09-12T18:47:56.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.5 2024-09-12T18:47:56.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.5 2024-09-12T18:47:56.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.6 2024-09-12T18:47:56.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.6 2024-09-12T18:47:56.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.7 2024-09-12T18:47:56.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.7 2024-09-12T18:47:56.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.8 2024-09-12T18:47:56.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.8 2024-09-12T18:47:56.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.9 2024-09-12T18:47:56.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.9 2024-09-12T18:47:56.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.10 2024-09-12T18:47:56.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.10 2024-09-12T18:47:56.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.11 2024-09-12T18:47:56.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.11 2024-09-12T18:47:56.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.0 2024-09-12T18:47:56.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1 2024-09-12T18:47:56.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.2 2024-09-12T18:47:56.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.342+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.3 2024-09-12T18:47:56.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.342+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.4 2024-09-12T18:47:56.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.342+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.5 2024-09-12T18:47:56.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.342+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.6 2024-09-12T18:47:56.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.346+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.7 2024-09-12T18:47:56.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.346+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.8 2024-09-12T18:47:56.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.346+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.9 2024-09-12T18:47:56.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.350+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.10 2024-09-12T18:47:56.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.354+0000 7f248076e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:56.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.354+0000 7f248076e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 2024-09-12T18:47:56.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.358+0000 7f248076e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.358+0000 7f248076e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.358+0000 7f248076e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.358+0000 7f248076e9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32, ofs0, ns] 2024-09-12T18:47:56.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.358+0000 7f23617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431643 cookie 93852045131408 notifier 7404 bl.length()=931 2024-09-12T18:47:56.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.358+0000 7f23617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.358+0000 7f23617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.358+0000 7f23617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.358+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_sources= new_sources= 2024-09-12T18:47:56.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.358+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential sources added=[] removed=[] 2024-09-12T18:47:56.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.358+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_dests= new_dests= 2024-09-12T18:47:56.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.358+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential dests added=[] removed=[] 2024-09-12T18:47:56.367 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.362+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.0 2024-09-12T18:47:56.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1 2024-09-12T18:47:56.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.2 2024-09-12T18:47:56.369 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.3 2024-09-12T18:47:56.370 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.4 2024-09-12T18:47:56.370 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.5 2024-09-12T18:47:56.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.6 2024-09-12T18:47:56.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.370+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.7 2024-09-12T18:47:56.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.370+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.8 2024-09-12T18:47:56.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.370+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.9 2024-09-12T18:47:56.375 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.370+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.10 2024-09-12T18:47:56.376 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f248076e9c0 time 2024-09-12T18:47:56.377123+0000 2024-09-12T18:47:56.376 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:47:56.377 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:56.377 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f24840482eb] 2024-09-12T18:47:56.377 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f248404849f] 2024-09-12T18:47:56.377 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ba029fcc1] 2024-09-12T18:47:56.378 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555ba02b4fc7] 2024-09-12T18:47:56.378 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:47:56.378 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2482eaed90] 2024-09-12T18:47:56.378 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:47:56.378 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:47:56.378 INFO:tasks.workunit.client.0.smithi111.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:47:56.378 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f248076e9c0 thread_name:radosgw-admin 2024-09-12T18:47:56.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.374+0000 7f248076e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f248076e9c0 time 2024-09-12T18:47:56.377123+0000 2024-09-12T18:47:56.378 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:47:56.378 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.378 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:56.378 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f24840482eb] 2024-09-12T18:47:56.378 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f248404849f] 2024-09-12T18:47:56.379 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ba029fcc1] 2024-09-12T18:47:56.379 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555ba02b4fc7] 2024-09-12T18:47:56.379 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:47:56.379 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2482eaed90] 2024-09-12T18:47:56.379 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:47:56.379 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:47:56.379 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.394 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:56.395 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2482ec7520] 2024-09-12T18:47:56.395 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:47:56.395 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:47:56.395 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:47:56.395 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2484048345] 2024-09-12T18:47:56.395 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f248404849f] 2024-09-12T18:47:56.395 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ba029fcc1] 2024-09-12T18:47:56.395 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555ba02b4fc7] 2024-09-12T18:47:56.395 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:47:56.395 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2482eaed90] 2024-09-12T18:47:56.395 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:47:56.395 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:47:56.396 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.374+0000 7f248076e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:47:56.396 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f248076e9c0 thread_name:radosgw-admin 2024-09-12T18:47:56.396 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.396 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:56.396 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2482ec7520] 2024-09-12T18:47:56.396 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:47:56.396 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:47:56.396 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:47:56.396 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2484048345] 2024-09-12T18:47:56.396 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f248404849f] 2024-09-12T18:47:56.396 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ba029fcc1] 2024-09-12T18:47:56.396 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555ba02b4fc7] 2024-09-12T18:47:56.396 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:47:56.397 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2482eaed90] 2024-09-12T18:47:56.397 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:47:56.397 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:47:56.397 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:47:56.397 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.397 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:47:56.397 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 AuthRegistry(0x555ba1bfc0b0) adding con mode: crc 2024-09-12T18:47:56.397 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 AuthRegistry(0x555ba1bfc0b0) adding con mode: crc 2024-09-12T18:47:56.397 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 AuthRegistry(0x555ba1bfc0b0) adding con mode: secure 2024-09-12T18:47:56.397 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 AuthRegistry(0x555ba1bfc0b0) adding con mode: crc 2024-09-12T18:47:56.397 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 AuthRegistry(0x555ba1bfc0b0) adding con mode: secure 2024-09-12T18:47:56.397 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 AuthRegistry(0x555ba1bfc0b0) adding con mode: crc 2024-09-12T18:47:56.397 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 AuthRegistry(0x555ba1bfc0b0) adding con mode: secure 2024-09-12T18:47:56.398 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:47:56.018+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.398 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:47:56.018+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.398 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command rotate-key hook 0x555ba1bfc1f8 2024-09-12T18:47:56.398 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:56.398 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:47:56.398 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-a con 0x555ba1aabde0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:56.398 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-b con 0x555ba1aba820 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:56.398 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-c con 0x555ba1b44a20 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:56.398 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.398 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.398 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.398 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:56.398 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): authenticate will time out at 2263.163189s 2024-09-12T18:47:56.398 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): get_auth_request con 0x555ba1aabde0 auth_method 0 2024-09-12T18:47:56.399 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.399 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.399 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.399 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:47:56.018+0000 7f247ea75640 10 monclient(hunting): get_auth_request con 0x555ba1b44a20 auth_method 0 2024-09-12T18:47:56.399 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:47:56.018+0000 7f247ea75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.399 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:47:56.018+0000 7f247ea75640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.399 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:47:56.018+0000 7f247ea75640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.399 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:56.399 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:56.399 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:56.399 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:47:56.018+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:56.399 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:47:56.018+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:56.399 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:47:56.018+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:56.399 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): handle_auth_done global_id 7395 payload 824 2024-09-12T18:47:56.400 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient: _finish_hunting 0 2024-09-12T18:47:56.400 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:47:56.018+0000 7f247e274640 1 monclient: found mon.noname-a 2024-09-12T18:47:56.400 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.400 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.400 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:47:56.400 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: dump: 2024-09-12T18:47:56.400 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.400 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.400 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.400 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.400 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.400 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.400 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.401 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.401 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.401 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.401 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: _finish_auth 0 2024-09-12T18:47:56.401 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: _check_auth_tickets 2024-09-12T18:47:56.401 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:56.401 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.401 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:47:56.401 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: dump: 2024-09-12T18:47:56.401 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.401 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.401 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.401 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.402 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.402 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.402 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.402 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.402 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.402 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.402 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 monclient: authenticate success, global_id 7395 2024-09-12T18:47:56.402 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:47:56.018+0000 7f236c608640 4 set_mon_vals no callback set 2024-09-12T18:47:56.402 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:47:56.022+0000 7f248076e9c0 10 monclient: _renew_subs 2024-09-12T18:47:56.402 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:47:56.022+0000 7f248076e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.402 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:47:56.022+0000 7f248076e9c0 10 monclient: _renew_subs 2024-09-12T18:47:56.402 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:47:56.022+0000 7f248076e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.402 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:47:56.022+0000 7f248076e9c0 1 librados: init done 2024-09-12T18:47:56.402 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:47:56.022+0000 7f236ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:47:56.403 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:47:56.022+0000 7f236ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:56.403 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:47:56.022+0000 7f236ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:56.403 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:47:56.022+0000 7f247da73640 10 monclient: get_auth_request con 0x7f2364070ae0 auth_method 0 2024-09-12T18:47:56.403 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:47:56.022+0000 7f247ea75640 10 monclient: get_auth_request con 0x555ba1c27980 auth_method 0 2024-09-12T18:47:56.403 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:47:56.022+0000 7f247e274640 10 monclient: get_auth_request con 0x555ba1c46720 auth_method 0 2024-09-12T18:47:56.403 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:47:56.026+0000 7f247da73640 10 monclient: get_auth_request con 0x555ba1c4aac0 auth_method 0 2024-09-12T18:47:56.403 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:47:56.026+0000 7f247ea75640 10 monclient: get_auth_request con 0x555ba1c49fe0 auth_method 0 2024-09-12T18:47:56.403 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: build_initial_monmap 2024-09-12T18:47:56.403 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:47:56.030+0000 7f248076e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:47:56.403 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: monmap: 2024-09-12T18:47:56.403 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:47:56.403 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:47:56.404 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:47:56.404 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:47:56.404 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:47:56.404 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.404 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:47:56.404 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:47:56.404 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:47:56.404 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.404 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding auth protocol: cephx 2024-09-12T18:47:56.404 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding auth protocol: cephx 2024-09-12T18:47:56.404 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding auth protocol: cephx 2024-09-12T18:47:56.404 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: secure 2024-09-12T18:47:56.405 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: crc 2024-09-12T18:47:56.405 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: secure 2024-09-12T18:47:56.405 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: crc 2024-09-12T18:47:56.405 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: secure 2024-09-12T18:47:56.405 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: crc 2024-09-12T18:47:56.405 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: crc 2024-09-12T18:47:56.405 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: secure 2024-09-12T18:47:56.405 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: crc 2024-09-12T18:47:56.405 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: secure 2024-09-12T18:47:56.405 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: crc 2024-09-12T18:47:56.405 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: secure 2024-09-12T18:47:56.405 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:47:56.030+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.406 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command objecter_requests cmddesc objecter_requests hook 0x555ba1c566b0 EEXIST 2024-09-12T18:47:56.406 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: init 2024-09-12T18:47:56.406 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding auth protocol: cephx 2024-09-12T18:47:56.406 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding auth protocol: cephx 2024-09-12T18:47:56.406 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding auth protocol: cephx 2024-09-12T18:47:56.406 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: secure 2024-09-12T18:47:56.406 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: crc 2024-09-12T18:47:56.406 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: secure 2024-09-12T18:47:56.406 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: crc 2024-09-12T18:47:56.406 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: secure 2024-09-12T18:47:56.406 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: crc 2024-09-12T18:47:56.406 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: crc 2024-09-12T18:47:56.406 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: secure 2024-09-12T18:47:56.406 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: crc 2024-09-12T18:47:56.407 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: secure 2024-09-12T18:47:56.407 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: crc 2024-09-12T18:47:56.407 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: secure 2024-09-12T18:47:56.407 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:47:56.030+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.407 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:47:56.030+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.407 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command rotate-key cmddesc rotate-key hook 0x555ba1c51d00 EEXIST 2024-09-12T18:47:56.407 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:56.407 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:47:56.407 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-b con 0x555ba1c80150 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:56.407 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-c con 0x555ba1c7abb0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:56.407 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-a con 0x555ba1c78c30 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:56.407 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.407 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.408 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.408 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:56.408 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): authenticate will time out at 2263.173782s 2024-09-12T18:47:56.408 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): get_auth_request con 0x555ba1c78c30 auth_method 0 2024-09-12T18:47:56.408 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.408 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.409 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.409 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:47:56.030+0000 7f247ea75640 10 monclient(hunting): get_auth_request con 0x555ba1c7abb0 auth_method 0 2024-09-12T18:47:56.409 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:47:56.030+0000 7f247ea75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.409 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:47:56.030+0000 7f247ea75640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.409 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:47:56.030+0000 7f247ea75640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.409 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:56.409 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:56.409 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:56.409 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:47:56.030+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:56.409 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:47:56.030+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:56.409 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:47:56.030+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:56.409 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:47:56.030+0000 7f247da73640 10 monclient(hunting): get_auth_request con 0x555ba1c80150 auth_method 0 2024-09-12T18:47:56.409 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:47:56.030+0000 7f247da73640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.409 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:47:56.030+0000 7f247da73640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.410 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:47:56.030+0000 7f247da73640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.410 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): handle_auth_done global_id 7398 payload 824 2024-09-12T18:47:56.410 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient: _finish_hunting 0 2024-09-12T18:47:56.410 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:47:56.030+0000 7f247e274640 1 monclient: found mon.noname-a 2024-09-12T18:47:56.410 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.410 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.410 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:47:56.410 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: dump: 2024-09-12T18:47:56.410 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.410 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.410 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.410 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.410 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.410 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.411 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.411 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.411 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.411 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.411 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: _finish_auth 0 2024-09-12T18:47:56.411 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: _check_auth_tickets 2024-09-12T18:47:56.411 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:56.411 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.411 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:47:56.411 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: dump: 2024-09-12T18:47:56.411 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.411 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.411 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.412 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.412 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.412 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.412 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.412 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.412 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.412 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.412 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 monclient: authenticate success, global_id 7398 2024-09-12T18:47:56.412 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: _renew_subs 2024-09-12T18:47:56.412 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.412 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:47:56.030+0000 7f247d272640 4 set_mon_vals no callback set 2024-09-12T18:47:56.412 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: _renew_subs 2024-09-12T18:47:56.412 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.413 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:47:56.034+0000 7f2363fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:47:56.413 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:47:56.034+0000 7f2363fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:56.413 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:47:56.034+0000 7f2363fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:56.413 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:47:56.034+0000 7f247da73640 10 monclient: get_auth_request con 0x7f23580709f0 auth_method 0 2024-09-12T18:47:56.413 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: get_monmap_and_config 2024-09-12T18:47:56.413 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: build_initial_monmap 2024-09-12T18:47:56.413 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:47:56.034+0000 7f248076e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:47:56.413 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: monmap: 2024-09-12T18:47:56.413 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:47:56.416 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:47:56.416 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:47:56.416 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:47:56.416 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:47:56.416 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.416 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:47:56.416 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:47:56.417 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:47:56.417 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.417 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding auth protocol: cephx 2024-09-12T18:47:56.417 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding auth protocol: cephx 2024-09-12T18:47:56.417 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding auth protocol: cephx 2024-09-12T18:47:56.417 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: secure 2024-09-12T18:47:56.417 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: crc 2024-09-12T18:47:56.417 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: secure 2024-09-12T18:47:56.417 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: crc 2024-09-12T18:47:56.417 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: secure 2024-09-12T18:47:56.417 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: crc 2024-09-12T18:47:56.417 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: crc 2024-09-12T18:47:56.417 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: secure 2024-09-12T18:47:56.417 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: crc 2024-09-12T18:47:56.418 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: secure 2024-09-12T18:47:56.418 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: crc 2024-09-12T18:47:56.418 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: secure 2024-09-12T18:47:56.418 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:47:56.034+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.418 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: init 2024-09-12T18:47:56.418 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding auth protocol: cephx 2024-09-12T18:47:56.418 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding auth protocol: cephx 2024-09-12T18:47:56.418 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding auth protocol: cephx 2024-09-12T18:47:56.418 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: secure 2024-09-12T18:47:56.418 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: crc 2024-09-12T18:47:56.418 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: secure 2024-09-12T18:47:56.418 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: crc 2024-09-12T18:47:56.418 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: secure 2024-09-12T18:47:56.418 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: crc 2024-09-12T18:47:56.419 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: crc 2024-09-12T18:47:56.419 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: secure 2024-09-12T18:47:56.419 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: crc 2024-09-12T18:47:56.419 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: secure 2024-09-12T18:47:56.419 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: crc 2024-09-12T18:47:56.419 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: secure 2024-09-12T18:47:56.419 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:47:56.034+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.419 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:47:56.034+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.419 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe6241f968 EEXIST 2024-09-12T18:47:56.419 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:56.419 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:47:56.419 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-c con 0x555ba1cc9850 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:56.419 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-b con 0x555ba1cc9c30 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:56.420 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-a con 0x555ba1ccb0f0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:56.420 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.420 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.420 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.420 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:56.420 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): authenticate will time out at 2263.177699s 2024-09-12T18:47:56.420 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): get_auth_request con 0x555ba1ccb0f0 auth_method 0 2024-09-12T18:47:56.420 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.420 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.420 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.420 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:56.420 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:56.420 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:56.421 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): handle_auth_done global_id 7401 payload 274 2024-09-12T18:47:56.421 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient: _finish_hunting 0 2024-09-12T18:47:56.421 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:47:56.034+0000 7f247e274640 1 monclient: found mon.noname-a 2024-09-12T18:47:56.421 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.421 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:47:56.034+0000 7f247ea75640 10 monclient: get_auth_request con 0x555ba1cc9c30 auth_method 0 2024-09-12T18:47:56.421 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.421 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:47:56.421 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: dump: 2024-09-12T18:47:56.421 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.421 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.421 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.421 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.421 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.422 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.422 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.422 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.422 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.422 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.422 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: _finish_auth 0 2024-09-12T18:47:56.422 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:47:56.422 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:56.422 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.422 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:47:56.422 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: dump: 2024-09-12T18:47:56.422 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.422 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.422 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.423 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.423 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.423 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.423 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.423 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.423 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.423 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.423 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 monclient: authenticate success, global_id 7401 2024-09-12T18:47:56.423 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:47:56.423 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:47:56.034+0000 7f248076e9c0 4 set_mon_vals no callback set 2024-09-12T18:47:56.423 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: shutdown 2024-09-12T18:47:56.423 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: build_initial_monmap 2024-09-12T18:47:56.424 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:47:56.034+0000 7f248076e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:47:56.424 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: monmap: 2024-09-12T18:47:56.424 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:47:56.424 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:47:56.424 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:47:56.424 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:47:56.424 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:47:56.424 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.424 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:47:56.424 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:47:56.424 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:47:56.424 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.424 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding auth protocol: cephx 2024-09-12T18:47:56.425 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding auth protocol: cephx 2024-09-12T18:47:56.425 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding auth protocol: cephx 2024-09-12T18:47:56.425 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: secure 2024-09-12T18:47:56.425 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: crc 2024-09-12T18:47:56.425 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: secure 2024-09-12T18:47:56.425 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: crc 2024-09-12T18:47:56.425 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: secure 2024-09-12T18:47:56.425 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: crc 2024-09-12T18:47:56.425 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: crc 2024-09-12T18:47:56.425 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: secure 2024-09-12T18:47:56.425 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: crc 2024-09-12T18:47:56.425 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: secure 2024-09-12T18:47:56.426 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: crc 2024-09-12T18:47:56.426 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: secure 2024-09-12T18:47:56.426 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:47:56.034+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.426 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:47:56.034+0000 7f248076e9c0 1 librados: starting msgr at 2024-09-12T18:47:56.426 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:47:56.034+0000 7f248076e9c0 1 librados: starting objecter 2024-09-12T18:47:56.426 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command objecter_requests cmddesc objecter_requests hook 0x555ba1c7a050 EEXIST 2024-09-12T18:47:56.426 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:47:56.034+0000 7f248076e9c0 1 librados: setting wanted keys 2024-09-12T18:47:56.426 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:47:56.034+0000 7f248076e9c0 1 librados: calling monclient init 2024-09-12T18:47:56.426 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: init 2024-09-12T18:47:56.426 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding auth protocol: cephx 2024-09-12T18:47:56.426 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding auth protocol: cephx 2024-09-12T18:47:56.426 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding auth protocol: cephx 2024-09-12T18:47:56.427 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: secure 2024-09-12T18:47:56.427 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: crc 2024-09-12T18:47:56.427 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: secure 2024-09-12T18:47:56.427 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: crc 2024-09-12T18:47:56.427 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: secure 2024-09-12T18:47:56.427 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: crc 2024-09-12T18:47:56.427 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: crc 2024-09-12T18:47:56.427 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: secure 2024-09-12T18:47:56.427 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: crc 2024-09-12T18:47:56.427 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: secure 2024-09-12T18:47:56.427 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: crc 2024-09-12T18:47:56.427 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: secure 2024-09-12T18:47:56.427 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:47:56.034+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.428 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:47:56.038+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.428 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:47:56.038+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command rotate-key cmddesc rotate-key hook 0x555ba1a8a9f8 EEXIST 2024-09-12T18:47:56.428 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:56.428 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:47:56.428 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-a con 0x555ba1cc9850 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:56.428 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-c con 0x555ba1ccb0f0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:56.428 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-b con 0x555ba1cc60c0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:56.428 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.428 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.428 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.428 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:56.428 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): authenticate will time out at 2263.180333s 2024-09-12T18:47:56.428 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): get_auth_request con 0x555ba1cc9850 auth_method 0 2024-09-12T18:47:56.429 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.429 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.429 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.429 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:47:56.038+0000 7f247ea75640 10 monclient(hunting): get_auth_request con 0x555ba1ccb0f0 auth_method 0 2024-09-12T18:47:56.429 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:47:56.038+0000 7f247ea75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.429 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:47:56.038+0000 7f247ea75640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.429 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:47:56.038+0000 7f247ea75640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.429 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:56.429 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:56.429 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:56.429 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:47:56.038+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:56.429 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:47:56.038+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:56.429 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:47:56.038+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:56.430 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): handle_auth_done global_id 7404 payload 824 2024-09-12T18:47:56.430 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient: _finish_hunting 0 2024-09-12T18:47:56.430 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:47:56.038+0000 7f247da73640 1 monclient: found mon.noname-a 2024-09-12T18:47:56.430 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.430 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.430 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:47:56.430 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: dump: 2024-09-12T18:47:56.430 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.430 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.430 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.430 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.430 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.430 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.431 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.431 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.431 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.431 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.431 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: _finish_auth 0 2024-09-12T18:47:56.431 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: _check_auth_tickets 2024-09-12T18:47:56.431 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:56.431 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.431 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:47:56.431 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: dump: 2024-09-12T18:47:56.431 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.431 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.431 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.431 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.432 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.432 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.432 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.432 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.432 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.432 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.432 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:47:56.038+0000 7f2361ffb640 4 set_mon_vals no callback set 2024-09-12T18:47:56.432 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:47:56.038+0000 7f248076e9c0 5 monclient: authenticate success, global_id 7404 2024-09-12T18:47:56.432 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient: _renew_subs 2024-09-12T18:47:56.432 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.432 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient: _renew_subs 2024-09-12T18:47:56.432 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.432 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:47:56.038+0000 7f248076e9c0 1 librados: init done 2024-09-12T18:47:56.432 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:47:56.038+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command cr dump hook 0x555ba1ccb598 2024-09-12T18:47:56.433 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:47:56.038+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.433 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:47:56.038+0000 7f234ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:47:56.433 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:47:56.038+0000 7f234ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:56.433 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:47:56.038+0000 7f234ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:56.433 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:47:56.042+0000 7f247ea75640 10 monclient: get_auth_request con 0x7f2348070ae0 auth_method 0 2024-09-12T18:47:56.433 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:47:56.042+0000 7f247e274640 10 monclient: get_auth_request con 0x555ba1ce90c0 auth_method 0 2024-09-12T18:47:56.433 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.433 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 realm 2024-09-12T18:47:56.433 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.433 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.433 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:47:56.042+0000 7f248076e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:56.433 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.434 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.434 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.434 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:47:56.042+0000 7f247da73640 10 monclient: get_auth_request con 0x555ba1ced300 auth_method 0 2024-09-12T18:47:56.434 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:56.434 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.434 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:47:56.042+0000 7f247ea75640 10 monclient: get_auth_request con 0x555ba1cf0b60 auth_method 0 2024-09-12T18:47:56.434 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:47:56.046+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:56.434 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:47:56.046+0000 7f248076e9c0 20 searching for the correct realm 2024-09-12T18:47:56.434 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:47:56.046+0000 7f247e274640 10 monclient: get_auth_request con 0x7f2478032040 auth_method 0 2024-09-12T18:47:56.434 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:47:56.046+0000 7f247da73640 10 monclient: get_auth_request con 0x7f24700882e0 auth_method 0 2024-09-12T18:47:56.434 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:47:56.046+0000 7f247ea75640 10 monclient: get_auth_request con 0x7f24740bb020 auth_method 0 2024-09-12T18:47:56.434 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:47:56.050+0000 7f247e274640 0 -- 172.21.15.111:0/4062124839 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f2478032040 msgr2=0x7f2478032930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:47:56.434 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:47:56.050+0000 7f234ffff640 1 client.7404.objecter ms_handle_reset 0x7f2478032040 session 0x7f247802b040 osd.7 2024-09-12T18:47:56.435 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:47:56.050+0000 7f234ffff640 10 monclient: _renew_subs 2024-09-12T18:47:56.435 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:47:56.050+0000 7f234ffff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.435 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:47:56.050+0000 7f247e274640 10 monclient: get_auth_request con 0x7f2348080a80 auth_method 0 2024-09-12T18:47:56.435 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:47:56.050+0000 7f247e274640 10 monclient: get_auth_request con 0x7f2478010950 auth_method 0 2024-09-12T18:47:56.435 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:47:56.054+0000 7f247da73640 10 monclient: get_auth_request con 0x7f24780243f0 auth_method 0 2024-09-12T18:47:56.435 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:47:56.058+0000 7f247da73640 0 -- 172.21.15.111:0/4062124839 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f24780243f0 msgr2=0x7f2478024850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:47:56.435 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:47:56.262+0000 7f247da73640 10 monclient: get_auth_request con 0x7f24780243f0 auth_method 0 2024-09-12T18:47:56.435 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:56.435 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:56.435 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:56.435 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:56.435 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:56.435 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:56.435 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.436 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.436 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.436 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:56.436 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.436 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:56.436 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 zone default found 2024-09-12T18:47:56.436 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:47:56.278+0000 7f248076e9c0 4 Realm: () 2024-09-12T18:47:56.436 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:47:56.278+0000 7f248076e9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:56.436 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:47:56.278+0000 7f248076e9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:56.436 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:47:56.278+0000 7f248076e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:56.436 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 zonegroup default 2024-09-12T18:47:56.436 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.436 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.437 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.437 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:47:56.282+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.437 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:47:56.282+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.437 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:47:56.282+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.437 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:47:56.282+0000 7f248076e9c0 20 started sync module instance, tier type = 2024-09-12T18:47:56.437 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:47:56.282+0000 7f248076e9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:56.437 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=0 2024-09-12T18:47:56.437 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=1 2024-09-12T18:47:56.437 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=2 2024-09-12T18:47:56.438 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=3 2024-09-12T18:47:56.438 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=4 2024-09-12T18:47:56.438 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=5 2024-09-12T18:47:56.438 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=6 2024-09-12T18:47:56.438 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:47:56.306+0000 7f248076e9c0 20 add_watcher() i=7 2024-09-12T18:47:56.438 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:47:56.306+0000 7f248076e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:56.438 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding auth protocol: cephx 2024-09-12T18:47:56.438 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding auth protocol: cephx 2024-09-12T18:47:56.438 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding auth protocol: cephx 2024-09-12T18:47:56.438 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: secure 2024-09-12T18:47:56.438 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: crc 2024-09-12T18:47:56.438 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: secure 2024-09-12T18:47:56.438 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: crc 2024-09-12T18:47:56.439 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: secure 2024-09-12T18:47:56.439 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: crc 2024-09-12T18:47:56.439 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: crc 2024-09-12T18:47:56.439 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: secure 2024-09-12T18:47:56.439 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: crc 2024-09-12T18:47:56.439 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:47:56.310+0000 7f2334fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:56.439 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: secure 2024-09-12T18:47:56.439 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: crc 2024-09-12T18:47:56.439 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: secure 2024-09-12T18:47:56.439 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:47:56.310+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.439 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:56.439 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:56.439 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command cache list hook 0x555ba1cc8cd0 2024-09-12T18:47:56.440 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command cache inspect hook 0x555ba1cc8cd0 2024-09-12T18:47:56.440 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command cache erase hook 0x555ba1cc8cd0 2024-09-12T18:47:56.440 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command cache zap hook 0x555ba1cc8cd0 2024-09-12T18:47:56.440 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 note: GC not initialized 2024-09-12T18:47:56.440 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:47:56.310+0000 7f22af7fe640 20 reqs_thread_entry: start 2024-09-12T18:47:56.440 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command sync trace show hook 0x7f2470084020 2024-09-12T18:47:56.440 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command sync trace history hook 0x7f2470084020 2024-09-12T18:47:56.440 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command sync trace active hook 0x7f2470084020 2024-09-12T18:47:56.440 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command sync trace active_short hook 0x7f2470084020 2024-09-12T18:47:56.440 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:47:56.310+0000 7f248076e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:56.440 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:47:56.310+0000 7f248076e9c0 20 Filter name: none 2024-09-12T18:47:56.440 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:47:56.310+0000 7f22ad7fa640 20 reqs_thread_entry: start 2024-09-12T18:47:56.440 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:47:56.310+0000 7f248076e9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T18:47:56.441 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.441 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:56.441 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:47:56.310+0000 7f248076e9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T18:47:56.441 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:47:56.310+0000 7f248076e9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T18:47:56.441 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:47:56.310+0000 7f248076e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 : miss 2024-09-12T18:47:56.441 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.441 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:47:56.314+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:56.441 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:47:56.314+0000 7f248076e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.441 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:47:56.314+0000 7f248076e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.441 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:47:56.314+0000 7f248076e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:47:56.441 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:47:56.314+0000 7f248076e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.441 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:47:56.314+0000 7f248076e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 2024-09-12T18:47:56.441 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:47:56.326+0000 7f248076e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.442 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:47:56.326+0000 7f248076e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.442 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:47:56.326+0000 7f248076e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.442 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:47:56.326+0000 7f248076e9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32, ofs0, ns] 2024-09-12T18:47:56.442 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:47:56.326+0000 7f23617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431642 cookie 93852045131408 notifier 7404 bl.length()=931 2024-09-12T18:47:56.442 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:47:56.326+0000 7f23617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.442 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:47:56.326+0000 7f23617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.442 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:47:56.326+0000 7f23617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.442 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:47:56.326+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_sources= new_sources= 2024-09-12T18:47:56.442 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:47:56.326+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential sources added=[] removed=[] 2024-09-12T18:47:56.442 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:47:56.326+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_dests= new_dests= 2024-09-12T18:47:56.442 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:47:56.326+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential dests added=[] removed=[] 2024-09-12T18:47:56.442 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.0 2024-09-12T18:47:56.442 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.0 2024-09-12T18:47:56.442 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.1 2024-09-12T18:47:56.443 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.1 2024-09-12T18:47:56.443 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.2 2024-09-12T18:47:56.443 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.2 2024-09-12T18:47:56.443 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.3 2024-09-12T18:47:56.443 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.3 2024-09-12T18:47:56.443 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.4 2024-09-12T18:47:56.443 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.4 2024-09-12T18:47:56.443 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.5 2024-09-12T18:47:56.443 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.5 2024-09-12T18:47:56.443 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.6 2024-09-12T18:47:56.443 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.6 2024-09-12T18:47:56.443 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.7 2024-09-12T18:47:56.443 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.7 2024-09-12T18:47:56.444 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.8 2024-09-12T18:47:56.444 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.8 2024-09-12T18:47:56.444 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.9 2024-09-12T18:47:56.444 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.9 2024-09-12T18:47:56.444 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.10 2024-09-12T18:47:56.444 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.10 2024-09-12T18:47:56.444 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.11 2024-09-12T18:47:56.444 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.11 2024-09-12T18:47:56.444 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.0 2024-09-12T18:47:56.444 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1 2024-09-12T18:47:56.444 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.2 2024-09-12T18:47:56.444 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:47:56.342+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.3 2024-09-12T18:47:56.444 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:47:56.342+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.4 2024-09-12T18:47:56.445 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:47:56.342+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.5 2024-09-12T18:47:56.445 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:47:56.342+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.6 2024-09-12T18:47:56.445 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:47:56.346+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.7 2024-09-12T18:47:56.445 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:47:56.346+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.8 2024-09-12T18:47:56.445 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:47:56.346+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.9 2024-09-12T18:47:56.445 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:47:56.350+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.10 2024-09-12T18:47:56.445 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:47:56.354+0000 7f248076e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:56.445 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:47:56.354+0000 7f248076e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 2024-09-12T18:47:56.445 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:47:56.358+0000 7f248076e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.445 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:47:56.358+0000 7f248076e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.445 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:47:56.358+0000 7f248076e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.445 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:47:56.358+0000 7f248076e9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32, ofs0, ns] 2024-09-12T18:47:56.446 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:47:56.358+0000 7f23617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431643 cookie 93852045131408 notifier 7404 bl.length()=931 2024-09-12T18:47:56.446 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:47:56.358+0000 7f23617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.446 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:47:56.358+0000 7f23617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.446 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:47:56.358+0000 7f23617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.446 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:47:56.358+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_sources= new_sources= 2024-09-12T18:47:56.446 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:47:56.358+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential sources added=[] removed=[] 2024-09-12T18:47:56.446 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:47:56.358+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_dests= new_dests= 2024-09-12T18:47:56.446 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:47:56.358+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential dests added=[] removed=[] 2024-09-12T18:47:56.447 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:47:56.362+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.0 2024-09-12T18:47:56.447 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1 2024-09-12T18:47:56.447 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.2 2024-09-12T18:47:56.447 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.3 2024-09-12T18:47:56.447 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.4 2024-09-12T18:47:56.447 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.5 2024-09-12T18:47:56.447 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.6 2024-09-12T18:47:56.447 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:47:56.370+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.7 2024-09-12T18:47:56.447 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:47:56.370+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.8 2024-09-12T18:47:56.447 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:47:56.370+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.9 2024-09-12T18:47:56.447 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:47:56.370+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.10 2024-09-12T18:47:56.447 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:47:56.374+0000 7f248076e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f248076e9c0 time 2024-09-12T18:47:56.377123+0000 2024-09-12T18:47:56.447 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:47:56.448 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.448 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:56.448 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f24840482eb] 2024-09-12T18:47:56.448 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f248404849f] 2024-09-12T18:47:56.448 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ba029fcc1] 2024-09-12T18:47:56.448 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555ba02b4fc7] 2024-09-12T18:47:56.448 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:47:56.448 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2482eaed90] 2024-09-12T18:47:56.448 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:47:56.448 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:47:56.448 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.448 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:47:56.374+0000 7f248076e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:47:56.449 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f248076e9c0 thread_name:radosgw-admin 2024-09-12T18:47:56.449 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.449 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:56.449 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2482ec7520] 2024-09-12T18:47:56.449 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:47:56.449 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:47:56.449 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:47:56.449 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2484048345] 2024-09-12T18:47:56.449 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f248404849f] 2024-09-12T18:47:56.449 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ba029fcc1] 2024-09-12T18:47:56.449 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555ba02b4fc7] 2024-09-12T18:47:56.450 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:47:56.450 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2482eaed90] 2024-09-12T18:47:56.450 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:47:56.450 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:47:56.450 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:47:56.450 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.450 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:47:56.450 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:47:56.450 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:47:56.450 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:47:56.450 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:47:56.450 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:47:56.450 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:47:56.451 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:47:56.451 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:47:56.451 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:47:56.451 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:47:56.451 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:47:56.451 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:47:56.451 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:47:56.451 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:47:56.451 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:47:56.451 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:47:56.451 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:47:56.451 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:47:56.451 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:47:56.451 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:47:56.452 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:47:56.452 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:47:56.452 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:47:56.452 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:47:56.452 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:47:56.452 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:47:56.452 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:47:56.452 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:47:56.452 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:47:56.452 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:47:56.452 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:47:56.452 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:47:56.452 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:47:56.452 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:47:56.453 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:47:56.453 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:47:56.453 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:47:56.453 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:47:56.453 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:47:56.453 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:47:56.453 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:47:56.453 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:47:56.453 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:47:56.453 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:47:56.453 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:47:56.453 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:47:56.453 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:47:56.453 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:47:56.454 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:47:56.454 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:47:56.454 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:47:56.454 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:47:56.454 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:47:56.454 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:47:56.454 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:47:56.454 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:47:56.454 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:47:56.454 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:47:56.454 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:47:56.454 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:47:56.454 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:47:56.455 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:47:56.455 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:47:56.455 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:47:56.455 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:47:56.455 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:47:56.455 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:47:56.455 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:47:56.455 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:47:56.455 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:47:56.455 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:47:56.455 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:47:56.455 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:47:56.456 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:47:56.456 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:47:56.456 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:47:56.456 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:47:56.456 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:47:56.456 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:47:56.456 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:47:56.456 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:47:56.456 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:47:56.456 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:47:56.456 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:47:56.456 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:47:56.456 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:47:56.457 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:47:56.457 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:47:56.457 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:47:56.457 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:47:56.457 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:47:56.457 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:47:56.457 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:47:56.457 INFO:tasks.workunit.client.0.smithi111.stderr: 7f22ad7fa640 / http_manager 2024-09-12T18:47:56.457 INFO:tasks.workunit.client.0.smithi111.stderr: 7f22af7fe640 / http_manager 2024-09-12T18:47:56.457 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2334fe1640 / rgw_dt_lg_renew 2024-09-12T18:47:56.457 INFO:tasks.workunit.client.0.smithi111.stderr: 7f234ffff640 / ms_dispatch 2024-09-12T18:47:56.457 INFO:tasks.workunit.client.0.smithi111.stderr: 7f23617fa640 / io_context_pool 2024-09-12T18:47:56.457 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2361ffb640 / io_context_pool 2024-09-12T18:47:56.458 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2363fff640 / ms_dispatch 2024-09-12T18:47:56.458 INFO:tasks.workunit.client.0.smithi111.stderr: 7f236ae05640 / ms_dispatch 2024-09-12T18:47:56.458 INFO:tasks.workunit.client.0.smithi111.stderr: 7f236c608640 / io_context_pool 2024-09-12T18:47:56.458 INFO:tasks.workunit.client.0.smithi111.stderr: 7f247d272640 / io_context_pool 2024-09-12T18:47:56.458 INFO:tasks.workunit.client.0.smithi111.stderr: 7f247da73640 / msgr-worker-2 2024-09-12T18:47:56.458 INFO:tasks.workunit.client.0.smithi111.stderr: 7f247e274640 / msgr-worker-1 2024-09-12T18:47:56.458 INFO:tasks.workunit.client.0.smithi111.stderr: 7f247ea75640 / msgr-worker-0 2024-09-12T18:47:56.458 INFO:tasks.workunit.client.0.smithi111.stderr: 7f248076e9c0 / radosgw-admin 2024-09-12T18:47:56.458 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:47:56.458 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:47:56.458 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/log/ceph/ceph-client.admin.114836.log 2024-09-12T18:47:56.458 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:47:56.458 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:47:56.459 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 AuthRegistry(0x555ba1bfc0b0) adding con mode: crc 2024-09-12T18:47:56.459 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 AuthRegistry(0x555ba1bfc0b0) adding con mode: crc 2024-09-12T18:47:56.459 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 AuthRegistry(0x555ba1bfc0b0) adding con mode: secure 2024-09-12T18:47:56.459 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 AuthRegistry(0x555ba1bfc0b0) adding con mode: crc 2024-09-12T18:47:56.459 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 AuthRegistry(0x555ba1bfc0b0) adding con mode: secure 2024-09-12T18:47:56.459 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 AuthRegistry(0x555ba1bfc0b0) adding con mode: crc 2024-09-12T18:47:56.459 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 AuthRegistry(0x555ba1bfc0b0) adding con mode: secure 2024-09-12T18:47:56.459 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:47:56.018+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.459 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:47:56.018+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.459 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command rotate-key hook 0x555ba1bfc1f8 2024-09-12T18:47:56.459 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:56.459 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:47:56.459 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-a con 0x555ba1aabde0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:56.460 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-b con 0x555ba1aba820 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:56.460 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-c con 0x555ba1b44a20 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:56.460 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.460 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.460 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.460 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:56.460 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:47:56.018+0000 7f248076e9c0 10 monclient(hunting): authenticate will time out at 2263.163189s 2024-09-12T18:47:56.460 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): get_auth_request con 0x555ba1aabde0 auth_method 0 2024-09-12T18:47:56.460 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.460 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.460 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.460 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:47:56.018+0000 7f247ea75640 10 monclient(hunting): get_auth_request con 0x555ba1b44a20 auth_method 0 2024-09-12T18:47:56.460 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:47:56.018+0000 7f247ea75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.461 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:47:56.018+0000 7f247ea75640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.461 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:47:56.018+0000 7f247ea75640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.461 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:56.461 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:56.461 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:56.461 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:47:56.018+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:56.461 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:47:56.018+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:56.461 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:47:56.018+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:56.461 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient(hunting): handle_auth_done global_id 7395 payload 824 2024-09-12T18:47:56.461 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient: _finish_hunting 0 2024-09-12T18:47:56.461 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:47:56.018+0000 7f247e274640 1 monclient: found mon.noname-a 2024-09-12T18:47:56.461 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:47:56.018+0000 7f247e274640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.461 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.462 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:47:56.462 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: dump: 2024-09-12T18:47:56.462 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.462 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.462 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.462 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.462 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.462 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.462 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.462 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.462 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.462 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.462 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: _finish_auth 0 2024-09-12T18:47:56.463 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: _check_auth_tickets 2024-09-12T18:47:56.463 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:56.463 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.463 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:47:56.463 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:47:56.018+0000 7f236ae05640 10 monclient: dump: 2024-09-12T18:47:56.463 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.463 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.463 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.463 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.463 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.463 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.463 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.464 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.464 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.464 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.464 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:47:56.018+0000 7f248076e9c0 5 monclient: authenticate success, global_id 7395 2024-09-12T18:47:56.464 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:47:56.018+0000 7f236c608640 4 set_mon_vals no callback set 2024-09-12T18:47:56.464 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:47:56.022+0000 7f248076e9c0 10 monclient: _renew_subs 2024-09-12T18:47:56.464 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:47:56.022+0000 7f248076e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.464 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:47:56.022+0000 7f248076e9c0 10 monclient: _renew_subs 2024-09-12T18:47:56.464 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:47:56.022+0000 7f248076e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.464 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:47:56.022+0000 7f248076e9c0 1 librados: init done 2024-09-12T18:47:56.464 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:47:56.022+0000 7f236ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:47:56.464 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:47:56.022+0000 7f236ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:56.465 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:47:56.022+0000 7f236ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:56.465 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:47:56.022+0000 7f247da73640 10 monclient: get_auth_request con 0x7f2364070ae0 auth_method 0 2024-09-12T18:47:56.465 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:47:56.022+0000 7f247ea75640 10 monclient: get_auth_request con 0x555ba1c27980 auth_method 0 2024-09-12T18:47:56.465 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:47:56.022+0000 7f247e274640 10 monclient: get_auth_request con 0x555ba1c46720 auth_method 0 2024-09-12T18:47:56.465 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:47:56.026+0000 7f247da73640 10 monclient: get_auth_request con 0x555ba1c4aac0 auth_method 0 2024-09-12T18:47:56.465 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:47:56.026+0000 7f247ea75640 10 monclient: get_auth_request con 0x555ba1c49fe0 auth_method 0 2024-09-12T18:47:56.465 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: build_initial_monmap 2024-09-12T18:47:56.465 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:47:56.030+0000 7f248076e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:47:56.465 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: monmap: 2024-09-12T18:47:56.465 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:47:56.465 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:47:56.465 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:47:56.465 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:47:56.465 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:47:56.466 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.466 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:47:56.466 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:47:56.466 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:47:56.466 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.466 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding auth protocol: cephx 2024-09-12T18:47:56.466 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding auth protocol: cephx 2024-09-12T18:47:56.466 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding auth protocol: cephx 2024-09-12T18:47:56.466 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: secure 2024-09-12T18:47:56.466 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: crc 2024-09-12T18:47:56.466 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: secure 2024-09-12T18:47:56.466 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: crc 2024-09-12T18:47:56.466 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: secure 2024-09-12T18:47:56.467 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: crc 2024-09-12T18:47:56.467 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: crc 2024-09-12T18:47:56.467 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: secure 2024-09-12T18:47:56.467 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: crc 2024-09-12T18:47:56.467 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: secure 2024-09-12T18:47:56.467 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: crc 2024-09-12T18:47:56.467 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c52cc0) adding con mode: secure 2024-09-12T18:47:56.467 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:47:56.030+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.467 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command objecter_requests cmddesc objecter_requests hook 0x555ba1c566b0 EEXIST 2024-09-12T18:47:56.467 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: init 2024-09-12T18:47:56.467 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding auth protocol: cephx 2024-09-12T18:47:56.467 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding auth protocol: cephx 2024-09-12T18:47:56.467 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding auth protocol: cephx 2024-09-12T18:47:56.468 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: secure 2024-09-12T18:47:56.468 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: crc 2024-09-12T18:47:56.468 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: secure 2024-09-12T18:47:56.468 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: crc 2024-09-12T18:47:56.468 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: secure 2024-09-12T18:47:56.468 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: crc 2024-09-12T18:47:56.468 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: crc 2024-09-12T18:47:56.468 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: secure 2024-09-12T18:47:56.468 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: crc 2024-09-12T18:47:56.468 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: secure 2024-09-12T18:47:56.468 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: crc 2024-09-12T18:47:56.468 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c51bb8) adding con mode: secure 2024-09-12T18:47:56.468 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:47:56.030+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.468 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:47:56.030+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.469 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command rotate-key cmddesc rotate-key hook 0x555ba1c51d00 EEXIST 2024-09-12T18:47:56.469 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:56.469 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:47:56.469 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-b con 0x555ba1c80150 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:56.469 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-c con 0x555ba1c7abb0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:56.469 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-a con 0x555ba1c78c30 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:56.469 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.469 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.469 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.469 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:56.469 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient(hunting): authenticate will time out at 2263.173782s 2024-09-12T18:47:56.469 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): get_auth_request con 0x555ba1c78c30 auth_method 0 2024-09-12T18:47:56.469 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:47:56.030+0000 7f247ea75640 10 monclient(hunting): get_auth_request con 0x555ba1c7abb0 auth_method 0 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:47:56.030+0000 7f247ea75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:47:56.030+0000 7f247ea75640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:47:56.030+0000 7f247ea75640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:47:56.030+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:47:56.030+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:47:56.030+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:47:56.030+0000 7f247da73640 10 monclient(hunting): get_auth_request con 0x555ba1c80150 auth_method 0 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:47:56.030+0000 7f247da73640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.470 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:47:56.030+0000 7f247da73640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.471 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:47:56.030+0000 7f247da73640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.471 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient(hunting): handle_auth_done global_id 7398 payload 824 2024-09-12T18:47:56.471 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient: _finish_hunting 0 2024-09-12T18:47:56.471 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:47:56.030+0000 7f247e274640 1 monclient: found mon.noname-a 2024-09-12T18:47:56.471 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:47:56.030+0000 7f247e274640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.471 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.471 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:47:56.471 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: dump: 2024-09-12T18:47:56.471 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.471 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.471 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.471 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.471 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.471 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.472 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.472 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.472 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.472 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.472 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: _finish_auth 0 2024-09-12T18:47:56.472 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: _check_auth_tickets 2024-09-12T18:47:56.472 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:56.472 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.472 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:47:56.472 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:47:56.030+0000 7f2363fff640 10 monclient: dump: 2024-09-12T18:47:56.472 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.472 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.472 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.472 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.473 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.473 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.473 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.473 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.473 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.473 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.473 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:47:56.030+0000 7f248076e9c0 5 monclient: authenticate success, global_id 7398 2024-09-12T18:47:56.473 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: _renew_subs 2024-09-12T18:47:56.473 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.473 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:47:56.030+0000 7f247d272640 4 set_mon_vals no callback set 2024-09-12T18:47:56.473 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: _renew_subs 2024-09-12T18:47:56.473 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:47:56.030+0000 7f248076e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.473 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:47:56.034+0000 7f2363fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:47:56.474 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:47:56.034+0000 7f2363fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:56.474 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:47:56.034+0000 7f2363fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:56.474 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:47:56.034+0000 7f247da73640 10 monclient: get_auth_request con 0x7f23580709f0 auth_method 0 2024-09-12T18:47:56.474 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: get_monmap_and_config 2024-09-12T18:47:56.474 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: build_initial_monmap 2024-09-12T18:47:56.474 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:47:56.034+0000 7f248076e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:47:56.474 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: monmap: 2024-09-12T18:47:56.474 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:47:56.474 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:47:56.474 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:47:56.474 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:47:56.474 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:47:56.474 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.475 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:47:56.475 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:47:56.475 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:47:56.475 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.475 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding auth protocol: cephx 2024-09-12T18:47:56.475 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding auth protocol: cephx 2024-09-12T18:47:56.475 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding auth protocol: cephx 2024-09-12T18:47:56.475 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: secure 2024-09-12T18:47:56.475 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: crc 2024-09-12T18:47:56.475 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: secure 2024-09-12T18:47:56.475 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: crc 2024-09-12T18:47:56.475 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: secure 2024-09-12T18:47:56.475 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: crc 2024-09-12T18:47:56.475 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: crc 2024-09-12T18:47:56.476 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: secure 2024-09-12T18:47:56.476 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: crc 2024-09-12T18:47:56.476 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: secure 2024-09-12T18:47:56.476 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: crc 2024-09-12T18:47:56.476 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b290) adding con mode: secure 2024-09-12T18:47:56.476 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:47:56.034+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.476 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: init 2024-09-12T18:47:56.476 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding auth protocol: cephx 2024-09-12T18:47:56.476 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding auth protocol: cephx 2024-09-12T18:47:56.476 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding auth protocol: cephx 2024-09-12T18:47:56.476 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: secure 2024-09-12T18:47:56.476 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: crc 2024-09-12T18:47:56.476 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: secure 2024-09-12T18:47:56.477 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: crc 2024-09-12T18:47:56.477 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: secure 2024-09-12T18:47:56.477 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: crc 2024-09-12T18:47:56.477 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: crc 2024-09-12T18:47:56.477 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: secure 2024-09-12T18:47:56.477 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: crc 2024-09-12T18:47:56.477 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: secure 2024-09-12T18:47:56.477 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: crc 2024-09-12T18:47:56.477 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241f820) adding con mode: secure 2024-09-12T18:47:56.477 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:47:56.034+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.477 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:47:56.034+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.477 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe6241f968 EEXIST 2024-09-12T18:47:56.478 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:56.478 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:47:56.478 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-c con 0x555ba1cc9850 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:56.478 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-b con 0x555ba1cc9c30 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:56.478 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-a con 0x555ba1ccb0f0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:56.478 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.478 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.478 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.478 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:56.478 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient(hunting): authenticate will time out at 2263.177699s 2024-09-12T18:47:56.478 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): get_auth_request con 0x555ba1ccb0f0 auth_method 0 2024-09-12T18:47:56.478 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.479 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.479 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.479 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:56.479 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:56.479 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:56.479 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient(hunting): handle_auth_done global_id 7401 payload 274 2024-09-12T18:47:56.479 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient: _finish_hunting 0 2024-09-12T18:47:56.479 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:47:56.034+0000 7f247e274640 1 monclient: found mon.noname-a 2024-09-12T18:47:56.479 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:47:56.034+0000 7f247e274640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.479 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:47:56.034+0000 7f247ea75640 10 monclient: get_auth_request con 0x555ba1cc9c30 auth_method 0 2024-09-12T18:47:56.479 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.479 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:47:56.479 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: dump: 2024-09-12T18:47:56.479 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.480 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.480 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.480 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.480 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.480 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.480 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.480 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.480 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.480 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.480 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: _finish_auth 0 2024-09-12T18:47:56.480 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:47:56.480 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:56.480 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.480 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:47:56.481 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:47:56.034+0000 7f2361ffb640 10 monclient: dump: 2024-09-12T18:47:56.481 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.481 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.481 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.481 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.481 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.481 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.481 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.481 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.481 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.481 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.481 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 monclient: authenticate success, global_id 7401 2024-09-12T18:47:56.481 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:47:56.482 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:47:56.034+0000 7f248076e9c0 4 set_mon_vals no callback set 2024-09-12T18:47:56.482 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: shutdown 2024-09-12T18:47:56.482 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: build_initial_monmap 2024-09-12T18:47:56.482 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:47:56.034+0000 7f248076e9c0 1 build_initial for_mkfs: 0 2024-09-12T18:47:56.482 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: monmap: 2024-09-12T18:47:56.482 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:47:56.482 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:47:56.482 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:47:56.482 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:47:56.482 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:47:56.482 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.482 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:47:56.482 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:47:56.482 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:47:56.483 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.483 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding auth protocol: cephx 2024-09-12T18:47:56.483 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding auth protocol: cephx 2024-09-12T18:47:56.483 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding auth protocol: cephx 2024-09-12T18:47:56.483 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: secure 2024-09-12T18:47:56.483 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: crc 2024-09-12T18:47:56.483 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: secure 2024-09-12T18:47:56.483 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: crc 2024-09-12T18:47:56.483 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: secure 2024-09-12T18:47:56.483 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: crc 2024-09-12T18:47:56.483 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: crc 2024-09-12T18:47:56.483 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: secure 2024-09-12T18:47:56.483 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: crc 2024-09-12T18:47:56.484 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: secure 2024-09-12T18:47:56.484 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: crc 2024-09-12T18:47:56.484 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1c9b240) adding con mode: secure 2024-09-12T18:47:56.484 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:47:56.034+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.484 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:47:56.034+0000 7f248076e9c0 1 librados: starting msgr at 2024-09-12T18:47:56.484 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:47:56.034+0000 7f248076e9c0 1 librados: starting objecter 2024-09-12T18:47:56.484 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command objecter_requests cmddesc objecter_requests hook 0x555ba1c7a050 EEXIST 2024-09-12T18:47:56.484 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:47:56.034+0000 7f248076e9c0 1 librados: setting wanted keys 2024-09-12T18:47:56.484 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:47:56.034+0000 7f248076e9c0 1 librados: calling monclient init 2024-09-12T18:47:56.484 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:47:56.034+0000 7f248076e9c0 10 monclient: init 2024-09-12T18:47:56.484 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding auth protocol: cephx 2024-09-12T18:47:56.484 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding auth protocol: cephx 2024-09-12T18:47:56.484 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding auth protocol: cephx 2024-09-12T18:47:56.484 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: secure 2024-09-12T18:47:56.485 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: crc 2024-09-12T18:47:56.485 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: secure 2024-09-12T18:47:56.485 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: crc 2024-09-12T18:47:56.485 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: secure 2024-09-12T18:47:56.485 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: crc 2024-09-12T18:47:56.485 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: crc 2024-09-12T18:47:56.485 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: secure 2024-09-12T18:47:56.485 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: crc 2024-09-12T18:47:56.485 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: secure 2024-09-12T18:47:56.485 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: crc 2024-09-12T18:47:56.485 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:47:56.034+0000 7f248076e9c0 5 AuthRegistry(0x555ba1a8a8b0) adding con mode: secure 2024-09-12T18:47:56.485 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:47:56.034+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.485 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:47:56.038+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.486 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:47:56.038+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command rotate-key cmddesc rotate-key hook 0x555ba1a8a9f8 EEXIST 2024-09-12T18:47:56.486 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:47:56.486 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:47:56.486 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-a con 0x555ba1cc9850 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:47:56.486 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-c con 0x555ba1ccb0f0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:47:56.486 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): picked mon.noname-b con 0x555ba1cc60c0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:47:56.486 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.486 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.486 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:47:56.486 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:47:56.486 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient(hunting): authenticate will time out at 2263.180333s 2024-09-12T18:47:56.486 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): get_auth_request con 0x555ba1cc9850 auth_method 0 2024-09-12T18:47:56.486 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.487 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.487 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.487 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:47:56.038+0000 7f247ea75640 10 monclient(hunting): get_auth_request con 0x555ba1ccb0f0 auth_method 0 2024-09-12T18:47:56.487 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:47:56.038+0000 7f247ea75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:47:56.487 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:47:56.038+0000 7f247ea75640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:47:56.487 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:47:56.038+0000 7f247ea75640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:47:56.487 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:56.487 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:56.487 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:56.487 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:47:56.038+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:47:56.487 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:47:56.038+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:47:56.487 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:47:56.038+0000 7f247ea75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:47:56.487 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient(hunting): handle_auth_done global_id 7404 payload 824 2024-09-12T18:47:56.488 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient: _finish_hunting 0 2024-09-12T18:47:56.488 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:47:56.038+0000 7f247da73640 1 monclient: found mon.noname-a 2024-09-12T18:47:56.488 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:47:56.038+0000 7f247da73640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.488 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.488 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:47:56.488 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: dump: 2024-09-12T18:47:56.488 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.488 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.488 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.488 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.488 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.488 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.488 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.488 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.489 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.489 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.489 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: _finish_auth 0 2024-09-12T18:47:56.489 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: _check_auth_tickets 2024-09-12T18:47:56.489 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:47:56.489 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:47:56.489 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:47:56.489 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:47:56.038+0000 7f234ffff640 10 monclient: dump: 2024-09-12T18:47:56.489 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:47:56.489 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:47:56.489 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.489 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:47:56.489 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:47:56.490 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:47:56.490 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:47:56.490 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:47:56.490 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:47:56.490 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.490 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:47:56.038+0000 7f2361ffb640 4 set_mon_vals no callback set 2024-09-12T18:47:56.490 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:47:56.038+0000 7f248076e9c0 5 monclient: authenticate success, global_id 7404 2024-09-12T18:47:56.490 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient: _renew_subs 2024-09-12T18:47:56.490 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.490 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient: _renew_subs 2024-09-12T18:47:56.490 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:47:56.038+0000 7f248076e9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.490 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:47:56.038+0000 7f248076e9c0 1 librados: init done 2024-09-12T18:47:56.490 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:47:56.038+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command cr dump hook 0x555ba1ccb598 2024-09-12T18:47:56.490 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:47:56.038+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.491 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:47:56.038+0000 7f234ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:47:56.491 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:47:56.038+0000 7f234ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:56.491 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:47:56.038+0000 7f234ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:47:56.491 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:47:56.042+0000 7f247ea75640 10 monclient: get_auth_request con 0x7f2348070ae0 auth_method 0 2024-09-12T18:47:56.491 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:47:56.042+0000 7f247e274640 10 monclient: get_auth_request con 0x555ba1ce90c0 auth_method 0 2024-09-12T18:47:56.491 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.491 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 realm 2024-09-12T18:47:56.491 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.491 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.491 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:47:56.042+0000 7f248076e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:56.491 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.491 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.491 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.492 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:47:56.042+0000 7f247da73640 10 monclient: get_auth_request con 0x555ba1ced300 auth_method 0 2024-09-12T18:47:56.492 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:56.492 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:47:56.042+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.492 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:47:56.042+0000 7f247ea75640 10 monclient: get_auth_request con 0x555ba1cf0b60 auth_method 0 2024-09-12T18:47:56.492 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:47:56.046+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:56.492 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:47:56.046+0000 7f248076e9c0 20 searching for the correct realm 2024-09-12T18:47:56.492 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:47:56.046+0000 7f247e274640 10 monclient: get_auth_request con 0x7f2478032040 auth_method 0 2024-09-12T18:47:56.492 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:47:56.046+0000 7f247da73640 10 monclient: get_auth_request con 0x7f24700882e0 auth_method 0 2024-09-12T18:47:56.492 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:47:56.046+0000 7f247ea75640 10 monclient: get_auth_request con 0x7f24740bb020 auth_method 0 2024-09-12T18:47:56.492 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:47:56.050+0000 7f247e274640 0 -- 172.21.15.111:0/4062124839 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f2478032040 msgr2=0x7f2478032930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:47:56.492 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:47:56.050+0000 7f234ffff640 1 client.7404.objecter ms_handle_reset 0x7f2478032040 session 0x7f247802b040 osd.7 2024-09-12T18:47:56.492 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:47:56.050+0000 7f234ffff640 10 monclient: _renew_subs 2024-09-12T18:47:56.492 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:47:56.050+0000 7f234ffff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:47:56.492 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:47:56.050+0000 7f247e274640 10 monclient: get_auth_request con 0x7f2348080a80 auth_method 0 2024-09-12T18:47:56.493 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:47:56.050+0000 7f247e274640 10 monclient: get_auth_request con 0x7f2478010950 auth_method 0 2024-09-12T18:47:56.493 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:47:56.054+0000 7f247da73640 10 monclient: get_auth_request con 0x7f24780243f0 auth_method 0 2024-09-12T18:47:56.493 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:47:56.058+0000 7f247da73640 0 -- 172.21.15.111:0/4062124839 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f24780243f0 msgr2=0x7f2478024850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:47:56.493 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:47:56.262+0000 7f247da73640 10 monclient: get_auth_request con 0x7f24780243f0 auth_method 0 2024-09-12T18:47:56.493 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:56.493 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:56.493 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:56.493 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:56.493 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:56.493 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:56.493 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.493 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.493 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.494 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:56.494 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.494 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:56.494 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 zone default found 2024-09-12T18:47:56.494 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:47:56.278+0000 7f248076e9c0 4 Realm: () 2024-09-12T18:47:56.494 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:47:56.278+0000 7f248076e9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:56.494 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:47:56.278+0000 7f248076e9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:56.494 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:47:56.278+0000 7f248076e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:56.494 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 zonegroup default 2024-09-12T18:47:56.494 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.494 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.494 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:47:56.278+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.494 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:47:56.282+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.494 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:47:56.282+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.495 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:47:56.282+0000 7f248076e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.495 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:47:56.282+0000 7f248076e9c0 20 started sync module instance, tier type = 2024-09-12T18:47:56.495 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:47:56.282+0000 7f248076e9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:56.495 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=0 2024-09-12T18:47:56.495 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=1 2024-09-12T18:47:56.495 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=2 2024-09-12T18:47:56.495 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=3 2024-09-12T18:47:56.495 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=4 2024-09-12T18:47:56.495 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=5 2024-09-12T18:47:56.495 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:47:56.302+0000 7f248076e9c0 20 add_watcher() i=6 2024-09-12T18:47:56.495 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:47:56.306+0000 7f248076e9c0 20 add_watcher() i=7 2024-09-12T18:47:56.495 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:47:56.306+0000 7f248076e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:56.495 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding auth protocol: cephx 2024-09-12T18:47:56.495 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding auth protocol: cephx 2024-09-12T18:47:56.496 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding auth protocol: cephx 2024-09-12T18:47:56.496 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: secure 2024-09-12T18:47:56.496 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: crc 2024-09-12T18:47:56.496 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: secure 2024-09-12T18:47:56.496 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: crc 2024-09-12T18:47:56.496 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: secure 2024-09-12T18:47:56.496 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: crc 2024-09-12T18:47:56.496 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: crc 2024-09-12T18:47:56.496 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: secure 2024-09-12T18:47:56.496 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: crc 2024-09-12T18:47:56.496 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:47:56.310+0000 7f2334fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:56.496 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: secure 2024-09-12T18:47:56.496 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: crc 2024-09-12T18:47:56.496 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 AuthRegistry(0x7ffe6241fd00) adding con mode: secure 2024-09-12T18:47:56.497 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:47:56.310+0000 7f248076e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:47:56.497 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:56.497 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:56.497 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command cache list hook 0x555ba1cc8cd0 2024-09-12T18:47:56.497 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command cache inspect hook 0x555ba1cc8cd0 2024-09-12T18:47:56.497 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command cache erase hook 0x555ba1cc8cd0 2024-09-12T18:47:56.497 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command cache zap hook 0x555ba1cc8cd0 2024-09-12T18:47:56.497 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 note: GC not initialized 2024-09-12T18:47:56.497 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:47:56.310+0000 7f22af7fe640 20 reqs_thread_entry: start 2024-09-12T18:47:56.497 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command sync trace show hook 0x7f2470084020 2024-09-12T18:47:56.497 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command sync trace history hook 0x7f2470084020 2024-09-12T18:47:56.497 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command sync trace active hook 0x7f2470084020 2024-09-12T18:47:56.497 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:47:56.310+0000 7f248076e9c0 5 asok(0x555ba19f22b0) register_command sync trace active_short hook 0x7f2470084020 2024-09-12T18:47:56.497 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:47:56.310+0000 7f248076e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:56.498 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:47:56.310+0000 7f248076e9c0 20 Filter name: none 2024-09-12T18:47:56.498 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:47:56.310+0000 7f22ad7fa640 20 reqs_thread_entry: start 2024-09-12T18:47:56.498 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:47:56.310+0000 7f248076e9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T18:47:56.498 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.498 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:56.498 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:47:56.310+0000 7f248076e9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T18:47:56.498 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:47:56.310+0000 7f248076e9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T18:47:56.498 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:47:56.310+0000 7f248076e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 : miss 2024-09-12T18:47:56.498 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:47:56.310+0000 7f248076e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.498 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:47:56.314+0000 7f248076e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:47:56.498 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:47:56.314+0000 7f248076e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.498 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:47:56.314+0000 7f248076e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.498 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:47:56.314+0000 7f248076e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:47:56.499 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:47:56.314+0000 7f248076e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.499 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:47:56.314+0000 7f248076e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 2024-09-12T18:47:56.499 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:47:56.326+0000 7f248076e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.499 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:47:56.326+0000 7f248076e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.499 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:47:56.326+0000 7f248076e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.499 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:47:56.326+0000 7f248076e9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32, ofs0, ns] 2024-09-12T18:47:56.499 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:47:56.326+0000 7f23617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431642 cookie 93852045131408 notifier 7404 bl.length()=931 2024-09-12T18:47:56.499 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:47:56.326+0000 7f23617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.499 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:47:56.326+0000 7f23617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.499 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:47:56.326+0000 7f23617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.499 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:47:56.326+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_sources= new_sources= 2024-09-12T18:47:56.499 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:47:56.326+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential sources added=[] removed=[] 2024-09-12T18:47:56.499 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:47:56.326+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_dests= new_dests= 2024-09-12T18:47:56.500 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:47:56.326+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential dests added=[] removed=[] 2024-09-12T18:47:56.500 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.0 2024-09-12T18:47:56.500 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.0 2024-09-12T18:47:56.500 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.1 2024-09-12T18:47:56.500 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.1 2024-09-12T18:47:56.500 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.2 2024-09-12T18:47:56.500 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.2 2024-09-12T18:47:56.500 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.3 2024-09-12T18:47:56.500 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.3 2024-09-12T18:47:56.500 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.4 2024-09-12T18:47:56.500 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.4 2024-09-12T18:47:56.500 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.5 2024-09-12T18:47:56.500 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.5 2024-09-12T18:47:56.500 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.6 2024-09-12T18:47:56.501 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.6 2024-09-12T18:47:56.501 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.7 2024-09-12T18:47:56.501 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.7 2024-09-12T18:47:56.501 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.8 2024-09-12T18:47:56.501 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.8 2024-09-12T18:47:56.501 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.9 2024-09-12T18:47:56.501 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.9 2024-09-12T18:47:56.501 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.10 2024-09-12T18:47:56.501 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.10 2024-09-12T18:47:56.501 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:47:56.338+0000 7f248076e9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.11 2024-09-12T18:47:56.501 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.11 2024-09-12T18:47:56.501 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.0 2024-09-12T18:47:56.501 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1 2024-09-12T18:47:56.502 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:47:56.338+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.2 2024-09-12T18:47:56.502 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:47:56.342+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.3 2024-09-12T18:47:56.502 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:47:56.342+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.4 2024-09-12T18:47:56.502 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:47:56.342+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.5 2024-09-12T18:47:56.502 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:47:56.342+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.6 2024-09-12T18:47:56.502 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:47:56.346+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.7 2024-09-12T18:47:56.502 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:47:56.346+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.8 2024-09-12T18:47:56.502 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:47:56.346+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.9 2024-09-12T18:47:56.502 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:47:56.350+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.10 2024-09-12T18:47:56.502 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:47:56.354+0000 7f248076e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:47:56.502 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:47:56.354+0000 7f248076e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 2024-09-12T18:47:56.502 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:47:56.358+0000 7f248076e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.502 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:47:56.358+0000 7f248076e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.502 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:47:56.358+0000 7f248076e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.503 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:47:56.358+0000 7f248076e9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32, ofs0, ns] 2024-09-12T18:47:56.503 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:47:56.358+0000 7f23617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431643 cookie 93852045131408 notifier 7404 bl.length()=931 2024-09-12T18:47:56.503 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:47:56.358+0000 7f23617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:47:56.503 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:47:56.358+0000 7f23617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:47:56.503 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:47:56.358+0000 7f23617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:47:56.503 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:47:56.358+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_sources= new_sources= 2024-09-12T18:47:56.503 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:47:56.358+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential sources added=[] removed=[] 2024-09-12T18:47:56.503 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:47:56.358+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_dests= new_dests= 2024-09-12T18:47:56.503 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:47:56.358+0000 7f248076e9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential dests added=[] removed=[] 2024-09-12T18:47:56.503 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:47:56.362+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.0 2024-09-12T18:47:56.503 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1 2024-09-12T18:47:56.503 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.2 2024-09-12T18:47:56.503 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.3 2024-09-12T18:47:56.504 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.4 2024-09-12T18:47:56.504 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.5 2024-09-12T18:47:56.504 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:47:56.366+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.6 2024-09-12T18:47:56.504 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:47:56.370+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.7 2024-09-12T18:47:56.504 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:47:56.370+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.8 2024-09-12T18:47:56.504 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:47:56.370+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.9 2024-09-12T18:47:56.504 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:47:56.370+0000 7f248076e9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.10 2024-09-12T18:47:56.504 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:47:56.374+0000 7f248076e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f248076e9c0 time 2024-09-12T18:47:56.377123+0000 2024-09-12T18:47:56.504 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:47:56.504 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.504 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:56.504 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f24840482eb] 2024-09-12T18:47:56.504 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f248404849f] 2024-09-12T18:47:56.504 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ba029fcc1] 2024-09-12T18:47:56.505 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555ba02b4fc7] 2024-09-12T18:47:56.505 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:47:56.505 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2482eaed90] 2024-09-12T18:47:56.505 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:47:56.505 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:47:56.505 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.505 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:47:56.374+0000 7f248076e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:47:56.505 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f248076e9c0 thread_name:radosgw-admin 2024-09-12T18:47:56.505 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.505 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:47:56.505 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2482ec7520] 2024-09-12T18:47:56.505 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:47:56.505 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:47:56.505 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:47:56.506 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2484048345] 2024-09-12T18:47:56.506 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f248404849f] 2024-09-12T18:47:56.506 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ba029fcc1] 2024-09-12T18:47:56.506 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x555ba02b4fc7] 2024-09-12T18:47:56.506 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:47:56.506 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2482eaed90] 2024-09-12T18:47:56.506 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:47:56.506 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:47:56.506 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:47:56.506 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.506 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:47:56.506 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:47:56.506 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:47:56.507 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:47:56.507 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:47:56.507 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:47:56.507 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:47:56.507 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:47:56.507 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:47:56.507 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:47:56.507 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:47:56.507 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:47:56.507 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:47:56.507 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:47:56.507 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:47:56.507 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:47:56.507 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:47:56.508 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:47:56.508 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:47:56.508 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:47:56.508 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:47:56.508 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:47:56.508 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:47:56.508 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:47:56.508 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:47:56.508 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:47:56.508 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:47:56.508 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:47:56.508 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:47:56.509 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:47:56.509 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:47:56.509 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:47:56.509 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:47:56.509 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:47:56.509 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:47:56.509 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:47:56.509 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:47:56.509 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:47:56.509 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:47:56.509 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:47:56.509 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:47:56.509 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:47:56.509 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:47:56.510 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:47:56.510 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:47:56.510 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:47:56.510 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:47:56.510 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:47:56.510 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:47:56.510 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:47:56.510 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:47:56.510 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:47:56.510 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:47:56.510 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:47:56.510 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:47:56.510 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:47:56.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:47:56.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:47:56.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:47:56.511 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:47:56.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:47:56.511 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:47:56.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:47:56.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:47:56.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:47:56.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:47:56.511 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:47:56.511 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:47:56.511 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:47:56.511 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:47:56.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:47:56.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:47:56.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:47:56.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:47:56.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:47:56.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:47:56.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:47:56.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:47:56.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:47:56.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:47:56.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:47:56.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:47:56.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:47:56.512 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:47:56.513 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:47:56.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:47:56.513 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:47:56.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:47:56.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:47:56.513 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:47:56.513 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:47:56.513 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:47:56.513 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:47:56.513 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:47:56.513 INFO:tasks.workunit.client.0.smithi111.stderr: 7f22ad7fa640 / http_manager 2024-09-12T18:47:56.513 INFO:tasks.workunit.client.0.smithi111.stderr: 7f22af7fe640 / http_manager 2024-09-12T18:47:56.513 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2334fe1640 / rgw_dt_lg_renew 2024-09-12T18:47:56.513 INFO:tasks.workunit.client.0.smithi111.stderr: 7f234ffff640 / ms_dispatch 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr: 7f23617fa640 / io_context_pool 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2361ffb640 / io_context_pool 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2363fff640 / ms_dispatch 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr: 7f236ae05640 / ms_dispatch 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr: 7f236c608640 / io_context_pool 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr: 7f247d272640 / io_context_pool 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr: 7f247da73640 / msgr-worker-2 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr: 7f247e274640 / msgr-worker-1 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr: 7f247ea75640 / msgr-worker-0 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr: 7f248076e9c0 / radosgw-admin 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:47:56.379696Z_bdd442c9-b518-4ed6-86a1-1ce3602132b3/log 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:47:56.514 INFO:tasks.workunit.client.0.smithi111.stderr:Aborted 2024-09-12T18:47:56.515 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T18:47:56.516 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:47:56.516 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:47:56.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.462+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.462+0000 7f4282fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.462+0000 7f4282fc59c0 20 realm 2024-09-12T18:47:56.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.462+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.462+0000 7f4282fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.462+0000 7f4282fc59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:47:56.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.462+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.462+0000 7f4282fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.462+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.466+0000 7f4282fc59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:56.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.466+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.466+0000 7f4282fc59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:47:56.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.466+0000 7f4282fc59c0 20 searching for the correct realm 2024-09-12T18:47:56.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.470+0000 7f42812cc640 0 -- 172.21.15.111:0/2863754877 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f4274022070 msgr2=0x7f4274008450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:56.690 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.686+0000 7f42802ca640 0 -- 172.21.15.111:0/2863754877 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f4278048900 msgr2=0x7f42780383b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:47:56.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.902+0000 7f4282fc59c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:47:56.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.902+0000 7f4282fc59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:47:56.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.902+0000 7f4282fc59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:47:56.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.902+0000 7f4282fc59c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:47:56.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.902+0000 7f4282fc59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:47:56.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.902+0000 7f4282fc59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:47:56.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.902+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:47:56.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:47:56.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 20 zone default found 2024-09-12T18:47:56.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 4 Realm: () 2024-09-12T18:47:56.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:47:56.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:47:56.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:47:56.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 20 zonegroup default 2024-09-12T18:47:56.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.906+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.910+0000 7f4282fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:47:56.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.910+0000 7f4282fc59c0 20 started sync module instance, tier type = 2024-09-12T18:47:56.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.910+0000 7f4282fc59c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:47:56.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.934+0000 7f4282fc59c0 20 add_watcher() i=0 2024-09-12T18:47:56.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.934+0000 7f4282fc59c0 20 add_watcher() i=1 2024-09-12T18:47:56.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.934+0000 7f4282fc59c0 20 add_watcher() i=2 2024-09-12T18:47:56.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.934+0000 7f4282fc59c0 20 add_watcher() i=3 2024-09-12T18:47:56.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.934+0000 7f4282fc59c0 20 add_watcher() i=4 2024-09-12T18:47:56.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.934+0000 7f4282fc59c0 20 add_watcher() i=5 2024-09-12T18:47:56.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.934+0000 7f4282fc59c0 20 add_watcher() i=6 2024-09-12T18:47:56.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.934+0000 7f4282fc59c0 20 add_watcher() i=7 2024-09-12T18:47:56.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.934+0000 7f4282fc59c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:47:56.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.938+0000 7f4136fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:56.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.938+0000 7f4282fc59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:47:56.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.938+0000 7f4282fc59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:47:56.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.938+0000 7f4282fc59c0 5 note: GC not initialized 2024-09-12T18:47:56.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.938+0000 7f4135fe3640 20 reqs_thread_entry: start 2024-09-12T18:47:56.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.938+0000 7f4282fc59c0 20 init_complete bucket index max shards: 11 2024-09-12T18:47:56.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.938+0000 7f4282fc59c0 20 Filter name: none 2024-09-12T18:47:56.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.938+0000 7f40a77fe640 20 reqs_thread_entry: start 2024-09-12T18:47:56.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.938+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.942+0000 7f4282fc59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:56.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.942+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.942+0000 7f4282fc59c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:47:56.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.942+0000 7f4282fc59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:56.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.942+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.942+0000 7f4282fc59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:47:56.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.942+0000 7f4282fc59c0 20 rados->read ofs=0 len=0 2024-09-12T18:47:56.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.942+0000 7f4282fc59c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:47:56.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.942+0000 7f4282fc59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:47:56.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.946+0000 7f4136fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:47:56.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.950+0000 7f4282fc59c0 20 remove_watcher() i=0 2024-09-12T18:47:56.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.950+0000 7f4282fc59c0 2 removed watcher, disabling cache 2024-09-12T18:47:56.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.954+0000 7f4282fc59c0 20 remove_watcher() i=1 2024-09-12T18:47:56.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.954+0000 7f4282fc59c0 20 remove_watcher() i=2 2024-09-12T18:47:56.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.958+0000 7f4282fc59c0 20 remove_watcher() i=3 2024-09-12T18:47:56.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.958+0000 7f4282fc59c0 20 remove_watcher() i=4 2024-09-12T18:47:56.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.962+0000 7f4282fc59c0 20 remove_watcher() i=5 2024-09-12T18:47:56.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.962+0000 7f4282fc59c0 20 remove_watcher() i=6 2024-09-12T18:47:56.967 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:47:56.962+0000 7f4282fc59c0 20 remove_watcher() i=7 2024-09-12T18:47:56.984 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.984 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:47:56.984 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-commit-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:47:56.984 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:47:56.985 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:47:56.985 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:27.069 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:27.069 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:27.117 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:48:27.155 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:48:27.155 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:48:27.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.193+0000 7fa788d889c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.197+0000 7fa788d889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:27.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.197+0000 7fa788d889c0 20 realm 2024-09-12T18:48:27.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.197+0000 7fa788d889c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.197+0000 7fa788d889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:27.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.197+0000 7fa788d889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:48:27.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.197+0000 7fa788d889c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.197+0000 7fa788d889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:27.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.197+0000 7fa788d889c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.197+0000 7fa788d889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:27.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.197+0000 7fa788d889c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.201+0000 7fa788d889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:48:27.204 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.201+0000 7fa788d889c0 20 searching for the correct realm 2024-09-12T18:48:27.207 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.201+0000 7fa78708f640 0 -- 172.21.15.111:0/3919785979 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fa77c00e070 msgr2=0x7fa77c07a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:27.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.213+0000 7fa78608d640 0 -- 172.21.15.111:0/3919785979 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fa780137b80 msgr2=0x7fa7800ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:27.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:48:27.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:48:27.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:48:27.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:48:27.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:48:27.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:48:27.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:27.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:27.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:48:27.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 zone default found 2024-09-12T18:48:27.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 4 Realm: () 2024-09-12T18:48:27.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:48:27.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:48:27.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:48:27.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 zonegroup default 2024-09-12T18:48:27.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:27.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.433+0000 7fa788d889c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.437+0000 7fa788d889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:27.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.437+0000 7fa788d889c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.437+0000 7fa788d889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:27.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.437+0000 7fa788d889c0 20 started sync module instance, tier type = 2024-09-12T18:48:27.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.437+0000 7fa788d889c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:48:27.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.461+0000 7fa788d889c0 20 add_watcher() i=0 2024-09-12T18:48:27.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.461+0000 7fa788d889c0 20 add_watcher() i=1 2024-09-12T18:48:27.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.461+0000 7fa788d889c0 20 add_watcher() i=2 2024-09-12T18:48:27.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.461+0000 7fa788d889c0 20 add_watcher() i=3 2024-09-12T18:48:27.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.461+0000 7fa788d889c0 20 add_watcher() i=4 2024-09-12T18:48:27.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.461+0000 7fa788d889c0 20 add_watcher() i=5 2024-09-12T18:48:27.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.461+0000 7fa788d889c0 20 add_watcher() i=6 2024-09-12T18:48:27.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.461+0000 7fa788d889c0 20 add_watcher() i=7 2024-09-12T18:48:27.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.461+0000 7fa788d889c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:48:27.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.465+0000 7fa63d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:27.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:48:27.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:48:27.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 5 note: GC not initialized 2024-09-12T18:48:27.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa5b7fff640 20 reqs_thread_entry: start 2024-09-12T18:48:27.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 20 init_complete bucket index max shards: 11 2024-09-12T18:48:27.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 20 Filter name: none 2024-09-12T18:48:27.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa5b5ffb640 20 reqs_thread_entry: start 2024-09-12T18:48:27.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T18:48:27.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:48:27.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T18:48:27.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T18:48:27.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 : miss 2024-09-12T18:48:27.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:48:27.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:48:27.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:48:27.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:48:27.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:27.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.469+0000 7fa788d889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 2024-09-12T18:48:27.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.481+0000 7fa788d889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:48:27.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.481+0000 7fa788d889c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:48:27.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.481+0000 7fa788d889c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:27.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.481+0000 7fa788d889c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32, ofs0, ns] 2024-09-12T18:48:27.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.481+0000 7fa669ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431645 cookie 94435784381968 notifier 7440 bl.length()=931 2024-09-12T18:48:27.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.481+0000 7fa669ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:48:27.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.481+0000 7fa669ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:48:27.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.481+0000 7fa669ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:27.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.481+0000 7fa788d889c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_sources= new_sources= 2024-09-12T18:48:27.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.481+0000 7fa788d889c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential sources added=[] removed=[] 2024-09-12T18:48:27.487 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.481+0000 7fa788d889c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_dests= new_dests= 2024-09-12T18:48:27.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.481+0000 7fa788d889c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential dests added=[] removed=[] 2024-09-12T18:48:27.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.0 2024-09-12T18:48:27.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.0 2024-09-12T18:48:27.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.1 2024-09-12T18:48:27.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.1 2024-09-12T18:48:27.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.2 2024-09-12T18:48:27.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.2 2024-09-12T18:48:27.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.3 2024-09-12T18:48:27.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.3 2024-09-12T18:48:27.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.4 2024-09-12T18:48:27.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.4 2024-09-12T18:48:27.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.5 2024-09-12T18:48:27.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.5 2024-09-12T18:48:27.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.6 2024-09-12T18:48:27.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.6 2024-09-12T18:48:27.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.7 2024-09-12T18:48:27.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.7 2024-09-12T18:48:27.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.8 2024-09-12T18:48:27.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.8 2024-09-12T18:48:27.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.9 2024-09-12T18:48:27.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.9 2024-09-12T18:48:27.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.10 2024-09-12T18:48:27.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.10 2024-09-12T18:48:27.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.11 2024-09-12T18:48:27.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1.11 2024-09-12T18:48:27.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.0 2024-09-12T18:48:27.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.493+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1 2024-09-12T18:48:27.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.497+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.2 2024-09-12T18:48:27.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.497+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.3 2024-09-12T18:48:27.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.497+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.4 2024-09-12T18:48:27.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.497+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.5 2024-09-12T18:48:27.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.501+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.6 2024-09-12T18:48:27.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.501+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.7 2024-09-12T18:48:27.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.501+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.8 2024-09-12T18:48:27.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.505+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.9 2024-09-12T18:48:27.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.505+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.10 2024-09-12T18:48:27.516 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.513+0000 7fa788d889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:48:27.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.513+0000 7fa788d889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 2024-09-12T18:48:27.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.513+0000 7fa788d889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:48:27.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.513+0000 7fa788d889c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:48:27.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.513+0000 7fa788d889c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:27.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.513+0000 7fa788d889c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32, ofs0, ns] 2024-09-12T18:48:27.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.513+0000 7fa669ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431646 cookie 94435784381968 notifier 7440 bl.length()=931 2024-09-12T18:48:27.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.513+0000 7fa669ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:48:27.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.513+0000 7fa669ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:48:27.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.513+0000 7fa669ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:27.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.513+0000 7fa788d889c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_sources= new_sources= 2024-09-12T18:48:27.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.513+0000 7fa788d889c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential sources added=[] removed=[] 2024-09-12T18:48:27.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.513+0000 7fa788d889c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_dests= new_dests= 2024-09-12T18:48:27.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.513+0000 7fa788d889c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential dests added=[] removed=[] 2024-09-12T18:48:27.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.521+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.0 2024-09-12T18:48:27.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.521+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.1 2024-09-12T18:48:27.527 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.521+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.2 2024-09-12T18:48:27.527 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.521+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.3 2024-09-12T18:48:27.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.525+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.4 2024-09-12T18:48:27.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.525+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.5 2024-09-12T18:48:27.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.525+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.6 2024-09-12T18:48:27.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.525+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.7 2024-09-12T18:48:27.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.525+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.8 2024-09-12T18:48:27.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.529+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.9 2024-09-12T18:48:27.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.529+0000 7fa788d889c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.32.10 2024-09-12T18:48:27.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.529+0000 7fa788d889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 : hit (requested=0x17, cached=0x17) 2024-09-12T18:48:27.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.529+0000 7fa788d889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 2024-09-12T18:48:27.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.529+0000 7fa788d889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:48:27.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.529+0000 7fa788d889c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:48:27.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.529+0000 7fa788d889c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:27.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.529+0000 7fa788d889c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32, ofs0, ns] 2024-09-12T18:48:27.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.533+0000 7fa66a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431647 cookie 94435784381968 notifier 7440 bl.length()=899 2024-09-12T18:48:27.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.533+0000 7fa66a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 info.flags=0x17 2024-09-12T18:48:27.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.533+0000 7fa66a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:97c2b296-1395-4700-8053-4f06c4c86557.4689.32 to cache LRU end 2024-09-12T18:48:27.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.533+0000 7fa66a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:27.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.533+0000 7fa788d889c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_sources= new_sources= 2024-09-12T18:48:27.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.533+0000 7fa788d889c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential sources added=[] removed=[] 2024-09-12T18:48:27.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.533+0000 7fa788d889c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): orig_dests= new_dests= 2024-09-12T18:48:27.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.533+0000 7fa788d889c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[97c2b296-1395-4700-8053-4f06c4c86557.4689.32]): potential dests added=[] removed=[] 2024-09-12T18:48:27.543 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.537+0000 7fa788d889c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T18:48:27.547 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.541+0000 7fa63d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:27.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.545+0000 7fa788d889c0 20 remove_watcher() i=0 2024-09-12T18:48:27.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.545+0000 7fa788d889c0 2 removed watcher, disabling cache 2024-09-12T18:48:27.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.549+0000 7fa788d889c0 20 remove_watcher() i=1 2024-09-12T18:48:27.556 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.553+0000 7fa788d889c0 20 remove_watcher() i=2 2024-09-12T18:48:27.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.553+0000 7fa788d889c0 20 remove_watcher() i=3 2024-09-12T18:48:27.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.557+0000 7fa788d889c0 20 remove_watcher() i=4 2024-09-12T18:48:27.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.557+0000 7fa788d889c0 20 remove_watcher() i=5 2024-09-12T18:48:27.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.557+0000 7fa788d889c0 20 remove_watcher() i=6 2024-09-12T18:48:27.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.561+0000 7fa788d889c0 20 remove_watcher() i=7 2024-09-12T18:48:27.581 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T18:48:27.611 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:48:27.611 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:48:27.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.649+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.653+0000 7ff7bb6b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:27.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.653+0000 7ff7bb6b79c0 20 realm 2024-09-12T18:48:27.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.653+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.653+0000 7ff7bb6b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:27.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.653+0000 7ff7bb6b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:48:27.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.653+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.653+0000 7ff7bb6b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:27.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.653+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.653+0000 7ff7bb6b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:27.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.653+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.657+0000 7ff7bb6b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:48:27.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.657+0000 7ff7bb6b79c0 20 searching for the correct realm 2024-09-12T18:48:27.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.661+0000 7ff7b91bd640 0 -- 172.21.15.111:0/4025715632 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7ff7b4046040 msgr2=0x7ff7b4046930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:27.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.665+0000 7ff7b89bc640 0 -- 172.21.15.111:0/4025715632 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7ff7b4036020 msgr2=0x7ff7b4058940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:27.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.881+0000 7ff7bb6b79c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:48:27.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.881+0000 7ff7bb6b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:48:27.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.881+0000 7ff7bb6b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:48:27.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.881+0000 7ff7bb6b79c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:48:27.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.881+0000 7ff7bb6b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:48:27.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.881+0000 7ff7bb6b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:48:27.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.881+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.881+0000 7ff7bb6b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:27.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.881+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:27.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:48:27.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 20 zone default found 2024-09-12T18:48:27.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 4 Realm: () 2024-09-12T18:48:27.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:48:27.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:48:27.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:48:27.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 20 zonegroup default 2024-09-12T18:48:27.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:27.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:27.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:27.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 20 started sync module instance, tier type = 2024-09-12T18:48:27.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.885+0000 7ff7bb6b79c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:48:27.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.909+0000 7ff7bb6b79c0 20 add_watcher() i=0 2024-09-12T18:48:27.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.909+0000 7ff7bb6b79c0 20 add_watcher() i=1 2024-09-12T18:48:27.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.909+0000 7ff7bb6b79c0 20 add_watcher() i=2 2024-09-12T18:48:27.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.909+0000 7ff7bb6b79c0 20 add_watcher() i=3 2024-09-12T18:48:27.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.909+0000 7ff7bb6b79c0 20 add_watcher() i=4 2024-09-12T18:48:27.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.909+0000 7ff7bb6b79c0 20 add_watcher() i=5 2024-09-12T18:48:27.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.909+0000 7ff7bb6b79c0 20 add_watcher() i=6 2024-09-12T18:48:27.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.913+0000 7ff7bb6b79c0 20 add_watcher() i=7 2024-09-12T18:48:27.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.913+0000 7ff7bb6b79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:48:27.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.917+0000 7ff66f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:27.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.917+0000 7ff7bb6b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:48:27.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.917+0000 7ff7bb6b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:48:27.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.917+0000 7ff7bb6b79c0 5 note: GC not initialized 2024-09-12T18:48:27.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.917+0000 7ff66e7e4640 20 reqs_thread_entry: start 2024-09-12T18:48:27.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.917+0000 7ff7bb6b79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:48:27.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.917+0000 7ff7bb6b79c0 20 Filter name: none 2024-09-12T18:48:27.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.917+0000 7ff5dffff640 20 reqs_thread_entry: start 2024-09-12T18:48:27.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.917+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.917+0000 7ff7bb6b79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:48:27.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.917+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.921+0000 7ff7bb6b79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:48:27.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.921+0000 7ff7bb6b79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:48:27.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.921+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.921+0000 7ff7bb6b79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:48:27.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.921+0000 7ff7bb6b79c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:27.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.921+0000 7ff7bb6b79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:48:27.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.921+0000 7ff7bb6b79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:48:27.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.925+0000 7ff66f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:27.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.929+0000 7ff7bb6b79c0 20 remove_watcher() i=0 2024-09-12T18:48:27.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.929+0000 7ff7bb6b79c0 2 removed watcher, disabling cache 2024-09-12T18:48:27.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.929+0000 7ff7bb6b79c0 20 remove_watcher() i=1 2024-09-12T18:48:27.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.933+0000 7ff7bb6b79c0 20 remove_watcher() i=2 2024-09-12T18:48:27.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.937+0000 7ff7bb6b79c0 20 remove_watcher() i=3 2024-09-12T18:48:27.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.937+0000 7ff7bb6b79c0 20 remove_watcher() i=4 2024-09-12T18:48:27.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.941+0000 7ff7bb6b79c0 20 remove_watcher() i=5 2024-09-12T18:48:27.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.941+0000 7ff7bb6b79c0 20 remove_watcher() i=6 2024-09-12T18:48:27.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:27.941+0000 7ff7bb6b79c0 20 remove_watcher() i=7 2024-09-12T18:48:27.964 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:27.964 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:48:27.964 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-commit-target-layout id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:48:27.965 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:27.966 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:27.966 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:27.970 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:27.970 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.014 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.014 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.070 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T18:48:28.070 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:28.072 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.072 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.092 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.092 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.139 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.140 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.158 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.159 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.180 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.180 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.199 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.199 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.272 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.273 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.288 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.289 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.304 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.304 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.322 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.323 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.340 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.340 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.357 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.358 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.375 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.375 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.395 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.395 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.413 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.413 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.432 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.432 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.451 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.451 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.470 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.471 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.490 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.490 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.508 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.509 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.529 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.529 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.549 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:28.549 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:28.566 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T18:48:28.598 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:48:28.598 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:48:28.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.637+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.641+0000 7f542f3f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:28.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.641+0000 7f542f3f39c0 20 realm 2024-09-12T18:48:28.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.641+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.641+0000 7f542f3f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:28.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.641+0000 7f542f3f39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:48:28.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.641+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.641+0000 7f542f3f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:28.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.641+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.641+0000 7f542f3f39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:28.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.641+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.645+0000 7f542f3f39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:48:28.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.645+0000 7f542f3f39c0 20 searching for the correct realm 2024-09-12T18:48:28.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.649+0000 7f542cef9640 0 -- 172.21.15.111:0/805776779 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f5428037040 msgr2=0x7f5428037930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:28.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.653+0000 7f5427fff640 0 -- 172.21.15.111:0/805776779 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f5428048920 msgr2=0x7f54280363b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:28.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.869+0000 7f542f3f39c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:48:28.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.869+0000 7f542f3f39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:48:28.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.869+0000 7f542f3f39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:48:28.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.869+0000 7f542f3f39c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:48:28.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.869+0000 7f542f3f39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:48:28.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.869+0000 7f542f3f39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:48:28.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.869+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.869+0000 7f542f3f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:28.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.869+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:28.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:48:28.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 20 zone default found 2024-09-12T18:48:28.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 4 Realm: () 2024-09-12T18:48:28.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:48:28.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:48:28.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:48:28.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 20 zonegroup default 2024-09-12T18:48:28.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:28.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:28.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:28.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 20 started sync module instance, tier type = 2024-09-12T18:48:28.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.873+0000 7f542f3f39c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:48:28.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.901+0000 7f542f3f39c0 20 add_watcher() i=0 2024-09-12T18:48:28.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.901+0000 7f542f3f39c0 20 add_watcher() i=1 2024-09-12T18:48:28.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.901+0000 7f542f3f39c0 20 add_watcher() i=2 2024-09-12T18:48:28.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.901+0000 7f542f3f39c0 20 add_watcher() i=3 2024-09-12T18:48:28.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.901+0000 7f542f3f39c0 20 add_watcher() i=4 2024-09-12T18:48:28.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.901+0000 7f542f3f39c0 20 add_watcher() i=5 2024-09-12T18:48:28.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.901+0000 7f542f3f39c0 20 add_watcher() i=6 2024-09-12T18:48:28.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.901+0000 7f542f3f39c0 20 add_watcher() i=7 2024-09-12T18:48:28.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.901+0000 7f542f3f39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:48:28.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.905+0000 7f52e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:28.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.909+0000 7f542f3f39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:48:28.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.909+0000 7f542f3f39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:48:28.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.909+0000 7f542f3f39c0 5 note: GC not initialized 2024-09-12T18:48:28.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.909+0000 7f52e1fe3640 20 reqs_thread_entry: start 2024-09-12T18:48:28.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.909+0000 7f542f3f39c0 20 init_complete bucket index max shards: 11 2024-09-12T18:48:28.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.909+0000 7f542f3f39c0 20 Filter name: none 2024-09-12T18:48:28.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.909+0000 7f52537fe640 20 reqs_thread_entry: start 2024-09-12T18:48:28.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.909+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.909+0000 7f542f3f39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:28.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.909+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.909+0000 7f542f3f39c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:48:28.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.909+0000 7f542f3f39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:48:28.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.909+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.913+0000 7f542f3f39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:28.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.913+0000 7f542f3f39c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:28.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.913+0000 7f542f3f39c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:48:28.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.913+0000 7f542f3f39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:48:28.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.917+0000 7f52e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:28.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.921+0000 7f542f3f39c0 20 remove_watcher() i=0 2024-09-12T18:48:28.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.921+0000 7f542f3f39c0 2 removed watcher, disabling cache 2024-09-12T18:48:28.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.921+0000 7f542f3f39c0 20 remove_watcher() i=1 2024-09-12T18:48:28.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.925+0000 7f542f3f39c0 20 remove_watcher() i=2 2024-09-12T18:48:28.931 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.925+0000 7f542f3f39c0 20 remove_watcher() i=3 2024-09-12T18:48:28.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.929+0000 7f542f3f39c0 20 remove_watcher() i=4 2024-09-12T18:48:28.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.929+0000 7f542f3f39c0 20 remove_watcher() i=5 2024-09-12T18:48:28.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.933+0000 7f542f3f39c0 20 remove_watcher() i=6 2024-09-12T18:48:28.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:28.933+0000 7f542f3f39c0 20 remove_watcher() i=7 2024-09-12T18:48:28.954 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:28.954 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:48:28.955 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-do-reshard id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:48:28.955 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:28.955 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T18:48:28.988 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:48:28.988 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:48:29.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.029+0000 7fb0d4c499c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.029+0000 7fb0d4c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.029+0000 7fb0d4c499c0 20 realm 2024-09-12T18:48:29.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.029+0000 7fb0d4c499c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.029+0000 7fb0d4c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.029+0000 7fb0d4c499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:48:29.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.029+0000 7fb0d4c499c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.029+0000 7fb0d4c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.029+0000 7fb0d4c499c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.033+0000 7fb0d4c499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:29.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.033+0000 7fb0d4c499c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.033+0000 7fb0d4c499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:48:29.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.033+0000 7fb0d4c499c0 20 searching for the correct realm 2024-09-12T18:48:29.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.037+0000 7fb0d274f640 0 -- 172.21.15.111:0/2986824753 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fb0cc064190 msgr2=0x7fb0cc069930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:48:29.050 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.045+0000 7fb0d1f4e640 0 -- 172.21.15.111:0/2986824753 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fb0cc068350 msgr2=0x7fb0cc0648c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:48:29.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.261+0000 7fb0d4c499c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:48:29.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.261+0000 7fb0d4c499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:48:29.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.261+0000 7fb0d4c499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:48:29.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.261+0000 7fb0d4c499c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:48:29.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.261+0000 7fb0d4c499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:48:29.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.261+0000 7fb0d4c499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:48:29.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.261+0000 7fb0d4c499c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:29.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:48:29.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 20 zone default found 2024-09-12T18:48:29.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 4 Realm: () 2024-09-12T18:48:29.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:48:29.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:48:29.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:48:29.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 20 zonegroup default 2024-09-12T18:48:29.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.265+0000 7fb0d4c499c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.269+0000 7fb0d4c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.269+0000 7fb0d4c499c0 20 started sync module instance, tier type = 2024-09-12T18:48:29.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.269+0000 7fb0d4c499c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:48:29.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.293+0000 7fb0d4c499c0 20 add_watcher() i=0 2024-09-12T18:48:29.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.293+0000 7fb0d4c499c0 20 add_watcher() i=1 2024-09-12T18:48:29.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.293+0000 7fb0d4c499c0 20 add_watcher() i=2 2024-09-12T18:48:29.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.293+0000 7fb0d4c499c0 20 add_watcher() i=3 2024-09-12T18:48:29.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.293+0000 7fb0d4c499c0 20 add_watcher() i=4 2024-09-12T18:48:29.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.293+0000 7fb0d4c499c0 20 add_watcher() i=5 2024-09-12T18:48:29.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.293+0000 7fb0d4c499c0 20 add_watcher() i=6 2024-09-12T18:48:29.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.293+0000 7fb0d4c499c0 20 add_watcher() i=7 2024-09-12T18:48:29.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.293+0000 7fb0d4c499c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:48:29.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.297+0000 7faf88fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:29.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.301+0000 7fb0d4c499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:48:29.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.301+0000 7fb0d4c499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:48:29.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.301+0000 7fb0d4c499c0 5 note: GC not initialized 2024-09-12T18:48:29.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.301+0000 7faf037fe640 20 reqs_thread_entry: start 2024-09-12T18:48:29.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.301+0000 7fb0d4c499c0 20 init_complete bucket index max shards: 11 2024-09-12T18:48:29.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.301+0000 7fb0d4c499c0 20 Filter name: none 2024-09-12T18:48:29.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.301+0000 7faf017fa640 20 reqs_thread_entry: start 2024-09-12T18:48:29.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.301+0000 7fb0d4c499c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T18:48:29.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.301+0000 7fb0d4c499c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.301+0000 7fb0d4c499c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:29.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.301+0000 7fb0d4c499c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T18:48:29.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.301+0000 7fb0d4c499c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T18:48:29.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.301+0000 7fb0d4c499c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 : miss 2024-09-12T18:48:29.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.301+0000 7fb0d4c499c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.305+0000 7fb0d4c499c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:48:29.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.305+0000 7fb0d4c499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 info.flags=0x17 2024-09-12T18:48:29.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.305+0000 7fb0d4c499c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 to cache LRU end 2024-09-12T18:48:29.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.305+0000 7fb0d4c499c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:48:29.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.305+0000 7fb0d4c499c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:29.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.305+0000 7fb0d4c499c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 2024-09-12T18:48:29.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.313+0000 7fb0d4c499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 info.flags=0x17 2024-09-12T18:48:29.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.313+0000 7fb0d4c499c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 to cache LRU end 2024-09-12T18:48:29.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.313+0000 7fb0d4c499c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:29.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.313+0000 7fb0d4c499c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33, ofs0, ns] 2024-09-12T18:48:29.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.317+0000 7fafb57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 94413605080112 notifier 7494 bl.length()=911 2024-09-12T18:48:29.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.317+0000 7fafb57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 info.flags=0x17 2024-09-12T18:48:29.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.317+0000 7fafb57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 to cache LRU end 2024-09-12T18:48:29.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.317+0000 7fafb57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:29.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.317+0000 7fb0d4c499c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): orig_sources= new_sources= 2024-09-12T18:48:29.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.317+0000 7fb0d4c499c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): potential sources added=[] removed=[] 2024-09-12T18:48:29.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.317+0000 7fb0d4c499c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): orig_dests= new_dests= 2024-09-12T18:48:29.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.317+0000 7fb0d4c499c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): potential dests added=[] removed=[] 2024-09-12T18:48:29.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.333+0000 7fb0d4c499c0 -1 Injecting error=-5 at location=do_reshard 2024-09-12T18:48:29.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.349+0000 7fb0d4c499c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 : hit (requested=0x17, cached=0x17) 2024-09-12T18:48:29.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.349+0000 7fb0d4c499c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 2024-09-12T18:48:29.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.353+0000 7fb0d4c499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 info.flags=0x17 2024-09-12T18:48:29.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.353+0000 7fb0d4c499c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 to cache LRU end 2024-09-12T18:48:29.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.353+0000 7fb0d4c499c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:29.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.353+0000 7fb0d4c499c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33, ofs0, ns] 2024-09-12T18:48:29.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.353+0000 7fafb5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431596 cookie 94413605080112 notifier 7494 bl.length()=879 2024-09-12T18:48:29.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.353+0000 7fafb5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 info.flags=0x17 2024-09-12T18:48:29.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.353+0000 7fafb5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 to cache LRU end 2024-09-12T18:48:29.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.353+0000 7fafb5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:29.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.353+0000 7fb0d4c499c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): orig_sources= new_sources= 2024-09-12T18:48:29.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.353+0000 7fb0d4c499c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): potential sources added=[] removed=[] 2024-09-12T18:48:29.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.353+0000 7fb0d4c499c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): orig_dests= new_dests= 2024-09-12T18:48:29.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.353+0000 7fb0d4c499c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): potential dests added=[] removed=[] 2024-09-12T18:48:29.359 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.353+0000 7fb0d4c499c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T18:48:29.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.357+0000 7faf88fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:29.367 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.361+0000 7fb0d4c499c0 20 remove_watcher() i=0 2024-09-12T18:48:29.367 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.361+0000 7fb0d4c499c0 2 removed watcher, disabling cache 2024-09-12T18:48:29.370 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.365+0000 7fb0d4c499c0 20 remove_watcher() i=1 2024-09-12T18:48:29.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.369+0000 7fb0d4c499c0 20 remove_watcher() i=2 2024-09-12T18:48:29.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.369+0000 7fb0d4c499c0 20 remove_watcher() i=3 2024-09-12T18:48:29.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.373+0000 7fb0d4c499c0 20 remove_watcher() i=4 2024-09-12T18:48:29.378 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.373+0000 7fb0d4c499c0 20 remove_watcher() i=5 2024-09-12T18:48:29.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.373+0000 7fb0d4c499c0 20 remove_watcher() i=6 2024-09-12T18:48:29.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.377+0000 7fb0d4c499c0 20 remove_watcher() i=7 2024-09-12T18:48:29.398 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T18:48:29.429 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:48:29.429 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:48:29.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.469+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.469+0000 7fd56858e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.469+0000 7fd56858e9c0 20 realm 2024-09-12T18:48:29.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.469+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.469+0000 7fd56858e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.469+0000 7fd56858e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:48:29.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.469+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.469+0000 7fd56858e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.469+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.473+0000 7fd56858e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:29.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.473+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.473+0000 7fd56858e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:48:29.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.473+0000 7fd56858e9c0 20 searching for the correct realm 2024-09-12T18:48:29.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.477+0000 7fd566094640 0 -- 172.21.15.111:0/562004622 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fd560044040 msgr2=0x7fd56001b560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:29.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.485+0000 7fd565893640 0 -- 172.21.15.111:0/562004622 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fd560044420 msgr2=0x7fd5600448a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:29.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.701+0000 7fd56858e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:48:29.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.701+0000 7fd56858e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:48:29.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.701+0000 7fd56858e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:48:29.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.701+0000 7fd56858e9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:48:29.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.701+0000 7fd56858e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:48:29.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.701+0000 7fd56858e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:48:29.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.701+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.701+0000 7fd56858e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.701+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.701+0000 7fd56858e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:29.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.701+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:48:29.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 20 zone default found 2024-09-12T18:48:29.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 4 Realm: () 2024-09-12T18:48:29.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:48:29.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:48:29.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:48:29.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 20 zonegroup default 2024-09-12T18:48:29.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 20 started sync module instance, tier type = 2024-09-12T18:48:29.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.705+0000 7fd56858e9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:48:29.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.729+0000 7fd56858e9c0 20 add_watcher() i=0 2024-09-12T18:48:29.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.729+0000 7fd56858e9c0 20 add_watcher() i=1 2024-09-12T18:48:29.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.729+0000 7fd56858e9c0 20 add_watcher() i=2 2024-09-12T18:48:29.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.729+0000 7fd56858e9c0 20 add_watcher() i=3 2024-09-12T18:48:29.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.729+0000 7fd56858e9c0 20 add_watcher() i=4 2024-09-12T18:48:29.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.729+0000 7fd56858e9c0 20 add_watcher() i=5 2024-09-12T18:48:29.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.729+0000 7fd56858e9c0 20 add_watcher() i=6 2024-09-12T18:48:29.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.733+0000 7fd56858e9c0 20 add_watcher() i=7 2024-09-12T18:48:29.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.733+0000 7fd56858e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:48:29.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.737+0000 7fd41cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:29.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.737+0000 7fd56858e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:48:29.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.737+0000 7fd56858e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:48:29.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.737+0000 7fd56858e9c0 5 note: GC not initialized 2024-09-12T18:48:29.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.737+0000 7fd3977fe640 20 reqs_thread_entry: start 2024-09-12T18:48:29.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.737+0000 7fd56858e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:48:29.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.741+0000 7fd56858e9c0 20 Filter name: none 2024-09-12T18:48:29.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.741+0000 7fd3957fa640 20 reqs_thread_entry: start 2024-09-12T18:48:29.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.741+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.741+0000 7fd56858e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:29.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.741+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.741+0000 7fd56858e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:48:29.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.741+0000 7fd56858e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:48:29.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.741+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.741+0000 7fd56858e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:29.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.741+0000 7fd56858e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.741+0000 7fd56858e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:48:29.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.741+0000 7fd56858e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:48:29.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.745+0000 7fd41cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:29.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.753+0000 7fd56858e9c0 20 remove_watcher() i=0 2024-09-12T18:48:29.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.753+0000 7fd56858e9c0 2 removed watcher, disabling cache 2024-09-12T18:48:29.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.753+0000 7fd56858e9c0 20 remove_watcher() i=1 2024-09-12T18:48:29.761 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.757+0000 7fd56858e9c0 20 remove_watcher() i=2 2024-09-12T18:48:29.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.757+0000 7fd56858e9c0 20 remove_watcher() i=3 2024-09-12T18:48:29.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.761+0000 7fd56858e9c0 20 remove_watcher() i=4 2024-09-12T18:48:29.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.761+0000 7fd56858e9c0 20 remove_watcher() i=5 2024-09-12T18:48:29.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.765+0000 7fd56858e9c0 20 remove_watcher() i=6 2024-09-12T18:48:29.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.765+0000 7fd56858e9c0 20 remove_watcher() i=7 2024-09-12T18:48:29.788 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:29.789 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:48:29.789 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-do-reshard id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:48:29.789 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:29.790 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:29.790 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:29.803 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:29.803 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:29.849 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:48:29.885 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:48:29.885 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:48:29.931 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.925+0000 7f5fa66f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.929+0000 7f5fa66f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.929+0000 7f5fa66f69c0 20 realm 2024-09-12T18:48:29.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.929+0000 7f5fa66f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.929+0000 7f5fa66f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.929+0000 7f5fa66f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:48:29.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.929+0000 7f5fa66f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.929+0000 7f5fa66f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:29.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.929+0000 7f5fa66f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.929+0000 7f5fa66f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:29.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.929+0000 7f5fa66f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:29.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.929+0000 7f5fa66f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:48:29.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.929+0000 7f5fa66f69c0 20 searching for the correct realm 2024-09-12T18:48:29.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:29.933+0000 7f5fa49fd640 0 -- 172.21.15.111:0/1660122917 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f5f98008040 msgr2=0x7f5f98017410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:30.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.149+0000 7f5fa39fb640 0 -- 172.21.15.111:0/1660122917 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f5f9c11a9b0 msgr2=0x7f5f9c0c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:30.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.365+0000 7f5fa66f69c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:48:30.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.365+0000 7f5fa66f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:48:30.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.365+0000 7f5fa66f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:48:30.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.365+0000 7f5fa66f69c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:48:30.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.365+0000 7f5fa66f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:48:30.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.365+0000 7f5fa66f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:48:30.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.365+0000 7f5fa66f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.365+0000 7f5fa66f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:30.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.365+0000 7f5fa66f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:30.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:48:30.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 20 zone default found 2024-09-12T18:48:30.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 4 Realm: () 2024-09-12T18:48:30.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:48:30.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:48:30.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:48:30.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 20 zonegroup default 2024-09-12T18:48:30.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:30.374 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.375 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:30.375 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:30.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 20 started sync module instance, tier type = 2024-09-12T18:48:30.376 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.369+0000 7f5fa66f69c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:48:30.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.393+0000 7f5fa66f69c0 20 add_watcher() i=0 2024-09-12T18:48:30.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.393+0000 7f5fa66f69c0 20 add_watcher() i=1 2024-09-12T18:48:30.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.393+0000 7f5fa66f69c0 20 add_watcher() i=2 2024-09-12T18:48:30.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.393+0000 7f5fa66f69c0 20 add_watcher() i=3 2024-09-12T18:48:30.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.393+0000 7f5fa66f69c0 20 add_watcher() i=4 2024-09-12T18:48:30.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.393+0000 7f5fa66f69c0 20 add_watcher() i=5 2024-09-12T18:48:30.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.393+0000 7f5fa66f69c0 20 add_watcher() i=6 2024-09-12T18:48:30.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.397+0000 7f5fa66f69c0 20 add_watcher() i=7 2024-09-12T18:48:30.402 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.397+0000 7f5fa66f69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:48:30.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.401+0000 7f5e5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:30.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.401+0000 7f5fa66f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:48:30.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.401+0000 7f5fa66f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:48:30.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.401+0000 7f5fa66f69c0 5 note: GC not initialized 2024-09-12T18:48:30.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.401+0000 7f5e59fdb640 20 reqs_thread_entry: start 2024-09-12T18:48:30.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 20 init_complete bucket index max shards: 11 2024-09-12T18:48:30.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 20 Filter name: none 2024-09-12T18:48:30.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5dcb7fe640 20 reqs_thread_entry: start 2024-09-12T18:48:30.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T18:48:30.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:30.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T18:48:30.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T18:48:30.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 : miss 2024-09-12T18:48:30.410 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:48:30.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 info.flags=0x17 2024-09-12T18:48:30.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 to cache LRU end 2024-09-12T18:48:30.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:48:30.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:30.411 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.405+0000 7f5fa66f69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 2024-09-12T18:48:30.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.417+0000 7f5fa66f69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 info.flags=0x17 2024-09-12T18:48:30.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.417+0000 7f5fa66f69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 to cache LRU end 2024-09-12T18:48:30.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.417+0000 7f5fa66f69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:30.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.417+0000 7f5fa66f69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33, ofs0, ns] 2024-09-12T18:48:30.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.417+0000 7f5e7b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431597 cookie 94717353851584 notifier 7536 bl.length()=911 2024-09-12T18:48:30.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.417+0000 7f5e7b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 info.flags=0x17 2024-09-12T18:48:30.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.417+0000 7f5e7b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 to cache LRU end 2024-09-12T18:48:30.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.417+0000 7f5e7b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:30.422 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.417+0000 7f5fa66f69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): orig_sources= new_sources= 2024-09-12T18:48:30.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.417+0000 7f5fa66f69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): potential sources added=[] removed=[] 2024-09-12T18:48:30.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.417+0000 7f5fa66f69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): orig_dests= new_dests= 2024-09-12T18:48:30.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.417+0000 7f5fa66f69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): potential dests added=[] removed=[] 2024-09-12T18:48:30.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.0 2024-09-12T18:48:30.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.0 2024-09-12T18:48:30.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.1 2024-09-12T18:48:30.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.1 2024-09-12T18:48:30.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.2 2024-09-12T18:48:30.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.2 2024-09-12T18:48:30.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.3 2024-09-12T18:48:30.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.3 2024-09-12T18:48:30.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.4 2024-09-12T18:48:30.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.4 2024-09-12T18:48:30.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.5 2024-09-12T18:48:30.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.5 2024-09-12T18:48:30.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.6 2024-09-12T18:48:30.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.6 2024-09-12T18:48:30.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.7 2024-09-12T18:48:30.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.7 2024-09-12T18:48:30.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.8 2024-09-12T18:48:30.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.8 2024-09-12T18:48:30.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.9 2024-09-12T18:48:30.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.9 2024-09-12T18:48:30.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.10 2024-09-12T18:48:30.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.10 2024-09-12T18:48:30.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.11 2024-09-12T18:48:30.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1.11 2024-09-12T18:48:30.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.429+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.0 2024-09-12T18:48:30.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.433+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1 2024-09-12T18:48:30.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.433+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.2 2024-09-12T18:48:30.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.433+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.3 2024-09-12T18:48:30.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.437+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.4 2024-09-12T18:48:30.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.437+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.5 2024-09-12T18:48:30.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.437+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.6 2024-09-12T18:48:30.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.441+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.7 2024-09-12T18:48:30.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.441+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.8 2024-09-12T18:48:30.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.441+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.9 2024-09-12T18:48:30.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.441+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.10 2024-09-12T18:48:30.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.449+0000 7f5fa66f69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 : hit (requested=0x17, cached=0x17) 2024-09-12T18:48:30.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.449+0000 7f5fa66f69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 2024-09-12T18:48:30.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.449+0000 7f5fa66f69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 info.flags=0x17 2024-09-12T18:48:30.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.449+0000 7f5fa66f69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 to cache LRU end 2024-09-12T18:48:30.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.449+0000 7f5fa66f69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:30.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.449+0000 7f5fa66f69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33, ofs0, ns] 2024-09-12T18:48:30.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.453+0000 7f5e7b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431598 cookie 94717353851584 notifier 7536 bl.length()=911 2024-09-12T18:48:30.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.453+0000 7f5e7b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 info.flags=0x17 2024-09-12T18:48:30.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.453+0000 7f5e7b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 to cache LRU end 2024-09-12T18:48:30.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.453+0000 7f5e7b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:30.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.453+0000 7f5fa66f69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): orig_sources= new_sources= 2024-09-12T18:48:30.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.453+0000 7f5fa66f69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): potential sources added=[] removed=[] 2024-09-12T18:48:30.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.453+0000 7f5fa66f69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): orig_dests= new_dests= 2024-09-12T18:48:30.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.453+0000 7f5fa66f69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): potential dests added=[] removed=[] 2024-09-12T18:48:30.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.457+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.0 2024-09-12T18:48:30.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.457+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.1 2024-09-12T18:48:30.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.461+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.2 2024-09-12T18:48:30.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.461+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.3 2024-09-12T18:48:30.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.461+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.4 2024-09-12T18:48:30.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.461+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.5 2024-09-12T18:48:30.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.461+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.6 2024-09-12T18:48:30.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.465+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.7 2024-09-12T18:48:30.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.465+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.8 2024-09-12T18:48:30.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.465+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.9 2024-09-12T18:48:30.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.465+0000 7f5fa66f69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.33.10 2024-09-12T18:48:30.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.469+0000 7f5fa66f69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 : hit (requested=0x17, cached=0x17) 2024-09-12T18:48:30.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.469+0000 7f5fa66f69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 2024-09-12T18:48:30.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.469+0000 7f5fa66f69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 info.flags=0x17 2024-09-12T18:48:30.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.469+0000 7f5fa66f69c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 to cache LRU end 2024-09-12T18:48:30.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.469+0000 7f5fa66f69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:30.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.469+0000 7f5fa66f69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33, ofs0, ns] 2024-09-12T18:48:30.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.469+0000 7f5e7b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431599 cookie 94717353851584 notifier 7536 bl.length()=879 2024-09-12T18:48:30.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.469+0000 7f5e7b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 info.flags=0x17 2024-09-12T18:48:30.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.469+0000 7f5e7b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.33 to cache LRU end 2024-09-12T18:48:30.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.469+0000 7f5e7b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:30.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.469+0000 7f5fa66f69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): orig_sources= new_sources= 2024-09-12T18:48:30.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.469+0000 7f5fa66f69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): potential sources added=[] removed=[] 2024-09-12T18:48:30.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.469+0000 7f5fa66f69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): orig_dests= new_dests= 2024-09-12T18:48:30.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.469+0000 7f5fa66f69c0 20 handle_bi_update(): bucket=:error-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.33]): potential dests added=[] removed=[] 2024-09-12T18:48:30.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.477+0000 7f5fa66f69c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T18:48:30.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.481+0000 7f5e5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:30.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.485+0000 7f5fa66f69c0 20 remove_watcher() i=0 2024-09-12T18:48:30.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.485+0000 7f5fa66f69c0 2 removed watcher, disabling cache 2024-09-12T18:48:30.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.489+0000 7f5fa66f69c0 20 remove_watcher() i=1 2024-09-12T18:48:30.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.493+0000 7f5fa66f69c0 20 remove_watcher() i=2 2024-09-12T18:48:30.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.497+0000 7f5fa66f69c0 20 remove_watcher() i=3 2024-09-12T18:48:30.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.497+0000 7f5fa66f69c0 20 remove_watcher() i=4 2024-09-12T18:48:30.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.497+0000 7f5fa66f69c0 20 remove_watcher() i=5 2024-09-12T18:48:30.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.501+0000 7f5fa66f69c0 20 remove_watcher() i=6 2024-09-12T18:48:30.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.501+0000 7f5fa66f69c0 20 remove_watcher() i=7 2024-09-12T18:48:30.523 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T18:48:30.553 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:48:30.553 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:48:30.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.593+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.593+0000 7f9445f069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:30.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.593+0000 7f9445f069c0 20 realm 2024-09-12T18:48:30.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.593+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.593+0000 7f9445f069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:30.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.593+0000 7f9445f069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:48:30.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.593+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.593+0000 7f9445f069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:30.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.593+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.601 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.597+0000 7f9445f069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:30.601 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.597+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.602 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.597+0000 7f9445f069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:48:30.602 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.597+0000 7f9445f069c0 20 searching for the correct realm 2024-09-12T18:48:30.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.601+0000 7f944420d640 0 -- 172.21.15.111:0/2898950166 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x559cc3c97190 msgr2=0x559cc3c99580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:48:30.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.609+0000 7f944320b640 0 -- 172.21.15.111:0/2898950166 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f943c04f400 msgr2=0x7f943c04f880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:30.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.825+0000 7f9445f069c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:48:30.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.825+0000 7f9445f069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:48:30.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.825+0000 7f9445f069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:48:30.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.825+0000 7f9445f069c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:48:30.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.825+0000 7f9445f069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:48:30.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.825+0000 7f9445f069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:48:30.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.825+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.825+0000 7f9445f069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:30.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.825+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:30.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:48:30.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 20 zone default found 2024-09-12T18:48:30.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 4 Realm: () 2024-09-12T18:48:30.833 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:48:30.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:48:30.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:48:30.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 20 zonegroup default 2024-09-12T18:48:30.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:30.834 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:30.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:30.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 20 started sync module instance, tier type = 2024-09-12T18:48:30.836 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.829+0000 7f9445f069c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:48:30.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.853+0000 7f9445f069c0 20 add_watcher() i=0 2024-09-12T18:48:30.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.853+0000 7f9445f069c0 20 add_watcher() i=1 2024-09-12T18:48:30.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.853+0000 7f9445f069c0 20 add_watcher() i=2 2024-09-12T18:48:30.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.853+0000 7f9445f069c0 20 add_watcher() i=3 2024-09-12T18:48:30.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.853+0000 7f9445f069c0 20 add_watcher() i=4 2024-09-12T18:48:30.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.853+0000 7f9445f069c0 20 add_watcher() i=5 2024-09-12T18:48:30.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.853+0000 7f9445f069c0 20 add_watcher() i=6 2024-09-12T18:48:30.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.857+0000 7f9445f069c0 20 add_watcher() i=7 2024-09-12T18:48:30.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.857+0000 7f9445f069c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:48:30.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.861+0000 7f92f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:30.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.861+0000 7f9445f069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:48:30.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.861+0000 7f9445f069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:48:30.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.861+0000 7f9445f069c0 5 note: GC not initialized 2024-09-12T18:48:30.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.861+0000 7f92f8fe1640 20 reqs_thread_entry: start 2024-09-12T18:48:30.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.861+0000 7f9445f069c0 20 init_complete bucket index max shards: 11 2024-09-12T18:48:30.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.861+0000 7f9445f069c0 20 Filter name: none 2024-09-12T18:48:30.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.861+0000 7f92727fc640 20 reqs_thread_entry: start 2024-09-12T18:48:30.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.861+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.861+0000 7f9445f069c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:30.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.861+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.865+0000 7f9445f069c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:48:30.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.865+0000 7f9445f069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:48:30.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.865+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.865+0000 7f9445f069c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:30.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.865+0000 7f9445f069c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:30.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.865+0000 7f9445f069c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:48:30.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.865+0000 7f9445f069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:48:30.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.869+0000 7f92f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:30.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.873+0000 7f9445f069c0 20 remove_watcher() i=0 2024-09-12T18:48:30.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.873+0000 7f9445f069c0 2 removed watcher, disabling cache 2024-09-12T18:48:30.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.873+0000 7f9445f069c0 20 remove_watcher() i=1 2024-09-12T18:48:30.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.877+0000 7f9445f069c0 20 remove_watcher() i=2 2024-09-12T18:48:30.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.881+0000 7f9445f069c0 20 remove_watcher() i=3 2024-09-12T18:48:30.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.881+0000 7f9445f069c0 20 remove_watcher() i=4 2024-09-12T18:48:30.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.885+0000 7f9445f069c0 20 remove_watcher() i=5 2024-09-12T18:48:30.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.885+0000 7f9445f069c0 20 remove_watcher() i=6 2024-09-12T18:48:30.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:30.885+0000 7f9445f069c0 20 remove_watcher() i=7 2024-09-12T18:48:30.907 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:30.907 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:48:30.908 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-do-reshard id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:48:30.908 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:30.909 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:30.909 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:30.913 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:30.913 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:30.958 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:30.958 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.014 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T18:48:31.014 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:31.016 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.016 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.039 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.039 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.088 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.088 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.106 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.106 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.126 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.126 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.144 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.144 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.163 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.163 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.182 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.182 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.202 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.202 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.221 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.222 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.241 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.241 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.260 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.260 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.279 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.279 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.300 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.300 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.319 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.319 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.339 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.339 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.357 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.357 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.377 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.377 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.396 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.396 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.416 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.416 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.435 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.436 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.455 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:31.455 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:31.472 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T18:48:31.505 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:48:31.505 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:48:31.550 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.545+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.549+0000 7f627fb849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:31.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.549+0000 7f627fb849c0 20 realm 2024-09-12T18:48:31.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.549+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.549+0000 7f627fb849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:31.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.549+0000 7f627fb849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:48:31.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.549+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.549+0000 7f627fb849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:31.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.549+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.549+0000 7f627fb849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:31.554 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.549+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.555 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.549+0000 7f627fb849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:48:31.555 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.549+0000 7f627fb849c0 20 searching for the correct realm 2024-09-12T18:48:31.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.557+0000 7f627d68a640 0 -- 172.21.15.111:0/2278750274 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f627802c060 msgr2=0x7f627805d490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:31.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.561+0000 7f627ce89640 0 -- 172.21.15.111:0/2278750274 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f627800e070 msgr2=0x7f627805fa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:31.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.777+0000 7f627fb849c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:48:31.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.777+0000 7f627fb849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:48:31.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.777+0000 7f627fb849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:48:31.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.777+0000 7f627fb849c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:48:31.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.777+0000 7f627fb849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:48:31.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.777+0000 7f627fb849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:48:31.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.777+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.777+0000 7f627fb849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:31.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.777+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.781+0000 7f627fb849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:31.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.781+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.785 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.781+0000 7f627fb849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:48:31.785 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.781+0000 7f627fb849c0 20 zone default found 2024-09-12T18:48:31.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.781+0000 7f627fb849c0 4 Realm: () 2024-09-12T18:48:31.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.781+0000 7f627fb849c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:48:31.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.781+0000 7f627fb849c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:48:31.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.781+0000 7f627fb849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:48:31.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.781+0000 7f627fb849c0 20 zonegroup default 2024-09-12T18:48:31.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.781+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.781+0000 7f627fb849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:31.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.781+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.781+0000 7f627fb849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:31.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.781+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.785+0000 7f627fb849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:31.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.785+0000 7f627fb849c0 20 started sync module instance, tier type = 2024-09-12T18:48:31.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.785+0000 7f627fb849c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:48:31.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.813+0000 7f627fb849c0 20 add_watcher() i=0 2024-09-12T18:48:31.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.813+0000 7f627fb849c0 20 add_watcher() i=1 2024-09-12T18:48:31.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.813+0000 7f627fb849c0 20 add_watcher() i=2 2024-09-12T18:48:31.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.813+0000 7f627fb849c0 20 add_watcher() i=3 2024-09-12T18:48:31.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.813+0000 7f627fb849c0 20 add_watcher() i=4 2024-09-12T18:48:31.817 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.813+0000 7f627fb849c0 20 add_watcher() i=5 2024-09-12T18:48:31.818 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.813+0000 7f627fb849c0 20 add_watcher() i=6 2024-09-12T18:48:31.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.813+0000 7f627fb849c0 20 add_watcher() i=7 2024-09-12T18:48:31.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.813+0000 7f627fb849c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:48:31.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.817+0000 7f61337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:31.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.821+0000 7f627fb849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:48:31.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.821+0000 7f627fb849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:48:31.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.821+0000 7f627fb849c0 5 note: GC not initialized 2024-09-12T18:48:31.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.821+0000 7f61327e4640 20 reqs_thread_entry: start 2024-09-12T18:48:31.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.821+0000 7f627fb849c0 20 init_complete bucket index max shards: 11 2024-09-12T18:48:31.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.821+0000 7f627fb849c0 20 Filter name: none 2024-09-12T18:48:31.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.821+0000 7f60a3fff640 20 reqs_thread_entry: start 2024-09-12T18:48:31.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.821+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.821+0000 7f627fb849c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:31.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.821+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.825+0000 7f627fb849c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:48:31.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.825+0000 7f627fb849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:48:31.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.825+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.825+0000 7f627fb849c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:31.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.825+0000 7f627fb849c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.825+0000 7f627fb849c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:48:31.830 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.825+0000 7f627fb849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:48:31.832 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.829+0000 7f61337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:31.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.833+0000 7f627fb849c0 20 remove_watcher() i=0 2024-09-12T18:48:31.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.833+0000 7f627fb849c0 2 removed watcher, disabling cache 2024-09-12T18:48:31.841 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.837+0000 7f627fb849c0 20 remove_watcher() i=1 2024-09-12T18:48:31.843 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.837+0000 7f627fb849c0 20 remove_watcher() i=2 2024-09-12T18:48:31.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.841+0000 7f627fb849c0 20 remove_watcher() i=3 2024-09-12T18:48:31.848 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.845+0000 7f627fb849c0 20 remove_watcher() i=4 2024-09-12T18:48:31.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.845+0000 7f627fb849c0 20 remove_watcher() i=5 2024-09-12T18:48:31.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.845+0000 7f627fb849c0 20 remove_watcher() i=6 2024-09-12T18:48:31.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.849+0000 7f627fb849c0 20 remove_watcher() i=7 2024-09-12T18:48:31.876 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:31.876 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:48:31.876 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-do-reshard id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:48:31.876 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:31.877 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T18:48:31.911 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:48:31.911 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:48:31.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:31.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 realm 2024-09-12T18:48:31.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:31.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:48:31.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:31.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:31.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:31.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:48:31.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 searching for the correct realm 2024-09-12T18:48:31.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.965+0000 7f7b02e34640 0 -- 172.21.15.111:0/795337595 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f7af8121070 msgr2=0x7f7af80fbd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:31.974 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:31.969+0000 7f7b01e32640 0 -- 172.21.15.111:0/795337595 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f7afc01c9b0 msgr2=0x7f7afc079950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:48:32.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:48:32.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:48:32.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:48:32.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:48:32.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:48:32.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:48:32.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:32.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:48:32.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 zone default found 2024-09-12T18:48:32.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 4 Realm: () 2024-09-12T18:48:32.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:48:32.193 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:48:32.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:48:32.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 zonegroup default 2024-09-12T18:48:32.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 started sync module instance, tier type = 2024-09-12T18:48:32.195 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:48:32.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=0 2024-09-12T18:48:32.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=1 2024-09-12T18:48:32.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=2 2024-09-12T18:48:32.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=3 2024-09-12T18:48:32.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=4 2024-09-12T18:48:32.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=5 2024-09-12T18:48:32.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=6 2024-09-12T18:48:32.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.221+0000 7f7b04b2d9c0 20 add_watcher() i=7 2024-09-12T18:48:32.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.221+0000 7f7b04b2d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:48:32.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.225+0000 7f79b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:32.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:48:32.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:48:32.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 note: GC not initialized 2024-09-12T18:48:32.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.225+0000 7f79337fe640 20 reqs_thread_entry: start 2024-09-12T18:48:32.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:48:32.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 20 Filter name: none 2024-09-12T18:48:32.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.225+0000 7f79317fa640 20 reqs_thread_entry: start 2024-09-12T18:48:32.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:48:32.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:32.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:48:32.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:48:32.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 : miss 2024-09-12T18:48:32.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:48:32.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:48:32.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:48:32.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:48:32.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:32.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 2024-09-12T18:48:32.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.237+0000 7f7b04b2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:48:32.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.237+0000 7f7b04b2d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:48:32.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.237+0000 7f7b04b2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:32.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.237+0000 7f7b04b2d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34, ofs0, ns] 2024-09-12T18:48:32.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.241+0000 7f79e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431578 cookie 94370346970112 notifier 7596 bl.length()=911 2024-09-12T18:48:32.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.241+0000 7f79e57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:48:32.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.241+0000 7f79e57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:48:32.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.241+0000 7f79e57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:32.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.241+0000 7f7b04b2d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): orig_sources= new_sources= 2024-09-12T18:48:32.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.241+0000 7f7b04b2d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): potential sources added=[] removed=[] 2024-09-12T18:48:32.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.241+0000 7f7b04b2d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): orig_dests= new_dests= 2024-09-12T18:48:32.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.241+0000 7f7b04b2d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): potential dests added=[] removed=[] 2024-09-12T18:48:32.256 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7b04b2d9c0 time 2024-09-12T18:48:32.256190+0000 2024-09-12T18:48:32.256 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:48:32.256 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:48:32.256 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7b084072eb] 2024-09-12T18:48:32.256 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7b0840749f] 2024-09-12T18:48:32.257 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d44cbf9cc1] 2024-09-12T18:48:32.257 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d44cc0ed5a] 2024-09-12T18:48:32.257 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:48:32.257 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7b0726dd90] 2024-09-12T18:48:32.257 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:48:32.257 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:48:32.257 INFO:tasks.workunit.client.0.smithi111.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:48:32.257 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f7b04b2d9c0 thread_name:radosgw-admin 2024-09-12T18:48:32.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.253+0000 7f7b04b2d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7b04b2d9c0 time 2024-09-12T18:48:32.256190+0000 2024-09-12T18:48:32.257 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:48:32.257 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.257 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:48:32.257 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7b084072eb] 2024-09-12T18:48:32.258 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7b0840749f] 2024-09-12T18:48:32.258 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d44cbf9cc1] 2024-09-12T18:48:32.258 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d44cc0ed5a] 2024-09-12T18:48:32.258 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:48:32.258 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7b0726dd90] 2024-09-12T18:48:32.258 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:48:32.258 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:48:32.258 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.277 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:48:32.277 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7b07286520] 2024-09-12T18:48:32.277 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:48:32.277 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:48:32.277 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:48:32.278 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7b08407345] 2024-09-12T18:48:32.278 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7b0840749f] 2024-09-12T18:48:32.278 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d44cbf9cc1] 2024-09-12T18:48:32.278 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d44cc0ed5a] 2024-09-12T18:48:32.278 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:48:32.278 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7b0726dd90] 2024-09-12T18:48:32.278 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:48:32.278 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:48:32.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.253+0000 7f7b04b2d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:48:32.278 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f7b04b2d9c0 thread_name:radosgw-admin 2024-09-12T18:48:32.278 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.278 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:48:32.278 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7b07286520] 2024-09-12T18:48:32.279 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:48:32.279 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:48:32.279 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:48:32.279 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7b08407345] 2024-09-12T18:48:32.279 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7b0840749f] 2024-09-12T18:48:32.279 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d44cbf9cc1] 2024-09-12T18:48:32.279 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d44cc0ed5a] 2024-09-12T18:48:32.279 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:48:32.279 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7b0726dd90] 2024-09-12T18:48:32.279 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:48:32.279 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:48:32.279 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:48:32.280 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.280 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:48:32.280 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:48:31.929+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.280 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:48:31.929+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.280 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:48:31.929+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.280 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:48:31.929+0000 7f7b02e34640 10 monclient(hunting): handle_auth_done global_id 7584 payload 274 2024-09-12T18:48:32.280 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:48:31.929+0000 7f7b02e34640 10 monclient: _finish_hunting 0 2024-09-12T18:48:32.280 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:48:31.929+0000 7f7b02e34640 1 monclient: found mon.noname-a 2024-09-12T18:48:32.280 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:48:31.929+0000 7f7b02e34640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.280 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.280 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:48:32.280 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: dump: 2024-09-12T18:48:32.280 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.280 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.281 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.281 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.281 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.281 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.281 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.281 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.281 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.281 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.281 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: _finish_auth 0 2024-09-12T18:48:32.281 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: _check_auth_tickets 2024-09-12T18:48:32.281 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: handle_config config(0 keys) 2024-09-12T18:48:32.281 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.281 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:48:32.281 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: dump: 2024-09-12T18:48:32.282 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.282 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.282 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.282 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.282 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.282 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.282 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.282 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.282 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.282 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.282 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:48:31.929+0000 7f7b04b2d9c0 5 monclient: authenticate success, global_id 7584 2024-09-12T18:48:32.282 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:48:31.929+0000 7f7b04b2d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:48:32.282 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:48:31.929+0000 7f7b04b2d9c0 4 set_mon_vals no callback set 2024-09-12T18:48:32.282 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: shutdown 2024-09-12T18:48:32.283 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) unregister_commands rotate-key 2024-09-12T18:48:32.283 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: build_initial_monmap 2024-09-12T18:48:32.283 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:48:32.283 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: monmap: 2024-09-12T18:48:32.283 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:48:32.283 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:48:32.283 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:48:32.283 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:48:32.283 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:48:32.283 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.283 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:48:32.283 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:48:32.283 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:48:32.283 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.284 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding auth protocol: cephx 2024-09-12T18:48:32.284 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding auth protocol: cephx 2024-09-12T18:48:32.284 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding auth protocol: cephx 2024-09-12T18:48:32.284 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: secure 2024-09-12T18:48:32.284 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: crc 2024-09-12T18:48:32.284 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: secure 2024-09-12T18:48:32.284 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: crc 2024-09-12T18:48:32.284 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: secure 2024-09-12T18:48:32.284 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: crc 2024-09-12T18:48:32.284 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: crc 2024-09-12T18:48:32.284 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: secure 2024-09-12T18:48:32.284 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: crc 2024-09-12T18:48:32.284 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: secure 2024-09-12T18:48:32.284 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: crc 2024-09-12T18:48:32.285 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: secure 2024-09-12T18:48:32.285 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.285 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 1 librados: starting msgr at 2024-09-12T18:48:32.285 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 1 librados: starting objecter 2024-09-12T18:48:32.285 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command objecter_requests hook 0x55d44ec965f0 2024-09-12T18:48:32.285 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 1 librados: setting wanted keys 2024-09-12T18:48:32.285 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 1 librados: calling monclient init 2024-09-12T18:48:32.285 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: init 2024-09-12T18:48:32.285 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding auth protocol: cephx 2024-09-12T18:48:32.285 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding auth protocol: cephx 2024-09-12T18:48:32.285 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding auth protocol: cephx 2024-09-12T18:48:32.285 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: secure 2024-09-12T18:48:32.285 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: crc 2024-09-12T18:48:32.286 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: secure 2024-09-12T18:48:32.286 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: crc 2024-09-12T18:48:32.286 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: secure 2024-09-12T18:48:32.286 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: crc 2024-09-12T18:48:32.286 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: crc 2024-09-12T18:48:32.286 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: secure 2024-09-12T18:48:32.286 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: crc 2024-09-12T18:48:32.286 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: secure 2024-09-12T18:48:32.286 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: crc 2024-09-12T18:48:32.286 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: secure 2024-09-12T18:48:32.286 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.286 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.286 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command rotate-key hook 0x55d44ef2a308 2024-09-12T18:48:32.286 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:48:32.287 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:48:32.287 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x55d44ede5430 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:48:32.287 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x55d44ede8b90 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:48:32.287 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x55d44ee6f940 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:48:32.287 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.287 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.287 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.287 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:48:32.287 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): authenticate will time out at 2299.078010s 2024-09-12T18:48:32.287 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): get_auth_request con 0x55d44ee6f940 auth_method 0 2024-09-12T18:48:32.287 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.287 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.287 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.288 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:48:31.933+0000 7f7b02633640 10 monclient(hunting): get_auth_request con 0x55d44ede5430 auth_method 0 2024-09-12T18:48:32.288 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:48:31.933+0000 7f7b02633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.288 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:48:31.933+0000 7f7b02633640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.288 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:48:31.933+0000 7f7b02633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.288 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.288 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.288 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.288 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:48:31.933+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.288 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:48:31.933+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.288 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:48:31.933+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.288 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): handle_auth_done global_id 7587 payload 824 2024-09-12T18:48:32.288 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient: _finish_hunting 0 2024-09-12T18:48:32.288 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:48:31.933+0000 7f7b02e34640 1 monclient: found mon.noname-a 2024-09-12T18:48:32.289 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.289 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.289 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:48:32.289 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: dump: 2024-09-12T18:48:32.289 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.289 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.289 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.289 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.289 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.289 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.289 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.289 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.289 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.289 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.290 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: _finish_auth 0 2024-09-12T18:48:32.290 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: _check_auth_tickets 2024-09-12T18:48:32.290 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: handle_config config(0 keys) 2024-09-12T18:48:32.290 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.290 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:48:32.290 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: dump: 2024-09-12T18:48:32.290 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.290 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.290 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.290 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.290 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.290 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.290 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.291 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.291 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.291 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.291 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 monclient: authenticate success, global_id 7587 2024-09-12T18:48:32.291 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:48:31.933+0000 7f79f0608640 4 set_mon_vals no callback set 2024-09-12T18:48:32.291 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: _renew_subs 2024-09-12T18:48:32.291 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.291 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: _renew_subs 2024-09-12T18:48:32.291 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.291 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 1 librados: init done 2024-09-12T18:48:32.291 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:48:31.937+0000 7f79eee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:48:32.291 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:48:31.937+0000 7f79eee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:48:32.291 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:48:31.937+0000 7f79eee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:48:32.291 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:48:31.937+0000 7f7b02633640 10 monclient: get_auth_request con 0x7f79e8070b10 auth_method 0 2024-09-12T18:48:32.292 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:48:31.937+0000 7f7b01e32640 10 monclient: get_auth_request con 0x55d44ef65490 auth_method 0 2024-09-12T18:48:32.292 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:48:31.937+0000 7f7b02633640 10 monclient: get_auth_request con 0x55d44ef74ae0 auth_method 0 2024-09-12T18:48:32.292 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:48:31.937+0000 7f7b01e32640 10 monclient: get_auth_request con 0x55d44ef78e40 auth_method 0 2024-09-12T18:48:32.292 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:48:31.941+0000 7f7b02e34640 10 monclient: get_auth_request con 0x55d44ef7cd80 auth_method 0 2024-09-12T18:48:32.292 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 10 monclient: build_initial_monmap 2024-09-12T18:48:32.292 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:48:32.292 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 10 monclient: monmap: 2024-09-12T18:48:32.292 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:48:32.292 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:48:32.292 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:48:32.292 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:48:32.292 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:48:32.293 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.293 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:48:32.293 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:48:32.293 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:48:32.293 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.293 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding auth protocol: cephx 2024-09-12T18:48:32.293 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding auth protocol: cephx 2024-09-12T18:48:32.293 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding auth protocol: cephx 2024-09-12T18:48:32.293 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: secure 2024-09-12T18:48:32.293 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: crc 2024-09-12T18:48:32.293 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: secure 2024-09-12T18:48:32.293 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: crc 2024-09-12T18:48:32.293 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: secure 2024-09-12T18:48:32.293 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: crc 2024-09-12T18:48:32.294 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: crc 2024-09-12T18:48:32.294 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: secure 2024-09-12T18:48:32.294 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: crc 2024-09-12T18:48:32.294 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: secure 2024-09-12T18:48:32.294 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: crc 2024-09-12T18:48:32.294 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: secure 2024-09-12T18:48:32.294 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.294 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d44ef84830 EEXIST 2024-09-12T18:48:32.294 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient: init 2024-09-12T18:48:32.294 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding auth protocol: cephx 2024-09-12T18:48:32.294 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding auth protocol: cephx 2024-09-12T18:48:32.294 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding auth protocol: cephx 2024-09-12T18:48:32.294 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: secure 2024-09-12T18:48:32.294 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: crc 2024-09-12T18:48:32.295 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: secure 2024-09-12T18:48:32.295 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: crc 2024-09-12T18:48:32.295 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: secure 2024-09-12T18:48:32.295 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: crc 2024-09-12T18:48:32.295 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: crc 2024-09-12T18:48:32.295 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: secure 2024-09-12T18:48:32.295 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: crc 2024-09-12T18:48:32.295 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: secure 2024-09-12T18:48:32.295 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: crc 2024-09-12T18:48:32.295 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: secure 2024-09-12T18:48:32.295 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.295 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.295 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command rotate-key cmddesc rotate-key hook 0x55d44ef7fe90 EEXIST 2024-09-12T18:48:32.295 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:48:32.296 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:48:32.296 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x55d44efa89e0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:48:32.296 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x55d44efa8310 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:48:32.296 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x55d44efa6cf0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:48:32.296 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.296 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.296 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.296 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:48:32.296 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): authenticate will time out at 2299.088785s 2024-09-12T18:48:32.296 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): get_auth_request con 0x55d44efa89e0 auth_method 0 2024-09-12T18:48:32.296 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.296 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.296 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.297 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:48:31.945+0000 7f7b02633640 10 monclient(hunting): get_auth_request con 0x55d44efa6cf0 auth_method 0 2024-09-12T18:48:32.297 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:48:31.945+0000 7f7b02633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.297 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:48:31.945+0000 7f7b02633640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.297 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:48:31.945+0000 7f7b02633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.297 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.297 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.297 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.297 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:48:31.945+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.297 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:48:31.945+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.297 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:48:31.945+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.297 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:48:31.945+0000 7f7b02e34640 10 monclient(hunting): get_auth_request con 0x55d44efa8310 auth_method 0 2024-09-12T18:48:32.297 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:48:31.945+0000 7f7b02e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.297 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:48:31.945+0000 7f7b02e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.297 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:48:31.945+0000 7f7b02e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.298 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): handle_auth_done global_id 7100 payload 824 2024-09-12T18:48:32.298 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient: _finish_hunting 0 2024-09-12T18:48:32.298 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:48:31.945+0000 7f7b01e32640 1 monclient: found mon.noname-c 2024-09-12T18:48:32.298 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:48:32.298 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.298 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:48:32.298 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: dump: 2024-09-12T18:48:32.298 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.298 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.298 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.298 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.298 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.298 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.298 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.299 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.299 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.299 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.299 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: _finish_auth 0 2024-09-12T18:48:32.299 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: _check_auth_tickets 2024-09-12T18:48:32.299 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:48:32.299 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.299 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:48:32.299 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: dump: 2024-09-12T18:48:32.299 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.299 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.299 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.299 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.299 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.300 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.300 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.300 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.300 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.300 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.300 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 monclient: authenticate success, global_id 7100 2024-09-12T18:48:32.300 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:48:31.945+0000 7f7b03635640 4 set_mon_vals no callback set 2024-09-12T18:48:32.300 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient: _renew_subs 2024-09-12T18:48:32.300 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:48:32.300 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient: _renew_subs 2024-09-12T18:48:32.300 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:48:32.300 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:48:31.949+0000 7f79e7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:48:32.300 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:48:31.949+0000 7f79e7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:48:32.300 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:48:31.949+0000 7f79e7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:48:32.301 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient: get_auth_request con 0x7f79dc070a20 auth_method 0 2024-09-12T18:48:32.301 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: get_monmap_and_config 2024-09-12T18:48:32.301 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: build_initial_monmap 2024-09-12T18:48:32.301 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:48:32.301 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: monmap: 2024-09-12T18:48:32.301 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:48:32.301 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:48:32.301 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:48:32.301 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:48:32.301 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:48:32.301 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.301 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:48:32.301 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:48:32.301 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:48:32.302 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.302 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding auth protocol: cephx 2024-09-12T18:48:32.302 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding auth protocol: cephx 2024-09-12T18:48:32.302 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding auth protocol: cephx 2024-09-12T18:48:32.302 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: secure 2024-09-12T18:48:32.302 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: crc 2024-09-12T18:48:32.302 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: secure 2024-09-12T18:48:32.302 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: crc 2024-09-12T18:48:32.302 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: secure 2024-09-12T18:48:32.302 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: crc 2024-09-12T18:48:32.302 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: crc 2024-09-12T18:48:32.302 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: secure 2024-09-12T18:48:32.302 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: crc 2024-09-12T18:48:32.302 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: secure 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: crc 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: secure 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: init 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding auth protocol: cephx 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding auth protocol: cephx 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding auth protocol: cephx 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: secure 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: crc 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: secure 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: crc 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: secure 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: crc 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: crc 2024-09-12T18:48:32.303 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: secure 2024-09-12T18:48:32.304 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: crc 2024-09-12T18:48:32.304 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: secure 2024-09-12T18:48:32.304 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: crc 2024-09-12T18:48:32.304 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: secure 2024-09-12T18:48:32.304 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.304 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.304 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd6b928288 EEXIST 2024-09-12T18:48:32.304 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:48:32.304 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:48:32.304 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x55d44effc800 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:48:32.304 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x55d44eff7bf0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:48:32.304 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x55d44eff8570 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:48:32.304 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.305 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.305 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.305 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:48:32.305 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): authenticate will time out at 2299.093595s 2024-09-12T18:48:32.305 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): get_auth_request con 0x55d44eff7bf0 auth_method 0 2024-09-12T18:48:32.305 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.305 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.305 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.305 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:48:31.949+0000 7f7b02633640 10 monclient(hunting): get_auth_request con 0x55d44eff8570 auth_method 0 2024-09-12T18:48:32.305 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:48:31.949+0000 7f7b02633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.305 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:48:31.949+0000 7f7b02633640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.305 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:48:31.949+0000 7f7b02633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.305 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:48:31.949+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:48:31.949+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:48:31.949+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): handle_auth_done global_id 7593 payload 274 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient: _finish_hunting 0 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:48:31.949+0000 7f7b02e34640 1 monclient: found mon.noname-a 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: dump: 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.306 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.307 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.307 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.307 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.307 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.307 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.307 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.307 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.307 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: _finish_auth 0 2024-09-12T18:48:32.307 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:48:32.307 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 monclient: authenticate success, global_id 7593 2024-09-12T18:48:32.307 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:48:32.307 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:48:32.307 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 4 set_mon_vals no callback set 2024-09-12T18:48:32.307 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.308 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:48:32.308 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: dump: 2024-09-12T18:48:32.308 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.308 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.308 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.308 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.308 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.308 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.308 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.308 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.308 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.308 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.308 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: shutdown 2024-09-12T18:48:32.308 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: build_initial_monmap 2024-09-12T18:48:32.309 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:48:32.309 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: monmap: 2024-09-12T18:48:32.309 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:48:32.309 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:48:32.309 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:48:32.309 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:48:32.309 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:48:32.309 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.309 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:48:32.309 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:48:32.309 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:48:32.309 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.309 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding auth protocol: cephx 2024-09-12T18:48:32.309 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding auth protocol: cephx 2024-09-12T18:48:32.310 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding auth protocol: cephx 2024-09-12T18:48:32.310 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: secure 2024-09-12T18:48:32.310 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: crc 2024-09-12T18:48:32.310 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: secure 2024-09-12T18:48:32.310 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: crc 2024-09-12T18:48:32.310 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: secure 2024-09-12T18:48:32.310 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: crc 2024-09-12T18:48:32.310 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: crc 2024-09-12T18:48:32.310 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: secure 2024-09-12T18:48:32.310 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: crc 2024-09-12T18:48:32.310 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: secure 2024-09-12T18:48:32.310 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: crc 2024-09-12T18:48:32.310 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: secure 2024-09-12T18:48:32.311 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.311 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 1 librados: starting msgr at 2024-09-12T18:48:32.311 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 1 librados: starting objecter 2024-09-12T18:48:32.311 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d44eff7150 EEXIST 2024-09-12T18:48:32.311 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 1 librados: setting wanted keys 2024-09-12T18:48:32.311 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 1 librados: calling monclient init 2024-09-12T18:48:32.311 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: init 2024-09-12T18:48:32.311 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding auth protocol: cephx 2024-09-12T18:48:32.311 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding auth protocol: cephx 2024-09-12T18:48:32.311 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding auth protocol: cephx 2024-09-12T18:48:32.311 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: secure 2024-09-12T18:48:32.311 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: crc 2024-09-12T18:48:32.311 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: secure 2024-09-12T18:48:32.311 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: crc 2024-09-12T18:48:32.312 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: secure 2024-09-12T18:48:32.312 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: crc 2024-09-12T18:48:32.312 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: crc 2024-09-12T18:48:32.312 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: secure 2024-09-12T18:48:32.312 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: crc 2024-09-12T18:48:32.312 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: secure 2024-09-12T18:48:32.312 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: crc 2024-09-12T18:48:32.312 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: secure 2024-09-12T18:48:32.312 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.312 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.312 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command rotate-key cmddesc rotate-key hook 0x55d44efaa948 EEXIST 2024-09-12T18:48:32.312 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:48:32.313 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:48:32.313 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x55d44eff7bf0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:48:32.313 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x55d44eff8570 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:48:32.313 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x55d44effc800 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:48:32.313 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.313 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.313 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.313 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:48:32.313 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): authenticate will time out at 2299.096405s 2024-09-12T18:48:32.313 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): get_auth_request con 0x55d44eff8570 auth_method 0 2024-09-12T18:48:32.313 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.313 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.313 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.313 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient(hunting): get_auth_request con 0x55d44eff7bf0 auth_method 0 2024-09-12T18:48:32.314 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.314 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.314 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.314 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.314 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.314 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.314 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.314 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.314 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.314 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): handle_auth_done global_id 7596 payload 824 2024-09-12T18:48:32.314 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient: _finish_hunting 0 2024-09-12T18:48:32.314 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:48:31.953+0000 7f7b02e34640 1 monclient: found mon.noname-a 2024-09-12T18:48:32.314 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.314 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.315 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:48:32.315 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: dump: 2024-09-12T18:48:32.315 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.315 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.315 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.315 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.315 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.315 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.315 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.315 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.315 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.315 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.315 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: _finish_auth 0 2024-09-12T18:48:32.316 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: _check_auth_tickets 2024-09-12T18:48:32.316 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:48:32.316 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.316 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:48:32.316 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: dump: 2024-09-12T18:48:32.316 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.316 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.316 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.316 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.316 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.316 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.316 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.316 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.316 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.317 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.317 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:48:31.953+0000 7f79e5ffb640 4 set_mon_vals no callback set 2024-09-12T18:48:32.317 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 5 monclient: authenticate success, global_id 7596 2024-09-12T18:48:32.317 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient: _renew_subs 2024-09-12T18:48:32.317 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.317 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient: _renew_subs 2024-09-12T18:48:32.317 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.317 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 1 librados: init done 2024-09-12T18:48:32.317 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command cr dump hook 0x55d44eff5278 2024-09-12T18:48:32.317 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.317 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:48:31.953+0000 7f79d3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:48:32.317 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:48:31.953+0000 7f79d3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:48:32.317 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:48:31.953+0000 7f79d3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:48:32.317 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient: get_auth_request con 0x7f79cc070ae0 auth_method 0 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:48:31.953+0000 7f7b02633640 10 monclient: get_auth_request con 0x55d44f015940 auth_method 0 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 realm 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:48:31.957+0000 7f7b01e32640 10 monclient: get_auth_request con 0x55d44f019a60 auth_method 0 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:48:31.957+0000 7f7b02e34640 10 monclient: get_auth_request con 0x55d44f01d350 auth_method 0 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:48:32.318 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 searching for the correct realm 2024-09-12T18:48:32.319 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:48:31.961+0000 7f7b02633640 10 monclient: get_auth_request con 0x7f7afc02d060 auth_method 0 2024-09-12T18:48:32.319 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:48:31.961+0000 7f7b01e32640 10 monclient: get_auth_request con 0x7f7af401d400 auth_method 0 2024-09-12T18:48:32.319 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:48:31.961+0000 7f7b02e34640 10 monclient: get_auth_request con 0x7f7af8121070 auth_method 0 2024-09-12T18:48:32.319 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:48:31.965+0000 7f7b02e34640 0 -- 172.21.15.111:0/795337595 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f7af8121070 msgr2=0x7f7af80fbd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:32.319 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:48:31.965+0000 7f79d3fff640 1 client.7596.objecter ms_handle_reset 0x7f7af8121070 session 0x7f7af8130040 osd.4 2024-09-12T18:48:32.319 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:48:31.965+0000 7f79d3fff640 10 monclient: _renew_subs 2024-09-12T18:48:32.319 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:48:31.965+0000 7f79d3fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.319 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:48:31.965+0000 7f7b02e34640 10 monclient: get_auth_request con 0x7f79cc080a60 auth_method 0 2024-09-12T18:48:32.319 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:48:31.965+0000 7f7b02633640 10 monclient: get_auth_request con 0x7f7afc010b60 auth_method 0 2024-09-12T18:48:32.319 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:48:31.969+0000 7f7b01e32640 10 monclient: get_auth_request con 0x7f7afc01c9b0 auth_method 0 2024-09-12T18:48:32.319 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:48:31.969+0000 7f7b01e32640 0 -- 172.21.15.111:0/795337595 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f7afc01c9b0 msgr2=0x7f7afc079950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:48:32.319 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:48:32.173+0000 7f7b01e32640 10 monclient: get_auth_request con 0x7f7afc01c9b0 auth_method 0 2024-09-12T18:48:32.319 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:48:32.319 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:48:32.320 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:48:32.320 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:48:32.320 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:48:32.320 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:48:32.320 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.320 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.320 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.320 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:32.320 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.320 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:48:32.320 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 zone default found 2024-09-12T18:48:32.320 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 4 Realm: () 2024-09-12T18:48:32.320 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:48:32.320 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:48:32.321 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:48:32.321 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 zonegroup default 2024-09-12T18:48:32.321 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.321 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.321 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.321 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.321 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.321 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.321 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 started sync module instance, tier type = 2024-09-12T18:48:32.321 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:48:32.321 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=0 2024-09-12T18:48:32.321 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=1 2024-09-12T18:48:32.321 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=2 2024-09-12T18:48:32.321 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=3 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=4 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=5 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=6 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:48:32.221+0000 7f7b04b2d9c0 20 add_watcher() i=7 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:48:32.221+0000 7f7b04b2d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding auth protocol: cephx 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding auth protocol: cephx 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding auth protocol: cephx 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: secure 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: crc 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: secure 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: crc 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: secure 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: crc 2024-09-12T18:48:32.322 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: crc 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: secure 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: crc 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: secure 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: crc 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: secure 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:48:32.225+0000 7f79b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command cache list hook 0x55d44eff4fd0 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command cache inspect hook 0x55d44eff4fd0 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command cache erase hook 0x55d44eff4fd0 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command cache zap hook 0x55d44eff4fd0 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 note: GC not initialized 2024-09-12T18:48:32.323 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:48:32.225+0000 7f79337fe640 20 reqs_thread_entry: start 2024-09-12T18:48:32.324 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command sync trace show hook 0x7f7afc05e5b0 2024-09-12T18:48:32.324 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command sync trace history hook 0x7f7afc05e5b0 2024-09-12T18:48:32.324 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command sync trace active hook 0x7f7afc05e5b0 2024-09-12T18:48:32.324 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command sync trace active_short hook 0x7f7afc05e5b0 2024-09-12T18:48:32.324 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:48:32.324 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 20 Filter name: none 2024-09-12T18:48:32.324 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:48:32.225+0000 7f79317fa640 20 reqs_thread_entry: start 2024-09-12T18:48:32.324 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:48:32.324 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.324 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:32.324 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:48:32.324 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:48:32.324 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 : miss 2024-09-12T18:48:32.325 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.325 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:48:32.325 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:48:32.325 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:48:32.325 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:48:32.325 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:32.325 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 2024-09-12T18:48:32.325 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:48:32.237+0000 7f7b04b2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:48:32.325 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:48:32.237+0000 7f7b04b2d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:48:32.325 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:48:32.237+0000 7f7b04b2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:32.325 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:48:32.237+0000 7f7b04b2d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34, ofs0, ns] 2024-09-12T18:48:32.325 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:48:32.241+0000 7f79e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431578 cookie 94370346970112 notifier 7596 bl.length()=911 2024-09-12T18:48:32.325 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:48:32.241+0000 7f79e57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:48:32.326 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:48:32.241+0000 7f79e57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:48:32.326 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:48:32.241+0000 7f79e57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:32.326 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:48:32.241+0000 7f7b04b2d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): orig_sources= new_sources= 2024-09-12T18:48:32.326 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:48:32.241+0000 7f7b04b2d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): potential sources added=[] removed=[] 2024-09-12T18:48:32.326 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:48:32.241+0000 7f7b04b2d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): orig_dests= new_dests= 2024-09-12T18:48:32.326 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:48:32.241+0000 7f7b04b2d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): potential dests added=[] removed=[] 2024-09-12T18:48:32.326 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:48:32.253+0000 7f7b04b2d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7b04b2d9c0 time 2024-09-12T18:48:32.256190+0000 2024-09-12T18:48:32.326 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:48:32.326 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.326 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:48:32.326 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7b084072eb] 2024-09-12T18:48:32.326 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7b0840749f] 2024-09-12T18:48:32.326 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d44cbf9cc1] 2024-09-12T18:48:32.326 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d44cc0ed5a] 2024-09-12T18:48:32.327 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:48:32.327 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7b0726dd90] 2024-09-12T18:48:32.327 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:48:32.327 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:48:32.327 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.327 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:48:32.253+0000 7f7b04b2d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:48:32.327 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f7b04b2d9c0 thread_name:radosgw-admin 2024-09-12T18:48:32.327 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.327 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:48:32.327 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7b07286520] 2024-09-12T18:48:32.327 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:48:32.327 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:48:32.327 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:48:32.327 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7b08407345] 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7b0840749f] 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d44cbf9cc1] 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d44cc0ed5a] 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7b0726dd90] 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:48:32.328 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:48:32.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:48:32.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:48:32.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:48:32.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:48:32.329 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:48:32.329 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:48:32.329 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:48:32.329 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:48:32.329 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:48:32.329 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:48:32.329 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:48:32.330 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:48:32.331 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:48:32.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:48:32.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:48:32.332 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:48:32.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:48:32.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:48:32.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:48:32.332 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:48:32.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:48:32.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:48:32.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:48:32.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:48:32.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:48:32.332 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:48:32.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:48:32.333 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:48:32.333 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:48:32.333 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:48:32.333 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:48:32.333 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:48:32.333 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:48:32.333 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:48:32.333 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:48:32.333 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:48:32.333 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:48:32.333 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:48:32.333 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:48:32.333 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:48:32.333 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:48:32.334 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:48:32.334 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:48:32.334 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:48:32.334 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:48:32.334 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:48:32.334 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:48:32.334 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:48:32.334 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:48:32.334 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:48:32.334 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:48:32.334 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:48:32.334 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:48:32.334 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:48:32.334 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:48:32.335 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:48:32.335 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:48:32.335 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:48:32.335 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:48:32.335 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:48:32.335 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79317fa640 / http_manager 2024-09-12T18:48:32.335 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79337fe640 / http_manager 2024-09-12T18:48:32.335 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79b8fe1640 / rgw_dt_lg_renew 2024-09-12T18:48:32.335 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79d3fff640 / ms_dispatch 2024-09-12T18:48:32.335 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79e57fa640 / io_context_pool 2024-09-12T18:48:32.335 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79e5ffb640 / io_context_pool 2024-09-12T18:48:32.335 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79e7fff640 / ms_dispatch 2024-09-12T18:48:32.335 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79eee05640 / ms_dispatch 2024-09-12T18:48:32.335 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79f0608640 / io_context_pool 2024-09-12T18:48:32.336 INFO:tasks.workunit.client.0.smithi111.stderr: 7f7b01e32640 / msgr-worker-2 2024-09-12T18:48:32.336 INFO:tasks.workunit.client.0.smithi111.stderr: 7f7b02633640 / msgr-worker-1 2024-09-12T18:48:32.336 INFO:tasks.workunit.client.0.smithi111.stderr: 7f7b02e34640 / msgr-worker-0 2024-09-12T18:48:32.336 INFO:tasks.workunit.client.0.smithi111.stderr: 7f7b03635640 / io_context_pool 2024-09-12T18:48:32.336 INFO:tasks.workunit.client.0.smithi111.stderr: 7f7b04b2d9c0 / radosgw-admin 2024-09-12T18:48:32.336 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:48:32.336 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:48:32.336 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/log/ceph/ceph-client.admin.120736.log 2024-09-12T18:48:32.336 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:48:32.336 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:48:32.336 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:48:31.929+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.336 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:48:31.929+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.336 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:48:31.929+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.337 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:48:31.929+0000 7f7b02e34640 10 monclient(hunting): handle_auth_done global_id 7584 payload 274 2024-09-12T18:48:32.337 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:48:31.929+0000 7f7b02e34640 10 monclient: _finish_hunting 0 2024-09-12T18:48:32.337 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:48:31.929+0000 7f7b02e34640 1 monclient: found mon.noname-a 2024-09-12T18:48:32.337 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:48:31.929+0000 7f7b02e34640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.337 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.337 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:48:32.337 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: dump: 2024-09-12T18:48:32.337 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.337 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.337 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.337 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.337 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.337 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.338 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.338 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.338 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.338 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.338 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: _finish_auth 0 2024-09-12T18:48:32.338 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: _check_auth_tickets 2024-09-12T18:48:32.338 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: handle_config config(0 keys) 2024-09-12T18:48:32.338 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.338 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:48:32.338 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:48:31.929+0000 7f79f0608640 10 monclient: dump: 2024-09-12T18:48:32.338 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.338 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.338 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.338 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.339 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.339 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.339 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.339 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.339 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.339 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.339 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:48:31.929+0000 7f7b04b2d9c0 5 monclient: authenticate success, global_id 7584 2024-09-12T18:48:32.339 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:48:31.929+0000 7f7b04b2d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:48:32.339 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:48:31.929+0000 7f7b04b2d9c0 4 set_mon_vals no callback set 2024-09-12T18:48:32.339 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: shutdown 2024-09-12T18:48:32.339 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) unregister_commands rotate-key 2024-09-12T18:48:32.339 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: build_initial_monmap 2024-09-12T18:48:32.339 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:48:32.339 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: monmap: 2024-09-12T18:48:32.340 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:48:32.340 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:48:32.340 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:48:32.340 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:48:32.340 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:48:32.340 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.340 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:48:32.340 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:48:32.340 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:48:32.340 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.340 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding auth protocol: cephx 2024-09-12T18:48:32.340 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding auth protocol: cephx 2024-09-12T18:48:32.340 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding auth protocol: cephx 2024-09-12T18:48:32.340 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: secure 2024-09-12T18:48:32.341 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: crc 2024-09-12T18:48:32.341 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: secure 2024-09-12T18:48:32.341 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: crc 2024-09-12T18:48:32.341 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: secure 2024-09-12T18:48:32.341 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: crc 2024-09-12T18:48:32.341 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: crc 2024-09-12T18:48:32.341 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: secure 2024-09-12T18:48:32.341 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: crc 2024-09-12T18:48:32.341 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: secure 2024-09-12T18:48:32.341 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: crc 2024-09-12T18:48:32.341 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2f470) adding con mode: secure 2024-09-12T18:48:32.341 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.341 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 1 librados: starting msgr at 2024-09-12T18:48:32.341 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 1 librados: starting objecter 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command objecter_requests hook 0x55d44ec965f0 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 1 librados: setting wanted keys 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 1 librados: calling monclient init 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: init 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding auth protocol: cephx 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding auth protocol: cephx 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding auth protocol: cephx 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: secure 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: crc 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: secure 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: crc 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: secure 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: crc 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: crc 2024-09-12T18:48:32.342 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: secure 2024-09-12T18:48:32.343 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: crc 2024-09-12T18:48:32.343 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: secure 2024-09-12T18:48:32.343 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: crc 2024-09-12T18:48:32.343 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef2a1c0) adding con mode: secure 2024-09-12T18:48:32.343 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.343 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.343 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command rotate-key hook 0x55d44ef2a308 2024-09-12T18:48:32.343 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:48:32.343 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:48:32.343 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x55d44ede5430 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:48:32.343 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x55d44ede8b90 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:48:32.343 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x55d44ee6f940 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:48:32.343 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.344 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.344 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.344 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:48:32.344 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient(hunting): authenticate will time out at 2299.078010s 2024-09-12T18:48:32.344 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): get_auth_request con 0x55d44ee6f940 auth_method 0 2024-09-12T18:48:32.344 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.344 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.344 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.344 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:48:31.933+0000 7f7b02633640 10 monclient(hunting): get_auth_request con 0x55d44ede5430 auth_method 0 2024-09-12T18:48:32.344 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:48:31.933+0000 7f7b02633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.344 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:48:31.933+0000 7f7b02633640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.344 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:48:31.933+0000 7f7b02633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.344 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.345 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.345 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.345 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:48:31.933+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.345 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:48:31.933+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.345 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:48:31.933+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.345 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient(hunting): handle_auth_done global_id 7587 payload 824 2024-09-12T18:48:32.345 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient: _finish_hunting 0 2024-09-12T18:48:32.345 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:48:31.933+0000 7f7b02e34640 1 monclient: found mon.noname-a 2024-09-12T18:48:32.345 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:48:31.933+0000 7f7b02e34640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.345 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.345 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:48:32.345 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: dump: 2024-09-12T18:48:32.345 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.345 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.346 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.346 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.346 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.346 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.346 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.346 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.346 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.346 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.346 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: _finish_auth 0 2024-09-12T18:48:32.346 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: _check_auth_tickets 2024-09-12T18:48:32.346 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: handle_config config(0 keys) 2024-09-12T18:48:32.346 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.346 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:48:32.346 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:48:31.933+0000 7f79eee05640 10 monclient: dump: 2024-09-12T18:48:32.347 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.347 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.347 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.347 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.347 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.347 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.347 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.347 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.347 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.347 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.347 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 5 monclient: authenticate success, global_id 7587 2024-09-12T18:48:32.347 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:48:31.933+0000 7f79f0608640 4 set_mon_vals no callback set 2024-09-12T18:48:32.347 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: _renew_subs 2024-09-12T18:48:32.347 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.348 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: _renew_subs 2024-09-12T18:48:32.348 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.348 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:48:31.933+0000 7f7b04b2d9c0 1 librados: init done 2024-09-12T18:48:32.348 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:48:31.937+0000 7f79eee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:48:32.348 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:48:31.937+0000 7f79eee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:48:32.348 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:48:31.937+0000 7f79eee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:48:32.348 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:48:31.937+0000 7f7b02633640 10 monclient: get_auth_request con 0x7f79e8070b10 auth_method 0 2024-09-12T18:48:32.348 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:48:31.937+0000 7f7b01e32640 10 monclient: get_auth_request con 0x55d44ef65490 auth_method 0 2024-09-12T18:48:32.348 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:48:31.937+0000 7f7b02633640 10 monclient: get_auth_request con 0x55d44ef74ae0 auth_method 0 2024-09-12T18:48:32.348 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:48:31.937+0000 7f7b01e32640 10 monclient: get_auth_request con 0x55d44ef78e40 auth_method 0 2024-09-12T18:48:32.348 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:48:31.941+0000 7f7b02e34640 10 monclient: get_auth_request con 0x55d44ef7cd80 auth_method 0 2024-09-12T18:48:32.348 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 10 monclient: build_initial_monmap 2024-09-12T18:48:32.348 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:48:32.348 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 10 monclient: monmap: 2024-09-12T18:48:32.349 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:48:32.349 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:48:32.349 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:48:32.349 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:48:32.349 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:48:32.349 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.349 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:48:32.349 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:48:32.349 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:48:32.349 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.349 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding auth protocol: cephx 2024-09-12T18:48:32.349 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding auth protocol: cephx 2024-09-12T18:48:32.349 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding auth protocol: cephx 2024-09-12T18:48:32.349 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: secure 2024-09-12T18:48:32.350 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: crc 2024-09-12T18:48:32.350 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: secure 2024-09-12T18:48:32.350 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: crc 2024-09-12T18:48:32.350 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: secure 2024-09-12T18:48:32.350 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: crc 2024-09-12T18:48:32.350 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: crc 2024-09-12T18:48:32.350 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: secure 2024-09-12T18:48:32.350 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: crc 2024-09-12T18:48:32.350 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: secure 2024-09-12T18:48:32.350 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: crc 2024-09-12T18:48:32.350 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef80ef0) adding con mode: secure 2024-09-12T18:48:32.350 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:48:31.941+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.350 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d44ef84830 EEXIST 2024-09-12T18:48:32.350 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient: init 2024-09-12T18:48:32.351 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding auth protocol: cephx 2024-09-12T18:48:32.351 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding auth protocol: cephx 2024-09-12T18:48:32.351 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding auth protocol: cephx 2024-09-12T18:48:32.351 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: secure 2024-09-12T18:48:32.351 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: crc 2024-09-12T18:48:32.351 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: secure 2024-09-12T18:48:32.351 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: crc 2024-09-12T18:48:32.351 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: secure 2024-09-12T18:48:32.351 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: crc 2024-09-12T18:48:32.351 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: crc 2024-09-12T18:48:32.351 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: secure 2024-09-12T18:48:32.351 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: crc 2024-09-12T18:48:32.351 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: secure 2024-09-12T18:48:32.351 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: crc 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44ef7fd48) adding con mode: secure 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command rotate-key cmddesc rotate-key hook 0x55d44ef7fe90 EEXIST 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x55d44efa89e0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x55d44efa8310 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x55d44efa6cf0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient(hunting): authenticate will time out at 2299.088785s 2024-09-12T18:48:32.352 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): get_auth_request con 0x55d44efa89e0 auth_method 0 2024-09-12T18:48:32.353 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.353 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.353 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.353 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:48:31.945+0000 7f7b02633640 10 monclient(hunting): get_auth_request con 0x55d44efa6cf0 auth_method 0 2024-09-12T18:48:32.353 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:48:31.945+0000 7f7b02633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.353 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:48:31.945+0000 7f7b02633640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.353 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:48:31.945+0000 7f7b02633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.353 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.353 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.353 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.353 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:48:31.945+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.353 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:48:31.945+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.353 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:48:31.945+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.353 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:48:31.945+0000 7f7b02e34640 10 monclient(hunting): get_auth_request con 0x55d44efa8310 auth_method 0 2024-09-12T18:48:32.354 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:48:31.945+0000 7f7b02e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.354 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:48:31.945+0000 7f7b02e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.354 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:48:31.945+0000 7f7b02e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.354 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient(hunting): handle_auth_done global_id 7100 payload 824 2024-09-12T18:48:32.354 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient: _finish_hunting 0 2024-09-12T18:48:32.354 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:48:31.945+0000 7f7b01e32640 1 monclient: found mon.noname-c 2024-09-12T18:48:32.354 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:48:31.945+0000 7f7b01e32640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:48:32.354 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.354 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:48:32.354 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: dump: 2024-09-12T18:48:32.354 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.354 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.354 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.354 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: _finish_auth 0 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: _check_auth_tickets 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:48:31.945+0000 7f79e7fff640 10 monclient: dump: 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.355 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.356 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.356 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.356 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.356 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.356 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.356 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.356 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.356 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 5 monclient: authenticate success, global_id 7100 2024-09-12T18:48:32.356 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:48:31.945+0000 7f7b03635640 4 set_mon_vals no callback set 2024-09-12T18:48:32.356 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient: _renew_subs 2024-09-12T18:48:32.356 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:48:32.356 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient: _renew_subs 2024-09-12T18:48:32.356 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:48:31.945+0000 7f7b04b2d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:48:32.357 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:48:31.949+0000 7f79e7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:48:32.357 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:48:31.949+0000 7f79e7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:48:32.357 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:48:31.949+0000 7f79e7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:48:32.357 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient: get_auth_request con 0x7f79dc070a20 auth_method 0 2024-09-12T18:48:32.357 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: get_monmap_and_config 2024-09-12T18:48:32.357 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: build_initial_monmap 2024-09-12T18:48:32.357 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:48:32.357 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: monmap: 2024-09-12T18:48:32.357 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:48:32.357 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:48:32.357 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:48:32.357 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:48:32.357 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:48:32.357 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.358 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:48:32.358 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:48:32.358 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:48:32.358 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.358 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding auth protocol: cephx 2024-09-12T18:48:32.358 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding auth protocol: cephx 2024-09-12T18:48:32.358 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding auth protocol: cephx 2024-09-12T18:48:32.358 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: secure 2024-09-12T18:48:32.358 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: crc 2024-09-12T18:48:32.358 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: secure 2024-09-12T18:48:32.358 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: crc 2024-09-12T18:48:32.358 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: secure 2024-09-12T18:48:32.358 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: crc 2024-09-12T18:48:32.358 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: crc 2024-09-12T18:48:32.359 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: secure 2024-09-12T18:48:32.359 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: crc 2024-09-12T18:48:32.359 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: secure 2024-09-12T18:48:32.359 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: crc 2024-09-12T18:48:32.359 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efc8330) adding con mode: secure 2024-09-12T18:48:32.359 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.359 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: init 2024-09-12T18:48:32.359 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding auth protocol: cephx 2024-09-12T18:48:32.359 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding auth protocol: cephx 2024-09-12T18:48:32.359 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding auth protocol: cephx 2024-09-12T18:48:32.359 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: secure 2024-09-12T18:48:32.359 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: crc 2024-09-12T18:48:32.359 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: secure 2024-09-12T18:48:32.359 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: crc 2024-09-12T18:48:32.360 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: secure 2024-09-12T18:48:32.360 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: crc 2024-09-12T18:48:32.360 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: crc 2024-09-12T18:48:32.360 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: secure 2024-09-12T18:48:32.360 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: crc 2024-09-12T18:48:32.360 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: secure 2024-09-12T18:48:32.360 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: crc 2024-09-12T18:48:32.360 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928140) adding con mode: secure 2024-09-12T18:48:32.360 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.360 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.360 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd6b928288 EEXIST 2024-09-12T18:48:32.360 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:48:32.360 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:48:32.360 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x55d44effc800 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:48:32.361 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x55d44eff7bf0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:48:32.361 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x55d44eff8570 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:48:32.361 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.361 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.361 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.361 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:48:32.361 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient(hunting): authenticate will time out at 2299.093595s 2024-09-12T18:48:32.361 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): get_auth_request con 0x55d44eff7bf0 auth_method 0 2024-09-12T18:48:32.361 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.361 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.362 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.362 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:48:31.949+0000 7f7b02633640 10 monclient(hunting): get_auth_request con 0x55d44eff8570 auth_method 0 2024-09-12T18:48:32.362 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:48:31.949+0000 7f7b02633640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.362 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:48:31.949+0000 7f7b02633640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.362 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:48:31.949+0000 7f7b02633640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.362 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.362 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.362 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.362 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:48:31.949+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.362 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:48:31.949+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.362 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:48:31.949+0000 7f7b02633640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.362 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient(hunting): handle_auth_done global_id 7593 payload 274 2024-09-12T18:48:32.362 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient: _finish_hunting 0 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:48:31.949+0000 7f7b02e34640 1 monclient: found mon.noname-a 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:48:31.949+0000 7f7b02e34640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: dump: 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.363 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.364 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: _finish_auth 0 2024-09-12T18:48:32.364 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: _check_auth_tickets 2024-09-12T18:48:32.364 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 monclient: authenticate success, global_id 7593 2024-09-12T18:48:32.364 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T18:48:32.364 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:48:32.364 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 4 set_mon_vals no callback set 2024-09-12T18:48:32.364 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.364 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:48:32.364 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:48:31.949+0000 7f79e5ffb640 10 monclient: dump: 2024-09-12T18:48:32.364 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.364 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.364 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.364 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.364 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.365 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.365 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.365 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.365 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.365 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.365 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: shutdown 2024-09-12T18:48:32.365 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: build_initial_monmap 2024-09-12T18:48:32.365 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:48:32.365 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: monmap: 2024-09-12T18:48:32.365 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:48:32.365 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:48:32.365 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:48:32.365 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:48:32.365 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:48:32.366 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.366 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:48:32.366 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:48:32.366 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:48:32.366 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.366 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding auth protocol: cephx 2024-09-12T18:48:32.366 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding auth protocol: cephx 2024-09-12T18:48:32.366 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding auth protocol: cephx 2024-09-12T18:48:32.366 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: secure 2024-09-12T18:48:32.366 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: crc 2024-09-12T18:48:32.366 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: secure 2024-09-12T18:48:32.366 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: crc 2024-09-12T18:48:32.366 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: secure 2024-09-12T18:48:32.366 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: crc 2024-09-12T18:48:32.367 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: crc 2024-09-12T18:48:32.367 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: secure 2024-09-12T18:48:32.367 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: crc 2024-09-12T18:48:32.367 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: secure 2024-09-12T18:48:32.367 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: crc 2024-09-12T18:48:32.367 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44eff8a60) adding con mode: secure 2024-09-12T18:48:32.367 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.367 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 1 librados: starting msgr at 2024-09-12T18:48:32.367 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 1 librados: starting objecter 2024-09-12T18:48:32.367 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d44eff7150 EEXIST 2024-09-12T18:48:32.367 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 1 librados: setting wanted keys 2024-09-12T18:48:32.367 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 1 librados: calling monclient init 2024-09-12T18:48:32.367 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 10 monclient: init 2024-09-12T18:48:32.367 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding auth protocol: cephx 2024-09-12T18:48:32.368 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding auth protocol: cephx 2024-09-12T18:48:32.368 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding auth protocol: cephx 2024-09-12T18:48:32.368 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: secure 2024-09-12T18:48:32.368 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: crc 2024-09-12T18:48:32.368 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: secure 2024-09-12T18:48:32.368 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: crc 2024-09-12T18:48:32.368 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: secure 2024-09-12T18:48:32.368 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: crc 2024-09-12T18:48:32.368 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: crc 2024-09-12T18:48:32.368 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: secure 2024-09-12T18:48:32.368 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: crc 2024-09-12T18:48:32.368 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: secure 2024-09-12T18:48:32.368 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: crc 2024-09-12T18:48:32.368 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:48:31.949+0000 7f7b04b2d9c0 5 AuthRegistry(0x55d44efaa800) adding con mode: secure 2024-09-12T18:48:32.369 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.369 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.369 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command rotate-key cmddesc rotate-key hook 0x55d44efaa948 EEXIST 2024-09-12T18:48:32.369 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:48:32.369 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:48:32.369 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-c con 0x55d44eff7bf0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:48:32.369 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-a con 0x55d44eff8570 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:48:32.369 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): picked mon.noname-b con 0x55d44effc800 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:48:32.369 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.369 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.369 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:48:32.369 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:48:32.369 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient(hunting): authenticate will time out at 2299.096405s 2024-09-12T18:48:32.370 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): get_auth_request con 0x55d44eff8570 auth_method 0 2024-09-12T18:48:32.370 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.370 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.370 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.370 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient(hunting): get_auth_request con 0x55d44eff7bf0 auth_method 0 2024-09-12T18:48:32.370 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:48:32.370 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:48:32.370 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:48:32.370 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.370 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.370 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.370 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:48:32.370 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:48:32.370 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:48:32.371 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient(hunting): handle_auth_done global_id 7596 payload 824 2024-09-12T18:48:32.371 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient: _finish_hunting 0 2024-09-12T18:48:32.371 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:48:31.953+0000 7f7b02e34640 1 monclient: found mon.noname-a 2024-09-12T18:48:32.371 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:48:31.953+0000 7f7b02e34640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.371 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.371 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:48:32.371 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: dump: 2024-09-12T18:48:32.371 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.371 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.371 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.371 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.371 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.371 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.371 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.372 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.372 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.372 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.372 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: _finish_auth 0 2024-09-12T18:48:32.372 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: _check_auth_tickets 2024-09-12T18:48:32.372 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T18:48:32.372 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:48:32.372 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:48:32.372 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:48:31.953+0000 7f79d3fff640 10 monclient: dump: 2024-09-12T18:48:32.372 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:48:32.372 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:48:32.372 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.372 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:48:32.372 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:48:32.373 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:48:32.373 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:48:32.373 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:48:32.373 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:48:32.373 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.373 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:48:31.953+0000 7f79e5ffb640 4 set_mon_vals no callback set 2024-09-12T18:48:32.373 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 5 monclient: authenticate success, global_id 7596 2024-09-12T18:48:32.373 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient: _renew_subs 2024-09-12T18:48:32.373 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.373 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient: _renew_subs 2024-09-12T18:48:32.373 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.373 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 1 librados: init done 2024-09-12T18:48:32.373 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command cr dump hook 0x55d44eff5278 2024-09-12T18:48:32.373 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:48:31.953+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.374 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:48:31.953+0000 7f79d3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:48:32.374 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:48:31.953+0000 7f79d3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:48:32.374 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:48:31.953+0000 7f79d3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:48:32.374 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:48:31.953+0000 7f7b01e32640 10 monclient: get_auth_request con 0x7f79cc070ae0 auth_method 0 2024-09-12T18:48:32.374 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:48:31.953+0000 7f7b02633640 10 monclient: get_auth_request con 0x55d44f015940 auth_method 0 2024-09-12T18:48:32.374 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.374 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 realm 2024-09-12T18:48:32.374 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.374 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.374 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:48:32.374 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.374 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.374 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.374 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:48:31.957+0000 7f7b01e32640 10 monclient: get_auth_request con 0x55d44f019a60 auth_method 0 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:48:31.957+0000 7f7b02e34640 10 monclient: get_auth_request con 0x55d44f01d350 auth_method 0 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:48:31.957+0000 7f7b04b2d9c0 20 searching for the correct realm 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:48:31.961+0000 7f7b02633640 10 monclient: get_auth_request con 0x7f7afc02d060 auth_method 0 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:48:31.961+0000 7f7b01e32640 10 monclient: get_auth_request con 0x7f7af401d400 auth_method 0 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:48:31.961+0000 7f7b02e34640 10 monclient: get_auth_request con 0x7f7af8121070 auth_method 0 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:48:31.965+0000 7f7b02e34640 0 -- 172.21.15.111:0/795337595 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f7af8121070 msgr2=0x7f7af80fbd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:48:31.965+0000 7f79d3fff640 1 client.7596.objecter ms_handle_reset 0x7f7af8121070 session 0x7f7af8130040 osd.4 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:48:31.965+0000 7f79d3fff640 10 monclient: _renew_subs 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:48:31.965+0000 7f79d3fff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:48:31.965+0000 7f7b02e34640 10 monclient: get_auth_request con 0x7f79cc080a60 auth_method 0 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:48:31.965+0000 7f7b02633640 10 monclient: get_auth_request con 0x7f7afc010b60 auth_method 0 2024-09-12T18:48:32.375 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:48:31.969+0000 7f7b01e32640 10 monclient: get_auth_request con 0x7f7afc01c9b0 auth_method 0 2024-09-12T18:48:32.376 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:48:31.969+0000 7f7b01e32640 0 -- 172.21.15.111:0/795337595 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f7afc01c9b0 msgr2=0x7f7afc079950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:48:32.376 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:48:32.173+0000 7f7b01e32640 10 monclient: get_auth_request con 0x7f7afc01c9b0 auth_method 0 2024-09-12T18:48:32.376 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:48:32.376 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:48:32.376 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:48:32.376 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:48:32.376 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:48:32.376 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:48:32.376 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.376 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.376 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:48:32.185+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.376 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:32.376 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.377 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:48:32.377 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 zone default found 2024-09-12T18:48:32.377 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 4 Realm: () 2024-09-12T18:48:32.377 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:48:32.377 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:48:32.377 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:48:32.377 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 zonegroup default 2024-09-12T18:48:32.377 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.377 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.377 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.377 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.377 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.377 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.377 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 started sync module instance, tier type = 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:48:32.189+0000 7f7b04b2d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=0 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=1 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=2 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=3 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=4 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=5 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:48:32.217+0000 7f7b04b2d9c0 20 add_watcher() i=6 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:48:32.221+0000 7f7b04b2d9c0 20 add_watcher() i=7 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:48:32.221+0000 7f7b04b2d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding auth protocol: cephx 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding auth protocol: cephx 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding auth protocol: cephx 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: secure 2024-09-12T18:48:32.378 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: crc 2024-09-12T18:48:32.379 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: secure 2024-09-12T18:48:32.379 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: crc 2024-09-12T18:48:32.379 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: secure 2024-09-12T18:48:32.379 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: crc 2024-09-12T18:48:32.379 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: crc 2024-09-12T18:48:32.379 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: secure 2024-09-12T18:48:32.379 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: crc 2024-09-12T18:48:32.379 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: secure 2024-09-12T18:48:32.379 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: crc 2024-09-12T18:48:32.379 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 AuthRegistry(0x7ffd6b928620) adding con mode: secure 2024-09-12T18:48:32.379 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:48:32.225+0000 7f79b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:32.379 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:48:32.379 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:48:32.379 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:48:32.380 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command cache list hook 0x55d44eff4fd0 2024-09-12T18:48:32.380 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command cache inspect hook 0x55d44eff4fd0 2024-09-12T18:48:32.380 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command cache erase hook 0x55d44eff4fd0 2024-09-12T18:48:32.380 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command cache zap hook 0x55d44eff4fd0 2024-09-12T18:48:32.380 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 note: GC not initialized 2024-09-12T18:48:32.380 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:48:32.225+0000 7f79337fe640 20 reqs_thread_entry: start 2024-09-12T18:48:32.380 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command sync trace show hook 0x7f7afc05e5b0 2024-09-12T18:48:32.380 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command sync trace history hook 0x7f7afc05e5b0 2024-09-12T18:48:32.380 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command sync trace active hook 0x7f7afc05e5b0 2024-09-12T18:48:32.380 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 5 asok(0x55d44ed1d2b0) register_command sync trace active_short hook 0x7f7afc05e5b0 2024-09-12T18:48:32.380 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:48:32.380 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:48:32.225+0000 7f7b04b2d9c0 20 Filter name: none 2024-09-12T18:48:32.380 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:48:32.225+0000 7f79317fa640 20 reqs_thread_entry: start 2024-09-12T18:48:32.381 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:48:32.381 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.381 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:32.381 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:48:32.381 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:48:32.381 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 : miss 2024-09-12T18:48:32.381 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.381 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:48:32.381 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:48:32.381 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:48:32.381 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:48:32.381 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:32.381 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:48:32.229+0000 7f7b04b2d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 2024-09-12T18:48:32.381 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:48:32.237+0000 7f7b04b2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:48:32.382 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:48:32.237+0000 7f7b04b2d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:48:32.382 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:48:32.237+0000 7f7b04b2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:32.382 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:48:32.237+0000 7f7b04b2d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34, ofs0, ns] 2024-09-12T18:48:32.382 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:48:32.241+0000 7f79e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431578 cookie 94370346970112 notifier 7596 bl.length()=911 2024-09-12T18:48:32.382 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:48:32.241+0000 7f79e57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:48:32.382 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:48:32.241+0000 7f79e57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:48:32.382 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:48:32.241+0000 7f79e57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:32.382 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:48:32.241+0000 7f7b04b2d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): orig_sources= new_sources= 2024-09-12T18:48:32.382 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:48:32.241+0000 7f7b04b2d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): potential sources added=[] removed=[] 2024-09-12T18:48:32.382 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:48:32.241+0000 7f7b04b2d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): orig_dests= new_dests= 2024-09-12T18:48:32.382 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:48:32.241+0000 7f7b04b2d9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): potential dests added=[] removed=[] 2024-09-12T18:48:32.382 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:48:32.253+0000 7f7b04b2d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7b04b2d9c0 time 2024-09-12T18:48:32.256190+0000 2024-09-12T18:48:32.382 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:48:32.382 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.383 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:48:32.383 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7b084072eb] 2024-09-12T18:48:32.383 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7b0840749f] 2024-09-12T18:48:32.383 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d44cbf9cc1] 2024-09-12T18:48:32.383 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d44cc0ed5a] 2024-09-12T18:48:32.383 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:48:32.383 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7b0726dd90] 2024-09-12T18:48:32.383 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:48:32.383 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:48:32.383 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.383 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:48:32.253+0000 7f7b04b2d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:48:32.383 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f7b04b2d9c0 thread_name:radosgw-admin 2024-09-12T18:48:32.383 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.383 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:48:32.384 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7b07286520] 2024-09-12T18:48:32.384 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:48:32.384 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:48:32.384 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:48:32.384 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7b08407345] 2024-09-12T18:48:32.384 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7b0840749f] 2024-09-12T18:48:32.384 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d44cbf9cc1] 2024-09-12T18:48:32.384 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55d44cc0ed5a] 2024-09-12T18:48:32.384 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:48:32.384 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7b0726dd90] 2024-09-12T18:48:32.384 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:48:32.384 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:48:32.384 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:48:32.384 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.385 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:48:32.385 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:48:32.385 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:48:32.385 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:48:32.385 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:48:32.385 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:48:32.385 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:48:32.385 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:48:32.385 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:48:32.385 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:48:32.385 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:48:32.385 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:48:32.385 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:48:32.385 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:48:32.386 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:48:32.387 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:48:32.388 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:48:32.388 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:48:32.388 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:48:32.388 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:48:32.388 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:48:32.388 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:48:32.388 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:48:32.388 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:48:32.388 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:48:32.388 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:48:32.388 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:48:32.388 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:48:32.388 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:48:32.388 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:48:32.389 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:48:32.389 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:48:32.389 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:48:32.389 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:48:32.389 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:48:32.389 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:48:32.389 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:48:32.389 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:48:32.389 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:48:32.389 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:48:32.389 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:48:32.389 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:48:32.389 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:48:32.389 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:48:32.390 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:48:32.390 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:48:32.390 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:48:32.390 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:48:32.390 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:48:32.390 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:48:32.390 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:48:32.390 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:48:32.390 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:48:32.390 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:48:32.390 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:48:32.390 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:48:32.390 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:48:32.390 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:48:32.391 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:48:32.391 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:48:32.391 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:48:32.391 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:48:32.391 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:48:32.391 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:48:32.391 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:48:32.391 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:48:32.391 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79317fa640 / http_manager 2024-09-12T18:48:32.391 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79337fe640 / http_manager 2024-09-12T18:48:32.391 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79b8fe1640 / rgw_dt_lg_renew 2024-09-12T18:48:32.391 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79d3fff640 / ms_dispatch 2024-09-12T18:48:32.391 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79e57fa640 / io_context_pool 2024-09-12T18:48:32.391 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79e5ffb640 / io_context_pool 2024-09-12T18:48:32.392 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79e7fff640 / ms_dispatch 2024-09-12T18:48:32.392 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79eee05640 / ms_dispatch 2024-09-12T18:48:32.392 INFO:tasks.workunit.client.0.smithi111.stderr: 7f79f0608640 / io_context_pool 2024-09-12T18:48:32.392 INFO:tasks.workunit.client.0.smithi111.stderr: 7f7b01e32640 / msgr-worker-2 2024-09-12T18:48:32.392 INFO:tasks.workunit.client.0.smithi111.stderr: 7f7b02633640 / msgr-worker-1 2024-09-12T18:48:32.392 INFO:tasks.workunit.client.0.smithi111.stderr: 7f7b02e34640 / msgr-worker-0 2024-09-12T18:48:32.392 INFO:tasks.workunit.client.0.smithi111.stderr: 7f7b03635640 / io_context_pool 2024-09-12T18:48:32.392 INFO:tasks.workunit.client.0.smithi111.stderr: 7f7b04b2d9c0 / radosgw-admin 2024-09-12T18:48:32.392 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:48:32.392 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:48:32.392 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:48:32.258867Z_1863c8bd-20ce-4862-ae2f-ebbe6825d7e5/log 2024-09-12T18:48:32.392 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:48:32.392 INFO:tasks.workunit.client.0.smithi111.stderr:Aborted 2024-09-12T18:48:32.392 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T18:48:32.394 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:48:32.394 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:48:32.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.341+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.341+0000 7f3ee89c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.341+0000 7f3ee89c49c0 20 realm 2024-09-12T18:48:32.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.341+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.341+0000 7f3ee89c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.341+0000 7f3ee89c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:48:32.394 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.341+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.341+0000 7f3ee89c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.341+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.345+0000 7f3ee89c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:32.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.345+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.345+0000 7f3ee89c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:48:32.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.345+0000 7f3ee89c49c0 20 searching for the correct realm 2024-09-12T18:48:32.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.349+0000 7f3ee64ca640 0 -- 172.21.15.111:0/1481508403 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f3ee000e070 msgr2=0x7f3ee007adf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:32.395 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.357+0000 7f3ee5cc9640 0 -- 172.21.15.111:0/1481508403 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f3ee007c380 msgr2=0x7f3ee0063830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:32.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.573+0000 7f3ee89c49c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:48:32.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.573+0000 7f3ee89c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:48:32.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.573+0000 7f3ee89c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:48:32.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.573+0000 7f3ee89c49c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:48:32.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.573+0000 7f3ee89c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:48:32.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.573+0000 7f3ee89c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:48:32.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.573+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.573+0000 7f3ee89c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.573+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.573+0000 7f3ee89c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:32.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.573+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:48:32.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 20 zone default found 2024-09-12T18:48:32.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 4 Realm: () 2024-09-12T18:48:32.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:48:32.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:48:32.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:48:32.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 20 zonegroup default 2024-09-12T18:48:32.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.582 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.582 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 20 started sync module instance, tier type = 2024-09-12T18:48:32.583 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.577+0000 7f3ee89c49c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:48:32.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.601+0000 7f3ee89c49c0 20 add_watcher() i=0 2024-09-12T18:48:32.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.605+0000 7f3ee89c49c0 20 add_watcher() i=1 2024-09-12T18:48:32.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.605+0000 7f3ee89c49c0 20 add_watcher() i=2 2024-09-12T18:48:32.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.605+0000 7f3ee89c49c0 20 add_watcher() i=3 2024-09-12T18:48:32.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.605+0000 7f3ee89c49c0 20 add_watcher() i=4 2024-09-12T18:48:32.608 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.605+0000 7f3ee89c49c0 20 add_watcher() i=5 2024-09-12T18:48:32.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.605+0000 7f3ee89c49c0 20 add_watcher() i=6 2024-09-12T18:48:32.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.605+0000 7f3ee89c49c0 20 add_watcher() i=7 2024-09-12T18:48:32.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.605+0000 7f3ee89c49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:48:32.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.609+0000 7f3d9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:32.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.609+0000 7f3ee89c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:48:32.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.609+0000 7f3ee89c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:48:32.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.609+0000 7f3ee89c49c0 5 note: GC not initialized 2024-09-12T18:48:32.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.613+0000 7f3d177fe640 20 reqs_thread_entry: start 2024-09-12T18:48:32.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.613+0000 7f3ee89c49c0 20 init_complete bucket index max shards: 11 2024-09-12T18:48:32.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.613+0000 7f3ee89c49c0 20 Filter name: none 2024-09-12T18:48:32.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.613+0000 7f3d157fa640 20 reqs_thread_entry: start 2024-09-12T18:48:32.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.613+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.613+0000 7f3ee89c49c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:32.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.613+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.613+0000 7f3ee89c49c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T18:48:32.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.613+0000 7f3ee89c49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:48:32.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.617+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.621 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.617+0000 7f3ee89c49c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:32.621 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.617+0000 7f3ee89c49c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.617+0000 7f3ee89c49c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T18:48:32.622 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.617+0000 7f3ee89c49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:48:32.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.621+0000 7f3d9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:32.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.625+0000 7f3ee89c49c0 20 remove_watcher() i=0 2024-09-12T18:48:32.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.625+0000 7f3ee89c49c0 2 removed watcher, disabling cache 2024-09-12T18:48:32.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.629+0000 7f3ee89c49c0 20 remove_watcher() i=1 2024-09-12T18:48:32.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.633+0000 7f3ee89c49c0 20 remove_watcher() i=2 2024-09-12T18:48:32.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.633+0000 7f3ee89c49c0 20 remove_watcher() i=3 2024-09-12T18:48:32.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.637+0000 7f3ee89c49c0 20 remove_watcher() i=4 2024-09-12T18:48:32.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.637+0000 7f3ee89c49c0 20 remove_watcher() i=5 2024-09-12T18:48:32.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.637+0000 7f3ee89c49c0 20 remove_watcher() i=6 2024-09-12T18:48:32.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.641+0000 7f3ee89c49c0 20 remove_watcher() i=7 2024-09-12T18:48:32.662 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.662 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:48:32.662 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-do-reshard id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:48:32.662 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:48:32.663 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:32.664 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:32.672 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:48:32.673 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:48:32.721 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:48:32.756 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:48:32.756 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:48:32.803 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.797+0000 7f7b4c1c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.801+0000 7f7b4c1c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.801+0000 7f7b4c1c09c0 20 realm 2024-09-12T18:48:32.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.801+0000 7f7b4c1c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.805 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.801+0000 7f7b4c1c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.801+0000 7f7b4c1c09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:48:32.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.801+0000 7f7b4c1c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.801+0000 7f7b4c1c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:32.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.801+0000 7f7b4c1c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.807 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.801+0000 7f7b4c1c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:32.807 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.801+0000 7f7b4c1c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:32.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.805+0000 7f7b4c1c09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:48:32.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.805+0000 7f7b4c1c09c0 20 searching for the correct realm 2024-09-12T18:48:32.812 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.809+0000 7f7b4a4c7640 0 -- 172.21.15.111:0/2158287813 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f7b400e0070 msgr2=0x7f7b400e1910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:32.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:32.813+0000 7f7b494c5640 0 -- 172.21.15.111:0/2158287813 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f7b440685d0 msgr2=0x7f7b44064b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:48:33.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.033+0000 7f7b4c1c09c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:48:33.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.033+0000 7f7b4c1c09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:48:33.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.033+0000 7f7b4c1c09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:48:33.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.033+0000 7f7b4c1c09c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:48:33.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.033+0000 7f7b4c1c09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:48:33.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.033+0000 7f7b4c1c09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:48:33.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.033+0000 7f7b4c1c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:33.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:33.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:33.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:48:33.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:33.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:48:33.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 20 zone default found 2024-09-12T18:48:33.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 4 Realm: () 2024-09-12T18:48:33.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:48:33.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:48:33.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:48:33.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 20 zonegroup default 2024-09-12T18:48:33.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:33.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:33.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:33.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:33.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.037+0000 7f7b4c1c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:33.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.041+0000 7f7b4c1c09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:48:33.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.041+0000 7f7b4c1c09c0 20 started sync module instance, tier type = 2024-09-12T18:48:33.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.041+0000 7f7b4c1c09c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:48:33.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.061+0000 7f7b4c1c09c0 20 add_watcher() i=0 2024-09-12T18:48:33.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.061+0000 7f7b4c1c09c0 20 add_watcher() i=1 2024-09-12T18:48:33.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.061+0000 7f7b4c1c09c0 20 add_watcher() i=2 2024-09-12T18:48:33.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.061+0000 7f7b4c1c09c0 20 add_watcher() i=3 2024-09-12T18:48:33.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.061+0000 7f7b4c1c09c0 20 add_watcher() i=4 2024-09-12T18:48:33.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.061+0000 7f7b4c1c09c0 20 add_watcher() i=5 2024-09-12T18:48:33.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.061+0000 7f7b4c1c09c0 20 add_watcher() i=6 2024-09-12T18:48:33.070 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.065+0000 7f7b4c1c09c0 20 add_watcher() i=7 2024-09-12T18:48:33.070 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.065+0000 7f7b4c1c09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:48:33.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.069+0000 7f79fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:33.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.069+0000 7f7b4c1c09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:48:33.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.069+0000 7f7b4c1c09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:48:33.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.069+0000 7f7b4c1c09c0 5 note: GC not initialized 2024-09-12T18:48:33.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.069+0000 7f79fa7fc640 20 reqs_thread_entry: start 2024-09-12T18:48:33.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.069+0000 7f7b4c1c09c0 20 init_complete bucket index max shards: 11 2024-09-12T18:48:33.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.069+0000 7f7b4c1c09c0 20 Filter name: none 2024-09-12T18:48:33.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.073+0000 7f796bfff640 20 reqs_thread_entry: start 2024-09-12T18:48:33.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.073+0000 7f7b4c1c09c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:48:33.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.073+0000 7f7b4c1c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:33.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.073+0000 7f7b4c1c09c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:48:33.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.073+0000 7f7b4c1c09c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:48:33.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.073+0000 7f7b4c1c09c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:48:33.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.073+0000 7f7b4c1c09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 : miss 2024-09-12T18:48:33.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.073+0000 7f7b4c1c09c0 20 rados->read ofs=0 len=0 2024-09-12T18:48:33.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.073+0000 7f7b4c1c09c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T18:48:33.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.073+0000 7f7b4c1c09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:48:33.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.073+0000 7f7b4c1c09c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:48:33.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.073+0000 7f7b4c1c09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:48:33.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.073+0000 7f7b4c1c09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:48:33.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.073+0000 7f7b4c1c09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 2024-09-12T18:48:33.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.077+0000 7f7b4c1c09c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to be held by another RGW process; skipping for now 2024-09-12T18:48:33.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.077+0000 7f79fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:48:33.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.085+0000 7f7b4c1c09c0 20 remove_watcher() i=0 2024-09-12T18:48:33.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.085+0000 7f7b4c1c09c0 2 removed watcher, disabling cache 2024-09-12T18:48:33.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.089+0000 7f7b4c1c09c0 20 remove_watcher() i=1 2024-09-12T18:48:33.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.089+0000 7f7b4c1c09c0 20 remove_watcher() i=2 2024-09-12T18:48:33.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.093+0000 7f7b4c1c09c0 20 remove_watcher() i=3 2024-09-12T18:48:33.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.093+0000 7f7b4c1c09c0 20 remove_watcher() i=4 2024-09-12T18:48:33.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.097+0000 7f7b4c1c09c0 20 remove_watcher() i=5 2024-09-12T18:48:33.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.097+0000 7f7b4c1c09c0 20 remove_watcher() i=6 2024-09-12T18:48:33.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:48:33.097+0000 7f7b4c1c09c0 20 remove_watcher() i=7 2024-09-12T18:48:33.118 INFO:tasks.workunit.client.0.smithi111.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:49:03.150 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:49:03.186 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:03.186 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:03.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.225+0000 7f1ce344a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.229+0000 7f1ce344a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:03.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.229+0000 7f1ce344a9c0 20 realm 2024-09-12T18:49:03.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.229+0000 7f1ce344a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.229+0000 7f1ce344a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:03.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.229+0000 7f1ce344a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:03.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.229+0000 7f1ce344a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.229+0000 7f1ce344a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:03.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.229+0000 7f1ce344a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.229+0000 7f1ce344a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:03.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.229+0000 7f1ce344a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.233+0000 7f1ce344a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:03.236 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.233+0000 7f1ce344a9c0 20 searching for the correct realm 2024-09-12T18:49:03.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.237+0000 7f1ce1751640 0 -- 172.21.15.111:0/743528078 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f1cc8015070 msgr2=0x7f1cc8098940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:03.247 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.241+0000 7f1ce074f640 0 -- 172.21.15.111:0/743528078 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f1cd80b7940 msgr2=0x7f1cd80f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:49:03.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.457+0000 7f1ce344a9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:03.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.457+0000 7f1ce344a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:03.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.457+0000 7f1ce344a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:03.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.457+0000 7f1ce344a9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:03.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.457+0000 7f1ce344a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:03.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.457+0000 7f1ce344a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:03.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.457+0000 7f1ce344a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.457+0000 7f1ce344a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:03.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.457+0000 7f1ce344a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:03.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:03.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 20 zone default found 2024-09-12T18:49:03.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 4 Realm: () 2024-09-12T18:49:03.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:03.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:03.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:03.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 20 zonegroup default 2024-09-12T18:49:03.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:03.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:03.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:03.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 20 started sync module instance, tier type = 2024-09-12T18:49:03.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.461+0000 7f1ce344a9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:03.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.489+0000 7f1ce344a9c0 20 add_watcher() i=0 2024-09-12T18:49:03.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.489+0000 7f1ce344a9c0 20 add_watcher() i=1 2024-09-12T18:49:03.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.489+0000 7f1ce344a9c0 20 add_watcher() i=2 2024-09-12T18:49:03.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.489+0000 7f1ce344a9c0 20 add_watcher() i=3 2024-09-12T18:49:03.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.489+0000 7f1ce344a9c0 20 add_watcher() i=4 2024-09-12T18:49:03.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.489+0000 7f1ce344a9c0 20 add_watcher() i=5 2024-09-12T18:49:03.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.489+0000 7f1ce344a9c0 20 add_watcher() i=6 2024-09-12T18:49:03.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.489+0000 7f1ce344a9c0 20 add_watcher() i=7 2024-09-12T18:49:03.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.489+0000 7f1ce344a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:03.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.493+0000 7f1b977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:03.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.493+0000 7f1ce344a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:03.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.493+0000 7f1ce344a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:03.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.493+0000 7f1ce344a9c0 5 note: GC not initialized 2024-09-12T18:49:03.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1b967e4640 20 reqs_thread_entry: start 2024-09-12T18:49:03.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:03.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 20 Filter name: none 2024-09-12T18:49:03.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1b8f7fe640 20 reqs_thread_entry: start 2024-09-12T18:49:03.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T18:49:03.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:49:03.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T18:49:03.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T18:49:03.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 : miss 2024-09-12T18:49:03.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T18:49:03.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:49:03.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:49:03.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:03.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:03.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.497+0000 7f1ce344a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 2024-09-12T18:49:03.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.501+0000 7f1ce344a9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:49:03.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.517+0000 7f1ce344a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:49:03.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.517+0000 7f1ce344a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:49:03.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.517+0000 7f1ce344a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:03.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.517+0000 7f1ce344a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34, ofs0, ns] 2024-09-12T18:49:03.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.517+0000 7f1bb7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431579 cookie 94043216978976 notifier 7157 bl.length()=911 2024-09-12T18:49:03.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.517+0000 7f1bb7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:49:03.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.517+0000 7f1bb7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:49:03.521 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.517+0000 7f1bb7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:03.522 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.517+0000 7f1ce344a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): orig_sources= new_sources= 2024-09-12T18:49:03.522 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.517+0000 7f1ce344a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): potential sources added=[] removed=[] 2024-09-12T18:49:03.522 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.517+0000 7f1ce344a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): orig_dests= new_dests= 2024-09-12T18:49:03.522 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.517+0000 7f1ce344a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): potential dests added=[] removed=[] 2024-09-12T18:49:03.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.0 2024-09-12T18:49:03.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.0 2024-09-12T18:49:03.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.1 2024-09-12T18:49:03.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.1 2024-09-12T18:49:03.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.2 2024-09-12T18:49:03.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.2 2024-09-12T18:49:03.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.3 2024-09-12T18:49:03.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.3 2024-09-12T18:49:03.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.4 2024-09-12T18:49:03.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.4 2024-09-12T18:49:03.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.5 2024-09-12T18:49:03.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.5 2024-09-12T18:49:03.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.6 2024-09-12T18:49:03.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.6 2024-09-12T18:49:03.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.7 2024-09-12T18:49:03.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.7 2024-09-12T18:49:03.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.8 2024-09-12T18:49:03.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.8 2024-09-12T18:49:03.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.9 2024-09-12T18:49:03.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.9 2024-09-12T18:49:03.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.10 2024-09-12T18:49:03.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.10 2024-09-12T18:49:03.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.11 2024-09-12T18:49:03.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2.11 2024-09-12T18:49:03.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.0 2024-09-12T18:49:03.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.1 2024-09-12T18:49:03.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2 2024-09-12T18:49:03.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.529+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.3 2024-09-12T18:49:03.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.533+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.4 2024-09-12T18:49:03.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.533+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.5 2024-09-12T18:49:03.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.533+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.6 2024-09-12T18:49:03.539 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.533+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.7 2024-09-12T18:49:03.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.537+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.8 2024-09-12T18:49:03.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.537+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.9 2024-09-12T18:49:03.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.537+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.10 2024-09-12T18:49:03.549 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.545+0000 7f1ce344a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 : hit (requested=0x17, cached=0x17) 2024-09-12T18:49:03.549 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.545+0000 7f1ce344a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 2024-09-12T18:49:03.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.545+0000 7f1ce344a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:49:03.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.545+0000 7f1ce344a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:49:03.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.545+0000 7f1ce344a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:03.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.545+0000 7f1ce344a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34, ofs0, ns] 2024-09-12T18:49:03.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.549+0000 7f1bb7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431580 cookie 94043216978976 notifier 7157 bl.length()=911 2024-09-12T18:49:03.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.549+0000 7f1bb7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:49:03.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.549+0000 7f1bb7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:49:03.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.549+0000 7f1bb7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:03.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.549+0000 7f1ce344a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): orig_sources= new_sources= 2024-09-12T18:49:03.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.549+0000 7f1ce344a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): potential sources added=[] removed=[] 2024-09-12T18:49:03.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.549+0000 7f1ce344a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): orig_dests= new_dests= 2024-09-12T18:49:03.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.549+0000 7f1ce344a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): potential dests added=[] removed=[] 2024-09-12T18:49:03.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.553+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.0 2024-09-12T18:49:03.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.553+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.1 2024-09-12T18:49:03.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.553+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.2 2024-09-12T18:49:03.559 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.553+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.3 2024-09-12T18:49:03.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.557+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.4 2024-09-12T18:49:03.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.557+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.5 2024-09-12T18:49:03.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.557+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.6 2024-09-12T18:49:03.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.557+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.7 2024-09-12T18:49:03.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.557+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.8 2024-09-12T18:49:03.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.557+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.9 2024-09-12T18:49:03.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.557+0000 7f1ce344a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.34.10 2024-09-12T18:49:03.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.561+0000 7f1ce344a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 : hit (requested=0x17, cached=0x17) 2024-09-12T18:49:03.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.561+0000 7f1ce344a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 2024-09-12T18:49:03.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.561+0000 7f1ce344a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:49:03.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.561+0000 7f1ce344a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:49:03.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.561+0000 7f1ce344a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:03.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.561+0000 7f1ce344a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34, ofs0, ns] 2024-09-12T18:49:03.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.561+0000 7f1bb77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431581 cookie 94043216978976 notifier 7157 bl.length()=879 2024-09-12T18:49:03.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.561+0000 7f1bb77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 info.flags=0x17 2024-09-12T18:49:03.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.561+0000 7f1bb77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:97c2b296-1395-4700-8053-4f06c4c86557.4689.34 to cache LRU end 2024-09-12T18:49:03.567 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.561+0000 7f1bb77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:03.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.565+0000 7f1ce344a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): orig_sources= new_sources= 2024-09-12T18:49:03.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.565+0000 7f1ce344a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): potential sources added=[] removed=[] 2024-09-12T18:49:03.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.565+0000 7f1ce344a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): orig_dests= new_dests= 2024-09-12T18:49:03.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.565+0000 7f1ce344a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[97c2b296-1395-4700-8053-4f06c4c86557.4689.34]): potential dests added=[] removed=[] 2024-09-12T18:49:03.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.569+0000 7f1ce344a9c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T18:49:03.577 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.573+0000 7f1b977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:03.581 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.577+0000 7f1ce344a9c0 20 remove_watcher() i=0 2024-09-12T18:49:03.582 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.577+0000 7f1ce344a9c0 2 removed watcher, disabling cache 2024-09-12T18:49:03.584 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.577+0000 7f1ce344a9c0 20 remove_watcher() i=1 2024-09-12T18:49:03.586 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.581+0000 7f1ce344a9c0 20 remove_watcher() i=2 2024-09-12T18:49:03.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.585+0000 7f1ce344a9c0 20 remove_watcher() i=3 2024-09-12T18:49:03.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.585+0000 7f1ce344a9c0 20 remove_watcher() i=4 2024-09-12T18:49:03.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.585+0000 7f1ce344a9c0 20 remove_watcher() i=5 2024-09-12T18:49:03.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.589+0000 7f1ce344a9c0 20 remove_watcher() i=6 2024-09-12T18:49:03.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.589+0000 7f1ce344a9c0 20 remove_watcher() i=7 2024-09-12T18:49:03.608 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T18:49:03.637 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:03.637 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:03.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.673+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.677+0000 7f6ee6fe79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:03.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.677+0000 7f6ee6fe79c0 20 realm 2024-09-12T18:49:03.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.677+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.677+0000 7f6ee6fe79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:03.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.677+0000 7f6ee6fe79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:03.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.677+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.677+0000 7f6ee6fe79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:03.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.677+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.681+0000 7f6ee6fe79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:03.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.681+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.681+0000 7f6ee6fe79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:03.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.681+0000 7f6ee6fe79c0 20 searching for the correct realm 2024-09-12T18:49:03.690 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.685+0000 7f6ee4aed640 0 -- 172.21.15.111:0/2735636192 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f6edc03ab20 msgr2=0x7f6edc025420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:03.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.693+0000 7f6ee42ec640 0 -- 172.21.15.111:0/2735636192 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f6edc04b040 msgr2=0x7f6edc04b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:03.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.909+0000 7f6ee6fe79c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:03.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.909+0000 7f6ee6fe79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:03.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.909+0000 7f6ee6fe79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:03.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.909+0000 7f6ee6fe79c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:03.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.909+0000 7f6ee6fe79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:03.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.909+0000 7f6ee6fe79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:03.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.909+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.909+0000 7f6ee6fe79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:03.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.909+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.913+0000 7f6ee6fe79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:03.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.913+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.913+0000 7f6ee6fe79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:03.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.913+0000 7f6ee6fe79c0 20 zone default found 2024-09-12T18:49:03.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.913+0000 7f6ee6fe79c0 4 Realm: () 2024-09-12T18:49:03.918 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.913+0000 7f6ee6fe79c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:03.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.913+0000 7f6ee6fe79c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:03.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.913+0000 7f6ee6fe79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:03.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.913+0000 7f6ee6fe79c0 20 zonegroup default 2024-09-12T18:49:03.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.913+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.913+0000 7f6ee6fe79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:03.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.913+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.913+0000 7f6ee6fe79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:03.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.913+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.917+0000 7f6ee6fe79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:03.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.917+0000 7f6ee6fe79c0 20 started sync module instance, tier type = 2024-09-12T18:49:03.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.917+0000 7f6ee6fe79c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:03.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.937+0000 7f6ee6fe79c0 20 add_watcher() i=0 2024-09-12T18:49:03.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.937+0000 7f6ee6fe79c0 20 add_watcher() i=1 2024-09-12T18:49:03.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.937+0000 7f6ee6fe79c0 20 add_watcher() i=2 2024-09-12T18:49:03.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.937+0000 7f6ee6fe79c0 20 add_watcher() i=3 2024-09-12T18:49:03.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.937+0000 7f6ee6fe79c0 20 add_watcher() i=4 2024-09-12T18:49:03.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.937+0000 7f6ee6fe79c0 20 add_watcher() i=5 2024-09-12T18:49:03.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.937+0000 7f6ee6fe79c0 20 add_watcher() i=6 2024-09-12T18:49:03.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.937+0000 7f6ee6fe79c0 20 add_watcher() i=7 2024-09-12T18:49:03.943 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.937+0000 7f6ee6fe79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:03.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.941+0000 7f6d9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:03.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.941+0000 7f6ee6fe79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:03.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.941+0000 7f6ee6fe79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:03.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.941+0000 7f6ee6fe79c0 5 note: GC not initialized 2024-09-12T18:49:03.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.941+0000 7f6d99fe3640 20 reqs_thread_entry: start 2024-09-12T18:49:03.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.941+0000 7f6ee6fe79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:03.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.941+0000 7f6ee6fe79c0 20 Filter name: none 2024-09-12T18:49:03.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.941+0000 7f6d0b7fe640 20 reqs_thread_entry: start 2024-09-12T18:49:03.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.941+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.945+0000 7f6ee6fe79c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:49:03.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.945+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.945+0000 7f6ee6fe79c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:49:03.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.945+0000 7f6ee6fe79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:03.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.945+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.945+0000 7f6ee6fe79c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T18:49:03.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.945+0000 7f6ee6fe79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:03.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.945+0000 7f6ee6fe79c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T18:49:03.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.945+0000 7f6ee6fe79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:03.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.949+0000 7f6d9afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:03.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.953+0000 7f6ee6fe79c0 20 remove_watcher() i=0 2024-09-12T18:49:03.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.953+0000 7f6ee6fe79c0 2 removed watcher, disabling cache 2024-09-12T18:49:03.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.957+0000 7f6ee6fe79c0 20 remove_watcher() i=1 2024-09-12T18:49:03.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.957+0000 7f6ee6fe79c0 20 remove_watcher() i=2 2024-09-12T18:49:03.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.961+0000 7f6ee6fe79c0 20 remove_watcher() i=3 2024-09-12T18:49:03.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.961+0000 7f6ee6fe79c0 20 remove_watcher() i=4 2024-09-12T18:49:03.968 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.965+0000 7f6ee6fe79c0 20 remove_watcher() i=5 2024-09-12T18:49:03.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.965+0000 7f6ee6fe79c0 20 remove_watcher() i=6 2024-09-12T18:49:03.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:03.965+0000 7f6ee6fe79c0 20 remove_watcher() i=7 2024-09-12T18:49:03.986 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:03.986 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:49:03.986 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-do-reshard id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:49:03.986 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:03.987 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:03.987 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:03.990 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:03.990 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.039 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.039 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.094 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T18:49:04.094 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:04.096 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.096 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.121 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.121 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.168 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.168 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.187 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.187 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.207 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.207 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.225 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.225 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.247 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.247 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.266 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.266 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.285 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.285 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.304 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.304 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.324 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.324 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.343 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.343 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.362 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.362 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.381 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.381 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.401 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.402 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.419 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.420 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.439 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.439 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.458 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.459 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.477 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.477 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.495 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.495 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.516 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.516 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.538 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:04.538 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:04.554 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T18:49:04.586 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:04.586 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:04.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.625+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:04.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.629+0000 7fe13b58c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:04.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.629+0000 7fe13b58c9c0 20 realm 2024-09-12T18:49:04.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.629+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:04.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.629+0000 7fe13b58c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:04.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.629+0000 7fe13b58c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:04.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.629+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:04.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.629+0000 7fe13b58c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:04.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.629+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:04.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.629+0000 7fe13b58c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:04.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.629+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:04.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.633+0000 7fe13b58c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:04.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.633+0000 7fe13b58c9c0 20 searching for the correct realm 2024-09-12T18:49:04.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.637+0000 7fe139893640 0 -- 172.21.15.111:0/1533690982 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fe130019040 msgr2=0x7fe130038920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:04.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:04.853+0000 7fe138891640 0 -- 172.21.15.111:0/1533690982 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fe134043be0 msgr2=0x7fe13400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:49:05.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.069+0000 7fe13b58c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:05.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.069+0000 7fe13b58c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:05.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.069+0000 7fe13b58c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:05.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.069+0000 7fe13b58c9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:05.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.069+0000 7fe13b58c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:05.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.069+0000 7fe13b58c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:05.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.069+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.069+0000 7fe13b58c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:05.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.069+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.069+0000 7fe13b58c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:05.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.069+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:05.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 20 zone default found 2024-09-12T18:49:05.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 4 Realm: () 2024-09-12T18:49:05.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:05.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:05.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:05.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 20 zonegroup default 2024-09-12T18:49:05.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:05.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:05.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:05.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 20 started sync module instance, tier type = 2024-09-12T18:49:05.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.073+0000 7fe13b58c9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:05.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.097+0000 7fe13b58c9c0 20 add_watcher() i=0 2024-09-12T18:49:05.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.097+0000 7fe13b58c9c0 20 add_watcher() i=1 2024-09-12T18:49:05.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.097+0000 7fe13b58c9c0 20 add_watcher() i=2 2024-09-12T18:49:05.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.097+0000 7fe13b58c9c0 20 add_watcher() i=3 2024-09-12T18:49:05.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.097+0000 7fe13b58c9c0 20 add_watcher() i=4 2024-09-12T18:49:05.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.097+0000 7fe13b58c9c0 20 add_watcher() i=5 2024-09-12T18:49:05.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.097+0000 7fe13b58c9c0 20 add_watcher() i=6 2024-09-12T18:49:05.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.101+0000 7fe13b58c9c0 20 add_watcher() i=7 2024-09-12T18:49:05.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.101+0000 7fe13b58c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:05.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.105+0000 7fdfef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:05.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.105+0000 7fe13b58c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:05.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.105+0000 7fe13b58c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:05.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.105+0000 7fe13b58c9c0 5 note: GC not initialized 2024-09-12T18:49:05.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.105+0000 7fdfee7e4640 20 reqs_thread_entry: start 2024-09-12T18:49:05.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.105+0000 7fe13b58c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:05.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.105+0000 7fe13b58c9c0 20 Filter name: none 2024-09-12T18:49:05.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.105+0000 7fdf5ffff640 20 reqs_thread_entry: start 2024-09-12T18:49:05.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.105+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.109+0000 7fe13b58c9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:05.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.109+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.109+0000 7fe13b58c9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:05.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.109+0000 7fe13b58c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:05.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.109+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.109+0000 7fe13b58c9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:05.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.109+0000 7fe13b58c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.113+0000 7fe13b58c9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:05.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.113+0000 7fe13b58c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:05.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.113+0000 7fdfef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:05.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.117+0000 7fe13b58c9c0 20 remove_watcher() i=0 2024-09-12T18:49:05.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.117+0000 7fe13b58c9c0 2 removed watcher, disabling cache 2024-09-12T18:49:05.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.121+0000 7fe13b58c9c0 20 remove_watcher() i=1 2024-09-12T18:49:05.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.125+0000 7fe13b58c9c0 20 remove_watcher() i=2 2024-09-12T18:49:05.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.125+0000 7fe13b58c9c0 20 remove_watcher() i=3 2024-09-12T18:49:05.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.129+0000 7fe13b58c9c0 20 remove_watcher() i=4 2024-09-12T18:49:05.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.129+0000 7fe13b58c9c0 20 remove_watcher() i=5 2024-09-12T18:49:05.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.133+0000 7fe13b58c9c0 20 remove_watcher() i=6 2024-09-12T18:49:05.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.133+0000 7fe13b58c9c0 20 remove_watcher() i=7 2024-09-12T18:49:05.153 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:05.153 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:49:05.153 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-logrecord-writes id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:49:05.153 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:05.153 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T18:49:05.192 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:05.192 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:05.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.229+0000 7f52dfd019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.233+0000 7f52dfd019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:05.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.233+0000 7f52dfd019c0 20 realm 2024-09-12T18:49:05.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.233+0000 7f52dfd019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.233+0000 7f52dfd019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:05.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.233+0000 7f52dfd019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:05.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.233+0000 7f52dfd019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.233+0000 7f52dfd019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:05.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.233+0000 7f52dfd019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.233+0000 7f52dfd019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:05.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.233+0000 7f52dfd019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.237+0000 7f52dfd019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:05.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.237+0000 7f52dfd019c0 20 searching for the correct realm 2024-09-12T18:49:05.244 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.241+0000 7f52de008640 0 -- 172.21.15.111:0/1346682521 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f52c8033070 msgr2=0x7f52c803fab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:49:05.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.457+0000 7f52dd006640 0 -- 172.21.15.111:0/1346682521 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f52d00ad970 msgr2=0x7f52d0009cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:05.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.673+0000 7f52dfd019c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:05.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.673+0000 7f52dfd019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:05.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.673+0000 7f52dfd019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:05.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.673+0000 7f52dfd019c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:05.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.673+0000 7f52dfd019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:05.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.673+0000 7f52dfd019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:05.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.673+0000 7f52dfd019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:05.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.681 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:05.681 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:05.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 20 zone default found 2024-09-12T18:49:05.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 4 Realm: () 2024-09-12T18:49:05.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:05.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:05.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:05.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 20 zonegroup default 2024-09-12T18:49:05.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:05.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:05.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.677+0000 7f52dfd019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.681+0000 7f52dfd019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:05.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.681+0000 7f52dfd019c0 20 started sync module instance, tier type = 2024-09-12T18:49:05.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.681+0000 7f52dfd019c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:05.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.705+0000 7f52dfd019c0 20 add_watcher() i=0 2024-09-12T18:49:05.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.705+0000 7f52dfd019c0 20 add_watcher() i=1 2024-09-12T18:49:05.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.705+0000 7f52dfd019c0 20 add_watcher() i=2 2024-09-12T18:49:05.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.705+0000 7f52dfd019c0 20 add_watcher() i=3 2024-09-12T18:49:05.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.705+0000 7f52dfd019c0 20 add_watcher() i=4 2024-09-12T18:49:05.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.705+0000 7f52dfd019c0 20 add_watcher() i=5 2024-09-12T18:49:05.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.705+0000 7f52dfd019c0 20 add_watcher() i=6 2024-09-12T18:49:05.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.705+0000 7f52dfd019c0 20 add_watcher() i=7 2024-09-12T18:49:05.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.705+0000 7f52dfd019c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:05.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.709+0000 7f518f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:05.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.713+0000 7f52dfd019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:05.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.713+0000 7f52dfd019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:05.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.713+0000 7f52dfd019c0 5 note: GC not initialized 2024-09-12T18:49:05.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.713+0000 7f518e7fc640 20 reqs_thread_entry: start 2024-09-12T18:49:05.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.713+0000 7f52dfd019c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:05.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.713+0000 7f52dfd019c0 20 Filter name: none 2024-09-12T18:49:05.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.713+0000 7f50fffff640 20 reqs_thread_entry: start 2024-09-12T18:49:05.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.713+0000 7f52dfd019c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T18:49:05.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.713+0000 7f52dfd019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.713+0000 7f52dfd019c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:05.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.713+0000 7f52dfd019c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T18:49:05.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.713+0000 7f52dfd019c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T18:49:05.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.713+0000 7f52dfd019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 : miss 2024-09-12T18:49:05.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.713+0000 7f52dfd019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.717+0000 7f52dfd019c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:05.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.717+0000 7f52dfd019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 info.flags=0x17 2024-09-12T18:49:05.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.717+0000 7f52dfd019c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 to cache LRU end 2024-09-12T18:49:05.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.717+0000 7f52dfd019c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:05.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.717+0000 7f52dfd019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:05.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.717+0000 7f52dfd019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 2024-09-12T18:49:05.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.725+0000 7f52dfd019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 info.flags=0x17 2024-09-12T18:49:05.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.725+0000 7f52dfd019c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 to cache LRU end 2024-09-12T18:49:05.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.725+0000 7f52dfd019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:05.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.725+0000 7f52dfd019c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35, ofs0, ns] 2024-09-12T18:49:05.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.729+0000 7f51c17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431652 cookie 94001877496304 notifier 7716 bl.length()=923 2024-09-12T18:49:05.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.729+0000 7f51c17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 info.flags=0x17 2024-09-12T18:49:05.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.729+0000 7f51c17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 to cache LRU end 2024-09-12T18:49:05.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.729+0000 7f51c17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:05.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.729+0000 7f52dfd019c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): orig_sources= new_sources= 2024-09-12T18:49:05.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.729+0000 7f52dfd019c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): potential sources added=[] removed=[] 2024-09-12T18:49:05.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.729+0000 7f52dfd019c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): orig_dests= new_dests= 2024-09-12T18:49:05.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.729+0000 7f52dfd019c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): potential dests added=[] removed=[] 2024-09-12T18:49:05.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.733+0000 7f52dfd019c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T18:49:05.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.733+0000 7f52dfd019c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T18:49:05.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.749+0000 7f52dfd019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 : hit (requested=0x17, cached=0x17) 2024-09-12T18:49:05.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.749+0000 7f52dfd019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 2024-09-12T18:49:05.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.753+0000 7f52dfd019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 info.flags=0x17 2024-09-12T18:49:05.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.753+0000 7f52dfd019c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 to cache LRU end 2024-09-12T18:49:05.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.753+0000 7f52dfd019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:05.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.753+0000 7f52dfd019c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35, ofs0, ns] 2024-09-12T18:49:05.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.753+0000 7f51c0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431653 cookie 94001877496304 notifier 7716 bl.length()=891 2024-09-12T18:49:05.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.753+0000 7f51c0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 info.flags=0x17 2024-09-12T18:49:05.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.753+0000 7f51c0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 to cache LRU end 2024-09-12T18:49:05.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.753+0000 7f51c0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:05.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.753+0000 7f52dfd019c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): orig_sources= new_sources= 2024-09-12T18:49:05.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.753+0000 7f52dfd019c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): potential sources added=[] removed=[] 2024-09-12T18:49:05.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.753+0000 7f52dfd019c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): orig_dests= new_dests= 2024-09-12T18:49:05.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.753+0000 7f52dfd019c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): potential dests added=[] removed=[] 2024-09-12T18:49:05.761 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.757+0000 7f518f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:05.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.761+0000 7f52dfd019c0 20 remove_watcher() i=0 2024-09-12T18:49:05.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.761+0000 7f52dfd019c0 2 removed watcher, disabling cache 2024-09-12T18:49:05.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.765+0000 7f52dfd019c0 20 remove_watcher() i=1 2024-09-12T18:49:05.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.765+0000 7f52dfd019c0 20 remove_watcher() i=2 2024-09-12T18:49:05.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.769+0000 7f52dfd019c0 20 remove_watcher() i=3 2024-09-12T18:49:05.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.769+0000 7f52dfd019c0 20 remove_watcher() i=4 2024-09-12T18:49:05.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.769+0000 7f52dfd019c0 20 remove_watcher() i=5 2024-09-12T18:49:05.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.773+0000 7f52dfd019c0 20 remove_watcher() i=6 2024-09-12T18:49:05.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.773+0000 7f52dfd019c0 20 remove_watcher() i=7 2024-09-12T18:49:05.793 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T18:49:05.822 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:05.822 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:05.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.861+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.865+0000 7f55e12a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:05.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.865+0000 7f55e12a69c0 20 realm 2024-09-12T18:49:05.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.865+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.865+0000 7f55e12a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:05.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.865+0000 7f55e12a69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:05.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.865+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.865+0000 7f55e12a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:05.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.865+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.865+0000 7f55e12a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:05.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.865+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:05.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.865+0000 7f55e12a69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:05.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.865+0000 7f55e12a69c0 20 searching for the correct realm 2024-09-12T18:49:05.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.873+0000 7f55df5ad640 0 -- 172.21.15.111:0/2005199011 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f55d40bf040 msgr2=0x7f55d40ca400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:05.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:05.877+0000 7f55de5ab640 0 -- 172.21.15.111:0/2005199011 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f55d805b850 msgr2=0x7f55d800f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:49:06.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.093+0000 7f55e12a69c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:06.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.093+0000 7f55e12a69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:06.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.093+0000 7f55e12a69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:06.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.093+0000 7f55e12a69c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:06.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.093+0000 7f55e12a69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:06.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.093+0000 7f55e12a69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:06.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.093+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.097+0000 7f55e12a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:06.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.097+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.097+0000 7f55e12a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:06.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.097+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.097+0000 7f55e12a69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:06.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.097+0000 7f55e12a69c0 20 zone default found 2024-09-12T18:49:06.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.097+0000 7f55e12a69c0 4 Realm: () 2024-09-12T18:49:06.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.097+0000 7f55e12a69c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:06.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.097+0000 7f55e12a69c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:06.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.097+0000 7f55e12a69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:06.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.097+0000 7f55e12a69c0 20 zonegroup default 2024-09-12T18:49:06.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.097+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.097+0000 7f55e12a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:06.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.097+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.101+0000 7f55e12a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:06.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.101+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.101+0000 7f55e12a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:06.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.101+0000 7f55e12a69c0 20 started sync module instance, tier type = 2024-09-12T18:49:06.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.101+0000 7f55e12a69c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:06.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.125+0000 7f55e12a69c0 20 add_watcher() i=0 2024-09-12T18:49:06.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.125+0000 7f55e12a69c0 20 add_watcher() i=1 2024-09-12T18:49:06.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.125+0000 7f55e12a69c0 20 add_watcher() i=2 2024-09-12T18:49:06.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.125+0000 7f55e12a69c0 20 add_watcher() i=3 2024-09-12T18:49:06.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.125+0000 7f55e12a69c0 20 add_watcher() i=4 2024-09-12T18:49:06.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.125+0000 7f55e12a69c0 20 add_watcher() i=5 2024-09-12T18:49:06.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.125+0000 7f55e12a69c0 20 add_watcher() i=6 2024-09-12T18:49:06.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.129+0000 7f55e12a69c0 20 add_watcher() i=7 2024-09-12T18:49:06.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.129+0000 7f55e12a69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:06.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.129+0000 7f54957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:06.136 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.133+0000 7f55e12a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:06.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.133+0000 7f55e12a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:06.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.133+0000 7f55e12a69c0 5 note: GC not initialized 2024-09-12T18:49:06.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.133+0000 7f540ffff640 20 reqs_thread_entry: start 2024-09-12T18:49:06.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.133+0000 7f55e12a69c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:06.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.133+0000 7f55e12a69c0 20 Filter name: none 2024-09-12T18:49:06.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.133+0000 7f540dffb640 20 reqs_thread_entry: start 2024-09-12T18:49:06.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.133+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.133+0000 7f55e12a69c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:06.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.133+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.137+0000 7f55e12a69c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:06.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.137+0000 7f55e12a69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:06.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.137+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.137+0000 7f55e12a69c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:06.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.137+0000 7f55e12a69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.137+0000 7f55e12a69c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:06.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.137+0000 7f55e12a69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:06.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.141+0000 7f54957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:06.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.145+0000 7f55e12a69c0 20 remove_watcher() i=0 2024-09-12T18:49:06.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.145+0000 7f55e12a69c0 2 removed watcher, disabling cache 2024-09-12T18:49:06.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.149+0000 7f55e12a69c0 20 remove_watcher() i=1 2024-09-12T18:49:06.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.149+0000 7f55e12a69c0 20 remove_watcher() i=2 2024-09-12T18:49:06.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.153+0000 7f55e12a69c0 20 remove_watcher() i=3 2024-09-12T18:49:06.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.153+0000 7f55e12a69c0 20 remove_watcher() i=4 2024-09-12T18:49:06.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.157+0000 7f55e12a69c0 20 remove_watcher() i=5 2024-09-12T18:49:06.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.157+0000 7f55e12a69c0 20 remove_watcher() i=6 2024-09-12T18:49:06.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.157+0000 7f55e12a69c0 20 remove_watcher() i=7 2024-09-12T18:49:06.177 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:06.177 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:49:06.177 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-logrecord-writes id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:49:06.177 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:06.179 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:06.179 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:06.192 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:06.192 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:06.237 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:49:06.273 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:06.274 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:06.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.313+0000 7fba44b8b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.317+0000 7fba44b8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:06.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.317+0000 7fba44b8b9c0 20 realm 2024-09-12T18:49:06.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.317+0000 7fba44b8b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.317+0000 7fba44b8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:06.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.317+0000 7fba44b8b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:06.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.317+0000 7fba44b8b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.317+0000 7fba44b8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:06.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.317+0000 7fba44b8b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.317+0000 7fba44b8b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:06.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.317+0000 7fba44b8b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.321+0000 7fba44b8b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:06.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.321+0000 7fba44b8b9c0 20 searching for the correct realm 2024-09-12T18:49:06.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.321+0000 7fba42e92640 0 -- 172.21.15.111:0/1048121218 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fba38088c20 msgr2=0x7fba38010040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:06.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.537+0000 7fba41e90640 0 -- 172.21.15.111:0/1048121218 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fba3c0e8910 msgr2=0x7fba3c0b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:06.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.752+0000 7fba44b8b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:06.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.752+0000 7fba44b8b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:06.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.752+0000 7fba44b8b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:06.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.752+0000 7fba44b8b9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:06.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.752+0000 7fba44b8b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:06.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.752+0000 7fba44b8b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:06.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.752+0000 7fba44b8b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:06.761 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.761 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:06.761 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:06.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 20 zone default found 2024-09-12T18:49:06.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 4 Realm: () 2024-09-12T18:49:06.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:06.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:06.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:06.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 20 zonegroup default 2024-09-12T18:49:06.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:06.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:06.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.756+0000 7fba44b8b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.760+0000 7fba44b8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:06.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.760+0000 7fba44b8b9c0 20 started sync module instance, tier type = 2024-09-12T18:49:06.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.760+0000 7fba44b8b9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:06.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.780+0000 7fba44b8b9c0 20 add_watcher() i=0 2024-09-12T18:49:06.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.780+0000 7fba44b8b9c0 20 add_watcher() i=1 2024-09-12T18:49:06.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.780+0000 7fba44b8b9c0 20 add_watcher() i=2 2024-09-12T18:49:06.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.780+0000 7fba44b8b9c0 20 add_watcher() i=3 2024-09-12T18:49:06.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.780+0000 7fba44b8b9c0 20 add_watcher() i=4 2024-09-12T18:49:06.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.780+0000 7fba44b8b9c0 20 add_watcher() i=5 2024-09-12T18:49:06.787 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.780+0000 7fba44b8b9c0 20 add_watcher() i=6 2024-09-12T18:49:06.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.784+0000 7fba44b8b9c0 20 add_watcher() i=7 2024-09-12T18:49:06.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.784+0000 7fba44b8b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:06.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fb8f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:06.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fba44b8b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:06.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fba44b8b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:06.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fba44b8b9c0 5 note: GC not initialized 2024-09-12T18:49:06.793 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fb8737fe640 20 reqs_thread_entry: start 2024-09-12T18:49:06.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fba44b8b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:06.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fba44b8b9c0 20 Filter name: none 2024-09-12T18:49:06.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fb8717fa640 20 reqs_thread_entry: start 2024-09-12T18:49:06.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fba44b8b9c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T18:49:06.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fba44b8b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fba44b8b9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:06.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fba44b8b9c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T18:49:06.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fba44b8b9c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T18:49:06.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fba44b8b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 : miss 2024-09-12T18:49:06.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.788+0000 7fba44b8b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.792+0000 7fba44b8b9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:06.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.792+0000 7fba44b8b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 info.flags=0x17 2024-09-12T18:49:06.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.792+0000 7fba44b8b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 to cache LRU end 2024-09-12T18:49:06.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.792+0000 7fba44b8b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:06.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.792+0000 7fba44b8b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:06.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.792+0000 7fba44b8b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 2024-09-12T18:49:06.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.804+0000 7fba44b8b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 info.flags=0x17 2024-09-12T18:49:06.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.804+0000 7fba44b8b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 to cache LRU end 2024-09-12T18:49:06.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.804+0000 7fba44b8b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:06.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.804+0000 7fba44b8b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35, ofs0, ns] 2024-09-12T18:49:06.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.804+0000 7fb925ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431654 cookie 94289670730272 notifier 7244 bl.length()=923 2024-09-12T18:49:06.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.804+0000 7fb925ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 info.flags=0x17 2024-09-12T18:49:06.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.804+0000 7fb925ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 to cache LRU end 2024-09-12T18:49:06.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.804+0000 7fb925ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:06.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.804+0000 7fba44b8b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): orig_sources= new_sources= 2024-09-12T18:49:06.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.804+0000 7fba44b8b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): potential sources added=[] removed=[] 2024-09-12T18:49:06.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.804+0000 7fba44b8b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): orig_dests= new_dests= 2024-09-12T18:49:06.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.804+0000 7fba44b8b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): potential dests added=[] removed=[] 2024-09-12T18:49:06.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.0 2024-09-12T18:49:06.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.0 2024-09-12T18:49:06.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.1 2024-09-12T18:49:06.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.1 2024-09-12T18:49:06.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.2 2024-09-12T18:49:06.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.2 2024-09-12T18:49:06.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.3 2024-09-12T18:49:06.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.3 2024-09-12T18:49:06.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.4 2024-09-12T18:49:06.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.4 2024-09-12T18:49:06.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.5 2024-09-12T18:49:06.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.5 2024-09-12T18:49:06.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.6 2024-09-12T18:49:06.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.6 2024-09-12T18:49:06.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.7 2024-09-12T18:49:06.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.7 2024-09-12T18:49:06.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.8 2024-09-12T18:49:06.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.8 2024-09-12T18:49:06.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.9 2024-09-12T18:49:06.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.9 2024-09-12T18:49:06.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.10 2024-09-12T18:49:06.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.10 2024-09-12T18:49:06.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.11 2024-09-12T18:49:06.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1.11 2024-09-12T18:49:06.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.812+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.0 2024-09-12T18:49:06.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.816+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1 2024-09-12T18:49:06.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.816+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.2 2024-09-12T18:49:06.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.816+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.3 2024-09-12T18:49:06.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.816+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.4 2024-09-12T18:49:06.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.820+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.5 2024-09-12T18:49:06.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.820+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.6 2024-09-12T18:49:06.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.820+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.7 2024-09-12T18:49:06.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.820+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.8 2024-09-12T18:49:06.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.820+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.9 2024-09-12T18:49:06.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.824+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.10 2024-09-12T18:49:06.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.828+0000 7fba44b8b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 : hit (requested=0x17, cached=0x17) 2024-09-12T18:49:06.835 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.828+0000 7fba44b8b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 2024-09-12T18:49:06.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.832+0000 7fba44b8b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 info.flags=0x17 2024-09-12T18:49:06.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.832+0000 7fba44b8b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 to cache LRU end 2024-09-12T18:49:06.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.832+0000 7fba44b8b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:06.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.832+0000 7fba44b8b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35, ofs0, ns] 2024-09-12T18:49:06.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.832+0000 7fb925ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431655 cookie 94289670730272 notifier 7244 bl.length()=923 2024-09-12T18:49:06.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.832+0000 7fb925ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 info.flags=0x17 2024-09-12T18:49:06.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.832+0000 7fb925ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 to cache LRU end 2024-09-12T18:49:06.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.832+0000 7fb925ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:06.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.832+0000 7fba44b8b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): orig_sources= new_sources= 2024-09-12T18:49:06.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.832+0000 7fba44b8b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): potential sources added=[] removed=[] 2024-09-12T18:49:06.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.832+0000 7fba44b8b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): orig_dests= new_dests= 2024-09-12T18:49:06.839 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.832+0000 7fba44b8b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): potential dests added=[] removed=[] 2024-09-12T18:49:06.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.840+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.0 2024-09-12T18:49:06.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.840+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.1 2024-09-12T18:49:06.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.840+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.2 2024-09-12T18:49:06.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.840+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.3 2024-09-12T18:49:06.848 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.844+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.4 2024-09-12T18:49:06.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.844+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.5 2024-09-12T18:49:06.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.844+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.6 2024-09-12T18:49:06.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.844+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.7 2024-09-12T18:49:06.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.844+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.8 2024-09-12T18:49:06.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.844+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.9 2024-09-12T18:49:06.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.848+0000 7fba44b8b9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.35.10 2024-09-12T18:49:06.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.848+0000 7fba44b8b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 : hit (requested=0x17, cached=0x17) 2024-09-12T18:49:06.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.848+0000 7fba44b8b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 2024-09-12T18:49:06.856 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.852+0000 7fba44b8b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 info.flags=0x17 2024-09-12T18:49:06.856 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.852+0000 7fba44b8b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 to cache LRU end 2024-09-12T18:49:06.856 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.852+0000 7fba44b8b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:06.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.852+0000 7fba44b8b9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35, ofs0, ns] 2024-09-12T18:49:06.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.852+0000 7fb9257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431656 cookie 94289670730272 notifier 7244 bl.length()=891 2024-09-12T18:49:06.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.852+0000 7fb9257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 info.flags=0x17 2024-09-12T18:49:06.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.852+0000 7fb9257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.35 to cache LRU end 2024-09-12T18:49:06.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.852+0000 7fb9257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:06.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.852+0000 7fba44b8b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): orig_sources= new_sources= 2024-09-12T18:49:06.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.852+0000 7fba44b8b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): potential sources added=[] removed=[] 2024-09-12T18:49:06.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.852+0000 7fba44b8b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): orig_dests= new_dests= 2024-09-12T18:49:06.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.852+0000 7fba44b8b9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.35]): potential dests added=[] removed=[] 2024-09-12T18:49:06.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.856+0000 7fba44b8b9c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T18:49:06.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.860+0000 7fb8f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:06.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.864+0000 7fba44b8b9c0 20 remove_watcher() i=0 2024-09-12T18:49:06.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.864+0000 7fba44b8b9c0 2 removed watcher, disabling cache 2024-09-12T18:49:06.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.868+0000 7fba44b8b9c0 20 remove_watcher() i=1 2024-09-12T18:49:06.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.872+0000 7fba44b8b9c0 20 remove_watcher() i=2 2024-09-12T18:49:06.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.872+0000 7fba44b8b9c0 20 remove_watcher() i=3 2024-09-12T18:49:06.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.876+0000 7fba44b8b9c0 20 remove_watcher() i=4 2024-09-12T18:49:06.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.876+0000 7fba44b8b9c0 20 remove_watcher() i=5 2024-09-12T18:49:06.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.880+0000 7fba44b8b9c0 20 remove_watcher() i=6 2024-09-12T18:49:06.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.880+0000 7fba44b8b9c0 20 remove_watcher() i=7 2024-09-12T18:49:06.902 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T18:49:06.931 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:06.931 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:06.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.968+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.972+0000 7f41dd35c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:06.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.972+0000 7f41dd35c9c0 20 realm 2024-09-12T18:49:06.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.972+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.972+0000 7f41dd35c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:06.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.972+0000 7f41dd35c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:06.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.972+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.972+0000 7f41dd35c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:06.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.972+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.976+0000 7f41dd35c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:06.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.976+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:06.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.976+0000 7f41dd35c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:06.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.976+0000 7f41dd35c9c0 20 searching for the correct realm 2024-09-12T18:49:06.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.976+0000 7f41d3fff640 0 -- 172.21.15.111:0/77052393 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f41cc0fe7a0 msgr2=0x7f41cc104f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:06.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.984+0000 7f41d3fff640 0 -- 172.21.15.111:0/77052393 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f40a4080ab0 msgr2=0x7f40a4082ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:49:07.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:07.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:07.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:07.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:07.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:07.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:07.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:07.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:07.001 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:07.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 zone default found 2024-09-12T18:49:07.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 4 Realm: () 2024-09-12T18:49:07.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:07.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:07.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:07.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 zonegroup default 2024-09-12T18:49:07.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.002 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:07.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:07.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:07.003 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 started sync module instance, tier type = 2024-09-12T18:49:07.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:06.996+0000 7f41dd35c9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:07.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.012+0000 7f41dd35c9c0 20 add_watcher() i=0 2024-09-12T18:49:07.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.012+0000 7f41dd35c9c0 20 add_watcher() i=1 2024-09-12T18:49:07.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.012+0000 7f41dd35c9c0 20 add_watcher() i=2 2024-09-12T18:49:07.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.012+0000 7f41dd35c9c0 20 add_watcher() i=3 2024-09-12T18:49:07.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.012+0000 7f41dd35c9c0 20 add_watcher() i=4 2024-09-12T18:49:07.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.012+0000 7f41dd35c9c0 20 add_watcher() i=5 2024-09-12T18:49:07.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.012+0000 7f41dd35c9c0 20 add_watcher() i=6 2024-09-12T18:49:07.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.016+0000 7f41dd35c9c0 20 add_watcher() i=7 2024-09-12T18:49:07.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.016+0000 7f41dd35c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:07.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.016+0000 7f40917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:07.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.016+0000 7f41dd35c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:07.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.016+0000 7f41dd35c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:07.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.016+0000 7f41dd35c9c0 5 note: GC not initialized 2024-09-12T18:49:07.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.016+0000 7f400bfff640 20 reqs_thread_entry: start 2024-09-12T18:49:07.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.016+0000 7f41dd35c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:07.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.016+0000 7f41dd35c9c0 20 Filter name: none 2024-09-12T18:49:07.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.016+0000 7f4009ffb640 20 reqs_thread_entry: start 2024-09-12T18:49:07.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.016+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.020+0000 7f41dd35c9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:07.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.020+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.020+0000 7f41dd35c9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:07.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.020+0000 7f41dd35c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:07.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.020+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.020+0000 7f41dd35c9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:07.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.020+0000 7f41dd35c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.020+0000 7f41dd35c9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:07.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.020+0000 7f41dd35c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:07.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.024+0000 7f40917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:07.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.032+0000 7f41dd35c9c0 20 remove_watcher() i=0 2024-09-12T18:49:07.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.032+0000 7f41dd35c9c0 2 removed watcher, disabling cache 2024-09-12T18:49:07.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.032+0000 7f41dd35c9c0 20 remove_watcher() i=1 2024-09-12T18:49:07.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.036+0000 7f41dd35c9c0 20 remove_watcher() i=2 2024-09-12T18:49:07.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.036+0000 7f41dd35c9c0 20 remove_watcher() i=3 2024-09-12T18:49:07.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.040+0000 7f41dd35c9c0 20 remove_watcher() i=4 2024-09-12T18:49:07.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.040+0000 7f41dd35c9c0 20 remove_watcher() i=5 2024-09-12T18:49:07.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.040+0000 7f41dd35c9c0 20 remove_watcher() i=6 2024-09-12T18:49:07.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.044+0000 7f41dd35c9c0 20 remove_watcher() i=7 2024-09-12T18:49:07.061 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:07.061 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:49:07.061 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-logrecord-writes id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:49:07.061 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:07.062 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.062 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.065 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.065 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.113 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.114 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.167 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T18:49:07.167 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:07.168 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.168 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.189 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.189 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.236 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.236 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.255 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.255 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.275 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.275 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.293 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.293 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.312 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.312 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.331 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.332 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.351 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.351 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.369 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.369 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.387 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.387 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.408 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.408 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.427 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.427 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.448 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.448 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.466 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.466 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.485 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.485 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.503 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.504 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.524 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.524 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.545 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.545 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.563 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.564 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.582 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.583 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.602 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:07.602 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:07.619 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T18:49:07.651 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:07.651 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:07.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.692+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.692+0000 7f7e5b7239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:07.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.692+0000 7f7e5b7239c0 20 realm 2024-09-12T18:49:07.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.692+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.692+0000 7f7e5b7239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:07.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.692+0000 7f7e5b7239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:07.698 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.692+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.692+0000 7f7e5b7239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:07.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.692+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.700 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.696+0000 7f7e5b7239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:07.700 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.696+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:07.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.696+0000 7f7e5b7239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:07.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.696+0000 7f7e5b7239c0 20 searching for the correct realm 2024-09-12T18:49:07.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.700+0000 7f7e59a2a640 0 -- 172.21.15.111:0/3964723773 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f7e5001f060 msgr2=0x7f7e500203d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:07.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:07.916+0000 7f7e58a28640 0 -- 172.21.15.111:0/3964723773 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f7e540ee450 msgr2=0x7f7e540ee8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:08.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.132+0000 7f7e5b7239c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:08.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.132+0000 7f7e5b7239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:08.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.132+0000 7f7e5b7239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:08.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.132+0000 7f7e5b7239c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:08.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.132+0000 7f7e5b7239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:08.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.132+0000 7f7e5b7239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:08.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.132+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.132+0000 7f7e5b7239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.132+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.132+0000 7f7e5b7239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:08.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.132+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:08.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 20 zone default found 2024-09-12T18:49:08.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 4 Realm: () 2024-09-12T18:49:08.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:08.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:08.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:08.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 20 zonegroup default 2024-09-12T18:49:08.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 20 started sync module instance, tier type = 2024-09-12T18:49:08.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.136+0000 7f7e5b7239c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:08.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.160+0000 7f7e5b7239c0 20 add_watcher() i=0 2024-09-12T18:49:08.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.160+0000 7f7e5b7239c0 20 add_watcher() i=1 2024-09-12T18:49:08.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.160+0000 7f7e5b7239c0 20 add_watcher() i=2 2024-09-12T18:49:08.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.160+0000 7f7e5b7239c0 20 add_watcher() i=3 2024-09-12T18:49:08.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.160+0000 7f7e5b7239c0 20 add_watcher() i=4 2024-09-12T18:49:08.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.160+0000 7f7e5b7239c0 20 add_watcher() i=5 2024-09-12T18:49:08.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.160+0000 7f7e5b7239c0 20 add_watcher() i=6 2024-09-12T18:49:08.170 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.164+0000 7f7e5b7239c0 20 add_watcher() i=7 2024-09-12T18:49:08.170 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.164+0000 7f7e5b7239c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:08.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.168+0000 7f7d0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:08.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.168+0000 7f7e5b7239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:08.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.168+0000 7f7e5b7239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:08.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.168+0000 7f7e5b7239c0 5 note: GC not initialized 2024-09-12T18:49:08.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.168+0000 7f7d0e7e4640 20 reqs_thread_entry: start 2024-09-12T18:49:08.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.168+0000 7f7e5b7239c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:08.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.168+0000 7f7e5b7239c0 20 Filter name: none 2024-09-12T18:49:08.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.172+0000 7f7c7ffff640 20 reqs_thread_entry: start 2024-09-12T18:49:08.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.172+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.172+0000 7f7e5b7239c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:08.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.172+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.172+0000 7f7e5b7239c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:08.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.172+0000 7f7e5b7239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:08.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.172+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.172+0000 7f7e5b7239c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:08.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.172+0000 7f7e5b7239c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.172+0000 7f7e5b7239c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:08.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.172+0000 7f7e5b7239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:08.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.176+0000 7f7d0f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:08.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.180+0000 7f7e5b7239c0 20 remove_watcher() i=0 2024-09-12T18:49:08.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.180+0000 7f7e5b7239c0 2 removed watcher, disabling cache 2024-09-12T18:49:08.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.184+0000 7f7e5b7239c0 20 remove_watcher() i=1 2024-09-12T18:49:08.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.188+0000 7f7e5b7239c0 20 remove_watcher() i=2 2024-09-12T18:49:08.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.188+0000 7f7e5b7239c0 20 remove_watcher() i=3 2024-09-12T18:49:08.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.192+0000 7f7e5b7239c0 20 remove_watcher() i=4 2024-09-12T18:49:08.198 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.192+0000 7f7e5b7239c0 20 remove_watcher() i=5 2024-09-12T18:49:08.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.192+0000 7f7e5b7239c0 20 remove_watcher() i=6 2024-09-12T18:49:08.201 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.196+0000 7f7e5b7239c0 20 remove_watcher() i=7 2024-09-12T18:49:08.214 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.214 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:49:08.214 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-logrecord-writes id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:49:08.214 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.215 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T18:49:08.247 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:08.247 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:08.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.284+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 realm 2024-09-12T18:49:08.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.288+0000 7faae7b6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:08.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:08.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:08.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 searching for the correct realm 2024-09-12T18:49:08.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.292+0000 7faae4e72640 0 -- 172.21.15.111:0/3123270491 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7faad80c4040 msgr2=0x7faad80b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:49:08.512 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.508+0000 7faae5673640 0 -- 172.21.15.111:0/3123270491 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7faae0061c20 msgr2=0x7faae007c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:08.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:08.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:08.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:08.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:08.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:08.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:08.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:08.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:08.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 zone default found 2024-09-12T18:49:08.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 4 Realm: () 2024-09-12T18:49:08.531 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:08.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:08.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:08.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 zonegroup default 2024-09-12T18:49:08.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 started sync module instance, tier type = 2024-09-12T18:49:08.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:08.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=0 2024-09-12T18:49:08.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=1 2024-09-12T18:49:08.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=2 2024-09-12T18:49:08.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=3 2024-09-12T18:49:08.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=4 2024-09-12T18:49:08.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=5 2024-09-12T18:49:08.558 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=6 2024-09-12T18:49:08.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.556+0000 7faae7b6d9c0 20 add_watcher() i=7 2024-09-12T18:49:08.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.556+0000 7faae7b6d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:08.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7fa99b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:08.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:08.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:08.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 note: GC not initialized 2024-09-12T18:49:08.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7fa99a7e4640 20 reqs_thread_entry: start 2024-09-12T18:49:08.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:08.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 Filter name: none 2024-09-12T18:49:08.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7fa90bfff640 20 reqs_thread_entry: start 2024-09-12T18:49:08.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7faae7b6d9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:49:08.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:08.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7faae7b6d9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:49:08.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7faae7b6d9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:49:08.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7faae7b6d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 : miss 2024-09-12T18:49:08.568 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.564+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:08.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:08.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:08.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:08.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:08.569 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 2024-09-12T18:49:08.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.572+0000 7faae7b6d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:08.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.572+0000 7faae7b6d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:08.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.572+0000 7faae7b6d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:08.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.572+0000 7faae7b6d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36, ofs0, ns] 2024-09-12T18:49:08.579 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.572+0000 7fa9c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431660 cookie 93966366331952 notifier 7803 bl.length()=923 2024-09-12T18:49:08.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.572+0000 7fa9c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:08.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.572+0000 7fa9c8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:08.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.572+0000 7fa9c8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:08.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.572+0000 7faae7b6d9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): orig_sources= new_sources= 2024-09-12T18:49:08.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.572+0000 7faae7b6d9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): potential sources added=[] removed=[] 2024-09-12T18:49:08.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.572+0000 7faae7b6d9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): orig_dests= new_dests= 2024-09-12T18:49:08.580 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.572+0000 7faae7b6d9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): potential dests added=[] removed=[] 2024-09-12T18:49:08.584 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faae7b6d9c0 time 2024-09-12T18:49:08.585564+0000 2024-09-12T18:49:08.584 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:49:08.586 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:08.586 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7faaeb4472eb] 2024-09-12T18:49:08.586 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faaeb44749f] 2024-09-12T18:49:08.586 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55763d769cc1] 2024-09-12T18:49:08.586 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422aac) [0x55763e1c7aac] 2024-09-12T18:49:08.586 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55763d77eced] 2024-09-12T18:49:08.586 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:49:08.586 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faaea2add90] 2024-09-12T18:49:08.586 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:49:08.587 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:49:08.587 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.580+0000 7faae7b6d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faae7b6d9c0 time 2024-09-12T18:49:08.585564+0000 2024-09-12T18:49:08.587 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:49:08.587 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.587 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:08.587 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7faaeb4472eb] 2024-09-12T18:49:08.587 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faaeb44749f] 2024-09-12T18:49:08.588 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55763d769cc1] 2024-09-12T18:49:08.588 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422aac) [0x55763e1c7aac] 2024-09-12T18:49:08.588 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55763d77eced] 2024-09-12T18:49:08.588 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:49:08.588 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faaea2add90] 2024-09-12T18:49:08.588 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:49:08.588 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:49:08.588 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.588 INFO:tasks.workunit.client.0.smithi111.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:49:08.588 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7faae7b6d9c0 thread_name:radosgw-admin 2024-09-12T18:49:08.613 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:08.613 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7faaea2c6520] 2024-09-12T18:49:08.613 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:49:08.613 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:49:08.613 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:49:08.613 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7faaeb447345] 2024-09-12T18:49:08.614 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faaeb44749f] 2024-09-12T18:49:08.614 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55763d769cc1] 2024-09-12T18:49:08.614 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422aac) [0x55763e1c7aac] 2024-09-12T18:49:08.614 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55763d77eced] 2024-09-12T18:49:08.614 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:49:08.614 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faaea2add90] 2024-09-12T18:49:08.614 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:49:08.614 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:49:08.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.580+0000 7faae7b6d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:49:08.614 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7faae7b6d9c0 thread_name:radosgw-admin 2024-09-12T18:49:08.614 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.615 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:08.615 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7faaea2c6520] 2024-09-12T18:49:08.615 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:49:08.615 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:49:08.615 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:49:08.615 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7faaeb447345] 2024-09-12T18:49:08.615 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faaeb44749f] 2024-09-12T18:49:08.615 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55763d769cc1] 2024-09-12T18:49:08.615 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422aac) [0x55763e1c7aac] 2024-09-12T18:49:08.615 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55763d77eced] 2024-09-12T18:49:08.615 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:49:08.616 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faaea2add90] 2024-09-12T18:49:08.616 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:49:08.616 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:49:08.616 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:49:08.616 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.616 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:49:08.616 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.616 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.617 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:49:08.264+0000 7faae4e72640 10 monclient(hunting): handle_auth_done global_id 7280 payload 274 2024-09-12T18:49:08.617 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:49:08.264+0000 7faae4e72640 10 monclient: _finish_hunting 0 2024-09-12T18:49:08.617 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:49:08.264+0000 7faae4e72640 1 monclient: found mon.noname-c 2024-09-12T18:49:08.617 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:49:08.264+0000 7faae4e72640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:49:08.617 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.617 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:49:08.617 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: dump: 2024-09-12T18:49:08.618 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.618 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.618 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.618 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.618 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.618 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.618 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.618 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.619 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.619 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.619 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: _finish_auth 0 2024-09-12T18:49:08.619 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: _check_auth_tickets 2024-09-12T18:49:08.619 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:08.619 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.619 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:49:08.620 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: dump: 2024-09-12T18:49:08.620 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.620 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.620 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.620 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.620 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.620 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.620 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.620 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.620 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.621 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.621 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 monclient: authenticate success, global_id 7280 2024-09-12T18:49:08.621 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:49:08.621 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 4 set_mon_vals no callback set 2024-09-12T18:49:08.621 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient: shutdown 2024-09-12T18:49:08.621 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) unregister_commands rotate-key 2024-09-12T18:49:08.621 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient: build_initial_monmap 2024-09-12T18:49:08.621 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:49:08.621 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient: monmap: 2024-09-12T18:49:08.621 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:49:08.621 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:49:08.622 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:49:08.622 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:49:08.622 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:49:08.622 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.622 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:49:08.622 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:49:08.622 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:49:08.622 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.623 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding auth protocol: cephx 2024-09-12T18:49:08.623 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding auth protocol: cephx 2024-09-12T18:49:08.623 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding auth protocol: cephx 2024-09-12T18:49:08.623 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: secure 2024-09-12T18:49:08.623 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: crc 2024-09-12T18:49:08.623 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: secure 2024-09-12T18:49:08.623 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: crc 2024-09-12T18:49:08.623 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: secure 2024-09-12T18:49:08.623 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: crc 2024-09-12T18:49:08.623 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: crc 2024-09-12T18:49:08.623 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: secure 2024-09-12T18:49:08.624 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: crc 2024-09-12T18:49:08.624 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: secure 2024-09-12T18:49:08.624 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: crc 2024-09-12T18:49:08.624 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: secure 2024-09-12T18:49:08.624 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.624 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 1 librados: starting msgr at 2024-09-12T18:49:08.624 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 1 librados: starting objecter 2024-09-12T18:49:08.625 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command objecter_requests hook 0x55763fbe5030 2024-09-12T18:49:08.625 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 1 librados: setting wanted keys 2024-09-12T18:49:08.625 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 1 librados: calling monclient init 2024-09-12T18:49:08.625 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient: init 2024-09-12T18:49:08.625 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding auth protocol: cephx 2024-09-12T18:49:08.625 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding auth protocol: cephx 2024-09-12T18:49:08.625 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding auth protocol: cephx 2024-09-12T18:49:08.625 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: secure 2024-09-12T18:49:08.625 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: crc 2024-09-12T18:49:08.625 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: secure 2024-09-12T18:49:08.626 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: crc 2024-09-12T18:49:08.626 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: secure 2024-09-12T18:49:08.626 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: crc 2024-09-12T18:49:08.626 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: crc 2024-09-12T18:49:08.626 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: secure 2024-09-12T18:49:08.626 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: crc 2024-09-12T18:49:08.626 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: secure 2024-09-12T18:49:08.626 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: crc 2024-09-12T18:49:08.627 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: secure 2024-09-12T18:49:08.627 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.627 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.627 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command rotate-key hook 0x55763fd2d8d8 2024-09-12T18:49:08.627 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:08.627 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:49:08.627 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-a con 0x55763fd30aa0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:08.627 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-b con 0x55763fd5bdb0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:08.627 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-c con 0x7faad0002350 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:08.628 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.628 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.628 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.628 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:08.628 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): authenticate will time out at 2335.411062s 2024-09-12T18:49:08.628 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): get_auth_request con 0x7faad0002350 auth_method 0 2024-09-12T18:49:08.628 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.628 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.629 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.629 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): get_auth_request con 0x55763fd30aa0 auth_method 0 2024-09-12T18:49:08.629 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.629 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.629 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.629 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.629 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.629 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.630 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.630 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.630 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.630 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): handle_auth_done global_id 7283 payload 824 2024-09-12T18:49:08.630 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient: _finish_hunting 0 2024-09-12T18:49:08.630 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:49:08.264+0000 7faae5e74640 1 monclient: found mon.noname-c 2024-09-12T18:49:08.630 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:49:08.631 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.631 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:49:08.631 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: dump: 2024-09-12T18:49:08.631 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.631 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.631 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.631 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.631 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.631 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.632 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.632 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.632 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.632 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.632 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: _finish_auth 0 2024-09-12T18:49:08.632 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: _check_auth_tickets 2024-09-12T18:49:08.632 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:08.632 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.632 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:49:08.632 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: dump: 2024-09-12T18:49:08.632 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.632 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.633 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.633 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.633 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.633 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.633 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.633 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.633 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.633 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.633 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:49:08.264+0000 7fa9d3606640 4 set_mon_vals no callback set 2024-09-12T18:49:08.633 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:49:08.268+0000 7faae7b6d9c0 5 monclient: authenticate success, global_id 7283 2024-09-12T18:49:08.633 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:49:08.268+0000 7faae7b6d9c0 10 monclient: _renew_subs 2024-09-12T18:49:08.633 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:49:08.268+0000 7faae7b6d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:49:08.634 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:49:08.268+0000 7faae7b6d9c0 10 monclient: _renew_subs 2024-09-12T18:49:08.634 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:49:08.268+0000 7faae7b6d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:49:08.634 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:49:08.268+0000 7faae7b6d9c0 1 librados: init done 2024-09-12T18:49:08.634 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:49:08.268+0000 7fa9d1e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:49:08.634 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:49:08.268+0000 7fa9d1e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:08.634 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:49:08.268+0000 7fa9d1e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:08.634 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:49:08.268+0000 7faae5673640 10 monclient: get_auth_request con 0x7fa9cc070ae0 auth_method 0 2024-09-12T18:49:08.634 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:49:08.268+0000 7faae4e72640 10 monclient: get_auth_request con 0x55763fd55ac0 auth_method 0 2024-09-12T18:49:08.634 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:49:08.268+0000 7faae5673640 10 monclient: get_auth_request con 0x55763fd78e20 auth_method 0 2024-09-12T18:49:08.634 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:49:08.272+0000 7faae4e72640 10 monclient: get_auth_request con 0x55763fd7d180 auth_method 0 2024-09-12T18:49:08.634 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:49:08.272+0000 7faae5e74640 10 monclient: get_auth_request con 0x55763fd7c710 auth_method 0 2024-09-12T18:49:08.635 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 10 monclient: build_initial_monmap 2024-09-12T18:49:08.635 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:49:08.635 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 10 monclient: monmap: 2024-09-12T18:49:08.635 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:49:08.635 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:49:08.635 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:49:08.635 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:49:08.635 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:49:08.635 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.635 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:49:08.635 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:49:08.636 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:49:08.636 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.636 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding auth protocol: cephx 2024-09-12T18:49:08.636 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding auth protocol: cephx 2024-09-12T18:49:08.636 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding auth protocol: cephx 2024-09-12T18:49:08.636 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: secure 2024-09-12T18:49:08.636 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: crc 2024-09-12T18:49:08.636 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: secure 2024-09-12T18:49:08.636 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: crc 2024-09-12T18:49:08.636 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: secure 2024-09-12T18:49:08.637 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: crc 2024-09-12T18:49:08.637 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: crc 2024-09-12T18:49:08.637 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: secure 2024-09-12T18:49:08.637 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: crc 2024-09-12T18:49:08.637 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: secure 2024-09-12T18:49:08.637 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: crc 2024-09-12T18:49:08.637 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: secure 2024-09-12T18:49:08.637 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.638 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command objecter_requests cmddesc objecter_requests hook 0x55763fd88b20 EEXIST 2024-09-12T18:49:08.638 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient: init 2024-09-12T18:49:08.638 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding auth protocol: cephx 2024-09-12T18:49:08.638 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding auth protocol: cephx 2024-09-12T18:49:08.638 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding auth protocol: cephx 2024-09-12T18:49:08.638 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: secure 2024-09-12T18:49:08.638 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: crc 2024-09-12T18:49:08.638 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: secure 2024-09-12T18:49:08.638 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: crc 2024-09-12T18:49:08.638 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: secure 2024-09-12T18:49:08.638 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: crc 2024-09-12T18:49:08.638 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: crc 2024-09-12T18:49:08.639 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: secure 2024-09-12T18:49:08.639 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: crc 2024-09-12T18:49:08.639 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: secure 2024-09-12T18:49:08.639 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: crc 2024-09-12T18:49:08.639 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: secure 2024-09-12T18:49:08.639 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.639 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.639 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command rotate-key cmddesc rotate-key hook 0x55763fd84130 EEXIST 2024-09-12T18:49:08.640 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:08.640 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:49:08.640 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-a con 0x55763fdaccd0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:08.640 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-b con 0x55763fdac600 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:08.640 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-c con 0x55763fdaafe0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:08.640 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.640 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.640 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.640 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:08.641 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): authenticate will time out at 2335.421126s 2024-09-12T18:49:08.641 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): get_auth_request con 0x55763fdaccd0 auth_method 0 2024-09-12T18:49:08.641 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.641 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.641 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.641 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:49:08.276+0000 7faae5673640 10 monclient(hunting): get_auth_request con 0x55763fdaafe0 auth_method 0 2024-09-12T18:49:08.641 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:49:08.276+0000 7faae5673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.641 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:49:08.276+0000 7faae5673640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.641 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:49:08.276+0000 7faae5673640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.641 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.642 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.642 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.642 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:49:08.276+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.642 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:49:08.276+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.642 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:49:08.276+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.642 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:49:08.276+0000 7faae5e74640 10 monclient(hunting): get_auth_request con 0x55763fdac600 auth_method 0 2024-09-12T18:49:08.642 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:49:08.276+0000 7faae5e74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.642 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:49:08.276+0000 7faae5e74640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.642 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:49:08.276+0000 7faae5e74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.643 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): handle_auth_done global_id 7797 payload 824 2024-09-12T18:49:08.643 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient: _finish_hunting 0 2024-09-12T18:49:08.643 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:49:08.276+0000 7faae4e72640 1 monclient: found mon.noname-a 2024-09-12T18:49:08.643 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.643 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.643 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:49:08.643 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: dump: 2024-09-12T18:49:08.643 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.643 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.643 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.644 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.644 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.644 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.644 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.644 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.644 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.644 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.644 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: _finish_auth 0 2024-09-12T18:49:08.644 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: _check_auth_tickets 2024-09-12T18:49:08.644 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:08.644 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.644 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:49:08.645 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: dump: 2024-09-12T18:49:08.645 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.645 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.645 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.645 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.645 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.645 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.645 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.645 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.645 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.645 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.646 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:49:08.276+0000 7faae6675640 4 set_mon_vals no callback set 2024-09-12T18:49:08.646 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 monclient: authenticate success, global_id 7797 2024-09-12T18:49:08.646 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient: _renew_subs 2024-09-12T18:49:08.646 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.646 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient: _renew_subs 2024-09-12T18:49:08.646 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.646 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:49:08.280+0000 7fa9caffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:49:08.646 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:49:08.280+0000 7fa9caffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:08.646 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:49:08.280+0000 7fa9caffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:08.647 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:49:08.280+0000 7faae5e74640 10 monclient: get_auth_request con 0x7fa9c0070a20 auth_method 0 2024-09-12T18:49:08.647 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: get_monmap_and_config 2024-09-12T18:49:08.647 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: build_initial_monmap 2024-09-12T18:49:08.647 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:49:08.647 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: monmap: 2024-09-12T18:49:08.647 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:49:08.647 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:49:08.647 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:49:08.648 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:49:08.648 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:49:08.648 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.648 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:49:08.648 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:49:08.648 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:49:08.648 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.648 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding auth protocol: cephx 2024-09-12T18:49:08.648 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding auth protocol: cephx 2024-09-12T18:49:08.648 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding auth protocol: cephx 2024-09-12T18:49:08.648 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: secure 2024-09-12T18:49:08.648 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: crc 2024-09-12T18:49:08.649 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: secure 2024-09-12T18:49:08.649 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: crc 2024-09-12T18:49:08.649 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: secure 2024-09-12T18:49:08.649 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: crc 2024-09-12T18:49:08.649 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: crc 2024-09-12T18:49:08.649 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: secure 2024-09-12T18:49:08.649 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: crc 2024-09-12T18:49:08.649 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: secure 2024-09-12T18:49:08.649 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: crc 2024-09-12T18:49:08.649 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: secure 2024-09-12T18:49:08.649 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.649 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: init 2024-09-12T18:49:08.650 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding auth protocol: cephx 2024-09-12T18:49:08.650 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding auth protocol: cephx 2024-09-12T18:49:08.650 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding auth protocol: cephx 2024-09-12T18:49:08.650 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: secure 2024-09-12T18:49:08.650 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: crc 2024-09-12T18:49:08.650 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: secure 2024-09-12T18:49:08.650 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: crc 2024-09-12T18:49:08.650 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: secure 2024-09-12T18:49:08.650 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: crc 2024-09-12T18:49:08.650 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: crc 2024-09-12T18:49:08.651 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: secure 2024-09-12T18:49:08.651 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: crc 2024-09-12T18:49:08.651 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: secure 2024-09-12T18:49:08.651 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: crc 2024-09-12T18:49:08.651 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: secure 2024-09-12T18:49:08.651 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.651 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.651 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc1f1458d8 EEXIST 2024-09-12T18:49:08.651 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:08.651 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:49:08.651 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-a con 0x55763fe02ce0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:08.652 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-b con 0x55763fbdbe50 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:08.652 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-c con 0x55763fdd2700 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:08.652 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.652 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.652 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.652 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:08.652 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): authenticate will time out at 2335.426006s 2024-09-12T18:49:08.652 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): get_auth_request con 0x55763fe02ce0 auth_method 0 2024-09-12T18:49:08.652 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.652 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.652 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.653 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:49:08.280+0000 7faae5673640 10 monclient(hunting): get_auth_request con 0x55763fdd2700 auth_method 0 2024-09-12T18:49:08.653 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:49:08.280+0000 7faae5673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.653 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:49:08.280+0000 7faae5673640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.653 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:49:08.280+0000 7faae5673640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.653 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.653 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.653 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.653 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:49:08.280+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.654 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:49:08.280+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.654 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:49:08.280+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.654 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): handle_auth_done global_id 7800 payload 274 2024-09-12T18:49:08.654 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient: _finish_hunting 0 2024-09-12T18:49:08.654 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:49:08.280+0000 7faae4e72640 1 monclient: found mon.noname-a 2024-09-12T18:49:08.654 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.654 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.654 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:49:08.654 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: dump: 2024-09-12T18:49:08.654 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.655 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.655 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.655 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.655 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.655 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.655 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.655 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.655 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.655 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.655 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: _finish_auth 0 2024-09-12T18:49:08.655 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:49:08.656 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:08.656 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.656 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:49:08.656 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: dump: 2024-09-12T18:49:08.656 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.656 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.656 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.657 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.657 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.657 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.657 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.657 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.657 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.657 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.657 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 monclient: authenticate success, global_id 7800 2024-09-12T18:49:08.657 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:49:08.657 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 4 set_mon_vals no callback set 2024-09-12T18:49:08.658 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: shutdown 2024-09-12T18:49:08.658 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: build_initial_monmap 2024-09-12T18:49:08.658 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:49:08.658 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: monmap: 2024-09-12T18:49:08.658 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:49:08.659 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:49:08.659 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:49:08.659 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:49:08.659 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:49:08.659 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.659 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:49:08.659 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:49:08.659 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:49:08.660 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.660 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding auth protocol: cephx 2024-09-12T18:49:08.660 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding auth protocol: cephx 2024-09-12T18:49:08.660 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding auth protocol: cephx 2024-09-12T18:49:08.660 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: secure 2024-09-12T18:49:08.661 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: crc 2024-09-12T18:49:08.661 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: secure 2024-09-12T18:49:08.661 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: crc 2024-09-12T18:49:08.661 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: secure 2024-09-12T18:49:08.661 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: crc 2024-09-12T18:49:08.661 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: crc 2024-09-12T18:49:08.661 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: secure 2024-09-12T18:49:08.661 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: crc 2024-09-12T18:49:08.662 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: secure 2024-09-12T18:49:08.662 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: crc 2024-09-12T18:49:08.662 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: secure 2024-09-12T18:49:08.662 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.662 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 1 librados: starting msgr at 2024-09-12T18:49:08.662 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 1 librados: starting objecter 2024-09-12T18:49:08.662 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command objecter_requests cmddesc objecter_requests hook 0x55763fdae5a0 EEXIST 2024-09-12T18:49:08.663 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 1 librados: setting wanted keys 2024-09-12T18:49:08.663 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 1 librados: calling monclient init 2024-09-12T18:49:08.663 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient: init 2024-09-12T18:49:08.663 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding auth protocol: cephx 2024-09-12T18:49:08.663 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding auth protocol: cephx 2024-09-12T18:49:08.663 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding auth protocol: cephx 2024-09-12T18:49:08.663 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: secure 2024-09-12T18:49:08.663 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: crc 2024-09-12T18:49:08.663 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: secure 2024-09-12T18:49:08.664 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: crc 2024-09-12T18:49:08.664 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: secure 2024-09-12T18:49:08.664 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: crc 2024-09-12T18:49:08.664 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: crc 2024-09-12T18:49:08.664 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: secure 2024-09-12T18:49:08.664 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: crc 2024-09-12T18:49:08.664 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: secure 2024-09-12T18:49:08.664 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: crc 2024-09-12T18:49:08.665 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: secure 2024-09-12T18:49:08.665 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.665 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.665 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command rotate-key cmddesc rotate-key hook 0x55763fdaec38 EEXIST 2024-09-12T18:49:08.665 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:08.665 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:49:08.665 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-c con 0x55763fbdbe50 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:08.665 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-a con 0x55763fdd2700 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:08.665 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-b con 0x55763fe02ce0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:08.665 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.665 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.665 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.666 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:08.666 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): authenticate will time out at 2335.428606s 2024-09-12T18:49:08.666 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): get_auth_request con 0x55763fdd2700 auth_method 0 2024-09-12T18:49:08.666 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.666 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.666 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.666 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient(hunting): get_auth_request con 0x55763fbdbe50 auth_method 0 2024-09-12T18:49:08.666 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.666 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.666 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.666 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.666 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.667 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.667 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.667 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.667 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.667 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): handle_auth_done global_id 7803 payload 824 2024-09-12T18:49:08.667 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient: _finish_hunting 0 2024-09-12T18:49:08.667 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:49:08.284+0000 7faae5e74640 1 monclient: found mon.noname-a 2024-09-12T18:49:08.667 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.667 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:49:08.284+0000 7faae5673640 10 monclient: get_auth_request con 0x55763fe02ce0 auth_method 0 2024-09-12T18:49:08.668 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.668 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:49:08.668 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: dump: 2024-09-12T18:49:08.668 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.668 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.668 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.668 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.668 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.668 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.669 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.669 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.669 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.669 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.669 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: _finish_auth 0 2024-09-12T18:49:08.669 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:49:08.669 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:08.669 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.669 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:49:08.669 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: dump: 2024-09-12T18:49:08.670 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.670 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.670 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.670 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.670 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.670 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.670 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.671 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.671 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.671 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.671 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 monclient: authenticate success, global_id 7803 2024-09-12T18:49:08.671 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient: _renew_subs 2024-09-12T18:49:08.671 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:49:08.284+0000 7fa9c8ff9640 4 set_mon_vals no callback set 2024-09-12T18:49:08.671 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.671 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient: _renew_subs 2024-09-12T18:49:08.671 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.671 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 1 librados: init done 2024-09-12T18:49:08.671 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command cr dump hook 0x55763fdf8708 2024-09-12T18:49:08.671 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.672 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:49:08.672 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:08.672 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:08.672 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient: get_auth_request con 0x7fa9b0070ae0 auth_method 0 2024-09-12T18:49:08.672 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:49:08.288+0000 7faae5673640 10 monclient: get_auth_request con 0x55763fe1c7d0 auth_method 0 2024-09-12T18:49:08.672 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.672 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 realm 2024-09-12T18:49:08.672 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.672 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.672 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:08.672 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.673 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.673 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.673 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:49:08.288+0000 7faae4e72640 10 monclient: get_auth_request con 0x55763fe20bd0 auth_method 0 2024-09-12T18:49:08.673 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:08.673 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.673 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:49:08.288+0000 7faae5e74640 10 monclient: get_auth_request con 0x55763fe242f0 auth_method 0 2024-09-12T18:49:08.673 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:08.673 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 searching for the correct realm 2024-09-12T18:49:08.673 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:49:08.292+0000 7faae5673640 10 monclient: get_auth_request con 0x7faae0061c20 auth_method 0 2024-09-12T18:49:08.673 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:49:08.292+0000 7faae4e72640 10 monclient: get_auth_request con 0x7faad80c4040 auth_method 0 2024-09-12T18:49:08.674 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:49:08.292+0000 7faae4e72640 0 -- 172.21.15.111:0/3123270491 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7faad80c4040 msgr2=0x7faad80b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:49:08.674 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:49:08.496+0000 7faae4e72640 10 monclient: get_auth_request con 0x7faad80c4040 auth_method 0 2024-09-12T18:49:08.674 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:49:08.496+0000 7faae5e74640 10 monclient: get_auth_request con 0x7faadc02a050 auth_method 0 2024-09-12T18:49:08.674 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:49:08.504+0000 7faae5673640 10 monclient: get_auth_request con 0x7faae0015030 auth_method 0 2024-09-12T18:49:08.674 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:49:08.508+0000 7faae5673640 0 -- 172.21.15.111:0/3123270491 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7faae0061c20 msgr2=0x7faae007c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:08.674 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:49:08.508+0000 7fa9b6ffd640 1 client.7803.objecter ms_handle_reset 0x7faae0061c20 session 0x7faae000f040 osd.7 2024-09-12T18:49:08.674 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:49:08.508+0000 7fa9b6ffd640 10 monclient: _renew_subs 2024-09-12T18:49:08.674 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:49:08.508+0000 7fa9b6ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.674 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:49:08.508+0000 7faae5673640 10 monclient: get_auth_request con 0x7fa9b0080a00 auth_method 0 2024-09-12T18:49:08.674 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:49:08.508+0000 7faae4e72640 10 monclient: get_auth_request con 0x7faad0003be0 auth_method 0 2024-09-12T18:49:08.674 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:08.674 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:08.675 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:08.675 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:08.675 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:08.675 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:08.675 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.675 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.675 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.675 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:08.675 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.675 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:08.676 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 zone default found 2024-09-12T18:49:08.676 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 4 Realm: () 2024-09-12T18:49:08.676 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:08.676 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:08.676 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:08.676 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 zonegroup default 2024-09-12T18:49:08.676 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.676 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.676 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.676 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.677 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.677 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.677 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 started sync module instance, tier type = 2024-09-12T18:49:08.677 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:08.677 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=0 2024-09-12T18:49:08.677 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=1 2024-09-12T18:49:08.677 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=2 2024-09-12T18:49:08.677 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=3 2024-09-12T18:49:08.677 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=4 2024-09-12T18:49:08.677 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=5 2024-09-12T18:49:08.677 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=6 2024-09-12T18:49:08.678 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:49:08.556+0000 7faae7b6d9c0 20 add_watcher() i=7 2024-09-12T18:49:08.678 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:49:08.556+0000 7faae7b6d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:08.678 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding auth protocol: cephx 2024-09-12T18:49:08.678 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding auth protocol: cephx 2024-09-12T18:49:08.678 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding auth protocol: cephx 2024-09-12T18:49:08.678 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: secure 2024-09-12T18:49:08.679 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: crc 2024-09-12T18:49:08.679 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: secure 2024-09-12T18:49:08.680 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: crc 2024-09-12T18:49:08.680 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: secure 2024-09-12T18:49:08.680 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: crc 2024-09-12T18:49:08.680 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: crc 2024-09-12T18:49:08.680 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: secure 2024-09-12T18:49:08.680 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: crc 2024-09-12T18:49:08.680 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: secure 2024-09-12T18:49:08.680 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: crc 2024-09-12T18:49:08.680 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: secure 2024-09-12T18:49:08.680 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:49:08.560+0000 7fa99b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:08.681 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.681 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:08.681 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:08.681 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command cache list hook 0x55763fdf2980 2024-09-12T18:49:08.681 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command cache inspect hook 0x55763fdf2980 2024-09-12T18:49:08.681 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command cache erase hook 0x55763fdf2980 2024-09-12T18:49:08.681 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command cache zap hook 0x55763fdf2980 2024-09-12T18:49:08.681 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 note: GC not initialized 2024-09-12T18:49:08.681 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:49:08.560+0000 7fa99a7e4640 20 reqs_thread_entry: start 2024-09-12T18:49:08.681 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command sync trace show hook 0x7faadc0014f0 2024-09-12T18:49:08.681 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command sync trace history hook 0x7faadc0014f0 2024-09-12T18:49:08.682 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command sync trace active hook 0x7faadc0014f0 2024-09-12T18:49:08.682 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command sync trace active_short hook 0x7faadc0014f0 2024-09-12T18:49:08.682 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:08.682 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 Filter name: none 2024-09-12T18:49:08.682 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:49:08.560+0000 7fa90bfff640 20 reqs_thread_entry: start 2024-09-12T18:49:08.682 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:49:08.682 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.682 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:08.682 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:49:08.682 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:49:08.683 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 : miss 2024-09-12T18:49:08.683 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.683 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:49:08.564+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:08.683 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:08.683 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:08.683 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:08.683 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:08.683 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 2024-09-12T18:49:08.683 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:08.683 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:08.683 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:08.683 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36, ofs0, ns] 2024-09-12T18:49:08.684 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:49:08.572+0000 7fa9c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431660 cookie 93966366331952 notifier 7803 bl.length()=923 2024-09-12T18:49:08.684 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:49:08.572+0000 7fa9c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:08.684 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:49:08.572+0000 7fa9c8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:08.684 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:49:08.572+0000 7fa9c8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:08.684 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): orig_sources= new_sources= 2024-09-12T18:49:08.684 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): potential sources added=[] removed=[] 2024-09-12T18:49:08.684 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): orig_dests= new_dests= 2024-09-12T18:49:08.684 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): potential dests added=[] removed=[] 2024-09-12T18:49:08.684 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:49:08.580+0000 7faae7b6d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faae7b6d9c0 time 2024-09-12T18:49:08.585564+0000 2024-09-12T18:49:08.684 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:49:08.684 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.684 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:08.685 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7faaeb4472eb] 2024-09-12T18:49:08.685 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faaeb44749f] 2024-09-12T18:49:08.685 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55763d769cc1] 2024-09-12T18:49:08.685 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422aac) [0x55763e1c7aac] 2024-09-12T18:49:08.685 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55763d77eced] 2024-09-12T18:49:08.685 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:49:08.685 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faaea2add90] 2024-09-12T18:49:08.685 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:49:08.685 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:49:08.685 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.686 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:49:08.580+0000 7faae7b6d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:49:08.686 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7faae7b6d9c0 thread_name:radosgw-admin 2024-09-12T18:49:08.686 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.686 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:08.686 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7faaea2c6520] 2024-09-12T18:49:08.686 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:49:08.686 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:49:08.686 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:49:08.686 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7faaeb447345] 2024-09-12T18:49:08.686 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faaeb44749f] 2024-09-12T18:49:08.686 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55763d769cc1] 2024-09-12T18:49:08.686 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422aac) [0x55763e1c7aac] 2024-09-12T18:49:08.686 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55763d77eced] 2024-09-12T18:49:08.686 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:49:08.687 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faaea2add90] 2024-09-12T18:49:08.687 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:49:08.687 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:49:08.687 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:49:08.687 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.687 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:49:08.687 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:49:08.687 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:49:08.687 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:49:08.687 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:49:08.687 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:49:08.688 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:49:08.688 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:49:08.688 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:49:08.688 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:49:08.688 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:49:08.688 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:49:08.688 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:49:08.688 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:49:08.688 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:49:08.688 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:49:08.689 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:49:08.689 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:49:08.689 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:49:08.689 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:49:08.689 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:49:08.689 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:49:08.689 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:49:08.689 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:49:08.689 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:49:08.689 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:49:08.689 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:49:08.690 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:49:08.690 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:49:08.690 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:49:08.690 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:49:08.690 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:49:08.690 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:49:08.690 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:49:08.690 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:49:08.690 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:49:08.690 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:49:08.690 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:49:08.690 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:49:08.691 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:49:08.691 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:49:08.691 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:49:08.691 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:49:08.691 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:49:08.691 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:49:08.691 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:49:08.691 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:49:08.691 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:49:08.691 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:49:08.691 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:49:08.692 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:49:08.692 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:49:08.692 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:49:08.692 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:49:08.692 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:49:08.692 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:49:08.692 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:49:08.692 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:49:08.692 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:49:08.693 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:49:08.693 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:49:08.693 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:49:08.693 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:49:08.693 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:49:08.693 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:49:08.693 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:49:08.693 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:49:08.693 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:49:08.693 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:49:08.693 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:49:08.694 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:49:08.695 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:49:08.695 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:49:08.695 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:49:08.695 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:49:08.695 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:49:08.695 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:49:08.695 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:49:08.695 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:49:08.695 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:49:08.695 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa90bfff640 / http_manager 2024-09-12T18:49:08.695 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa99a7e4640 / http_manager 2024-09-12T18:49:08.695 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa99b7e6640 / rgw_dt_lg_renew 2024-09-12T18:49:08.695 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa9b6ffd640 / ms_dispatch 2024-09-12T18:49:08.696 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa9c8ff9640 / io_context_pool 2024-09-12T18:49:08.696 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa9caffd640 / ms_dispatch 2024-09-12T18:49:08.696 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa9d1e03640 / ms_dispatch 2024-09-12T18:49:08.696 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa9d3606640 / io_context_pool 2024-09-12T18:49:08.696 INFO:tasks.workunit.client.0.smithi111.stderr: 7faae4e72640 / msgr-worker-2 2024-09-12T18:49:08.696 INFO:tasks.workunit.client.0.smithi111.stderr: 7faae5673640 / msgr-worker-1 2024-09-12T18:49:08.696 INFO:tasks.workunit.client.0.smithi111.stderr: 7faae5e74640 / msgr-worker-0 2024-09-12T18:49:08.696 INFO:tasks.workunit.client.0.smithi111.stderr: 7faae6675640 / io_context_pool 2024-09-12T18:49:08.697 INFO:tasks.workunit.client.0.smithi111.stderr: 7faae7b6d9c0 / radosgw-admin 2024-09-12T18:49:08.697 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:49:08.697 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:49:08.697 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/log/ceph/ceph-client.admin.127226.log 2024-09-12T18:49:08.697 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:49:08.697 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:49:08.697 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.697 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.697 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:49:08.264+0000 7faae4e72640 10 monclient(hunting): handle_auth_done global_id 7280 payload 274 2024-09-12T18:49:08.697 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:49:08.264+0000 7faae4e72640 10 monclient: _finish_hunting 0 2024-09-12T18:49:08.697 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:49:08.264+0000 7faae4e72640 1 monclient: found mon.noname-c 2024-09-12T18:49:08.697 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:49:08.264+0000 7faae4e72640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:49:08.697 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.698 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:49:08.698 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: dump: 2024-09-12T18:49:08.698 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.698 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.698 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.698 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.698 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.698 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.698 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.698 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.698 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.698 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.698 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: _finish_auth 0 2024-09-12T18:49:08.699 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: _check_auth_tickets 2024-09-12T18:49:08.699 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:08.699 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.699 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:49:08.699 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:49:08.264+0000 7fa9d3606640 10 monclient: dump: 2024-09-12T18:49:08.699 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.699 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.699 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.699 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.699 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.699 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.699 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.699 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.699 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.700 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.700 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 monclient: authenticate success, global_id 7280 2024-09-12T18:49:08.700 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:49:08.700 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 4 set_mon_vals no callback set 2024-09-12T18:49:08.700 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient: shutdown 2024-09-12T18:49:08.700 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) unregister_commands rotate-key 2024-09-12T18:49:08.700 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient: build_initial_monmap 2024-09-12T18:49:08.700 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:49:08.700 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient: monmap: 2024-09-12T18:49:08.700 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:49:08.700 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:49:08.700 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:49:08.700 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:49:08.701 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:49:08.701 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.701 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:49:08.701 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:49:08.701 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:49:08.701 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.701 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding auth protocol: cephx 2024-09-12T18:49:08.701 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding auth protocol: cephx 2024-09-12T18:49:08.701 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding auth protocol: cephx 2024-09-12T18:49:08.701 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: secure 2024-09-12T18:49:08.701 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: crc 2024-09-12T18:49:08.701 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: secure 2024-09-12T18:49:08.701 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: crc 2024-09-12T18:49:08.701 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: secure 2024-09-12T18:49:08.702 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: crc 2024-09-12T18:49:08.702 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: crc 2024-09-12T18:49:08.702 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: secure 2024-09-12T18:49:08.702 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: crc 2024-09-12T18:49:08.702 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: secure 2024-09-12T18:49:08.702 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: crc 2024-09-12T18:49:08.702 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2f580) adding con mode: secure 2024-09-12T18:49:08.702 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.702 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 1 librados: starting msgr at 2024-09-12T18:49:08.702 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 1 librados: starting objecter 2024-09-12T18:49:08.702 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command objecter_requests hook 0x55763fbe5030 2024-09-12T18:49:08.702 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 1 librados: setting wanted keys 2024-09-12T18:49:08.702 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 1 librados: calling monclient init 2024-09-12T18:49:08.702 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient: init 2024-09-12T18:49:08.703 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding auth protocol: cephx 2024-09-12T18:49:08.703 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding auth protocol: cephx 2024-09-12T18:49:08.703 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding auth protocol: cephx 2024-09-12T18:49:08.703 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: secure 2024-09-12T18:49:08.703 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: crc 2024-09-12T18:49:08.703 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: secure 2024-09-12T18:49:08.703 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: crc 2024-09-12T18:49:08.703 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: secure 2024-09-12T18:49:08.703 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: crc 2024-09-12T18:49:08.703 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: crc 2024-09-12T18:49:08.703 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: secure 2024-09-12T18:49:08.703 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: crc 2024-09-12T18:49:08.703 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: secure 2024-09-12T18:49:08.703 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: crc 2024-09-12T18:49:08.704 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd2d790) adding con mode: secure 2024-09-12T18:49:08.704 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.704 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.704 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command rotate-key hook 0x55763fd2d8d8 2024-09-12T18:49:08.704 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:08.704 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:49:08.704 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-a con 0x55763fd30aa0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:08.704 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-b con 0x55763fd5bdb0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:08.704 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-c con 0x7faad0002350 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:08.704 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.704 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.704 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.704 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:08.705 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:49:08.264+0000 7faae7b6d9c0 10 monclient(hunting): authenticate will time out at 2335.411062s 2024-09-12T18:49:08.705 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): get_auth_request con 0x7faad0002350 auth_method 0 2024-09-12T18:49:08.705 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.705 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.705 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.705 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): get_auth_request con 0x55763fd30aa0 auth_method 0 2024-09-12T18:49:08.705 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.705 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.705 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.705 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.705 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.705 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.705 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.705 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.706 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:49:08.264+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.706 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient(hunting): handle_auth_done global_id 7283 payload 824 2024-09-12T18:49:08.706 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient: _finish_hunting 0 2024-09-12T18:49:08.706 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:49:08.264+0000 7faae5e74640 1 monclient: found mon.noname-c 2024-09-12T18:49:08.706 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:49:08.264+0000 7faae5e74640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:49:08.706 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.706 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:49:08.706 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: dump: 2024-09-12T18:49:08.706 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.706 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.706 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.706 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.706 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.706 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.707 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.707 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.707 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.707 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.707 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: _finish_auth 0 2024-09-12T18:49:08.707 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: _check_auth_tickets 2024-09-12T18:49:08.707 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:08.707 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.707 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:49:08.707 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:49:08.264+0000 7fa9d1e03640 10 monclient: dump: 2024-09-12T18:49:08.707 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.707 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.707 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.707 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.708 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.708 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.708 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.708 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.708 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.708 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.708 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:49:08.264+0000 7fa9d3606640 4 set_mon_vals no callback set 2024-09-12T18:49:08.708 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:49:08.268+0000 7faae7b6d9c0 5 monclient: authenticate success, global_id 7283 2024-09-12T18:49:08.709 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:49:08.268+0000 7faae7b6d9c0 10 monclient: _renew_subs 2024-09-12T18:49:08.709 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:49:08.268+0000 7faae7b6d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:49:08.709 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:49:08.268+0000 7faae7b6d9c0 10 monclient: _renew_subs 2024-09-12T18:49:08.709 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:49:08.268+0000 7faae7b6d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:49:08.709 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:49:08.268+0000 7faae7b6d9c0 1 librados: init done 2024-09-12T18:49:08.709 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:49:08.268+0000 7fa9d1e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:49:08.709 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:49:08.268+0000 7fa9d1e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:08.709 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:49:08.268+0000 7fa9d1e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:08.709 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:49:08.268+0000 7faae5673640 10 monclient: get_auth_request con 0x7fa9cc070ae0 auth_method 0 2024-09-12T18:49:08.709 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:49:08.268+0000 7faae4e72640 10 monclient: get_auth_request con 0x55763fd55ac0 auth_method 0 2024-09-12T18:49:08.709 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:49:08.268+0000 7faae5673640 10 monclient: get_auth_request con 0x55763fd78e20 auth_method 0 2024-09-12T18:49:08.709 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:49:08.272+0000 7faae4e72640 10 monclient: get_auth_request con 0x55763fd7d180 auth_method 0 2024-09-12T18:49:08.709 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:49:08.272+0000 7faae5e74640 10 monclient: get_auth_request con 0x55763fd7c710 auth_method 0 2024-09-12T18:49:08.710 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 10 monclient: build_initial_monmap 2024-09-12T18:49:08.710 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:49:08.710 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 10 monclient: monmap: 2024-09-12T18:49:08.710 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:49:08.710 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:49:08.710 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:49:08.710 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:49:08.710 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:49:08.710 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.710 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:49:08.710 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:49:08.710 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:49:08.710 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding auth protocol: cephx 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding auth protocol: cephx 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding auth protocol: cephx 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: secure 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: crc 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: secure 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: crc 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: secure 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: crc 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: crc 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: secure 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: crc 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: secure 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: crc 2024-09-12T18:49:08.711 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:49:08.272+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd850f0) adding con mode: secure 2024-09-12T18:49:08.712 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.712 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command objecter_requests cmddesc objecter_requests hook 0x55763fd88b20 EEXIST 2024-09-12T18:49:08.712 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient: init 2024-09-12T18:49:08.712 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding auth protocol: cephx 2024-09-12T18:49:08.712 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding auth protocol: cephx 2024-09-12T18:49:08.712 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding auth protocol: cephx 2024-09-12T18:49:08.712 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: secure 2024-09-12T18:49:08.712 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: crc 2024-09-12T18:49:08.712 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: secure 2024-09-12T18:49:08.712 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: crc 2024-09-12T18:49:08.712 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: secure 2024-09-12T18:49:08.712 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: crc 2024-09-12T18:49:08.712 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: crc 2024-09-12T18:49:08.712 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: secure 2024-09-12T18:49:08.713 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: crc 2024-09-12T18:49:08.713 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: secure 2024-09-12T18:49:08.713 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: crc 2024-09-12T18:49:08.713 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fd83fe8) adding con mode: secure 2024-09-12T18:49:08.713 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.713 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.713 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command rotate-key cmddesc rotate-key hook 0x55763fd84130 EEXIST 2024-09-12T18:49:08.713 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:08.713 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:49:08.713 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-a con 0x55763fdaccd0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:08.713 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-b con 0x55763fdac600 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:08.713 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-c con 0x55763fdaafe0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:08.713 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.713 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.714 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.714 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:08.714 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient(hunting): authenticate will time out at 2335.421126s 2024-09-12T18:49:08.714 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): get_auth_request con 0x55763fdaccd0 auth_method 0 2024-09-12T18:49:08.714 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.714 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.714 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.714 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:49:08.276+0000 7faae5673640 10 monclient(hunting): get_auth_request con 0x55763fdaafe0 auth_method 0 2024-09-12T18:49:08.714 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:49:08.276+0000 7faae5673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.714 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:49:08.276+0000 7faae5673640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.714 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:49:08.276+0000 7faae5673640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.715 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.715 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.715 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.715 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:49:08.276+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.715 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:49:08.276+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.715 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:49:08.276+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.715 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:49:08.276+0000 7faae5e74640 10 monclient(hunting): get_auth_request con 0x55763fdac600 auth_method 0 2024-09-12T18:49:08.715 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:49:08.276+0000 7faae5e74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.715 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:49:08.276+0000 7faae5e74640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:49:08.276+0000 7faae5e74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient(hunting): handle_auth_done global_id 7797 payload 824 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient: _finish_hunting 0 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:49:08.276+0000 7faae4e72640 1 monclient: found mon.noname-a 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:49:08.276+0000 7faae4e72640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: dump: 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.716 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.717 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.717 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.717 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.717 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: _finish_auth 0 2024-09-12T18:49:08.717 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: _check_auth_tickets 2024-09-12T18:49:08.717 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:08.717 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.717 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:49:08.717 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:49:08.276+0000 7fa9caffd640 10 monclient: dump: 2024-09-12T18:49:08.717 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.717 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.717 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:49:08.276+0000 7faae6675640 4 set_mon_vals no callback set 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 5 monclient: authenticate success, global_id 7797 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient: _renew_subs 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient: _renew_subs 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:49:08.276+0000 7faae7b6d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:49:08.280+0000 7fa9caffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:49:08.718 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:49:08.280+0000 7fa9caffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:49:08.280+0000 7fa9caffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:49:08.280+0000 7faae5e74640 10 monclient: get_auth_request con 0x7fa9c0070a20 auth_method 0 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: get_monmap_and_config 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: build_initial_monmap 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: monmap: 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:49:08.719 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:49:08.720 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.720 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding auth protocol: cephx 2024-09-12T18:49:08.720 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding auth protocol: cephx 2024-09-12T18:49:08.720 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding auth protocol: cephx 2024-09-12T18:49:08.720 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: secure 2024-09-12T18:49:08.720 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: crc 2024-09-12T18:49:08.720 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: secure 2024-09-12T18:49:08.720 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: crc 2024-09-12T18:49:08.720 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: secure 2024-09-12T18:49:08.720 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: crc 2024-09-12T18:49:08.720 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: crc 2024-09-12T18:49:08.720 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: secure 2024-09-12T18:49:08.720 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: crc 2024-09-12T18:49:08.720 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: secure 2024-09-12T18:49:08.721 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: crc 2024-09-12T18:49:08.721 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdcc580) adding con mode: secure 2024-09-12T18:49:08.721 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.721 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: init 2024-09-12T18:49:08.721 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding auth protocol: cephx 2024-09-12T18:49:08.721 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding auth protocol: cephx 2024-09-12T18:49:08.721 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding auth protocol: cephx 2024-09-12T18:49:08.721 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: secure 2024-09-12T18:49:08.721 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: crc 2024-09-12T18:49:08.721 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: secure 2024-09-12T18:49:08.721 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: crc 2024-09-12T18:49:08.721 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: secure 2024-09-12T18:49:08.721 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: crc 2024-09-12T18:49:08.721 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: crc 2024-09-12T18:49:08.722 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: secure 2024-09-12T18:49:08.722 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: crc 2024-09-12T18:49:08.722 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: secure 2024-09-12T18:49:08.722 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: crc 2024-09-12T18:49:08.722 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145790) adding con mode: secure 2024-09-12T18:49:08.722 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.722 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.722 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc1f1458d8 EEXIST 2024-09-12T18:49:08.722 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:08.722 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:49:08.722 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-a con 0x55763fe02ce0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:08.722 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-b con 0x55763fbdbe50 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:08.722 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-c con 0x55763fdd2700 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:08.722 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient(hunting): authenticate will time out at 2335.426006s 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): get_auth_request con 0x55763fe02ce0 auth_method 0 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:49:08.280+0000 7faae5673640 10 monclient(hunting): get_auth_request con 0x55763fdd2700 auth_method 0 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:49:08.280+0000 7faae5673640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:49:08.280+0000 7faae5673640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:49:08.280+0000 7faae5673640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.723 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.724 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:49:08.280+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.724 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:49:08.280+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.724 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:49:08.280+0000 7faae5673640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.724 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient(hunting): handle_auth_done global_id 7800 payload 274 2024-09-12T18:49:08.724 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient: _finish_hunting 0 2024-09-12T18:49:08.724 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:49:08.280+0000 7faae4e72640 1 monclient: found mon.noname-a 2024-09-12T18:49:08.724 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:49:08.280+0000 7faae4e72640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.724 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.724 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:49:08.724 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: dump: 2024-09-12T18:49:08.724 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.724 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.724 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.725 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.725 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.725 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.725 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.725 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.725 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.725 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.725 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: _finish_auth 0 2024-09-12T18:49:08.725 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:49:08.725 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:08.725 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.725 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:49:08.725 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:49:08.280+0000 7fa9c8ff9640 10 monclient: dump: 2024-09-12T18:49:08.725 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 monclient: authenticate success, global_id 7800 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 4 set_mon_vals no callback set 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: shutdown 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: build_initial_monmap 2024-09-12T18:49:08.726 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 1 build_initial for_mkfs: 0 2024-09-12T18:49:08.727 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 10 monclient: monmap: 2024-09-12T18:49:08.727 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:49:08.727 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:49:08.727 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:49:08.727 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:49:08.727 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:49:08.727 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.727 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:49:08.727 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:49:08.727 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:49:08.727 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.727 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding auth protocol: cephx 2024-09-12T18:49:08.727 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding auth protocol: cephx 2024-09-12T18:49:08.727 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding auth protocol: cephx 2024-09-12T18:49:08.728 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: secure 2024-09-12T18:49:08.728 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: crc 2024-09-12T18:49:08.728 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: secure 2024-09-12T18:49:08.728 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: crc 2024-09-12T18:49:08.728 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: secure 2024-09-12T18:49:08.728 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: crc 2024-09-12T18:49:08.728 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: crc 2024-09-12T18:49:08.728 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: secure 2024-09-12T18:49:08.728 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: crc 2024-09-12T18:49:08.728 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: secure 2024-09-12T18:49:08.728 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: crc 2024-09-12T18:49:08.728 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdf3700) adding con mode: secure 2024-09-12T18:49:08.728 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.729 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 1 librados: starting msgr at 2024-09-12T18:49:08.729 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 1 librados: starting objecter 2024-09-12T18:49:08.729 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:49:08.280+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command objecter_requests cmddesc objecter_requests hook 0x55763fdae5a0 EEXIST 2024-09-12T18:49:08.729 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 1 librados: setting wanted keys 2024-09-12T18:49:08.729 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 1 librados: calling monclient init 2024-09-12T18:49:08.729 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient: init 2024-09-12T18:49:08.729 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding auth protocol: cephx 2024-09-12T18:49:08.729 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding auth protocol: cephx 2024-09-12T18:49:08.729 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding auth protocol: cephx 2024-09-12T18:49:08.729 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: secure 2024-09-12T18:49:08.729 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: crc 2024-09-12T18:49:08.729 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: secure 2024-09-12T18:49:08.729 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: crc 2024-09-12T18:49:08.729 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: secure 2024-09-12T18:49:08.730 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: crc 2024-09-12T18:49:08.730 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: crc 2024-09-12T18:49:08.730 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: secure 2024-09-12T18:49:08.730 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: crc 2024-09-12T18:49:08.730 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: secure 2024-09-12T18:49:08.730 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: crc 2024-09-12T18:49:08.730 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 AuthRegistry(0x55763fdaeaf0) adding con mode: secure 2024-09-12T18:49:08.730 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.730 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.730 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command rotate-key cmddesc rotate-key hook 0x55763fdaec38 EEXIST 2024-09-12T18:49:08.730 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:08.730 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:49:08.730 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-c con 0x55763fbdbe50 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:08.730 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-a con 0x55763fdd2700 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:08.731 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): picked mon.noname-b con 0x55763fe02ce0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:08.731 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.731 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.731 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:08.731 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:08.731 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient(hunting): authenticate will time out at 2335.428606s 2024-09-12T18:49:08.731 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): get_auth_request con 0x55763fdd2700 auth_method 0 2024-09-12T18:49:08.731 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.731 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.731 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.732 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient(hunting): get_auth_request con 0x55763fbdbe50 auth_method 0 2024-09-12T18:49:08.732 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:08.732 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:08.732 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:08.732 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.732 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.732 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.732 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:08.732 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:08.732 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:08.732 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient(hunting): handle_auth_done global_id 7803 payload 824 2024-09-12T18:49:08.732 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient: _finish_hunting 0 2024-09-12T18:49:08.732 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:49:08.284+0000 7faae5e74640 1 monclient: found mon.noname-a 2024-09-12T18:49:08.733 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:49:08.284+0000 7faae5e74640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.733 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:49:08.284+0000 7faae5673640 10 monclient: get_auth_request con 0x55763fe02ce0 auth_method 0 2024-09-12T18:49:08.733 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.733 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:49:08.733 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: dump: 2024-09-12T18:49:08.733 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.733 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.733 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.733 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.733 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.733 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.733 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.733 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.733 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: _finish_auth 0 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 10 monclient: dump: 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:08.734 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:08.735 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:08.735 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.735 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 monclient: authenticate success, global_id 7803 2024-09-12T18:49:08.735 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient: _renew_subs 2024-09-12T18:49:08.735 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:49:08.284+0000 7fa9c8ff9640 4 set_mon_vals no callback set 2024-09-12T18:49:08.735 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.735 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient: _renew_subs 2024-09-12T18:49:08.735 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.735 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 1 librados: init done 2024-09-12T18:49:08.735 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command cr dump hook 0x55763fdf8708 2024-09-12T18:49:08.735 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:49:08.284+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.735 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:49:08.735 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:08.735 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:49:08.284+0000 7fa9b6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:08.736 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:49:08.284+0000 7faae4e72640 10 monclient: get_auth_request con 0x7fa9b0070ae0 auth_method 0 2024-09-12T18:49:08.736 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:49:08.288+0000 7faae5673640 10 monclient: get_auth_request con 0x55763fe1c7d0 auth_method 0 2024-09-12T18:49:08.736 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.736 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 realm 2024-09-12T18:49:08.736 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.736 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.736 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:08.736 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.736 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.736 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.736 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:49:08.288+0000 7faae4e72640 10 monclient: get_auth_request con 0x55763fe20bd0 auth_method 0 2024-09-12T18:49:08.736 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:08.736 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.736 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:49:08.288+0000 7faae5e74640 10 monclient: get_auth_request con 0x55763fe242f0 auth_method 0 2024-09-12T18:49:08.737 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:08.737 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:49:08.288+0000 7faae7b6d9c0 20 searching for the correct realm 2024-09-12T18:49:08.737 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:49:08.292+0000 7faae5673640 10 monclient: get_auth_request con 0x7faae0061c20 auth_method 0 2024-09-12T18:49:08.737 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:49:08.292+0000 7faae4e72640 10 monclient: get_auth_request con 0x7faad80c4040 auth_method 0 2024-09-12T18:49:08.737 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:49:08.292+0000 7faae4e72640 0 -- 172.21.15.111:0/3123270491 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7faad80c4040 msgr2=0x7faad80b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:49:08.737 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:49:08.496+0000 7faae4e72640 10 monclient: get_auth_request con 0x7faad80c4040 auth_method 0 2024-09-12T18:49:08.737 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:49:08.496+0000 7faae5e74640 10 monclient: get_auth_request con 0x7faadc02a050 auth_method 0 2024-09-12T18:49:08.737 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:49:08.504+0000 7faae5673640 10 monclient: get_auth_request con 0x7faae0015030 auth_method 0 2024-09-12T18:49:08.737 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:49:08.508+0000 7faae5673640 0 -- 172.21.15.111:0/3123270491 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7faae0061c20 msgr2=0x7faae007c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:08.737 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:49:08.508+0000 7fa9b6ffd640 1 client.7803.objecter ms_handle_reset 0x7faae0061c20 session 0x7faae000f040 osd.7 2024-09-12T18:49:08.737 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:49:08.508+0000 7fa9b6ffd640 10 monclient: _renew_subs 2024-09-12T18:49:08.737 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:49:08.508+0000 7fa9b6ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:49:08.737 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:49:08.508+0000 7faae5673640 10 monclient: get_auth_request con 0x7fa9b0080a00 auth_method 0 2024-09-12T18:49:08.738 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:49:08.508+0000 7faae4e72640 10 monclient: get_auth_request con 0x7faad0003be0 auth_method 0 2024-09-12T18:49:08.738 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:08.738 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:08.738 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:08.738 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:08.738 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:08.738 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:08.738 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.738 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.738 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.738 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:08.738 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.738 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:08.738 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 zone default found 2024-09-12T18:49:08.739 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 4 Realm: () 2024-09-12T18:49:08.739 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:08.739 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:08.739 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:08.739 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 zonegroup default 2024-09-12T18:49:08.739 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:49:08.524+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.739 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.739 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.739 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.739 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.739 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.739 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 started sync module instance, tier type = 2024-09-12T18:49:08.739 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:49:08.528+0000 7faae7b6d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:08.739 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=0 2024-09-12T18:49:08.740 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=1 2024-09-12T18:49:08.740 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=2 2024-09-12T18:49:08.740 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=3 2024-09-12T18:49:08.740 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=4 2024-09-12T18:49:08.740 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=5 2024-09-12T18:49:08.740 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:49:08.552+0000 7faae7b6d9c0 20 add_watcher() i=6 2024-09-12T18:49:08.740 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:49:08.556+0000 7faae7b6d9c0 20 add_watcher() i=7 2024-09-12T18:49:08.740 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:49:08.556+0000 7faae7b6d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:08.740 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding auth protocol: cephx 2024-09-12T18:49:08.740 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding auth protocol: cephx 2024-09-12T18:49:08.740 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding auth protocol: cephx 2024-09-12T18:49:08.740 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: secure 2024-09-12T18:49:08.740 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: crc 2024-09-12T18:49:08.740 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: secure 2024-09-12T18:49:08.741 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: crc 2024-09-12T18:49:08.741 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: secure 2024-09-12T18:49:08.741 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: crc 2024-09-12T18:49:08.741 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: crc 2024-09-12T18:49:08.741 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: secure 2024-09-12T18:49:08.741 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: crc 2024-09-12T18:49:08.741 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: secure 2024-09-12T18:49:08.741 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: crc 2024-09-12T18:49:08.741 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 AuthRegistry(0x7ffc1f145c70) adding con mode: secure 2024-09-12T18:49:08.741 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:49:08.560+0000 7fa99b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:08.741 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:08.741 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:08.741 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command cache list hook 0x55763fdf2980 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command cache inspect hook 0x55763fdf2980 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command cache erase hook 0x55763fdf2980 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command cache zap hook 0x55763fdf2980 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 note: GC not initialized 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:49:08.560+0000 7fa99a7e4640 20 reqs_thread_entry: start 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command sync trace show hook 0x7faadc0014f0 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command sync trace history hook 0x7faadc0014f0 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command sync trace active hook 0x7faadc0014f0 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 5 asok(0x55763fb222b0) register_command sync trace active_short hook 0x7faadc0014f0 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 Filter name: none 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:49:08.560+0000 7fa90bfff640 20 reqs_thread_entry: start 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:49:08.742 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.743 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:08.743 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:49:08.743 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:49:08.743 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 : miss 2024-09-12T18:49:08.743 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:49:08.560+0000 7faae7b6d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.743 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:49:08.564+0000 7faae7b6d9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:08.743 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:08.743 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:08.743 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:08.743 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:08.743 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:49:08.564+0000 7faae7b6d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 2024-09-12T18:49:08.744 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:08.744 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:08.744 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:08.744 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36, ofs0, ns] 2024-09-12T18:49:08.744 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:49:08.572+0000 7fa9c8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431660 cookie 93966366331952 notifier 7803 bl.length()=923 2024-09-12T18:49:08.744 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:49:08.572+0000 7fa9c8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:08.744 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:49:08.572+0000 7fa9c8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:08.744 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:49:08.572+0000 7fa9c8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:08.744 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): orig_sources= new_sources= 2024-09-12T18:49:08.744 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): potential sources added=[] removed=[] 2024-09-12T18:49:08.744 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): orig_dests= new_dests= 2024-09-12T18:49:08.744 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:49:08.572+0000 7faae7b6d9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): potential dests added=[] removed=[] 2024-09-12T18:49:08.744 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:49:08.580+0000 7faae7b6d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faae7b6d9c0 time 2024-09-12T18:49:08.585564+0000 2024-09-12T18:49:08.745 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:49:08.745 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.745 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:08.745 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7faaeb4472eb] 2024-09-12T18:49:08.745 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faaeb44749f] 2024-09-12T18:49:08.745 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55763d769cc1] 2024-09-12T18:49:08.745 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422aac) [0x55763e1c7aac] 2024-09-12T18:49:08.745 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55763d77eced] 2024-09-12T18:49:08.745 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:49:08.745 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faaea2add90] 2024-09-12T18:49:08.745 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:49:08.745 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:49:08.745 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.746 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:49:08.580+0000 7faae7b6d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:49:08.746 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7faae7b6d9c0 thread_name:radosgw-admin 2024-09-12T18:49:08.746 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.746 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:08.746 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7faaea2c6520] 2024-09-12T18:49:08.746 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:49:08.746 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:49:08.746 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:49:08.746 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7faaeb447345] 2024-09-12T18:49:08.746 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7faaeb44749f] 2024-09-12T18:49:08.746 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55763d769cc1] 2024-09-12T18:49:08.746 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422aac) [0x55763e1c7aac] 2024-09-12T18:49:08.746 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55763d77eced] 2024-09-12T18:49:08.746 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:49:08.747 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7faaea2add90] 2024-09-12T18:49:08.747 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:49:08.747 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:49:08.747 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:49:08.747 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.747 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:49:08.747 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:49:08.747 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:49:08.747 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:49:08.747 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:49:08.747 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:49:08.747 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:49:08.747 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:49:08.747 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:49:08.748 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:49:08.748 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:49:08.748 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:49:08.748 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:49:08.748 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:49:08.748 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:49:08.748 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:49:08.748 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:49:08.748 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:49:08.748 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:49:08.748 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:49:08.748 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:49:08.748 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:49:08.748 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:49:08.749 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:49:08.749 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:49:08.749 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:49:08.749 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:49:08.749 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:49:08.749 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:49:08.749 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:49:08.749 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:49:08.749 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:49:08.749 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:49:08.749 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:49:08.749 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:49:08.749 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:49:08.749 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:49:08.750 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:49:08.751 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:49:08.751 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:49:08.751 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:49:08.751 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:49:08.751 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:49:08.751 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:49:08.751 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:49:08.751 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:49:08.751 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:49:08.751 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:49:08.751 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:49:08.751 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:49:08.751 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:49:08.751 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:49:08.752 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:49:08.752 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:49:08.752 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:49:08.752 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:49:08.752 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:49:08.752 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:49:08.752 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:49:08.752 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:49:08.752 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:49:08.752 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:49:08.752 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:49:08.752 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:49:08.752 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:49:08.752 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:49:08.753 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:49:08.753 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:49:08.753 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:49:08.753 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:49:08.753 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:49:08.753 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:49:08.753 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:49:08.753 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:49:08.753 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:49:08.753 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:49:08.753 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:49:08.753 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:49:08.753 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:49:08.753 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:49:08.754 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa90bfff640 / http_manager 2024-09-12T18:49:08.754 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa99a7e4640 / http_manager 2024-09-12T18:49:08.754 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa99b7e6640 / rgw_dt_lg_renew 2024-09-12T18:49:08.754 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa9b6ffd640 / ms_dispatch 2024-09-12T18:49:08.754 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa9c8ff9640 / io_context_pool 2024-09-12T18:49:08.754 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa9caffd640 / ms_dispatch 2024-09-12T18:49:08.754 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa9d1e03640 / ms_dispatch 2024-09-12T18:49:08.754 INFO:tasks.workunit.client.0.smithi111.stderr: 7fa9d3606640 / io_context_pool 2024-09-12T18:49:08.754 INFO:tasks.workunit.client.0.smithi111.stderr: 7faae4e72640 / msgr-worker-2 2024-09-12T18:49:08.754 INFO:tasks.workunit.client.0.smithi111.stderr: 7faae5673640 / msgr-worker-1 2024-09-12T18:49:08.754 INFO:tasks.workunit.client.0.smithi111.stderr: 7faae5e74640 / msgr-worker-0 2024-09-12T18:49:08.754 INFO:tasks.workunit.client.0.smithi111.stderr: 7faae6675640 / io_context_pool 2024-09-12T18:49:08.754 INFO:tasks.workunit.client.0.smithi111.stderr: 7faae7b6d9c0 / radosgw-admin 2024-09-12T18:49:08.754 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:49:08.755 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:49:08.755 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:49:08.588058Z_6ed1a00f-df12-447e-b750-62d8ecaed85d/log 2024-09-12T18:49:08.755 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:49:08.755 INFO:tasks.workunit.client.0.smithi111.stderr:Aborted 2024-09-12T18:49:08.755 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T18:49:08.756 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:08.756 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:08.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.664+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.668+0000 7f0027dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.668+0000 7f0027dc89c0 20 realm 2024-09-12T18:49:08.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.668+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.668+0000 7f0027dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.668+0000 7f0027dc89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:08.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.668+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.668+0000 7f0027dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.668+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.668+0000 7f0027dc89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:08.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.668+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.672+0000 7f0027dc89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:08.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.672+0000 7f0027dc89c0 20 searching for the correct realm 2024-09-12T18:49:08.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.676+0000 7f00258ce640 0 -- 172.21.15.111:0/3667570029 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f0020035030 msgr2=0x7f00200638e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:08.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.680+0000 7f00250cd640 0 -- 172.21.15.111:0/3667570029 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f0020064e70 msgr2=0x7f002006c770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:08.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.896+0000 7f0027dc89c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:08.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.896+0000 7f0027dc89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:08.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.896+0000 7f0027dc89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:08.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.896+0000 7f0027dc89c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:08.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.896+0000 7f0027dc89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:08.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.896+0000 7f0027dc89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:08.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.896+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.896+0000 7f0027dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.896+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.896+0000 7f0027dc89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:08.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.896+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:08.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 20 zone default found 2024-09-12T18:49:08.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 4 Realm: () 2024-09-12T18:49:08.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:08.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:08.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:08.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 20 zonegroup default 2024-09-12T18:49:08.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:08.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 20 started sync module instance, tier type = 2024-09-12T18:49:08.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.900+0000 7f0027dc89c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:08.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.924+0000 7f0027dc89c0 20 add_watcher() i=0 2024-09-12T18:49:08.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.924+0000 7f0027dc89c0 20 add_watcher() i=1 2024-09-12T18:49:08.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.924+0000 7f0027dc89c0 20 add_watcher() i=2 2024-09-12T18:49:08.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.924+0000 7f0027dc89c0 20 add_watcher() i=3 2024-09-12T18:49:08.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.924+0000 7f0027dc89c0 20 add_watcher() i=4 2024-09-12T18:49:08.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.924+0000 7f0027dc89c0 20 add_watcher() i=5 2024-09-12T18:49:08.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.924+0000 7f0027dc89c0 20 add_watcher() i=6 2024-09-12T18:49:08.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.928+0000 7f0027dc89c0 20 add_watcher() i=7 2024-09-12T18:49:08.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.928+0000 7f0027dc89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:08.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.928+0000 7efed77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:08.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.932+0000 7f0027dc89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:08.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.932+0000 7f0027dc89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:08.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.932+0000 7f0027dc89c0 5 note: GC not initialized 2024-09-12T18:49:08.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.932+0000 7efed67fc640 20 reqs_thread_entry: start 2024-09-12T18:49:08.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.932+0000 7f0027dc89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:08.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.932+0000 7f0027dc89c0 20 Filter name: none 2024-09-12T18:49:08.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.932+0000 7efe47fff640 20 reqs_thread_entry: start 2024-09-12T18:49:08.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.932+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.932+0000 7f0027dc89c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:08.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.932+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.936+0000 7f0027dc89c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:49:08.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.936+0000 7f0027dc89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:08.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.936+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.936+0000 7f0027dc89c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:08.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.936+0000 7f0027dc89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:08.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.936+0000 7f0027dc89c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:49:08.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.936+0000 7f0027dc89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:08.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.940+0000 7efed77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:08.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.944+0000 7f0027dc89c0 20 remove_watcher() i=0 2024-09-12T18:49:08.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.944+0000 7f0027dc89c0 2 removed watcher, disabling cache 2024-09-12T18:49:08.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.948+0000 7f0027dc89c0 20 remove_watcher() i=1 2024-09-12T18:49:08.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.948+0000 7f0027dc89c0 20 remove_watcher() i=2 2024-09-12T18:49:08.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.952+0000 7f0027dc89c0 20 remove_watcher() i=3 2024-09-12T18:49:08.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.952+0000 7f0027dc89c0 20 remove_watcher() i=4 2024-09-12T18:49:08.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.956+0000 7f0027dc89c0 20 remove_watcher() i=5 2024-09-12T18:49:08.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.956+0000 7f0027dc89c0 20 remove_watcher() i=6 2024-09-12T18:49:08.963 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:08.960+0000 7f0027dc89c0 20 remove_watcher() i=7 2024-09-12T18:49:08.978 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.978 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:49:08.978 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-logrecord-writes id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:49:08.978 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:08.979 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:08.979 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:08.993 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:08.993 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:09.037 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:49:09.073 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:09.073 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:09.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.112+0000 7f43658449c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:09.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.116+0000 7f43658449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:09.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.116+0000 7f43658449c0 20 realm 2024-09-12T18:49:09.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.116+0000 7f43658449c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:09.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.116+0000 7f43658449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:09.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.116+0000 7f43658449c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:09.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.116+0000 7f43658449c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:09.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.116+0000 7f43658449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:09.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.116+0000 7f43658449c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:09.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.116+0000 7f43658449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:09.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.116+0000 7f43658449c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:09.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.116+0000 7f43658449c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:09.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.116+0000 7f43658449c0 20 searching for the correct realm 2024-09-12T18:49:09.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.120+0000 7f4363b4b640 0 -- 172.21.15.111:0/3212674196 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f435812bab0 msgr2=0x7f43580f6180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:09.341 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.336+0000 7f4362b49640 0 -- 172.21.15.111:0/3212674196 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f435c0636f0 msgr2=0x7f435c061860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:09.559 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.552+0000 7f43658449c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:09.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.552+0000 7f43658449c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:09.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.552+0000 7f43658449c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:09.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.552+0000 7f43658449c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:09.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.552+0000 7f43658449c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:09.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.552+0000 7f43658449c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:09.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.552+0000 7f43658449c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:09.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.552+0000 7f43658449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:09.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.552+0000 7f43658449c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:09.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.556+0000 7f43658449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:09.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.556+0000 7f43658449c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:09.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.556+0000 7f43658449c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:09.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.556+0000 7f43658449c0 20 zone default found 2024-09-12T18:49:09.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.556+0000 7f43658449c0 4 Realm: () 2024-09-12T18:49:09.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.556+0000 7f43658449c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:09.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.556+0000 7f43658449c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:09.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.556+0000 7f43658449c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:09.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.556+0000 7f43658449c0 20 zonegroup default 2024-09-12T18:49:09.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.556+0000 7f43658449c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:09.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.556+0000 7f43658449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:09.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.556+0000 7f43658449c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:09.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.560+0000 7f43658449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:09.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.560+0000 7f43658449c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:09.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.560+0000 7f43658449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:09.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.560+0000 7f43658449c0 20 started sync module instance, tier type = 2024-09-12T18:49:09.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.560+0000 7f43658449c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:09.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.584+0000 7f43658449c0 20 add_watcher() i=0 2024-09-12T18:49:09.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.584+0000 7f43658449c0 20 add_watcher() i=1 2024-09-12T18:49:09.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.584+0000 7f43658449c0 20 add_watcher() i=2 2024-09-12T18:49:09.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.584+0000 7f43658449c0 20 add_watcher() i=3 2024-09-12T18:49:09.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.584+0000 7f43658449c0 20 add_watcher() i=4 2024-09-12T18:49:09.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.584+0000 7f43658449c0 20 add_watcher() i=5 2024-09-12T18:49:09.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.584+0000 7f43658449c0 20 add_watcher() i=6 2024-09-12T18:49:09.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.584+0000 7f43658449c0 20 add_watcher() i=7 2024-09-12T18:49:09.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.584+0000 7f43658449c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:09.594 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.588+0000 7f4219fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:09.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.588+0000 7f43658449c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:09.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.588+0000 7f43658449c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:09.595 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.588+0000 7f43658449c0 5 note: GC not initialized 2024-09-12T18:49:09.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.588+0000 7f4218fe1640 20 reqs_thread_entry: start 2024-09-12T18:49:09.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:09.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 20 Filter name: none 2024-09-12T18:49:09.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f41927fc640 20 reqs_thread_entry: start 2024-09-12T18:49:09.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:49:09.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:09.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:09.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:49:09.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:49:09.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 : miss 2024-09-12T18:49:09.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:09.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:49:09.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:09.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:09.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:09.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:09.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.592+0000 7f43658449c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 2024-09-12T18:49:09.601 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.596+0000 7f43658449c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to be held by another RGW process; skipping for now 2024-09-12T18:49:09.602 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.596+0000 7f4219fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:09.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.600+0000 7f43658449c0 20 remove_watcher() i=0 2024-09-12T18:49:09.607 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.600+0000 7f43658449c0 2 removed watcher, disabling cache 2024-09-12T18:49:09.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.604+0000 7f43658449c0 20 remove_watcher() i=1 2024-09-12T18:49:09.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.604+0000 7f43658449c0 20 remove_watcher() i=2 2024-09-12T18:49:09.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.608+0000 7f43658449c0 20 remove_watcher() i=3 2024-09-12T18:49:09.616 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.612+0000 7f43658449c0 20 remove_watcher() i=4 2024-09-12T18:49:09.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.612+0000 7f43658449c0 20 remove_watcher() i=5 2024-09-12T18:49:09.619 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.612+0000 7f43658449c0 20 remove_watcher() i=6 2024-09-12T18:49:09.620 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:09.616+0000 7f43658449c0 20 remove_watcher() i=7 2024-09-12T18:49:09.636 INFO:tasks.workunit.client.0.smithi111.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:49:39.665 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:49:39.702 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:39.702 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:39.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.748+0000 7fa17325c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:39.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.748+0000 7fa17325c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:39.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.748+0000 7fa17325c9c0 20 realm 2024-09-12T18:49:39.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.748+0000 7fa17325c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:39.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.748+0000 7fa17325c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:39.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.748+0000 7fa17325c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:39.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.748+0000 7fa17325c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:39.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.748+0000 7fa17325c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:39.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.748+0000 7fa17325c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:39.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.752+0000 7fa17325c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:39.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.752+0000 7fa17325c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:39.754 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.752+0000 7fa17325c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:39.754 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.752+0000 7fa17325c9c0 20 searching for the correct realm 2024-09-12T18:49:39.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.756+0000 7fa170561640 0 -- 172.21.15.111:0/2778849129 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7fa158043070 msgr2=0x7fa1580239f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:39.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.968+0000 7fa170d62640 0 -- 172.21.15.111:0/2778849129 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x55d619cceb80 msgr2=0x7fa16805b9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:39.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.984+0000 7fa17325c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:39.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.984+0000 7fa17325c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:39.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.984+0000 7fa17325c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:39.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.984+0000 7fa17325c9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:39.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.984+0000 7fa17325c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:39.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.984+0000 7fa17325c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:39.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.984+0000 7fa17325c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:39.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.984+0000 7fa17325c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:39.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.984+0000 7fa17325c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:39.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.988+0000 7fa17325c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:39.989 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.988+0000 7fa17325c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:39.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.988+0000 7fa17325c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:39.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.988+0000 7fa17325c9c0 20 zone default found 2024-09-12T18:49:39.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.988+0000 7fa17325c9c0 4 Realm: () 2024-09-12T18:49:39.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.988+0000 7fa17325c9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:39.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.988+0000 7fa17325c9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:39.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.988+0000 7fa17325c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:39.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.988+0000 7fa17325c9c0 20 zonegroup default 2024-09-12T18:49:39.990 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.988+0000 7fa17325c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:39.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.988+0000 7fa17325c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:39.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.988+0000 7fa17325c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:39.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.988+0000 7fa17325c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:39.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.988+0000 7fa17325c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:39.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.992+0000 7fa17325c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:39.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.992+0000 7fa17325c9c0 20 started sync module instance, tier type = 2024-09-12T18:49:39.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:39.992+0000 7fa17325c9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:40.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.012+0000 7fa17325c9c0 20 add_watcher() i=0 2024-09-12T18:49:40.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.012+0000 7fa17325c9c0 20 add_watcher() i=1 2024-09-12T18:49:40.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.012+0000 7fa17325c9c0 20 add_watcher() i=2 2024-09-12T18:49:40.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.012+0000 7fa17325c9c0 20 add_watcher() i=3 2024-09-12T18:49:40.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.012+0000 7fa17325c9c0 20 add_watcher() i=4 2024-09-12T18:49:40.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.012+0000 7fa17325c9c0 20 add_watcher() i=5 2024-09-12T18:49:40.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.012+0000 7fa17325c9c0 20 add_watcher() i=6 2024-09-12T18:49:40.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.016+0000 7fa17325c9c0 20 add_watcher() i=7 2024-09-12T18:49:40.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.016+0000 7fa17325c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:40.022 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.020+0000 7fa026fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:40.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.020+0000 7fa17325c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:40.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.020+0000 7fa17325c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:40.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.020+0000 7fa17325c9c0 5 note: GC not initialized 2024-09-12T18:49:40.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.020+0000 7fa025fe3640 20 reqs_thread_entry: start 2024-09-12T18:49:40.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.020+0000 7fa17325c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:40.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 20 Filter name: none 2024-09-12T18:49:40.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7f9f977fe640 20 reqs_thread_entry: start 2024-09-12T18:49:40.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T18:49:40.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:40.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T18:49:40.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T18:49:40.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 : miss 2024-09-12T18:49:40.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T18:49:40.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:40.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:40.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:40.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:40.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 2024-09-12T18:49:40.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.024+0000 7fa17325c9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:49:40.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.040+0000 7fa17325c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:40.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.040+0000 7fa17325c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:40.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.040+0000 7fa17325c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:40.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.040+0000 7fa17325c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36, ofs0, ns] 2024-09-12T18:49:40.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.040+0000 7fa047fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431661 cookie 94378046575600 notifier 7343 bl.length()=923 2024-09-12T18:49:40.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.040+0000 7fa047fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:40.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.040+0000 7fa047fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:40.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.040+0000 7fa047fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:40.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.040+0000 7fa17325c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): orig_sources= new_sources= 2024-09-12T18:49:40.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.040+0000 7fa17325c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): potential sources added=[] removed=[] 2024-09-12T18:49:40.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.040+0000 7fa17325c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): orig_dests= new_dests= 2024-09-12T18:49:40.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.040+0000 7fa17325c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): potential dests added=[] removed=[] 2024-09-12T18:49:40.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.0 2024-09-12T18:49:40.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.0 2024-09-12T18:49:40.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.1 2024-09-12T18:49:40.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.1 2024-09-12T18:49:40.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.2 2024-09-12T18:49:40.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.2 2024-09-12T18:49:40.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.3 2024-09-12T18:49:40.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.3 2024-09-12T18:49:40.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.4 2024-09-12T18:49:40.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.4 2024-09-12T18:49:40.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.5 2024-09-12T18:49:40.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.5 2024-09-12T18:49:40.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.6 2024-09-12T18:49:40.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.6 2024-09-12T18:49:40.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.7 2024-09-12T18:49:40.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.7 2024-09-12T18:49:40.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.8 2024-09-12T18:49:40.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.8 2024-09-12T18:49:40.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.9 2024-09-12T18:49:40.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.9 2024-09-12T18:49:40.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.10 2024-09-12T18:49:40.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.10 2024-09-12T18:49:40.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.11 2024-09-12T18:49:40.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2.11 2024-09-12T18:49:40.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.0 2024-09-12T18:49:40.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.052+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.1 2024-09-12T18:49:40.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.056+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2 2024-09-12T18:49:40.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.056+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.3 2024-09-12T18:49:40.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.056+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.4 2024-09-12T18:49:40.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.060+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.5 2024-09-12T18:49:40.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.060+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.6 2024-09-12T18:49:40.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.060+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.7 2024-09-12T18:49:40.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.060+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.8 2024-09-12T18:49:40.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.060+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.9 2024-09-12T18:49:40.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.064+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.10 2024-09-12T18:49:40.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.068+0000 7fa17325c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 : hit (requested=0x17, cached=0x17) 2024-09-12T18:49:40.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.068+0000 7fa17325c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 2024-09-12T18:49:40.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.072+0000 7fa17325c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:40.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.072+0000 7fa17325c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:40.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.072+0000 7fa17325c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:40.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.072+0000 7fa17325c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36, ofs0, ns] 2024-09-12T18:49:40.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.072+0000 7fa0477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431662 cookie 94378046575600 notifier 7343 bl.length()=923 2024-09-12T18:49:40.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.072+0000 7fa0477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:40.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.072+0000 7fa0477fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:40.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.072+0000 7fa0477fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:40.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.072+0000 7fa17325c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): orig_sources= new_sources= 2024-09-12T18:49:40.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.072+0000 7fa17325c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): potential sources added=[] removed=[] 2024-09-12T18:49:40.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.072+0000 7fa17325c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): orig_dests= new_dests= 2024-09-12T18:49:40.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.072+0000 7fa17325c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): potential dests added=[] removed=[] 2024-09-12T18:49:40.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.080+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.0 2024-09-12T18:49:40.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.080+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.1 2024-09-12T18:49:40.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.080+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.2 2024-09-12T18:49:40.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.080+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.3 2024-09-12T18:49:40.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.080+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.4 2024-09-12T18:49:40.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.080+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.5 2024-09-12T18:49:40.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.084+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.6 2024-09-12T18:49:40.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.084+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.7 2024-09-12T18:49:40.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.084+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.8 2024-09-12T18:49:40.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.084+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.9 2024-09-12T18:49:40.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.084+0000 7fa17325c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.36.10 2024-09-12T18:49:40.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.088+0000 7fa17325c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 : hit (requested=0x17, cached=0x17) 2024-09-12T18:49:40.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.088+0000 7fa17325c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 2024-09-12T18:49:40.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.088+0000 7fa17325c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:40.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.088+0000 7fa17325c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:40.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.088+0000 7fa17325c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:40.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.088+0000 7fa17325c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36, ofs0, ns] 2024-09-12T18:49:40.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.088+0000 7fa047fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431663 cookie 94378046575600 notifier 7343 bl.length()=891 2024-09-12T18:49:40.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.088+0000 7fa047fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 info.flags=0x17 2024-09-12T18:49:40.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.088+0000 7fa047fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:97c2b296-1395-4700-8053-4f06c4c86557.4689.36 to cache LRU end 2024-09-12T18:49:40.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.088+0000 7fa047fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:40.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.092+0000 7fa17325c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): orig_sources= new_sources= 2024-09-12T18:49:40.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.092+0000 7fa17325c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): potential sources added=[] removed=[] 2024-09-12T18:49:40.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.092+0000 7fa17325c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): orig_dests= new_dests= 2024-09-12T18:49:40.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.092+0000 7fa17325c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[97c2b296-1395-4700-8053-4f06c4c86557.4689.36]): potential dests added=[] removed=[] 2024-09-12T18:49:40.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.096+0000 7fa17325c9c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T18:49:40.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.100+0000 7fa026fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:40.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.104+0000 7fa17325c9c0 20 remove_watcher() i=0 2024-09-12T18:49:40.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.104+0000 7fa17325c9c0 2 removed watcher, disabling cache 2024-09-12T18:49:40.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.104+0000 7fa17325c9c0 20 remove_watcher() i=1 2024-09-12T18:49:40.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.108+0000 7fa17325c9c0 20 remove_watcher() i=2 2024-09-12T18:49:40.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.112+0000 7fa17325c9c0 20 remove_watcher() i=3 2024-09-12T18:49:40.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.112+0000 7fa17325c9c0 20 remove_watcher() i=4 2024-09-12T18:49:40.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.112+0000 7fa17325c9c0 20 remove_watcher() i=5 2024-09-12T18:49:40.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.116+0000 7fa17325c9c0 20 remove_watcher() i=6 2024-09-12T18:49:40.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.116+0000 7fa17325c9c0 20 remove_watcher() i=7 2024-09-12T18:49:40.133 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T18:49:40.161 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:40.161 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:40.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.204+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.208 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.208+0000 7f9c807fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:40.208 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.208+0000 7f9c807fc9c0 20 realm 2024-09-12T18:49:40.208 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.208+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.208+0000 7f9c807fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:40.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.208+0000 7f9c807fc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:40.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.208+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.208+0000 7f9c807fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:40.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.208+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.208+0000 7f9c807fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:40.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.208+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.208+0000 7f9c807fc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:40.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.208+0000 7f9c807fc9c0 20 searching for the correct realm 2024-09-12T18:49:40.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.216+0000 7f9c7eb03640 0 -- 172.21.15.111:0/4031563116 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x55ad9b4f7270 msgr2=0x55ad9b4f9660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:40.222 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.220+0000 7f9c7db01640 0 -- 172.21.15.111:0/4031563116 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f9c7800f3d0 msgr2=0x7f9c7800f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:40.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.228+0000 7f9c807fc9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:40.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.228+0000 7f9c807fc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:40.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.228+0000 7f9c807fc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:40.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.228+0000 7f9c807fc9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:40.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.228+0000 7f9c807fc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:40.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.228+0000 7f9c807fc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:40.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.228+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.228+0000 7f9c807fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:40.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.228+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.228+0000 7f9c807fc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:40.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.228+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:40.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 20 zone default found 2024-09-12T18:49:40.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 4 Realm: () 2024-09-12T18:49:40.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:40.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:40.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:40.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 20 zonegroup default 2024-09-12T18:49:40.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:40.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:40.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:40.234 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 20 started sync module instance, tier type = 2024-09-12T18:49:40.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.232+0000 7f9c807fc9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:40.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.248+0000 7f9c807fc9c0 20 add_watcher() i=0 2024-09-12T18:49:40.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.248+0000 7f9c807fc9c0 20 add_watcher() i=1 2024-09-12T18:49:40.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.248+0000 7f9c807fc9c0 20 add_watcher() i=2 2024-09-12T18:49:40.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.248+0000 7f9c807fc9c0 20 add_watcher() i=3 2024-09-12T18:49:40.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.248+0000 7f9c807fc9c0 20 add_watcher() i=4 2024-09-12T18:49:40.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.248+0000 7f9c807fc9c0 20 add_watcher() i=5 2024-09-12T18:49:40.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.248+0000 7f9c807fc9c0 20 add_watcher() i=6 2024-09-12T18:49:40.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.248+0000 7f9c807fc9c0 20 add_watcher() i=7 2024-09-12T18:49:40.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.248+0000 7f9c807fc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:40.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.252+0000 7f9b34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:40.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.252+0000 7f9c807fc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:40.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.252+0000 7f9c807fc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:40.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.252+0000 7f9c807fc9c0 5 note: GC not initialized 2024-09-12T18:49:40.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.252+0000 7f9aaf7fe640 20 reqs_thread_entry: start 2024-09-12T18:49:40.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.252+0000 7f9c807fc9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:40.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.252+0000 7f9c807fc9c0 20 Filter name: none 2024-09-12T18:49:40.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.252+0000 7f9aad7fa640 20 reqs_thread_entry: start 2024-09-12T18:49:40.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.252+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.252+0000 7f9c807fc9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:40.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.252+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.256+0000 7f9c807fc9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:40.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.256+0000 7f9c807fc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:40.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.256+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.256+0000 7f9c807fc9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T18:49:40.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.256+0000 7f9c807fc9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.256+0000 7f9c807fc9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T18:49:40.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.256+0000 7f9c807fc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:40.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.256+0000 7f9b34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:40.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.264+0000 7f9c807fc9c0 20 remove_watcher() i=0 2024-09-12T18:49:40.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.264+0000 7f9c807fc9c0 2 removed watcher, disabling cache 2024-09-12T18:49:40.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.264+0000 7f9c807fc9c0 20 remove_watcher() i=1 2024-09-12T18:49:40.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.268+0000 7f9c807fc9c0 20 remove_watcher() i=2 2024-09-12T18:49:40.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.268+0000 7f9c807fc9c0 20 remove_watcher() i=3 2024-09-12T18:49:40.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.272+0000 7f9c807fc9c0 20 remove_watcher() i=4 2024-09-12T18:49:40.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.272+0000 7f9c807fc9c0 20 remove_watcher() i=5 2024-09-12T18:49:40.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.272+0000 7f9c807fc9c0 20 remove_watcher() i=6 2024-09-12T18:49:40.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.276+0000 7f9c807fc9c0 20 remove_watcher() i=7 2024-09-12T18:49:40.289 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:40.289 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:49:40.289 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-logrecord-writes id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:49:40.289 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:40.291 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.291 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.294 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.294 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.341 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.342 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.385 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T18:49:40.385 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:40.387 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.387 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.404 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.404 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.451 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.452 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.471 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.471 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.490 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.490 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.509 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.510 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.529 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.529 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.551 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.551 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.571 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.572 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.591 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.591 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.612 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.612 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.632 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.632 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.650 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.651 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.670 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.670 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.689 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.689 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.709 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.709 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.728 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.729 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.747 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.747 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.767 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.767 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.787 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.787 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.806 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.806 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.825 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:40.825 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:40.844 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:49:40.877 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:40.878 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:40.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.924+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.924+0000 7fc88d02a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:40.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.924+0000 7fc88d02a9c0 20 realm 2024-09-12T18:49:40.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.924+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.924+0000 7fc88d02a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:40.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.924+0000 7fc88d02a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:40.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.924+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:40.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.924+0000 7fc88d02a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:40.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:40.924+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.128+0000 7fc88d02a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:41.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.128+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.132+0000 7fc88d02a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:41.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.132+0000 7fc88d02a9c0 20 searching for the correct realm 2024-09-12T18:49:41.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.136+0000 7fc88b331640 0 -- 172.21.15.111:0/836518599 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fc8800e2040 msgr2=0x7fc8800c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:41.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.352+0000 7fc88a32f640 0 -- 172.21.15.111:0/836518599 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fc8840832a0 msgr2=0x7fc88407f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:41.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:41.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:41.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:41.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:41.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:41.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:41.573 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:41.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:41.574 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:41.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 zone default found 2024-09-12T18:49:41.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 4 Realm: () 2024-09-12T18:49:41.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:41.575 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:41.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:41.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 zonegroup default 2024-09-12T18:49:41.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.572+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.576+0000 7fc88d02a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:41.576 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.576+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.577 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.576+0000 7fc88d02a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:41.577 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.576+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.576+0000 7fc88d02a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:41.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.576+0000 7fc88d02a9c0 20 started sync module instance, tier type = 2024-09-12T18:49:41.578 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.576+0000 7fc88d02a9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:41.602 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.600+0000 7fc88d02a9c0 20 add_watcher() i=0 2024-09-12T18:49:41.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.600+0000 7fc88d02a9c0 20 add_watcher() i=1 2024-09-12T18:49:41.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.600+0000 7fc88d02a9c0 20 add_watcher() i=2 2024-09-12T18:49:41.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.600+0000 7fc88d02a9c0 20 add_watcher() i=3 2024-09-12T18:49:41.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.600+0000 7fc88d02a9c0 20 add_watcher() i=4 2024-09-12T18:49:41.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.600+0000 7fc88d02a9c0 20 add_watcher() i=5 2024-09-12T18:49:41.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.600+0000 7fc88d02a9c0 20 add_watcher() i=6 2024-09-12T18:49:41.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.604+0000 7fc88d02a9c0 20 add_watcher() i=7 2024-09-12T18:49:41.605 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.604+0000 7fc88d02a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:41.609 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.608+0000 7fc7417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:41.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.608+0000 7fc88d02a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:41.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.608+0000 7fc88d02a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:41.610 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.608+0000 7fc88d02a9c0 5 note: GC not initialized 2024-09-12T18:49:41.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.608+0000 7fc6bbfff640 20 reqs_thread_entry: start 2024-09-12T18:49:41.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.608+0000 7fc88d02a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:41.611 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.608+0000 7fc88d02a9c0 20 Filter name: none 2024-09-12T18:49:41.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.612+0000 7fc6b9ffb640 20 reqs_thread_entry: start 2024-09-12T18:49:41.612 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.612+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.612+0000 7fc88d02a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:41.613 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.612+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.612+0000 7fc88d02a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:41.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.612+0000 7fc88d02a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:41.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.612+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.614 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.612+0000 7fc88d02a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:41.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.612+0000 7fc88d02a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.612+0000 7fc88d02a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:41.615 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.612+0000 7fc88d02a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:41.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.616+0000 7fc7417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:41.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.620+0000 7fc88d02a9c0 20 remove_watcher() i=0 2024-09-12T18:49:41.623 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.620+0000 7fc88d02a9c0 2 removed watcher, disabling cache 2024-09-12T18:49:41.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.624+0000 7fc88d02a9c0 20 remove_watcher() i=1 2024-09-12T18:49:41.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.628+0000 7fc88d02a9c0 20 remove_watcher() i=2 2024-09-12T18:49:41.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.628+0000 7fc88d02a9c0 20 remove_watcher() i=3 2024-09-12T18:49:41.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.632+0000 7fc88d02a9c0 20 remove_watcher() i=4 2024-09-12T18:49:41.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.632+0000 7fc88d02a9c0 20 remove_watcher() i=5 2024-09-12T18:49:41.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.632+0000 7fc88d02a9c0 20 remove_watcher() i=6 2024-09-12T18:49:41.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.636+0000 7fc88d02a9c0 20 remove_watcher() i=7 2024-09-12T18:49:41.650 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:41.651 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:49:41.651 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-change-reshard-state id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:49:41.651 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:41.651 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T18:49:41.684 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:41.684 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:41.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.728+0000 7fc490a019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.728+0000 7fc490a019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:41.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.728+0000 7fc490a019c0 20 realm 2024-09-12T18:49:41.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.728+0000 7fc490a019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.728+0000 7fc490a019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:41.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.728+0000 7fc490a019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:41.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.728+0000 7fc490a019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.728+0000 7fc490a019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:41.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.728+0000 7fc490a019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.728+0000 7fc490a019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:41.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.728+0000 7fc490a019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.732+0000 7fc490a019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:41.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.732+0000 7fc490a019c0 20 searching for the correct realm 2024-09-12T18:49:41.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.736+0000 7fc48ed08640 0 -- 172.21.15.111:0/3637652099 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fc4840785c0 msgr2=0x7fc484085400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:41.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.740+0000 7fc48dd06640 0 -- 172.21.15.111:0/3637652099 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fc48804a950 msgr2=0x7fc48801a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:41.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.956+0000 7fc490a019c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:41.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.956+0000 7fc490a019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:41.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.956+0000 7fc490a019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:41.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.956+0000 7fc490a019c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:41.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.956+0000 7fc490a019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:41.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.956+0000 7fc490a019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:41.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.956+0000 7fc490a019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.956+0000 7fc490a019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:41.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.956+0000 7fc490a019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.956+0000 7fc490a019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:41.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.956+0000 7fc490a019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.956+0000 7fc490a019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:41.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.956+0000 7fc490a019c0 20 zone default found 2024-09-12T18:49:41.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.960+0000 7fc490a019c0 4 Realm: () 2024-09-12T18:49:41.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.960+0000 7fc490a019c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:41.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.960+0000 7fc490a019c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:41.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.960+0000 7fc490a019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:41.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.960+0000 7fc490a019c0 20 zonegroup default 2024-09-12T18:49:41.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.960+0000 7fc490a019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.960 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.960+0000 7fc490a019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:41.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.960+0000 7fc490a019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.960+0000 7fc490a019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:41.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.960+0000 7fc490a019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.960+0000 7fc490a019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:41.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.960+0000 7fc490a019c0 20 started sync module instance, tier type = 2024-09-12T18:49:41.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.960+0000 7fc490a019c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:41.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.984+0000 7fc490a019c0 20 add_watcher() i=0 2024-09-12T18:49:41.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.984+0000 7fc490a019c0 20 add_watcher() i=1 2024-09-12T18:49:41.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.984+0000 7fc490a019c0 20 add_watcher() i=2 2024-09-12T18:49:41.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.984+0000 7fc490a019c0 20 add_watcher() i=3 2024-09-12T18:49:41.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.984+0000 7fc490a019c0 20 add_watcher() i=4 2024-09-12T18:49:41.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.984+0000 7fc490a019c0 20 add_watcher() i=5 2024-09-12T18:49:41.987 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.984+0000 7fc490a019c0 20 add_watcher() i=6 2024-09-12T18:49:41.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.988+0000 7fc490a019c0 20 add_watcher() i=7 2024-09-12T18:49:41.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.988+0000 7fc490a019c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:41.992 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.992+0000 7fc344fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:41.994 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.992+0000 7fc490a019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:41.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.992+0000 7fc490a019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:41.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.992+0000 7fc490a019c0 5 note: GC not initialized 2024-09-12T18:49:41.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.992+0000 7fc2bf7fe640 20 reqs_thread_entry: start 2024-09-12T18:49:41.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.992+0000 7fc490a019c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:41.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.992+0000 7fc490a019c0 20 Filter name: none 2024-09-12T18:49:41.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.992+0000 7fc2bd7fa640 20 reqs_thread_entry: start 2024-09-12T18:49:41.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.992+0000 7fc490a019c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T18:49:41.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.992+0000 7fc490a019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.996+0000 7fc490a019c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:41.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.996+0000 7fc490a019c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T18:49:41.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.996+0000 7fc490a019c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T18:49:41.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.996+0000 7fc490a019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 : miss 2024-09-12T18:49:41.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.996+0000 7fc490a019c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:41.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.996+0000 7fc490a019c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:41.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.996+0000 7fc490a019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 info.flags=0x17 2024-09-12T18:49:41.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.996+0000 7fc490a019c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 to cache LRU end 2024-09-12T18:49:41.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.996+0000 7fc490a019c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:41.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.996+0000 7fc490a019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:41.997 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:41.996+0000 7fc490a019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 2024-09-12T18:49:42.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.004+0000 7fc490a019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 info.flags=0x17 2024-09-12T18:49:42.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.004+0000 7fc490a019c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 to cache LRU end 2024-09-12T18:49:42.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.004+0000 7fc490a019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:42.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.004+0000 7fc490a019c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37, ofs0, ns] 2024-09-12T18:49:42.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.008+0000 7fc371ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431667 cookie 94170510018288 notifier 7920 bl.length()=931 2024-09-12T18:49:42.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.008+0000 7fc371ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 info.flags=0x17 2024-09-12T18:49:42.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.008+0000 7fc371ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 to cache LRU end 2024-09-12T18:49:42.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.008+0000 7fc371ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:42.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.008+0000 7fc490a019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): orig_sources= new_sources= 2024-09-12T18:49:42.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.008+0000 7fc490a019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): potential sources added=[] removed=[] 2024-09-12T18:49:42.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.008+0000 7fc490a019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): orig_dests= new_dests= 2024-09-12T18:49:42.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.008+0000 7fc490a019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): potential dests added=[] removed=[] 2024-09-12T18:49:42.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.0 2024-09-12T18:49:42.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.0 2024-09-12T18:49:42.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.1 2024-09-12T18:49:42.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.1 2024-09-12T18:49:42.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.2 2024-09-12T18:49:42.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.2 2024-09-12T18:49:42.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.3 2024-09-12T18:49:42.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.3 2024-09-12T18:49:42.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.4 2024-09-12T18:49:42.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.4 2024-09-12T18:49:42.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.5 2024-09-12T18:49:42.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.5 2024-09-12T18:49:42.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.6 2024-09-12T18:49:42.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.6 2024-09-12T18:49:42.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.7 2024-09-12T18:49:42.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.7 2024-09-12T18:49:42.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.8 2024-09-12T18:49:42.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.8 2024-09-12T18:49:42.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.9 2024-09-12T18:49:42.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.9 2024-09-12T18:49:42.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.10 2024-09-12T18:49:42.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.10 2024-09-12T18:49:42.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.11 2024-09-12T18:49:42.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.11 2024-09-12T18:49:42.021 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.0 2024-09-12T18:49:42.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.016+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1 2024-09-12T18:49:42.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.020+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.2 2024-09-12T18:49:42.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.020+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.3 2024-09-12T18:49:42.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.020+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.4 2024-09-12T18:49:42.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.020+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.5 2024-09-12T18:49:42.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.020+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.6 2024-09-12T18:49:42.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.024+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.7 2024-09-12T18:49:42.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.024+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.8 2024-09-12T18:49:42.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.024+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.9 2024-09-12T18:49:42.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.024+0000 7fc490a019c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.10 2024-09-12T18:49:42.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.032+0000 7fc490a019c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T18:49:42.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.032+0000 7fc490a019c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T18:49:42.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.048+0000 7fc490a019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 : hit (requested=0x17, cached=0x17) 2024-09-12T18:49:42.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.048+0000 7fc490a019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 2024-09-12T18:49:42.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.052+0000 7fc490a019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 info.flags=0x17 2024-09-12T18:49:42.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.052+0000 7fc490a019c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 to cache LRU end 2024-09-12T18:49:42.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.052+0000 7fc490a019c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:42.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.052+0000 7fc490a019c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37, ofs0, ns] 2024-09-12T18:49:42.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.052+0000 7fc371ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431668 cookie 94170510018288 notifier 7920 bl.length()=899 2024-09-12T18:49:42.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.052+0000 7fc371ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 info.flags=0x17 2024-09-12T18:49:42.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.052+0000 7fc371ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 to cache LRU end 2024-09-12T18:49:42.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.052+0000 7fc371ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:42.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.052+0000 7fc490a019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): orig_sources= new_sources= 2024-09-12T18:49:42.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.052+0000 7fc490a019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): potential sources added=[] removed=[] 2024-09-12T18:49:42.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.052+0000 7fc490a019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): orig_dests= new_dests= 2024-09-12T18:49:42.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.052+0000 7fc490a019c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): potential dests added=[] removed=[] 2024-09-12T18:49:42.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.052+0000 7fc490a019c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T18:49:42.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.056+0000 7fc344fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:42.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.060+0000 7fc490a019c0 20 remove_watcher() i=0 2024-09-12T18:49:42.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.060+0000 7fc490a019c0 2 removed watcher, disabling cache 2024-09-12T18:49:42.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.064+0000 7fc490a019c0 20 remove_watcher() i=1 2024-09-12T18:49:42.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.064+0000 7fc490a019c0 20 remove_watcher() i=2 2024-09-12T18:49:42.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.068+0000 7fc490a019c0 20 remove_watcher() i=3 2024-09-12T18:49:42.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.068+0000 7fc490a019c0 20 remove_watcher() i=4 2024-09-12T18:49:42.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.072+0000 7fc490a019c0 20 remove_watcher() i=5 2024-09-12T18:49:42.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.072+0000 7fc490a019c0 20 remove_watcher() i=6 2024-09-12T18:49:42.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.072+0000 7fc490a019c0 20 remove_watcher() i=7 2024-09-12T18:49:42.093 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:49:42.123 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:42.124 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:42.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.168+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.168+0000 7fdbdc4d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:42.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.168+0000 7fdbdc4d69c0 20 realm 2024-09-12T18:49:42.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.168+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.172+0000 7fdbdc4d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:42.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.172+0000 7fdbdc4d69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:42.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.172+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.172+0000 7fdbdc4d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:42.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.172+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.172+0000 7fdbdc4d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:42.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.172+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.172+0000 7fdbdc4d69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:42.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.172+0000 7fdbdc4d69c0 20 searching for the correct realm 2024-09-12T18:49:42.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.176+0000 7fdbda7dd640 0 -- 172.21.15.111:0/210324171 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fdbd001a040 msgr2=0x7fdbd0046ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:42.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.184+0000 7fdbd97db640 0 -- 172.21.15.111:0/210324171 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fdbcc0c1c20 msgr2=0x7fdbcc0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:42.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.400+0000 7fdbdc4d69c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:42.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.400+0000 7fdbdc4d69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:42.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.400+0000 7fdbdc4d69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:42.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.400+0000 7fdbdc4d69c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:42.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.400+0000 7fdbdc4d69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:42.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.400+0000 7fdbdc4d69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:42.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.400+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.400+0000 7fdbdc4d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:42.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.400+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:42.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:42.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 20 zone default found 2024-09-12T18:49:42.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 4 Realm: () 2024-09-12T18:49:42.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:42.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:42.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:42.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 20 zonegroup default 2024-09-12T18:49:42.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:42.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:42.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:42.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 20 started sync module instance, tier type = 2024-09-12T18:49:42.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.404+0000 7fdbdc4d69c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:42.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.428+0000 7fdbdc4d69c0 20 add_watcher() i=0 2024-09-12T18:49:42.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.428+0000 7fdbdc4d69c0 20 add_watcher() i=1 2024-09-12T18:49:42.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.428+0000 7fdbdc4d69c0 20 add_watcher() i=2 2024-09-12T18:49:42.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.428+0000 7fdbdc4d69c0 20 add_watcher() i=3 2024-09-12T18:49:42.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.428+0000 7fdbdc4d69c0 20 add_watcher() i=4 2024-09-12T18:49:42.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.428+0000 7fdbdc4d69c0 20 add_watcher() i=5 2024-09-12T18:49:42.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.428+0000 7fdbdc4d69c0 20 add_watcher() i=6 2024-09-12T18:49:42.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.432+0000 7fdbdc4d69c0 20 add_watcher() i=7 2024-09-12T18:49:42.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.432+0000 7fdbdc4d69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:42.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.436+0000 7fda8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:42.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.436+0000 7fdbdc4d69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:42.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.436+0000 7fdbdc4d69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:42.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.436+0000 7fdbdc4d69c0 5 note: GC not initialized 2024-09-12T18:49:42.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.436+0000 7fda8a7fc640 20 reqs_thread_entry: start 2024-09-12T18:49:42.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.436+0000 7fdbdc4d69c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:42.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.436+0000 7fdbdc4d69c0 20 Filter name: none 2024-09-12T18:49:42.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.440+0000 7fd9fbfff640 20 reqs_thread_entry: start 2024-09-12T18:49:42.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.440+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.440+0000 7fdbdc4d69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:42.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.440+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.440+0000 7fdbdc4d69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:42.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.440+0000 7fdbdc4d69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:42.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.440+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.440+0000 7fdbdc4d69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:42.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.440+0000 7fdbdc4d69c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.440+0000 7fdbdc4d69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:42.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.440+0000 7fdbdc4d69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:42.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.444+0000 7fda8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:42.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.448+0000 7fdbdc4d69c0 20 remove_watcher() i=0 2024-09-12T18:49:42.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.448+0000 7fdbdc4d69c0 2 removed watcher, disabling cache 2024-09-12T18:49:42.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.452+0000 7fdbdc4d69c0 20 remove_watcher() i=1 2024-09-12T18:49:42.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.456+0000 7fdbdc4d69c0 20 remove_watcher() i=2 2024-09-12T18:49:42.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.456+0000 7fdbdc4d69c0 20 remove_watcher() i=3 2024-09-12T18:49:42.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.460+0000 7fdbdc4d69c0 20 remove_watcher() i=4 2024-09-12T18:49:42.462 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.460+0000 7fdbdc4d69c0 20 remove_watcher() i=5 2024-09-12T18:49:42.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.464+0000 7fdbdc4d69c0 20 remove_watcher() i=6 2024-09-12T18:49:42.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.464+0000 7fdbdc4d69c0 20 remove_watcher() i=7 2024-09-12T18:49:42.481 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:42.481 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:49:42.482 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-change-reshard-state id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:49:42.482 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:42.482 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:42.482 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:42.493 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:42.493 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:42.537 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:49:42.575 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:42.576 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:42.624 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.620+0000 7fb0434299c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.624+0000 7fb0434299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:42.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.624+0000 7fb0434299c0 20 realm 2024-09-12T18:49:42.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.624+0000 7fb0434299c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.625 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.624+0000 7fb0434299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:42.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.624+0000 7fb0434299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:42.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.624+0000 7fb0434299c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.624+0000 7fb0434299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:42.626 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.624+0000 7fb0434299c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.624+0000 7fb0434299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:42.627 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.624+0000 7fb0434299c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.628+0000 7fb0434299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:42.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.628+0000 7fb0434299c0 20 searching for the correct realm 2024-09-12T18:49:42.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.632+0000 7fb041730640 0 -- 172.21.15.111:0/2510939100 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fb028079c20 msgr2=0x7fb028062110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:42.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.840+0000 7fb041730640 0 -- 172.21.15.111:0/2510939100 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7faf0c080a00 msgr2=0x7faf0c082e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:42.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.856+0000 7fb0434299c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:42.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.856+0000 7fb0434299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:42.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.856+0000 7fb0434299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:42.857 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.856+0000 7fb0434299c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:42.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.856+0000 7fb0434299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:42.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.856+0000 7fb0434299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:42.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.856+0000 7fb0434299c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.856+0000 7fb0434299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:42.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.856+0000 7fb0434299c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.856+0000 7fb0434299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:42.859 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.856+0000 7fb0434299c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:42.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 20 zone default found 2024-09-12T18:49:42.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 4 Realm: () 2024-09-12T18:49:42.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:42.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:42.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:42.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 20 zonegroup default 2024-09-12T18:49:42.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:42.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:42.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:42.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 20 started sync module instance, tier type = 2024-09-12T18:49:42.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.860+0000 7fb0434299c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:42.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.884+0000 7fb0434299c0 20 add_watcher() i=0 2024-09-12T18:49:42.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.884+0000 7fb0434299c0 20 add_watcher() i=1 2024-09-12T18:49:42.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.884+0000 7fb0434299c0 20 add_watcher() i=2 2024-09-12T18:49:42.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.884+0000 7fb0434299c0 20 add_watcher() i=3 2024-09-12T18:49:42.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.884+0000 7fb0434299c0 20 add_watcher() i=4 2024-09-12T18:49:42.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.884+0000 7fb0434299c0 20 add_watcher() i=5 2024-09-12T18:49:42.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.884+0000 7fb0434299c0 20 add_watcher() i=6 2024-09-12T18:49:42.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.888+0000 7fb0434299c0 20 add_watcher() i=7 2024-09-12T18:49:42.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.888+0000 7fb0434299c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:42.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7faef6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:42.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:42.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:42.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 5 note: GC not initialized 2024-09-12T18:49:42.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7faef5fe3640 20 reqs_thread_entry: start 2024-09-12T18:49:42.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:42.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 20 Filter name: none 2024-09-12T18:49:42.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fae677fe640 20 reqs_thread_entry: start 2024-09-12T18:49:42.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T18:49:42.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:42.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T18:49:42.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T18:49:42.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 : miss 2024-09-12T18:49:42.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:42.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:42.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 info.flags=0x17 2024-09-12T18:49:42.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 to cache LRU end 2024-09-12T18:49:42.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:42.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:42.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.892+0000 7fb0434299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 2024-09-12T18:49:42.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.904+0000 7fb0434299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 info.flags=0x17 2024-09-12T18:49:42.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.904+0000 7fb0434299c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 to cache LRU end 2024-09-12T18:49:42.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.904+0000 7fb0434299c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:42.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.904+0000 7fb0434299c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37, ofs0, ns] 2024-09-12T18:49:42.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.904+0000 7faf177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431669 cookie 94550008465824 notifier 7424 bl.length()=931 2024-09-12T18:49:42.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.904+0000 7faf177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 info.flags=0x17 2024-09-12T18:49:42.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.904+0000 7faf177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 to cache LRU end 2024-09-12T18:49:42.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.904+0000 7faf177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:42.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.904+0000 7fb0434299c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): orig_sources= new_sources= 2024-09-12T18:49:42.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.904+0000 7fb0434299c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): potential sources added=[] removed=[] 2024-09-12T18:49:42.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.904+0000 7fb0434299c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): orig_dests= new_dests= 2024-09-12T18:49:42.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.904+0000 7fb0434299c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): potential dests added=[] removed=[] 2024-09-12T18:49:42.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.0 2024-09-12T18:49:42.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.0 2024-09-12T18:49:42.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.1 2024-09-12T18:49:42.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.1 2024-09-12T18:49:42.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.2 2024-09-12T18:49:42.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.2 2024-09-12T18:49:42.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.3 2024-09-12T18:49:42.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.3 2024-09-12T18:49:42.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.4 2024-09-12T18:49:42.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.4 2024-09-12T18:49:42.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.5 2024-09-12T18:49:42.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.5 2024-09-12T18:49:42.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.6 2024-09-12T18:49:42.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.6 2024-09-12T18:49:42.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.7 2024-09-12T18:49:42.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.7 2024-09-12T18:49:42.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.8 2024-09-12T18:49:42.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.8 2024-09-12T18:49:42.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.9 2024-09-12T18:49:42.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.9 2024-09-12T18:49:42.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.10 2024-09-12T18:49:42.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.10 2024-09-12T18:49:42.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.11 2024-09-12T18:49:42.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1.11 2024-09-12T18:49:42.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.0 2024-09-12T18:49:42.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1 2024-09-12T18:49:42.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.920+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.2 2024-09-12T18:49:42.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.924+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.3 2024-09-12T18:49:42.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.924+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.4 2024-09-12T18:49:42.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.924+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.5 2024-09-12T18:49:42.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.924+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.6 2024-09-12T18:49:42.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.924+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.7 2024-09-12T18:49:42.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.924+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.8 2024-09-12T18:49:42.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.928+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.9 2024-09-12T18:49:42.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.928+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.10 2024-09-12T18:49:42.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.936+0000 7fb0434299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 : hit (requested=0x17, cached=0x17) 2024-09-12T18:49:42.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.936+0000 7fb0434299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 2024-09-12T18:49:42.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.936+0000 7fb0434299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 info.flags=0x17 2024-09-12T18:49:42.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.936+0000 7fb0434299c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 to cache LRU end 2024-09-12T18:49:42.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.936+0000 7fb0434299c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:42.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.936+0000 7fb0434299c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37, ofs0, ns] 2024-09-12T18:49:42.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.936+0000 7faf17fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431670 cookie 94550008465824 notifier 7424 bl.length()=931 2024-09-12T18:49:42.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.936+0000 7faf17fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 info.flags=0x17 2024-09-12T18:49:42.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.936+0000 7faf17fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 to cache LRU end 2024-09-12T18:49:42.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.936+0000 7faf17fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:42.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.936+0000 7fb0434299c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): orig_sources= new_sources= 2024-09-12T18:49:42.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.936+0000 7fb0434299c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): potential sources added=[] removed=[] 2024-09-12T18:49:42.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.936+0000 7fb0434299c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): orig_dests= new_dests= 2024-09-12T18:49:42.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.936+0000 7fb0434299c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): potential dests added=[] removed=[] 2024-09-12T18:49:42.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.944+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.0 2024-09-12T18:49:42.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.944+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.1 2024-09-12T18:49:42.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.944+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.2 2024-09-12T18:49:42.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.944+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.3 2024-09-12T18:49:42.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.944+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.4 2024-09-12T18:49:42.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.948+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.5 2024-09-12T18:49:42.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.948+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.6 2024-09-12T18:49:42.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.948+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.7 2024-09-12T18:49:42.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.948+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.8 2024-09-12T18:49:42.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.948+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.9 2024-09-12T18:49:42.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.948+0000 7fb0434299c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.37.10 2024-09-12T18:49:42.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.948+0000 7fb0434299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 : hit (requested=0x17, cached=0x17) 2024-09-12T18:49:42.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.948+0000 7fb0434299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 2024-09-12T18:49:42.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.952+0000 7fb0434299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 info.flags=0x17 2024-09-12T18:49:42.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.952+0000 7fb0434299c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 to cache LRU end 2024-09-12T18:49:42.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.952+0000 7fb0434299c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:42.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.952+0000 7fb0434299c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37, ofs0, ns] 2024-09-12T18:49:42.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.952+0000 7faf177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431671 cookie 94550008465824 notifier 7424 bl.length()=899 2024-09-12T18:49:42.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.952+0000 7faf177fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 info.flags=0x17 2024-09-12T18:49:42.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.952+0000 7faf177fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.37 to cache LRU end 2024-09-12T18:49:42.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.952+0000 7faf177fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:42.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.952+0000 7fb0434299c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): orig_sources= new_sources= 2024-09-12T18:49:42.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.952+0000 7fb0434299c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): potential sources added=[] removed=[] 2024-09-12T18:49:42.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.952+0000 7fb0434299c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): orig_dests= new_dests= 2024-09-12T18:49:42.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.952+0000 7fb0434299c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.37]): potential dests added=[] removed=[] 2024-09-12T18:49:42.959 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.956+0000 7fb0434299c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T18:49:42.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.960+0000 7faef6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:42.967 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.964+0000 7fb0434299c0 20 remove_watcher() i=0 2024-09-12T18:49:42.967 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.964+0000 7fb0434299c0 2 removed watcher, disabling cache 2024-09-12T18:49:42.969 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.968+0000 7fb0434299c0 20 remove_watcher() i=1 2024-09-12T18:49:42.971 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.968+0000 7fb0434299c0 20 remove_watcher() i=2 2024-09-12T18:49:42.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.972+0000 7fb0434299c0 20 remove_watcher() i=3 2024-09-12T18:49:42.975 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.972+0000 7fb0434299c0 20 remove_watcher() i=4 2024-09-12T18:49:42.976 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.976+0000 7fb0434299c0 20 remove_watcher() i=5 2024-09-12T18:49:42.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.976+0000 7fb0434299c0 20 remove_watcher() i=6 2024-09-12T18:49:42.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:42.976+0000 7fb0434299c0 20 remove_watcher() i=7 2024-09-12T18:49:42.996 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:49:43.025 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:43.025 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:43.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.068+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.072+0000 7f532d4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:43.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.072+0000 7f532d4cd9c0 20 realm 2024-09-12T18:49:43.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.072+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.072+0000 7f532d4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:43.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.072+0000 7f532d4cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:43.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.072+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.072+0000 7f532d4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:43.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.072+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.072+0000 7f532d4cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:43.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.072+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.076+0000 7f532d4cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:43.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.076+0000 7f532d4cd9c0 20 searching for the correct realm 2024-09-12T18:49:43.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.080+0000 7f532afd3640 0 -- 172.21.15.111:0/1409131145 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f532401abb0 msgr2=0x7f532402b3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:43.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.088+0000 7f532a7d2640 0 -- 172.21.15.111:0/1409131145 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f532400d8c0 msgr2=0x7f532403a3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:49:43.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.304+0000 7f532d4cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:43.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.304+0000 7f532d4cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:43.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.304+0000 7f532d4cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:43.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.304+0000 7f532d4cd9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:43.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.304+0000 7f532d4cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:43.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.304+0000 7f532d4cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:43.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.304+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.304+0000 7f532d4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:43.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.304+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.308+0000 7f532d4cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:43.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.308+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.308+0000 7f532d4cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:43.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.308+0000 7f532d4cd9c0 20 zone default found 2024-09-12T18:49:43.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.308+0000 7f532d4cd9c0 4 Realm: () 2024-09-12T18:49:43.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.308+0000 7f532d4cd9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:43.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.308+0000 7f532d4cd9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:43.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.308+0000 7f532d4cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:43.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.308+0000 7f532d4cd9c0 20 zonegroup default 2024-09-12T18:49:43.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.308+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.308+0000 7f532d4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:43.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.308+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.312+0000 7f532d4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:43.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.312+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.312+0000 7f532d4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:43.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.312+0000 7f532d4cd9c0 20 started sync module instance, tier type = 2024-09-12T18:49:43.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.312+0000 7f532d4cd9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:43.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.336+0000 7f532d4cd9c0 20 add_watcher() i=0 2024-09-12T18:49:43.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.336+0000 7f532d4cd9c0 20 add_watcher() i=1 2024-09-12T18:49:43.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.336+0000 7f532d4cd9c0 20 add_watcher() i=2 2024-09-12T18:49:43.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.336+0000 7f532d4cd9c0 20 add_watcher() i=3 2024-09-12T18:49:43.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.336+0000 7f532d4cd9c0 20 add_watcher() i=4 2024-09-12T18:49:43.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.336+0000 7f532d4cd9c0 20 add_watcher() i=5 2024-09-12T18:49:43.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.336+0000 7f532d4cd9c0 20 add_watcher() i=6 2024-09-12T18:49:43.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.340+0000 7f532d4cd9c0 20 add_watcher() i=7 2024-09-12T18:49:43.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.340+0000 7f532d4cd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:43.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.344+0000 7f51e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:43.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.344+0000 7f532d4cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:43.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.344+0000 7f532d4cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:43.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.344+0000 7f532d4cd9c0 5 note: GC not initialized 2024-09-12T18:49:43.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.344+0000 7f515bfff640 20 reqs_thread_entry: start 2024-09-12T18:49:43.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.344+0000 7f532d4cd9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:43.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.344+0000 7f532d4cd9c0 20 Filter name: none 2024-09-12T18:49:43.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.344+0000 7f5159ffb640 20 reqs_thread_entry: start 2024-09-12T18:49:43.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.344+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.348+0000 7f532d4cd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:43.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.348+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.348+0000 7f532d4cd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:43.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.348+0000 7f532d4cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:43.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.348+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.348+0000 7f532d4cd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:43.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.348+0000 7f532d4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:43.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.348+0000 7f532d4cd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:43.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.348+0000 7f532d4cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:43.353 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.352+0000 7f51e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:43.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.356+0000 7f532d4cd9c0 20 remove_watcher() i=0 2024-09-12T18:49:43.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.356+0000 7f532d4cd9c0 2 removed watcher, disabling cache 2024-09-12T18:49:43.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.360+0000 7f532d4cd9c0 20 remove_watcher() i=1 2024-09-12T18:49:43.363 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.360+0000 7f532d4cd9c0 20 remove_watcher() i=2 2024-09-12T18:49:43.365 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.364+0000 7f532d4cd9c0 20 remove_watcher() i=3 2024-09-12T18:49:43.368 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.368+0000 7f532d4cd9c0 20 remove_watcher() i=4 2024-09-12T18:49:43.369 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.368+0000 7f532d4cd9c0 20 remove_watcher() i=5 2024-09-12T18:49:43.371 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.368+0000 7f532d4cd9c0 20 remove_watcher() i=6 2024-09-12T18:49:43.372 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:43.372+0000 7f532d4cd9c0 20 remove_watcher() i=7 2024-09-12T18:49:43.388 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:43.389 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:49:43.389 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-change-reshard-state id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:49:43.389 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:43.390 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.390 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.393 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.393 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.442 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.442 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.501 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T18:49:43.502 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:43.502 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.502 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.522 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.522 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.575 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.575 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.594 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.594 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.613 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.613 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.632 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.632 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.650 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.650 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.668 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.668 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.687 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.687 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.707 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.707 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.725 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.725 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.744 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.744 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.761 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.761 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.780 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.780 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.797 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.798 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.818 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.818 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.836 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.836 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.855 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.855 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.874 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.874 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.894 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.894 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.912 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.913 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.932 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:43.932 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:43.948 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:49:43.982 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:43.982 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:44.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.024+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.028+0000 7f4cb10069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:44.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.028+0000 7f4cb10069c0 20 realm 2024-09-12T18:49:44.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.028+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.028+0000 7f4cb10069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:44.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.028+0000 7f4cb10069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:44.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.028+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.028+0000 7f4cb10069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:44.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.028+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.032+0000 7f4cb10069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:44.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.032+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.032+0000 7f4cb10069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:44.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.032+0000 7f4cb10069c0 20 searching for the correct realm 2024-09-12T18:49:44.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.036+0000 7f4caf30d640 0 -- 172.21.15.111:0/3690570432 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f4ca4042070 msgr2=0x7f4ca402c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:44.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.252+0000 7f4cae30b640 0 -- 172.21.15.111:0/3690570432 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f4ca8114b70 msgr2=0x7f4ca80fd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:44.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.468+0000 7f4cb10069c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:44.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.468+0000 7f4cb10069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:44.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.468+0000 7f4cb10069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:44.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.468+0000 7f4cb10069c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:44.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.468+0000 7f4cb10069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:44.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.468+0000 7f4cb10069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:44.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.468+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.468+0000 7f4cb10069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:44.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.468+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.472+0000 7f4cb10069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:44.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.472+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.472+0000 7f4cb10069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:44.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.472+0000 7f4cb10069c0 20 zone default found 2024-09-12T18:49:44.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.472+0000 7f4cb10069c0 4 Realm: () 2024-09-12T18:49:44.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.472+0000 7f4cb10069c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:44.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.472+0000 7f4cb10069c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:44.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.472+0000 7f4cb10069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:44.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.472+0000 7f4cb10069c0 20 zonegroup default 2024-09-12T18:49:44.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.472+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.472+0000 7f4cb10069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:44.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.472+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.476+0000 7f4cb10069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:44.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.476+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.476+0000 7f4cb10069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:44.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.476+0000 7f4cb10069c0 20 started sync module instance, tier type = 2024-09-12T18:49:44.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.476+0000 7f4cb10069c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:44.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.500+0000 7f4cb10069c0 20 add_watcher() i=0 2024-09-12T18:49:44.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.500+0000 7f4cb10069c0 20 add_watcher() i=1 2024-09-12T18:49:44.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.500+0000 7f4cb10069c0 20 add_watcher() i=2 2024-09-12T18:49:44.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.500+0000 7f4cb10069c0 20 add_watcher() i=3 2024-09-12T18:49:44.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.500+0000 7f4cb10069c0 20 add_watcher() i=4 2024-09-12T18:49:44.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.500+0000 7f4cb10069c0 20 add_watcher() i=5 2024-09-12T18:49:44.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.500+0000 7f4cb10069c0 20 add_watcher() i=6 2024-09-12T18:49:44.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.500+0000 7f4cb10069c0 20 add_watcher() i=7 2024-09-12T18:49:44.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.500+0000 7f4cb10069c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:44.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.504+0000 7f4b657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:44.508 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.508+0000 7f4cb10069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:44.508 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.508+0000 7f4cb10069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:44.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.508+0000 7f4cb10069c0 5 note: GC not initialized 2024-09-12T18:49:44.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.508+0000 7f4adffff640 20 reqs_thread_entry: start 2024-09-12T18:49:44.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.508+0000 7f4cb10069c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:44.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.508+0000 7f4cb10069c0 20 Filter name: none 2024-09-12T18:49:44.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.508+0000 7f4addffb640 20 reqs_thread_entry: start 2024-09-12T18:49:44.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.508+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.508+0000 7f4cb10069c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:44.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.508+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.512+0000 7f4cb10069c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:44.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.512+0000 7f4cb10069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:44.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.512+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.512+0000 7f4cb10069c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:44.514 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.512+0000 7f4cb10069c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.512+0000 7f4cb10069c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:44.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.512+0000 7f4cb10069c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:44.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.516+0000 7f4b657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:44.523 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.520+0000 7f4cb10069c0 20 remove_watcher() i=0 2024-09-12T18:49:44.523 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.520+0000 7f4cb10069c0 2 removed watcher, disabling cache 2024-09-12T18:49:44.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.524+0000 7f4cb10069c0 20 remove_watcher() i=1 2024-09-12T18:49:44.527 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.528+0000 7f4cb10069c0 20 remove_watcher() i=2 2024-09-12T18:49:44.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.528+0000 7f4cb10069c0 20 remove_watcher() i=3 2024-09-12T18:49:44.532 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.532+0000 7f4cb10069c0 20 remove_watcher() i=4 2024-09-12T18:49:44.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.532+0000 7f4cb10069c0 20 remove_watcher() i=5 2024-09-12T18:49:44.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.536+0000 7f4cb10069c0 20 remove_watcher() i=6 2024-09-12T18:49:44.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.536+0000 7f4cb10069c0 20 remove_watcher() i=7 2024-09-12T18:49:44.553 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:44.553 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:49:44.553 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-change-reshard-state id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:49:44.554 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:44.554 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T18:49:44.590 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:44.590 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:44.634 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.632+0000 7f31fabd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.632+0000 7f31fabd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:44.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.632+0000 7f31fabd79c0 20 realm 2024-09-12T18:49:44.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.632+0000 7f31fabd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.632+0000 7f31fabd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:44.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.632+0000 7f31fabd79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:44.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.636+0000 7f31fabd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.636+0000 7f31fabd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:44.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.636+0000 7f31fabd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.636+0000 7f31fabd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:44.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.636+0000 7f31fabd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.636+0000 7f31fabd79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:44.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.636+0000 7f31fabd79c0 20 searching for the correct realm 2024-09-12T18:49:44.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.640+0000 7f31f8ede640 0 -- 172.21.15.111:0/302219502 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f31ec023400 msgr2=0x7f31ec023840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:44.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.648+0000 7f31f7edc640 0 -- 172.21.15.111:0/302219502 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f31f0018040 msgr2=0x7f31f006cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:44.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.864+0000 7f31fabd79c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:44.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.864+0000 7f31fabd79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:44.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.864+0000 7f31fabd79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:44.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.864+0000 7f31fabd79c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:44.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.864+0000 7f31fabd79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:44.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.864+0000 7f31fabd79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:44.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.864+0000 7f31fabd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:44.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:44.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:44.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 20 zone default found 2024-09-12T18:49:44.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 4 Realm: () 2024-09-12T18:49:44.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:44.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:44.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:44.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 20 zonegroup default 2024-09-12T18:49:44.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:44.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:44.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.868+0000 7f31fabd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.872+0000 7f31fabd79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:44.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.872+0000 7f31fabd79c0 20 started sync module instance, tier type = 2024-09-12T18:49:44.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.872+0000 7f31fabd79c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:44.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.892+0000 7f31fabd79c0 20 add_watcher() i=0 2024-09-12T18:49:44.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.892+0000 7f31fabd79c0 20 add_watcher() i=1 2024-09-12T18:49:44.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.892+0000 7f31fabd79c0 20 add_watcher() i=2 2024-09-12T18:49:44.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.892+0000 7f31fabd79c0 20 add_watcher() i=3 2024-09-12T18:49:44.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.892+0000 7f31fabd79c0 20 add_watcher() i=4 2024-09-12T18:49:44.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.892+0000 7f31fabd79c0 20 add_watcher() i=5 2024-09-12T18:49:44.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.892+0000 7f31fabd79c0 20 add_watcher() i=6 2024-09-12T18:49:44.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.896+0000 7f31fabd79c0 20 add_watcher() i=7 2024-09-12T18:49:44.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.896+0000 7f31fabd79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:44.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f30ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:44.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f31fabd79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:44.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f31fabd79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:44.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f31fabd79c0 5 note: GC not initialized 2024-09-12T18:49:44.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f30ad7e2640 20 reqs_thread_entry: start 2024-09-12T18:49:44.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f31fabd79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:44.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f31fabd79c0 20 Filter name: none 2024-09-12T18:49:44.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f301effd640 20 reqs_thread_entry: start 2024-09-12T18:49:44.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f31fabd79c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T18:49:44.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f31fabd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f31fabd79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:44.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f31fabd79c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T18:49:44.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f31fabd79c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T18:49:44.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f31fabd79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 : miss 2024-09-12T18:49:44.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.900+0000 7f31fabd79c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:44.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.904+0000 7f31fabd79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:44.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.904+0000 7f31fabd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 info.flags=0x17 2024-09-12T18:49:44.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.904+0000 7f31fabd79c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 to cache LRU end 2024-09-12T18:49:44.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.904+0000 7f31fabd79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:44.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.904+0000 7f31fabd79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:44.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.904+0000 7f31fabd79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 2024-09-12T18:49:44.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.916+0000 7f31fabd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 info.flags=0x17 2024-09-12T18:49:44.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.916+0000 7f31fabd79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 to cache LRU end 2024-09-12T18:49:44.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.916+0000 7f31fabd79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:44.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.916+0000 7f31fabd79c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38, ofs0, ns] 2024-09-12T18:49:44.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.916+0000 7f30ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431674 cookie 94541838659008 notifier 7478 bl.length()=931 2024-09-12T18:49:44.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.916+0000 7f30ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 info.flags=0x17 2024-09-12T18:49:44.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.916+0000 7f30ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 to cache LRU end 2024-09-12T18:49:44.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.916+0000 7f30ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:44.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.916+0000 7f31fabd79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.38]): orig_sources= new_sources= 2024-09-12T18:49:44.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.916+0000 7f31fabd79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.38]): potential sources added=[] removed=[] 2024-09-12T18:49:44.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.916+0000 7f31fabd79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.38]): orig_dests= new_dests= 2024-09-12T18:49:44.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.916+0000 7f31fabd79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.38]): potential dests added=[] removed=[] 2024-09-12T18:49:44.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.0 2024-09-12T18:49:44.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.0 2024-09-12T18:49:44.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.1 2024-09-12T18:49:44.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.1 2024-09-12T18:49:44.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.2 2024-09-12T18:49:44.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.2 2024-09-12T18:49:44.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.3 2024-09-12T18:49:44.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.3 2024-09-12T18:49:44.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.4 2024-09-12T18:49:44.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.4 2024-09-12T18:49:44.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.5 2024-09-12T18:49:44.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.5 2024-09-12T18:49:44.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.6 2024-09-12T18:49:44.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.6 2024-09-12T18:49:44.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.7 2024-09-12T18:49:44.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.7 2024-09-12T18:49:44.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.8 2024-09-12T18:49:44.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.8 2024-09-12T18:49:44.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.9 2024-09-12T18:49:44.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.9 2024-09-12T18:49:44.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.10 2024-09-12T18:49:44.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.10 2024-09-12T18:49:44.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.11 2024-09-12T18:49:44.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1.11 2024-09-12T18:49:44.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.0 2024-09-12T18:49:44.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1 2024-09-12T18:49:44.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.924+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.2 2024-09-12T18:49:44.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.928+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.3 2024-09-12T18:49:44.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.928+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.4 2024-09-12T18:49:44.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.928+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.5 2024-09-12T18:49:44.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.928+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.6 2024-09-12T18:49:44.931 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.928+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.7 2024-09-12T18:49:44.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.932+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.8 2024-09-12T18:49:44.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.932+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.9 2024-09-12T18:49:44.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.932+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.10 2024-09-12T18:49:44.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.940+0000 7f31fabd79c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T18:49:44.941 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.940+0000 7f31fabd79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 : hit (requested=0x17, cached=0x17) 2024-09-12T18:49:44.942 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.940+0000 7f31fabd79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 2024-09-12T18:49:44.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.944+0000 7f31fabd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 info.flags=0x17 2024-09-12T18:49:44.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.944+0000 7f31fabd79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 to cache LRU end 2024-09-12T18:49:44.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.944+0000 7f31fabd79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:44.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.944+0000 7f31fabd79c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38, ofs0, ns] 2024-09-12T18:49:44.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.944+0000 7f30ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431675 cookie 94541838659008 notifier 7478 bl.length()=931 2024-09-12T18:49:44.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.944+0000 7f30ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 info.flags=0x17 2024-09-12T18:49:44.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.944+0000 7f30ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 to cache LRU end 2024-09-12T18:49:44.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.944+0000 7f30ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:44.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.944+0000 7f31fabd79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.38]): orig_sources= new_sources= 2024-09-12T18:49:44.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.944+0000 7f31fabd79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.38]): potential sources added=[] removed=[] 2024-09-12T18:49:44.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.944+0000 7f31fabd79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.38]): orig_dests= new_dests= 2024-09-12T18:49:44.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.944+0000 7f31fabd79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.38]): potential dests added=[] removed=[] 2024-09-12T18:49:44.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.948+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.0 2024-09-12T18:49:44.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.948+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.1 2024-09-12T18:49:44.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.948+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.2 2024-09-12T18:49:44.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.952+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.3 2024-09-12T18:49:44.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.952+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.4 2024-09-12T18:49:44.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.952+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.5 2024-09-12T18:49:44.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.952+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.6 2024-09-12T18:49:44.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.952+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.7 2024-09-12T18:49:44.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.956+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.8 2024-09-12T18:49:44.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.956+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.9 2024-09-12T18:49:44.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.956+0000 7f31fabd79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.38.10 2024-09-12T18:49:44.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.956+0000 7f31fabd79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 : hit (requested=0x17, cached=0x17) 2024-09-12T18:49:44.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.956+0000 7f31fabd79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 2024-09-12T18:49:44.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.960+0000 7f31fabd79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 info.flags=0x17 2024-09-12T18:49:44.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.960+0000 7f31fabd79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 to cache LRU end 2024-09-12T18:49:44.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.960+0000 7f31fabd79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:44.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.960+0000 7f31fabd79c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38, ofs0, ns] 2024-09-12T18:49:44.961 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.960+0000 7f30cf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431676 cookie 94541838659008 notifier 7478 bl.length()=899 2024-09-12T18:49:44.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.960+0000 7f30cf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 info.flags=0x17 2024-09-12T18:49:44.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.960+0000 7f30cf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.38 to cache LRU end 2024-09-12T18:49:44.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.960+0000 7f30cf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:44.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.960+0000 7f31fabd79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.38]): orig_sources= new_sources= 2024-09-12T18:49:44.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.960+0000 7f31fabd79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.38]): potential sources added=[] removed=[] 2024-09-12T18:49:44.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.960+0000 7f31fabd79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.38]): orig_dests= new_dests= 2024-09-12T18:49:44.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.960+0000 7f31fabd79c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.38]): potential dests added=[] removed=[] 2024-09-12T18:49:44.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.964+0000 7f31fabd79c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T18:49:44.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.968+0000 7f30ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:44.975 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.972+0000 7f31fabd79c0 20 remove_watcher() i=0 2024-09-12T18:49:44.975 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.972+0000 7f31fabd79c0 2 removed watcher, disabling cache 2024-09-12T18:49:44.977 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.976+0000 7f31fabd79c0 20 remove_watcher() i=1 2024-09-12T18:49:44.979 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.976+0000 7f31fabd79c0 20 remove_watcher() i=2 2024-09-12T18:49:44.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.980+0000 7f31fabd79c0 20 remove_watcher() i=3 2024-09-12T18:49:44.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.980+0000 7f31fabd79c0 20 remove_watcher() i=4 2024-09-12T18:49:44.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.984+0000 7f31fabd79c0 20 remove_watcher() i=5 2024-09-12T18:49:44.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.984+0000 7f31fabd79c0 20 remove_watcher() i=6 2024-09-12T18:49:44.988 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:44.988+0000 7f31fabd79c0 20 remove_watcher() i=7 2024-09-12T18:49:45.005 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T18:49:45.032 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:45.032 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:45.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.076+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.076+0000 7f95525929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:45.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.076+0000 7f95525929c0 20 realm 2024-09-12T18:49:45.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.076+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.076+0000 7f95525929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:45.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.076+0000 7f95525929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:45.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.076+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.076+0000 7f95525929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:45.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.076+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.080+0000 7f95525929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:45.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.080+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.080+0000 7f95525929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:45.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.080+0000 7f95525929c0 20 searching for the correct realm 2024-09-12T18:49:45.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.084+0000 7f9550098640 0 -- 172.21.15.111:0/3869937647 >> [v2:172.21.15.111:6800/2832238944,v1:172.21.15.111:6801/2832238944] conn(0x56157fa80450 msgr2=0x56157fa82840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:45.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.092+0000 7f9550899640 0 -- 172.21.15.111:0/3869937647 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f9538008070 msgr2=0x7f9538065010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:49:45.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:45.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:45.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:45.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:45.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:45.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:45.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:45.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:45.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:45.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 zone default found 2024-09-12T18:49:45.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 4 Realm: () 2024-09-12T18:49:45.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:45.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:45.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:45.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 zonegroup default 2024-09-12T18:49:45.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:45.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.100+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.104+0000 7f95525929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:45.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.104+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.104+0000 7f95525929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:45.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.104+0000 7f95525929c0 20 started sync module instance, tier type = 2024-09-12T18:49:45.105 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.104+0000 7f95525929c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:45.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.120+0000 7f95525929c0 20 add_watcher() i=0 2024-09-12T18:49:45.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.120+0000 7f95525929c0 20 add_watcher() i=1 2024-09-12T18:49:45.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.120+0000 7f95525929c0 20 add_watcher() i=2 2024-09-12T18:49:45.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.120+0000 7f95525929c0 20 add_watcher() i=3 2024-09-12T18:49:45.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.120+0000 7f95525929c0 20 add_watcher() i=4 2024-09-12T18:49:45.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.120+0000 7f95525929c0 20 add_watcher() i=5 2024-09-12T18:49:45.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.120+0000 7f95525929c0 20 add_watcher() i=6 2024-09-12T18:49:45.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.120+0000 7f95525929c0 20 add_watcher() i=7 2024-09-12T18:49:45.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.120+0000 7f95525929c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:45.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.120+0000 7f9406fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:45.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.120+0000 7f95525929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:45.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.120+0000 7f95525929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:45.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.124+0000 7f95525929c0 5 note: GC not initialized 2024-09-12T18:49:45.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.124+0000 7f9405fdb640 20 reqs_thread_entry: start 2024-09-12T18:49:45.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.124+0000 7f95525929c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:45.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.124+0000 7f95525929c0 20 Filter name: none 2024-09-12T18:49:45.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.124+0000 7f93777fe640 20 reqs_thread_entry: start 2024-09-12T18:49:45.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.124+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.124+0000 7f95525929c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:45.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.124+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.124+0000 7f95525929c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:45.126 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.124+0000 7f95525929c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:45.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.124+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.124+0000 7f95525929c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:45.127 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.124+0000 7f95525929c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.128+0000 7f95525929c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:45.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.128+0000 7f95525929c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:45.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.128+0000 7f9406fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:45.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.132+0000 7f95525929c0 20 remove_watcher() i=0 2024-09-12T18:49:45.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.132+0000 7f95525929c0 2 removed watcher, disabling cache 2024-09-12T18:49:45.137 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.136+0000 7f95525929c0 20 remove_watcher() i=1 2024-09-12T18:49:45.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.136+0000 7f95525929c0 20 remove_watcher() i=2 2024-09-12T18:49:45.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.140+0000 7f95525929c0 20 remove_watcher() i=3 2024-09-12T18:49:45.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.140+0000 7f95525929c0 20 remove_watcher() i=4 2024-09-12T18:49:45.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.144+0000 7f95525929c0 20 remove_watcher() i=5 2024-09-12T18:49:45.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.144+0000 7f95525929c0 20 remove_watcher() i=6 2024-09-12T18:49:45.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.144+0000 7f95525929c0 20 remove_watcher() i=7 2024-09-12T18:49:45.160 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:45.160 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:49:45.160 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: error-at-change-reshard-state id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T18:49:45.160 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:45.162 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.162 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.164 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.164 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.214 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.214 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.260 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T18:49:45.260 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:45.261 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.261 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.277 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.277 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.323 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.323 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.342 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.342 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.362 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.362 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.382 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.382 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.401 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.401 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.421 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.421 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.439 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.440 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.461 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.461 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.480 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.480 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.502 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.503 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.521 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.521 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.541 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.541 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.561 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.561 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.581 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.582 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.601 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.601 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.621 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.621 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.639 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.640 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.660 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.660 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.680 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.680 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.700 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:45.701 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:45.716 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T18:49:45.748 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:45.749 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:45.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.792+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.796+0000 7f46685c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:45.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.796+0000 7f46685c29c0 20 realm 2024-09-12T18:49:45.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.796+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.796+0000 7f46685c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:45.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.796+0000 7f46685c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:45.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.796+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.796+0000 7f46685c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:45.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.796+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.796+0000 7f46685c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:45.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.796+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:45.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.800+0000 7f46685c29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:45.799 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.800+0000 7f46685c29c0 20 searching for the correct realm 2024-09-12T18:49:45.801 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.800+0000 7f46660c8640 0 -- 172.21.15.111:0/2669351850 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f4660021070 msgr2=0x7f466000c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:45.807 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:45.808+0000 7f46660c8640 0 -- 172.21.15.111:0/2669351850 >> [v2:172.21.15.153:6808/1571723771,v1:172.21.15.153:6809/1571723771] conn(0x7f4660061bf0 msgr2=0x7f46600480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:46.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.032+0000 7f46685c29c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:46.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.032+0000 7f46685c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:46.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.032+0000 7f46685c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:46.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.032+0000 7f46685c29c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:46.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.032+0000 7f46685c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:46.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.032+0000 7f46685c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:46.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.032+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.032+0000 7f46685c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.032+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.032+0000 7f46685c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:46.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.032+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:46.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 20 zone default found 2024-09-12T18:49:46.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 4 Realm: () 2024-09-12T18:49:46.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:46.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:46.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:46.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 20 zonegroup default 2024-09-12T18:49:46.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.038 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 20 started sync module instance, tier type = 2024-09-12T18:49:46.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.036+0000 7f46685c29c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:46.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.060+0000 7f46685c29c0 20 add_watcher() i=0 2024-09-12T18:49:46.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.060+0000 7f46685c29c0 20 add_watcher() i=1 2024-09-12T18:49:46.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.060+0000 7f46685c29c0 20 add_watcher() i=2 2024-09-12T18:49:46.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.060+0000 7f46685c29c0 20 add_watcher() i=3 2024-09-12T18:49:46.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.060+0000 7f46685c29c0 20 add_watcher() i=4 2024-09-12T18:49:46.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.060+0000 7f46685c29c0 20 add_watcher() i=5 2024-09-12T18:49:46.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.060+0000 7f46685c29c0 20 add_watcher() i=6 2024-09-12T18:49:46.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.060+0000 7f46685c29c0 20 add_watcher() i=7 2024-09-12T18:49:46.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.060+0000 7f46685c29c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:46.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.064+0000 7f451cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:46.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.068+0000 7f46685c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:46.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.068+0000 7f46685c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:46.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.068+0000 7f46685c29c0 5 note: GC not initialized 2024-09-12T18:49:46.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.068+0000 7f44977fe640 20 reqs_thread_entry: start 2024-09-12T18:49:46.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.068+0000 7f46685c29c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:46.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.068+0000 7f46685c29c0 20 Filter name: none 2024-09-12T18:49:46.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.068+0000 7f44957fa640 20 reqs_thread_entry: start 2024-09-12T18:49:46.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.068+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.070 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.068+0000 7f46685c29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:46.070 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.068+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.068+0000 7f46685c29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:46.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.068+0000 7f46685c29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:46.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.068+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.072+0000 7f46685c29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:46.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.072+0000 7f46685c29c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.072+0000 7f46685c29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:46.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.072+0000 7f46685c29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:46.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.076+0000 7f451cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:46.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.080+0000 7f46685c29c0 20 remove_watcher() i=0 2024-09-12T18:49:46.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.080+0000 7f46685c29c0 2 removed watcher, disabling cache 2024-09-12T18:49:46.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.084+0000 7f46685c29c0 20 remove_watcher() i=1 2024-09-12T18:49:46.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.084+0000 7f46685c29c0 20 remove_watcher() i=2 2024-09-12T18:49:46.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.088+0000 7f46685c29c0 20 remove_watcher() i=3 2024-09-12T18:49:46.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.088+0000 7f46685c29c0 20 remove_watcher() i=4 2024-09-12T18:49:46.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.092+0000 7f46685c29c0 20 remove_watcher() i=5 2024-09-12T18:49:46.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.092+0000 7f46685c29c0 20 remove_watcher() i=6 2024-09-12T18:49:46.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.096+0000 7f46685c29c0 20 remove_watcher() i=7 2024-09-12T18:49:46.119 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.119 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:49:46.120 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-change-reshard-state id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:49:46.120 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.120 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T18:49:46.158 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:46.158 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:46.203 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.200+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.204+0000 7f68599e99c0 20 realm 2024-09-12T18:49:46.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.205 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.204+0000 7f68599e99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:46.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.207 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:46.207 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.208 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.208+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:46.208 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.208+0000 7f68599e99c0 20 searching for the correct realm 2024-09-12T18:49:46.212 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.212+0000 7f6857cf0640 0 -- 172.21.15.111:0/869913933 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f684c035bc0 msgr2=0x7f684c0273d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:46.429 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.428+0000 7f6856cee640 0 -- 172.21.15.111:0/869913933 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f68500b83c0 msgr2=0x7f68500b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:46.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:46.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:46.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:46.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:46.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:46.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:46.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.644+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.644+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.644+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:46.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:46.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.648+0000 7f68599e99c0 20 zone default found 2024-09-12T18:49:46.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.648+0000 7f68599e99c0 4 Realm: () 2024-09-12T18:49:46.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.648+0000 7f68599e99c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:46.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.648+0000 7f68599e99c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:46.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.648+0000 7f68599e99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:46.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.648+0000 7f68599e99c0 20 zonegroup default 2024-09-12T18:49:46.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.652+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.652+0000 7f68599e99c0 20 started sync module instance, tier type = 2024-09-12T18:49:46.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.652+0000 7f68599e99c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:46.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=0 2024-09-12T18:49:46.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=1 2024-09-12T18:49:46.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=2 2024-09-12T18:49:46.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=3 2024-09-12T18:49:46.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=4 2024-09-12T18:49:46.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=5 2024-09-12T18:49:46.676 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=6 2024-09-12T18:49:46.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.676+0000 7f68599e99c0 20 add_watcher() i=7 2024-09-12T18:49:46.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.676+0000 7f68599e99c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:46.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.680+0000 7f670e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:46.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.680+0000 7f68599e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:46.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.680+0000 7f68599e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:46.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.680+0000 7f68599e99c0 5 note: GC not initialized 2024-09-12T18:49:46.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.680+0000 7f670d7e2640 20 reqs_thread_entry: start 2024-09-12T18:49:46.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:46.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 20 Filter name: none 2024-09-12T18:49:46.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f67067fc640 20 reqs_thread_entry: start 2024-09-12T18:49:46.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:49:46.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:46.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:49:46.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:49:46.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 : miss 2024-09-12T18:49:46.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:46.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:49:46.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:49:46.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:46.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:46.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.684+0000 7f68599e99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 2024-09-12T18:49:46.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.696+0000 7f68599e99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:49:46.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.696+0000 7f68599e99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:49:46.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.696+0000 7f68599e99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:46.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.696+0000 7f68599e99c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39, ofs0, ns] 2024-09-12T18:49:46.702 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.696+0000 7f673a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431680 cookie 94693764783024 notifier 7529 bl.length()=931 2024-09-12T18:49:46.703 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.696+0000 7f673a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:49:46.703 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.696+0000 7f673a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:49:46.704 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.696+0000 7f673a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:46.704 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.700+0000 7f68599e99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): orig_sources= new_sources= 2024-09-12T18:49:46.704 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.700+0000 7f68599e99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): potential sources added=[] removed=[] 2024-09-12T18:49:46.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.700+0000 7f68599e99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): orig_dests= new_dests= 2024-09-12T18:49:46.705 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.700+0000 7f68599e99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): potential dests added=[] removed=[] 2024-09-12T18:49:46.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.0 2024-09-12T18:49:46.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.0 2024-09-12T18:49:46.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.1 2024-09-12T18:49:46.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.1 2024-09-12T18:49:46.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.2 2024-09-12T18:49:46.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.2 2024-09-12T18:49:46.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.3 2024-09-12T18:49:46.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.3 2024-09-12T18:49:46.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.4 2024-09-12T18:49:46.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.4 2024-09-12T18:49:46.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.5 2024-09-12T18:49:46.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.5 2024-09-12T18:49:46.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.6 2024-09-12T18:49:46.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.6 2024-09-12T18:49:46.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.7 2024-09-12T18:49:46.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.7 2024-09-12T18:49:46.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.8 2024-09-12T18:49:46.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.8 2024-09-12T18:49:46.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.9 2024-09-12T18:49:46.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.9 2024-09-12T18:49:46.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.10 2024-09-12T18:49:46.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.10 2024-09-12T18:49:46.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.11 2024-09-12T18:49:46.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.11 2024-09-12T18:49:46.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.0 2024-09-12T18:49:46.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1 2024-09-12T18:49:46.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2 2024-09-12T18:49:46.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.3 2024-09-12T18:49:46.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.4 2024-09-12T18:49:46.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.5 2024-09-12T18:49:46.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.6 2024-09-12T18:49:46.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.7 2024-09-12T18:49:46.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.8 2024-09-12T18:49:46.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.716+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.9 2024-09-12T18:49:46.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.716+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.10 2024-09-12T18:49:46.724 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f68599e99c0 time 2024-09-12T18:49:46.724922+0000 2024-09-12T18:49:46.724 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:49:46.727 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:46.727 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f685d2c32eb] 2024-09-12T18:49:46.727 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f685d2c349f] 2024-09-12T18:49:46.727 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f9a6d5cc1] 2024-09-12T18:49:46.727 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561f9a6ea01c] 2024-09-12T18:49:46.727 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561f9a6eb6a4] 2024-09-12T18:49:46.727 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:49:46.727 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f685c129d90] 2024-09-12T18:49:46.727 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:49:46.727 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:49:46.727 INFO:tasks.workunit.client.0.smithi111.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:49:46.728 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f68599e99c0 thread_name:radosgw-admin 2024-09-12T18:49:46.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.724+0000 7f68599e99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f68599e99c0 time 2024-09-12T18:49:46.724922+0000 2024-09-12T18:49:46.728 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:49:46.728 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.728 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:46.728 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f685d2c32eb] 2024-09-12T18:49:46.728 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f685d2c349f] 2024-09-12T18:49:46.728 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f9a6d5cc1] 2024-09-12T18:49:46.728 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561f9a6ea01c] 2024-09-12T18:49:46.728 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561f9a6eb6a4] 2024-09-12T18:49:46.728 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:49:46.728 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f685c129d90] 2024-09-12T18:49:46.729 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:49:46.729 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:49:46.729 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.818 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:46.819 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f685c142520] 2024-09-12T18:49:46.819 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:49:46.819 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:49:46.819 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:49:46.819 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f685d2c3345] 2024-09-12T18:49:46.819 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f685d2c349f] 2024-09-12T18:49:46.819 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f9a6d5cc1] 2024-09-12T18:49:46.819 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561f9a6ea01c] 2024-09-12T18:49:46.819 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561f9a6eb6a4] 2024-09-12T18:49:46.819 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:49:46.820 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f685c129d90] 2024-09-12T18:49:46.820 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:49:46.820 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:49:46.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.728+0000 7f68599e99c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:49:46.820 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f68599e99c0 thread_name:radosgw-admin 2024-09-12T18:49:46.820 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.820 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:46.820 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f685c142520] 2024-09-12T18:49:46.820 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:49:46.821 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:49:46.821 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:49:46.821 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f685d2c3345] 2024-09-12T18:49:46.821 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f685d2c349f] 2024-09-12T18:49:46.821 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f9a6d5cc1] 2024-09-12T18:49:46.821 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561f9a6ea01c] 2024-09-12T18:49:46.821 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561f9a6eb6a4] 2024-09-12T18:49:46.821 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:49:46.821 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f685c129d90] 2024-09-12T18:49:46.821 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:49:46.821 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:49:46.822 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:49:46.822 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.822 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:49:46.822 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c26d090) adding con mode: crc 2024-09-12T18:49:46.822 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c26d090) adding con mode: secure 2024-09-12T18:49:46.822 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:49:46.180+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.822 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:49:46.180+0000 7f68599e99c0 1 librados: starting msgr at 2024-09-12T18:49:46.822 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:49:46.180+0000 7f68599e99c0 1 librados: starting objecter 2024-09-12T18:49:46.822 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command objecter_requests hook 0x561f9c004be0 2024-09-12T18:49:46.822 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:49:46.180+0000 7f68599e99c0 1 librados: setting wanted keys 2024-09-12T18:49:46.822 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:49:46.180+0000 7f68599e99c0 1 librados: calling monclient init 2024-09-12T18:49:46.822 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient: init 2024-09-12T18:49:46.823 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding auth protocol: cephx 2024-09-12T18:49:46.823 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding auth protocol: cephx 2024-09-12T18:49:46.823 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding auth protocol: cephx 2024-09-12T18:49:46.823 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: secure 2024-09-12T18:49:46.823 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: crc 2024-09-12T18:49:46.823 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: secure 2024-09-12T18:49:46.823 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: crc 2024-09-12T18:49:46.823 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: secure 2024-09-12T18:49:46.823 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: crc 2024-09-12T18:49:46.823 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: crc 2024-09-12T18:49:46.823 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: secure 2024-09-12T18:49:46.823 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: crc 2024-09-12T18:49:46.824 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: secure 2024-09-12T18:49:46.824 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: crc 2024-09-12T18:49:46.824 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: secure 2024-09-12T18:49:46.824 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:49:46.180+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.824 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:49:46.180+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.824 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command rotate-key hook 0x561f9c267df8 2024-09-12T18:49:46.824 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:46.824 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:49:46.824 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-c con 0x561f9c11fcc0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:46.824 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-a con 0x561f9c122040 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:46.824 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-b con 0x561f9c125820 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:46.824 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.824 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.824 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.825 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:46.825 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): authenticate will time out at 2373.323707s 2024-09-12T18:49:46.825 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:49:46.180+0000 7f68574ef640 10 monclient(hunting): get_auth_request con 0x561f9c11fcc0 auth_method 0 2024-09-12T18:49:46.825 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:49:46.180+0000 7f68574ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.825 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:49:46.180+0000 7f68574ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.825 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:49:46.180+0000 7f68574ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.825 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:49:46.180+0000 7f6856cee640 10 monclient(hunting): get_auth_request con 0x561f9c122040 auth_method 0 2024-09-12T18:49:46.825 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:49:46.180+0000 7f6856cee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.825 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:49:46.180+0000 7f6856cee640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.825 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:49:46.180+0000 7f6856cee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.825 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:49:46.180+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.825 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:49:46.180+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.825 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:49:46.180+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.826 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:49:46.180+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.826 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:49:46.180+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.826 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:49:46.180+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.826 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:49:46.184+0000 7f68574ef640 10 monclient(hunting): handle_auth_done global_id 7520 payload 824 2024-09-12T18:49:46.826 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:49:46.184+0000 7f68574ef640 10 monclient: _finish_hunting 0 2024-09-12T18:49:46.826 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:49:46.184+0000 7f68574ef640 1 monclient: found mon.noname-c 2024-09-12T18:49:46.826 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:49:46.184+0000 7f68574ef640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:49:46.826 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.826 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:49:46.826 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: dump: 2024-09-12T18:49:46.826 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.826 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.826 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.826 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.827 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.827 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.827 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.827 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.827 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.827 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.827 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: _finish_auth 0 2024-09-12T18:49:46.827 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: _check_auth_tickets 2024-09-12T18:49:46.827 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:46.827 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.827 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:49:46.827 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: dump: 2024-09-12T18:49:46.827 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.828 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.828 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.828 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.828 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.828 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.828 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.828 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.828 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.828 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.828 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:49:46.184+0000 7f68599e99c0 5 monclient: authenticate success, global_id 7520 2024-09-12T18:49:46.828 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:49:46.184+0000 7f674560a640 4 set_mon_vals no callback set 2024-09-12T18:49:46.828 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:49:46.184+0000 7f68599e99c0 10 monclient: _renew_subs 2024-09-12T18:49:46.828 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:49:46.184+0000 7f68599e99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:49:46.829 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:49:46.184+0000 7f68599e99c0 10 monclient: _renew_subs 2024-09-12T18:49:46.829 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:49:46.184+0000 7f68599e99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:49:46.829 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:49:46.184+0000 7f68599e99c0 1 librados: init done 2024-09-12T18:49:46.829 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:49:46.184+0000 7f6743e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:49:46.829 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:49:46.184+0000 7f6743e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:46.829 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:49:46.184+0000 7f6743e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:46.829 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:49:46.184+0000 7f6856cee640 10 monclient: get_auth_request con 0x7f673c070b10 auth_method 0 2024-09-12T18:49:46.829 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:49:46.184+0000 7f6857cf0640 10 monclient: get_auth_request con 0x561f9c2a93e0 auth_method 0 2024-09-12T18:49:46.829 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:49:46.188+0000 7f68574ef640 10 monclient: get_auth_request con 0x561f9c2b2860 auth_method 0 2024-09-12T18:49:46.829 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:49:46.188+0000 7f6856cee640 10 monclient: get_auth_request con 0x561f9c2b6bc0 auth_method 0 2024-09-12T18:49:46.829 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:49:46.192+0000 7f6857cf0640 10 monclient: get_auth_request con 0x561f9c2b6110 auth_method 0 2024-09-12T18:49:46.829 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: build_initial_monmap 2024-09-12T18:49:46.829 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:49:46.192+0000 7f68599e99c0 1 build_initial for_mkfs: 0 2024-09-12T18:49:46.830 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: monmap: 2024-09-12T18:49:46.830 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:49:46.830 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:49:46.830 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:49:46.830 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:49:46.830 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:49:46.830 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.830 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:49:46.830 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:49:46.830 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:49:46.830 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.830 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding auth protocol: cephx 2024-09-12T18:49:46.830 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding auth protocol: cephx 2024-09-12T18:49:46.831 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding auth protocol: cephx 2024-09-12T18:49:46.831 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: secure 2024-09-12T18:49:46.831 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: crc 2024-09-12T18:49:46.831 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: secure 2024-09-12T18:49:46.831 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: crc 2024-09-12T18:49:46.831 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: secure 2024-09-12T18:49:46.831 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: crc 2024-09-12T18:49:46.831 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: crc 2024-09-12T18:49:46.831 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: secure 2024-09-12T18:49:46.831 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: crc 2024-09-12T18:49:46.831 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: secure 2024-09-12T18:49:46.831 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: crc 2024-09-12T18:49:46.832 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: secure 2024-09-12T18:49:46.832 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:49:46.192+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.832 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x561f9c2c2690 EEXIST 2024-09-12T18:49:46.832 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: init 2024-09-12T18:49:46.832 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding auth protocol: cephx 2024-09-12T18:49:46.832 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding auth protocol: cephx 2024-09-12T18:49:46.832 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding auth protocol: cephx 2024-09-12T18:49:46.832 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: secure 2024-09-12T18:49:46.832 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: crc 2024-09-12T18:49:46.832 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: secure 2024-09-12T18:49:46.832 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: crc 2024-09-12T18:49:46.832 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: secure 2024-09-12T18:49:46.832 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: crc 2024-09-12T18:49:46.833 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: crc 2024-09-12T18:49:46.833 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: secure 2024-09-12T18:49:46.833 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: crc 2024-09-12T18:49:46.833 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: secure 2024-09-12T18:49:46.833 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: crc 2024-09-12T18:49:46.833 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: secure 2024-09-12T18:49:46.833 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:49:46.192+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.833 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:49:46.192+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.833 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command rotate-key cmddesc rotate-key hook 0x561f9c2bdd00 EEXIST 2024-09-12T18:49:46.834 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:46.834 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:49:46.834 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-c con 0x561f9c2e6840 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:46.834 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-b con 0x561f9c2e6170 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:46.834 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-a con 0x561f9c2e4b50 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:46.834 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.834 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.834 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.834 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:46.834 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): authenticate will time out at 2373.334700s 2024-09-12T18:49:46.834 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:49:46.192+0000 7f6856cee640 10 monclient(hunting): get_auth_request con 0x561f9c2e6840 auth_method 0 2024-09-12T18:49:46.834 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:49:46.192+0000 7f6856cee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.834 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:49:46.192+0000 7f6856cee640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.835 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:49:46.192+0000 7f6856cee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.835 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): get_auth_request con 0x561f9c2e4b50 auth_method 0 2024-09-12T18:49:46.835 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.835 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.835 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.835 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:49:46.192+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.835 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:49:46.192+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.835 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:49:46.192+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.835 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.835 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.835 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.835 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:49:46.192+0000 7f6857cf0640 10 monclient(hunting): get_auth_request con 0x561f9c2e6170 auth_method 0 2024-09-12T18:49:46.835 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:49:46.192+0000 7f6857cf0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.836 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:49:46.192+0000 7f6857cf0640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.836 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:49:46.192+0000 7f6857cf0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.836 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): handle_auth_done global_id 8064 payload 824 2024-09-12T18:49:46.836 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient: _finish_hunting 0 2024-09-12T18:49:46.836 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:49:46.192+0000 7f68574ef640 1 monclient: found mon.noname-a 2024-09-12T18:49:46.836 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:49:46.836 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.836 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:49:46.836 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: dump: 2024-09-12T18:49:46.836 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.836 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.836 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.836 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.837 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.837 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.837 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.837 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.837 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.837 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.837 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: _finish_auth 0 2024-09-12T18:49:46.837 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: _check_auth_tickets 2024-09-12T18:49:46.837 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:46.837 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.837 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:49:46.837 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: dump: 2024-09-12T18:49:46.837 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.838 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.838 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.838 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.838 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.838 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.838 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.838 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.838 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.838 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.838 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 monclient: authenticate success, global_id 8064 2024-09-12T18:49:46.838 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:49:46.192+0000 7f68584f1640 4 set_mon_vals no callback set 2024-09-12T18:49:46.838 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: _renew_subs 2024-09-12T18:49:46.839 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:49:46.839 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: _renew_subs 2024-09-12T18:49:46.839 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:49:46.839 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:49:46.196+0000 7f6741602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:49:46.839 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:49:46.196+0000 7f6741602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:46.839 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:49:46.196+0000 7f6741602640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:46.839 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient: get_auth_request con 0x7f6730070bc0 auth_method 0 2024-09-12T18:49:46.839 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient: get_monmap_and_config 2024-09-12T18:49:46.839 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient: build_initial_monmap 2024-09-12T18:49:46.839 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:49:46.196+0000 7f68599e99c0 1 build_initial for_mkfs: 0 2024-09-12T18:49:46.839 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient: monmap: 2024-09-12T18:49:46.840 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:49:46.840 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:49:46.840 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:49:46.840 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:49:46.840 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:49:46.840 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.840 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:49:46.840 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:49:46.840 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:49:46.840 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.840 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding auth protocol: cephx 2024-09-12T18:49:46.840 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding auth protocol: cephx 2024-09-12T18:49:46.840 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding auth protocol: cephx 2024-09-12T18:49:46.841 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: secure 2024-09-12T18:49:46.841 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: crc 2024-09-12T18:49:46.841 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: secure 2024-09-12T18:49:46.841 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: crc 2024-09-12T18:49:46.841 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: secure 2024-09-12T18:49:46.841 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: crc 2024-09-12T18:49:46.841 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: crc 2024-09-12T18:49:46.841 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: secure 2024-09-12T18:49:46.841 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: crc 2024-09-12T18:49:46.841 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: secure 2024-09-12T18:49:46.841 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: crc 2024-09-12T18:49:46.841 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: secure 2024-09-12T18:49:46.842 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:49:46.196+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.842 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient: init 2024-09-12T18:49:46.842 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding auth protocol: cephx 2024-09-12T18:49:46.842 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding auth protocol: cephx 2024-09-12T18:49:46.842 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding auth protocol: cephx 2024-09-12T18:49:46.842 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: secure 2024-09-12T18:49:46.842 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: crc 2024-09-12T18:49:46.842 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: secure 2024-09-12T18:49:46.842 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: crc 2024-09-12T18:49:46.842 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: secure 2024-09-12T18:49:46.842 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: crc 2024-09-12T18:49:46.843 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: crc 2024-09-12T18:49:46.843 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: secure 2024-09-12T18:49:46.843 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: crc 2024-09-12T18:49:46.843 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: secure 2024-09-12T18:49:46.843 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: crc 2024-09-12T18:49:46.843 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: secure 2024-09-12T18:49:46.843 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:49:46.196+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.843 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:49:46.196+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.843 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff1c4bb6d8 EEXIST 2024-09-12T18:49:46.843 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:46.843 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:49:46.843 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-c con 0x561f9c33a1e0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:46.843 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-a con 0x561f9c3355d0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:46.844 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-b con 0x561f9c335f50 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:46.844 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.844 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.844 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.844 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:46.844 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): authenticate will time out at 2373.338897s 2024-09-12T18:49:46.844 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): get_auth_request con 0x561f9c3355d0 auth_method 0 2024-09-12T18:49:46.844 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.844 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.844 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.844 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient(hunting): get_auth_request con 0x561f9c33a1e0 auth_method 0 2024-09-12T18:49:46.844 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.845 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.845 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.845 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.845 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.845 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.845 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.845 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.845 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.845 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): handle_auth_done global_id 8067 payload 274 2024-09-12T18:49:46.845 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient: _finish_hunting 0 2024-09-12T18:49:46.845 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:49:46.196+0000 7f6857cf0640 1 monclient: found mon.noname-a 2024-09-12T18:49:46.846 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:49:46.846 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:49:46.196+0000 7f68574ef640 10 monclient: get_auth_request con 0x561f9c335f50 auth_method 0 2024-09-12T18:49:46.846 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.846 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:49:46.846 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: dump: 2024-09-12T18:49:46.846 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.846 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.846 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.846 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.846 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.846 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.846 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.846 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: _finish_auth 0 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: _check_auth_tickets 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 monclient: authenticate success, global_id 8067 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient: get_monmap_and_config success 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:49:46.196+0000 7f68599e99c0 4 set_mon_vals no callback set 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: dump: 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.847 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.848 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.848 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.848 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.848 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.848 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.848 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.848 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: shutdown 2024-09-12T18:49:46.848 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: build_initial_monmap 2024-09-12T18:49:46.848 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:49:46.200+0000 7f68599e99c0 1 build_initial for_mkfs: 0 2024-09-12T18:49:46.848 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: monmap: 2024-09-12T18:49:46.848 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:49:46.849 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:49:46.849 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:49:46.849 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:49:46.849 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:49:46.849 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.849 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:49:46.849 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:49:46.849 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:49:46.849 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.849 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding auth protocol: cephx 2024-09-12T18:49:46.849 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding auth protocol: cephx 2024-09-12T18:49:46.849 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding auth protocol: cephx 2024-09-12T18:49:46.850 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: secure 2024-09-12T18:49:46.850 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: crc 2024-09-12T18:49:46.850 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: secure 2024-09-12T18:49:46.850 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: crc 2024-09-12T18:49:46.850 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: secure 2024-09-12T18:49:46.850 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: crc 2024-09-12T18:49:46.850 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: crc 2024-09-12T18:49:46.850 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: secure 2024-09-12T18:49:46.850 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: crc 2024-09-12T18:49:46.850 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: secure 2024-09-12T18:49:46.850 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: crc 2024-09-12T18:49:46.851 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: secure 2024-09-12T18:49:46.851 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:49:46.200+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.851 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:49:46.200+0000 7f68599e99c0 1 librados: starting msgr at 2024-09-12T18:49:46.851 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:49:46.200+0000 7f68599e99c0 1 librados: starting objecter 2024-09-12T18:49:46.851 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x561f9c32cfd0 EEXIST 2024-09-12T18:49:46.851 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:49:46.200+0000 7f68599e99c0 1 librados: setting wanted keys 2024-09-12T18:49:46.851 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:49:46.200+0000 7f68599e99c0 1 librados: calling monclient init 2024-09-12T18:49:46.851 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: init 2024-09-12T18:49:46.851 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding auth protocol: cephx 2024-09-12T18:49:46.851 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding auth protocol: cephx 2024-09-12T18:49:46.851 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding auth protocol: cephx 2024-09-12T18:49:46.852 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: secure 2024-09-12T18:49:46.852 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: crc 2024-09-12T18:49:46.852 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: secure 2024-09-12T18:49:46.852 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: crc 2024-09-12T18:49:46.852 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: secure 2024-09-12T18:49:46.852 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: crc 2024-09-12T18:49:46.852 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: crc 2024-09-12T18:49:46.852 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: secure 2024-09-12T18:49:46.852 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: crc 2024-09-12T18:49:46.852 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: secure 2024-09-12T18:49:46.852 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: crc 2024-09-12T18:49:46.853 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: secure 2024-09-12T18:49:46.853 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:49:46.200+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.853 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:49:46.200+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.853 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command rotate-key cmddesc rotate-key hook 0x561f9c2e87a8 EEXIST 2024-09-12T18:49:46.853 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:46.853 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:49:46.853 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-b con 0x561f9c3355d0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:46.853 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-a con 0x561f9c335f50 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:46.853 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-c con 0x561f9c33a1e0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:46.853 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.853 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.854 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.854 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:46.854 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): authenticate will time out at 2373.341502s 2024-09-12T18:49:46.854 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:49:46.200+0000 7f6857cf0640 10 monclient(hunting): get_auth_request con 0x561f9c335f50 auth_method 0 2024-09-12T18:49:46.854 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:49:46.200+0000 7f6857cf0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.854 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:49:46.200+0000 7f6857cf0640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.854 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:49:46.200+0000 7f6857cf0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.854 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): get_auth_request con 0x561f9c33a1e0 auth_method 0 2024-09-12T18:49:46.854 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.854 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.854 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.855 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.855 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.855 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.855 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:49:46.200+0000 7f6857cf0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.855 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:49:46.200+0000 7f6857cf0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.855 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:49:46.200+0000 7f6857cf0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.855 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:49:46.200+0000 7f6856cee640 10 monclient(hunting): get_auth_request con 0x561f9c3355d0 auth_method 0 2024-09-12T18:49:46.855 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:49:46.200+0000 7f6856cee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.855 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:49:46.200+0000 7f6856cee640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.855 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:49:46.200+0000 7f6856cee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.855 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): handle_auth_done global_id 7529 payload 824 2024-09-12T18:49:46.856 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient: _finish_hunting 0 2024-09-12T18:49:46.856 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:49:46.200+0000 7f68574ef640 1 monclient: found mon.noname-c 2024-09-12T18:49:46.856 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:49:46.856 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.856 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:49:46.856 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: dump: 2024-09-12T18:49:46.856 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.856 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.856 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.857 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.857 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.857 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.857 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.857 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.857 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.857 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.857 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: _finish_auth 0 2024-09-12T18:49:46.857 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: _check_auth_tickets 2024-09-12T18:49:46.857 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:46.858 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.858 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:49:46.858 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: dump: 2024-09-12T18:49:46.858 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.858 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.858 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.858 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.858 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.858 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.858 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.859 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.859 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.859 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.859 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 monclient: authenticate success, global_id 7529 2024-09-12T18:49:46.859 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:49:46.200+0000 7f673affd640 4 set_mon_vals no callback set 2024-09-12T18:49:46.859 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: _renew_subs 2024-09-12T18:49:46.859 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:49:46.859 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: _renew_subs 2024-09-12T18:49:46.859 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:49:46.859 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:49:46.200+0000 7f68599e99c0 1 librados: init done 2024-09-12T18:49:46.859 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command cr dump hook 0x561f9c32c358 2024-09-12T18:49:46.859 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:49:46.200+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.860 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:49:46.204+0000 7f67397fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:49:46.860 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:49:46.204+0000 7f67397fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:46.860 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:49:46.204+0000 7f67397fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:46.860 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:49:46.204+0000 7f6856cee640 10 monclient: get_auth_request con 0x7f6720070ae0 auth_method 0 2024-09-12T18:49:46.860 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:49:46.204+0000 7f6857cf0640 10 monclient: get_auth_request con 0x561f9c353410 auth_method 0 2024-09-12T18:49:46.860 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.860 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 realm 2024-09-12T18:49:46.860 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.860 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.860 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:49:46.204+0000 7f68599e99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:46.861 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.861 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.861 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.861 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:49:46.204+0000 7f6856cee640 10 monclient: get_auth_request con 0x561f9c357660 auth_method 0 2024-09-12T18:49:46.861 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:46.861 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.861 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:49:46.204+0000 7f6857cf0640 10 monclient: get_auth_request con 0x561f9c35af10 auth_method 0 2024-09-12T18:49:46.861 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:49:46.208+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:46.861 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:49:46.208+0000 7f68599e99c0 20 searching for the correct realm 2024-09-12T18:49:46.861 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:49:46.208+0000 7f68574ef640 10 monclient: get_auth_request con 0x7f68500b9940 auth_method 0 2024-09-12T18:49:46.861 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:49:46.208+0000 7f6856cee640 10 monclient: get_auth_request con 0x7f684802a060 auth_method 0 2024-09-12T18:49:46.862 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:49:46.208+0000 7f6857cf0640 10 monclient: get_auth_request con 0x7f684c035bc0 auth_method 0 2024-09-12T18:49:46.862 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:49:46.212+0000 7f6857cf0640 0 -- 172.21.15.111:0/869913933 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f684c035bc0 msgr2=0x7f684c0273d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:46.862 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:49:46.416+0000 7f6857cf0640 10 monclient: get_auth_request con 0x7f684c035bc0 auth_method 0 2024-09-12T18:49:46.862 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:49:46.420+0000 7f68574ef640 10 monclient: get_auth_request con 0x7f68500db940 auth_method 0 2024-09-12T18:49:46.862 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:49:46.428+0000 7f6856cee640 10 monclient: get_auth_request con 0x7f68500b83c0 auth_method 0 2024-09-12T18:49:46.862 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:49:46.428+0000 7f6856cee640 0 -- 172.21.15.111:0/869913933 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f68500b83c0 msgr2=0x7f68500b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:46.862 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:49:46.632+0000 7f6856cee640 10 monclient: get_auth_request con 0x7f68500b83c0 auth_method 0 2024-09-12T18:49:46.862 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:46.863 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:46.863 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:46.863 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:46.863 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:46.863 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:46.863 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.863 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.863 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.863 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:46.863 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.863 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:46.863 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 zone default found 2024-09-12T18:49:46.863 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:49:46.648+0000 7f68599e99c0 4 Realm: () 2024-09-12T18:49:46.863 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:49:46.648+0000 7f68599e99c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:46.864 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:49:46.648+0000 7f68599e99c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:46.864 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:49:46.648+0000 7f68599e99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:46.864 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 zonegroup default 2024-09-12T18:49:46.864 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.864 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.864 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.864 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.864 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.864 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:49:46.652+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.864 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:49:46.652+0000 7f68599e99c0 20 started sync module instance, tier type = 2024-09-12T18:49:46.864 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:49:46.652+0000 7f68599e99c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:46.864 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=0 2024-09-12T18:49:46.865 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=1 2024-09-12T18:49:46.865 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=2 2024-09-12T18:49:46.865 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=3 2024-09-12T18:49:46.865 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=4 2024-09-12T18:49:46.865 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=5 2024-09-12T18:49:46.865 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=6 2024-09-12T18:49:46.865 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:49:46.676+0000 7f68599e99c0 20 add_watcher() i=7 2024-09-12T18:49:46.865 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:49:46.676+0000 7f68599e99c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:46.865 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding auth protocol: cephx 2024-09-12T18:49:46.865 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding auth protocol: cephx 2024-09-12T18:49:46.865 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding auth protocol: cephx 2024-09-12T18:49:46.865 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: secure 2024-09-12T18:49:46.865 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: crc 2024-09-12T18:49:46.866 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: secure 2024-09-12T18:49:46.866 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: crc 2024-09-12T18:49:46.866 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: secure 2024-09-12T18:49:46.866 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: crc 2024-09-12T18:49:46.866 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: crc 2024-09-12T18:49:46.866 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: secure 2024-09-12T18:49:46.866 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: crc 2024-09-12T18:49:46.866 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: secure 2024-09-12T18:49:46.866 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:49:46.680+0000 7f670e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:46.866 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: crc 2024-09-12T18:49:46.866 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: secure 2024-09-12T18:49:46.866 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:49:46.680+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.866 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:49:46.680+0000 7f68599e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:46.867 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:49:46.680+0000 7f68599e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:46.867 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command cache list hook 0x561f9c332250 2024-09-12T18:49:46.867 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command cache inspect hook 0x561f9c332250 2024-09-12T18:49:46.867 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command cache erase hook 0x561f9c332250 2024-09-12T18:49:46.867 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command cache zap hook 0x561f9c332250 2024-09-12T18:49:46.867 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 note: GC not initialized 2024-09-12T18:49:46.867 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:49:46.680+0000 7f670d7e2640 20 reqs_thread_entry: start 2024-09-12T18:49:46.867 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command sync trace show hook 0x7f68500ac530 2024-09-12T18:49:46.867 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command sync trace history hook 0x7f68500ac530 2024-09-12T18:49:46.867 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:49:46.684+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command sync trace active hook 0x7f68500ac530 2024-09-12T18:49:46.867 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:49:46.684+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command sync trace active_short hook 0x7f68500ac530 2024-09-12T18:49:46.867 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:49:46.684+0000 7f68599e99c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:46.867 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:49:46.684+0000 7f68599e99c0 20 Filter name: none 2024-09-12T18:49:46.868 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:49:46.684+0000 7f67067fc640 20 reqs_thread_entry: start 2024-09-12T18:49:46.868 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:49:46.868 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:49:46.684+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.868 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:49:46.684+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:46.868 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:49:46.868 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:49:46.868 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 : miss 2024-09-12T18:49:46.868 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:49:46.684+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.868 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:49:46.684+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:46.868 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:49:46.868 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:49:46.868 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:46.868 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:46.868 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 2024-09-12T18:49:46.869 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:49:46.696+0000 7f68599e99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:49:46.869 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:49:46.696+0000 7f68599e99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:49:46.869 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:49:46.696+0000 7f68599e99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:46.869 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:49:46.696+0000 7f68599e99c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39, ofs0, ns] 2024-09-12T18:49:46.869 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:49:46.696+0000 7f673a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431680 cookie 94693764783024 notifier 7529 bl.length()=931 2024-09-12T18:49:46.869 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:49:46.696+0000 7f673a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:49:46.869 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:49:46.696+0000 7f673a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:49:46.869 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:49:46.696+0000 7f673a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:46.869 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:49:46.700+0000 7f68599e99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): orig_sources= new_sources= 2024-09-12T18:49:46.869 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:49:46.700+0000 7f68599e99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): potential sources added=[] removed=[] 2024-09-12T18:49:46.869 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:49:46.700+0000 7f68599e99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): orig_dests= new_dests= 2024-09-12T18:49:46.869 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:49:46.700+0000 7f68599e99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): potential dests added=[] removed=[] 2024-09-12T18:49:46.870 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.0 2024-09-12T18:49:46.870 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.0 2024-09-12T18:49:46.870 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.1 2024-09-12T18:49:46.870 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.1 2024-09-12T18:49:46.870 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.2 2024-09-12T18:49:46.870 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.2 2024-09-12T18:49:46.870 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.3 2024-09-12T18:49:46.870 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.3 2024-09-12T18:49:46.870 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.4 2024-09-12T18:49:46.870 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.4 2024-09-12T18:49:46.870 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.5 2024-09-12T18:49:46.870 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.5 2024-09-12T18:49:46.870 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.6 2024-09-12T18:49:46.870 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.6 2024-09-12T18:49:46.871 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.7 2024-09-12T18:49:46.871 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.7 2024-09-12T18:49:46.871 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.8 2024-09-12T18:49:46.871 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.8 2024-09-12T18:49:46.871 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.9 2024-09-12T18:49:46.871 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.9 2024-09-12T18:49:46.871 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.10 2024-09-12T18:49:46.871 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.10 2024-09-12T18:49:46.871 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.11 2024-09-12T18:49:46.871 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.11 2024-09-12T18:49:46.871 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.0 2024-09-12T18:49:46.871 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1 2024-09-12T18:49:46.871 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2 2024-09-12T18:49:46.872 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.3 2024-09-12T18:49:46.872 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.4 2024-09-12T18:49:46.872 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.5 2024-09-12T18:49:46.872 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.6 2024-09-12T18:49:46.872 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.7 2024-09-12T18:49:46.872 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.8 2024-09-12T18:49:46.872 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:49:46.716+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.9 2024-09-12T18:49:46.872 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:49:46.716+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.10 2024-09-12T18:49:46.872 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:49:46.724+0000 7f68599e99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f68599e99c0 time 2024-09-12T18:49:46.724922+0000 2024-09-12T18:49:46.872 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:49:46.872 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.872 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:46.872 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f685d2c32eb] 2024-09-12T18:49:46.873 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f685d2c349f] 2024-09-12T18:49:46.873 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f9a6d5cc1] 2024-09-12T18:49:46.873 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561f9a6ea01c] 2024-09-12T18:49:46.873 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561f9a6eb6a4] 2024-09-12T18:49:46.873 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:49:46.873 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f685c129d90] 2024-09-12T18:49:46.873 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:49:46.873 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:49:46.873 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.873 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:49:46.728+0000 7f68599e99c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:49:46.873 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f68599e99c0 thread_name:radosgw-admin 2024-09-12T18:49:46.873 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.873 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:46.874 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f685c142520] 2024-09-12T18:49:46.874 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:49:46.874 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:49:46.874 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:49:46.874 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f685d2c3345] 2024-09-12T18:49:46.874 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f685d2c349f] 2024-09-12T18:49:46.874 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f9a6d5cc1] 2024-09-12T18:49:46.874 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561f9a6ea01c] 2024-09-12T18:49:46.874 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561f9a6eb6a4] 2024-09-12T18:49:46.874 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:49:46.874 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f685c129d90] 2024-09-12T18:49:46.874 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:49:46.875 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:49:46.875 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:49:46.875 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.875 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:49:46.875 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:49:46.875 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:49:46.875 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:49:46.875 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:49:46.875 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:49:46.875 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:49:46.876 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:49:46.876 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:49:46.876 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:49:46.876 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:49:46.876 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:49:46.876 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:49:46.876 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:49:46.876 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:49:46.876 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:49:46.876 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:49:46.876 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:49:46.876 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:49:46.876 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:49:46.877 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:49:46.877 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:49:46.877 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:49:46.877 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:49:46.877 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:49:46.877 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:49:46.877 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:49:46.877 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:49:46.877 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:49:46.877 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:49:46.877 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:49:46.878 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:49:46.878 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:49:46.878 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:49:46.878 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:49:46.878 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:49:46.878 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:49:46.878 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:49:46.878 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:49:46.878 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:49:46.878 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:49:46.878 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:49:46.878 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:49:46.879 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:49:46.879 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:49:46.879 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:49:46.879 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:49:46.879 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:49:46.879 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:49:46.879 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:49:46.879 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:49:46.879 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:49:46.879 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:49:46.879 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:49:46.879 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:49:46.880 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:49:46.880 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:49:46.880 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:49:46.880 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:49:46.880 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:49:46.880 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:49:46.880 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:49:46.880 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:49:46.880 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:49:46.880 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:49:46.881 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:49:46.881 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:49:46.881 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:49:46.881 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:49:46.881 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:49:46.881 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:49:46.881 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:49:46.881 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:49:46.881 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:49:46.881 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:49:46.881 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:49:46.882 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:49:46.882 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:49:46.882 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:49:46.882 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:49:46.882 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:49:46.882 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:49:46.882 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:49:46.882 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:49:46.882 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:49:46.882 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:49:46.882 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:49:46.883 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:49:46.883 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:49:46.883 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:49:46.883 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:49:46.883 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:49:46.883 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:49:46.883 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:49:46.883 INFO:tasks.workunit.client.0.smithi111.stderr: 7f67067fc640 / http_manager 2024-09-12T18:49:46.883 INFO:tasks.workunit.client.0.smithi111.stderr: 7f670d7e2640 / http_manager 2024-09-12T18:49:46.883 INFO:tasks.workunit.client.0.smithi111.stderr: 7f670e7e4640 / rgw_dt_lg_renew 2024-09-12T18:49:46.883 INFO:tasks.workunit.client.0.smithi111.stderr: 7f67397fa640 / ms_dispatch 2024-09-12T18:49:46.884 INFO:tasks.workunit.client.0.smithi111.stderr: 7f673a7fc640 / io_context_pool 2024-09-12T18:49:46.884 INFO:tasks.workunit.client.0.smithi111.stderr: 7f673affd640 / io_context_pool 2024-09-12T18:49:46.884 INFO:tasks.workunit.client.0.smithi111.stderr: 7f6741602640 / ms_dispatch 2024-09-12T18:49:46.884 INFO:tasks.workunit.client.0.smithi111.stderr: 7f6743e07640 / ms_dispatch 2024-09-12T18:49:46.884 INFO:tasks.workunit.client.0.smithi111.stderr: 7f674560a640 / io_context_pool 2024-09-12T18:49:46.884 INFO:tasks.workunit.client.0.smithi111.stderr: 7f6856cee640 / msgr-worker-2 2024-09-12T18:49:46.884 INFO:tasks.workunit.client.0.smithi111.stderr: 7f68574ef640 / msgr-worker-1 2024-09-12T18:49:46.884 INFO:tasks.workunit.client.0.smithi111.stderr: 7f6857cf0640 / msgr-worker-0 2024-09-12T18:49:46.884 INFO:tasks.workunit.client.0.smithi111.stderr: 7f68584f1640 / io_context_pool 2024-09-12T18:49:46.884 INFO:tasks.workunit.client.0.smithi111.stderr: 7f68599e99c0 / radosgw-admin 2024-09-12T18:49:46.885 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:49:46.885 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:49:46.885 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/log/ceph/ceph-client.admin.135487.log 2024-09-12T18:49:46.885 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:49:46.885 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:49:46.885 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c26d090) adding con mode: crc 2024-09-12T18:49:46.885 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c26d090) adding con mode: secure 2024-09-12T18:49:46.885 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:49:46.180+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.885 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:49:46.180+0000 7f68599e99c0 1 librados: starting msgr at 2024-09-12T18:49:46.885 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:49:46.180+0000 7f68599e99c0 1 librados: starting objecter 2024-09-12T18:49:46.885 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command objecter_requests hook 0x561f9c004be0 2024-09-12T18:49:46.886 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:49:46.180+0000 7f68599e99c0 1 librados: setting wanted keys 2024-09-12T18:49:46.886 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:49:46.180+0000 7f68599e99c0 1 librados: calling monclient init 2024-09-12T18:49:46.886 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient: init 2024-09-12T18:49:46.886 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding auth protocol: cephx 2024-09-12T18:49:46.886 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding auth protocol: cephx 2024-09-12T18:49:46.886 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding auth protocol: cephx 2024-09-12T18:49:46.886 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: secure 2024-09-12T18:49:46.886 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: crc 2024-09-12T18:49:46.886 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: secure 2024-09-12T18:49:46.886 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: crc 2024-09-12T18:49:46.886 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: secure 2024-09-12T18:49:46.887 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: crc 2024-09-12T18:49:46.887 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: crc 2024-09-12T18:49:46.887 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: secure 2024-09-12T18:49:46.887 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: crc 2024-09-12T18:49:46.887 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: secure 2024-09-12T18:49:46.887 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: crc 2024-09-12T18:49:46.887 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 AuthRegistry(0x561f9c267cb0) adding con mode: secure 2024-09-12T18:49:46.887 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:49:46.180+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.887 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:49:46.180+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.887 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:49:46.180+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command rotate-key hook 0x561f9c267df8 2024-09-12T18:49:46.888 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:46.888 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:49:46.888 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-c con 0x561f9c11fcc0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:46.888 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-a con 0x561f9c122040 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:46.888 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-b con 0x561f9c125820 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:46.888 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.888 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.888 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.888 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:46.888 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:49:46.180+0000 7f68599e99c0 10 monclient(hunting): authenticate will time out at 2373.323707s 2024-09-12T18:49:46.888 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:49:46.180+0000 7f68574ef640 10 monclient(hunting): get_auth_request con 0x561f9c11fcc0 auth_method 0 2024-09-12T18:49:46.889 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:49:46.180+0000 7f68574ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.889 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:49:46.180+0000 7f68574ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.889 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:49:46.180+0000 7f68574ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.889 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:49:46.180+0000 7f6856cee640 10 monclient(hunting): get_auth_request con 0x561f9c122040 auth_method 0 2024-09-12T18:49:46.889 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:49:46.180+0000 7f6856cee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.889 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:49:46.180+0000 7f6856cee640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.889 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:49:46.180+0000 7f6856cee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.889 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:49:46.180+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.889 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:49:46.180+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.889 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:49:46.180+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.889 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:49:46.180+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.890 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:49:46.180+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.890 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:49:46.180+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.890 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:49:46.184+0000 7f68574ef640 10 monclient(hunting): handle_auth_done global_id 7520 payload 824 2024-09-12T18:49:46.890 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:49:46.184+0000 7f68574ef640 10 monclient: _finish_hunting 0 2024-09-12T18:49:46.890 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:49:46.184+0000 7f68574ef640 1 monclient: found mon.noname-c 2024-09-12T18:49:46.890 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:49:46.184+0000 7f68574ef640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:49:46.890 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.890 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:49:46.890 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: dump: 2024-09-12T18:49:46.890 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.890 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.891 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.891 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.891 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.891 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.891 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.891 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.891 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.891 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.891 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: _finish_auth 0 2024-09-12T18:49:46.891 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: _check_auth_tickets 2024-09-12T18:49:46.891 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:46.892 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.892 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:49:46.892 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:49:46.184+0000 7f6743e07640 10 monclient: dump: 2024-09-12T18:49:46.892 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.892 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.892 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.892 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.892 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.892 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.892 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.892 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.893 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.893 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.893 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:49:46.184+0000 7f68599e99c0 5 monclient: authenticate success, global_id 7520 2024-09-12T18:49:46.893 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:49:46.184+0000 7f674560a640 4 set_mon_vals no callback set 2024-09-12T18:49:46.893 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:49:46.184+0000 7f68599e99c0 10 monclient: _renew_subs 2024-09-12T18:49:46.893 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:49:46.184+0000 7f68599e99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:49:46.893 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:49:46.184+0000 7f68599e99c0 10 monclient: _renew_subs 2024-09-12T18:49:46.893 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:49:46.184+0000 7f68599e99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:49:46.893 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:49:46.184+0000 7f68599e99c0 1 librados: init done 2024-09-12T18:49:46.893 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:49:46.184+0000 7f6743e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:49:46.893 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:49:46.184+0000 7f6743e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:46.893 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:49:46.184+0000 7f6743e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:46.893 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:49:46.184+0000 7f6856cee640 10 monclient: get_auth_request con 0x7f673c070b10 auth_method 0 2024-09-12T18:49:46.893 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:49:46.184+0000 7f6857cf0640 10 monclient: get_auth_request con 0x561f9c2a93e0 auth_method 0 2024-09-12T18:49:46.894 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:49:46.188+0000 7f68574ef640 10 monclient: get_auth_request con 0x561f9c2b2860 auth_method 0 2024-09-12T18:49:46.894 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:49:46.188+0000 7f6856cee640 10 monclient: get_auth_request con 0x561f9c2b6bc0 auth_method 0 2024-09-12T18:49:46.894 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:49:46.192+0000 7f6857cf0640 10 monclient: get_auth_request con 0x561f9c2b6110 auth_method 0 2024-09-12T18:49:46.894 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: build_initial_monmap 2024-09-12T18:49:46.894 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:49:46.192+0000 7f68599e99c0 1 build_initial for_mkfs: 0 2024-09-12T18:49:46.894 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: monmap: 2024-09-12T18:49:46.894 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:49:46.894 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:49:46.894 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:49:46.894 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:49:46.894 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:49:46.894 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.894 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:49:46.895 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:49:46.895 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:49:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding auth protocol: cephx 2024-09-12T18:49:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding auth protocol: cephx 2024-09-12T18:49:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding auth protocol: cephx 2024-09-12T18:49:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: secure 2024-09-12T18:49:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: crc 2024-09-12T18:49:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: secure 2024-09-12T18:49:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: crc 2024-09-12T18:49:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: secure 2024-09-12T18:49:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: crc 2024-09-12T18:49:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: crc 2024-09-12T18:49:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: secure 2024-09-12T18:49:46.896 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: crc 2024-09-12T18:49:46.896 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: secure 2024-09-12T18:49:46.896 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: crc 2024-09-12T18:49:46.896 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2becc0) adding con mode: secure 2024-09-12T18:49:46.896 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:49:46.192+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.896 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x561f9c2c2690 EEXIST 2024-09-12T18:49:46.896 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: init 2024-09-12T18:49:46.896 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding auth protocol: cephx 2024-09-12T18:49:46.896 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding auth protocol: cephx 2024-09-12T18:49:46.896 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding auth protocol: cephx 2024-09-12T18:49:46.896 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: secure 2024-09-12T18:49:46.896 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: crc 2024-09-12T18:49:46.896 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: secure 2024-09-12T18:49:46.897 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: crc 2024-09-12T18:49:46.897 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: secure 2024-09-12T18:49:46.897 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: crc 2024-09-12T18:49:46.897 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: crc 2024-09-12T18:49:46.897 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: secure 2024-09-12T18:49:46.897 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: crc 2024-09-12T18:49:46.897 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: secure 2024-09-12T18:49:46.897 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: crc 2024-09-12T18:49:46.897 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2bdbb8) adding con mode: secure 2024-09-12T18:49:46.897 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:49:46.192+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.897 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:49:46.192+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.897 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command rotate-key cmddesc rotate-key hook 0x561f9c2bdd00 EEXIST 2024-09-12T18:49:46.897 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:46.898 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:49:46.898 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-c con 0x561f9c2e6840 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:46.898 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-b con 0x561f9c2e6170 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:46.898 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-a con 0x561f9c2e4b50 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:46.898 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.898 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.898 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.898 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:46.898 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient(hunting): authenticate will time out at 2373.334700s 2024-09-12T18:49:46.898 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:49:46.192+0000 7f6856cee640 10 monclient(hunting): get_auth_request con 0x561f9c2e6840 auth_method 0 2024-09-12T18:49:46.898 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:49:46.192+0000 7f6856cee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.898 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:49:46.192+0000 7f6856cee640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.898 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:49:46.192+0000 7f6856cee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.898 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): get_auth_request con 0x561f9c2e4b50 auth_method 0 2024-09-12T18:49:46.899 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.899 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.899 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.899 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:49:46.192+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.899 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:49:46.192+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.899 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:49:46.192+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.899 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.899 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.899 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.899 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:49:46.192+0000 7f6857cf0640 10 monclient(hunting): get_auth_request con 0x561f9c2e6170 auth_method 0 2024-09-12T18:49:46.899 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:49:46.192+0000 7f6857cf0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.899 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:49:46.192+0000 7f6857cf0640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.899 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:49:46.192+0000 7f6857cf0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.900 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient(hunting): handle_auth_done global_id 8064 payload 824 2024-09-12T18:49:46.900 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient: _finish_hunting 0 2024-09-12T18:49:46.900 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:49:46.192+0000 7f68574ef640 1 monclient: found mon.noname-a 2024-09-12T18:49:46.900 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:49:46.192+0000 7f68574ef640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:49:46.900 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.900 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:49:46.900 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: dump: 2024-09-12T18:49:46.900 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.900 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.900 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.900 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.900 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.900 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.901 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.901 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.901 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.901 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.901 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: _finish_auth 0 2024-09-12T18:49:46.901 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: _check_auth_tickets 2024-09-12T18:49:46.901 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:46.901 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.901 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:49:46.901 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:49:46.192+0000 7f6741602640 10 monclient: dump: 2024-09-12T18:49:46.901 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.901 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.901 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.902 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.902 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.902 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.902 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.902 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.902 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.902 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.902 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:49:46.192+0000 7f68599e99c0 5 monclient: authenticate success, global_id 8064 2024-09-12T18:49:46.902 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:49:46.192+0000 7f68584f1640 4 set_mon_vals no callback set 2024-09-12T18:49:46.902 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: _renew_subs 2024-09-12T18:49:46.902 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:49:46.902 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: _renew_subs 2024-09-12T18:49:46.902 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:49:46.192+0000 7f68599e99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:49:46.902 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:49:46.196+0000 7f6741602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:49:46.903 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:49:46.196+0000 7f6741602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:46.903 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:49:46.196+0000 7f6741602640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:46.903 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient: get_auth_request con 0x7f6730070bc0 auth_method 0 2024-09-12T18:49:46.903 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient: get_monmap_and_config 2024-09-12T18:49:46.903 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient: build_initial_monmap 2024-09-12T18:49:46.903 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:49:46.196+0000 7f68599e99c0 1 build_initial for_mkfs: 0 2024-09-12T18:49:46.903 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient: monmap: 2024-09-12T18:49:46.903 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:49:46.903 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:49:46.903 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:49:46.903 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:49:46.903 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:49:46.903 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.903 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:49:46.904 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:49:46.904 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:49:46.904 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.904 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding auth protocol: cephx 2024-09-12T18:49:46.904 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding auth protocol: cephx 2024-09-12T18:49:46.904 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding auth protocol: cephx 2024-09-12T18:49:46.904 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: secure 2024-09-12T18:49:46.904 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: crc 2024-09-12T18:49:46.904 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: secure 2024-09-12T18:49:46.904 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: crc 2024-09-12T18:49:46.904 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: secure 2024-09-12T18:49:46.904 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: crc 2024-09-12T18:49:46.904 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: crc 2024-09-12T18:49:46.904 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: secure 2024-09-12T18:49:46.905 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: crc 2024-09-12T18:49:46.905 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: secure 2024-09-12T18:49:46.905 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: crc 2024-09-12T18:49:46.905 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x561f9c305d00) adding con mode: secure 2024-09-12T18:49:46.905 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:49:46.196+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.905 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient: init 2024-09-12T18:49:46.905 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding auth protocol: cephx 2024-09-12T18:49:46.905 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding auth protocol: cephx 2024-09-12T18:49:46.905 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding auth protocol: cephx 2024-09-12T18:49:46.905 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: secure 2024-09-12T18:49:46.905 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: crc 2024-09-12T18:49:46.905 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: secure 2024-09-12T18:49:46.905 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: crc 2024-09-12T18:49:46.905 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: secure 2024-09-12T18:49:46.906 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: crc 2024-09-12T18:49:46.906 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: crc 2024-09-12T18:49:46.906 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: secure 2024-09-12T18:49:46.906 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: crc 2024-09-12T18:49:46.906 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: secure 2024-09-12T18:49:46.906 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: crc 2024-09-12T18:49:46.906 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bb590) adding con mode: secure 2024-09-12T18:49:46.906 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:49:46.196+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.906 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:49:46.196+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.906 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff1c4bb6d8 EEXIST 2024-09-12T18:49:46.906 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:46.906 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:49:46.906 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-c con 0x561f9c33a1e0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:46.907 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-a con 0x561f9c3355d0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:46.907 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-b con 0x561f9c335f50 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:46.907 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.907 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.907 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.907 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:46.907 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient(hunting): authenticate will time out at 2373.338897s 2024-09-12T18:49:46.907 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): get_auth_request con 0x561f9c3355d0 auth_method 0 2024-09-12T18:49:46.907 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.907 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.907 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.908 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient(hunting): get_auth_request con 0x561f9c33a1e0 auth_method 0 2024-09-12T18:49:46.908 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.908 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.908 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.908 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.908 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.908 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.908 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.908 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.908 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:49:46.196+0000 7f6856cee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.908 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient(hunting): handle_auth_done global_id 8067 payload 274 2024-09-12T18:49:46.908 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient: _finish_hunting 0 2024-09-12T18:49:46.908 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:49:46.196+0000 7f6857cf0640 1 monclient: found mon.noname-a 2024-09-12T18:49:46.909 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:49:46.196+0000 7f6857cf0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:49:46.909 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:49:46.196+0000 7f68574ef640 10 monclient: get_auth_request con 0x561f9c335f50 auth_method 0 2024-09-12T18:49:46.909 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.909 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:49:46.909 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: dump: 2024-09-12T18:49:46.909 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.909 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.909 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.909 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.909 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.909 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.909 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.910 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.910 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.910 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.910 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: _finish_auth 0 2024-09-12T18:49:46.910 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: _check_auth_tickets 2024-09-12T18:49:46.910 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:49:46.196+0000 7f68599e99c0 5 monclient: authenticate success, global_id 8067 2024-09-12T18:49:46.910 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:46.910 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:49:46.196+0000 7f68599e99c0 10 monclient: get_monmap_and_config success 2024-09-12T18:49:46.910 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:49:46.196+0000 7f68599e99c0 4 set_mon_vals no callback set 2024-09-12T18:49:46.910 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.910 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:49:46.911 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:49:46.196+0000 7f673affd640 10 monclient: dump: 2024-09-12T18:49:46.911 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.911 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.911 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.911 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.911 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.911 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.911 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.911 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.911 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.911 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.911 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: shutdown 2024-09-12T18:49:46.911 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: build_initial_monmap 2024-09-12T18:49:46.912 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:49:46.200+0000 7f68599e99c0 1 build_initial for_mkfs: 0 2024-09-12T18:49:46.912 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: monmap: 2024-09-12T18:49:46.912 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:49:46.912 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:49:46.912 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:49:46.912 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:49:46.912 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:49:46.912 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.912 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:49:46.912 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:49:46.912 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:49:46.913 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.913 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding auth protocol: cephx 2024-09-12T18:49:46.913 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding auth protocol: cephx 2024-09-12T18:49:46.913 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding auth protocol: cephx 2024-09-12T18:49:46.913 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: secure 2024-09-12T18:49:46.913 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: crc 2024-09-12T18:49:46.913 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: secure 2024-09-12T18:49:46.913 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: crc 2024-09-12T18:49:46.913 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: secure 2024-09-12T18:49:46.913 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: crc 2024-09-12T18:49:46.913 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: crc 2024-09-12T18:49:46.914 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: secure 2024-09-12T18:49:46.914 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: crc 2024-09-12T18:49:46.914 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: secure 2024-09-12T18:49:46.914 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: crc 2024-09-12T18:49:46.914 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c32c830) adding con mode: secure 2024-09-12T18:49:46.914 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:49:46.200+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.914 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:49:46.200+0000 7f68599e99c0 1 librados: starting msgr at 2024-09-12T18:49:46.914 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:49:46.200+0000 7f68599e99c0 1 librados: starting objecter 2024-09-12T18:49:46.914 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x561f9c32cfd0 EEXIST 2024-09-12T18:49:46.914 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:49:46.200+0000 7f68599e99c0 1 librados: setting wanted keys 2024-09-12T18:49:46.914 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:49:46.200+0000 7f68599e99c0 1 librados: calling monclient init 2024-09-12T18:49:46.914 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: init 2024-09-12T18:49:46.914 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding auth protocol: cephx 2024-09-12T18:49:46.914 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding auth protocol: cephx 2024-09-12T18:49:46.915 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding auth protocol: cephx 2024-09-12T18:49:46.915 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: secure 2024-09-12T18:49:46.915 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: crc 2024-09-12T18:49:46.915 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: secure 2024-09-12T18:49:46.915 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: crc 2024-09-12T18:49:46.915 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: secure 2024-09-12T18:49:46.915 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: crc 2024-09-12T18:49:46.915 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: crc 2024-09-12T18:49:46.915 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: secure 2024-09-12T18:49:46.915 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: crc 2024-09-12T18:49:46.915 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: secure 2024-09-12T18:49:46.915 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: crc 2024-09-12T18:49:46.915 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 AuthRegistry(0x561f9c2e8660) adding con mode: secure 2024-09-12T18:49:46.915 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:49:46.200+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.916 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:49:46.200+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.916 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command rotate-key cmddesc rotate-key hook 0x561f9c2e87a8 EEXIST 2024-09-12T18:49:46.916 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: _reopen_session rank -1 2024-09-12T18:49:46.916 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:49:46.916 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-b con 0x561f9c3355d0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:49:46.916 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-a con 0x561f9c335f50 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:49:46.916 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): picked mon.noname-c con 0x561f9c33a1e0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:49:46.916 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.916 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.916 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:49:46.916 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): _renew_subs 2024-09-12T18:49:46.916 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient(hunting): authenticate will time out at 2373.341502s 2024-09-12T18:49:46.916 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:49:46.200+0000 7f6857cf0640 10 monclient(hunting): get_auth_request con 0x561f9c335f50 auth_method 0 2024-09-12T18:49:46.917 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:49:46.200+0000 7f6857cf0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.917 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:49:46.200+0000 7f6857cf0640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.917 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:49:46.200+0000 7f6857cf0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.917 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): get_auth_request con 0x561f9c33a1e0 auth_method 0 2024-09-12T18:49:46.917 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.917 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.917 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.917 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.917 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.917 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.917 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:49:46.200+0000 7f6857cf0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:49:46.917 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:49:46.200+0000 7f6857cf0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:49:46.917 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:49:46.200+0000 7f6857cf0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:49:46.918 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:49:46.200+0000 7f6856cee640 10 monclient(hunting): get_auth_request con 0x561f9c3355d0 auth_method 0 2024-09-12T18:49:46.918 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:49:46.200+0000 7f6856cee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:49:46.918 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:49:46.200+0000 7f6856cee640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:49:46.918 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:49:46.200+0000 7f6856cee640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:49:46.918 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient(hunting): handle_auth_done global_id 7529 payload 824 2024-09-12T18:49:46.918 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient: _finish_hunting 0 2024-09-12T18:49:46.918 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:49:46.200+0000 7f68574ef640 1 monclient: found mon.noname-c 2024-09-12T18:49:46.918 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:49:46.200+0000 7f68574ef640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:49:46.918 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.918 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:49:46.918 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: dump: 2024-09-12T18:49:46.918 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.918 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.918 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.919 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.919 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.919 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.919 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.919 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.919 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.919 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.919 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: _finish_auth 0 2024-09-12T18:49:46.919 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: _check_auth_tickets 2024-09-12T18:49:46.919 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:49:46.919 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:49:46.919 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:49:46.919 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:49:46.200+0000 7f67397fa640 10 monclient: dump: 2024-09-12T18:49:46.919 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:49:46.920 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:49:46.920 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.920 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:49:46.920 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:49:46.920 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:49:46.920 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:49:46.920 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:49:46.920 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:49:46.920 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.920 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 monclient: authenticate success, global_id 7529 2024-09-12T18:49:46.920 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:49:46.200+0000 7f673affd640 4 set_mon_vals no callback set 2024-09-12T18:49:46.921 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: _renew_subs 2024-09-12T18:49:46.921 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:49:46.921 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: _renew_subs 2024-09-12T18:49:46.921 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:49:46.200+0000 7f68599e99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:49:46.924 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:49:46.200+0000 7f68599e99c0 1 librados: init done 2024-09-12T18:49:46.924 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:49:46.200+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command cr dump hook 0x561f9c32c358 2024-09-12T18:49:46.924 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:49:46.200+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.924 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:49:46.204+0000 7f67397fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:49:46.925 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:49:46.204+0000 7f67397fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:46.925 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:49:46.204+0000 7f67397fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:49:46.925 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:49:46.204+0000 7f6856cee640 10 monclient: get_auth_request con 0x7f6720070ae0 auth_method 0 2024-09-12T18:49:46.925 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:49:46.204+0000 7f6857cf0640 10 monclient: get_auth_request con 0x561f9c353410 auth_method 0 2024-09-12T18:49:46.925 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.925 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 realm 2024-09-12T18:49:46.925 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.925 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.925 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:49:46.204+0000 7f68599e99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:46.925 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.925 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.926 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.926 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:49:46.204+0000 7f6856cee640 10 monclient: get_auth_request con 0x561f9c357660 auth_method 0 2024-09-12T18:49:46.926 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:46.926 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:49:46.204+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.926 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:49:46.204+0000 7f6857cf0640 10 monclient: get_auth_request con 0x561f9c35af10 auth_method 0 2024-09-12T18:49:46.926 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:49:46.208+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:46.926 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:49:46.208+0000 7f68599e99c0 20 searching for the correct realm 2024-09-12T18:49:46.926 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:49:46.208+0000 7f68574ef640 10 monclient: get_auth_request con 0x7f68500b9940 auth_method 0 2024-09-12T18:49:46.926 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:49:46.208+0000 7f6856cee640 10 monclient: get_auth_request con 0x7f684802a060 auth_method 0 2024-09-12T18:49:46.926 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:49:46.208+0000 7f6857cf0640 10 monclient: get_auth_request con 0x7f684c035bc0 auth_method 0 2024-09-12T18:49:46.926 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:49:46.212+0000 7f6857cf0640 0 -- 172.21.15.111:0/869913933 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f684c035bc0 msgr2=0x7f684c0273d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:46.926 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:49:46.416+0000 7f6857cf0640 10 monclient: get_auth_request con 0x7f684c035bc0 auth_method 0 2024-09-12T18:49:46.927 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:49:46.420+0000 7f68574ef640 10 monclient: get_auth_request con 0x7f68500db940 auth_method 0 2024-09-12T18:49:46.927 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:49:46.428+0000 7f6856cee640 10 monclient: get_auth_request con 0x7f68500b83c0 auth_method 0 2024-09-12T18:49:46.927 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:49:46.428+0000 7f6856cee640 0 -- 172.21.15.111:0/869913933 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f68500b83c0 msgr2=0x7f68500b8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:46.927 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:49:46.632+0000 7f6856cee640 10 monclient: get_auth_request con 0x7f68500b83c0 auth_method 0 2024-09-12T18:49:46.927 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:46.927 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:46.927 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:46.927 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:46.927 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:46.927 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:46.928 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.928 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.928 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:49:46.644+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.928 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:46.928 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.928 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:46.928 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 zone default found 2024-09-12T18:49:46.928 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:49:46.648+0000 7f68599e99c0 4 Realm: () 2024-09-12T18:49:46.928 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:49:46.648+0000 7f68599e99c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:46.928 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:49:46.648+0000 7f68599e99c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:46.928 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:49:46.648+0000 7f68599e99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:46.929 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 zonegroup default 2024-09-12T18:49:46.929 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.929 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.929 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.929 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.929 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:49:46.648+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.929 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:49:46.652+0000 7f68599e99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.929 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:49:46.652+0000 7f68599e99c0 20 started sync module instance, tier type = 2024-09-12T18:49:46.929 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:49:46.652+0000 7f68599e99c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:46.929 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=0 2024-09-12T18:49:46.929 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=1 2024-09-12T18:49:46.929 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=2 2024-09-12T18:49:46.930 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=3 2024-09-12T18:49:46.930 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=4 2024-09-12T18:49:46.930 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=5 2024-09-12T18:49:46.930 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:49:46.672+0000 7f68599e99c0 20 add_watcher() i=6 2024-09-12T18:49:46.930 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:49:46.676+0000 7f68599e99c0 20 add_watcher() i=7 2024-09-12T18:49:46.930 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:49:46.676+0000 7f68599e99c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:46.930 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding auth protocol: cephx 2024-09-12T18:49:46.930 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding auth protocol: cephx 2024-09-12T18:49:46.930 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding auth protocol: cephx 2024-09-12T18:49:46.931 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: secure 2024-09-12T18:49:46.931 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: crc 2024-09-12T18:49:46.931 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: secure 2024-09-12T18:49:46.931 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: crc 2024-09-12T18:49:46.931 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: secure 2024-09-12T18:49:46.931 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: crc 2024-09-12T18:49:46.931 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: crc 2024-09-12T18:49:46.931 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: secure 2024-09-12T18:49:46.931 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: crc 2024-09-12T18:49:46.931 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: secure 2024-09-12T18:49:46.931 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:49:46.680+0000 7f670e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:46.932 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: crc 2024-09-12T18:49:46.932 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 AuthRegistry(0x7fff1c4bba70) adding con mode: secure 2024-09-12T18:49:46.932 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:49:46.680+0000 7f68599e99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:49:46.932 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:49:46.680+0000 7f68599e99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:46.932 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:49:46.680+0000 7f68599e99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:46.932 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command cache list hook 0x561f9c332250 2024-09-12T18:49:46.932 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command cache inspect hook 0x561f9c332250 2024-09-12T18:49:46.932 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command cache erase hook 0x561f9c332250 2024-09-12T18:49:46.932 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command cache zap hook 0x561f9c332250 2024-09-12T18:49:46.932 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 note: GC not initialized 2024-09-12T18:49:46.933 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:49:46.680+0000 7f670d7e2640 20 reqs_thread_entry: start 2024-09-12T18:49:46.933 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command sync trace show hook 0x7f68500ac530 2024-09-12T18:49:46.933 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:49:46.680+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command sync trace history hook 0x7f68500ac530 2024-09-12T18:49:46.933 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:49:46.684+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command sync trace active hook 0x7f68500ac530 2024-09-12T18:49:46.933 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:49:46.684+0000 7f68599e99c0 5 asok(0x561f9c05d2b0) register_command sync trace active_short hook 0x7f68500ac530 2024-09-12T18:49:46.933 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:49:46.684+0000 7f68599e99c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:46.933 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:49:46.684+0000 7f68599e99c0 20 Filter name: none 2024-09-12T18:49:46.933 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:49:46.684+0000 7f67067fc640 20 reqs_thread_entry: start 2024-09-12T18:49:46.933 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:49:46.933 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:49:46.684+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.933 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:49:46.684+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:46.934 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:49:46.934 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:49:46.934 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 : miss 2024-09-12T18:49:46.934 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:49:46.684+0000 7f68599e99c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.934 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:49:46.684+0000 7f68599e99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:49:46.934 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:49:46.934 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:49:46.934 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:46.934 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:46.934 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:49:46.684+0000 7f68599e99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 2024-09-12T18:49:46.934 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:49:46.696+0000 7f68599e99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:49:46.935 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:49:46.696+0000 7f68599e99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:49:46.935 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:49:46.696+0000 7f68599e99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:46.935 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:49:46.696+0000 7f68599e99c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39, ofs0, ns] 2024-09-12T18:49:46.935 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:49:46.696+0000 7f673a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431680 cookie 94693764783024 notifier 7529 bl.length()=931 2024-09-12T18:49:46.935 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:49:46.696+0000 7f673a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:49:46.935 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:49:46.696+0000 7f673a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:49:46.935 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:49:46.696+0000 7f673a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:46.935 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:49:46.700+0000 7f68599e99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): orig_sources= new_sources= 2024-09-12T18:49:46.935 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:49:46.700+0000 7f68599e99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): potential sources added=[] removed=[] 2024-09-12T18:49:46.935 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:49:46.700+0000 7f68599e99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): orig_dests= new_dests= 2024-09-12T18:49:46.935 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:49:46.700+0000 7f68599e99c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): potential dests added=[] removed=[] 2024-09-12T18:49:46.935 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.0 2024-09-12T18:49:46.935 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.0 2024-09-12T18:49:46.936 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.1 2024-09-12T18:49:46.936 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.1 2024-09-12T18:49:46.936 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.2 2024-09-12T18:49:46.936 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.2 2024-09-12T18:49:46.936 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.3 2024-09-12T18:49:46.936 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.3 2024-09-12T18:49:46.936 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.4 2024-09-12T18:49:46.936 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.4 2024-09-12T18:49:46.936 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.5 2024-09-12T18:49:46.936 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.5 2024-09-12T18:49:46.936 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.6 2024-09-12T18:49:46.937 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.6 2024-09-12T18:49:46.937 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.7 2024-09-12T18:49:46.937 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.7 2024-09-12T18:49:46.937 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.8 2024-09-12T18:49:46.937 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.8 2024-09-12T18:49:46.937 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.9 2024-09-12T18:49:46.937 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.9 2024-09-12T18:49:46.937 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.10 2024-09-12T18:49:46.937 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.10 2024-09-12T18:49:46.937 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:49:46.708+0000 7f68599e99c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.11 2024-09-12T18:49:46.937 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1.11 2024-09-12T18:49:46.937 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.0 2024-09-12T18:49:46.937 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1 2024-09-12T18:49:46.938 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2 2024-09-12T18:49:46.938 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:49:46.708+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.3 2024-09-12T18:49:46.938 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.4 2024-09-12T18:49:46.938 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.5 2024-09-12T18:49:46.938 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.6 2024-09-12T18:49:46.938 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.7 2024-09-12T18:49:46.938 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:49:46.712+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.8 2024-09-12T18:49:46.938 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:49:46.716+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.9 2024-09-12T18:49:46.938 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:49:46.716+0000 7f68599e99c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.10 2024-09-12T18:49:46.938 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:49:46.724+0000 7f68599e99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f68599e99c0 time 2024-09-12T18:49:46.724922+0000 2024-09-12T18:49:46.938 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:49:46.938 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.938 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:46.938 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f685d2c32eb] 2024-09-12T18:49:46.939 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f685d2c349f] 2024-09-12T18:49:46.939 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f9a6d5cc1] 2024-09-12T18:49:46.939 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561f9a6ea01c] 2024-09-12T18:49:46.939 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561f9a6eb6a4] 2024-09-12T18:49:46.939 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:49:46.939 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f685c129d90] 2024-09-12T18:49:46.939 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:49:46.939 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:49:46.939 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.939 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:49:46.728+0000 7f68599e99c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:49:46.939 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f68599e99c0 thread_name:radosgw-admin 2024-09-12T18:49:46.939 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.939 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:49:46.940 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f685c142520] 2024-09-12T18:49:46.940 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:49:46.940 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:49:46.940 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:49:46.940 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f685d2c3345] 2024-09-12T18:49:46.940 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f685d2c349f] 2024-09-12T18:49:46.940 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f9a6d5cc1] 2024-09-12T18:49:46.940 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x561f9a6ea01c] 2024-09-12T18:49:46.940 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561f9a6eb6a4] 2024-09-12T18:49:46.940 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:49:46.940 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f685c129d90] 2024-09-12T18:49:46.940 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:49:46.940 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:49:46.941 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:49:46.941 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:46.941 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:49:46.941 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:49:46.941 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:49:46.941 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:49:46.941 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:49:46.941 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:49:46.941 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:49:46.941 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:49:46.941 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:49:46.941 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:49:46.941 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:49:46.941 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:49:46.942 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:49:46.942 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:49:46.942 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:49:46.942 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:49:46.942 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:49:46.942 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:49:46.942 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:49:46.942 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:49:46.942 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:49:46.942 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:49:46.942 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:49:46.942 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:49:46.942 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:49:46.942 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:49:46.943 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:49:46.943 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:49:46.943 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:49:46.943 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:49:46.943 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:49:46.943 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:49:46.943 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:49:46.943 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:49:46.943 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:49:46.943 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:49:46.943 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:49:46.943 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:49:46.943 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:49:46.943 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:49:46.944 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:49:46.944 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:49:46.944 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:49:46.944 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:49:46.944 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:49:46.944 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:49:46.944 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:49:46.944 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:49:46.944 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:49:46.944 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:49:46.944 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:49:46.944 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:49:46.944 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:49:46.945 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:49:46.945 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:49:46.945 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:49:46.945 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:49:46.945 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:49:46.945 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:49:46.945 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:49:46.945 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:49:46.945 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:49:46.945 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:49:46.945 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:49:46.945 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:49:46.945 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:49:46.945 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:49:46.946 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:49:46.947 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:49:46.947 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:49:46.947 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:49:46.947 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:49:46.947 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:49:46.947 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:49:46.947 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:49:46.947 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:49:46.947 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:49:46.947 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:49:46.947 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:49:46.947 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:49:46.947 INFO:tasks.workunit.client.0.smithi111.stderr: 7f67067fc640 / http_manager 2024-09-12T18:49:46.947 INFO:tasks.workunit.client.0.smithi111.stderr: 7f670d7e2640 / http_manager 2024-09-12T18:49:46.948 INFO:tasks.workunit.client.0.smithi111.stderr: 7f670e7e4640 / rgw_dt_lg_renew 2024-09-12T18:49:46.948 INFO:tasks.workunit.client.0.smithi111.stderr: 7f67397fa640 / ms_dispatch 2024-09-12T18:49:46.948 INFO:tasks.workunit.client.0.smithi111.stderr: 7f673a7fc640 / io_context_pool 2024-09-12T18:49:46.948 INFO:tasks.workunit.client.0.smithi111.stderr: 7f673affd640 / io_context_pool 2024-09-12T18:49:46.948 INFO:tasks.workunit.client.0.smithi111.stderr: 7f6741602640 / ms_dispatch 2024-09-12T18:49:46.948 INFO:tasks.workunit.client.0.smithi111.stderr: 7f6743e07640 / ms_dispatch 2024-09-12T18:49:46.948 INFO:tasks.workunit.client.0.smithi111.stderr: 7f674560a640 / io_context_pool 2024-09-12T18:49:46.948 INFO:tasks.workunit.client.0.smithi111.stderr: 7f6856cee640 / msgr-worker-2 2024-09-12T18:49:46.948 INFO:tasks.workunit.client.0.smithi111.stderr: 7f68574ef640 / msgr-worker-1 2024-09-12T18:49:46.948 INFO:tasks.workunit.client.0.smithi111.stderr: 7f6857cf0640 / msgr-worker-0 2024-09-12T18:49:46.948 INFO:tasks.workunit.client.0.smithi111.stderr: 7f68584f1640 / io_context_pool 2024-09-12T18:49:46.948 INFO:tasks.workunit.client.0.smithi111.stderr: 7f68599e99c0 / radosgw-admin 2024-09-12T18:49:46.948 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:49:46.949 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:49:46.949 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:49:46.731506Z_95ccb5f5-cda1-46af-8239-d171cb0344fd/log 2024-09-12T18:49:46.949 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:49:46.949 INFO:tasks.workunit.client.0.smithi111.stderr:Aborted 2024-09-12T18:49:46.949 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T18:49:46.949 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:46.949 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:46.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.816+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.820+0000 7f91526ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.820+0000 7f91526ca9c0 20 realm 2024-09-12T18:49:46.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.820+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.820+0000 7f91526ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.820+0000 7f91526ca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:46.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.820+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.820+0000 7f91526ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:46.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.820+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.820+0000 7f91526ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:46.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.820+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:46.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.820+0000 7f91526ca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:46.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.820+0000 7f91526ca9c0 20 searching for the correct realm 2024-09-12T18:49:46.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.824+0000 7f91509d1640 0 -- 172.21.15.111:0/1972454005 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f9144008040 msgr2=0x7f9144043410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:46.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:46.832+0000 7f914f9cf640 0 -- 172.21.15.111:0/1972454005 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f9148065200 msgr2=0x7f914805d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:49:47.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.048+0000 7f91526ca9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:47.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.048+0000 7f91526ca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:47.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.048+0000 7f91526ca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:47.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.048+0000 7f91526ca9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:47.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.048+0000 7f91526ca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:47.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.048+0000 7f91526ca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:47.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:47.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:47.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:47.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 20 zone default found 2024-09-12T18:49:47.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 4 Realm: () 2024-09-12T18:49:47.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:47.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:47.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:47.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 20 zonegroup default 2024-09-12T18:49:47.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.055 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:47.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:47.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.052+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.056+0000 7f91526ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:47.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.056+0000 7f91526ca9c0 20 started sync module instance, tier type = 2024-09-12T18:49:47.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.056+0000 7f91526ca9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:47.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.080+0000 7f91526ca9c0 20 add_watcher() i=0 2024-09-12T18:49:47.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.080+0000 7f91526ca9c0 20 add_watcher() i=1 2024-09-12T18:49:47.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.080+0000 7f91526ca9c0 20 add_watcher() i=2 2024-09-12T18:49:47.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.080+0000 7f91526ca9c0 20 add_watcher() i=3 2024-09-12T18:49:47.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.080+0000 7f91526ca9c0 20 add_watcher() i=4 2024-09-12T18:49:47.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.080+0000 7f91526ca9c0 20 add_watcher() i=5 2024-09-12T18:49:47.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.080+0000 7f91526ca9c0 20 add_watcher() i=6 2024-09-12T18:49:47.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.080+0000 7f91526ca9c0 20 add_watcher() i=7 2024-09-12T18:49:47.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.080+0000 7f91526ca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:47.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.084+0000 7f9006fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:47.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.084+0000 7f91526ca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:47.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.084+0000 7f91526ca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:47.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.084+0000 7f91526ca9c0 5 note: GC not initialized 2024-09-12T18:49:47.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.088+0000 7f9005fdb640 20 reqs_thread_entry: start 2024-09-12T18:49:47.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.088+0000 7f91526ca9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:47.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.088+0000 7f91526ca9c0 20 Filter name: none 2024-09-12T18:49:47.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.088+0000 7f8f777fe640 20 reqs_thread_entry: start 2024-09-12T18:49:47.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.088+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.088+0000 7f91526ca9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:47.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.088+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.088+0000 7f91526ca9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:49:47.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.088+0000 7f91526ca9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:47.091 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.088+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.088+0000 7f91526ca9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:47.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.088+0000 7f91526ca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.092+0000 7f91526ca9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:49:47.093 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.092+0000 7f91526ca9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:49:47.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.096+0000 7f9006fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:47.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.100+0000 7f91526ca9c0 20 remove_watcher() i=0 2024-09-12T18:49:47.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.100+0000 7f91526ca9c0 2 removed watcher, disabling cache 2024-09-12T18:49:47.104 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.104+0000 7f91526ca9c0 20 remove_watcher() i=1 2024-09-12T18:49:47.106 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.104+0000 7f91526ca9c0 20 remove_watcher() i=2 2024-09-12T18:49:47.108 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.108+0000 7f91526ca9c0 20 remove_watcher() i=3 2024-09-12T18:49:47.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.108+0000 7f91526ca9c0 20 remove_watcher() i=4 2024-09-12T18:49:47.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.112+0000 7f91526ca9c0 20 remove_watcher() i=5 2024-09-12T18:49:47.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.112+0000 7f91526ca9c0 20 remove_watcher() i=6 2024-09-12T18:49:47.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.112+0000 7f91526ca9c0 20 remove_watcher() i=7 2024-09-12T18:49:47.132 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:47.132 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:49:47.132 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-change-reshard-state id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T18:49:47.132 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:49:47.134 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:47.134 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:47.145 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:49:47.145 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:49:47.189 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:49:47.224 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:49:47.224 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:49:47.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.268+0000 7f29ab8c89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.272+0000 7f29ab8c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:47.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.272+0000 7f29ab8c89c0 20 realm 2024-09-12T18:49:47.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.272+0000 7f29ab8c89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.272+0000 7f29ab8c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:47.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.272+0000 7f29ab8c89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:49:47.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.272+0000 7f29ab8c89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.272+0000 7f29ab8c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:47.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.272+0000 7f29ab8c89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.272+0000 7f29ab8c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:47.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.272+0000 7f29ab8c89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.276+0000 7f29ab8c89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:49:47.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.276+0000 7f29ab8c89c0 20 searching for the correct realm 2024-09-12T18:49:47.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.280+0000 7f29a9bcf640 0 -- 172.21.15.111:0/322013869 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f299405c140 msgr2=0x7f2994089840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:49:47.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.496+0000 7f29a8bcd640 0 -- 172.21.15.111:0/322013869 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f29a40aa8e0 msgr2=0x7f29a40fc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:49:47.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.712+0000 7f29ab8c89c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:49:47.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.712+0000 7f29ab8c89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:49:47.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.712+0000 7f29ab8c89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:49:47.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.712+0000 7f29ab8c89c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:49:47.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.712+0000 7f29ab8c89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:49:47.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.712+0000 7f29ab8c89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:49:47.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.712+0000 7f29ab8c89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.716+0000 7f29ab8c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:47.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.716+0000 7f29ab8c89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.716+0000 7f29ab8c89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:49:47.717 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.716+0000 7f29ab8c89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.716+0000 7f29ab8c89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:49:47.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.716+0000 7f29ab8c89c0 20 zone default found 2024-09-12T18:49:47.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.716+0000 7f29ab8c89c0 4 Realm: () 2024-09-12T18:49:47.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.716+0000 7f29ab8c89c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:49:47.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.716+0000 7f29ab8c89c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:49:47.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.716+0000 7f29ab8c89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:49:47.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.716+0000 7f29ab8c89c0 20 zonegroup default 2024-09-12T18:49:47.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.716+0000 7f29ab8c89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.716+0000 7f29ab8c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:47.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.716+0000 7f29ab8c89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.720+0000 7f29ab8c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:47.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.720+0000 7f29ab8c89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.720+0000 7f29ab8c89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:49:47.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.720+0000 7f29ab8c89c0 20 started sync module instance, tier type = 2024-09-12T18:49:47.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.720+0000 7f29ab8c89c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:49:47.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.744+0000 7f29ab8c89c0 20 add_watcher() i=0 2024-09-12T18:49:47.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.744+0000 7f29ab8c89c0 20 add_watcher() i=1 2024-09-12T18:49:47.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.744+0000 7f29ab8c89c0 20 add_watcher() i=2 2024-09-12T18:49:47.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.744+0000 7f29ab8c89c0 20 add_watcher() i=3 2024-09-12T18:49:47.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.744+0000 7f29ab8c89c0 20 add_watcher() i=4 2024-09-12T18:49:47.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.744+0000 7f29ab8c89c0 20 add_watcher() i=5 2024-09-12T18:49:47.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.744+0000 7f29ab8c89c0 20 add_watcher() i=6 2024-09-12T18:49:47.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.748+0000 7f29ab8c89c0 20 add_watcher() i=7 2024-09-12T18:49:47.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.748+0000 7f29ab8c89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:49:47.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f285f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:47.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f29ab8c89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:49:47.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f29ab8c89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:49:47.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f29ab8c89c0 5 note: GC not initialized 2024-09-12T18:49:47.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f285e7e4640 20 reqs_thread_entry: start 2024-09-12T18:49:47.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f29ab8c89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:49:47.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f29ab8c89c0 20 Filter name: none 2024-09-12T18:49:47.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f27cffff640 20 reqs_thread_entry: start 2024-09-12T18:49:47.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f29ab8c89c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:49:47.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f29ab8c89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f29ab8c89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:49:47.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f29ab8c89c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:49:47.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f29ab8c89c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:49:47.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f29ab8c89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 : miss 2024-09-12T18:49:47.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.752+0000 7f29ab8c89c0 20 rados->read ofs=0 len=0 2024-09-12T18:49:47.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.756+0000 7f29ab8c89c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:49:47.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.756+0000 7f29ab8c89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:49:47.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.756+0000 7f29ab8c89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:49:47.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.756+0000 7f29ab8c89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:49:47.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.756+0000 7f29ab8c89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:49:47.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.756+0000 7f29ab8c89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 2024-09-12T18:49:47.759 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.756+0000 7f29ab8c89c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to be held by another RGW process; skipping for now 2024-09-12T18:49:47.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.760+0000 7f285f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:49:47.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.764+0000 7f29ab8c89c0 20 remove_watcher() i=0 2024-09-12T18:49:47.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.764+0000 7f29ab8c89c0 2 removed watcher, disabling cache 2024-09-12T18:49:47.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.768+0000 7f29ab8c89c0 20 remove_watcher() i=1 2024-09-12T18:49:47.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.768+0000 7f29ab8c89c0 20 remove_watcher() i=2 2024-09-12T18:49:47.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.772+0000 7f29ab8c89c0 20 remove_watcher() i=3 2024-09-12T18:49:47.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.772+0000 7f29ab8c89c0 20 remove_watcher() i=4 2024-09-12T18:49:47.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.776+0000 7f29ab8c89c0 20 remove_watcher() i=5 2024-09-12T18:49:47.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.776+0000 7f29ab8c89c0 20 remove_watcher() i=6 2024-09-12T18:49:47.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:49:47.776+0000 7f29ab8c89c0 20 remove_watcher() i=7 2024-09-12T18:49:47.799 INFO:tasks.workunit.client.0.smithi111.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T18:50:17.829 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T18:50:17.865 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:50:17.865 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:50:17.914 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:17.911+0000 7f88025629c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:17.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:17.915+0000 7f88025629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:17.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:17.915+0000 7f88025629c0 20 realm 2024-09-12T18:50:17.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:17.915+0000 7f88025629c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:17.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:17.915+0000 7f88025629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:17.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:17.915+0000 7f88025629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:17.916 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:17.915+0000 7f88025629c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:17.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:17.915+0000 7f88025629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:17.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:17.915+0000 7f88025629c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:17.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:17.915+0000 7f88025629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:17.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:17.915+0000 7f88025629c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:17.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:17.919+0000 7f88025629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:17.920 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:17.919+0000 7f88025629c0 20 searching for the correct realm 2024-09-12T18:50:17.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:17.923+0000 7f8800869640 0 -- 172.21.15.111:0/1266390769 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f87e8049040 msgr2=0x7f87e8081950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:18.544 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.543+0000 7f87ff867640 0 -- 172.21.15.111:0/1266390769 >> [v2:172.21.15.153:6824/2813139034,v1:172.21.15.153:6825/2813139034] conn(0x55cd2edc9a50 msgr2=0x55cd2edcbe40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:18.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:18.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:18.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:18.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:18.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:18.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:18.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:18.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:18.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:18.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:18.562 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:18.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:18.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 zone default found 2024-09-12T18:50:18.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 4 Realm: () 2024-09-12T18:50:18.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:18.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:18.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:18.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 zonegroup default 2024-09-12T18:50:18.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.559+0000 7f88025629c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:18.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.563+0000 7f88025629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:18.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.563+0000 7f88025629c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:18.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.563+0000 7f88025629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:18.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.563+0000 7f88025629c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:18.565 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.563+0000 7f88025629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:18.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.563+0000 7f88025629c0 20 started sync module instance, tier type = 2024-09-12T18:50:18.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.563+0000 7f88025629c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:18.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.587+0000 7f88025629c0 20 add_watcher() i=0 2024-09-12T18:50:18.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.587+0000 7f88025629c0 20 add_watcher() i=1 2024-09-12T18:50:18.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.587+0000 7f88025629c0 20 add_watcher() i=2 2024-09-12T18:50:18.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.587+0000 7f88025629c0 20 add_watcher() i=3 2024-09-12T18:50:18.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.587+0000 7f88025629c0 20 add_watcher() i=4 2024-09-12T18:50:18.589 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.587+0000 7f88025629c0 20 add_watcher() i=5 2024-09-12T18:50:18.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.587+0000 7f88025629c0 20 add_watcher() i=6 2024-09-12T18:50:18.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.591+0000 7f88025629c0 20 add_watcher() i=7 2024-09-12T18:50:18.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.591+0000 7f88025629c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:18.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f86b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:18.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f88025629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:18.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f88025629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:18.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f88025629c0 5 note: GC not initialized 2024-09-12T18:50:18.597 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f86b5fdb640 20 reqs_thread_entry: start 2024-09-12T18:50:18.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f88025629c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:18.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f88025629c0 20 Filter name: none 2024-09-12T18:50:18.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f86277fe640 20 reqs_thread_entry: start 2024-09-12T18:50:18.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f88025629c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T18:50:18.598 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f88025629c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:18.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f88025629c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:50:18.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f88025629c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T18:50:18.599 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f88025629c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T18:50:18.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f88025629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 : miss 2024-09-12T18:50:18.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.595+0000 7f88025629c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:18.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.599+0000 7f88025629c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T18:50:18.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.599+0000 7f88025629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:50:18.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.599+0000 7f88025629c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:50:18.600 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.599+0000 7f88025629c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:50:18.601 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.599+0000 7f88025629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:50:18.601 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.599+0000 7f88025629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 2024-09-12T18:50:18.603 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.599+0000 7f88025629c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:50:18.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.615+0000 7f88025629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:50:18.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.615+0000 7f88025629c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:50:18.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.615+0000 7f88025629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:50:18.617 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.615+0000 7f88025629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39, ofs0, ns] 2024-09-12T18:50:18.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.615+0000 7f86d77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431681 cookie 94339742914944 notifier 8124 bl.length()=931 2024-09-12T18:50:18.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.615+0000 7f86d77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:50:18.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.615+0000 7f86d77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:50:18.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.615+0000 7f86d77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:50:18.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.615+0000 7f88025629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): orig_sources= new_sources= 2024-09-12T18:50:18.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.615+0000 7f88025629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): potential sources added=[] removed=[] 2024-09-12T18:50:18.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.615+0000 7f88025629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): orig_dests= new_dests= 2024-09-12T18:50:18.618 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.615+0000 7f88025629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): potential dests added=[] removed=[] 2024-09-12T18:50:18.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.0 2024-09-12T18:50:18.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.0 2024-09-12T18:50:18.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.1 2024-09-12T18:50:18.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.1 2024-09-12T18:50:18.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.2 2024-09-12T18:50:18.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.2 2024-09-12T18:50:18.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.3 2024-09-12T18:50:18.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.3 2024-09-12T18:50:18.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.4 2024-09-12T18:50:18.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.4 2024-09-12T18:50:18.628 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.5 2024-09-12T18:50:18.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.5 2024-09-12T18:50:18.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.6 2024-09-12T18:50:18.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.6 2024-09-12T18:50:18.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.7 2024-09-12T18:50:18.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.7 2024-09-12T18:50:18.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.8 2024-09-12T18:50:18.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.8 2024-09-12T18:50:18.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.9 2024-09-12T18:50:18.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.9 2024-09-12T18:50:18.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.10 2024-09-12T18:50:18.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.10 2024-09-12T18:50:18.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.11 2024-09-12T18:50:18.629 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2.11 2024-09-12T18:50:18.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.0 2024-09-12T18:50:18.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1 2024-09-12T18:50:18.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2 2024-09-12T18:50:18.630 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.3 2024-09-12T18:50:18.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.4 2024-09-12T18:50:18.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.5 2024-09-12T18:50:18.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.627+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.6 2024-09-12T18:50:18.632 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.631+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.7 2024-09-12T18:50:18.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.631+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.8 2024-09-12T18:50:18.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.631+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.9 2024-09-12T18:50:18.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.631+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.10 2024-09-12T18:50:18.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.639+0000 7f88025629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 : hit (requested=0x17, cached=0x17) 2024-09-12T18:50:18.642 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.639+0000 7f88025629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 2024-09-12T18:50:18.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.643+0000 7f88025629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:50:18.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.643+0000 7f88025629c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:50:18.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.643+0000 7f88025629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:50:18.645 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.643+0000 7f88025629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39, ofs0, ns] 2024-09-12T18:50:18.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.643+0000 7f86d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431682 cookie 94339742914944 notifier 8124 bl.length()=931 2024-09-12T18:50:18.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.643+0000 7f86d6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:50:18.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.643+0000 7f86d6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:50:18.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.643+0000 7f86d6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:50:18.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.643+0000 7f88025629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): orig_sources= new_sources= 2024-09-12T18:50:18.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.643+0000 7f88025629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): potential sources added=[] removed=[] 2024-09-12T18:50:18.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.643+0000 7f88025629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): orig_dests= new_dests= 2024-09-12T18:50:18.646 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.643+0000 7f88025629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): potential dests added=[] removed=[] 2024-09-12T18:50:18.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.647+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.0 2024-09-12T18:50:18.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.651+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.1 2024-09-12T18:50:18.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.651+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.2 2024-09-12T18:50:18.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.651+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.3 2024-09-12T18:50:18.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.651+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.4 2024-09-12T18:50:18.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.651+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.5 2024-09-12T18:50:18.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.651+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.6 2024-09-12T18:50:18.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.651+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.7 2024-09-12T18:50:18.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.651+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.8 2024-09-12T18:50:18.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.655+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.9 2024-09-12T18:50:18.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.655+0000 7f88025629c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.39.10 2024-09-12T18:50:18.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.655+0000 7f88025629c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 : hit (requested=0x17, cached=0x17) 2024-09-12T18:50:18.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.655+0000 7f88025629c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 2024-09-12T18:50:18.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.659+0000 7f88025629c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:50:18.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.659+0000 7f88025629c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:50:18.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.659+0000 7f88025629c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:50:18.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.659+0000 7f88025629c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39, ofs0, ns] 2024-09-12T18:50:18.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.659+0000 7f86d77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431683 cookie 94339742914944 notifier 8124 bl.length()=899 2024-09-12T18:50:18.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.659+0000 7f86d77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 info.flags=0x17 2024-09-12T18:50:18.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.659+0000 7f86d77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:97c2b296-1395-4700-8053-4f06c4c86557.4689.39 to cache LRU end 2024-09-12T18:50:18.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.659+0000 7f86d77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T18:50:18.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.659+0000 7f88025629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): orig_sources= new_sources= 2024-09-12T18:50:18.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.659+0000 7f88025629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): potential sources added=[] removed=[] 2024-09-12T18:50:18.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.659+0000 7f88025629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): orig_dests= new_dests= 2024-09-12T18:50:18.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.659+0000 7f88025629c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[97c2b296-1395-4700-8053-4f06c4c86557.4689.39]): potential dests added=[] removed=[] 2024-09-12T18:50:18.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.663+0000 7f88025629c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T18:50:18.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.667+0000 7f86b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:18.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.671+0000 7f88025629c0 20 remove_watcher() i=0 2024-09-12T18:50:18.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.671+0000 7f88025629c0 2 removed watcher, disabling cache 2024-09-12T18:50:18.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.675+0000 7f88025629c0 20 remove_watcher() i=1 2024-09-12T18:50:18.678 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.675+0000 7f88025629c0 20 remove_watcher() i=2 2024-09-12T18:50:18.680 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.679+0000 7f88025629c0 20 remove_watcher() i=3 2024-09-12T18:50:18.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.679+0000 7f88025629c0 20 remove_watcher() i=4 2024-09-12T18:50:18.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.679+0000 7f88025629c0 20 remove_watcher() i=5 2024-09-12T18:50:18.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.683+0000 7f88025629c0 20 remove_watcher() i=6 2024-09-12T18:50:18.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.683+0000 7f88025629c0 20 remove_watcher() i=7 2024-09-12T18:50:18.701 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T18:50:18.727 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:50:18.728 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:50:18.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.771+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:18.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.771+0000 7f3ebce699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:18.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.771+0000 7f3ebce699c0 20 realm 2024-09-12T18:50:18.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.771+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:18.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.771+0000 7f3ebce699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:18.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.771+0000 7f3ebce699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:18.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.771+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:18.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.771+0000 7f3ebce699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:18.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.771+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:18.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.775+0000 7f3ebce699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:18.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.775+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:18.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.775+0000 7f3ebce699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:18.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.775+0000 7f3ebce699c0 20 searching for the correct realm 2024-09-12T18:50:18.782 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.779+0000 7f3eba96f640 0 -- 172.21.15.111:0/2985292520 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f3eac01a040 msgr2=0x7f3eac05d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:18.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:18.787+0000 7f3eba16e640 0 -- 172.21.15.111:0/2985292520 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f3eac05d3e0 msgr2=0x7f3eac05f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:19.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.003+0000 7f3ebce699c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:19.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.003+0000 7f3ebce699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:19.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.003+0000 7f3ebce699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:19.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.003+0000 7f3ebce699c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:19.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.003+0000 7f3ebce699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:19.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.003+0000 7f3ebce699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:19.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.003+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.003+0000 7f3ebce699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:19.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.003+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:19.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:19.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 20 zone default found 2024-09-12T18:50:19.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 4 Realm: () 2024-09-12T18:50:19.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:19.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:19.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:19.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 20 zonegroup default 2024-09-12T18:50:19.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:19.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:19.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:19.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 20 started sync module instance, tier type = 2024-09-12T18:50:19.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.007+0000 7f3ebce699c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:19.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.031+0000 7f3ebce699c0 20 add_watcher() i=0 2024-09-12T18:50:19.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.031+0000 7f3ebce699c0 20 add_watcher() i=1 2024-09-12T18:50:19.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.031+0000 7f3ebce699c0 20 add_watcher() i=2 2024-09-12T18:50:19.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.031+0000 7f3ebce699c0 20 add_watcher() i=3 2024-09-12T18:50:19.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.031+0000 7f3ebce699c0 20 add_watcher() i=4 2024-09-12T18:50:19.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.031+0000 7f3ebce699c0 20 add_watcher() i=5 2024-09-12T18:50:19.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.031+0000 7f3ebce699c0 20 add_watcher() i=6 2024-09-12T18:50:19.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.031+0000 7f3ebce699c0 20 add_watcher() i=7 2024-09-12T18:50:19.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.031+0000 7f3ebce699c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:19.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.035+0000 7f3d717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:19.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.039+0000 7f3ebce699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:19.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.039+0000 7f3ebce699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:19.040 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.039+0000 7f3ebce699c0 5 note: GC not initialized 2024-09-12T18:50:19.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.039+0000 7f3cebfff640 20 reqs_thread_entry: start 2024-09-12T18:50:19.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.039+0000 7f3ebce699c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:19.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.039+0000 7f3ebce699c0 20 Filter name: none 2024-09-12T18:50:19.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.039+0000 7f3ce9ffb640 20 reqs_thread_entry: start 2024-09-12T18:50:19.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.039+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.039+0000 7f3ebce699c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:50:19.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.039+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.039+0000 7f3ebce699c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:50:19.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.039+0000 7f3ebce699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:19.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.039+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.043+0000 7f3ebce699c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T18:50:19.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.043+0000 7f3ebce699c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.043+0000 7f3ebce699c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T18:50:19.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.043+0000 7f3ebce699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:19.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.047+0000 7f3d717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:19.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.051+0000 7f3ebce699c0 20 remove_watcher() i=0 2024-09-12T18:50:19.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.051+0000 7f3ebce699c0 2 removed watcher, disabling cache 2024-09-12T18:50:19.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.051+0000 7f3ebce699c0 20 remove_watcher() i=1 2024-09-12T18:50:19.056 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.055+0000 7f3ebce699c0 20 remove_watcher() i=2 2024-09-12T18:50:19.058 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.055+0000 7f3ebce699c0 20 remove_watcher() i=3 2024-09-12T18:50:19.061 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.059+0000 7f3ebce699c0 20 remove_watcher() i=4 2024-09-12T18:50:19.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.059+0000 7f3ebce699c0 20 remove_watcher() i=5 2024-09-12T18:50:19.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.059+0000 7f3ebce699c0 20 remove_watcher() i=6 2024-09-12T18:50:19.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.063+0000 7f3ebce699c0 20 remove_watcher() i=7 2024-09-12T18:50:19.081 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:19.082 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:50:19.082 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: abort-at-change-reshard-state id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T18:50:19.082 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:19.083 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:50:19.083 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:50:19.086 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:50:19.086 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:50:19.130 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:50:19.130 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:50:19.178 INFO:tasks.workunit.client.0.smithi111.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T18:50:19.179 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:50:19.208 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:50:19.208 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:50:19.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.251+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.255+0000 7f66a310e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:19.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.255+0000 7f66a310e9c0 20 realm 2024-09-12T18:50:19.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.255+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.255+0000 7f66a310e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:19.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.255+0000 7f66a310e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:19.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.255+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.255+0000 7f66a310e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:19.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.255+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.255+0000 7f66a310e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:19.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.255+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.258 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.255+0000 7f66a310e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:19.258 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.255+0000 7f66a310e9c0 20 searching for the correct realm 2024-09-12T18:50:19.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.259+0000 7f66a1415640 0 -- 172.21.15.111:0/3809925603 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f6694088070 msgr2=0x7f669407c040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:19.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.267+0000 7f66a0413640 0 -- 172.21.15.111:0/3809925603 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f6698093b60 msgr2=0x7f669806ecd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:50:19.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:19.488 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:19.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:19.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:19.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:19.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:19.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:19.489 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:19.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:19.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 zone default found 2024-09-12T18:50:19.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 4 Realm: () 2024-09-12T18:50:19.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:19.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:19.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:19.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 zonegroup default 2024-09-12T18:50:19.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.487+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.491+0000 7f66a310e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:19.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.491+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.491+0000 7f66a310e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:19.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.491+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.491+0000 7f66a310e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:19.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.491+0000 7f66a310e9c0 20 started sync module instance, tier type = 2024-09-12T18:50:19.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.491+0000 7f66a310e9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:19.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.515+0000 7f66a310e9c0 20 add_watcher() i=0 2024-09-12T18:50:19.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.515+0000 7f66a310e9c0 20 add_watcher() i=1 2024-09-12T18:50:19.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.515+0000 7f66a310e9c0 20 add_watcher() i=2 2024-09-12T18:50:19.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.515+0000 7f66a310e9c0 20 add_watcher() i=3 2024-09-12T18:50:19.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.515+0000 7f66a310e9c0 20 add_watcher() i=4 2024-09-12T18:50:19.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.515+0000 7f66a310e9c0 20 add_watcher() i=5 2024-09-12T18:50:19.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.515+0000 7f66a310e9c0 20 add_watcher() i=6 2024-09-12T18:50:19.519 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.519+0000 7f66a310e9c0 20 add_watcher() i=7 2024-09-12T18:50:19.520 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.519+0000 7f66a310e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:19.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.523+0000 7f65577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:19.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.523+0000 7f66a310e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:19.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.523+0000 7f66a310e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:19.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.523+0000 7f66a310e9c0 5 note: GC not initialized 2024-09-12T18:50:19.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.523+0000 7f65567e4640 20 reqs_thread_entry: start 2024-09-12T18:50:19.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.523+0000 7f66a310e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:19.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.523+0000 7f66a310e9c0 20 Filter name: none 2024-09-12T18:50:19.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.523+0000 7f654ffff640 20 reqs_thread_entry: start 2024-09-12T18:50:19.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.523+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.527 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.523+0000 7f66a310e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:19.527 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.523+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.527+0000 7f66a310e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:19.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.527+0000 7f66a310e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:19.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.527+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.527+0000 7f66a310e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:19.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.527+0000 7f66a310e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.527+0000 7f66a310e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:19.529 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.527+0000 7f66a310e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:19.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.531+0000 7f65577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:19.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.535+0000 7f66a310e9c0 20 remove_watcher() i=0 2024-09-12T18:50:19.538 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.535+0000 7f66a310e9c0 2 removed watcher, disabling cache 2024-09-12T18:50:19.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.539+0000 7f66a310e9c0 20 remove_watcher() i=1 2024-09-12T18:50:19.542 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.539+0000 7f66a310e9c0 20 remove_watcher() i=2 2024-09-12T18:50:19.546 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.543+0000 7f66a310e9c0 20 remove_watcher() i=3 2024-09-12T18:50:19.548 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.547+0000 7f66a310e9c0 20 remove_watcher() i=4 2024-09-12T18:50:19.549 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.547+0000 7f66a310e9c0 20 remove_watcher() i=5 2024-09-12T18:50:19.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.547+0000 7f66a310e9c0 20 remove_watcher() i=6 2024-09-12T18:50:19.552 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.551+0000 7f66a310e9c0 20 remove_watcher() i=7 2024-09-12T18:50:19.567 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:19.567 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:50:19.567 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: a-bucket id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T18:50:19.568 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:19.568 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:50:19.595 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:50:19.595 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:50:19.639 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.635+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.639+0000 7f8b0721a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:19.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.639+0000 7f8b0721a9c0 20 realm 2024-09-12T18:50:19.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.639+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.639+0000 7f8b0721a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:19.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.639+0000 7f8b0721a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:19.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.639+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.639+0000 7f8b0721a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:19.641 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.639+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.639+0000 7f8b0721a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:19.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.639+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:19.643 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.643+0000 7f8b0721a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:19.644 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.643+0000 7f8b0721a9c0 20 searching for the correct realm 2024-09-12T18:50:19.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.643+0000 7f8b05521640 0 -- 172.21.15.111:0/2721490971 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f8af807f030 msgr2=0x7f8af8063ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:19.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:19.859+0000 7f8b0451f640 0 -- 172.21.15.111:0/2721490971 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f8afc0b9990 msgr2=0x7f8afc12c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:20.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:20.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:20.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:20.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:20.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:20.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:20.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:20.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:20.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 zone default found 2024-09-12T18:50:20.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 4 Realm: () 2024-09-12T18:50:20.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:20.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:20.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:20.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 zonegroup default 2024-09-12T18:50:20.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.079+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.083+0000 7f8b0721a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.083+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.083+0000 7f8b0721a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.083+0000 7f8b0721a9c0 20 started sync module instance, tier type = 2024-09-12T18:50:20.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.083+0000 7f8b0721a9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:20.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.111+0000 7f8b0721a9c0 20 add_watcher() i=0 2024-09-12T18:50:20.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.111+0000 7f8b0721a9c0 20 add_watcher() i=1 2024-09-12T18:50:20.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.111+0000 7f8b0721a9c0 20 add_watcher() i=2 2024-09-12T18:50:20.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.111+0000 7f8b0721a9c0 20 add_watcher() i=3 2024-09-12T18:50:20.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.111+0000 7f8b0721a9c0 20 add_watcher() i=4 2024-09-12T18:50:20.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.111+0000 7f8b0721a9c0 20 add_watcher() i=5 2024-09-12T18:50:20.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.111+0000 7f8b0721a9c0 20 add_watcher() i=6 2024-09-12T18:50:20.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.111+0000 7f8b0721a9c0 20 add_watcher() i=7 2024-09-12T18:50:20.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.111+0000 7f8b0721a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:20.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.115+0000 7f89bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:20.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.115+0000 7f8b0721a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:20.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.115+0000 7f8b0721a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:20.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.115+0000 7f8b0721a9c0 5 note: GC not initialized 2024-09-12T18:50:20.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.119+0000 7f89b9fe3640 20 reqs_thread_entry: start 2024-09-12T18:50:20.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.119+0000 7f8b0721a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:20.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.119+0000 7f8b0721a9c0 20 Filter name: none 2024-09-12T18:50:20.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.119+0000 7f892b7fe640 20 reqs_thread_entry: start 2024-09-12T18:50:20.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.119+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.119+0000 7f8b0721a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:20.122 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.119+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.119+0000 7f8b0721a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:20.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.119+0000 7f8b0721a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:20.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.119+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.123+0000 7f8b0721a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:20.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.123+0000 7f8b0721a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.123+0000 7f8b0721a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:20.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.123+0000 7f8b0721a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:20.128 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.127+0000 7f89bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:20.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.131+0000 7f8b0721a9c0 20 remove_watcher() i=0 2024-09-12T18:50:20.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.131+0000 7f8b0721a9c0 2 removed watcher, disabling cache 2024-09-12T18:50:20.135 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.131+0000 7f8b0721a9c0 20 remove_watcher() i=1 2024-09-12T18:50:20.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.135+0000 7f8b0721a9c0 20 remove_watcher() i=2 2024-09-12T18:50:20.140 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.139+0000 7f8b0721a9c0 20 remove_watcher() i=3 2024-09-12T18:50:20.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.139+0000 7f8b0721a9c0 20 remove_watcher() i=4 2024-09-12T18:50:20.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.139+0000 7f8b0721a9c0 20 remove_watcher() i=5 2024-09-12T18:50:20.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.143+0000 7f8b0721a9c0 20 remove_watcher() i=6 2024-09-12T18:50:20.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.143+0000 7f8b0721a9c0 20 remove_watcher() i=7 2024-09-12T18:50:20.161 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T18:50:20.194 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:50:20.194 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:50:20.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 realm 2024-09-12T18:50:20.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:20.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:20.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:20.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 searching for the correct realm 2024-09-12T18:50:20.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.247+0000 7f3b6d003640 0 -- 172.21.15.111:0/2689114401 >> [v2:172.21.15.111:6800/2832238944,v1:172.21.15.111:6801/2832238944] conn(0x558a3117edb0 msgr2=0x558a31181240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:20.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.251+0000 7f3b6c802640 0 -- 172.21.15.111:0/2689114401 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f3b680615a0 msgr2=0x7f3b6800e6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:20.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:20.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:20.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:20.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:20.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:20.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:20.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:20.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:20.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 zone default found 2024-09-12T18:50:20.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 4 Realm: () 2024-09-12T18:50:20.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:20.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:20.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:20.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 zonegroup default 2024-09-12T18:50:20.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 started sync module instance, tier type = 2024-09-12T18:50:20.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:20.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=0 2024-09-12T18:50:20.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=1 2024-09-12T18:50:20.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=2 2024-09-12T18:50:20.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=3 2024-09-12T18:50:20.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=4 2024-09-12T18:50:20.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=5 2024-09-12T18:50:20.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=6 2024-09-12T18:50:20.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=7 2024-09-12T18:50:20.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:20.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.283+0000 7f3a237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:20.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:20.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:20.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 note: GC not initialized 2024-09-12T18:50:20.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.283+0000 7f3a227e4640 20 reqs_thread_entry: start 2024-09-12T18:50:20.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:20.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 Filter name: none 2024-09-12T18:50:20.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.283+0000 7f3993fff640 20 reqs_thread_entry: start 2024-09-12T18:50:20.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:50:20.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:20.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:50:20.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:50:20.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:50:20.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:20.289 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:20.289 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:20.289 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:50:20.289 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:20.289 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:50:20.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.295+0000 7f3b6f4fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:20.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.295+0000 7f3b6f4fd9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:20.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.295+0000 7f3b6f4fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:20.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.295+0000 7f3b6f4fd9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:50:20.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.295+0000 7f3a3ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431686 cookie 94052017565984 notifier 8190 bl.length()=827 2024-09-12T18:50:20.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.295+0000 7f3a3ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:20.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.295+0000 7f3a3ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:20.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.295+0000 7f3a3ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:20.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.299+0000 7f3b6f4fd9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:50:20.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.299+0000 7f3b6f4fd9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:50:20.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.299+0000 7f3b6f4fd9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:50:20.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.299+0000 7f3b6f4fd9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:50:20.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.0 2024-09-12T18:50:20.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.0 2024-09-12T18:50:20.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.1 2024-09-12T18:50:20.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.1 2024-09-12T18:50:20.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.2 2024-09-12T18:50:20.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.2 2024-09-12T18:50:20.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.3 2024-09-12T18:50:20.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.3 2024-09-12T18:50:20.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.4 2024-09-12T18:50:20.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.4 2024-09-12T18:50:20.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.5 2024-09-12T18:50:20.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.5 2024-09-12T18:50:20.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.6 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.6 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.7 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.7 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.8 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.8 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.9 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.9 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.10 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.10 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.11 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.11 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.12 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.12 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.13 2024-09-12T18:50:20.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.13 2024-09-12T18:50:20.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:50:20.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:50:20.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:50:20.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:50:20.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:50:20.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:50:20.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:50:20.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:50:20.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:50:20.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:50:20.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:50:20.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:50:20.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:50:20.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:50:20.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:50:20.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:50:20.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:50:20.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:50:20.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:50:20.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:50:20.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:50:20.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:50:20.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:50:20.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:50:20.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:50:20.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:50:20.330 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3b6f4fd9c0 time 2024-09-12T18:50:20.331396+0000 2024-09-12T18:50:20.330 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:50:20.331 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:20.331 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3b72dd72eb] 2024-09-12T18:50:20.331 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3b72dd749f] 2024-09-12T18:50:20.331 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a2df44cc1] 2024-09-12T18:50:20.331 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x558a2df5901c] 2024-09-12T18:50:20.332 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558a2df5a6a4] 2024-09-12T18:50:20.332 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:50:20.332 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3b71c3dd90] 2024-09-12T18:50:20.332 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:50:20.332 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:50:20.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.327+0000 7f3b6f4fd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3b6f4fd9c0 time 2024-09-12T18:50:20.331396+0000 2024-09-12T18:50:20.332 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:50:20.332 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.332 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:20.332 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3b72dd72eb] 2024-09-12T18:50:20.332 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3b72dd749f] 2024-09-12T18:50:20.332 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a2df44cc1] 2024-09-12T18:50:20.332 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x558a2df5901c] 2024-09-12T18:50:20.333 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558a2df5a6a4] 2024-09-12T18:50:20.333 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:50:20.333 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3b71c3dd90] 2024-09-12T18:50:20.333 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:50:20.333 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:50:20.333 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.333 INFO:tasks.workunit.client.0.smithi111.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:50:20.333 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f3b6f4fd9c0 thread_name:radosgw-admin 2024-09-12T18:50:20.350 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:20.350 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3b71c56520] 2024-09-12T18:50:20.350 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:50:20.350 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:50:20.350 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:50:20.350 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3b72dd7345] 2024-09-12T18:50:20.350 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3b72dd749f] 2024-09-12T18:50:20.351 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a2df44cc1] 2024-09-12T18:50:20.351 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x558a2df5901c] 2024-09-12T18:50:20.351 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558a2df5a6a4] 2024-09-12T18:50:20.351 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:50:20.351 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3b71c3dd90] 2024-09-12T18:50:20.351 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:50:20.351 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:50:20.351 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.331+0000 7f3b6f4fd9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:50:20.351 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f3b6f4fd9c0 thread_name:radosgw-admin 2024-09-12T18:50:20.351 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.351 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:20.351 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3b71c56520] 2024-09-12T18:50:20.352 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:50:20.352 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:50:20.352 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:50:20.352 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3b72dd7345] 2024-09-12T18:50:20.352 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3b72dd749f] 2024-09-12T18:50:20.352 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a2df44cc1] 2024-09-12T18:50:20.352 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x558a2df5901c] 2024-09-12T18:50:20.352 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558a2df5a6a4] 2024-09-12T18:50:20.352 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:50:20.352 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3b71c3dd90] 2024-09-12T18:50:20.352 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:50:20.352 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:50:20.353 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:50:20.353 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.353 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:50:20.353 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: secure 2024-09-12T18:50:20.353 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: crc 2024-09-12T18:50:20.353 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: secure 2024-09-12T18:50:20.353 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: crc 2024-09-12T18:50:20.353 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: secure 2024-09-12T18:50:20.353 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: crc 2024-09-12T18:50:20.353 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: crc 2024-09-12T18:50:20.353 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: secure 2024-09-12T18:50:20.353 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: crc 2024-09-12T18:50:20.353 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: secure 2024-09-12T18:50:20.354 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: crc 2024-09-12T18:50:20.354 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: secure 2024-09-12T18:50:20.354 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.354 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.354 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command rotate-key hook 0x558a31092438 2024-09-12T18:50:20.354 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:20.354 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:50:20.354 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-b con 0x558a30f41de0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:20.354 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-a con 0x558a30f50820 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:20.354 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-c con 0x558a30fdaa20 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:20.354 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.354 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.354 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.355 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:20.355 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): authenticate will time out at 2407.358930s 2024-09-12T18:50:20.355 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): get_auth_request con 0x558a30fdaa20 auth_method 0 2024-09-12T18:50:20.355 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.355 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.355 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.355 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:20.355 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:20.355 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:20.355 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): handle_auth_done global_id 7637 payload 824 2024-09-12T18:50:20.355 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient: _finish_hunting 0 2024-09-12T18:50:20.355 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:50:20.215+0000 7f3b6d804640 1 monclient: found mon.noname-c 2024-09-12T18:50:20.355 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:50:20.355 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:50:20.215+0000 7f3b6d003640 10 monclient: get_auth_request con 0x558a30f41de0 auth_method 0 2024-09-12T18:50:20.356 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.356 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:50:20.356 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: dump: 2024-09-12T18:50:20.356 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.356 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.356 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.356 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.356 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.356 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.356 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.356 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.356 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.356 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.357 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: _finish_auth 0 2024-09-12T18:50:20.357 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: _check_auth_tickets 2024-09-12T18:50:20.357 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:20.357 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.357 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:50:20.357 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: dump: 2024-09-12T18:50:20.357 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.357 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.357 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.357 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.357 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.357 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.357 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.357 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.358 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.358 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.358 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 monclient: authenticate success, global_id 7637 2024-09-12T18:50:20.358 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient: _renew_subs 2024-09-12T18:50:20.358 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:50:20.215+0000 7f3a5b606640 4 set_mon_vals no callback set 2024-09-12T18:50:20.358 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:50:20.358 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient: _renew_subs 2024-09-12T18:50:20.358 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:50:20.358 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 1 librados: init done 2024-09-12T18:50:20.358 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:50:20.219+0000 7f3a59e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:50:20.358 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:50:20.219+0000 7f3a59e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:20.358 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:50:20.219+0000 7f3a59e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:20.358 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:50:20.219+0000 7f3b6d003640 10 monclient: get_auth_request con 0x7f3a54070b10 auth_method 0 2024-09-12T18:50:20.359 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:50:20.219+0000 7f3b6c802640 10 monclient: get_auth_request con 0x558a310bb010 auth_method 0 2024-09-12T18:50:20.359 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:50:20.219+0000 7f3b6d003640 10 monclient: get_auth_request con 0x558a310ddbe0 auth_method 0 2024-09-12T18:50:20.359 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:50:20.223+0000 7f3b6c802640 10 monclient: get_auth_request con 0x558a310e22d0 auth_method 0 2024-09-12T18:50:20.359 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:50:20.223+0000 7f3b6d804640 10 monclient: get_auth_request con 0x558a310e6180 auth_method 0 2024-09-12T18:50:20.359 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: build_initial_monmap 2024-09-12T18:50:20.359 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 1 build_initial for_mkfs: 0 2024-09-12T18:50:20.359 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: monmap: 2024-09-12T18:50:20.359 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:50:20.359 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:50:20.359 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:50:20.359 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:50:20.359 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:50:20.359 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.359 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:50:20.360 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:50:20.360 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:50:20.360 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.360 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding auth protocol: cephx 2024-09-12T18:50:20.360 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding auth protocol: cephx 2024-09-12T18:50:20.360 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding auth protocol: cephx 2024-09-12T18:50:20.360 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: secure 2024-09-12T18:50:20.360 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: crc 2024-09-12T18:50:20.360 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: secure 2024-09-12T18:50:20.360 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: crc 2024-09-12T18:50:20.360 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: secure 2024-09-12T18:50:20.360 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: crc 2024-09-12T18:50:20.360 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: crc 2024-09-12T18:50:20.361 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: secure 2024-09-12T18:50:20.361 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: crc 2024-09-12T18:50:20.361 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: secure 2024-09-12T18:50:20.361 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: crc 2024-09-12T18:50:20.361 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: secure 2024-09-12T18:50:20.361 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.361 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command objecter_requests cmddesc objecter_requests hook 0x558a310edce0 EEXIST 2024-09-12T18:50:20.361 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: init 2024-09-12T18:50:20.361 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding auth protocol: cephx 2024-09-12T18:50:20.361 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding auth protocol: cephx 2024-09-12T18:50:20.361 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding auth protocol: cephx 2024-09-12T18:50:20.361 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: secure 2024-09-12T18:50:20.361 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: crc 2024-09-12T18:50:20.361 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: secure 2024-09-12T18:50:20.362 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: crc 2024-09-12T18:50:20.362 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: secure 2024-09-12T18:50:20.362 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: crc 2024-09-12T18:50:20.362 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: crc 2024-09-12T18:50:20.362 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: secure 2024-09-12T18:50:20.362 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: crc 2024-09-12T18:50:20.362 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: secure 2024-09-12T18:50:20.362 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: crc 2024-09-12T18:50:20.362 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: secure 2024-09-12T18:50:20.362 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.362 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.362 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command rotate-key cmddesc rotate-key hook 0x558a310e92f0 EEXIST 2024-09-12T18:50:20.362 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:20.362 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:50:20.363 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-c con 0x558a31111e90 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:20.363 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-a con 0x558a311117c0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:20.363 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-b con 0x558a311101a0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:20.363 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.363 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.363 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.363 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:20.363 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): authenticate will time out at 2407.369323s 2024-09-12T18:50:20.363 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): get_auth_request con 0x558a31111e90 auth_method 0 2024-09-12T18:50:20.363 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.363 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.364 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.364 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:50:20.227+0000 7f3b6d804640 10 monclient(hunting): get_auth_request con 0x558a311117c0 auth_method 0 2024-09-12T18:50:20.364 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:50:20.227+0000 7f3b6d804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.364 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:50:20.227+0000 7f3b6d804640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.364 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:50:20.227+0000 7f3b6d804640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.364 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:20.364 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:20.364 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:20.364 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:50:20.227+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:20.364 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:50:20.227+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:20.364 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:50:20.227+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:20.364 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:50:20.227+0000 7f3b6d003640 10 monclient(hunting): get_auth_request con 0x558a311101a0 auth_method 0 2024-09-12T18:50:20.364 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:50:20.227+0000 7f3b6d003640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.365 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:50:20.227+0000 7f3b6d003640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.365 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:50:20.227+0000 7f3b6d003640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.365 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): handle_auth_done global_id 7640 payload 824 2024-09-12T18:50:20.365 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient: _finish_hunting 0 2024-09-12T18:50:20.365 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:50:20.227+0000 7f3b6c802640 1 monclient: found mon.noname-c 2024-09-12T18:50:20.365 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:50:20.365 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.365 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:50:20.365 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: dump: 2024-09-12T18:50:20.365 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.365 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.365 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.366 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.366 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.366 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.366 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.366 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.366 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.366 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.366 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: _finish_auth 0 2024-09-12T18:50:20.366 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:50:20.366 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:20.366 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.366 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:50:20.366 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: dump: 2024-09-12T18:50:20.367 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.367 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.367 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.367 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.367 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.367 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.367 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.367 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.367 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.367 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.367 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 monclient: authenticate success, global_id 7640 2024-09-12T18:50:20.367 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: _renew_subs 2024-09-12T18:50:20.367 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:50:20.227+0000 7f3b6e005640 4 set_mon_vals no callback set 2024-09-12T18:50:20.367 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:50:20.368 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: _renew_subs 2024-09-12T18:50:20.368 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:50:20.368 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:50:20.231+0000 7f3a52ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:50:20.368 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:50:20.231+0000 7f3a52ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:20.368 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:50:20.231+0000 7f3a52ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:20.368 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:50:20.231+0000 7f3b6d804640 10 monclient: get_auth_request con 0x7f3a48070a20 auth_method 0 2024-09-12T18:50:20.368 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: get_monmap_and_config 2024-09-12T18:50:20.368 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: build_initial_monmap 2024-09-12T18:50:20.368 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 1 build_initial for_mkfs: 0 2024-09-12T18:50:20.368 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: monmap: 2024-09-12T18:50:20.368 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:50:20.368 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:50:20.368 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:50:20.368 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:50:20.369 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:50:20.369 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.369 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:50:20.369 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:50:20.369 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:50:20.369 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.369 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding auth protocol: cephx 2024-09-12T18:50:20.369 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding auth protocol: cephx 2024-09-12T18:50:20.369 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding auth protocol: cephx 2024-09-12T18:50:20.369 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: secure 2024-09-12T18:50:20.369 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: crc 2024-09-12T18:50:20.369 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: secure 2024-09-12T18:50:20.369 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: crc 2024-09-12T18:50:20.370 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: secure 2024-09-12T18:50:20.370 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: crc 2024-09-12T18:50:20.370 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: crc 2024-09-12T18:50:20.370 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: secure 2024-09-12T18:50:20.370 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: crc 2024-09-12T18:50:20.370 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: secure 2024-09-12T18:50:20.370 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: crc 2024-09-12T18:50:20.370 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: secure 2024-09-12T18:50:20.370 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.370 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: init 2024-09-12T18:50:20.370 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding auth protocol: cephx 2024-09-12T18:50:20.370 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding auth protocol: cephx 2024-09-12T18:50:20.370 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding auth protocol: cephx 2024-09-12T18:50:20.371 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: secure 2024-09-12T18:50:20.371 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: crc 2024-09-12T18:50:20.371 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: secure 2024-09-12T18:50:20.371 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: crc 2024-09-12T18:50:20.371 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: secure 2024-09-12T18:50:20.371 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: crc 2024-09-12T18:50:20.371 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: crc 2024-09-12T18:50:20.371 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: secure 2024-09-12T18:50:20.371 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: crc 2024-09-12T18:50:20.371 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: secure 2024-09-12T18:50:20.371 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: crc 2024-09-12T18:50:20.371 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: secure 2024-09-12T18:50:20.371 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.372 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.372 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command rotate-key cmddesc rotate-key hook 0x7ffcf44ec3e8 EEXIST 2024-09-12T18:50:20.372 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:20.372 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:50:20.372 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-c con 0x558a31165cc0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:20.372 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-b con 0x558a31161160 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:20.372 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-a con 0x558a311578d0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:20.372 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.372 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.372 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.372 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:20.372 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): authenticate will time out at 2407.373741s 2024-09-12T18:50:20.372 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): get_auth_request con 0x558a31165cc0 auth_method 0 2024-09-12T18:50:20.373 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.373 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.373 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.373 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:50:20.231+0000 7f3b6d003640 10 monclient(hunting): get_auth_request con 0x558a311578d0 auth_method 0 2024-09-12T18:50:20.373 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:50:20.231+0000 7f3b6d003640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.373 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:50:20.231+0000 7f3b6d003640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.373 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:50:20.231+0000 7f3b6d003640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.373 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:20.373 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:20.373 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:20.373 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:50:20.231+0000 7f3b6d003640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:20.373 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:50:20.231+0000 7f3b6d003640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:20.373 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:50:20.231+0000 7f3b6d003640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:20.374 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): handle_auth_done global_id 7643 payload 274 2024-09-12T18:50:20.374 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient: _finish_hunting 0 2024-09-12T18:50:20.374 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:50:20.231+0000 7f3b6c802640 1 monclient: found mon.noname-c 2024-09-12T18:50:20.374 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:50:20.374 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.374 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:50:20.374 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: dump: 2024-09-12T18:50:20.374 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.374 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.374 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.374 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.374 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.374 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.375 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.375 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.375 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.375 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.375 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: _finish_auth 0 2024-09-12T18:50:20.375 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:50:20.375 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:20.375 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.375 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:50:20.375 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: dump: 2024-09-12T18:50:20.375 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.375 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.375 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.375 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.376 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.376 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.376 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.376 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.376 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.376 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.376 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 monclient: authenticate success, global_id 7643 2024-09-12T18:50:20.376 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:50:20.376 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 4 set_mon_vals no callback set 2024-09-12T18:50:20.376 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: shutdown 2024-09-12T18:50:20.376 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: build_initial_monmap 2024-09-12T18:50:20.376 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 1 build_initial for_mkfs: 0 2024-09-12T18:50:20.376 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: monmap: 2024-09-12T18:50:20.376 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:50:20.377 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:50:20.377 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:50:20.377 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:50:20.377 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:50:20.377 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.377 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:50:20.377 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:50:20.377 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:50:20.377 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.377 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding auth protocol: cephx 2024-09-12T18:50:20.377 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding auth protocol: cephx 2024-09-12T18:50:20.377 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding auth protocol: cephx 2024-09-12T18:50:20.378 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: secure 2024-09-12T18:50:20.378 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: crc 2024-09-12T18:50:20.378 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: secure 2024-09-12T18:50:20.378 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: crc 2024-09-12T18:50:20.378 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: secure 2024-09-12T18:50:20.378 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: crc 2024-09-12T18:50:20.378 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: crc 2024-09-12T18:50:20.378 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: secure 2024-09-12T18:50:20.378 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: crc 2024-09-12T18:50:20.378 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: secure 2024-09-12T18:50:20.378 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: crc 2024-09-12T18:50:20.378 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: secure 2024-09-12T18:50:20.378 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.379 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 1 librados: starting msgr at 2024-09-12T18:50:20.379 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 1 librados: starting objecter 2024-09-12T18:50:20.379 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command objecter_requests cmddesc objecter_requests hook 0x558a31116aa0 EEXIST 2024-09-12T18:50:20.379 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 1 librados: setting wanted keys 2024-09-12T18:50:20.379 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 1 librados: calling monclient init 2024-09-12T18:50:20.379 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: init 2024-09-12T18:50:20.379 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding auth protocol: cephx 2024-09-12T18:50:20.379 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding auth protocol: cephx 2024-09-12T18:50:20.379 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding auth protocol: cephx 2024-09-12T18:50:20.380 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: secure 2024-09-12T18:50:20.380 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: crc 2024-09-12T18:50:20.380 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: secure 2024-09-12T18:50:20.380 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: crc 2024-09-12T18:50:20.380 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: secure 2024-09-12T18:50:20.380 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: crc 2024-09-12T18:50:20.380 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: crc 2024-09-12T18:50:20.380 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: secure 2024-09-12T18:50:20.380 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: crc 2024-09-12T18:50:20.380 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: secure 2024-09-12T18:50:20.380 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: crc 2024-09-12T18:50:20.380 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: secure 2024-09-12T18:50:20.380 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.381 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.381 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command rotate-key cmddesc rotate-key hook 0x558a31113df8 EEXIST 2024-09-12T18:50:20.381 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:20.381 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:50:20.381 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-a con 0x558a311578d0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:20.381 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-c con 0x558a31161160 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:20.381 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-b con 0x558a31165cc0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:20.381 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.381 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.381 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.381 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:20.381 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): authenticate will time out at 2407.376381s 2024-09-12T18:50:20.381 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): get_auth_request con 0x558a311578d0 auth_method 0 2024-09-12T18:50:20.382 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.382 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.382 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.382 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient(hunting): get_auth_request con 0x558a31161160 auth_method 0 2024-09-12T18:50:20.382 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.382 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.382 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.382 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:20.382 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:20.382 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:20.382 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:20.382 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:20.382 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:20.382 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): handle_auth_done global_id 8190 payload 824 2024-09-12T18:50:20.383 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient: _finish_hunting 0 2024-09-12T18:50:20.383 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:50:20.235+0000 7f3b6c802640 1 monclient: found mon.noname-a 2024-09-12T18:50:20.383 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:50:20.383 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.383 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:50:20.383 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: dump: 2024-09-12T18:50:20.383 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.383 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.383 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.383 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.383 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.383 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.383 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.383 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.384 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.384 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.384 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: _finish_auth 0 2024-09-12T18:50:20.384 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: _check_auth_tickets 2024-09-12T18:50:20.384 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:20.384 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.384 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:50:20.384 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: dump: 2024-09-12T18:50:20.384 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.384 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.384 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.384 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.384 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.384 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.385 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.385 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.385 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.385 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.385 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 5 monclient: authenticate success, global_id 8190 2024-09-12T18:50:20.385 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:50:20.235+0000 7f3a50ff9640 4 set_mon_vals no callback set 2024-09-12T18:50:20.385 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient: _renew_subs 2024-09-12T18:50:20.385 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:20.385 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient: _renew_subs 2024-09-12T18:50:20.385 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:20.385 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 1 librados: init done 2024-09-12T18:50:20.385 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command cr dump hook 0x558a3115d168 2024-09-12T18:50:20.386 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.386 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:50:20.235+0000 7f3a3effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:50:20.386 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:50:20.235+0000 7f3a3effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:20.386 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:50:20.235+0000 7f3a3effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:20.386 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient: get_auth_request con 0x7f3a38070b10 auth_method 0 2024-09-12T18:50:20.386 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:50:20.235+0000 7f3b6d003640 10 monclient: get_auth_request con 0x558a3117edb0 auth_method 0 2024-09-12T18:50:20.386 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.386 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 realm 2024-09-12T18:50:20.386 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.386 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.386 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:20.386 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.386 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.386 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.387 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:50:20.239+0000 7f3b6c802640 10 monclient: get_auth_request con 0x558a31182ff0 auth_method 0 2024-09-12T18:50:20.387 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:20.387 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.387 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:50:20.239+0000 7f3b6d804640 10 monclient: get_auth_request con 0x558a31186850 auth_method 0 2024-09-12T18:50:20.387 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:20.387 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 searching for the correct realm 2024-09-12T18:50:20.387 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:50:20.243+0000 7f3b6d003640 10 monclient: get_auth_request con 0x7f3b6805b620 auth_method 0 2024-09-12T18:50:20.387 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:50:20.243+0000 7f3b6c802640 10 monclient: get_auth_request con 0x7f3b60027040 auth_method 0 2024-09-12T18:50:20.387 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:50:20.243+0000 7f3b6d804640 10 monclient: get_auth_request con 0x7f3b640c9070 auth_method 0 2024-09-12T18:50:20.387 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:50:20.247+0000 7f3b6d003640 0 -- 172.21.15.111:0/2689114401 >> [v2:172.21.15.111:6800/2832238944,v1:172.21.15.111:6801/2832238944] conn(0x558a3117edb0 msgr2=0x558a31181240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:20.387 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:50:20.247+0000 7f3a3effd640 1 client.8190.objecter ms_handle_reset 0x558a3117edb0 session 0x558a3117e6a0 osd.1 2024-09-12T18:50:20.387 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:50:20.247+0000 7f3a3effd640 10 monclient: _renew_subs 2024-09-12T18:50:20.387 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:50:20.247+0000 7f3a3effd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:20.388 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:50:20.247+0000 7f3b6d003640 10 monclient: get_auth_request con 0x7f3a38080ab0 auth_method 0 2024-09-12T18:50:20.388 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:50:20.247+0000 7f3b6d003640 10 monclient: get_auth_request con 0x7f3b6804abd0 auth_method 0 2024-09-12T18:50:20.388 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:50:20.251+0000 7f3b6c802640 10 monclient: get_auth_request con 0x7f3b680615a0 auth_method 0 2024-09-12T18:50:20.388 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:50:20.251+0000 7f3b6c802640 0 -- 172.21.15.111:0/2689114401 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f3b680615a0 msgr2=0x7f3b6800e6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:20.388 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:50:20.251+0000 7f3a3effd640 1 client.8190.objecter ms_handle_reset 0x7f3b680615a0 session 0x7f3b680727c0 osd.0 2024-09-12T18:50:20.388 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:50:20.251+0000 7f3b6c802640 10 monclient: get_auth_request con 0x558a3117edb0 auth_method 0 2024-09-12T18:50:20.388 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:20.388 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:20.388 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:20.388 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:20.388 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:20.388 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:20.388 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.389 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.389 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.389 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:20.389 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.389 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:20.389 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 zone default found 2024-09-12T18:50:20.389 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 4 Realm: () 2024-09-12T18:50:20.389 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:20.389 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:20.389 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:20.389 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 zonegroup default 2024-09-12T18:50:20.389 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.389 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.390 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.390 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.390 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.390 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.390 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 started sync module instance, tier type = 2024-09-12T18:50:20.390 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:20.390 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=0 2024-09-12T18:50:20.390 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=1 2024-09-12T18:50:20.390 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=2 2024-09-12T18:50:20.390 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=3 2024-09-12T18:50:20.390 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=4 2024-09-12T18:50:20.390 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=5 2024-09-12T18:50:20.390 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=6 2024-09-12T18:50:20.390 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=7 2024-09-12T18:50:20.391 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:20.391 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding auth protocol: cephx 2024-09-12T18:50:20.391 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding auth protocol: cephx 2024-09-12T18:50:20.391 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding auth protocol: cephx 2024-09-12T18:50:20.391 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: secure 2024-09-12T18:50:20.391 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: crc 2024-09-12T18:50:20.391 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: secure 2024-09-12T18:50:20.391 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: crc 2024-09-12T18:50:20.391 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: secure 2024-09-12T18:50:20.391 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: crc 2024-09-12T18:50:20.391 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: crc 2024-09-12T18:50:20.391 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: secure 2024-09-12T18:50:20.391 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: crc 2024-09-12T18:50:20.391 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: secure 2024-09-12T18:50:20.392 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:50:20.283+0000 7f3a237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:20.392 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: crc 2024-09-12T18:50:20.392 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: secure 2024-09-12T18:50:20.392 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.392 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:20.392 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:20.392 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command cache list hook 0x558a3115db00 2024-09-12T18:50:20.392 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command cache inspect hook 0x558a3115db00 2024-09-12T18:50:20.392 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command cache erase hook 0x558a3115db00 2024-09-12T18:50:20.392 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command cache zap hook 0x558a3115db00 2024-09-12T18:50:20.392 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 note: GC not initialized 2024-09-12T18:50:20.392 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:50:20.283+0000 7f3a227e4640 20 reqs_thread_entry: start 2024-09-12T18:50:20.392 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command sync trace show hook 0x7f3b68059150 2024-09-12T18:50:20.392 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command sync trace history hook 0x7f3b68059150 2024-09-12T18:50:20.393 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command sync trace active hook 0x7f3b68059150 2024-09-12T18:50:20.393 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command sync trace active_short hook 0x7f3b68059150 2024-09-12T18:50:20.393 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:20.393 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 Filter name: none 2024-09-12T18:50:20.393 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:50:20.283+0000 7f3993fff640 20 reqs_thread_entry: start 2024-09-12T18:50:20.393 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:50:20.393 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.393 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:20.393 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:50:20.393 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:50:20.393 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:50:20.393 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.394 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:20.394 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:20.394 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:20.394 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:50:20.394 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:20.394 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:50:20.394 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:50:20.295+0000 7f3b6f4fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:20.394 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:50:20.295+0000 7f3b6f4fd9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:20.394 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:50:20.295+0000 7f3b6f4fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:20.394 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:50:20.295+0000 7f3b6f4fd9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:50:20.395 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:50:20.295+0000 7f3a3ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431686 cookie 94052017565984 notifier 8190 bl.length()=827 2024-09-12T18:50:20.395 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:50:20.295+0000 7f3a3ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:20.395 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:50:20.295+0000 7f3a3ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:20.395 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:50:20.295+0000 7f3a3ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:20.395 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:50:20.299+0000 7f3b6f4fd9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:50:20.395 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:50:20.299+0000 7f3b6f4fd9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:50:20.395 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:50:20.299+0000 7f3b6f4fd9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:50:20.395 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:50:20.299+0000 7f3b6f4fd9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:50:20.395 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.0 2024-09-12T18:50:20.395 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.0 2024-09-12T18:50:20.395 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.1 2024-09-12T18:50:20.395 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.1 2024-09-12T18:50:20.396 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.2 2024-09-12T18:50:20.396 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.2 2024-09-12T18:50:20.396 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.3 2024-09-12T18:50:20.396 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.3 2024-09-12T18:50:20.396 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.4 2024-09-12T18:50:20.396 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.4 2024-09-12T18:50:20.396 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.5 2024-09-12T18:50:20.396 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.5 2024-09-12T18:50:20.396 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.6 2024-09-12T18:50:20.396 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.6 2024-09-12T18:50:20.396 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.7 2024-09-12T18:50:20.396 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.7 2024-09-12T18:50:20.396 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.8 2024-09-12T18:50:20.397 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.8 2024-09-12T18:50:20.397 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.9 2024-09-12T18:50:20.397 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.9 2024-09-12T18:50:20.397 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.10 2024-09-12T18:50:20.397 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.10 2024-09-12T18:50:20.397 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.11 2024-09-12T18:50:20.397 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.11 2024-09-12T18:50:20.397 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.12 2024-09-12T18:50:20.397 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.12 2024-09-12T18:50:20.397 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.13 2024-09-12T18:50:20.397 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.13 2024-09-12T18:50:20.397 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:50:20.397 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:50:20.397 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:50:20.398 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:50:20.398 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:50:20.398 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:50:20.398 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:50:20.398 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:50:20.398 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:50:20.398 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:50:20.398 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:50:20.398 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:50:20.398 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:50:20.398 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:50:20.398 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:50:20.398 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:50:20.399 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:50:20.399 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:50:20.399 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:50:20.399 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:50:20.399 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:50:20.399 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:50:20.399 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:50:20.399 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:50:20.399 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:50:20.399 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:50:20.399 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:50:20.327+0000 7f3b6f4fd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3b6f4fd9c0 time 2024-09-12T18:50:20.331396+0000 2024-09-12T18:50:20.399 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:50:20.399 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.399 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:20.400 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3b72dd72eb] 2024-09-12T18:50:20.400 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3b72dd749f] 2024-09-12T18:50:20.400 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a2df44cc1] 2024-09-12T18:50:20.400 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x558a2df5901c] 2024-09-12T18:50:20.400 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558a2df5a6a4] 2024-09-12T18:50:20.400 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:50:20.400 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3b71c3dd90] 2024-09-12T18:50:20.400 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:50:20.400 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:50:20.400 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.400 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:50:20.331+0000 7f3b6f4fd9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:50:20.400 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f3b6f4fd9c0 thread_name:radosgw-admin 2024-09-12T18:50:20.400 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.401 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:20.401 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3b71c56520] 2024-09-12T18:50:20.401 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:50:20.401 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:50:20.401 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:50:20.401 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3b72dd7345] 2024-09-12T18:50:20.401 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3b72dd749f] 2024-09-12T18:50:20.401 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a2df44cc1] 2024-09-12T18:50:20.401 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x558a2df5901c] 2024-09-12T18:50:20.401 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558a2df5a6a4] 2024-09-12T18:50:20.401 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:50:20.401 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3b71c3dd90] 2024-09-12T18:50:20.402 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:50:20.402 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:50:20.402 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:50:20.402 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.402 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:50:20.402 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:50:20.402 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:50:20.402 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:50:20.402 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:50:20.402 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:50:20.402 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:50:20.402 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:50:20.402 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:50:20.402 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:50:20.403 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:50:20.404 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:50:20.404 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:50:20.404 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:50:20.404 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:50:20.404 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:50:20.404 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:50:20.404 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:50:20.404 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:50:20.404 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:50:20.404 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:50:20.404 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:50:20.404 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:50:20.405 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:50:20.405 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:50:20.405 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:50:20.405 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:50:20.405 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:50:20.405 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:50:20.405 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:50:20.405 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:50:20.405 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:50:20.405 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:50:20.405 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:50:20.405 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:50:20.405 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:50:20.406 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:50:20.406 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:50:20.406 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:50:20.406 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:50:20.406 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:50:20.406 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:50:20.406 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:50:20.406 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:50:20.407 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:50:20.407 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:50:20.407 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:50:20.407 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:50:20.407 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:50:20.407 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:50:20.407 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:50:20.407 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:50:20.407 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:50:20.407 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:50:20.407 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:50:20.407 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:50:20.407 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:50:20.407 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:50:20.408 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:50:20.408 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:50:20.408 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:50:20.408 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:50:20.408 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:50:20.408 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:50:20.408 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:50:20.408 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:50:20.408 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:50:20.408 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:50:20.408 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:50:20.408 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:50:20.408 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:50:20.409 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:50:20.409 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:50:20.409 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:50:20.409 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:50:20.409 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:50:20.409 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:50:20.409 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:50:20.409 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:50:20.409 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:50:20.409 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3993fff640 / http_manager 2024-09-12T18:50:20.409 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a227e4640 / http_manager 2024-09-12T18:50:20.409 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a237e6640 / rgw_dt_lg_renew 2024-09-12T18:50:20.409 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a3effd640 / ms_dispatch 2024-09-12T18:50:20.409 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a3ffff640 / io_context_pool 2024-09-12T18:50:20.410 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a50ff9640 / io_context_pool 2024-09-12T18:50:20.410 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a52ffd640 / ms_dispatch 2024-09-12T18:50:20.410 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a59e03640 / ms_dispatch 2024-09-12T18:50:20.410 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a5b606640 / io_context_pool 2024-09-12T18:50:20.410 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3b6c802640 / msgr-worker-2 2024-09-12T18:50:20.410 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3b6d003640 / msgr-worker-1 2024-09-12T18:50:20.410 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3b6d804640 / msgr-worker-0 2024-09-12T18:50:20.410 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3b6e005640 / io_context_pool 2024-09-12T18:50:20.410 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3b6f4fd9c0 / radosgw-admin 2024-09-12T18:50:20.410 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:50:20.410 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:50:20.410 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/log/ceph/ceph-client.admin.139617.log 2024-09-12T18:50:20.410 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:50:20.410 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:50:20.411 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: secure 2024-09-12T18:50:20.411 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: crc 2024-09-12T18:50:20.411 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: secure 2024-09-12T18:50:20.411 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: crc 2024-09-12T18:50:20.411 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: secure 2024-09-12T18:50:20.411 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: crc 2024-09-12T18:50:20.411 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: crc 2024-09-12T18:50:20.411 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: secure 2024-09-12T18:50:20.411 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: crc 2024-09-12T18:50:20.411 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: secure 2024-09-12T18:50:20.411 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: crc 2024-09-12T18:50:20.411 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310922f0) adding con mode: secure 2024-09-12T18:50:20.411 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.411 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.412 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command rotate-key hook 0x558a31092438 2024-09-12T18:50:20.412 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:20.412 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:50:20.412 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-b con 0x558a30f41de0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:20.412 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-a con 0x558a30f50820 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:20.412 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-c con 0x558a30fdaa20 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:20.412 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.412 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.412 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.412 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:20.412 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient(hunting): authenticate will time out at 2407.358930s 2024-09-12T18:50:20.412 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): get_auth_request con 0x558a30fdaa20 auth_method 0 2024-09-12T18:50:20.412 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.413 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.413 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.413 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:20.413 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:20.413 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:20.413 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient(hunting): handle_auth_done global_id 7637 payload 824 2024-09-12T18:50:20.413 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient: _finish_hunting 0 2024-09-12T18:50:20.413 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:50:20.215+0000 7f3b6d804640 1 monclient: found mon.noname-c 2024-09-12T18:50:20.413 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:50:20.215+0000 7f3b6d804640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:50:20.413 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:50:20.215+0000 7f3b6d003640 10 monclient: get_auth_request con 0x558a30f41de0 auth_method 0 2024-09-12T18:50:20.413 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.413 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:50:20.413 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: dump: 2024-09-12T18:50:20.413 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.414 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.414 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.414 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.414 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.414 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.414 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.414 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.414 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.414 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.414 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: _finish_auth 0 2024-09-12T18:50:20.414 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: _check_auth_tickets 2024-09-12T18:50:20.414 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:20.414 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.414 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:50:20.415 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:50:20.215+0000 7f3a59e03640 10 monclient: dump: 2024-09-12T18:50:20.415 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.415 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.415 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.415 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.415 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.415 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.415 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.415 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.415 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.415 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.415 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 5 monclient: authenticate success, global_id 7637 2024-09-12T18:50:20.415 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient: _renew_subs 2024-09-12T18:50:20.416 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:50:20.215+0000 7f3a5b606640 4 set_mon_vals no callback set 2024-09-12T18:50:20.416 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:50:20.416 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient: _renew_subs 2024-09-12T18:50:20.416 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:50:20.416 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:50:20.215+0000 7f3b6f4fd9c0 1 librados: init done 2024-09-12T18:50:20.416 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:50:20.219+0000 7f3a59e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:50:20.416 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:50:20.219+0000 7f3a59e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:20.416 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:50:20.219+0000 7f3a59e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:20.416 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:50:20.219+0000 7f3b6d003640 10 monclient: get_auth_request con 0x7f3a54070b10 auth_method 0 2024-09-12T18:50:20.416 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:50:20.219+0000 7f3b6c802640 10 monclient: get_auth_request con 0x558a310bb010 auth_method 0 2024-09-12T18:50:20.416 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:50:20.219+0000 7f3b6d003640 10 monclient: get_auth_request con 0x558a310ddbe0 auth_method 0 2024-09-12T18:50:20.416 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:50:20.223+0000 7f3b6c802640 10 monclient: get_auth_request con 0x558a310e22d0 auth_method 0 2024-09-12T18:50:20.416 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:50:20.223+0000 7f3b6d804640 10 monclient: get_auth_request con 0x558a310e6180 auth_method 0 2024-09-12T18:50:20.416 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: build_initial_monmap 2024-09-12T18:50:20.417 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 1 build_initial for_mkfs: 0 2024-09-12T18:50:20.417 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: monmap: 2024-09-12T18:50:20.417 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:50:20.417 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:50:20.417 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:50:20.417 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:50:20.417 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:50:20.417 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.417 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:50:20.417 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:50:20.417 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:50:20.417 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.417 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding auth protocol: cephx 2024-09-12T18:50:20.418 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding auth protocol: cephx 2024-09-12T18:50:20.418 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding auth protocol: cephx 2024-09-12T18:50:20.418 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: secure 2024-09-12T18:50:20.418 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: crc 2024-09-12T18:50:20.418 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: secure 2024-09-12T18:50:20.418 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: crc 2024-09-12T18:50:20.418 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: secure 2024-09-12T18:50:20.418 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: crc 2024-09-12T18:50:20.418 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: crc 2024-09-12T18:50:20.418 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: secure 2024-09-12T18:50:20.418 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: crc 2024-09-12T18:50:20.418 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: secure 2024-09-12T18:50:20.418 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: crc 2024-09-12T18:50:20.419 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310ea2b0) adding con mode: secure 2024-09-12T18:50:20.419 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.419 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command objecter_requests cmddesc objecter_requests hook 0x558a310edce0 EEXIST 2024-09-12T18:50:20.419 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: init 2024-09-12T18:50:20.419 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding auth protocol: cephx 2024-09-12T18:50:20.419 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding auth protocol: cephx 2024-09-12T18:50:20.419 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding auth protocol: cephx 2024-09-12T18:50:20.419 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: secure 2024-09-12T18:50:20.419 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: crc 2024-09-12T18:50:20.419 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: secure 2024-09-12T18:50:20.419 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: crc 2024-09-12T18:50:20.419 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: secure 2024-09-12T18:50:20.419 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: crc 2024-09-12T18:50:20.420 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: crc 2024-09-12T18:50:20.420 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: secure 2024-09-12T18:50:20.420 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: crc 2024-09-12T18:50:20.420 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: secure 2024-09-12T18:50:20.420 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: crc 2024-09-12T18:50:20.420 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a310e91a8) adding con mode: secure 2024-09-12T18:50:20.420 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.420 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.420 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command rotate-key cmddesc rotate-key hook 0x558a310e92f0 EEXIST 2024-09-12T18:50:20.420 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:20.420 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:50:20.420 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-c con 0x558a31111e90 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:20.420 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-a con 0x558a311117c0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:20.420 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-b con 0x558a311101a0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:20.421 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.421 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.421 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.421 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:20.421 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient(hunting): authenticate will time out at 2407.369323s 2024-09-12T18:50:20.421 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): get_auth_request con 0x558a31111e90 auth_method 0 2024-09-12T18:50:20.421 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.421 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.421 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.421 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:50:20.227+0000 7f3b6d804640 10 monclient(hunting): get_auth_request con 0x558a311117c0 auth_method 0 2024-09-12T18:50:20.421 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:50:20.227+0000 7f3b6d804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.421 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:50:20.227+0000 7f3b6d804640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.421 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:50:20.227+0000 7f3b6d804640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.422 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:20.422 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:20.422 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:20.422 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:50:20.227+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:20.422 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:50:20.227+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:20.422 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:50:20.227+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:20.422 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:50:20.227+0000 7f3b6d003640 10 monclient(hunting): get_auth_request con 0x558a311101a0 auth_method 0 2024-09-12T18:50:20.422 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:50:20.227+0000 7f3b6d003640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.422 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:50:20.227+0000 7f3b6d003640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.422 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:50:20.227+0000 7f3b6d003640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.422 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient(hunting): handle_auth_done global_id 7640 payload 824 2024-09-12T18:50:20.422 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient: _finish_hunting 0 2024-09-12T18:50:20.422 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:50:20.227+0000 7f3b6c802640 1 monclient: found mon.noname-c 2024-09-12T18:50:20.423 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:50:20.227+0000 7f3b6c802640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:50:20.423 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.423 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:50:20.423 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: dump: 2024-09-12T18:50:20.423 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.423 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.423 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.423 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.423 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.423 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.423 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.423 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.423 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.423 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.424 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: _finish_auth 0 2024-09-12T18:50:20.424 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:50:20.424 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:20.424 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.424 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:50:20.424 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:50:20.227+0000 7f3a52ffd640 10 monclient: dump: 2024-09-12T18:50:20.424 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.424 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.424 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.424 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.424 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.424 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.424 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.424 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.425 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.425 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.425 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 5 monclient: authenticate success, global_id 7640 2024-09-12T18:50:20.425 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: _renew_subs 2024-09-12T18:50:20.425 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:50:20.227+0000 7f3b6e005640 4 set_mon_vals no callback set 2024-09-12T18:50:20.425 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:50:20.425 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: _renew_subs 2024-09-12T18:50:20.425 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:50:20.227+0000 7f3b6f4fd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:50:20.425 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:50:20.231+0000 7f3a52ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:50:20.425 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:50:20.231+0000 7f3a52ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:20.425 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:50:20.231+0000 7f3a52ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:20.425 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:50:20.231+0000 7f3b6d804640 10 monclient: get_auth_request con 0x7f3a48070a20 auth_method 0 2024-09-12T18:50:20.425 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: get_monmap_and_config 2024-09-12T18:50:20.425 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: build_initial_monmap 2024-09-12T18:50:20.426 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 1 build_initial for_mkfs: 0 2024-09-12T18:50:20.426 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: monmap: 2024-09-12T18:50:20.426 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:50:20.426 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:50:20.426 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:50:20.426 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:50:20.426 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:50:20.426 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.426 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:50:20.426 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:50:20.426 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:50:20.426 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.426 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding auth protocol: cephx 2024-09-12T18:50:20.426 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding auth protocol: cephx 2024-09-12T18:50:20.427 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding auth protocol: cephx 2024-09-12T18:50:20.427 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: secure 2024-09-12T18:50:20.427 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: crc 2024-09-12T18:50:20.427 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: secure 2024-09-12T18:50:20.427 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: crc 2024-09-12T18:50:20.427 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: secure 2024-09-12T18:50:20.427 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: crc 2024-09-12T18:50:20.427 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: crc 2024-09-12T18:50:20.427 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: secure 2024-09-12T18:50:20.427 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: crc 2024-09-12T18:50:20.427 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: secure 2024-09-12T18:50:20.427 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: crc 2024-09-12T18:50:20.427 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311317e0) adding con mode: secure 2024-09-12T18:50:20.427 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.428 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: init 2024-09-12T18:50:20.428 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding auth protocol: cephx 2024-09-12T18:50:20.428 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding auth protocol: cephx 2024-09-12T18:50:20.428 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding auth protocol: cephx 2024-09-12T18:50:20.428 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: secure 2024-09-12T18:50:20.428 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: crc 2024-09-12T18:50:20.428 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: secure 2024-09-12T18:50:20.428 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: crc 2024-09-12T18:50:20.428 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: secure 2024-09-12T18:50:20.428 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: crc 2024-09-12T18:50:20.428 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: crc 2024-09-12T18:50:20.428 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: secure 2024-09-12T18:50:20.428 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: crc 2024-09-12T18:50:20.429 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: secure 2024-09-12T18:50:20.429 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: crc 2024-09-12T18:50:20.429 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec2a0) adding con mode: secure 2024-09-12T18:50:20.429 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.429 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.429 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command rotate-key cmddesc rotate-key hook 0x7ffcf44ec3e8 EEXIST 2024-09-12T18:50:20.429 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:20.429 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:50:20.429 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-c con 0x558a31165cc0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:20.429 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-b con 0x558a31161160 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:20.429 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-a con 0x558a311578d0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:20.429 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.429 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.430 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.430 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:20.430 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient(hunting): authenticate will time out at 2407.373741s 2024-09-12T18:50:20.430 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): get_auth_request con 0x558a31165cc0 auth_method 0 2024-09-12T18:50:20.430 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.430 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.430 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.430 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:50:20.231+0000 7f3b6d003640 10 monclient(hunting): get_auth_request con 0x558a311578d0 auth_method 0 2024-09-12T18:50:20.430 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:50:20.231+0000 7f3b6d003640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.430 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:50:20.231+0000 7f3b6d003640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.430 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:50:20.231+0000 7f3b6d003640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.430 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:20.430 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:50:20.231+0000 7f3b6d003640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:50:20.231+0000 7f3b6d003640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:50:20.231+0000 7f3b6d003640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient(hunting): handle_auth_done global_id 7643 payload 274 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient: _finish_hunting 0 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:50:20.231+0000 7f3b6c802640 1 monclient: found mon.noname-c 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:50:20.231+0000 7f3b6c802640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: dump: 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.431 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.432 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.432 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.432 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.432 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.432 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.432 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.432 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: _finish_auth 0 2024-09-12T18:50:20.432 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:50:20.432 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:20.432 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.432 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:50:20.432 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:50:20.231+0000 7f3a50ff9640 10 monclient: dump: 2024-09-12T18:50:20.432 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.433 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.433 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.433 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.433 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.433 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.433 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.433 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.433 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.433 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.433 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 monclient: authenticate success, global_id 7643 2024-09-12T18:50:20.433 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: get_monmap_and_config success 2024-09-12T18:50:20.433 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 4 set_mon_vals no callback set 2024-09-12T18:50:20.433 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: shutdown 2024-09-12T18:50:20.433 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: build_initial_monmap 2024-09-12T18:50:20.434 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 1 build_initial for_mkfs: 0 2024-09-12T18:50:20.434 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: monmap: 2024-09-12T18:50:20.434 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:50:20.434 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:50:20.434 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:50:20.434 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:50:20.434 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:50:20.434 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.434 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:50:20.434 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:50:20.434 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:50:20.434 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.435 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding auth protocol: cephx 2024-09-12T18:50:20.435 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding auth protocol: cephx 2024-09-12T18:50:20.435 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding auth protocol: cephx 2024-09-12T18:50:20.435 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: secure 2024-09-12T18:50:20.435 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: crc 2024-09-12T18:50:20.435 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: secure 2024-09-12T18:50:20.435 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: crc 2024-09-12T18:50:20.435 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: secure 2024-09-12T18:50:20.435 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: crc 2024-09-12T18:50:20.435 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: crc 2024-09-12T18:50:20.435 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: secure 2024-09-12T18:50:20.435 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: crc 2024-09-12T18:50:20.435 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: secure 2024-09-12T18:50:20.436 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: crc 2024-09-12T18:50:20.436 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a311357a0) adding con mode: secure 2024-09-12T18:50:20.436 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.436 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 1 librados: starting msgr at 2024-09-12T18:50:20.436 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 1 librados: starting objecter 2024-09-12T18:50:20.436 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command objecter_requests cmddesc objecter_requests hook 0x558a31116aa0 EEXIST 2024-09-12T18:50:20.436 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 1 librados: setting wanted keys 2024-09-12T18:50:20.436 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 1 librados: calling monclient init 2024-09-12T18:50:20.436 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 10 monclient: init 2024-09-12T18:50:20.436 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding auth protocol: cephx 2024-09-12T18:50:20.436 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding auth protocol: cephx 2024-09-12T18:50:20.436 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding auth protocol: cephx 2024-09-12T18:50:20.436 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: secure 2024-09-12T18:50:20.437 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: crc 2024-09-12T18:50:20.437 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: secure 2024-09-12T18:50:20.437 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: crc 2024-09-12T18:50:20.437 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: secure 2024-09-12T18:50:20.437 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: crc 2024-09-12T18:50:20.437 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: crc 2024-09-12T18:50:20.437 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: secure 2024-09-12T18:50:20.437 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: crc 2024-09-12T18:50:20.437 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: secure 2024-09-12T18:50:20.437 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: crc 2024-09-12T18:50:20.437 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:50:20.231+0000 7f3b6f4fd9c0 5 AuthRegistry(0x558a31113cb0) adding con mode: secure 2024-09-12T18:50:20.437 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.437 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.437 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command rotate-key cmddesc rotate-key hook 0x558a31113df8 EEXIST 2024-09-12T18:50:20.438 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:20.438 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:50:20.438 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-a con 0x558a311578d0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:20.438 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-c con 0x558a31161160 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:20.438 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): picked mon.noname-b con 0x558a31165cc0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:20.438 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.438 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.438 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:20.438 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:20.438 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient(hunting): authenticate will time out at 2407.376381s 2024-09-12T18:50:20.438 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): get_auth_request con 0x558a311578d0 auth_method 0 2024-09-12T18:50:20.438 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.438 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.439 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.439 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient(hunting): get_auth_request con 0x558a31161160 auth_method 0 2024-09-12T18:50:20.439 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:20.439 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:20.439 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:20.439 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:20.439 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:20.439 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:20.439 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:20.439 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:20.439 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:20.439 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient(hunting): handle_auth_done global_id 8190 payload 824 2024-09-12T18:50:20.439 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient: _finish_hunting 0 2024-09-12T18:50:20.440 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:50:20.235+0000 7f3b6c802640 1 monclient: found mon.noname-a 2024-09-12T18:50:20.440 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:50:20.235+0000 7f3b6c802640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:50:20.440 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.440 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:50:20.440 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: dump: 2024-09-12T18:50:20.440 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.440 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.440 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.440 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.440 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.440 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.440 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.440 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.440 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.441 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.441 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: _finish_auth 0 2024-09-12T18:50:20.441 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: _check_auth_tickets 2024-09-12T18:50:20.441 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:20.441 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:20.441 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:50:20.441 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:50:20.235+0000 7f3a3effd640 10 monclient: dump: 2024-09-12T18:50:20.441 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:20.441 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:20.441 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.441 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:20.441 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:20.441 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:20.442 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:20.442 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:20.442 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:20.442 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.442 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 5 monclient: authenticate success, global_id 8190 2024-09-12T18:50:20.442 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:50:20.235+0000 7f3a50ff9640 4 set_mon_vals no callback set 2024-09-12T18:50:20.442 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient: _renew_subs 2024-09-12T18:50:20.442 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:20.442 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient: _renew_subs 2024-09-12T18:50:20.442 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:20.442 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 1 librados: init done 2024-09-12T18:50:20.442 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command cr dump hook 0x558a3115d168 2024-09-12T18:50:20.442 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:50:20.235+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.442 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:50:20.235+0000 7f3a3effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:50:20.443 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:50:20.235+0000 7f3a3effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:20.443 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:50:20.235+0000 7f3a3effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:20.443 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:50:20.235+0000 7f3b6d804640 10 monclient: get_auth_request con 0x7f3a38070b10 auth_method 0 2024-09-12T18:50:20.443 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:50:20.235+0000 7f3b6d003640 10 monclient: get_auth_request con 0x558a3117edb0 auth_method 0 2024-09-12T18:50:20.443 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.443 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 realm 2024-09-12T18:50:20.443 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.443 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.443 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:20.443 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.443 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.443 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.443 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:50:20.239+0000 7f3b6c802640 10 monclient: get_auth_request con 0x558a31182ff0 auth_method 0 2024-09-12T18:50:20.444 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:20.444 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.444 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:50:20.239+0000 7f3b6d804640 10 monclient: get_auth_request con 0x558a31186850 auth_method 0 2024-09-12T18:50:20.444 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:20.444 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:50:20.239+0000 7f3b6f4fd9c0 20 searching for the correct realm 2024-09-12T18:50:20.444 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:50:20.243+0000 7f3b6d003640 10 monclient: get_auth_request con 0x7f3b6805b620 auth_method 0 2024-09-12T18:50:20.444 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:50:20.243+0000 7f3b6c802640 10 monclient: get_auth_request con 0x7f3b60027040 auth_method 0 2024-09-12T18:50:20.444 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:50:20.243+0000 7f3b6d804640 10 monclient: get_auth_request con 0x7f3b640c9070 auth_method 0 2024-09-12T18:50:20.444 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:50:20.247+0000 7f3b6d003640 0 -- 172.21.15.111:0/2689114401 >> [v2:172.21.15.111:6800/2832238944,v1:172.21.15.111:6801/2832238944] conn(0x558a3117edb0 msgr2=0x558a31181240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:20.444 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:50:20.247+0000 7f3a3effd640 1 client.8190.objecter ms_handle_reset 0x558a3117edb0 session 0x558a3117e6a0 osd.1 2024-09-12T18:50:20.444 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:50:20.247+0000 7f3a3effd640 10 monclient: _renew_subs 2024-09-12T18:50:20.444 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:50:20.247+0000 7f3a3effd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:20.445 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:50:20.247+0000 7f3b6d003640 10 monclient: get_auth_request con 0x7f3a38080ab0 auth_method 0 2024-09-12T18:50:20.445 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:50:20.247+0000 7f3b6d003640 10 monclient: get_auth_request con 0x7f3b6804abd0 auth_method 0 2024-09-12T18:50:20.445 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:50:20.251+0000 7f3b6c802640 10 monclient: get_auth_request con 0x7f3b680615a0 auth_method 0 2024-09-12T18:50:20.445 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:50:20.251+0000 7f3b6c802640 0 -- 172.21.15.111:0/2689114401 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f3b680615a0 msgr2=0x7f3b6800e6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:20.445 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:50:20.251+0000 7f3a3effd640 1 client.8190.objecter ms_handle_reset 0x7f3b680615a0 session 0x7f3b680727c0 osd.0 2024-09-12T18:50:20.445 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:50:20.251+0000 7f3b6c802640 10 monclient: get_auth_request con 0x558a3117edb0 auth_method 0 2024-09-12T18:50:20.445 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:20.445 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:20.445 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:20.445 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:20.445 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:20.445 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:20.445 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.446 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.446 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.446 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:20.446 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.446 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:50:20.259+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:20.446 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 zone default found 2024-09-12T18:50:20.446 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 4 Realm: () 2024-09-12T18:50:20.446 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:20.446 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:20.446 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:20.446 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 zonegroup default 2024-09-12T18:50:20.446 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.446 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.447 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.447 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.447 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.447 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.447 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 started sync module instance, tier type = 2024-09-12T18:50:20.447 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:50:20.263+0000 7f3b6f4fd9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:20.447 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=0 2024-09-12T18:50:20.447 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=1 2024-09-12T18:50:20.447 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=2 2024-09-12T18:50:20.447 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=3 2024-09-12T18:50:20.447 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=4 2024-09-12T18:50:20.447 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=5 2024-09-12T18:50:20.447 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=6 2024-09-12T18:50:20.447 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 20 add_watcher() i=7 2024-09-12T18:50:20.448 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:50:20.279+0000 7f3b6f4fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:20.448 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding auth protocol: cephx 2024-09-12T18:50:20.448 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding auth protocol: cephx 2024-09-12T18:50:20.448 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding auth protocol: cephx 2024-09-12T18:50:20.448 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: secure 2024-09-12T18:50:20.448 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: crc 2024-09-12T18:50:20.448 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: secure 2024-09-12T18:50:20.448 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: crc 2024-09-12T18:50:20.448 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: secure 2024-09-12T18:50:20.448 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: crc 2024-09-12T18:50:20.448 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: crc 2024-09-12T18:50:20.448 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: secure 2024-09-12T18:50:20.448 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: crc 2024-09-12T18:50:20.448 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: secure 2024-09-12T18:50:20.449 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:50:20.283+0000 7f3a237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:20.449 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: crc 2024-09-12T18:50:20.449 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 AuthRegistry(0x7ffcf44ec780) adding con mode: secure 2024-09-12T18:50:20.449 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:20.449 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:20.449 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:20.449 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command cache list hook 0x558a3115db00 2024-09-12T18:50:20.449 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command cache inspect hook 0x558a3115db00 2024-09-12T18:50:20.449 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command cache erase hook 0x558a3115db00 2024-09-12T18:50:20.449 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command cache zap hook 0x558a3115db00 2024-09-12T18:50:20.449 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 note: GC not initialized 2024-09-12T18:50:20.449 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:50:20.283+0000 7f3a227e4640 20 reqs_thread_entry: start 2024-09-12T18:50:20.450 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command sync trace show hook 0x7f3b68059150 2024-09-12T18:50:20.450 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command sync trace history hook 0x7f3b68059150 2024-09-12T18:50:20.450 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command sync trace active hook 0x7f3b68059150 2024-09-12T18:50:20.450 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 5 asok(0x558a30e882b0) register_command sync trace active_short hook 0x7f3b68059150 2024-09-12T18:50:20.450 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:20.450 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 Filter name: none 2024-09-12T18:50:20.450 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:50:20.283+0000 7f3993fff640 20 reqs_thread_entry: start 2024-09-12T18:50:20.450 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:50:20.450 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:50:20.283+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.450 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:20.450 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:50:20.450 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:50:20.450 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:50:20.450 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:50:20.287+0000 7f3b6f4fd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:50:20.295+0000 7f3b6f4fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:50:20.295+0000 7f3b6f4fd9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:50:20.295+0000 7f3b6f4fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:50:20.295+0000 7f3b6f4fd9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:50:20.295+0000 7f3a3ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431686 cookie 94052017565984 notifier 8190 bl.length()=827 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:50:20.295+0000 7f3a3ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:50:20.295+0000 7f3a3ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:50:20.295+0000 7f3a3ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:20.451 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:50:20.299+0000 7f3b6f4fd9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:50:20.299+0000 7f3b6f4fd9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:50:20.299+0000 7f3b6f4fd9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:50:20.299+0000 7f3b6f4fd9c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.0 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.0 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.1 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.1 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.2 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.2 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.3 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.3 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.4 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.4 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.5 2024-09-12T18:50:20.452 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.5 2024-09-12T18:50:20.453 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.6 2024-09-12T18:50:20.453 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.6 2024-09-12T18:50:20.453 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.7 2024-09-12T18:50:20.453 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.7 2024-09-12T18:50:20.453 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.8 2024-09-12T18:50:20.453 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.8 2024-09-12T18:50:20.453 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.9 2024-09-12T18:50:20.453 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.9 2024-09-12T18:50:20.453 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.10 2024-09-12T18:50:20.453 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.10 2024-09-12T18:50:20.453 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.11 2024-09-12T18:50:20.453 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.11 2024-09-12T18:50:20.453 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.12 2024-09-12T18:50:20.454 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.12 2024-09-12T18:50:20.454 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.13 2024-09-12T18:50:20.454 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.13 2024-09-12T18:50:20.454 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:50:20.454 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:50:20.311+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:50:20.454 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:50:20.454 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:50:20.454 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:50:20.454 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:50:20.454 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:50:20.454 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:50:20.454 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:50:20.454 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:50:20.455 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:50:20.455 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:50:20.315+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:50:20.455 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:50:20.455 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:50:20.455 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:50:20.455 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:50:20.455 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:50:20.455 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:50:20.455 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:50:20.455 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:50:20.319+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:50:20.455 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:50:20.455 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:50:20.456 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:50:20.456 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:50:20.456 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:50:20.456 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:50:20.323+0000 7f3b6f4fd9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:50:20.456 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:50:20.327+0000 7f3b6f4fd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3b6f4fd9c0 time 2024-09-12T18:50:20.331396+0000 2024-09-12T18:50:20.456 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:50:20.456 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.456 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:20.456 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f3b72dd72eb] 2024-09-12T18:50:20.456 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3b72dd749f] 2024-09-12T18:50:20.456 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a2df44cc1] 2024-09-12T18:50:20.456 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x558a2df5901c] 2024-09-12T18:50:20.456 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558a2df5a6a4] 2024-09-12T18:50:20.456 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:50:20.457 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3b71c3dd90] 2024-09-12T18:50:20.457 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:50:20.457 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:50:20.457 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.457 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:50:20.331+0000 7f3b6f4fd9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:50:20.457 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f3b6f4fd9c0 thread_name:radosgw-admin 2024-09-12T18:50:20.457 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.457 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:20.457 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3b71c56520] 2024-09-12T18:50:20.457 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:50:20.457 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:50:20.457 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:50:20.457 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3b72dd7345] 2024-09-12T18:50:20.457 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f3b72dd749f] 2024-09-12T18:50:20.458 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558a2df44cc1] 2024-09-12T18:50:20.458 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x558a2df5901c] 2024-09-12T18:50:20.458 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x558a2df5a6a4] 2024-09-12T18:50:20.458 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:50:20.458 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3b71c3dd90] 2024-09-12T18:50:20.458 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:50:20.458 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:50:20.458 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:50:20.458 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:20.458 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:50:20.458 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:50:20.458 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:50:20.458 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:50:20.458 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:50:20.459 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:50:20.459 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:50:20.459 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:50:20.459 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:50:20.459 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:50:20.459 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:50:20.459 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:50:20.459 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:50:20.459 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:50:20.459 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:50:20.459 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:50:20.459 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:50:20.459 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:50:20.460 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:50:20.460 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:50:20.460 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:50:20.460 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:50:20.460 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:50:20.460 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:50:20.460 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:50:20.460 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:50:20.460 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:50:20.460 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:50:20.460 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:50:20.460 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:50:20.460 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:50:20.460 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:50:20.461 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:50:20.461 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:50:20.461 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:50:20.461 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:50:20.461 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:50:20.461 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:50:20.461 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:50:20.461 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:50:20.461 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:50:20.461 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:50:20.461 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:50:20.461 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:50:20.461 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:50:20.462 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:50:20.462 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:50:20.462 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:50:20.462 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:50:20.462 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:50:20.462 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:50:20.462 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:50:20.462 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:50:20.462 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:50:20.462 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:50:20.462 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:50:20.462 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:50:20.462 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:50:20.462 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:50:20.463 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:50:20.463 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:50:20.463 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:50:20.463 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:50:20.463 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:50:20.463 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:50:20.463 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:50:20.463 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:50:20.463 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:50:20.463 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:50:20.463 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:50:20.463 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:50:20.463 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:50:20.463 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:50:20.464 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:50:20.464 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:50:20.464 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:50:20.464 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:50:20.464 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:50:20.464 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:50:20.464 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:50:20.464 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:50:20.464 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:50:20.464 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:50:20.464 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:50:20.464 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:50:20.464 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:50:20.464 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:50:20.465 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:50:20.465 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:50:20.465 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:50:20.465 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:50:20.465 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:50:20.465 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:50:20.465 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:50:20.465 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3993fff640 / http_manager 2024-09-12T18:50:20.465 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a227e4640 / http_manager 2024-09-12T18:50:20.465 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a237e6640 / rgw_dt_lg_renew 2024-09-12T18:50:20.465 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a3effd640 / ms_dispatch 2024-09-12T18:50:20.465 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a3ffff640 / io_context_pool 2024-09-12T18:50:20.465 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a50ff9640 / io_context_pool 2024-09-12T18:50:20.465 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a52ffd640 / ms_dispatch 2024-09-12T18:50:20.466 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a59e03640 / ms_dispatch 2024-09-12T18:50:20.466 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3a5b606640 / io_context_pool 2024-09-12T18:50:20.466 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3b6c802640 / msgr-worker-2 2024-09-12T18:50:20.466 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3b6d003640 / msgr-worker-1 2024-09-12T18:50:20.466 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3b6d804640 / msgr-worker-0 2024-09-12T18:50:20.466 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3b6e005640 / io_context_pool 2024-09-12T18:50:20.466 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3b6f4fd9c0 / radosgw-admin 2024-09-12T18:50:20.466 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:50:20.466 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:50:20.466 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:50:20.333779Z_cff561a2-dc3e-4dde-9b18-a0dd6fa92aa3/log 2024-09-12T18:50:20.466 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:50:20.466 INFO:tasks.workunit.client.0.smithi111.stderr:Aborted 2024-09-12T18:50:20.466 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:50:20.468 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:50:20.468 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:50:20.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.411+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.411+0000 7f92305179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.411+0000 7f92305179c0 20 realm 2024-09-12T18:50:20.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.411+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.411+0000 7f92305179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.411+0000 7f92305179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:20.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.411+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.411+0000 7f92305179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.411+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.415+0000 7f92305179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:20.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.415+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.415+0000 7f92305179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:20.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.415+0000 7f92305179c0 20 searching for the correct realm 2024-09-12T18:50:20.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.419+0000 7f922e01d640 0 -- 172.21.15.111:0/437023062 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f922806c040 msgr2=0x7f922805cb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:50:20.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.427+0000 7f922d81c640 0 -- 172.21.15.111:0/437023062 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f92280648c0 msgr2=0x7f9228065a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:50:20.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.643+0000 7f92305179c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:20.647 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.643+0000 7f92305179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:20.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.643+0000 7f92305179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:20.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.643+0000 7f92305179c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:20.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.643+0000 7f92305179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:20.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.643+0000 7f92305179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:20.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.643+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.647+0000 7f92305179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.648 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.647+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.647+0000 7f92305179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:20.649 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.647+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.647+0000 7f92305179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:20.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.647+0000 7f92305179c0 20 zone default found 2024-09-12T18:50:20.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.647+0000 7f92305179c0 4 Realm: () 2024-09-12T18:50:20.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.647+0000 7f92305179c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:20.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.647+0000 7f92305179c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:20.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.647+0000 7f92305179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:20.650 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.647+0000 7f92305179c0 20 zonegroup default 2024-09-12T18:50:20.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.647+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.647+0000 7f92305179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.651 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.647+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.651+0000 7f92305179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.651+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.651+0000 7f92305179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.652 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.651+0000 7f92305179c0 20 started sync module instance, tier type = 2024-09-12T18:50:20.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.651+0000 7f92305179c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:20.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.675+0000 7f92305179c0 20 add_watcher() i=0 2024-09-12T18:50:20.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.675+0000 7f92305179c0 20 add_watcher() i=1 2024-09-12T18:50:20.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.675+0000 7f92305179c0 20 add_watcher() i=2 2024-09-12T18:50:20.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.675+0000 7f92305179c0 20 add_watcher() i=3 2024-09-12T18:50:20.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.675+0000 7f92305179c0 20 add_watcher() i=4 2024-09-12T18:50:20.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.675+0000 7f92305179c0 20 add_watcher() i=5 2024-09-12T18:50:20.679 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.675+0000 7f92305179c0 20 add_watcher() i=6 2024-09-12T18:50:20.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.679+0000 7f92305179c0 20 add_watcher() i=7 2024-09-12T18:50:20.682 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.679+0000 7f92305179c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:20.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.683+0000 7f90e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:20.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.683+0000 7f92305179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:20.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.683+0000 7f92305179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:20.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.683+0000 7f92305179c0 5 note: GC not initialized 2024-09-12T18:50:20.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.687+0000 7f905f7fe640 20 reqs_thread_entry: start 2024-09-12T18:50:20.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.687+0000 7f92305179c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:20.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.687+0000 7f92305179c0 20 Filter name: none 2024-09-12T18:50:20.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.687+0000 7f905d7fa640 20 reqs_thread_entry: start 2024-09-12T18:50:20.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.687+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.687+0000 7f92305179c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:20.690 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.687+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.687+0000 7f92305179c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:50:20.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.687+0000 7f92305179c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:20.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.687+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.691+0000 7f92305179c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:20.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.691+0000 7f92305179c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.691+0000 7f92305179c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:50:20.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.691+0000 7f92305179c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:20.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.695+0000 7f90e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:20.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.699+0000 7f92305179c0 20 remove_watcher() i=0 2024-09-12T18:50:20.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.699+0000 7f92305179c0 2 removed watcher, disabling cache 2024-09-12T18:50:20.703 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.699+0000 7f92305179c0 20 remove_watcher() i=1 2024-09-12T18:50:20.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.703+0000 7f92305179c0 20 remove_watcher() i=2 2024-09-12T18:50:20.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.707+0000 7f92305179c0 20 remove_watcher() i=3 2024-09-12T18:50:20.711 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.707+0000 7f92305179c0 20 remove_watcher() i=4 2024-09-12T18:50:20.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.711+0000 7f92305179c0 20 remove_watcher() i=5 2024-09-12T18:50:20.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.711+0000 7f92305179c0 20 remove_watcher() i=6 2024-09-12T18:50:20.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.715+0000 7f92305179c0 20 remove_watcher() i=7 2024-09-12T18:50:20.732 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:50:20.733 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:50:20.745 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:50:20.772 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:50:20.772 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:50:20.819 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.815+0000 7fba84e039c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.820 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.819+0000 7fba84e039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.819+0000 7fba84e039c0 20 realm 2024-09-12T18:50:20.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.819+0000 7fba84e039c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.819+0000 7fba84e039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.819+0000 7fba84e039c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:20.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.819+0000 7fba84e039c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.819+0000 7fba84e039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:20.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.819+0000 7fba84e039c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.822 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.819+0000 7fba84e039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:20.822 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.819+0000 7fba84e039c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:20.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.819+0000 7fba84e039c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:20.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.819+0000 7fba84e039c0 20 searching for the correct realm 2024-09-12T18:50:20.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:20.823+0000 7fba8310a640 0 -- 172.21.15.111:0/2781132117 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fba7812bc20 msgr2=0x7fba781052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:21.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.039+0000 7fba82108640 0 -- 172.21.15.111:0/2781132117 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fba7c03c940 msgr2=0x7fba7c02d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:21.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.255+0000 7fba84e039c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:21.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.255+0000 7fba84e039c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:21.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.255+0000 7fba84e039c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:21.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.255+0000 7fba84e039c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:21.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.255+0000 7fba84e039c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:21.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.255+0000 7fba84e039c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:21.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.255+0000 7fba84e039c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:21.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.255+0000 7fba84e039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:21.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.255+0000 7fba84e039c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:21.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.259+0000 7fba84e039c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:21.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.259+0000 7fba84e039c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:21.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.259+0000 7fba84e039c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:21.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.259+0000 7fba84e039c0 20 zone default found 2024-09-12T18:50:21.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.259+0000 7fba84e039c0 4 Realm: () 2024-09-12T18:50:21.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.259+0000 7fba84e039c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:21.262 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.259+0000 7fba84e039c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:21.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.259+0000 7fba84e039c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:21.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.259+0000 7fba84e039c0 20 zonegroup default 2024-09-12T18:50:21.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.259+0000 7fba84e039c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:21.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.259+0000 7fba84e039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:21.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.259+0000 7fba84e039c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:21.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.259+0000 7fba84e039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:21.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.259+0000 7fba84e039c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:21.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.263+0000 7fba84e039c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:21.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.263+0000 7fba84e039c0 20 started sync module instance, tier type = 2024-09-12T18:50:21.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.263+0000 7fba84e039c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:21.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.287+0000 7fba84e039c0 20 add_watcher() i=0 2024-09-12T18:50:21.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.287+0000 7fba84e039c0 20 add_watcher() i=1 2024-09-12T18:50:21.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.287+0000 7fba84e039c0 20 add_watcher() i=2 2024-09-12T18:50:21.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.287+0000 7fba84e039c0 20 add_watcher() i=3 2024-09-12T18:50:21.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.287+0000 7fba84e039c0 20 add_watcher() i=4 2024-09-12T18:50:21.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.287+0000 7fba84e039c0 20 add_watcher() i=5 2024-09-12T18:50:21.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.287+0000 7fba84e039c0 20 add_watcher() i=6 2024-09-12T18:50:21.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.291+0000 7fba84e039c0 20 add_watcher() i=7 2024-09-12T18:50:21.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.291+0000 7fba84e039c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:21.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.295+0000 7fb9397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:21.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.295+0000 7fba84e039c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:21.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.295+0000 7fba84e039c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:21.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.295+0000 7fba84e039c0 5 note: GC not initialized 2024-09-12T18:50:21.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.295+0000 7fb8b3fff640 20 reqs_thread_entry: start 2024-09-12T18:50:21.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.295+0000 7fba84e039c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:21.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.295+0000 7fba84e039c0 20 Filter name: none 2024-09-12T18:50:21.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.295+0000 7fb8b1ffb640 20 reqs_thread_entry: start 2024-09-12T18:50:21.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.295+0000 7fba84e039c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:50:21.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.295+0000 7fba84e039c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:21.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:21.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:50:21.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:50:21.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:50:21.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:21.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:50:21.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:21.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:21.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:50:21.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:21.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:50:21.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:50:21.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:50:21.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:50:21.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:50:21.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:50:21.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:50:21.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:50:21.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:50:21.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:50:21.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.299+0000 7fba84e039c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:50:21.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.303+0000 7fba84e039c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:50:21.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.303+0000 7fba84e039c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:50:21.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.303+0000 7fba84e039c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:50:21.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.303+0000 7fba84e039c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:50:21.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.303+0000 7fba84e039c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:50:21.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.303+0000 7fba84e039c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:50:21.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.303+0000 7fba84e039c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:50:21.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.303+0000 7fba84e039c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:50:21.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.303+0000 7fba84e039c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:50:21.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.303+0000 7fba84e039c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:50:21.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.307+0000 7fba84e039c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:50:21.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.307+0000 7fba84e039c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:50:21.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.307+0000 7fba84e039c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:50:21.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.307+0000 7fba84e039c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:50:21.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.307+0000 7fba84e039c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:50:21.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.307+0000 7fba84e039c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:50:21.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.311+0000 7fb9397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:21.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.315+0000 7fba84e039c0 20 remove_watcher() i=0 2024-09-12T18:50:21.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.315+0000 7fba84e039c0 2 removed watcher, disabling cache 2024-09-12T18:50:21.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.319+0000 7fba84e039c0 20 remove_watcher() i=1 2024-09-12T18:50:21.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.323+0000 7fba84e039c0 20 remove_watcher() i=2 2024-09-12T18:50:21.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.323+0000 7fba84e039c0 20 remove_watcher() i=3 2024-09-12T18:50:21.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.327+0000 7fba84e039c0 20 remove_watcher() i=4 2024-09-12T18:50:21.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.327+0000 7fba84e039c0 20 remove_watcher() i=5 2024-09-12T18:50:21.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.331+0000 7fba84e039c0 20 remove_watcher() i=6 2024-09-12T18:50:21.334 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:21.331+0000 7fba84e039c0 20 remove_watcher() i=7 2024-09-12T18:50:51.371 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:50:51.403 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:50:51.403 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:50:51.449 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.447+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.447+0000 7fbd39a849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:51.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.447+0000 7fbd39a849c0 20 realm 2024-09-12T18:50:51.451 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.447+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.447+0000 7fbd39a849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:51.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.447+0000 7fbd39a849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:51.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.447+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.451+0000 7fbd39a849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:51.452 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.451+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.451+0000 7fbd39a849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:51.453 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.451+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.451+0000 7fbd39a849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:51.454 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.451+0000 7fbd39a849c0 20 searching for the correct realm 2024-09-12T18:50:51.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.455+0000 7fbd37d8b640 0 -- 172.21.15.111:0/3323952584 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fbd20008050 msgr2=0x7fbd200089c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:51.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.463+0000 7fbd36d89640 0 -- 172.21.15.111:0/3323952584 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fbd30039420 msgr2=0x7fbd30039880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:51.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.679+0000 7fbd39a849c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:51.683 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.679+0000 7fbd39a849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:51.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.679+0000 7fbd39a849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:51.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.679+0000 7fbd39a849c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:51.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.679+0000 7fbd39a849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:51.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.679+0000 7fbd39a849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:51.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.679+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:51.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:51.685 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:51.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 20 zone default found 2024-09-12T18:50:51.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 4 Realm: () 2024-09-12T18:50:51.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:51.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:51.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:51.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 20 zonegroup default 2024-09-12T18:50:51.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:51.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:51.687 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.683+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.687+0000 7fbd39a849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:51.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.687+0000 7fbd39a849c0 20 started sync module instance, tier type = 2024-09-12T18:50:51.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.687+0000 7fbd39a849c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:51.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.711+0000 7fbd39a849c0 20 add_watcher() i=0 2024-09-12T18:50:51.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.711+0000 7fbd39a849c0 20 add_watcher() i=1 2024-09-12T18:50:51.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.711+0000 7fbd39a849c0 20 add_watcher() i=2 2024-09-12T18:50:51.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.711+0000 7fbd39a849c0 20 add_watcher() i=3 2024-09-12T18:50:51.713 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.711+0000 7fbd39a849c0 20 add_watcher() i=4 2024-09-12T18:50:51.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.711+0000 7fbd39a849c0 20 add_watcher() i=5 2024-09-12T18:50:51.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.711+0000 7fbd39a849c0 20 add_watcher() i=6 2024-09-12T18:50:51.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.711+0000 7fbd39a849c0 20 add_watcher() i=7 2024-09-12T18:50:51.715 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.711+0000 7fbd39a849c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:51.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.715+0000 7fbbedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:51.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.719+0000 7fbd39a849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:51.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.719+0000 7fbd39a849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:51.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.719+0000 7fbd39a849c0 5 note: GC not initialized 2024-09-12T18:50:51.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.719+0000 7fbbecfe1640 20 reqs_thread_entry: start 2024-09-12T18:50:51.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.719+0000 7fbd39a849c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:51.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.719+0000 7fbd39a849c0 20 Filter name: none 2024-09-12T18:50:51.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.719+0000 7fbb667fc640 20 reqs_thread_entry: start 2024-09-12T18:50:51.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.719+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.719+0000 7fbd39a849c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:51.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.719+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.719+0000 7fbd39a849c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:50:51.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.719+0000 7fbd39a849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:51.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.719+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.723+0000 7fbd39a849c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:51.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.723+0000 7fbd39a849c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.723+0000 7fbd39a849c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:50:51.724 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.723+0000 7fbd39a849c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:51.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.727+0000 7fbbedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:51.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.731+0000 7fbd39a849c0 20 remove_watcher() i=0 2024-09-12T18:50:51.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.731+0000 7fbd39a849c0 2 removed watcher, disabling cache 2024-09-12T18:50:51.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.735+0000 7fbd39a849c0 20 remove_watcher() i=1 2024-09-12T18:50:51.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.735+0000 7fbd39a849c0 20 remove_watcher() i=2 2024-09-12T18:50:51.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.739+0000 7fbd39a849c0 20 remove_watcher() i=3 2024-09-12T18:50:51.743 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.739+0000 7fbd39a849c0 20 remove_watcher() i=4 2024-09-12T18:50:51.745 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.743+0000 7fbd39a849c0 20 remove_watcher() i=5 2024-09-12T18:50:51.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.743+0000 7fbd39a849c0 20 remove_watcher() i=6 2024-09-12T18:50:51.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.747+0000 7fbd39a849c0 20 remove_watcher() i=7 2024-09-12T18:50:51.765 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:50:51.765 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:50:51.803 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:50:51.830 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:50:51.830 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:50:51.876 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.875+0000 7f171748a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.875+0000 7f171748a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:51.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.875+0000 7f171748a9c0 20 realm 2024-09-12T18:50:51.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.875+0000 7f171748a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.875+0000 7f171748a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:51.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.875+0000 7f171748a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:51.878 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.875+0000 7f171748a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.875+0000 7f171748a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:51.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.875+0000 7f171748a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.879+0000 7f171748a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:51.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.879+0000 7f171748a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:51.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.879+0000 7f171748a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:51.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.879+0000 7f171748a9c0 20 searching for the correct realm 2024-09-12T18:50:51.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.883+0000 7f1714f90640 0 -- 172.21.15.111:0/1619673668 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f171008e050 msgr2=0x7f171006eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:51.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:51.891+0000 7f170ffff640 0 -- 172.21.15.111:0/1619673668 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f1710099bb0 msgr2=0x7f17100919d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:52.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.107+0000 7f171748a9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:52.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.107+0000 7f171748a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:52.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.107+0000 7f171748a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:52.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.107+0000 7f171748a9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:52.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.107+0000 7f171748a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:52.110 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.107+0000 7f171748a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:52.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.107+0000 7f171748a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.107+0000 7f171748a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.107+0000 7f171748a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.107+0000 7f171748a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:52.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.107+0000 7f171748a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:52.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 20 zone default found 2024-09-12T18:50:52.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 4 Realm: () 2024-09-12T18:50:52.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:52.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:52.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:52.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 20 zonegroup default 2024-09-12T18:50:52.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 20 started sync module instance, tier type = 2024-09-12T18:50:52.115 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.111+0000 7f171748a9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:52.138 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.135+0000 7f171748a9c0 20 add_watcher() i=0 2024-09-12T18:50:52.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.135+0000 7f171748a9c0 20 add_watcher() i=1 2024-09-12T18:50:52.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.135+0000 7f171748a9c0 20 add_watcher() i=2 2024-09-12T18:50:52.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.135+0000 7f171748a9c0 20 add_watcher() i=3 2024-09-12T18:50:52.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.135+0000 7f171748a9c0 20 add_watcher() i=4 2024-09-12T18:50:52.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.135+0000 7f171748a9c0 20 add_watcher() i=5 2024-09-12T18:50:52.139 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.135+0000 7f171748a9c0 20 add_watcher() i=6 2024-09-12T18:50:52.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.139+0000 7f171748a9c0 20 add_watcher() i=7 2024-09-12T18:50:52.141 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.139+0000 7f171748a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:52.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.143+0000 7f15cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:52.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.143+0000 7f171748a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:52.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.143+0000 7f171748a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:52.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.143+0000 7f171748a9c0 5 note: GC not initialized 2024-09-12T18:50:52.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.143+0000 7f15ca7e4640 20 reqs_thread_entry: start 2024-09-12T18:50:52.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.143+0000 7f171748a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:52.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.143+0000 7f171748a9c0 20 Filter name: none 2024-09-12T18:50:52.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.143+0000 7f15c37fe640 20 reqs_thread_entry: start 2024-09-12T18:50:52.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.143+0000 7f171748a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:50:52.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.143+0000 7f171748a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:52.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:50:52.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:50:52.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:50:52.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:52.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:52.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:52.149 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:50:52.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:52.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:50:52.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:50:52.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:50:52.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:50:52.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:50:52.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:50:52.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.147+0000 7f171748a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:50:52.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.151+0000 7f171748a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:50:52.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.151+0000 7f171748a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:50:52.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.151+0000 7f171748a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:50:52.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.151+0000 7f171748a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:50:52.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.151+0000 7f171748a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:50:52.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.151+0000 7f171748a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:50:52.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.151+0000 7f171748a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:50:52.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.151+0000 7f171748a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:50:52.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.151+0000 7f171748a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:50:52.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.151+0000 7f171748a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:50:52.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.155+0000 7f171748a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:50:52.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.155+0000 7f171748a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:50:52.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.155+0000 7f171748a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:50:52.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.155+0000 7f171748a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:50:52.158 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.155+0000 7f171748a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:50:52.158 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.155+0000 7f171748a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:50:52.158 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.155+0000 7f171748a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:50:52.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.155+0000 7f171748a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:50:52.159 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.159+0000 7f171748a9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:50:52.160 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.159+0000 7f171748a9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:50:52.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.159+0000 7f15cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:52.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.163+0000 7f171748a9c0 20 remove_watcher() i=0 2024-09-12T18:50:52.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.163+0000 7f171748a9c0 2 removed watcher, disabling cache 2024-09-12T18:50:52.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.167+0000 7f171748a9c0 20 remove_watcher() i=1 2024-09-12T18:50:52.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.167+0000 7f171748a9c0 20 remove_watcher() i=2 2024-09-12T18:50:52.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.171+0000 7f171748a9c0 20 remove_watcher() i=3 2024-09-12T18:50:52.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.171+0000 7f171748a9c0 20 remove_watcher() i=4 2024-09-12T18:50:52.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.175+0000 7f171748a9c0 20 remove_watcher() i=5 2024-09-12T18:50:52.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.175+0000 7f171748a9c0 20 remove_watcher() i=6 2024-09-12T18:50:52.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.175+0000 7f171748a9c0 20 remove_watcher() i=7 2024-09-12T18:50:52.197 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:50:52.228 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:50:52.228 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:50:52.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.271+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.271+0000 7fb4fec9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.271+0000 7fb4fec9a9c0 20 realm 2024-09-12T18:50:52.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.271+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.271+0000 7fb4fec9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.271+0000 7fb4fec9a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:52.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.271+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.271+0000 7fb4fec9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.271+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.275+0000 7fb4fec9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:52.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.275+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.275+0000 7fb4fec9a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:52.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.275+0000 7fb4fec9a9c0 20 searching for the correct realm 2024-09-12T18:50:52.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.279+0000 7fb4fc7a0640 0 -- 172.21.15.111:0/1642273931 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fb4f40ebb00 msgr2=0x7fb4f40e4920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:52.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.287+0000 7fb4fbf9f640 0 -- 172.21.15.111:0/1642273931 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fb4f40fb920 msgr2=0x7fb4f40c43f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:52.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.503+0000 7fb4fec9a9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:52.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.503+0000 7fb4fec9a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:52.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.503+0000 7fb4fec9a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:52.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.503+0000 7fb4fec9a9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:52.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.503+0000 7fb4fec9a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:52.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.503+0000 7fb4fec9a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:52.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.503+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.503+0000 7fb4fec9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.508 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.503+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.508 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:52.508 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:52.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 20 zone default found 2024-09-12T18:50:52.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 4 Realm: () 2024-09-12T18:50:52.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:52.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:52.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:52.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 20 zonegroup default 2024-09-12T18:50:52.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 20 started sync module instance, tier type = 2024-09-12T18:50:52.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.507+0000 7fb4fec9a9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:52.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.531+0000 7fb4fec9a9c0 20 add_watcher() i=0 2024-09-12T18:50:52.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.531+0000 7fb4fec9a9c0 20 add_watcher() i=1 2024-09-12T18:50:52.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.531+0000 7fb4fec9a9c0 20 add_watcher() i=2 2024-09-12T18:50:52.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.531+0000 7fb4fec9a9c0 20 add_watcher() i=3 2024-09-12T18:50:52.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.531+0000 7fb4fec9a9c0 20 add_watcher() i=4 2024-09-12T18:50:52.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.531+0000 7fb4fec9a9c0 20 add_watcher() i=5 2024-09-12T18:50:52.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.531+0000 7fb4fec9a9c0 20 add_watcher() i=6 2024-09-12T18:50:52.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.531+0000 7fb4fec9a9c0 20 add_watcher() i=7 2024-09-12T18:50:52.535 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.531+0000 7fb4fec9a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:52.539 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.535+0000 7fb3b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:52.539 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb4fec9a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:52.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb4fec9a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:52.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb4fec9a9c0 5 note: GC not initialized 2024-09-12T18:50:52.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb3b1fdb640 20 reqs_thread_entry: start 2024-09-12T18:50:52.540 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb4fec9a9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:52.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb4fec9a9c0 20 Filter name: none 2024-09-12T18:50:52.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb3237fe640 20 reqs_thread_entry: start 2024-09-12T18:50:52.541 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.542 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb4fec9a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:52.542 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.542 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb4fec9a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:52.542 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb4fec9a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:52.542 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.543 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb4fec9a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:52.543 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.539+0000 7fb4fec9a9c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.544 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.543+0000 7fb4fec9a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:52.544 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.543+0000 7fb4fec9a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:52.547 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.543+0000 7fb3b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:52.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.551+0000 7fb4fec9a9c0 20 remove_watcher() i=0 2024-09-12T18:50:52.553 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.551+0000 7fb4fec9a9c0 2 removed watcher, disabling cache 2024-09-12T18:50:52.555 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.551+0000 7fb4fec9a9c0 20 remove_watcher() i=1 2024-09-12T18:50:52.557 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.555+0000 7fb4fec9a9c0 20 remove_watcher() i=2 2024-09-12T18:50:52.559 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.555+0000 7fb4fec9a9c0 20 remove_watcher() i=3 2024-09-12T18:50:52.561 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.559+0000 7fb4fec9a9c0 20 remove_watcher() i=4 2024-09-12T18:50:52.563 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.559+0000 7fb4fec9a9c0 20 remove_watcher() i=5 2024-09-12T18:50:52.564 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.563+0000 7fb4fec9a9c0 20 remove_watcher() i=6 2024-09-12T18:50:52.566 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.563+0000 7fb4fec9a9c0 20 remove_watcher() i=7 2024-09-12T18:50:52.582 INFO:tasks.workunit.client.0.smithi111.stderr: test: duplicated entries should be purged before reshard 2024-09-12T18:50:52.583 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:50:52.613 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:50:52.613 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:50:52.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.655+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.659+0000 7fdfdfb879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.659+0000 7fdfdfb879c0 20 realm 2024-09-12T18:50:52.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.659+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.659+0000 7fdfdfb879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.659+0000 7fdfdfb879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:52.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.659+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.659+0000 7fdfdfb879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.661 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.659+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.659+0000 7fdfdfb879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:52.662 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.659+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.659+0000 7fdfdfb879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:52.663 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.659+0000 7fdfdfb879c0 20 searching for the correct realm 2024-09-12T18:50:52.665 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.663+0000 7fdfdce8c640 0 -- 172.21.15.111:0/1201031127 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7fdfd00c3980 msgr2=0x7fdfd00e1430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:52.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.875+0000 7fdfdd68d640 0 -- 172.21.15.111:0/1201031127 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fdfd803e030 msgr2=0x7fdfd8041960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:52.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.891+0000 7fdfdfb879c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:52.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.891+0000 7fdfdfb879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:52.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.891+0000 7fdfdfb879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:52.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.891+0000 7fdfdfb879c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:52.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.891+0000 7fdfdfb879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:52.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.891+0000 7fdfdfb879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:52.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.891+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:52.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:52.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 20 zone default found 2024-09-12T18:50:52.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 4 Realm: () 2024-09-12T18:50:52.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:52.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:52.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:52.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 20 zonegroup default 2024-09-12T18:50:52.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.895+0000 7fdfdfb879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.899+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.899+0000 7fdfdfb879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:52.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.899+0000 7fdfdfb879c0 20 started sync module instance, tier type = 2024-09-12T18:50:52.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.899+0000 7fdfdfb879c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:52.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.923+0000 7fdfdfb879c0 20 add_watcher() i=0 2024-09-12T18:50:52.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.923+0000 7fdfdfb879c0 20 add_watcher() i=1 2024-09-12T18:50:52.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.923+0000 7fdfdfb879c0 20 add_watcher() i=2 2024-09-12T18:50:52.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.923+0000 7fdfdfb879c0 20 add_watcher() i=3 2024-09-12T18:50:52.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.923+0000 7fdfdfb879c0 20 add_watcher() i=4 2024-09-12T18:50:52.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.923+0000 7fdfdfb879c0 20 add_watcher() i=5 2024-09-12T18:50:52.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.923+0000 7fdfdfb879c0 20 add_watcher() i=6 2024-09-12T18:50:52.926 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.923+0000 7fdfdfb879c0 20 add_watcher() i=7 2024-09-12T18:50:52.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.923+0000 7fdfdfb879c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:52.930 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.927+0000 7fde937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:52.931 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.927+0000 7fdfdfb879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:52.931 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.927+0000 7fdfdfb879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:52.931 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.927+0000 7fdfdfb879c0 5 note: GC not initialized 2024-09-12T18:50:52.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.931+0000 7fde927e4640 20 reqs_thread_entry: start 2024-09-12T18:50:52.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.931+0000 7fdfdfb879c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:52.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.931+0000 7fdfdfb879c0 20 Filter name: none 2024-09-12T18:50:52.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.931+0000 7fde03fff640 20 reqs_thread_entry: start 2024-09-12T18:50:52.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.931+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.931+0000 7fdfdfb879c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:52.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.931+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.931+0000 7fdfdfb879c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:52.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.931+0000 7fdfdfb879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:52.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.931+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.935+0000 7fdfdfb879c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:52.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.935+0000 7fdfdfb879c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:52.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.935+0000 7fdfdfb879c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:52.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.935+0000 7fdfdfb879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:52.940 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.939+0000 7fde937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:52.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.943+0000 7fdfdfb879c0 20 remove_watcher() i=0 2024-09-12T18:50:52.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.943+0000 7fdfdfb879c0 2 removed watcher, disabling cache 2024-09-12T18:50:52.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.947+0000 7fdfdfb879c0 20 remove_watcher() i=1 2024-09-12T18:50:52.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.947+0000 7fdfdfb879c0 20 remove_watcher() i=2 2024-09-12T18:50:52.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.951+0000 7fdfdfb879c0 20 remove_watcher() i=3 2024-09-12T18:50:52.954 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.951+0000 7fdfdfb879c0 20 remove_watcher() i=4 2024-09-12T18:50:52.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.955+0000 7fdfdfb879c0 20 remove_watcher() i=5 2024-09-12T18:50:52.957 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.955+0000 7fdfdfb879c0 20 remove_watcher() i=6 2024-09-12T18:50:52.958 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:52.955+0000 7fdfdfb879c0 20 remove_watcher() i=7 2024-09-12T18:50:52.974 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:52.974 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:50:52.974 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: a-bucket id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-12T18:50:52.974 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:52.975 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T18:50:53.006 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:50:53.007 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:50:53.050 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.047+0000 7f1490e959c0 20 realm 2024-09-12T18:50:53.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.047+0000 7f1490e959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:53.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:53.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:53.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.051+0000 7f1490e959c0 20 searching for the correct realm 2024-09-12T18:50:53.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.055+0000 7f148e99b640 0 -- 172.21.15.111:0/2404062939 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f148801f040 msgr2=0x7f14880143f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:53.065 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.063+0000 7f148e19a640 0 -- 172.21.15.111:0/2404062939 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f1488054410 msgr2=0x7f1488054870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:53.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:53.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:53.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:53.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:53.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:53.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:53.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:53.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:53.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 20 zone default found 2024-09-12T18:50:53.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 4 Realm: () 2024-09-12T18:50:53.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:53.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:53.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:53.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 20 zonegroup default 2024-09-12T18:50:53.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 20 started sync module instance, tier type = 2024-09-12T18:50:53.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.283+0000 7f1490e959c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:53.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=0 2024-09-12T18:50:53.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=1 2024-09-12T18:50:53.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=2 2024-09-12T18:50:53.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=3 2024-09-12T18:50:53.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=4 2024-09-12T18:50:53.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=5 2024-09-12T18:50:53.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=6 2024-09-12T18:50:53.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.311+0000 7f1490e959c0 20 add_watcher() i=7 2024-09-12T18:50:53.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.311+0000 7f1490e959c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:53.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.315+0000 7f13457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:53.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.315+0000 7f1490e959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:53.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.315+0000 7f1490e959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:53.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.315+0000 7f1490e959c0 5 note: GC not initialized 2024-09-12T18:50:53.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f12bffff640 20 reqs_thread_entry: start 2024-09-12T18:50:53.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:53.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 20 Filter name: none 2024-09-12T18:50:53.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f12bdffb640 20 reqs_thread_entry: start 2024-09-12T18:50:53.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:50:53.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:53.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:50:53.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:50:53.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:50:53.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:53.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:53.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:53.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:50:53.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:53.322 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.319+0000 7f1490e959c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:50:53.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.331+0000 7f1490e959c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:53.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.331+0000 7f1490e959c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:53.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.331+0000 7f1490e959c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:53.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.331+0000 7f1490e959c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:50:53.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.331+0000 7f1371ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431688 cookie 94294751231856 notifier 8316 bl.length()=827 2024-09-12T18:50:53.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.331+0000 7f1371ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:53.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.331+0000 7f1371ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:53.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.331+0000 7f1371ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:53.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.331+0000 7f1490e959c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:50:53.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.331+0000 7f1490e959c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:50:53.334 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.331+0000 7f1490e959c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:50:53.334 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.331+0000 7f1490e959c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:50:53.345 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1490e959c0 time 2024-09-12T18:50:53.346168+0000 2024-09-12T18:50:53.345 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:50:53.346 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:53.346 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f149476f2eb] 2024-09-12T18:50:53.346 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f149476f49f] 2024-09-12T18:50:53.346 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c2b363ecc1] 2024-09-12T18:50:53.346 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c2b3653d5a] 2024-09-12T18:50:53.346 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:50:53.346 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14935d5d90] 2024-09-12T18:50:53.346 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:50:53.346 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:50:53.346 INFO:tasks.workunit.client.0.smithi111.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:50:53.346 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f1490e959c0 thread_name:radosgw-admin 2024-09-12T18:50:53.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.343+0000 7f1490e959c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1490e959c0 time 2024-09-12T18:50:53.346168+0000 2024-09-12T18:50:53.347 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:50:53.347 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.347 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:53.347 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f149476f2eb] 2024-09-12T18:50:53.347 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f149476f49f] 2024-09-12T18:50:53.347 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c2b363ecc1] 2024-09-12T18:50:53.347 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c2b3653d5a] 2024-09-12T18:50:53.347 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:50:53.347 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14935d5d90] 2024-09-12T18:50:53.347 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:50:53.347 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:50:53.347 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.365 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:53.365 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f14935ee520] 2024-09-12T18:50:53.365 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:50:53.365 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:50:53.365 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:50:53.365 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f149476f345] 2024-09-12T18:50:53.365 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f149476f49f] 2024-09-12T18:50:53.365 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c2b363ecc1] 2024-09-12T18:50:53.365 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c2b3653d5a] 2024-09-12T18:50:53.365 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:50:53.366 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14935d5d90] 2024-09-12T18:50:53.366 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:50:53.366 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:50:53.366 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.343+0000 7f1490e959c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:50:53.366 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f1490e959c0 thread_name:radosgw-admin 2024-09-12T18:50:53.366 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.366 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:53.366 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f14935ee520] 2024-09-12T18:50:53.366 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:50:53.366 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:50:53.366 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:50:53.366 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f149476f345] 2024-09-12T18:50:53.367 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f149476f49f] 2024-09-12T18:50:53.367 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c2b363ecc1] 2024-09-12T18:50:53.367 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c2b3653d5a] 2024-09-12T18:50:53.367 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:50:53.367 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14935d5d90] 2024-09-12T18:50:53.367 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:50:53.367 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:50:53.367 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:50:53.367 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.367 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:50:53.367 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:50:53.027+0000 7f148f19c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.367 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient: get_auth_request con 0x55c2b50b2c40 auth_method 0 2024-09-12T18:50:53.368 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.368 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:50:53.368 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: dump: 2024-09-12T18:50:53.368 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.368 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.368 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.368 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.368 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.368 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.368 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.368 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.368 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.368 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.368 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: _finish_auth 0 2024-09-12T18:50:53.369 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: _check_auth_tickets 2024-09-12T18:50:53.369 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:53.369 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 monclient: authenticate success, global_id 8304 2024-09-12T18:50:53.369 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: get_monmap_and_config success 2024-09-12T18:50:53.369 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:50:53.027+0000 7f1490e959c0 4 set_mon_vals no callback set 2024-09-12T18:50:53.369 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.369 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:50:53.369 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: dump: 2024-09-12T18:50:53.369 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.369 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.369 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.369 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.369 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.370 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.370 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.370 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.370 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.370 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.370 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: shutdown 2024-09-12T18:50:53.370 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) unregister_commands rotate-key 2024-09-12T18:50:53.370 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: build_initial_monmap 2024-09-12T18:50:53.370 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:50:53.027+0000 7f1490e959c0 1 build_initial for_mkfs: 0 2024-09-12T18:50:53.370 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: monmap: 2024-09-12T18:50:53.370 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:50:53.370 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:50:53.370 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:50:53.371 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:50:53.371 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:50:53.371 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.371 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:50:53.371 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:50:53.371 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:50:53.371 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.371 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding auth protocol: cephx 2024-09-12T18:50:53.371 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding auth protocol: cephx 2024-09-12T18:50:53.371 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding auth protocol: cephx 2024-09-12T18:50:53.371 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: secure 2024-09-12T18:50:53.371 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: crc 2024-09-12T18:50:53.371 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: secure 2024-09-12T18:50:53.371 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: crc 2024-09-12T18:50:53.372 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: secure 2024-09-12T18:50:53.372 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: crc 2024-09-12T18:50:53.372 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: crc 2024-09-12T18:50:53.372 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: secure 2024-09-12T18:50:53.372 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: crc 2024-09-12T18:50:53.372 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: secure 2024-09-12T18:50:53.372 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: crc 2024-09-12T18:50:53.372 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: secure 2024-09-12T18:50:53.372 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:50:53.027+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.372 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:50:53.027+0000 7f1490e959c0 1 librados: starting msgr at 2024-09-12T18:50:53.372 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:50:53.027+0000 7f1490e959c0 1 librados: starting objecter 2024-09-12T18:50:53.372 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command objecter_requests hook 0x55c2b4f52d40 2024-09-12T18:50:53.372 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:50:53.027+0000 7f1490e959c0 1 librados: setting wanted keys 2024-09-12T18:50:53.373 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:50:53.027+0000 7f1490e959c0 1 librados: calling monclient init 2024-09-12T18:50:53.373 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: init 2024-09-12T18:50:53.373 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding auth protocol: cephx 2024-09-12T18:50:53.373 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding auth protocol: cephx 2024-09-12T18:50:53.373 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding auth protocol: cephx 2024-09-12T18:50:53.373 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: secure 2024-09-12T18:50:53.373 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: crc 2024-09-12T18:50:53.373 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: secure 2024-09-12T18:50:53.373 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: crc 2024-09-12T18:50:53.373 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: secure 2024-09-12T18:50:53.373 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: crc 2024-09-12T18:50:53.373 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: crc 2024-09-12T18:50:53.373 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: secure 2024-09-12T18:50:53.373 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: crc 2024-09-12T18:50:53.374 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: secure 2024-09-12T18:50:53.374 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: crc 2024-09-12T18:50:53.374 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: secure 2024-09-12T18:50:53.374 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:50:53.027+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.374 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:50:53.027+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.374 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command rotate-key hook 0x55c2b516d0a8 2024-09-12T18:50:53.374 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:53.374 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:50:53.374 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-c con 0x55c2b501d310 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:53.374 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-a con 0x55c2b50b2c40 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:53.374 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-b con 0x55c2b50b5b30 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:53.374 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.374 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.375 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.375 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:53.375 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): authenticate will time out at 2440.171038s 2024-09-12T18:50:53.375 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): get_auth_request con 0x55c2b501d310 auth_method 0 2024-09-12T18:50:53.375 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.375 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.375 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.375 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient(hunting): get_auth_request con 0x55c2b50b2c40 auth_method 0 2024-09-12T18:50:53.375 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.375 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.375 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.375 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.375 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.376 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.376 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.376 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.376 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.376 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): handle_auth_done global_id 7760 payload 824 2024-09-12T18:50:53.376 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient: _finish_hunting 0 2024-09-12T18:50:53.376 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:50:53.027+0000 7f148e99b640 1 monclient: found mon.noname-c 2024-09-12T18:50:53.376 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:50:53.376 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.376 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:50:53.376 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: dump: 2024-09-12T18:50:53.376 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.376 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.377 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.377 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.377 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.377 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.377 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.377 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.377 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.377 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.377 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: _finish_auth 0 2024-09-12T18:50:53.377 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: _check_auth_tickets 2024-09-12T18:50:53.377 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:53.377 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.377 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:50:53.377 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: dump: 2024-09-12T18:50:53.378 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.378 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.378 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.378 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.378 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.378 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.378 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.378 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.378 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.378 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.378 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 monclient: authenticate success, global_id 7760 2024-09-12T18:50:53.378 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:50:53.027+0000 7f137ce09640 4 set_mon_vals no callback set 2024-09-12T18:50:53.378 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: _renew_subs 2024-09-12T18:50:53.378 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:50:53.379 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: _renew_subs 2024-09-12T18:50:53.379 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:50:53.379 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:50:53.027+0000 7f1490e959c0 1 librados: init done 2024-09-12T18:50:53.379 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:50:53.031+0000 7f137b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:50:53.379 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:50:53.031+0000 7f137b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:53.379 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:50:53.031+0000 7f137b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:53.379 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:50:53.031+0000 7f148e19a640 10 monclient: get_auth_request con 0x7f1374070ae0 auth_method 0 2024-09-12T18:50:53.379 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:50:53.031+0000 7f148f19c640 10 monclient: get_auth_request con 0x55c2b5175230 auth_method 0 2024-09-12T18:50:53.379 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:50:53.031+0000 7f148e99b640 10 monclient: get_auth_request con 0x55c2b51b7700 auth_method 0 2024-09-12T18:50:53.379 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:50:53.035+0000 7f148e19a640 10 monclient: get_auth_request con 0x55c2b51bbb50 auth_method 0 2024-09-12T18:50:53.379 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:50:53.035+0000 7f148f19c640 10 monclient: get_auth_request con 0x55c2b51bafb0 auth_method 0 2024-09-12T18:50:53.379 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:50:53.035+0000 7f1490e959c0 10 monclient: build_initial_monmap 2024-09-12T18:50:53.379 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:50:53.035+0000 7f1490e959c0 1 build_initial for_mkfs: 0 2024-09-12T18:50:53.380 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:50:53.035+0000 7f1490e959c0 10 monclient: monmap: 2024-09-12T18:50:53.380 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:50:53.380 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:50:53.380 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:50:53.380 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:50:53.380 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:50:53.380 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.380 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:50:53.380 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:50:53.380 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:50:53.380 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.380 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding auth protocol: cephx 2024-09-12T18:50:53.380 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding auth protocol: cephx 2024-09-12T18:50:53.380 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding auth protocol: cephx 2024-09-12T18:50:53.381 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: secure 2024-09-12T18:50:53.381 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: crc 2024-09-12T18:50:53.381 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: secure 2024-09-12T18:50:53.381 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: crc 2024-09-12T18:50:53.381 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: secure 2024-09-12T18:50:53.381 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: crc 2024-09-12T18:50:53.381 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: crc 2024-09-12T18:50:53.381 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: secure 2024-09-12T18:50:53.381 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: crc 2024-09-12T18:50:53.381 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: secure 2024-09-12T18:50:53.381 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: crc 2024-09-12T18:50:53.381 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: secure 2024-09-12T18:50:53.381 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:50:53.039+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.382 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c2b51c76c0 EEXIST 2024-09-12T18:50:53.382 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient: init 2024-09-12T18:50:53.382 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding auth protocol: cephx 2024-09-12T18:50:53.382 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding auth protocol: cephx 2024-09-12T18:50:53.382 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding auth protocol: cephx 2024-09-12T18:50:53.382 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: secure 2024-09-12T18:50:53.382 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: crc 2024-09-12T18:50:53.382 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: secure 2024-09-12T18:50:53.382 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: crc 2024-09-12T18:50:53.382 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: secure 2024-09-12T18:50:53.382 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: crc 2024-09-12T18:50:53.382 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: crc 2024-09-12T18:50:53.382 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: secure 2024-09-12T18:50:53.383 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: crc 2024-09-12T18:50:53.383 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: secure 2024-09-12T18:50:53.383 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: crc 2024-09-12T18:50:53.383 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: secure 2024-09-12T18:50:53.383 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:50:53.039+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.383 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:50:53.039+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.383 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command rotate-key cmddesc rotate-key hook 0x55c2b51c2d40 EEXIST 2024-09-12T18:50:53.383 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:53.383 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:50:53.383 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-a con 0x55c2b51eb870 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:53.383 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-b con 0x55c2b51eb1a0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:53.383 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-c con 0x55c2b51e9b80 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:53.383 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.383 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.384 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.384 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:53.384 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): authenticate will time out at 2440.181120s 2024-09-12T18:50:53.384 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): get_auth_request con 0x55c2b51eb870 auth_method 0 2024-09-12T18:50:53.384 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.384 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.384 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.384 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:50:53.039+0000 7f148e99b640 10 monclient(hunting): get_auth_request con 0x55c2b51e9b80 auth_method 0 2024-09-12T18:50:53.384 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:50:53.039+0000 7f148e99b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.384 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:50:53.039+0000 7f148e99b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.384 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:50:53.039+0000 7f148e99b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.384 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.384 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.385 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.385 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:50:53.039+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.385 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:50:53.039+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.385 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:50:53.039+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.385 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:50:53.039+0000 7f148f19c640 10 monclient(hunting): get_auth_request con 0x55c2b51eb1a0 auth_method 0 2024-09-12T18:50:53.385 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:50:53.039+0000 7f148f19c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.385 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:50:53.039+0000 7f148f19c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.385 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:50:53.039+0000 7f148f19c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.385 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): handle_auth_done global_id 8310 payload 824 2024-09-12T18:50:53.385 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient: _finish_hunting 0 2024-09-12T18:50:53.385 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:50:53.039+0000 7f148e19a640 1 monclient: found mon.noname-a 2024-09-12T18:50:53.385 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.385 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.386 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:50:53.386 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: dump: 2024-09-12T18:50:53.386 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.386 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.386 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.386 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.386 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.386 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.386 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.386 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.386 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.386 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.386 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: _finish_auth 0 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: _check_auth_tickets 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: dump: 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.387 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.388 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 monclient: authenticate success, global_id 8310 2024-09-12T18:50:53.388 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient: _renew_subs 2024-09-12T18:50:53.388 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:50:53.039+0000 7f148d198640 4 set_mon_vals no callback set 2024-09-12T18:50:53.388 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.388 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient: _renew_subs 2024-09-12T18:50:53.388 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.388 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:50:53.039+0000 7f1378e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:50:53.388 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:50:53.039+0000 7f1378e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:53.388 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:50:53.039+0000 7f1378e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:53.388 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient: get_auth_request con 0x7f1368070a20 auth_method 0 2024-09-12T18:50:53.388 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: get_monmap_and_config 2024-09-12T18:50:53.388 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: build_initial_monmap 2024-09-12T18:50:53.388 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:50:53.043+0000 7f1490e959c0 1 build_initial for_mkfs: 0 2024-09-12T18:50:53.388 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: monmap: 2024-09-12T18:50:53.389 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:50:53.389 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:50:53.389 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:50:53.389 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:50:53.389 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:50:53.389 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.389 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:50:53.389 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:50:53.389 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:50:53.389 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.389 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding auth protocol: cephx 2024-09-12T18:50:53.389 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding auth protocol: cephx 2024-09-12T18:50:53.389 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding auth protocol: cephx 2024-09-12T18:50:53.390 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: secure 2024-09-12T18:50:53.390 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: crc 2024-09-12T18:50:53.390 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: secure 2024-09-12T18:50:53.390 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: crc 2024-09-12T18:50:53.390 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: secure 2024-09-12T18:50:53.390 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: crc 2024-09-12T18:50:53.390 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: crc 2024-09-12T18:50:53.390 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: secure 2024-09-12T18:50:53.390 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: crc 2024-09-12T18:50:53.390 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: secure 2024-09-12T18:50:53.390 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: crc 2024-09-12T18:50:53.390 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: secure 2024-09-12T18:50:53.390 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:50:53.043+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.391 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: init 2024-09-12T18:50:53.391 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding auth protocol: cephx 2024-09-12T18:50:53.391 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding auth protocol: cephx 2024-09-12T18:50:53.391 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding auth protocol: cephx 2024-09-12T18:50:53.391 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: secure 2024-09-12T18:50:53.391 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: crc 2024-09-12T18:50:53.391 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: secure 2024-09-12T18:50:53.391 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: crc 2024-09-12T18:50:53.391 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: secure 2024-09-12T18:50:53.391 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: crc 2024-09-12T18:50:53.391 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: crc 2024-09-12T18:50:53.391 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: secure 2024-09-12T18:50:53.391 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: crc 2024-09-12T18:50:53.392 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: secure 2024-09-12T18:50:53.392 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: crc 2024-09-12T18:50:53.392 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: secure 2024-09-12T18:50:53.392 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:50:53.043+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.392 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:50:53.043+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.392 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe4492c558 EEXIST 2024-09-12T18:50:53.392 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:53.392 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:50:53.392 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-b con 0x55c2b523f700 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:53.392 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-c con 0x55c2b520f270 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:53.392 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-a con 0x55c2b5230180 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:53.392 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.392 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.392 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.393 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:53.393 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): authenticate will time out at 2440.185273s 2024-09-12T18:50:53.393 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient(hunting): get_auth_request con 0x55c2b520f270 auth_method 0 2024-09-12T18:50:53.393 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.393 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.393 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.393 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): get_auth_request con 0x55c2b5230180 auth_method 0 2024-09-12T18:50:53.393 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.393 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.393 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.394 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.394 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.394 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.394 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.394 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.394 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.394 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): get_auth_request con 0x55c2b523f700 auth_method 0 2024-09-12T18:50:53.394 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.394 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.394 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.394 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): handle_auth_done global_id 8313 payload 274 2024-09-12T18:50:53.394 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient: _finish_hunting 0 2024-09-12T18:50:53.394 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:50:53.043+0000 7f148e99b640 1 monclient: found mon.noname-a 2024-09-12T18:50:53.395 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.395 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.395 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:50:53.395 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: dump: 2024-09-12T18:50:53.395 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.395 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.395 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.395 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.395 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.395 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.395 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.395 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.395 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.395 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.396 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: _finish_auth 0 2024-09-12T18:50:53.396 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: _check_auth_tickets 2024-09-12T18:50:53.396 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:53.396 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.396 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:50:53.396 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: dump: 2024-09-12T18:50:53.396 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.396 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.396 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.397 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.397 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.397 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.397 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.397 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.397 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.397 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.397 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 monclient: authenticate success, global_id 8313 2024-09-12T18:50:53.397 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: get_monmap_and_config success 2024-09-12T18:50:53.397 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:50:53.043+0000 7f1490e959c0 4 set_mon_vals no callback set 2024-09-12T18:50:53.397 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: shutdown 2024-09-12T18:50:53.397 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: build_initial_monmap 2024-09-12T18:50:53.397 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:50:53.043+0000 7f1490e959c0 1 build_initial for_mkfs: 0 2024-09-12T18:50:53.398 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: monmap: 2024-09-12T18:50:53.398 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:50:53.398 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:50:53.398 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:50:53.398 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:50:53.398 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:50:53.398 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.398 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:50:53.398 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:50:53.398 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:50:53.398 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.398 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding auth protocol: cephx 2024-09-12T18:50:53.398 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding auth protocol: cephx 2024-09-12T18:50:53.398 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding auth protocol: cephx 2024-09-12T18:50:53.399 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: secure 2024-09-12T18:50:53.399 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: crc 2024-09-12T18:50:53.399 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: secure 2024-09-12T18:50:53.399 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: crc 2024-09-12T18:50:53.399 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: secure 2024-09-12T18:50:53.399 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: crc 2024-09-12T18:50:53.399 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: crc 2024-09-12T18:50:53.399 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: secure 2024-09-12T18:50:53.399 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: crc 2024-09-12T18:50:53.399 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: secure 2024-09-12T18:50:53.399 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: crc 2024-09-12T18:50:53.399 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: secure 2024-09-12T18:50:53.399 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:50:53.043+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:50:53.043+0000 7f1490e959c0 1 librados: starting msgr at 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:50:53.043+0000 7f1490e959c0 1 librados: starting objecter 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c2b51ebe20 EEXIST 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:50:53.043+0000 7f1490e959c0 1 librados: setting wanted keys 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:50:53.043+0000 7f1490e959c0 1 librados: calling monclient init 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: init 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding auth protocol: cephx 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding auth protocol: cephx 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding auth protocol: cephx 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: secure 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: crc 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: secure 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: crc 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: secure 2024-09-12T18:50:53.400 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: crc 2024-09-12T18:50:53.401 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: crc 2024-09-12T18:50:53.401 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: secure 2024-09-12T18:50:53.401 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: crc 2024-09-12T18:50:53.401 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: secure 2024-09-12T18:50:53.401 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: crc 2024-09-12T18:50:53.401 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: secure 2024-09-12T18:50:53.401 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:50:53.043+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.401 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:50:53.043+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.401 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command rotate-key cmddesc rotate-key hook 0x55c2b51ed7d8 EEXIST 2024-09-12T18:50:53.401 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:53.401 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:50:53.401 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-a con 0x55c2b520f270 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:53.402 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-b con 0x55c2b5230180 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:53.402 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-c con 0x55c2b523f700 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:53.402 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.402 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.402 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.402 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:53.402 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): authenticate will time out at 2440.187833s 2024-09-12T18:50:53.402 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): get_auth_request con 0x55c2b520f270 auth_method 0 2024-09-12T18:50:53.402 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.402 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.402 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.402 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): get_auth_request con 0x55c2b523f700 auth_method 0 2024-09-12T18:50:53.402 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.403 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.403 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.403 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:50:53.047+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.403 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:50:53.047+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.403 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:50:53.047+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.403 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:50:53.047+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.403 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:50:53.047+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.403 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:50:53.047+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.403 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:50:53.047+0000 7f148e19a640 10 monclient(hunting): handle_auth_done global_id 8316 payload 824 2024-09-12T18:50:53.403 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:50:53.047+0000 7f148e19a640 10 monclient: _finish_hunting 0 2024-09-12T18:50:53.403 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:50:53.047+0000 7f148e19a640 1 monclient: found mon.noname-a 2024-09-12T18:50:53.403 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:50:53.047+0000 7f148e19a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.403 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:50:53.047+0000 7f148f19c640 10 monclient: get_auth_request con 0x55c2b5230180 auth_method 0 2024-09-12T18:50:53.404 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.404 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:50:53.404 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: dump: 2024-09-12T18:50:53.404 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.404 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.404 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.404 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.404 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.404 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.404 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.404 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.404 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.404 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.405 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: _finish_auth 0 2024-09-12T18:50:53.405 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:50:53.405 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:53.405 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.405 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:50:53.405 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: dump: 2024-09-12T18:50:53.405 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.405 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.405 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.405 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.405 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.405 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.405 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.405 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.406 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.406 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.406 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:50:53.047+0000 7f1490e959c0 5 monclient: authenticate success, global_id 8316 2024-09-12T18:50:53.406 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:50:53.047+0000 7f13727fc640 4 set_mon_vals no callback set 2024-09-12T18:50:53.406 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:50:53.047+0000 7f1490e959c0 10 monclient: _renew_subs 2024-09-12T18:50:53.406 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:50:53.047+0000 7f1490e959c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.406 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:50:53.047+0000 7f1490e959c0 10 monclient: _renew_subs 2024-09-12T18:50:53.406 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:50:53.047+0000 7f1490e959c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.406 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:50:53.047+0000 7f1490e959c0 1 librados: init done 2024-09-12T18:50:53.406 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:50:53.047+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command cr dump hook 0x55c2b52377b8 2024-09-12T18:50:53.406 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.406 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:50:53.047+0000 7f1370ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:50:53.407 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:50:53.047+0000 7f1370ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:53.407 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:50:53.047+0000 7f1370ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:53.407 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:50:53.047+0000 7f148f19c640 10 monclient: get_auth_request con 0x7f1358070b10 auth_method 0 2024-09-12T18:50:53.407 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:50:53.047+0000 7f148e99b640 10 monclient: get_auth_request con 0x55c2b5259140 auth_method 0 2024-09-12T18:50:53.407 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.407 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:50:53.047+0000 7f1490e959c0 20 realm 2024-09-12T18:50:53.407 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.407 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.407 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:50:53.047+0000 7f1490e959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:53.407 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.407 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.407 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.407 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:50:53.051+0000 7f148e19a640 10 monclient: get_auth_request con 0x55c2b525d3a0 auth_method 0 2024-09-12T18:50:53.407 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:53.408 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.408 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:50:53.051+0000 7f148f19c640 10 monclient: get_auth_request con 0x55c2b5260c00 auth_method 0 2024-09-12T18:50:53.408 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:53.408 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:50:53.051+0000 7f1490e959c0 20 searching for the correct realm 2024-09-12T18:50:53.408 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:50:53.051+0000 7f148e99b640 10 monclient: get_auth_request con 0x7f148801f040 auth_method 0 2024-09-12T18:50:53.408 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:50:53.055+0000 7f148e19a640 10 monclient: get_auth_request con 0x7f1480063400 auth_method 0 2024-09-12T18:50:53.408 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:50:53.055+0000 7f148f19c640 10 monclient: get_auth_request con 0x7f1478137260 auth_method 0 2024-09-12T18:50:53.408 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:50:53.055+0000 7f148e99b640 0 -- 172.21.15.111:0/2404062939 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f148801f040 msgr2=0x7f14880143f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:53.408 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:50:53.055+0000 7f1370ff9640 1 client.8316.objecter ms_handle_reset 0x7f148801f040 session 0x7f14880297a0 osd.7 2024-09-12T18:50:53.408 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:50:53.059+0000 7f1370ff9640 10 monclient: _renew_subs 2024-09-12T18:50:53.408 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:50:53.059+0000 7f1370ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.408 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:50:53.059+0000 7f148e99b640 10 monclient: get_auth_request con 0x7f1358080ab0 auth_method 0 2024-09-12T18:50:53.408 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:50:53.059+0000 7f148e99b640 10 monclient: get_auth_request con 0x7f1488008050 auth_method 0 2024-09-12T18:50:53.409 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:50:53.063+0000 7f148e19a640 10 monclient: get_auth_request con 0x7f1488054410 auth_method 0 2024-09-12T18:50:53.409 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:50:53.063+0000 7f148e19a640 0 -- 172.21.15.111:0/2404062939 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f1488054410 msgr2=0x7f1488054870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:53.409 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:50:53.267+0000 7f148e19a640 10 monclient: get_auth_request con 0x7f1488054410 auth_method 0 2024-09-12T18:50:53.409 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:53.409 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:53.409 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:53.409 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:53.409 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:53.409 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:53.409 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.409 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.409 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.409 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:53.410 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.410 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:53.410 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 zone default found 2024-09-12T18:50:53.410 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:50:53.283+0000 7f1490e959c0 4 Realm: () 2024-09-12T18:50:53.410 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:50:53.283+0000 7f1490e959c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:53.410 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:50:53.283+0000 7f1490e959c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:53.410 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:50:53.283+0000 7f1490e959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:53.410 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 zonegroup default 2024-09-12T18:50:53.410 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.410 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.410 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.410 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.410 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.411 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.411 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 started sync module instance, tier type = 2024-09-12T18:50:53.411 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:53.411 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=0 2024-09-12T18:50:53.411 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=1 2024-09-12T18:50:53.411 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=2 2024-09-12T18:50:53.411 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=3 2024-09-12T18:50:53.411 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=4 2024-09-12T18:50:53.411 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=5 2024-09-12T18:50:53.411 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=6 2024-09-12T18:50:53.411 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:50:53.311+0000 7f1490e959c0 20 add_watcher() i=7 2024-09-12T18:50:53.411 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:50:53.311+0000 7f1490e959c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:53.411 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding auth protocol: cephx 2024-09-12T18:50:53.412 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding auth protocol: cephx 2024-09-12T18:50:53.412 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding auth protocol: cephx 2024-09-12T18:50:53.412 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: secure 2024-09-12T18:50:53.412 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: crc 2024-09-12T18:50:53.412 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: secure 2024-09-12T18:50:53.412 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: crc 2024-09-12T18:50:53.412 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: secure 2024-09-12T18:50:53.412 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: crc 2024-09-12T18:50:53.412 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:50:53.315+0000 7f13457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:53.412 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: crc 2024-09-12T18:50:53.412 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: secure 2024-09-12T18:50:53.412 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: crc 2024-09-12T18:50:53.412 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: secure 2024-09-12T18:50:53.412 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: crc 2024-09-12T18:50:53.413 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: secure 2024-09-12T18:50:53.413 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:50:53.315+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.413 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:50:53.315+0000 7f1490e959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:53.413 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:50:53.315+0000 7f1490e959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:53.413 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command cache list hook 0x55c2b5235e30 2024-09-12T18:50:53.413 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command cache inspect hook 0x55c2b5235e30 2024-09-12T18:50:53.413 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command cache erase hook 0x55c2b5235e30 2024-09-12T18:50:53.413 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command cache zap hook 0x55c2b5235e30 2024-09-12T18:50:53.413 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 note: GC not initialized 2024-09-12T18:50:53.413 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:50:53.319+0000 7f12bffff640 20 reqs_thread_entry: start 2024-09-12T18:50:53.413 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:50:53.319+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command sync trace show hook 0x7f1480060040 2024-09-12T18:50:53.413 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:50:53.319+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command sync trace history hook 0x7f1480060040 2024-09-12T18:50:53.413 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:50:53.319+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command sync trace active hook 0x7f1480060040 2024-09-12T18:50:53.414 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:50:53.319+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command sync trace active_short hook 0x7f1480060040 2024-09-12T18:50:53.414 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:50:53.319+0000 7f1490e959c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:53.414 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:50:53.319+0000 7f1490e959c0 20 Filter name: none 2024-09-12T18:50:53.414 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:50:53.319+0000 7f12bdffb640 20 reqs_thread_entry: start 2024-09-12T18:50:53.414 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:50:53.414 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:50:53.319+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.414 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:50:53.319+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:53.414 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:50:53.414 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:50:53.414 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:50:53.414 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:50:53.319+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.414 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:50:53.319+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:53.414 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:53.415 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:53.415 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:50:53.415 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:53.415 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:50:53.415 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:50:53.331+0000 7f1490e959c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:53.415 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:50:53.331+0000 7f1490e959c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:53.415 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:50:53.331+0000 7f1490e959c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:53.415 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:50:53.331+0000 7f1490e959c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:50:53.415 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:50:53.331+0000 7f1371ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431688 cookie 94294751231856 notifier 8316 bl.length()=827 2024-09-12T18:50:53.415 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:50:53.331+0000 7f1371ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:53.415 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:50:53.331+0000 7f1371ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:53.415 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:50:53.331+0000 7f1371ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:53.415 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:50:53.331+0000 7f1490e959c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:50:53.416 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:50:53.331+0000 7f1490e959c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:50:53.416 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:50:53.331+0000 7f1490e959c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:50:53.416 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:50:53.331+0000 7f1490e959c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:50:53.416 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:50:53.343+0000 7f1490e959c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1490e959c0 time 2024-09-12T18:50:53.346168+0000 2024-09-12T18:50:53.416 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:50:53.416 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.416 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:53.416 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f149476f2eb] 2024-09-12T18:50:53.416 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f149476f49f] 2024-09-12T18:50:53.416 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c2b363ecc1] 2024-09-12T18:50:53.416 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c2b3653d5a] 2024-09-12T18:50:53.416 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:50:53.417 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14935d5d90] 2024-09-12T18:50:53.417 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:50:53.417 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:50:53.417 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.417 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:50:53.343+0000 7f1490e959c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:50:53.417 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f1490e959c0 thread_name:radosgw-admin 2024-09-12T18:50:53.417 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.417 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:53.417 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f14935ee520] 2024-09-12T18:50:53.417 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:50:53.417 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:50:53.417 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:50:53.417 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f149476f345] 2024-09-12T18:50:53.418 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f149476f49f] 2024-09-12T18:50:53.418 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c2b363ecc1] 2024-09-12T18:50:53.418 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c2b3653d5a] 2024-09-12T18:50:53.418 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:50:53.418 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14935d5d90] 2024-09-12T18:50:53.418 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:50:53.418 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:50:53.418 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:50:53.418 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.418 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:50:53.418 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:50:53.418 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:50:53.419 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:50:53.419 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:50:53.419 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:50:53.419 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:50:53.419 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:50:53.419 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:50:53.419 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:50:53.419 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:50:53.419 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:50:53.419 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:50:53.419 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:50:53.419 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:50:53.419 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:50:53.419 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:50:53.420 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:50:53.420 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:50:53.420 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:50:53.420 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:50:53.420 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:50:53.420 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:50:53.420 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:50:53.420 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:50:53.420 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:50:53.420 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:50:53.420 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:50:53.420 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:50:53.420 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:50:53.421 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:50:53.421 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:50:53.421 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:50:53.421 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:50:53.421 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:50:53.421 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:50:53.421 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:50:53.421 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:50:53.421 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:50:53.421 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:50:53.421 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:50:53.421 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:50:53.421 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:50:53.421 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:50:53.422 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:50:53.422 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:50:53.422 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:50:53.422 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:50:53.422 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:50:53.422 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:50:53.422 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:50:53.422 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:50:53.422 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:50:53.422 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:50:53.422 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:50:53.422 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:50:53.422 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:50:53.423 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:50:53.423 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:50:53.423 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:50:53.423 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:50:53.423 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:50:53.423 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:50:53.423 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:50:53.423 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:50:53.423 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:50:53.423 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:50:53.423 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:50:53.423 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:50:53.424 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:50:53.424 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:50:53.424 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:50:53.424 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:50:53.424 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:50:53.424 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:50:53.424 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:50:53.424 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:50:53.424 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:50:53.424 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:50:53.424 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:50:53.424 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:50:53.425 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:50:53.425 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:50:53.425 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:50:53.425 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:50:53.425 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:50:53.425 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:50:53.425 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:50:53.425 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:50:53.425 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:50:53.425 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:50:53.425 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:50:53.425 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:50:53.425 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:50:53.425 INFO:tasks.workunit.client.0.smithi111.stderr: 7f12bdffb640 / http_manager 2024-09-12T18:50:53.426 INFO:tasks.workunit.client.0.smithi111.stderr: 7f12bffff640 / http_manager 2024-09-12T18:50:53.426 INFO:tasks.workunit.client.0.smithi111.stderr: 7f13457e2640 / rgw_dt_lg_renew 2024-09-12T18:50:53.426 INFO:tasks.workunit.client.0.smithi111.stderr: 7f1370ff9640 / ms_dispatch 2024-09-12T18:50:53.426 INFO:tasks.workunit.client.0.smithi111.stderr: 7f1371ffb640 / io_context_pool 2024-09-12T18:50:53.426 INFO:tasks.workunit.client.0.smithi111.stderr: 7f13727fc640 / io_context_pool 2024-09-12T18:50:53.426 INFO:tasks.workunit.client.0.smithi111.stderr: 7f1378e01640 / ms_dispatch 2024-09-12T18:50:53.426 INFO:tasks.workunit.client.0.smithi111.stderr: 7f137b606640 / ms_dispatch 2024-09-12T18:50:53.426 INFO:tasks.workunit.client.0.smithi111.stderr: 7f137ce09640 / io_context_pool 2024-09-12T18:50:53.426 INFO:tasks.workunit.client.0.smithi111.stderr: 7f148d198640 / io_context_pool 2024-09-12T18:50:53.426 INFO:tasks.workunit.client.0.smithi111.stderr: 7f148e19a640 / msgr-worker-2 2024-09-12T18:50:53.426 INFO:tasks.workunit.client.0.smithi111.stderr: 7f148e99b640 / msgr-worker-1 2024-09-12T18:50:53.426 INFO:tasks.workunit.client.0.smithi111.stderr: 7f148f19c640 / msgr-worker-0 2024-09-12T18:50:53.426 INFO:tasks.workunit.client.0.smithi111.stderr: 7f1490e959c0 / radosgw-admin 2024-09-12T18:50:53.427 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:50:53.427 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:50:53.427 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/log/ceph/ceph-client.admin.143747.log 2024-09-12T18:50:53.427 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:50:53.427 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:50:53.427 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:50:53.027+0000 7f148f19c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.427 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient: get_auth_request con 0x55c2b50b2c40 auth_method 0 2024-09-12T18:50:53.427 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.427 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:50:53.427 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: dump: 2024-09-12T18:50:53.427 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.427 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.427 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.427 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.428 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.428 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.428 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.428 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.428 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.428 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.428 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: _finish_auth 0 2024-09-12T18:50:53.428 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: _check_auth_tickets 2024-09-12T18:50:53.428 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:53.428 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 monclient: authenticate success, global_id 8304 2024-09-12T18:50:53.428 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: get_monmap_and_config success 2024-09-12T18:50:53.428 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:50:53.027+0000 7f1490e959c0 4 set_mon_vals no callback set 2024-09-12T18:50:53.428 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.428 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:50:53.429 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:50:53.027+0000 7f137ce09640 10 monclient: dump: 2024-09-12T18:50:53.429 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.429 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.429 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.429 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.429 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.429 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.429 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.429 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.429 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.429 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.429 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: shutdown 2024-09-12T18:50:53.430 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) unregister_commands rotate-key 2024-09-12T18:50:53.430 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: build_initial_monmap 2024-09-12T18:50:53.430 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:50:53.027+0000 7f1490e959c0 1 build_initial for_mkfs: 0 2024-09-12T18:50:53.430 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: monmap: 2024-09-12T18:50:53.430 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:50:53.430 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:50:53.430 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:50:53.430 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:50:53.430 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:50:53.430 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.430 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:50:53.430 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:50:53.430 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:50:53.431 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.431 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding auth protocol: cephx 2024-09-12T18:50:53.431 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding auth protocol: cephx 2024-09-12T18:50:53.431 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding auth protocol: cephx 2024-09-12T18:50:53.431 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: secure 2024-09-12T18:50:53.431 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: crc 2024-09-12T18:50:53.431 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: secure 2024-09-12T18:50:53.431 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: crc 2024-09-12T18:50:53.431 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: secure 2024-09-12T18:50:53.431 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: crc 2024-09-12T18:50:53.431 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: crc 2024-09-12T18:50:53.431 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: secure 2024-09-12T18:50:53.432 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: crc 2024-09-12T18:50:53.432 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: secure 2024-09-12T18:50:53.432 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: crc 2024-09-12T18:50:53.432 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b5172260) adding con mode: secure 2024-09-12T18:50:53.432 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:50:53.027+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.432 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:50:53.027+0000 7f1490e959c0 1 librados: starting msgr at 2024-09-12T18:50:53.432 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:50:53.027+0000 7f1490e959c0 1 librados: starting objecter 2024-09-12T18:50:53.432 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command objecter_requests hook 0x55c2b4f52d40 2024-09-12T18:50:53.432 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:50:53.027+0000 7f1490e959c0 1 librados: setting wanted keys 2024-09-12T18:50:53.432 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:50:53.027+0000 7f1490e959c0 1 librados: calling monclient init 2024-09-12T18:50:53.432 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: init 2024-09-12T18:50:53.433 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding auth protocol: cephx 2024-09-12T18:50:53.433 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding auth protocol: cephx 2024-09-12T18:50:53.433 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding auth protocol: cephx 2024-09-12T18:50:53.433 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: secure 2024-09-12T18:50:53.433 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: crc 2024-09-12T18:50:53.433 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: secure 2024-09-12T18:50:53.433 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: crc 2024-09-12T18:50:53.433 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: secure 2024-09-12T18:50:53.433 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: crc 2024-09-12T18:50:53.433 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: crc 2024-09-12T18:50:53.433 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: secure 2024-09-12T18:50:53.433 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: crc 2024-09-12T18:50:53.435 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: secure 2024-09-12T18:50:53.436 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: crc 2024-09-12T18:50:53.436 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 AuthRegistry(0x55c2b516cf60) adding con mode: secure 2024-09-12T18:50:53.436 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:50:53.027+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.436 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:50:53.027+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.436 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command rotate-key hook 0x55c2b516d0a8 2024-09-12T18:50:53.436 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:53.436 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:50:53.436 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-c con 0x55c2b501d310 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:53.436 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-a con 0x55c2b50b2c40 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:53.436 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-b con 0x55c2b50b5b30 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:53.436 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.437 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.437 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.437 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:53.437 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient(hunting): authenticate will time out at 2440.171038s 2024-09-12T18:50:53.437 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): get_auth_request con 0x55c2b501d310 auth_method 0 2024-09-12T18:50:53.437 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.437 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.437 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.437 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient(hunting): get_auth_request con 0x55c2b50b2c40 auth_method 0 2024-09-12T18:50:53.437 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.437 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.437 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.437 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.438 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.438 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.438 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.438 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.438 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:50:53.027+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.438 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient(hunting): handle_auth_done global_id 7760 payload 824 2024-09-12T18:50:53.438 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient: _finish_hunting 0 2024-09-12T18:50:53.438 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:50:53.027+0000 7f148e99b640 1 monclient: found mon.noname-c 2024-09-12T18:50:53.438 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:50:53.027+0000 7f148e99b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:50:53.438 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.438 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:50:53.438 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: dump: 2024-09-12T18:50:53.438 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.439 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.439 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.439 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.439 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.439 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.439 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.439 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.439 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.439 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.439 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: _finish_auth 0 2024-09-12T18:50:53.439 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: _check_auth_tickets 2024-09-12T18:50:53.439 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:53.439 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.439 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:50:53.440 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:50:53.027+0000 7f137b606640 10 monclient: dump: 2024-09-12T18:50:53.440 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.440 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.440 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.440 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.440 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.440 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.440 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.440 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.440 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.440 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.440 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:50:53.027+0000 7f1490e959c0 5 monclient: authenticate success, global_id 7760 2024-09-12T18:50:53.440 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:50:53.027+0000 7f137ce09640 4 set_mon_vals no callback set 2024-09-12T18:50:53.441 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: _renew_subs 2024-09-12T18:50:53.441 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:50:53.441 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: _renew_subs 2024-09-12T18:50:53.441 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:50:53.027+0000 7f1490e959c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:50:53.441 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:50:53.027+0000 7f1490e959c0 1 librados: init done 2024-09-12T18:50:53.441 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:50:53.031+0000 7f137b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:50:53.441 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:50:53.031+0000 7f137b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:53.441 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:50:53.031+0000 7f137b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:53.441 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:50:53.031+0000 7f148e19a640 10 monclient: get_auth_request con 0x7f1374070ae0 auth_method 0 2024-09-12T18:50:53.441 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:50:53.031+0000 7f148f19c640 10 monclient: get_auth_request con 0x55c2b5175230 auth_method 0 2024-09-12T18:50:53.441 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:50:53.031+0000 7f148e99b640 10 monclient: get_auth_request con 0x55c2b51b7700 auth_method 0 2024-09-12T18:50:53.441 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:50:53.035+0000 7f148e19a640 10 monclient: get_auth_request con 0x55c2b51bbb50 auth_method 0 2024-09-12T18:50:53.441 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:50:53.035+0000 7f148f19c640 10 monclient: get_auth_request con 0x55c2b51bafb0 auth_method 0 2024-09-12T18:50:53.441 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:50:53.035+0000 7f1490e959c0 10 monclient: build_initial_monmap 2024-09-12T18:50:53.442 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:50:53.035+0000 7f1490e959c0 1 build_initial for_mkfs: 0 2024-09-12T18:50:53.442 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:50:53.035+0000 7f1490e959c0 10 monclient: monmap: 2024-09-12T18:50:53.442 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:50:53.442 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:50:53.442 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:50:53.442 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:50:53.442 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:50:53.442 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.442 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:50:53.442 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:50:53.442 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:50:53.442 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.443 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding auth protocol: cephx 2024-09-12T18:50:53.443 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding auth protocol: cephx 2024-09-12T18:50:53.443 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding auth protocol: cephx 2024-09-12T18:50:53.443 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: secure 2024-09-12T18:50:53.443 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: crc 2024-09-12T18:50:53.443 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: secure 2024-09-12T18:50:53.443 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: crc 2024-09-12T18:50:53.443 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: secure 2024-09-12T18:50:53.443 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: crc 2024-09-12T18:50:53.443 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: crc 2024-09-12T18:50:53.443 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: secure 2024-09-12T18:50:53.443 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: crc 2024-09-12T18:50:53.443 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: secure 2024-09-12T18:50:53.444 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: crc 2024-09-12T18:50:53.444 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:50:53.035+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c3da0) adding con mode: secure 2024-09-12T18:50:53.444 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:50:53.039+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.444 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c2b51c76c0 EEXIST 2024-09-12T18:50:53.444 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient: init 2024-09-12T18:50:53.444 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding auth protocol: cephx 2024-09-12T18:50:53.444 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding auth protocol: cephx 2024-09-12T18:50:53.444 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding auth protocol: cephx 2024-09-12T18:50:53.444 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: secure 2024-09-12T18:50:53.444 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: crc 2024-09-12T18:50:53.444 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: secure 2024-09-12T18:50:53.444 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: crc 2024-09-12T18:50:53.445 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: secure 2024-09-12T18:50:53.445 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: crc 2024-09-12T18:50:53.445 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: crc 2024-09-12T18:50:53.445 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: secure 2024-09-12T18:50:53.445 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: crc 2024-09-12T18:50:53.445 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: secure 2024-09-12T18:50:53.445 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: crc 2024-09-12T18:50:53.445 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51c2bf8) adding con mode: secure 2024-09-12T18:50:53.445 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:50:53.039+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.445 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:50:53.039+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.445 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command rotate-key cmddesc rotate-key hook 0x55c2b51c2d40 EEXIST 2024-09-12T18:50:53.445 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:53.445 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:50:53.446 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-a con 0x55c2b51eb870 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:53.446 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-b con 0x55c2b51eb1a0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:53.446 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-c con 0x55c2b51e9b80 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:53.446 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.446 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.446 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.446 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:53.446 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient(hunting): authenticate will time out at 2440.181120s 2024-09-12T18:50:53.446 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): get_auth_request con 0x55c2b51eb870 auth_method 0 2024-09-12T18:50:53.446 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.446 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.446 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.447 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:50:53.039+0000 7f148e99b640 10 monclient(hunting): get_auth_request con 0x55c2b51e9b80 auth_method 0 2024-09-12T18:50:53.447 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:50:53.039+0000 7f148e99b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.447 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:50:53.039+0000 7f148e99b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.447 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:50:53.039+0000 7f148e99b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.447 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.447 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.447 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.447 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:50:53.039+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.447 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:50:53.039+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.447 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:50:53.039+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.447 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:50:53.039+0000 7f148f19c640 10 monclient(hunting): get_auth_request con 0x55c2b51eb1a0 auth_method 0 2024-09-12T18:50:53.447 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:50:53.039+0000 7f148f19c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.447 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:50:53.039+0000 7f148f19c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.448 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:50:53.039+0000 7f148f19c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.448 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient(hunting): handle_auth_done global_id 8310 payload 824 2024-09-12T18:50:53.448 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient: _finish_hunting 0 2024-09-12T18:50:53.448 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:50:53.039+0000 7f148e19a640 1 monclient: found mon.noname-a 2024-09-12T18:50:53.448 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:50:53.039+0000 7f148e19a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.448 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.448 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:50:53.448 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: dump: 2024-09-12T18:50:53.448 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.448 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.448 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.448 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.449 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.449 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.449 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.449 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.449 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.449 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.449 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: _finish_auth 0 2024-09-12T18:50:53.449 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: _check_auth_tickets 2024-09-12T18:50:53.449 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:53.449 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.449 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:50:53.449 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:50:53.039+0000 7f1378e01640 10 monclient: dump: 2024-09-12T18:50:53.449 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.450 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.450 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.450 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.450 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.450 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.450 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.450 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.450 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.450 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.450 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:50:53.039+0000 7f1490e959c0 5 monclient: authenticate success, global_id 8310 2024-09-12T18:50:53.450 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient: _renew_subs 2024-09-12T18:50:53.450 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:50:53.039+0000 7f148d198640 4 set_mon_vals no callback set 2024-09-12T18:50:53.450 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.450 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient: _renew_subs 2024-09-12T18:50:53.451 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:50:53.039+0000 7f1490e959c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.451 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:50:53.039+0000 7f1378e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:50:53.451 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:50:53.039+0000 7f1378e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:53.451 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:50:53.039+0000 7f1378e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:53.451 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient: get_auth_request con 0x7f1368070a20 auth_method 0 2024-09-12T18:50:53.451 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: get_monmap_and_config 2024-09-12T18:50:53.451 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: build_initial_monmap 2024-09-12T18:50:53.451 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:50:53.043+0000 7f1490e959c0 1 build_initial for_mkfs: 0 2024-09-12T18:50:53.451 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: monmap: 2024-09-12T18:50:53.451 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:50:53.451 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:50:53.451 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:50:53.451 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:50:53.452 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:50:53.452 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.452 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:50:53.452 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:50:53.452 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:50:53.452 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.452 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding auth protocol: cephx 2024-09-12T18:50:53.452 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding auth protocol: cephx 2024-09-12T18:50:53.452 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding auth protocol: cephx 2024-09-12T18:50:53.452 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: secure 2024-09-12T18:50:53.452 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: crc 2024-09-12T18:50:53.452 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: secure 2024-09-12T18:50:53.452 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: crc 2024-09-12T18:50:53.452 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: secure 2024-09-12T18:50:53.453 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: crc 2024-09-12T18:50:53.453 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: crc 2024-09-12T18:50:53.453 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: secure 2024-09-12T18:50:53.453 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: crc 2024-09-12T18:50:53.453 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: secure 2024-09-12T18:50:53.453 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: crc 2024-09-12T18:50:53.453 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b520b220) adding con mode: secure 2024-09-12T18:50:53.453 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:50:53.043+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.453 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: init 2024-09-12T18:50:53.453 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding auth protocol: cephx 2024-09-12T18:50:53.453 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding auth protocol: cephx 2024-09-12T18:50:53.453 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding auth protocol: cephx 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: secure 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: crc 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: secure 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: crc 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: secure 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: crc 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: crc 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: secure 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: crc 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: secure 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: crc 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c410) adding con mode: secure 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:50:53.043+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:50:53.043+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.454 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe4492c558 EEXIST 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-b con 0x55c2b523f700 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-c con 0x55c2b520f270 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-a con 0x55c2b5230180 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): authenticate will time out at 2440.185273s 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient(hunting): get_auth_request con 0x55c2b520f270 auth_method 0 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.455 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): get_auth_request con 0x55c2b5230180 auth_method 0 2024-09-12T18:50:53.456 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.456 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.456 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.456 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.456 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.456 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:50:53.043+0000 7f148f19c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.456 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.456 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.456 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.456 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): get_auth_request con 0x55c2b523f700 auth_method 0 2024-09-12T18:50:53.456 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.456 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.456 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.456 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): handle_auth_done global_id 8313 payload 274 2024-09-12T18:50:53.457 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient: _finish_hunting 0 2024-09-12T18:50:53.457 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:50:53.043+0000 7f148e99b640 1 monclient: found mon.noname-a 2024-09-12T18:50:53.457 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.457 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.457 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:50:53.457 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: dump: 2024-09-12T18:50:53.457 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.457 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.457 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.457 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.457 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.457 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.457 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.457 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: _finish_auth 0 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: _check_auth_tickets 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:50:53.043+0000 7f13727fc640 10 monclient: dump: 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.458 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.459 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.459 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.459 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.459 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 monclient: authenticate success, global_id 8313 2024-09-12T18:50:53.459 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: get_monmap_and_config success 2024-09-12T18:50:53.459 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:50:53.043+0000 7f1490e959c0 4 set_mon_vals no callback set 2024-09-12T18:50:53.459 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: shutdown 2024-09-12T18:50:53.459 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: build_initial_monmap 2024-09-12T18:50:53.459 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:50:53.043+0000 7f1490e959c0 1 build_initial for_mkfs: 0 2024-09-12T18:50:53.459 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: monmap: 2024-09-12T18:50:53.459 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:50:53.459 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:50:53.459 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:50:53.460 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:50:53.460 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:50:53.460 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.460 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:50:53.460 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:50:53.460 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:50:53.460 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.460 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding auth protocol: cephx 2024-09-12T18:50:53.460 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding auth protocol: cephx 2024-09-12T18:50:53.460 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding auth protocol: cephx 2024-09-12T18:50:53.460 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: secure 2024-09-12T18:50:53.460 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: crc 2024-09-12T18:50:53.460 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: secure 2024-09-12T18:50:53.460 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: crc 2024-09-12T18:50:53.461 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: secure 2024-09-12T18:50:53.461 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: crc 2024-09-12T18:50:53.461 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: crc 2024-09-12T18:50:53.461 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: secure 2024-09-12T18:50:53.461 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: crc 2024-09-12T18:50:53.461 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: secure 2024-09-12T18:50:53.461 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: crc 2024-09-12T18:50:53.461 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b52102b0) adding con mode: secure 2024-09-12T18:50:53.461 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:50:53.043+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.461 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:50:53.043+0000 7f1490e959c0 1 librados: starting msgr at 2024-09-12T18:50:53.461 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:50:53.043+0000 7f1490e959c0 1 librados: starting objecter 2024-09-12T18:50:53.461 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command objecter_requests cmddesc objecter_requests hook 0x55c2b51ebe20 EEXIST 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:50:53.043+0000 7f1490e959c0 1 librados: setting wanted keys 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:50:53.043+0000 7f1490e959c0 1 librados: calling monclient init 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: init 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding auth protocol: cephx 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding auth protocol: cephx 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding auth protocol: cephx 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: secure 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: crc 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: secure 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: crc 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: secure 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: crc 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: crc 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: secure 2024-09-12T18:50:53.462 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: crc 2024-09-12T18:50:53.463 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: secure 2024-09-12T18:50:53.463 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: crc 2024-09-12T18:50:53.463 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 AuthRegistry(0x55c2b51ed690) adding con mode: secure 2024-09-12T18:50:53.463 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:50:53.043+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.463 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:50:53.043+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.463 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:50:53.043+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command rotate-key cmddesc rotate-key hook 0x55c2b51ed7d8 EEXIST 2024-09-12T18:50:53.463 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: _reopen_session rank -1 2024-09-12T18:50:53.463 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T18:50:53.463 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-a con 0x55c2b520f270 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:50:53.463 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-b con 0x55c2b5230180 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:50:53.463 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): picked mon.noname-c con 0x55c2b523f700 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:50:53.463 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.463 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.463 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): _renew_subs 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:50:53.043+0000 7f1490e959c0 10 monclient(hunting): authenticate will time out at 2440.187833s 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): get_auth_request con 0x55c2b520f270 auth_method 0 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:50:53.043+0000 7f148e19a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): get_auth_request con 0x55c2b523f700 auth_method 0 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:50:53.043+0000 7f148e99b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:50:53.047+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:50:53.047+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:50:53.047+0000 7f148e19a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:50:53.047+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:50:53.464 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:50:53.047+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:50:53.465 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:50:53.047+0000 7f148e99b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:50:53.465 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:50:53.047+0000 7f148e19a640 10 monclient(hunting): handle_auth_done global_id 8316 payload 824 2024-09-12T18:50:53.465 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:50:53.047+0000 7f148e19a640 10 monclient: _finish_hunting 0 2024-09-12T18:50:53.465 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:50:53.047+0000 7f148e19a640 1 monclient: found mon.noname-a 2024-09-12T18:50:53.465 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:50:53.047+0000 7f148e19a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.465 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:50:53.047+0000 7f148f19c640 10 monclient: get_auth_request con 0x55c2b5230180 auth_method 0 2024-09-12T18:50:53.465 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.465 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:50:53.465 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: dump: 2024-09-12T18:50:53.465 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.465 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.465 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.465 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.466 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.466 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.466 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.466 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.466 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.466 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.466 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: _finish_auth 0 2024-09-12T18:50:53.466 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: _check_auth_tickets 2024-09-12T18:50:53.466 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T18:50:53.466 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:50:53.466 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:50:53.466 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:50:53.047+0000 7f1370ff9640 10 monclient: dump: 2024-09-12T18:50:53.467 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:50:53.467 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:50:53.467 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.467 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:50:53.467 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:50:53.467 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:50:53.467 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:50:53.467 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:50:53.467 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:50:53.467 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.467 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:50:53.047+0000 7f1490e959c0 5 monclient: authenticate success, global_id 8316 2024-09-12T18:50:53.467 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:50:53.047+0000 7f13727fc640 4 set_mon_vals no callback set 2024-09-12T18:50:53.467 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:50:53.047+0000 7f1490e959c0 10 monclient: _renew_subs 2024-09-12T18:50:53.467 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:50:53.047+0000 7f1490e959c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.468 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:50:53.047+0000 7f1490e959c0 10 monclient: _renew_subs 2024-09-12T18:50:53.468 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:50:53.047+0000 7f1490e959c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.468 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:50:53.047+0000 7f1490e959c0 1 librados: init done 2024-09-12T18:50:53.468 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:50:53.047+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command cr dump hook 0x55c2b52377b8 2024-09-12T18:50:53.468 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.468 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:50:53.047+0000 7f1370ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:50:53.468 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:50:53.047+0000 7f1370ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:53.468 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:50:53.047+0000 7f1370ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:50:53.468 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:50:53.047+0000 7f148f19c640 10 monclient: get_auth_request con 0x7f1358070b10 auth_method 0 2024-09-12T18:50:53.468 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:50:53.047+0000 7f148e99b640 10 monclient: get_auth_request con 0x55c2b5259140 auth_method 0 2024-09-12T18:50:53.468 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.468 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:50:53.047+0000 7f1490e959c0 20 realm 2024-09-12T18:50:53.469 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.469 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.469 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:50:53.047+0000 7f1490e959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:53.469 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:50:53.047+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.469 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.469 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.469 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:50:53.051+0000 7f148e19a640 10 monclient: get_auth_request con 0x55c2b525d3a0 auth_method 0 2024-09-12T18:50:53.469 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:53.469 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.469 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:50:53.051+0000 7f148f19c640 10 monclient: get_auth_request con 0x55c2b5260c00 auth_method 0 2024-09-12T18:50:53.469 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:50:53.051+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:53.469 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:50:53.051+0000 7f1490e959c0 20 searching for the correct realm 2024-09-12T18:50:53.469 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:50:53.051+0000 7f148e99b640 10 monclient: get_auth_request con 0x7f148801f040 auth_method 0 2024-09-12T18:50:53.470 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:50:53.055+0000 7f148e19a640 10 monclient: get_auth_request con 0x7f1480063400 auth_method 0 2024-09-12T18:50:53.470 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:50:53.055+0000 7f148f19c640 10 monclient: get_auth_request con 0x7f1478137260 auth_method 0 2024-09-12T18:50:53.470 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:50:53.055+0000 7f148e99b640 0 -- 172.21.15.111:0/2404062939 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f148801f040 msgr2=0x7f14880143f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:53.470 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:50:53.055+0000 7f1370ff9640 1 client.8316.objecter ms_handle_reset 0x7f148801f040 session 0x7f14880297a0 osd.7 2024-09-12T18:50:53.470 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:50:53.059+0000 7f1370ff9640 10 monclient: _renew_subs 2024-09-12T18:50:53.470 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:50:53.059+0000 7f1370ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:50:53.470 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:50:53.059+0000 7f148e99b640 10 monclient: get_auth_request con 0x7f1358080ab0 auth_method 0 2024-09-12T18:50:53.470 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:50:53.059+0000 7f148e99b640 10 monclient: get_auth_request con 0x7f1488008050 auth_method 0 2024-09-12T18:50:53.470 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:50:53.063+0000 7f148e19a640 10 monclient: get_auth_request con 0x7f1488054410 auth_method 0 2024-09-12T18:50:53.470 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:50:53.063+0000 7f148e19a640 0 -- 172.21.15.111:0/2404062939 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f1488054410 msgr2=0x7f1488054870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:53.470 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:50:53.267+0000 7f148e19a640 10 monclient: get_auth_request con 0x7f1488054410 auth_method 0 2024-09-12T18:50:53.470 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:53.470 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:53.470 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:53.471 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:53.471 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:53.471 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:53.471 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.471 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.471 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.471 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:53.471 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:50:53.279+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.471 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:53.471 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 zone default found 2024-09-12T18:50:53.471 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:50:53.283+0000 7f1490e959c0 4 Realm: () 2024-09-12T18:50:53.471 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:50:53.283+0000 7f1490e959c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:53.471 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:50:53.283+0000 7f1490e959c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:53.471 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:50:53.283+0000 7f1490e959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:53.472 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 zonegroup default 2024-09-12T18:50:53.472 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.472 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.472 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.472 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.472 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.472 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.472 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 started sync module instance, tier type = 2024-09-12T18:50:53.472 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:50:53.283+0000 7f1490e959c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:53.472 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=0 2024-09-12T18:50:53.472 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=1 2024-09-12T18:50:53.472 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=2 2024-09-12T18:50:53.472 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=3 2024-09-12T18:50:53.473 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=4 2024-09-12T18:50:53.473 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=5 2024-09-12T18:50:53.473 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:50:53.307+0000 7f1490e959c0 20 add_watcher() i=6 2024-09-12T18:50:53.473 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:50:53.311+0000 7f1490e959c0 20 add_watcher() i=7 2024-09-12T18:50:53.473 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:50:53.311+0000 7f1490e959c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:53.473 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding auth protocol: cephx 2024-09-12T18:50:53.473 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding auth protocol: cephx 2024-09-12T18:50:53.473 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding auth protocol: cephx 2024-09-12T18:50:53.473 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: secure 2024-09-12T18:50:53.473 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: crc 2024-09-12T18:50:53.473 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: secure 2024-09-12T18:50:53.473 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: crc 2024-09-12T18:50:53.473 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: secure 2024-09-12T18:50:53.473 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: crc 2024-09-12T18:50:53.474 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:50:53.315+0000 7f13457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:53.474 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: crc 2024-09-12T18:50:53.474 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: secure 2024-09-12T18:50:53.474 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: crc 2024-09-12T18:50:53.474 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: secure 2024-09-12T18:50:53.474 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: crc 2024-09-12T18:50:53.474 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 AuthRegistry(0x7ffe4492c8f0) adding con mode: secure 2024-09-12T18:50:53.474 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:50:53.315+0000 7f1490e959c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:50:53.474 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:50:53.315+0000 7f1490e959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:53.474 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:50:53.315+0000 7f1490e959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:53.474 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command cache list hook 0x55c2b5235e30 2024-09-12T18:50:53.474 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command cache inspect hook 0x55c2b5235e30 2024-09-12T18:50:53.474 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command cache erase hook 0x55c2b5235e30 2024-09-12T18:50:53.474 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command cache zap hook 0x55c2b5235e30 2024-09-12T18:50:53.475 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:50:53.315+0000 7f1490e959c0 5 note: GC not initialized 2024-09-12T18:50:53.475 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:50:53.319+0000 7f12bffff640 20 reqs_thread_entry: start 2024-09-12T18:50:53.475 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:50:53.319+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command sync trace show hook 0x7f1480060040 2024-09-12T18:50:53.475 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:50:53.319+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command sync trace history hook 0x7f1480060040 2024-09-12T18:50:53.475 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:50:53.319+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command sync trace active hook 0x7f1480060040 2024-09-12T18:50:53.475 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:50:53.319+0000 7f1490e959c0 5 asok(0x55c2b4f622b0) register_command sync trace active_short hook 0x7f1480060040 2024-09-12T18:50:53.475 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:50:53.319+0000 7f1490e959c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:53.475 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:50:53.319+0000 7f1490e959c0 20 Filter name: none 2024-09-12T18:50:53.475 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:50:53.319+0000 7f12bdffb640 20 reqs_thread_entry: start 2024-09-12T18:50:53.475 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:50:53.475 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:50:53.319+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.475 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:50:53.319+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:53.475 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:50:53.475 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:50:53.476 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:50:53.476 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:50:53.319+0000 7f1490e959c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.476 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:50:53.319+0000 7f1490e959c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:50:53.476 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:53.476 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:53.476 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:50:53.476 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:53.476 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:50:53.319+0000 7f1490e959c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:50:53.476 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:50:53.331+0000 7f1490e959c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:53.476 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:50:53.331+0000 7f1490e959c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:53.476 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:50:53.331+0000 7f1490e959c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:53.476 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:50:53.331+0000 7f1490e959c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:50:53.476 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:50:53.331+0000 7f1371ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431688 cookie 94294751231856 notifier 8316 bl.length()=827 2024-09-12T18:50:53.476 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:50:53.331+0000 7f1371ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:53.477 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:50:53.331+0000 7f1371ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:53.477 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:50:53.331+0000 7f1371ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:53.477 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:50:53.331+0000 7f1490e959c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:50:53.477 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:50:53.331+0000 7f1490e959c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:50:53.477 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:50:53.331+0000 7f1490e959c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:50:53.477 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:50:53.331+0000 7f1490e959c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:50:53.477 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:50:53.343+0000 7f1490e959c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1490e959c0 time 2024-09-12T18:50:53.346168+0000 2024-09-12T18:50:53.477 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:50:53.477 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.477 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:53.477 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f149476f2eb] 2024-09-12T18:50:53.477 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f149476f49f] 2024-09-12T18:50:53.478 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c2b363ecc1] 2024-09-12T18:50:53.478 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c2b3653d5a] 2024-09-12T18:50:53.478 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:50:53.478 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14935d5d90] 2024-09-12T18:50:53.478 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:50:53.478 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:50:53.478 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.478 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:50:53.343+0000 7f1490e959c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:50:53.478 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f1490e959c0 thread_name:radosgw-admin 2024-09-12T18:50:53.478 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.478 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:50:53.478 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f14935ee520] 2024-09-12T18:50:53.478 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:50:53.479 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:50:53.479 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:50:53.479 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f149476f345] 2024-09-12T18:50:53.479 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f149476f49f] 2024-09-12T18:50:53.479 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c2b363ecc1] 2024-09-12T18:50:53.479 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c2b3653d5a] 2024-09-12T18:50:53.479 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:50:53.479 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f14935d5d90] 2024-09-12T18:50:53.479 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:50:53.479 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:50:53.479 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:50:53.479 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:50:53.479 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:50:53.480 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:50:53.480 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:50:53.480 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:50:53.480 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:50:53.480 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:50:53.480 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:50:53.480 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:50:53.480 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:50:53.480 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:50:53.480 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:50:53.480 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:50:53.480 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:50:53.480 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:50:53.480 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:50:53.481 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:50:53.481 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:50:53.481 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:50:53.481 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:50:53.481 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:50:53.481 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:50:53.481 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:50:53.481 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:50:53.481 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:50:53.481 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:50:53.481 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:50:53.481 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:50:53.481 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:50:53.481 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:50:53.482 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:50:53.482 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:50:53.482 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:50:53.482 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:50:53.482 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:50:53.482 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:50:53.482 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:50:53.482 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:50:53.482 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:50:53.482 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:50:53.482 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:50:53.482 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:50:53.482 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:50:53.482 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:50:53.483 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:50:53.483 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:50:53.483 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:50:53.483 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:50:53.483 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:50:53.483 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:50:53.483 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:50:53.483 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:50:53.483 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:50:53.483 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:50:53.483 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:50:53.483 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:50:53.483 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:50:53.484 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:50:53.484 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:50:53.484 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:50:53.484 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:50:53.484 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:50:53.484 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:50:53.484 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:50:53.484 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:50:53.484 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:50:53.484 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:50:53.484 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:50:53.484 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:50:53.484 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:50:53.485 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:50:53.485 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:50:53.485 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:50:53.485 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:50:53.485 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:50:53.485 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:50:53.485 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:50:53.485 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:50:53.485 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:50:53.485 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:50:53.485 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:50:53.485 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:50:53.485 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:50:53.485 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr: 7f12bdffb640 / http_manager 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr: 7f12bffff640 / http_manager 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr: 7f13457e2640 / rgw_dt_lg_renew 2024-09-12T18:50:53.486 INFO:tasks.workunit.client.0.smithi111.stderr: 7f1370ff9640 / ms_dispatch 2024-09-12T18:50:53.487 INFO:tasks.workunit.client.0.smithi111.stderr: 7f1371ffb640 / io_context_pool 2024-09-12T18:50:53.487 INFO:tasks.workunit.client.0.smithi111.stderr: 7f13727fc640 / io_context_pool 2024-09-12T18:50:53.487 INFO:tasks.workunit.client.0.smithi111.stderr: 7f1378e01640 / ms_dispatch 2024-09-12T18:50:53.487 INFO:tasks.workunit.client.0.smithi111.stderr: 7f137b606640 / ms_dispatch 2024-09-12T18:50:53.487 INFO:tasks.workunit.client.0.smithi111.stderr: 7f137ce09640 / io_context_pool 2024-09-12T18:50:53.487 INFO:tasks.workunit.client.0.smithi111.stderr: 7f148d198640 / io_context_pool 2024-09-12T18:50:53.487 INFO:tasks.workunit.client.0.smithi111.stderr: 7f148e19a640 / msgr-worker-2 2024-09-12T18:50:53.487 INFO:tasks.workunit.client.0.smithi111.stderr: 7f148e99b640 / msgr-worker-1 2024-09-12T18:50:53.487 INFO:tasks.workunit.client.0.smithi111.stderr: 7f148f19c640 / msgr-worker-0 2024-09-12T18:50:53.487 INFO:tasks.workunit.client.0.smithi111.stderr: 7f1490e959c0 / radosgw-admin 2024-09-12T18:50:53.487 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:50:53.487 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:50:53.487 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:50:53.348166Z_8bb7ced3-ef3e-4166-8890-e4f500addb9b/log 2024-09-12T18:50:53.487 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:50:53.488 INFO:tasks.workunit.client.0.smithi111.stderr:Aborted 2024-09-12T18:50:53.488 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:50:53.492 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:50:53.492 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:50:53.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.423+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.423+0000 7f16286079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.423+0000 7f16286079c0 20 realm 2024-09-12T18:50:53.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.423+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.427+0000 7f16286079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.427+0000 7f16286079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:53.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.427+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.427+0000 7f16286079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.427+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.427+0000 7f16286079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:53.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.427+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.427+0000 7f16286079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:53.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.427+0000 7f16286079c0 20 searching for the correct realm 2024-09-12T18:50:53.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.435+0000 7f162610d640 0 -- 172.21.15.111:0/2569315444 >> [v2:172.21.15.111:6800/2832238944,v1:172.21.15.111:6801/2832238944] conn(0x55b1e21b7c70 msgr2=0x55b1e21ba130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:53.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.439+0000 7f161ffff640 0 -- 172.21.15.111:0/2569315444 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f162010d320 msgr2=0x7f16201199b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:53.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:53.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:53.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:53.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:53.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:53.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:53.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:53.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:53.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 zone default found 2024-09-12T18:50:53.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 4 Realm: () 2024-09-12T18:50:53.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:53.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:53.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:53.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 zonegroup default 2024-09-12T18:50:53.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.447+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.451+0000 7f16286079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.451+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.451+0000 7f16286079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.451+0000 7f16286079c0 20 started sync module instance, tier type = 2024-09-12T18:50:53.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.451+0000 7f16286079c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:53.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.463+0000 7f16286079c0 20 add_watcher() i=0 2024-09-12T18:50:53.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.463+0000 7f16286079c0 20 add_watcher() i=1 2024-09-12T18:50:53.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.463+0000 7f16286079c0 20 add_watcher() i=2 2024-09-12T18:50:53.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.463+0000 7f16286079c0 20 add_watcher() i=3 2024-09-12T18:50:53.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.463+0000 7f16286079c0 20 add_watcher() i=4 2024-09-12T18:50:53.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.463+0000 7f16286079c0 20 add_watcher() i=5 2024-09-12T18:50:53.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.463+0000 7f16286079c0 20 add_watcher() i=6 2024-09-12T18:50:53.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.467+0000 7f16286079c0 20 add_watcher() i=7 2024-09-12T18:50:53.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.467+0000 7f16286079c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:53.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.467+0000 7f14dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:53.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.467+0000 7f16286079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:53.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.467+0000 7f16286079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:53.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.467+0000 7f16286079c0 5 note: GC not initialized 2024-09-12T18:50:53.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.467+0000 7f14577fe640 20 reqs_thread_entry: start 2024-09-12T18:50:53.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.467+0000 7f16286079c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:53.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.467+0000 7f16286079c0 20 Filter name: none 2024-09-12T18:50:53.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.467+0000 7f14557fa640 20 reqs_thread_entry: start 2024-09-12T18:50:53.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.467+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.471+0000 7f16286079c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:53.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.471+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.471+0000 7f16286079c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:50:53.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.471+0000 7f16286079c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:53.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.471+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.471+0000 7f16286079c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:53.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.471+0000 7f16286079c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.471+0000 7f16286079c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:50:53.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.471+0000 7f16286079c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:50:53.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.475+0000 7f14dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:53.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.479+0000 7f16286079c0 20 remove_watcher() i=0 2024-09-12T18:50:53.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.479+0000 7f16286079c0 2 removed watcher, disabling cache 2024-09-12T18:50:53.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.483+0000 7f16286079c0 20 remove_watcher() i=1 2024-09-12T18:50:53.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.483+0000 7f16286079c0 20 remove_watcher() i=2 2024-09-12T18:50:53.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.487+0000 7f16286079c0 20 remove_watcher() i=3 2024-09-12T18:50:53.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.487+0000 7f16286079c0 20 remove_watcher() i=4 2024-09-12T18:50:53.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.487+0000 7f16286079c0 20 remove_watcher() i=5 2024-09-12T18:50:53.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.491+0000 7f16286079c0 20 remove_watcher() i=6 2024-09-12T18:50:53.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.491+0000 7f16286079c0 20 remove_watcher() i=7 2024-09-12T18:50:53.509 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:50:53.509 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:50:53.518 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:50:53.545 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:50:53.545 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:50:53.588 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.587+0000 7f91302a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.590 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.587+0000 7f91302a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.587+0000 7f91302a09c0 20 realm 2024-09-12T18:50:53.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.587+0000 7f91302a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.587+0000 7f91302a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.587+0000 7f91302a09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:50:53.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.587+0000 7f91302a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.587+0000 7f91302a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:53.591 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.587+0000 7f91302a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.591+0000 7f91302a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:53.592 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.591+0000 7f91302a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:53.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.591+0000 7f91302a09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:50:53.593 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.591+0000 7f91302a09c0 20 searching for the correct realm 2024-09-12T18:50:53.596 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.595+0000 7f912e5a7640 0 -- 172.21.15.111:0/667606589 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f912405b7f0 msgr2=0x7f9124065040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:53.813 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:53.811+0000 7f912d5a5640 0 -- 172.21.15.111:0/667606589 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f9128126180 msgr2=0x7f9128003420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:50:54.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.027+0000 7f91302a09c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:50:54.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.027+0000 7f91302a09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:50:54.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.027+0000 7f91302a09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:50:54.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.027+0000 7f91302a09c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:50:54.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.027+0000 7f91302a09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:50:54.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.027+0000 7f91302a09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:50:54.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.027+0000 7f91302a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:54.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.027+0000 7f91302a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:54.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:54.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:50:54.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:54.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:50:54.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 20 zone default found 2024-09-12T18:50:54.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 4 Realm: () 2024-09-12T18:50:54.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:50:54.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:50:54.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:50:54.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 20 zonegroup default 2024-09-12T18:50:54.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:54.034 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:54.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:54.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:54.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.031+0000 7f91302a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:54.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.035+0000 7f91302a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:50:54.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.035+0000 7f91302a09c0 20 started sync module instance, tier type = 2024-09-12T18:50:54.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.035+0000 7f91302a09c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:50:54.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.055+0000 7f91302a09c0 20 add_watcher() i=0 2024-09-12T18:50:54.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.055+0000 7f91302a09c0 20 add_watcher() i=1 2024-09-12T18:50:54.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.055+0000 7f91302a09c0 20 add_watcher() i=2 2024-09-12T18:50:54.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.055+0000 7f91302a09c0 20 add_watcher() i=3 2024-09-12T18:50:54.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.055+0000 7f91302a09c0 20 add_watcher() i=4 2024-09-12T18:50:54.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.055+0000 7f91302a09c0 20 add_watcher() i=5 2024-09-12T18:50:54.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.055+0000 7f91302a09c0 20 add_watcher() i=6 2024-09-12T18:50:54.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.059+0000 7f91302a09c0 20 add_watcher() i=7 2024-09-12T18:50:54.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.059+0000 7f91302a09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:50:54.066 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.063+0000 7f8fe3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:54.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.063+0000 7f91302a09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:50:54.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.063+0000 7f91302a09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:50:54.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.063+0000 7f91302a09c0 5 note: GC not initialized 2024-09-12T18:50:54.067 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.063+0000 7f8fe2fe5640 20 reqs_thread_entry: start 2024-09-12T18:50:54.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 20 init_complete bucket index max shards: 11 2024-09-12T18:50:54.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 20 Filter name: none 2024-09-12T18:50:54.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f8fe0fe1640 20 reqs_thread_entry: start 2024-09-12T18:50:54.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:50:54.068 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:54.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:50:54.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:50:54.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:50:54.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:50:54.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 20 rados->read ofs=0 len=0 2024-09-12T18:50:54.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:50:54.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:50:54.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:50:54.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:50:54.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:50:54.071 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:50:54.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:50:54.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.067+0000 7f91302a09c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:50:54.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.071+0000 7f91302a09c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:50:54.072 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.071+0000 7f91302a09c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:50:54.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.071+0000 7f91302a09c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:50:54.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.071+0000 7f91302a09c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:50:54.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.071+0000 7f91302a09c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:50:54.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.071+0000 7f91302a09c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:50:54.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.071+0000 7f91302a09c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:50:54.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.071+0000 7f91302a09c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:50:54.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.071+0000 7f91302a09c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:50:54.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.071+0000 7f91302a09c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:50:54.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.075+0000 7f91302a09c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:50:54.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.075+0000 7f91302a09c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:50:54.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.075+0000 7f91302a09c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:50:54.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.075+0000 7f91302a09c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:50:54.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.075+0000 7f91302a09c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:50:54.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.075+0000 7f91302a09c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:50:54.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.075+0000 7f91302a09c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:50:54.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.075+0000 7f91302a09c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:50:54.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.075+0000 7f91302a09c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:50:54.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.075+0000 7f91302a09c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:50:54.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.075+0000 7f91302a09c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:50:54.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.075+0000 7f91302a09c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:50:54.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.079+0000 7f91302a09c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:50:54.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.079+0000 7f91302a09c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:50:54.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.079+0000 7f8fe3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:50:54.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.083+0000 7f91302a09c0 20 remove_watcher() i=0 2024-09-12T18:50:54.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.083+0000 7f91302a09c0 2 removed watcher, disabling cache 2024-09-12T18:50:54.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.087+0000 7f91302a09c0 20 remove_watcher() i=1 2024-09-12T18:50:54.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.091+0000 7f91302a09c0 20 remove_watcher() i=2 2024-09-12T18:50:54.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.091+0000 7f91302a09c0 20 remove_watcher() i=3 2024-09-12T18:50:54.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.095+0000 7f91302a09c0 20 remove_watcher() i=4 2024-09-12T18:50:54.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.095+0000 7f91302a09c0 20 remove_watcher() i=5 2024-09-12T18:50:54.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.095+0000 7f91302a09c0 20 remove_watcher() i=6 2024-09-12T18:50:54.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:50:54.099+0000 7f91302a09c0 20 remove_watcher() i=7 2024-09-12T18:51:24.154 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T18:51:24.193 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:51:24.193 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:51:24.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.234+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.238+0000 7f313dc699c0 20 realm 2024-09-12T18:51:24.240 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.238+0000 7f313dc699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:51:24.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.241 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:24.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:51:24.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.238+0000 7f313dc699c0 20 searching for the correct realm 2024-09-12T18:51:24.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.246+0000 7f313bf70640 0 -- 172.21.15.111:0/3663818594 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f3130083b70 msgr2=0x7f31300615f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:24.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.250+0000 7f313af6e640 0 -- 172.21.15.111:0/3663818594 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f313408e940 msgr2=0x7f31340a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:51:24.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:51:24.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:51:24.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:51:24.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:51:24.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:51:24.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:51:24.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:24.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:51:24.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 20 zone default found 2024-09-12T18:51:24.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 4 Realm: () 2024-09-12T18:51:24.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:51:24.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:51:24.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:51:24.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 20 zonegroup default 2024-09-12T18:51:24.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 20 started sync module instance, tier type = 2024-09-12T18:51:24.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.470+0000 7f313dc699c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:51:24.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=0 2024-09-12T18:51:24.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=1 2024-09-12T18:51:24.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=2 2024-09-12T18:51:24.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=3 2024-09-12T18:51:24.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=4 2024-09-12T18:51:24.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=5 2024-09-12T18:51:24.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=6 2024-09-12T18:51:24.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=7 2024-09-12T18:51:24.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.494+0000 7f313dc699c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:51:24.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.498+0000 7f2ff1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:51:24.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.498+0000 7f313dc699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:51:24.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.498+0000 7f313dc699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:51:24.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.498+0000 7f313dc699c0 5 note: GC not initialized 2024-09-12T18:51:24.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f2ff0fe1640 20 reqs_thread_entry: start 2024-09-12T18:51:24.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 20 init_complete bucket index max shards: 11 2024-09-12T18:51:24.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 20 Filter name: none 2024-09-12T18:51:24.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f2f6a7fc640 20 reqs_thread_entry: start 2024-09-12T18:51:24.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:51:24.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:51:24.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:51:24.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:51:24.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:51:24.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:51:24.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:24.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:24.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:51:24.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:24.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.502+0000 7f313dc699c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:51:24.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.506+0000 7f313dc699c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:51:24.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.518+0000 7f313dc699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:24.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.518+0000 7f313dc699c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:24.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.518+0000 7f313dc699c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:24.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.518+0000 7f313dc699c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:51:24.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.522+0000 7f301effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431689 cookie 94748749945440 notifier 8370 bl.length()=827 2024-09-12T18:51:24.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.522+0000 7f301effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:24.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.522+0000 7f301effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:24.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.522+0000 7f301effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:24.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.522+0000 7f313dc699c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:51:24.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.522+0000 7f313dc699c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:51:24.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.522+0000 7f313dc699c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:51:24.525 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.522+0000 7f313dc699c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:51:24.530 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f313dc699c0 time 2024-09-12T18:51:24.531648+0000 2024-09-12T18:51:24.530 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:51:24.532 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:24.532 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f31415432eb] 2024-09-12T18:51:24.532 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f314154349f] 2024-09-12T18:51:24.532 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c66fcecc1] 2024-09-12T18:51:24.533 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422aac) [0x562c67a2caac] 2024-09-12T18:51:24.533 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c66fe3ced] 2024-09-12T18:51:24.537 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:51:24.537 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f31403a9d90] 2024-09-12T18:51:24.537 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:51:24.537 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:51:24.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.530+0000 7f313dc699c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f313dc699c0 time 2024-09-12T18:51:24.531648+0000 2024-09-12T18:51:24.537 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:51:24.537 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.537 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:24.537 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f31415432eb] 2024-09-12T18:51:24.537 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f314154349f] 2024-09-12T18:51:24.537 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c66fcecc1] 2024-09-12T18:51:24.537 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422aac) [0x562c67a2caac] 2024-09-12T18:51:24.538 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c66fe3ced] 2024-09-12T18:51:24.538 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:51:24.538 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f31403a9d90] 2024-09-12T18:51:24.538 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:51:24.538 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:51:24.538 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.538 INFO:tasks.workunit.client.0.smithi111.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:51:24.538 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f313dc699c0 thread_name:radosgw-admin 2024-09-12T18:51:24.549 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:24.550 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f31403c2520] 2024-09-12T18:51:24.550 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:51:24.550 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:51:24.550 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:51:24.550 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3141543345] 2024-09-12T18:51:24.550 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f314154349f] 2024-09-12T18:51:24.550 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c66fcecc1] 2024-09-12T18:51:24.550 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422aac) [0x562c67a2caac] 2024-09-12T18:51:24.550 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c66fe3ced] 2024-09-12T18:51:24.550 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:51:24.551 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f31403a9d90] 2024-09-12T18:51:24.551 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:51:24.551 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:51:24.551 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.530+0000 7f313dc699c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:51:24.551 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f313dc699c0 thread_name:radosgw-admin 2024-09-12T18:51:24.551 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.551 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:24.551 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f31403c2520] 2024-09-12T18:51:24.551 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:51:24.551 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:51:24.551 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:51:24.551 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3141543345] 2024-09-12T18:51:24.551 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f314154349f] 2024-09-12T18:51:24.552 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c66fcecc1] 2024-09-12T18:51:24.552 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422aac) [0x562c67a2caac] 2024-09-12T18:51:24.552 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c66fe3ced] 2024-09-12T18:51:24.552 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:51:24.552 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f31403a9d90] 2024-09-12T18:51:24.552 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:51:24.552 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:51:24.552 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:51:24.552 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.552 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:51:24.552 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:51:24.210+0000 7f313b76f640 1 monclient: found mon.noname-a 2024-09-12T18:51:24.552 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:51:24.210+0000 7f313b76f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.553 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:51:24.210+0000 7f313af6e640 10 monclient: get_auth_request con 0x562c69715b90 auth_method 0 2024-09-12T18:51:24.553 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.553 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:51:24.553 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: dump: 2024-09-12T18:51:24.553 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.553 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.553 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.553 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.553 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.553 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.553 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.553 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.553 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.553 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.554 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: _finish_auth 0 2024-09-12T18:51:24.554 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: _check_auth_tickets 2024-09-12T18:51:24.554 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 monclient: authenticate success, global_id 8358 2024-09-12T18:51:24.554 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:24.554 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: get_monmap_and_config success 2024-09-12T18:51:24.554 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.554 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:51:24.214+0000 7f313dc699c0 4 set_mon_vals no callback set 2024-09-12T18:51:24.554 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:51:24.554 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: dump: 2024-09-12T18:51:24.555 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.555 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.555 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.555 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.555 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.555 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.555 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.555 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.555 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.555 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.556 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: shutdown 2024-09-12T18:51:24.556 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 asok(0x562c6964a2b0) unregister_commands rotate-key 2024-09-12T18:51:24.556 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: build_initial_monmap 2024-09-12T18:51:24.556 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:51:24.214+0000 7f313dc699c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:24.556 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: monmap: 2024-09-12T18:51:24.556 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:24.556 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:24.556 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:24.556 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:24.556 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:24.556 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.557 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:24.557 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:24.557 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:24.557 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.557 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding auth protocol: cephx 2024-09-12T18:51:24.557 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding auth protocol: cephx 2024-09-12T18:51:24.557 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding auth protocol: cephx 2024-09-12T18:51:24.557 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: secure 2024-09-12T18:51:24.557 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: crc 2024-09-12T18:51:24.557 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: secure 2024-09-12T18:51:24.557 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: crc 2024-09-12T18:51:24.557 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: secure 2024-09-12T18:51:24.557 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: crc 2024-09-12T18:51:24.557 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: crc 2024-09-12T18:51:24.558 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: secure 2024-09-12T18:51:24.558 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: crc 2024-09-12T18:51:24.558 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: secure 2024-09-12T18:51:24.558 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: crc 2024-09-12T18:51:24.558 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: secure 2024-09-12T18:51:24.558 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:51:24.214+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.558 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:51:24.214+0000 7f313dc699c0 1 librados: starting msgr at 2024-09-12T18:51:24.558 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:51:24.214+0000 7f313dc699c0 1 librados: starting objecter 2024-09-12T18:51:24.558 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command objecter_requests hook 0x562c696072f0 2024-09-12T18:51:24.558 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:51:24.214+0000 7f313dc699c0 1 librados: setting wanted keys 2024-09-12T18:51:24.558 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:51:24.214+0000 7f313dc699c0 1 librados: calling monclient init 2024-09-12T18:51:24.558 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: init 2024-09-12T18:51:24.558 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding auth protocol: cephx 2024-09-12T18:51:24.559 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding auth protocol: cephx 2024-09-12T18:51:24.559 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding auth protocol: cephx 2024-09-12T18:51:24.559 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: secure 2024-09-12T18:51:24.559 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: crc 2024-09-12T18:51:24.559 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: secure 2024-09-12T18:51:24.559 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: crc 2024-09-12T18:51:24.559 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: secure 2024-09-12T18:51:24.559 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: crc 2024-09-12T18:51:24.559 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: crc 2024-09-12T18:51:24.559 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: secure 2024-09-12T18:51:24.559 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: crc 2024-09-12T18:51:24.559 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: secure 2024-09-12T18:51:24.559 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: crc 2024-09-12T18:51:24.559 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: secure 2024-09-12T18:51:24.560 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:51:24.214+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.560 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:51:24.214+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.560 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command rotate-key hook 0x562c698574b8 2024-09-12T18:51:24.560 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:24.560 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:51:24.560 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-c con 0x562c69712430 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:24.560 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-b con 0x562c69715b90 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:24.560 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-a con 0x562c6979c940 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:24.560 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.560 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.560 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.561 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:24.561 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): authenticate will time out at 2471.358379s 2024-09-12T18:51:24.561 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): get_auth_request con 0x562c6979c940 auth_method 0 2024-09-12T18:51:24.561 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.561 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.561 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.561 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:51:24.214+0000 7f313b76f640 10 monclient(hunting): get_auth_request con 0x562c69712430 auth_method 0 2024-09-12T18:51:24.561 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:51:24.214+0000 7f313b76f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.561 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:51:24.214+0000 7f313b76f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.561 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:51:24.214+0000 7f313b76f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.561 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.561 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.561 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.562 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:51:24.214+0000 7f313b76f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.562 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:51:24.214+0000 7f313b76f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.562 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:51:24.214+0000 7f313b76f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.562 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): handle_auth_done global_id 8361 payload 824 2024-09-12T18:51:24.562 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient: _finish_hunting 0 2024-09-12T18:51:24.562 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:51:24.214+0000 7f313bf70640 1 monclient: found mon.noname-a 2024-09-12T18:51:24.562 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.562 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:51:24.214+0000 7f313af6e640 10 monclient: get_auth_request con 0x562c69715b90 auth_method 0 2024-09-12T18:51:24.562 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.562 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:51:24.562 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: dump: 2024-09-12T18:51:24.562 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.562 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.562 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.563 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.563 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.563 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.563 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.563 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.563 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.563 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.563 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: _finish_auth 0 2024-09-12T18:51:24.563 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: _check_auth_tickets 2024-09-12T18:51:24.563 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:24.563 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.563 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:51:24.563 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: dump: 2024-09-12T18:51:24.563 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.564 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.564 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.564 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.564 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.564 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.564 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.564 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.564 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.564 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.564 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 monclient: authenticate success, global_id 8361 2024-09-12T18:51:24.564 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:51:24.214+0000 7f302960a640 4 set_mon_vals no callback set 2024-09-12T18:51:24.564 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: _renew_subs 2024-09-12T18:51:24.564 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.565 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: _renew_subs 2024-09-12T18:51:24.565 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.565 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:51:24.214+0000 7f313dc699c0 1 librados: init done 2024-09-12T18:51:24.565 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:51:24.218+0000 7f3027e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:51:24.565 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:51:24.218+0000 7f3027e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:24.565 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:51:24.218+0000 7f3027e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:24.565 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:51:24.218+0000 7f313b76f640 10 monclient: get_auth_request con 0x7f3020070ae0 auth_method 0 2024-09-12T18:51:24.565 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:51:24.218+0000 7f313af6e640 10 monclient: get_auth_request con 0x562c698809c0 auth_method 0 2024-09-12T18:51:24.565 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:51:24.218+0000 7f313b76f640 10 monclient: get_auth_request con 0x562c698a1720 auth_method 0 2024-09-12T18:51:24.566 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:51:24.222+0000 7f313af6e640 10 monclient: get_auth_request con 0x562c698a5c50 auth_method 0 2024-09-12T18:51:24.566 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:51:24.222+0000 7f313bf70640 10 monclient: get_auth_request con 0x562c698a4f80 auth_method 0 2024-09-12T18:51:24.566 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:51:24.222+0000 7f313dc699c0 10 monclient: build_initial_monmap 2024-09-12T18:51:24.566 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:51:24.222+0000 7f313dc699c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:24.566 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:51:24.222+0000 7f313dc699c0 10 monclient: monmap: 2024-09-12T18:51:24.566 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:24.566 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:24.566 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:24.566 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:24.566 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:24.567 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.567 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:24.567 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:24.567 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:24.567 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.567 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding auth protocol: cephx 2024-09-12T18:51:24.567 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding auth protocol: cephx 2024-09-12T18:51:24.567 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding auth protocol: cephx 2024-09-12T18:51:24.567 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: secure 2024-09-12T18:51:24.567 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: crc 2024-09-12T18:51:24.567 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: secure 2024-09-12T18:51:24.567 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: crc 2024-09-12T18:51:24.567 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: secure 2024-09-12T18:51:24.567 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: crc 2024-09-12T18:51:24.568 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: crc 2024-09-12T18:51:24.568 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: secure 2024-09-12T18:51:24.568 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: crc 2024-09-12T18:51:24.568 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: secure 2024-09-12T18:51:24.568 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: crc 2024-09-12T18:51:24.568 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: secure 2024-09-12T18:51:24.568 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:51:24.222+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.568 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562c698b1810 EEXIST 2024-09-12T18:51:24.568 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient: init 2024-09-12T18:51:24.568 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding auth protocol: cephx 2024-09-12T18:51:24.569 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding auth protocol: cephx 2024-09-12T18:51:24.569 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding auth protocol: cephx 2024-09-12T18:51:24.569 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: secure 2024-09-12T18:51:24.569 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: crc 2024-09-12T18:51:24.569 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: secure 2024-09-12T18:51:24.569 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: crc 2024-09-12T18:51:24.569 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: secure 2024-09-12T18:51:24.569 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: crc 2024-09-12T18:51:24.569 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: crc 2024-09-12T18:51:24.569 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: secure 2024-09-12T18:51:24.569 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: crc 2024-09-12T18:51:24.570 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: secure 2024-09-12T18:51:24.570 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: crc 2024-09-12T18:51:24.570 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: secure 2024-09-12T18:51:24.570 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:51:24.226+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.570 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:51:24.226+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.570 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command rotate-key cmddesc rotate-key hook 0x562c698ace20 EEXIST 2024-09-12T18:51:24.570 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:24.570 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:51:24.570 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-c con 0x562c698d59c0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:24.571 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-a con 0x562c698d52f0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:24.571 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-b con 0x562c698d3cd0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:24.571 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.571 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.571 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.571 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:24.571 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): authenticate will time out at 2471.368624s 2024-09-12T18:51:24.571 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): get_auth_request con 0x562c698d59c0 auth_method 0 2024-09-12T18:51:24.572 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.572 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.572 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.572 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:51:24.226+0000 7f313bf70640 10 monclient(hunting): get_auth_request con 0x562c698d52f0 auth_method 0 2024-09-12T18:51:24.572 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:51:24.226+0000 7f313bf70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.572 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:51:24.226+0000 7f313bf70640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.572 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:51:24.226+0000 7f313bf70640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.572 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.573 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.573 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.573 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:51:24.226+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.573 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:51:24.226+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.573 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:51:24.226+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.573 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): handle_auth_done global_id 7814 payload 824 2024-09-12T18:51:24.573 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient: _finish_hunting 0 2024-09-12T18:51:24.573 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:51:24.226+0000 7f313af6e640 1 monclient: found mon.noname-c 2024-09-12T18:51:24.574 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:51:24.574 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:51:24.226+0000 7f313b76f640 10 monclient: get_auth_request con 0x562c698d3cd0 auth_method 0 2024-09-12T18:51:24.574 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.574 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:51:24.574 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: dump: 2024-09-12T18:51:24.574 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.574 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.574 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.575 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.575 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.575 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.575 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.575 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.575 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.575 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.575 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: _finish_auth 0 2024-09-12T18:51:24.576 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: _check_auth_tickets 2024-09-12T18:51:24.576 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:24.576 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.576 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:51:24.576 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: dump: 2024-09-12T18:51:24.576 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.576 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.576 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.577 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.577 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.577 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.577 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.577 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.577 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.577 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.577 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 monclient: authenticate success, global_id 7814 2024-09-12T18:51:24.577 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient: _renew_subs 2024-09-12T18:51:24.578 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:51:24.578 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:51:24.226+0000 7f313c771640 4 set_mon_vals no callback set 2024-09-12T18:51:24.578 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient: _renew_subs 2024-09-12T18:51:24.578 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:51:24.578 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:51:24.226+0000 7f3025602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:51:24.578 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:51:24.226+0000 7f3025602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:24.578 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:51:24.226+0000 7f3025602640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:24.579 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient: get_auth_request con 0x7f3014070a20 auth_method 0 2024-09-12T18:51:24.579 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: get_monmap_and_config 2024-09-12T18:51:24.579 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: build_initial_monmap 2024-09-12T18:51:24.579 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:51:24.230+0000 7f313dc699c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:24.579 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: monmap: 2024-09-12T18:51:24.579 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:24.579 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:24.579 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:24.579 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:24.580 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:24.580 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.580 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:24.580 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:24.580 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:24.580 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.580 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding auth protocol: cephx 2024-09-12T18:51:24.581 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding auth protocol: cephx 2024-09-12T18:51:24.581 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding auth protocol: cephx 2024-09-12T18:51:24.581 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: secure 2024-09-12T18:51:24.581 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: crc 2024-09-12T18:51:24.581 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: secure 2024-09-12T18:51:24.581 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: crc 2024-09-12T18:51:24.581 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: secure 2024-09-12T18:51:24.581 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: crc 2024-09-12T18:51:24.582 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: crc 2024-09-12T18:51:24.582 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: secure 2024-09-12T18:51:24.582 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: crc 2024-09-12T18:51:24.582 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: secure 2024-09-12T18:51:24.582 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: crc 2024-09-12T18:51:24.582 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: secure 2024-09-12T18:51:24.582 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:51:24.230+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.582 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: init 2024-09-12T18:51:24.583 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding auth protocol: cephx 2024-09-12T18:51:24.583 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding auth protocol: cephx 2024-09-12T18:51:24.583 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding auth protocol: cephx 2024-09-12T18:51:24.583 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: secure 2024-09-12T18:51:24.583 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: crc 2024-09-12T18:51:24.583 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: secure 2024-09-12T18:51:24.583 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: crc 2024-09-12T18:51:24.583 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: secure 2024-09-12T18:51:24.583 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: crc 2024-09-12T18:51:24.583 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: crc 2024-09-12T18:51:24.584 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: secure 2024-09-12T18:51:24.584 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: crc 2024-09-12T18:51:24.584 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: secure 2024-09-12T18:51:24.584 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: crc 2024-09-12T18:51:24.584 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: secure 2024-09-12T18:51:24.584 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:51:24.230+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.584 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:51:24.230+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.584 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command rotate-key cmddesc rotate-key hook 0x7fffa3fd9168 EEXIST 2024-09-12T18:51:24.584 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:24.585 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:51:24.585 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-b con 0x562c699296b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:24.585 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-a con 0x562c69929a90 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:24.585 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-c con 0x562c69923e50 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:24.585 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.585 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.585 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.585 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:24.585 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): authenticate will time out at 2471.373317s 2024-09-12T18:51:24.585 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): get_auth_request con 0x562c69929a90 auth_method 0 2024-09-12T18:51:24.585 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.585 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.585 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.586 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:51:24.230+0000 7f313b76f640 10 monclient(hunting): get_auth_request con 0x562c69923e50 auth_method 0 2024-09-12T18:51:24.586 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:51:24.230+0000 7f313b76f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.586 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:51:24.230+0000 7f313b76f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.586 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:51:24.230+0000 7f313b76f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.586 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.586 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.586 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.586 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:51:24.230+0000 7f313b76f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.586 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:51:24.230+0000 7f313b76f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.586 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:51:24.230+0000 7f313b76f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.586 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:51:24.230+0000 7f313af6e640 10 monclient(hunting): get_auth_request con 0x562c699296b0 auth_method 0 2024-09-12T18:51:24.586 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:51:24.230+0000 7f313af6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.587 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:51:24.230+0000 7f313af6e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.587 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:51:24.230+0000 7f313af6e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.587 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): handle_auth_done global_id 8367 payload 274 2024-09-12T18:51:24.587 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient: _finish_hunting 0 2024-09-12T18:51:24.587 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:51:24.230+0000 7f313bf70640 1 monclient: found mon.noname-a 2024-09-12T18:51:24.587 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.587 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.587 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:51:24.587 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: dump: 2024-09-12T18:51:24.587 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.587 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.587 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.587 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.587 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.588 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.588 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.588 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.588 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.588 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.588 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: _finish_auth 0 2024-09-12T18:51:24.588 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: _check_auth_tickets 2024-09-12T18:51:24.588 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:24.588 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.588 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:51:24.588 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: dump: 2024-09-12T18:51:24.588 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.589 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.589 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.589 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.589 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.589 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.589 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.589 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.589 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.589 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.589 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 monclient: authenticate success, global_id 8367 2024-09-12T18:51:24.590 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: get_monmap_and_config success 2024-09-12T18:51:24.590 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:51:24.230+0000 7f313dc699c0 4 set_mon_vals no callback set 2024-09-12T18:51:24.590 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: shutdown 2024-09-12T18:51:24.590 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: build_initial_monmap 2024-09-12T18:51:24.590 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:51:24.230+0000 7f313dc699c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:24.590 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: monmap: 2024-09-12T18:51:24.590 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:24.590 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:24.590 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:24.590 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:24.590 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:24.590 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.590 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:24.591 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:24.591 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:24.591 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.591 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding auth protocol: cephx 2024-09-12T18:51:24.591 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding auth protocol: cephx 2024-09-12T18:51:24.591 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding auth protocol: cephx 2024-09-12T18:51:24.591 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: secure 2024-09-12T18:51:24.591 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: crc 2024-09-12T18:51:24.591 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: secure 2024-09-12T18:51:24.591 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: crc 2024-09-12T18:51:24.591 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: secure 2024-09-12T18:51:24.591 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: crc 2024-09-12T18:51:24.591 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: crc 2024-09-12T18:51:24.592 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: secure 2024-09-12T18:51:24.592 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: crc 2024-09-12T18:51:24.592 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: secure 2024-09-12T18:51:24.592 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: crc 2024-09-12T18:51:24.592 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: secure 2024-09-12T18:51:24.592 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:51:24.230+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.592 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:51:24.230+0000 7f313dc699c0 1 librados: starting msgr at 2024-09-12T18:51:24.592 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:51:24.230+0000 7f313dc699c0 1 librados: starting objecter 2024-09-12T18:51:24.592 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562c69925810 EEXIST 2024-09-12T18:51:24.592 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:51:24.230+0000 7f313dc699c0 1 librados: setting wanted keys 2024-09-12T18:51:24.593 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:51:24.230+0000 7f313dc699c0 1 librados: calling monclient init 2024-09-12T18:51:24.593 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: init 2024-09-12T18:51:24.593 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding auth protocol: cephx 2024-09-12T18:51:24.593 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding auth protocol: cephx 2024-09-12T18:51:24.593 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding auth protocol: cephx 2024-09-12T18:51:24.593 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: secure 2024-09-12T18:51:24.594 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: crc 2024-09-12T18:51:24.594 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: secure 2024-09-12T18:51:24.594 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: crc 2024-09-12T18:51:24.594 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: secure 2024-09-12T18:51:24.594 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: crc 2024-09-12T18:51:24.594 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: crc 2024-09-12T18:51:24.594 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: secure 2024-09-12T18:51:24.595 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: crc 2024-09-12T18:51:24.595 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: secure 2024-09-12T18:51:24.595 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: crc 2024-09-12T18:51:24.595 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: secure 2024-09-12T18:51:24.595 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:51:24.230+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.595 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:51:24.230+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.595 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command rotate-key cmddesc rotate-key hook 0x562c698d7928 EEXIST 2024-09-12T18:51:24.596 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:24.596 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:51:24.596 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-c con 0x562c69923e50 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:24.596 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-a con 0x562c699296b0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:24.596 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-b con 0x562c69922f40 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:24.596 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.597 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.597 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.597 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:24.597 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): authenticate will time out at 2471.375891s 2024-09-12T18:51:24.597 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:51:24.230+0000 7f313af6e640 10 monclient(hunting): get_auth_request con 0x562c69923e50 auth_method 0 2024-09-12T18:51:24.598 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:51:24.234+0000 7f313af6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.598 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:51:24.234+0000 7f313af6e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.598 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:51:24.234+0000 7f313af6e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.598 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): get_auth_request con 0x562c699296b0 auth_method 0 2024-09-12T18:51:24.598 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.598 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.599 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.599 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:51:24.234+0000 7f313af6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.599 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:51:24.234+0000 7f313af6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.599 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:51:24.234+0000 7f313af6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.599 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.600 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.600 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.600 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): handle_auth_done global_id 8370 payload 824 2024-09-12T18:51:24.600 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient: _finish_hunting 0 2024-09-12T18:51:24.600 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:51:24.234+0000 7f313bf70640 1 monclient: found mon.noname-a 2024-09-12T18:51:24.601 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.601 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:51:24.234+0000 7f313b76f640 10 monclient: get_auth_request con 0x562c69922f40 auth_method 0 2024-09-12T18:51:24.601 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.601 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:51:24.601 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: dump: 2024-09-12T18:51:24.601 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.602 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.602 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.602 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.602 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.602 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.602 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.602 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.603 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.603 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.603 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: _finish_auth 0 2024-09-12T18:51:24.603 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: _check_auth_tickets 2024-09-12T18:51:24.603 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:24.603 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.603 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:51:24.603 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: dump: 2024-09-12T18:51:24.603 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.604 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.604 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.604 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.604 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.604 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.604 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.604 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.604 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.604 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.604 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:51:24.234+0000 7f313dc699c0 5 monclient: authenticate success, global_id 8370 2024-09-12T18:51:24.604 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:51:24.234+0000 7f301effd640 4 set_mon_vals no callback set 2024-09-12T18:51:24.605 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:51:24.234+0000 7f313dc699c0 10 monclient: _renew_subs 2024-09-12T18:51:24.605 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:51:24.234+0000 7f313dc699c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.605 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:51:24.234+0000 7f313dc699c0 10 monclient: _renew_subs 2024-09-12T18:51:24.605 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:51:24.234+0000 7f313dc699c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.605 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:51:24.234+0000 7f313dc699c0 1 librados: init done 2024-09-12T18:51:24.605 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:51:24.234+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command cr dump hook 0x562c699258a8 2024-09-12T18:51:24.605 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:51:24.234+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.605 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:51:24.234+0000 7f301d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:51:24.605 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:51:24.234+0000 7f301d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:24.605 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:51:24.234+0000 7f301d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:24.605 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:51:24.234+0000 7f313af6e640 10 monclient: get_auth_request con 0x7f3004070ae0 auth_method 0 2024-09-12T18:51:24.605 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:51:24.234+0000 7f313b76f640 10 monclient: get_auth_request con 0x562c69943370 auth_method 0 2024-09-12T18:51:24.605 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.606 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 realm 2024-09-12T18:51:24.606 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.606 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.606 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:51:24.238+0000 7f313dc699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:51:24.606 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.606 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.606 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.606 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:51:24.238+0000 7f313af6e640 10 monclient: get_auth_request con 0x562c69947590 auth_method 0 2024-09-12T18:51:24.606 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:24.606 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.606 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:51:24.238+0000 7f313bf70640 10 monclient: get_auth_request con 0x562c6994adf0 auth_method 0 2024-09-12T18:51:24.606 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:51:24.606 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 searching for the correct realm 2024-09-12T18:51:24.607 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:51:24.242+0000 7f313b76f640 10 monclient: get_auth_request con 0x7f3134020950 auth_method 0 2024-09-12T18:51:24.607 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:51:24.242+0000 7f313af6e640 10 monclient: get_auth_request con 0x7f312c0c8040 auth_method 0 2024-09-12T18:51:24.607 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:51:24.242+0000 7f313bf70640 10 monclient: get_auth_request con 0x7f3130083b70 auth_method 0 2024-09-12T18:51:24.607 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:51:24.246+0000 7f313bf70640 0 -- 172.21.15.111:0/3663818594 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f3130083b70 msgr2=0x7f31300615f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:24.607 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:51:24.246+0000 7f301d7fa640 1 client.8370.objecter ms_handle_reset 0x7f3130083b70 session 0x7f3130062920 osd.4 2024-09-12T18:51:24.607 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:51:24.246+0000 7f301d7fa640 10 monclient: _renew_subs 2024-09-12T18:51:24.607 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:51:24.246+0000 7f301d7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.607 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:51:24.246+0000 7f313bf70640 10 monclient: get_auth_request con 0x7f3004080a00 auth_method 0 2024-09-12T18:51:24.607 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:51:24.246+0000 7f313b76f640 10 monclient: get_auth_request con 0x7f3134092b80 auth_method 0 2024-09-12T18:51:24.607 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:51:24.250+0000 7f313af6e640 10 monclient: get_auth_request con 0x7f313408e940 auth_method 0 2024-09-12T18:51:24.607 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:51:24.250+0000 7f313af6e640 0 -- 172.21.15.111:0/3663818594 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f313408e940 msgr2=0x7f31340a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:51:24.607 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:51:24.454+0000 7f313af6e640 10 monclient: get_auth_request con 0x7f313408e940 auth_method 0 2024-09-12T18:51:24.607 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:51:24.608 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:51:24.608 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:51:24.608 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:51:24.608 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:51:24.608 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:51:24.608 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.608 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.608 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.608 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:24.608 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.608 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:51:24.608 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 zone default found 2024-09-12T18:51:24.608 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:51:24.470+0000 7f313dc699c0 4 Realm: () 2024-09-12T18:51:24.609 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:51:24.470+0000 7f313dc699c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:51:24.609 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:51:24.470+0000 7f313dc699c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:51:24.609 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:51:24.470+0000 7f313dc699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:51:24.609 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 zonegroup default 2024-09-12T18:51:24.609 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.609 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.609 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.609 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.609 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.609 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.609 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 started sync module instance, tier type = 2024-09-12T18:51:24.610 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:51:24.610 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=0 2024-09-12T18:51:24.610 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=1 2024-09-12T18:51:24.610 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=2 2024-09-12T18:51:24.610 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=3 2024-09-12T18:51:24.610 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=4 2024-09-12T18:51:24.610 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=5 2024-09-12T18:51:24.610 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=6 2024-09-12T18:51:24.610 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=7 2024-09-12T18:51:24.611 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:51:24.494+0000 7f313dc699c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:51:24.611 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding auth protocol: cephx 2024-09-12T18:51:24.611 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding auth protocol: cephx 2024-09-12T18:51:24.611 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding auth protocol: cephx 2024-09-12T18:51:24.611 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: secure 2024-09-12T18:51:24.611 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: crc 2024-09-12T18:51:24.611 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: secure 2024-09-12T18:51:24.611 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: crc 2024-09-12T18:51:24.611 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: secure 2024-09-12T18:51:24.611 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:51:24.498+0000 7f2ff1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:51:24.611 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: crc 2024-09-12T18:51:24.611 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: crc 2024-09-12T18:51:24.611 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: secure 2024-09-12T18:51:24.612 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: crc 2024-09-12T18:51:24.612 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: secure 2024-09-12T18:51:24.612 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: crc 2024-09-12T18:51:24.612 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: secure 2024-09-12T18:51:24.612 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:51:24.498+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.612 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:51:24.498+0000 7f313dc699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:51:24.612 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:51:24.498+0000 7f313dc699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:51:24.612 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command cache list hook 0x562c69922ce0 2024-09-12T18:51:24.612 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command cache inspect hook 0x562c69922ce0 2024-09-12T18:51:24.612 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command cache erase hook 0x562c69922ce0 2024-09-12T18:51:24.612 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command cache zap hook 0x562c69922ce0 2024-09-12T18:51:24.613 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 note: GC not initialized 2024-09-12T18:51:24.613 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:51:24.502+0000 7f2ff0fe1640 20 reqs_thread_entry: start 2024-09-12T18:51:24.613 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:51:24.502+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command sync trace show hook 0x7f3134004550 2024-09-12T18:51:24.613 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:51:24.502+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command sync trace history hook 0x7f3134004550 2024-09-12T18:51:24.613 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:51:24.502+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command sync trace active hook 0x7f3134004550 2024-09-12T18:51:24.613 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:51:24.502+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command sync trace active_short hook 0x7f3134004550 2024-09-12T18:51:24.613 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:51:24.502+0000 7f313dc699c0 20 init_complete bucket index max shards: 11 2024-09-12T18:51:24.613 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:51:24.502+0000 7f313dc699c0 20 Filter name: none 2024-09-12T18:51:24.613 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:51:24.502+0000 7f2f6a7fc640 20 reqs_thread_entry: start 2024-09-12T18:51:24.613 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:51:24.613 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:51:24.502+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.613 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:51:24.502+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:51:24.613 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:51:24.614 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:51:24.614 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:51:24.614 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:51:24.502+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.614 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:51:24.502+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:51:24.614 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:24.614 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:24.614 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:51:24.614 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:24.614 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:51:24.614 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:51:24.506+0000 7f313dc699c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:51:24.614 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:51:24.518+0000 7f313dc699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:24.614 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:51:24.518+0000 7f313dc699c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:24.615 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:51:24.518+0000 7f313dc699c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:24.615 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:51:24.518+0000 7f313dc699c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:51:24.615 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:51:24.522+0000 7f301effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431689 cookie 94748749945440 notifier 8370 bl.length()=827 2024-09-12T18:51:24.615 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:51:24.522+0000 7f301effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:24.615 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:51:24.522+0000 7f301effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:24.615 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:51:24.522+0000 7f301effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:24.615 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:51:24.522+0000 7f313dc699c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:51:24.615 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:51:24.522+0000 7f313dc699c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:51:24.615 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:51:24.522+0000 7f313dc699c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:51:24.615 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:51:24.522+0000 7f313dc699c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:51:24.615 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:51:24.530+0000 7f313dc699c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f313dc699c0 time 2024-09-12T18:51:24.531648+0000 2024-09-12T18:51:24.615 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:51:24.616 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.616 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:24.616 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f31415432eb] 2024-09-12T18:51:24.616 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f314154349f] 2024-09-12T18:51:24.616 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c66fcecc1] 2024-09-12T18:51:24.616 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422aac) [0x562c67a2caac] 2024-09-12T18:51:24.616 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c66fe3ced] 2024-09-12T18:51:24.616 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:51:24.616 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f31403a9d90] 2024-09-12T18:51:24.616 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:51:24.616 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:51:24.616 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.616 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:51:24.530+0000 7f313dc699c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:51:24.617 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f313dc699c0 thread_name:radosgw-admin 2024-09-12T18:51:24.617 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.617 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:24.617 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f31403c2520] 2024-09-12T18:51:24.617 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:51:24.617 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:51:24.617 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:51:24.617 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3141543345] 2024-09-12T18:51:24.617 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f314154349f] 2024-09-12T18:51:24.617 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c66fcecc1] 2024-09-12T18:51:24.617 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422aac) [0x562c67a2caac] 2024-09-12T18:51:24.617 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c66fe3ced] 2024-09-12T18:51:24.617 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:51:24.618 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f31403a9d90] 2024-09-12T18:51:24.618 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:51:24.618 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:51:24.618 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:51:24.618 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.618 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:51:24.618 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:51:24.618 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:51:24.618 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:51:24.618 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:51:24.618 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:51:24.618 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:51:24.618 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:51:24.619 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:51:24.619 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:51:24.619 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:51:24.619 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:51:24.619 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:51:24.619 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:51:24.619 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:51:24.619 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:51:24.619 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:51:24.619 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:51:24.619 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:51:24.619 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:51:24.619 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:51:24.619 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:51:24.620 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:51:24.620 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:51:24.620 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:51:24.620 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:51:24.620 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:51:24.620 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:51:24.620 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:51:24.620 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:51:24.620 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:51:24.620 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:51:24.620 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:51:24.620 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:51:24.620 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:51:24.621 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:51:24.621 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:51:24.621 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:51:24.621 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:51:24.621 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:51:24.621 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:51:24.621 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:51:24.621 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:51:24.621 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:51:24.621 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:51:24.621 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:51:24.621 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:51:24.621 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:51:24.621 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:51:24.622 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:51:24.622 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:51:24.622 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:51:24.622 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:51:24.622 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:51:24.622 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:51:24.622 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:51:24.622 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:51:24.622 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:51:24.622 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:51:24.622 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:51:24.622 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:51:24.622 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:51:24.623 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:51:24.623 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:51:24.623 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:51:24.623 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:51:24.623 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:51:24.623 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:51:24.623 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:51:24.623 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:51:24.623 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:51:24.623 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:51:24.623 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:51:24.623 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:51:24.623 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:51:24.623 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:51:24.624 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:51:24.624 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:51:24.624 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:51:24.624 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:51:24.624 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:51:24.624 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:51:24.624 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:51:24.624 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:51:24.624 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:51:24.624 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:51:24.624 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:51:24.624 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:51:24.625 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:51:24.625 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:51:24.625 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:51:24.625 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:51:24.625 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:51:24.625 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:51:24.625 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2f6a7fc640 / http_manager 2024-09-12T18:51:24.625 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2ff0fe1640 / http_manager 2024-09-12T18:51:24.625 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2ff1fe3640 / rgw_dt_lg_renew 2024-09-12T18:51:24.625 INFO:tasks.workunit.client.0.smithi111.stderr: 7f301d7fa640 / ms_dispatch 2024-09-12T18:51:24.625 INFO:tasks.workunit.client.0.smithi111.stderr: 7f301effd640 / io_context_pool 2024-09-12T18:51:24.625 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3025602640 / ms_dispatch 2024-09-12T18:51:24.625 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3027e07640 / ms_dispatch 2024-09-12T18:51:24.626 INFO:tasks.workunit.client.0.smithi111.stderr: 7f302960a640 / io_context_pool 2024-09-12T18:51:24.626 INFO:tasks.workunit.client.0.smithi111.stderr: 7f313af6e640 / msgr-worker-2 2024-09-12T18:51:24.626 INFO:tasks.workunit.client.0.smithi111.stderr: 7f313b76f640 / msgr-worker-1 2024-09-12T18:51:24.626 INFO:tasks.workunit.client.0.smithi111.stderr: 7f313bf70640 / msgr-worker-0 2024-09-12T18:51:24.626 INFO:tasks.workunit.client.0.smithi111.stderr: 7f313c771640 / io_context_pool 2024-09-12T18:51:24.626 INFO:tasks.workunit.client.0.smithi111.stderr: 7f313dc699c0 / radosgw-admin 2024-09-12T18:51:24.626 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:51:24.626 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:51:24.626 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/log/ceph/ceph-client.admin.145517.log 2024-09-12T18:51:24.626 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:51:24.626 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:51:24.626 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:51:24.210+0000 7f313b76f640 1 monclient: found mon.noname-a 2024-09-12T18:51:24.626 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:51:24.210+0000 7f313b76f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.627 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:51:24.210+0000 7f313af6e640 10 monclient: get_auth_request con 0x562c69715b90 auth_method 0 2024-09-12T18:51:24.627 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.627 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:51:24.627 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: dump: 2024-09-12T18:51:24.627 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.627 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.627 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.627 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.627 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.627 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.627 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.627 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.628 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.628 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.628 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: _finish_auth 0 2024-09-12T18:51:24.628 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: _check_auth_tickets 2024-09-12T18:51:24.628 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 monclient: authenticate success, global_id 8358 2024-09-12T18:51:24.628 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:24.628 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: get_monmap_and_config success 2024-09-12T18:51:24.628 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.628 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:51:24.214+0000 7f313dc699c0 4 set_mon_vals no callback set 2024-09-12T18:51:24.628 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:51:24.628 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:51:24.214+0000 7f302960a640 10 monclient: dump: 2024-09-12T18:51:24.628 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.629 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.629 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.629 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.629 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.629 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.629 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.629 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.629 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.629 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.629 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: shutdown 2024-09-12T18:51:24.629 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 asok(0x562c6964a2b0) unregister_commands rotate-key 2024-09-12T18:51:24.629 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: build_initial_monmap 2024-09-12T18:51:24.629 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:51:24.214+0000 7f313dc699c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:24.630 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: monmap: 2024-09-12T18:51:24.630 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:24.630 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:24.630 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:24.630 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:24.630 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:24.630 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.630 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:24.630 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:24.630 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:24.630 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.630 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding auth protocol: cephx 2024-09-12T18:51:24.630 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding auth protocol: cephx 2024-09-12T18:51:24.631 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding auth protocol: cephx 2024-09-12T18:51:24.631 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: secure 2024-09-12T18:51:24.631 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: crc 2024-09-12T18:51:24.631 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: secure 2024-09-12T18:51:24.631 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: crc 2024-09-12T18:51:24.631 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: secure 2024-09-12T18:51:24.631 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: crc 2024-09-12T18:51:24.631 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: crc 2024-09-12T18:51:24.631 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: secure 2024-09-12T18:51:24.631 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: crc 2024-09-12T18:51:24.631 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: secure 2024-09-12T18:51:24.631 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: crc 2024-09-12T18:51:24.631 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c6985a480) adding con mode: secure 2024-09-12T18:51:24.632 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:51:24.214+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.632 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:51:24.214+0000 7f313dc699c0 1 librados: starting msgr at 2024-09-12T18:51:24.632 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:51:24.214+0000 7f313dc699c0 1 librados: starting objecter 2024-09-12T18:51:24.632 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command objecter_requests hook 0x562c696072f0 2024-09-12T18:51:24.632 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:51:24.214+0000 7f313dc699c0 1 librados: setting wanted keys 2024-09-12T18:51:24.632 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:51:24.214+0000 7f313dc699c0 1 librados: calling monclient init 2024-09-12T18:51:24.632 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: init 2024-09-12T18:51:24.632 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding auth protocol: cephx 2024-09-12T18:51:24.632 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding auth protocol: cephx 2024-09-12T18:51:24.632 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding auth protocol: cephx 2024-09-12T18:51:24.632 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: secure 2024-09-12T18:51:24.632 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: crc 2024-09-12T18:51:24.632 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: secure 2024-09-12T18:51:24.633 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: crc 2024-09-12T18:51:24.633 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: secure 2024-09-12T18:51:24.633 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: crc 2024-09-12T18:51:24.633 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: crc 2024-09-12T18:51:24.633 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: secure 2024-09-12T18:51:24.633 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: crc 2024-09-12T18:51:24.633 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: secure 2024-09-12T18:51:24.633 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: crc 2024-09-12T18:51:24.633 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 AuthRegistry(0x562c69857370) adding con mode: secure 2024-09-12T18:51:24.633 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:51:24.214+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.633 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:51:24.214+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.633 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command rotate-key hook 0x562c698574b8 2024-09-12T18:51:24.633 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:24.634 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:51:24.634 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-c con 0x562c69712430 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:24.634 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-b con 0x562c69715b90 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:24.634 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-a con 0x562c6979c940 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:24.634 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.634 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.634 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.634 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:24.634 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient(hunting): authenticate will time out at 2471.358379s 2024-09-12T18:51:24.634 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): get_auth_request con 0x562c6979c940 auth_method 0 2024-09-12T18:51:24.634 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.634 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.634 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.635 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:51:24.214+0000 7f313b76f640 10 monclient(hunting): get_auth_request con 0x562c69712430 auth_method 0 2024-09-12T18:51:24.635 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:51:24.214+0000 7f313b76f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.635 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:51:24.214+0000 7f313b76f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.635 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:51:24.214+0000 7f313b76f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.635 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.635 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.635 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.635 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:51:24.214+0000 7f313b76f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.635 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:51:24.214+0000 7f313b76f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.635 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:51:24.214+0000 7f313b76f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.635 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient(hunting): handle_auth_done global_id 8361 payload 824 2024-09-12T18:51:24.635 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient: _finish_hunting 0 2024-09-12T18:51:24.635 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:51:24.214+0000 7f313bf70640 1 monclient: found mon.noname-a 2024-09-12T18:51:24.635 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:51:24.214+0000 7f313bf70640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.636 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:51:24.214+0000 7f313af6e640 10 monclient: get_auth_request con 0x562c69715b90 auth_method 0 2024-09-12T18:51:24.636 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.636 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:51:24.636 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: dump: 2024-09-12T18:51:24.636 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.636 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.636 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.636 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.636 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.636 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.636 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.636 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.636 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.637 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.637 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: _finish_auth 0 2024-09-12T18:51:24.637 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: _check_auth_tickets 2024-09-12T18:51:24.637 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:24.637 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.637 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:51:24.637 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:51:24.214+0000 7f3027e07640 10 monclient: dump: 2024-09-12T18:51:24.637 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.637 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.637 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.637 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.637 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.637 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.638 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.638 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.638 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.638 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.638 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:51:24.214+0000 7f313dc699c0 5 monclient: authenticate success, global_id 8361 2024-09-12T18:51:24.638 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:51:24.214+0000 7f302960a640 4 set_mon_vals no callback set 2024-09-12T18:51:24.638 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: _renew_subs 2024-09-12T18:51:24.638 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.638 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: _renew_subs 2024-09-12T18:51:24.638 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:51:24.214+0000 7f313dc699c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.638 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:51:24.214+0000 7f313dc699c0 1 librados: init done 2024-09-12T18:51:24.638 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:51:24.218+0000 7f3027e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:51:24.638 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:51:24.218+0000 7f3027e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:24.639 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:51:24.218+0000 7f3027e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:24.639 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:51:24.218+0000 7f313b76f640 10 monclient: get_auth_request con 0x7f3020070ae0 auth_method 0 2024-09-12T18:51:24.639 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:51:24.218+0000 7f313af6e640 10 monclient: get_auth_request con 0x562c698809c0 auth_method 0 2024-09-12T18:51:24.639 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:51:24.218+0000 7f313b76f640 10 monclient: get_auth_request con 0x562c698a1720 auth_method 0 2024-09-12T18:51:24.639 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:51:24.222+0000 7f313af6e640 10 monclient: get_auth_request con 0x562c698a5c50 auth_method 0 2024-09-12T18:51:24.639 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:51:24.222+0000 7f313bf70640 10 monclient: get_auth_request con 0x562c698a4f80 auth_method 0 2024-09-12T18:51:24.639 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:51:24.222+0000 7f313dc699c0 10 monclient: build_initial_monmap 2024-09-12T18:51:24.639 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:51:24.222+0000 7f313dc699c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:24.639 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:51:24.222+0000 7f313dc699c0 10 monclient: monmap: 2024-09-12T18:51:24.639 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:24.639 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:24.639 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:24.639 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:24.640 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:24.640 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.640 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:24.640 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:24.640 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:24.640 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.640 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding auth protocol: cephx 2024-09-12T18:51:24.640 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding auth protocol: cephx 2024-09-12T18:51:24.640 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding auth protocol: cephx 2024-09-12T18:51:24.640 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: secure 2024-09-12T18:51:24.640 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: crc 2024-09-12T18:51:24.640 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: secure 2024-09-12T18:51:24.640 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: crc 2024-09-12T18:51:24.641 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: secure 2024-09-12T18:51:24.641 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: crc 2024-09-12T18:51:24.641 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: crc 2024-09-12T18:51:24.641 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: secure 2024-09-12T18:51:24.641 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: crc 2024-09-12T18:51:24.641 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: secure 2024-09-12T18:51:24.641 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: crc 2024-09-12T18:51:24.641 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 AuthRegistry(0x562c698adde0) adding con mode: secure 2024-09-12T18:51:24.641 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:51:24.222+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.641 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:51:24.222+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562c698b1810 EEXIST 2024-09-12T18:51:24.641 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient: init 2024-09-12T18:51:24.641 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding auth protocol: cephx 2024-09-12T18:51:24.642 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding auth protocol: cephx 2024-09-12T18:51:24.642 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding auth protocol: cephx 2024-09-12T18:51:24.642 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: secure 2024-09-12T18:51:24.642 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: crc 2024-09-12T18:51:24.642 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: secure 2024-09-12T18:51:24.642 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: crc 2024-09-12T18:51:24.642 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: secure 2024-09-12T18:51:24.642 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: crc 2024-09-12T18:51:24.642 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: crc 2024-09-12T18:51:24.642 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: secure 2024-09-12T18:51:24.642 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: crc 2024-09-12T18:51:24.642 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: secure 2024-09-12T18:51:24.642 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: crc 2024-09-12T18:51:24.643 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 AuthRegistry(0x562c698accd8) adding con mode: secure 2024-09-12T18:51:24.643 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:51:24.226+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.643 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:51:24.226+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.643 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command rotate-key cmddesc rotate-key hook 0x562c698ace20 EEXIST 2024-09-12T18:51:24.643 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:24.643 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:51:24.643 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-c con 0x562c698d59c0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:24.643 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-a con 0x562c698d52f0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:24.643 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-b con 0x562c698d3cd0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:24.643 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.643 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.643 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.643 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:24.644 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient(hunting): authenticate will time out at 2471.368624s 2024-09-12T18:51:24.644 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): get_auth_request con 0x562c698d59c0 auth_method 0 2024-09-12T18:51:24.644 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.644 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.644 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.644 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:51:24.226+0000 7f313bf70640 10 monclient(hunting): get_auth_request con 0x562c698d52f0 auth_method 0 2024-09-12T18:51:24.644 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:51:24.226+0000 7f313bf70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.644 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:51:24.226+0000 7f313bf70640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.644 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:51:24.226+0000 7f313bf70640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.644 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.644 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.644 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.644 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:51:24.226+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.645 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:51:24.226+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.645 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:51:24.226+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.645 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient(hunting): handle_auth_done global_id 7814 payload 824 2024-09-12T18:51:24.645 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient: _finish_hunting 0 2024-09-12T18:51:24.645 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:51:24.226+0000 7f313af6e640 1 monclient: found mon.noname-c 2024-09-12T18:51:24.645 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:51:24.226+0000 7f313af6e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:51:24.645 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:51:24.226+0000 7f313b76f640 10 monclient: get_auth_request con 0x562c698d3cd0 auth_method 0 2024-09-12T18:51:24.645 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.645 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:51:24.645 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: dump: 2024-09-12T18:51:24.645 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.645 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.645 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.645 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.646 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.646 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.646 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.646 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.646 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.646 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.646 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: _finish_auth 0 2024-09-12T18:51:24.646 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: _check_auth_tickets 2024-09-12T18:51:24.646 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:24.646 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.646 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:51:24.646 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:51:24.226+0000 7f3025602640 10 monclient: dump: 2024-09-12T18:51:24.646 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.647 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.647 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.647 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.647 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.647 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.647 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.647 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.647 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.647 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.647 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:51:24.226+0000 7f313dc699c0 5 monclient: authenticate success, global_id 7814 2024-09-12T18:51:24.647 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient: _renew_subs 2024-09-12T18:51:24.647 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:51:24.647 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:51:24.226+0000 7f313c771640 4 set_mon_vals no callback set 2024-09-12T18:51:24.648 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient: _renew_subs 2024-09-12T18:51:24.648 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:51:24.226+0000 7f313dc699c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:51:24.648 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:51:24.226+0000 7f3025602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:51:24.648 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:51:24.226+0000 7f3025602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:24.648 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:51:24.226+0000 7f3025602640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:24.648 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient: get_auth_request con 0x7f3014070a20 auth_method 0 2024-09-12T18:51:24.648 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: get_monmap_and_config 2024-09-12T18:51:24.648 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: build_initial_monmap 2024-09-12T18:51:24.648 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:51:24.230+0000 7f313dc699c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:24.648 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: monmap: 2024-09-12T18:51:24.649 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:24.649 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:24.649 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:24.649 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:24.649 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:24.649 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.649 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:24.649 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:24.649 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:24.649 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.649 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding auth protocol: cephx 2024-09-12T18:51:24.649 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding auth protocol: cephx 2024-09-12T18:51:24.649 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding auth protocol: cephx 2024-09-12T18:51:24.650 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: secure 2024-09-12T18:51:24.650 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: crc 2024-09-12T18:51:24.650 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: secure 2024-09-12T18:51:24.650 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: crc 2024-09-12T18:51:24.650 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: secure 2024-09-12T18:51:24.650 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: crc 2024-09-12T18:51:24.650 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: crc 2024-09-12T18:51:24.650 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: secure 2024-09-12T18:51:24.650 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: crc 2024-09-12T18:51:24.650 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: secure 2024-09-12T18:51:24.650 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: crc 2024-09-12T18:51:24.650 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698f53f0) adding con mode: secure 2024-09-12T18:51:24.651 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:51:24.230+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.651 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: init 2024-09-12T18:51:24.651 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding auth protocol: cephx 2024-09-12T18:51:24.651 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding auth protocol: cephx 2024-09-12T18:51:24.651 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding auth protocol: cephx 2024-09-12T18:51:24.651 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: secure 2024-09-12T18:51:24.651 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: crc 2024-09-12T18:51:24.651 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: secure 2024-09-12T18:51:24.651 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: crc 2024-09-12T18:51:24.651 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: secure 2024-09-12T18:51:24.651 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: crc 2024-09-12T18:51:24.651 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: crc 2024-09-12T18:51:24.651 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: secure 2024-09-12T18:51:24.652 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: crc 2024-09-12T18:51:24.652 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: secure 2024-09-12T18:51:24.652 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: crc 2024-09-12T18:51:24.652 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9020) adding con mode: secure 2024-09-12T18:51:24.652 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:51:24.230+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.652 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:51:24.230+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.652 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command rotate-key cmddesc rotate-key hook 0x7fffa3fd9168 EEXIST 2024-09-12T18:51:24.652 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:24.652 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T18:51:24.652 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-b con 0x562c699296b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:24.652 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-a con 0x562c69929a90 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:24.652 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-c con 0x562c69923e50 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:24.652 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.653 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.653 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.653 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:24.653 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): authenticate will time out at 2471.373317s 2024-09-12T18:51:24.653 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): get_auth_request con 0x562c69929a90 auth_method 0 2024-09-12T18:51:24.653 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.653 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.653 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.653 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:51:24.230+0000 7f313b76f640 10 monclient(hunting): get_auth_request con 0x562c69923e50 auth_method 0 2024-09-12T18:51:24.653 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:51:24.230+0000 7f313b76f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.653 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:51:24.230+0000 7f313b76f640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.653 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:51:24.230+0000 7f313b76f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.653 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.654 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.654 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.654 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:51:24.230+0000 7f313b76f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.654 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:51:24.230+0000 7f313b76f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.654 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:51:24.230+0000 7f313b76f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.654 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:51:24.230+0000 7f313af6e640 10 monclient(hunting): get_auth_request con 0x562c699296b0 auth_method 0 2024-09-12T18:51:24.654 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:51:24.230+0000 7f313af6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.654 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:51:24.230+0000 7f313af6e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.654 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:51:24.230+0000 7f313af6e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.654 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient(hunting): handle_auth_done global_id 8367 payload 274 2024-09-12T18:51:24.654 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient: _finish_hunting 0 2024-09-12T18:51:24.654 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:51:24.230+0000 7f313bf70640 1 monclient: found mon.noname-a 2024-09-12T18:51:24.654 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:51:24.230+0000 7f313bf70640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.655 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.655 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:51:24.655 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: dump: 2024-09-12T18:51:24.655 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.655 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.655 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.655 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.655 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.655 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.655 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.655 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.655 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.655 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.656 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: _finish_auth 0 2024-09-12T18:51:24.656 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: _check_auth_tickets 2024-09-12T18:51:24.656 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:24.656 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.656 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:51:24.656 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:51:24.230+0000 7f301effd640 10 monclient: dump: 2024-09-12T18:51:24.656 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.656 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.656 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.656 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.656 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.656 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.656 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.657 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.657 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.657 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.657 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 monclient: authenticate success, global_id 8367 2024-09-12T18:51:24.657 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: get_monmap_and_config success 2024-09-12T18:51:24.657 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:51:24.230+0000 7f313dc699c0 4 set_mon_vals no callback set 2024-09-12T18:51:24.657 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: shutdown 2024-09-12T18:51:24.657 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: build_initial_monmap 2024-09-12T18:51:24.657 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:51:24.230+0000 7f313dc699c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:24.657 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: monmap: 2024-09-12T18:51:24.657 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:24.657 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:24.657 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:24.658 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:24.658 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:24.658 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.658 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:24.658 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:24.658 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:24.658 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.658 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding auth protocol: cephx 2024-09-12T18:51:24.658 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding auth protocol: cephx 2024-09-12T18:51:24.658 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding auth protocol: cephx 2024-09-12T18:51:24.658 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: secure 2024-09-12T18:51:24.658 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: crc 2024-09-12T18:51:24.658 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: secure 2024-09-12T18:51:24.659 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: crc 2024-09-12T18:51:24.659 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: secure 2024-09-12T18:51:24.659 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: crc 2024-09-12T18:51:24.659 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: crc 2024-09-12T18:51:24.659 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: secure 2024-09-12T18:51:24.659 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: crc 2024-09-12T18:51:24.659 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: secure 2024-09-12T18:51:24.659 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: crc 2024-09-12T18:51:24.659 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c69925ab0) adding con mode: secure 2024-09-12T18:51:24.659 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:51:24.230+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.659 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:51:24.230+0000 7f313dc699c0 1 librados: starting msgr at 2024-09-12T18:51:24.659 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:51:24.230+0000 7f313dc699c0 1 librados: starting objecter 2024-09-12T18:51:24.659 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command objecter_requests cmddesc objecter_requests hook 0x562c69925810 EEXIST 2024-09-12T18:51:24.660 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:51:24.230+0000 7f313dc699c0 1 librados: setting wanted keys 2024-09-12T18:51:24.660 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:51:24.230+0000 7f313dc699c0 1 librados: calling monclient init 2024-09-12T18:51:24.660 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: init 2024-09-12T18:51:24.660 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding auth protocol: cephx 2024-09-12T18:51:24.660 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding auth protocol: cephx 2024-09-12T18:51:24.660 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding auth protocol: cephx 2024-09-12T18:51:24.660 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: secure 2024-09-12T18:51:24.660 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: crc 2024-09-12T18:51:24.660 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: secure 2024-09-12T18:51:24.660 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: crc 2024-09-12T18:51:24.660 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: secure 2024-09-12T18:51:24.660 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: crc 2024-09-12T18:51:24.660 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: crc 2024-09-12T18:51:24.661 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: secure 2024-09-12T18:51:24.661 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: crc 2024-09-12T18:51:24.661 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: secure 2024-09-12T18:51:24.661 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: crc 2024-09-12T18:51:24.661 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 AuthRegistry(0x562c698d77e0) adding con mode: secure 2024-09-12T18:51:24.661 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:51:24.230+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.661 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:51:24.230+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.661 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:51:24.230+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command rotate-key cmddesc rotate-key hook 0x562c698d7928 EEXIST 2024-09-12T18:51:24.661 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:24.661 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:51:24.661 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-c con 0x562c69923e50 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:24.661 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-a con 0x562c699296b0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:24.661 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): picked mon.noname-b con 0x562c69922f40 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:24.662 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.662 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.662 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:24.662 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:24.662 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:51:24.230+0000 7f313dc699c0 10 monclient(hunting): authenticate will time out at 2471.375891s 2024-09-12T18:51:24.662 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:51:24.230+0000 7f313af6e640 10 monclient(hunting): get_auth_request con 0x562c69923e50 auth_method 0 2024-09-12T18:51:24.662 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:51:24.234+0000 7f313af6e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.662 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:51:24.234+0000 7f313af6e640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.662 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:51:24.234+0000 7f313af6e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.662 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): get_auth_request con 0x562c699296b0 auth_method 0 2024-09-12T18:51:24.662 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:24.662 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:24.662 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:24.663 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:51:24.234+0000 7f313af6e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.663 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:51:24.234+0000 7f313af6e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.663 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:51:24.234+0000 7f313af6e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.663 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:24.663 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:24.663 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:24.663 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient(hunting): handle_auth_done global_id 8370 payload 824 2024-09-12T18:51:24.663 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient: _finish_hunting 0 2024-09-12T18:51:24.663 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:51:24.234+0000 7f313bf70640 1 monclient: found mon.noname-a 2024-09-12T18:51:24.663 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:51:24.234+0000 7f313bf70640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.663 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:51:24.234+0000 7f313b76f640 10 monclient: get_auth_request con 0x562c69922f40 auth_method 0 2024-09-12T18:51:24.663 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.663 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:51:24.664 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: dump: 2024-09-12T18:51:24.664 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.664 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.664 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.664 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.664 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.664 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.664 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.664 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.664 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.664 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.664 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: _finish_auth 0 2024-09-12T18:51:24.665 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: _check_auth_tickets 2024-09-12T18:51:24.665 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:24.665 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:24.665 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:51:24.665 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:51:24.234+0000 7f301d7fa640 10 monclient: dump: 2024-09-12T18:51:24.665 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:24.665 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:24.665 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.665 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:24.665 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:24.665 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:24.665 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:24.665 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:24.666 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:24.666 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.666 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:51:24.234+0000 7f313dc699c0 5 monclient: authenticate success, global_id 8370 2024-09-12T18:51:24.666 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:51:24.234+0000 7f301effd640 4 set_mon_vals no callback set 2024-09-12T18:51:24.666 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:51:24.234+0000 7f313dc699c0 10 monclient: _renew_subs 2024-09-12T18:51:24.666 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:51:24.234+0000 7f313dc699c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.666 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:51:24.234+0000 7f313dc699c0 10 monclient: _renew_subs 2024-09-12T18:51:24.666 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:51:24.234+0000 7f313dc699c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.666 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:51:24.234+0000 7f313dc699c0 1 librados: init done 2024-09-12T18:51:24.666 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:51:24.234+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command cr dump hook 0x562c699258a8 2024-09-12T18:51:24.666 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:51:24.234+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.666 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:51:24.234+0000 7f301d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:51:24.666 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:51:24.234+0000 7f301d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:24.667 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:51:24.234+0000 7f301d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:24.667 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:51:24.234+0000 7f313af6e640 10 monclient: get_auth_request con 0x7f3004070ae0 auth_method 0 2024-09-12T18:51:24.667 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:51:24.234+0000 7f313b76f640 10 monclient: get_auth_request con 0x562c69943370 auth_method 0 2024-09-12T18:51:24.667 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.667 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 realm 2024-09-12T18:51:24.667 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.667 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.667 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:51:24.238+0000 7f313dc699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:51:24.667 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.667 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.667 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.667 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:51:24.238+0000 7f313af6e640 10 monclient: get_auth_request con 0x562c69947590 auth_method 0 2024-09-12T18:51:24.667 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:24.667 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.668 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:51:24.238+0000 7f313bf70640 10 monclient: get_auth_request con 0x562c6994adf0 auth_method 0 2024-09-12T18:51:24.668 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:51:24.668 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:51:24.238+0000 7f313dc699c0 20 searching for the correct realm 2024-09-12T18:51:24.668 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:51:24.242+0000 7f313b76f640 10 monclient: get_auth_request con 0x7f3134020950 auth_method 0 2024-09-12T18:51:24.668 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:51:24.242+0000 7f313af6e640 10 monclient: get_auth_request con 0x7f312c0c8040 auth_method 0 2024-09-12T18:51:24.668 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:51:24.242+0000 7f313bf70640 10 monclient: get_auth_request con 0x7f3130083b70 auth_method 0 2024-09-12T18:51:24.668 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:51:24.246+0000 7f313bf70640 0 -- 172.21.15.111:0/3663818594 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f3130083b70 msgr2=0x7f31300615f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:24.668 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:51:24.246+0000 7f301d7fa640 1 client.8370.objecter ms_handle_reset 0x7f3130083b70 session 0x7f3130062920 osd.4 2024-09-12T18:51:24.668 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:51:24.246+0000 7f301d7fa640 10 monclient: _renew_subs 2024-09-12T18:51:24.668 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:51:24.246+0000 7f301d7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:24.668 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:51:24.246+0000 7f313bf70640 10 monclient: get_auth_request con 0x7f3004080a00 auth_method 0 2024-09-12T18:51:24.668 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:51:24.246+0000 7f313b76f640 10 monclient: get_auth_request con 0x7f3134092b80 auth_method 0 2024-09-12T18:51:24.668 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:51:24.250+0000 7f313af6e640 10 monclient: get_auth_request con 0x7f313408e940 auth_method 0 2024-09-12T18:51:24.669 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:51:24.250+0000 7f313af6e640 0 -- 172.21.15.111:0/3663818594 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f313408e940 msgr2=0x7f31340a1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:51:24.669 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:51:24.454+0000 7f313af6e640 10 monclient: get_auth_request con 0x7f313408e940 auth_method 0 2024-09-12T18:51:24.669 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:51:24.669 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:51:24.669 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:51:24.669 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:51:24.669 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:51:24.669 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:51:24.669 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.669 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.669 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.669 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:24.670 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:51:24.466+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.670 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:51:24.670 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 zone default found 2024-09-12T18:51:24.670 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:51:24.470+0000 7f313dc699c0 4 Realm: () 2024-09-12T18:51:24.670 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:51:24.470+0000 7f313dc699c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:51:24.670 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:51:24.470+0000 7f313dc699c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:51:24.670 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:51:24.470+0000 7f313dc699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:51:24.670 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 zonegroup default 2024-09-12T18:51:24.670 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.670 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.670 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.670 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.670 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.670 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.671 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 started sync module instance, tier type = 2024-09-12T18:51:24.671 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:51:24.470+0000 7f313dc699c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:51:24.671 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=0 2024-09-12T18:51:24.671 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=1 2024-09-12T18:51:24.671 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=2 2024-09-12T18:51:24.671 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=3 2024-09-12T18:51:24.671 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=4 2024-09-12T18:51:24.671 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=5 2024-09-12T18:51:24.671 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=6 2024-09-12T18:51:24.671 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:51:24.494+0000 7f313dc699c0 20 add_watcher() i=7 2024-09-12T18:51:24.671 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:51:24.494+0000 7f313dc699c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:51:24.671 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding auth protocol: cephx 2024-09-12T18:51:24.671 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding auth protocol: cephx 2024-09-12T18:51:24.672 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding auth protocol: cephx 2024-09-12T18:51:24.672 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: secure 2024-09-12T18:51:24.672 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: crc 2024-09-12T18:51:24.672 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: secure 2024-09-12T18:51:24.672 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: crc 2024-09-12T18:51:24.672 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: secure 2024-09-12T18:51:24.672 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:51:24.498+0000 7f2ff1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:51:24.672 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: crc 2024-09-12T18:51:24.672 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: crc 2024-09-12T18:51:24.672 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: secure 2024-09-12T18:51:24.672 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: crc 2024-09-12T18:51:24.672 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: secure 2024-09-12T18:51:24.673 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: crc 2024-09-12T18:51:24.673 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 AuthRegistry(0x7fffa3fd9500) adding con mode: secure 2024-09-12T18:51:24.673 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:51:24.498+0000 7f313dc699c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:24.673 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:51:24.498+0000 7f313dc699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:51:24.673 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:51:24.498+0000 7f313dc699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:51:24.673 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command cache list hook 0x562c69922ce0 2024-09-12T18:51:24.673 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command cache inspect hook 0x562c69922ce0 2024-09-12T18:51:24.673 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command cache erase hook 0x562c69922ce0 2024-09-12T18:51:24.673 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command cache zap hook 0x562c69922ce0 2024-09-12T18:51:24.673 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:51:24.498+0000 7f313dc699c0 5 note: GC not initialized 2024-09-12T18:51:24.673 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:51:24.502+0000 7f2ff0fe1640 20 reqs_thread_entry: start 2024-09-12T18:51:24.673 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:51:24.502+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command sync trace show hook 0x7f3134004550 2024-09-12T18:51:24.673 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:51:24.502+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command sync trace history hook 0x7f3134004550 2024-09-12T18:51:24.674 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:51:24.502+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command sync trace active hook 0x7f3134004550 2024-09-12T18:51:24.674 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:51:24.502+0000 7f313dc699c0 5 asok(0x562c6964a2b0) register_command sync trace active_short hook 0x7f3134004550 2024-09-12T18:51:24.674 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:51:24.502+0000 7f313dc699c0 20 init_complete bucket index max shards: 11 2024-09-12T18:51:24.674 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:51:24.502+0000 7f313dc699c0 20 Filter name: none 2024-09-12T18:51:24.674 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:51:24.502+0000 7f2f6a7fc640 20 reqs_thread_entry: start 2024-09-12T18:51:24.674 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:51:24.674 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:51:24.502+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.674 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:51:24.502+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:51:24.674 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:51:24.674 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:51:24.674 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:51:24.674 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:51:24.502+0000 7f313dc699c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.674 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:51:24.502+0000 7f313dc699c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:51:24.675 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:24.675 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:24.675 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:51:24.675 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:24.675 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:51:24.502+0000 7f313dc699c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:51:24.675 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:51:24.506+0000 7f313dc699c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:51:24.675 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:51:24.518+0000 7f313dc699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:24.675 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:51:24.518+0000 7f313dc699c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:24.675 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:51:24.518+0000 7f313dc699c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:24.675 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:51:24.518+0000 7f313dc699c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:51:24.675 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:51:24.522+0000 7f301effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431689 cookie 94748749945440 notifier 8370 bl.length()=827 2024-09-12T18:51:24.675 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:51:24.522+0000 7f301effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:24.675 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:51:24.522+0000 7f301effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:24.676 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:51:24.522+0000 7f301effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:24.676 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:51:24.522+0000 7f313dc699c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:51:24.676 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:51:24.522+0000 7f313dc699c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:51:24.676 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:51:24.522+0000 7f313dc699c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:51:24.676 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:51:24.522+0000 7f313dc699c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:51:24.676 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:51:24.530+0000 7f313dc699c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f313dc699c0 time 2024-09-12T18:51:24.531648+0000 2024-09-12T18:51:24.676 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:51:24.676 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.676 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:24.676 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f31415432eb] 2024-09-12T18:51:24.676 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f314154349f] 2024-09-12T18:51:24.676 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c66fcecc1] 2024-09-12T18:51:24.676 INFO:tasks.workunit.client.0.smithi111.stderr: 4: radosgw-admin(+0x1422aac) [0x562c67a2caac] 2024-09-12T18:51:24.677 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c66fe3ced] 2024-09-12T18:51:24.677 INFO:tasks.workunit.client.0.smithi111.stderr: 6: main() 2024-09-12T18:51:24.677 INFO:tasks.workunit.client.0.smithi111.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f31403a9d90] 2024-09-12T18:51:24.677 INFO:tasks.workunit.client.0.smithi111.stderr: 8: __libc_start_main() 2024-09-12T18:51:24.677 INFO:tasks.workunit.client.0.smithi111.stderr: 9: _start() 2024-09-12T18:51:24.677 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.677 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:51:24.530+0000 7f313dc699c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:51:24.677 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f313dc699c0 thread_name:radosgw-admin 2024-09-12T18:51:24.677 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.677 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:24.677 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f31403c2520] 2024-09-12T18:51:24.677 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:51:24.677 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:51:24.678 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:51:24.678 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3141543345] 2024-09-12T18:51:24.678 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f314154349f] 2024-09-12T18:51:24.678 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c66fcecc1] 2024-09-12T18:51:24.678 INFO:tasks.workunit.client.0.smithi111.stderr: 8: radosgw-admin(+0x1422aac) [0x562c67a2caac] 2024-09-12T18:51:24.678 INFO:tasks.workunit.client.0.smithi111.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c66fe3ced] 2024-09-12T18:51:24.678 INFO:tasks.workunit.client.0.smithi111.stderr: 10: main() 2024-09-12T18:51:24.678 INFO:tasks.workunit.client.0.smithi111.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f31403a9d90] 2024-09-12T18:51:24.678 INFO:tasks.workunit.client.0.smithi111.stderr: 12: __libc_start_main() 2024-09-12T18:51:24.678 INFO:tasks.workunit.client.0.smithi111.stderr: 13: _start() 2024-09-12T18:51:24.678 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:51:24.678 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:24.678 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:51:24.678 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:51:24.679 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:51:24.679 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:51:24.679 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:51:24.679 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:51:24.679 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:51:24.679 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:51:24.679 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:51:24.679 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:51:24.679 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:51:24.679 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:51:24.679 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:51:24.679 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:51:24.679 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:51:24.679 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:51:24.680 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:51:24.680 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:51:24.680 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:51:24.680 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:51:24.680 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:51:24.680 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:51:24.680 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:51:24.680 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:51:24.680 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:51:24.680 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:51:24.680 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:51:24.680 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:51:24.680 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:51:24.681 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:51:24.681 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:51:24.681 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:51:24.681 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:51:24.681 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:51:24.681 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:51:24.681 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:51:24.681 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:51:24.681 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:51:24.681 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:51:24.681 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:51:24.681 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:51:24.681 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:51:24.681 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:51:24.682 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:51:24.682 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:51:24.682 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:51:24.682 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:51:24.682 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:51:24.682 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:51:24.682 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:51:24.682 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:51:24.682 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:51:24.682 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:51:24.682 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:51:24.682 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:51:24.682 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:51:24.682 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:51:24.683 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:51:24.683 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:51:24.683 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:51:24.683 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:51:24.683 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:51:24.683 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:51:24.683 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:51:24.683 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:51:24.683 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:51:24.683 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:51:24.683 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:51:24.683 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:51:24.683 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:51:24.684 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:51:24.684 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:51:24.684 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:51:24.684 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:51:24.684 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:51:24.684 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:51:24.684 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:51:24.684 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:51:24.684 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:51:24.684 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:51:24.684 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:51:24.684 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:51:24.684 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:51:24.684 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:51:24.685 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:51:24.685 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:51:24.685 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:51:24.685 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:51:24.685 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:51:24.685 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:51:24.685 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:51:24.685 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:51:24.685 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:51:24.685 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:51:24.685 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2f6a7fc640 / http_manager 2024-09-12T18:51:24.685 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2ff0fe1640 / http_manager 2024-09-12T18:51:24.685 INFO:tasks.workunit.client.0.smithi111.stderr: 7f2ff1fe3640 / rgw_dt_lg_renew 2024-09-12T18:51:24.685 INFO:tasks.workunit.client.0.smithi111.stderr: 7f301d7fa640 / ms_dispatch 2024-09-12T18:51:24.686 INFO:tasks.workunit.client.0.smithi111.stderr: 7f301effd640 / io_context_pool 2024-09-12T18:51:24.686 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3025602640 / ms_dispatch 2024-09-12T18:51:24.686 INFO:tasks.workunit.client.0.smithi111.stderr: 7f3027e07640 / ms_dispatch 2024-09-12T18:51:24.686 INFO:tasks.workunit.client.0.smithi111.stderr: 7f302960a640 / io_context_pool 2024-09-12T18:51:24.686 INFO:tasks.workunit.client.0.smithi111.stderr: 7f313af6e640 / msgr-worker-2 2024-09-12T18:51:24.686 INFO:tasks.workunit.client.0.smithi111.stderr: 7f313b76f640 / msgr-worker-1 2024-09-12T18:51:24.686 INFO:tasks.workunit.client.0.smithi111.stderr: 7f313bf70640 / msgr-worker-0 2024-09-12T18:51:24.686 INFO:tasks.workunit.client.0.smithi111.stderr: 7f313c771640 / io_context_pool 2024-09-12T18:51:24.686 INFO:tasks.workunit.client.0.smithi111.stderr: 7f313dc699c0 / radosgw-admin 2024-09-12T18:51:24.686 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:51:24.686 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:51:24.686 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:51:24.535031Z_5ec4d83f-4d38-4888-86f2-f68ad720d52c/log 2024-09-12T18:51:24.686 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:51:24.686 INFO:tasks.workunit.client.0.smithi111.stderr:Aborted 2024-09-12T18:51:24.687 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:51:24.688 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:51:24.688 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:51:24.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.614+0000 7f00f9cdf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.688 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.614+0000 7f00f9cdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.614+0000 7f00f9cdf9c0 20 realm 2024-09-12T18:51:24.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.614+0000 7f00f9cdf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.614+0000 7f00f9cdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.614+0000 7f00f9cdf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:51:24.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.614+0000 7f00f9cdf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.614+0000 7f00f9cdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.614+0000 7f00f9cdf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.618+0000 7f00f9cdf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:24.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.618+0000 7f00f9cdf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.618+0000 7f00f9cdf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:51:24.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.618+0000 7f00f9cdf9c0 20 searching for the correct realm 2024-09-12T18:51:24.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.622+0000 7f00f77e5640 0 -- 172.21.15.111:0/4042310455 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f00f0085070 msgr2=0x7f00f005deb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:51:24.689 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.630+0000 7f00f6fe4640 0 -- 172.21.15.111:0/4042310455 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f00f008b260 msgr2=0x7f00f00199e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:24.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.846+0000 7f00f9cdf9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:51:24.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.846+0000 7f00f9cdf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:51:24.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.846+0000 7f00f9cdf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:51:24.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.846+0000 7f00f9cdf9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:51:24.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.846+0000 7f00f9cdf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:51:24.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.846+0000 7f00f9cdf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:51:24.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.846+0000 7f00f9cdf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.846+0000 7f00f9cdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.846+0000 7f00f9cdf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.846+0000 7f00f9cdf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:24.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.846+0000 7f00f9cdf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:51:24.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 20 zone default found 2024-09-12T18:51:24.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 4 Realm: () 2024-09-12T18:51:24.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:51:24.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:51:24.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:51:24.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 20 zonegroup default 2024-09-12T18:51:24.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.855 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:24.855 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 20 started sync module instance, tier type = 2024-09-12T18:51:24.855 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.850+0000 7f00f9cdf9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:51:24.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.874+0000 7f00f9cdf9c0 20 add_watcher() i=0 2024-09-12T18:51:24.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.874+0000 7f00f9cdf9c0 20 add_watcher() i=1 2024-09-12T18:51:24.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.874+0000 7f00f9cdf9c0 20 add_watcher() i=2 2024-09-12T18:51:24.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.874+0000 7f00f9cdf9c0 20 add_watcher() i=3 2024-09-12T18:51:24.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.874+0000 7f00f9cdf9c0 20 add_watcher() i=4 2024-09-12T18:51:24.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.874+0000 7f00f9cdf9c0 20 add_watcher() i=5 2024-09-12T18:51:24.880 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.874+0000 7f00f9cdf9c0 20 add_watcher() i=6 2024-09-12T18:51:24.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.878+0000 7f00f9cdf9c0 20 add_watcher() i=7 2024-09-12T18:51:24.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.878+0000 7f00f9cdf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:51:24.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.882+0000 7effae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:51:24.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:51:24.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:51:24.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 5 note: GC not initialized 2024-09-12T18:51:24.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7effad7e2640 20 reqs_thread_entry: start 2024-09-12T18:51:24.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:51:24.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 20 Filter name: none 2024-09-12T18:51:24.889 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7effa67fc640 20 reqs_thread_entry: start 2024-09-12T18:51:24.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:51:24.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:51:24.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:51:24.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:51:24.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:51:24.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:24.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:51:24.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:24.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:24.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:51:24.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:24.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.886+0000 7f00f9cdf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:51:24.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.890+0000 7f00f9cdf9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:51:24.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.890+0000 7f00f9cdf9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:51:24.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.890+0000 7f00f9cdf9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:51:24.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.890+0000 7f00f9cdf9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:51:24.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.890+0000 7f00f9cdf9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:51:24.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.890+0000 7f00f9cdf9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:51:24.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.890+0000 7f00f9cdf9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:51:24.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.890+0000 7f00f9cdf9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:51:24.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.890+0000 7f00f9cdf9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:51:24.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.890+0000 7f00f9cdf9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:51:24.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.894+0000 7f00f9cdf9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:51:24.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.894+0000 7f00f9cdf9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:51:24.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.894+0000 7f00f9cdf9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:51:24.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.894+0000 7f00f9cdf9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:51:24.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.894+0000 7f00f9cdf9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:51:24.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.894+0000 7f00f9cdf9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:51:24.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.894+0000 7f00f9cdf9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:51:24.898 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.894+0000 7f00f9cdf9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:51:24.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.894+0000 7f00f9cdf9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:51:24.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.894+0000 7f00f9cdf9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:51:24.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.898+0000 7f00f9cdf9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:51:24.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.898+0000 7f00f9cdf9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:51:24.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.898+0000 7f00f9cdf9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:51:24.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.898+0000 7f00f9cdf9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:51:24.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.898+0000 7f00f9cdf9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:51:24.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.898+0000 7f00f9cdf9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:51:24.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.902+0000 7effae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:51:24.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.906+0000 7f00f9cdf9c0 20 remove_watcher() i=0 2024-09-12T18:51:24.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.906+0000 7f00f9cdf9c0 2 removed watcher, disabling cache 2024-09-12T18:51:24.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.910+0000 7f00f9cdf9c0 20 remove_watcher() i=1 2024-09-12T18:51:24.915 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.910+0000 7f00f9cdf9c0 20 remove_watcher() i=2 2024-09-12T18:51:24.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.914+0000 7f00f9cdf9c0 20 remove_watcher() i=3 2024-09-12T18:51:24.919 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.914+0000 7f00f9cdf9c0 20 remove_watcher() i=4 2024-09-12T18:51:24.921 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.918+0000 7f00f9cdf9c0 20 remove_watcher() i=5 2024-09-12T18:51:24.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.918+0000 7f00f9cdf9c0 20 remove_watcher() i=6 2024-09-12T18:51:24.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:24.922+0000 7f00f9cdf9c0 20 remove_watcher() i=7 2024-09-12T18:51:24.940 INFO:tasks.workunit.client.0.smithi111.stderr: test: duplicated entries can be purged manually 2024-09-12T18:51:54.962 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:51:54.994 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:51:54.994 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:51:55.041 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.037+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.037+0000 7f4c9cde09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.037+0000 7f4c9cde09c0 20 realm 2024-09-12T18:51:55.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.037+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.037+0000 7f4c9cde09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.037+0000 7f4c9cde09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:51:55.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.037+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.037+0000 7f4c9cde09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.037+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.041+0000 7f4c9cde09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:55.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.041+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.041+0000 7f4c9cde09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:51:55.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.041+0000 7f4c9cde09c0 20 searching for the correct realm 2024-09-12T18:51:55.050 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.045+0000 7f4c9b0e7640 0 -- 172.21.15.111:0/2685933961 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f4c900dfb70 msgr2=0x7f4c90118730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:55.057 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.053+0000 7f4c9a0e5640 0 -- 172.21.15.111:0/2685933961 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f4c9400e3c0 msgr2=0x7f4c9400e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:55.275 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.269+0000 7f4c9cde09c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:51:55.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.269+0000 7f4c9cde09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:51:55.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.269+0000 7f4c9cde09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:51:55.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.269+0000 7f4c9cde09c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:51:55.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.269+0000 7f4c9cde09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:51:55.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.269+0000 7f4c9cde09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:51:55.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.269+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.269+0000 7f4c9cde09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.269+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:55.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:51:55.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 20 zone default found 2024-09-12T18:51:55.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 4 Realm: () 2024-09-12T18:51:55.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:51:55.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:51:55.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:51:55.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 20 zonegroup default 2024-09-12T18:51:55.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 20 started sync module instance, tier type = 2024-09-12T18:51:55.280 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.273+0000 7f4c9cde09c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:51:55.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.297+0000 7f4c9cde09c0 20 add_watcher() i=0 2024-09-12T18:51:55.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.297+0000 7f4c9cde09c0 20 add_watcher() i=1 2024-09-12T18:51:55.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.297+0000 7f4c9cde09c0 20 add_watcher() i=2 2024-09-12T18:51:55.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.297+0000 7f4c9cde09c0 20 add_watcher() i=3 2024-09-12T18:51:55.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.297+0000 7f4c9cde09c0 20 add_watcher() i=4 2024-09-12T18:51:55.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.297+0000 7f4c9cde09c0 20 add_watcher() i=5 2024-09-12T18:51:55.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.297+0000 7f4c9cde09c0 20 add_watcher() i=6 2024-09-12T18:51:55.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.297+0000 7f4c9cde09c0 20 add_watcher() i=7 2024-09-12T18:51:55.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.297+0000 7f4c9cde09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:51:55.307 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.301+0000 7f4b517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:51:55.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.305+0000 7f4c9cde09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:51:55.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.305+0000 7f4c9cde09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:51:55.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.305+0000 7f4c9cde09c0 5 note: GC not initialized 2024-09-12T18:51:55.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.305+0000 7f4acbfff640 20 reqs_thread_entry: start 2024-09-12T18:51:55.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.305+0000 7f4c9cde09c0 20 init_complete bucket index max shards: 11 2024-09-12T18:51:55.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.305+0000 7f4c9cde09c0 20 Filter name: none 2024-09-12T18:51:55.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.305+0000 7f4ac9ffb640 20 reqs_thread_entry: start 2024-09-12T18:51:55.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.305+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.305+0000 7f4c9cde09c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:51:55.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.305+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.305+0000 7f4c9cde09c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:51:55.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.305+0000 7f4c9cde09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:51:55.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.305+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.309+0000 7f4c9cde09c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:51:55.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.309+0000 7f4c9cde09c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.309+0000 7f4c9cde09c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:51:55.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.309+0000 7f4c9cde09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:51:55.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.313+0000 7f4b517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:51:55.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.317+0000 7f4c9cde09c0 20 remove_watcher() i=0 2024-09-12T18:51:55.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.317+0000 7f4c9cde09c0 2 removed watcher, disabling cache 2024-09-12T18:51:55.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.317+0000 7f4c9cde09c0 20 remove_watcher() i=1 2024-09-12T18:51:55.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.321+0000 7f4c9cde09c0 20 remove_watcher() i=2 2024-09-12T18:51:55.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.325+0000 7f4c9cde09c0 20 remove_watcher() i=3 2024-09-12T18:51:55.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.325+0000 7f4c9cde09c0 20 remove_watcher() i=4 2024-09-12T18:51:55.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.329+0000 7f4c9cde09c0 20 remove_watcher() i=5 2024-09-12T18:51:55.334 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.329+0000 7f4c9cde09c0 20 remove_watcher() i=6 2024-09-12T18:51:55.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.329+0000 7f4c9cde09c0 20 remove_watcher() i=7 2024-09-12T18:51:55.351 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.351 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:51:55.351 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: a-bucket id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-12T18:51:55.351 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.352 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T18:51:55.388 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:51:55.388 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:51:55.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.425+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.429+0000 7f52a18319c0 20 realm 2024-09-12T18:51:55.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.429+0000 7f52a18319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:51:55.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:55.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:51:55.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.429+0000 7f52a18319c0 20 searching for the correct realm 2024-09-12T18:51:55.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.437+0000 7f529fb38640 0 -- 172.21.15.111:0/3853883544 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x560872ab35d0 msgr2=0x560872ab59c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:55.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.441+0000 7f529eb36640 0 -- 172.21.15.111:0/3853883544 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f529807f090 msgr2=0x7f5298008c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:55.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:51:55.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:51:55.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:51:55.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:51:55.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:51:55.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:51:55.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:55.456 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:51:55.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 20 zone default found 2024-09-12T18:51:55.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 4 Realm: () 2024-09-12T18:51:55.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:51:55.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:51:55.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:51:55.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 20 zonegroup default 2024-09-12T18:51:55.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 20 started sync module instance, tier type = 2024-09-12T18:51:55.458 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.453+0000 7f52a18319c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:51:55.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=0 2024-09-12T18:51:55.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=1 2024-09-12T18:51:55.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=2 2024-09-12T18:51:55.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=3 2024-09-12T18:51:55.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=4 2024-09-12T18:51:55.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=5 2024-09-12T18:51:55.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=6 2024-09-12T18:51:55.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=7 2024-09-12T18:51:55.473 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.469+0000 7f52a18319c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:51:55.476 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.469+0000 7f5155fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:51:55.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:51:55.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:51:55.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 5 note: GC not initialized 2024-09-12T18:51:55.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f5154fe1640 20 reqs_thread_entry: start 2024-09-12T18:51:55.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 20 init_complete bucket index max shards: 11 2024-09-12T18:51:55.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 20 Filter name: none 2024-09-12T18:51:55.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f50ce7fc640 20 reqs_thread_entry: start 2024-09-12T18:51:55.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:51:55.477 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.478 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:51:55.478 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:51:55.478 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:51:55.478 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:51:55.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:51:55.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:55.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:55.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:51:55.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:55.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.473+0000 7f52a18319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:51:55.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.477+0000 7f52a18319c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:51:55.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.489+0000 7f52a18319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:55.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.489+0000 7f52a18319c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:55.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.489+0000 7f52a18319c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:55.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.489+0000 7f52a18319c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:51:55.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.489+0000 7f5182ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431690 cookie 94594283581264 notifier 7874 bl.length()=827 2024-09-12T18:51:55.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.489+0000 7f5182ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:55.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.489+0000 7f5182ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:55.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.489+0000 7f5182ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:55.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.489+0000 7f52a18319c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:51:55.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.489+0000 7f52a18319c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:51:55.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.489+0000 7f52a18319c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:51:55.496 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.489+0000 7f52a18319c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:51:55.509 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f52a18319c0 time 2024-09-12T18:51:55.510467+0000 2024-09-12T18:51:55.509 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:51:55.510 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:55.511 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f52a510b2eb] 2024-09-12T18:51:55.511 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f52a510b49f] 2024-09-12T18:51:55.511 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560870391cc1] 2024-09-12T18:51:55.511 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5608703a6d5a] 2024-09-12T18:51:55.511 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:51:55.511 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f52a3f71d90] 2024-09-12T18:51:55.511 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:51:55.511 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:51:55.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.505+0000 7f52a18319c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f52a18319c0 time 2024-09-12T18:51:55.510467+0000 2024-09-12T18:51:55.511 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:51:55.511 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.511 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:55.512 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f52a510b2eb] 2024-09-12T18:51:55.512 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f52a510b49f] 2024-09-12T18:51:55.512 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560870391cc1] 2024-09-12T18:51:55.512 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5608703a6d5a] 2024-09-12T18:51:55.512 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:51:55.512 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f52a3f71d90] 2024-09-12T18:51:55.512 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:51:55.512 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:51:55.512 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.512 INFO:tasks.workunit.client.0.smithi111.stderr:*** Caught signal (Aborted) ** 2024-09-12T18:51:55.512 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f52a18319c0 thread_name:radosgw-admin 2024-09-12T18:51:55.529 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:55.529 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f52a3f8a520] 2024-09-12T18:51:55.529 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:51:55.529 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:51:55.529 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:51:55.529 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f52a510b345] 2024-09-12T18:51:55.529 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f52a510b49f] 2024-09-12T18:51:55.529 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560870391cc1] 2024-09-12T18:51:55.529 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5608703a6d5a] 2024-09-12T18:51:55.530 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:51:55.530 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f52a3f71d90] 2024-09-12T18:51:55.530 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:51:55.530 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:51:55.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.505+0000 7f52a18319c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:51:55.530 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f52a18319c0 thread_name:radosgw-admin 2024-09-12T18:51:55.530 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.530 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:55.530 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f52a3f8a520] 2024-09-12T18:51:55.530 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:51:55.530 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:51:55.530 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:51:55.531 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f52a510b345] 2024-09-12T18:51:55.531 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f52a510b49f] 2024-09-12T18:51:55.531 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560870391cc1] 2024-09-12T18:51:55.531 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5608703a6d5a] 2024-09-12T18:51:55.531 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:51:55.531 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f52a3f71d90] 2024-09-12T18:51:55.531 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:51:55.531 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:51:55.531 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:51:55.531 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.531 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:51:55.531 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:51:55.405+0000 7f529f337640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.531 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient(hunting): handle_auth_done global_id 8412 payload 274 2024-09-12T18:51:55.532 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient: _finish_hunting 0 2024-09-12T18:51:55.532 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:51:55.405+0000 7f529fb38640 1 monclient: found mon.noname-a 2024-09-12T18:51:55.532 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:51:55.532 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.532 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:51:55.532 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: dump: 2024-09-12T18:51:55.532 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.532 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.532 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.532 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.532 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.532 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.532 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.533 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.533 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.533 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.533 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: _finish_auth 0 2024-09-12T18:51:55.533 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: _check_auth_tickets 2024-09-12T18:51:55.533 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:55.533 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 monclient: authenticate success, global_id 8412 2024-09-12T18:51:55.533 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient: get_monmap_and_config success 2024-09-12T18:51:55.533 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.533 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:51:55.405+0000 7f52a18319c0 4 set_mon_vals no callback set 2024-09-12T18:51:55.533 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:51:55.533 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: dump: 2024-09-12T18:51:55.533 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.534 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.534 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.534 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.534 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.534 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.534 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.534 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.534 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.534 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.534 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient: shutdown 2024-09-12T18:51:55.534 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 asok(0x5608727b52b0) unregister_commands rotate-key 2024-09-12T18:51:55.534 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient: build_initial_monmap 2024-09-12T18:51:55.534 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:51:55.405+0000 7f52a18319c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:55.534 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient: monmap: 2024-09-12T18:51:55.535 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:55.535 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:55.535 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:55.535 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:55.535 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:55.535 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.535 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:55.535 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:55.535 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:55.535 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.535 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding auth protocol: cephx 2024-09-12T18:51:55.535 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding auth protocol: cephx 2024-09-12T18:51:55.535 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding auth protocol: cephx 2024-09-12T18:51:55.536 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: secure 2024-09-12T18:51:55.536 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: crc 2024-09-12T18:51:55.536 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: secure 2024-09-12T18:51:55.536 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: crc 2024-09-12T18:51:55.536 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: secure 2024-09-12T18:51:55.536 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: crc 2024-09-12T18:51:55.536 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: crc 2024-09-12T18:51:55.536 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: secure 2024-09-12T18:51:55.536 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: crc 2024-09-12T18:51:55.536 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: secure 2024-09-12T18:51:55.536 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: crc 2024-09-12T18:51:55.536 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: secure 2024-09-12T18:51:55.536 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:51:55.405+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.536 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:51:55.405+0000 7f52a18319c0 1 librados: starting msgr at 2024-09-12T18:51:55.537 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:51:55.405+0000 7f52a18319c0 1 librados: starting objecter 2024-09-12T18:51:55.537 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command objecter_requests hook 0x5608727e0950 2024-09-12T18:51:55.537 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:51:55.405+0000 7f52a18319c0 1 librados: setting wanted keys 2024-09-12T18:51:55.537 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:51:55.405+0000 7f52a18319c0 1 librados: calling monclient init 2024-09-12T18:51:55.537 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient: init 2024-09-12T18:51:55.537 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding auth protocol: cephx 2024-09-12T18:51:55.537 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding auth protocol: cephx 2024-09-12T18:51:55.537 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding auth protocol: cephx 2024-09-12T18:51:55.537 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: secure 2024-09-12T18:51:55.537 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: crc 2024-09-12T18:51:55.537 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: secure 2024-09-12T18:51:55.537 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: crc 2024-09-12T18:51:55.538 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: secure 2024-09-12T18:51:55.538 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: crc 2024-09-12T18:51:55.538 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: crc 2024-09-12T18:51:55.538 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: secure 2024-09-12T18:51:55.538 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: crc 2024-09-12T18:51:55.538 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: secure 2024-09-12T18:51:55.538 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: crc 2024-09-12T18:51:55.538 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: secure 2024-09-12T18:51:55.538 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:51:55.405+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.538 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:51:55.405+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.538 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command rotate-key hook 0x5608729c0348 2024-09-12T18:51:55.538 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:55.538 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:51:55.539 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-c con 0x560872877530 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:55.539 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-b con 0x56087287d5b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:55.539 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-a con 0x5608729c6610 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:55.539 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.539 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.539 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.539 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:55.539 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): authenticate will time out at 2502.551795s 2024-09-12T18:51:55.539 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient(hunting): get_auth_request con 0x5608729c6610 auth_method 0 2024-09-12T18:51:55.539 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.539 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.539 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.540 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:51:55.405+0000 7f529f337640 10 monclient(hunting): get_auth_request con 0x560872877530 auth_method 0 2024-09-12T18:51:55.540 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:51:55.405+0000 7f529f337640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.540 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:51:55.405+0000 7f529f337640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.540 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:51:55.405+0000 7f529f337640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.540 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.540 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.540 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:51:55.409+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.540 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:51:55.409+0000 7f529f337640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.540 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:51:55.409+0000 7f529f337640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.540 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:51:55.409+0000 7f529f337640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.540 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:51:55.409+0000 7f529fb38640 10 monclient(hunting): handle_auth_done global_id 8415 payload 824 2024-09-12T18:51:55.540 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:51:55.409+0000 7f529fb38640 10 monclient: _finish_hunting 0 2024-09-12T18:51:55.540 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:51:55.409+0000 7f529fb38640 1 monclient: found mon.noname-a 2024-09-12T18:51:55.541 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:51:55.409+0000 7f529fb38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:51:55.541 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.541 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:51:55.541 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: dump: 2024-09-12T18:51:55.541 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.541 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.541 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.541 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.541 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.541 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.541 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.541 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.541 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.542 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.542 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: _finish_auth 0 2024-09-12T18:51:55.542 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: _check_auth_tickets 2024-09-12T18:51:55.542 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:51:55.409+0000 7f52a18319c0 5 monclient: authenticate success, global_id 8415 2024-09-12T18:51:55.542 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:51:55.409+0000 7f52a18319c0 10 monclient: _renew_subs 2024-09-12T18:51:55.542 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:51:55.409+0000 7f52a18319c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:55.542 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:55.542 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.542 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:51:55.542 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: dump: 2024-09-12T18:51:55.542 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.542 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.542 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.542 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.543 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.543 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.543 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.543 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.543 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.543 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.543 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:51:55.409+0000 7f518d60a640 4 set_mon_vals no callback set 2024-09-12T18:51:55.543 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:51:55.409+0000 7f52a18319c0 10 monclient: _renew_subs 2024-09-12T18:51:55.543 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:51:55.409+0000 7f52a18319c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:55.543 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:51:55.409+0000 7f52a18319c0 1 librados: init done 2024-09-12T18:51:55.543 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:51:55.409+0000 7f518be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:51:55.543 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:51:55.409+0000 7f518be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:55.543 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:51:55.409+0000 7f518be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:55.543 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:51:55.409+0000 7f529f337640 10 monclient: get_auth_request con 0x7f5184070ae0 auth_method 0 2024-09-12T18:51:55.544 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:51:55.409+0000 7f529eb36640 10 monclient: get_auth_request con 0x5608729ff130 auth_method 0 2024-09-12T18:51:55.544 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:51:55.413+0000 7f529f337640 10 monclient: get_auth_request con 0x560872a0aae0 auth_method 0 2024-09-12T18:51:55.544 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:51:55.413+0000 7f529eb36640 10 monclient: get_auth_request con 0x560872a0ef90 auth_method 0 2024-09-12T18:51:55.544 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:51:55.413+0000 7f529fb38640 10 monclient: get_auth_request con 0x560872a12fd0 auth_method 0 2024-09-12T18:51:55.544 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: build_initial_monmap 2024-09-12T18:51:55.544 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:51:55.417+0000 7f52a18319c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:55.544 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: monmap: 2024-09-12T18:51:55.544 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:55.544 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:55.544 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:55.544 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:55.544 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:55.544 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.545 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:55.545 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:55.545 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:55.545 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.545 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding auth protocol: cephx 2024-09-12T18:51:55.545 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding auth protocol: cephx 2024-09-12T18:51:55.545 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding auth protocol: cephx 2024-09-12T18:51:55.545 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: secure 2024-09-12T18:51:55.545 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: crc 2024-09-12T18:51:55.545 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: secure 2024-09-12T18:51:55.545 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: crc 2024-09-12T18:51:55.545 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: secure 2024-09-12T18:51:55.546 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: crc 2024-09-12T18:51:55.546 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: crc 2024-09-12T18:51:55.546 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: secure 2024-09-12T18:51:55.546 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: crc 2024-09-12T18:51:55.546 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: secure 2024-09-12T18:51:55.546 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: crc 2024-09-12T18:51:55.546 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: secure 2024-09-12T18:51:55.546 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:51:55.417+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.546 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command objecter_requests cmddesc objecter_requests hook 0x560872a1aaf0 EEXIST 2024-09-12T18:51:55.546 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: init 2024-09-12T18:51:55.546 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding auth protocol: cephx 2024-09-12T18:51:55.546 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding auth protocol: cephx 2024-09-12T18:51:55.546 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding auth protocol: cephx 2024-09-12T18:51:55.547 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: secure 2024-09-12T18:51:55.547 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: crc 2024-09-12T18:51:55.547 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: secure 2024-09-12T18:51:55.547 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: crc 2024-09-12T18:51:55.547 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: secure 2024-09-12T18:51:55.547 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: crc 2024-09-12T18:51:55.547 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: crc 2024-09-12T18:51:55.547 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: secure 2024-09-12T18:51:55.547 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: crc 2024-09-12T18:51:55.547 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: secure 2024-09-12T18:51:55.547 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: crc 2024-09-12T18:51:55.547 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: secure 2024-09-12T18:51:55.547 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:51:55.417+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.548 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:51:55.417+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.548 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command rotate-key cmddesc rotate-key hook 0x560872a16130 EEXIST 2024-09-12T18:51:55.548 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:55.548 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:51:55.548 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-c con 0x560872a3eca0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:55.548 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-a con 0x560872a3e5d0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:55.548 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-b con 0x560872a3cfb0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:55.548 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.548 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.548 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.548 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:55.548 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): authenticate will time out at 2502.562006s 2024-09-12T18:51:55.548 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:51:55.417+0000 7f529eb36640 10 monclient(hunting): get_auth_request con 0x560872a3eca0 auth_method 0 2024-09-12T18:51:55.549 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:51:55.417+0000 7f529eb36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.549 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:51:55.417+0000 7f529eb36640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.549 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:51:55.417+0000 7f529eb36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.549 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): get_auth_request con 0x560872a3e5d0 auth_method 0 2024-09-12T18:51:55.549 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.549 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.549 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.549 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:51:55.417+0000 7f529eb36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.549 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:51:55.417+0000 7f529eb36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.549 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:51:55.417+0000 7f529eb36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.549 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.549 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.549 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.549 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): handle_auth_done global_id 8418 payload 824 2024-09-12T18:51:55.550 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient: _finish_hunting 0 2024-09-12T18:51:55.550 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:51:55.417+0000 7f529fb38640 1 monclient: found mon.noname-a 2024-09-12T18:51:55.550 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:51:55.550 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.550 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:51:55.550 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: dump: 2024-09-12T18:51:55.550 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.550 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.550 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.550 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.550 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.550 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.550 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.551 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.551 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.551 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.551 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: _finish_auth 0 2024-09-12T18:51:55.551 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: _check_auth_tickets 2024-09-12T18:51:55.551 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:55.551 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.551 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:51:55.551 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: dump: 2024-09-12T18:51:55.551 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.551 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.551 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.551 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.551 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.552 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.552 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.552 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.552 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.552 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.552 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:51:55.417+0000 7f52a0339640 4 set_mon_vals no callback set 2024-09-12T18:51:55.552 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 monclient: authenticate success, global_id 8418 2024-09-12T18:51:55.552 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: _renew_subs 2024-09-12T18:51:55.552 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:55.552 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: _renew_subs 2024-09-12T18:51:55.552 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:55.552 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:51:55.421+0000 7f5189602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:51:55.552 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:51:55.421+0000 7f5189602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:55.553 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:51:55.421+0000 7f5189602640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:55.553 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient: get_auth_request con 0x7f5178070a20 auth_method 0 2024-09-12T18:51:55.553 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: get_monmap_and_config 2024-09-12T18:51:55.553 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: build_initial_monmap 2024-09-12T18:51:55.553 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:51:55.421+0000 7f52a18319c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:55.553 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: monmap: 2024-09-12T18:51:55.553 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:55.553 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:55.553 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:55.553 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:55.553 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:55.553 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.553 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:55.553 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:55.554 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:55.554 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.554 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding auth protocol: cephx 2024-09-12T18:51:55.554 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding auth protocol: cephx 2024-09-12T18:51:55.554 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding auth protocol: cephx 2024-09-12T18:51:55.554 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: secure 2024-09-12T18:51:55.554 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: crc 2024-09-12T18:51:55.554 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: secure 2024-09-12T18:51:55.554 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: crc 2024-09-12T18:51:55.554 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: secure 2024-09-12T18:51:55.554 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: crc 2024-09-12T18:51:55.554 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: crc 2024-09-12T18:51:55.554 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: secure 2024-09-12T18:51:55.555 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: crc 2024-09-12T18:51:55.555 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: secure 2024-09-12T18:51:55.555 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: crc 2024-09-12T18:51:55.555 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: secure 2024-09-12T18:51:55.555 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:51:55.421+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.555 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: init 2024-09-12T18:51:55.555 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding auth protocol: cephx 2024-09-12T18:51:55.555 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding auth protocol: cephx 2024-09-12T18:51:55.555 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding auth protocol: cephx 2024-09-12T18:51:55.555 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: secure 2024-09-12T18:51:55.555 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: crc 2024-09-12T18:51:55.555 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: secure 2024-09-12T18:51:55.555 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: crc 2024-09-12T18:51:55.555 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: secure 2024-09-12T18:51:55.556 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: crc 2024-09-12T18:51:55.556 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: crc 2024-09-12T18:51:55.556 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: secure 2024-09-12T18:51:55.556 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: crc 2024-09-12T18:51:55.556 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: secure 2024-09-12T18:51:55.556 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: crc 2024-09-12T18:51:55.556 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: secure 2024-09-12T18:51:55.556 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:51:55.421+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.556 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:51:55.421+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.556 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc4a9e6e58 EEXIST 2024-09-12T18:51:55.556 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:55.556 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:51:55.556 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-a con 0x560872a8c690 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:55.557 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-c con 0x560872a8ca70 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:55.557 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-b con 0x560872a8df30 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:55.557 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.557 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.557 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.557 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:55.557 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): authenticate will time out at 2502.566185s 2024-09-12T18:51:55.557 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): get_auth_request con 0x560872a8ca70 auth_method 0 2024-09-12T18:51:55.557 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.557 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.557 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.557 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient(hunting): get_auth_request con 0x560872a8c690 auth_method 0 2024-09-12T18:51:55.557 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.558 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.558 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.558 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.558 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.558 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.558 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.558 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.558 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.558 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): handle_auth_done global_id 7871 payload 274 2024-09-12T18:51:55.558 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient: _finish_hunting 0 2024-09-12T18:51:55.558 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:51:55.421+0000 7f529fb38640 1 monclient: found mon.noname-c 2024-09-12T18:51:55.558 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:51:55.558 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: dump: 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: _finish_auth 0 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:51:55.559 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:55.560 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 monclient: authenticate success, global_id 7871 2024-09-12T18:51:55.560 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: get_monmap_and_config success 2024-09-12T18:51:55.560 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:51:55.421+0000 7f52a18319c0 4 set_mon_vals no callback set 2024-09-12T18:51:55.560 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.560 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:51:55.560 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: dump: 2024-09-12T18:51:55.560 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.560 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.560 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.560 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.560 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.560 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.560 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.561 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.561 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.561 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.561 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: shutdown 2024-09-12T18:51:55.561 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: build_initial_monmap 2024-09-12T18:51:55.561 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:51:55.421+0000 7f52a18319c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:55.561 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: monmap: 2024-09-12T18:51:55.561 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:55.561 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:55.561 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:55.561 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:55.561 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:55.561 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.562 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:55.562 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:55.562 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:55.562 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.562 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding auth protocol: cephx 2024-09-12T18:51:55.562 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding auth protocol: cephx 2024-09-12T18:51:55.562 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding auth protocol: cephx 2024-09-12T18:51:55.562 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: secure 2024-09-12T18:51:55.562 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: crc 2024-09-12T18:51:55.562 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: secure 2024-09-12T18:51:55.562 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: crc 2024-09-12T18:51:55.562 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: secure 2024-09-12T18:51:55.562 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: crc 2024-09-12T18:51:55.563 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: crc 2024-09-12T18:51:55.563 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: secure 2024-09-12T18:51:55.563 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: crc 2024-09-12T18:51:55.563 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: secure 2024-09-12T18:51:55.563 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: crc 2024-09-12T18:51:55.563 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: secure 2024-09-12T18:51:55.563 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:51:55.421+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.563 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:51:55.421+0000 7f52a18319c0 1 librados: starting msgr at 2024-09-12T18:51:55.563 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:51:55.421+0000 7f52a18319c0 1 librados: starting objecter 2024-09-12T18:51:55.563 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command objecter_requests cmddesc objecter_requests hook 0x560872a60580 EEXIST 2024-09-12T18:51:55.563 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:51:55.425+0000 7f52a18319c0 1 librados: setting wanted keys 2024-09-12T18:51:55.563 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:51:55.425+0000 7f52a18319c0 1 librados: calling monclient init 2024-09-12T18:51:55.563 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient: init 2024-09-12T18:51:55.564 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding auth protocol: cephx 2024-09-12T18:51:55.564 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding auth protocol: cephx 2024-09-12T18:51:55.564 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding auth protocol: cephx 2024-09-12T18:51:55.564 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: secure 2024-09-12T18:51:55.564 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: crc 2024-09-12T18:51:55.564 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: secure 2024-09-12T18:51:55.564 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: crc 2024-09-12T18:51:55.564 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: secure 2024-09-12T18:51:55.564 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: crc 2024-09-12T18:51:55.564 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: crc 2024-09-12T18:51:55.564 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: secure 2024-09-12T18:51:55.564 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: crc 2024-09-12T18:51:55.564 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: secure 2024-09-12T18:51:55.565 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: crc 2024-09-12T18:51:55.565 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: secure 2024-09-12T18:51:55.565 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:51:55.425+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.565 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:51:55.425+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.565 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command rotate-key cmddesc rotate-key hook 0x560872a40c08 EEXIST 2024-09-12T18:51:55.565 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:55.565 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:51:55.565 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-b con 0x560872a8c690 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:55.565 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-c con 0x560872a8df30 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:55.565 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-a con 0x560872a86650 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:55.565 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.565 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.565 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.566 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:55.566 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): authenticate will time out at 2502.568756s 2024-09-12T18:51:55.566 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): get_auth_request con 0x560872a8df30 auth_method 0 2024-09-12T18:51:55.566 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.566 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.566 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.566 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:51:55.425+0000 7f529f337640 10 monclient(hunting): get_auth_request con 0x560872a86650 auth_method 0 2024-09-12T18:51:55.566 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:51:55.425+0000 7f529f337640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.566 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:51:55.425+0000 7f529f337640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.566 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:51:55.425+0000 7f529f337640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.566 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.566 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.566 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.567 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:51:55.425+0000 7f529f337640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.567 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:51:55.425+0000 7f529f337640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.567 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:51:55.425+0000 7f529f337640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.567 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:51:55.425+0000 7f529eb36640 10 monclient(hunting): get_auth_request con 0x560872a8c690 auth_method 0 2024-09-12T18:51:55.567 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:51:55.425+0000 7f529eb36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.567 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:51:55.425+0000 7f529eb36640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.567 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:51:55.425+0000 7f529eb36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.567 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): handle_auth_done global_id 7874 payload 824 2024-09-12T18:51:55.567 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient: _finish_hunting 0 2024-09-12T18:51:55.567 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:51:55.425+0000 7f529fb38640 1 monclient: found mon.noname-c 2024-09-12T18:51:55.567 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:51:55.567 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.567 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:51:55.567 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: dump: 2024-09-12T18:51:55.568 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.568 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.568 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.568 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.568 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.568 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.568 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.568 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.568 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.568 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.568 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: _finish_auth 0 2024-09-12T18:51:55.568 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: _check_auth_tickets 2024-09-12T18:51:55.568 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:55.569 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.569 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:51:55.569 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: dump: 2024-09-12T18:51:55.569 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.569 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.569 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.569 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.569 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.569 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.569 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.569 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.569 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.569 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 monclient: authenticate success, global_id 7874 2024-09-12T18:51:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:51:55.425+0000 7f5182ffd640 4 set_mon_vals no callback set 2024-09-12T18:51:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient: _renew_subs 2024-09-12T18:51:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:51:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient: _renew_subs 2024-09-12T18:51:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:51:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:51:55.425+0000 7f52a18319c0 1 librados: init done 2024-09-12T18:51:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command cr dump hook 0x560872a62668 2024-09-12T18:51:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:51:55.425+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:51:55.425+0000 7f51817fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:51:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:51:55.425+0000 7f51817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:51:55.425+0000 7f51817fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:51:55.425+0000 7f529eb36640 10 monclient: get_auth_request con 0x7f5168070ae0 auth_method 0 2024-09-12T18:51:55.570 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:51:55.429+0000 7f529f337640 10 monclient: get_auth_request con 0x560872aabac0 auth_method 0 2024-09-12T18:51:55.571 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.571 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 realm 2024-09-12T18:51:55.571 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.571 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.571 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:51:55.429+0000 7f52a18319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:51:55.571 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.571 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.571 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.571 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:51:55.429+0000 7f529eb36640 10 monclient: get_auth_request con 0x560872aafd20 auth_method 0 2024-09-12T18:51:55.571 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:55.571 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.571 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:51:55.429+0000 7f529fb38640 10 monclient: get_auth_request con 0x560872ab35d0 auth_method 0 2024-09-12T18:51:55.571 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:51:55.571 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 searching for the correct realm 2024-09-12T18:51:55.572 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:51:55.433+0000 7f529f337640 10 monclient: get_auth_request con 0x7f529800e070 auth_method 0 2024-09-12T18:51:55.572 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:51:55.433+0000 7f529eb36640 10 monclient: get_auth_request con 0x7f52900d5920 auth_method 0 2024-09-12T18:51:55.572 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:51:55.433+0000 7f529fb38640 10 monclient: get_auth_request con 0x7f5294046040 auth_method 0 2024-09-12T18:51:55.572 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:51:55.437+0000 7f529fb38640 0 -- 172.21.15.111:0/3853883544 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x560872ab35d0 msgr2=0x560872ab59c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:55.572 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:51:55.437+0000 7f51817fa640 1 client.7874.objecter ms_handle_reset 0x560872ab35d0 session 0x560872aaf070 osd.3 2024-09-12T18:51:55.572 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:51:55.437+0000 7f51817fa640 10 monclient: _renew_subs 2024-09-12T18:51:55.572 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:51:55.437+0000 7f51817fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:51:55.572 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:51:55.437+0000 7f529fb38640 10 monclient: get_auth_request con 0x7f5168080a00 auth_method 0 2024-09-12T18:51:55.572 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:51:55.437+0000 7f529f337640 10 monclient: get_auth_request con 0x7f529808ca10 auth_method 0 2024-09-12T18:51:55.572 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:51:55.441+0000 7f529eb36640 10 monclient: get_auth_request con 0x7f529807f090 auth_method 0 2024-09-12T18:51:55.572 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:51:55.441+0000 7f529eb36640 0 -- 172.21.15.111:0/3853883544 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f529807f090 msgr2=0x7f5298008c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:55.572 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:51:55.441+0000 7f51817fa640 1 client.7874.objecter ms_handle_reset 0x7f529807f090 session 0x7f5298059130 osd.0 2024-09-12T18:51:55.573 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:51:55.441+0000 7f529eb36640 10 monclient: get_auth_request con 0x560872ab35d0 auth_method 0 2024-09-12T18:51:55.573 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:51:55.573 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:51:55.573 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:51:55.573 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:51:55.573 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:51:55.573 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:51:55.573 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.573 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.573 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.573 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:55.573 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.573 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:51:55.573 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 zone default found 2024-09-12T18:51:55.574 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:51:55.453+0000 7f52a18319c0 4 Realm: () 2024-09-12T18:51:55.574 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:51:55.453+0000 7f52a18319c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:51:55.574 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:51:55.453+0000 7f52a18319c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:51:55.574 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:51:55.453+0000 7f52a18319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:51:55.574 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 zonegroup default 2024-09-12T18:51:55.574 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.574 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.574 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.574 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.574 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.574 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.574 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 started sync module instance, tier type = 2024-09-12T18:51:55.574 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:51:55.575 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=0 2024-09-12T18:51:55.575 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=1 2024-09-12T18:51:55.575 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=2 2024-09-12T18:51:55.575 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=3 2024-09-12T18:51:55.575 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=4 2024-09-12T18:51:55.575 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=5 2024-09-12T18:51:55.575 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=6 2024-09-12T18:51:55.575 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=7 2024-09-12T18:51:55.575 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:51:55.469+0000 7f52a18319c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:51:55.575 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding auth protocol: cephx 2024-09-12T18:51:55.575 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding auth protocol: cephx 2024-09-12T18:51:55.575 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding auth protocol: cephx 2024-09-12T18:51:55.575 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: secure 2024-09-12T18:51:55.575 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: crc 2024-09-12T18:51:55.576 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: secure 2024-09-12T18:51:55.576 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: crc 2024-09-12T18:51:55.576 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: secure 2024-09-12T18:51:55.576 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: crc 2024-09-12T18:51:55.576 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: crc 2024-09-12T18:51:55.576 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: secure 2024-09-12T18:51:55.576 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: crc 2024-09-12T18:51:55.576 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: secure 2024-09-12T18:51:55.576 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:51:55.469+0000 7f5155fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:51:55.576 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: crc 2024-09-12T18:51:55.576 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: secure 2024-09-12T18:51:55.576 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:51:55.473+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.576 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:51:55.577 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:51:55.577 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command cache list hook 0x560872a86a50 2024-09-12T18:51:55.577 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command cache inspect hook 0x560872a86a50 2024-09-12T18:51:55.577 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command cache erase hook 0x560872a86a50 2024-09-12T18:51:55.577 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command cache zap hook 0x560872a86a50 2024-09-12T18:51:55.577 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 note: GC not initialized 2024-09-12T18:51:55.577 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:51:55.473+0000 7f5154fe1640 20 reqs_thread_entry: start 2024-09-12T18:51:55.577 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command sync trace show hook 0x7f529808e070 2024-09-12T18:51:55.577 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command sync trace history hook 0x7f529808e070 2024-09-12T18:51:55.577 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command sync trace active hook 0x7f529808e070 2024-09-12T18:51:55.577 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command sync trace active_short hook 0x7f529808e070 2024-09-12T18:51:55.577 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 init_complete bucket index max shards: 11 2024-09-12T18:51:55.577 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 Filter name: none 2024-09-12T18:51:55.577 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:51:55.473+0000 7f50ce7fc640 20 reqs_thread_entry: start 2024-09-12T18:51:55.578 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:51:55.578 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.578 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:51:55.578 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:51:55.578 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:51:55.578 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:51:55.578 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.578 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:51:55.578 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:55.578 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:55.578 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:51:55.578 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:55.578 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:51:55.579 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:51:55.477+0000 7f52a18319c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:51:55.579 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:51:55.489+0000 7f52a18319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:55.579 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:51:55.489+0000 7f52a18319c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:55.579 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:51:55.489+0000 7f52a18319c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:55.579 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:51:55.489+0000 7f52a18319c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:51:55.579 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:51:55.489+0000 7f5182ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431690 cookie 94594283581264 notifier 7874 bl.length()=827 2024-09-12T18:51:55.579 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:51:55.489+0000 7f5182ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:55.579 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:51:55.489+0000 7f5182ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:55.579 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:51:55.489+0000 7f5182ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:55.579 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:51:55.489+0000 7f52a18319c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:51:55.579 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:51:55.489+0000 7f52a18319c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:51:55.579 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:51:55.489+0000 7f52a18319c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:51:55.579 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:51:55.489+0000 7f52a18319c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:51:55.580 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:51:55.505+0000 7f52a18319c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f52a18319c0 time 2024-09-12T18:51:55.510467+0000 2024-09-12T18:51:55.580 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:51:55.580 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.580 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:55.580 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f52a510b2eb] 2024-09-12T18:51:55.580 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f52a510b49f] 2024-09-12T18:51:55.580 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560870391cc1] 2024-09-12T18:51:55.580 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5608703a6d5a] 2024-09-12T18:51:55.580 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:51:55.580 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f52a3f71d90] 2024-09-12T18:51:55.580 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:51:55.580 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:51:55.580 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.581 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:51:55.505+0000 7f52a18319c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:51:55.581 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f52a18319c0 thread_name:radosgw-admin 2024-09-12T18:51:55.581 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.581 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:55.581 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f52a3f8a520] 2024-09-12T18:51:55.581 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:51:55.581 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:51:55.581 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:51:55.581 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f52a510b345] 2024-09-12T18:51:55.581 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f52a510b49f] 2024-09-12T18:51:55.581 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560870391cc1] 2024-09-12T18:51:55.581 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5608703a6d5a] 2024-09-12T18:51:55.581 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:51:55.581 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f52a3f71d90] 2024-09-12T18:51:55.582 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:51:55.582 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:51:55.582 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:51:55.582 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.582 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:51:55.582 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:51:55.582 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:51:55.582 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:51:55.582 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:51:55.582 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:51:55.582 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:51:55.582 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:51:55.582 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:51:55.582 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:51:55.583 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:51:55.583 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:51:55.583 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:51:55.583 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:51:55.583 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:51:55.583 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:51:55.583 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:51:55.583 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:51:55.583 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:51:55.583 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:51:55.583 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:51:55.583 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:51:55.583 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:51:55.584 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:51:55.584 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:51:55.584 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:51:55.584 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:51:55.584 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:51:55.584 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:51:55.584 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:51:55.584 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:51:55.584 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:51:55.584 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:51:55.584 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:51:55.584 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:51:55.584 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:51:55.585 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:51:55.585 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:51:55.585 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:51:55.585 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:51:55.585 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:51:55.585 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:51:55.585 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:51:55.585 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:51:55.585 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:51:55.585 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:51:55.585 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:51:55.585 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:51:55.585 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:51:55.585 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:51:55.586 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:51:55.586 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:51:55.586 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:51:55.586 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:51:55.586 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:51:55.586 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:51:55.586 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:51:55.586 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:51:55.586 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:51:55.586 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:51:55.586 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:51:55.586 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:51:55.586 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:51:55.586 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:51:55.587 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:51:55.587 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:51:55.587 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:51:55.587 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:51:55.587 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:51:55.587 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:51:55.587 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:51:55.587 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:51:55.587 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:51:55.587 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:51:55.587 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:51:55.587 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:51:55.587 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:51:55.588 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:51:55.588 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:51:55.588 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:51:55.588 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:51:55.588 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:51:55.588 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:51:55.588 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:51:55.588 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:51:55.588 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:51:55.588 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:51:55.588 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:51:55.588 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:51:55.588 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:51:55.588 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:51:55.589 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:51:55.589 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:51:55.589 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:51:55.589 INFO:tasks.workunit.client.0.smithi111.stderr: 7f50ce7fc640 / http_manager 2024-09-12T18:51:55.589 INFO:tasks.workunit.client.0.smithi111.stderr: 7f5154fe1640 / http_manager 2024-09-12T18:51:55.589 INFO:tasks.workunit.client.0.smithi111.stderr: 7f5155fe3640 / rgw_dt_lg_renew 2024-09-12T18:51:55.589 INFO:tasks.workunit.client.0.smithi111.stderr: 7f51817fa640 / ms_dispatch 2024-09-12T18:51:55.589 INFO:tasks.workunit.client.0.smithi111.stderr: 7f5182ffd640 / io_context_pool 2024-09-12T18:51:55.589 INFO:tasks.workunit.client.0.smithi111.stderr: 7f5189602640 / ms_dispatch 2024-09-12T18:51:55.589 INFO:tasks.workunit.client.0.smithi111.stderr: 7f518be07640 / ms_dispatch 2024-09-12T18:51:55.589 INFO:tasks.workunit.client.0.smithi111.stderr: 7f518d60a640 / io_context_pool 2024-09-12T18:51:55.589 INFO:tasks.workunit.client.0.smithi111.stderr: 7f529eb36640 / msgr-worker-2 2024-09-12T18:51:55.589 INFO:tasks.workunit.client.0.smithi111.stderr: 7f529f337640 / msgr-worker-1 2024-09-12T18:51:55.590 INFO:tasks.workunit.client.0.smithi111.stderr: 7f529fb38640 / msgr-worker-0 2024-09-12T18:51:55.590 INFO:tasks.workunit.client.0.smithi111.stderr: 7f52a0339640 / io_context_pool 2024-09-12T18:51:55.590 INFO:tasks.workunit.client.0.smithi111.stderr: 7f52a18319c0 / radosgw-admin 2024-09-12T18:51:55.590 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:51:55.590 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:51:55.590 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/log/ceph/ceph-client.admin.147287.log 2024-09-12T18:51:55.590 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:51:55.590 INFO:tasks.workunit.client.0.smithi111.stderr:--- begin dump of recent events --- 2024-09-12T18:51:55.590 INFO:tasks.workunit.client.0.smithi111.stderr: -499> 2024-09-12T18:51:55.405+0000 7f529f337640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.590 INFO:tasks.workunit.client.0.smithi111.stderr: -498> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient(hunting): handle_auth_done global_id 8412 payload 274 2024-09-12T18:51:55.590 INFO:tasks.workunit.client.0.smithi111.stderr: -497> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient: _finish_hunting 0 2024-09-12T18:51:55.590 INFO:tasks.workunit.client.0.smithi111.stderr: -496> 2024-09-12T18:51:55.405+0000 7f529fb38640 1 monclient: found mon.noname-a 2024-09-12T18:51:55.590 INFO:tasks.workunit.client.0.smithi111.stderr: -495> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:51:55.590 INFO:tasks.workunit.client.0.smithi111.stderr: -494> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.591 INFO:tasks.workunit.client.0.smithi111.stderr: -493> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:51:55.591 INFO:tasks.workunit.client.0.smithi111.stderr: -492> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: dump: 2024-09-12T18:51:55.591 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.591 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.591 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.591 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.591 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.591 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.591 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.591 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.591 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.592 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.592 INFO:tasks.workunit.client.0.smithi111.stderr: -491> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: _finish_auth 0 2024-09-12T18:51:55.592 INFO:tasks.workunit.client.0.smithi111.stderr: -490> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: _check_auth_tickets 2024-09-12T18:51:55.593 INFO:tasks.workunit.client.0.smithi111.stderr: -489> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:55.593 INFO:tasks.workunit.client.0.smithi111.stderr: -488> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 monclient: authenticate success, global_id 8412 2024-09-12T18:51:55.593 INFO:tasks.workunit.client.0.smithi111.stderr: -487> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient: get_monmap_and_config success 2024-09-12T18:51:55.593 INFO:tasks.workunit.client.0.smithi111.stderr: -486> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.593 INFO:tasks.workunit.client.0.smithi111.stderr: -485> 2024-09-12T18:51:55.405+0000 7f52a18319c0 4 set_mon_vals no callback set 2024-09-12T18:51:55.593 INFO:tasks.workunit.client.0.smithi111.stderr: -484> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:51:55.593 INFO:tasks.workunit.client.0.smithi111.stderr: -483> 2024-09-12T18:51:55.405+0000 7f518d60a640 10 monclient: dump: 2024-09-12T18:51:55.593 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.593 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.593 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.593 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.593 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.593 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.594 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.594 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.594 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.594 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.594 INFO:tasks.workunit.client.0.smithi111.stderr: -482> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient: shutdown 2024-09-12T18:51:55.594 INFO:tasks.workunit.client.0.smithi111.stderr: -481> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 asok(0x5608727b52b0) unregister_commands rotate-key 2024-09-12T18:51:55.594 INFO:tasks.workunit.client.0.smithi111.stderr: -480> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient: build_initial_monmap 2024-09-12T18:51:55.594 INFO:tasks.workunit.client.0.smithi111.stderr: -479> 2024-09-12T18:51:55.405+0000 7f52a18319c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:55.594 INFO:tasks.workunit.client.0.smithi111.stderr: -478> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient: monmap: 2024-09-12T18:51:55.594 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:55.594 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:55.594 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:55.594 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:55.594 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:55.595 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.595 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:55.595 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:55.595 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:55.595 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.595 INFO:tasks.workunit.client.0.smithi111.stderr: -477> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding auth protocol: cephx 2024-09-12T18:51:55.595 INFO:tasks.workunit.client.0.smithi111.stderr: -476> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding auth protocol: cephx 2024-09-12T18:51:55.595 INFO:tasks.workunit.client.0.smithi111.stderr: -475> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding auth protocol: cephx 2024-09-12T18:51:55.595 INFO:tasks.workunit.client.0.smithi111.stderr: -474> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: secure 2024-09-12T18:51:55.595 INFO:tasks.workunit.client.0.smithi111.stderr: -473> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: crc 2024-09-12T18:51:55.595 INFO:tasks.workunit.client.0.smithi111.stderr: -472> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: secure 2024-09-12T18:51:55.595 INFO:tasks.workunit.client.0.smithi111.stderr: -471> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: crc 2024-09-12T18:51:55.595 INFO:tasks.workunit.client.0.smithi111.stderr: -470> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: secure 2024-09-12T18:51:55.596 INFO:tasks.workunit.client.0.smithi111.stderr: -469> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: crc 2024-09-12T18:51:55.596 INFO:tasks.workunit.client.0.smithi111.stderr: -468> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: crc 2024-09-12T18:51:55.596 INFO:tasks.workunit.client.0.smithi111.stderr: -467> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: secure 2024-09-12T18:51:55.596 INFO:tasks.workunit.client.0.smithi111.stderr: -466> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: crc 2024-09-12T18:51:55.596 INFO:tasks.workunit.client.0.smithi111.stderr: -465> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: secure 2024-09-12T18:51:55.596 INFO:tasks.workunit.client.0.smithi111.stderr: -464> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: crc 2024-09-12T18:51:55.596 INFO:tasks.workunit.client.0.smithi111.stderr: -463> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c3310) adding con mode: secure 2024-09-12T18:51:55.596 INFO:tasks.workunit.client.0.smithi111.stderr: -462> 2024-09-12T18:51:55.405+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.596 INFO:tasks.workunit.client.0.smithi111.stderr: -461> 2024-09-12T18:51:55.405+0000 7f52a18319c0 1 librados: starting msgr at 2024-09-12T18:51:55.596 INFO:tasks.workunit.client.0.smithi111.stderr: -460> 2024-09-12T18:51:55.405+0000 7f52a18319c0 1 librados: starting objecter 2024-09-12T18:51:55.596 INFO:tasks.workunit.client.0.smithi111.stderr: -459> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command objecter_requests hook 0x5608727e0950 2024-09-12T18:51:55.596 INFO:tasks.workunit.client.0.smithi111.stderr: -458> 2024-09-12T18:51:55.405+0000 7f52a18319c0 1 librados: setting wanted keys 2024-09-12T18:51:55.596 INFO:tasks.workunit.client.0.smithi111.stderr: -457> 2024-09-12T18:51:55.405+0000 7f52a18319c0 1 librados: calling monclient init 2024-09-12T18:51:55.597 INFO:tasks.workunit.client.0.smithi111.stderr: -456> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient: init 2024-09-12T18:51:55.597 INFO:tasks.workunit.client.0.smithi111.stderr: -455> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding auth protocol: cephx 2024-09-12T18:51:55.597 INFO:tasks.workunit.client.0.smithi111.stderr: -454> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding auth protocol: cephx 2024-09-12T18:51:55.597 INFO:tasks.workunit.client.0.smithi111.stderr: -453> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding auth protocol: cephx 2024-09-12T18:51:55.597 INFO:tasks.workunit.client.0.smithi111.stderr: -452> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: secure 2024-09-12T18:51:55.597 INFO:tasks.workunit.client.0.smithi111.stderr: -451> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: crc 2024-09-12T18:51:55.597 INFO:tasks.workunit.client.0.smithi111.stderr: -450> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: secure 2024-09-12T18:51:55.597 INFO:tasks.workunit.client.0.smithi111.stderr: -449> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: crc 2024-09-12T18:51:55.597 INFO:tasks.workunit.client.0.smithi111.stderr: -448> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: secure 2024-09-12T18:51:55.597 INFO:tasks.workunit.client.0.smithi111.stderr: -447> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: crc 2024-09-12T18:51:55.597 INFO:tasks.workunit.client.0.smithi111.stderr: -446> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: crc 2024-09-12T18:51:55.597 INFO:tasks.workunit.client.0.smithi111.stderr: -445> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: secure 2024-09-12T18:51:55.597 INFO:tasks.workunit.client.0.smithi111.stderr: -444> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: crc 2024-09-12T18:51:55.598 INFO:tasks.workunit.client.0.smithi111.stderr: -443> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: secure 2024-09-12T18:51:55.598 INFO:tasks.workunit.client.0.smithi111.stderr: -442> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: crc 2024-09-12T18:51:55.598 INFO:tasks.workunit.client.0.smithi111.stderr: -441> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 AuthRegistry(0x5608729c0200) adding con mode: secure 2024-09-12T18:51:55.598 INFO:tasks.workunit.client.0.smithi111.stderr: -440> 2024-09-12T18:51:55.405+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.598 INFO:tasks.workunit.client.0.smithi111.stderr: -439> 2024-09-12T18:51:55.405+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.598 INFO:tasks.workunit.client.0.smithi111.stderr: -438> 2024-09-12T18:51:55.405+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command rotate-key hook 0x5608729c0348 2024-09-12T18:51:55.598 INFO:tasks.workunit.client.0.smithi111.stderr: -437> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:55.598 INFO:tasks.workunit.client.0.smithi111.stderr: -436> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T18:51:55.598 INFO:tasks.workunit.client.0.smithi111.stderr: -435> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-c con 0x560872877530 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:55.598 INFO:tasks.workunit.client.0.smithi111.stderr: -434> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-b con 0x56087287d5b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:55.598 INFO:tasks.workunit.client.0.smithi111.stderr: -433> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-a con 0x5608729c6610 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:55.598 INFO:tasks.workunit.client.0.smithi111.stderr: -432> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.599 INFO:tasks.workunit.client.0.smithi111.stderr: -431> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.599 INFO:tasks.workunit.client.0.smithi111.stderr: -430> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.599 INFO:tasks.workunit.client.0.smithi111.stderr: -429> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:55.599 INFO:tasks.workunit.client.0.smithi111.stderr: -428> 2024-09-12T18:51:55.405+0000 7f52a18319c0 10 monclient(hunting): authenticate will time out at 2502.551795s 2024-09-12T18:51:55.599 INFO:tasks.workunit.client.0.smithi111.stderr: -427> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient(hunting): get_auth_request con 0x5608729c6610 auth_method 0 2024-09-12T18:51:55.599 INFO:tasks.workunit.client.0.smithi111.stderr: -426> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.599 INFO:tasks.workunit.client.0.smithi111.stderr: -425> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.599 INFO:tasks.workunit.client.0.smithi111.stderr: -424> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.599 INFO:tasks.workunit.client.0.smithi111.stderr: -423> 2024-09-12T18:51:55.405+0000 7f529f337640 10 monclient(hunting): get_auth_request con 0x560872877530 auth_method 0 2024-09-12T18:51:55.599 INFO:tasks.workunit.client.0.smithi111.stderr: -422> 2024-09-12T18:51:55.405+0000 7f529f337640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.599 INFO:tasks.workunit.client.0.smithi111.stderr: -421> 2024-09-12T18:51:55.405+0000 7f529f337640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.599 INFO:tasks.workunit.client.0.smithi111.stderr: -420> 2024-09-12T18:51:55.405+0000 7f529f337640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.599 INFO:tasks.workunit.client.0.smithi111.stderr: -419> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.600 INFO:tasks.workunit.client.0.smithi111.stderr: -418> 2024-09-12T18:51:55.405+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.600 INFO:tasks.workunit.client.0.smithi111.stderr: -417> 2024-09-12T18:51:55.409+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.600 INFO:tasks.workunit.client.0.smithi111.stderr: -416> 2024-09-12T18:51:55.409+0000 7f529f337640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.600 INFO:tasks.workunit.client.0.smithi111.stderr: -415> 2024-09-12T18:51:55.409+0000 7f529f337640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.600 INFO:tasks.workunit.client.0.smithi111.stderr: -414> 2024-09-12T18:51:55.409+0000 7f529f337640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.600 INFO:tasks.workunit.client.0.smithi111.stderr: -413> 2024-09-12T18:51:55.409+0000 7f529fb38640 10 monclient(hunting): handle_auth_done global_id 8415 payload 824 2024-09-12T18:51:55.600 INFO:tasks.workunit.client.0.smithi111.stderr: -412> 2024-09-12T18:51:55.409+0000 7f529fb38640 10 monclient: _finish_hunting 0 2024-09-12T18:51:55.600 INFO:tasks.workunit.client.0.smithi111.stderr: -411> 2024-09-12T18:51:55.409+0000 7f529fb38640 1 monclient: found mon.noname-a 2024-09-12T18:51:55.600 INFO:tasks.workunit.client.0.smithi111.stderr: -410> 2024-09-12T18:51:55.409+0000 7f529fb38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:51:55.600 INFO:tasks.workunit.client.0.smithi111.stderr: -409> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.600 INFO:tasks.workunit.client.0.smithi111.stderr: -408> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:51:55.600 INFO:tasks.workunit.client.0.smithi111.stderr: -407> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: dump: 2024-09-12T18:51:55.601 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.601 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.601 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.601 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.601 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.601 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.601 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.601 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.601 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.601 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.601 INFO:tasks.workunit.client.0.smithi111.stderr: -406> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: _finish_auth 0 2024-09-12T18:51:55.601 INFO:tasks.workunit.client.0.smithi111.stderr: -405> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: _check_auth_tickets 2024-09-12T18:51:55.601 INFO:tasks.workunit.client.0.smithi111.stderr: -404> 2024-09-12T18:51:55.409+0000 7f52a18319c0 5 monclient: authenticate success, global_id 8415 2024-09-12T18:51:55.601 INFO:tasks.workunit.client.0.smithi111.stderr: -403> 2024-09-12T18:51:55.409+0000 7f52a18319c0 10 monclient: _renew_subs 2024-09-12T18:51:55.602 INFO:tasks.workunit.client.0.smithi111.stderr: -402> 2024-09-12T18:51:55.409+0000 7f52a18319c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:55.602 INFO:tasks.workunit.client.0.smithi111.stderr: -401> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:55.602 INFO:tasks.workunit.client.0.smithi111.stderr: -400> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.602 INFO:tasks.workunit.client.0.smithi111.stderr: -399> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:51:55.602 INFO:tasks.workunit.client.0.smithi111.stderr: -398> 2024-09-12T18:51:55.409+0000 7f518be07640 10 monclient: dump: 2024-09-12T18:51:55.602 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.602 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.602 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.602 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.602 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.602 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.602 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.602 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.603 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.603 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.603 INFO:tasks.workunit.client.0.smithi111.stderr: -397> 2024-09-12T18:51:55.409+0000 7f518d60a640 4 set_mon_vals no callback set 2024-09-12T18:51:55.603 INFO:tasks.workunit.client.0.smithi111.stderr: -396> 2024-09-12T18:51:55.409+0000 7f52a18319c0 10 monclient: _renew_subs 2024-09-12T18:51:55.603 INFO:tasks.workunit.client.0.smithi111.stderr: -395> 2024-09-12T18:51:55.409+0000 7f52a18319c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:55.603 INFO:tasks.workunit.client.0.smithi111.stderr: -394> 2024-09-12T18:51:55.409+0000 7f52a18319c0 1 librados: init done 2024-09-12T18:51:55.603 INFO:tasks.workunit.client.0.smithi111.stderr: -393> 2024-09-12T18:51:55.409+0000 7f518be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:51:55.603 INFO:tasks.workunit.client.0.smithi111.stderr: -392> 2024-09-12T18:51:55.409+0000 7f518be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:55.603 INFO:tasks.workunit.client.0.smithi111.stderr: -391> 2024-09-12T18:51:55.409+0000 7f518be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:55.603 INFO:tasks.workunit.client.0.smithi111.stderr: -390> 2024-09-12T18:51:55.409+0000 7f529f337640 10 monclient: get_auth_request con 0x7f5184070ae0 auth_method 0 2024-09-12T18:51:55.603 INFO:tasks.workunit.client.0.smithi111.stderr: -389> 2024-09-12T18:51:55.409+0000 7f529eb36640 10 monclient: get_auth_request con 0x5608729ff130 auth_method 0 2024-09-12T18:51:55.603 INFO:tasks.workunit.client.0.smithi111.stderr: -388> 2024-09-12T18:51:55.413+0000 7f529f337640 10 monclient: get_auth_request con 0x560872a0aae0 auth_method 0 2024-09-12T18:51:55.603 INFO:tasks.workunit.client.0.smithi111.stderr: -387> 2024-09-12T18:51:55.413+0000 7f529eb36640 10 monclient: get_auth_request con 0x560872a0ef90 auth_method 0 2024-09-12T18:51:55.603 INFO:tasks.workunit.client.0.smithi111.stderr: -386> 2024-09-12T18:51:55.413+0000 7f529fb38640 10 monclient: get_auth_request con 0x560872a12fd0 auth_method 0 2024-09-12T18:51:55.604 INFO:tasks.workunit.client.0.smithi111.stderr: -385> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: build_initial_monmap 2024-09-12T18:51:55.604 INFO:tasks.workunit.client.0.smithi111.stderr: -384> 2024-09-12T18:51:55.417+0000 7f52a18319c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:55.604 INFO:tasks.workunit.client.0.smithi111.stderr: -383> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: monmap: 2024-09-12T18:51:55.604 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:55.604 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:55.604 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:55.604 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:55.604 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:55.604 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.604 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:55.604 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:55.604 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:55.604 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.605 INFO:tasks.workunit.client.0.smithi111.stderr: -382> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding auth protocol: cephx 2024-09-12T18:51:55.605 INFO:tasks.workunit.client.0.smithi111.stderr: -381> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding auth protocol: cephx 2024-09-12T18:51:55.605 INFO:tasks.workunit.client.0.smithi111.stderr: -380> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding auth protocol: cephx 2024-09-12T18:51:55.605 INFO:tasks.workunit.client.0.smithi111.stderr: -379> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: secure 2024-09-12T18:51:55.605 INFO:tasks.workunit.client.0.smithi111.stderr: -378> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: crc 2024-09-12T18:51:55.605 INFO:tasks.workunit.client.0.smithi111.stderr: -377> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: secure 2024-09-12T18:51:55.605 INFO:tasks.workunit.client.0.smithi111.stderr: -376> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: crc 2024-09-12T18:51:55.605 INFO:tasks.workunit.client.0.smithi111.stderr: -375> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: secure 2024-09-12T18:51:55.605 INFO:tasks.workunit.client.0.smithi111.stderr: -374> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: crc 2024-09-12T18:51:55.605 INFO:tasks.workunit.client.0.smithi111.stderr: -373> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: crc 2024-09-12T18:51:55.605 INFO:tasks.workunit.client.0.smithi111.stderr: -372> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: secure 2024-09-12T18:51:55.605 INFO:tasks.workunit.client.0.smithi111.stderr: -371> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: crc 2024-09-12T18:51:55.605 INFO:tasks.workunit.client.0.smithi111.stderr: -370> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: secure 2024-09-12T18:51:55.605 INFO:tasks.workunit.client.0.smithi111.stderr: -369> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: crc 2024-09-12T18:51:55.606 INFO:tasks.workunit.client.0.smithi111.stderr: -368> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a170a0) adding con mode: secure 2024-09-12T18:51:55.606 INFO:tasks.workunit.client.0.smithi111.stderr: -367> 2024-09-12T18:51:55.417+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.606 INFO:tasks.workunit.client.0.smithi111.stderr: -366> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command objecter_requests cmddesc objecter_requests hook 0x560872a1aaf0 EEXIST 2024-09-12T18:51:55.606 INFO:tasks.workunit.client.0.smithi111.stderr: -365> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: init 2024-09-12T18:51:55.606 INFO:tasks.workunit.client.0.smithi111.stderr: -364> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding auth protocol: cephx 2024-09-12T18:51:55.606 INFO:tasks.workunit.client.0.smithi111.stderr: -363> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding auth protocol: cephx 2024-09-12T18:51:55.606 INFO:tasks.workunit.client.0.smithi111.stderr: -362> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding auth protocol: cephx 2024-09-12T18:51:55.606 INFO:tasks.workunit.client.0.smithi111.stderr: -361> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: secure 2024-09-12T18:51:55.606 INFO:tasks.workunit.client.0.smithi111.stderr: -360> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: crc 2024-09-12T18:51:55.606 INFO:tasks.workunit.client.0.smithi111.stderr: -359> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: secure 2024-09-12T18:51:55.606 INFO:tasks.workunit.client.0.smithi111.stderr: -358> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: crc 2024-09-12T18:51:55.606 INFO:tasks.workunit.client.0.smithi111.stderr: -357> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: secure 2024-09-12T18:51:55.606 INFO:tasks.workunit.client.0.smithi111.stderr: -356> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: crc 2024-09-12T18:51:55.607 INFO:tasks.workunit.client.0.smithi111.stderr: -355> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: crc 2024-09-12T18:51:55.607 INFO:tasks.workunit.client.0.smithi111.stderr: -354> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: secure 2024-09-12T18:51:55.607 INFO:tasks.workunit.client.0.smithi111.stderr: -353> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: crc 2024-09-12T18:51:55.607 INFO:tasks.workunit.client.0.smithi111.stderr: -352> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: secure 2024-09-12T18:51:55.607 INFO:tasks.workunit.client.0.smithi111.stderr: -351> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: crc 2024-09-12T18:51:55.607 INFO:tasks.workunit.client.0.smithi111.stderr: -350> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 AuthRegistry(0x560872a15fe8) adding con mode: secure 2024-09-12T18:51:55.607 INFO:tasks.workunit.client.0.smithi111.stderr: -349> 2024-09-12T18:51:55.417+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.607 INFO:tasks.workunit.client.0.smithi111.stderr: -348> 2024-09-12T18:51:55.417+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.607 INFO:tasks.workunit.client.0.smithi111.stderr: -347> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command rotate-key cmddesc rotate-key hook 0x560872a16130 EEXIST 2024-09-12T18:51:55.607 INFO:tasks.workunit.client.0.smithi111.stderr: -346> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:55.607 INFO:tasks.workunit.client.0.smithi111.stderr: -345> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T18:51:55.607 INFO:tasks.workunit.client.0.smithi111.stderr: -344> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-c con 0x560872a3eca0 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:55.607 INFO:tasks.workunit.client.0.smithi111.stderr: -343> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-a con 0x560872a3e5d0 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:55.608 INFO:tasks.workunit.client.0.smithi111.stderr: -342> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-b con 0x560872a3cfb0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:55.608 INFO:tasks.workunit.client.0.smithi111.stderr: -341> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.608 INFO:tasks.workunit.client.0.smithi111.stderr: -340> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.608 INFO:tasks.workunit.client.0.smithi111.stderr: -339> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.608 INFO:tasks.workunit.client.0.smithi111.stderr: -338> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:55.608 INFO:tasks.workunit.client.0.smithi111.stderr: -337> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient(hunting): authenticate will time out at 2502.562006s 2024-09-12T18:51:55.608 INFO:tasks.workunit.client.0.smithi111.stderr: -336> 2024-09-12T18:51:55.417+0000 7f529eb36640 10 monclient(hunting): get_auth_request con 0x560872a3eca0 auth_method 0 2024-09-12T18:51:55.608 INFO:tasks.workunit.client.0.smithi111.stderr: -335> 2024-09-12T18:51:55.417+0000 7f529eb36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.608 INFO:tasks.workunit.client.0.smithi111.stderr: -334> 2024-09-12T18:51:55.417+0000 7f529eb36640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.608 INFO:tasks.workunit.client.0.smithi111.stderr: -333> 2024-09-12T18:51:55.417+0000 7f529eb36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.608 INFO:tasks.workunit.client.0.smithi111.stderr: -332> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): get_auth_request con 0x560872a3e5d0 auth_method 0 2024-09-12T18:51:55.608 INFO:tasks.workunit.client.0.smithi111.stderr: -331> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.609 INFO:tasks.workunit.client.0.smithi111.stderr: -330> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.609 INFO:tasks.workunit.client.0.smithi111.stderr: -329> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.609 INFO:tasks.workunit.client.0.smithi111.stderr: -328> 2024-09-12T18:51:55.417+0000 7f529eb36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.609 INFO:tasks.workunit.client.0.smithi111.stderr: -327> 2024-09-12T18:51:55.417+0000 7f529eb36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.609 INFO:tasks.workunit.client.0.smithi111.stderr: -326> 2024-09-12T18:51:55.417+0000 7f529eb36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.609 INFO:tasks.workunit.client.0.smithi111.stderr: -325> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.609 INFO:tasks.workunit.client.0.smithi111.stderr: -324> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.609 INFO:tasks.workunit.client.0.smithi111.stderr: -323> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.609 INFO:tasks.workunit.client.0.smithi111.stderr: -322> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient(hunting): handle_auth_done global_id 8418 payload 824 2024-09-12T18:51:55.609 INFO:tasks.workunit.client.0.smithi111.stderr: -321> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient: _finish_hunting 0 2024-09-12T18:51:55.609 INFO:tasks.workunit.client.0.smithi111.stderr: -320> 2024-09-12T18:51:55.417+0000 7f529fb38640 1 monclient: found mon.noname-a 2024-09-12T18:51:55.609 INFO:tasks.workunit.client.0.smithi111.stderr: -319> 2024-09-12T18:51:55.417+0000 7f529fb38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.111:3300/0 2024-09-12T18:51:55.609 INFO:tasks.workunit.client.0.smithi111.stderr: -318> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.609 INFO:tasks.workunit.client.0.smithi111.stderr: -317> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T18:51:55.610 INFO:tasks.workunit.client.0.smithi111.stderr: -316> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: dump: 2024-09-12T18:51:55.610 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.610 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.610 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.610 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.610 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.610 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.610 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.610 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.610 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.610 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.610 INFO:tasks.workunit.client.0.smithi111.stderr: -315> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: _finish_auth 0 2024-09-12T18:51:55.610 INFO:tasks.workunit.client.0.smithi111.stderr: -314> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: _check_auth_tickets 2024-09-12T18:51:55.610 INFO:tasks.workunit.client.0.smithi111.stderr: -313> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:55.611 INFO:tasks.workunit.client.0.smithi111.stderr: -312> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.611 INFO:tasks.workunit.client.0.smithi111.stderr: -311> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T18:51:55.611 INFO:tasks.workunit.client.0.smithi111.stderr: -310> 2024-09-12T18:51:55.417+0000 7f5189602640 10 monclient: dump: 2024-09-12T18:51:55.611 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.611 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.611 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.611 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.611 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.611 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.611 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.611 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.611 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.611 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.611 INFO:tasks.workunit.client.0.smithi111.stderr: -309> 2024-09-12T18:51:55.417+0000 7f52a0339640 4 set_mon_vals no callback set 2024-09-12T18:51:55.612 INFO:tasks.workunit.client.0.smithi111.stderr: -308> 2024-09-12T18:51:55.417+0000 7f52a18319c0 5 monclient: authenticate success, global_id 8418 2024-09-12T18:51:55.612 INFO:tasks.workunit.client.0.smithi111.stderr: -307> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: _renew_subs 2024-09-12T18:51:55.612 INFO:tasks.workunit.client.0.smithi111.stderr: -306> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:55.612 INFO:tasks.workunit.client.0.smithi111.stderr: -305> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: _renew_subs 2024-09-12T18:51:55.612 INFO:tasks.workunit.client.0.smithi111.stderr: -304> 2024-09-12T18:51:55.417+0000 7f52a18319c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.111:3300/0 2024-09-12T18:51:55.612 INFO:tasks.workunit.client.0.smithi111.stderr: -303> 2024-09-12T18:51:55.421+0000 7f5189602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:51:55.612 INFO:tasks.workunit.client.0.smithi111.stderr: -302> 2024-09-12T18:51:55.421+0000 7f5189602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:55.612 INFO:tasks.workunit.client.0.smithi111.stderr: -301> 2024-09-12T18:51:55.421+0000 7f5189602640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:55.612 INFO:tasks.workunit.client.0.smithi111.stderr: -300> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient: get_auth_request con 0x7f5178070a20 auth_method 0 2024-09-12T18:51:55.612 INFO:tasks.workunit.client.0.smithi111.stderr: -299> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: get_monmap_and_config 2024-09-12T18:51:55.612 INFO:tasks.workunit.client.0.smithi111.stderr: -298> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: build_initial_monmap 2024-09-12T18:51:55.612 INFO:tasks.workunit.client.0.smithi111.stderr: -297> 2024-09-12T18:51:55.421+0000 7f52a18319c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:55.612 INFO:tasks.workunit.client.0.smithi111.stderr: -296> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: monmap: 2024-09-12T18:51:55.613 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:55.613 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:55.613 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:55.613 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:55.613 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:55.613 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.613 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:55.613 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:55.613 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:55.613 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.613 INFO:tasks.workunit.client.0.smithi111.stderr: -295> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding auth protocol: cephx 2024-09-12T18:51:55.613 INFO:tasks.workunit.client.0.smithi111.stderr: -294> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding auth protocol: cephx 2024-09-12T18:51:55.613 INFO:tasks.workunit.client.0.smithi111.stderr: -293> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding auth protocol: cephx 2024-09-12T18:51:55.614 INFO:tasks.workunit.client.0.smithi111.stderr: -292> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: secure 2024-09-12T18:51:55.614 INFO:tasks.workunit.client.0.smithi111.stderr: -291> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: crc 2024-09-12T18:51:55.614 INFO:tasks.workunit.client.0.smithi111.stderr: -290> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: secure 2024-09-12T18:51:55.614 INFO:tasks.workunit.client.0.smithi111.stderr: -289> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: crc 2024-09-12T18:51:55.614 INFO:tasks.workunit.client.0.smithi111.stderr: -288> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: secure 2024-09-12T18:51:55.614 INFO:tasks.workunit.client.0.smithi111.stderr: -287> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: crc 2024-09-12T18:51:55.614 INFO:tasks.workunit.client.0.smithi111.stderr: -286> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: crc 2024-09-12T18:51:55.614 INFO:tasks.workunit.client.0.smithi111.stderr: -285> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: secure 2024-09-12T18:51:55.614 INFO:tasks.workunit.client.0.smithi111.stderr: -284> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: crc 2024-09-12T18:51:55.614 INFO:tasks.workunit.client.0.smithi111.stderr: -283> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: secure 2024-09-12T18:51:55.614 INFO:tasks.workunit.client.0.smithi111.stderr: -282> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: crc 2024-09-12T18:51:55.614 INFO:tasks.workunit.client.0.smithi111.stderr: -281> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e0c0) adding con mode: secure 2024-09-12T18:51:55.614 INFO:tasks.workunit.client.0.smithi111.stderr: -280> 2024-09-12T18:51:55.421+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.615 INFO:tasks.workunit.client.0.smithi111.stderr: -279> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: init 2024-09-12T18:51:55.615 INFO:tasks.workunit.client.0.smithi111.stderr: -278> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding auth protocol: cephx 2024-09-12T18:51:55.615 INFO:tasks.workunit.client.0.smithi111.stderr: -277> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding auth protocol: cephx 2024-09-12T18:51:55.615 INFO:tasks.workunit.client.0.smithi111.stderr: -276> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding auth protocol: cephx 2024-09-12T18:51:55.615 INFO:tasks.workunit.client.0.smithi111.stderr: -275> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: secure 2024-09-12T18:51:55.615 INFO:tasks.workunit.client.0.smithi111.stderr: -274> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: crc 2024-09-12T18:51:55.615 INFO:tasks.workunit.client.0.smithi111.stderr: -273> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: secure 2024-09-12T18:51:55.615 INFO:tasks.workunit.client.0.smithi111.stderr: -272> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: crc 2024-09-12T18:51:55.615 INFO:tasks.workunit.client.0.smithi111.stderr: -271> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: secure 2024-09-12T18:51:55.615 INFO:tasks.workunit.client.0.smithi111.stderr: -270> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: crc 2024-09-12T18:51:55.615 INFO:tasks.workunit.client.0.smithi111.stderr: -269> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: crc 2024-09-12T18:51:55.615 INFO:tasks.workunit.client.0.smithi111.stderr: -268> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: secure 2024-09-12T18:51:55.615 INFO:tasks.workunit.client.0.smithi111.stderr: -267> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: crc 2024-09-12T18:51:55.616 INFO:tasks.workunit.client.0.smithi111.stderr: -266> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: secure 2024-09-12T18:51:55.616 INFO:tasks.workunit.client.0.smithi111.stderr: -265> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: crc 2024-09-12T18:51:55.616 INFO:tasks.workunit.client.0.smithi111.stderr: -264> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e6d10) adding con mode: secure 2024-09-12T18:51:55.616 INFO:tasks.workunit.client.0.smithi111.stderr: -263> 2024-09-12T18:51:55.421+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.616 INFO:tasks.workunit.client.0.smithi111.stderr: -262> 2024-09-12T18:51:55.421+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.616 INFO:tasks.workunit.client.0.smithi111.stderr: -261> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc4a9e6e58 EEXIST 2024-09-12T18:51:55.616 INFO:tasks.workunit.client.0.smithi111.stderr: -260> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:55.616 INFO:tasks.workunit.client.0.smithi111.stderr: -259> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T18:51:55.616 INFO:tasks.workunit.client.0.smithi111.stderr: -258> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-a con 0x560872a8c690 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:55.616 INFO:tasks.workunit.client.0.smithi111.stderr: -257> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-c con 0x560872a8ca70 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:55.616 INFO:tasks.workunit.client.0.smithi111.stderr: -256> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-b con 0x560872a8df30 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:55.616 INFO:tasks.workunit.client.0.smithi111.stderr: -255> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.616 INFO:tasks.workunit.client.0.smithi111.stderr: -254> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.617 INFO:tasks.workunit.client.0.smithi111.stderr: -253> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.617 INFO:tasks.workunit.client.0.smithi111.stderr: -252> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:55.617 INFO:tasks.workunit.client.0.smithi111.stderr: -251> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient(hunting): authenticate will time out at 2502.566185s 2024-09-12T18:51:55.617 INFO:tasks.workunit.client.0.smithi111.stderr: -250> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): get_auth_request con 0x560872a8ca70 auth_method 0 2024-09-12T18:51:55.617 INFO:tasks.workunit.client.0.smithi111.stderr: -249> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.617 INFO:tasks.workunit.client.0.smithi111.stderr: -248> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.617 INFO:tasks.workunit.client.0.smithi111.stderr: -247> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.617 INFO:tasks.workunit.client.0.smithi111.stderr: -246> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient(hunting): get_auth_request con 0x560872a8c690 auth_method 0 2024-09-12T18:51:55.617 INFO:tasks.workunit.client.0.smithi111.stderr: -245> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.617 INFO:tasks.workunit.client.0.smithi111.stderr: -244> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.617 INFO:tasks.workunit.client.0.smithi111.stderr: -243> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.617 INFO:tasks.workunit.client.0.smithi111.stderr: -242> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.617 INFO:tasks.workunit.client.0.smithi111.stderr: -241> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.617 INFO:tasks.workunit.client.0.smithi111.stderr: -240> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.620 INFO:tasks.workunit.client.0.smithi111.stderr: -239> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.620 INFO:tasks.workunit.client.0.smithi111.stderr: -238> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.620 INFO:tasks.workunit.client.0.smithi111.stderr: -237> 2024-09-12T18:51:55.421+0000 7f529eb36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.620 INFO:tasks.workunit.client.0.smithi111.stderr: -236> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient(hunting): handle_auth_done global_id 7871 payload 274 2024-09-12T18:51:55.620 INFO:tasks.workunit.client.0.smithi111.stderr: -235> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient: _finish_hunting 0 2024-09-12T18:51:55.620 INFO:tasks.workunit.client.0.smithi111.stderr: -234> 2024-09-12T18:51:55.421+0000 7f529fb38640 1 monclient: found mon.noname-c 2024-09-12T18:51:55.621 INFO:tasks.workunit.client.0.smithi111.stderr: -233> 2024-09-12T18:51:55.421+0000 7f529fb38640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:51:55.621 INFO:tasks.workunit.client.0.smithi111.stderr: -232> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.621 INFO:tasks.workunit.client.0.smithi111.stderr: -231> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:51:55.621 INFO:tasks.workunit.client.0.smithi111.stderr: -230> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: dump: 2024-09-12T18:51:55.621 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.621 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.621 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.621 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.621 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.621 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.621 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.621 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.621 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.621 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.622 INFO:tasks.workunit.client.0.smithi111.stderr: -229> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: _finish_auth 0 2024-09-12T18:51:55.622 INFO:tasks.workunit.client.0.smithi111.stderr: -228> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: _check_auth_tickets 2024-09-12T18:51:55.622 INFO:tasks.workunit.client.0.smithi111.stderr: -227> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:55.622 INFO:tasks.workunit.client.0.smithi111.stderr: -226> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 monclient: authenticate success, global_id 7871 2024-09-12T18:51:55.622 INFO:tasks.workunit.client.0.smithi111.stderr: -225> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: get_monmap_and_config success 2024-09-12T18:51:55.622 INFO:tasks.workunit.client.0.smithi111.stderr: -224> 2024-09-12T18:51:55.421+0000 7f52a18319c0 4 set_mon_vals no callback set 2024-09-12T18:51:55.622 INFO:tasks.workunit.client.0.smithi111.stderr: -223> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.622 INFO:tasks.workunit.client.0.smithi111.stderr: -222> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:51:55.622 INFO:tasks.workunit.client.0.smithi111.stderr: -221> 2024-09-12T18:51:55.421+0000 7f5182ffd640 10 monclient: dump: 2024-09-12T18:51:55.622 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.622 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.622 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.622 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.623 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.623 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.623 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.623 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.623 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.623 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.623 INFO:tasks.workunit.client.0.smithi111.stderr: -220> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: shutdown 2024-09-12T18:51:55.623 INFO:tasks.workunit.client.0.smithi111.stderr: -219> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: build_initial_monmap 2024-09-12T18:51:55.623 INFO:tasks.workunit.client.0.smithi111.stderr: -218> 2024-09-12T18:51:55.421+0000 7f52a18319c0 1 build_initial for_mkfs: 0 2024-09-12T18:51:55.623 INFO:tasks.workunit.client.0.smithi111.stderr: -217> 2024-09-12T18:51:55.421+0000 7f52a18319c0 10 monclient: monmap: 2024-09-12T18:51:55.623 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 0 2024-09-12T18:51:55.623 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T18:51:55.623 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 0.000000 2024-09-12T18:51:55.623 INFO:tasks.workunit.client.0.smithi111.stderr:created 0.000000 2024-09-12T18:51:55.624 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 0 (unknown) 2024-09-12T18:51:55.624 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.624 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.noname-a 2024-09-12T18:51:55.624 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-b 2024-09-12T18:51:55.624 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.noname-c 2024-09-12T18:51:55.624 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.624 INFO:tasks.workunit.client.0.smithi111.stderr: -216> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding auth protocol: cephx 2024-09-12T18:51:55.624 INFO:tasks.workunit.client.0.smithi111.stderr: -215> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding auth protocol: cephx 2024-09-12T18:51:55.624 INFO:tasks.workunit.client.0.smithi111.stderr: -214> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding auth protocol: cephx 2024-09-12T18:51:55.624 INFO:tasks.workunit.client.0.smithi111.stderr: -213> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: secure 2024-09-12T18:51:55.624 INFO:tasks.workunit.client.0.smithi111.stderr: -212> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: crc 2024-09-12T18:51:55.624 INFO:tasks.workunit.client.0.smithi111.stderr: -211> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: secure 2024-09-12T18:51:55.624 INFO:tasks.workunit.client.0.smithi111.stderr: -210> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: crc 2024-09-12T18:51:55.625 INFO:tasks.workunit.client.0.smithi111.stderr: -209> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: secure 2024-09-12T18:51:55.625 INFO:tasks.workunit.client.0.smithi111.stderr: -208> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: crc 2024-09-12T18:51:55.625 INFO:tasks.workunit.client.0.smithi111.stderr: -207> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: crc 2024-09-12T18:51:55.625 INFO:tasks.workunit.client.0.smithi111.stderr: -206> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: secure 2024-09-12T18:51:55.625 INFO:tasks.workunit.client.0.smithi111.stderr: -205> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: crc 2024-09-12T18:51:55.625 INFO:tasks.workunit.client.0.smithi111.stderr: -204> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: secure 2024-09-12T18:51:55.625 INFO:tasks.workunit.client.0.smithi111.stderr: -203> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: crc 2024-09-12T18:51:55.625 INFO:tasks.workunit.client.0.smithi111.stderr: -202> 2024-09-12T18:51:55.421+0000 7f52a18319c0 5 AuthRegistry(0x560872a5e070) adding con mode: secure 2024-09-12T18:51:55.625 INFO:tasks.workunit.client.0.smithi111.stderr: -201> 2024-09-12T18:51:55.421+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.625 INFO:tasks.workunit.client.0.smithi111.stderr: -200> 2024-09-12T18:51:55.421+0000 7f52a18319c0 1 librados: starting msgr at 2024-09-12T18:51:55.625 INFO:tasks.workunit.client.0.smithi111.stderr: -199> 2024-09-12T18:51:55.421+0000 7f52a18319c0 1 librados: starting objecter 2024-09-12T18:51:55.625 INFO:tasks.workunit.client.0.smithi111.stderr: -198> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command objecter_requests cmddesc objecter_requests hook 0x560872a60580 EEXIST 2024-09-12T18:51:55.625 INFO:tasks.workunit.client.0.smithi111.stderr: -197> 2024-09-12T18:51:55.425+0000 7f52a18319c0 1 librados: setting wanted keys 2024-09-12T18:51:55.626 INFO:tasks.workunit.client.0.smithi111.stderr: -196> 2024-09-12T18:51:55.425+0000 7f52a18319c0 1 librados: calling monclient init 2024-09-12T18:51:55.626 INFO:tasks.workunit.client.0.smithi111.stderr: -195> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient: init 2024-09-12T18:51:55.626 INFO:tasks.workunit.client.0.smithi111.stderr: -194> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding auth protocol: cephx 2024-09-12T18:51:55.626 INFO:tasks.workunit.client.0.smithi111.stderr: -193> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding auth protocol: cephx 2024-09-12T18:51:55.626 INFO:tasks.workunit.client.0.smithi111.stderr: -192> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding auth protocol: cephx 2024-09-12T18:51:55.626 INFO:tasks.workunit.client.0.smithi111.stderr: -191> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: secure 2024-09-12T18:51:55.626 INFO:tasks.workunit.client.0.smithi111.stderr: -190> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: crc 2024-09-12T18:51:55.626 INFO:tasks.workunit.client.0.smithi111.stderr: -189> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: secure 2024-09-12T18:51:55.626 INFO:tasks.workunit.client.0.smithi111.stderr: -188> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: crc 2024-09-12T18:51:55.626 INFO:tasks.workunit.client.0.smithi111.stderr: -187> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: secure 2024-09-12T18:51:55.626 INFO:tasks.workunit.client.0.smithi111.stderr: -186> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: crc 2024-09-12T18:51:55.626 INFO:tasks.workunit.client.0.smithi111.stderr: -185> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: crc 2024-09-12T18:51:55.626 INFO:tasks.workunit.client.0.smithi111.stderr: -184> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: secure 2024-09-12T18:51:55.627 INFO:tasks.workunit.client.0.smithi111.stderr: -183> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: crc 2024-09-12T18:51:55.627 INFO:tasks.workunit.client.0.smithi111.stderr: -182> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: secure 2024-09-12T18:51:55.627 INFO:tasks.workunit.client.0.smithi111.stderr: -181> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: crc 2024-09-12T18:51:55.627 INFO:tasks.workunit.client.0.smithi111.stderr: -180> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 AuthRegistry(0x560872a40ac0) adding con mode: secure 2024-09-12T18:51:55.627 INFO:tasks.workunit.client.0.smithi111.stderr: -179> 2024-09-12T18:51:55.425+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.627 INFO:tasks.workunit.client.0.smithi111.stderr: -178> 2024-09-12T18:51:55.425+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.627 INFO:tasks.workunit.client.0.smithi111.stderr: -177> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command rotate-key cmddesc rotate-key hook 0x560872a40c08 EEXIST 2024-09-12T18:51:55.627 INFO:tasks.workunit.client.0.smithi111.stderr: -176> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient: _reopen_session rank -1 2024-09-12T18:51:55.627 INFO:tasks.workunit.client.0.smithi111.stderr: -175> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T18:51:55.627 INFO:tasks.workunit.client.0.smithi111.stderr: -174> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-b con 0x560872a8c690 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T18:51:55.627 INFO:tasks.workunit.client.0.smithi111.stderr: -173> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-c con 0x560872a8df30 addr [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] 2024-09-12T18:51:55.627 INFO:tasks.workunit.client.0.smithi111.stderr: -172> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): picked mon.noname-a con 0x560872a86650 addr [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] 2024-09-12T18:51:55.627 INFO:tasks.workunit.client.0.smithi111.stderr: -171> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.627 INFO:tasks.workunit.client.0.smithi111.stderr: -170> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.628 INFO:tasks.workunit.client.0.smithi111.stderr: -169> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): start opening mon connection 2024-09-12T18:51:55.628 INFO:tasks.workunit.client.0.smithi111.stderr: -168> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): _renew_subs 2024-09-12T18:51:55.628 INFO:tasks.workunit.client.0.smithi111.stderr: -167> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient(hunting): authenticate will time out at 2502.568756s 2024-09-12T18:51:55.628 INFO:tasks.workunit.client.0.smithi111.stderr: -166> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): get_auth_request con 0x560872a8df30 auth_method 0 2024-09-12T18:51:55.628 INFO:tasks.workunit.client.0.smithi111.stderr: -165> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.628 INFO:tasks.workunit.client.0.smithi111.stderr: -164> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.628 INFO:tasks.workunit.client.0.smithi111.stderr: -163> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.628 INFO:tasks.workunit.client.0.smithi111.stderr: -162> 2024-09-12T18:51:55.425+0000 7f529f337640 10 monclient(hunting): get_auth_request con 0x560872a86650 auth_method 0 2024-09-12T18:51:55.629 INFO:tasks.workunit.client.0.smithi111.stderr: -161> 2024-09-12T18:51:55.425+0000 7f529f337640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.629 INFO:tasks.workunit.client.0.smithi111.stderr: -160> 2024-09-12T18:51:55.425+0000 7f529f337640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.629 INFO:tasks.workunit.client.0.smithi111.stderr: -159> 2024-09-12T18:51:55.425+0000 7f529f337640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.629 INFO:tasks.workunit.client.0.smithi111.stderr: -158> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.629 INFO:tasks.workunit.client.0.smithi111.stderr: -157> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.629 INFO:tasks.workunit.client.0.smithi111.stderr: -156> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.629 INFO:tasks.workunit.client.0.smithi111.stderr: -155> 2024-09-12T18:51:55.425+0000 7f529f337640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T18:51:55.629 INFO:tasks.workunit.client.0.smithi111.stderr: -154> 2024-09-12T18:51:55.425+0000 7f529f337640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T18:51:55.629 INFO:tasks.workunit.client.0.smithi111.stderr: -153> 2024-09-12T18:51:55.425+0000 7f529f337640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T18:51:55.629 INFO:tasks.workunit.client.0.smithi111.stderr: -152> 2024-09-12T18:51:55.425+0000 7f529eb36640 10 monclient(hunting): get_auth_request con 0x560872a8c690 auth_method 0 2024-09-12T18:51:55.629 INFO:tasks.workunit.client.0.smithi111.stderr: -151> 2024-09-12T18:51:55.425+0000 7f529eb36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T18:51:55.629 INFO:tasks.workunit.client.0.smithi111.stderr: -150> 2024-09-12T18:51:55.425+0000 7f529eb36640 10 monclient(hunting): _init_auth method 2 2024-09-12T18:51:55.629 INFO:tasks.workunit.client.0.smithi111.stderr: -149> 2024-09-12T18:51:55.425+0000 7f529eb36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T18:51:55.629 INFO:tasks.workunit.client.0.smithi111.stderr: -148> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient(hunting): handle_auth_done global_id 7874 payload 824 2024-09-12T18:51:55.630 INFO:tasks.workunit.client.0.smithi111.stderr: -147> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient: _finish_hunting 0 2024-09-12T18:51:55.630 INFO:tasks.workunit.client.0.smithi111.stderr: -146> 2024-09-12T18:51:55.425+0000 7f529fb38640 1 monclient: found mon.noname-c 2024-09-12T18:51:55.630 INFO:tasks.workunit.client.0.smithi111.stderr: -145> 2024-09-12T18:51:55.425+0000 7f529fb38640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.111:3301/0 2024-09-12T18:51:55.630 INFO:tasks.workunit.client.0.smithi111.stderr: -144> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.630 INFO:tasks.workunit.client.0.smithi111.stderr: -143> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T18:51:55.630 INFO:tasks.workunit.client.0.smithi111.stderr: -142> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: dump: 2024-09-12T18:51:55.630 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.630 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.630 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.630 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.630 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.630 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.630 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.631 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.631 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.631 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.631 INFO:tasks.workunit.client.0.smithi111.stderr: -141> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: _finish_auth 0 2024-09-12T18:51:55.631 INFO:tasks.workunit.client.0.smithi111.stderr: -140> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: _check_auth_tickets 2024-09-12T18:51:55.631 INFO:tasks.workunit.client.0.smithi111.stderr: -139> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: handle_config config(0 keys) 2024-09-12T18:51:55.631 INFO:tasks.workunit.client.0.smithi111.stderr: -138> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T18:51:55.631 INFO:tasks.workunit.client.0.smithi111.stderr: -137> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T18:51:55.631 INFO:tasks.workunit.client.0.smithi111.stderr: -136> 2024-09-12T18:51:55.425+0000 7f51817fa640 10 monclient: dump: 2024-09-12T18:51:55.631 INFO:tasks.workunit.client.0.smithi111.stderr:epoch 1 2024-09-12T18:51:55.631 INFO:tasks.workunit.client.0.smithi111.stderr:fsid 2cc18cb2-6afc-4366-93a9-b1f579cd792f 2024-09-12T18:51:55.631 INFO:tasks.workunit.client.0.smithi111.stderr:last_changed 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.631 INFO:tasks.workunit.client.0.smithi111.stderr:created 2024-09-12T18:25:25.728656+0000 2024-09-12T18:51:55.632 INFO:tasks.workunit.client.0.smithi111.stderr:min_mon_release 19 (squid) 2024-09-12T18:51:55.632 INFO:tasks.workunit.client.0.smithi111.stderr:election_strategy: 1 2024-09-12T18:51:55.632 INFO:tasks.workunit.client.0.smithi111.stderr:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-09-12T18:51:55.632 INFO:tasks.workunit.client.0.smithi111.stderr:1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.b 2024-09-12T18:51:55.632 INFO:tasks.workunit.client.0.smithi111.stderr:2: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.c 2024-09-12T18:51:55.632 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.632 INFO:tasks.workunit.client.0.smithi111.stderr: -135> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 monclient: authenticate success, global_id 7874 2024-09-12T18:51:55.632 INFO:tasks.workunit.client.0.smithi111.stderr: -134> 2024-09-12T18:51:55.425+0000 7f5182ffd640 4 set_mon_vals no callback set 2024-09-12T18:51:55.632 INFO:tasks.workunit.client.0.smithi111.stderr: -133> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient: _renew_subs 2024-09-12T18:51:55.632 INFO:tasks.workunit.client.0.smithi111.stderr: -132> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:51:55.632 INFO:tasks.workunit.client.0.smithi111.stderr: -131> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient: _renew_subs 2024-09-12T18:51:55.632 INFO:tasks.workunit.client.0.smithi111.stderr: -130> 2024-09-12T18:51:55.425+0000 7f52a18319c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:51:55.632 INFO:tasks.workunit.client.0.smithi111.stderr: -129> 2024-09-12T18:51:55.425+0000 7f52a18319c0 1 librados: init done 2024-09-12T18:51:55.632 INFO:tasks.workunit.client.0.smithi111.stderr: -128> 2024-09-12T18:51:55.425+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command cr dump hook 0x560872a62668 2024-09-12T18:51:55.633 INFO:tasks.workunit.client.0.smithi111.stderr: -127> 2024-09-12T18:51:55.425+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.633 INFO:tasks.workunit.client.0.smithi111.stderr: -126> 2024-09-12T18:51:55.425+0000 7f51817fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T18:51:55.633 INFO:tasks.workunit.client.0.smithi111.stderr: -125> 2024-09-12T18:51:55.425+0000 7f51817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:55.633 INFO:tasks.workunit.client.0.smithi111.stderr: -124> 2024-09-12T18:51:55.425+0000 7f51817fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.111:6832/3142190257,v1:172.21.15.111:6833/3142190257] 2024-09-12T18:51:55.633 INFO:tasks.workunit.client.0.smithi111.stderr: -123> 2024-09-12T18:51:55.425+0000 7f529eb36640 10 monclient: get_auth_request con 0x7f5168070ae0 auth_method 0 2024-09-12T18:51:55.633 INFO:tasks.workunit.client.0.smithi111.stderr: -122> 2024-09-12T18:51:55.429+0000 7f529f337640 10 monclient: get_auth_request con 0x560872aabac0 auth_method 0 2024-09-12T18:51:55.633 INFO:tasks.workunit.client.0.smithi111.stderr: -121> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.633 INFO:tasks.workunit.client.0.smithi111.stderr: -120> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 realm 2024-09-12T18:51:55.633 INFO:tasks.workunit.client.0.smithi111.stderr: -119> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.633 INFO:tasks.workunit.client.0.smithi111.stderr: -118> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.633 INFO:tasks.workunit.client.0.smithi111.stderr: -117> 2024-09-12T18:51:55.429+0000 7f52a18319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:51:55.633 INFO:tasks.workunit.client.0.smithi111.stderr: -116> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.633 INFO:tasks.workunit.client.0.smithi111.stderr: -115> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.633 INFO:tasks.workunit.client.0.smithi111.stderr: -114> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.634 INFO:tasks.workunit.client.0.smithi111.stderr: -113> 2024-09-12T18:51:55.429+0000 7f529eb36640 10 monclient: get_auth_request con 0x560872aafd20 auth_method 0 2024-09-12T18:51:55.634 INFO:tasks.workunit.client.0.smithi111.stderr: -112> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:55.634 INFO:tasks.workunit.client.0.smithi111.stderr: -111> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.634 INFO:tasks.workunit.client.0.smithi111.stderr: -110> 2024-09-12T18:51:55.429+0000 7f529fb38640 10 monclient: get_auth_request con 0x560872ab35d0 auth_method 0 2024-09-12T18:51:55.634 INFO:tasks.workunit.client.0.smithi111.stderr: -109> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:51:55.634 INFO:tasks.workunit.client.0.smithi111.stderr: -108> 2024-09-12T18:51:55.429+0000 7f52a18319c0 20 searching for the correct realm 2024-09-12T18:51:55.634 INFO:tasks.workunit.client.0.smithi111.stderr: -107> 2024-09-12T18:51:55.433+0000 7f529f337640 10 monclient: get_auth_request con 0x7f529800e070 auth_method 0 2024-09-12T18:51:55.634 INFO:tasks.workunit.client.0.smithi111.stderr: -106> 2024-09-12T18:51:55.433+0000 7f529eb36640 10 monclient: get_auth_request con 0x7f52900d5920 auth_method 0 2024-09-12T18:51:55.634 INFO:tasks.workunit.client.0.smithi111.stderr: -105> 2024-09-12T18:51:55.433+0000 7f529fb38640 10 monclient: get_auth_request con 0x7f5294046040 auth_method 0 2024-09-12T18:51:55.634 INFO:tasks.workunit.client.0.smithi111.stderr: -104> 2024-09-12T18:51:55.437+0000 7f529fb38640 0 -- 172.21.15.111:0/3853883544 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x560872ab35d0 msgr2=0x560872ab59c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:55.634 INFO:tasks.workunit.client.0.smithi111.stderr: -103> 2024-09-12T18:51:55.437+0000 7f51817fa640 1 client.7874.objecter ms_handle_reset 0x560872ab35d0 session 0x560872aaf070 osd.3 2024-09-12T18:51:55.634 INFO:tasks.workunit.client.0.smithi111.stderr: -102> 2024-09-12T18:51:55.437+0000 7f51817fa640 10 monclient: _renew_subs 2024-09-12T18:51:55.634 INFO:tasks.workunit.client.0.smithi111.stderr: -101> 2024-09-12T18:51:55.437+0000 7f51817fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.111:3301/0 2024-09-12T18:51:55.635 INFO:tasks.workunit.client.0.smithi111.stderr: -100> 2024-09-12T18:51:55.437+0000 7f529fb38640 10 monclient: get_auth_request con 0x7f5168080a00 auth_method 0 2024-09-12T18:51:55.635 INFO:tasks.workunit.client.0.smithi111.stderr: -99> 2024-09-12T18:51:55.437+0000 7f529f337640 10 monclient: get_auth_request con 0x7f529808ca10 auth_method 0 2024-09-12T18:51:55.635 INFO:tasks.workunit.client.0.smithi111.stderr: -98> 2024-09-12T18:51:55.441+0000 7f529eb36640 10 monclient: get_auth_request con 0x7f529807f090 auth_method 0 2024-09-12T18:51:55.635 INFO:tasks.workunit.client.0.smithi111.stderr: -97> 2024-09-12T18:51:55.441+0000 7f529eb36640 0 -- 172.21.15.111:0/3853883544 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f529807f090 msgr2=0x7f5298008c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:55.635 INFO:tasks.workunit.client.0.smithi111.stderr: -96> 2024-09-12T18:51:55.441+0000 7f51817fa640 1 client.7874.objecter ms_handle_reset 0x7f529807f090 session 0x7f5298059130 osd.0 2024-09-12T18:51:55.635 INFO:tasks.workunit.client.0.smithi111.stderr: -95> 2024-09-12T18:51:55.441+0000 7f529eb36640 10 monclient: get_auth_request con 0x560872ab35d0 auth_method 0 2024-09-12T18:51:55.635 INFO:tasks.workunit.client.0.smithi111.stderr: -94> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:51:55.635 INFO:tasks.workunit.client.0.smithi111.stderr: -93> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:51:55.635 INFO:tasks.workunit.client.0.smithi111.stderr: -92> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:51:55.635 INFO:tasks.workunit.client.0.smithi111.stderr: -91> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:51:55.635 INFO:tasks.workunit.client.0.smithi111.stderr: -90> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:51:55.635 INFO:tasks.workunit.client.0.smithi111.stderr: -89> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:51:55.635 INFO:tasks.workunit.client.0.smithi111.stderr: -88> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.636 INFO:tasks.workunit.client.0.smithi111.stderr: -87> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.636 INFO:tasks.workunit.client.0.smithi111.stderr: -86> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.636 INFO:tasks.workunit.client.0.smithi111.stderr: -85> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:55.636 INFO:tasks.workunit.client.0.smithi111.stderr: -84> 2024-09-12T18:51:55.449+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.636 INFO:tasks.workunit.client.0.smithi111.stderr: -83> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:51:55.636 INFO:tasks.workunit.client.0.smithi111.stderr: -82> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 zone default found 2024-09-12T18:51:55.636 INFO:tasks.workunit.client.0.smithi111.stderr: -81> 2024-09-12T18:51:55.453+0000 7f52a18319c0 4 Realm: () 2024-09-12T18:51:55.636 INFO:tasks.workunit.client.0.smithi111.stderr: -80> 2024-09-12T18:51:55.453+0000 7f52a18319c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:51:55.636 INFO:tasks.workunit.client.0.smithi111.stderr: -79> 2024-09-12T18:51:55.453+0000 7f52a18319c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:51:55.636 INFO:tasks.workunit.client.0.smithi111.stderr: -78> 2024-09-12T18:51:55.453+0000 7f52a18319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:51:55.636 INFO:tasks.workunit.client.0.smithi111.stderr: -77> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 zonegroup default 2024-09-12T18:51:55.636 INFO:tasks.workunit.client.0.smithi111.stderr: -76> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.636 INFO:tasks.workunit.client.0.smithi111.stderr: -75> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.637 INFO:tasks.workunit.client.0.smithi111.stderr: -74> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.637 INFO:tasks.workunit.client.0.smithi111.stderr: -73> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.637 INFO:tasks.workunit.client.0.smithi111.stderr: -72> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.637 INFO:tasks.workunit.client.0.smithi111.stderr: -71> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.637 INFO:tasks.workunit.client.0.smithi111.stderr: -70> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 started sync module instance, tier type = 2024-09-12T18:51:55.637 INFO:tasks.workunit.client.0.smithi111.stderr: -69> 2024-09-12T18:51:55.453+0000 7f52a18319c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:51:55.637 INFO:tasks.workunit.client.0.smithi111.stderr: -68> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=0 2024-09-12T18:51:55.637 INFO:tasks.workunit.client.0.smithi111.stderr: -67> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=1 2024-09-12T18:51:55.637 INFO:tasks.workunit.client.0.smithi111.stderr: -66> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=2 2024-09-12T18:51:55.637 INFO:tasks.workunit.client.0.smithi111.stderr: -65> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=3 2024-09-12T18:51:55.637 INFO:tasks.workunit.client.0.smithi111.stderr: -64> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=4 2024-09-12T18:51:55.637 INFO:tasks.workunit.client.0.smithi111.stderr: -63> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=5 2024-09-12T18:51:55.637 INFO:tasks.workunit.client.0.smithi111.stderr: -62> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=6 2024-09-12T18:51:55.637 INFO:tasks.workunit.client.0.smithi111.stderr: -61> 2024-09-12T18:51:55.469+0000 7f52a18319c0 20 add_watcher() i=7 2024-09-12T18:51:55.638 INFO:tasks.workunit.client.0.smithi111.stderr: -60> 2024-09-12T18:51:55.469+0000 7f52a18319c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:51:55.638 INFO:tasks.workunit.client.0.smithi111.stderr: -59> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding auth protocol: cephx 2024-09-12T18:51:55.638 INFO:tasks.workunit.client.0.smithi111.stderr: -58> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding auth protocol: cephx 2024-09-12T18:51:55.638 INFO:tasks.workunit.client.0.smithi111.stderr: -57> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding auth protocol: cephx 2024-09-12T18:51:55.638 INFO:tasks.workunit.client.0.smithi111.stderr: -56> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: secure 2024-09-12T18:51:55.638 INFO:tasks.workunit.client.0.smithi111.stderr: -55> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: crc 2024-09-12T18:51:55.638 INFO:tasks.workunit.client.0.smithi111.stderr: -54> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: secure 2024-09-12T18:51:55.638 INFO:tasks.workunit.client.0.smithi111.stderr: -53> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: crc 2024-09-12T18:51:55.638 INFO:tasks.workunit.client.0.smithi111.stderr: -52> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: secure 2024-09-12T18:51:55.638 INFO:tasks.workunit.client.0.smithi111.stderr: -51> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: crc 2024-09-12T18:51:55.638 INFO:tasks.workunit.client.0.smithi111.stderr: -50> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: crc 2024-09-12T18:51:55.638 INFO:tasks.workunit.client.0.smithi111.stderr: -49> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: secure 2024-09-12T18:51:55.638 INFO:tasks.workunit.client.0.smithi111.stderr: -48> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: crc 2024-09-12T18:51:55.639 INFO:tasks.workunit.client.0.smithi111.stderr: -47> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: secure 2024-09-12T18:51:55.639 INFO:tasks.workunit.client.0.smithi111.stderr: -46> 2024-09-12T18:51:55.469+0000 7f5155fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:51:55.639 INFO:tasks.workunit.client.0.smithi111.stderr: -45> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: crc 2024-09-12T18:51:55.639 INFO:tasks.workunit.client.0.smithi111.stderr: -44> 2024-09-12T18:51:55.469+0000 7f52a18319c0 5 AuthRegistry(0x7ffc4a9e71f0) adding con mode: secure 2024-09-12T18:51:55.639 INFO:tasks.workunit.client.0.smithi111.stderr: -43> 2024-09-12T18:51:55.473+0000 7f52a18319c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T18:51:55.639 INFO:tasks.workunit.client.0.smithi111.stderr: -42> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:51:55.639 INFO:tasks.workunit.client.0.smithi111.stderr: -41> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:51:55.639 INFO:tasks.workunit.client.0.smithi111.stderr: -40> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command cache list hook 0x560872a86a50 2024-09-12T18:51:55.639 INFO:tasks.workunit.client.0.smithi111.stderr: -39> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command cache inspect hook 0x560872a86a50 2024-09-12T18:51:55.639 INFO:tasks.workunit.client.0.smithi111.stderr: -38> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command cache erase hook 0x560872a86a50 2024-09-12T18:51:55.639 INFO:tasks.workunit.client.0.smithi111.stderr: -37> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command cache zap hook 0x560872a86a50 2024-09-12T18:51:55.639 INFO:tasks.workunit.client.0.smithi111.stderr: -36> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 note: GC not initialized 2024-09-12T18:51:55.639 INFO:tasks.workunit.client.0.smithi111.stderr: -35> 2024-09-12T18:51:55.473+0000 7f5154fe1640 20 reqs_thread_entry: start 2024-09-12T18:51:55.640 INFO:tasks.workunit.client.0.smithi111.stderr: -34> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command sync trace show hook 0x7f529808e070 2024-09-12T18:51:55.640 INFO:tasks.workunit.client.0.smithi111.stderr: -33> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command sync trace history hook 0x7f529808e070 2024-09-12T18:51:55.640 INFO:tasks.workunit.client.0.smithi111.stderr: -32> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command sync trace active hook 0x7f529808e070 2024-09-12T18:51:55.640 INFO:tasks.workunit.client.0.smithi111.stderr: -31> 2024-09-12T18:51:55.473+0000 7f52a18319c0 5 asok(0x5608727b52b0) register_command sync trace active_short hook 0x7f529808e070 2024-09-12T18:51:55.640 INFO:tasks.workunit.client.0.smithi111.stderr: -30> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 init_complete bucket index max shards: 11 2024-09-12T18:51:55.640 INFO:tasks.workunit.client.0.smithi111.stderr: -29> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 Filter name: none 2024-09-12T18:51:55.640 INFO:tasks.workunit.client.0.smithi111.stderr: -28> 2024-09-12T18:51:55.473+0000 7f50ce7fc640 20 reqs_thread_entry: start 2024-09-12T18:51:55.640 INFO:tasks.workunit.client.0.smithi111.stderr: -27> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:51:55.640 INFO:tasks.workunit.client.0.smithi111.stderr: -26> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.640 INFO:tasks.workunit.client.0.smithi111.stderr: -25> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:51:55.640 INFO:tasks.workunit.client.0.smithi111.stderr: -24> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:51:55.640 INFO:tasks.workunit.client.0.smithi111.stderr: -23> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:51:55.640 INFO:tasks.workunit.client.0.smithi111.stderr: -22> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:51:55.640 INFO:tasks.workunit.client.0.smithi111.stderr: -21> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.641 INFO:tasks.workunit.client.0.smithi111.stderr: -20> 2024-09-12T18:51:55.473+0000 7f52a18319c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:51:55.641 INFO:tasks.workunit.client.0.smithi111.stderr: -19> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:55.641 INFO:tasks.workunit.client.0.smithi111.stderr: -18> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:55.641 INFO:tasks.workunit.client.0.smithi111.stderr: -17> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:51:55.641 INFO:tasks.workunit.client.0.smithi111.stderr: -16> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:55.641 INFO:tasks.workunit.client.0.smithi111.stderr: -15> 2024-09-12T18:51:55.473+0000 7f52a18319c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:51:55.641 INFO:tasks.workunit.client.0.smithi111.stderr: -14> 2024-09-12T18:51:55.477+0000 7f52a18319c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T18:51:55.641 INFO:tasks.workunit.client.0.smithi111.stderr: -13> 2024-09-12T18:51:55.489+0000 7f52a18319c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:55.641 INFO:tasks.workunit.client.0.smithi111.stderr: -12> 2024-09-12T18:51:55.489+0000 7f52a18319c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:55.641 INFO:tasks.workunit.client.0.smithi111.stderr: -11> 2024-09-12T18:51:55.489+0000 7f52a18319c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:55.641 INFO:tasks.workunit.client.0.smithi111.stderr: -10> 2024-09-12T18:51:55.489+0000 7f52a18319c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:51:55.641 INFO:tasks.workunit.client.0.smithi111.stderr: -9> 2024-09-12T18:51:55.489+0000 7f5182ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431690 cookie 94594283581264 notifier 7874 bl.length()=827 2024-09-12T18:51:55.641 INFO:tasks.workunit.client.0.smithi111.stderr: -8> 2024-09-12T18:51:55.489+0000 7f5182ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:55.642 INFO:tasks.workunit.client.0.smithi111.stderr: -7> 2024-09-12T18:51:55.489+0000 7f5182ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:55.642 INFO:tasks.workunit.client.0.smithi111.stderr: -6> 2024-09-12T18:51:55.489+0000 7f5182ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:55.642 INFO:tasks.workunit.client.0.smithi111.stderr: -5> 2024-09-12T18:51:55.489+0000 7f52a18319c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:51:55.642 INFO:tasks.workunit.client.0.smithi111.stderr: -4> 2024-09-12T18:51:55.489+0000 7f52a18319c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:51:55.642 INFO:tasks.workunit.client.0.smithi111.stderr: -3> 2024-09-12T18:51:55.489+0000 7f52a18319c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:51:55.642 INFO:tasks.workunit.client.0.smithi111.stderr: -2> 2024-09-12T18:51:55.489+0000 7f52a18319c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:51:55.642 INFO:tasks.workunit.client.0.smithi111.stderr: -1> 2024-09-12T18:51:55.505+0000 7f52a18319c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f52a18319c0 time 2024-09-12T18:51:55.510467+0000 2024-09-12T18:51:55.642 INFO:tasks.workunit.client.0.smithi111.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T18:51:55.642 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.642 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:55.642 INFO:tasks.workunit.client.0.smithi111.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f52a510b2eb] 2024-09-12T18:51:55.642 INFO:tasks.workunit.client.0.smithi111.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f52a510b49f] 2024-09-12T18:51:55.642 INFO:tasks.workunit.client.0.smithi111.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560870391cc1] 2024-09-12T18:51:55.643 INFO:tasks.workunit.client.0.smithi111.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5608703a6d5a] 2024-09-12T18:51:55.643 INFO:tasks.workunit.client.0.smithi111.stderr: 5: main() 2024-09-12T18:51:55.643 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f52a3f71d90] 2024-09-12T18:51:55.643 INFO:tasks.workunit.client.0.smithi111.stderr: 7: __libc_start_main() 2024-09-12T18:51:55.643 INFO:tasks.workunit.client.0.smithi111.stderr: 8: _start() 2024-09-12T18:51:55.643 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.643 INFO:tasks.workunit.client.0.smithi111.stderr: 0> 2024-09-12T18:51:55.505+0000 7f52a18319c0 -1 *** Caught signal (Aborted) ** 2024-09-12T18:51:55.643 INFO:tasks.workunit.client.0.smithi111.stderr: in thread 7f52a18319c0 thread_name:radosgw-admin 2024-09-12T18:51:55.643 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.643 INFO:tasks.workunit.client.0.smithi111.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T18:51:55.643 INFO:tasks.workunit.client.0.smithi111.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f52a3f8a520] 2024-09-12T18:51:55.643 INFO:tasks.workunit.client.0.smithi111.stderr: 2: pthread_kill() 2024-09-12T18:51:55.643 INFO:tasks.workunit.client.0.smithi111.stderr: 3: raise() 2024-09-12T18:51:55.644 INFO:tasks.workunit.client.0.smithi111.stderr: 4: abort() 2024-09-12T18:51:55.644 INFO:tasks.workunit.client.0.smithi111.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f52a510b345] 2024-09-12T18:51:55.644 INFO:tasks.workunit.client.0.smithi111.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f52a510b49f] 2024-09-12T18:51:55.644 INFO:tasks.workunit.client.0.smithi111.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560870391cc1] 2024-09-12T18:51:55.644 INFO:tasks.workunit.client.0.smithi111.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5608703a6d5a] 2024-09-12T18:51:55.644 INFO:tasks.workunit.client.0.smithi111.stderr: 9: main() 2024-09-12T18:51:55.644 INFO:tasks.workunit.client.0.smithi111.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f52a3f71d90] 2024-09-12T18:51:55.644 INFO:tasks.workunit.client.0.smithi111.stderr: 11: __libc_start_main() 2024-09-12T18:51:55.644 INFO:tasks.workunit.client.0.smithi111.stderr: 12: _start() 2024-09-12T18:51:55.644 INFO:tasks.workunit.client.0.smithi111.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T18:51:55.644 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:51:55.644 INFO:tasks.workunit.client.0.smithi111.stderr:--- logging levels --- 2024-09-12T18:51:55.644 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 none 2024-09-12T18:51:55.645 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 lockdep 2024-09-12T18:51:55.645 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 context 2024-09-12T18:51:55.645 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 crush 2024-09-12T18:51:55.645 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds 2024-09-12T18:51:55.645 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_balancer 2024-09-12T18:51:55.645 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_locker 2024-09-12T18:51:55.645 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log 2024-09-12T18:51:55.645 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_log_expire 2024-09-12T18:51:55.645 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mds_migrator 2024-09-12T18:51:55.645 INFO:tasks.workunit.client.0.smithi111.stderr: 3/ 5 mds_quiesce 2024-09-12T18:51:55.645 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 buffer 2024-09-12T18:51:55.645 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 timer 2024-09-12T18:51:55.645 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 filer 2024-09-12T18:51:55.645 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 striper 2024-09-12T18:51:55.646 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 1 objecter 2024-09-12T18:51:55.646 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rados 2024-09-12T18:51:55.646 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd 2024-09-12T18:51:55.646 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_mirror 2024-09-12T18:51:55.646 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_replay 2024-09-12T18:51:55.646 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 rbd_pwl 2024-09-12T18:51:55.646 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 journaler 2024-09-12T18:51:55.646 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objectcacher 2024-09-12T18:51:55.646 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 immutable_obj_cache 2024-09-12T18:51:55.646 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 client 2024-09-12T18:51:55.646 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 osd 2024-09-12T18:51:55.646 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 optracker 2024-09-12T18:51:55.646 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 objclass 2024-09-12T18:51:55.646 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 filestore 2024-09-12T18:51:55.647 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 journal 2024-09-12T18:51:55.647 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 ms 2024-09-12T18:51:55.647 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mon 2024-09-12T18:51:55.647 INFO:tasks.workunit.client.0.smithi111.stderr: 0/10 monc 2024-09-12T18:51:55.647 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 paxos 2024-09-12T18:51:55.647 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 tp 2024-09-12T18:51:55.647 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 auth 2024-09-12T18:51:55.647 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 crypto 2024-09-12T18:51:55.647 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 finisher 2024-09-12T18:51:55.647 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 reserver 2024-09-12T18:51:55.647 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 heartbeatmap 2024-09-12T18:51:55.647 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 perfcounter 2024-09-12T18:51:55.647 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw 2024-09-12T18:51:55.647 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_sync 2024-09-12T18:51:55.648 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_datacache 2024-09-12T18:51:55.648 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_access 2024-09-12T18:51:55.648 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_dbstore 2024-09-12T18:51:55.648 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_flight 2024-09-12T18:51:55.648 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 rgw_lifecycle 2024-09-12T18:51:55.648 INFO:tasks.workunit.client.0.smithi111.stderr: 20/20 rgw_notification 2024-09-12T18:51:55.648 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 javaclient 2024-09-12T18:51:55.648 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 asok 2024-09-12T18:51:55.648 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 1 throttle 2024-09-12T18:51:55.648 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 0 refs 2024-09-12T18:51:55.648 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 compressor 2024-09-12T18:51:55.648 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluestore 2024-09-12T18:51:55.648 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 bluefs 2024-09-12T18:51:55.648 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 3 bdev 2024-09-12T18:51:55.649 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 kstore 2024-09-12T18:51:55.649 INFO:tasks.workunit.client.0.smithi111.stderr: 4/ 5 rocksdb 2024-09-12T18:51:55.649 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 fuse 2024-09-12T18:51:55.649 INFO:tasks.workunit.client.0.smithi111.stderr: 2/ 5 mgr 2024-09-12T18:51:55.649 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mgrc 2024-09-12T18:51:55.649 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 dpdk 2024-09-12T18:51:55.649 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 eventtrace 2024-09-12T18:51:55.649 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 prioritycache 2024-09-12T18:51:55.649 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 test 2024-09-12T18:51:55.649 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephfs_mirror 2024-09-12T18:51:55.649 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cephsqlite 2024-09-12T18:51:55.649 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 crimson_interrupt 2024-09-12T18:51:55.649 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore 2024-09-12T18:51:55.649 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_onode 2024-09-12T18:51:55.650 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_odata 2024-09-12T18:51:55.650 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_omap 2024-09-12T18:51:55.650 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_tm 2024-09-12T18:51:55.650 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_t 2024-09-12T18:51:55.650 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cleaner 2024-09-12T18:51:55.650 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_epm 2024-09-12T18:51:55.650 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_lba 2024-09-12T18:51:55.650 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T18:51:55.650 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_cache 2024-09-12T18:51:55.650 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_journal 2024-09-12T18:51:55.650 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_device 2024-09-12T18:51:55.650 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 seastore_backref 2024-09-12T18:51:55.650 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 alienstore 2024-09-12T18:51:55.650 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 mclock 2024-09-12T18:51:55.651 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 cyanstore 2024-09-12T18:51:55.651 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 ceph_exporter 2024-09-12T18:51:55.651 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 memstore 2024-09-12T18:51:55.651 INFO:tasks.workunit.client.0.smithi111.stderr: 1/ 5 trace 2024-09-12T18:51:55.651 INFO:tasks.workunit.client.0.smithi111.stderr: 0/ 5 ceph_dedup 2024-09-12T18:51:55.651 INFO:tasks.workunit.client.0.smithi111.stderr: -2/-2 (syslog threshold) 2024-09-12T18:51:55.651 INFO:tasks.workunit.client.0.smithi111.stderr: 99/99 (stderr threshold) 2024-09-12T18:51:55.651 INFO:tasks.workunit.client.0.smithi111.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T18:51:55.651 INFO:tasks.workunit.client.0.smithi111.stderr: 7f50ce7fc640 / http_manager 2024-09-12T18:51:55.651 INFO:tasks.workunit.client.0.smithi111.stderr: 7f5154fe1640 / http_manager 2024-09-12T18:51:55.651 INFO:tasks.workunit.client.0.smithi111.stderr: 7f5155fe3640 / rgw_dt_lg_renew 2024-09-12T18:51:55.651 INFO:tasks.workunit.client.0.smithi111.stderr: 7f51817fa640 / ms_dispatch 2024-09-12T18:51:55.651 INFO:tasks.workunit.client.0.smithi111.stderr: 7f5182ffd640 / io_context_pool 2024-09-12T18:51:55.652 INFO:tasks.workunit.client.0.smithi111.stderr: 7f5189602640 / ms_dispatch 2024-09-12T18:51:55.652 INFO:tasks.workunit.client.0.smithi111.stderr: 7f518be07640 / ms_dispatch 2024-09-12T18:51:55.652 INFO:tasks.workunit.client.0.smithi111.stderr: 7f518d60a640 / io_context_pool 2024-09-12T18:51:55.652 INFO:tasks.workunit.client.0.smithi111.stderr: 7f529eb36640 / msgr-worker-2 2024-09-12T18:51:55.652 INFO:tasks.workunit.client.0.smithi111.stderr: 7f529f337640 / msgr-worker-1 2024-09-12T18:51:55.652 INFO:tasks.workunit.client.0.smithi111.stderr: 7f529fb38640 / msgr-worker-0 2024-09-12T18:51:55.652 INFO:tasks.workunit.client.0.smithi111.stderr: 7f52a0339640 / io_context_pool 2024-09-12T18:51:55.652 INFO:tasks.workunit.client.0.smithi111.stderr: 7f52a18319c0 / radosgw-admin 2024-09-12T18:51:55.652 INFO:tasks.workunit.client.0.smithi111.stderr: max_recent 500 2024-09-12T18:51:55.652 INFO:tasks.workunit.client.0.smithi111.stderr: max_new 1000 2024-09-12T18:51:55.652 INFO:tasks.workunit.client.0.smithi111.stderr: log_file /var/lib/ceph/crash/2024-09-12T18:51:55.512518Z_f3fa4a9d-90c7-4e7c-957e-090afb4447bd/log 2024-09-12T18:51:55.652 INFO:tasks.workunit.client.0.smithi111.stderr:--- end dump of recent events --- 2024-09-12T18:51:55.652 INFO:tasks.workunit.client.0.smithi111.stderr:Aborted 2024-09-12T18:51:55.652 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:51:55.654 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:51:55.654 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:51:55.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.585+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.589+0000 7f15500de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.589+0000 7f15500de9c0 20 realm 2024-09-12T18:51:55.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.589+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.589+0000 7f15500de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.654 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.589+0000 7f15500de9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:51:55.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.589+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.589+0000 7f15500de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.589+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.589+0000 7f15500de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:55.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.589+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.593+0000 7f15500de9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:51:55.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.593+0000 7f15500de9c0 20 searching for the correct realm 2024-09-12T18:51:55.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.597+0000 7f154e3e5640 0 -- 172.21.15.111:0/1206929813 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f1544039070 msgr2=0x7f1544049930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:55.655 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.601+0000 7f154d3e3640 0 -- 172.21.15.111:0/1206929813 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f154812a900 msgr2=0x7f15480fe8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:55.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:51:55.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:51:55.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:51:55.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:51:55.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:51:55.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:51:55.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:55.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:51:55.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 zone default found 2024-09-12T18:51:55.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 4 Realm: () 2024-09-12T18:51:55.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:51:55.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:51:55.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:51:55.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 zonegroup default 2024-09-12T18:51:55.827 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.821+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.825+0000 7f15500de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.828 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.825+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.825+0000 7f15500de9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.825+0000 7f15500de9c0 20 started sync module instance, tier type = 2024-09-12T18:51:55.829 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.825+0000 7f15500de9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:51:55.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.845+0000 7f15500de9c0 20 add_watcher() i=0 2024-09-12T18:51:55.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.845+0000 7f15500de9c0 20 add_watcher() i=1 2024-09-12T18:51:55.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.845+0000 7f15500de9c0 20 add_watcher() i=2 2024-09-12T18:51:55.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.845+0000 7f15500de9c0 20 add_watcher() i=3 2024-09-12T18:51:55.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.845+0000 7f15500de9c0 20 add_watcher() i=4 2024-09-12T18:51:55.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.845+0000 7f15500de9c0 20 add_watcher() i=5 2024-09-12T18:51:55.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.845+0000 7f15500de9c0 20 add_watcher() i=6 2024-09-12T18:51:55.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.849+0000 7f15500de9c0 20 add_watcher() i=7 2024-09-12T18:51:55.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.849+0000 7f15500de9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:51:55.860 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.857+0000 7f13ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:51:55.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.857+0000 7f15500de9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:51:55.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.857+0000 7f15500de9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:51:55.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.857+0000 7f15500de9c0 5 note: GC not initialized 2024-09-12T18:51:55.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.857+0000 7f13fe7fc640 20 reqs_thread_entry: start 2024-09-12T18:51:55.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.857+0000 7f15500de9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:51:55.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.857+0000 7f15500de9c0 20 Filter name: none 2024-09-12T18:51:55.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.857+0000 7f136ffff640 20 reqs_thread_entry: start 2024-09-12T18:51:55.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.857+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.857+0000 7f15500de9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:51:55.863 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.857+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.861+0000 7f15500de9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:51:55.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.861+0000 7f15500de9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:51:55.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.861+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.861+0000 7f15500de9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:51:55.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.861+0000 7f15500de9c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.861+0000 7f15500de9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:51:55.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.861+0000 7f15500de9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:51:55.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.865+0000 7f13ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:51:55.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.869+0000 7f15500de9c0 20 remove_watcher() i=0 2024-09-12T18:51:55.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.869+0000 7f15500de9c0 2 removed watcher, disabling cache 2024-09-12T18:51:55.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.873+0000 7f15500de9c0 20 remove_watcher() i=1 2024-09-12T18:51:55.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.873+0000 7f15500de9c0 20 remove_watcher() i=2 2024-09-12T18:51:55.881 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.877+0000 7f15500de9c0 20 remove_watcher() i=3 2024-09-12T18:51:55.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.877+0000 7f15500de9c0 20 remove_watcher() i=4 2024-09-12T18:51:55.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.881+0000 7f15500de9c0 20 remove_watcher() i=5 2024-09-12T18:51:55.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.881+0000 7f15500de9c0 20 remove_watcher() i=6 2024-09-12T18:51:55.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.885+0000 7f15500de9c0 20 remove_watcher() i=7 2024-09-12T18:51:55.904 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:51:55.904 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:51:55.915 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:51:55.946 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:51:55.946 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:51:55.991 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.985+0000 7ff2bbd799c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.989+0000 7ff2bbd799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.989+0000 7ff2bbd799c0 20 realm 2024-09-12T18:51:55.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.989+0000 7ff2bbd799c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.989+0000 7ff2bbd799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.989+0000 7ff2bbd799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:51:55.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.989+0000 7ff2bbd799c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.989+0000 7ff2bbd799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:55.993 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.989+0000 7ff2bbd799c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.989+0000 7ff2bbd799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:55.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.989+0000 7ff2bbd799c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:55.995 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.989+0000 7ff2bbd799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:51:55.996 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.989+0000 7ff2bbd799c0 20 searching for the correct realm 2024-09-12T18:51:56.000 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:55.997+0000 7ff2ba080640 0 -- 172.21.15.111:0/607867049 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7ff2ac03f060 msgr2=0x7ff2ac0668f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:56.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.001+0000 7ff2b907e640 0 -- 172.21.15.111:0/607867049 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7ff2b4024040 msgr2=0x7ff2b4045930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:51:56.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:51:56.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:51:56.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:51:56.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:51:56.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:51:56.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:51:56.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:56.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:56.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:56.228 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:51:56.228 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:56.228 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:51:56.228 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 zone default found 2024-09-12T18:51:56.228 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 4 Realm: () 2024-09-12T18:51:56.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:51:56.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:51:56.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:51:56.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 zonegroup default 2024-09-12T18:51:56.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:56.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:56.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.221+0000 7ff2bbd799c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:56.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.225+0000 7ff2bbd799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:56.230 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.225+0000 7ff2bbd799c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:56.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.225+0000 7ff2bbd799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:51:56.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.225+0000 7ff2bbd799c0 20 started sync module instance, tier type = 2024-09-12T18:51:56.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.225+0000 7ff2bbd799c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:51:56.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.245+0000 7ff2bbd799c0 20 add_watcher() i=0 2024-09-12T18:51:56.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.245+0000 7ff2bbd799c0 20 add_watcher() i=1 2024-09-12T18:51:56.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.245+0000 7ff2bbd799c0 20 add_watcher() i=2 2024-09-12T18:51:56.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.245+0000 7ff2bbd799c0 20 add_watcher() i=3 2024-09-12T18:51:56.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.245+0000 7ff2bbd799c0 20 add_watcher() i=4 2024-09-12T18:51:56.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.245+0000 7ff2bbd799c0 20 add_watcher() i=5 2024-09-12T18:51:56.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.249+0000 7ff2bbd799c0 20 add_watcher() i=6 2024-09-12T18:51:56.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.249+0000 7ff2bbd799c0 20 add_watcher() i=7 2024-09-12T18:51:56.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.249+0000 7ff2bbd799c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:51:56.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.253+0000 7ff16ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:51:56.259 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.253+0000 7ff2bbd799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:51:56.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.253+0000 7ff2bbd799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:51:56.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.253+0000 7ff2bbd799c0 5 note: GC not initialized 2024-09-12T18:51:56.260 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff16efe5640 20 reqs_thread_entry: start 2024-09-12T18:51:56.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 20 init_complete bucket index max shards: 11 2024-09-12T18:51:56.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 20 Filter name: none 2024-09-12T18:51:56.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff16cfe1640 20 reqs_thread_entry: start 2024-09-12T18:51:56.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:51:56.261 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:56.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:51:56.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:51:56.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:51:56.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:51:56.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 20 rados->read ofs=0 len=0 2024-09-12T18:51:56.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:51:56.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:51:56.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:51:56.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:51:56.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:51:56.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:51:56.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:51:56.264 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.257+0000 7ff2bbd799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:51:56.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.261+0000 7ff2bbd799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:51:56.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.261+0000 7ff2bbd799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:51:56.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.261+0000 7ff2bbd799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:51:56.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.261+0000 7ff2bbd799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:51:56.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.261+0000 7ff2bbd799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:51:56.266 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.261+0000 7ff2bbd799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:51:56.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.261+0000 7ff2bbd799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:51:56.267 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.261+0000 7ff2bbd799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:51:56.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.265+0000 7ff2bbd799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:51:56.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.265+0000 7ff2bbd799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:51:56.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.265+0000 7ff2bbd799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:51:56.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.265+0000 7ff2bbd799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:51:56.269 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.265+0000 7ff2bbd799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:51:56.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.265+0000 7ff2bbd799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:51:56.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.265+0000 7ff2bbd799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:51:56.270 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.265+0000 7ff2bbd799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:51:56.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.265+0000 7ff2bbd799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:51:56.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.265+0000 7ff2bbd799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:51:56.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.269+0000 7ff2bbd799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:51:56.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.269+0000 7ff2bbd799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:51:56.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.269+0000 7ff2bbd799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:51:56.272 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.269+0000 7ff2bbd799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:51:56.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.269+0000 7ff2bbd799c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:51:56.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.269+0000 7ff2bbd799c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:51:56.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.273+0000 7ff16ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:51:56.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.277+0000 7ff2bbd799c0 20 remove_watcher() i=0 2024-09-12T18:51:56.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.277+0000 7ff2bbd799c0 2 removed watcher, disabling cache 2024-09-12T18:51:56.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.281+0000 7ff2bbd799c0 20 remove_watcher() i=1 2024-09-12T18:51:56.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.281+0000 7ff2bbd799c0 20 remove_watcher() i=2 2024-09-12T18:51:56.289 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.285+0000 7ff2bbd799c0 20 remove_watcher() i=3 2024-09-12T18:51:56.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.285+0000 7ff2bbd799c0 20 remove_watcher() i=4 2024-09-12T18:51:56.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.289+0000 7ff2bbd799c0 20 remove_watcher() i=5 2024-09-12T18:51:56.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.289+0000 7ff2bbd799c0 20 remove_watcher() i=6 2024-09-12T18:51:56.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:51:56.289+0000 7ff2bbd799c0 20 remove_watcher() i=7 2024-09-12T18:52:26.342 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T18:52:26.376 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:26.376 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:26.421 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.420+0000 7fbd0aa569c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.420+0000 7fbd0aa569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:26.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.420+0000 7fbd0aa569c0 20 realm 2024-09-12T18:52:26.423 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.420+0000 7fbd0aa569c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.420+0000 7fbd0aa569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:26.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.420+0000 7fbd0aa569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:26.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.420+0000 7fbd0aa569c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.420+0000 7fbd0aa569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:26.424 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.420+0000 7fbd0aa569c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.424+0000 7fbd0aa569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:26.425 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.424+0000 7fbd0aa569c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.424+0000 7fbd0aa569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:26.426 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.424+0000 7fbd0aa569c0 20 searching for the correct realm 2024-09-12T18:52:26.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.428+0000 7fbd08d5d640 0 -- 172.21.15.111:0/384087868 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fbcf00e8450 msgr2=0x7fbcf00e8890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:26.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.436+0000 7fbd07d5b640 0 -- 172.21.15.111:0/384087868 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fbd0005f000 msgr2=0x7fbd000771c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:52:26.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.652+0000 7fbd0aa569c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:26.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.652+0000 7fbd0aa569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:26.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.652+0000 7fbd0aa569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:26.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.652+0000 7fbd0aa569c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:26.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.652+0000 7fbd0aa569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:26.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.652+0000 7fbd0aa569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:26.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.652+0000 7fbd0aa569c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:26.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:26.657 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:26.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 zone default found 2024-09-12T18:52:26.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 4 Realm: () 2024-09-12T18:52:26.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:26.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:26.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:26.658 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 zonegroup default 2024-09-12T18:52:26.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:26.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:26.659 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:26.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 started sync module instance, tier type = 2024-09-12T18:52:26.660 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.656+0000 7fbd0aa569c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:26.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.680+0000 7fbd0aa569c0 20 add_watcher() i=0 2024-09-12T18:52:26.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.680+0000 7fbd0aa569c0 20 add_watcher() i=1 2024-09-12T18:52:26.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.680+0000 7fbd0aa569c0 20 add_watcher() i=2 2024-09-12T18:52:26.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.680+0000 7fbd0aa569c0 20 add_watcher() i=3 2024-09-12T18:52:26.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.680+0000 7fbd0aa569c0 20 add_watcher() i=4 2024-09-12T18:52:26.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.680+0000 7fbd0aa569c0 20 add_watcher() i=5 2024-09-12T18:52:26.684 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.680+0000 7fbd0aa569c0 20 add_watcher() i=6 2024-09-12T18:52:26.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.684+0000 7fbd0aa569c0 20 add_watcher() i=7 2024-09-12T18:52:26.686 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.684+0000 7fbd0aa569c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:26.690 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.688+0000 7fbbbf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:26.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.688+0000 7fbd0aa569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:26.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.688+0000 7fbd0aa569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:26.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.688+0000 7fbd0aa569c0 5 note: GC not initialized 2024-09-12T18:52:26.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.688+0000 7fbbbe7dc640 20 reqs_thread_entry: start 2024-09-12T18:52:26.691 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.688+0000 7fbd0aa569c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:26.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.688+0000 7fbd0aa569c0 20 Filter name: none 2024-09-12T18:52:26.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.688+0000 7fbbb77fe640 20 reqs_thread_entry: start 2024-09-12T18:52:26.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.688+0000 7fbd0aa569c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:52:26.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.688+0000 7fbd0aa569c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.692+0000 7fbd0aa569c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:52:26.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.692+0000 7fbd0aa569c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:52:26.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.692+0000 7fbd0aa569c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:52:26.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.692+0000 7fbd0aa569c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:52:26.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.692+0000 7fbd0aa569c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.692+0000 7fbd0aa569c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:52:26.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.692+0000 7fbd0aa569c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:52:26.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.692+0000 7fbd0aa569c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:52:26.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.692+0000 7fbd0aa569c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:52:26.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.692+0000 7fbd0aa569c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:26.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.692+0000 7fbd0aa569c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:52:26.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.700+0000 7fbbbf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:26.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.704+0000 7fbd0aa569c0 20 remove_watcher() i=0 2024-09-12T18:52:26.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.704+0000 7fbd0aa569c0 2 removed watcher, disabling cache 2024-09-12T18:52:26.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.704+0000 7fbd0aa569c0 20 remove_watcher() i=1 2024-09-12T18:52:26.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.708+0000 7fbd0aa569c0 20 remove_watcher() i=2 2024-09-12T18:52:26.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.712+0000 7fbd0aa569c0 20 remove_watcher() i=3 2024-09-12T18:52:26.714 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.712+0000 7fbd0aa569c0 20 remove_watcher() i=4 2024-09-12T18:52:26.716 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.712+0000 7fbd0aa569c0 20 remove_watcher() i=5 2024-09-12T18:52:26.718 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.716+0000 7fbd0aa569c0 20 remove_watcher() i=6 2024-09-12T18:52:26.719 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.716+0000 7fbd0aa569c0 20 remove_watcher() i=7 2024-09-12T18:52:26.735 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T18:52:26.762 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:26.762 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:26.807 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.804+0000 7f979a7099c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.808+0000 7f979a7099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:26.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.808+0000 7f979a7099c0 20 realm 2024-09-12T18:52:26.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.808+0000 7f979a7099c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.808+0000 7f979a7099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:26.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.808+0000 7f979a7099c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:26.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.808+0000 7f979a7099c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.808+0000 7f979a7099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:26.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.808+0000 7f979a7099c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.808+0000 7f979a7099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:26.811 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.808+0000 7f979a7099c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:26.812 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.808+0000 7f979a7099c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:26.812 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.808+0000 7f979a7099c0 20 searching for the correct realm 2024-09-12T18:52:26.815 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:26.812+0000 7f9798a10640 0 -- 172.21.15.111:0/3343611069 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f978c0d3040 msgr2=0x7f978c0f4930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:52:27.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.028+0000 7f9797a0e640 0 -- 172.21.15.111:0/3343611069 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f9790048bb0 msgr2=0x7f9790076850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:27.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.244+0000 7f979a7099c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:27.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.244+0000 7f979a7099c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:27.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.244+0000 7f979a7099c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:27.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.244+0000 7f979a7099c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:27.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.244+0000 7f979a7099c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:27.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.244+0000 7f979a7099c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:27.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.244+0000 7f979a7099c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:27.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:27.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:27.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 20 zone default found 2024-09-12T18:52:27.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 4 Realm: () 2024-09-12T18:52:27.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:27.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:27.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:27.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 20 zonegroup default 2024-09-12T18:52:27.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:27.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:27.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.248+0000 7f979a7099c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.252+0000 7f979a7099c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:27.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.252+0000 7f979a7099c0 20 started sync module instance, tier type = 2024-09-12T18:52:27.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.252+0000 7f979a7099c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:27.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.272+0000 7f979a7099c0 20 add_watcher() i=0 2024-09-12T18:52:27.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.272+0000 7f979a7099c0 20 add_watcher() i=1 2024-09-12T18:52:27.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.272+0000 7f979a7099c0 20 add_watcher() i=2 2024-09-12T18:52:27.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.272+0000 7f979a7099c0 20 add_watcher() i=3 2024-09-12T18:52:27.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.272+0000 7f979a7099c0 20 add_watcher() i=4 2024-09-12T18:52:27.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.272+0000 7f979a7099c0 20 add_watcher() i=5 2024-09-12T18:52:27.276 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.272+0000 7f979a7099c0 20 add_watcher() i=6 2024-09-12T18:52:27.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.276+0000 7f979a7099c0 20 add_watcher() i=7 2024-09-12T18:52:27.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.276+0000 7f979a7099c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:27.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.280+0000 7f964efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:27.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.280+0000 7f979a7099c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:27.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.280+0000 7f979a7099c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:27.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.280+0000 7f979a7099c0 5 note: GC not initialized 2024-09-12T18:52:27.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.280+0000 7f964dfdb640 20 reqs_thread_entry: start 2024-09-12T18:52:27.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.280+0000 7f979a7099c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:27.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.280+0000 7f979a7099c0 20 Filter name: none 2024-09-12T18:52:27.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f95bf7fe640 20 reqs_thread_entry: start 2024-09-12T18:52:27.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:52:27.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:52:27.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:52:27.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:52:27.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:52:27.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T18:52:27.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:52:27.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:52:27.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:52:27.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:27.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:52:27.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:52:27.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:52:27.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:52:27.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.284+0000 7f979a7099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:52:27.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.288+0000 7f979a7099c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:52:27.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.288+0000 7f979a7099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:52:27.289 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.288+0000 7f979a7099c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:52:27.289 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.288+0000 7f979a7099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:52:27.289 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.288+0000 7f979a7099c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:52:27.290 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.288+0000 7f979a7099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:52:27.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.288+0000 7f979a7099c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:52:27.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.288+0000 7f979a7099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:52:27.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.288+0000 7f979a7099c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:52:27.291 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.288+0000 7f979a7099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:52:27.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.288+0000 7f979a7099c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:52:27.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.288+0000 7f979a7099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:52:27.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.292+0000 7f979a7099c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:52:27.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.292+0000 7f979a7099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:52:27.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.292+0000 7f979a7099c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:52:27.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.292+0000 7f979a7099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:52:27.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.292+0000 7f979a7099c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:52:27.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.292+0000 7f979a7099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:52:27.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.292+0000 7f979a7099c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:52:27.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.292+0000 7f979a7099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:52:27.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.292+0000 7f979a7099c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:52:27.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.292+0000 7f979a7099c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:52:27.298 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.296+0000 7f964efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:27.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.300+0000 7f979a7099c0 20 remove_watcher() i=0 2024-09-12T18:52:27.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.300+0000 7f979a7099c0 2 removed watcher, disabling cache 2024-09-12T18:52:27.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.304+0000 7f979a7099c0 20 remove_watcher() i=1 2024-09-12T18:52:27.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.304+0000 7f979a7099c0 20 remove_watcher() i=2 2024-09-12T18:52:27.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.308+0000 7f979a7099c0 20 remove_watcher() i=3 2024-09-12T18:52:27.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.308+0000 7f979a7099c0 20 remove_watcher() i=4 2024-09-12T18:52:27.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.312+0000 7f979a7099c0 20 remove_watcher() i=5 2024-09-12T18:52:27.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.312+0000 7f979a7099c0 20 remove_watcher() i=6 2024-09-12T18:52:27.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.316+0000 7f979a7099c0 20 remove_watcher() i=7 2024-09-12T18:52:27.332 INFO:tasks.workunit.client.0.smithi111.stderr:check reshard logrecord successfully 2024-09-12T18:52:27.332 INFO:tasks.workunit.client.0.smithi111.stderr: test: reshard versioned bucket 2024-09-12T18:52:27.332 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:52:27.359 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:27.359 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:27.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.404+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.404+0000 7f29c02d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:27.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.404+0000 7f29c02d59c0 20 realm 2024-09-12T18:52:27.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.404+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.404+0000 7f29c02d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:27.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.404+0000 7f29c02d59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:27.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.404+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.404+0000 7f29c02d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:27.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.404+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.404+0000 7f29c02d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:27.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.408+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.408+0000 7f29c02d59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:27.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.408+0000 7f29c02d59c0 20 searching for the correct realm 2024-09-12T18:52:27.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.412+0000 7f29be5dc640 0 -- 172.21.15.111:0/2405831184 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f29a8070020 msgr2=0x7f29a8072040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:27.631 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.628+0000 7f29b7fff640 0 -- 172.21.15.111:0/2405831184 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f29b8025040 msgr2=0x7f29b8050420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:27.848 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.844+0000 7f29c02d59c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:27.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.844+0000 7f29c02d59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:27.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.844+0000 7f29c02d59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:27.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.844+0000 7f29c02d59c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:27.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.844+0000 7f29c02d59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:27.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.844+0000 7f29c02d59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:27.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.844+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.848+0000 7f29c02d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:27.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.848+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.848+0000 7f29c02d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:27.850 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.848+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.848+0000 7f29c02d59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:27.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.848+0000 7f29c02d59c0 20 zone default found 2024-09-12T18:52:27.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.848+0000 7f29c02d59c0 4 Realm: () 2024-09-12T18:52:27.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.848+0000 7f29c02d59c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:27.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.848+0000 7f29c02d59c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:27.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.848+0000 7f29c02d59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:27.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.848+0000 7f29c02d59c0 20 zonegroup default 2024-09-12T18:52:27.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.848+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.848+0000 7f29c02d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:27.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.848+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.852+0000 7f29c02d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:27.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.852+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.852+0000 7f29c02d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:27.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.852+0000 7f29c02d59c0 20 started sync module instance, tier type = 2024-09-12T18:52:27.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.852+0000 7f29c02d59c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:27.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.876+0000 7f29c02d59c0 20 add_watcher() i=0 2024-09-12T18:52:27.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.876+0000 7f29c02d59c0 20 add_watcher() i=1 2024-09-12T18:52:27.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.876+0000 7f29c02d59c0 20 add_watcher() i=2 2024-09-12T18:52:27.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.876+0000 7f29c02d59c0 20 add_watcher() i=3 2024-09-12T18:52:27.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.876+0000 7f29c02d59c0 20 add_watcher() i=4 2024-09-12T18:52:27.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.876+0000 7f29c02d59c0 20 add_watcher() i=5 2024-09-12T18:52:27.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.876+0000 7f29c02d59c0 20 add_watcher() i=6 2024-09-12T18:52:27.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.876+0000 7f29c02d59c0 20 add_watcher() i=7 2024-09-12T18:52:27.879 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.876+0000 7f29c02d59c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:27.883 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.880+0000 7f286f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:27.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.880+0000 7f29c02d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:27.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.880+0000 7f29c02d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:27.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.880+0000 7f29c02d59c0 5 note: GC not initialized 2024-09-12T18:52:27.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.884+0000 7f286e7fc640 20 reqs_thread_entry: start 2024-09-12T18:52:27.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.884+0000 7f29c02d59c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:27.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.884+0000 7f29c02d59c0 20 Filter name: none 2024-09-12T18:52:27.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.884+0000 7f27dffff640 20 reqs_thread_entry: start 2024-09-12T18:52:27.885 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.884+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.884+0000 7f29c02d59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:27.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.884+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.884+0000 7f29c02d59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:27.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.884+0000 7f29c02d59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:27.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.884+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.884+0000 7f29c02d59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:27.887 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.884+0000 7f29c02d59c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:27.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.884+0000 7f29c02d59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:27.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.884+0000 7f29c02d59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:27.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.888+0000 7f286f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:27.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.892+0000 7f29c02d59c0 20 remove_watcher() i=0 2024-09-12T18:52:27.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.892+0000 7f29c02d59c0 2 removed watcher, disabling cache 2024-09-12T18:52:27.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.896+0000 7f29c02d59c0 20 remove_watcher() i=1 2024-09-12T18:52:27.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.896+0000 7f29c02d59c0 20 remove_watcher() i=2 2024-09-12T18:52:27.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.900+0000 7f29c02d59c0 20 remove_watcher() i=3 2024-09-12T18:52:27.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.904+0000 7f29c02d59c0 20 remove_watcher() i=4 2024-09-12T18:52:27.906 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.904+0000 7f29c02d59c0 20 remove_watcher() i=5 2024-09-12T18:52:27.907 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.904+0000 7f29c02d59c0 20 remove_watcher() i=6 2024-09-12T18:52:27.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:27.908+0000 7f29c02d59c0 20 remove_watcher() i=7 2024-09-12T18:52:27.926 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:52:27.926 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:52:27.926 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: myver id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T18:52:27.926 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:52:27.926 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-12T18:52:27.960 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:27.960 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:28.004 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.000+0000 7f6b7d2379c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.004+0000 7f6b7d2379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.004+0000 7f6b7d2379c0 20 realm 2024-09-12T18:52:28.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.004+0000 7f6b7d2379c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.004+0000 7f6b7d2379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.004+0000 7f6b7d2379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:28.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.004+0000 7f6b7d2379c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.004+0000 7f6b7d2379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.006 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.004+0000 7f6b7d2379c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.007 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.004+0000 7f6b7d2379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:28.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.004+0000 7f6b7d2379c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.008+0000 7f6b7d2379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:28.008 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.008+0000 7f6b7d2379c0 20 searching for the correct realm 2024-09-12T18:52:28.014 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.012+0000 7f6b7b53e640 0 -- 172.21.15.111:0/3724763129 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x5606aee2afd0 msgr2=0x5606aee2d3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:28.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.016+0000 7f6b7a53c640 0 -- 172.21.15.111:0/3724763129 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f6b740841a0 msgr2=0x7f6b74001690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:52:28.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.024+0000 7f6b7d2379c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:28.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.024+0000 7f6b7d2379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:28.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.024+0000 7f6b7d2379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:28.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.024+0000 7f6b7d2379c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:28.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.024+0000 7f6b7d2379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:28.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.024+0000 7f6b7d2379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:28.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.024+0000 7f6b7d2379c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.024+0000 7f6b7d2379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.024+0000 7f6b7d2379c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:28.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:28.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 20 zone default found 2024-09-12T18:52:28.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 4 Realm: () 2024-09-12T18:52:28.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:28.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:28.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:28.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 20 zonegroup default 2024-09-12T18:52:28.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 20 started sync module instance, tier type = 2024-09-12T18:52:28.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.028+0000 7f6b7d2379c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:28.047 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.044+0000 7f6b7d2379c0 20 add_watcher() i=0 2024-09-12T18:52:28.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.044+0000 7f6b7d2379c0 20 add_watcher() i=1 2024-09-12T18:52:28.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.044+0000 7f6b7d2379c0 20 add_watcher() i=2 2024-09-12T18:52:28.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.044+0000 7f6b7d2379c0 20 add_watcher() i=3 2024-09-12T18:52:28.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.044+0000 7f6b7d2379c0 20 add_watcher() i=4 2024-09-12T18:52:28.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.044+0000 7f6b7d2379c0 20 add_watcher() i=5 2024-09-12T18:52:28.048 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.044+0000 7f6b7d2379c0 20 add_watcher() i=6 2024-09-12T18:52:28.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.048+0000 7f6b7d2379c0 20 add_watcher() i=7 2024-09-12T18:52:28.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.048+0000 7f6b7d2379c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:28.051 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.048+0000 7f6a317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:28.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.048+0000 7f6b7d2379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:28.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.048+0000 7f6b7d2379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:28.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.048+0000 7f6b7d2379c0 5 note: GC not initialized 2024-09-12T18:52:28.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.048+0000 7f69abfff640 20 reqs_thread_entry: start 2024-09-12T18:52:28.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.048+0000 7f6b7d2379c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:28.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.048+0000 7f6b7d2379c0 20 Filter name: none 2024-09-12T18:52:28.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.048+0000 7f69a9ffb640 20 reqs_thread_entry: start 2024-09-12T18:52:28.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.048+0000 7f6b7d2379c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:52:28.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.048+0000 7f6b7d2379c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.052+0000 7f6b7d2379c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:28.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.052+0000 7f6b7d2379c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:52:28.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.052+0000 7f6b7d2379c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:52:28.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.052+0000 7f6b7d2379c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 : miss 2024-09-12T18:52:28.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.052+0000 7f6b7d2379c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.052+0000 7f6b7d2379c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:28.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.052+0000 7f6b7d2379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:28.053 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.052+0000 7f6b7d2379c0 10 adding default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:28.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.052+0000 7f6b7d2379c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:52:28.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.052+0000 7f6b7d2379c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:28.054 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.052+0000 7f6b7d2379c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 2024-09-12T18:52:28.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.060+0000 7f6b7d2379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:28.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.060+0000 7f6b7d2379c0 10 moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:28.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.060+0000 7f6b7d2379c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:28.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.060+0000 7f6b7d2379c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18, ofs0, ns] 2024-09-12T18:52:28.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.060+0000 7f6a5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431587 cookie 94586703914768 notifier 7973 bl.length()=821 2024-09-12T18:52:28.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.060+0000 7f6a5e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:28.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.060+0000 7f6a5e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:28.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.060+0000 7f6a5e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:28.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.060+0000 7f6b7d2379c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_sources= new_sources= 2024-09-12T18:52:28.063 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.060+0000 7f6b7d2379c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential sources added=[] removed=[] 2024-09-12T18:52:28.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.060+0000 7f6b7d2379c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_dests= new_dests= 2024-09-12T18:52:28.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.060+0000 7f6b7d2379c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential dests added=[] removed=[] 2024-09-12T18:52:28.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.0 2024-09-12T18:52:28.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.0 2024-09-12T18:52:28.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.1 2024-09-12T18:52:28.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.1 2024-09-12T18:52:28.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.2 2024-09-12T18:52:28.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.2 2024-09-12T18:52:28.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.3 2024-09-12T18:52:28.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.3 2024-09-12T18:52:28.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.4 2024-09-12T18:52:28.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.4 2024-09-12T18:52:28.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.5 2024-09-12T18:52:28.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.5 2024-09-12T18:52:28.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.6 2024-09-12T18:52:28.075 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.6 2024-09-12T18:52:28.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.7 2024-09-12T18:52:28.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.7 2024-09-12T18:52:28.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.8 2024-09-12T18:52:28.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.8 2024-09-12T18:52:28.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.9 2024-09-12T18:52:28.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.9 2024-09-12T18:52:28.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.10 2024-09-12T18:52:28.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.10 2024-09-12T18:52:28.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.11 2024-09-12T18:52:28.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.11 2024-09-12T18:52:28.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.0 2024-09-12T18:52:28.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.072+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1 2024-09-12T18:52:28.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.076+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2 2024-09-12T18:52:28.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.076+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3 2024-09-12T18:52:28.078 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.076+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.4 2024-09-12T18:52:28.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.076+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.5 2024-09-12T18:52:28.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.080+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.6 2024-09-12T18:52:28.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.080+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.7 2024-09-12T18:52:28.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.080+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.8 2024-09-12T18:52:28.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.080+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.9 2024-09-12T18:52:28.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.080+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.10 2024-09-12T18:52:28.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.080+0000 7f6b7d2379c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:52:28.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.080+0000 7f6b7d2379c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 2024-09-12T18:52:28.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.084+0000 7f6b7d2379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:28.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.084+0000 7f6b7d2379c0 10 moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:28.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.084+0000 7f6b7d2379c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:28.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.084+0000 7f6b7d2379c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18, ofs0, ns] 2024-09-12T18:52:28.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.084+0000 7f6a5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431588 cookie 94586703914768 notifier 7973 bl.length()=821 2024-09-12T18:52:28.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.084+0000 7f6a5e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:28.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.084+0000 7f6a5e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:28.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.084+0000 7f6a5e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:28.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.084+0000 7f6b7d2379c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_sources= new_sources= 2024-09-12T18:52:28.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.084+0000 7f6b7d2379c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential sources added=[] removed=[] 2024-09-12T18:52:28.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.084+0000 7f6b7d2379c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_dests= new_dests= 2024-09-12T18:52:28.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.084+0000 7f6b7d2379c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential dests added=[] removed=[] 2024-09-12T18:52:28.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.092+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.0 2024-09-12T18:52:28.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.092+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1 2024-09-12T18:52:28.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.092+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2 2024-09-12T18:52:28.095 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.092+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3 2024-09-12T18:52:28.095 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.092+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.4 2024-09-12T18:52:28.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.092+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.5 2024-09-12T18:52:28.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.096+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.6 2024-09-12T18:52:28.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.096+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.7 2024-09-12T18:52:28.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.096+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.8 2024-09-12T18:52:28.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.096+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.9 2024-09-12T18:52:28.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.096+0000 7f6b7d2379c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.10 2024-09-12T18:52:28.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.096+0000 7f6b7d2379c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:52:28.099 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.096+0000 7f6b7d2379c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 2024-09-12T18:52:28.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.100+0000 7f6b7d2379c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:28.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.100+0000 7f6b7d2379c0 10 moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:28.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.100+0000 7f6b7d2379c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:28.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.100+0000 7f6b7d2379c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18, ofs0, ns] 2024-09-12T18:52:28.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.100+0000 7f6a5e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 94586703914768 notifier 7973 bl.length()=789 2024-09-12T18:52:28.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.100+0000 7f6a5e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:28.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.100+0000 7f6a5e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:28.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.100+0000 7f6a5e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:28.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.100+0000 7f6b7d2379c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_sources= new_sources= 2024-09-12T18:52:28.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.100+0000 7f6b7d2379c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential sources added=[] removed=[] 2024-09-12T18:52:28.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.100+0000 7f6b7d2379c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_dests= new_dests= 2024-09-12T18:52:28.102 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.100+0000 7f6b7d2379c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential dests added=[] removed=[] 2024-09-12T18:52:28.107 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.104+0000 7f6b7d2379c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-12T18:52:28.109 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.108+0000 7f6a317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:28.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.112+0000 7f6b7d2379c0 20 remove_watcher() i=0 2024-09-12T18:52:28.114 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.112+0000 7f6b7d2379c0 2 removed watcher, disabling cache 2024-09-12T18:52:28.116 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.112+0000 7f6b7d2379c0 20 remove_watcher() i=1 2024-09-12T18:52:28.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.116+0000 7f6b7d2379c0 20 remove_watcher() i=2 2024-09-12T18:52:28.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.116+0000 7f6b7d2379c0 20 remove_watcher() i=3 2024-09-12T18:52:28.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.120+0000 7f6b7d2379c0 20 remove_watcher() i=4 2024-09-12T18:52:28.123 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.120+0000 7f6b7d2379c0 20 remove_watcher() i=5 2024-09-12T18:52:28.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.124+0000 7f6b7d2379c0 20 remove_watcher() i=6 2024-09-12T18:52:28.125 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.124+0000 7f6b7d2379c0 20 remove_watcher() i=7 2024-09-12T18:52:28.139 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:52:28.165 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:28.165 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:28.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.208+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.208+0000 7f59b70c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.208+0000 7f59b70c39c0 20 realm 2024-09-12T18:52:28.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.208+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.208+0000 7f59b70c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.208+0000 7f59b70c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:28.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.208+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.208+0000 7f59b70c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.212 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.208+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.213 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.212+0000 7f59b70c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:28.213 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.212+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.214 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.212+0000 7f59b70c39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:28.214 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.212+0000 7f59b70c39c0 20 searching for the correct realm 2024-09-12T18:52:28.219 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.216+0000 7f59b4bc9640 0 -- 172.21.15.111:0/3532586262 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f59ac02a020 msgr2=0x7f59ac07e220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:28.225 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.224+0000 7f59b43c8640 0 -- 172.21.15.111:0/3532586262 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f59ac090280 msgr2=0x7f59ac050120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:28.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.440+0000 7f59b70c39c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:28.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.440+0000 7f59b70c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:28.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.440+0000 7f59b70c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:28.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.440+0000 7f59b70c39c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:28.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.440+0000 7f59b70c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:28.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.440+0000 7f59b70c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:28.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.440+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:28.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:28.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 zone default found 2024-09-12T18:52:28.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 4 Realm: () 2024-09-12T18:52:28.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:28.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:28.446 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:28.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 zonegroup default 2024-09-12T18:52:28.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 started sync module instance, tier type = 2024-09-12T18:52:28.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.444+0000 7f59b70c39c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:28.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.468+0000 7f59b70c39c0 20 add_watcher() i=0 2024-09-12T18:52:28.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.468+0000 7f59b70c39c0 20 add_watcher() i=1 2024-09-12T18:52:28.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.468+0000 7f59b70c39c0 20 add_watcher() i=2 2024-09-12T18:52:28.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.468+0000 7f59b70c39c0 20 add_watcher() i=3 2024-09-12T18:52:28.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.468+0000 7f59b70c39c0 20 add_watcher() i=4 2024-09-12T18:52:28.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.468+0000 7f59b70c39c0 20 add_watcher() i=5 2024-09-12T18:52:28.472 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.468+0000 7f59b70c39c0 20 add_watcher() i=6 2024-09-12T18:52:28.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.472+0000 7f59b70c39c0 20 add_watcher() i=7 2024-09-12T18:52:28.474 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.472+0000 7f59b70c39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:28.478 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.476+0000 7f586afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:28.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.476+0000 7f59b70c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:28.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.476+0000 7f59b70c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:28.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.476+0000 7f59b70c39c0 5 note: GC not initialized 2024-09-12T18:52:28.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.476+0000 7f5869fe3640 20 reqs_thread_entry: start 2024-09-12T18:52:28.479 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.476+0000 7f59b70c39c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:28.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.476+0000 7f59b70c39c0 20 Filter name: none 2024-09-12T18:52:28.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.476+0000 7f57db7fe640 20 reqs_thread_entry: start 2024-09-12T18:52:28.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.476+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.480+0000 7f59b70c39c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:28.480 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.480+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.481 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.480+0000 7f59b70c39c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:28.481 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.480+0000 7f59b70c39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:28.481 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.480+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.480+0000 7f59b70c39c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:28.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.480+0000 7f59b70c39c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.480+0000 7f59b70c39c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:28.482 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.480+0000 7f59b70c39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:28.486 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.484+0000 7f586afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:28.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.488+0000 7f59b70c39c0 20 remove_watcher() i=0 2024-09-12T18:52:28.491 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.488+0000 7f59b70c39c0 2 removed watcher, disabling cache 2024-09-12T18:52:28.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.492+0000 7f59b70c39c0 20 remove_watcher() i=1 2024-09-12T18:52:28.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.492+0000 7f59b70c39c0 20 remove_watcher() i=2 2024-09-12T18:52:28.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.496+0000 7f59b70c39c0 20 remove_watcher() i=3 2024-09-12T18:52:28.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.496+0000 7f59b70c39c0 20 remove_watcher() i=4 2024-09-12T18:52:28.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.500+0000 7f59b70c39c0 20 remove_watcher() i=5 2024-09-12T18:52:28.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.500+0000 7f59b70c39c0 20 remove_watcher() i=6 2024-09-12T18:52:28.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.500+0000 7f59b70c39c0 20 remove_watcher() i=7 2024-09-12T18:52:28.520 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:52:28.520 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:52:28.520 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: myver id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T18:52:28.520 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:52:28.522 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:28.522 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:28.526 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:28.526 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:28.569 INFO:tasks.workunit.client.0.smithi111.stderr: test: reshard removes olh entries with empty name 2024-09-12T18:52:28.575 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:28.575 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:28.632 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:28.632 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:28.729 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T18:52:28.760 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:28.760 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:28.806 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.804+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.804+0000 7f3d0463e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.804+0000 7f3d0463e9c0 20 realm 2024-09-12T18:52:28.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.804+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.804+0000 7f3d0463e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.804+0000 7f3d0463e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:28.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.804+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.804+0000 7f3d0463e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:28.808 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.804+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.808+0000 7f3d0463e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:28.809 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.808+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:28.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.808+0000 7f3d0463e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:28.810 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.808+0000 7f3d0463e9c0 20 searching for the correct realm 2024-09-12T18:52:28.814 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:28.812+0000 7f3d02945640 0 -- 172.21.15.111:0/3697242383 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f3cf8046060 msgr2=0x7f3cf8065680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:29.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.028+0000 7f3d01943640 0 -- 172.21.15.111:0/3697242383 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f3cfc063a90 msgr2=0x7f3cfc061040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:29.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.248+0000 7f3d0463e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:29.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.248+0000 7f3d0463e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:29.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.248+0000 7f3d0463e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:29.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.248+0000 7f3d0463e9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:29.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.248+0000 7f3d0463e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:29.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.248+0000 7f3d0463e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:29.250 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.248+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.248+0000 7f3d0463e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:29.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.248+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.248+0000 7f3d0463e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:29.251 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.248+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:29.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 20 zone default found 2024-09-12T18:52:29.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 4 Realm: () 2024-09-12T18:52:29.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:29.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:29.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:29.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 20 zonegroup default 2024-09-12T18:52:29.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:29.254 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:29.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:29.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 20 started sync module instance, tier type = 2024-09-12T18:52:29.255 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.252+0000 7f3d0463e9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:29.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.276+0000 7f3d0463e9c0 20 add_watcher() i=0 2024-09-12T18:52:29.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.276+0000 7f3d0463e9c0 20 add_watcher() i=1 2024-09-12T18:52:29.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.276+0000 7f3d0463e9c0 20 add_watcher() i=2 2024-09-12T18:52:29.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.276+0000 7f3d0463e9c0 20 add_watcher() i=3 2024-09-12T18:52:29.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.276+0000 7f3d0463e9c0 20 add_watcher() i=4 2024-09-12T18:52:29.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.276+0000 7f3d0463e9c0 20 add_watcher() i=5 2024-09-12T18:52:29.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.276+0000 7f3d0463e9c0 20 add_watcher() i=6 2024-09-12T18:52:29.278 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.276+0000 7f3d0463e9c0 20 add_watcher() i=7 2024-09-12T18:52:29.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.276+0000 7f3d0463e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:29.282 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.280+0000 7f3bb8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:29.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.280+0000 7f3d0463e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:29.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.280+0000 7f3d0463e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:29.283 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.280+0000 7f3d0463e9c0 5 note: GC not initialized 2024-09-12T18:52:29.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.280+0000 7f3b337fe640 20 reqs_thread_entry: start 2024-09-12T18:52:29.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.280+0000 7f3d0463e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:29.284 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.284+0000 7f3d0463e9c0 20 Filter name: none 2024-09-12T18:52:29.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.284+0000 7f3b317fa640 20 reqs_thread_entry: start 2024-09-12T18:52:29.285 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.284+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.284+0000 7f3d0463e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:52:29.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.284+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.284+0000 7f3d0463e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:52:29.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.284+0000 7f3d0463e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:29.286 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.284+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.287 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.284+0000 7f3d0463e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:52:29.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.284+0000 7f3d0463e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.284+0000 7f3d0463e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:52:29.288 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.284+0000 7f3d0463e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:29.292 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.288+0000 7f3bb8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:29.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.296+0000 7f3d0463e9c0 20 remove_watcher() i=0 2024-09-12T18:52:29.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.296+0000 7f3d0463e9c0 2 removed watcher, disabling cache 2024-09-12T18:52:29.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.296+0000 7f3d0463e9c0 20 remove_watcher() i=1 2024-09-12T18:52:29.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.300+0000 7f3d0463e9c0 20 remove_watcher() i=2 2024-09-12T18:52:29.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.300+0000 7f3d0463e9c0 20 remove_watcher() i=3 2024-09-12T18:52:29.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.304+0000 7f3d0463e9c0 20 remove_watcher() i=4 2024-09-12T18:52:29.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.304+0000 7f3d0463e9c0 20 remove_watcher() i=5 2024-09-12T18:52:29.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.304+0000 7f3d0463e9c0 20 remove_watcher() i=6 2024-09-12T18:52:29.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.308+0000 7f3d0463e9c0 20 remove_watcher() i=7 2024-09-12T18:52:29.325 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:52:29.325 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:52:29.325 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: a-bucket id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-12T18:52:29.326 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:52:29.326 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T18:52:29.357 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:29.358 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:29.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.400+0000 7f1e1ec6e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.404+0000 7f1e1ec6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:29.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.404+0000 7f1e1ec6e9c0 20 realm 2024-09-12T18:52:29.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.404+0000 7f1e1ec6e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.404+0000 7f1e1ec6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:29.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.404+0000 7f1e1ec6e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:29.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.404+0000 7f1e1ec6e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.404+0000 7f1e1ec6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:29.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.404+0000 7f1e1ec6e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.404+0000 7f1e1ec6e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:29.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.404+0000 7f1e1ec6e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:29.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.404+0000 7f1e1ec6e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:29.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.404+0000 7f1e1ec6e9c0 20 searching for the correct realm 2024-09-12T18:52:29.412 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:29.408+0000 7f1e1cf75640 0 -- 172.21.15.111:0/4224127178 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f1e04088070 msgr2=0x7f1e0407f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:30.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.024+0000 7f1e1bf73640 0 -- 172.21.15.111:0/4224127178 >> [v2:172.21.15.153:6824/2813139034,v1:172.21.15.153:6825/2813139034] conn(0x558ee42a44b0 msgr2=0x558ee42a68a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:30.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.040+0000 7f1e1ec6e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:30.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.040+0000 7f1e1ec6e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:30.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.040+0000 7f1e1ec6e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:30.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.040+0000 7f1e1ec6e9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:30.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.040+0000 7f1e1ec6e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:30.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.040+0000 7f1e1ec6e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:30.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.040+0000 7f1e1ec6e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.040+0000 7f1e1ec6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.043 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.040+0000 7f1e1ec6e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.040+0000 7f1e1ec6e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:30.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.040+0000 7f1e1ec6e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:30.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 20 zone default found 2024-09-12T18:52:30.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 4 Realm: () 2024-09-12T18:52:30.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:30.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:30.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:30.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 20 zonegroup default 2024-09-12T18:52:30.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.045 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.047 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.047 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 20 started sync module instance, tier type = 2024-09-12T18:52:30.047 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.044+0000 7f1e1ec6e9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:30.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.072+0000 7f1e1ec6e9c0 20 add_watcher() i=0 2024-09-12T18:52:30.073 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.072+0000 7f1e1ec6e9c0 20 add_watcher() i=1 2024-09-12T18:52:30.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.072+0000 7f1e1ec6e9c0 20 add_watcher() i=2 2024-09-12T18:52:30.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.072+0000 7f1e1ec6e9c0 20 add_watcher() i=3 2024-09-12T18:52:30.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.072+0000 7f1e1ec6e9c0 20 add_watcher() i=4 2024-09-12T18:52:30.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.072+0000 7f1e1ec6e9c0 20 add_watcher() i=5 2024-09-12T18:52:30.074 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.072+0000 7f1e1ec6e9c0 20 add_watcher() i=6 2024-09-12T18:52:30.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.072+0000 7f1e1ec6e9c0 20 add_watcher() i=7 2024-09-12T18:52:30.076 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.072+0000 7f1e1ec6e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:30.079 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.076+0000 7f1cd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:30.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.080+0000 7f1e1ec6e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:30.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.080+0000 7f1e1ec6e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:30.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.080+0000 7f1e1ec6e9c0 5 note: GC not initialized 2024-09-12T18:52:30.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.080+0000 7f1cd1fdb640 20 reqs_thread_entry: start 2024-09-12T18:52:30.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.080+0000 7f1e1ec6e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:30.081 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.080+0000 7f1e1ec6e9c0 20 Filter name: none 2024-09-12T18:52:30.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.080+0000 7f1c437fe640 20 reqs_thread_entry: start 2024-09-12T18:52:30.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.080+0000 7f1e1ec6e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.080+0000 7f1e1ec6e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:52:30.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.080+0000 7f1e1ec6e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.080+0000 7f1e1ec6e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:52:30.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.080+0000 7f1e1ec6e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:30.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.084+0000 7f1cd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:30.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.088+0000 7f1e1ec6e9c0 20 remove_watcher() i=0 2024-09-12T18:52:30.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.088+0000 7f1e1ec6e9c0 2 removed watcher, disabling cache 2024-09-12T18:52:30.092 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.088+0000 7f1e1ec6e9c0 20 remove_watcher() i=1 2024-09-12T18:52:30.094 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.092+0000 7f1e1ec6e9c0 20 remove_watcher() i=2 2024-09-12T18:52:30.097 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.096+0000 7f1e1ec6e9c0 20 remove_watcher() i=3 2024-09-12T18:52:30.098 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.096+0000 7f1e1ec6e9c0 20 remove_watcher() i=4 2024-09-12T18:52:30.100 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.096+0000 7f1e1ec6e9c0 20 remove_watcher() i=5 2024-09-12T18:52:30.101 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.100+0000 7f1e1ec6e9c0 20 remove_watcher() i=6 2024-09-12T18:52:30.103 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.100+0000 7f1e1ec6e9c0 20 remove_watcher() i=7 2024-09-12T18:52:30.118 INFO:tasks.workunit.client.0.smithi111.stderr:rados -p default.rgw.buckets.index setomapval .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T18:52:30.144 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:30.144 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:30.164 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T18:52:30.190 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:30.190 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:30.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.232+0000 7f5850cf79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.232+0000 7f5850cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.232+0000 7f5850cf79c0 20 realm 2024-09-12T18:52:30.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.232+0000 7f5850cf79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.232+0000 7f5850cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.232+0000 7f5850cf79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:30.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.232+0000 7f5850cf79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.232+0000 7f5850cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.232+0000 7f5850cf79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.236+0000 7f5850cf79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:30.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.236+0000 7f5850cf79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.236+0000 7f5850cf79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:30.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.236+0000 7f5850cf79c0 20 searching for the correct realm 2024-09-12T18:52:30.242 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.240+0000 7f584effe640 0 -- 172.21.15.111:0/504559748 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f5844008040 msgr2=0x7f58440635f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:30.249 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.248+0000 7f584dffc640 0 -- 172.21.15.111:0/504559748 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f5848004040 msgr2=0x7f58480ea980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:30.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.464+0000 7f5850cf79c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:30.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.464+0000 7f5850cf79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:30.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.464+0000 7f5850cf79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:30.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.464+0000 7f5850cf79c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:30.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.464+0000 7f5850cf79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:30.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.464+0000 7f5850cf79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:30.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.464+0000 7f5850cf79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.467 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.464+0000 7f5850cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.464+0000 7f5850cf79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.464+0000 7f5850cf79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:30.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.464+0000 7f5850cf79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:30.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 20 zone default found 2024-09-12T18:52:30.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 4 Realm: () 2024-09-12T18:52:30.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:30.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:30.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:30.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 20 zonegroup default 2024-09-12T18:52:30.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.470 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 20 started sync module instance, tier type = 2024-09-12T18:52:30.471 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.468+0000 7f5850cf79c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:30.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.492+0000 7f5850cf79c0 20 add_watcher() i=0 2024-09-12T18:52:30.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.492+0000 7f5850cf79c0 20 add_watcher() i=1 2024-09-12T18:52:30.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.492+0000 7f5850cf79c0 20 add_watcher() i=2 2024-09-12T18:52:30.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.492+0000 7f5850cf79c0 20 add_watcher() i=3 2024-09-12T18:52:30.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.492+0000 7f5850cf79c0 20 add_watcher() i=4 2024-09-12T18:52:30.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.492+0000 7f5850cf79c0 20 add_watcher() i=5 2024-09-12T18:52:30.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.492+0000 7f5850cf79c0 20 add_watcher() i=6 2024-09-12T18:52:30.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.492+0000 7f5850cf79c0 20 add_watcher() i=7 2024-09-12T18:52:30.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.492+0000 7f5850cf79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:30.498 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.496+0000 7f5704fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:30.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.496+0000 7f5850cf79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:30.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.496+0000 7f5850cf79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:30.499 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.496+0000 7f5850cf79c0 5 note: GC not initialized 2024-09-12T18:52:30.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.496+0000 7f567f7fe640 20 reqs_thread_entry: start 2024-09-12T18:52:30.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.496+0000 7f5850cf79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:30.500 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f5850cf79c0 20 Filter name: none 2024-09-12T18:52:30.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f567d7fa640 20 reqs_thread_entry: start 2024-09-12T18:52:30.501 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f5850cf79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f5850cf79c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:52:30.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f5850cf79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f5850cf79c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:52:30.502 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f5850cf79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:30.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f5850cf79c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:52:30.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f5850cf79c0 20 INFO: main: starting shard=0 2024-09-12T18:52:30.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f5850cf79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:52:30.503 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f5850cf79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:52:30.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f5850cf79c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:52:30.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f5850cf79c0 20 INFO: main: starting shard=1 2024-09-12T18:52:30.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f5850cf79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:52:30.504 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.500+0000 7f5850cf79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:52:30.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:30.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 20 INFO: main: starting shard=2 2024-09-12T18:52:30.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:52:30.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:52:30.505 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:30.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 20 INFO: main: starting shard=3 2024-09-12T18:52:30.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:52:30.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:52:30.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:30.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 20 INFO: main: starting shard=4 2024-09-12T18:52:30.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:52:30.506 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:52:30.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:30.507 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 20 INFO: main: starting shard=5 2024-09-12T18:52:30.508 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:52:30.508 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.504+0000 7f5850cf79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:52:30.508 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:30.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 20 INFO: main: starting shard=6 2024-09-12T18:52:30.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:52:30.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:52:30.509 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:30.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 20 INFO: main: starting shard=7 2024-09-12T18:52:30.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:52:30.510 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:52:30.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:30.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 20 INFO: main: starting shard=8 2024-09-12T18:52:30.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:52:30.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:52:30.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:30.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 20 INFO: main: starting shard=9 2024-09-12T18:52:30.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:52:30.511 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.508+0000 7f5850cf79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:52:30.512 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.512+0000 7f5850cf79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:30.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.512+0000 7f5850cf79c0 20 INFO: main: starting shard=10 2024-09-12T18:52:30.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.512+0000 7f5850cf79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:52:30.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.512+0000 7f5850cf79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:52:30.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.512+0000 7f5850cf79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:30.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.512+0000 7f5850cf79c0 20 INFO: main: starting shard=11 2024-09-12T18:52:30.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.512+0000 7f5850cf79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:52:30.513 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.512+0000 7f5850cf79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:52:30.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.512+0000 7f5850cf79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:30.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.512+0000 7f5850cf79c0 20 INFO: main: starting shard=12 2024-09-12T18:52:30.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.512+0000 7f5850cf79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:52:30.515 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.512+0000 7f5850cf79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:52:30.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.516+0000 7f5850cf79c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:30.517 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.516+0000 7f5850cf79c0 20 INFO: main: done 2024-09-12T18:52:30.518 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.516+0000 7f5704fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:30.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.520+0000 7f5850cf79c0 20 remove_watcher() i=0 2024-09-12T18:52:30.524 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.520+0000 7f5850cf79c0 2 removed watcher, disabling cache 2024-09-12T18:52:30.526 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.524+0000 7f5850cf79c0 20 remove_watcher() i=1 2024-09-12T18:52:30.528 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.528+0000 7f5850cf79c0 20 remove_watcher() i=2 2024-09-12T18:52:30.530 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.528+0000 7f5850cf79c0 20 remove_watcher() i=3 2024-09-12T18:52:30.533 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.532+0000 7f5850cf79c0 20 remove_watcher() i=4 2024-09-12T18:52:30.534 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.532+0000 7f5850cf79c0 20 remove_watcher() i=5 2024-09-12T18:52:30.536 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.532+0000 7f5850cf79c0 20 remove_watcher() i=6 2024-09-12T18:52:30.537 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.536+0000 7f5850cf79c0 20 remove_watcher() i=7 2024-09-12T18:52:30.554 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T18:52:30.588 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:30.588 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:30.633 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.632+0000 7ff4d4dc69c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.632+0000 7ff4d4dc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.632+0000 7ff4d4dc69c0 20 realm 2024-09-12T18:52:30.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.632+0000 7ff4d4dc69c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.632+0000 7ff4d4dc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.632+0000 7ff4d4dc69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:30.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.632+0000 7ff4d4dc69c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.635 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.632+0000 7ff4d4dc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.636 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.632+0000 7ff4d4dc69c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.636+0000 7ff4d4dc69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:30.637 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.636+0000 7ff4d4dc69c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.636+0000 7ff4d4dc69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:30.638 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.636+0000 7ff4d4dc69c0 20 searching for the correct realm 2024-09-12T18:52:30.640 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.636+0000 7ff4d20cb640 0 -- 172.21.15.111:0/1313173268 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7ff4c40d4070 msgr2=0x7ff4c40fb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:30.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.848+0000 7ff4d28cc640 0 -- 172.21.15.111:0/1313173268 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7ff4cc04a030 msgr2=0x7ff4cc0036b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:30.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.864+0000 7ff4d4dc69c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:30.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.864+0000 7ff4d4dc69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:30.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.864+0000 7ff4d4dc69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:30.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.864+0000 7ff4d4dc69c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:30.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.864+0000 7ff4d4dc69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:30.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.864+0000 7ff4d4dc69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:30.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.864+0000 7ff4d4dc69c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:30.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:30.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 20 zone default found 2024-09-12T18:52:30.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 4 Realm: () 2024-09-12T18:52:30.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:30.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:30.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:30.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 20 zonegroup default 2024-09-12T18:52:30.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.868+0000 7ff4d4dc69c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.872+0000 7ff4d4dc69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:30.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.872+0000 7ff4d4dc69c0 20 started sync module instance, tier type = 2024-09-12T18:52:30.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.872+0000 7ff4d4dc69c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:30.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.892+0000 7ff4d4dc69c0 20 add_watcher() i=0 2024-09-12T18:52:30.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.892+0000 7ff4d4dc69c0 20 add_watcher() i=1 2024-09-12T18:52:30.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.892+0000 7ff4d4dc69c0 20 add_watcher() i=2 2024-09-12T18:52:30.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.892+0000 7ff4d4dc69c0 20 add_watcher() i=3 2024-09-12T18:52:30.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.892+0000 7ff4d4dc69c0 20 add_watcher() i=4 2024-09-12T18:52:30.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.892+0000 7ff4d4dc69c0 20 add_watcher() i=5 2024-09-12T18:52:30.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.892+0000 7ff4d4dc69c0 20 add_watcher() i=6 2024-09-12T18:52:30.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.892+0000 7ff4d4dc69c0 20 add_watcher() i=7 2024-09-12T18:52:30.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.892+0000 7ff4d4dc69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:30.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.896+0000 7ff3897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:30.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.896+0000 7ff4d4dc69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:30.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.896+0000 7ff4d4dc69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:30.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.896+0000 7ff4d4dc69c0 5 note: GC not initialized 2024-09-12T18:52:30.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.896+0000 7ff303fff640 20 reqs_thread_entry: start 2024-09-12T18:52:30.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.896+0000 7ff4d4dc69c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:30.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.896+0000 7ff4d4dc69c0 20 Filter name: none 2024-09-12T18:52:30.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.896+0000 7ff301ffb640 20 reqs_thread_entry: start 2024-09-12T18:52:30.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.896+0000 7ff4d4dc69c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T18:52:30.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.896+0000 7ff4d4dc69c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.900+0000 7ff4d4dc69c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:52:30.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.900+0000 7ff4d4dc69c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T18:52:30.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.900+0000 7ff4d4dc69c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T18:52:30.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.900+0000 7ff4d4dc69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : miss 2024-09-12T18:52:30.901 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.900+0000 7ff4d4dc69c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:30.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.900+0000 7ff4d4dc69c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:52:30.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.900+0000 7ff4d4dc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:52:30.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.900+0000 7ff4d4dc69c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:52:30.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.900+0000 7ff4d4dc69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:52:30.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.900+0000 7ff4d4dc69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:30.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.900+0000 7ff4d4dc69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:52:30.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.904+0000 7ff4d4dc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:52:30.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.904+0000 7ff4d4dc69c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:52:30.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.904+0000 7ff4d4dc69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:30.908 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.904+0000 7ff4d4dc69c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:52:30.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.908+0000 7ff3b5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431692 cookie 94093104343936 notifier 8643 bl.length()=827 2024-09-12T18:52:30.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.908+0000 7ff3b5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:52:30.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.908+0000 7ff3b5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:52:30.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.908+0000 7ff3b5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:30.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.908+0000 7ff4d4dc69c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:52:30.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.908+0000 7ff4d4dc69c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:52:30.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.908+0000 7ff4d4dc69c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:52:30.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.908+0000 7ff4d4dc69c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:52:30.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.920+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.0 2024-09-12T18:52:30.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.920+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.0 2024-09-12T18:52:30.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.920+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:52:30.922 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.920+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:52:30.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.920+0000 7ff4d4dc69c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T18:52:30.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.920+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:52:30.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.920+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:52:30.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.920+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:52:30.924 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.920+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:52:30.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.924+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:52:30.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.924+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:52:30.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.924+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:52:30.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.924+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:52:30.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.924+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:52:30.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.924+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:52:30.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.924+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:52:30.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.924+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:52:30.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.928+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:52:30.928 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.928+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:52:30.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.928+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:52:30.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.928+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:52:30.931 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.928+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:52:30.931 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.928+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:52:30.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.928+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:52:30.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.928+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:52:30.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.932+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:52:30.932 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.932+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:52:30.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.932+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:52:30.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.932+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:52:30.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.932+0000 7ff4d4dc69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:52:30.935 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.932+0000 7ff4d4dc69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:52:30.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.936+0000 7ff4d4dc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:52:30.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.936+0000 7ff4d4dc69c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:52:30.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.936+0000 7ff4d4dc69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:30.937 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.936+0000 7ff4d4dc69c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:52:30.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.936+0000 7ff3b5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431693 cookie 94093104343936 notifier 8643 bl.length()=827 2024-09-12T18:52:30.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.936+0000 7ff3b5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:52:30.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.936+0000 7ff3b5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:52:30.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.936+0000 7ff3b5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:30.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.936+0000 7ff4d4dc69c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:52:30.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.936+0000 7ff4d4dc69c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:52:30.938 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.936+0000 7ff4d4dc69c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:52:30.939 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.936+0000 7ff4d4dc69c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:52:30.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.940+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:52:30.944 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.940+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.0 2024-09-12T18:52:30.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.944+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:52:30.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.944+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.1 2024-09-12T18:52:30.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.944+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:52:30.945 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.944+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.2 2024-09-12T18:52:30.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.944+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:52:30.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.944+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.3 2024-09-12T18:52:30.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.944+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:52:30.946 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.944+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.4 2024-09-12T18:52:30.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.944+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:52:30.947 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.944+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.5 2024-09-12T18:52:30.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.948+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:52:30.948 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.948+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.6 2024-09-12T18:52:30.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.948+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:52:30.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.948+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.7 2024-09-12T18:52:30.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.948+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:52:30.949 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.948+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.8 2024-09-12T18:52:30.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.948+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:52:30.950 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.948+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.9 2024-09-12T18:52:30.951 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.948+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:52:30.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.948+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.10 2024-09-12T18:52:30.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.948+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:52:30.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.948+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.11 2024-09-12T18:52:30.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.952+0000 7ff4d4dc69c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:52:30.952 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.952+0000 7ff4d4dc69c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.2.12 2024-09-12T18:52:30.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.952+0000 7ff4d4dc69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 : hit (requested=0x17, cached=0x17) 2024-09-12T18:52:30.953 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.952+0000 7ff4d4dc69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 2024-09-12T18:52:30.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.952+0000 7ff4d4dc69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:52:30.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.952+0000 7ff4d4dc69c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:52:30.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.952+0000 7ff4d4dc69c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:30.955 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.952+0000 7ff4d4dc69c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17, ofs0, ns] 2024-09-12T18:52:30.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.952+0000 7ff3b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431694 cookie 94093104343936 notifier 8643 bl.length()=795 2024-09-12T18:52:30.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.952+0000 7ff3b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 info.flags=0x17 2024-09-12T18:52:30.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.952+0000 7ff3b67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.17 to cache LRU end 2024-09-12T18:52:30.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.952+0000 7ff3b67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:30.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.956+0000 7ff4d4dc69c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_sources= new_sources= 2024-09-12T18:52:30.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.956+0000 7ff4d4dc69c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential sources added=[] removed=[] 2024-09-12T18:52:30.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.956+0000 7ff4d4dc69c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): orig_dests= new_dests= 2024-09-12T18:52:30.956 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.956+0000 7ff4d4dc69c0 20 handle_bi_update(): bucket=:a-bucket[97c2b296-1395-4700-8053-4f06c4c86557.4689.17]): potential dests added=[] removed=[] 2024-09-12T18:52:30.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.960+0000 7ff4d4dc69c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-12T18:52:30.965 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.964+0000 7ff3897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:30.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.968+0000 7ff4d4dc69c0 20 remove_watcher() i=0 2024-09-12T18:52:30.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.968+0000 7ff4d4dc69c0 2 removed watcher, disabling cache 2024-09-12T18:52:30.973 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.972+0000 7ff4d4dc69c0 20 remove_watcher() i=1 2024-09-12T18:52:30.975 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.972+0000 7ff4d4dc69c0 20 remove_watcher() i=2 2024-09-12T18:52:30.978 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.976+0000 7ff4d4dc69c0 20 remove_watcher() i=3 2024-09-12T18:52:30.980 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.976+0000 7ff4d4dc69c0 20 remove_watcher() i=4 2024-09-12T18:52:30.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.980+0000 7ff4d4dc69c0 20 remove_watcher() i=5 2024-09-12T18:52:30.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.980+0000 7ff4d4dc69c0 20 remove_watcher() i=6 2024-09-12T18:52:30.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:30.984+0000 7ff4d4dc69c0 20 remove_watcher() i=7 2024-09-12T18:52:31.004 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T18:52:31.035 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:31.035 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:31.080 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.076+0000 7f5cce8f09c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.080+0000 7f5cce8f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.080+0000 7f5cce8f09c0 20 realm 2024-09-12T18:52:31.082 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.080+0000 7f5cce8f09c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.080+0000 7f5cce8f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.080+0000 7f5cce8f09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:31.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.080+0000 7f5cce8f09c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.080+0000 7f5cce8f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.083 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.080+0000 7f5cce8f09c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.084+0000 7f5cce8f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:31.084 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.084+0000 7f5cce8f09c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.084+0000 7f5cce8f09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:31.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.084+0000 7f5cce8f09c0 20 searching for the correct realm 2024-09-12T18:52:31.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.088+0000 7f5ccc3f6640 0 -- 172.21.15.111:0/2381096363 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f5cbc004050 msgr2=0x7f5cbc05cd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:31.096 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.092+0000 7f5ccbbf5640 0 -- 172.21.15.111:0/2381096363 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f5cbc017070 msgr2=0x7f5cbc073040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:31.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.308+0000 7f5cce8f09c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:31.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.308+0000 7f5cce8f09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:31.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.308+0000 7f5cce8f09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:31.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.308+0000 7f5cce8f09c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:31.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.308+0000 7f5cce8f09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:31.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.308+0000 7f5cce8f09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:31.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.308+0000 7f5cce8f09c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.308+0000 7f5cce8f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.308+0000 7f5cce8f09c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.312+0000 7f5cce8f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:31.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.312+0000 7f5cce8f09c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.312+0000 7f5cce8f09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:31.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.312+0000 7f5cce8f09c0 20 zone default found 2024-09-12T18:52:31.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.312+0000 7f5cce8f09c0 4 Realm: () 2024-09-12T18:52:31.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.312+0000 7f5cce8f09c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:31.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.312+0000 7f5cce8f09c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:31.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.312+0000 7f5cce8f09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:31.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.312+0000 7f5cce8f09c0 20 zonegroup default 2024-09-12T18:52:31.315 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.312+0000 7f5cce8f09c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.312+0000 7f5cce8f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.312+0000 7f5cce8f09c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.316 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.316+0000 7f5cce8f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.316+0000 7f5cce8f09c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.316+0000 7f5cce8f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.316+0000 7f5cce8f09c0 20 started sync module instance, tier type = 2024-09-12T18:52:31.317 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.316+0000 7f5cce8f09c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:31.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.336+0000 7f5cce8f09c0 20 add_watcher() i=0 2024-09-12T18:52:31.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.336+0000 7f5cce8f09c0 20 add_watcher() i=1 2024-09-12T18:52:31.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.336+0000 7f5cce8f09c0 20 add_watcher() i=2 2024-09-12T18:52:31.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.336+0000 7f5cce8f09c0 20 add_watcher() i=3 2024-09-12T18:52:31.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.336+0000 7f5cce8f09c0 20 add_watcher() i=4 2024-09-12T18:52:31.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.336+0000 7f5cce8f09c0 20 add_watcher() i=5 2024-09-12T18:52:31.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.336+0000 7f5cce8f09c0 20 add_watcher() i=6 2024-09-12T18:52:31.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.340+0000 7f5cce8f09c0 20 add_watcher() i=7 2024-09-12T18:52:31.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.340+0000 7f5cce8f09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:31.344 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.340+0000 7f5b827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:31.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5cce8f09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:31.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5cce8f09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:31.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5cce8f09c0 5 note: GC not initialized 2024-09-12T18:52:31.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5b817e2640 20 reqs_thread_entry: start 2024-09-12T18:52:31.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5cce8f09c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:31.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5cce8f09c0 20 Filter name: none 2024-09-12T18:52:31.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5af2ffd640 20 reqs_thread_entry: start 2024-09-12T18:52:31.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5cce8f09c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5cce8f09c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T18:52:31.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5cce8f09c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5cce8f09c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T18:52:31.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5cce8f09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:31.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5cce8f09c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T18:52:31.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5cce8f09c0 20 INFO: main: starting shard=0 2024-09-12T18:52:31.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5cce8f09c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.0 2024-09-12T18:52:31.348 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.344+0000 7f5cce8f09c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.17.3.0 2024-09-12T18:52:31.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.348+0000 7f5cce8f09c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:31.349 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.348+0000 7f5cce8f09c0 20 INFO: main: done 2024-09-12T18:52:31.350 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.348+0000 7f5b827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:31.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.352+0000 7f5cce8f09c0 20 remove_watcher() i=0 2024-09-12T18:52:31.355 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.352+0000 7f5cce8f09c0 2 removed watcher, disabling cache 2024-09-12T18:52:31.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.356+0000 7f5cce8f09c0 20 remove_watcher() i=1 2024-09-12T18:52:31.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.356+0000 7f5cce8f09c0 20 remove_watcher() i=2 2024-09-12T18:52:31.362 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.360+0000 7f5cce8f09c0 20 remove_watcher() i=3 2024-09-12T18:52:31.364 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.360+0000 7f5cce8f09c0 20 remove_watcher() i=4 2024-09-12T18:52:31.365 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.364+0000 7f5cce8f09c0 20 remove_watcher() i=5 2024-09-12T18:52:31.367 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.364+0000 7f5cce8f09c0 20 remove_watcher() i=6 2024-09-12T18:52:31.369 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.368+0000 7f5cce8f09c0 20 remove_watcher() i=7 2024-09-12T18:52:31.384 INFO:tasks.workunit.client.0.smithi111.stderr: test: PUT succeeds during reshard 2024-09-12T18:52:31.384 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:52:31.414 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:31.414 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:31.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.456+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.460+0000 7f819b3dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.460+0000 7f819b3dd9c0 20 realm 2024-09-12T18:52:31.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.460+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.460+0000 7f819b3dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.460+0000 7f819b3dd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:31.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.460+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.460+0000 7f819b3dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.464 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.460+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.460+0000 7f819b3dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:31.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.460+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.460+0000 7f819b3dd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:31.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.460+0000 7f819b3dd9c0 20 searching for the correct realm 2024-09-12T18:52:31.469 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.468+0000 7f8198ee3640 0 -- 172.21.15.111:0/3102548673 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f819003f040 msgr2=0x7f81900409c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:31.475 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.472+0000 7f81986e2640 0 -- 172.21.15.111:0/3102548673 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f819000cc20 msgr2=0x7f8190032410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:31.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.688+0000 7f819b3dd9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:31.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.688+0000 7f819b3dd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:31.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.688+0000 7f819b3dd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:31.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.688+0000 7f819b3dd9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:31.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.688+0000 7f819b3dd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:31.692 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.688+0000 7f819b3dd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:31.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.688+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:31.693 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.694 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:31.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 20 zone default found 2024-09-12T18:52:31.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 4 Realm: () 2024-09-12T18:52:31.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:31.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:31.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:31.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 20 zonegroup default 2024-09-12T18:52:31.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.695 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.692+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.696 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.696+0000 7f819b3dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.697 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.696+0000 7f819b3dd9c0 20 started sync module instance, tier type = 2024-09-12T18:52:31.697 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.696+0000 7f819b3dd9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:31.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.716+0000 7f819b3dd9c0 20 add_watcher() i=0 2024-09-12T18:52:31.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.716+0000 7f819b3dd9c0 20 add_watcher() i=1 2024-09-12T18:52:31.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.716+0000 7f819b3dd9c0 20 add_watcher() i=2 2024-09-12T18:52:31.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.716+0000 7f819b3dd9c0 20 add_watcher() i=3 2024-09-12T18:52:31.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.716+0000 7f819b3dd9c0 20 add_watcher() i=4 2024-09-12T18:52:31.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.716+0000 7f819b3dd9c0 20 add_watcher() i=5 2024-09-12T18:52:31.720 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.716+0000 7f819b3dd9c0 20 add_watcher() i=6 2024-09-12T18:52:31.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.720+0000 7f819b3dd9c0 20 add_watcher() i=7 2024-09-12T18:52:31.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.720+0000 7f819b3dd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:31.726 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.724+0000 7f804efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:31.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.724+0000 7f819b3dd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:31.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.724+0000 7f819b3dd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:31.727 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.724+0000 7f819b3dd9c0 5 note: GC not initialized 2024-09-12T18:52:31.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.724+0000 7f804dfe3640 20 reqs_thread_entry: start 2024-09-12T18:52:31.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.724+0000 7f819b3dd9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:31.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.724+0000 7f819b3dd9c0 20 Filter name: none 2024-09-12T18:52:31.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.724+0000 7f7fbf7fe640 20 reqs_thread_entry: start 2024-09-12T18:52:31.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.728+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.728+0000 7f819b3dd9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:31.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.728+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.728+0000 7f819b3dd9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:31.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.728+0000 7f819b3dd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:31.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.728+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.728+0000 7f819b3dd9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:31.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.728+0000 7f819b3dd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.728+0000 7f819b3dd9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:31.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.728+0000 7f819b3dd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:31.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.732+0000 7f804efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:31.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.736+0000 7f819b3dd9c0 20 remove_watcher() i=0 2024-09-12T18:52:31.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.736+0000 7f819b3dd9c0 2 removed watcher, disabling cache 2024-09-12T18:52:31.742 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.740+0000 7f819b3dd9c0 20 remove_watcher() i=1 2024-09-12T18:52:31.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.740+0000 7f819b3dd9c0 20 remove_watcher() i=2 2024-09-12T18:52:31.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.744+0000 7f819b3dd9c0 20 remove_watcher() i=3 2024-09-12T18:52:31.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.748+0000 7f819b3dd9c0 20 remove_watcher() i=4 2024-09-12T18:52:31.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.748+0000 7f819b3dd9c0 20 remove_watcher() i=5 2024-09-12T18:52:31.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.748+0000 7f819b3dd9c0 20 remove_watcher() i=6 2024-09-12T18:52:31.753 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.752+0000 7f819b3dd9c0 20 remove_watcher() i=7 2024-09-12T18:52:31.769 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:52:31.769 INFO:tasks.workunit.client.0.smithi111.stderr:BUCKET_STATS: 2024-09-12T18:52:31.769 INFO:tasks.workunit.client.0.smithi111.stderr:bucket: myver id: 97c2b296-1395-4700-8053-4f06c4c86557.4689.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T18:52:31.769 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:52:31.770 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-12T18:52:31.805 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:31.805 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:31.849 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.848+0000 7fa2051ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.848+0000 7fa2051ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.848+0000 7fa2051ab9c0 20 realm 2024-09-12T18:52:31.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.848+0000 7fa2051ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.848+0000 7fa2051ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.848+0000 7fa2051ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:31.851 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.848+0000 7fa2051ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.848+0000 7fa2051ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:31.852 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.848+0000 7fa2051ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.852+0000 7fa2051ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:31.853 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.852+0000 7fa2051ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:31.854 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.852+0000 7fa2051ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:31.855 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.852+0000 7fa2051ab9c0 20 searching for the correct realm 2024-09-12T18:52:31.858 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.856+0000 7fa202cb1640 0 -- 172.21.15.111:0/3643760413 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fa1fc0e3070 msgr2=0x7fa1fc10a760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:31.864 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:31.864+0000 7fa2024b0640 0 -- 172.21.15.111:0/3643760413 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fa1fc10ba00 msgr2=0x7fa1fc0e5570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:32.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.080+0000 7fa2051ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:32.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.080+0000 7fa2051ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:32.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.080+0000 7fa2051ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:32.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.080+0000 7fa2051ab9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:32.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.080+0000 7fa2051ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:32.085 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.080+0000 7fa2051ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:32.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.080+0000 7fa2051ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:32.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.084+0000 7fa2051ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:32.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.084+0000 7fa2051ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:32.086 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.084+0000 7fa2051ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:32.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.084+0000 7fa2051ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:32.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.084+0000 7fa2051ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:32.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.084+0000 7fa2051ab9c0 20 zone default found 2024-09-12T18:52:32.087 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.084+0000 7fa2051ab9c0 4 Realm: () 2024-09-12T18:52:32.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.084+0000 7fa2051ab9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:32.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.084+0000 7fa2051ab9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:32.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.084+0000 7fa2051ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:32.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.084+0000 7fa2051ab9c0 20 zonegroup default 2024-09-12T18:52:32.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.084+0000 7fa2051ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:32.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.084+0000 7fa2051ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:32.088 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.084+0000 7fa2051ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:32.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.088+0000 7fa2051ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:32.089 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.088+0000 7fa2051ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:32.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.088+0000 7fa2051ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:32.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.088+0000 7fa2051ab9c0 20 started sync module instance, tier type = 2024-09-12T18:52:32.090 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.088+0000 7fa2051ab9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:32.111 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.108+0000 7fa2051ab9c0 20 add_watcher() i=0 2024-09-12T18:52:32.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.108+0000 7fa2051ab9c0 20 add_watcher() i=1 2024-09-12T18:52:32.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.108+0000 7fa2051ab9c0 20 add_watcher() i=2 2024-09-12T18:52:32.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.108+0000 7fa2051ab9c0 20 add_watcher() i=3 2024-09-12T18:52:32.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.108+0000 7fa2051ab9c0 20 add_watcher() i=4 2024-09-12T18:52:32.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.108+0000 7fa2051ab9c0 20 add_watcher() i=5 2024-09-12T18:52:32.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.108+0000 7fa2051ab9c0 20 add_watcher() i=6 2024-09-12T18:52:32.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.112+0000 7fa2051ab9c0 20 add_watcher() i=7 2024-09-12T18:52:32.113 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.112+0000 7fa2051ab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:32.117 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa0b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:32.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:32.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:32.118 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 5 note: GC not initialized 2024-09-12T18:52:32.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa033fff640 20 reqs_thread_entry: start 2024-09-12T18:52:32.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:32.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 20 Filter name: none 2024-09-12T18:52:32.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa031ffb640 20 reqs_thread_entry: start 2024-09-12T18:52:32.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:52:32.119 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:32.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:32.120 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:52:32.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:52:32.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 : miss 2024-09-12T18:52:32.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:32.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:32.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:32.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:32.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:52:32.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:32.121 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.116+0000 7fa2051ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 2024-09-12T18:52:32.130 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.128+0000 7fa2051ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:32.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.128+0000 7fa2051ab9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:32.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.128+0000 7fa2051ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:32.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.128+0000 7fa2051ab9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18, ofs0, ns] 2024-09-12T18:52:32.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.128+0000 7fa0e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431590 cookie 93942727862176 notifier 8123 bl.length()=821 2024-09-12T18:52:32.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.128+0000 7fa0e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:32.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.128+0000 7fa0e67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:32.131 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.128+0000 7fa0e67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:32.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.128+0000 7fa2051ab9c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_sources= new_sources= 2024-09-12T18:52:32.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.128+0000 7fa2051ab9c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential sources added=[] removed=[] 2024-09-12T18:52:32.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.128+0000 7fa2051ab9c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_dests= new_dests= 2024-09-12T18:52:32.132 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.128+0000 7fa2051ab9c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential dests added=[] removed=[] 2024-09-12T18:52:32.142 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:32.140+0000 7fa2051ab9c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T18:52:32.774 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:32.775 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:32.807 INFO:tasks.workunit.client.0.smithi111.stderr:put object successful 2024-09-12T18:52:37.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.0 2024-09-12T18:52:37.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.0 2024-09-12T18:52:37.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.1 2024-09-12T18:52:37.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.1 2024-09-12T18:52:37.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.2 2024-09-12T18:52:37.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.2 2024-09-12T18:52:37.143 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.3 2024-09-12T18:52:37.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.3 2024-09-12T18:52:37.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.4 2024-09-12T18:52:37.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.4 2024-09-12T18:52:37.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.5 2024-09-12T18:52:37.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.5 2024-09-12T18:52:37.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.6 2024-09-12T18:52:37.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.6 2024-09-12T18:52:37.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.7 2024-09-12T18:52:37.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.7 2024-09-12T18:52:37.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.8 2024-09-12T18:52:37.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.8 2024-09-12T18:52:37.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.9 2024-09-12T18:52:37.144 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.9 2024-09-12T18:52:37.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.10 2024-09-12T18:52:37.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.10 2024-09-12T18:52:37.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.11 2024-09-12T18:52:37.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.11 2024-09-12T18:52:37.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.12 2024-09-12T18:52:37.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.12 2024-09-12T18:52:37.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.0 2024-09-12T18:52:37.145 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.0 2024-09-12T18:52:37.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.1 2024-09-12T18:52:37.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.140+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.1 2024-09-12T18:52:37.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.144+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.2 2024-09-12T18:52:37.146 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.144+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.2 2024-09-12T18:52:37.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.144+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.3 2024-09-12T18:52:37.147 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.144+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.3 2024-09-12T18:52:37.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.144+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.4 2024-09-12T18:52:37.148 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.144+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.4 2024-09-12T18:52:37.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.148+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.5 2024-09-12T18:52:37.150 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.148+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.5 2024-09-12T18:52:37.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.148+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.6 2024-09-12T18:52:37.151 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.148+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.6 2024-09-12T18:52:37.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.152+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.7 2024-09-12T18:52:37.152 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.152+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.7 2024-09-12T18:52:37.153 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.152+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.8 2024-09-12T18:52:37.154 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.152+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.8 2024-09-12T18:52:37.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.152+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.9 2024-09-12T18:52:37.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.152+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.9 2024-09-12T18:52:37.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.152+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.10 2024-09-12T18:52:37.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.152+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.10 2024-09-12T18:52:37.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.156+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.11 2024-09-12T18:52:37.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.156+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.11 2024-09-12T18:52:37.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.160+0000 7fa2051ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:52:37.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.160+0000 7fa2051ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 2024-09-12T18:52:37.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.164+0000 7fa2051ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:37.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.164+0000 7fa2051ab9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:37.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.164+0000 7fa2051ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:37.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.164+0000 7fa2051ab9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18, ofs0, ns] 2024-09-12T18:52:37.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.164+0000 7fa0e5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 93942727862176 notifier 8123 bl.length()=821 2024-09-12T18:52:37.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.164+0000 7fa0e5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:37.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.164+0000 7fa0e5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:37.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.164+0000 7fa0e5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:37.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.164+0000 7fa2051ab9c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_sources= new_sources= 2024-09-12T18:52:37.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.164+0000 7fa2051ab9c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential sources added=[] removed=[] 2024-09-12T18:52:37.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.164+0000 7fa2051ab9c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_dests= new_dests= 2024-09-12T18:52:37.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.164+0000 7fa2051ab9c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential dests added=[] removed=[] 2024-09-12T18:52:37.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.176+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.0 2024-09-12T18:52:37.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.176+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.0 2024-09-12T18:52:37.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.176+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.1 2024-09-12T18:52:37.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.176+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.1 2024-09-12T18:52:37.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.176+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.2 2024-09-12T18:52:37.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.176+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.2 2024-09-12T18:52:37.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.176+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.3 2024-09-12T18:52:37.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.176+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.3 2024-09-12T18:52:37.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.176+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.4 2024-09-12T18:52:37.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.176+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.4 2024-09-12T18:52:37.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.180+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.5 2024-09-12T18:52:37.181 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.180+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.5 2024-09-12T18:52:37.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.180+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.6 2024-09-12T18:52:37.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.180+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.6 2024-09-12T18:52:37.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.180+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.7 2024-09-12T18:52:37.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.180+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.7 2024-09-12T18:52:37.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.180+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.8 2024-09-12T18:52:37.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.180+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.8 2024-09-12T18:52:37.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.184+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.9 2024-09-12T18:52:37.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.184+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.9 2024-09-12T18:52:37.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.184+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.10 2024-09-12T18:52:37.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.184+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.10 2024-09-12T18:52:37.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.184+0000 7fa2051ab9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.11 2024-09-12T18:52:37.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.184+0000 7fa2051ab9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.1.11 2024-09-12T18:52:37.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.188+0000 7fa2051ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:52:37.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.188+0000 7fa2051ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 2024-09-12T18:52:37.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.192+0000 7fa2051ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:37.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.192+0000 7fa2051ab9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:37.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.192+0000 7fa2051ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:37.194 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.192+0000 7fa2051ab9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18, ofs0, ns] 2024-09-12T18:52:37.196 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.192+0000 7fa0e5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431592 cookie 93942727862176 notifier 8123 bl.length()=789 2024-09-12T18:52:37.196 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.192+0000 7fa0e5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:37.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.192+0000 7fa0e5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:37.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.192+0000 7fa0e5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:37.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.192+0000 7fa2051ab9c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_sources= new_sources= 2024-09-12T18:52:37.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.192+0000 7fa2051ab9c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential sources added=[] removed=[] 2024-09-12T18:52:37.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.192+0000 7fa2051ab9c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_dests= new_dests= 2024-09-12T18:52:37.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.192+0000 7fa2051ab9c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential dests added=[] removed=[] 2024-09-12T18:52:37.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.200+0000 7fa2051ab9c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-12T18:52:37.207 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.204+0000 7fa0b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:37.212 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.208+0000 7fa2051ab9c0 20 remove_watcher() i=0 2024-09-12T18:52:37.212 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.208+0000 7fa2051ab9c0 2 removed watcher, disabling cache 2024-09-12T18:52:37.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.212+0000 7fa2051ab9c0 20 remove_watcher() i=1 2024-09-12T18:52:37.218 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.216+0000 7fa2051ab9c0 20 remove_watcher() i=2 2024-09-12T18:52:37.220 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.220+0000 7fa2051ab9c0 20 remove_watcher() i=3 2024-09-12T18:52:37.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.220+0000 7fa2051ab9c0 20 remove_watcher() i=4 2024-09-12T18:52:37.224 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.224+0000 7fa2051ab9c0 20 remove_watcher() i=5 2024-09-12T18:52:37.227 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.224+0000 7fa2051ab9c0 20 remove_watcher() i=6 2024-09-12T18:52:37.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:37.228+0000 7fa2051ab9c0 20 remove_watcher() i=7 2024-09-12T18:52:37.812 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T18:52:37.813 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T18:52:37.817 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:37.818 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:37.829 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:37.829 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:37.876 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:37.877 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:37.911 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:37.911 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:37.921 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:37.921 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:37.954 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:37.954 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:37.963 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:37.963 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:37.996 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:37.997 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:38.003 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T18:52:38.440 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T18:52:39.880 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:39.880 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:39.950 INFO:tasks.workunit.client.0.smithi111.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:52:39.950 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T18:52:39.986 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:39.986 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:40.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.028+0000 7fc6d88f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.032+0000 7fc6d88f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.032+0000 7fc6d88f89c0 20 realm 2024-09-12T18:52:40.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.032+0000 7fc6d88f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.032+0000 7fc6d88f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.032+0000 7fc6d88f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:40.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.032+0000 7fc6d88f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.032+0000 7fc6d88f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.033 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.032+0000 7fc6d88f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.032+0000 7fc6d88f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:40.035 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.032+0000 7fc6d88f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.032+0000 7fc6d88f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:40.036 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.032+0000 7fc6d88f89c0 20 searching for the correct realm 2024-09-12T18:52:40.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.036+0000 7fc6d6bff640 0 -- 172.21.15.111:0/813229083 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fc6cc065050 msgr2=0x7fc6cc07d340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:40.252 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.252+0000 7fc6d5bfd640 0 -- 172.21.15.111:0/813229083 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7fc5a0080a80 msgr2=0x7fc5a0082eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:40.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.264+0000 7fc6d88f89c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:40.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.264+0000 7fc6d88f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:40.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.264+0000 7fc6d88f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:40.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.264+0000 7fc6d88f89c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:40.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.264+0000 7fc6d88f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:40.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.264+0000 7fc6d88f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:40.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.264+0000 7fc6d88f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:40.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:40.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 20 zone default found 2024-09-12T18:52:40.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 4 Realm: () 2024-09-12T18:52:40.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:40.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:40.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:40.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 20 zonegroup default 2024-09-12T18:52:40.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.268+0000 7fc6d88f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.272+0000 7fc6d88f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.272+0000 7fc6d88f89c0 20 started sync module instance, tier type = 2024-09-12T18:52:40.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.272+0000 7fc6d88f89c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:40.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.292+0000 7fc6d88f89c0 20 add_watcher() i=0 2024-09-12T18:52:40.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.292+0000 7fc6d88f89c0 20 add_watcher() i=1 2024-09-12T18:52:40.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.292+0000 7fc6d88f89c0 20 add_watcher() i=2 2024-09-12T18:52:40.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.292+0000 7fc6d88f89c0 20 add_watcher() i=3 2024-09-12T18:52:40.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.292+0000 7fc6d88f89c0 20 add_watcher() i=4 2024-09-12T18:52:40.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.292+0000 7fc6d88f89c0 20 add_watcher() i=5 2024-09-12T18:52:40.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.292+0000 7fc6d88f89c0 20 add_watcher() i=6 2024-09-12T18:52:40.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.292+0000 7fc6d88f89c0 20 add_watcher() i=7 2024-09-12T18:52:40.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.292+0000 7fc6d88f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:40.299 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.296+0000 7fc58cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:40.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.296+0000 7fc6d88f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:40.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.296+0000 7fc6d88f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:40.300 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.296+0000 7fc6d88f89c0 5 note: GC not initialized 2024-09-12T18:52:40.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc5077fe640 20 reqs_thread_entry: start 2024-09-12T18:52:40.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:40.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 Filter name: none 2024-09-12T18:52:40.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc5057fa640 20 reqs_thread_entry: start 2024-09-12T18:52:40.301 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:40.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.302 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:40.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:40.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:52:40.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 INFO: main: starting shard=0 2024-09-12T18:52:40.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.0 2024-09-12T18:52:40.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.0 2024-09-12T18:52:40.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 INFO: main: starting shard=1 2024-09-12T18:52:40.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.1 2024-09-12T18:52:40.303 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.1 2024-09-12T18:52:40.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 INFO: main: starting shard=2 2024-09-12T18:52:40.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.2 2024-09-12T18:52:40.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.2 2024-09-12T18:52:40.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 INFO: main: starting shard=3 2024-09-12T18:52:40.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.3 2024-09-12T18:52:40.304 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.300+0000 7fc6d88f89c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.3 2024-09-12T18:52:40.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 20 INFO: main: starting shard=4 2024-09-12T18:52:40.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.4 2024-09-12T18:52:40.305 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.4 2024-09-12T18:52:40.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 20 INFO: main: starting shard=5 2024-09-12T18:52:40.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.5 2024-09-12T18:52:40.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.5 2024-09-12T18:52:40.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:52:40.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 20 INFO: main: starting shard=6 2024-09-12T18:52:40.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.6 2024-09-12T18:52:40.306 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.6 2024-09-12T18:52:40.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 20 INFO: main: starting shard=7 2024-09-12T18:52:40.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.7 2024-09-12T18:52:40.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.304+0000 7fc6d88f89c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.7 2024-09-12T18:52:40.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.308 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 20 INFO: main: starting shard=8 2024-09-12T18:52:40.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.8 2024-09-12T18:52:40.309 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.8 2024-09-12T18:52:40.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 20 INFO: main: starting shard=9 2024-09-12T18:52:40.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.9 2024-09-12T18:52:40.310 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.9 2024-09-12T18:52:40.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 20 INFO: main: starting shard=10 2024-09-12T18:52:40.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.10 2024-09-12T18:52:40.311 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.10 2024-09-12T18:52:40.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 20 INFO: main: starting shard=11 2024-09-12T18:52:40.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.11 2024-09-12T18:52:40.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.308+0000 7fc6d88f89c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.11 2024-09-12T18:52:40.312 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.312+0000 7fc6d88f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.312+0000 7fc6d88f89c0 20 INFO: main: starting shard=12 2024-09-12T18:52:40.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.312+0000 7fc6d88f89c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.12 2024-09-12T18:52:40.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.312+0000 7fc6d88f89c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.12 2024-09-12T18:52:40.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.312+0000 7fc6d88f89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.313 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.312+0000 7fc6d88f89c0 20 INFO: main: done 2024-09-12T18:52:40.314 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.312+0000 7fc58cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:40.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.316+0000 7fc6d88f89c0 20 remove_watcher() i=0 2024-09-12T18:52:40.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.316+0000 7fc6d88f89c0 2 removed watcher, disabling cache 2024-09-12T18:52:40.321 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.320+0000 7fc6d88f89c0 20 remove_watcher() i=1 2024-09-12T18:52:40.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.320+0000 7fc6d88f89c0 20 remove_watcher() i=2 2024-09-12T18:52:40.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.324+0000 7fc6d88f89c0 20 remove_watcher() i=3 2024-09-12T18:52:40.327 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.324+0000 7fc6d88f89c0 20 remove_watcher() i=4 2024-09-12T18:52:40.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.324+0000 7fc6d88f89c0 20 remove_watcher() i=5 2024-09-12T18:52:40.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.328+0000 7fc6d88f89c0 20 remove_watcher() i=6 2024-09-12T18:52:40.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.328+0000 7fc6d88f89c0 20 remove_watcher() i=7 2024-09-12T18:52:40.347 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:40.347 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:40.352 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:40.352 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:40.409 INFO:tasks.workunit.client.0.smithi111.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:52:40.410 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T18:52:40.444 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:40.444 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:40.490 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.488+0000 7f99bc63d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.488+0000 7f99bc63d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.488+0000 7f99bc63d9c0 20 realm 2024-09-12T18:52:40.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.488+0000 7f99bc63d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.488+0000 7f99bc63d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.488+0000 7f99bc63d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:40.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.488+0000 7f99bc63d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.492 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.488+0000 7f99bc63d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.493 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.488+0000 7f99bc63d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.492+0000 7f99bc63d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:40.494 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.492+0000 7f99bc63d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.492+0000 7f99bc63d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:40.495 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.492+0000 7f99bc63d9c0 20 searching for the correct realm 2024-09-12T18:52:40.497 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.496+0000 7f99b9942640 0 -- 172.21.15.111:0/1324252561 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f99ac017030 msgr2=0x7f99ac03b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:40.712 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.708+0000 7f99ba143640 0 -- 172.21.15.111:0/1324252561 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f99a4003ac0 msgr2=0x7f99b40698a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:40.728 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.724+0000 7f99bc63d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:40.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.724+0000 7f99bc63d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:40.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.724+0000 7f99bc63d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:40.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.724+0000 7f99bc63d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:40.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.724+0000 7f99bc63d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:40.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.724+0000 7f99bc63d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:40.729 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:40.730 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:40.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 20 zone default found 2024-09-12T18:52:40.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 4 Realm: () 2024-09-12T18:52:40.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:40.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:40.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:40.731 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 20 zonegroup default 2024-09-12T18:52:40.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.728+0000 7f99bc63d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.732+0000 7f99bc63d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.732+0000 7f99bc63d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.732+0000 7f99bc63d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.732+0000 7f99bc63d9c0 20 started sync module instance, tier type = 2024-09-12T18:52:40.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.732+0000 7f99bc63d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:40.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.756+0000 7f99bc63d9c0 20 add_watcher() i=0 2024-09-12T18:52:40.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.756+0000 7f99bc63d9c0 20 add_watcher() i=1 2024-09-12T18:52:40.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.756+0000 7f99bc63d9c0 20 add_watcher() i=2 2024-09-12T18:52:40.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.756+0000 7f99bc63d9c0 20 add_watcher() i=3 2024-09-12T18:52:40.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.756+0000 7f99bc63d9c0 20 add_watcher() i=4 2024-09-12T18:52:40.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.756+0000 7f99bc63d9c0 20 add_watcher() i=5 2024-09-12T18:52:40.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.756+0000 7f99bc63d9c0 20 add_watcher() i=6 2024-09-12T18:52:40.759 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.756+0000 7f99bc63d9c0 20 add_watcher() i=7 2024-09-12T18:52:40.759 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.756+0000 7f99bc63d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:40.764 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.760+0000 7f9870fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:40.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:40.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:40.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 5 note: GC not initialized 2024-09-12T18:52:40.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f97eb7fe640 20 reqs_thread_entry: start 2024-09-12T18:52:40.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:40.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 Filter name: none 2024-09-12T18:52:40.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f97e97fa640 20 reqs_thread_entry: start 2024-09-12T18:52:40.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:40.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.767 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:40.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:40.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:52:40.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 INFO: main: starting shard=0 2024-09-12T18:52:40.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.0 2024-09-12T18:52:40.768 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.0 2024-09-12T18:52:40.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 INFO: main: starting shard=1 2024-09-12T18:52:40.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.1 2024-09-12T18:52:40.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.764+0000 7f99bc63d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.1 2024-09-12T18:52:40.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 INFO: main: starting shard=2 2024-09-12T18:52:40.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.2 2024-09-12T18:52:40.769 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.2 2024-09-12T18:52:40.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 INFO: main: starting shard=3 2024-09-12T18:52:40.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.3 2024-09-12T18:52:40.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.3 2024-09-12T18:52:40.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.770 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 INFO: main: starting shard=4 2024-09-12T18:52:40.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.4 2024-09-12T18:52:40.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.4 2024-09-12T18:52:40.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.771 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 INFO: main: starting shard=5 2024-09-12T18:52:40.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.5 2024-09-12T18:52:40.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.5 2024-09-12T18:52:40.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 INFO: main: starting shard=6 2024-09-12T18:52:40.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.6 2024-09-12T18:52:40.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.768+0000 7f99bc63d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.6 2024-09-12T18:52:40.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 20 INFO: main: starting shard=7 2024-09-12T18:52:40.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.7 2024-09-12T18:52:40.773 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.7 2024-09-12T18:52:40.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 20 INFO: main: starting shard=8 2024-09-12T18:52:40.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.8 2024-09-12T18:52:40.774 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.8 2024-09-12T18:52:40.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 20 INFO: main: starting shard=9 2024-09-12T18:52:40.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.9 2024-09-12T18:52:40.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.9 2024-09-12T18:52:40.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:52:40.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 20 INFO: main: starting shard=10 2024-09-12T18:52:40.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.10 2024-09-12T18:52:40.776 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.772+0000 7f99bc63d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.10 2024-09-12T18:52:40.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.776+0000 7f99bc63d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.776+0000 7f99bc63d9c0 20 INFO: main: starting shard=11 2024-09-12T18:52:40.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.776+0000 7f99bc63d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.11 2024-09-12T18:52:40.777 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.776+0000 7f99bc63d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.11 2024-09-12T18:52:40.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.776+0000 7f99bc63d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.776+0000 7f99bc63d9c0 20 INFO: main: starting shard=12 2024-09-12T18:52:40.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.776+0000 7f99bc63d9c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.12 2024-09-12T18:52:40.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.776+0000 7f99bc63d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.12 2024-09-12T18:52:40.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.776+0000 7f99bc63d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:40.778 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.776+0000 7f99bc63d9c0 20 INFO: main: done 2024-09-12T18:52:40.779 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.776+0000 7f9870fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:40.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.780+0000 7f99bc63d9c0 20 remove_watcher() i=0 2024-09-12T18:52:40.784 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.780+0000 7f99bc63d9c0 2 removed watcher, disabling cache 2024-09-12T18:52:40.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.784+0000 7f99bc63d9c0 20 remove_watcher() i=1 2024-09-12T18:52:40.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.788+0000 7f99bc63d9c0 20 remove_watcher() i=2 2024-09-12T18:52:40.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.788+0000 7f99bc63d9c0 20 remove_watcher() i=3 2024-09-12T18:52:40.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.792+0000 7f99bc63d9c0 20 remove_watcher() i=4 2024-09-12T18:52:40.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.792+0000 7f99bc63d9c0 20 remove_watcher() i=5 2024-09-12T18:52:40.796 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.792+0000 7f99bc63d9c0 20 remove_watcher() i=6 2024-09-12T18:52:40.797 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.796+0000 7f99bc63d9c0 20 remove_watcher() i=7 2024-09-12T18:52:40.816 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:40.817 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:40.822 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:40.822 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:40.881 INFO:tasks.workunit.client.0.smithi111.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T18:52:40.882 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T18:52:40.916 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:40.916 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:40.962 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.960+0000 7f0bf55d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.960+0000 7f0bf55d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.960+0000 7f0bf55d49c0 20 realm 2024-09-12T18:52:40.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.960+0000 7f0bf55d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.960+0000 7f0bf55d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.960+0000 7f0bf55d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:40.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.960+0000 7f0bf55d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.960+0000 7f0bf55d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:40.964 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.960+0000 7f0bf55d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.964+0000 7f0bf55d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:40.966 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.964+0000 7f0bf55d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:40.967 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.964+0000 7f0bf55d49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:40.967 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.964+0000 7f0bf55d49c0 20 searching for the correct realm 2024-09-12T18:52:40.970 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:40.968+0000 7f0bf38db640 0 -- 172.21.15.111:0/1275668883 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f0be8008040 msgr2=0x7f0be8067980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:41.186 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.184+0000 7f0bf28d9640 0 -- 172.21.15.111:0/1275668883 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f0bec101350 msgr2=0x7f0bec102990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:41.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.400+0000 7f0bf55d49c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:41.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.400+0000 7f0bf55d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:41.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.400+0000 7f0bf55d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:41.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.400+0000 7f0bf55d49c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:41.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.400+0000 7f0bf55d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:41.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.400+0000 7f0bf55d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:41.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.400+0000 7f0bf55d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:41.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.400+0000 7f0bf55d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:41.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.400+0000 7f0bf55d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:41.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.400+0000 7f0bf55d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:41.404 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.400+0000 7f0bf55d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:41.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:41.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 20 zone default found 2024-09-12T18:52:41.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 4 Realm: () 2024-09-12T18:52:41.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:41.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:41.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:41.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 20 zonegroup default 2024-09-12T18:52:41.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:41.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:41.406 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:41.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:41.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:41.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:41.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 20 started sync module instance, tier type = 2024-09-12T18:52:41.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.404+0000 7f0bf55d49c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:41.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.424+0000 7f0bf55d49c0 20 add_watcher() i=0 2024-09-12T18:52:41.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.424+0000 7f0bf55d49c0 20 add_watcher() i=1 2024-09-12T18:52:41.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.424+0000 7f0bf55d49c0 20 add_watcher() i=2 2024-09-12T18:52:41.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.424+0000 7f0bf55d49c0 20 add_watcher() i=3 2024-09-12T18:52:41.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.424+0000 7f0bf55d49c0 20 add_watcher() i=4 2024-09-12T18:52:41.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.424+0000 7f0bf55d49c0 20 add_watcher() i=5 2024-09-12T18:52:41.428 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.424+0000 7f0bf55d49c0 20 add_watcher() i=6 2024-09-12T18:52:41.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.428+0000 7f0bf55d49c0 20 add_watcher() i=7 2024-09-12T18:52:41.430 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.428+0000 7f0bf55d49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:41.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.432+0000 7f0aa9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:41.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.432+0000 7f0bf55d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:41.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.432+0000 7f0bf55d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:41.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.432+0000 7f0bf55d49c0 5 note: GC not initialized 2024-09-12T18:52:41.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.432+0000 7f0aa8fe1640 20 reqs_thread_entry: start 2024-09-12T18:52:41.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.432+0000 7f0bf55d49c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:41.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.432+0000 7f0bf55d49c0 20 Filter name: none 2024-09-12T18:52:41.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.432+0000 7f0a227fc640 20 reqs_thread_entry: start 2024-09-12T18:52:41.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.432+0000 7f0bf55d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:41.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:41.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:41.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:41.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:41.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T18:52:41.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 INFO: main: starting shard=0 2024-09-12T18:52:41.437 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.0 2024-09-12T18:52:41.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.0 2024-09-12T18:52:41.438 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T18:52:41.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 INFO: main: starting shard=1 2024-09-12T18:52:41.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.1 2024-09-12T18:52:41.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.1 2024-09-12T18:52:41.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:41.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 INFO: main: starting shard=2 2024-09-12T18:52:41.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.2 2024-09-12T18:52:41.439 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.2 2024-09-12T18:52:41.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:41.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 INFO: main: starting shard=3 2024-09-12T18:52:41.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.3 2024-09-12T18:52:41.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.3 2024-09-12T18:52:41.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:41.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 INFO: main: starting shard=4 2024-09-12T18:52:41.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.4 2024-09-12T18:52:41.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.436+0000 7f0bf55d49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.4 2024-09-12T18:52:41.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:41.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 20 INFO: main: starting shard=5 2024-09-12T18:52:41.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.5 2024-09-12T18:52:41.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.5 2024-09-12T18:52:41.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:41.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 20 INFO: main: starting shard=6 2024-09-12T18:52:41.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.6 2024-09-12T18:52:41.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.6 2024-09-12T18:52:41.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:41.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 20 INFO: main: starting shard=7 2024-09-12T18:52:41.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.7 2024-09-12T18:52:41.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.7 2024-09-12T18:52:41.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:41.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 20 INFO: main: starting shard=8 2024-09-12T18:52:41.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.8 2024-09-12T18:52:41.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.440+0000 7f0bf55d49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.8 2024-09-12T18:52:41.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:41.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 20 INFO: main: starting shard=9 2024-09-12T18:52:41.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.9 2024-09-12T18:52:41.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.9 2024-09-12T18:52:41.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:41.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 20 INFO: main: starting shard=10 2024-09-12T18:52:41.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.10 2024-09-12T18:52:41.445 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.10 2024-09-12T18:52:41.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:41.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 20 INFO: main: starting shard=11 2024-09-12T18:52:41.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.11 2024-09-12T18:52:41.447 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.11 2024-09-12T18:52:41.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:41.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 20 INFO: main: starting shard=12 2024-09-12T18:52:41.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.12 2024-09-12T18:52:41.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.444+0000 7f0bf55d49c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.12 2024-09-12T18:52:41.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.448+0000 7f0bf55d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T18:52:41.448 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.448+0000 7f0bf55d49c0 20 INFO: main: done 2024-09-12T18:52:41.450 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.448+0000 7f0aa9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:41.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.452+0000 7f0bf55d49c0 20 remove_watcher() i=0 2024-09-12T18:52:41.455 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.452+0000 7f0bf55d49c0 2 removed watcher, disabling cache 2024-09-12T18:52:41.457 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.456+0000 7f0bf55d49c0 20 remove_watcher() i=1 2024-09-12T18:52:41.459 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.456+0000 7f0bf55d49c0 20 remove_watcher() i=2 2024-09-12T18:52:41.461 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.460+0000 7f0bf55d49c0 20 remove_watcher() i=3 2024-09-12T18:52:41.463 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.460+0000 7f0bf55d49c0 20 remove_watcher() i=4 2024-09-12T18:52:41.465 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.464+0000 7f0bf55d49c0 20 remove_watcher() i=5 2024-09-12T18:52:41.466 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.464+0000 7f0bf55d49c0 20 remove_watcher() i=6 2024-09-12T18:52:41.468 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:41.464+0000 7f0bf55d49c0 20 remove_watcher() i=7 2024-09-12T18:52:41.487 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:41.487 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:41.490 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T18:52:41.927 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T18:52:42.364 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T18:52:42.397 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:42.397 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:42.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.436+0000 7f5d63a259c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.441 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.440+0000 7f5d63a259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:42.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.440+0000 7f5d63a259c0 20 realm 2024-09-12T18:52:42.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.440+0000 7f5d63a259c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.440+0000 7f5d63a259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:42.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.440+0000 7f5d63a259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:42.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.440+0000 7f5d63a259c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.440+0000 7f5d63a259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:42.442 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.440+0000 7f5d63a259c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.440+0000 7f5d63a259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:42.443 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.440+0000 7f5d63a259c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.440+0000 7f5d63a259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:42.444 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.440+0000 7f5d63a259c0 20 searching for the correct realm 2024-09-12T18:52:42.450 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.448+0000 7f5d61d2c640 0 -- 172.21.15.111:0/1872600770 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f5d58008040 msgr2=0x7f5d5800c950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:42.656 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.652+0000 7f5d60d2a640 0 -- 172.21.15.111:0/1872600770 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f5d5c052bf0 msgr2=0x7f5d5c060400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:42.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.668+0000 7f5d63a259c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:42.669 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.668+0000 7f5d63a259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:42.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.668+0000 7f5d63a259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:42.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.668+0000 7f5d63a259c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:42.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.668+0000 7f5d63a259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:42.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.668+0000 7f5d63a259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:42.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.668+0000 7f5d63a259c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.668+0000 7f5d63a259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:42.670 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.668+0000 7f5d63a259c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.668+0000 7f5d63a259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:42.671 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.668+0000 7f5d63a259c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:42.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 20 zone default found 2024-09-12T18:52:42.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 4 Realm: () 2024-09-12T18:52:42.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:42.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:42.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:42.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 20 zonegroup default 2024-09-12T18:52:42.673 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:42.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:42.674 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:42.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 20 started sync module instance, tier type = 2024-09-12T18:52:42.675 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.672+0000 7f5d63a259c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:42.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.696+0000 7f5d63a259c0 20 add_watcher() i=0 2024-09-12T18:52:42.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.696+0000 7f5d63a259c0 20 add_watcher() i=1 2024-09-12T18:52:42.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.696+0000 7f5d63a259c0 20 add_watcher() i=2 2024-09-12T18:52:42.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.696+0000 7f5d63a259c0 20 add_watcher() i=3 2024-09-12T18:52:42.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.696+0000 7f5d63a259c0 20 add_watcher() i=4 2024-09-12T18:52:42.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.696+0000 7f5d63a259c0 20 add_watcher() i=5 2024-09-12T18:52:42.699 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.696+0000 7f5d63a259c0 20 add_watcher() i=6 2024-09-12T18:52:42.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.700+0000 7f5d63a259c0 20 add_watcher() i=7 2024-09-12T18:52:42.701 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.700+0000 7f5d63a259c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:42.706 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.704+0000 7f5c17fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:42.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.704+0000 7f5d63a259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:42.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.704+0000 7f5d63a259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:42.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.704+0000 7f5d63a259c0 5 note: GC not initialized 2024-09-12T18:52:42.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.704+0000 7f5c16fe5640 20 reqs_thread_entry: start 2024-09-12T18:52:42.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.704+0000 7f5d63a259c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:42.707 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.704+0000 7f5d63a259c0 20 Filter name: none 2024-09-12T18:52:42.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.704+0000 7f5c14fe1640 20 reqs_thread_entry: start 2024-09-12T18:52:42.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.704+0000 7f5d63a259c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:52:42.708 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.704+0000 7f5d63a259c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.708+0000 7f5d63a259c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:42.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.708+0000 7f5d63a259c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:52:42.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.708+0000 7f5d63a259c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:52:42.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.708+0000 7f5d63a259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 : miss 2024-09-12T18:52:42.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.708+0000 7f5d63a259c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.709 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.708+0000 7f5d63a259c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:42.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.708+0000 7f5d63a259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:42.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.708+0000 7f5d63a259c0 10 adding default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:42.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.708+0000 7f5d63a259c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:52:42.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.708+0000 7f5d63a259c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:42.710 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.708+0000 7f5d63a259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 2024-09-12T18:52:42.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.720+0000 7f5d63a259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:42.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.720+0000 7f5d63a259c0 10 moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:42.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.720+0000 7f5d63a259c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:42.721 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.720+0000 7f5d63a259c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18, ofs0, ns] 2024-09-12T18:52:42.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.720+0000 7f5c44ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 94639604014272 notifier 8201 bl.length()=821 2024-09-12T18:52:42.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.720+0000 7f5c44ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:42.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.720+0000 7f5c44ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:42.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.720+0000 7f5c44ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:42.722 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.720+0000 7f5d63a259c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_sources= new_sources= 2024-09-12T18:52:42.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.720+0000 7f5d63a259c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential sources added=[] removed=[] 2024-09-12T18:52:42.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.720+0000 7f5d63a259c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_dests= new_dests= 2024-09-12T18:52:42.723 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.720+0000 7f5d63a259c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential dests added=[] removed=[] 2024-09-12T18:52:42.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.0 2024-09-12T18:52:42.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.0 2024-09-12T18:52:42.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.1 2024-09-12T18:52:42.732 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.1 2024-09-12T18:52:42.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.2 2024-09-12T18:52:42.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.2 2024-09-12T18:52:42.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.3 2024-09-12T18:52:42.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.3 2024-09-12T18:52:42.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.4 2024-09-12T18:52:42.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.4 2024-09-12T18:52:42.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.5 2024-09-12T18:52:42.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.5 2024-09-12T18:52:42.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.6 2024-09-12T18:52:42.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.6 2024-09-12T18:52:42.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.7 2024-09-12T18:52:42.733 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.7 2024-09-12T18:52:42.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.8 2024-09-12T18:52:42.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.8 2024-09-12T18:52:42.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:42.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:42.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.10 2024-09-12T18:52:42.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.10 2024-09-12T18:52:42.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.11 2024-09-12T18:52:42.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.11 2024-09-12T18:52:42.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.12 2024-09-12T18:52:42.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.12 2024-09-12T18:52:42.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.13 2024-09-12T18:52:42.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.13 2024-09-12T18:52:42.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.14 2024-09-12T18:52:42.734 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.14 2024-09-12T18:52:42.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.15 2024-09-12T18:52:42.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.15 2024-09-12T18:52:42.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.16 2024-09-12T18:52:42.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.16 2024-09-12T18:52:42.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.0 2024-09-12T18:52:42.735 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.728+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.0 2024-09-12T18:52:42.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.732+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.1 2024-09-12T18:52:42.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.732+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.1 2024-09-12T18:52:42.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.732+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.2 2024-09-12T18:52:42.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.732+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.2 2024-09-12T18:52:42.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.732+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.3 2024-09-12T18:52:42.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.732+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.3 2024-09-12T18:52:42.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.732+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.4 2024-09-12T18:52:42.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.732+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.4 2024-09-12T18:52:42.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.732+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.5 2024-09-12T18:52:42.736 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.732+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.5 2024-09-12T18:52:42.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.732+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.6 2024-09-12T18:52:42.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.732+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.6 2024-09-12T18:52:42.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.736+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.7 2024-09-12T18:52:42.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.736+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.7 2024-09-12T18:52:42.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.736+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.8 2024-09-12T18:52:42.737 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.736+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.8 2024-09-12T18:52:42.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.736+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.9 2024-09-12T18:52:42.738 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.736+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.9 2024-09-12T18:52:42.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.736+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.10 2024-09-12T18:52:42.739 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.736+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.10 2024-09-12T18:52:42.740 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.740+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.11 2024-09-12T18:52:42.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.740+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.11 2024-09-12T18:52:42.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.740+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.12 2024-09-12T18:52:42.741 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.740+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.12 2024-09-12T18:52:42.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.740+0000 7f5d63a259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:52:42.744 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.740+0000 7f5d63a259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 2024-09-12T18:52:42.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.744+0000 7f5d63a259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:42.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.744+0000 7f5d63a259c0 10 moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:42.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.744+0000 7f5d63a259c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:42.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.744+0000 7f5d63a259c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18, ofs0, ns] 2024-09-12T18:52:42.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.744+0000 7f5c44ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94639604014272 notifier 8201 bl.length()=821 2024-09-12T18:52:42.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.744+0000 7f5c44ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:42.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.744+0000 7f5c44ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:42.746 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.744+0000 7f5c44ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:42.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.744+0000 7f5d63a259c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_sources= new_sources= 2024-09-12T18:52:42.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.744+0000 7f5d63a259c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential sources added=[] removed=[] 2024-09-12T18:52:42.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.744+0000 7f5d63a259c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_dests= new_dests= 2024-09-12T18:52:42.747 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.744+0000 7f5d63a259c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential dests added=[] removed=[] 2024-09-12T18:52:42.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.752+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.0 2024-09-12T18:52:42.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.752+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.0 2024-09-12T18:52:42.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.752+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.1 2024-09-12T18:52:42.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.752+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.1 2024-09-12T18:52:42.755 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.752+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.2 2024-09-12T18:52:42.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.752+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.2 2024-09-12T18:52:42.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.752+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.3 2024-09-12T18:52:42.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.752+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.3 2024-09-12T18:52:42.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.756+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.4 2024-09-12T18:52:42.756 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.756+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.4 2024-09-12T18:52:42.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.756+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.5 2024-09-12T18:52:42.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.756+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.5 2024-09-12T18:52:42.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.756+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.6 2024-09-12T18:52:42.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.756+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.6 2024-09-12T18:52:42.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.756+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.7 2024-09-12T18:52:42.758 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.756+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.7 2024-09-12T18:52:42.759 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.756+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.8 2024-09-12T18:52:42.759 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.756+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.8 2024-09-12T18:52:42.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.756+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.9 2024-09-12T18:52:42.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.756+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.9 2024-09-12T18:52:42.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.760+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.10 2024-09-12T18:52:42.760 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.760+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.10 2024-09-12T18:52:42.761 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.760+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.11 2024-09-12T18:52:42.761 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.760+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.11 2024-09-12T18:52:42.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.760+0000 7f5d63a259c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.12 2024-09-12T18:52:42.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.760+0000 7f5d63a259c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.2.12 2024-09-12T18:52:42.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.760+0000 7f5d63a259c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 : hit (requested=0x17, cached=0x17) 2024-09-12T18:52:42.762 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.760+0000 7f5d63a259c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 2024-09-12T18:52:42.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.764+0000 7f5d63a259c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:42.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.764+0000 7f5d63a259c0 10 moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:42.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.764+0000 7f5d63a259c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:42.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.764+0000 7f5d63a259c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18, ofs0, ns] 2024-09-12T18:52:42.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.764+0000 7f5c44ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 94639604014272 notifier 8201 bl.length()=789 2024-09-12T18:52:42.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.764+0000 7f5c44ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:42.765 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.764+0000 7f5c44ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:42.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.764+0000 7f5c44ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:42.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.764+0000 7f5d63a259c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_sources= new_sources= 2024-09-12T18:52:42.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.764+0000 7f5d63a259c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential sources added=[] removed=[] 2024-09-12T18:52:42.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.764+0000 7f5d63a259c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): orig_dests= new_dests= 2024-09-12T18:52:42.766 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.764+0000 7f5d63a259c0 20 handle_bi_update(): bucket=:myver[97c2b296-1395-4700-8053-4f06c4c86557.4689.18]): potential dests added=[] removed=[] 2024-09-12T18:52:42.772 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.768+0000 7f5d63a259c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-12T18:52:42.775 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.772+0000 7f5c17fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:42.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.780+0000 7f5d63a259c0 20 remove_watcher() i=0 2024-09-12T18:52:42.781 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.780+0000 7f5d63a259c0 2 removed watcher, disabling cache 2024-09-12T18:52:42.783 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.780+0000 7f5d63a259c0 20 remove_watcher() i=1 2024-09-12T18:52:42.786 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.784+0000 7f5d63a259c0 20 remove_watcher() i=2 2024-09-12T18:52:42.788 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.788+0000 7f5d63a259c0 20 remove_watcher() i=3 2024-09-12T18:52:42.790 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.788+0000 7f5d63a259c0 20 remove_watcher() i=4 2024-09-12T18:52:42.792 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.788+0000 7f5d63a259c0 20 remove_watcher() i=5 2024-09-12T18:52:42.794 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.792+0000 7f5d63a259c0 20 remove_watcher() i=6 2024-09-12T18:52:42.795 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.792+0000 7f5d63a259c0 20 remove_watcher() i=7 2024-09-12T18:52:42.812 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T18:52:42.847 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:42.847 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:42.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.888+0000 7f8a9b7d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.892+0000 7f8a9b7d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:42.894 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.892+0000 7f8a9b7d79c0 20 realm 2024-09-12T18:52:42.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.892+0000 7f8a9b7d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.892+0000 7f8a9b7d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:42.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.892+0000 7f8a9b7d79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:42.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.892+0000 7f8a9b7d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.892+0000 7f8a9b7d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:42.895 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.892+0000 7f8a9b7d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.892+0000 7f8a9b7d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:42.896 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.892+0000 7f8a9b7d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:42.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.896+0000 7f8a9b7d79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:42.897 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.896+0000 7f8a9b7d79c0 20 searching for the correct realm 2024-09-12T18:52:42.899 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:42.896+0000 7f8a98adc640 0 -- 172.21.15.111:0/2433383577 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f8a8c026040 msgr2=0x7f8a8c063e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:43.112 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.108+0000 7f8a992dd640 0 -- 172.21.15.111:0/2433383577 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f8a9401a040 msgr2=0x7f8a94022480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:43.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:43.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:43.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:43.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:43.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:43.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:43.129 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:43.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:43.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:43.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 zone default found 2024-09-12T18:52:43.133 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 4 Realm: () 2024-09-12T18:52:43.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:43.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:43.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:43.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 zonegroup default 2024-09-12T18:52:43.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:43.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.128+0000 7f8a9b7d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.132+0000 7f8a9b7d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:43.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.132+0000 7f8a9b7d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.132+0000 7f8a9b7d79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:43.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.132+0000 7f8a9b7d79c0 20 started sync module instance, tier type = 2024-09-12T18:52:43.134 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.132+0000 7f8a9b7d79c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:43.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.152+0000 7f8a9b7d79c0 20 add_watcher() i=0 2024-09-12T18:52:43.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.152+0000 7f8a9b7d79c0 20 add_watcher() i=1 2024-09-12T18:52:43.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.152+0000 7f8a9b7d79c0 20 add_watcher() i=2 2024-09-12T18:52:43.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.152+0000 7f8a9b7d79c0 20 add_watcher() i=3 2024-09-12T18:52:43.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.152+0000 7f8a9b7d79c0 20 add_watcher() i=4 2024-09-12T18:52:43.155 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.152+0000 7f8a9b7d79c0 20 add_watcher() i=5 2024-09-12T18:52:43.156 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.152+0000 7f8a9b7d79c0 20 add_watcher() i=6 2024-09-12T18:52:43.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.156+0000 7f8a9b7d79c0 20 add_watcher() i=7 2024-09-12T18:52:43.157 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.156+0000 7f8a9b7d79c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:43.161 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f894ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:43.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f8a9b7d79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:43.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f8a9b7d79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:43.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f8a9b7d79c0 5 note: GC not initialized 2024-09-12T18:52:43.162 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f894efe5640 20 reqs_thread_entry: start 2024-09-12T18:52:43.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f8a9b7d79c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:43.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f8a9b7d79c0 20 Filter name: none 2024-09-12T18:52:43.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f894cfe1640 20 reqs_thread_entry: start 2024-09-12T18:52:43.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f8a9b7d79c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T18:52:43.163 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f8a9b7d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.164 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f8a9b7d79c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:43.164 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f8a9b7d79c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T18:52:43.164 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f8a9b7d79c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T18:52:43.164 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f8a9b7d79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 : miss 2024-09-12T18:52:43.164 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.160+0000 7f8a9b7d79c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:43.165 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 info.flags=0x17 2024-09-12T18:52:43.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 10 adding default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 to cache LRU end 2024-09-12T18:52:43.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:52:43.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T18:52:43.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:97c2b296-1395-4700-8053-4f06c4c86557.4689.18 2024-09-12T18:52:43.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.0 2024-09-12T18:52:43.166 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.0 2024-09-12T18:52:43.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T18:52:43.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.1 2024-09-12T18:52:43.167 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.1 2024-09-12T18:52:43.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T18:52:43.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.2 2024-09-12T18:52:43.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.2 2024-09-12T18:52:43.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.164+0000 7f8a9b7d79c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T18:52:43.168 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.168+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.3 2024-09-12T18:52:43.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.168+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.3 2024-09-12T18:52:43.169 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.168+0000 7f8a9b7d79c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T18:52:43.170 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.168+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.4 2024-09-12T18:52:43.170 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.168+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.4 2024-09-12T18:52:43.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.168+0000 7f8a9b7d79c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T18:52:43.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.168+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.5 2024-09-12T18:52:43.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.168+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.5 2024-09-12T18:52:43.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.168+0000 7f8a9b7d79c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T18:52:43.171 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.168+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.6 2024-09-12T18:52:43.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.168+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.6 2024-09-12T18:52:43.172 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.172+0000 7f8a9b7d79c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T18:52:43.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.172+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.7 2024-09-12T18:52:43.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.172+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.7 2024-09-12T18:52:43.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.172+0000 7f8a9b7d79c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T18:52:43.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.172+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.8 2024-09-12T18:52:43.173 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.172+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.8 2024-09-12T18:52:43.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.172+0000 7f8a9b7d79c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T18:52:43.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.172+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.174 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.172+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.172+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.10 2024-09-12T18:52:43.175 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.172+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.10 2024-09-12T18:52:43.176 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.176+0000 7f8a9b7d79c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T18:52:43.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.176+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.11 2024-09-12T18:52:43.177 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.176+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.11 2024-09-12T18:52:43.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.176+0000 7f8a9b7d79c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T18:52:43.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.176+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.12 2024-09-12T18:52:43.178 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.176+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.12 2024-09-12T18:52:43.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.176+0000 7f8a9b7d79c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T18:52:43.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.176+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.13 2024-09-12T18:52:43.179 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.176+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.13 2024-09-12T18:52:43.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.176+0000 7f8a9b7d79c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T18:52:43.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.176+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.14 2024-09-12T18:52:43.180 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.176+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.14 2024-09-12T18:52:43.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.180+0000 7f8a9b7d79c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T18:52:43.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.180+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.15 2024-09-12T18:52:43.182 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.180+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.15 2024-09-12T18:52:43.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.180+0000 7f8a9b7d79c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T18:52:43.183 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.180+0000 7f8a9b7d79c0 10 bucket_obj is .dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.16 2024-09-12T18:52:43.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.180+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.16 2024-09-12T18:52:43.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.180+0000 7f8a9b7d79c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T18:52:43.184 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.184+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.184+0000 7f8a9b7d79c0 20 get_obj_state: octx=0x55ee5d6c13b0 obj=myver:x state=0x55ee5da05b48 s->prefetch_data=0 2024-09-12T18:52:43.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.184+0000 7f8a9b7d79c0 20 get_obj_state: setting s->obj_tag to k1vu8vdsdcvrega9rwhwsqb5t0m0yj8q 2024-09-12T18:52:43.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.184+0000 7f8a9b7d79c0 20 get_obj_state_impl: setting s->olh_tag to c9906dgplc2zibjq4njwy9h72qpf9wfw 2024-09-12T18:52:43.185 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.184+0000 7f8a9b7d79c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c9906dgplc2zibjq4njwy9h72qpf9wfw 2024-09-12T18:52:43.187 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.184+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.190 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.188+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.188+0000 7f8a9b7d79c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T18:52:43.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.188+0000 7f8a9b7d79c0 20 olh_log_entry: epoch=2 op=3 key=x[jDIeVZJkZdKI0XxSZLHy4stuSi.hmjD] 2024-09-12T18:52:43.191 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.188+0000 7f8a9b7d79c0 20 get_obj_state: octx=0x55ee5d6c13b0 obj=myver:_:jDIeVZJkZdKI0XxSZLHy4stuSi.hmjD_x state=0x55ee5da04c58 s->prefetch_data=0 2024-09-12T18:52:43.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.188+0000 7f8a9b7d79c0 10 manifest: total_size = 11 2024-09-12T18:52:43.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.188+0000 7f8a9b7d79c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.6787457524744305004 2024-09-12T18:52:43.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.188+0000 7f8a9b7d79c0 20 get_obj_state: octx=0x55ee5d6c13b0 obj=myver:_:jDIeVZJkZdKI0XxSZLHy4stuSi.hmjD_x state=0x55ee5da04c58 s->prefetch_data=0 2024-09-12T18:52:43.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.188+0000 7f8a9b7d79c0 20 prepare_atomic_modification: state is not atomic. state=0x55ee5da04c58 2024-09-12T18:52:43.192 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.188+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.196+0000 7f8a9b7d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:52:43.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.196+0000 7f8a9b7d79c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T18:52:43.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.196+0000 7f8a9b7d79c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:52:43.197 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.196+0000 7f8a9b7d79c0 5 delete_objs_inline: removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.18__shadow:jDIeVZJkZdKI0XxSZLHy4stuSi.hmjD_.13nK2ku5OnlKBXrQ-M_jdAf1bz1RiRA_0 2024-09-12T18:52:43.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.196+0000 7f8a9b7d79c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:52:43.199 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.196+0000 7f896bfff640 20 handle_completion(): completion ok for obj=x[jDIeVZJkZdKI0XxSZLHy4stuSi.hmjD] 2024-09-12T18:52:43.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.200+0000 7f8a9b7d79c0 20 get_obj_state: octx=0x55ee5d6c13b0 obj=myver:x state=0x55ee5da05b48 s->prefetch_data=0 2024-09-12T18:52:43.202 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.200+0000 7f8a9b7d79c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c9906dgplc2zibjq4njwy9h72qpf9wfw 2024-09-12T18:52:43.206 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.204+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.208+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.209 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.208+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.208+0000 7f8a9b7d79c0 20 get_obj_state: octx=0x55ee5d6c13b0 obj=myver:y state=0x55ee5da05b48 s->prefetch_data=0 2024-09-12T18:52:43.210 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.208+0000 7f8a9b7d79c0 20 get_obj_state: setting s->obj_tag to wmvibw2q1o91dy7r2jruz2vsvnghl5x3 2024-09-12T18:52:43.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.208+0000 7f8a9b7d79c0 20 get_obj_state_impl: setting s->olh_tag to qxgc3qsy4ks7mea8lkcrnnm88p44i9ut 2024-09-12T18:52:43.211 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.208+0000 7f8a9b7d79c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qxgc3qsy4ks7mea8lkcrnnm88p44i9ut 2024-09-12T18:52:43.213 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.212+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.215 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.212+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.212+0000 7f8a9b7d79c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T18:52:43.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.212+0000 7f8a9b7d79c0 20 olh_log_entry: epoch=2 op=3 key=y[7k.7UG49W9UgRmgHXtBKPfI128Mczr7] 2024-09-12T18:52:43.216 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.212+0000 7f8a9b7d79c0 20 get_obj_state: octx=0x55ee5d6c13b0 obj=myver:_:7k.7UG49W9UgRmgHXtBKPfI128Mczr7_y state=0x55ee5da38628 s->prefetch_data=0 2024-09-12T18:52:43.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.216+0000 7f8a9b7d79c0 10 manifest: total_size = 11 2024-09-12T18:52:43.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.216+0000 7f8a9b7d79c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.781125967178333163 2024-09-12T18:52:43.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.216+0000 7f8a9b7d79c0 20 get_obj_state: octx=0x55ee5d6c13b0 obj=myver:_:7k.7UG49W9UgRmgHXtBKPfI128Mczr7_y state=0x55ee5da38628 s->prefetch_data=0 2024-09-12T18:52:43.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.216+0000 7f8a9b7d79c0 20 prepare_atomic_modification: state is not atomic. state=0x55ee5da38628 2024-09-12T18:52:43.217 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.216+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.220+0000 7f8a9b7d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:52:43.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.220+0000 7f8a9b7d79c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T18:52:43.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.220+0000 7f8a9b7d79c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:52:43.221 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.220+0000 7f8a9b7d79c0 5 delete_objs_inline: removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.18__shadow:7k.7UG49W9UgRmgHXtBKPfI128Mczr7_.8mQmSC12EWhBJMhaAzgeZTFuHz-G9nE_0 2024-09-12T18:52:43.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.220+0000 7f897cff9640 20 handle_completion(): completion ok for obj=y[7k.7UG49W9UgRmgHXtBKPfI128Mczr7] 2024-09-12T18:52:43.223 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.220+0000 7f8a9b7d79c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:52:43.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.224+0000 7f8a9b7d79c0 20 get_obj_state: octx=0x55ee5d6c13b0 obj=myver:y state=0x55ee5da05b48 s->prefetch_data=0 2024-09-12T18:52:43.226 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.224+0000 7f8a9b7d79c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qxgc3qsy4ks7mea8lkcrnnm88p44i9ut 2024-09-12T18:52:43.229 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.228+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.231 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.228+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.228+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.232 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.232+0000 7f8a9b7d79c0 20 get_obj_state: octx=0x55ee5d6c13b0 obj=myver:z state=0x55ee5da05b48 s->prefetch_data=0 2024-09-12T18:52:43.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.232+0000 7f8a9b7d79c0 20 get_obj_state: setting s->obj_tag to 9jmxbvs14yriqk6nbaox7e8tcllt6z3z 2024-09-12T18:52:43.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.232+0000 7f8a9b7d79c0 20 get_obj_state_impl: setting s->olh_tag to heclq73m6aie5n9jnz5m83sqvjgbprx8 2024-09-12T18:52:43.233 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.232+0000 7f8a9b7d79c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=heclq73m6aie5n9jnz5m83sqvjgbprx8 2024-09-12T18:52:43.235 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.232+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.237 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.236+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.236+0000 7f8a9b7d79c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T18:52:43.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.236+0000 7f8a9b7d79c0 20 olh_log_entry: epoch=2 op=3 key=z[wHYIcH.AbkRlyw3SmyJc0CQlftAhZ7G] 2024-09-12T18:52:43.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.236+0000 7f8a9b7d79c0 20 get_obj_state: octx=0x55ee5d6c13b0 obj=myver:_:wHYIcH.AbkRlyw3SmyJc0CQlftAhZ7G_z state=0x55ee5da38628 s->prefetch_data=0 2024-09-12T18:52:43.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.236+0000 7f8a9b7d79c0 10 manifest: total_size = 9 2024-09-12T18:52:43.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.236+0000 7f8a9b7d79c0 20 get_obj_state: setting s->obj_tag to 97c2b296-1395-4700-8053-4f06c4c86557.4689.9805083908001052069 2024-09-12T18:52:43.238 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.236+0000 7f8a9b7d79c0 20 get_obj_state: octx=0x55ee5d6c13b0 obj=myver:_:wHYIcH.AbkRlyw3SmyJc0CQlftAhZ7G_z state=0x55ee5da38628 s->prefetch_data=0 2024-09-12T18:52:43.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.236+0000 7f8a9b7d79c0 20 prepare_atomic_modification: state is not atomic. state=0x55ee5da38628 2024-09-12T18:52:43.239 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.236+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.240+0000 7f8a9b7d79c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T18:52:43.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.240+0000 7f8a9b7d79c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T18:52:43.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.240+0000 7f8a9b7d79c0 0 deleting objects inline since gc isn't initialized 2024-09-12T18:52:43.243 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.240+0000 7f8a9b7d79c0 5 delete_objs_inline: removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.18__shadow:wHYIcH.AbkRlyw3SmyJc0CQlftAhZ7G_.uTWZPBbs3On5tR0N5DLF6S2ntUhGMxG_0 2024-09-12T18:52:43.245 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.244+0000 7f897cff9640 20 handle_completion(): completion ok for obj=z[wHYIcH.AbkRlyw3SmyJc0CQlftAhZ7G] 2024-09-12T18:52:43.246 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.244+0000 7f8a9b7d79c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T18:52:43.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.248+0000 7f8a9b7d79c0 20 get_obj_state: octx=0x55ee5d6c13b0 obj=myver:z state=0x55ee5da05b48 s->prefetch_data=0 2024-09-12T18:52:43.248 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.248+0000 7f8a9b7d79c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=heclq73m6aie5n9jnz5m83sqvjgbprx8 2024-09-12T18:52:43.253 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.252+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.252+0000 7f8a9b7d79c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.18.3.9 2024-09-12T18:52:43.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.252+0000 7f8a9b7d79c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T18:52:43.256 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.252+0000 7f8a9b7d79c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T18:52:43.257 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.256+0000 7f894ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:43.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.260+0000 7f8a9b7d79c0 20 remove_watcher() i=0 2024-09-12T18:52:43.263 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.260+0000 7f8a9b7d79c0 2 removed watcher, disabling cache 2024-09-12T18:52:43.265 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.264+0000 7f8a9b7d79c0 20 remove_watcher() i=1 2024-09-12T18:52:43.268 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.264+0000 7f8a9b7d79c0 20 remove_watcher() i=2 2024-09-12T18:52:43.271 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.268+0000 7f8a9b7d79c0 20 remove_watcher() i=3 2024-09-12T18:52:43.273 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.272+0000 7f8a9b7d79c0 20 remove_watcher() i=4 2024-09-12T18:52:43.274 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.272+0000 7f8a9b7d79c0 20 remove_watcher() i=5 2024-09-12T18:52:43.277 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.276+0000 7f8a9b7d79c0 20 remove_watcher() i=6 2024-09-12T18:52:43.279 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.276+0000 7f8a9b7d79c0 20 remove_watcher() i=7 2024-09-12T18:52:43.302 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:43.302 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:43.310 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:43.310 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:43.354 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T18:52:43.385 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:52:43.385 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:52:43.431 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.428+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.432+0000 7fa03ee559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:43.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.432+0000 7fa03ee559c0 20 realm 2024-09-12T18:52:43.433 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.432+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.432+0000 7fa03ee559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:43.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.432+0000 7fa03ee559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:52:43.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.432+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.432+0000 7fa03ee559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:43.434 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.432+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.432+0000 7fa03ee559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:43.435 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.432+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.432+0000 7fa03ee559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:52:43.436 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.432+0000 7fa03ee559c0 20 searching for the correct realm 2024-09-12T18:52:43.440 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.436+0000 7fa03d15c640 0 -- 172.21.15.111:0/1323443311 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fa030031070 msgr2=0x7fa030061a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:52:43.653 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.652+0000 7fa03c15a640 0 -- 172.21.15.111:0/1323443311 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fa0341205c0 msgr2=0x7fa0340ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:52:43.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.868+0000 7fa03ee559c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:52:43.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.868+0000 7fa03ee559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:52:43.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.868+0000 7fa03ee559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:52:43.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.868+0000 7fa03ee559c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:52:43.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.868+0000 7fa03ee559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:52:43.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.868+0000 7fa03ee559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:52:43.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.868+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.868+0000 7fa03ee559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:43.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.868+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.868+0000 7fa03ee559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:52:43.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.868+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:52:43.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 20 zone default found 2024-09-12T18:52:43.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 4 Realm: () 2024-09-12T18:52:43.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:52:43.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:52:43.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:52:43.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 20 zonegroup default 2024-09-12T18:52:43.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:43.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:43.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:52:43.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 20 started sync module instance, tier type = 2024-09-12T18:52:43.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.872+0000 7fa03ee559c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:52:43.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.900+0000 7fa03ee559c0 20 add_watcher() i=0 2024-09-12T18:52:43.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.900+0000 7fa03ee559c0 20 add_watcher() i=1 2024-09-12T18:52:43.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.900+0000 7fa03ee559c0 20 add_watcher() i=2 2024-09-12T18:52:43.902 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.900+0000 7fa03ee559c0 20 add_watcher() i=3 2024-09-12T18:52:43.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.900+0000 7fa03ee559c0 20 add_watcher() i=4 2024-09-12T18:52:43.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.900+0000 7fa03ee559c0 20 add_watcher() i=5 2024-09-12T18:52:43.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.900+0000 7fa03ee559c0 20 add_watcher() i=6 2024-09-12T18:52:43.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.904+0000 7fa03ee559c0 20 add_watcher() i=7 2024-09-12T18:52:43.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.904+0000 7fa03ee559c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:52:43.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.908+0000 7f9ef2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:43.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.908+0000 7fa03ee559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:52:43.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.908+0000 7fa03ee559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:52:43.910 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.908+0000 7fa03ee559c0 5 note: GC not initialized 2024-09-12T18:52:43.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.908+0000 7f9ef1fe3640 20 reqs_thread_entry: start 2024-09-12T18:52:43.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.908+0000 7fa03ee559c0 20 init_complete bucket index max shards: 11 2024-09-12T18:52:43.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.908+0000 7fa03ee559c0 20 Filter name: none 2024-09-12T18:52:43.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.908+0000 7f9e637fe640 20 reqs_thread_entry: start 2024-09-12T18:52:43.911 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.908+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.908+0000 7fa03ee559c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:43.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.908+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.908+0000 7fa03ee559c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:43.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.908+0000 7fa03ee559c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:43.912 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.908+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.912+0000 7fa03ee559c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T18:52:43.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.912+0000 7fa03ee559c0 20 rados->read ofs=0 len=0 2024-09-12T18:52:43.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.912+0000 7fa03ee559c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T18:52:43.913 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.912+0000 7fa03ee559c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T18:52:43.917 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.916+0000 7f9ef2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:52:43.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.920+0000 7fa03ee559c0 20 remove_watcher() i=0 2024-09-12T18:52:43.923 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.920+0000 7fa03ee559c0 2 removed watcher, disabling cache 2024-09-12T18:52:43.925 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.924+0000 7fa03ee559c0 20 remove_watcher() i=1 2024-09-12T18:52:43.927 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.924+0000 7fa03ee559c0 20 remove_watcher() i=2 2024-09-12T18:52:43.929 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.928+0000 7fa03ee559c0 20 remove_watcher() i=3 2024-09-12T18:52:43.931 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.928+0000 7fa03ee559c0 20 remove_watcher() i=4 2024-09-12T18:52:43.933 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.932+0000 7fa03ee559c0 20 remove_watcher() i=5 2024-09-12T18:52:43.934 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.932+0000 7fa03ee559c0 20 remove_watcher() i=6 2024-09-12T18:52:43.936 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T18:52:43.932+0000 7fa03ee559c0 20 remove_watcher() i=7 2024-09-12T18:52:43.950 INFO:tasks.workunit.client.0.smithi111.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T18:52:43.950 INFO:tasks.workunit.client.0.smithi111.stderr:Deleting bucket a-bucket 2024-09-12T18:52:43.951 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:43.951 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:43.956 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:43.957 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:43.976 INFO:tasks.workunit.client.0.smithi111.stderr:Deleting bucket myver 2024-09-12T18:52:43.977 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:43.977 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:44.028 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T18:52:44.028 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T18:52:44.128 INFO:tasks.workunit.client.0.smithi111.stderr:Completed resharding tests 2024-09-12T18:52:44.128 INFO:tasks.workunit.client.0.smithi111.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T18:52:44.128 INFO:tasks.workunit.client.0.smithi111.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T18:52:44.128 INFO:tasks.workunit.client.0.smithi111.stdout:connected to https://localhost:443 2024-09-12T18:52:44.250 INFO:tasks.workunit.client.0.smithi111.stderr:+ deactivate 2024-09-12T18:52:44.250 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T18:52:44.250 INFO:tasks.workunit.client.0.smithi111.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T18:52:44.251 INFO:tasks.workunit.client.0.smithi111.stderr:+ export PATH 2024-09-12T18:52:44.251 INFO:tasks.workunit.client.0.smithi111.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T18:52:44.251 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' -n '' ']' 2024-09-12T18:52:44.251 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T18:52:44.251 INFO:tasks.workunit.client.0.smithi111.stderr:+ hash -r 2024-09-12T18:52:44.251 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' -n '' ']' 2024-09-12T18:52:44.251 INFO:tasks.workunit.client.0.smithi111.stderr:+ unset VIRTUAL_ENV 2024-09-12T18:52:44.251 INFO:tasks.workunit.client.0.smithi111.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T18:52:44.251 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T18:52:44.251 INFO:tasks.workunit.client.0.smithi111.stderr:+ unset -f deactivate 2024-09-12T18:52:44.251 INFO:tasks.workunit.client.0.smithi111.stderr:+ echo OK. 2024-09-12T18:52:44.252 INFO:tasks.workunit.client.0.smithi111.stdout:OK. 2024-09-12T18:52:44.253 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T18:52:44.253 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T18:52:44.310 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T18:52:44.310 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T18:52:44.742 DEBUG:teuthology.parallel:result is None 2024-09-12T18:52:44.742 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:52:44.754 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:52:44.754 DEBUG:teuthology.orchestra.run.smithi111:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T18:52:44.801 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T18:52:44.801 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T18:52:44.826 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T18:52:44.826 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T18:52:44.826 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T18:52:44.826 DEBUG:teuthology.orchestra.run.smithi111:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T18:52:44.848 INFO:teuthology.orchestra.run.smithi111.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T18:52:49.295 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T18:52:49.296 DEBUG:teuthology.orchestra.run.smithi111:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T18:52:49.384 INFO:teuthology.orchestra.run.smithi111.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-12T18:52:49.435 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-09-12T18:52:49.627 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-09-12T18:52:49.628 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-09-12T18:52:49.817 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T18:52:49.817 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T18:52:49.817 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T18:52:49.817 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T18:52:49.818 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T18:52:49.818 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T18:52:49.818 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T18:52:49.818 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-09-12T18:52:49.819 INFO:teuthology.orchestra.run.smithi111.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T18:52:49.819 INFO:teuthology.orchestra.run.smithi111.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T18:52:49.820 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-09-12T18:52:49.821 INFO:teuthology.orchestra.run.smithi111.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-12T18:52:49.821 INFO:teuthology.orchestra.run.smithi111.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-12T18:52:49.821 INFO:teuthology.orchestra.run.smithi111.stdout: fonts-wqy-zenhei fonts-indic 2024-09-12T18:52:49.855 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-09-12T18:52:49.855 INFO:teuthology.orchestra.run.smithi111.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T18:52:49.856 INFO:teuthology.orchestra.run.smithi111.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T18:52:49.910 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T18:52:49.910 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 46.0 MB of archives. 2024-09-12T18:52:49.910 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-12T18:52:49.910 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-12T18:52:49.989 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-12T18:52:50.073 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-12T18:52:50.074 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-12T18:52:50.076 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-12T18:52:50.076 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-12T18:52:50.466 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-12T18:52:50.467 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-12T18:52:50.561 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-12T18:52:50.842 INFO:teuthology.orchestra.run.smithi111.stderr:debconf: unable to initialize frontend: Dialog 2024-09-12T18:52:50.842 INFO:teuthology.orchestra.run.smithi111.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-12T18:52:50.842 INFO:teuthology.orchestra.run.smithi111.stderr:debconf: falling back to frontend: Readline 2024-09-12T18:52:50.858 INFO:teuthology.orchestra.run.smithi111.stderr:debconf: unable to initialize frontend: Readline 2024-09-12T18:52:50.858 INFO:teuthology.orchestra.run.smithi111.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-12T18:52:50.858 INFO:teuthology.orchestra.run.smithi111.stderr:debconf: falling back to frontend: Teletype 2024-09-12T18:52:50.862 INFO:teuthology.orchestra.run.smithi111.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-12T18:52:50.895 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 46.0 MB in 1s (63.4 MB/s) 2024-09-12T18:52:51.011 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-12T18:52:51.112 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177243 files and directories currently installed.) 2024-09-12T18:52:51.118 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-12T18:52:51.159 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T18:52:51.563 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-12T18:52:51.591 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:52:51.654 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:52:52.092 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-12T18:52:52.108 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:52:52.152 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:52:52.395 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-12T18:52:52.423 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:52:52.461 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:52:52.730 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-12T18:52:52.759 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T18:52:52.797 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T18:52:53.226 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-12T18:52:53.254 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:52:53.296 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:52:54.964 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-12T18:52:54.992 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:52:55.034 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:52:55.477 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-12T18:52:55.505 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:52:55.538 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:52:56.264 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-12T18:52:56.292 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T18:52:56.325 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:52:56.701 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:52:57.773 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-12T18:52:57.790 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-12T18:52:57.814 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-12T18:52:58.189 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T18:52:58.356 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:52:58.700 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:52:58.775 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-12T18:52:58.835 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:52:58.911 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-12T18:52:58.931 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-12T18:52:58.966 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-12T18:52:58.990 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-12T18:52:59.101 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-12T18:52:59.252 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-12T18:52:59.379 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-12T18:52:59.474 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-12T18:52:59.523 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-12T18:52:59.574 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-12T18:52:59.599 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-12T18:52:59.625 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-12T18:52:59.689 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:52:59.816 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T18:52:59.942 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T18:53:00.034 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-12T18:53:00.119 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T18:53:00.271 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T18:53:01.313 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T18:53:01.422 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T18:53:01.732 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T18:53:02.168 INFO:teuthology.orchestra.run.smithi111.stdout: Gradle will be installed under /opt/gradle 2024-09-12T18:53:02.197 INFO:teuthology.orchestra.run.smithi111.stderr:--2024-09-12 18:53:02-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T18:53:02.267 INFO:teuthology.orchestra.run.smithi111.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4865, ... 2024-09-12T18:53:02.276 INFO:teuthology.orchestra.run.smithi111.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-12T18:53:02.323 INFO:teuthology.orchestra.run.smithi111.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T18:53:02.323 INFO:teuthology.orchestra.run.smithi111.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T18:53:02.324 INFO:teuthology.orchestra.run.smithi111.stderr:--2024-09-12 18:53:02-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T18:53:02.325 INFO:teuthology.orchestra.run.smithi111.stderr:Resolving github.com (github.com)... 140.82.112.3 2024-09-12T18:53:02.333 INFO:teuthology.orchestra.run.smithi111.stderr:Connecting to github.com (github.com)|140.82.112.3|:443... connected. 2024-09-12T18:53:02.425 INFO:teuthology.orchestra.run.smithi111.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T18:53:02.425 INFO:teuthology.orchestra.run.smithi111.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T185302Z&X-Amz-Expires=300&X-Amz-Signature=d1cdf252973b57bc30e17068fb749ccc8c7c6b1239c06cb269fbd64b7a0429dd&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T18:53:02.425 INFO:teuthology.orchestra.run.smithi111.stderr:--2024-09-12 18:53:02-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T185302Z&X-Amz-Expires=300&X-Amz-Signature=d1cdf252973b57bc30e17068fb749ccc8c7c6b1239c06cb269fbd64b7a0429dd&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T18:53:02.427 INFO:teuthology.orchestra.run.smithi111.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.109.133, 185.199.111.133, ... 2024-09-12T18:53:02.439 INFO:teuthology.orchestra.run.smithi111.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-12T18:53:02.526 INFO:teuthology.orchestra.run.smithi111.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T18:53:02.526 INFO:teuthology.orchestra.run.smithi111.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T18:53:02.527 INFO:teuthology.orchestra.run.smithi111.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-12T18:53:02.527 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-09-12T18:53:02.539 INFO:teuthology.orchestra.run.smithi111.stderr: 0K .......... .......... .......... .......... .......... 0% 3.99M 23s 2024-09-12T18:53:02.550 INFO:teuthology.orchestra.run.smithi111.stderr: 50K .......... .......... .......... .......... .......... 0% 4.21M 22s 2024-09-12T18:53:02.552 INFO:teuthology.orchestra.run.smithi111.stderr: 100K .......... .......... .......... .......... .......... 0% 19.3M 16s 2024-09-12T18:53:02.556 INFO:teuthology.orchestra.run.smithi111.stderr: 150K .......... .......... .......... .......... .......... 0% 14.6M 14s 2024-09-12T18:53:02.562 INFO:teuthology.orchestra.run.smithi111.stderr: 200K .......... .......... .......... .......... .......... 0% 7.91M 13s 2024-09-12T18:53:02.564 INFO:teuthology.orchestra.run.smithi111.stderr: 250K .......... .......... .......... .......... .......... 0% 31.8M 12s 2024-09-12T18:53:02.566 INFO:teuthology.orchestra.run.smithi111.stderr: 300K .......... .......... .......... .......... .......... 0% 22.9M 10s 2024-09-12T18:53:02.567 INFO:teuthology.orchestra.run.smithi111.stderr: 350K .......... .......... .......... .......... .......... 0% 47.4M 9s 2024-09-12T18:53:02.568 INFO:teuthology.orchestra.run.smithi111.stderr: 400K .......... .......... .......... .......... .......... 0% 44.0M 9s 2024-09-12T18:53:02.574 INFO:teuthology.orchestra.run.smithi111.stderr: 450K .......... .......... .......... .......... .......... 0% 8.78M 9s 2024-09-12T18:53:02.575 INFO:teuthology.orchestra.run.smithi111.stderr: 500K .......... .......... .......... .......... .......... 0% 42.3M 8s 2024-09-12T18:53:02.575 INFO:teuthology.orchestra.run.smithi111.stderr: 550K .......... .......... .......... .......... .......... 0% 90.5M 8s 2024-09-12T18:53:02.578 INFO:teuthology.orchestra.run.smithi111.stderr: 600K .......... .......... .......... .......... .......... 0% 39.9M 7s 2024-09-12T18:53:02.578 INFO:teuthology.orchestra.run.smithi111.stderr: 650K .......... .......... .......... .......... .......... 0% 85.8M 7s 2024-09-12T18:53:02.578 INFO:teuthology.orchestra.run.smithi111.stderr: 700K .......... .......... .......... .......... .......... 0% 60.0M 6s 2024-09-12T18:53:02.582 INFO:teuthology.orchestra.run.smithi111.stderr: 750K .......... .......... .......... .......... .......... 0% 48.4M 6s 2024-09-12T18:53:02.582 INFO:teuthology.orchestra.run.smithi111.stderr: 800K .......... .......... .......... .......... .......... 0% 85.7M 6s 2024-09-12T18:53:02.582 INFO:teuthology.orchestra.run.smithi111.stderr: 850K .......... .......... .......... .......... .......... 0% 88.9M 5s 2024-09-12T18:53:02.582 INFO:teuthology.orchestra.run.smithi111.stderr: 900K .......... .......... .......... .......... .......... 1% 77.0M 5s 2024-09-12T18:53:03.757 INFO:teuthology.orchestra.run.smithi111.stderr: 950K .......... .......... .......... .......... .......... 1% 11.0M 5s 2024-09-12T18:53:03.757 INFO:teuthology.orchestra.run.smithi111.stderr: 1000K .......... .......... .......... .......... .......... 1% 81.0M 5s 2024-09-12T18:53:03.757 INFO:teuthology.orchestra.run.smithi111.stderr: 1050K .......... .......... .......... .......... .......... 1% 84.2M 5s 2024-09-12T18:53:03.757 INFO:teuthology.orchestra.run.smithi111.stderr: 1100K .......... .......... .......... .......... .......... 1% 67.8M 5s 2024-09-12T18:53:03.757 INFO:teuthology.orchestra.run.smithi111.stderr: 1150K .......... .......... .......... .......... .......... 1% 91.1M 5s 2024-09-12T18:53:03.757 INFO:teuthology.orchestra.run.smithi111.stderr: 1200K .......... .......... .......... .......... .......... 1% 82.7M 5s 2024-09-12T18:53:03.757 INFO:teuthology.orchestra.run.smithi111.stderr: 1250K .......... .......... .......... .......... .......... 1% 70.7M 4s 2024-09-12T18:53:03.758 INFO:teuthology.orchestra.run.smithi111.stderr: 1300K .......... .......... .......... .......... .......... 1% 79.9M 4s 2024-09-12T18:53:03.758 INFO:teuthology.orchestra.run.smithi111.stderr: 1350K .......... .......... .......... .......... .......... 1% 87.2M 4s 2024-09-12T18:53:03.758 INFO:teuthology.orchestra.run.smithi111.stderr: 1400K .......... .......... .......... .......... .......... 1% 90.3M 4s 2024-09-12T18:53:03.758 INFO:teuthology.orchestra.run.smithi111.stderr: 1450K .......... .......... .......... .......... .......... 1% 90.7M 4s 2024-09-12T18:53:03.758 INFO:teuthology.orchestra.run.smithi111.stderr: 1500K .......... .......... .......... .......... .......... 1% 72.9M 4s 2024-09-12T18:53:03.758 INFO:teuthology.orchestra.run.smithi111.stderr: 1550K .......... .......... .......... .......... .......... 1% 85.4M 4s 2024-09-12T18:53:03.758 INFO:teuthology.orchestra.run.smithi111.stderr: 1600K .......... .......... .......... .......... .......... 1% 85.8M 4s 2024-09-12T18:53:03.758 INFO:teuthology.orchestra.run.smithi111.stderr: 1650K .......... .......... .......... .......... .......... 1% 91.1M 4s 2024-09-12T18:53:03.758 INFO:teuthology.orchestra.run.smithi111.stderr: 1700K .......... .......... .......... .......... .......... 1% 82.7M 4s 2024-09-12T18:53:03.758 INFO:teuthology.orchestra.run.smithi111.stderr: 1750K .......... .......... .......... .......... .......... 1% 91.0M 3s 2024-09-12T18:53:03.758 INFO:teuthology.orchestra.run.smithi111.stderr: 1800K .......... .......... .......... .......... .......... 1% 92.1M 3s 2024-09-12T18:53:03.758 INFO:teuthology.orchestra.run.smithi111.stderr: 1850K .......... .......... .......... .......... .......... 2% 91.3M 3s 2024-09-12T18:53:03.759 INFO:teuthology.orchestra.run.smithi111.stderr: 1900K .......... .......... .......... .......... .......... 2% 76.2M 3s 2024-09-12T18:53:03.759 INFO:teuthology.orchestra.run.smithi111.stderr: 1950K .......... .......... .......... .......... .......... 2% 88.2M 3s 2024-09-12T18:53:03.759 INFO:teuthology.orchestra.run.smithi111.stderr: 2000K .......... .......... .......... .......... .......... 2% 85.7M 3s 2024-09-12T18:53:03.759 INFO:teuthology.orchestra.run.smithi111.stderr: 2050K .......... .......... .......... .......... .......... 2% 83.7M 3s 2024-09-12T18:53:03.759 INFO:teuthology.orchestra.run.smithi111.stderr: 2100K .......... .......... .......... .......... .......... 2% 79.6M 3s 2024-09-12T18:53:03.759 INFO:teuthology.orchestra.run.smithi111.stderr: 2150K .......... .......... .......... .......... .......... 2% 87.8M 3s 2024-09-12T18:53:03.759 INFO:teuthology.orchestra.run.smithi111.stderr: 2200K .......... .......... .......... .......... .......... 2% 84.7M 3s 2024-09-12T18:53:03.759 INFO:teuthology.orchestra.run.smithi111.stderr: 2250K .......... .......... .......... .......... .......... 2% 84.0M 3s 2024-09-12T18:53:03.759 INFO:teuthology.orchestra.run.smithi111.stderr: 2300K .......... .......... .......... .......... .......... 2% 68.8M 3s 2024-09-12T18:53:03.759 INFO:teuthology.orchestra.run.smithi111.stderr: 2350K .......... .......... .......... .......... .......... 2% 84.2M 3s 2024-09-12T18:53:03.759 INFO:teuthology.orchestra.run.smithi111.stderr: 2400K .......... .......... .......... .......... .......... 2% 82.0M 3s 2024-09-12T18:53:03.760 INFO:teuthology.orchestra.run.smithi111.stderr: 2450K .......... .......... .......... .......... .......... 2% 82.1M 3s 2024-09-12T18:53:03.760 INFO:teuthology.orchestra.run.smithi111.stderr: 2500K .......... .......... .......... .......... .......... 2% 72.3M 3s 2024-09-12T18:53:03.760 INFO:teuthology.orchestra.run.smithi111.stderr: 2550K .......... .......... .......... .......... .......... 2% 82.4M 3s 2024-09-12T18:53:03.760 INFO:teuthology.orchestra.run.smithi111.stderr: 2600K .......... .......... .......... .......... .......... 2% 86.2M 3s 2024-09-12T18:53:03.760 INFO:teuthology.orchestra.run.smithi111.stderr: 2650K .......... .......... .......... .......... .......... 2% 97.0M 3s 2024-09-12T18:53:03.760 INFO:teuthology.orchestra.run.smithi111.stderr: 2700K .......... .......... .......... .......... .......... 2% 123M 3s 2024-09-12T18:53:03.760 INFO:teuthology.orchestra.run.smithi111.stderr: 2750K .......... .......... .......... .......... .......... 3% 151M 3s 2024-09-12T18:53:03.760 INFO:teuthology.orchestra.run.smithi111.stderr: 2800K .......... .......... .......... .......... .......... 3% 151M 3s 2024-09-12T18:53:03.760 INFO:teuthology.orchestra.run.smithi111.stderr: 2850K .......... .......... .......... .......... .......... 3% 147M 2s 2024-09-12T18:53:03.760 INFO:teuthology.orchestra.run.smithi111.stderr: 2900K .......... .......... .......... .......... .......... 3% 137M 2s 2024-09-12T18:53:03.761 INFO:teuthology.orchestra.run.smithi111.stderr: 2950K .......... .......... .......... .......... .......... 3% 150M 2s 2024-09-12T18:53:03.761 INFO:teuthology.orchestra.run.smithi111.stderr: 3000K .......... .......... .......... .......... .......... 3% 153M 2s 2024-09-12T18:53:03.761 INFO:teuthology.orchestra.run.smithi111.stderr: 3050K .......... .......... .......... .......... .......... 3% 143M 2s 2024-09-12T18:53:03.761 INFO:teuthology.orchestra.run.smithi111.stderr: 3100K .......... .......... .......... .......... .......... 3% 123M 2s 2024-09-12T18:53:03.761 INFO:teuthology.orchestra.run.smithi111.stderr: 3150K .......... .......... .......... .......... .......... 3% 135M 2s 2024-09-12T18:53:03.761 INFO:teuthology.orchestra.run.smithi111.stderr: 3200K .......... .......... .......... .......... .......... 3% 121M 2s 2024-09-12T18:53:03.761 INFO:teuthology.orchestra.run.smithi111.stderr: 3250K .......... .......... .......... .......... .......... 3% 129M 2s 2024-09-12T18:53:03.761 INFO:teuthology.orchestra.run.smithi111.stderr: 3300K .......... .......... .......... .......... .......... 3% 116M 2s 2024-09-12T18:53:03.761 INFO:teuthology.orchestra.run.smithi111.stderr: 3350K .......... .......... .......... .......... .......... 3% 128M 2s 2024-09-12T18:53:03.761 INFO:teuthology.orchestra.run.smithi111.stderr: 3400K .......... .......... .......... .......... .......... 3% 128M 2s 2024-09-12T18:53:03.761 INFO:teuthology.orchestra.run.smithi111.stderr: 3450K .......... .......... .......... .......... .......... 3% 124M 2s 2024-09-12T18:53:03.762 INFO:teuthology.orchestra.run.smithi111.stderr: 3500K .......... .......... .......... .......... .......... 3% 109M 2s 2024-09-12T18:53:03.762 INFO:teuthology.orchestra.run.smithi111.stderr: 3550K .......... .......... .......... .......... .......... 3% 143M 2s 2024-09-12T18:53:03.762 INFO:teuthology.orchestra.run.smithi111.stderr: 3600K .......... .......... .......... .......... .......... 3% 130M 2s 2024-09-12T18:53:03.762 INFO:teuthology.orchestra.run.smithi111.stderr: 3650K .......... .......... .......... .......... .......... 3% 136M 2s 2024-09-12T18:53:03.762 INFO:teuthology.orchestra.run.smithi111.stderr: 3700K .......... .......... .......... .......... .......... 4% 119M 2s 2024-09-12T18:53:03.762 INFO:teuthology.orchestra.run.smithi111.stderr: 3750K .......... .......... .......... .......... .......... 4% 129M 2s 2024-09-12T18:53:03.762 INFO:teuthology.orchestra.run.smithi111.stderr: 3800K .......... .......... .......... .......... .......... 4% 139M 2s 2024-09-12T18:53:03.762 INFO:teuthology.orchestra.run.smithi111.stderr: 3850K .......... .......... .......... .......... .......... 4% 138M 2s 2024-09-12T18:53:03.762 INFO:teuthology.orchestra.run.smithi111.stderr: 3900K .......... .......... .......... .......... .......... 4% 118M 2s 2024-09-12T18:53:03.762 INFO:teuthology.orchestra.run.smithi111.stderr: 3950K .......... .......... .......... .......... .......... 4% 142M 2s 2024-09-12T18:53:03.762 INFO:teuthology.orchestra.run.smithi111.stderr: 4000K .......... .......... .......... .......... .......... 4% 147M 2s 2024-09-12T18:53:03.762 INFO:teuthology.orchestra.run.smithi111.stderr: 4050K .......... .......... .......... .......... .......... 4% 145M 2s 2024-09-12T18:53:03.763 INFO:teuthology.orchestra.run.smithi111.stderr: 4100K .......... .......... .......... .......... .......... 4% 117M 2s 2024-09-12T18:53:03.763 INFO:teuthology.orchestra.run.smithi111.stderr: 4150K .......... .......... .......... .......... .......... 4% 146M 2s 2024-09-12T18:53:03.763 INFO:teuthology.orchestra.run.smithi111.stderr: 4200K .......... .......... .......... .......... .......... 4% 112M 2s 2024-09-12T18:53:03.763 INFO:teuthology.orchestra.run.smithi111.stderr: 4250K .......... .......... .......... .......... .......... 4% 145M 2s 2024-09-12T18:53:03.763 INFO:teuthology.orchestra.run.smithi111.stderr: 4300K .......... .......... .......... .......... .......... 4% 127M 2s 2024-09-12T18:53:03.763 INFO:teuthology.orchestra.run.smithi111.stderr: 4350K .......... .......... .......... .......... .......... 4% 144M 2s 2024-09-12T18:53:03.763 INFO:teuthology.orchestra.run.smithi111.stderr: 4400K .......... .......... .......... .......... .......... 4% 155M 2s 2024-09-12T18:53:03.763 INFO:teuthology.orchestra.run.smithi111.stderr: 4450K .......... .......... .......... .......... .......... 4% 154M 2s 2024-09-12T18:53:03.763 INFO:teuthology.orchestra.run.smithi111.stderr: 4500K .......... .......... .......... .......... .......... 4% 139M 2s 2024-09-12T18:53:03.763 INFO:teuthology.orchestra.run.smithi111.stderr: 4550K .......... .......... .......... .......... .......... 4% 151M 2s 2024-09-12T18:53:03.763 INFO:teuthology.orchestra.run.smithi111.stderr: 4600K .......... .......... .......... .......... .......... 5% 153M 2s 2024-09-12T18:53:03.763 INFO:teuthology.orchestra.run.smithi111.stderr: 4650K .......... .......... .......... .......... .......... 5% 147M 2s 2024-09-12T18:53:03.764 INFO:teuthology.orchestra.run.smithi111.stderr: 4700K .......... .......... .......... .......... .......... 5% 126M 2s 2024-09-12T18:53:03.764 INFO:teuthology.orchestra.run.smithi111.stderr: 4750K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-12T18:53:03.764 INFO:teuthology.orchestra.run.smithi111.stderr: 4800K .......... .......... .......... .......... .......... 5% 134M 2s 2024-09-12T18:53:03.764 INFO:teuthology.orchestra.run.smithi111.stderr: 4850K .......... .......... .......... .......... .......... 5% 121M 2s 2024-09-12T18:53:03.764 INFO:teuthology.orchestra.run.smithi111.stderr: 4900K .......... .......... .......... .......... .......... 5% 123M 2s 2024-09-12T18:53:03.764 INFO:teuthology.orchestra.run.smithi111.stderr: 4950K .......... .......... .......... .......... .......... 5% 159M 2s 2024-09-12T18:53:03.764 INFO:teuthology.orchestra.run.smithi111.stderr: 5000K .......... .......... .......... .......... .......... 5% 146M 2s 2024-09-12T18:53:03.764 INFO:teuthology.orchestra.run.smithi111.stderr: 5050K .......... .......... .......... .......... .......... 5% 153M 2s 2024-09-12T18:53:03.764 INFO:teuthology.orchestra.run.smithi111.stderr: 5100K .......... .......... .......... .......... .......... 5% 124M 2s 2024-09-12T18:53:03.764 INFO:teuthology.orchestra.run.smithi111.stderr: 5150K .......... .......... .......... .......... .......... 5% 136M 2s 2024-09-12T18:53:03.764 INFO:teuthology.orchestra.run.smithi111.stderr: 5200K .......... .......... .......... .......... .......... 5% 151M 2s 2024-09-12T18:53:03.764 INFO:teuthology.orchestra.run.smithi111.stderr: 5250K .......... .......... .......... .......... .......... 5% 161M 2s 2024-09-12T18:53:03.765 INFO:teuthology.orchestra.run.smithi111.stderr: 5300K .......... .......... .......... .......... .......... 5% 145M 2s 2024-09-12T18:53:03.765 INFO:teuthology.orchestra.run.smithi111.stderr: 5350K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-12T18:53:03.765 INFO:teuthology.orchestra.run.smithi111.stderr: 5400K .......... .......... .......... .......... .......... 5% 140M 2s 2024-09-12T18:53:03.765 INFO:teuthology.orchestra.run.smithi111.stderr: 5450K .......... .......... .......... .......... .......... 5% 164M 2s 2024-09-12T18:53:03.765 INFO:teuthology.orchestra.run.smithi111.stderr: 5500K .......... .......... .......... .......... .......... 5% 134M 2s 2024-09-12T18:53:03.765 INFO:teuthology.orchestra.run.smithi111.stderr: 5550K .......... .......... .......... .......... .......... 6% 170M 2s 2024-09-12T18:53:03.765 INFO:teuthology.orchestra.run.smithi111.stderr: 5600K .......... .......... .......... .......... .......... 6% 159M 2s 2024-09-12T18:53:03.765 INFO:teuthology.orchestra.run.smithi111.stderr: 5650K .......... .......... .......... .......... .......... 6% 151M 2s 2024-09-12T18:53:03.765 INFO:teuthology.orchestra.run.smithi111.stderr: 5700K .......... .......... .......... .......... .......... 6% 149M 2s 2024-09-12T18:53:03.765 INFO:teuthology.orchestra.run.smithi111.stderr: 5750K .......... .......... .......... .......... .......... 6% 156M 2s 2024-09-12T18:53:03.765 INFO:teuthology.orchestra.run.smithi111.stderr: 5800K .......... .......... .......... .......... .......... 6% 153M 2s 2024-09-12T18:53:03.766 INFO:teuthology.orchestra.run.smithi111.stderr: 5850K .......... .......... .......... .......... .......... 6% 161M 1s 2024-09-12T18:53:03.766 INFO:teuthology.orchestra.run.smithi111.stderr: 5900K .......... .......... .......... .......... .......... 6% 131M 1s 2024-09-12T18:53:03.766 INFO:teuthology.orchestra.run.smithi111.stderr: 5950K .......... .......... .......... .......... .......... 6% 169M 1s 2024-09-12T18:53:03.766 INFO:teuthology.orchestra.run.smithi111.stderr: 6000K .......... .......... .......... .......... .......... 6% 173M 1s 2024-09-12T18:53:03.766 INFO:teuthology.orchestra.run.smithi111.stderr: 6050K .......... .......... .......... .......... .......... 6% 167M 1s 2024-09-12T18:53:03.766 INFO:teuthology.orchestra.run.smithi111.stderr: 6100K .......... .......... .......... .......... .......... 6% 148M 1s 2024-09-12T18:53:03.766 INFO:teuthology.orchestra.run.smithi111.stderr: 6150K .......... .......... .......... .......... .......... 6% 195M 1s 2024-09-12T18:53:03.766 INFO:teuthology.orchestra.run.smithi111.stderr: 6200K .......... .......... .......... .......... .......... 6% 193M 1s 2024-09-12T18:53:03.766 INFO:teuthology.orchestra.run.smithi111.stderr: 6250K .......... .......... .......... .......... .......... 6% 191M 1s 2024-09-12T18:53:03.766 INFO:teuthology.orchestra.run.smithi111.stderr: 6300K .......... .......... .......... .......... .......... 6% 165M 1s 2024-09-12T18:53:03.766 INFO:teuthology.orchestra.run.smithi111.stderr: 6350K .......... .......... .......... .......... .......... 6% 199M 1s 2024-09-12T18:53:03.766 INFO:teuthology.orchestra.run.smithi111.stderr: 6400K .......... .......... .......... .......... .......... 6% 191M 1s 2024-09-12T18:53:03.767 INFO:teuthology.orchestra.run.smithi111.stderr: 6450K .......... .......... .......... .......... .......... 6% 198M 1s 2024-09-12T18:53:03.767 INFO:teuthology.orchestra.run.smithi111.stderr: 6500K .......... .......... .......... .......... .......... 7% 177M 1s 2024-09-12T18:53:03.767 INFO:teuthology.orchestra.run.smithi111.stderr: 6550K .......... .......... .......... .......... .......... 7% 162M 1s 2024-09-12T18:53:03.767 INFO:teuthology.orchestra.run.smithi111.stderr: 6600K .......... .......... .......... .......... .......... 7% 169M 1s 2024-09-12T18:53:03.767 INFO:teuthology.orchestra.run.smithi111.stderr: 6650K .......... .......... .......... .......... .......... 7% 174M 1s 2024-09-12T18:53:03.767 INFO:teuthology.orchestra.run.smithi111.stderr: 6700K .......... .......... .......... .......... .......... 7% 144M 1s 2024-09-12T18:53:03.767 INFO:teuthology.orchestra.run.smithi111.stderr: 6750K .......... .......... .......... .......... .......... 7% 156M 1s 2024-09-12T18:53:03.767 INFO:teuthology.orchestra.run.smithi111.stderr: 6800K .......... .......... .......... .......... .......... 7% 176M 1s 2024-09-12T18:53:03.767 INFO:teuthology.orchestra.run.smithi111.stderr: 6850K .......... .......... .......... .......... .......... 7% 196M 1s 2024-09-12T18:53:03.767 INFO:teuthology.orchestra.run.smithi111.stderr: 6900K .......... .......... .......... .......... .......... 7% 165M 1s 2024-09-12T18:53:03.767 INFO:teuthology.orchestra.run.smithi111.stderr: 6950K .......... .......... .......... .......... .......... 7% 203M 1s 2024-09-12T18:53:03.767 INFO:teuthology.orchestra.run.smithi111.stderr: 7000K .......... .......... .......... .......... .......... 7% 185M 1s 2024-09-12T18:53:03.768 INFO:teuthology.orchestra.run.smithi111.stderr: 7050K .......... .......... .......... .......... .......... 7% 200M 1s 2024-09-12T18:53:03.768 INFO:teuthology.orchestra.run.smithi111.stderr: 7100K .......... .......... .......... .......... .......... 7% 155M 1s 2024-09-12T18:53:03.768 INFO:teuthology.orchestra.run.smithi111.stderr: 7150K .......... .......... .......... .......... .......... 7% 194M 1s 2024-09-12T18:53:03.768 INFO:teuthology.orchestra.run.smithi111.stderr: 7200K .......... .......... .......... .......... .......... 7% 199M 1s 2024-09-12T18:53:03.768 INFO:teuthology.orchestra.run.smithi111.stderr: 7250K .......... .......... .......... .......... .......... 7% 194M 1s 2024-09-12T18:53:03.768 INFO:teuthology.orchestra.run.smithi111.stderr: 7300K .......... .......... .......... .......... .......... 7% 179M 1s 2024-09-12T18:53:03.768 INFO:teuthology.orchestra.run.smithi111.stderr: 7350K .......... .......... .......... .......... .......... 7% 193M 1s 2024-09-12T18:53:03.768 INFO:teuthology.orchestra.run.smithi111.stderr: 7400K .......... .......... .......... .......... .......... 8% 202M 1s 2024-09-12T18:53:03.768 INFO:teuthology.orchestra.run.smithi111.stderr: 7450K .......... .......... .......... .......... .......... 8% 207M 1s 2024-09-12T18:53:03.768 INFO:teuthology.orchestra.run.smithi111.stderr: 7500K .......... .......... .......... .......... .......... 8% 155M 1s 2024-09-12T18:53:03.768 INFO:teuthology.orchestra.run.smithi111.stderr: 7550K .......... .......... .......... .......... .......... 8% 193M 1s 2024-09-12T18:53:03.769 INFO:teuthology.orchestra.run.smithi111.stderr: 7600K .......... .......... .......... .......... .......... 8% 199M 1s 2024-09-12T18:53:03.769 INFO:teuthology.orchestra.run.smithi111.stderr: 7650K .......... .......... .......... .......... .......... 8% 195M 1s 2024-09-12T18:53:03.769 INFO:teuthology.orchestra.run.smithi111.stderr: 7700K .......... .......... .......... .......... .......... 8% 185M 1s 2024-09-12T18:53:03.769 INFO:teuthology.orchestra.run.smithi111.stderr: 7750K .......... .......... .......... .......... .......... 8% 206M 1s 2024-09-12T18:53:03.769 INFO:teuthology.orchestra.run.smithi111.stderr: 7800K .......... .......... .......... .......... .......... 8% 217M 1s 2024-09-12T18:53:03.769 INFO:teuthology.orchestra.run.smithi111.stderr: 7850K .......... .......... .......... .......... .......... 8% 212M 1s 2024-09-12T18:53:03.769 INFO:teuthology.orchestra.run.smithi111.stderr: 7900K .......... .......... .......... .......... .......... 8% 155M 1s 2024-09-12T18:53:03.769 INFO:teuthology.orchestra.run.smithi111.stderr: 7950K .......... .......... .......... .......... .......... 8% 214M 1s 2024-09-12T18:53:03.769 INFO:teuthology.orchestra.run.smithi111.stderr: 8000K .......... .......... .......... .......... .......... 8% 196M 1s 2024-09-12T18:53:03.769 INFO:teuthology.orchestra.run.smithi111.stderr: 8050K .......... .......... .......... .......... .......... 8% 210M 1s 2024-09-12T18:53:03.769 INFO:teuthology.orchestra.run.smithi111.stderr: 8100K .......... .......... .......... .......... .......... 8% 179M 1s 2024-09-12T18:53:03.769 INFO:teuthology.orchestra.run.smithi111.stderr: 8150K .......... .......... .......... .......... .......... 8% 199M 1s 2024-09-12T18:53:03.770 INFO:teuthology.orchestra.run.smithi111.stderr: 8200K .......... .......... .......... .......... .......... 8% 208M 1s 2024-09-12T18:53:03.770 INFO:teuthology.orchestra.run.smithi111.stderr: 8250K .......... .......... .......... .......... .......... 8% 222M 1s 2024-09-12T18:53:03.770 INFO:teuthology.orchestra.run.smithi111.stderr: 8300K .......... .......... .......... .......... .......... 8% 145M 1s 2024-09-12T18:53:03.770 INFO:teuthology.orchestra.run.smithi111.stderr: 8350K .......... .......... .......... .......... .......... 9% 221M 1s 2024-09-12T18:53:03.770 INFO:teuthology.orchestra.run.smithi111.stderr: 8400K .......... .......... .......... .......... .......... 9% 194M 1s 2024-09-12T18:53:03.770 INFO:teuthology.orchestra.run.smithi111.stderr: 8450K .......... .......... .......... .......... .......... 9% 227M 1s 2024-09-12T18:53:03.770 INFO:teuthology.orchestra.run.smithi111.stderr: 8500K .......... .......... .......... .......... .......... 9% 200M 1s 2024-09-12T18:53:03.770 INFO:teuthology.orchestra.run.smithi111.stderr: 8550K .......... .......... .......... .......... .......... 9% 230M 1s 2024-09-12T18:53:03.770 INFO:teuthology.orchestra.run.smithi111.stderr: 8600K .......... .......... .......... .......... .......... 9% 227M 1s 2024-09-12T18:53:03.770 INFO:teuthology.orchestra.run.smithi111.stderr: 8650K .......... .......... .......... .......... .......... 9% 200M 1s 2024-09-12T18:53:03.770 INFO:teuthology.orchestra.run.smithi111.stderr: 8700K .......... .......... .......... .......... .......... 9% 190M 1s 2024-09-12T18:53:03.771 INFO:teuthology.orchestra.run.smithi111.stderr: 8750K .......... .......... .......... .......... .......... 9% 225M 1s 2024-09-12T18:53:03.771 INFO:teuthology.orchestra.run.smithi111.stderr: 8800K .......... .......... .......... .......... .......... 9% 231M 1s 2024-09-12T18:53:03.771 INFO:teuthology.orchestra.run.smithi111.stderr: 8850K .......... .......... .......... .......... .......... 9% 214M 1s 2024-09-12T18:53:03.771 INFO:teuthology.orchestra.run.smithi111.stderr: 8900K .......... .......... .......... .......... .......... 9% 186M 1s 2024-09-12T18:53:03.771 INFO:teuthology.orchestra.run.smithi111.stderr: 8950K .......... .......... .......... .......... .......... 9% 216M 1s 2024-09-12T18:53:03.771 INFO:teuthology.orchestra.run.smithi111.stderr: 9000K .......... .......... .......... .......... .......... 9% 200M 1s 2024-09-12T18:53:03.771 INFO:teuthology.orchestra.run.smithi111.stderr: 9050K .......... .......... .......... .......... .......... 9% 197M 1s 2024-09-12T18:53:03.771 INFO:teuthology.orchestra.run.smithi111.stderr: 9100K .......... .......... .......... .......... .......... 9% 167M 1s 2024-09-12T18:53:03.771 INFO:teuthology.orchestra.run.smithi111.stderr: 9150K .......... .......... .......... .......... .......... 9% 204M 1s 2024-09-12T18:53:03.771 INFO:teuthology.orchestra.run.smithi111.stderr: 9200K .......... .......... .......... .......... .......... 9% 216M 1s 2024-09-12T18:53:03.771 INFO:teuthology.orchestra.run.smithi111.stderr: 9250K .......... .......... .......... .......... .......... 10% 208M 1s 2024-09-12T18:53:03.772 INFO:teuthology.orchestra.run.smithi111.stderr: 9300K .......... .......... .......... .......... .......... 10% 196M 1s 2024-09-12T18:53:03.772 INFO:teuthology.orchestra.run.smithi111.stderr: 9350K .......... .......... .......... .......... .......... 10% 205M 1s 2024-09-12T18:53:03.772 INFO:teuthology.orchestra.run.smithi111.stderr: 9400K .......... .......... .......... .......... .......... 10% 223M 1s 2024-09-12T18:53:03.772 INFO:teuthology.orchestra.run.smithi111.stderr: 9450K .......... .......... .......... .......... .......... 10% 234M 1s 2024-09-12T18:53:03.772 INFO:teuthology.orchestra.run.smithi111.stderr: 9500K .......... .......... .......... .......... .......... 10% 177M 1s 2024-09-12T18:53:03.772 INFO:teuthology.orchestra.run.smithi111.stderr: 9550K .......... .......... .......... .......... .......... 10% 226M 1s 2024-09-12T18:53:03.772 INFO:teuthology.orchestra.run.smithi111.stderr: 9600K .......... .......... .......... .......... .......... 10% 214M 1s 2024-09-12T18:53:03.772 INFO:teuthology.orchestra.run.smithi111.stderr: 9650K .......... .......... .......... .......... .......... 10% 236M 1s 2024-09-12T18:53:03.772 INFO:teuthology.orchestra.run.smithi111.stderr: 9700K .......... .......... .......... .......... .......... 10% 211M 1s 2024-09-12T18:53:03.772 INFO:teuthology.orchestra.run.smithi111.stderr: 9750K .......... .......... .......... .......... .......... 10% 220M 1s 2024-09-12T18:53:03.772 INFO:teuthology.orchestra.run.smithi111.stderr: 9800K .......... .......... .......... .......... .......... 10% 232M 1s 2024-09-12T18:53:03.772 INFO:teuthology.orchestra.run.smithi111.stderr: 9850K .......... .......... .......... .......... .......... 10% 225M 1s 2024-09-12T18:53:03.773 INFO:teuthology.orchestra.run.smithi111.stderr: 9900K .......... .......... .......... .......... .......... 10% 190M 1s 2024-09-12T18:53:03.773 INFO:teuthology.orchestra.run.smithi111.stderr: 9950K .......... .......... .......... .......... .......... 10% 219M 1s 2024-09-12T18:53:03.773 INFO:teuthology.orchestra.run.smithi111.stderr: 10000K .......... .......... .......... .......... .......... 10% 215M 1s 2024-09-12T18:53:03.773 INFO:teuthology.orchestra.run.smithi111.stderr: 10050K .......... .......... .......... .......... .......... 10% 215M 1s 2024-09-12T18:53:03.773 INFO:teuthology.orchestra.run.smithi111.stderr: 10100K .......... .......... .......... .......... .......... 10% 201M 1s 2024-09-12T18:53:03.773 INFO:teuthology.orchestra.run.smithi111.stderr: 10150K .......... .......... .......... .......... .......... 10% 250M 1s 2024-09-12T18:53:03.773 INFO:teuthology.orchestra.run.smithi111.stderr: 10200K .......... .......... .......... .......... .......... 11% 226M 1s 2024-09-12T18:53:03.773 INFO:teuthology.orchestra.run.smithi111.stderr: 10250K .......... .......... .......... .......... .......... 11% 271M 1s 2024-09-12T18:53:03.773 INFO:teuthology.orchestra.run.smithi111.stderr: 10300K .......... .......... .......... .......... .......... 11% 233M 1s 2024-09-12T18:53:03.773 INFO:teuthology.orchestra.run.smithi111.stderr: 10350K .......... .......... .......... .......... .......... 11% 204M 1s 2024-09-12T18:53:03.773 INFO:teuthology.orchestra.run.smithi111.stderr: 10400K .......... .......... .......... .......... .......... 11% 250M 1s 2024-09-12T18:53:03.773 INFO:teuthology.orchestra.run.smithi111.stderr: 10450K .......... .......... .......... .......... .......... 11% 240M 1s 2024-09-12T18:53:03.774 INFO:teuthology.orchestra.run.smithi111.stderr: 10500K .......... .......... .......... .......... .......... 11% 230M 1s 2024-09-12T18:53:03.774 INFO:teuthology.orchestra.run.smithi111.stderr: 10550K .......... .......... .......... .......... .......... 11% 204M 1s 2024-09-12T18:53:03.774 INFO:teuthology.orchestra.run.smithi111.stderr: 10600K .......... .......... .......... .......... .......... 11% 250M 1s 2024-09-12T18:53:03.774 INFO:teuthology.orchestra.run.smithi111.stderr: 10650K .......... .......... .......... .......... .......... 11% 254M 1s 2024-09-12T18:53:03.774 INFO:teuthology.orchestra.run.smithi111.stderr: 10700K .......... .......... .......... .......... .......... 11% 237M 1s 2024-09-12T18:53:03.774 INFO:teuthology.orchestra.run.smithi111.stderr: 10750K .......... .......... .......... .......... .......... 11% 198M 1s 2024-09-12T18:53:03.774 INFO:teuthology.orchestra.run.smithi111.stderr: 10800K .......... .......... .......... .......... .......... 11% 235M 1s 2024-09-12T18:53:03.774 INFO:teuthology.orchestra.run.smithi111.stderr: 10850K .......... .......... .......... .......... .......... 11% 246M 1s 2024-09-12T18:53:03.774 INFO:teuthology.orchestra.run.smithi111.stderr: 10900K .......... .......... .......... .......... .......... 11% 266M 1s 2024-09-12T18:53:03.774 INFO:teuthology.orchestra.run.smithi111.stderr: 10950K .......... .......... .......... .......... .......... 11% 216M 1s 2024-09-12T18:53:03.774 INFO:teuthology.orchestra.run.smithi111.stderr: 11000K .......... .......... .......... .......... .......... 11% 258M 1s 2024-09-12T18:53:03.774 INFO:teuthology.orchestra.run.smithi111.stderr: 11050K .......... .......... .......... .......... .......... 11% 225M 1s 2024-09-12T18:53:03.774 INFO:teuthology.orchestra.run.smithi111.stderr: 11100K .......... .......... .......... .......... .......... 12% 269M 1s 2024-09-12T18:53:03.775 INFO:teuthology.orchestra.run.smithi111.stderr: 11150K .......... .......... .......... .......... .......... 12% 219M 1s 2024-09-12T18:53:03.775 INFO:teuthology.orchestra.run.smithi111.stderr: 11200K .......... .......... .......... .......... .......... 12% 276M 1s 2024-09-12T18:53:03.775 INFO:teuthology.orchestra.run.smithi111.stderr: 11250K .......... .......... .......... .......... .......... 12% 268M 1s 2024-09-12T18:53:03.775 INFO:teuthology.orchestra.run.smithi111.stderr: 11300K .......... .......... .......... .......... .......... 12% 264M 1s 2024-09-12T18:53:03.775 INFO:teuthology.orchestra.run.smithi111.stderr: 11350K .......... .......... .......... .......... .......... 12% 233M 1s 2024-09-12T18:53:03.775 INFO:teuthology.orchestra.run.smithi111.stderr: 11400K .......... .......... .......... .......... .......... 12% 274M 1s 2024-09-12T18:53:03.775 INFO:teuthology.orchestra.run.smithi111.stderr: 11450K .......... .......... .......... .......... .......... 12% 275M 1s 2024-09-12T18:53:03.775 INFO:teuthology.orchestra.run.smithi111.stderr: 11500K .......... .......... .......... .......... .......... 12% 243M 1s 2024-09-12T18:53:03.775 INFO:teuthology.orchestra.run.smithi111.stderr: 11550K .......... .......... .......... .......... .......... 12% 44.4M 1s 2024-09-12T18:53:03.775 INFO:teuthology.orchestra.run.smithi111.stderr: 11600K .......... .......... .......... .......... .......... 12% 232M 1s 2024-09-12T18:53:03.775 INFO:teuthology.orchestra.run.smithi111.stderr: 11650K .......... .......... .......... .......... .......... 12% 245M 1s 2024-09-12T18:53:03.776 INFO:teuthology.orchestra.run.smithi111.stderr: 11700K .......... .......... .......... .......... .......... 12% 244M 1s 2024-09-12T18:53:03.776 INFO:teuthology.orchestra.run.smithi111.stderr: 11750K .......... .......... .......... .......... .......... 12% 191M 1s 2024-09-12T18:53:03.776 INFO:teuthology.orchestra.run.smithi111.stderr: 11800K .......... .......... .......... .......... .......... 12% 236M 1s 2024-09-12T18:53:03.776 INFO:teuthology.orchestra.run.smithi111.stderr: 11850K .......... .......... .......... .......... .......... 12% 197M 1s 2024-09-12T18:53:03.776 INFO:teuthology.orchestra.run.smithi111.stderr: 11900K .......... .......... .......... .......... .......... 12% 228M 1s 2024-09-12T18:53:03.776 INFO:teuthology.orchestra.run.smithi111.stderr: 11950K .......... .......... .......... .......... .......... 12% 206M 1s 2024-09-12T18:53:03.776 INFO:teuthology.orchestra.run.smithi111.stderr: 12000K .......... .......... .......... .......... .......... 12% 208M 1s 2024-09-12T18:53:03.776 INFO:teuthology.orchestra.run.smithi111.stderr: 12050K .......... .......... .......... .......... .......... 13% 189M 1s 2024-09-12T18:53:03.776 INFO:teuthology.orchestra.run.smithi111.stderr: 12100K .......... .......... .......... .......... .......... 13% 230M 1s 2024-09-12T18:53:03.776 INFO:teuthology.orchestra.run.smithi111.stderr: 12150K .......... .......... .......... .......... .......... 13% 206M 1s 2024-09-12T18:53:03.776 INFO:teuthology.orchestra.run.smithi111.stderr: 12200K .......... .......... .......... .......... .......... 13% 252M 1s 2024-09-12T18:53:03.777 INFO:teuthology.orchestra.run.smithi111.stderr: 12250K .......... .......... .......... .......... .......... 13% 214M 1s 2024-09-12T18:53:03.777 INFO:teuthology.orchestra.run.smithi111.stderr: 12300K .......... .......... .......... .......... .......... 13% 252M 1s 2024-09-12T18:53:03.777 INFO:teuthology.orchestra.run.smithi111.stderr: 12350K .......... .......... .......... .......... .......... 13% 177M 1s 2024-09-12T18:53:03.777 INFO:teuthology.orchestra.run.smithi111.stderr: 12400K .......... .......... .......... .......... .......... 13% 204M 1s 2024-09-12T18:53:03.777 INFO:teuthology.orchestra.run.smithi111.stderr: 12450K .......... .......... .......... .......... .......... 13% 245M 1s 2024-09-12T18:53:03.777 INFO:teuthology.orchestra.run.smithi111.stderr: 12500K .......... .......... .......... .......... .......... 13% 202M 1s 2024-09-12T18:53:03.777 INFO:teuthology.orchestra.run.smithi111.stderr: 12550K .......... .......... .......... .......... .......... 13% 214M 1s 2024-09-12T18:53:03.777 INFO:teuthology.orchestra.run.smithi111.stderr: 12600K .......... .......... .......... .......... .......... 13% 254M 1s 2024-09-12T18:53:03.777 INFO:teuthology.orchestra.run.smithi111.stderr: 12650K .......... .......... .......... .......... .......... 13% 240M 1s 2024-09-12T18:53:03.777 INFO:teuthology.orchestra.run.smithi111.stderr: 12700K .......... .......... .......... .......... .......... 13% 229M 1s 2024-09-12T18:53:03.777 INFO:teuthology.orchestra.run.smithi111.stderr: 12750K .......... .......... .......... .......... .......... 13% 194M 1s 2024-09-12T18:53:03.777 INFO:teuthology.orchestra.run.smithi111.stderr: 12800K .......... .......... .......... .......... .......... 13% 246M 1s 2024-09-12T18:53:03.778 INFO:teuthology.orchestra.run.smithi111.stderr: 12850K .......... .......... .......... .......... .......... 13% 258M 1s 2024-09-12T18:53:03.778 INFO:teuthology.orchestra.run.smithi111.stderr: 12900K .......... .......... .......... .......... .......... 13% 237M 1s 2024-09-12T18:53:03.778 INFO:teuthology.orchestra.run.smithi111.stderr: 12950K .......... .......... .......... .......... .......... 13% 200M 1s 2024-09-12T18:53:03.778 INFO:teuthology.orchestra.run.smithi111.stderr: 13000K .......... .......... .......... .......... .......... 14% 229M 1s 2024-09-12T18:53:03.778 INFO:teuthology.orchestra.run.smithi111.stderr: 13050K .......... .......... .......... .......... .......... 14% 227M 1s 2024-09-12T18:53:03.778 INFO:teuthology.orchestra.run.smithi111.stderr: 13100K .......... .......... .......... .......... .......... 14% 226M 1s 2024-09-12T18:53:03.778 INFO:teuthology.orchestra.run.smithi111.stderr: 13150K .......... .......... .......... .......... .......... 14% 214M 1s 2024-09-12T18:53:03.778 INFO:teuthology.orchestra.run.smithi111.stderr: 13200K .......... .......... .......... .......... .......... 14% 256M 1s 2024-09-12T18:53:03.778 INFO:teuthology.orchestra.run.smithi111.stderr: 13250K .......... .......... .......... .......... .......... 14% 234M 1s 2024-09-12T18:53:03.778 INFO:teuthology.orchestra.run.smithi111.stderr: 13300K .......... .......... .......... .......... .......... 14% 233M 1s 2024-09-12T18:53:03.778 INFO:teuthology.orchestra.run.smithi111.stderr: 13350K .......... .......... .......... .......... .......... 14% 210M 1s 2024-09-12T18:53:03.778 INFO:teuthology.orchestra.run.smithi111.stderr: 13400K .......... .......... .......... .......... .......... 14% 248M 1s 2024-09-12T18:53:03.778 INFO:teuthology.orchestra.run.smithi111.stderr: 13450K .......... .......... .......... .......... .......... 14% 241M 1s 2024-09-12T18:53:03.779 INFO:teuthology.orchestra.run.smithi111.stderr: 13500K .......... .......... .......... .......... .......... 14% 256M 1s 2024-09-12T18:53:03.779 INFO:teuthology.orchestra.run.smithi111.stderr: 13550K .......... .......... .......... .......... .......... 14% 195M 1s 2024-09-12T18:53:03.779 INFO:teuthology.orchestra.run.smithi111.stderr: 13600K .......... .......... .......... .......... .......... 14% 246M 1s 2024-09-12T18:53:03.779 INFO:teuthology.orchestra.run.smithi111.stderr: 13650K .......... .......... .......... .......... .......... 14% 245M 1s 2024-09-12T18:53:03.779 INFO:teuthology.orchestra.run.smithi111.stderr: 13700K .......... .......... .......... .......... .......... 14% 250M 1s 2024-09-12T18:53:03.779 INFO:teuthology.orchestra.run.smithi111.stderr: 13750K .......... .......... .......... .......... .......... 14% 203M 1s 2024-09-12T18:53:03.779 INFO:teuthology.orchestra.run.smithi111.stderr: 13800K .......... .......... .......... .......... .......... 14% 251M 1s 2024-09-12T18:53:03.779 INFO:teuthology.orchestra.run.smithi111.stderr: 13850K .......... .......... .......... .......... .......... 14% 264M 1s 2024-09-12T18:53:03.779 INFO:teuthology.orchestra.run.smithi111.stderr: 13900K .......... .......... .......... .......... .......... 15% 252M 1s 2024-09-12T18:53:03.779 INFO:teuthology.orchestra.run.smithi111.stderr: 13950K .......... .......... .......... .......... .......... 15% 210M 1s 2024-09-12T18:53:03.779 INFO:teuthology.orchestra.run.smithi111.stderr: 14000K .......... .......... .......... .......... .......... 15% 47.1M 1s 2024-09-12T18:53:03.779 INFO:teuthology.orchestra.run.smithi111.stderr: 14050K .......... .......... .......... .......... .......... 15% 171M 1s 2024-09-12T18:53:03.780 INFO:teuthology.orchestra.run.smithi111.stderr: 14100K .......... .......... .......... .......... .......... 15% 186M 1s 2024-09-12T18:53:03.780 INFO:teuthology.orchestra.run.smithi111.stderr: 14150K .......... .......... .......... .......... .......... 15% 185M 1s 2024-09-12T18:53:03.780 INFO:teuthology.orchestra.run.smithi111.stderr: 14200K .......... .......... .......... .......... .......... 15% 204M 1s 2024-09-12T18:53:03.780 INFO:teuthology.orchestra.run.smithi111.stderr: 14250K .......... .......... .......... .......... .......... 15% 194M 1s 2024-09-12T18:53:03.780 INFO:teuthology.orchestra.run.smithi111.stderr: 14300K .......... .......... .......... .......... .......... 15% 191M 1s 2024-09-12T18:53:03.780 INFO:teuthology.orchestra.run.smithi111.stderr: 14350K .......... .......... .......... .......... .......... 15% 188M 1s 2024-09-12T18:53:03.780 INFO:teuthology.orchestra.run.smithi111.stderr: 14400K .......... .......... .......... .......... .......... 15% 211M 1s 2024-09-12T18:53:03.780 INFO:teuthology.orchestra.run.smithi111.stderr: 14450K .......... .......... .......... .......... .......... 15% 223M 1s 2024-09-12T18:53:03.780 INFO:teuthology.orchestra.run.smithi111.stderr: 14500K .......... .......... .......... .......... .......... 15% 208M 1s 2024-09-12T18:53:03.780 INFO:teuthology.orchestra.run.smithi111.stderr: 14550K .......... .......... .......... .......... .......... 15% 203M 1s 2024-09-12T18:53:03.780 INFO:teuthology.orchestra.run.smithi111.stderr: 14600K .......... .......... .......... .......... .......... 15% 235M 1s 2024-09-12T18:53:03.781 INFO:teuthology.orchestra.run.smithi111.stderr: 14650K .......... .......... .......... .......... .......... 15% 231M 1s 2024-09-12T18:53:03.781 INFO:teuthology.orchestra.run.smithi111.stderr: 14700K .......... .......... .......... .......... .......... 15% 198M 1s 2024-09-12T18:53:03.781 INFO:teuthology.orchestra.run.smithi111.stderr: 14750K .......... .......... .......... .......... .......... 15% 176M 1s 2024-09-12T18:53:03.781 INFO:teuthology.orchestra.run.smithi111.stderr: 14800K .......... .......... .......... .......... .......... 15% 213M 1s 2024-09-12T18:53:03.781 INFO:teuthology.orchestra.run.smithi111.stderr: 14850K .......... .......... .......... .......... .......... 16% 216M 1s 2024-09-12T18:53:03.781 INFO:teuthology.orchestra.run.smithi111.stderr: 14900K .......... .......... .......... .......... .......... 16% 214M 1s 2024-09-12T18:53:03.781 INFO:teuthology.orchestra.run.smithi111.stderr: 14950K .......... .......... .......... .......... .......... 16% 189M 1s 2024-09-12T18:53:03.781 INFO:teuthology.orchestra.run.smithi111.stderr: 15000K .......... .......... .......... .......... .......... 16% 230M 1s 2024-09-12T18:53:03.781 INFO:teuthology.orchestra.run.smithi111.stderr: 15050K .......... .......... .......... .......... .......... 16% 208M 1s 2024-09-12T18:53:03.781 INFO:teuthology.orchestra.run.smithi111.stderr: 15100K .......... .......... .......... .......... .......... 16% 182M 1s 2024-09-12T18:53:03.781 INFO:teuthology.orchestra.run.smithi111.stderr: 15150K .......... .......... .......... .......... .......... 16% 159M 1s 2024-09-12T18:53:03.781 INFO:teuthology.orchestra.run.smithi111.stderr: 15200K .......... .......... .......... .......... .......... 16% 199M 1s 2024-09-12T18:53:03.781 INFO:teuthology.orchestra.run.smithi111.stderr: 15250K .......... .......... .......... .......... .......... 16% 198M 1s 2024-09-12T18:53:03.782 INFO:teuthology.orchestra.run.smithi111.stderr: 15300K .......... .......... .......... .......... .......... 16% 195M 1s 2024-09-12T18:53:03.782 INFO:teuthology.orchestra.run.smithi111.stderr: 15350K .......... .......... .......... .......... .......... 16% 173M 1s 2024-09-12T18:53:03.782 INFO:teuthology.orchestra.run.smithi111.stderr: 15400K .......... .......... .......... .......... .......... 16% 189M 1s 2024-09-12T18:53:03.782 INFO:teuthology.orchestra.run.smithi111.stderr: 15450K .......... .......... .......... .......... .......... 16% 203M 1s 2024-09-12T18:53:03.782 INFO:teuthology.orchestra.run.smithi111.stderr: 15500K .......... .......... .......... .......... .......... 16% 212M 1s 2024-09-12T18:53:03.782 INFO:teuthology.orchestra.run.smithi111.stderr: 15550K .......... .......... .......... .......... .......... 16% 152M 1s 2024-09-12T18:53:03.782 INFO:teuthology.orchestra.run.smithi111.stderr: 15600K .......... .......... .......... .......... .......... 16% 204M 1s 2024-09-12T18:53:03.782 INFO:teuthology.orchestra.run.smithi111.stderr: 15650K .......... .......... .......... .......... .......... 16% 210M 1s 2024-09-12T18:53:03.782 INFO:teuthology.orchestra.run.smithi111.stderr: 15700K .......... .......... .......... .......... .......... 16% 190M 1s 2024-09-12T18:53:03.782 INFO:teuthology.orchestra.run.smithi111.stderr: 15750K .......... .......... .......... .......... .......... 17% 186M 1s 2024-09-12T18:53:03.782 INFO:teuthology.orchestra.run.smithi111.stderr: 15800K .......... .......... .......... .......... .......... 17% 189M 1s 2024-09-12T18:53:03.783 INFO:teuthology.orchestra.run.smithi111.stderr: 15850K .......... .......... .......... .......... .......... 17% 39.5M 1s 2024-09-12T18:53:03.783 INFO:teuthology.orchestra.run.smithi111.stderr: 15900K .......... .......... .......... .......... .......... 17% 175M 1s 2024-09-12T18:53:03.783 INFO:teuthology.orchestra.run.smithi111.stderr: 15950K .......... .......... .......... .......... .......... 17% 126M 1s 2024-09-12T18:53:03.783 INFO:teuthology.orchestra.run.smithi111.stderr: 16000K .......... .......... .......... .......... .......... 17% 181M 1s 2024-09-12T18:53:03.783 INFO:teuthology.orchestra.run.smithi111.stderr: 16050K .......... .......... .......... .......... .......... 17% 189M 1s 2024-09-12T18:53:03.783 INFO:teuthology.orchestra.run.smithi111.stderr: 16100K .......... .......... .......... .......... .......... 17% 176M 1s 2024-09-12T18:53:03.783 INFO:teuthology.orchestra.run.smithi111.stderr: 16150K .......... .......... .......... .......... .......... 17% 162M 1s 2024-09-12T18:53:03.783 INFO:teuthology.orchestra.run.smithi111.stderr: 16200K .......... .......... .......... .......... .......... 17% 181M 1s 2024-09-12T18:53:03.783 INFO:teuthology.orchestra.run.smithi111.stderr: 16250K .......... .......... .......... .......... .......... 17% 173M 1s 2024-09-12T18:53:03.783 INFO:teuthology.orchestra.run.smithi111.stderr: 16300K .......... .......... .......... .......... .......... 17% 186M 1s 2024-09-12T18:53:03.783 INFO:teuthology.orchestra.run.smithi111.stderr: 16350K .......... .......... .......... .......... .......... 17% 170M 1s 2024-09-12T18:53:03.783 INFO:teuthology.orchestra.run.smithi111.stderr: 16400K .......... .......... .......... .......... .......... 17% 160M 1s 2024-09-12T18:53:03.784 INFO:teuthology.orchestra.run.smithi111.stderr: 16450K .......... .......... .......... .......... .......... 17% 194M 1s 2024-09-12T18:53:03.784 INFO:teuthology.orchestra.run.smithi111.stderr: 16500K .......... .......... .......... .......... .......... 17% 145M 1s 2024-09-12T18:53:03.784 INFO:teuthology.orchestra.run.smithi111.stderr: 16550K .......... .......... .......... .......... .......... 17% 153M 1s 2024-09-12T18:53:03.784 INFO:teuthology.orchestra.run.smithi111.stderr: 16600K .......... .......... .......... .......... .......... 17% 185M 1s 2024-09-12T18:53:03.784 INFO:teuthology.orchestra.run.smithi111.stderr: 16650K .......... .......... .......... .......... .......... 17% 166M 1s 2024-09-12T18:53:03.784 INFO:teuthology.orchestra.run.smithi111.stderr: 16700K .......... .......... .......... .......... .......... 18% 174M 1s 2024-09-12T18:53:03.784 INFO:teuthology.orchestra.run.smithi111.stderr: 16750K .......... .......... .......... .......... .......... 18% 151M 1s 2024-09-12T18:53:03.784 INFO:teuthology.orchestra.run.smithi111.stderr: 16800K .......... .......... .......... .......... .......... 18% 169M 1s 2024-09-12T18:53:03.784 INFO:teuthology.orchestra.run.smithi111.stderr: 16850K .......... .......... .......... .......... .......... 18% 193M 1s 2024-09-12T18:53:03.784 INFO:teuthology.orchestra.run.smithi111.stderr: 16900K .......... .......... .......... .......... .......... 18% 188M 1s 2024-09-12T18:53:03.784 INFO:teuthology.orchestra.run.smithi111.stderr: 16950K .......... .......... .......... .......... .......... 18% 170M 1s 2024-09-12T18:53:03.785 INFO:teuthology.orchestra.run.smithi111.stderr: 17000K .......... .......... .......... .......... .......... 18% 180M 1s 2024-09-12T18:53:03.785 INFO:teuthology.orchestra.run.smithi111.stderr: 17050K .......... .......... .......... .......... .......... 18% 174M 1s 2024-09-12T18:53:03.785 INFO:teuthology.orchestra.run.smithi111.stderr: 17100K .......... .......... .......... .......... .......... 18% 177M 1s 2024-09-12T18:53:03.785 INFO:teuthology.orchestra.run.smithi111.stderr: 17150K .......... .......... .......... .......... .......... 18% 144M 1s 2024-09-12T18:53:03.785 INFO:teuthology.orchestra.run.smithi111.stderr: 17200K .......... .......... .......... .......... .......... 18% 191M 1s 2024-09-12T18:53:03.785 INFO:teuthology.orchestra.run.smithi111.stderr: 17250K .......... .......... .......... .......... .......... 18% 196M 1s 2024-09-12T18:53:03.785 INFO:teuthology.orchestra.run.smithi111.stderr: 17300K .......... .......... .......... .......... .......... 18% 191M 1s 2024-09-12T18:53:03.785 INFO:teuthology.orchestra.run.smithi111.stderr: 17350K .......... .......... .......... .......... .......... 18% 191M 1s 2024-09-12T18:53:03.785 INFO:teuthology.orchestra.run.smithi111.stderr: 17400K .......... .......... .......... .......... .......... 18% 182M 1s 2024-09-12T18:53:03.785 INFO:teuthology.orchestra.run.smithi111.stderr: 17450K .......... .......... .......... .......... .......... 18% 184M 1s 2024-09-12T18:53:03.785 INFO:teuthology.orchestra.run.smithi111.stderr: 17500K .......... .......... .......... .......... .......... 18% 202M 1s 2024-09-12T18:53:03.786 INFO:teuthology.orchestra.run.smithi111.stderr: 17550K .......... .......... .......... .......... .......... 18% 161M 1s 2024-09-12T18:53:03.786 INFO:teuthology.orchestra.run.smithi111.stderr: 17600K .......... .......... .......... .......... .......... 18% 187M 1s 2024-09-12T18:53:03.786 INFO:teuthology.orchestra.run.smithi111.stderr: 17650K .......... .......... .......... .......... .......... 19% 200M 1s 2024-09-12T18:53:03.786 INFO:teuthology.orchestra.run.smithi111.stderr: 17700K .......... .......... .......... .......... .......... 19% 207M 1s 2024-09-12T18:53:03.786 INFO:teuthology.orchestra.run.smithi111.stderr: 17750K .......... .......... .......... .......... .......... 19% 172M 1s 2024-09-12T18:53:03.786 INFO:teuthology.orchestra.run.smithi111.stderr: 17800K .......... .......... .......... .......... .......... 19% 201M 1s 2024-09-12T18:53:03.786 INFO:teuthology.orchestra.run.smithi111.stderr: 17850K .......... .......... .......... .......... .......... 19% 154M 1s 2024-09-12T18:53:03.786 INFO:teuthology.orchestra.run.smithi111.stderr: 17900K .......... .......... .......... .......... .......... 19% 207M 1s 2024-09-12T18:53:03.786 INFO:teuthology.orchestra.run.smithi111.stderr: 17950K .......... .......... .......... .......... .......... 19% 145M 1s 2024-09-12T18:53:03.786 INFO:teuthology.orchestra.run.smithi111.stderr: 18000K .......... .......... .......... .......... .......... 19% 175M 1s 2024-09-12T18:53:03.786 INFO:teuthology.orchestra.run.smithi111.stderr: 18050K .......... .......... .......... .......... .......... 19% 207M 1s 2024-09-12T18:53:03.786 INFO:teuthology.orchestra.run.smithi111.stderr: 18100K .......... .......... .......... .......... .......... 19% 216M 1s 2024-09-12T18:53:03.787 INFO:teuthology.orchestra.run.smithi111.stderr: 18150K .......... .......... .......... .......... .......... 19% 174M 1s 2024-09-12T18:53:03.787 INFO:teuthology.orchestra.run.smithi111.stderr: 18200K .......... .......... .......... .......... .......... 19% 193M 1s 2024-09-12T18:53:03.787 INFO:teuthology.orchestra.run.smithi111.stderr: 18250K .......... .......... .......... .......... .......... 19% 212M 1s 2024-09-12T18:53:03.787 INFO:teuthology.orchestra.run.smithi111.stderr: 18300K .......... .......... .......... .......... .......... 19% 198M 1s 2024-09-12T18:53:03.787 INFO:teuthology.orchestra.run.smithi111.stderr: 18350K .......... .......... .......... .......... .......... 19% 173M 1s 2024-09-12T18:53:03.787 INFO:teuthology.orchestra.run.smithi111.stderr: 18400K .......... .......... .......... .......... .......... 19% 166M 1s 2024-09-12T18:53:03.787 INFO:teuthology.orchestra.run.smithi111.stderr: 18450K .......... .......... .......... .......... .......... 19% 180M 1s 2024-09-12T18:53:03.787 INFO:teuthology.orchestra.run.smithi111.stderr: 18500K .......... .......... .......... .......... .......... 19% 165M 1s 2024-09-12T18:53:03.787 INFO:teuthology.orchestra.run.smithi111.stderr: 18550K .......... .......... .......... .......... .......... 20% 157M 1s 2024-09-12T18:53:03.787 INFO:teuthology.orchestra.run.smithi111.stderr: 18600K .......... .......... .......... .......... .......... 20% 179M 1s 2024-09-12T18:53:03.787 INFO:teuthology.orchestra.run.smithi111.stderr: 18650K .......... .......... .......... .......... .......... 20% 183M 1s 2024-09-12T18:53:03.788 INFO:teuthology.orchestra.run.smithi111.stderr: 18700K .......... .......... .......... .......... .......... 20% 201M 1s 2024-09-12T18:53:03.788 INFO:teuthology.orchestra.run.smithi111.stderr: 18750K .......... .......... .......... .......... .......... 20% 179M 1s 2024-09-12T18:53:03.788 INFO:teuthology.orchestra.run.smithi111.stderr: 18800K .......... .......... .......... .......... .......... 20% 235M 1s 2024-09-12T18:53:03.788 INFO:teuthology.orchestra.run.smithi111.stderr: 18850K .......... .......... .......... .......... .......... 20% 186M 1s 2024-09-12T18:53:03.788 INFO:teuthology.orchestra.run.smithi111.stderr: 18900K .......... .......... .......... .......... .......... 20% 224M 1s 2024-09-12T18:53:03.788 INFO:teuthology.orchestra.run.smithi111.stderr: 18950K .......... .......... .......... .......... .......... 20% 200M 1s 2024-09-12T18:53:03.788 INFO:teuthology.orchestra.run.smithi111.stderr: 19000K .......... .......... .......... .......... .......... 20% 210M 1s 2024-09-12T18:53:03.788 INFO:teuthology.orchestra.run.smithi111.stderr: 19050K .......... .......... .......... .......... .......... 20% 236M 1s 2024-09-12T18:53:03.788 INFO:teuthology.orchestra.run.smithi111.stderr: 19100K .......... .......... .......... .......... .......... 20% 232M 1s 2024-09-12T18:53:03.788 INFO:teuthology.orchestra.run.smithi111.stderr: 19150K .......... .......... .......... .......... .......... 20% 163M 1s 2024-09-12T18:53:03.788 INFO:teuthology.orchestra.run.smithi111.stderr: 19200K .......... .......... .......... .......... .......... 20% 205M 1s 2024-09-12T18:53:03.788 INFO:teuthology.orchestra.run.smithi111.stderr: 19250K .......... .......... .......... .......... .......... 20% 223M 1s 2024-09-12T18:53:03.789 INFO:teuthology.orchestra.run.smithi111.stderr: 19300K .......... .......... .......... .......... .......... 20% 219M 1s 2024-09-12T18:53:03.789 INFO:teuthology.orchestra.run.smithi111.stderr: 19350K .......... .......... .......... .......... .......... 20% 167M 1s 2024-09-12T18:53:03.789 INFO:teuthology.orchestra.run.smithi111.stderr: 19400K .......... .......... .......... .......... .......... 20% 197M 1s 2024-09-12T18:53:03.789 INFO:teuthology.orchestra.run.smithi111.stderr: 19450K .......... .......... .......... .......... .......... 20% 214M 1s 2024-09-12T18:53:03.789 INFO:teuthology.orchestra.run.smithi111.stderr: 19500K .......... .......... .......... .......... .......... 21% 212M 1s 2024-09-12T18:53:03.789 INFO:teuthology.orchestra.run.smithi111.stderr: 19550K .......... .......... .......... .......... .......... 21% 168M 1s 2024-09-12T18:53:03.789 INFO:teuthology.orchestra.run.smithi111.stderr: 19600K .......... .......... .......... .......... .......... 21% 240M 1s 2024-09-12T18:53:03.789 INFO:teuthology.orchestra.run.smithi111.stderr: 19650K .......... .......... .......... .......... .......... 21% 203M 1s 2024-09-12T18:53:03.789 INFO:teuthology.orchestra.run.smithi111.stderr: 19700K .......... .......... .......... .......... .......... 21% 210M 1s 2024-09-12T18:53:03.789 INFO:teuthology.orchestra.run.smithi111.stderr: 19750K .......... .......... .......... .......... .......... 21% 202M 1s 2024-09-12T18:53:03.789 INFO:teuthology.orchestra.run.smithi111.stderr: 19800K .......... .......... .......... .......... .......... 21% 220M 1s 2024-09-12T18:53:03.790 INFO:teuthology.orchestra.run.smithi111.stderr: 19850K .......... .......... .......... .......... .......... 21% 222M 1s 2024-09-12T18:53:03.790 INFO:teuthology.orchestra.run.smithi111.stderr: 19900K .......... .......... .......... .......... .......... 21% 243M 1s 2024-09-12T18:53:03.790 INFO:teuthology.orchestra.run.smithi111.stderr: 19950K .......... .......... .......... .......... .......... 21% 190M 1s 2024-09-12T18:53:03.790 INFO:teuthology.orchestra.run.smithi111.stderr: 20000K .......... .......... .......... .......... .......... 21% 219M 1s 2024-09-12T18:53:03.790 INFO:teuthology.orchestra.run.smithi111.stderr: 20050K .......... .......... .......... .......... .......... 21% 227M 1s 2024-09-12T18:53:03.790 INFO:teuthology.orchestra.run.smithi111.stderr: 20100K .......... .......... .......... .......... .......... 21% 206M 1s 2024-09-12T18:53:03.790 INFO:teuthology.orchestra.run.smithi111.stderr: 20150K .......... .......... .......... .......... .......... 21% 200M 1s 2024-09-12T18:53:03.790 INFO:teuthology.orchestra.run.smithi111.stderr: 20200K .......... .......... .......... .......... .......... 21% 229M 1s 2024-09-12T18:53:03.790 INFO:teuthology.orchestra.run.smithi111.stderr: 20250K .......... .......... .......... .......... .......... 21% 193M 1s 2024-09-12T18:53:03.790 INFO:teuthology.orchestra.run.smithi111.stderr: 20300K .......... .......... .......... .......... .......... 21% 213M 1s 2024-09-12T18:53:03.790 INFO:teuthology.orchestra.run.smithi111.stderr: 20350K .......... .......... .......... .......... .......... 21% 183M 1s 2024-09-12T18:53:03.790 INFO:teuthology.orchestra.run.smithi111.stderr: 20400K .......... .......... .......... .......... .......... 22% 191M 1s 2024-09-12T18:53:03.791 INFO:teuthology.orchestra.run.smithi111.stderr: 20450K .......... .......... .......... .......... .......... 22% 233M 1s 2024-09-12T18:53:03.791 INFO:teuthology.orchestra.run.smithi111.stderr: 20500K .......... .......... .......... .......... .......... 22% 255M 1s 2024-09-12T18:53:03.791 INFO:teuthology.orchestra.run.smithi111.stderr: 20550K .......... .......... .......... .......... .......... 22% 207M 1s 2024-09-12T18:53:03.791 INFO:teuthology.orchestra.run.smithi111.stderr: 20600K .......... .......... .......... .......... .......... 22% 192M 1s 2024-09-12T18:53:03.791 INFO:teuthology.orchestra.run.smithi111.stderr: 20650K .......... .......... .......... .......... .......... 22% 256M 1s 2024-09-12T18:53:03.791 INFO:teuthology.orchestra.run.smithi111.stderr: 20700K .......... .......... .......... .......... .......... 22% 185M 1s 2024-09-12T18:53:03.791 INFO:teuthology.orchestra.run.smithi111.stderr: 20750K .......... .......... .......... .......... .......... 22% 243M 1s 2024-09-12T18:53:03.791 INFO:teuthology.orchestra.run.smithi111.stderr: 20800K .......... .......... .......... .......... .......... 22% 232M 1s 2024-09-12T18:53:03.791 INFO:teuthology.orchestra.run.smithi111.stderr: 20850K .......... .......... .......... .......... .......... 22% 215M 1s 2024-09-12T18:53:03.791 INFO:teuthology.orchestra.run.smithi111.stderr: 20900K .......... .......... .......... .......... .......... 22% 199M 1s 2024-09-12T18:53:03.791 INFO:teuthology.orchestra.run.smithi111.stderr: 20950K .......... .......... .......... .......... .......... 22% 229M 1s 2024-09-12T18:53:03.791 INFO:teuthology.orchestra.run.smithi111.stderr: 21000K .......... .......... .......... .......... .......... 22% 211M 1s 2024-09-12T18:53:03.792 INFO:teuthology.orchestra.run.smithi111.stderr: 21050K .......... .......... .......... .......... .......... 22% 242M 1s 2024-09-12T18:53:03.792 INFO:teuthology.orchestra.run.smithi111.stderr: 21100K .......... .......... .......... .......... .......... 22% 202M 1s 2024-09-12T18:53:03.792 INFO:teuthology.orchestra.run.smithi111.stderr: 21150K .......... .......... .......... .......... .......... 22% 219M 1s 2024-09-12T18:53:03.792 INFO:teuthology.orchestra.run.smithi111.stderr: 21200K .......... .......... .......... .......... .......... 22% 218M 1s 2024-09-12T18:53:03.792 INFO:teuthology.orchestra.run.smithi111.stderr: 21250K .......... .......... .......... .......... .......... 22% 217M 1s 2024-09-12T18:53:03.792 INFO:teuthology.orchestra.run.smithi111.stderr: 21300K .......... .......... .......... .......... .......... 22% 231M 1s 2024-09-12T18:53:03.792 INFO:teuthology.orchestra.run.smithi111.stderr: 21350K .......... .......... .......... .......... .......... 23% 245M 1s 2024-09-12T18:53:03.792 INFO:teuthology.orchestra.run.smithi111.stderr: 21400K .......... .......... .......... .......... .......... 23% 240M 1s 2024-09-12T18:53:03.792 INFO:teuthology.orchestra.run.smithi111.stderr: 21450K .......... .......... .......... .......... .......... 23% 241M 1s 2024-09-12T18:53:03.792 INFO:teuthology.orchestra.run.smithi111.stderr: 21500K .......... .......... .......... .......... .......... 23% 207M 1s 2024-09-12T18:53:03.792 INFO:teuthology.orchestra.run.smithi111.stderr: 21550K .......... .......... .......... .......... .......... 23% 265M 1s 2024-09-12T18:53:03.793 INFO:teuthology.orchestra.run.smithi111.stderr: 21600K .......... .......... .......... .......... .......... 23% 275M 1s 2024-09-12T18:53:03.793 INFO:teuthology.orchestra.run.smithi111.stderr: 21650K .......... .......... .......... .......... .......... 23% 262M 1s 2024-09-12T18:53:03.793 INFO:teuthology.orchestra.run.smithi111.stderr: 21700K .......... .......... .......... .......... .......... 23% 202M 1s 2024-09-12T18:53:03.793 INFO:teuthology.orchestra.run.smithi111.stderr: 21750K .......... .......... .......... .......... .......... 23% 239M 1s 2024-09-12T18:53:03.793 INFO:teuthology.orchestra.run.smithi111.stderr: 21800K .......... .......... .......... .......... .......... 23% 240M 1s 2024-09-12T18:53:03.793 INFO:teuthology.orchestra.run.smithi111.stderr: 21850K .......... .......... .......... .......... .......... 23% 223M 1s 2024-09-12T18:53:03.793 INFO:teuthology.orchestra.run.smithi111.stderr: 21900K .......... .......... .......... .......... .......... 23% 223M 1s 2024-09-12T18:53:03.793 INFO:teuthology.orchestra.run.smithi111.stderr: 21950K .......... .......... .......... .......... .......... 23% 257M 1s 2024-09-12T18:53:03.793 INFO:teuthology.orchestra.run.smithi111.stderr: 22000K .......... .......... .......... .......... .......... 23% 247M 1s 2024-09-12T18:53:03.793 INFO:teuthology.orchestra.run.smithi111.stderr: 22050K .......... .......... .......... .......... .......... 23% 245M 1s 2024-09-12T18:53:03.794 INFO:teuthology.orchestra.run.smithi111.stderr: 22100K .......... .......... .......... .......... .......... 23% 237M 1s 2024-09-12T18:53:03.794 INFO:teuthology.orchestra.run.smithi111.stderr: 22150K .......... .......... .......... .......... .......... 23% 238M 1s 2024-09-12T18:53:03.794 INFO:teuthology.orchestra.run.smithi111.stderr: 22200K .......... .......... .......... .......... .......... 23% 245M 1s 2024-09-12T18:53:03.794 INFO:teuthology.orchestra.run.smithi111.stderr: 22250K .......... .......... .......... .......... .......... 24% 289M 1s 2024-09-12T18:53:03.794 INFO:teuthology.orchestra.run.smithi111.stderr: 22300K .......... .......... .......... .......... .......... 24% 227M 1s 2024-09-12T18:53:03.794 INFO:teuthology.orchestra.run.smithi111.stderr: 22350K .......... .......... .......... .......... .......... 24% 253M 1s 2024-09-12T18:53:03.794 INFO:teuthology.orchestra.run.smithi111.stderr: 22400K .......... .......... .......... .......... .......... 24% 259M 1s 2024-09-12T18:53:03.794 INFO:teuthology.orchestra.run.smithi111.stderr: 22450K .......... .......... .......... .......... .......... 24% 246M 1s 2024-09-12T18:53:03.794 INFO:teuthology.orchestra.run.smithi111.stderr: 22500K .......... .......... .......... .......... .......... 24% 209M 1s 2024-09-12T18:53:03.794 INFO:teuthology.orchestra.run.smithi111.stderr: 22550K .......... .......... .......... .......... .......... 24% 242M 1s 2024-09-12T18:53:03.794 INFO:teuthology.orchestra.run.smithi111.stderr: 22600K .......... .......... .......... .......... .......... 24% 271M 1s 2024-09-12T18:53:03.795 INFO:teuthology.orchestra.run.smithi111.stderr: 22650K .......... .......... .......... .......... .......... 24% 247M 1s 2024-09-12T18:53:03.795 INFO:teuthology.orchestra.run.smithi111.stderr: 22700K .......... .......... .......... .......... .......... 24% 221M 1s 2024-09-12T18:53:03.795 INFO:teuthology.orchestra.run.smithi111.stderr: 22750K .......... .......... .......... .......... .......... 24% 287M 1s 2024-09-12T18:53:03.795 INFO:teuthology.orchestra.run.smithi111.stderr: 22800K .......... .......... .......... .......... .......... 24% 244M 1s 2024-09-12T18:53:03.795 INFO:teuthology.orchestra.run.smithi111.stderr: 22850K .......... .......... .......... .......... .......... 24% 288M 1s 2024-09-12T18:53:03.795 INFO:teuthology.orchestra.run.smithi111.stderr: 22900K .......... .......... .......... .......... .......... 24% 248M 1s 2024-09-12T18:53:03.795 INFO:teuthology.orchestra.run.smithi111.stderr: 22950K .......... .......... .......... .......... .......... 24% 252M 1s 2024-09-12T18:53:03.795 INFO:teuthology.orchestra.run.smithi111.stderr: 23000K .......... .......... .......... .......... .......... 24% 283M 1s 2024-09-12T18:53:03.795 INFO:teuthology.orchestra.run.smithi111.stderr: 23050K .......... .......... .......... .......... .......... 24% 242M 1s 2024-09-12T18:53:03.795 INFO:teuthology.orchestra.run.smithi111.stderr: 23100K .......... .......... .......... .......... .......... 24% 177M 1s 2024-09-12T18:53:03.795 INFO:teuthology.orchestra.run.smithi111.stderr: 23150K .......... .......... .......... .......... .......... 24% 264M 1s 2024-09-12T18:53:03.796 INFO:teuthology.orchestra.run.smithi111.stderr: 23200K .......... .......... .......... .......... .......... 25% 279M 1s 2024-09-12T18:53:03.796 INFO:teuthology.orchestra.run.smithi111.stderr: 23250K .......... .......... .......... .......... .......... 25% 246M 1s 2024-09-12T18:53:03.796 INFO:teuthology.orchestra.run.smithi111.stderr: 23300K .......... .......... .......... .......... .......... 25% 232M 1s 2024-09-12T18:53:03.796 INFO:teuthology.orchestra.run.smithi111.stderr: 23350K .......... .......... .......... .......... .......... 25% 257M 1s 2024-09-12T18:53:03.796 INFO:teuthology.orchestra.run.smithi111.stderr: 23400K .......... .......... .......... .......... .......... 25% 293M 1s 2024-09-12T18:53:03.796 INFO:teuthology.orchestra.run.smithi111.stderr: 23450K .......... .......... .......... .......... .......... 25% 246M 1s 2024-09-12T18:53:03.796 INFO:teuthology.orchestra.run.smithi111.stderr: 23500K .......... .......... .......... .......... .......... 25% 232M 1s 2024-09-12T18:53:03.796 INFO:teuthology.orchestra.run.smithi111.stderr: 23550K .......... .......... .......... .......... .......... 25% 271M 1s 2024-09-12T18:53:03.796 INFO:teuthology.orchestra.run.smithi111.stderr: 23600K .......... .......... .......... .......... .......... 25% 158M 1s 2024-09-12T18:53:03.796 INFO:teuthology.orchestra.run.smithi111.stderr: 23650K .......... .......... .......... .......... .......... 25% 219M 1s 2024-09-12T18:53:03.796 INFO:teuthology.orchestra.run.smithi111.stderr: 23700K .......... .......... .......... .......... .......... 25% 190M 1s 2024-09-12T18:53:03.796 INFO:teuthology.orchestra.run.smithi111.stderr: 23750K .......... .......... .......... .......... .......... 25% 236M 1s 2024-09-12T18:53:03.797 INFO:teuthology.orchestra.run.smithi111.stderr: 23800K .......... .......... .......... .......... .......... 25% 271M 1s 2024-09-12T18:53:03.797 INFO:teuthology.orchestra.run.smithi111.stderr: 23850K .......... .......... .......... .......... .......... 25% 269M 1s 2024-09-12T18:53:03.797 INFO:teuthology.orchestra.run.smithi111.stderr: 23900K .......... .......... .......... .......... .......... 25% 232M 1s 2024-09-12T18:53:03.797 INFO:teuthology.orchestra.run.smithi111.stderr: 23950K .......... .......... .......... .......... .......... 25% 276M 1s 2024-09-12T18:53:03.797 INFO:teuthology.orchestra.run.smithi111.stderr: 24000K .......... .......... .......... .......... .......... 25% 287M 1s 2024-09-12T18:53:03.797 INFO:teuthology.orchestra.run.smithi111.stderr: 24050K .......... .......... .......... .......... .......... 25% 286M 1s 2024-09-12T18:53:03.797 INFO:teuthology.orchestra.run.smithi111.stderr: 24100K .......... .......... .......... .......... .......... 25% 242M 1s 2024-09-12T18:53:03.797 INFO:teuthology.orchestra.run.smithi111.stderr: 24150K .......... .......... .......... .......... .......... 26% 295M 1s 2024-09-12T18:53:03.797 INFO:teuthology.orchestra.run.smithi111.stderr: 24200K .......... .......... .......... .......... .......... 26% 301M 1s 2024-09-12T18:53:03.797 INFO:teuthology.orchestra.run.smithi111.stderr: 24250K .......... .......... .......... .......... .......... 26% 273M 1s 2024-09-12T18:53:03.797 INFO:teuthology.orchestra.run.smithi111.stderr: 24300K .......... .......... .......... .......... .......... 26% 119M 1s 2024-09-12T18:53:03.797 INFO:teuthology.orchestra.run.smithi111.stderr: 24350K .......... .......... .......... .......... .......... 26% 248M 1s 2024-09-12T18:53:03.798 INFO:teuthology.orchestra.run.smithi111.stderr: 24400K .......... .......... .......... .......... .......... 26% 281M 1s 2024-09-12T18:53:03.798 INFO:teuthology.orchestra.run.smithi111.stderr: 24450K .......... .......... .......... .......... .......... 26% 240M 1s 2024-09-12T18:53:03.798 INFO:teuthology.orchestra.run.smithi111.stderr: 24500K .......... .......... .......... .......... .......... 26% 244M 1s 2024-09-12T18:53:03.798 INFO:teuthology.orchestra.run.smithi111.stderr: 24550K .......... .......... .......... .......... .......... 26% 196M 1s 2024-09-12T18:53:03.798 INFO:teuthology.orchestra.run.smithi111.stderr: 24600K .......... .......... .......... .......... .......... 26% 232M 1s 2024-09-12T18:53:03.798 INFO:teuthology.orchestra.run.smithi111.stderr: 24650K .......... .......... .......... .......... .......... 26% 73.7M 1s 2024-09-12T18:53:03.798 INFO:teuthology.orchestra.run.smithi111.stderr: 24700K .......... .......... .......... .......... .......... 26% 154M 1s 2024-09-12T18:53:03.798 INFO:teuthology.orchestra.run.smithi111.stderr: 24750K .......... .......... .......... .......... .......... 26% 216M 1s 2024-09-12T18:53:03.798 INFO:teuthology.orchestra.run.smithi111.stderr: 24800K .......... .......... .......... .......... .......... 26% 250M 1s 2024-09-12T18:53:03.798 INFO:teuthology.orchestra.run.smithi111.stderr: 24850K .......... .......... .......... .......... .......... 26% 283M 1s 2024-09-12T18:53:03.798 INFO:teuthology.orchestra.run.smithi111.stderr: 24900K .......... .......... .......... .......... .......... 26% 200M 1s 2024-09-12T18:53:03.798 INFO:teuthology.orchestra.run.smithi111.stderr: 24950K .......... .......... .......... .......... .......... 26% 243M 1s 2024-09-12T18:53:03.798 INFO:teuthology.orchestra.run.smithi111.stderr: 25000K .......... .......... .......... .......... .......... 26% 254M 1s 2024-09-12T18:53:03.799 INFO:teuthology.orchestra.run.smithi111.stderr: 25050K .......... .......... .......... .......... .......... 27% 230M 1s 2024-09-12T18:53:03.799 INFO:teuthology.orchestra.run.smithi111.stderr: 25100K .......... .......... .......... .......... .......... 27% 219M 1s 2024-09-12T18:53:03.799 INFO:teuthology.orchestra.run.smithi111.stderr: 25150K .......... .......... .......... .......... .......... 27% 279M 1s 2024-09-12T18:53:03.799 INFO:teuthology.orchestra.run.smithi111.stderr: 25200K .......... .......... .......... .......... .......... 27% 235M 1s 2024-09-12T18:53:03.799 INFO:teuthology.orchestra.run.smithi111.stderr: 25250K .......... .......... .......... .......... .......... 27% 252M 1s 2024-09-12T18:53:03.799 INFO:teuthology.orchestra.run.smithi111.stderr: 25300K .......... .......... .......... .......... .......... 27% 208M 1s 2024-09-12T18:53:03.799 INFO:teuthology.orchestra.run.smithi111.stderr: 25350K .......... .......... .......... .......... .......... 27% 274M 1s 2024-09-12T18:53:03.799 INFO:teuthology.orchestra.run.smithi111.stderr: 25400K .......... .......... .......... .......... .......... 27% 242M 1s 2024-09-12T18:53:03.799 INFO:teuthology.orchestra.run.smithi111.stderr: 25450K .......... .......... .......... .......... .......... 27% 261M 1s 2024-09-12T18:53:03.799 INFO:teuthology.orchestra.run.smithi111.stderr: 25500K .......... .......... .......... .......... .......... 27% 211M 1s 2024-09-12T18:53:03.799 INFO:teuthology.orchestra.run.smithi111.stderr: 25550K .......... .......... .......... .......... .......... 27% 239M 1s 2024-09-12T18:53:03.799 INFO:teuthology.orchestra.run.smithi111.stderr: 25600K .......... .......... .......... .......... .......... 27% 280M 1s 2024-09-12T18:53:03.800 INFO:teuthology.orchestra.run.smithi111.stderr: 25650K .......... .......... .......... .......... .......... 27% 262M 1s 2024-09-12T18:53:03.800 INFO:teuthology.orchestra.run.smithi111.stderr: 25700K .......... .......... .......... .......... .......... 27% 201M 1s 2024-09-12T18:53:03.800 INFO:teuthology.orchestra.run.smithi111.stderr: 25750K .......... .......... .......... .......... .......... 27% 71.2M 1s 2024-09-12T18:53:03.800 INFO:teuthology.orchestra.run.smithi111.stderr: 25800K .......... .......... .......... .......... .......... 27% 242M 1s 2024-09-12T18:53:03.800 INFO:teuthology.orchestra.run.smithi111.stderr: 25850K .......... .......... .......... .......... .......... 27% 276M 1s 2024-09-12T18:53:03.800 INFO:teuthology.orchestra.run.smithi111.stderr: 25900K .......... .......... .......... .......... .......... 27% 231M 1s 2024-09-12T18:53:03.800 INFO:teuthology.orchestra.run.smithi111.stderr: 25950K .......... .......... .......... .......... .......... 27% 272M 1s 2024-09-12T18:53:03.800 INFO:teuthology.orchestra.run.smithi111.stderr: 26000K .......... .......... .......... .......... .......... 28% 257M 1s 2024-09-12T18:53:03.800 INFO:teuthology.orchestra.run.smithi111.stderr: 26050K .......... .......... .......... .......... .......... 28% 246M 1s 2024-09-12T18:53:03.800 INFO:teuthology.orchestra.run.smithi111.stderr: 26100K .......... .......... .......... .......... .......... 28% 250M 1s 2024-09-12T18:53:03.800 INFO:teuthology.orchestra.run.smithi111.stderr: 26150K .......... .......... .......... .......... .......... 28% 261M 1s 2024-09-12T18:53:03.801 INFO:teuthology.orchestra.run.smithi111.stderr: 26200K .......... .......... .......... .......... .......... 28% 282M 1s 2024-09-12T18:53:03.801 INFO:teuthology.orchestra.run.smithi111.stderr: 26250K .......... .......... .......... .......... .......... 28% 281M 1s 2024-09-12T18:53:03.801 INFO:teuthology.orchestra.run.smithi111.stderr: 26300K .......... .......... .......... .......... .......... 28% 208M 1s 2024-09-12T18:53:03.801 INFO:teuthology.orchestra.run.smithi111.stderr: 26350K .......... .......... .......... .......... .......... 28% 254M 1s 2024-09-12T18:53:03.801 INFO:teuthology.orchestra.run.smithi111.stderr: 26400K .......... .......... .......... .......... .......... 28% 251M 1s 2024-09-12T18:53:03.801 INFO:teuthology.orchestra.run.smithi111.stderr: 26450K .......... .......... .......... .......... .......... 28% 257M 1s 2024-09-12T18:53:03.801 INFO:teuthology.orchestra.run.smithi111.stderr: 26500K .......... .......... .......... .......... .......... 28% 258M 1s 2024-09-12T18:53:03.801 INFO:teuthology.orchestra.run.smithi111.stderr: 26550K .......... .......... .......... .......... .......... 28% 258M 1s 2024-09-12T18:53:03.801 INFO:teuthology.orchestra.run.smithi111.stderr: 26600K .......... .......... .......... .......... .......... 28% 258M 1s 2024-09-12T18:53:03.801 INFO:teuthology.orchestra.run.smithi111.stderr: 26650K .......... .......... .......... .......... .......... 28% 261M 1s 2024-09-12T18:53:03.801 INFO:teuthology.orchestra.run.smithi111.stderr: 26700K .......... .......... .......... .......... .......... 28% 214M 0s 2024-09-12T18:53:03.801 INFO:teuthology.orchestra.run.smithi111.stderr: 26750K .......... .......... .......... .......... .......... 28% 276M 0s 2024-09-12T18:53:03.801 INFO:teuthology.orchestra.run.smithi111.stderr: 26800K .......... .......... .......... .......... .......... 28% 269M 0s 2024-09-12T18:53:03.802 INFO:teuthology.orchestra.run.smithi111.stderr: 26850K .......... .......... .......... .......... .......... 28% 246M 0s 2024-09-12T18:53:03.802 INFO:teuthology.orchestra.run.smithi111.stderr: 26900K .......... .......... .......... .......... .......... 29% 221M 0s 2024-09-12T18:53:03.802 INFO:teuthology.orchestra.run.smithi111.stderr: 26950K .......... .......... .......... .......... .......... 29% 264M 0s 2024-09-12T18:53:03.802 INFO:teuthology.orchestra.run.smithi111.stderr: 27000K .......... .......... .......... .......... .......... 29% 263M 0s 2024-09-12T18:53:03.802 INFO:teuthology.orchestra.run.smithi111.stderr: 27050K .......... .......... .......... .......... .......... 29% 243M 0s 2024-09-12T18:53:03.802 INFO:teuthology.orchestra.run.smithi111.stderr: 27100K .......... .......... .......... .......... .......... 29% 235M 0s 2024-09-12T18:53:03.802 INFO:teuthology.orchestra.run.smithi111.stderr: 27150K .......... .......... .......... .......... .......... 29% 265M 0s 2024-09-12T18:53:03.802 INFO:teuthology.orchestra.run.smithi111.stderr: 27200K .......... .......... .......... .......... .......... 29% 237M 0s 2024-09-12T18:53:03.802 INFO:teuthology.orchestra.run.smithi111.stderr: 27250K .......... .......... .......... .......... .......... 29% 279M 0s 2024-09-12T18:53:03.802 INFO:teuthology.orchestra.run.smithi111.stderr: 27300K .......... .......... .......... .......... .......... 29% 214M 0s 2024-09-12T18:53:03.802 INFO:teuthology.orchestra.run.smithi111.stderr: 27350K .......... .......... .......... .......... .......... 29% 265M 0s 2024-09-12T18:53:03.802 INFO:teuthology.orchestra.run.smithi111.stderr: 27400K .......... .......... .......... .......... .......... 29% 257M 0s 2024-09-12T18:53:03.803 INFO:teuthology.orchestra.run.smithi111.stderr: 27450K .......... .......... .......... .......... .......... 29% 242M 0s 2024-09-12T18:53:03.803 INFO:teuthology.orchestra.run.smithi111.stderr: 27500K .......... .......... .......... .......... .......... 29% 236M 0s 2024-09-12T18:53:03.803 INFO:teuthology.orchestra.run.smithi111.stderr: 27550K .......... .......... .......... .......... .......... 29% 274M 0s 2024-09-12T18:53:03.803 INFO:teuthology.orchestra.run.smithi111.stderr: 27600K .......... .......... .......... .......... .......... 29% 76.3M 0s 2024-09-12T18:53:03.803 INFO:teuthology.orchestra.run.smithi111.stderr: 27650K .......... .......... .......... .......... .......... 29% 263M 0s 2024-09-12T18:53:03.803 INFO:teuthology.orchestra.run.smithi111.stderr: 27700K .......... .......... .......... .......... .......... 29% 173M 0s 2024-09-12T18:53:03.803 INFO:teuthology.orchestra.run.smithi111.stderr: 27750K .......... .......... .......... .......... .......... 29% 111M 0s 2024-09-12T18:53:03.803 INFO:teuthology.orchestra.run.smithi111.stderr: 27800K .......... .......... .......... .......... .......... 29% 247M 0s 2024-09-12T18:53:03.803 INFO:teuthology.orchestra.run.smithi111.stderr: 27850K .......... .......... .......... .......... .......... 30% 282M 0s 2024-09-12T18:53:03.803 INFO:teuthology.orchestra.run.smithi111.stderr: 27900K .......... .......... .......... .......... .......... 30% 220M 0s 2024-09-12T18:53:03.803 INFO:teuthology.orchestra.run.smithi111.stderr: 27950K .......... .......... .......... .......... .......... 30% 283M 0s 2024-09-12T18:53:03.803 INFO:teuthology.orchestra.run.smithi111.stderr: 28000K .......... .......... .......... .......... .......... 30% 243M 0s 2024-09-12T18:53:03.804 INFO:teuthology.orchestra.run.smithi111.stderr: 28050K .......... .......... .......... .......... .......... 30% 228M 0s 2024-09-12T18:53:03.804 INFO:teuthology.orchestra.run.smithi111.stderr: 28100K .......... .......... .......... .......... .......... 30% 226M 0s 2024-09-12T18:53:03.804 INFO:teuthology.orchestra.run.smithi111.stderr: 28150K .......... .......... .......... .......... .......... 30% 281M 0s 2024-09-12T18:53:03.804 INFO:teuthology.orchestra.run.smithi111.stderr: 28200K .......... .......... .......... .......... .......... 30% 111M 0s 2024-09-12T18:53:03.804 INFO:teuthology.orchestra.run.smithi111.stderr: 28250K .......... .......... .......... .......... .......... 30% 270M 0s 2024-09-12T18:53:03.804 INFO:teuthology.orchestra.run.smithi111.stderr: 28300K .......... .......... .......... .......... .......... 30% 175M 0s 2024-09-12T18:53:03.804 INFO:teuthology.orchestra.run.smithi111.stderr: 28350K .......... .......... .......... .......... .......... 30% 221M 0s 2024-09-12T18:53:03.804 INFO:teuthology.orchestra.run.smithi111.stderr: 28400K .......... .......... .......... .......... .......... 30% 265M 0s 2024-09-12T18:53:03.804 INFO:teuthology.orchestra.run.smithi111.stderr: 28450K .......... .......... .......... .......... .......... 30% 289M 0s 2024-09-12T18:53:03.804 INFO:teuthology.orchestra.run.smithi111.stderr: 28500K .......... .......... .......... .......... .......... 30% 237M 0s 2024-09-12T18:53:03.804 INFO:teuthology.orchestra.run.smithi111.stderr: 28550K .......... .......... .......... .......... .......... 30% 283M 0s 2024-09-12T18:53:03.804 INFO:teuthology.orchestra.run.smithi111.stderr: 28600K .......... .......... .......... .......... .......... 30% 142M 0s 2024-09-12T18:53:03.805 INFO:teuthology.orchestra.run.smithi111.stderr: 28650K .......... .......... .......... .......... .......... 30% 274M 0s 2024-09-12T18:53:03.805 INFO:teuthology.orchestra.run.smithi111.stderr: 28700K .......... .......... .......... .......... .......... 30% 221M 0s 2024-09-12T18:53:03.805 INFO:teuthology.orchestra.run.smithi111.stderr: 28750K .......... .......... .......... .......... .......... 31% 90.8M 0s 2024-09-12T18:53:03.805 INFO:teuthology.orchestra.run.smithi111.stderr: 28800K .......... .......... .......... .......... .......... 31% 260M 0s 2024-09-12T18:53:03.805 INFO:teuthology.orchestra.run.smithi111.stderr: 28850K .......... .......... .......... .......... .......... 31% 168M 0s 2024-09-12T18:53:03.805 INFO:teuthology.orchestra.run.smithi111.stderr: 28900K .......... .......... .......... .......... .......... 31% 245M 0s 2024-09-12T18:53:03.805 INFO:teuthology.orchestra.run.smithi111.stderr: 28950K .......... .......... .......... .......... .......... 31% 242M 0s 2024-09-12T18:53:03.805 INFO:teuthology.orchestra.run.smithi111.stderr: 29000K .......... .......... .......... .......... .......... 31% 217M 0s 2024-09-12T18:53:03.805 INFO:teuthology.orchestra.run.smithi111.stderr: 29050K .......... .......... .......... .......... .......... 31% 282M 0s 2024-09-12T18:53:03.805 INFO:teuthology.orchestra.run.smithi111.stderr: 29100K .......... .......... .......... .......... .......... 31% 194M 0s 2024-09-12T18:53:03.805 INFO:teuthology.orchestra.run.smithi111.stderr: 29150K .......... .......... .......... .......... .......... 31% 279M 0s 2024-09-12T18:53:03.806 INFO:teuthology.orchestra.run.smithi111.stderr: 29200K .......... .......... .......... .......... .......... 31% 272M 0s 2024-09-12T18:53:03.806 INFO:teuthology.orchestra.run.smithi111.stderr: 29250K .......... .......... .......... .......... .......... 31% 233M 0s 2024-09-12T18:53:03.806 INFO:teuthology.orchestra.run.smithi111.stderr: 29300K .......... .......... .......... .......... .......... 31% 264M 0s 2024-09-12T18:53:03.806 INFO:teuthology.orchestra.run.smithi111.stderr: 29350K .......... .......... .......... .......... .......... 31% 256M 0s 2024-09-12T18:53:03.806 INFO:teuthology.orchestra.run.smithi111.stderr: 29400K .......... .......... .......... .......... .......... 31% 273M 0s 2024-09-12T18:53:03.806 INFO:teuthology.orchestra.run.smithi111.stderr: 29450K .......... .......... .......... .......... .......... 31% 227M 0s 2024-09-12T18:53:03.806 INFO:teuthology.orchestra.run.smithi111.stderr: 29500K .......... .......... .......... .......... .......... 31% 220M 0s 2024-09-12T18:53:03.806 INFO:teuthology.orchestra.run.smithi111.stderr: 29550K .......... .......... .......... .......... .......... 31% 289M 0s 2024-09-12T18:53:03.806 INFO:teuthology.orchestra.run.smithi111.stderr: 29600K .......... .......... .......... .......... .......... 31% 249M 0s 2024-09-12T18:53:03.806 INFO:teuthology.orchestra.run.smithi111.stderr: 29650K .......... .......... .......... .......... .......... 31% 265M 0s 2024-09-12T18:53:03.806 INFO:teuthology.orchestra.run.smithi111.stderr: 29700K .......... .......... .......... .......... .......... 32% 241M 0s 2024-09-12T18:53:03.806 INFO:teuthology.orchestra.run.smithi111.stderr: 29750K .......... .......... .......... .......... .......... 32% 251M 0s 2024-09-12T18:53:03.806 INFO:teuthology.orchestra.run.smithi111.stderr: 29800K .......... .......... .......... .......... .......... 32% 264M 0s 2024-09-12T18:53:03.807 INFO:teuthology.orchestra.run.smithi111.stderr: 29850K .......... .......... .......... .......... .......... 32% 257M 0s 2024-09-12T18:53:03.807 INFO:teuthology.orchestra.run.smithi111.stderr: 29900K .......... .......... .......... .......... .......... 32% 205M 0s 2024-09-12T18:53:03.807 INFO:teuthology.orchestra.run.smithi111.stderr: 29950K .......... .......... .......... .......... .......... 32% 262M 0s 2024-09-12T18:53:03.807 INFO:teuthology.orchestra.run.smithi111.stderr: 30000K .......... .......... .......... .......... .......... 32% 271M 0s 2024-09-12T18:53:03.807 INFO:teuthology.orchestra.run.smithi111.stderr: 30050K .......... .......... .......... .......... .......... 32% 236M 0s 2024-09-12T18:53:03.807 INFO:teuthology.orchestra.run.smithi111.stderr: 30100K .......... .......... .......... .......... .......... 32% 241M 0s 2024-09-12T18:53:03.807 INFO:teuthology.orchestra.run.smithi111.stderr: 30150K .......... .......... .......... .......... .......... 32% 271M 0s 2024-09-12T18:53:03.807 INFO:teuthology.orchestra.run.smithi111.stderr: 30200K .......... .......... .......... .......... .......... 32% 254M 0s 2024-09-12T18:53:03.807 INFO:teuthology.orchestra.run.smithi111.stderr: 30250K .......... .......... .......... .......... .......... 32% 282M 0s 2024-09-12T18:53:03.807 INFO:teuthology.orchestra.run.smithi111.stderr: 30300K .......... .......... .......... .......... .......... 32% 239M 0s 2024-09-12T18:53:03.807 INFO:teuthology.orchestra.run.smithi111.stderr: 30350K .......... .......... .......... .......... .......... 32% 257M 0s 2024-09-12T18:53:03.808 INFO:teuthology.orchestra.run.smithi111.stderr: 30400K .......... .......... .......... .......... .......... 32% 287M 0s 2024-09-12T18:53:03.808 INFO:teuthology.orchestra.run.smithi111.stderr: 30450K .......... .......... .......... .......... .......... 32% 272M 0s 2024-09-12T18:53:03.808 INFO:teuthology.orchestra.run.smithi111.stderr: 30500K .......... .......... .......... .......... .......... 32% 195M 0s 2024-09-12T18:53:03.808 INFO:teuthology.orchestra.run.smithi111.stderr: 30550K .......... .......... .......... .......... .......... 32% 278M 0s 2024-09-12T18:53:03.808 INFO:teuthology.orchestra.run.smithi111.stderr: 30600K .......... .......... .......... .......... .......... 32% 264M 0s 2024-09-12T18:53:03.808 INFO:teuthology.orchestra.run.smithi111.stderr: 30650K .......... .......... .......... .......... .......... 33% 216M 0s 2024-09-12T18:53:03.808 INFO:teuthology.orchestra.run.smithi111.stderr: 30700K .......... .......... .......... .......... .......... 33% 264M 0s 2024-09-12T18:53:03.808 INFO:teuthology.orchestra.run.smithi111.stderr: 30750K .......... .......... .......... .......... .......... 33% 256M 0s 2024-09-12T18:53:03.808 INFO:teuthology.orchestra.run.smithi111.stderr: 30800K .......... .......... .......... .......... .......... 33% 244M 0s 2024-09-12T18:53:03.808 INFO:teuthology.orchestra.run.smithi111.stderr: 30850K .......... .......... .......... .......... .......... 33% 279M 0s 2024-09-12T18:53:03.808 INFO:teuthology.orchestra.run.smithi111.stderr: 30900K .......... .......... .......... .......... .......... 33% 247M 0s 2024-09-12T18:53:03.808 INFO:teuthology.orchestra.run.smithi111.stderr: 30950K .......... .......... .......... .......... .......... 33% 225M 0s 2024-09-12T18:53:03.808 INFO:teuthology.orchestra.run.smithi111.stderr: 31000K .......... .......... .......... .......... .......... 33% 255M 0s 2024-09-12T18:53:03.809 INFO:teuthology.orchestra.run.smithi111.stderr: 31050K .......... .......... .......... .......... .......... 33% 282M 0s 2024-09-12T18:53:03.809 INFO:teuthology.orchestra.run.smithi111.stderr: 31100K .......... .......... .......... .......... .......... 33% 236M 0s 2024-09-12T18:53:03.809 INFO:teuthology.orchestra.run.smithi111.stderr: 31150K .......... .......... .......... .......... .......... 33% 234M 0s 2024-09-12T18:53:03.809 INFO:teuthology.orchestra.run.smithi111.stderr: 31200K .......... .......... .......... .......... .......... 33% 139M 0s 2024-09-12T18:53:03.809 INFO:teuthology.orchestra.run.smithi111.stderr: 31250K .......... .......... .......... .......... .......... 33% 160M 0s 2024-09-12T18:53:03.809 INFO:teuthology.orchestra.run.smithi111.stderr: 31300K .......... .......... .......... .......... .......... 33% 234M 0s 2024-09-12T18:53:03.809 INFO:teuthology.orchestra.run.smithi111.stderr: 31350K .......... .......... .......... .......... .......... 33% 106M 0s 2024-09-12T18:53:03.809 INFO:teuthology.orchestra.run.smithi111.stderr: 31400K .......... .......... .......... .......... .......... 33% 268M 0s 2024-09-12T18:53:03.809 INFO:teuthology.orchestra.run.smithi111.stderr: 31450K .......... .......... .......... .......... .......... 33% 185M 0s 2024-09-12T18:53:03.809 INFO:teuthology.orchestra.run.smithi111.stderr: 31500K .......... .......... .......... .......... .......... 33% 259M 0s 2024-09-12T18:53:03.809 INFO:teuthology.orchestra.run.smithi111.stderr: 31550K .......... .......... .......... .......... .......... 34% 232M 0s 2024-09-12T18:53:03.810 INFO:teuthology.orchestra.run.smithi111.stderr: 31600K .......... .......... .......... .......... .......... 34% 288M 0s 2024-09-12T18:53:03.810 INFO:teuthology.orchestra.run.smithi111.stderr: 31650K .......... .......... .......... .......... .......... 34% 306M 0s 2024-09-12T18:53:03.810 INFO:teuthology.orchestra.run.smithi111.stderr: 31700K .......... .......... .......... .......... .......... 34% 255M 0s 2024-09-12T18:53:03.810 INFO:teuthology.orchestra.run.smithi111.stderr: 31750K .......... .......... .......... .......... .......... 34% 121M 0s 2024-09-12T18:53:03.810 INFO:teuthology.orchestra.run.smithi111.stderr: 31800K .......... .......... .......... .......... .......... 34% 91.2M 0s 2024-09-12T18:53:03.810 INFO:teuthology.orchestra.run.smithi111.stderr: 31850K .......... .......... .......... .......... .......... 34% 227M 0s 2024-09-12T18:53:03.810 INFO:teuthology.orchestra.run.smithi111.stderr: 31900K .......... .......... .......... .......... .......... 34% 172M 0s 2024-09-12T18:53:03.810 INFO:teuthology.orchestra.run.smithi111.stderr: 31950K .......... .......... .......... .......... .......... 34% 216M 0s 2024-09-12T18:53:03.810 INFO:teuthology.orchestra.run.smithi111.stderr: 32000K .......... .......... .......... .......... .......... 34% 267M 0s 2024-09-12T18:53:03.810 INFO:teuthology.orchestra.run.smithi111.stderr: 32050K .......... .......... .......... .......... .......... 34% 292M 0s 2024-09-12T18:53:03.810 INFO:teuthology.orchestra.run.smithi111.stderr: 32100K .......... .......... .......... .......... .......... 34% 244M 0s 2024-09-12T18:53:03.810 INFO:teuthology.orchestra.run.smithi111.stderr: 32150K .......... .......... .......... .......... .......... 34% 158M 0s 2024-09-12T18:53:03.810 INFO:teuthology.orchestra.run.smithi111.stderr: 32200K .......... .......... .......... .......... .......... 34% 261M 0s 2024-09-12T18:53:03.811 INFO:teuthology.orchestra.run.smithi111.stderr: 32250K .......... .......... .......... .......... .......... 34% 248M 0s 2024-09-12T18:53:03.811 INFO:teuthology.orchestra.run.smithi111.stderr: 32300K .......... .......... .......... .......... .......... 34% 271M 0s 2024-09-12T18:53:03.811 INFO:teuthology.orchestra.run.smithi111.stderr: 32350K .......... .......... .......... .......... .......... 34% 231M 0s 2024-09-12T18:53:03.811 INFO:teuthology.orchestra.run.smithi111.stderr: 32400K .......... .......... .......... .......... .......... 34% 289M 0s 2024-09-12T18:53:03.811 INFO:teuthology.orchestra.run.smithi111.stderr: 32450K .......... .......... .......... .......... .......... 34% 164M 0s 2024-09-12T18:53:03.811 INFO:teuthology.orchestra.run.smithi111.stderr: 32500K .......... .......... .......... .......... .......... 35% 267M 0s 2024-09-12T18:53:03.811 INFO:teuthology.orchestra.run.smithi111.stderr: 32550K .......... .......... .......... .......... .......... 35% 235M 0s 2024-09-12T18:53:03.811 INFO:teuthology.orchestra.run.smithi111.stderr: 32600K .......... .......... .......... .......... .......... 35% 281M 0s 2024-09-12T18:53:03.811 INFO:teuthology.orchestra.run.smithi111.stderr: 32650K .......... .......... .......... .......... .......... 35% 133M 0s 2024-09-12T18:53:03.811 INFO:teuthology.orchestra.run.smithi111.stderr: 32700K .......... .......... .......... .......... .......... 35% 155M 0s 2024-09-12T18:53:03.811 INFO:teuthology.orchestra.run.smithi111.stderr: 32750K .......... .......... .......... .......... .......... 35% 215M 0s 2024-09-12T18:53:03.811 INFO:teuthology.orchestra.run.smithi111.stderr: 32800K .......... .......... .......... .......... .......... 35% 302M 0s 2024-09-12T18:53:03.811 INFO:teuthology.orchestra.run.smithi111.stderr: 32850K .......... .......... .......... .......... .......... 35% 176M 0s 2024-09-12T18:53:03.812 INFO:teuthology.orchestra.run.smithi111.stderr: 32900K .......... .......... .......... .......... .......... 35% 269M 0s 2024-09-12T18:53:03.812 INFO:teuthology.orchestra.run.smithi111.stderr: 32950K .......... .......... .......... .......... .......... 35% 211M 0s 2024-09-12T18:53:03.812 INFO:teuthology.orchestra.run.smithi111.stderr: 33000K .......... .......... .......... .......... .......... 35% 261M 0s 2024-09-12T18:53:03.812 INFO:teuthology.orchestra.run.smithi111.stderr: 33050K .......... .......... .......... .......... .......... 35% 169M 0s 2024-09-12T18:53:03.812 INFO:teuthology.orchestra.run.smithi111.stderr: 33100K .......... .......... .......... .......... .......... 35% 228M 0s 2024-09-12T18:53:03.812 INFO:teuthology.orchestra.run.smithi111.stderr: 33150K .......... .......... .......... .......... .......... 35% 235M 0s 2024-09-12T18:53:03.812 INFO:teuthology.orchestra.run.smithi111.stderr: 33200K .......... .......... .......... .......... .......... 35% 268M 0s 2024-09-12T18:53:03.812 INFO:teuthology.orchestra.run.smithi111.stderr: 33250K .......... .......... .......... .......... .......... 35% 263M 0s 2024-09-12T18:53:03.812 INFO:teuthology.orchestra.run.smithi111.stderr: 33300K .......... .......... .......... .......... .......... 35% 72.2M 0s 2024-09-12T18:53:03.812 INFO:teuthology.orchestra.run.smithi111.stderr: 33350K .......... .......... .......... .......... .......... 35% 232M 0s 2024-09-12T18:53:03.812 INFO:teuthology.orchestra.run.smithi111.stderr: 33400K .......... .......... .......... .......... .......... 36% 247M 0s 2024-09-12T18:53:03.813 INFO:teuthology.orchestra.run.smithi111.stderr: 33450K .......... .......... .......... .......... .......... 36% 282M 0s 2024-09-12T18:53:03.813 INFO:teuthology.orchestra.run.smithi111.stderr: 33500K .......... .......... .......... .......... .......... 36% 288M 0s 2024-09-12T18:53:03.813 INFO:teuthology.orchestra.run.smithi111.stderr: 33550K .......... .......... .......... .......... .......... 36% 221M 0s 2024-09-12T18:53:03.813 INFO:teuthology.orchestra.run.smithi111.stderr: 33600K .......... .......... .......... .......... .......... 36% 282M 0s 2024-09-12T18:53:03.813 INFO:teuthology.orchestra.run.smithi111.stderr: 33650K .......... .......... .......... .......... .......... 36% 294M 0s 2024-09-12T18:53:03.813 INFO:teuthology.orchestra.run.smithi111.stderr: 33700K .......... .......... .......... .......... .......... 36% 247M 0s 2024-09-12T18:53:03.813 INFO:teuthology.orchestra.run.smithi111.stderr: 33750K .......... .......... .......... .......... .......... 36% 263M 0s 2024-09-12T18:53:03.813 INFO:teuthology.orchestra.run.smithi111.stderr: 33800K .......... .......... .......... .......... .......... 36% 289M 0s 2024-09-12T18:53:03.813 INFO:teuthology.orchestra.run.smithi111.stderr: 33850K .......... .......... .......... .......... .......... 36% 222M 0s 2024-09-12T18:53:03.813 INFO:teuthology.orchestra.run.smithi111.stderr: 33900K .......... .......... .......... .......... .......... 36% 264M 0s 2024-09-12T18:53:03.813 INFO:teuthology.orchestra.run.smithi111.stderr: 33950K .......... .......... .......... .......... .......... 36% 290M 0s 2024-09-12T18:53:03.813 INFO:teuthology.orchestra.run.smithi111.stderr: 34000K .......... .......... .......... .......... .......... 36% 234M 0s 2024-09-12T18:53:03.814 INFO:teuthology.orchestra.run.smithi111.stderr: 34050K .......... .......... .......... .......... .......... 36% 254M 0s 2024-09-12T18:53:03.814 INFO:teuthology.orchestra.run.smithi111.stderr: 34100K .......... .......... .......... .......... .......... 36% 271M 0s 2024-09-12T18:53:03.814 INFO:teuthology.orchestra.run.smithi111.stderr: 34150K .......... .......... .......... .......... .......... 36% 270M 0s 2024-09-12T18:53:03.814 INFO:teuthology.orchestra.run.smithi111.stderr: 34200K .......... .......... .......... .......... .......... 36% 280M 0s 2024-09-12T18:53:03.814 INFO:teuthology.orchestra.run.smithi111.stderr: 34250K .......... .......... .......... .......... .......... 36% 276M 0s 2024-09-12T18:53:03.814 INFO:teuthology.orchestra.run.smithi111.stderr: 34300K .......... .......... .......... .......... .......... 36% 262M 0s 2024-09-12T18:53:03.814 INFO:teuthology.orchestra.run.smithi111.stderr: 34350K .......... .......... .......... .......... .......... 37% 239M 0s 2024-09-12T18:53:03.814 INFO:teuthology.orchestra.run.smithi111.stderr: 34400K .......... .......... .......... .......... .......... 37% 253M 0s 2024-09-12T18:53:03.814 INFO:teuthology.orchestra.run.smithi111.stderr: 34450K .......... .......... .......... .......... .......... 37% 238M 0s 2024-09-12T18:53:03.814 INFO:teuthology.orchestra.run.smithi111.stderr: 34500K .......... .......... .......... .......... .......... 37% 181M 0s 2024-09-12T18:53:03.814 INFO:teuthology.orchestra.run.smithi111.stderr: 34550K .......... .......... .......... .......... .......... 37% 272M 0s 2024-09-12T18:53:03.814 INFO:teuthology.orchestra.run.smithi111.stderr: 34600K .......... .......... .......... .......... .......... 37% 276M 0s 2024-09-12T18:53:03.814 INFO:teuthology.orchestra.run.smithi111.stderr: 34650K .......... .......... .......... .......... .......... 37% 272M 0s 2024-09-12T18:53:03.815 INFO:teuthology.orchestra.run.smithi111.stderr: 34700K .......... .......... .......... .......... .......... 37% 265M 0s 2024-09-12T18:53:03.815 INFO:teuthology.orchestra.run.smithi111.stderr: 34750K .......... .......... .......... .......... .......... 37% 296M 0s 2024-09-12T18:53:03.815 INFO:teuthology.orchestra.run.smithi111.stderr: 34800K .......... .......... .......... .......... .......... 37% 107M 0s 2024-09-12T18:53:03.815 INFO:teuthology.orchestra.run.smithi111.stderr: 34850K .......... .......... .......... .......... .......... 37% 145M 0s 2024-09-12T18:53:03.815 INFO:teuthology.orchestra.run.smithi111.stderr: 34900K .......... .......... .......... .......... .......... 37% 276M 0s 2024-09-12T18:53:03.815 INFO:teuthology.orchestra.run.smithi111.stderr: 34950K .......... .......... .......... .......... .......... 37% 98.9M 0s 2024-09-12T18:53:03.815 INFO:teuthology.orchestra.run.smithi111.stderr: 35000K .......... .......... .......... .......... .......... 37% 282M 0s 2024-09-12T18:53:03.815 INFO:teuthology.orchestra.run.smithi111.stderr: 35050K .......... .......... .......... .......... .......... 37% 241M 0s 2024-09-12T18:53:03.815 INFO:teuthology.orchestra.run.smithi111.stderr: 35100K .......... .......... .......... .......... .......... 37% 295M 0s 2024-09-12T18:53:03.815 INFO:teuthology.orchestra.run.smithi111.stderr: 35150K .......... .......... .......... .......... .......... 37% 88.6M 0s 2024-09-12T18:53:03.815 INFO:teuthology.orchestra.run.smithi111.stderr: 35200K .......... .......... .......... .......... .......... 37% 169M 0s 2024-09-12T18:53:03.815 INFO:teuthology.orchestra.run.smithi111.stderr: 35250K .......... .......... .......... .......... .......... 37% 239M 0s 2024-09-12T18:53:03.816 INFO:teuthology.orchestra.run.smithi111.stderr: 35300K .......... .......... .......... .......... .......... 38% 301M 0s 2024-09-12T18:53:03.816 INFO:teuthology.orchestra.run.smithi111.stderr: 35350K .......... .......... .......... .......... .......... 38% 283M 0s 2024-09-12T18:53:03.816 INFO:teuthology.orchestra.run.smithi111.stderr: 35400K .......... .......... .......... .......... .......... 38% 196M 0s 2024-09-12T18:53:03.816 INFO:teuthology.orchestra.run.smithi111.stderr: 35450K .......... .......... .......... .......... .......... 38% 182M 0s 2024-09-12T18:53:03.816 INFO:teuthology.orchestra.run.smithi111.stderr: 35500K .......... .......... .......... .......... .......... 38% 174M 0s 2024-09-12T18:53:03.816 INFO:teuthology.orchestra.run.smithi111.stderr: 35550K .......... .......... .......... .......... .......... 38% 243M 0s 2024-09-12T18:53:03.816 INFO:teuthology.orchestra.run.smithi111.stderr: 35600K .......... .......... .......... .......... .......... 38% 229M 0s 2024-09-12T18:53:03.816 INFO:teuthology.orchestra.run.smithi111.stderr: 35650K .......... .......... .......... .......... .......... 38% 275M 0s 2024-09-12T18:53:03.816 INFO:teuthology.orchestra.run.smithi111.stderr: 35700K .......... .......... .......... .......... .......... 38% 153M 0s 2024-09-12T18:53:03.816 INFO:teuthology.orchestra.run.smithi111.stderr: 35750K .......... .......... .......... .......... .......... 38% 145M 0s 2024-09-12T18:53:03.816 INFO:teuthology.orchestra.run.smithi111.stderr: 35800K .......... .......... .......... .......... .......... 38% 217M 0s 2024-09-12T18:53:03.816 INFO:teuthology.orchestra.run.smithi111.stderr: 35850K .......... .......... .......... .......... .......... 38% 280M 0s 2024-09-12T18:53:03.817 INFO:teuthology.orchestra.run.smithi111.stderr: 35900K .......... .......... .......... .......... .......... 38% 249M 0s 2024-09-12T18:53:03.817 INFO:teuthology.orchestra.run.smithi111.stderr: 35950K .......... .......... .......... .......... .......... 38% 206M 0s 2024-09-12T18:53:03.817 INFO:teuthology.orchestra.run.smithi111.stderr: 36000K .......... .......... .......... .......... .......... 38% 248M 0s 2024-09-12T18:53:03.817 INFO:teuthology.orchestra.run.smithi111.stderr: 36050K .......... .......... .......... .......... .......... 38% 279M 0s 2024-09-12T18:53:03.817 INFO:teuthology.orchestra.run.smithi111.stderr: 36100K .......... .......... .......... .......... .......... 38% 248M 0s 2024-09-12T18:53:03.817 INFO:teuthology.orchestra.run.smithi111.stderr: 36150K .......... .......... .......... .......... .......... 38% 276M 0s 2024-09-12T18:53:03.817 INFO:teuthology.orchestra.run.smithi111.stderr: 36200K .......... .......... .......... .......... .......... 39% 272M 0s 2024-09-12T18:53:03.817 INFO:teuthology.orchestra.run.smithi111.stderr: 36250K .......... .......... .......... .......... .......... 39% 285M 0s 2024-09-12T18:53:03.817 INFO:teuthology.orchestra.run.smithi111.stderr: 36300K .......... .......... .......... .......... .......... 39% 110M 0s 2024-09-12T18:53:03.817 INFO:teuthology.orchestra.run.smithi111.stderr: 36350K .......... .......... .......... .......... .......... 39% 102M 0s 2024-09-12T18:53:03.817 INFO:teuthology.orchestra.run.smithi111.stderr: 36400K .......... .......... .......... .......... .......... 39% 206M 0s 2024-09-12T18:53:03.817 INFO:teuthology.orchestra.run.smithi111.stderr: 36450K .......... .......... .......... .......... .......... 39% 288M 0s 2024-09-12T18:53:03.817 INFO:teuthology.orchestra.run.smithi111.stderr: 36500K .......... .......... .......... .......... .......... 39% 278M 0s 2024-09-12T18:53:03.818 INFO:teuthology.orchestra.run.smithi111.stderr: 36550K .......... .......... .......... .......... .......... 39% 255M 0s 2024-09-12T18:53:03.818 INFO:teuthology.orchestra.run.smithi111.stderr: 36600K .......... .......... .......... .......... .......... 39% 252M 0s 2024-09-12T18:53:03.818 INFO:teuthology.orchestra.run.smithi111.stderr: 36650K .......... .......... .......... .......... .......... 39% 144M 0s 2024-09-12T18:53:03.818 INFO:teuthology.orchestra.run.smithi111.stderr: 36700K .......... .......... .......... .......... .......... 39% 273M 0s 2024-09-12T18:53:03.818 INFO:teuthology.orchestra.run.smithi111.stderr: 36750K .......... .......... .......... .......... .......... 39% 230M 0s 2024-09-12T18:53:03.818 INFO:teuthology.orchestra.run.smithi111.stderr: 36800K .......... .......... .......... .......... .......... 39% 283M 0s 2024-09-12T18:53:03.818 INFO:teuthology.orchestra.run.smithi111.stderr: 36850K .......... .......... .......... .......... .......... 39% 295M 0s 2024-09-12T18:53:03.818 INFO:teuthology.orchestra.run.smithi111.stderr: 36900K .......... .......... .......... .......... .......... 39% 289M 0s 2024-09-12T18:53:03.818 INFO:teuthology.orchestra.run.smithi111.stderr: 36950K .......... .......... .......... .......... .......... 39% 192M 0s 2024-09-12T18:53:03.818 INFO:teuthology.orchestra.run.smithi111.stderr: 37000K .......... .......... .......... .......... .......... 39% 299M 0s 2024-09-12T18:53:03.818 INFO:teuthology.orchestra.run.smithi111.stderr: 37050K .......... .......... .......... .......... .......... 39% 238M 0s 2024-09-12T18:53:03.818 INFO:teuthology.orchestra.run.smithi111.stderr: 37100K .......... .......... .......... .......... .......... 39% 281M 0s 2024-09-12T18:53:03.819 INFO:teuthology.orchestra.run.smithi111.stderr: 37150K .......... .......... .......... .......... .......... 40% 232M 0s 2024-09-12T18:53:03.819 INFO:teuthology.orchestra.run.smithi111.stderr: 37200K .......... .......... .......... .......... .......... 40% 241M 0s 2024-09-12T18:53:03.819 INFO:teuthology.orchestra.run.smithi111.stderr: 37250K .......... .......... .......... .......... .......... 40% 296M 0s 2024-09-12T18:53:03.819 INFO:teuthology.orchestra.run.smithi111.stderr: 37300K .......... .......... .......... .......... .......... 40% 275M 0s 2024-09-12T18:53:03.819 INFO:teuthology.orchestra.run.smithi111.stderr: 37350K .......... .......... .......... .......... .......... 40% 230M 0s 2024-09-12T18:53:03.819 INFO:teuthology.orchestra.run.smithi111.stderr: 37400K .......... .......... .......... .......... .......... 40% 265M 0s 2024-09-12T18:53:03.819 INFO:teuthology.orchestra.run.smithi111.stderr: 37450K .......... .......... .......... .......... .......... 40% 301M 0s 2024-09-12T18:53:03.819 INFO:teuthology.orchestra.run.smithi111.stderr: 37500K .......... .......... .......... .......... .......... 40% 276M 0s 2024-09-12T18:53:03.819 INFO:teuthology.orchestra.run.smithi111.stderr: 37550K .......... .......... .......... .......... .......... 40% 224M 0s 2024-09-12T18:53:03.819 INFO:teuthology.orchestra.run.smithi111.stderr: 37600K .......... .......... .......... .......... .......... 40% 272M 0s 2024-09-12T18:53:03.819 INFO:teuthology.orchestra.run.smithi111.stderr: 37650K .......... .......... .......... .......... .......... 40% 302M 0s 2024-09-12T18:53:03.819 INFO:teuthology.orchestra.run.smithi111.stderr: 37700K .......... .......... .......... .......... .......... 40% 255M 0s 2024-09-12T18:53:03.819 INFO:teuthology.orchestra.run.smithi111.stderr: 37750K .......... .......... .......... .......... .......... 40% 262M 0s 2024-09-12T18:53:03.819 INFO:teuthology.orchestra.run.smithi111.stderr: 37800K .......... .......... .......... .......... .......... 40% 291M 0s 2024-09-12T18:53:03.820 INFO:teuthology.orchestra.run.smithi111.stderr: 37850K .......... .......... .......... .......... .......... 40% 286M 0s 2024-09-12T18:53:03.820 INFO:teuthology.orchestra.run.smithi111.stderr: 37900K .......... .......... .......... .......... .......... 40% 301M 0s 2024-09-12T18:53:03.820 INFO:teuthology.orchestra.run.smithi111.stderr: 37950K .......... .......... .......... .......... .......... 40% 230M 0s 2024-09-12T18:53:03.820 INFO:teuthology.orchestra.run.smithi111.stderr: 38000K .......... .......... .......... .......... .......... 40% 279M 0s 2024-09-12T18:53:03.820 INFO:teuthology.orchestra.run.smithi111.stderr: 38050K .......... .......... .......... .......... .......... 41% 216M 0s 2024-09-12T18:53:03.820 INFO:teuthology.orchestra.run.smithi111.stderr: 38100K .......... .......... .......... .......... .......... 41% 265M 0s 2024-09-12T18:53:03.820 INFO:teuthology.orchestra.run.smithi111.stderr: 38150K .......... .......... .......... .......... .......... 41% 248M 0s 2024-09-12T18:53:03.820 INFO:teuthology.orchestra.run.smithi111.stderr: 38200K .......... .......... .......... .......... .......... 41% 206M 0s 2024-09-12T18:53:03.820 INFO:teuthology.orchestra.run.smithi111.stderr: 38250K .......... .......... .......... .......... .......... 41% 146M 0s 2024-09-12T18:53:03.820 INFO:teuthology.orchestra.run.smithi111.stderr: 38300K .......... .......... .......... .......... .......... 41% 301M 0s 2024-09-12T18:53:03.820 INFO:teuthology.orchestra.run.smithi111.stderr: 38350K .......... .......... .......... .......... .......... 41% 221M 0s 2024-09-12T18:53:03.820 INFO:teuthology.orchestra.run.smithi111.stderr: 38400K .......... .......... .......... .......... .......... 41% 246M 0s 2024-09-12T18:53:03.821 INFO:teuthology.orchestra.run.smithi111.stderr: 38450K .......... .......... .......... .......... .......... 41% 313M 0s 2024-09-12T18:53:03.821 INFO:teuthology.orchestra.run.smithi111.stderr: 38500K .......... .......... .......... .......... .......... 41% 145M 0s 2024-09-12T18:53:03.821 INFO:teuthology.orchestra.run.smithi111.stderr: 38550K .......... .......... .......... .......... .......... 41% 246M 0s 2024-09-12T18:53:03.821 INFO:teuthology.orchestra.run.smithi111.stderr: 38600K .......... .......... .......... .......... .......... 41% 298M 0s 2024-09-12T18:53:03.821 INFO:teuthology.orchestra.run.smithi111.stderr: 38650K .......... .......... .......... .......... .......... 41% 273M 0s 2024-09-12T18:53:03.821 INFO:teuthology.orchestra.run.smithi111.stderr: 38700K .......... .......... .......... .......... .......... 41% 286M 0s 2024-09-12T18:53:03.821 INFO:teuthology.orchestra.run.smithi111.stderr: 38750K .......... .......... .......... .......... .......... 41% 181M 0s 2024-09-12T18:53:03.821 INFO:teuthology.orchestra.run.smithi111.stderr: 38800K .......... .......... .......... .......... .......... 41% 310M 0s 2024-09-12T18:53:03.821 INFO:teuthology.orchestra.run.smithi111.stderr: 38850K .......... .......... .......... .......... .......... 41% 273M 0s 2024-09-12T18:53:03.821 INFO:teuthology.orchestra.run.smithi111.stderr: 38900K .......... .......... .......... .......... .......... 41% 221M 0s 2024-09-12T18:53:03.821 INFO:teuthology.orchestra.run.smithi111.stderr: 38950K .......... .......... .......... .......... .......... 41% 248M 0s 2024-09-12T18:53:03.821 INFO:teuthology.orchestra.run.smithi111.stderr: 39000K .......... .......... .......... .......... .......... 42% 254M 0s 2024-09-12T18:53:03.822 INFO:teuthology.orchestra.run.smithi111.stderr: 39050K .......... .......... .......... .......... .......... 42% 263M 0s 2024-09-12T18:53:03.822 INFO:teuthology.orchestra.run.smithi111.stderr: 39100K .......... .......... .......... .......... .......... 42% 325M 0s 2024-09-12T18:53:03.822 INFO:teuthology.orchestra.run.smithi111.stderr: 39150K .......... .......... .......... .......... .......... 42% 254M 0s 2024-09-12T18:53:03.822 INFO:teuthology.orchestra.run.smithi111.stderr: 39200K .......... .......... .......... .......... .......... 42% 323M 0s 2024-09-12T18:53:03.822 INFO:teuthology.orchestra.run.smithi111.stderr: 39250K .......... .......... .......... .......... .......... 42% 276M 0s 2024-09-12T18:53:03.822 INFO:teuthology.orchestra.run.smithi111.stderr: 39300K .......... .......... .......... .......... .......... 42% 81.7M 0s 2024-09-12T18:53:03.822 INFO:teuthology.orchestra.run.smithi111.stderr: 39350K .......... .......... .......... .......... .......... 42% 201M 0s 2024-09-12T18:53:03.822 INFO:teuthology.orchestra.run.smithi111.stderr: 39400K .......... .......... .......... .......... .......... 42% 292M 0s 2024-09-12T18:53:03.822 INFO:teuthology.orchestra.run.smithi111.stderr: 39450K .......... .......... .......... .......... .......... 42% 310M 0s 2024-09-12T18:53:03.822 INFO:teuthology.orchestra.run.smithi111.stderr: 39500K .......... .......... .......... .......... .......... 42% 305M 0s 2024-09-12T18:53:03.822 INFO:teuthology.orchestra.run.smithi111.stderr: 39550K .......... .......... .......... .......... .......... 42% 221M 0s 2024-09-12T18:53:03.823 INFO:teuthology.orchestra.run.smithi111.stderr: 39600K .......... .......... .......... .......... .......... 42% 290M 0s 2024-09-12T18:53:03.823 INFO:teuthology.orchestra.run.smithi111.stderr: 39650K .......... .......... .......... .......... .......... 42% 250M 0s 2024-09-12T18:53:03.823 INFO:teuthology.orchestra.run.smithi111.stderr: 39700K .......... .......... .......... .......... .......... 42% 144M 0s 2024-09-12T18:53:03.823 INFO:teuthology.orchestra.run.smithi111.stderr: 39750K .......... .......... .......... .......... .......... 42% 212M 0s 2024-09-12T18:53:03.823 INFO:teuthology.orchestra.run.smithi111.stderr: 39800K .......... .......... .......... .......... .......... 42% 281M 0s 2024-09-12T18:53:03.823 INFO:teuthology.orchestra.run.smithi111.stderr: 39850K .......... .......... .......... .......... .......... 42% 230M 0s 2024-09-12T18:53:03.823 INFO:teuthology.orchestra.run.smithi111.stderr: 39900K .......... .......... .......... .......... .......... 43% 284M 0s 2024-09-12T18:53:03.823 INFO:teuthology.orchestra.run.smithi111.stderr: 39950K .......... .......... .......... .......... .......... 43% 265M 0s 2024-09-12T18:53:03.823 INFO:teuthology.orchestra.run.smithi111.stderr: 40000K .......... .......... .......... .......... .......... 43% 305M 0s 2024-09-12T18:53:03.823 INFO:teuthology.orchestra.run.smithi111.stderr: 40050K .......... .......... .......... .......... .......... 43% 316M 0s 2024-09-12T18:53:03.823 INFO:teuthology.orchestra.run.smithi111.stderr: 40100K .......... .......... .......... .......... .......... 43% 93.8M 0s 2024-09-12T18:53:03.823 INFO:teuthology.orchestra.run.smithi111.stderr: 40150K .......... .......... .......... .......... .......... 43% 253M 0s 2024-09-12T18:53:03.823 INFO:teuthology.orchestra.run.smithi111.stderr: 40200K .......... .......... .......... .......... .......... 43% 295M 0s 2024-09-12T18:53:03.824 INFO:teuthology.orchestra.run.smithi111.stderr: 40250K .......... .......... .......... .......... .......... 43% 320M 0s 2024-09-12T18:53:03.824 INFO:teuthology.orchestra.run.smithi111.stderr: 40300K .......... .......... .......... .......... .......... 43% 159M 0s 2024-09-12T18:53:03.824 INFO:teuthology.orchestra.run.smithi111.stderr: 40350K .......... .......... .......... .......... .......... 43% 251M 0s 2024-09-12T18:53:03.824 INFO:teuthology.orchestra.run.smithi111.stderr: 40400K .......... .......... .......... .......... .......... 43% 287M 0s 2024-09-12T18:53:03.824 INFO:teuthology.orchestra.run.smithi111.stderr: 40450K .......... .......... .......... .......... .......... 43% 319M 0s 2024-09-12T18:53:03.824 INFO:teuthology.orchestra.run.smithi111.stderr: 40500K .......... .......... .......... .......... .......... 43% 260M 0s 2024-09-12T18:53:03.824 INFO:teuthology.orchestra.run.smithi111.stderr: 40550K .......... .......... .......... .......... .......... 43% 290M 0s 2024-09-12T18:53:03.824 INFO:teuthology.orchestra.run.smithi111.stderr: 40600K .......... .......... .......... .......... .......... 43% 235M 0s 2024-09-12T18:53:03.824 INFO:teuthology.orchestra.run.smithi111.stderr: 40650K .......... .......... .......... .......... .......... 43% 184M 0s 2024-09-12T18:53:03.824 INFO:teuthology.orchestra.run.smithi111.stderr: 40700K .......... .......... .......... .......... .......... 43% 185M 0s 2024-09-12T18:53:03.824 INFO:teuthology.orchestra.run.smithi111.stderr: 40750K .......... .......... .......... .......... .......... 43% 243M 0s 2024-09-12T18:53:03.824 INFO:teuthology.orchestra.run.smithi111.stderr: 40800K .......... .......... .......... .......... .......... 43% 240M 0s 2024-09-12T18:53:03.825 INFO:teuthology.orchestra.run.smithi111.stderr: 40850K .......... .......... .......... .......... .......... 44% 324M 0s 2024-09-12T18:53:03.825 INFO:teuthology.orchestra.run.smithi111.stderr: 40900K .......... .......... .......... .......... .......... 44% 114M 0s 2024-09-12T18:53:03.825 INFO:teuthology.orchestra.run.smithi111.stderr: 40950K .......... .......... .......... .......... .......... 44% 253M 0s 2024-09-12T18:53:03.825 INFO:teuthology.orchestra.run.smithi111.stderr: 41000K .......... .......... .......... .......... .......... 44% 287M 0s 2024-09-12T18:53:03.825 INFO:teuthology.orchestra.run.smithi111.stderr: 41050K .......... .......... .......... .......... .......... 44% 213M 0s 2024-09-12T18:53:03.825 INFO:teuthology.orchestra.run.smithi111.stderr: 41100K .......... .......... .......... .......... .......... 44% 272M 0s 2024-09-12T18:53:03.825 INFO:teuthology.orchestra.run.smithi111.stderr: 41150K .......... .......... .......... .......... .......... 44% 247M 0s 2024-09-12T18:53:03.825 INFO:teuthology.orchestra.run.smithi111.stderr: 41200K .......... .......... .......... .......... .......... 44% 300M 0s 2024-09-12T18:53:03.825 INFO:teuthology.orchestra.run.smithi111.stderr: 41250K .......... .......... .......... .......... .......... 44% 320M 0s 2024-09-12T18:53:03.825 INFO:teuthology.orchestra.run.smithi111.stderr: 41300K .......... .......... .......... .......... .......... 44% 302M 0s 2024-09-12T18:53:03.825 INFO:teuthology.orchestra.run.smithi111.stderr: 41350K .......... .......... .......... .......... .......... 44% 270M 0s 2024-09-12T18:53:03.826 INFO:teuthology.orchestra.run.smithi111.stderr: 41400K .......... .......... .......... .......... .......... 44% 282M 0s 2024-09-12T18:53:03.826 INFO:teuthology.orchestra.run.smithi111.stderr: 41450K .......... .......... .......... .......... .......... 44% 144M 0s 2024-09-12T18:53:03.826 INFO:teuthology.orchestra.run.smithi111.stderr: 41500K .......... .......... .......... .......... .......... 44% 272M 0s 2024-09-12T18:53:03.826 INFO:teuthology.orchestra.run.smithi111.stderr: 41550K .......... .......... .......... .......... .......... 44% 250M 0s 2024-09-12T18:53:03.826 INFO:teuthology.orchestra.run.smithi111.stderr: 41600K .......... .......... .......... .......... .......... 44% 293M 0s 2024-09-12T18:53:03.826 INFO:teuthology.orchestra.run.smithi111.stderr: 41650K .......... .......... .......... .......... .......... 44% 275M 0s 2024-09-12T18:53:03.826 INFO:teuthology.orchestra.run.smithi111.stderr: 41700K .......... .......... .......... .......... .......... 44% 215M 0s 2024-09-12T18:53:03.826 INFO:teuthology.orchestra.run.smithi111.stderr: 41750K .......... .......... .......... .......... .......... 44% 125M 0s 2024-09-12T18:53:03.826 INFO:teuthology.orchestra.run.smithi111.stderr: 41800K .......... .......... .......... .......... .......... 45% 268M 0s 2024-09-12T18:53:03.826 INFO:teuthology.orchestra.run.smithi111.stderr: 41850K .......... .......... .......... .......... .......... 45% 285M 0s 2024-09-12T18:53:03.826 INFO:teuthology.orchestra.run.smithi111.stderr: 41900K .......... .......... .......... .......... .......... 45% 273M 0s 2024-09-12T18:53:03.826 INFO:teuthology.orchestra.run.smithi111.stderr: 41950K .......... .......... .......... .......... .......... 45% 248M 0s 2024-09-12T18:53:03.827 INFO:teuthology.orchestra.run.smithi111.stderr: 42000K .......... .......... .......... .......... .......... 45% 199M 0s 2024-09-12T18:53:03.827 INFO:teuthology.orchestra.run.smithi111.stderr: 42050K .......... .......... .......... .......... .......... 45% 264M 0s 2024-09-12T18:53:03.827 INFO:teuthology.orchestra.run.smithi111.stderr: 42100K .......... .......... .......... .......... .......... 45% 303M 0s 2024-09-12T18:53:03.827 INFO:teuthology.orchestra.run.smithi111.stderr: 42150K .......... .......... .......... .......... .......... 45% 254M 0s 2024-09-12T18:53:03.827 INFO:teuthology.orchestra.run.smithi111.stderr: 42200K .......... .......... .......... .......... .......... 45% 310M 0s 2024-09-12T18:53:03.827 INFO:teuthology.orchestra.run.smithi111.stderr: 42250K .......... .......... .......... .......... .......... 45% 66.3M 0s 2024-09-12T18:53:03.827 INFO:teuthology.orchestra.run.smithi111.stderr: 42300K .......... .......... .......... .......... .......... 45% 177M 0s 2024-09-12T18:53:03.827 INFO:teuthology.orchestra.run.smithi111.stderr: 42350K .......... .......... .......... .......... .......... 45% 224M 0s 2024-09-12T18:53:03.827 INFO:teuthology.orchestra.run.smithi111.stderr: 42400K .......... .......... .......... .......... .......... 45% 279M 0s 2024-09-12T18:53:03.827 INFO:teuthology.orchestra.run.smithi111.stderr: 42450K .......... .......... .......... .......... .......... 45% 298M 0s 2024-09-12T18:53:03.827 INFO:teuthology.orchestra.run.smithi111.stderr: 42500K .......... .......... .......... .......... .......... 45% 159M 0s 2024-09-12T18:53:03.827 INFO:teuthology.orchestra.run.smithi111.stderr: 42550K .......... .......... .......... .......... .......... 45% 189M 0s 2024-09-12T18:53:03.828 INFO:teuthology.orchestra.run.smithi111.stderr: 42600K .......... .......... .......... .......... .......... 45% 316M 0s 2024-09-12T18:53:03.828 INFO:teuthology.orchestra.run.smithi111.stderr: 42650K .......... .......... .......... .......... .......... 45% 313M 0s 2024-09-12T18:53:03.828 INFO:teuthology.orchestra.run.smithi111.stderr: 42700K .......... .......... .......... .......... .......... 46% 322M 0s 2024-09-12T18:53:03.828 INFO:teuthology.orchestra.run.smithi111.stderr: 42750K .......... .......... .......... .......... .......... 46% 112M 0s 2024-09-12T18:53:03.828 INFO:teuthology.orchestra.run.smithi111.stderr: 42800K .......... .......... .......... .......... .......... 46% 313M 0s 2024-09-12T18:53:03.828 INFO:teuthology.orchestra.run.smithi111.stderr: 42850K .......... .......... .......... .......... .......... 46% 192M 0s 2024-09-12T18:53:03.828 INFO:teuthology.orchestra.run.smithi111.stderr: 42900K .......... .......... .......... .......... .......... 46% 286M 0s 2024-09-12T18:53:03.828 INFO:teuthology.orchestra.run.smithi111.stderr: 42950K .......... .......... .......... .......... .......... 46% 234M 0s 2024-09-12T18:53:03.828 INFO:teuthology.orchestra.run.smithi111.stderr: 43000K .......... .......... .......... .......... .......... 46% 283M 0s 2024-09-12T18:53:03.828 INFO:teuthology.orchestra.run.smithi111.stderr: 43050K .......... .......... .......... .......... .......... 46% 336M 0s 2024-09-12T18:53:03.828 INFO:teuthology.orchestra.run.smithi111.stderr: 43100K .......... .......... .......... .......... .......... 46% 155M 0s 2024-09-12T18:53:03.828 INFO:teuthology.orchestra.run.smithi111.stderr: 43150K .......... .......... .......... .......... .......... 46% 153M 0s 2024-09-12T18:53:03.828 INFO:teuthology.orchestra.run.smithi111.stderr: 43200K .......... .......... .......... .......... .......... 46% 104M 0s 2024-09-12T18:53:03.829 INFO:teuthology.orchestra.run.smithi111.stderr: 43250K .......... .......... .......... .......... .......... 46% 307M 0s 2024-09-12T18:53:03.829 INFO:teuthology.orchestra.run.smithi111.stderr: 43300K .......... .......... .......... .......... .......... 46% 318M 0s 2024-09-12T18:53:03.829 INFO:teuthology.orchestra.run.smithi111.stderr: 43350K .......... .......... .......... .......... .......... 46% 276M 0s 2024-09-12T18:53:03.829 INFO:teuthology.orchestra.run.smithi111.stderr: 43400K .......... .......... .......... .......... .......... 46% 113M 0s 2024-09-12T18:53:03.829 INFO:teuthology.orchestra.run.smithi111.stderr: 43450K .......... .......... .......... .......... .......... 46% 290M 0s 2024-09-12T18:53:03.829 INFO:teuthology.orchestra.run.smithi111.stderr: 43500K .......... .......... .......... .......... .......... 46% 170M 0s 2024-09-12T18:53:03.829 INFO:teuthology.orchestra.run.smithi111.stderr: 43550K .......... .......... .......... .......... .......... 46% 274M 0s 2024-09-12T18:53:03.829 INFO:teuthology.orchestra.run.smithi111.stderr: 43600K .......... .......... .......... .......... .......... 46% 189M 0s 2024-09-12T18:53:03.829 INFO:teuthology.orchestra.run.smithi111.stderr: 43650K .......... .......... .......... .......... .......... 47% 148M 0s 2024-09-12T18:53:03.829 INFO:teuthology.orchestra.run.smithi111.stderr: 43700K .......... .......... .......... .......... .......... 47% 208M 0s 2024-09-12T18:53:03.829 INFO:teuthology.orchestra.run.smithi111.stderr: 43750K .......... .......... .......... .......... .......... 47% 249M 0s 2024-09-12T18:53:03.829 INFO:teuthology.orchestra.run.smithi111.stderr: 43800K .......... .......... .......... .......... .......... 47% 295M 0s 2024-09-12T18:53:03.829 INFO:teuthology.orchestra.run.smithi111.stderr: 43850K .......... .......... .......... .......... .......... 47% 117M 0s 2024-09-12T18:53:03.830 INFO:teuthology.orchestra.run.smithi111.stderr: 43900K .......... .......... .......... .......... .......... 47% 294M 0s 2024-09-12T18:53:03.830 INFO:teuthology.orchestra.run.smithi111.stderr: 43950K .......... .......... .......... .......... .......... 47% 199M 0s 2024-09-12T18:53:03.830 INFO:teuthology.orchestra.run.smithi111.stderr: 44000K .......... .......... .......... .......... .......... 47% 273M 0s 2024-09-12T18:53:03.830 INFO:teuthology.orchestra.run.smithi111.stderr: 44050K .......... .......... .......... .......... .......... 47% 295M 0s 2024-09-12T18:53:03.830 INFO:teuthology.orchestra.run.smithi111.stderr: 44100K .......... .......... .......... .......... .......... 47% 327M 0s 2024-09-12T18:53:03.830 INFO:teuthology.orchestra.run.smithi111.stderr: 44150K .......... .......... .......... .......... .......... 47% 200M 0s 2024-09-12T18:53:03.830 INFO:teuthology.orchestra.run.smithi111.stderr: 44200K .......... .......... .......... .......... .......... 47% 320M 0s 2024-09-12T18:53:03.830 INFO:teuthology.orchestra.run.smithi111.stderr: 44250K .......... .......... .......... .......... .......... 47% 316M 0s 2024-09-12T18:53:03.830 INFO:teuthology.orchestra.run.smithi111.stderr: 44300K .......... .......... .......... .......... .......... 47% 325M 0s 2024-09-12T18:53:03.830 INFO:teuthology.orchestra.run.smithi111.stderr: 44350K .......... .......... .......... .......... .......... 47% 239M 0s 2024-09-12T18:53:03.830 INFO:teuthology.orchestra.run.smithi111.stderr: 44400K .......... .......... .......... .......... .......... 47% 280M 0s 2024-09-12T18:53:03.831 INFO:teuthology.orchestra.run.smithi111.stderr: 44450K .......... .......... .......... .......... .......... 47% 309M 0s 2024-09-12T18:53:03.831 INFO:teuthology.orchestra.run.smithi111.stderr: 44500K .......... .......... .......... .......... .......... 47% 291M 0s 2024-09-12T18:53:03.831 INFO:teuthology.orchestra.run.smithi111.stderr: 44550K .......... .......... .......... .......... .......... 48% 277M 0s 2024-09-12T18:53:03.831 INFO:teuthology.orchestra.run.smithi111.stderr: 44600K .......... .......... .......... .......... .......... 48% 283M 0s 2024-09-12T18:53:03.831 INFO:teuthology.orchestra.run.smithi111.stderr: 44650K .......... .......... .......... .......... .......... 48% 270M 0s 2024-09-12T18:53:03.831 INFO:teuthology.orchestra.run.smithi111.stderr: 44700K .......... .......... .......... .......... .......... 48% 304M 0s 2024-09-12T18:53:03.831 INFO:teuthology.orchestra.run.smithi111.stderr: 44750K .......... .......... .......... .......... .......... 48% 245M 0s 2024-09-12T18:53:03.831 INFO:teuthology.orchestra.run.smithi111.stderr: 44800K .......... .......... .......... .......... .......... 48% 293M 0s 2024-09-12T18:53:03.831 INFO:teuthology.orchestra.run.smithi111.stderr: 44850K .......... .......... .......... .......... .......... 48% 333M 0s 2024-09-12T18:53:03.831 INFO:teuthology.orchestra.run.smithi111.stderr: 44900K .......... .......... .......... .......... .......... 48% 297M 0s 2024-09-12T18:53:03.831 INFO:teuthology.orchestra.run.smithi111.stderr: 44950K .......... .......... .......... .......... .......... 48% 240M 0s 2024-09-12T18:53:03.832 INFO:teuthology.orchestra.run.smithi111.stderr: 45000K .......... .......... .......... .......... .......... 48% 339M 0s 2024-09-12T18:53:03.832 INFO:teuthology.orchestra.run.smithi111.stderr: 45050K .......... .......... .......... .......... .......... 48% 301M 0s 2024-09-12T18:53:03.832 INFO:teuthology.orchestra.run.smithi111.stderr: 45100K .......... .......... .......... .......... .......... 48% 298M 0s 2024-09-12T18:53:03.832 INFO:teuthology.orchestra.run.smithi111.stderr: 45150K .......... .......... .......... .......... .......... 48% 190M 0s 2024-09-12T18:53:03.832 INFO:teuthology.orchestra.run.smithi111.stderr: 45200K .......... .......... .......... .......... .......... 48% 330M 0s 2024-09-12T18:53:03.832 INFO:teuthology.orchestra.run.smithi111.stderr: 45250K .......... .......... .......... .......... .......... 48% 286M 0s 2024-09-12T18:53:03.832 INFO:teuthology.orchestra.run.smithi111.stderr: 45300K .......... .......... .......... .......... .......... 48% 101M 0s 2024-09-12T18:53:03.832 INFO:teuthology.orchestra.run.smithi111.stderr: 45350K .......... .......... .......... .......... .......... 48% 197M 0s 2024-09-12T18:53:03.832 INFO:teuthology.orchestra.run.smithi111.stderr: 45400K .......... .......... .......... .......... .......... 48% 285M 0s 2024-09-12T18:53:03.832 INFO:teuthology.orchestra.run.smithi111.stderr: 45450K .......... .......... .......... .......... .......... 48% 149M 0s 2024-09-12T18:53:03.832 INFO:teuthology.orchestra.run.smithi111.stderr: 45500K .......... .......... .......... .......... .......... 49% 304M 0s 2024-09-12T18:53:03.832 INFO:teuthology.orchestra.run.smithi111.stderr: 45550K .......... .......... .......... .......... .......... 49% 254M 0s 2024-09-12T18:53:03.833 INFO:teuthology.orchestra.run.smithi111.stderr: 45600K .......... .......... .......... .......... .......... 49% 240M 0s 2024-09-12T18:53:03.833 INFO:teuthology.orchestra.run.smithi111.stderr: 45650K .......... .......... .......... .......... .......... 49% 299M 0s 2024-09-12T18:53:03.833 INFO:teuthology.orchestra.run.smithi111.stderr: 45700K .......... .......... .......... .......... .......... 49% 242M 0s 2024-09-12T18:53:03.833 INFO:teuthology.orchestra.run.smithi111.stderr: 45750K .......... .......... .......... .......... .......... 49% 238M 0s 2024-09-12T18:53:03.833 INFO:teuthology.orchestra.run.smithi111.stderr: 45800K .......... .......... .......... .......... .......... 49% 272M 0s 2024-09-12T18:53:03.833 INFO:teuthology.orchestra.run.smithi111.stderr: 45850K .......... .......... .......... .......... .......... 49% 323M 0s 2024-09-12T18:53:03.833 INFO:teuthology.orchestra.run.smithi111.stderr: 45900K .......... .......... .......... .......... .......... 49% 111M 0s 2024-09-12T18:53:03.833 INFO:teuthology.orchestra.run.smithi111.stderr: 45950K .......... .......... .......... .......... .......... 49% 182M 0s 2024-09-12T18:53:03.833 INFO:teuthology.orchestra.run.smithi111.stderr: 46000K .......... .......... .......... .......... .......... 49% 91.5M 0s 2024-09-12T18:53:03.833 INFO:teuthology.orchestra.run.smithi111.stderr: 46050K .......... .......... .......... .......... .......... 49% 288M 0s 2024-09-12T18:53:03.833 INFO:teuthology.orchestra.run.smithi111.stderr: 46100K .......... .......... .......... .......... .......... 49% 338M 0s 2024-09-12T18:53:03.834 INFO:teuthology.orchestra.run.smithi111.stderr: 46150K .......... .......... .......... .......... .......... 49% 260M 0s 2024-09-12T18:53:03.834 INFO:teuthology.orchestra.run.smithi111.stderr: 46200K .......... .......... .......... .......... .......... 49% 72.0M 0s 2024-09-12T18:53:03.834 INFO:teuthology.orchestra.run.smithi111.stderr: 46250K .......... .......... .......... .......... .......... 49% 89.0M 0s 2024-09-12T18:53:03.834 INFO:teuthology.orchestra.run.smithi111.stderr: 46300K .......... .......... .......... .......... .......... 49% 278M 0s 2024-09-12T18:53:03.834 INFO:teuthology.orchestra.run.smithi111.stderr: 46350K .......... .......... .......... .......... .......... 49% 263M 0s 2024-09-12T18:53:03.834 INFO:teuthology.orchestra.run.smithi111.stderr: 46400K .......... .......... .......... .......... .......... 49% 327M 0s 2024-09-12T18:53:03.834 INFO:teuthology.orchestra.run.smithi111.stderr: 46450K .......... .......... .......... .......... .......... 50% 294M 0s 2024-09-12T18:53:03.834 INFO:teuthology.orchestra.run.smithi111.stderr: 46500K .......... .......... .......... .......... .......... 50% 302M 0s 2024-09-12T18:53:03.836 INFO:teuthology.orchestra.run.smithi111.stderr: 46550K .......... .......... .......... .......... .......... 50% 319M 0s 2024-09-12T18:53:03.836 INFO:teuthology.orchestra.run.smithi111.stderr: 46600K .......... .......... .......... .......... .......... 50% 281M 0s 2024-09-12T18:53:03.836 INFO:teuthology.orchestra.run.smithi111.stderr: 46650K .......... .......... .......... .......... .......... 50% 331M 0s 2024-09-12T18:53:03.836 INFO:teuthology.orchestra.run.smithi111.stderr: 46700K .......... .......... .......... .......... .......... 50% 125M 0s 2024-09-12T18:53:03.836 INFO:teuthology.orchestra.run.smithi111.stderr: 46750K .......... .......... .......... .......... .......... 50% 226M 0s 2024-09-12T18:53:03.836 INFO:teuthology.orchestra.run.smithi111.stderr: 46800K .......... .......... .......... .......... .......... 50% 304M 0s 2024-09-12T18:53:03.836 INFO:teuthology.orchestra.run.smithi111.stderr: 46850K .......... .......... .......... .......... .......... 50% 84.5M 0s 2024-09-12T18:53:03.836 INFO:teuthology.orchestra.run.smithi111.stderr: 46900K .......... .......... .......... .......... .......... 50% 299M 0s 2024-09-12T18:53:03.836 INFO:teuthology.orchestra.run.smithi111.stderr: 46950K .......... .......... .......... .......... .......... 50% 270M 0s 2024-09-12T18:53:03.836 INFO:teuthology.orchestra.run.smithi111.stderr: 47000K .......... .......... .......... .......... .......... 50% 301M 0s 2024-09-12T18:53:03.836 INFO:teuthology.orchestra.run.smithi111.stderr: 47050K .......... .......... .......... .......... .......... 50% 259M 0s 2024-09-12T18:53:03.837 INFO:teuthology.orchestra.run.smithi111.stderr: 47100K .......... .......... .......... .......... .......... 50% 279M 0s 2024-09-12T18:53:03.837 INFO:teuthology.orchestra.run.smithi111.stderr: 47150K .......... .......... .......... .......... .......... 50% 264M 0s 2024-09-12T18:53:03.837 INFO:teuthology.orchestra.run.smithi111.stderr: 47200K .......... .......... .......... .......... .......... 50% 314M 0s 2024-09-12T18:53:03.837 INFO:teuthology.orchestra.run.smithi111.stderr: 47250K .......... .......... .......... .......... .......... 50% 237M 0s 2024-09-12T18:53:03.837 INFO:teuthology.orchestra.run.smithi111.stderr: 47300K .......... .......... .......... .......... .......... 50% 317M 0s 2024-09-12T18:53:03.837 INFO:teuthology.orchestra.run.smithi111.stderr: 47350K .......... .......... .......... .......... .......... 51% 277M 0s 2024-09-12T18:53:03.837 INFO:teuthology.orchestra.run.smithi111.stderr: 47400K .......... .......... .......... .......... .......... 51% 326M 0s 2024-09-12T18:53:03.837 INFO:teuthology.orchestra.run.smithi111.stderr: 47450K .......... .......... .......... .......... .......... 51% 295M 0s 2024-09-12T18:53:03.837 INFO:teuthology.orchestra.run.smithi111.stderr: 47500K .......... .......... .......... .......... .......... 51% 252M 0s 2024-09-12T18:53:03.837 INFO:teuthology.orchestra.run.smithi111.stderr: 47550K .......... .......... .......... .......... .......... 51% 292M 0s 2024-09-12T18:53:03.838 INFO:teuthology.orchestra.run.smithi111.stderr: 47600K .......... .......... .......... .......... .......... 51% 289M 0s 2024-09-12T18:53:03.838 INFO:teuthology.orchestra.run.smithi111.stderr: 47650K .......... .......... .......... .......... .......... 51% 242M 0s 2024-09-12T18:53:03.838 INFO:teuthology.orchestra.run.smithi111.stderr: 47700K .......... .......... .......... .......... .......... 51% 286M 0s 2024-09-12T18:53:03.838 INFO:teuthology.orchestra.run.smithi111.stderr: 47750K .......... .......... .......... .......... .......... 51% 283M 0s 2024-09-12T18:53:03.838 INFO:teuthology.orchestra.run.smithi111.stderr: 47800K .......... .......... .......... .......... .......... 51% 296M 0s 2024-09-12T18:53:03.838 INFO:teuthology.orchestra.run.smithi111.stderr: 47850K .......... .......... .......... .......... .......... 51% 295M 0s 2024-09-12T18:53:03.838 INFO:teuthology.orchestra.run.smithi111.stderr: 47900K .......... .......... .......... .......... .......... 51% 277M 0s 2024-09-12T18:53:03.838 INFO:teuthology.orchestra.run.smithi111.stderr: 47950K .......... .......... .......... .......... .......... 51% 290M 0s 2024-09-12T18:53:03.838 INFO:teuthology.orchestra.run.smithi111.stderr: 48000K .......... .......... .......... .......... .......... 51% 321M 0s 2024-09-12T18:53:03.838 INFO:teuthology.orchestra.run.smithi111.stderr: 48050K .......... .......... .......... .......... .......... 51% 234M 0s 2024-09-12T18:53:03.838 INFO:teuthology.orchestra.run.smithi111.stderr: 48100K .......... .......... .......... .......... .......... 51% 338M 0s 2024-09-12T18:53:03.838 INFO:teuthology.orchestra.run.smithi111.stderr: 48150K .......... .......... .......... .......... .......... 51% 338M 0s 2024-09-12T18:53:03.838 INFO:teuthology.orchestra.run.smithi111.stderr: 48200K .......... .......... .......... .......... .......... 51% 282M 0s 2024-09-12T18:53:03.839 INFO:teuthology.orchestra.run.smithi111.stderr: 48250K .......... .......... .......... .......... .......... 51% 276M 0s 2024-09-12T18:53:03.839 INFO:teuthology.orchestra.run.smithi111.stderr: 48300K .......... .......... .......... .......... .......... 52% 339M 0s 2024-09-12T18:53:03.839 INFO:teuthology.orchestra.run.smithi111.stderr: 48350K .......... .......... .......... .......... .......... 52% 317M 0s 2024-09-12T18:53:03.839 INFO:teuthology.orchestra.run.smithi111.stderr: 48400K .......... .......... .......... .......... .......... 52% 287M 0s 2024-09-12T18:53:03.839 INFO:teuthology.orchestra.run.smithi111.stderr: 48450K .......... .......... .......... .......... .......... 52% 251M 0s 2024-09-12T18:53:03.839 INFO:teuthology.orchestra.run.smithi111.stderr: 48500K .......... .......... .......... .......... .......... 52% 265M 0s 2024-09-12T18:53:03.839 INFO:teuthology.orchestra.run.smithi111.stderr: 48550K .......... .......... .......... .......... .......... 52% 310M 0s 2024-09-12T18:53:03.839 INFO:teuthology.orchestra.run.smithi111.stderr: 48600K .......... .......... .......... .......... .......... 52% 307M 0s 2024-09-12T18:53:03.839 INFO:teuthology.orchestra.run.smithi111.stderr: 48650K .......... .......... .......... .......... .......... 52% 287M 0s 2024-09-12T18:53:03.839 INFO:teuthology.orchestra.run.smithi111.stderr: 48700K .......... .......... .......... .......... .......... 52% 302M 0s 2024-09-12T18:53:03.839 INFO:teuthology.orchestra.run.smithi111.stderr: 48750K .......... .......... .......... .......... .......... 52% 302M 0s 2024-09-12T18:53:03.839 INFO:teuthology.orchestra.run.smithi111.stderr: 48800K .......... .......... .......... .......... .......... 52% 296M 0s 2024-09-12T18:53:03.839 INFO:teuthology.orchestra.run.smithi111.stderr: 48850K .......... .......... .......... .......... .......... 52% 225M 0s 2024-09-12T18:53:03.840 INFO:teuthology.orchestra.run.smithi111.stderr: 48900K .......... .......... .......... .......... .......... 52% 332M 0s 2024-09-12T18:53:03.840 INFO:teuthology.orchestra.run.smithi111.stderr: 48950K .......... .......... .......... .......... .......... 52% 208M 0s 2024-09-12T18:53:03.840 INFO:teuthology.orchestra.run.smithi111.stderr: 49000K .......... .......... .......... .......... .......... 52% 129M 0s 2024-09-12T18:53:03.840 INFO:teuthology.orchestra.run.smithi111.stderr: 49050K .......... .......... .......... .......... .......... 52% 172M 0s 2024-09-12T18:53:03.840 INFO:teuthology.orchestra.run.smithi111.stderr: 49100K .......... .......... .......... .......... .......... 52% 322M 0s 2024-09-12T18:53:03.840 INFO:teuthology.orchestra.run.smithi111.stderr: 49150K .......... .......... .......... .......... .......... 52% 265M 0s 2024-09-12T18:53:03.840 INFO:teuthology.orchestra.run.smithi111.stderr: 49200K .......... .......... .......... .......... .......... 53% 83.9M 0s 2024-09-12T18:53:03.840 INFO:teuthology.orchestra.run.smithi111.stderr: 49250K .......... .......... .......... .......... .......... 53% 66.2M 0s 2024-09-12T18:53:03.840 INFO:teuthology.orchestra.run.smithi111.stderr: 49300K .......... .......... .......... .......... .......... 53% 284M 0s 2024-09-12T18:53:03.840 INFO:teuthology.orchestra.run.smithi111.stderr: 49350K .......... .......... .......... .......... .......... 53% 342M 0s 2024-09-12T18:53:03.840 INFO:teuthology.orchestra.run.smithi111.stderr: 49400K .......... .......... .......... .......... .......... 53% 305M 0s 2024-09-12T18:53:03.840 INFO:teuthology.orchestra.run.smithi111.stderr: 49450K .......... .......... .......... .......... .......... 53% 307M 0s 2024-09-12T18:53:03.840 INFO:teuthology.orchestra.run.smithi111.stderr: 49500K .......... .......... .......... .......... .......... 53% 338M 0s 2024-09-12T18:53:03.841 INFO:teuthology.orchestra.run.smithi111.stderr: 49550K .......... .......... .......... .......... .......... 53% 342M 0s 2024-09-12T18:53:03.841 INFO:teuthology.orchestra.run.smithi111.stderr: 49600K .......... .......... .......... .......... .......... 53% 310M 0s 2024-09-12T18:53:03.841 INFO:teuthology.orchestra.run.smithi111.stderr: 49650K .......... .......... .......... .......... .......... 53% 284M 0s 2024-09-12T18:53:03.841 INFO:teuthology.orchestra.run.smithi111.stderr: 49700K .......... .......... .......... .......... .......... 53% 315M 0s 2024-09-12T18:53:03.841 INFO:teuthology.orchestra.run.smithi111.stderr: 49750K .......... .......... .......... .......... .......... 53% 240M 0s 2024-09-12T18:53:03.841 INFO:teuthology.orchestra.run.smithi111.stderr: 49800K .......... .......... .......... .......... .......... 53% 155M 0s 2024-09-12T18:53:03.841 INFO:teuthology.orchestra.run.smithi111.stderr: 49850K .......... .......... .......... .......... .......... 53% 292M 0s 2024-09-12T18:53:03.841 INFO:teuthology.orchestra.run.smithi111.stderr: 49900K .......... .......... .......... .......... .......... 53% 72.8M 0s 2024-09-12T18:53:03.841 INFO:teuthology.orchestra.run.smithi111.stderr: 49950K .......... .......... .......... .......... .......... 53% 140M 0s 2024-09-12T18:53:03.841 INFO:teuthology.orchestra.run.smithi111.stderr: 50000K .......... .......... .......... .......... .......... 53% 308M 0s 2024-09-12T18:53:03.841 INFO:teuthology.orchestra.run.smithi111.stderr: 50050K .......... .......... .......... .......... .......... 53% 228M 0s 2024-09-12T18:53:03.842 INFO:teuthology.orchestra.run.smithi111.stderr: 50100K .......... .......... .......... .......... .......... 53% 279M 0s 2024-09-12T18:53:03.842 INFO:teuthology.orchestra.run.smithi111.stderr: 50150K .......... .......... .......... .......... .......... 54% 289M 0s 2024-09-12T18:53:03.842 INFO:teuthology.orchestra.run.smithi111.stderr: 50200K .......... .......... .......... .......... .......... 54% 146M 0s 2024-09-12T18:53:03.842 INFO:teuthology.orchestra.run.smithi111.stderr: 50250K .......... .......... .......... .......... .......... 54% 272M 0s 2024-09-12T18:53:03.842 INFO:teuthology.orchestra.run.smithi111.stderr: 50300K .......... .......... .......... .......... .......... 54% 248M 0s 2024-09-12T18:53:03.842 INFO:teuthology.orchestra.run.smithi111.stderr: 50350K .......... .......... .......... .......... .......... 54% 344M 0s 2024-09-12T18:53:03.842 INFO:teuthology.orchestra.run.smithi111.stderr: 50400K .......... .......... .......... .......... .......... 54% 223M 0s 2024-09-12T18:53:03.842 INFO:teuthology.orchestra.run.smithi111.stderr: 50450K .......... .......... .......... .......... .......... 54% 242M 0s 2024-09-12T18:53:03.842 INFO:teuthology.orchestra.run.smithi111.stderr: 50500K .......... .......... .......... .......... .......... 54% 297M 0s 2024-09-12T18:53:03.842 INFO:teuthology.orchestra.run.smithi111.stderr: 50550K .......... .......... .......... .......... .......... 54% 318M 0s 2024-09-12T18:53:03.842 INFO:teuthology.orchestra.run.smithi111.stderr: 50600K .......... .......... .......... .......... .......... 54% 329M 0s 2024-09-12T18:53:03.842 INFO:teuthology.orchestra.run.smithi111.stderr: 50650K .......... .......... .......... .......... .......... 54% 133M 0s 2024-09-12T18:53:03.842 INFO:teuthology.orchestra.run.smithi111.stderr: 50700K .......... .......... .......... .......... .......... 54% 302M 0s 2024-09-12T18:53:03.842 INFO:teuthology.orchestra.run.smithi111.stderr: 50750K .......... .......... .......... .......... .......... 54% 308M 0s 2024-09-12T18:53:03.843 INFO:teuthology.orchestra.run.smithi111.stderr: 50800K .......... .......... .......... .......... .......... 54% 312M 0s 2024-09-12T18:53:03.843 INFO:teuthology.orchestra.run.smithi111.stderr: 50850K .......... .......... .......... .......... .......... 54% 235M 0s 2024-09-12T18:53:03.843 INFO:teuthology.orchestra.run.smithi111.stderr: 50900K .......... .......... .......... .......... .......... 54% 317M 0s 2024-09-12T18:53:03.843 INFO:teuthology.orchestra.run.smithi111.stderr: 50950K .......... .......... .......... .......... .......... 54% 311M 0s 2024-09-12T18:53:03.843 INFO:teuthology.orchestra.run.smithi111.stderr: 51000K .......... .......... .......... .......... .......... 54% 343M 0s 2024-09-12T18:53:03.843 INFO:teuthology.orchestra.run.smithi111.stderr: 51050K .......... .......... .......... .......... .......... 55% 281M 0s 2024-09-12T18:53:03.843 INFO:teuthology.orchestra.run.smithi111.stderr: 51100K .......... .......... .......... .......... .......... 55% 298M 0s 2024-09-12T18:53:03.843 INFO:teuthology.orchestra.run.smithi111.stderr: 51150K .......... .......... .......... .......... .......... 55% 313M 0s 2024-09-12T18:53:03.843 INFO:teuthology.orchestra.run.smithi111.stderr: 51200K .......... .......... .......... .......... .......... 55% 277M 0s 2024-09-12T18:53:03.843 INFO:teuthology.orchestra.run.smithi111.stderr: 51250K .......... .......... .......... .......... .......... 55% 321M 0s 2024-09-12T18:53:03.843 INFO:teuthology.orchestra.run.smithi111.stderr: 51300K .......... .......... .......... .......... .......... 55% 292M 0s 2024-09-12T18:53:03.843 INFO:teuthology.orchestra.run.smithi111.stderr: 51350K .......... .......... .......... .......... .......... 55% 295M 0s 2024-09-12T18:53:03.843 INFO:teuthology.orchestra.run.smithi111.stderr: 51400K .......... .......... .......... .......... .......... 55% 291M 0s 2024-09-12T18:53:03.843 INFO:teuthology.orchestra.run.smithi111.stderr: 51450K .......... .......... .......... .......... .......... 55% 320M 0s 2024-09-12T18:53:03.844 INFO:teuthology.orchestra.run.smithi111.stderr: 51500K .......... .......... .......... .......... .......... 55% 248M 0s 2024-09-12T18:53:03.844 INFO:teuthology.orchestra.run.smithi111.stderr: 51550K .......... .......... .......... .......... .......... 55% 308M 0s 2024-09-12T18:53:03.844 INFO:teuthology.orchestra.run.smithi111.stderr: 51600K .......... .......... .......... .......... .......... 55% 335M 0s 2024-09-12T18:53:03.844 INFO:teuthology.orchestra.run.smithi111.stderr: 51650K .......... .......... .......... .......... .......... 55% 287M 0s 2024-09-12T18:53:03.844 INFO:teuthology.orchestra.run.smithi111.stderr: 51700K .......... .......... .......... .......... .......... 55% 323M 0s 2024-09-12T18:53:03.844 INFO:teuthology.orchestra.run.smithi111.stderr: 51750K .......... .......... .......... .......... .......... 55% 290M 0s 2024-09-12T18:53:03.844 INFO:teuthology.orchestra.run.smithi111.stderr: 51800K .......... .......... .......... .......... .......... 55% 259M 0s 2024-09-12T18:53:03.844 INFO:teuthology.orchestra.run.smithi111.stderr: 51850K .......... .......... .......... .......... .......... 55% 330M 0s 2024-09-12T18:53:03.844 INFO:teuthology.orchestra.run.smithi111.stderr: 51900K .......... .......... .......... .......... .......... 55% 252M 0s 2024-09-12T18:53:03.844 INFO:teuthology.orchestra.run.smithi111.stderr: 51950K .......... .......... .......... .......... .......... 55% 301M 0s 2024-09-12T18:53:03.844 INFO:teuthology.orchestra.run.smithi111.stderr: 52000K .......... .......... .......... .......... .......... 56% 139M 0s 2024-09-12T18:53:03.844 INFO:teuthology.orchestra.run.smithi111.stderr: 52050K .......... .......... .......... .......... .......... 56% 308M 0s 2024-09-12T18:53:03.845 INFO:teuthology.orchestra.run.smithi111.stderr: 52100K .......... .......... .......... .......... .......... 56% 247M 0s 2024-09-12T18:53:03.845 INFO:teuthology.orchestra.run.smithi111.stderr: 52150K .......... .......... .......... .......... .......... 56% 345M 0s 2024-09-12T18:53:03.845 INFO:teuthology.orchestra.run.smithi111.stderr: 52200K .......... .......... .......... .......... .......... 56% 216M 0s 2024-09-12T18:53:03.845 INFO:teuthology.orchestra.run.smithi111.stderr: 52250K .......... .......... .......... .......... .......... 56% 127M 0s 2024-09-12T18:53:03.845 INFO:teuthology.orchestra.run.smithi111.stderr: 52300K .......... .......... .......... .......... .......... 56% 96.7M 0s 2024-09-12T18:53:03.845 INFO:teuthology.orchestra.run.smithi111.stderr: 52350K .......... .......... .......... .......... .......... 56% 297M 0s 2024-09-12T18:53:03.845 INFO:teuthology.orchestra.run.smithi111.stderr: 52400K .......... .......... .......... .......... .......... 56% 312M 0s 2024-09-12T18:53:03.845 INFO:teuthology.orchestra.run.smithi111.stderr: 52450K .......... .......... .......... .......... .......... 56% 227M 0s 2024-09-12T18:53:03.845 INFO:teuthology.orchestra.run.smithi111.stderr: 52500K .......... .......... .......... .......... .......... 56% 276M 0s 2024-09-12T18:53:03.845 INFO:teuthology.orchestra.run.smithi111.stderr: 52550K .......... .......... .......... .......... .......... 56% 256M 0s 2024-09-12T18:53:03.845 INFO:teuthology.orchestra.run.smithi111.stderr: 52600K .......... .......... .......... .......... .......... 56% 308M 0s 2024-09-12T18:53:03.845 INFO:teuthology.orchestra.run.smithi111.stderr: 52650K .......... .......... .......... .......... .......... 56% 346M 0s 2024-09-12T18:53:03.845 INFO:teuthology.orchestra.run.smithi111.stderr: 52700K .......... .......... .......... .......... .......... 56% 268M 0s 2024-09-12T18:53:03.846 INFO:teuthology.orchestra.run.smithi111.stderr: 52750K .......... .......... .......... .......... .......... 56% 277M 0s 2024-09-12T18:53:03.846 INFO:teuthology.orchestra.run.smithi111.stderr: 52800K .......... .......... .......... .......... .......... 56% 326M 0s 2024-09-12T18:53:03.846 INFO:teuthology.orchestra.run.smithi111.stderr: 52850K .......... .......... .......... .......... .......... 56% 355M 0s 2024-09-12T18:53:03.846 INFO:teuthology.orchestra.run.smithi111.stderr: 52900K .......... .......... .......... .......... .......... 56% 75.0M 0s 2024-09-12T18:53:03.846 INFO:teuthology.orchestra.run.smithi111.stderr: 52950K .......... .......... .......... .......... .......... 57% 201M 0s 2024-09-12T18:53:03.846 INFO:teuthology.orchestra.run.smithi111.stderr: 53000K .......... .......... .......... .......... .......... 57% 91.5M 0s 2024-09-12T18:53:03.846 INFO:teuthology.orchestra.run.smithi111.stderr: 53050K .......... .......... .......... .......... .......... 57% 297M 0s 2024-09-12T18:53:03.846 INFO:teuthology.orchestra.run.smithi111.stderr: 53100K .......... .......... .......... .......... .......... 57% 245M 0s 2024-09-12T18:53:03.846 INFO:teuthology.orchestra.run.smithi111.stderr: 53150K .......... .......... .......... .......... .......... 57% 390M 0s 2024-09-12T18:53:03.846 INFO:teuthology.orchestra.run.smithi111.stderr: 53200K .......... .......... .......... .......... .......... 57% 357M 0s 2024-09-12T18:53:03.846 INFO:teuthology.orchestra.run.smithi111.stderr: 53250K .......... .......... .......... .......... .......... 57% 332M 0s 2024-09-12T18:53:03.846 INFO:teuthology.orchestra.run.smithi111.stderr: 53300K .......... .......... .......... .......... .......... 57% 127M 0s 2024-09-12T18:53:03.846 INFO:teuthology.orchestra.run.smithi111.stderr: 53350K .......... .......... .......... .......... .......... 57% 209M 0s 2024-09-12T18:53:03.847 INFO:teuthology.orchestra.run.smithi111.stderr: 53400K .......... .......... .......... .......... .......... 57% 280M 0s 2024-09-12T18:53:03.847 INFO:teuthology.orchestra.run.smithi111.stderr: 53450K .......... .......... .......... .......... .......... 57% 334M 0s 2024-09-12T18:53:03.847 INFO:teuthology.orchestra.run.smithi111.stderr: 53500K .......... .......... .......... .......... .......... 57% 253M 0s 2024-09-12T18:53:03.847 INFO:teuthology.orchestra.run.smithi111.stderr: 53550K .......... .......... .......... .......... .......... 57% 187M 0s 2024-09-12T18:53:03.847 INFO:teuthology.orchestra.run.smithi111.stderr: 53600K .......... .......... .......... .......... .......... 57% 238M 0s 2024-09-12T18:53:03.847 INFO:teuthology.orchestra.run.smithi111.stderr: 53650K .......... .......... .......... .......... .......... 57% 307M 0s 2024-09-12T18:53:03.847 INFO:teuthology.orchestra.run.smithi111.stderr: 53700K .......... .......... .......... .......... .......... 57% 289M 0s 2024-09-12T18:53:03.847 INFO:teuthology.orchestra.run.smithi111.stderr: 53750K .......... .......... .......... .......... .......... 57% 189M 0s 2024-09-12T18:53:03.847 INFO:teuthology.orchestra.run.smithi111.stderr: 53800K .......... .......... .......... .......... .......... 57% 265M 0s 2024-09-12T18:53:03.847 INFO:teuthology.orchestra.run.smithi111.stderr: 53850K .......... .......... .......... .......... .......... 58% 232M 0s 2024-09-12T18:53:03.847 INFO:teuthology.orchestra.run.smithi111.stderr: 53900K .......... .......... .......... .......... .......... 58% 261M 0s 2024-09-12T18:53:03.847 INFO:teuthology.orchestra.run.smithi111.stderr: 53950K .......... .......... .......... .......... .......... 58% 331M 0s 2024-09-12T18:53:03.847 INFO:teuthology.orchestra.run.smithi111.stderr: 54000K .......... .......... .......... .......... .......... 58% 304M 0s 2024-09-12T18:53:03.848 INFO:teuthology.orchestra.run.smithi111.stderr: 54050K .......... .......... .......... .......... .......... 58% 335M 0s 2024-09-12T18:53:03.848 INFO:teuthology.orchestra.run.smithi111.stderr: 54100K .......... .......... .......... .......... .......... 58% 257M 0s 2024-09-12T18:53:03.848 INFO:teuthology.orchestra.run.smithi111.stderr: 54150K .......... .......... .......... .......... .......... 58% 274M 0s 2024-09-12T18:53:03.848 INFO:teuthology.orchestra.run.smithi111.stderr: 54200K .......... .......... .......... .......... .......... 58% 323M 0s 2024-09-12T18:53:03.848 INFO:teuthology.orchestra.run.smithi111.stderr: 54250K .......... .......... .......... .......... .......... 58% 337M 0s 2024-09-12T18:53:03.848 INFO:teuthology.orchestra.run.smithi111.stderr: 54300K .......... .......... .......... .......... .......... 58% 247M 0s 2024-09-12T18:53:03.848 INFO:teuthology.orchestra.run.smithi111.stderr: 54350K .......... .......... .......... .......... .......... 58% 324M 0s 2024-09-12T18:53:03.848 INFO:teuthology.orchestra.run.smithi111.stderr: 54400K .......... .......... .......... .......... .......... 58% 353M 0s 2024-09-12T18:53:03.848 INFO:teuthology.orchestra.run.smithi111.stderr: 54450K .......... .......... .......... .......... .......... 58% 318M 0s 2024-09-12T18:53:03.848 INFO:teuthology.orchestra.run.smithi111.stderr: 54500K .......... .......... .......... .......... .......... 58% 306M 0s 2024-09-12T18:53:03.848 INFO:teuthology.orchestra.run.smithi111.stderr: 54550K .......... .......... .......... .......... .......... 58% 285M 0s 2024-09-12T18:53:03.848 INFO:teuthology.orchestra.run.smithi111.stderr: 54600K .......... .......... .......... .......... .......... 58% 237M 0s 2024-09-12T18:53:03.848 INFO:teuthology.orchestra.run.smithi111.stderr: 54650K .......... .......... .......... .......... .......... 58% 306M 0s 2024-09-12T18:53:03.849 INFO:teuthology.orchestra.run.smithi111.stderr: 54700K .......... .......... .......... .......... .......... 58% 268M 0s 2024-09-12T18:53:03.849 INFO:teuthology.orchestra.run.smithi111.stderr: 54750K .......... .......... .......... .......... .......... 58% 259M 0s 2024-09-12T18:53:03.849 INFO:teuthology.orchestra.run.smithi111.stderr: 54800K .......... .......... .......... .......... .......... 59% 335M 0s 2024-09-12T18:53:03.849 INFO:teuthology.orchestra.run.smithi111.stderr: 54850K .......... .......... .......... .......... .......... 59% 338M 0s 2024-09-12T18:53:03.849 INFO:teuthology.orchestra.run.smithi111.stderr: 54900K .......... .......... .......... .......... .......... 59% 262M 0s 2024-09-12T18:53:03.849 INFO:teuthology.orchestra.run.smithi111.stderr: 54950K .......... .......... .......... .......... .......... 59% 320M 0s 2024-09-12T18:53:03.849 INFO:teuthology.orchestra.run.smithi111.stderr: 55000K .......... .......... .......... .......... .......... 59% 304M 0s 2024-09-12T18:53:03.849 INFO:teuthology.orchestra.run.smithi111.stderr: 55050K .......... .......... .......... .......... .......... 59% 321M 0s 2024-09-12T18:53:03.849 INFO:teuthology.orchestra.run.smithi111.stderr: 55100K .......... .......... .......... .......... .......... 59% 273M 0s 2024-09-12T18:53:03.849 INFO:teuthology.orchestra.run.smithi111.stderr: 55150K .......... .......... .......... .......... .......... 59% 338M 0s 2024-09-12T18:53:03.849 INFO:teuthology.orchestra.run.smithi111.stderr: 55200K .......... .......... .......... .......... .......... 59% 360M 0s 2024-09-12T18:53:03.850 INFO:teuthology.orchestra.run.smithi111.stderr: 55250K .......... .......... .......... .......... .......... 59% 306M 0s 2024-09-12T18:53:03.850 INFO:teuthology.orchestra.run.smithi111.stderr: 55300K .......... .......... .......... .......... .......... 59% 104M 0s 2024-09-12T18:53:03.850 INFO:teuthology.orchestra.run.smithi111.stderr: 55350K .......... .......... .......... .......... .......... 59% 338M 0s 2024-09-12T18:53:03.850 INFO:teuthology.orchestra.run.smithi111.stderr: 55400K .......... .......... .......... .......... .......... 59% 320M 0s 2024-09-12T18:53:03.850 INFO:teuthology.orchestra.run.smithi111.stderr: 55450K .......... .......... .......... .......... .......... 59% 127M 0s 2024-09-12T18:53:03.850 INFO:teuthology.orchestra.run.smithi111.stderr: 55500K .......... .......... .......... .......... .......... 59% 139M 0s 2024-09-12T18:53:03.850 INFO:teuthology.orchestra.run.smithi111.stderr: 55550K .......... .......... .......... .......... .......... 59% 289M 0s 2024-09-12T18:53:03.850 INFO:teuthology.orchestra.run.smithi111.stderr: 55600K .......... .......... .......... .......... .......... 59% 350M 0s 2024-09-12T18:53:03.850 INFO:teuthology.orchestra.run.smithi111.stderr: 55650K .......... .......... .......... .......... .......... 59% 329M 0s 2024-09-12T18:53:03.850 INFO:teuthology.orchestra.run.smithi111.stderr: 55700K .......... .......... .......... .......... .......... 60% 291M 0s 2024-09-12T18:53:03.850 INFO:teuthology.orchestra.run.smithi111.stderr: 55750K .......... .......... .......... .......... .......... 60% 220M 0s 2024-09-12T18:53:03.850 INFO:teuthology.orchestra.run.smithi111.stderr: 55800K .......... .......... .......... .......... .......... 60% 118M 0s 2024-09-12T18:53:03.850 INFO:teuthology.orchestra.run.smithi111.stderr: 55850K .......... .......... .......... .......... .......... 60% 348M 0s 2024-09-12T18:53:03.850 INFO:teuthology.orchestra.run.smithi111.stderr: 55900K .......... .......... .......... .......... .......... 60% 285M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 55950K .......... .......... .......... .......... .......... 60% 309M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 56000K .......... .......... .......... .......... .......... 60% 105M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 56050K .......... .......... .......... .......... .......... 60% 153M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 56100K .......... .......... .......... .......... .......... 60% 245M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 56150K .......... .......... .......... .......... .......... 60% 303M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 56200K .......... .......... .......... .......... .......... 60% 344M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 56250K .......... .......... .......... .......... .......... 60% 313M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 56300K .......... .......... .......... .......... .......... 60% 72.0M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 56350K .......... .......... .......... .......... .......... 60% 258M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 56400K .......... .......... .......... .......... .......... 60% 339M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 56450K .......... .......... .......... .......... .......... 60% 290M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 56500K .......... .......... .......... .......... .......... 60% 265M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 56550K .......... .......... .......... .......... .......... 60% 341M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 56600K .......... .......... .......... .......... .......... 60% 318M 0s 2024-09-12T18:53:03.851 INFO:teuthology.orchestra.run.smithi111.stderr: 56650K .......... .......... .......... .......... .......... 61% 208M 0s 2024-09-12T18:53:03.852 INFO:teuthology.orchestra.run.smithi111.stderr: 56700K .......... .......... .......... .......... .......... 61% 257M 0s 2024-09-12T18:53:03.852 INFO:teuthology.orchestra.run.smithi111.stderr: 56750K .......... .......... .......... .......... .......... 61% 339M 0s 2024-09-12T18:53:03.852 INFO:teuthology.orchestra.run.smithi111.stderr: 56800K .......... .......... .......... .......... .......... 61% 262M 0s 2024-09-12T18:53:03.852 INFO:teuthology.orchestra.run.smithi111.stderr: 56850K .......... .......... .......... .......... .......... 61% 314M 0s 2024-09-12T18:53:03.852 INFO:teuthology.orchestra.run.smithi111.stderr: 56900K .......... .......... .......... .......... .......... 61% 267M 0s 2024-09-12T18:53:03.852 INFO:teuthology.orchestra.run.smithi111.stderr: 56950K .......... .......... .......... .......... .......... 61% 287M 0s 2024-09-12T18:53:03.852 INFO:teuthology.orchestra.run.smithi111.stderr: 57000K .......... .......... .......... .......... .......... 61% 345M 0s 2024-09-12T18:53:03.852 INFO:teuthology.orchestra.run.smithi111.stderr: 57050K .......... .......... .......... .......... .......... 61% 246M 0s 2024-09-12T18:53:03.852 INFO:teuthology.orchestra.run.smithi111.stderr: 57100K .......... .......... .......... .......... .......... 61% 166M 0s 2024-09-12T18:53:03.852 INFO:teuthology.orchestra.run.smithi111.stderr: 57150K .......... .......... .......... .......... .......... 61% 225M 0s 2024-09-12T18:53:03.852 INFO:teuthology.orchestra.run.smithi111.stderr: 57200K .......... .......... .......... .......... .......... 61% 247M 0s 2024-09-12T18:53:03.852 INFO:teuthology.orchestra.run.smithi111.stderr: 57250K .......... .......... .......... .......... .......... 61% 287M 0s 2024-09-12T18:53:03.852 INFO:teuthology.orchestra.run.smithi111.stderr: 57300K .......... .......... .......... .......... .......... 61% 310M 0s 2024-09-12T18:53:03.853 INFO:teuthology.orchestra.run.smithi111.stderr: 57350K .......... .......... .......... .......... .......... 61% 341M 0s 2024-09-12T18:53:03.853 INFO:teuthology.orchestra.run.smithi111.stderr: 57400K .......... .......... .......... .......... .......... 61% 339M 0s 2024-09-12T18:53:03.853 INFO:teuthology.orchestra.run.smithi111.stderr: 57450K .......... .......... .......... .......... .......... 61% 122M 0s 2024-09-12T18:53:03.853 INFO:teuthology.orchestra.run.smithi111.stderr: 57500K .......... .......... .......... .......... .......... 61% 201M 0s 2024-09-12T18:53:03.853 INFO:teuthology.orchestra.run.smithi111.stderr: 57550K .......... .......... .......... .......... .......... 62% 353M 0s 2024-09-12T18:53:03.853 INFO:teuthology.orchestra.run.smithi111.stderr: 57600K .......... .......... .......... .......... .......... 62% 310M 0s 2024-09-12T18:53:03.853 INFO:teuthology.orchestra.run.smithi111.stderr: 57650K .......... .......... .......... .......... .......... 62% 119M 0s 2024-09-12T18:53:03.853 INFO:teuthology.orchestra.run.smithi111.stderr: 57700K .......... .......... .......... .......... .......... 62% 270M 0s 2024-09-12T18:53:03.853 INFO:teuthology.orchestra.run.smithi111.stderr: 57750K .......... .......... .......... .......... .......... 62% 313M 0s 2024-09-12T18:53:03.853 INFO:teuthology.orchestra.run.smithi111.stderr: 57800K .......... .......... .......... .......... .......... 62% 335M 0s 2024-09-12T18:53:03.853 INFO:teuthology.orchestra.run.smithi111.stderr: 57850K .......... .......... .......... .......... .......... 62% 352M 0s 2024-09-12T18:53:03.853 INFO:teuthology.orchestra.run.smithi111.stderr: 57900K .......... .......... .......... .......... .......... 62% 296M 0s 2024-09-12T18:53:03.854 INFO:teuthology.orchestra.run.smithi111.stderr: 57950K .......... .......... .......... .......... .......... 62% 280M 0s 2024-09-12T18:53:03.854 INFO:teuthology.orchestra.run.smithi111.stderr: 58000K .......... .......... .......... .......... .......... 62% 300M 0s 2024-09-12T18:53:03.854 INFO:teuthology.orchestra.run.smithi111.stderr: 58050K .......... .......... .......... .......... .......... 62% 310M 0s 2024-09-12T18:53:03.854 INFO:teuthology.orchestra.run.smithi111.stderr: 58100K .......... .......... .......... .......... .......... 62% 290M 0s 2024-09-12T18:53:03.854 INFO:teuthology.orchestra.run.smithi111.stderr: 58150K .......... .......... .......... .......... .......... 62% 164M 0s 2024-09-12T18:53:03.854 INFO:teuthology.orchestra.run.smithi111.stderr: 58200K .......... .......... .......... .......... .......... 62% 311M 0s 2024-09-12T18:53:03.854 INFO:teuthology.orchestra.run.smithi111.stderr: 58250K .......... .......... .......... .......... .......... 62% 334M 0s 2024-09-12T18:53:03.854 INFO:teuthology.orchestra.run.smithi111.stderr: 58300K .......... .......... .......... .......... .......... 62% 277M 0s 2024-09-12T18:53:03.854 INFO:teuthology.orchestra.run.smithi111.stderr: 58350K .......... .......... .......... .......... .......... 62% 331M 0s 2024-09-12T18:53:03.854 INFO:teuthology.orchestra.run.smithi111.stderr: 58400K .......... .......... .......... .......... .......... 62% 256M 0s 2024-09-12T18:53:03.854 INFO:teuthology.orchestra.run.smithi111.stderr: 58450K .......... .......... .......... .......... .......... 62% 254M 0s 2024-09-12T18:53:03.854 INFO:teuthology.orchestra.run.smithi111.stderr: 58500K .......... .......... .......... .......... .......... 63% 126M 0s 2024-09-12T18:53:03.854 INFO:teuthology.orchestra.run.smithi111.stderr: 58550K .......... .......... .......... .......... .......... 63% 335M 0s 2024-09-12T18:53:03.855 INFO:teuthology.orchestra.run.smithi111.stderr: 58600K .......... .......... .......... .......... .......... 63% 332M 0s 2024-09-12T18:53:03.855 INFO:teuthology.orchestra.run.smithi111.stderr: 58650K .......... .......... .......... .......... .......... 63% 315M 0s 2024-09-12T18:53:03.855 INFO:teuthology.orchestra.run.smithi111.stderr: 58700K .......... .......... .......... .......... .......... 63% 176M 0s 2024-09-12T18:53:03.855 INFO:teuthology.orchestra.run.smithi111.stderr: 58750K .......... .......... .......... .......... .......... 63% 196M 0s 2024-09-12T18:53:03.855 INFO:teuthology.orchestra.run.smithi111.stderr: 58800K .......... .......... .......... .......... .......... 63% 171M 0s 2024-09-12T18:53:03.855 INFO:teuthology.orchestra.run.smithi111.stderr: 58850K .......... .......... .......... .......... .......... 63% 131M 0s 2024-09-12T18:53:03.855 INFO:teuthology.orchestra.run.smithi111.stderr: 58900K .......... .......... .......... .......... .......... 63% 168M 0s 2024-09-12T18:53:03.855 INFO:teuthology.orchestra.run.smithi111.stderr: 58950K .......... .......... .......... .......... .......... 63% 308M 0s 2024-09-12T18:53:03.855 INFO:teuthology.orchestra.run.smithi111.stderr: 59000K .......... .......... .......... .......... .......... 63% 174M 0s 2024-09-12T18:53:03.855 INFO:teuthology.orchestra.run.smithi111.stderr: 59050K .......... .......... .......... .......... .......... 63% 212M 0s 2024-09-12T18:53:03.855 INFO:teuthology.orchestra.run.smithi111.stderr: 59100K .......... .......... .......... .......... .......... 63% 106M 0s 2024-09-12T18:53:03.855 INFO:teuthology.orchestra.run.smithi111.stderr: 59150K .......... .......... .......... .......... .......... 63% 296M 0s 2024-09-12T18:53:03.855 INFO:teuthology.orchestra.run.smithi111.stderr: 59200K .......... .......... .......... .......... .......... 63% 323M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59250K .......... .......... .......... .......... .......... 63% 346M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59300K .......... .......... .......... .......... .......... 63% 166M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59350K .......... .......... .......... .......... .......... 63% 69.7M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59400K .......... .......... .......... .......... .......... 63% 307M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59450K .......... .......... .......... .......... .......... 64% 317M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59500K .......... .......... .......... .......... .......... 64% 294M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59550K .......... .......... .......... .......... .......... 64% 309M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59600K .......... .......... .......... .......... .......... 64% 309M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59650K .......... .......... .......... .......... .......... 64% 345M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59700K .......... .......... .......... .......... .......... 64% 240M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59750K .......... .......... .......... .......... .......... 64% 350M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59800K .......... .......... .......... .......... .......... 64% 360M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59850K .......... .......... .......... .......... .......... 64% 361M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59900K .......... .......... .......... .......... .......... 64% 271M 0s 2024-09-12T18:53:03.856 INFO:teuthology.orchestra.run.smithi111.stderr: 59950K .......... .......... .......... .......... .......... 64% 302M 0s 2024-09-12T18:53:03.857 INFO:teuthology.orchestra.run.smithi111.stderr: 60000K .......... .......... .......... .......... .......... 64% 275M 0s 2024-09-12T18:53:03.857 INFO:teuthology.orchestra.run.smithi111.stderr: 60050K .......... .......... .......... .......... .......... 64% 312M 0s 2024-09-12T18:53:03.857 INFO:teuthology.orchestra.run.smithi111.stderr: 60100K .......... .......... .......... .......... .......... 64% 322M 0s 2024-09-12T18:53:03.857 INFO:teuthology.orchestra.run.smithi111.stderr: 60150K .......... .......... .......... .......... .......... 64% 187M 0s 2024-09-12T18:53:03.857 INFO:teuthology.orchestra.run.smithi111.stderr: 60200K .......... .......... .......... .......... .......... 64% 304M 0s 2024-09-12T18:53:03.857 INFO:teuthology.orchestra.run.smithi111.stderr: 60250K .......... .......... .......... .......... .......... 64% 243M 0s 2024-09-12T18:53:03.857 INFO:teuthology.orchestra.run.smithi111.stderr: 60300K .......... .......... .......... .......... .......... 64% 246M 0s 2024-09-12T18:53:03.857 INFO:teuthology.orchestra.run.smithi111.stderr: 60350K .......... .......... .......... .......... .......... 65% 296M 0s 2024-09-12T18:53:03.857 INFO:teuthology.orchestra.run.smithi111.stderr: 60400K .......... .......... .......... .......... .......... 65% 291M 0s 2024-09-12T18:53:03.857 INFO:teuthology.orchestra.run.smithi111.stderr: 60450K .......... .......... .......... .......... .......... 65% 157M 0s 2024-09-12T18:53:03.857 INFO:teuthology.orchestra.run.smithi111.stderr: 60500K .......... .......... .......... .......... .......... 65% 223M 0s 2024-09-12T18:53:03.857 INFO:teuthology.orchestra.run.smithi111.stderr: 60550K .......... .......... .......... .......... .......... 65% 299M 0s 2024-09-12T18:53:03.857 INFO:teuthology.orchestra.run.smithi111.stderr: 60600K .......... .......... .......... .......... .......... 65% 191M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 60650K .......... .......... .......... .......... .......... 65% 172M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 60700K .......... .......... .......... .......... .......... 65% 75.7M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 60750K .......... .......... .......... .......... .......... 65% 329M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 60800K .......... .......... .......... .......... .......... 65% 327M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 60850K .......... .......... .......... .......... .......... 65% 303M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 60900K .......... .......... .......... .......... .......... 65% 309M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 60950K .......... .......... .......... .......... .......... 65% 346M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 61000K .......... .......... .......... .......... .......... 65% 314M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 61050K .......... .......... .......... .......... .......... 65% 337M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 61100K .......... .......... .......... .......... .......... 65% 288M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 61150K .......... .......... .......... .......... .......... 65% 183M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 61200K .......... .......... .......... .......... .......... 65% 140M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 61250K .......... .......... .......... .......... .......... 65% 332M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 61300K .......... .......... .......... .......... .......... 66% 313M 0s 2024-09-12T18:53:03.858 INFO:teuthology.orchestra.run.smithi111.stderr: 61350K .......... .......... .......... .......... .......... 66% 333M 0s 2024-09-12T18:53:03.859 INFO:teuthology.orchestra.run.smithi111.stderr: 61400K .......... .......... .......... .......... .......... 66% 335M 0s 2024-09-12T18:53:03.859 INFO:teuthology.orchestra.run.smithi111.stderr: 61450K .......... .......... .......... .......... .......... 66% 351M 0s 2024-09-12T18:53:03.859 INFO:teuthology.orchestra.run.smithi111.stderr: 61500K .......... .......... .......... .......... .......... 66% 279M 0s 2024-09-12T18:53:03.859 INFO:teuthology.orchestra.run.smithi111.stderr: 61550K .......... .......... .......... .......... .......... 66% 102M 0s 2024-09-12T18:53:03.859 INFO:teuthology.orchestra.run.smithi111.stderr: 61600K .......... .......... .......... .......... .......... 66% 341M 0s 2024-09-12T18:53:03.859 INFO:teuthology.orchestra.run.smithi111.stderr: 61650K .......... .......... .......... .......... .......... 66% 280M 0s 2024-09-12T18:53:03.859 INFO:teuthology.orchestra.run.smithi111.stderr: 61700K .......... .......... .......... .......... .......... 66% 340M 0s 2024-09-12T18:53:03.859 INFO:teuthology.orchestra.run.smithi111.stderr: 61750K .......... .......... .......... .......... .......... 66% 280M 0s 2024-09-12T18:53:03.859 INFO:teuthology.orchestra.run.smithi111.stderr: 61800K .......... .......... .......... .......... .......... 66% 147M 0s 2024-09-12T18:53:03.859 INFO:teuthology.orchestra.run.smithi111.stderr: 61850K .......... .......... .......... .......... .......... 66% 120M 0s 2024-09-12T18:53:03.859 INFO:teuthology.orchestra.run.smithi111.stderr: 61900K .......... .......... .......... .......... .......... 66% 376M 0s 2024-09-12T18:53:03.859 INFO:teuthology.orchestra.run.smithi111.stderr: 61950K .......... .......... .......... .......... .......... 66% 147M 0s 2024-09-12T18:53:03.860 INFO:teuthology.orchestra.run.smithi111.stderr: 62000K .......... .......... .......... .......... .......... 66% 364M 0s 2024-09-12T18:53:03.860 INFO:teuthology.orchestra.run.smithi111.stderr: 62050K .......... .......... .......... .......... .......... 66% 138M 0s 2024-09-12T18:53:03.860 INFO:teuthology.orchestra.run.smithi111.stderr: 62100K .......... .......... .......... .......... .......... 66% 254M 0s 2024-09-12T18:53:03.860 INFO:teuthology.orchestra.run.smithi111.stderr: 62150K .......... .......... .......... .......... .......... 66% 296M 0s 2024-09-12T18:53:03.860 INFO:teuthology.orchestra.run.smithi111.stderr: 62200K .......... .......... .......... .......... .......... 67% 396M 0s 2024-09-12T18:53:03.860 INFO:teuthology.orchestra.run.smithi111.stderr: 62250K .......... .......... .......... .......... .......... 67% 200M 0s 2024-09-12T18:53:03.860 INFO:teuthology.orchestra.run.smithi111.stderr: 62300K .......... .......... .......... .......... .......... 67% 392M 0s 2024-09-12T18:53:03.860 INFO:teuthology.orchestra.run.smithi111.stderr: 62350K .......... .......... .......... .......... .......... 67% 85.9M 0s 2024-09-12T18:53:03.860 INFO:teuthology.orchestra.run.smithi111.stderr: 62400K .......... .......... .......... .......... .......... 67% 388M 0s 2024-09-12T18:53:03.860 INFO:teuthology.orchestra.run.smithi111.stderr: 62450K .......... .......... .......... .......... .......... 67% 318M 0s 2024-09-12T18:53:03.860 INFO:teuthology.orchestra.run.smithi111.stderr: 62500K .......... .......... .......... .......... .......... 67% 133M 0s 2024-09-12T18:53:03.860 INFO:teuthology.orchestra.run.smithi111.stderr: 62550K .......... .......... .......... .......... .......... 67% 287M 0s 2024-09-12T18:53:03.861 INFO:teuthology.orchestra.run.smithi111.stderr: 62600K .......... .......... .......... .......... .......... 67% 145M 0s 2024-09-12T18:53:03.861 INFO:teuthology.orchestra.run.smithi111.stderr: 62650K .......... .......... .......... .......... .......... 67% 231M 0s 2024-09-12T18:53:03.861 INFO:teuthology.orchestra.run.smithi111.stderr: 62700K .......... .......... .......... .......... .......... 67% 194M 0s 2024-09-12T18:53:03.861 INFO:teuthology.orchestra.run.smithi111.stderr: 62750K .......... .......... .......... .......... .......... 67% 249M 0s 2024-09-12T18:53:03.861 INFO:teuthology.orchestra.run.smithi111.stderr: 62800K .......... .......... .......... .......... .......... 67% 268M 0s 2024-09-12T18:53:03.861 INFO:teuthology.orchestra.run.smithi111.stderr: 62850K .......... .......... .......... .......... .......... 67% 362M 0s 2024-09-12T18:53:03.861 INFO:teuthology.orchestra.run.smithi111.stderr: 62900K .......... .......... .......... .......... .......... 67% 318M 0s 2024-09-12T18:53:03.861 INFO:teuthology.orchestra.run.smithi111.stderr: 62950K .......... .......... .......... .......... .......... 67% 334M 0s 2024-09-12T18:53:03.861 INFO:teuthology.orchestra.run.smithi111.stderr: 63000K .......... .......... .......... .......... .......... 67% 280M 0s 2024-09-12T18:53:03.861 INFO:teuthology.orchestra.run.smithi111.stderr: 63050K .......... .......... .......... .......... .......... 67% 76.0M 0s 2024-09-12T18:53:03.861 INFO:teuthology.orchestra.run.smithi111.stderr: 63100K .......... .......... .......... .......... .......... 67% 377M 0s 2024-09-12T18:53:03.861 INFO:teuthology.orchestra.run.smithi111.stderr: 63150K .......... .......... .......... .......... .......... 68% 286M 0s 2024-09-12T18:53:03.861 INFO:teuthology.orchestra.run.smithi111.stderr: 63200K .......... .......... .......... .......... .......... 68% 351M 0s 2024-09-12T18:53:03.861 INFO:teuthology.orchestra.run.smithi111.stderr: 63250K .......... .......... .......... .......... .......... 68% 355M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 63300K .......... .......... .......... .......... .......... 68% 239M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 63350K .......... .......... .......... .......... .......... 68% 222M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 63400K .......... .......... .......... .......... .......... 68% 384M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 63450K .......... .......... .......... .......... .......... 68% 233M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 63500K .......... .......... .......... .......... .......... 68% 191M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 63550K .......... .......... .......... .......... .......... 68% 140M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 63600K .......... .......... .......... .......... .......... 68% 157M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 63650K .......... .......... .......... .......... .......... 68% 309M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 63700K .......... .......... .......... .......... .......... 68% 109M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 63750K .......... .......... .......... .......... .......... 68% 155M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 63800K .......... .......... .......... .......... .......... 68% 187M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 63850K .......... .......... .......... .......... .......... 68% 326M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 63900K .......... .......... .......... .......... .......... 68% 359M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 63950K .......... .......... .......... .......... .......... 68% 293M 0s 2024-09-12T18:53:03.862 INFO:teuthology.orchestra.run.smithi111.stderr: 64000K .......... .......... .......... .......... .......... 68% 328M 0s 2024-09-12T18:53:03.863 INFO:teuthology.orchestra.run.smithi111.stderr: 64050K .......... .......... .......... .......... .......... 68% 99.1M 0s 2024-09-12T18:53:03.863 INFO:teuthology.orchestra.run.smithi111.stderr: 64100K .......... .......... .......... .......... .......... 69% 346M 0s 2024-09-12T18:53:03.863 INFO:teuthology.orchestra.run.smithi111.stderr: 64150K .......... .......... .......... .......... .......... 69% 340M 0s 2024-09-12T18:53:03.863 INFO:teuthology.orchestra.run.smithi111.stderr: 64200K .......... .......... .......... .......... .......... 69% 380M 0s 2024-09-12T18:53:03.863 INFO:teuthology.orchestra.run.smithi111.stderr: 64250K .......... .......... .......... .......... .......... 69% 369M 0s 2024-09-12T18:53:03.863 INFO:teuthology.orchestra.run.smithi111.stderr: 64300K .......... .......... .......... .......... .......... 69% 393M 0s 2024-09-12T18:53:03.863 INFO:teuthology.orchestra.run.smithi111.stderr: 64350K .......... .......... .......... .......... .......... 69% 311M 0s 2024-09-12T18:53:03.863 INFO:teuthology.orchestra.run.smithi111.stderr: 64400K .......... .......... .......... .......... .......... 69% 332M 0s 2024-09-12T18:53:03.863 INFO:teuthology.orchestra.run.smithi111.stderr: 64450K .......... .......... .......... .......... .......... 69% 337M 0s 2024-09-12T18:53:03.863 INFO:teuthology.orchestra.run.smithi111.stderr: 64500K .......... .......... .......... .......... .......... 69% 364M 0s 2024-09-12T18:53:03.863 INFO:teuthology.orchestra.run.smithi111.stderr: 64550K .......... .......... .......... .......... .......... 69% 253M 0s 2024-09-12T18:53:03.863 INFO:teuthology.orchestra.run.smithi111.stderr: 64600K .......... .......... .......... .......... .......... 69% 197M 0s 2024-09-12T18:53:03.863 INFO:teuthology.orchestra.run.smithi111.stderr: 64650K .......... .......... .......... .......... .......... 69% 346M 0s 2024-09-12T18:53:03.863 INFO:teuthology.orchestra.run.smithi111.stderr: 64700K .......... .......... .......... .......... .......... 69% 381M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 64750K .......... .......... .......... .......... .......... 69% 271M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 64800K .......... .......... .......... .......... .......... 69% 347M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 64850K .......... .......... .......... .......... .......... 69% 113M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 64900K .......... .......... .......... .......... .......... 69% 147M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 64950K .......... .......... .......... .......... .......... 69% 331M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 65000K .......... .......... .......... .......... .......... 70% 373M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 65050K .......... .......... .......... .......... .......... 70% 208M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 65100K .......... .......... .......... .......... .......... 70% 341M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 65150K .......... .......... .......... .......... .......... 70% 222M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 65200K .......... .......... .......... .......... .......... 70% 243M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 65250K .......... .......... .......... .......... .......... 70% 349M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 65300K .......... .......... .......... .......... .......... 70% 361M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 65350K .......... .......... .......... .......... .......... 70% 70.8M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 65400K .......... .......... .......... .......... .......... 70% 377M 0s 2024-09-12T18:53:03.864 INFO:teuthology.orchestra.run.smithi111.stderr: 65450K .......... .......... .......... .......... .......... 70% 419M 0s 2024-09-12T18:53:03.865 INFO:teuthology.orchestra.run.smithi111.stderr: 65500K .......... .......... .......... .......... .......... 70% 216M 0s 2024-09-12T18:53:03.865 INFO:teuthology.orchestra.run.smithi111.stderr: 65550K .......... .......... .......... .......... .......... 70% 119M 0s 2024-09-12T18:53:03.865 INFO:teuthology.orchestra.run.smithi111.stderr: 65600K .......... .......... .......... .......... .......... 70% 148M 0s 2024-09-12T18:53:03.865 INFO:teuthology.orchestra.run.smithi111.stderr: 65650K .......... .......... .......... .......... .......... 70% 101M 0s 2024-09-12T18:53:03.865 INFO:teuthology.orchestra.run.smithi111.stderr: 65700K .......... .......... .......... .......... .......... 70% 339M 0s 2024-09-12T18:53:03.865 INFO:teuthology.orchestra.run.smithi111.stderr: 65750K .......... .......... .......... .......... .......... 70% 134M 0s 2024-09-12T18:53:03.865 INFO:teuthology.orchestra.run.smithi111.stderr: 65800K .......... .......... .......... .......... .......... 70% 286M 0s 2024-09-12T18:53:03.865 INFO:teuthology.orchestra.run.smithi111.stderr: 65850K .......... .......... .......... .......... .......... 70% 330M 0s 2024-09-12T18:53:03.865 INFO:teuthology.orchestra.run.smithi111.stderr: 65900K .......... .......... .......... .......... .......... 70% 408M 0s 2024-09-12T18:53:03.865 INFO:teuthology.orchestra.run.smithi111.stderr: 65950K .......... .......... .......... .......... .......... 71% 218M 0s 2024-09-12T18:53:03.865 INFO:teuthology.orchestra.run.smithi111.stderr: 66000K .......... .......... .......... .......... .......... 71% 371M 0s 2024-09-12T18:53:03.866 INFO:teuthology.orchestra.run.smithi111.stderr: 66050K .......... .......... .......... .......... .......... 71% 270M 0s 2024-09-12T18:53:03.866 INFO:teuthology.orchestra.run.smithi111.stderr: 66100K .......... .......... .......... .......... .......... 71% 132M 0s 2024-09-12T18:53:03.866 INFO:teuthology.orchestra.run.smithi111.stderr: 66150K .......... .......... .......... .......... .......... 71% 152M 0s 2024-09-12T18:53:03.866 INFO:teuthology.orchestra.run.smithi111.stderr: 66200K .......... .......... .......... .......... .......... 71% 291M 0s 2024-09-12T18:53:03.866 INFO:teuthology.orchestra.run.smithi111.stderr: 66250K .......... .......... .......... .......... .......... 71% 252M 0s 2024-09-12T18:53:03.866 INFO:teuthology.orchestra.run.smithi111.stderr: 66300K .......... .......... .......... .......... .......... 71% 352M 0s 2024-09-12T18:53:03.866 INFO:teuthology.orchestra.run.smithi111.stderr: 66350K .......... .......... .......... .......... .......... 71% 181M 0s 2024-09-12T18:53:03.866 INFO:teuthology.orchestra.run.smithi111.stderr: 66400K .......... .......... .......... .......... .......... 71% 252M 0s 2024-09-12T18:53:03.866 INFO:teuthology.orchestra.run.smithi111.stderr: 66450K .......... .......... .......... .......... .......... 71% 261M 0s 2024-09-12T18:53:03.866 INFO:teuthology.orchestra.run.smithi111.stderr: 66500K .......... .......... .......... .......... .......... 71% 405M 0s 2024-09-12T18:53:03.866 INFO:teuthology.orchestra.run.smithi111.stderr: 66550K .......... .......... .......... .......... .......... 71% 316M 0s 2024-09-12T18:53:03.866 INFO:teuthology.orchestra.run.smithi111.stderr: 66600K .......... .......... .......... .......... .......... 71% 170M 0s 2024-09-12T18:53:03.866 INFO:teuthology.orchestra.run.smithi111.stderr: 66650K .......... .......... .......... .......... .......... 71% 283M 0s 2024-09-12T18:53:03.866 INFO:teuthology.orchestra.run.smithi111.stderr: 66700K .......... .......... .......... .......... .......... 71% 147M 0s 2024-09-12T18:53:03.867 INFO:teuthology.orchestra.run.smithi111.stderr: 66750K .......... .......... .......... .......... .......... 71% 73.7M 0s 2024-09-12T18:53:03.867 INFO:teuthology.orchestra.run.smithi111.stderr: 66800K .......... .......... .......... .......... .......... 71% 128M 0s 2024-09-12T18:53:03.867 INFO:teuthology.orchestra.run.smithi111.stderr: 66850K .......... .......... .......... .......... .......... 72% 308M 0s 2024-09-12T18:53:03.867 INFO:teuthology.orchestra.run.smithi111.stderr: 66900K .......... .......... .......... .......... .......... 72% 382M 0s 2024-09-12T18:53:03.867 INFO:teuthology.orchestra.run.smithi111.stderr: 66950K .......... .......... .......... .......... .......... 72% 285M 0s 2024-09-12T18:53:03.867 INFO:teuthology.orchestra.run.smithi111.stderr: 67000K .......... .......... .......... .......... .......... 72% 338M 0s 2024-09-12T18:53:03.867 INFO:teuthology.orchestra.run.smithi111.stderr: 67050K .......... .......... .......... .......... .......... 72% 399M 0s 2024-09-12T18:53:03.867 INFO:teuthology.orchestra.run.smithi111.stderr: 67100K .......... .......... .......... .......... .......... 72% 387M 0s 2024-09-12T18:53:03.867 INFO:teuthology.orchestra.run.smithi111.stderr: 67150K .......... .......... .......... .......... .......... 72% 84.9M 0s 2024-09-12T18:53:03.867 INFO:teuthology.orchestra.run.smithi111.stderr: 67200K .......... .......... .......... .......... .......... 72% 392M 0s 2024-09-12T18:53:03.868 INFO:teuthology.orchestra.run.smithi111.stderr: 67250K .......... .......... .......... .......... .......... 72% 137M 0s 2024-09-12T18:53:03.868 INFO:teuthology.orchestra.run.smithi111.stderr: 67300K .......... .......... .......... .......... .......... 72% 142M 0s 2024-09-12T18:53:03.868 INFO:teuthology.orchestra.run.smithi111.stderr: 67350K .......... .......... .......... .......... .......... 72% 322M 0s 2024-09-12T18:53:03.868 INFO:teuthology.orchestra.run.smithi111.stderr: 67400K .......... .......... .......... .......... .......... 72% 361M 0s 2024-09-12T18:53:03.868 INFO:teuthology.orchestra.run.smithi111.stderr: 67450K .......... .......... .......... .......... .......... 72% 381M 0s 2024-09-12T18:53:03.868 INFO:teuthology.orchestra.run.smithi111.stderr: 67500K .......... .......... .......... .......... .......... 72% 357M 0s 2024-09-12T18:53:03.868 INFO:teuthology.orchestra.run.smithi111.stderr: 67550K .......... .......... .......... .......... .......... 72% 207M 0s 2024-09-12T18:53:03.868 INFO:teuthology.orchestra.run.smithi111.stderr: 67600K .......... .......... .......... .......... .......... 72% 293M 0s 2024-09-12T18:53:03.868 INFO:teuthology.orchestra.run.smithi111.stderr: 67650K .......... .......... .......... .......... .......... 72% 131M 0s 2024-09-12T18:53:03.868 INFO:teuthology.orchestra.run.smithi111.stderr: 67700K .......... .......... .......... .......... .......... 72% 314M 0s 2024-09-12T18:53:03.869 INFO:teuthology.orchestra.run.smithi111.stderr: 67750K .......... .......... .......... .......... .......... 72% 315M 0s 2024-09-12T18:53:03.869 INFO:teuthology.orchestra.run.smithi111.stderr: 67800K .......... .......... .......... .......... .......... 73% 372M 0s 2024-09-12T18:53:03.869 INFO:teuthology.orchestra.run.smithi111.stderr: 67850K .......... .......... .......... .......... .......... 73% 399M 0s 2024-09-12T18:53:03.869 INFO:teuthology.orchestra.run.smithi111.stderr: 67900K .......... .......... .......... .......... .......... 73% 184M 0s 2024-09-12T18:53:03.869 INFO:teuthology.orchestra.run.smithi111.stderr: 67950K .......... .......... .......... .......... .......... 73% 234M 0s 2024-09-12T18:53:03.869 INFO:teuthology.orchestra.run.smithi111.stderr: 68000K .......... .......... .......... .......... .......... 73% 385M 0s 2024-09-12T18:53:03.869 INFO:teuthology.orchestra.run.smithi111.stderr: 68050K .......... .......... .......... .......... .......... 73% 406M 0s 2024-09-12T18:53:03.869 INFO:teuthology.orchestra.run.smithi111.stderr: 68100K .......... .......... .......... .......... .......... 73% 138M 0s 2024-09-12T18:53:03.869 INFO:teuthology.orchestra.run.smithi111.stderr: 68150K .......... .......... .......... .......... .......... 73% 336M 0s 2024-09-12T18:53:03.869 INFO:teuthology.orchestra.run.smithi111.stderr: 68200K .......... .......... .......... .......... .......... 73% 115M 0s 2024-09-12T18:53:03.870 INFO:teuthology.orchestra.run.smithi111.stderr: 68250K .......... .......... .......... .......... .......... 73% 276M 0s 2024-09-12T18:53:03.870 INFO:teuthology.orchestra.run.smithi111.stderr: 68300K .......... .......... .......... .......... .......... 73% 147M 0s 2024-09-12T18:53:03.870 INFO:teuthology.orchestra.run.smithi111.stderr: 68350K .......... .......... .......... .......... .......... 73% 238M 0s 2024-09-12T18:53:03.870 INFO:teuthology.orchestra.run.smithi111.stderr: 68400K .......... .......... .......... .......... .......... 73% 119M 0s 2024-09-12T18:53:03.870 INFO:teuthology.orchestra.run.smithi111.stderr: 68450K .......... .......... .......... .......... .......... 73% 351M 0s 2024-09-12T18:53:03.870 INFO:teuthology.orchestra.run.smithi111.stderr: 68500K .......... .......... .......... .......... .......... 73% 379M 0s 2024-09-12T18:53:03.870 INFO:teuthology.orchestra.run.smithi111.stderr: 68550K .......... .......... .......... .......... .......... 73% 299M 0s 2024-09-12T18:53:03.870 INFO:teuthology.orchestra.run.smithi111.stderr: 68600K .......... .......... .......... .......... .......... 73% 208M 0s 2024-09-12T18:53:03.870 INFO:teuthology.orchestra.run.smithi111.stderr: 68650K .......... .......... .......... .......... .......... 73% 127M 0s 2024-09-12T18:53:03.870 INFO:teuthology.orchestra.run.smithi111.stderr: 68700K .......... .......... .......... .......... .......... 74% 359M 0s 2024-09-12T18:53:03.870 INFO:teuthology.orchestra.run.smithi111.stderr: 68750K .......... .......... .......... .......... .......... 74% 127M 0s 2024-09-12T18:53:03.870 INFO:teuthology.orchestra.run.smithi111.stderr: 68800K .......... .......... .......... .......... .......... 74% 372M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 68850K .......... .......... .......... .......... .......... 74% 233M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 68900K .......... .......... .......... .......... .......... 74% 169M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 68950K .......... .......... .......... .......... .......... 74% 329M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 69000K .......... .......... .......... .......... .......... 74% 388M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 69050K .......... .......... .......... .......... .......... 74% 340M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 69100K .......... .......... .......... .......... .......... 74% 135M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 69150K .......... .......... .......... .......... .......... 74% 308M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 69200K .......... .......... .......... .......... .......... 74% 348M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 69250K .......... .......... .......... .......... .......... 74% 273M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 69300K .......... .......... .......... .......... .......... 74% 266M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 69350K .......... .......... .......... .......... .......... 74% 319M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 69400K .......... .......... .......... .......... .......... 74% 277M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 69450K .......... .......... .......... .......... .......... 74% 336M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 69500K .......... .......... .......... .......... .......... 74% 262M 0s 2024-09-12T18:53:03.871 INFO:teuthology.orchestra.run.smithi111.stderr: 69550K .......... .......... .......... .......... .......... 74% 282M 0s 2024-09-12T18:53:03.872 INFO:teuthology.orchestra.run.smithi111.stderr: 69600K .......... .......... .......... .......... .......... 74% 351M 0s 2024-09-12T18:53:03.872 INFO:teuthology.orchestra.run.smithi111.stderr: 69650K .......... .......... .......... .......... .......... 75% 88.4M 0s 2024-09-12T18:53:03.872 INFO:teuthology.orchestra.run.smithi111.stderr: 69700K .......... .......... .......... .......... .......... 75% 334M 0s 2024-09-12T18:53:03.872 INFO:teuthology.orchestra.run.smithi111.stderr: 69750K .......... .......... .......... .......... .......... 75% 106M 0s 2024-09-12T18:53:03.872 INFO:teuthology.orchestra.run.smithi111.stderr: 69800K .......... .......... .......... .......... .......... 75% 48.0M 0s 2024-09-12T18:53:03.872 INFO:teuthology.orchestra.run.smithi111.stderr: 69850K .......... .......... .......... .......... .......... 75% 175M 0s 2024-09-12T18:53:03.872 INFO:teuthology.orchestra.run.smithi111.stderr: 69900K .......... .......... .......... .......... .......... 75% 243M 0s 2024-09-12T18:53:03.872 INFO:teuthology.orchestra.run.smithi111.stderr: 69950K .......... .......... .......... .......... .......... 75% 298M 0s 2024-09-12T18:53:03.872 INFO:teuthology.orchestra.run.smithi111.stderr: 70000K .......... .......... .......... .......... .......... 75% 197M 0s 2024-09-12T18:53:03.872 INFO:teuthology.orchestra.run.smithi111.stderr: 70050K .......... .......... .......... .......... .......... 75% 163M 0s 2024-09-12T18:53:03.872 INFO:teuthology.orchestra.run.smithi111.stderr: 70100K .......... .......... .......... .......... .......... 75% 324M 0s 2024-09-12T18:53:03.872 INFO:teuthology.orchestra.run.smithi111.stderr: 70150K .......... .......... .......... .......... .......... 75% 336M 0s 2024-09-12T18:53:03.872 INFO:teuthology.orchestra.run.smithi111.stderr: 70200K .......... .......... .......... .......... .......... 75% 191M 0s 2024-09-12T18:53:03.872 INFO:teuthology.orchestra.run.smithi111.stderr: 70250K .......... .......... .......... .......... .......... 75% 383M 0s 2024-09-12T18:53:03.873 INFO:teuthology.orchestra.run.smithi111.stderr: 70300K .......... .......... .......... .......... .......... 75% 166M 0s 2024-09-12T18:53:03.873 INFO:teuthology.orchestra.run.smithi111.stderr: 70350K .......... .......... .......... .......... .......... 75% 71.1M 0s 2024-09-12T18:53:03.873 INFO:teuthology.orchestra.run.smithi111.stderr: 70400K .......... .......... .......... .......... .......... 75% 347M 0s 2024-09-12T18:53:03.873 INFO:teuthology.orchestra.run.smithi111.stderr: 70450K .......... .......... .......... .......... .......... 75% 361M 0s 2024-09-12T18:53:03.873 INFO:teuthology.orchestra.run.smithi111.stderr: 70500K .......... .......... .......... .......... .......... 75% 178M 0s 2024-09-12T18:53:03.873 INFO:teuthology.orchestra.run.smithi111.stderr: 70550K .......... .......... .......... .......... .......... 75% 319M 0s 2024-09-12T18:53:03.873 INFO:teuthology.orchestra.run.smithi111.stderr: 70600K .......... .......... .......... .......... .......... 76% 402M 0s 2024-09-12T18:53:03.873 INFO:teuthology.orchestra.run.smithi111.stderr: 70650K .......... .......... .......... .......... .......... 76% 156M 0s 2024-09-12T18:53:03.873 INFO:teuthology.orchestra.run.smithi111.stderr: 70700K .......... .......... .......... .......... .......... 76% 230M 0s 2024-09-12T18:53:03.873 INFO:teuthology.orchestra.run.smithi111.stderr: 70750K .......... .......... .......... .......... .......... 76% 288M 0s 2024-09-12T18:53:03.873 INFO:teuthology.orchestra.run.smithi111.stderr: 70800K .......... .......... .......... .......... .......... 76% 344M 0s 2024-09-12T18:53:03.873 INFO:teuthology.orchestra.run.smithi111.stderr: 70850K .......... .......... .......... .......... .......... 76% 318M 0s 2024-09-12T18:53:03.873 INFO:teuthology.orchestra.run.smithi111.stderr: 70900K .......... .......... .......... .......... .......... 76% 238M 0s 2024-09-12T18:53:03.873 INFO:teuthology.orchestra.run.smithi111.stderr: 70950K .......... .......... .......... .......... .......... 76% 111M 0s 2024-09-12T18:53:03.874 INFO:teuthology.orchestra.run.smithi111.stderr: 71000K .......... .......... .......... .......... .......... 76% 222M 0s 2024-09-12T18:53:03.874 INFO:teuthology.orchestra.run.smithi111.stderr: 71050K .......... .......... .......... .......... .......... 76% 372M 0s 2024-09-12T18:53:03.874 INFO:teuthology.orchestra.run.smithi111.stderr: 71100K .......... .......... .......... .......... .......... 76% 105M 0s 2024-09-12T18:53:03.874 INFO:teuthology.orchestra.run.smithi111.stderr: 71150K .......... .......... .......... .......... .......... 76% 142M 0s 2024-09-12T18:53:03.874 INFO:teuthology.orchestra.run.smithi111.stderr: 71200K .......... .......... .......... .......... .......... 76% 119M 0s 2024-09-12T18:53:03.874 INFO:teuthology.orchestra.run.smithi111.stderr: 71250K .......... .......... .......... .......... .......... 76% 213M 0s 2024-09-12T18:53:03.874 INFO:teuthology.orchestra.run.smithi111.stderr: 71300K .......... .......... .......... .......... .......... 76% 240M 0s 2024-09-12T18:53:03.874 INFO:teuthology.orchestra.run.smithi111.stderr: 71350K .......... .......... .......... .......... .......... 76% 211M 0s 2024-09-12T18:53:03.874 INFO:teuthology.orchestra.run.smithi111.stderr: 71400K .......... .......... .......... .......... .......... 76% 186M 0s 2024-09-12T18:53:03.874 INFO:teuthology.orchestra.run.smithi111.stderr: 71450K .......... .......... .......... .......... .......... 76% 375M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 71500K .......... .......... .......... .......... .......... 77% 298M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 71550K .......... .......... .......... .......... .......... 77% 126M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 71600K .......... .......... .......... .......... .......... 77% 222M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 71650K .......... .......... .......... .......... .......... 77% 153M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 71700K .......... .......... .......... .......... .......... 77% 150M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 71750K .......... .......... .......... .......... .......... 77% 327M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 71800K .......... .......... .......... .......... .......... 77% 353M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 71850K .......... .......... .......... .......... .......... 77% 367M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 71900K .......... .......... .......... .......... .......... 77% 298M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 71950K .......... .......... .......... .......... .......... 77% 119M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 72000K .......... .......... .......... .......... .......... 77% 345M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 72050K .......... .......... .......... .......... .......... 77% 356M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 72100K .......... .......... .......... .......... .......... 77% 179M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 72150K .......... .......... .......... .......... .......... 77% 206M 0s 2024-09-12T18:53:03.875 INFO:teuthology.orchestra.run.smithi111.stderr: 72200K .......... .......... .......... .......... .......... 77% 338M 0s 2024-09-12T18:53:03.876 INFO:teuthology.orchestra.run.smithi111.stderr: 72250K .......... .......... .......... .......... .......... 77% 341M 0s 2024-09-12T18:53:03.876 INFO:teuthology.orchestra.run.smithi111.stderr: 72300K .......... .......... .......... .......... .......... 77% 280M 0s 2024-09-12T18:53:03.876 INFO:teuthology.orchestra.run.smithi111.stderr: 72350K .......... .......... .......... .......... .......... 77% 360M 0s 2024-09-12T18:53:03.876 INFO:teuthology.orchestra.run.smithi111.stderr: 72400K .......... .......... .......... .......... .......... 77% 357M 0s 2024-09-12T18:53:03.876 INFO:teuthology.orchestra.run.smithi111.stderr: 72450K .......... .......... .......... .......... .......... 78% 377M 0s 2024-09-12T18:53:03.876 INFO:teuthology.orchestra.run.smithi111.stderr: 72500K .......... .......... .......... .......... .......... 78% 312M 0s 2024-09-12T18:53:03.876 INFO:teuthology.orchestra.run.smithi111.stderr: 72550K .......... .......... .......... .......... .......... 78% 395M 0s 2024-09-12T18:53:03.876 INFO:teuthology.orchestra.run.smithi111.stderr: 72600K .......... .......... .......... .......... .......... 78% 191M 0s 2024-09-12T18:53:03.876 INFO:teuthology.orchestra.run.smithi111.stderr: 72650K .......... .......... .......... .......... .......... 78% 337M 0s 2024-09-12T18:53:03.876 INFO:teuthology.orchestra.run.smithi111.stderr: 72700K .......... .......... .......... .......... .......... 78% 346M 0s 2024-09-12T18:53:03.876 INFO:teuthology.orchestra.run.smithi111.stderr: 72750K .......... .......... .......... .......... .......... 78% 137M 0s 2024-09-12T18:53:03.876 INFO:teuthology.orchestra.run.smithi111.stderr: 72800K .......... .......... .......... .......... .......... 78% 188M 0s 2024-09-12T18:53:03.876 INFO:teuthology.orchestra.run.smithi111.stderr: 72850K .......... .......... .......... .......... .......... 78% 150M 0s 2024-09-12T18:53:03.876 INFO:teuthology.orchestra.run.smithi111.stderr: 72900K .......... .......... .......... .......... .......... 78% 180M 0s 2024-09-12T18:53:03.877 INFO:teuthology.orchestra.run.smithi111.stderr: 72950K .......... .......... .......... .......... .......... 78% 359M 0s 2024-09-12T18:53:03.877 INFO:teuthology.orchestra.run.smithi111.stderr: 73000K .......... .......... .......... .......... .......... 78% 161M 0s 2024-09-12T18:53:03.877 INFO:teuthology.orchestra.run.smithi111.stderr: 73050K .......... .......... .......... .......... .......... 78% 119M 0s 2024-09-12T18:53:03.877 INFO:teuthology.orchestra.run.smithi111.stderr: 73100K .......... .......... .......... .......... .......... 78% 144M 0s 2024-09-12T18:53:03.877 INFO:teuthology.orchestra.run.smithi111.stderr: 73150K .......... .......... .......... .......... .......... 78% 360M 0s 2024-09-12T18:53:03.877 INFO:teuthology.orchestra.run.smithi111.stderr: 73200K .......... .......... .......... .......... .......... 78% 233M 0s 2024-09-12T18:53:03.877 INFO:teuthology.orchestra.run.smithi111.stderr: 73250K .......... .......... .......... .......... .......... 78% 105M 0s 2024-09-12T18:53:03.877 INFO:teuthology.orchestra.run.smithi111.stderr: 73300K .......... .......... .......... .......... .......... 78% 269M 0s 2024-09-12T18:53:03.877 INFO:teuthology.orchestra.run.smithi111.stderr: 73350K .......... .......... .......... .......... .......... 79% 53.9M 0s 2024-09-12T18:53:03.877 INFO:teuthology.orchestra.run.smithi111.stderr: 73400K .......... .......... .......... .......... .......... 79% 271M 0s 2024-09-12T18:53:03.877 INFO:teuthology.orchestra.run.smithi111.stderr: 73450K .......... .......... .......... .......... .......... 79% 229M 0s 2024-09-12T18:53:03.878 INFO:teuthology.orchestra.run.smithi111.stderr: 73500K .......... .......... .......... .......... .......... 79% 295M 0s 2024-09-12T18:53:03.878 INFO:teuthology.orchestra.run.smithi111.stderr: 73550K .......... .......... .......... .......... .......... 79% 380M 0s 2024-09-12T18:53:03.878 INFO:teuthology.orchestra.run.smithi111.stderr: 73600K .......... .......... .......... .......... .......... 79% 350M 0s 2024-09-12T18:53:03.878 INFO:teuthology.orchestra.run.smithi111.stderr: 73650K .......... .......... .......... .......... .......... 79% 303M 0s 2024-09-12T18:53:03.878 INFO:teuthology.orchestra.run.smithi111.stderr: 73700K .......... .......... .......... .......... .......... 79% 176M 0s 2024-09-12T18:53:03.878 INFO:teuthology.orchestra.run.smithi111.stderr: 73750K .......... .......... .......... .......... .......... 79% 148M 0s 2024-09-12T18:53:03.878 INFO:teuthology.orchestra.run.smithi111.stderr: 73800K .......... .......... .......... .......... .......... 79% 321M 0s 2024-09-12T18:53:03.878 INFO:teuthology.orchestra.run.smithi111.stderr: 73850K .......... .......... .......... .......... .......... 79% 263M 0s 2024-09-12T18:53:03.878 INFO:teuthology.orchestra.run.smithi111.stderr: 73900K .......... .......... .......... .......... .......... 79% 292M 0s 2024-09-12T18:53:03.878 INFO:teuthology.orchestra.run.smithi111.stderr: 73950K .......... .......... .......... .......... .......... 79% 172M 0s 2024-09-12T18:53:03.878 INFO:teuthology.orchestra.run.smithi111.stderr: 74000K .......... .......... .......... .......... .......... 79% 225M 0s 2024-09-12T18:53:03.878 INFO:teuthology.orchestra.run.smithi111.stderr: 74050K .......... .......... .......... .......... .......... 79% 187M 0s 2024-09-12T18:53:03.878 INFO:teuthology.orchestra.run.smithi111.stderr: 74100K .......... .......... .......... .......... .......... 79% 55.9M 0s 2024-09-12T18:53:03.879 INFO:teuthology.orchestra.run.smithi111.stderr: 74150K .......... .......... .......... .......... .......... 79% 296M 0s 2024-09-12T18:53:03.879 INFO:teuthology.orchestra.run.smithi111.stderr: 74200K .......... .......... .......... .......... .......... 79% 111M 0s 2024-09-12T18:53:03.879 INFO:teuthology.orchestra.run.smithi111.stderr: 74250K .......... .......... .......... .......... .......... 79% 328M 0s 2024-09-12T18:53:03.879 INFO:teuthology.orchestra.run.smithi111.stderr: 74300K .......... .......... .......... .......... .......... 80% 313M 0s 2024-09-12T18:53:03.879 INFO:teuthology.orchestra.run.smithi111.stderr: 74350K .......... .......... .......... .......... .......... 80% 261M 0s 2024-09-12T18:53:03.879 INFO:teuthology.orchestra.run.smithi111.stderr: 74400K .......... .......... .......... .......... .......... 80% 307M 0s 2024-09-12T18:53:03.879 INFO:teuthology.orchestra.run.smithi111.stderr: 74450K .......... .......... .......... .......... .......... 80% 147M 0s 2024-09-12T18:53:03.879 INFO:teuthology.orchestra.run.smithi111.stderr: 74500K .......... .......... .......... .......... .......... 80% 298M 0s 2024-09-12T18:53:03.879 INFO:teuthology.orchestra.run.smithi111.stderr: 74550K .......... .......... .......... .......... .......... 80% 143M 0s 2024-09-12T18:53:03.880 INFO:teuthology.orchestra.run.smithi111.stderr: 74600K .......... .......... .......... .......... .......... 80% 322M 0s 2024-09-12T18:53:03.880 INFO:teuthology.orchestra.run.smithi111.stderr: 74650K .......... .......... .......... .......... .......... 80% 139M 0s 2024-09-12T18:53:03.880 INFO:teuthology.orchestra.run.smithi111.stderr: 74700K .......... .......... .......... .......... .......... 80% 97.3M 0s 2024-09-12T18:53:03.880 INFO:teuthology.orchestra.run.smithi111.stderr: 74750K .......... .......... .......... .......... .......... 80% 236M 0s 2024-09-12T18:53:03.880 INFO:teuthology.orchestra.run.smithi111.stderr: 74800K .......... .......... .......... .......... .......... 80% 395M 0s 2024-09-12T18:53:03.880 INFO:teuthology.orchestra.run.smithi111.stderr: 74850K .......... .......... .......... .......... .......... 80% 170M 0s 2024-09-12T18:53:03.880 INFO:teuthology.orchestra.run.smithi111.stderr: 74900K .......... .......... .......... .......... .......... 80% 266M 0s 2024-09-12T18:53:03.880 INFO:teuthology.orchestra.run.smithi111.stderr: 74950K .......... .......... .......... .......... .......... 80% 270M 0s 2024-09-12T18:53:03.880 INFO:teuthology.orchestra.run.smithi111.stderr: 75000K .......... .......... .......... .......... .......... 80% 123M 0s 2024-09-12T18:53:03.880 INFO:teuthology.orchestra.run.smithi111.stderr: 75050K .......... .......... .......... .......... .......... 80% 192M 0s 2024-09-12T18:53:03.880 INFO:teuthology.orchestra.run.smithi111.stderr: 75100K .......... .......... .......... .......... .......... 80% 272M 0s 2024-09-12T18:53:03.880 INFO:teuthology.orchestra.run.smithi111.stderr: 75150K .......... .......... .......... .......... .......... 80% 313M 0s 2024-09-12T18:53:03.880 INFO:teuthology.orchestra.run.smithi111.stderr: 75200K .......... .......... .......... .......... .......... 81% 318M 0s 2024-09-12T18:53:03.880 INFO:teuthology.orchestra.run.smithi111.stderr: 75250K .......... .......... .......... .......... .......... 81% 249M 0s 2024-09-12T18:53:03.881 INFO:teuthology.orchestra.run.smithi111.stderr: 75300K .......... .......... .......... .......... .......... 81% 315M 0s 2024-09-12T18:53:03.881 INFO:teuthology.orchestra.run.smithi111.stderr: 75350K .......... .......... .......... .......... .......... 81% 302M 0s 2024-09-12T18:53:03.881 INFO:teuthology.orchestra.run.smithi111.stderr: 75400K .......... .......... .......... .......... .......... 81% 321M 0s 2024-09-12T18:53:03.881 INFO:teuthology.orchestra.run.smithi111.stderr: 75450K .......... .......... .......... .......... .......... 81% 341M 0s 2024-09-12T18:53:03.881 INFO:teuthology.orchestra.run.smithi111.stderr: 75500K .......... .......... .......... .......... .......... 81% 306M 0s 2024-09-12T18:53:03.881 INFO:teuthology.orchestra.run.smithi111.stderr: 75550K .......... .......... .......... .......... .......... 81% 344M 0s 2024-09-12T18:53:03.881 INFO:teuthology.orchestra.run.smithi111.stderr: 75600K .......... .......... .......... .......... .......... 81% 320M 0s 2024-09-12T18:53:03.881 INFO:teuthology.orchestra.run.smithi111.stderr: 75650K .......... .......... .......... .......... .......... 81% 306M 0s 2024-09-12T18:53:03.881 INFO:teuthology.orchestra.run.smithi111.stderr: 75700K .......... .......... .......... .......... .......... 81% 129M 0s 2024-09-12T18:53:03.881 INFO:teuthology.orchestra.run.smithi111.stderr: 75750K .......... .......... .......... .......... .......... 81% 345M 0s 2024-09-12T18:53:03.881 INFO:teuthology.orchestra.run.smithi111.stderr: 75800K .......... .......... .......... .......... .......... 81% 123M 0s 2024-09-12T18:53:03.882 INFO:teuthology.orchestra.run.smithi111.stderr: 75850K .......... .......... .......... .......... .......... 81% 84.0M 0s 2024-09-12T18:53:03.882 INFO:teuthology.orchestra.run.smithi111.stderr: 75900K .......... .......... .......... .......... .......... 81% 248M 0s 2024-09-12T18:53:03.882 INFO:teuthology.orchestra.run.smithi111.stderr: 75950K .......... .......... .......... .......... .......... 81% 343M 0s 2024-09-12T18:53:03.882 INFO:teuthology.orchestra.run.smithi111.stderr: 76000K .......... .......... .......... .......... .......... 81% 308M 0s 2024-09-12T18:53:03.882 INFO:teuthology.orchestra.run.smithi111.stderr: 76050K .......... .......... .......... .......... .......... 81% 137M 0s 2024-09-12T18:53:03.882 INFO:teuthology.orchestra.run.smithi111.stderr: 76100K .......... .......... .......... .......... .......... 81% 253M 0s 2024-09-12T18:53:03.882 INFO:teuthology.orchestra.run.smithi111.stderr: 76150K .......... .......... .......... .......... .......... 82% 155M 0s 2024-09-12T18:53:03.882 INFO:teuthology.orchestra.run.smithi111.stderr: 76200K .......... .......... .......... .......... .......... 82% 320M 0s 2024-09-12T18:53:03.882 INFO:teuthology.orchestra.run.smithi111.stderr: 76250K .......... .......... .......... .......... .......... 82% 194M 0s 2024-09-12T18:53:03.882 INFO:teuthology.orchestra.run.smithi111.stderr: 76300K .......... .......... .......... .......... .......... 82% 285M 0s 2024-09-12T18:53:03.882 INFO:teuthology.orchestra.run.smithi111.stderr: 76350K .......... .......... .......... .......... .......... 82% 49.5M 0s 2024-09-12T18:53:03.882 INFO:teuthology.orchestra.run.smithi111.stderr: 76400K .......... .......... .......... .......... .......... 82% 145M 0s 2024-09-12T18:53:03.882 INFO:teuthology.orchestra.run.smithi111.stderr: 76450K .......... .......... .......... .......... .......... 82% 318M 0s 2024-09-12T18:53:03.882 INFO:teuthology.orchestra.run.smithi111.stderr: 76500K .......... .......... .......... .......... .......... 82% 137M 0s 2024-09-12T18:53:03.883 INFO:teuthology.orchestra.run.smithi111.stderr: 76550K .......... .......... .......... .......... .......... 82% 314M 0s 2024-09-12T18:53:03.883 INFO:teuthology.orchestra.run.smithi111.stderr: 76600K .......... .......... .......... .......... .......... 82% 340M 0s 2024-09-12T18:53:03.883 INFO:teuthology.orchestra.run.smithi111.stderr: 76650K .......... .......... .......... .......... .......... 82% 288M 0s 2024-09-12T18:53:03.883 INFO:teuthology.orchestra.run.smithi111.stderr: 76700K .......... .......... .......... .......... .......... 82% 227M 0s 2024-09-12T18:53:03.883 INFO:teuthology.orchestra.run.smithi111.stderr: 76750K .......... .......... .......... .......... .......... 82% 212M 0s 2024-09-12T18:53:03.883 INFO:teuthology.orchestra.run.smithi111.stderr: 76800K .......... .......... .......... .......... .......... 82% 325M 0s 2024-09-12T18:53:03.883 INFO:teuthology.orchestra.run.smithi111.stderr: 76850K .......... .......... .......... .......... .......... 82% 130M 0s 2024-09-12T18:53:03.883 INFO:teuthology.orchestra.run.smithi111.stderr: 76900K .......... .......... .......... .......... .......... 82% 283M 0s 2024-09-12T18:53:03.883 INFO:teuthology.orchestra.run.smithi111.stderr: 76950K .......... .......... .......... .......... .......... 82% 180M 0s 2024-09-12T18:53:03.883 INFO:teuthology.orchestra.run.smithi111.stderr: 77000K .......... .......... .......... .......... .......... 82% 143M 0s 2024-09-12T18:53:03.883 INFO:teuthology.orchestra.run.smithi111.stderr: 77050K .......... .......... .......... .......... .......... 82% 73.3M 0s 2024-09-12T18:53:03.883 INFO:teuthology.orchestra.run.smithi111.stderr: 77100K .......... .......... .......... .......... .......... 83% 89.2M 0s 2024-09-12T18:53:03.883 INFO:teuthology.orchestra.run.smithi111.stderr: 77150K .......... .......... .......... .......... .......... 83% 310M 0s 2024-09-12T18:53:03.884 INFO:teuthology.orchestra.run.smithi111.stderr: 77200K .......... .......... .......... .......... .......... 83% 184M 0s 2024-09-12T18:53:03.884 INFO:teuthology.orchestra.run.smithi111.stderr: 77250K .......... .......... .......... .......... .......... 83% 141M 0s 2024-09-12T18:53:03.884 INFO:teuthology.orchestra.run.smithi111.stderr: 77300K .......... .......... .......... .......... .......... 83% 254M 0s 2024-09-12T18:53:03.884 INFO:teuthology.orchestra.run.smithi111.stderr: 77350K .......... .......... .......... .......... .......... 83% 159M 0s 2024-09-12T18:53:03.884 INFO:teuthology.orchestra.run.smithi111.stderr: 77400K .......... .......... .......... .......... .......... 83% 259M 0s 2024-09-12T18:53:03.884 INFO:teuthology.orchestra.run.smithi111.stderr: 77450K .......... .......... .......... .......... .......... 83% 191M 0s 2024-09-12T18:53:03.884 INFO:teuthology.orchestra.run.smithi111.stderr: 77500K .......... .......... .......... .......... .......... 83% 53.8M 0s 2024-09-12T18:53:03.884 INFO:teuthology.orchestra.run.smithi111.stderr: 77550K .......... .......... .......... .......... .......... 83% 296M 0s 2024-09-12T18:53:03.884 INFO:teuthology.orchestra.run.smithi111.stderr: 77600K .......... .......... .......... .......... .......... 83% 88.2M 0s 2024-09-12T18:53:03.884 INFO:teuthology.orchestra.run.smithi111.stderr: 77650K .......... .......... .......... .......... .......... 83% 294M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 77700K .......... .......... .......... .......... .......... 83% 67.1M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 77750K .......... .......... .......... .......... .......... 83% 80.2M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 77800K .......... .......... .......... .......... .......... 83% 62.8M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 77850K .......... .......... .......... .......... .......... 83% 242M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 77900K .......... .......... .......... .......... .......... 83% 91.2M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 77950K .......... .......... .......... .......... .......... 83% 231M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 78000K .......... .......... .......... .......... .......... 84% 55.9M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 78050K .......... .......... .......... .......... .......... 84% 281M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 78100K .......... .......... .......... .......... .......... 84% 256M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 78150K .......... .......... .......... .......... .......... 84% 170M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 78200K .......... .......... .......... .......... .......... 84% 281M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 78250K .......... .......... .......... .......... .......... 84% 292M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 78300K .......... .......... .......... .......... .......... 84% 256M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 78350K .......... .......... .......... .......... .......... 84% 347M 0s 2024-09-12T18:53:03.885 INFO:teuthology.orchestra.run.smithi111.stderr: 78400K .......... .......... .......... .......... .......... 84% 333M 0s 2024-09-12T18:53:03.886 INFO:teuthology.orchestra.run.smithi111.stderr: 78450K .......... .......... .......... .......... .......... 84% 326M 0s 2024-09-12T18:53:03.886 INFO:teuthology.orchestra.run.smithi111.stderr: 78500K .......... .......... .......... .......... .......... 84% 264M 0s 2024-09-12T18:53:03.886 INFO:teuthology.orchestra.run.smithi111.stderr: 78550K .......... .......... .......... .......... .......... 84% 332M 0s 2024-09-12T18:53:03.886 INFO:teuthology.orchestra.run.smithi111.stderr: 78600K .......... .......... .......... .......... .......... 84% 342M 0s 2024-09-12T18:53:03.886 INFO:teuthology.orchestra.run.smithi111.stderr: 78650K .......... .......... .......... .......... .......... 84% 200M 0s 2024-09-12T18:53:03.886 INFO:teuthology.orchestra.run.smithi111.stderr: 78700K .......... .......... .......... .......... .......... 84% 271M 0s 2024-09-12T18:53:03.886 INFO:teuthology.orchestra.run.smithi111.stderr: 78750K .......... .......... .......... .......... .......... 84% 89.8M 0s 2024-09-12T18:53:03.886 INFO:teuthology.orchestra.run.smithi111.stderr: 78800K .......... .......... .......... .......... .......... 84% 282M 0s 2024-09-12T18:53:03.886 INFO:teuthology.orchestra.run.smithi111.stderr: 78850K .......... .......... .......... .......... .......... 84% 99.2M 0s 2024-09-12T18:53:03.886 INFO:teuthology.orchestra.run.smithi111.stderr: 78900K .......... .......... .......... .......... .......... 84% 164M 0s 2024-09-12T18:53:03.886 INFO:teuthology.orchestra.run.smithi111.stderr: 78950K .......... .......... .......... .......... .......... 85% 200M 0s 2024-09-12T18:53:03.887 INFO:teuthology.orchestra.run.smithi111.stderr: 79000K .......... .......... .......... .......... .......... 85% 304M 0s 2024-09-12T18:53:03.887 INFO:teuthology.orchestra.run.smithi111.stderr: 79050K .......... .......... .......... .......... .......... 85% 84.1M 0s 2024-09-12T18:53:03.887 INFO:teuthology.orchestra.run.smithi111.stderr: 79100K .......... .......... .......... .......... .......... 85% 251M 0s 2024-09-12T18:53:03.887 INFO:teuthology.orchestra.run.smithi111.stderr: 79150K .......... .......... .......... .......... .......... 85% 281M 0s 2024-09-12T18:53:03.887 INFO:teuthology.orchestra.run.smithi111.stderr: 79200K .......... .......... .......... .......... .......... 85% 128M 0s 2024-09-12T18:53:03.887 INFO:teuthology.orchestra.run.smithi111.stderr: 79250K .......... .......... .......... .......... .......... 85% 333M 0s 2024-09-12T18:53:03.887 INFO:teuthology.orchestra.run.smithi111.stderr: 79300K .......... .......... .......... .......... .......... 85% 267M 0s 2024-09-12T18:53:03.887 INFO:teuthology.orchestra.run.smithi111.stderr: 79350K .......... .......... .......... .......... .......... 85% 56.6M 0s 2024-09-12T18:53:03.887 INFO:teuthology.orchestra.run.smithi111.stderr: 79400K .......... .......... .......... .......... .......... 85% 150M 0s 2024-09-12T18:53:03.887 INFO:teuthology.orchestra.run.smithi111.stderr: 79450K .......... .......... .......... .......... .......... 85% 264M 0s 2024-09-12T18:53:03.887 INFO:teuthology.orchestra.run.smithi111.stderr: 79500K .......... .......... .......... .......... .......... 85% 184M 0s 2024-09-12T18:53:03.888 INFO:teuthology.orchestra.run.smithi111.stderr: 79550K .......... .......... .......... .......... .......... 85% 147M 0s 2024-09-12T18:53:03.888 INFO:teuthology.orchestra.run.smithi111.stderr: 79600K .......... .......... .......... .......... .......... 85% 265M 0s 2024-09-12T18:53:03.888 INFO:teuthology.orchestra.run.smithi111.stderr: 79650K .......... .......... .......... .......... .......... 85% 261M 0s 2024-09-12T18:53:03.888 INFO:teuthology.orchestra.run.smithi111.stderr: 79700K .......... .......... .......... .......... .......... 85% 233M 0s 2024-09-12T18:53:03.888 INFO:teuthology.orchestra.run.smithi111.stderr: 79750K .......... .......... .......... .......... .......... 85% 258M 0s 2024-09-12T18:53:03.888 INFO:teuthology.orchestra.run.smithi111.stderr: 79800K .......... .......... .......... .......... .......... 85% 296M 0s 2024-09-12T18:53:03.888 INFO:teuthology.orchestra.run.smithi111.stderr: 79850K .......... .......... .......... .......... .......... 86% 297M 0s 2024-09-12T18:53:03.888 INFO:teuthology.orchestra.run.smithi111.stderr: 79900K .......... .......... .......... .......... .......... 86% 224M 0s 2024-09-12T18:53:03.888 INFO:teuthology.orchestra.run.smithi111.stderr: 79950K .......... .......... .......... .......... .......... 86% 189M 0s 2024-09-12T18:53:03.888 INFO:teuthology.orchestra.run.smithi111.stderr: 80000K .......... .......... .......... .......... .......... 86% 280M 0s 2024-09-12T18:53:03.889 INFO:teuthology.orchestra.run.smithi111.stderr: 80050K .......... .......... .......... .......... .......... 86% 81.8M 0s 2024-09-12T18:53:03.889 INFO:teuthology.orchestra.run.smithi111.stderr: 80100K .......... .......... .......... .......... .......... 86% 58.9M 0s 2024-09-12T18:53:03.889 INFO:teuthology.orchestra.run.smithi111.stderr: 80150K .......... .......... .......... .......... .......... 86% 162M 0s 2024-09-12T18:53:03.889 INFO:teuthology.orchestra.run.smithi111.stderr: 80200K .......... .......... .......... .......... .......... 86% 239M 0s 2024-09-12T18:53:03.889 INFO:teuthology.orchestra.run.smithi111.stderr: 80250K .......... .......... .......... .......... .......... 86% 118M 0s 2024-09-12T18:53:03.889 INFO:teuthology.orchestra.run.smithi111.stderr: 80300K .......... .......... .......... .......... .......... 86% 96.2M 0s 2024-09-12T18:53:03.889 INFO:teuthology.orchestra.run.smithi111.stderr: 80350K .......... .......... .......... .......... .......... 86% 28.2M 0s 2024-09-12T18:53:03.889 INFO:teuthology.orchestra.run.smithi111.stderr: 80400K .......... .......... .......... .......... .......... 86% 50.9M 0s 2024-09-12T18:53:03.889 INFO:teuthology.orchestra.run.smithi111.stderr: 80450K .......... .......... .......... .......... .......... 86% 160M 0s 2024-09-12T18:53:03.889 INFO:teuthology.orchestra.run.smithi111.stderr: 80500K .......... .......... .......... .......... .......... 86% 84.5M 0s 2024-09-12T18:53:03.889 INFO:teuthology.orchestra.run.smithi111.stderr: 80550K .......... .......... .......... .......... .......... 86% 314M 0s 2024-09-12T18:53:03.889 INFO:teuthology.orchestra.run.smithi111.stderr: 80600K .......... .......... .......... .......... .......... 86% 325M 0s 2024-09-12T18:53:03.889 INFO:teuthology.orchestra.run.smithi111.stderr: 80650K .......... .......... .......... .......... .......... 86% 213M 0s 2024-09-12T18:53:03.889 INFO:teuthology.orchestra.run.smithi111.stderr: 80700K .......... .......... .......... .......... .......... 86% 117M 0s 2024-09-12T18:53:03.890 INFO:teuthology.orchestra.run.smithi111.stderr: 80750K .......... .......... .......... .......... .......... 86% 133M 0s 2024-09-12T18:53:03.890 INFO:teuthology.orchestra.run.smithi111.stderr: 80800K .......... .......... .......... .......... .......... 87% 93.1M 0s 2024-09-12T18:53:03.890 INFO:teuthology.orchestra.run.smithi111.stderr: 80850K .......... .......... .......... .......... .......... 87% 98.9M 0s 2024-09-12T18:53:03.890 INFO:teuthology.orchestra.run.smithi111.stderr: 80900K .......... .......... .......... .......... .......... 87% 293M 0s 2024-09-12T18:53:03.890 INFO:teuthology.orchestra.run.smithi111.stderr: 80950K .......... .......... .......... .......... .......... 87% 193M 0s 2024-09-12T18:53:03.890 INFO:teuthology.orchestra.run.smithi111.stderr: 81000K .......... .......... .......... .......... .......... 87% 90.2M 0s 2024-09-12T18:53:03.890 INFO:teuthology.orchestra.run.smithi111.stderr: 81050K .......... .......... .......... .......... .......... 87% 315M 0s 2024-09-12T18:53:03.890 INFO:teuthology.orchestra.run.smithi111.stderr: 81100K .......... .......... .......... .......... .......... 87% 254M 0s 2024-09-12T18:53:03.890 INFO:teuthology.orchestra.run.smithi111.stderr: 81150K .......... .......... .......... .......... .......... 87% 334M 0s 2024-09-12T18:53:03.890 INFO:teuthology.orchestra.run.smithi111.stderr: 81200K .......... .......... .......... .......... .......... 87% 139M 0s 2024-09-12T18:53:03.890 INFO:teuthology.orchestra.run.smithi111.stderr: 81250K .......... .......... .......... .......... .......... 87% 291M 0s 2024-09-12T18:53:03.890 INFO:teuthology.orchestra.run.smithi111.stderr: 81300K .......... .......... .......... .......... .......... 87% 282M 0s 2024-09-12T18:53:03.890 INFO:teuthology.orchestra.run.smithi111.stderr: 81350K .......... .......... .......... .......... .......... 87% 343M 0s 2024-09-12T18:53:03.890 INFO:teuthology.orchestra.run.smithi111.stderr: 81400K .......... .......... .......... .......... .......... 87% 257M 0s 2024-09-12T18:53:03.891 INFO:teuthology.orchestra.run.smithi111.stderr: 81450K .......... .......... .......... .......... .......... 87% 302M 0s 2024-09-12T18:53:03.891 INFO:teuthology.orchestra.run.smithi111.stderr: 81500K .......... .......... .......... .......... .......... 87% 268M 0s 2024-09-12T18:53:03.891 INFO:teuthology.orchestra.run.smithi111.stderr: 81550K .......... .......... .......... .......... .......... 87% 311M 0s 2024-09-12T18:53:03.891 INFO:teuthology.orchestra.run.smithi111.stderr: 81600K .......... .......... .......... .......... .......... 87% 310M 0s 2024-09-12T18:53:03.891 INFO:teuthology.orchestra.run.smithi111.stderr: 81650K .......... .......... .......... .......... .......... 87% 345M 0s 2024-09-12T18:53:03.891 INFO:teuthology.orchestra.run.smithi111.stderr: 81700K .......... .......... .......... .......... .......... 87% 288M 0s 2024-09-12T18:53:03.891 INFO:teuthology.orchestra.run.smithi111.stderr: 81750K .......... .......... .......... .......... .......... 88% 286M 0s 2024-09-12T18:53:03.891 INFO:teuthology.orchestra.run.smithi111.stderr: 81800K .......... .......... .......... .......... .......... 88% 296M 0s 2024-09-12T18:53:03.891 INFO:teuthology.orchestra.run.smithi111.stderr: 81850K .......... .......... .......... .......... .......... 88% 195M 0s 2024-09-12T18:53:03.891 INFO:teuthology.orchestra.run.smithi111.stderr: 81900K .......... .......... .......... .......... .......... 88% 129M 0s 2024-09-12T18:53:03.891 INFO:teuthology.orchestra.run.smithi111.stderr: 81950K .......... .......... .......... .......... .......... 88% 104M 0s 2024-09-12T18:53:03.892 INFO:teuthology.orchestra.run.smithi111.stderr: 82000K .......... .......... .......... .......... .......... 88% 61.6M 0s 2024-09-12T18:53:03.892 INFO:teuthology.orchestra.run.smithi111.stderr: 82050K .......... .......... .......... .......... .......... 88% 302M 0s 2024-09-12T18:53:03.892 INFO:teuthology.orchestra.run.smithi111.stderr: 82100K .......... .......... .......... .......... .......... 88% 194M 0s 2024-09-12T18:53:03.892 INFO:teuthology.orchestra.run.smithi111.stderr: 82150K .......... .......... .......... .......... .......... 88% 286M 0s 2024-09-12T18:53:03.892 INFO:teuthology.orchestra.run.smithi111.stderr: 82200K .......... .......... .......... .......... .......... 88% 312M 0s 2024-09-12T18:53:03.892 INFO:teuthology.orchestra.run.smithi111.stderr: 82250K .......... .......... .......... .......... .......... 88% 312M 0s 2024-09-12T18:53:03.892 INFO:teuthology.orchestra.run.smithi111.stderr: 82300K .......... .......... .......... .......... .......... 88% 326M 0s 2024-09-12T18:53:03.892 INFO:teuthology.orchestra.run.smithi111.stderr: 82350K .......... .......... .......... .......... .......... 88% 148M 0s 2024-09-12T18:53:03.892 INFO:teuthology.orchestra.run.smithi111.stderr: 82400K .......... .......... .......... .......... .......... 88% 107M 0s 2024-09-12T18:53:03.892 INFO:teuthology.orchestra.run.smithi111.stderr: 82450K .......... .......... .......... .......... .......... 88% 313M 0s 2024-09-12T18:53:03.892 INFO:teuthology.orchestra.run.smithi111.stderr: 82500K .......... .......... .......... .......... .......... 88% 206M 0s 2024-09-12T18:53:03.892 INFO:teuthology.orchestra.run.smithi111.stderr: 82550K .......... .......... .......... .......... .......... 88% 232M 0s 2024-09-12T18:53:03.893 INFO:teuthology.orchestra.run.smithi111.stderr: 82600K .......... .......... .......... .......... .......... 88% 297M 0s 2024-09-12T18:53:03.893 INFO:teuthology.orchestra.run.smithi111.stderr: 82650K .......... .......... .......... .......... .......... 89% 215M 0s 2024-09-12T18:53:03.893 INFO:teuthology.orchestra.run.smithi111.stderr: 82700K .......... .......... .......... .......... .......... 89% 289M 0s 2024-09-12T18:53:03.893 INFO:teuthology.orchestra.run.smithi111.stderr: 82750K .......... .......... .......... .......... .......... 89% 273M 0s 2024-09-12T18:53:03.893 INFO:teuthology.orchestra.run.smithi111.stderr: 82800K .......... .......... .......... .......... .......... 89% 337M 0s 2024-09-12T18:53:03.893 INFO:teuthology.orchestra.run.smithi111.stderr: 82850K .......... .......... .......... .......... .......... 89% 75.1M 0s 2024-09-12T18:53:03.893 INFO:teuthology.orchestra.run.smithi111.stderr: 82900K .......... .......... .......... .......... .......... 89% 319M 0s 2024-09-12T18:53:03.893 INFO:teuthology.orchestra.run.smithi111.stderr: 82950K .......... .......... .......... .......... .......... 89% 83.3M 0s 2024-09-12T18:53:03.893 INFO:teuthology.orchestra.run.smithi111.stderr: 83000K .......... .......... .......... .......... .......... 89% 317M 0s 2024-09-12T18:53:03.894 INFO:teuthology.orchestra.run.smithi111.stderr: 83050K .......... .......... .......... .......... .......... 89% 51.9M 0s 2024-09-12T18:53:03.894 INFO:teuthology.orchestra.run.smithi111.stderr: 83100K .......... .......... .......... .......... .......... 89% 122M 0s 2024-09-12T18:53:03.894 INFO:teuthology.orchestra.run.smithi111.stderr: 83150K .......... .......... .......... .......... .......... 89% 177M 0s 2024-09-12T18:53:03.894 INFO:teuthology.orchestra.run.smithi111.stderr: 83200K .......... .......... .......... .......... .......... 89% 271M 0s 2024-09-12T18:53:03.894 INFO:teuthology.orchestra.run.smithi111.stderr: 83250K .......... .......... .......... .......... .......... 89% 307M 0s 2024-09-12T18:53:03.894 INFO:teuthology.orchestra.run.smithi111.stderr: 83300K .......... .......... .......... .......... .......... 89% 246M 0s 2024-09-12T18:53:03.894 INFO:teuthology.orchestra.run.smithi111.stderr: 83350K .......... .......... .......... .......... .......... 89% 95.6M 0s 2024-09-12T18:53:03.894 INFO:teuthology.orchestra.run.smithi111.stderr: 83400K .......... .......... .......... .......... .......... 89% 76.1M 0s 2024-09-12T18:53:03.894 INFO:teuthology.orchestra.run.smithi111.stderr: 83450K .......... .......... .......... .......... .......... 89% 294M 0s 2024-09-12T18:53:03.894 INFO:teuthology.orchestra.run.smithi111.stderr: 83500K .......... .......... .......... .......... .......... 89% 205M 0s 2024-09-12T18:53:03.894 INFO:teuthology.orchestra.run.smithi111.stderr: 83550K .......... .......... .......... .......... .......... 89% 115M 0s 2024-09-12T18:53:03.894 INFO:teuthology.orchestra.run.smithi111.stderr: 83600K .......... .......... .......... .......... .......... 90% 226M 0s 2024-09-12T18:53:03.895 INFO:teuthology.orchestra.run.smithi111.stderr: 83650K .......... .......... .......... .......... .......... 90% 167M 0s 2024-09-12T18:53:03.895 INFO:teuthology.orchestra.run.smithi111.stderr: 83700K .......... .......... .......... .......... .......... 90% 306M 0s 2024-09-12T18:53:03.895 INFO:teuthology.orchestra.run.smithi111.stderr: 83750K .......... .......... .......... .......... .......... 90% 113M 0s 2024-09-12T18:53:03.895 INFO:teuthology.orchestra.run.smithi111.stderr: 83800K .......... .......... .......... .......... .......... 90% 127M 0s 2024-09-12T18:53:03.895 INFO:teuthology.orchestra.run.smithi111.stderr: 83850K .......... .......... .......... .......... .......... 90% 74.5M 0s 2024-09-12T18:53:03.895 INFO:teuthology.orchestra.run.smithi111.stderr: 83900K .......... .......... .......... .......... .......... 90% 306M 0s 2024-09-12T18:53:03.895 INFO:teuthology.orchestra.run.smithi111.stderr: 83950K .......... .......... .......... .......... .......... 90% 147M 0s 2024-09-12T18:53:03.895 INFO:teuthology.orchestra.run.smithi111.stderr: 84000K .......... .......... .......... .......... .......... 90% 260M 0s 2024-09-12T18:53:03.895 INFO:teuthology.orchestra.run.smithi111.stderr: 84050K .......... .......... .......... .......... .......... 90% 327M 0s 2024-09-12T18:53:03.895 INFO:teuthology.orchestra.run.smithi111.stderr: 84100K .......... .......... .......... .......... .......... 90% 69.2M 0s 2024-09-12T18:53:03.895 INFO:teuthology.orchestra.run.smithi111.stderr: 84150K .......... .......... .......... .......... .......... 90% 271M 0s 2024-09-12T18:53:03.895 INFO:teuthology.orchestra.run.smithi111.stderr: 84200K .......... .......... .......... .......... .......... 90% 331M 0s 2024-09-12T18:53:03.896 INFO:teuthology.orchestra.run.smithi111.stderr: 84250K .......... .......... .......... .......... .......... 90% 157M 0s 2024-09-12T18:53:03.896 INFO:teuthology.orchestra.run.smithi111.stderr: 84300K .......... .......... .......... .......... .......... 90% 225M 0s 2024-09-12T18:53:03.896 INFO:teuthology.orchestra.run.smithi111.stderr: 84350K .......... .......... .......... .......... .......... 90% 164M 0s 2024-09-12T18:53:03.896 INFO:teuthology.orchestra.run.smithi111.stderr: 84400K .......... .......... .......... .......... .......... 90% 293M 0s 2024-09-12T18:53:03.896 INFO:teuthology.orchestra.run.smithi111.stderr: 84450K .......... .......... .......... .......... .......... 90% 281M 0s 2024-09-12T18:53:03.896 INFO:teuthology.orchestra.run.smithi111.stderr: 84500K .......... .......... .......... .......... .......... 91% 331M 0s 2024-09-12T18:53:03.896 INFO:teuthology.orchestra.run.smithi111.stderr: 84550K .......... .......... .......... .......... .......... 91% 228M 0s 2024-09-12T18:53:03.896 INFO:teuthology.orchestra.run.smithi111.stderr: 84600K .......... .......... .......... .......... .......... 91% 256M 0s 2024-09-12T18:53:03.896 INFO:teuthology.orchestra.run.smithi111.stderr: 84650K .......... .......... .......... .......... .......... 91% 300M 0s 2024-09-12T18:53:03.896 INFO:teuthology.orchestra.run.smithi111.stderr: 84700K .......... .......... .......... .......... .......... 91% 274M 0s 2024-09-12T18:53:03.896 INFO:teuthology.orchestra.run.smithi111.stderr: 84750K .......... .......... .......... .......... .......... 91% 192M 0s 2024-09-12T18:53:03.896 INFO:teuthology.orchestra.run.smithi111.stderr: 84800K .......... .......... .......... .......... .......... 91% 304M 0s 2024-09-12T18:53:03.896 INFO:teuthology.orchestra.run.smithi111.stderr: 84850K .......... .......... .......... .......... .......... 91% 280M 0s 2024-09-12T18:53:03.896 INFO:teuthology.orchestra.run.smithi111.stderr: 84900K .......... .......... .......... .......... .......... 91% 317M 0s 2024-09-12T18:53:03.897 INFO:teuthology.orchestra.run.smithi111.stderr: 84950K .......... .......... .......... .......... .......... 91% 271M 0s 2024-09-12T18:53:03.897 INFO:teuthology.orchestra.run.smithi111.stderr: 85000K .......... .......... .......... .......... .......... 91% 63.9M 0s 2024-09-12T18:53:03.897 INFO:teuthology.orchestra.run.smithi111.stderr: 85050K .......... .......... .......... .......... .......... 91% 280M 0s 2024-09-12T18:53:03.897 INFO:teuthology.orchestra.run.smithi111.stderr: 85100K .......... .......... .......... .......... .......... 91% 305M 0s 2024-09-12T18:53:03.897 INFO:teuthology.orchestra.run.smithi111.stderr: 85150K .......... .......... .......... .......... .......... 91% 274M 0s 2024-09-12T18:53:03.897 INFO:teuthology.orchestra.run.smithi111.stderr: 85200K .......... .......... .......... .......... .......... 91% 282M 0s 2024-09-12T18:53:03.897 INFO:teuthology.orchestra.run.smithi111.stderr: 85250K .......... .......... .......... .......... .......... 91% 336M 0s 2024-09-12T18:53:03.897 INFO:teuthology.orchestra.run.smithi111.stderr: 85300K .......... .......... .......... .......... .......... 91% 322M 0s 2024-09-12T18:53:03.897 INFO:teuthology.orchestra.run.smithi111.stderr: 85350K .......... .......... .......... .......... .......... 91% 274M 0s 2024-09-12T18:53:03.897 INFO:teuthology.orchestra.run.smithi111.stderr: 85400K .......... .......... .......... .......... .......... 91% 302M 0s 2024-09-12T18:53:03.897 INFO:teuthology.orchestra.run.smithi111.stderr: 85450K .......... .......... .......... .......... .......... 92% 308M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 85500K .......... .......... .......... .......... .......... 92% 280M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 85550K .......... .......... .......... .......... .......... 92% 100M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 85600K .......... .......... .......... .......... .......... 92% 295M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 85650K .......... .......... .......... .......... .......... 92% 298M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 85700K .......... .......... .......... .......... .......... 92% 313M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 85750K .......... .......... .......... .......... .......... 92% 298M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 85800K .......... .......... .......... .......... .......... 92% 332M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 85850K .......... .......... .......... .......... .......... 92% 322M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 85900K .......... .......... .......... .......... .......... 92% 125M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 85950K .......... .......... .......... .......... .......... 92% 241M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 86000K .......... .......... .......... .......... .......... 92% 120M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 86050K .......... .......... .......... .......... .......... 92% 306M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 86100K .......... .......... .......... .......... .......... 92% 179M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 86150K .......... .......... .......... .......... .......... 92% 267M 0s 2024-09-12T18:53:03.898 INFO:teuthology.orchestra.run.smithi111.stderr: 86200K .......... .......... .......... .......... .......... 92% 324M 0s 2024-09-12T18:53:03.899 INFO:teuthology.orchestra.run.smithi111.stderr: 86250K .......... .......... .......... .......... .......... 92% 207M 0s 2024-09-12T18:53:03.899 INFO:teuthology.orchestra.run.smithi111.stderr: 86300K .......... .......... .......... .......... .......... 92% 259M 0s 2024-09-12T18:53:03.899 INFO:teuthology.orchestra.run.smithi111.stderr: 86350K .......... .......... .......... .......... .......... 93% 233M 0s 2024-09-12T18:53:03.899 INFO:teuthology.orchestra.run.smithi111.stderr: 86400K .......... .......... .......... .......... .......... 93% 108M 0s 2024-09-12T18:53:03.899 INFO:teuthology.orchestra.run.smithi111.stderr: 86450K .......... .......... .......... .......... .......... 93% 217M 0s 2024-09-12T18:53:03.899 INFO:teuthology.orchestra.run.smithi111.stderr: 86500K .......... .......... .......... .......... .......... 93% 297M 0s 2024-09-12T18:53:03.899 INFO:teuthology.orchestra.run.smithi111.stderr: 86550K .......... .......... .......... .......... .......... 93% 170M 0s 2024-09-12T18:53:03.899 INFO:teuthology.orchestra.run.smithi111.stderr: 86600K .......... .......... .......... .......... .......... 93% 214M 0s 2024-09-12T18:53:03.899 INFO:teuthology.orchestra.run.smithi111.stderr: 86650K .......... .......... .......... .......... .......... 93% 240M 0s 2024-09-12T18:53:03.899 INFO:teuthology.orchestra.run.smithi111.stderr: 86700K .......... .......... .......... .......... .......... 93% 317M 0s 2024-09-12T18:53:03.899 INFO:teuthology.orchestra.run.smithi111.stderr: 86750K .......... .......... .......... .......... .......... 93% 257M 0s 2024-09-12T18:53:03.899 INFO:teuthology.orchestra.run.smithi111.stderr: 86800K .......... .......... .......... .......... .......... 93% 142M 0s 2024-09-12T18:53:03.899 INFO:teuthology.orchestra.run.smithi111.stderr: 86850K .......... .......... .......... .......... .......... 93% 121M 0s 2024-09-12T18:53:03.899 INFO:teuthology.orchestra.run.smithi111.stderr: 86900K .......... .......... .......... .......... .......... 93% 183M 0s 2024-09-12T18:53:03.900 INFO:teuthology.orchestra.run.smithi111.stderr: 86950K .......... .......... .......... .......... .......... 93% 266M 0s 2024-09-12T18:53:03.900 INFO:teuthology.orchestra.run.smithi111.stderr: 87000K .......... .......... .......... .......... .......... 93% 313M 0s 2024-09-12T18:53:03.900 INFO:teuthology.orchestra.run.smithi111.stderr: 87050K .......... .......... .......... .......... .......... 93% 301M 0s 2024-09-12T18:53:03.900 INFO:teuthology.orchestra.run.smithi111.stderr: 87100K .......... .......... .......... .......... .......... 93% 55.0M 0s 2024-09-12T18:53:03.900 INFO:teuthology.orchestra.run.smithi111.stderr: 87150K .......... .......... .......... .......... .......... 93% 204M 0s 2024-09-12T18:53:03.900 INFO:teuthology.orchestra.run.smithi111.stderr: 87200K .......... .......... .......... .......... .......... 93% 280M 0s 2024-09-12T18:53:03.900 INFO:teuthology.orchestra.run.smithi111.stderr: 87250K .......... .......... .......... .......... .......... 93% 301M 0s 2024-09-12T18:53:03.900 INFO:teuthology.orchestra.run.smithi111.stderr: 87300K .......... .......... .......... .......... .......... 94% 122M 0s 2024-09-12T18:53:03.900 INFO:teuthology.orchestra.run.smithi111.stderr: 87350K .......... .......... .......... .......... .......... 94% 247M 0s 2024-09-12T18:53:03.900 INFO:teuthology.orchestra.run.smithi111.stderr: 87400K .......... .......... .......... .......... .......... 94% 273M 0s 2024-09-12T18:53:03.900 INFO:teuthology.orchestra.run.smithi111.stderr: 87450K .......... .......... .......... .......... .......... 94% 271M 0s 2024-09-12T18:53:03.900 INFO:teuthology.orchestra.run.smithi111.stderr: 87500K .......... .......... .......... .......... .......... 94% 310M 0s 2024-09-12T18:53:03.901 INFO:teuthology.orchestra.run.smithi111.stderr: 87550K .......... .......... .......... .......... .......... 94% 275M 0s 2024-09-12T18:53:03.901 INFO:teuthology.orchestra.run.smithi111.stderr: 87600K .......... .......... .......... .......... .......... 94% 313M 0s 2024-09-12T18:53:03.901 INFO:teuthology.orchestra.run.smithi111.stderr: 87650K .......... .......... .......... .......... .......... 94% 320M 0s 2024-09-12T18:53:03.901 INFO:teuthology.orchestra.run.smithi111.stderr: 87700K .......... .......... .......... .......... .......... 94% 331M 0s 2024-09-12T18:53:03.901 INFO:teuthology.orchestra.run.smithi111.stderr: 87750K .......... .......... .......... .......... .......... 94% 98.0M 0s 2024-09-12T18:53:03.901 INFO:teuthology.orchestra.run.smithi111.stderr: 87800K .......... .......... .......... .......... .......... 94% 331M 0s 2024-09-12T18:53:03.901 INFO:teuthology.orchestra.run.smithi111.stderr: 87850K .......... .......... .......... .......... .......... 94% 285M 0s 2024-09-12T18:53:03.901 INFO:teuthology.orchestra.run.smithi111.stderr: 87900K .......... .......... .......... .......... .......... 94% 341M 0s 2024-09-12T18:53:03.901 INFO:teuthology.orchestra.run.smithi111.stderr: 87950K .......... .......... .......... .......... .......... 94% 71.3M 0s 2024-09-12T18:53:03.901 INFO:teuthology.orchestra.run.smithi111.stderr: 88000K .......... .......... .......... .......... .......... 94% 288M 0s 2024-09-12T18:53:03.901 INFO:teuthology.orchestra.run.smithi111.stderr: 88050K .......... .......... .......... .......... .......... 94% 232M 0s 2024-09-12T18:53:03.901 INFO:teuthology.orchestra.run.smithi111.stderr: 88100K .......... .......... .......... .......... .......... 94% 152M 0s 2024-09-12T18:53:03.902 INFO:teuthology.orchestra.run.smithi111.stderr: 88150K .......... .......... .......... .......... .......... 94% 207M 0s 2024-09-12T18:53:03.902 INFO:teuthology.orchestra.run.smithi111.stderr: 88200K .......... .......... .......... .......... .......... 94% 277M 0s 2024-09-12T18:53:03.902 INFO:teuthology.orchestra.run.smithi111.stderr: 88250K .......... .......... .......... .......... .......... 95% 251M 0s 2024-09-12T18:53:03.902 INFO:teuthology.orchestra.run.smithi111.stderr: 88300K .......... .......... .......... .......... .......... 95% 244M 0s 2024-09-12T18:53:03.902 INFO:teuthology.orchestra.run.smithi111.stderr: 88350K .......... .......... .......... .......... .......... 95% 244M 0s 2024-09-12T18:53:03.902 INFO:teuthology.orchestra.run.smithi111.stderr: 88400K .......... .......... .......... .......... .......... 95% 283M 0s 2024-09-12T18:53:03.902 INFO:teuthology.orchestra.run.smithi111.stderr: 88450K .......... .......... .......... .......... .......... 95% 253M 0s 2024-09-12T18:53:03.902 INFO:teuthology.orchestra.run.smithi111.stderr: 88500K .......... .......... .......... .......... .......... 95% 272M 0s 2024-09-12T18:53:03.902 INFO:teuthology.orchestra.run.smithi111.stderr: 88550K .......... .......... .......... .......... .......... 95% 228M 0s 2024-09-12T18:53:03.902 INFO:teuthology.orchestra.run.smithi111.stderr: 88600K .......... .......... .......... .......... .......... 95% 213M 0s 2024-09-12T18:53:03.902 INFO:teuthology.orchestra.run.smithi111.stderr: 88650K .......... .......... .......... .......... .......... 95% 268M 0s 2024-09-12T18:53:03.902 INFO:teuthology.orchestra.run.smithi111.stderr: 88700K .......... .......... .......... .......... .......... 95% 284M 0s 2024-09-12T18:53:03.903 INFO:teuthology.orchestra.run.smithi111.stderr: 88750K .......... .......... .......... .......... .......... 95% 210M 0s 2024-09-12T18:53:03.903 INFO:teuthology.orchestra.run.smithi111.stderr: 88800K .......... .......... .......... .......... .......... 95% 252M 0s 2024-09-12T18:53:03.903 INFO:teuthology.orchestra.run.smithi111.stderr: 88850K .......... .......... .......... .......... .......... 95% 250M 0s 2024-09-12T18:53:03.903 INFO:teuthology.orchestra.run.smithi111.stderr: 88900K .......... .......... .......... .......... .......... 95% 292M 0s 2024-09-12T18:53:03.903 INFO:teuthology.orchestra.run.smithi111.stderr: 88950K .......... .......... .......... .......... .......... 95% 232M 0s 2024-09-12T18:53:03.903 INFO:teuthology.orchestra.run.smithi111.stderr: 89000K .......... .......... .......... .......... .......... 95% 281M 0s 2024-09-12T18:53:03.903 INFO:teuthology.orchestra.run.smithi111.stderr: 89050K .......... .......... .......... .......... .......... 95% 282M 0s 2024-09-12T18:53:03.903 INFO:teuthology.orchestra.run.smithi111.stderr: 89100K .......... .......... .......... .......... .......... 95% 274M 0s 2024-09-12T18:53:03.903 INFO:teuthology.orchestra.run.smithi111.stderr: 89150K .......... .......... .......... .......... .......... 96% 60.5M 0s 2024-09-12T18:53:03.903 INFO:teuthology.orchestra.run.smithi111.stderr: 89200K .......... .......... .......... .......... .......... 96% 98.8M 0s 2024-09-12T18:53:03.903 INFO:teuthology.orchestra.run.smithi111.stderr: 89250K .......... .......... .......... .......... .......... 96% 218M 0s 2024-09-12T18:53:03.903 INFO:teuthology.orchestra.run.smithi111.stderr: 89300K .......... .......... .......... .......... .......... 96% 251M 0s 2024-09-12T18:53:03.903 INFO:teuthology.orchestra.run.smithi111.stderr: 89350K .......... .......... .......... .......... .......... 96% 247M 0s 2024-09-12T18:53:03.903 INFO:teuthology.orchestra.run.smithi111.stderr: 89400K .......... .......... .......... .......... .......... 96% 268M 0s 2024-09-12T18:53:03.904 INFO:teuthology.orchestra.run.smithi111.stderr: 89450K .......... .......... .......... .......... .......... 96% 205M 0s 2024-09-12T18:53:03.904 INFO:teuthology.orchestra.run.smithi111.stderr: 89500K .......... .......... .......... .......... .......... 96% 275M 0s 2024-09-12T18:53:03.904 INFO:teuthology.orchestra.run.smithi111.stderr: 89550K .......... .......... .......... .......... .......... 96% 234M 0s 2024-09-12T18:53:03.904 INFO:teuthology.orchestra.run.smithi111.stderr: 89600K .......... .......... .......... .......... .......... 96% 157M 0s 2024-09-12T18:53:03.904 INFO:teuthology.orchestra.run.smithi111.stderr: 89650K .......... .......... .......... .......... .......... 96% 132M 0s 2024-09-12T18:53:03.904 INFO:teuthology.orchestra.run.smithi111.stderr: 89700K .......... .......... .......... .......... .......... 96% 258M 0s 2024-09-12T18:53:03.904 INFO:teuthology.orchestra.run.smithi111.stderr: 89750K .......... .......... .......... .......... .......... 96% 214M 0s 2024-09-12T18:53:03.904 INFO:teuthology.orchestra.run.smithi111.stderr: 89800K .......... .......... .......... .......... .......... 96% 281M 0s 2024-09-12T18:53:03.904 INFO:teuthology.orchestra.run.smithi111.stderr: 89850K .......... .......... .......... .......... .......... 96% 274M 0s 2024-09-12T18:53:03.904 INFO:teuthology.orchestra.run.smithi111.stderr: 89900K .......... .......... .......... .......... .......... 96% 254M 0s 2024-09-12T18:53:03.904 INFO:teuthology.orchestra.run.smithi111.stderr: 89950K .......... .......... .......... .......... .......... 96% 226M 0s 2024-09-12T18:53:03.904 INFO:teuthology.orchestra.run.smithi111.stderr: 90000K .......... .......... .......... .......... .......... 96% 260M 0s 2024-09-12T18:53:03.904 INFO:teuthology.orchestra.run.smithi111.stderr: 90050K .......... .......... .......... .......... .......... 96% 212M 0s 2024-09-12T18:53:03.905 INFO:teuthology.orchestra.run.smithi111.stderr: 90100K .......... .......... .......... .......... .......... 97% 98.3M 0s 2024-09-12T18:53:03.905 INFO:teuthology.orchestra.run.smithi111.stderr: 90150K .......... .......... .......... .......... .......... 97% 128M 0s 2024-09-12T18:53:03.905 INFO:teuthology.orchestra.run.smithi111.stderr: 90200K .......... .......... .......... .......... .......... 97% 208M 0s 2024-09-12T18:53:03.905 INFO:teuthology.orchestra.run.smithi111.stderr: 90250K .......... .......... .......... .......... .......... 97% 278M 0s 2024-09-12T18:53:03.905 INFO:teuthology.orchestra.run.smithi111.stderr: 90300K .......... .......... .......... .......... .......... 97% 118M 0s 2024-09-12T18:53:03.905 INFO:teuthology.orchestra.run.smithi111.stderr: 90350K .......... .......... .......... .......... .......... 97% 164M 0s 2024-09-12T18:53:03.905 INFO:teuthology.orchestra.run.smithi111.stderr: 90400K .......... .......... .......... .......... .......... 97% 266M 0s 2024-09-12T18:53:03.905 INFO:teuthology.orchestra.run.smithi111.stderr: 90450K .......... .......... .......... .......... .......... 97% 252M 0s 2024-09-12T18:53:03.905 INFO:teuthology.orchestra.run.smithi111.stderr: 90500K .......... .......... .......... .......... .......... 97% 245M 0s 2024-09-12T18:53:03.905 INFO:teuthology.orchestra.run.smithi111.stderr: 90550K .......... .......... .......... .......... .......... 97% 248M 0s 2024-09-12T18:53:03.905 INFO:teuthology.orchestra.run.smithi111.stderr: 90600K .......... .......... .......... .......... .......... 97% 195M 0s 2024-09-12T18:53:03.905 INFO:teuthology.orchestra.run.smithi111.stderr: 90650K .......... .......... .......... .......... .......... 97% 258M 0s 2024-09-12T18:53:03.906 INFO:teuthology.orchestra.run.smithi111.stderr: 90700K .......... .......... .......... .......... .......... 97% 281M 0s 2024-09-12T18:53:03.906 INFO:teuthology.orchestra.run.smithi111.stderr: 90750K .......... .......... .......... .......... .......... 97% 51.4M 0s 2024-09-12T18:53:03.906 INFO:teuthology.orchestra.run.smithi111.stderr: 90800K .......... .......... .......... .......... .......... 97% 62.6M 0s 2024-09-12T18:53:03.906 INFO:teuthology.orchestra.run.smithi111.stderr: 90850K .......... .......... .......... .......... .......... 97% 129M 0s 2024-09-12T18:53:03.906 INFO:teuthology.orchestra.run.smithi111.stderr: 90900K .......... .......... .......... .......... .......... 97% 51.5M 0s 2024-09-12T18:53:03.906 INFO:teuthology.orchestra.run.smithi111.stderr: 90950K .......... .......... .......... .......... .......... 97% 211M 0s 2024-09-12T18:53:03.906 INFO:teuthology.orchestra.run.smithi111.stderr: 91000K .......... .......... .......... .......... .......... 98% 162M 0s 2024-09-12T18:53:03.906 INFO:teuthology.orchestra.run.smithi111.stderr: 91050K .......... .......... .......... .......... .......... 98% 266M 0s 2024-09-12T18:53:03.906 INFO:teuthology.orchestra.run.smithi111.stderr: 91100K .......... .......... .......... .......... .......... 98% 255M 0s 2024-09-12T18:53:03.907 INFO:teuthology.orchestra.run.smithi111.stderr: 91150K .......... .......... .......... .......... .......... 98% 199M 0s 2024-09-12T18:53:03.907 INFO:teuthology.orchestra.run.smithi111.stderr: 91200K .......... .......... .......... .......... .......... 98% 250M 0s 2024-09-12T18:53:03.907 INFO:teuthology.orchestra.run.smithi111.stderr: 91250K .......... .......... .......... .......... .......... 98% 256M 0s 2024-09-12T18:53:03.907 INFO:teuthology.orchestra.run.smithi111.stderr: 91300K .......... .......... .......... .......... .......... 98% 253M 0s 2024-09-12T18:53:03.907 INFO:teuthology.orchestra.run.smithi111.stderr: 91350K .......... .......... .......... .......... .......... 98% 239M 0s 2024-09-12T18:53:03.907 INFO:teuthology.orchestra.run.smithi111.stderr: 91400K .......... .......... .......... .......... .......... 98% 270M 0s 2024-09-12T18:53:03.907 INFO:teuthology.orchestra.run.smithi111.stderr: 91450K .......... .......... .......... .......... .......... 98% 297M 0s 2024-09-12T18:53:03.907 INFO:teuthology.orchestra.run.smithi111.stderr: 91500K .......... .......... .......... .......... .......... 98% 191M 0s 2024-09-12T18:53:03.907 INFO:teuthology.orchestra.run.smithi111.stderr: 91550K .......... .......... .......... .......... .......... 98% 230M 0s 2024-09-12T18:53:03.907 INFO:teuthology.orchestra.run.smithi111.stderr: 91600K .......... .......... .......... .......... .......... 98% 155M 0s 2024-09-12T18:53:03.907 INFO:teuthology.orchestra.run.smithi111.stderr: 91650K .......... .......... .......... .......... .......... 98% 250M 0s 2024-09-12T18:53:03.907 INFO:teuthology.orchestra.run.smithi111.stderr: 91700K .......... .......... .......... .......... .......... 98% 293M 0s 2024-09-12T18:53:03.907 INFO:teuthology.orchestra.run.smithi111.stderr: 91750K .......... .......... .......... .......... .......... 98% 158M 0s 2024-09-12T18:53:03.908 INFO:teuthology.orchestra.run.smithi111.stderr: 91800K .......... .......... .......... .......... .......... 98% 79.9M 0s 2024-09-12T18:53:03.908 INFO:teuthology.orchestra.run.smithi111.stderr: 91850K .......... .......... .......... .......... .......... 98% 272M 0s 2024-09-12T18:53:03.908 INFO:teuthology.orchestra.run.smithi111.stderr: 91900K .......... .......... .......... .......... .......... 98% 170M 0s 2024-09-12T18:53:03.908 INFO:teuthology.orchestra.run.smithi111.stderr: 91950K .......... .......... .......... .......... .......... 99% 70.3M 0s 2024-09-12T18:53:03.908 INFO:teuthology.orchestra.run.smithi111.stderr: 92000K .......... .......... .......... .......... .......... 99% 193M 0s 2024-09-12T18:53:03.908 INFO:teuthology.orchestra.run.smithi111.stderr: 92050K .......... .......... .......... .......... .......... 99% 165M 0s 2024-09-12T18:53:03.908 INFO:teuthology.orchestra.run.smithi111.stderr: 92100K .......... .......... .......... .......... .......... 99% 250M 0s 2024-09-12T18:53:03.908 INFO:teuthology.orchestra.run.smithi111.stderr: 92150K .......... .......... .......... .......... .......... 99% 100M 0s 2024-09-12T18:53:03.908 INFO:teuthology.orchestra.run.smithi111.stderr: 92200K .......... .......... .......... .......... .......... 99% 152M 0s 2024-09-12T18:53:03.908 INFO:teuthology.orchestra.run.smithi111.stderr: 92250K .......... .......... .......... .......... .......... 99% 129M 0s 2024-09-12T18:53:03.908 INFO:teuthology.orchestra.run.smithi111.stderr: 92300K .......... .......... .......... .......... .......... 99% 260M 0s 2024-09-12T18:53:03.908 INFO:teuthology.orchestra.run.smithi111.stderr: 92350K .......... .......... .......... .......... .......... 99% 213M 0s 2024-09-12T18:53:03.908 INFO:teuthology.orchestra.run.smithi111.stderr: 92400K .......... .......... .......... .......... .......... 99% 80.7M 0s 2024-09-12T18:53:03.909 INFO:teuthology.orchestra.run.smithi111.stderr: 92450K .......... .......... .......... .......... .......... 99% 96.6M 0s 2024-09-12T18:53:03.909 INFO:teuthology.orchestra.run.smithi111.stderr: 92500K .......... .......... .......... .......... .......... 99% 109M 0s 2024-09-12T18:53:03.909 INFO:teuthology.orchestra.run.smithi111.stderr: 92550K .......... .......... .......... .......... .......... 99% 200M 0s 2024-09-12T18:53:03.909 INFO:teuthology.orchestra.run.smithi111.stderr: 92600K .......... .......... .......... .......... .......... 99% 117M 0s 2024-09-12T18:53:03.909 INFO:teuthology.orchestra.run.smithi111.stderr: 92650K .......... .......... .......... .......... .......... 99% 234M 0s 2024-09-12T18:53:03.909 INFO:teuthology.orchestra.run.smithi111.stderr: 92700K .......... .......... .......... .......... .......... 99% 163M 0s 2024-09-12T18:53:03.909 INFO:teuthology.orchestra.run.smithi111.stderr: 92750K .......... .......... .......... .......... .......... 99% 166M 0s 2024-09-12T18:53:03.909 INFO:teuthology.orchestra.run.smithi111.stderr: 92800K .......... .......... .......... .......... .......... 99% 262M 0s 2024-09-12T18:53:03.909 INFO:teuthology.orchestra.run.smithi111.stderr: 92850K .......... .......... .......... .......... .......... 99% 171M 0s 2024-09-12T18:53:03.909 INFO:teuthology.orchestra.run.smithi111.stderr: 92900K 100% 134G=0.5s 2024-09-12T18:53:03.909 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-09-12T18:53:03.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12 18:53:03 (176 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-12T18:53:03.910 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-09-12T18:53:03.945 INFO:teuthology.orchestra.run.smithi111.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T18:53:03.946 INFO:teuthology.orchestra.run.smithi111.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T18:53:03.946 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T18:53:03.946 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T18:53:03.946 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T18:53:03.946 INFO:teuthology.orchestra.run.smithi111.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T18:53:03.947 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T18:53:03.947 INFO:teuthology.orchestra.run.smithi111.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T18:53:03.947 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T18:53:03.947 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T18:53:03.947 INFO:teuthology.orchestra.run.smithi111.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T18:53:03.947 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T18:53:03.948 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T18:53:03.948 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T18:53:03.948 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T18:53:03.948 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T18:53:03.948 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T18:53:03.949 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T18:53:03.949 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T18:53:03.949 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T18:53:03.949 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T18:53:03.949 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T18:53:03.949 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T18:53:03.950 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T18:53:03.950 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T18:53:03.950 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T18:53:03.950 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T18:53:03.950 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T18:53:03.951 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T18:53:03.951 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T18:53:03.951 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T18:53:03.951 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T18:53:03.951 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T18:53:03.951 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T18:53:03.952 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T18:53:03.952 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T18:53:03.952 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T18:53:03.952 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T18:53:03.952 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T18:53:03.953 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T18:53:03.953 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T18:53:03.953 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T18:53:03.953 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T18:53:03.953 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T18:53:03.953 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T18:53:03.954 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T18:53:03.954 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T18:53:03.954 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T18:53:03.954 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T18:53:03.954 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T18:53:03.955 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T18:53:03.955 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T18:53:03.955 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T18:53:03.955 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T18:53:03.955 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T18:53:03.955 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T18:53:03.956 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T18:53:03.956 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T18:53:03.956 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T18:53:03.956 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T18:53:03.956 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T18:53:03.957 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T18:53:03.957 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T18:53:03.957 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T18:53:03.957 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T18:53:03.957 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T18:53:03.957 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T18:53:03.957 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T18:53:03.958 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T18:53:03.958 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T18:53:03.958 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T18:53:03.958 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T18:53:03.958 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T18:53:03.958 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T18:53:03.958 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T18:53:03.959 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T18:53:03.959 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T18:53:03.959 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T18:53:03.959 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T18:53:03.959 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T18:53:03.959 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T18:53:03.959 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T18:53:03.959 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T18:53:03.960 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T18:53:03.960 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T18:53:03.960 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T18:53:03.960 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T18:53:03.960 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T18:53:03.960 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T18:53:03.960 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T18:53:03.961 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T18:53:03.961 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T18:53:03.961 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T18:53:03.961 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T18:53:03.961 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T18:53:03.961 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T18:53:03.961 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T18:53:03.961 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T18:53:03.961 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T18:53:03.961 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T18:53:03.961 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T18:53:03.961 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T18:53:03.961 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T18:53:03.962 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T18:53:03.962 INFO:teuthology.orchestra.run.smithi111.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T18:53:03.962 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T18:53:03.962 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T18:53:03.962 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T18:53:03.962 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T18:53:03.962 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T18:53:03.962 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T18:53:03.962 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T18:53:03.962 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T18:53:03.962 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T18:53:03.963 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T18:53:03.963 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T18:53:03.963 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T18:53:03.963 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T18:53:03.963 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T18:53:03.963 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T18:53:03.963 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T18:53:03.963 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T18:53:03.963 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T18:53:03.963 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T18:53:03.963 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T18:53:03.964 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T18:53:03.964 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T18:53:03.964 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T18:53:03.964 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T18:53:03.964 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T18:53:03.964 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T18:53:03.964 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T18:53:03.964 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T18:53:03.964 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T18:53:03.964 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T18:53:03.965 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T18:53:03.965 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T18:53:03.965 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T18:53:03.965 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T18:53:03.965 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T18:53:03.965 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T18:53:03.965 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T18:53:03.965 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T18:53:03.965 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T18:53:03.965 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T18:53:03.965 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T18:53:03.965 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T18:53:03.966 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T18:53:03.966 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T18:53:03.966 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T18:53:03.966 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T18:53:03.966 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T18:53:03.966 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T18:53:03.966 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T18:53:03.966 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T18:53:03.967 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T18:53:03.967 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T18:53:03.967 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T18:53:03.967 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T18:53:03.967 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T18:53:03.967 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T18:53:03.967 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T18:53:03.967 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T18:53:03.967 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T18:53:03.967 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T18:53:03.967 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T18:53:03.968 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T18:53:03.968 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T18:53:03.968 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T18:53:03.968 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T18:53:03.968 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T18:53:03.968 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T18:53:03.968 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T18:53:03.969 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T18:53:03.969 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T18:53:03.969 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T18:53:03.969 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T18:53:03.969 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T18:53:03.969 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T18:53:03.969 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T18:53:03.969 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T18:53:03.969 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T18:53:03.969 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T18:53:03.969 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T18:53:03.969 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T18:53:03.970 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T18:53:03.970 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T18:53:03.970 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T18:53:03.970 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T18:53:03.970 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T18:53:03.970 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T18:53:03.970 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T18:53:03.971 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T18:53:03.971 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T18:53:03.971 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T18:53:03.971 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T18:53:03.971 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T18:53:03.972 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T18:53:03.972 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T18:53:03.972 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T18:53:03.972 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T18:53:03.973 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T18:53:03.973 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T18:53:03.973 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T18:53:03.973 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T18:53:03.973 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T18:53:03.973 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T18:53:03.973 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T18:53:03.973 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T18:53:03.974 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T18:53:03.974 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T18:53:03.974 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T18:53:03.974 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T18:53:03.974 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T18:53:03.974 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T18:53:03.974 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T18:53:03.974 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T18:53:03.974 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T18:53:03.974 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T18:53:03.975 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T18:53:03.975 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T18:53:03.975 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T18:53:03.975 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T18:53:03.975 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T18:53:03.975 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T18:53:03.975 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T18:53:03.975 INFO:teuthology.orchestra.run.smithi111.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T18:53:03.975 INFO:teuthology.orchestra.run.smithi111.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-12T18:53:04.221 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:04.221 INFO:teuthology.orchestra.run.smithi111.stdout:Welcome to Gradle 6.0.1! 2024-09-12T18:53:04.221 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:04.222 INFO:teuthology.orchestra.run.smithi111.stdout:Here are the highlights of this release: 2024-09-12T18:53:04.222 INFO:teuthology.orchestra.run.smithi111.stdout: - Substantial improvements in dependency management, including 2024-09-12T18:53:04.222 INFO:teuthology.orchestra.run.smithi111.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T18:53:04.222 INFO:teuthology.orchestra.run.smithi111.stdout: - Advanced control of transitive versions 2024-09-12T18:53:04.222 INFO:teuthology.orchestra.run.smithi111.stdout: - Support for optional features and dependencies 2024-09-12T18:53:04.222 INFO:teuthology.orchestra.run.smithi111.stdout: - Rules to tweak published metadata 2024-09-12T18:53:04.222 INFO:teuthology.orchestra.run.smithi111.stdout: - Support for Java 13 2024-09-12T18:53:04.222 INFO:teuthology.orchestra.run.smithi111.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T18:53:04.222 INFO:teuthology.orchestra.run.smithi111.stdout: - New Zinc compiler for Scala 2024-09-12T18:53:04.222 INFO:teuthology.orchestra.run.smithi111.stdout: - VS2019 support 2024-09-12T18:53:04.222 INFO:teuthology.orchestra.run.smithi111.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T18:53:04.222 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:04.222 INFO:teuthology.orchestra.run.smithi111.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T18:53:04.223 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:04.223 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:04.223 INFO:teuthology.orchestra.run.smithi111.stdout:------------------------------------------------------------ 2024-09-12T18:53:04.223 INFO:teuthology.orchestra.run.smithi111.stdout:Gradle 6.0.1 2024-09-12T18:53:04.223 INFO:teuthology.orchestra.run.smithi111.stdout:------------------------------------------------------------ 2024-09-12T18:53:04.223 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:04.223 INFO:teuthology.orchestra.run.smithi111.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T18:53:04.223 INFO:teuthology.orchestra.run.smithi111.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T18:53:04.223 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:04.223 INFO:teuthology.orchestra.run.smithi111.stdout:Kotlin: 1.3.50 2024-09-12T18:53:04.223 INFO:teuthology.orchestra.run.smithi111.stdout:Groovy: 2.5.8 2024-09-12T18:53:04.223 INFO:teuthology.orchestra.run.smithi111.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T18:53:04.223 INFO:teuthology.orchestra.run.smithi111.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-12T18:53:04.223 INFO:teuthology.orchestra.run.smithi111.stdout:OS: Linux 5.15.0-119-generic amd64 2024-09-12T18:53:04.224 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:04.224 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T18:53:04.225 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T18:53:04.225 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T18:53:04.225 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T18:53:04.225 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T18:53:04.225 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T18:53:04.419 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T18:53:04.419 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T18:53:04.419 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'GRMLAJZNMYVUCGQZMOEU', 'access_secret': 'ignQkO2cnhpAG9ruSZQJRZ+W1xCwoUqDbo2i6EMu7lpfSQCmdsLegA==', 'region': 'mexico', 'endpoint': 'smithi111.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi111.front.sepia.ceph.com'} 2024-09-12T18:53:04.419 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T18:53:04.420 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'GRMLAJZNMYVUCGQZMOEU', '--secret', 'ignQkO2cnhpAG9ruSZQJRZ+W1xCwoUqDbo2i6EMu7lpfSQCmdsLegA==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T18:53:04.420 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key GRMLAJZNMYVUCGQZMOEU --secret ignQkO2cnhpAG9ruSZQJRZ+W1xCwoUqDbo2i6EMu7lpfSQCmdsLegA== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T18:53:04.464 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:53:04.465 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:53:04.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.499+0000 7f0e1f6bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:04.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.503+0000 7f0e1f6bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:04.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.503+0000 7f0e1f6bf9c0 20 realm 2024-09-12T18:53:04.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.503+0000 7f0e1f6bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:04.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.503+0000 7f0e1f6bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:04.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.503+0000 7f0e1f6bf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:53:04.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.503+0000 7f0e1f6bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:04.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.503+0000 7f0e1f6bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:04.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.503+0000 7f0e1f6bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:04.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.503+0000 7f0e1f6bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:53:04.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.503+0000 7f0e1f6bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:04.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.503+0000 7f0e1f6bf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:53:04.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.503+0000 7f0e1f6bf9c0 20 searching for the correct realm 2024-09-12T18:53:04.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.511+0000 7f0e1d1c5640 0 -- 172.21.15.111:0/919619061 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f0e18034070 msgr2=0x7f0e18035400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:53:04.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.515+0000 7f0e1c9c4640 0 -- 172.21.15.111:0/919619061 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f0e18034960 msgr2=0x7f0e180173b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:53:04.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.731+0000 7f0e1f6bf9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:53:04.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.731+0000 7f0e1f6bf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:53:04.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.731+0000 7f0e1f6bf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:53:04.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.731+0000 7f0e1f6bf9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:53:04.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.731+0000 7f0e1f6bf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:53:04.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.731+0000 7f0e1f6bf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:53:04.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.731+0000 7f0e1f6bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:04.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.731+0000 7f0e1f6bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:04.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.731+0000 7f0e1f6bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:04.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:53:04.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:04.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:53:04.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 20 zone default found 2024-09-12T18:53:04.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 4 Realm: () 2024-09-12T18:53:04.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:53:04.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:53:04.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:53:04.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 20 zonegroup default 2024-09-12T18:53:04.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:04.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:04.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:04.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:04.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:04.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:04.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 20 started sync module instance, tier type = 2024-09-12T18:53:04.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.735+0000 7f0e1f6bf9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:53:04.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.763+0000 7f0e1f6bf9c0 20 add_watcher() i=0 2024-09-12T18:53:04.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.763+0000 7f0e1f6bf9c0 20 add_watcher() i=1 2024-09-12T18:53:04.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.763+0000 7f0e1f6bf9c0 20 add_watcher() i=2 2024-09-12T18:53:04.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.763+0000 7f0e1f6bf9c0 20 add_watcher() i=3 2024-09-12T18:53:04.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.763+0000 7f0e1f6bf9c0 20 add_watcher() i=4 2024-09-12T18:53:04.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.763+0000 7f0e1f6bf9c0 20 add_watcher() i=5 2024-09-12T18:53:04.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.763+0000 7f0e1f6bf9c0 20 add_watcher() i=6 2024-09-12T18:53:04.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.767+0000 7f0e1f6bf9c0 20 add_watcher() i=7 2024-09-12T18:53:04.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.767+0000 7f0e1f6bf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:53:04.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0cd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:53:04.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0e1f6bf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:53:04.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0e1f6bf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:53:04.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0e1f6bf9c0 5 note: GC not initialized 2024-09-12T18:53:04.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0cd27e4640 20 reqs_thread_entry: start 2024-09-12T18:53:04.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0e1f6bf9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:53:04.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0e1f6bf9c0 20 Filter name: none 2024-09-12T18:53:04.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0c43fff640 20 reqs_thread_entry: start 2024-09-12T18:53:04.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0e1f6bf9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T18:53:04.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0e1f6bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:04.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0e1f6bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:04.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0e1f6bf9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T18:53:04.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0e1f6bf9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:53:04.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0e1f6bf9c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T18:53:04.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.771+0000 7f0e1f6bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:04.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.775+0000 7f0e1f6bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:04.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.775+0000 7f0e1f6bf9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T18:53:04.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.775+0000 7f0e1f6bf9c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:53:04.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.775+0000 7f0e1f6bf9c0 10 cache get: name=default.rgw.meta+users.keys+GRMLAJZNMYVUCGQZMOEU : miss 2024-09-12T18:53:04.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.775+0000 7f0e1f6bf9c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:04.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.775+0000 7f0e1f6bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:04.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.775+0000 7f0e1f6bf9c0 10 cache put: name=default.rgw.meta+users.keys+GRMLAJZNMYVUCGQZMOEU info.flags=0x0 2024-09-12T18:53:04.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.775+0000 7f0e1f6bf9c0 10 adding default.rgw.meta+users.keys+GRMLAJZNMYVUCGQZMOEU to cache LRU end 2024-09-12T18:53:04.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.775+0000 7f0e1f6bf9c0 10 cache get: name=default.rgw.meta+users.keys+GRMLAJZNMYVUCGQZMOEU : hit (negative entry) 2024-09-12T18:53:04.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.775+0000 7f0e1f6bf9c0 10 cache get: name=default.rgw.meta+users.keys+GRMLAJZNMYVUCGQZMOEU : hit (negative entry) 2024-09-12T18:53:04.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.779+0000 7f0e1f6bf9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T18:53:04.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.779+0000 7f0e1f6bf9c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:53:04.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.779+0000 7f0e1f6bf9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T18:53:04.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.779+0000 7f0d00ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431696 cookie 94723571527200 notifier 8249 bl.length()=670 2024-09-12T18:53:04.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.779+0000 7f0d00ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T18:53:04.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.779+0000 7f0d00ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T18:53:04.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.779+0000 7f0e1f6bf9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T18:53:04.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.779+0000 7f0e1f6bf9c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:53:04.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.779+0000 7f0e1f6bf9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T18:53:04.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.783+0000 7f0ceffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431602 cookie 94723571515152 notifier 8249 bl.length()=200 2024-09-12T18:53:04.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.783+0000 7f0ceffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T18:53:04.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.783+0000 7f0ceffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T18:53:04.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.783+0000 7f0e1f6bf9c0 10 cache put: name=default.rgw.meta+users.keys+GRMLAJZNMYVUCGQZMOEU info.flags=0x7 2024-09-12T18:53:04.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.783+0000 7f0e1f6bf9c0 10 moving default.rgw.meta+users.keys+GRMLAJZNMYVUCGQZMOEU to cache LRU end 2024-09-12T18:53:04.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.783+0000 7f0e1f6bf9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:GRMLAJZNMYVUCGQZMOEU, ofs0, ns] 2024-09-12T18:53:04.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.783+0000 7f0ceffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431597 cookie 94723571531712 notifier 8249 bl.length()=189 2024-09-12T18:53:04.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.783+0000 7f0ceffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GRMLAJZNMYVUCGQZMOEU info.flags=0x7 2024-09-12T18:53:04.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.783+0000 7f0ceffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GRMLAJZNMYVUCGQZMOEU to cache LRU end 2024-09-12T18:53:04.789 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:53:04.789 INFO:teuthology.orchestra.run.smithi111.stdout: "user_id": "tester.client.0", 2024-09-12T18:53:04.789 INFO:teuthology.orchestra.run.smithi111.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T18:53:04.789 INFO:teuthology.orchestra.run.smithi111.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T18:53:04.789 INFO:teuthology.orchestra.run.smithi111.stdout: "suspended": 0, 2024-09-12T18:53:04.789 INFO:teuthology.orchestra.run.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:53:04.789 INFO:teuthology.orchestra.run.smithi111.stdout: "subusers": [], 2024-09-12T18:53:04.789 INFO:teuthology.orchestra.run.smithi111.stdout: "keys": [ 2024-09-12T18:53:04.789 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:53:04.789 INFO:teuthology.orchestra.run.smithi111.stdout: "user": "tester.client.0", 2024-09-12T18:53:04.789 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "GRMLAJZNMYVUCGQZMOEU", 2024-09-12T18:53:04.790 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "ignQkO2cnhpAG9ruSZQJRZ+W1xCwoUqDbo2i6EMu7lpfSQCmdsLegA==", 2024-09-12T18:53:04.790 INFO:teuthology.orchestra.run.smithi111.stdout: "active": true, 2024-09-12T18:53:04.790 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:53:04.778056Z" 2024-09-12T18:53:04.790 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:53:04.790 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:53:04.790 INFO:teuthology.orchestra.run.smithi111.stdout: "swift_keys": [], 2024-09-12T18:53:04.790 INFO:teuthology.orchestra.run.smithi111.stdout: "caps": [], 2024-09-12T18:53:04.790 INFO:teuthology.orchestra.run.smithi111.stdout: "op_mask": "read, write, delete", 2024-09-12T18:53:04.790 INFO:teuthology.orchestra.run.smithi111.stdout: "default_placement": "", 2024-09-12T18:53:04.790 INFO:teuthology.orchestra.run.smithi111.stdout: "default_storage_class": "", 2024-09-12T18:53:04.790 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_tags": [], 2024-09-12T18:53:04.790 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2024-09-12T18:53:04.790 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:53:04.791 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:53:04.791 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:53:04.791 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:53:04.791 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:53:04.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:53:04.791 INFO:teuthology.orchestra.run.smithi111.stdout: "user_quota": { 2024-09-12T18:53:04.791 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:53:04.791 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:53:04.791 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:53:04.791 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:53:04.791 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:53:04.791 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:53:04.791 INFO:teuthology.orchestra.run.smithi111.stdout: "temp_url_keys": [], 2024-09-12T18:53:04.792 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "rgw", 2024-09-12T18:53:04.792 INFO:teuthology.orchestra.run.smithi111.stdout: "mfa_ids": [], 2024-09-12T18:53:04.792 INFO:teuthology.orchestra.run.smithi111.stdout: "account_id": "", 2024-09-12T18:53:04.792 INFO:teuthology.orchestra.run.smithi111.stdout: "path": "/", 2024-09-12T18:53:04.792 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:53:04.778019Z", 2024-09-12T18:53:04.792 INFO:teuthology.orchestra.run.smithi111.stdout: "tags": [], 2024-09-12T18:53:04.792 INFO:teuthology.orchestra.run.smithi111.stdout: "group_ids": [] 2024-09-12T18:53:04.792 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:53:04.792 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:04.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.787+0000 7f0cd37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:53:04.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.791+0000 7f0e1f6bf9c0 20 remove_watcher() i=0 2024-09-12T18:53:04.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.791+0000 7f0e1f6bf9c0 2 removed watcher, disabling cache 2024-09-12T18:53:04.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.795+0000 7f0e1f6bf9c0 20 remove_watcher() i=1 2024-09-12T18:53:04.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.795+0000 7f0e1f6bf9c0 20 remove_watcher() i=2 2024-09-12T18:53:04.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.795+0000 7f0e1f6bf9c0 20 remove_watcher() i=3 2024-09-12T18:53:04.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.799+0000 7f0e1f6bf9c0 20 remove_watcher() i=4 2024-09-12T18:53:04.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.799+0000 7f0e1f6bf9c0 20 remove_watcher() i=5 2024-09-12T18:53:04.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.803+0000 7f0e1f6bf9c0 20 remove_watcher() i=6 2024-09-12T18:53:04.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:04.803+0000 7f0e1f6bf9c0 20 remove_watcher() i=7 2024-09-12T18:53:04.823 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:53:04.823 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T18:53:04.872 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T18:53:04.872 DEBUG:teuthology.orchestra.run.smithi111:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T18:53:04.918 DEBUG:teuthology.orchestra.run.smithi111:> radosgw-admin gc process --include-all 2024-09-12T18:53:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:53:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:53:05.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.035+0000 7fc1089909c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:05.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.035+0000 7fc1089909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:05.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.035+0000 7fc1089909c0 20 realm 2024-09-12T18:53:05.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.035+0000 7fc1089909c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:05.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.035+0000 7fc1089909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:05.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.035+0000 7fc1089909c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:53:05.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.035+0000 7fc1089909c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:05.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.035+0000 7fc1089909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:05.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.035+0000 7fc1089909c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:05.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.039+0000 7fc1089909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:53:05.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.039+0000 7fc1089909c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:05.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.039+0000 7fc1089909c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:53:05.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.039+0000 7fc1089909c0 20 searching for the correct realm 2024-09-12T18:53:05.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.043+0000 7fc105c95640 0 -- 172.21.15.111:0/3334044434 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7fc0f8027040 msgr2=0x7fc0f8019430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:53:05.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.255+0000 7fc106496640 0 -- 172.21.15.111:0/3334044434 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fc100128040 msgr2=0x7fc1000a7a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:53:05.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.271+0000 7fc1089909c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:53:05.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.271+0000 7fc1089909c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:53:05.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.271+0000 7fc1089909c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:53:05.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.271+0000 7fc1089909c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:53:05.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.271+0000 7fc1089909c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:53:05.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.271+0000 7fc1089909c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:53:05.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.271+0000 7fc1089909c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:05.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.271+0000 7fc1089909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:05.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.271+0000 7fc1089909c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:05.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:53:05.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:05.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:53:05.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 20 zone default found 2024-09-12T18:53:05.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 4 Realm: () 2024-09-12T18:53:05.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:53:05.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:53:05.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:53:05.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 20 zonegroup default 2024-09-12T18:53:05.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:05.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:05.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:05.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:05.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:05.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:05.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 20 started sync module instance, tier type = 2024-09-12T18:53:05.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.275+0000 7fc1089909c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:53:05.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.299+0000 7fc1089909c0 20 add_watcher() i=0 2024-09-12T18:53:05.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.299+0000 7fc1089909c0 20 add_watcher() i=1 2024-09-12T18:53:05.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.299+0000 7fc1089909c0 20 add_watcher() i=2 2024-09-12T18:53:05.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.299+0000 7fc1089909c0 20 add_watcher() i=3 2024-09-12T18:53:05.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.299+0000 7fc1089909c0 20 add_watcher() i=4 2024-09-12T18:53:05.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.299+0000 7fc1089909c0 20 add_watcher() i=5 2024-09-12T18:53:05.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.299+0000 7fc1089909c0 20 add_watcher() i=6 2024-09-12T18:53:05.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.303+0000 7fc1089909c0 20 add_watcher() i=7 2024-09-12T18:53:05.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.303+0000 7fc1089909c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:53:05.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.307+0000 7fbfbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:53:05.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.307+0000 7fc1089909c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:53:05.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.307+0000 7fc1089909c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:53:05.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.399+0000 7fbf377fe640 20 reqs_thread_entry: start 2024-09-12T18:53:05.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.399+0000 7fc1089909c0 20 init_complete bucket index max shards: 11 2024-09-12T18:53:05.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.399+0000 7fc1089909c0 20 Filter name: none 2024-09-12T18:53:05.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.399+0000 7fbf357fa640 20 reqs_thread_entry: start 2024-09-12T18:53:05.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.399+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:53:05.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T18:53:05.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='_G7ERP6jvbpXmSG3ht0CpvREp2ikDLmq', time=2024-09-12T20:43:46.394397+0000, chain.objs.size()=3 2024-09-12T18:53:05.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.uoACddA2ptWJfuYX3cm0k6QLCRGK08H_0 2024-09-12T18:53:05.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.uoACddA2ptWJfuYX3cm0k6QLCRGK08H_1 2024-09-12T18:53:05.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.uoACddA2ptWJfuYX3cm0k6QLCRGK08H_2 2024-09-12T18:53:05.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1385904735549168355', time=2024-09-12T20:45:22.928119+0000, chain.objs.size()=1 2024-09-12T18:53:05.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.AFnRmf_v-MqC_K9nhfIRdeXWuNElrRx_0 2024-09-12T18:53:05.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1702962393944661957', time=2024-09-12T20:46:01.163554+0000, chain.objs.size()=1 2024-09-12T18:53:05.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.vvg6bnBfgfUztl7gsad67ch3I_re7p2_0 2024-09-12T18:53:05.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11188681545158403116', time=2024-09-12T20:46:01.170649+0000, chain.objs.size()=1 2024-09-12T18:53:05.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.0nCNZvHknAsoTw1dEcykQrh-QLq6OkZ_0 2024-09-12T18:53:05.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4820456466841390909', time=2024-09-12T20:46:35.897362+0000, chain.objs.size()=1 2024-09-12T18:53:05.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.7ykFPFHfEaevkki9O6SwnYvdhWixZvf_0 2024-09-12T18:53:05.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12876984259189801973', time=2024-09-12T20:46:38.119552+0000, chain.objs.size()=1 2024-09-12T18:53:05.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.M5q2AwW3cRrKOBQHFQec0B-K3tUZels_0 2024-09-12T18:53:05.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18397639420691033716', time=2024-09-12T20:46:38.126854+0000, chain.objs.size()=1 2024-09-12T18:53:05.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.P6a7VJsY_kD4JPVXK99fMoxPaX6pnUe_0 2024-09-12T18:53:05.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14650066925977640840', time=2024-09-12T20:46:39.893672+0000, chain.objs.size()=1 2024-09-12T18:53:05.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.3xVoLknA3Vzind6aBmIrtDQ9H-H4eGc_0 2024-09-12T18:53:05.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1743044267974602876', time=2024-09-12T20:46:39.895527+0000, chain.objs.size()=1 2024-09-12T18:53:05.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.SkrQJv6Oc_kft0Gn00GzW3E2X3X2SLC_0 2024-09-12T18:53:05.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3388399156951323892', time=2024-09-12T20:47:13.121840+0000, chain.objs.size()=1 2024-09-12T18:53:05.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.403+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.JwOsdyAdJxsen4p-AOnjfgrjQwRLCz7_0 2024-09-12T18:53:05.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.407+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4366733565396463523', time=2024-09-12T20:47:16.240069+0000, chain.objs.size()=1 2024-09-12T18:53:05.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.407+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.6crVkrf0-K3RPUgcJjfcpuRnS8OYJTJ_0 2024-09-12T18:53:05.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.407+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9687526698778482206', time=2024-09-12T20:47:16.243172+0000, chain.objs.size()=1 2024-09-12T18:53:05.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.407+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.X0gli_V6LFwegshfAXdiZ7L7kR1Zhns_0 2024-09-12T18:53:05.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.407+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4362174913712062558', time=2024-09-12T20:47:16.262133+0000, chain.objs.size()=1 2024-09-12T18:53:05.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.407+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.8HEKwyOrLGdTZefmS2Y19kddN5cCdGq_0 2024-09-12T18:53:05.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.836791584124012141', time=2024-09-12T20:47:52.838132+0000, chain.objs.size()=1 2024-09-12T18:53:05.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.z4YnfEdwSCulzB5eSxRxZbgAtVX79iN_0 2024-09-12T18:53:05.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5697969920932880188', time=2024-09-12T20:47:52.843791+0000, chain.objs.size()=1 2024-09-12T18:53:05.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_._fgYHgHveUxsARbNsB7y6HWCD5G7PxM_0 2024-09-12T18:53:05.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15983998959375342897', time=2024-09-12T20:48:30.934655+0000, chain.objs.size()=1 2024-09-12T18:53:05.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.FUAqVjjiwuGDp2oRA0ThipLHhG7Vi4X_0 2024-09-12T18:53:05.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14573589583638098639', time=2024-09-12T20:49:04.013684+0000, chain.objs.size()=1 2024-09-12T18:53:05.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.LaiJ6jNFlw3MkwMqN3oeJwxnpu29MqK_0 2024-09-12T18:53:05.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10679489920346846864', time=2024-09-12T20:49:43.409707+0000, chain.objs.size()=1 2024-09-12T18:53:05.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.kIv4kXxIO-9JL6_ZIt55ZAq--l5mVDb_0 2024-09-12T18:53:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8484345185372158485', time=2024-09-12T20:49:45.188655+0000, chain.objs.size()=1 2024-09-12T18:53:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.4f2Ls7vTNvbEXCksJ8wRkc8ppR3NBDL_0 2024-09-12T18:53:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16831626706230822198', time=2024-09-12T20:50:19.099693+0000, chain.objs.size()=1 2024-09-12T18:53:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.P6S-jcO-wS_wpSa3hdy31MINAMwg8qx_0 2024-09-12T18:53:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15517595254587216847', time=2024-09-12T20:52:28.714294+0000, chain.objs.size()=1 2024-09-12T18:53:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.411+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.17__shadow_.hK0Jfo1lfymZ-NNpKPCzu5MiaRJMOtJ_0 2024-09-12T18:53:05.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.415+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.419+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:53:05.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T18:53:05.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8605850082400200395', time=2024-09-12T20:43:46.207413+0000, chain.objs.size()=2 2024-09-12T18:53:05.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.roO8KZwuOubh2yQeho0penm6GMSIEB2_0 2024-09-12T18:53:05.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.roO8KZwuOubh2yQeho0penm6GMSIEB2_1 2024-09-12T18:53:05.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7634965542007028196', time=2024-09-12T20:43:46.383970+0000, chain.objs.size()=5 2024-09-12T18:53:05.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.1 2024-09-12T18:53:05.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.1_1 2024-09-12T18:53:05.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.2 2024-09-12T18:53:05.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.2_1 2024-09-12T18:53:05.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.3 2024-09-12T18:53:05.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.157056092714499448', time=2024-09-12T20:45:24.695203+0000, chain.objs.size()=1 2024-09-12T18:53:05.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.ad25h9aXeG9Ou1kOEazo4e5J1VsNWNR_0 2024-09-12T18:53:05.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2641656482370520164', time=2024-09-12T20:46:03.123109+0000, chain.objs.size()=1 2024-09-12T18:53:05.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.Fa_qiavbWF7yMJJA9aPLgeL2fSqWhuX_0 2024-09-12T18:53:05.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3634549058382475973', time=2024-09-12T20:46:03.132566+0000, chain.objs.size()=1 2024-09-12T18:53:05.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.65ubqiEf9DGpY0-dsMdoEEi1mwNHamc_0 2024-09-12T18:53:05.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5730757547678714385', time=2024-09-12T20:46:39.899177+0000, chain.objs.size()=1 2024-09-12T18:53:05.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.J6b_X0xYTDyxX4TxgstQqDu__GLPqMp_0 2024-09-12T18:53:05.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1739023004656093790', time=2024-09-12T20:47:16.267380+0000, chain.objs.size()=1 2024-09-12T18:53:05.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.423+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.EEMMhyJ6J3P9rmg0ijsS-y4VHcIbm_Y_0 2024-09-12T18:53:05.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.427+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12825188685023216374', time=2024-09-12T20:47:18.375410+0000, chain.objs.size()=1 2024-09-12T18:53:05.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.427+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_._5aC_SmzUujJd-2W34KlZRFG0TnG-3V_0 2024-09-12T18:53:05.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.427+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12206691743887789566', time=2024-09-12T20:49:06.188276+0000, chain.objs.size()=1 2024-09-12T18:53:05.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.427+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.GLdcWAMoY6gD8SYotMuhK-ryGyXY6VB_0 2024-09-12T18:53:05.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.427+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15082845103030633000', time=2024-09-12T20:49:07.083535+0000, chain.objs.size()=1 2024-09-12T18:53:05.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.427+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.vX1CdwtPBqOpnYeFyKMn8u5M9LaBbb6_0 2024-09-12T18:53:05.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.427+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6413821812968110007', time=2024-09-12T20:49:45.188377+0000, chain.objs.size()=1 2024-09-12T18:53:05.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.427+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.iSxGNUdhOT5-_3l2ztRxO9uAAPkKhzb_0 2024-09-12T18:53:05.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.431+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.435+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:53:05.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:53:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10644876349128241786', time=2024-09-12T20:43:45.873577+0000, chain.objs.size()=1 2024-09-12T18:53:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.IyTyPxS_xskb6zYrmSBjsPGXefFcsb0_0 2024-09-12T18:53:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2844962566488950906', time=2024-09-12T20:46:01.150629+0000, chain.objs.size()=1 2024-09-12T18:53:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.Ys0fNj_eM74mKoSJ2XazG8Fc0FpcT9m_0 2024-09-12T18:53:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5327971099959096813', time=2024-09-12T20:46:03.119490+0000, chain.objs.size()=1 2024-09-12T18:53:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.gN7Zw8AllaBeWvuLdm-1A1dPvyHYY3N_0 2024-09-12T18:53:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15265423111192845775', time=2024-09-12T20:46:39.891233+0000, chain.objs.size()=1 2024-09-12T18:53:05.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.bqST_JVc1AT_khxDJ3PMxo2hEJQMOmJ_0 2024-09-12T18:53:05.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7890696810917390048', time=2024-09-12T20:46:41.577597+0000, chain.objs.size()=1 2024-09-12T18:53:05.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.pf-5bVaCOWGpFYly9rPNic5zlnyeBEz_0 2024-09-12T18:53:05.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.137275927753303811', time=2024-09-12T20:47:13.131154+0000, chain.objs.size()=1 2024-09-12T18:53:05.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.ptNY2T8d2ztXOle6PFKL-eLCvA0lcZt_0 2024-09-12T18:53:05.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3023550684166789278', time=2024-09-12T20:48:30.939403+0000, chain.objs.size()=1 2024-09-12T18:53:05.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.yUxxhTUgo_aqnQ_YBTGjc2TilViWG5P_0 2024-09-12T18:53:05.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12023583571551208804', time=2024-09-12T20:49:40.315887+0000, chain.objs.size()=1 2024-09-12T18:53:05.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.GxFop8k1ClfEFelFksJg6HTrCNyBn6__0 2024-09-12T18:53:05.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16366486322271768753', time=2024-09-12T20:49:43.413732+0000, chain.objs.size()=1 2024-09-12T18:53:05.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.44dY4bD3q1S14-Uj-mQhqV9ItOXlr2Z_0 2024-09-12T18:53:05.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15451113472434289045', time=2024-09-12T20:49:43.415735+0000, chain.objs.size()=1 2024-09-12T18:53:05.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.ybjo1zroXlWbBQwgf1AdWIpMsdsaC2W_0 2024-09-12T18:53:05.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15647757737414552912', time=2024-09-12T20:49:45.179637+0000, chain.objs.size()=1 2024-09-12T18:53:05.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.-BjkfWvkt3t_PzKvEBXe4PWgJ2EYFjI_0 2024-09-12T18:53:05.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8514553975461337307', time=2024-09-12T20:50:19.099319+0000, chain.objs.size()=1 2024-09-12T18:53:05.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.439+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.gDnUklwho_8NDa-4tutW4G3be0q3BHj_0 2024-09-12T18:53:05.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.443+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11018407460452355253', time=2024-09-12T20:52:28.715389+0000, chain.objs.size()=1 2024-09-12T18:53:05.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.443+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.17__shadow_.CBDSp7A14J_6U-oyKBVOjv8GR5dc7_u_0 2024-09-12T18:53:05.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.447+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.451+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:53:05.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:53:05.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17346819871101230521', time=2024-09-12T20:43:46.138966+0000, chain.objs.size()=2 2024-09-12T18:53:05.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.Y4MpRgpPAyfI4cyGIXy4x-hg4TkkO7A_0 2024-09-12T18:53:05.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.Y4MpRgpPAyfI4cyGIXy4x-hg4TkkO7A_1 2024-09-12T18:53:05.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11835019199715828503', time=2024-09-12T20:43:46.188767+0000, chain.objs.size()=2 2024-09-12T18:53:05.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.roO8KZwuOubh2yQeho0penm6GMSIEB2_0 2024-09-12T18:53:05.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.roO8KZwuOubh2yQeho0penm6GMSIEB2_1 2024-09-12T18:53:05.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7744059512073799951', time=2024-09-12T20:46:03.114220+0000, chain.objs.size()=1 2024-09-12T18:53:05.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_._ZywDnf_2CxKeXakUmabzhr1ax4DMTT_0 2024-09-12T18:53:05.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16762122403090130150', time=2024-09-12T20:46:37.202559+0000, chain.objs.size()=1 2024-09-12T18:53:05.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.8PoYP12LhJ45GZNBxUb1FBrxG1JGJhA_0 2024-09-12T18:53:05.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7689111611254568521', time=2024-09-12T20:46:38.118536+0000, chain.objs.size()=1 2024-09-12T18:53:05.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.IryytWp1HfdLlNZtMPDcIjgGsex1cLd_0 2024-09-12T18:53:05.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2982087031035287821', time=2024-09-12T20:47:13.127229+0000, chain.objs.size()=1 2024-09-12T18:53:05.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.XgZmLlXYG8BA1qkhwz4TLTmwuNbPgHa_0 2024-09-12T18:53:05.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4538588807441129350', time=2024-09-12T20:47:13.139997+0000, chain.objs.size()=1 2024-09-12T18:53:05.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.yI63-UPLnrtgKugtjSmiNLrJWaSiKbV_0 2024-09-12T18:53:05.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17300382903275341070', time=2024-09-12T20:47:16.250696+0000, chain.objs.size()=1 2024-09-12T18:53:05.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.3Ey4TlegDAvYERDVGjNUO4Cvacs8GUX_0 2024-09-12T18:53:05.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11342095395499362066', time=2024-09-12T20:47:49.722868+0000, chain.objs.size()=1 2024-09-12T18:53:05.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.n8bZx0TGE8gS7mJrc_dTNiwBXtWUQ2D_0 2024-09-12T18:53:05.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3402779788508206913', time=2024-09-12T20:47:52.844842+0000, chain.objs.size()=1 2024-09-12T18:53:05.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.455+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.fvjjZR2jdWQDervJt71C0YzmP3s953w_0 2024-09-12T18:53:05.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.459+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4654568641073378983', time=2024-09-12T20:48:30.932131+0000, chain.objs.size()=1 2024-09-12T18:53:05.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.459+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.ommTkfok70dtxQvZMgN_5P0WRrCZL07_0 2024-09-12T18:53:05.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.459+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2475192495115920638', time=2024-09-12T20:49:04.016729+0000, chain.objs.size()=1 2024-09-12T18:53:05.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.459+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.M0dCtC2NqSMM8P8CfIknsBfSwF6R-kx_0 2024-09-12T18:53:05.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.463+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12522586792782954904', time=2024-09-12T20:49:04.027904+0000, chain.objs.size()=1 2024-09-12T18:53:05.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.463+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.mZOnoeBPotQ0fxL_iBI4tIjXIpB0T2l_0 2024-09-12T18:53:05.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.463+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3225622277649728940', time=2024-09-12T20:49:07.094855+0000, chain.objs.size()=1 2024-09-12T18:53:05.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.463+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.kk7HVh-zczwNsS6HoS51rwW-WqkvgbW_0 2024-09-12T18:53:05.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.463+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4649682890709962064', time=2024-09-12T20:49:40.309232+0000, chain.objs.size()=1 2024-09-12T18:53:05.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.463+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.T5RTlN-fUzl04-pS3DhrlnywvQWFDAj_0 2024-09-12T18:53:05.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.463+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10052349019302516992', time=2024-09-12T20:49:40.311982+0000, chain.objs.size()=1 2024-09-12T18:53:05.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.463+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.3s5rqeHi8HTXpxcY6f3VsOh_ek52bV-_0 2024-09-12T18:53:05.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.463+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5430194234668611203', time=2024-09-12T20:49:40.316502+0000, chain.objs.size()=1 2024-09-12T18:53:05.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.463+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.okfNwuhb0QyyTDnZnMU7dIjXZnzAgNu_0 2024-09-12T18:53:05.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.463+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2241586216846530035', time=2024-09-12T20:50:19.122107+0000, chain.objs.size()=1 2024-09-12T18:53:05.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.463+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.3Ri5tDqhuZieBC7guhYGu1hVGlHhCSI_0 2024-09-12T18:53:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.467+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.471+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:53:05.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:53:05.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1826251127256592324', time=2024-09-12T20:43:46.167595+0000, chain.objs.size()=2 2024-09-12T18:53:05.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.qIk5xFPB23EAiHqTmrezm1m3WIMEb8z_0 2024-09-12T18:53:05.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.qIk5xFPB23EAiHqTmrezm1m3WIMEb8z_1 2024-09-12T18:53:05.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='_vnjH3ZPfejjmAPc3Kf-XBkTNeSfI90s', time=2024-09-12T20:43:46.177056+0000, chain.objs.size()=2 2024-09-12T18:53:05.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.Jb-kA52M7HsuyN0Kb-wcvdsxvBpsKLr_0 2024-09-12T18:53:05.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.Jb-kA52M7HsuyN0Kb-wcvdsxvBpsKLr_1 2024-09-12T18:53:05.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8358101813561783202', time=2024-09-12T20:43:46.795540+0000, chain.objs.size()=1 2024-09-12T18:53:05.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.8__shadow_.O9a_wHa6BOr8OI2Kir1tN18gGESbDhn_0 2024-09-12T18:53:05.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4512236717710729418', time=2024-09-12T20:45:22.927276+0000, chain.objs.size()=1 2024-09-12T18:53:05.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.ZSKwANWKMSLalQ0PvgIFr_COsC-P69h_0 2024-09-12T18:53:05.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10923042203082398438', time=2024-09-12T20:46:01.153803+0000, chain.objs.size()=1 2024-09-12T18:53:05.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.7NxniHHBbmj20VSAFePD52MJu2gYpvn_0 2024-09-12T18:53:05.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17406880345576742442', time=2024-09-12T20:46:04.575883+0000, chain.objs.size()=1 2024-09-12T18:53:05.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.qEKRFE0ZxGYFO69Q3sswvDvg6mgIiaA_0 2024-09-12T18:53:05.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15031659053917656003', time=2024-09-12T20:46:35.904948+0000, chain.objs.size()=1 2024-09-12T18:53:05.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.AyDWXeUFIGdTDLqBYZWHQMeIRwRAzbp_0 2024-09-12T18:53:05.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4678479944066260998', time=2024-09-12T20:46:38.113196+0000, chain.objs.size()=1 2024-09-12T18:53:05.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.NlNV53WqEr476xLu0xwVlu4TaQhyn1P_0 2024-09-12T18:53:05.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14686807433185042438', time=2024-09-12T20:47:16.252811+0000, chain.objs.size()=1 2024-09-12T18:53:05.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.DoLGH46q1VfphvsBpQyWiFHRNw-w2mq_0 2024-09-12T18:53:05.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11160156242951944967', time=2024-09-12T20:47:52.850411+0000, chain.objs.size()=1 2024-09-12T18:53:05.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.475+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.QJy34beNo_OYSqKcQLoDBTO8ixHSvQ9_0 2024-09-12T18:53:05.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.479+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11135706733395498480', time=2024-09-12T20:47:55.049049+0000, chain.objs.size()=1 2024-09-12T18:53:05.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.479+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.7MkJAU9NM9h8Lb8dDnKOQvZ-R2FQW8-_0 2024-09-12T18:53:05.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.479+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3462681399490190900', time=2024-09-12T20:48:30.926030+0000, chain.objs.size()=1 2024-09-12T18:53:05.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.479+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.VcqrtjgJb0vFNICCy_r3hc3YJC4uYY2_0 2024-09-12T18:53:05.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.483+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1551256461451577008', time=2024-09-12T20:48:30.944990+0000, chain.objs.size()=1 2024-09-12T18:53:05.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.483+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.WsMv5NHcUNEe7lIqmTVtssh_8Y8gV8Z_0 2024-09-12T18:53:05.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.483+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9480790143748716267', time=2024-09-12T20:49:43.408371+0000, chain.objs.size()=1 2024-09-12T18:53:05.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.483+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.i8Xyr1T-XHy3DzOl8AXk0nc2WAN_e9N_0 2024-09-12T18:53:05.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.483+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11339560056464399012', time=2024-09-12T20:50:19.105941+0000, chain.objs.size()=1 2024-09-12T18:53:05.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.483+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.ULTpETlMPkYyxjpt5n8U47BZDPprQ3m_0 2024-09-12T18:53:05.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.483+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1204202585446762048', time=2024-09-12T20:52:28.718624+0000, chain.objs.size()=1 2024-09-12T18:53:05.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.483+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.17__shadow_.UPbJ1QNtF_blpFPJwcbFjPI0Xc_XoEY_0 2024-09-12T18:53:05.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.487+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.491+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:53:05.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:53:05.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17950753458456230350', time=2024-09-12T20:43:45.883007+0000, chain.objs.size()=1 2024-09-12T18:53:05.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.VNV_0a6SD15fQgCmHm9XFkDIdNMeGSA_0 2024-09-12T18:53:05.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10937224087767340409', time=2024-09-12T20:43:46.363288+0000, chain.objs.size()=5 2024-09-12T18:53:05.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.1 2024-09-12T18:53:05.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.1_1 2024-09-12T18:53:05.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.2 2024-09-12T18:53:05.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.2_1 2024-09-12T18:53:05.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-LUKEWARM.2~VfwEAK011jjGuTfdR6vcbUDr7nxeDlQ.3 2024-09-12T18:53:05.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11381257314695194615', time=2024-09-12T20:43:46.701476+0000, chain.objs.size()=1 2024-09-12T18:53:05.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.7__shadow_.DPUJXObMKImaZG2JGugPuY_Ylohpaws_0 2024-09-12T18:53:05.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8152290088192153943', time=2024-09-12T20:45:24.697013+0000, chain.objs.size()=1 2024-09-12T18:53:05.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.rKaO_Pdf-Aowv6rCv9_GOVKDjy14K9p_0 2024-09-12T18:53:05.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9716054601607988938', time=2024-09-12T20:45:24.699700+0000, chain.objs.size()=1 2024-09-12T18:53:05.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.m60jX94suK-VZqoMCF770LnXsgzDN98_0 2024-09-12T18:53:05.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9540134454740608159', time=2024-09-12T20:46:03.118179+0000, chain.objs.size()=1 2024-09-12T18:53:05.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.SQazn5KvHyaXeWKvNMl22Y24lB1AETI_0 2024-09-12T18:53:05.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6963790337446268328', time=2024-09-12T20:46:39.915287+0000, chain.objs.size()=1 2024-09-12T18:53:05.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.D0QqwkeMKcyP171NnhQcGE0nvBtu9nn_0 2024-09-12T18:53:05.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7935841385053074180', time=2024-09-12T20:47:13.135343+0000, chain.objs.size()=1 2024-09-12T18:53:05.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.495+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.QutSF20HAQ-YL8e8-PqP1kb2cfMK9QZ_0 2024-09-12T18:53:05.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.503+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8115093585033529619', time=2024-09-12T20:47:16.246724+0000, chain.objs.size()=1 2024-09-12T18:53:05.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.503+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.P9ZG-zFcjbaSvZ9ApTuaSGIh-0tfWFG_0 2024-09-12T18:53:05.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.503+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12132606583908012533', time=2024-09-12T20:47:49.716628+0000, chain.objs.size()=1 2024-09-12T18:53:05.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.503+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.eFJIZOaEH2yOzue-UCzj9RepAhwpfs0_0 2024-09-12T18:53:05.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.503+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12531233108499871715', time=2024-09-12T20:49:07.081415+0000, chain.objs.size()=1 2024-09-12T18:53:05.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.503+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.GsuyJCJakI6ogSpjj8WXbP85PItO3uL_0 2024-09-12T18:53:05.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.503+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16356136104532825051', time=2024-09-12T20:49:07.087142+0000, chain.objs.size()=1 2024-09-12T18:53:05.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.503+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.2IZlvrniMuNkBRc9zg-BS9wlb9ccsoL_0 2024-09-12T18:53:05.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.503+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6375311812632345539', time=2024-09-12T20:49:40.311838+0000, chain.objs.size()=1 2024-09-12T18:53:05.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.503+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.95t383auBS0Ht5v4rEZvFrgz5ds1aFW_0 2024-09-12T18:53:05.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.503+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8008236318293709026', time=2024-09-12T20:49:43.415583+0000, chain.objs.size()=1 2024-09-12T18:53:05.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.503+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.BxS-YFsHmDfCQ_0rtOtl6FjpiFAOMxq_0 2024-09-12T18:53:05.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.503+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13641637018829720401', time=2024-09-12T20:49:45.195155+0000, chain.objs.size()=1 2024-09-12T18:53:05.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.503+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.JbvKQGkhgj58hnK5WilfTx1ksbLCba8_0 2024-09-12T18:53:05.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.507+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.511+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:53:05.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:53:05.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2681203772670160822', time=2024-09-12T20:43:46.338845+0000, chain.objs.size()=5 2024-09-12T18:53:05.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.1 2024-09-12T18:53:05.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.1_1 2024-09-12T18:53:05.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.2 2024-09-12T18:53:05.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.2_1 2024-09-12T18:53:05.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.3 2024-09-12T18:53:05.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7938331560006010191', time=2024-09-12T20:45:22.921784+0000, chain.objs.size()=1 2024-09-12T18:53:05.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.fE20UaV3FFyOWtXuI3v9lBeK2_r9nVZ_0 2024-09-12T18:53:05.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3638080762465182396', time=2024-09-12T20:45:22.923970+0000, chain.objs.size()=1 2024-09-12T18:53:05.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.pQZE3XZw8k4m1cYMsNpvGqBJB6Ir-dx_0 2024-09-12T18:53:05.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13546146566478337786', time=2024-09-12T20:45:22.925038+0000, chain.objs.size()=1 2024-09-12T18:53:05.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.09tFIZhde8gRpm3b5bO3YMLktpOmE5b_0 2024-09-12T18:53:05.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17212670478520148817', time=2024-09-12T20:45:22.938326+0000, chain.objs.size()=1 2024-09-12T18:53:05.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.nQigOsBQpdneubkZIK6LXgZOTJIltPD_0 2024-09-12T18:53:05.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7407099888933917911', time=2024-09-12T20:45:24.697019+0000, chain.objs.size()=1 2024-09-12T18:53:05.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.oUscnKDg6odtGyZuQlW4HYrFY2v5qil_0 2024-09-12T18:53:05.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10480069119818224442', time=2024-09-12T20:46:38.115474+0000, chain.objs.size()=1 2024-09-12T18:53:05.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.pAZ3GxdKA5Lrb3e8lsFITMmGKV-eh8A_0 2024-09-12T18:53:05.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15590907460433911072', time=2024-09-12T20:46:38.126284+0000, chain.objs.size()=1 2024-09-12T18:53:05.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.515+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.rfrz5i5AYhtyS35IJUXb0gq7vWUxYt__0 2024-09-12T18:53:05.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.519+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3085204333393454151', time=2024-09-12T20:47:13.122249+0000, chain.objs.size()=1 2024-09-12T18:53:05.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.519+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.QWNtDdIhLA_6WKoRvqmmXPj4FuK6tvP_0 2024-09-12T18:53:05.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.519+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11982191138124730639', time=2024-09-12T20:47:16.258036+0000, chain.objs.size()=1 2024-09-12T18:53:05.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.519+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.Hzs9E8E6awj-NOZi7JMmrT3MbysCv7p_0 2024-09-12T18:53:05.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.519+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.391368106205310312', time=2024-09-12T20:47:52.840873+0000, chain.objs.size()=1 2024-09-12T18:53:05.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.519+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.ojqkbjN0JPELWnBvhACz57KtClWgoO8_0 2024-09-12T18:53:05.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.519+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12951710463087336289', time=2024-09-12T20:47:55.043181+0000, chain.objs.size()=1 2024-09-12T18:53:05.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.519+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.4pRCZI41z8p2JkgDMBLjElL4fC7DDO__0 2024-09-12T18:53:05.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.519+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16613293859209194801', time=2024-09-12T20:47:55.067446+0000, chain.objs.size()=1 2024-09-12T18:53:05.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.519+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.xM0Hn4AGpngphB48DUxHqhSO7Zst1jK_0 2024-09-12T18:53:05.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.523+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7110209929136401032', time=2024-09-12T20:48:30.936303+0000, chain.objs.size()=1 2024-09-12T18:53:05.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.523+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.pmP2qDx3uaMrM4_t4fdWqFFPqJ3sH50_0 2024-09-12T18:53:05.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.523+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18055921795547182368', time=2024-09-12T20:49:43.404612+0000, chain.objs.size()=1 2024-09-12T18:53:05.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.523+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.jNQcpLLzIbXzVScvJVHl7kgtIpMr_9P_0 2024-09-12T18:53:05.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.523+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8232093206500946685', time=2024-09-12T20:52:28.717498+0000, chain.objs.size()=1 2024-09-12T18:53:05.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.523+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.17__shadow_.ZCwCyY7h-2WiCy91bNP6j0FdMeQZjcX_0 2024-09-12T18:53:05.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.523+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12243165943858998734', time=2024-09-12T20:52:43.329535+0000, chain.objs.size()=1 2024-09-12T18:53:05.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.523+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.18__shadow:LnRxZ5ziGO.i1IdBl0Q0QpdUjeT8Bqc_.JORUbmusPtsGS8ZwkDTCEHH_WkUy9LQ_0 2024-09-12T18:53:05.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.527+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.531+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:53:05.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:53:05.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4436011339451854060', time=2024-09-12T20:43:45.830141+0000, chain.objs.size()=1 2024-09-12T18:53:05.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.tFPWNzZW4SSE6MqMikEGpdtOUUP-h2Y_0 2024-09-12T18:53:05.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15116586851342782797', time=2024-09-12T20:45:21.990099+0000, chain.objs.size()=1 2024-09-12T18:53:05.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.wiRmrnr8N2UAQZ-SooRt93GCIR2Y6JC_0 2024-09-12T18:53:05.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17549450248497075301', time=2024-09-12T20:45:24.690975+0000, chain.objs.size()=1 2024-09-12T18:53:05.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.szmiOcfSKw9ZI8Bgy3w4v3Zqb7pDy3Q_0 2024-09-12T18:53:05.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8554157092182770959', time=2024-09-12T20:46:01.167258+0000, chain.objs.size()=1 2024-09-12T18:53:05.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.Ubj5icmVVb-XYKqbNi0gjDj3K2cxKDC_0 2024-09-12T18:53:05.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18043374830874716022', time=2024-09-12T20:46:03.128226+0000, chain.objs.size()=1 2024-09-12T18:53:05.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.mAVB_-gGmm8yvlIewKlk87J5fI34__Y_0 2024-09-12T18:53:05.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2151633004218525014', time=2024-09-12T20:46:03.142534+0000, chain.objs.size()=1 2024-09-12T18:53:05.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.4fvGbSjlNpF90Ga1kwNrKkv4EmumKhZ_0 2024-09-12T18:53:05.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10325358428313638816', time=2024-09-12T20:46:38.114168+0000, chain.objs.size()=1 2024-09-12T18:53:05.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.qvW5KU2VT-Ysij2L6IESK-EvZ0k3DZS_0 2024-09-12T18:53:05.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9787234824839805287', time=2024-09-12T20:46:38.116977+0000, chain.objs.size()=1 2024-09-12T18:53:05.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.jyJOqJrPO-l996HP1_Go3MNxiAJxnt1_0 2024-09-12T18:53:05.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3988828596949447000', time=2024-09-12T20:47:52.844060+0000, chain.objs.size()=1 2024-09-12T18:53:05.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.2WRioW1LtCIeGJxMXTlrtYG4LXNwEy8_0 2024-09-12T18:53:05.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17188573713093128010', time=2024-09-12T20:47:55.045252+0000, chain.objs.size()=1 2024-09-12T18:53:05.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.Dw_THj-7OfGwh6HDTirWczTBfgduJTi_0 2024-09-12T18:53:05.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1666321713295818064', time=2024-09-12T20:47:55.060045+0000, chain.objs.size()=1 2024-09-12T18:53:05.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.xhwVH9OGJeI_68TGt8bJPrthsvbZZSV_0 2024-09-12T18:53:05.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6793222485415735524', time=2024-09-12T20:48:28.005137+0000, chain.objs.size()=1 2024-09-12T18:53:05.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.535+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.T19IM6eLINI0jmasdoITHUp8eZnBLIx_0 2024-09-12T18:53:05.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.539+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6549212684151156853', time=2024-09-12T20:48:28.006624+0000, chain.objs.size()=1 2024-09-12T18:53:05.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.539+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.GWKBtkxqGVmnO1OA5xBsuUm3dLCU_df_0 2024-09-12T18:53:05.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.539+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13065142742702029397', time=2024-09-12T20:49:04.005259+0000, chain.objs.size()=1 2024-09-12T18:53:05.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.539+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.vkiHnN98bNTZ6-W5LroWeJ6iOVS9h9p_0 2024-09-12T18:53:05.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.539+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13284907759923363783', time=2024-09-12T20:49:04.006109+0000, chain.objs.size()=1 2024-09-12T18:53:05.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.539+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.CcrBSmLRdDtC9_iStZiN-32vssHlSb3_0 2024-09-12T18:53:05.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.539+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17649383842778492917', time=2024-09-12T20:52:28.717003+0000, chain.objs.size()=1 2024-09-12T18:53:05.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.539+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.17__shadow_.NYJqnl41jCfZN5USbDAF4Iu5mEjArnT_0 2024-09-12T18:53:05.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.543+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.547+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:53:05.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:53:05.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15536843064923599243', time=2024-09-12T20:45:24.691108+0000, chain.objs.size()=1 2024-09-12T18:53:05.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.PXuAibNqAN_eeFiI-qnOkdr9kTkMSeA_0 2024-09-12T18:53:05.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4153871359814148478', time=2024-09-12T20:45:24.706031+0000, chain.objs.size()=1 2024-09-12T18:53:05.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.RPH1WnFFYdQkf5TFzkuC_8b5k-BvgXR_0 2024-09-12T18:53:05.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18069318485346442625', time=2024-09-12T20:45:58.131305+0000, chain.objs.size()=1 2024-09-12T18:53:05.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.YojJqLYrG2vRdZsVJZ4yAaBTx8h1oo8_0 2024-09-12T18:53:05.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15468538263193500740', time=2024-09-12T20:45:58.133952+0000, chain.objs.size()=1 2024-09-12T18:53:05.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.bgS1yrp4MepwUtInPOBPHl70D-4abHH_0 2024-09-12T18:53:05.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16056739822726466054', time=2024-09-12T20:46:01.159500+0000, chain.objs.size()=1 2024-09-12T18:53:05.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.B_VdZD6h9udw2LCSHMiEEphYXu073ZF_0 2024-09-12T18:53:05.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10998379845456444979', time=2024-09-12T20:46:03.116004+0000, chain.objs.size()=1 2024-09-12T18:53:05.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.sW485acC9-jaanThj2ZPUi2oPLC9Aao_0 2024-09-12T18:53:05.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12266654711105233022', time=2024-09-12T20:46:39.916361+0000, chain.objs.size()=1 2024-09-12T18:53:05.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.70hxCjgPu71XFTi67f3FVk54v-dk19n_0 2024-09-12T18:53:05.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12666588180850350245', time=2024-09-12T20:47:13.146766+0000, chain.objs.size()=1 2024-09-12T18:53:05.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.JgP3k-u1QiAXy2GLvHddw9VNQvew86v_0 2024-09-12T18:53:05.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2549471520699109052', time=2024-09-12T20:47:49.709979+0000, chain.objs.size()=1 2024-09-12T18:53:05.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.wcSkcLeUH_fZBpXCGgD0qXqhiCTKsBs_0 2024-09-12T18:53:05.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2486212400133663737', time=2024-09-12T20:47:55.061396+0000, chain.objs.size()=1 2024-09-12T18:53:05.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.Yin2oKirwJi7XR0WXTOfDlBuxNrBN1p_0 2024-09-12T18:53:05.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15712168223167937777', time=2024-09-12T20:48:27.987193+0000, chain.objs.size()=1 2024-09-12T18:53:05.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.3j0eGVrKCK1rR58OvGpKtlaH8t3-G8-_0 2024-09-12T18:53:05.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16126703295824050362', time=2024-09-12T20:48:27.990583+0000, chain.objs.size()=1 2024-09-12T18:53:05.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.551+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.L4pgODq42IfcKJlfbMBsFXjlpvKf9NC_0 2024-09-12T18:53:05.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.555+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2217781902326216480', time=2024-09-12T20:50:19.100083+0000, chain.objs.size()=1 2024-09-12T18:53:05.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.555+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.eNG-FXemdc-cTEYzF2dJhvkifnj-J2q_0 2024-09-12T18:53:05.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.559+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.563+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:53:05.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T18:53:05.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7655713617634948146', time=2024-09-12T20:43:45.838933+0000, chain.objs.size()=1 2024-09-12T18:53:05.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.PjJ_IFEA5VEUHNBC002XghQjpSPlqQ1_0 2024-09-12T18:53:05.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3341280490876601415', time=2024-09-12T20:43:46.405155+0000, chain.objs.size()=5 2024-09-12T18:53:05.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.1 2024-09-12T18:53:05.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.1_1 2024-09-12T18:53:05.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.2 2024-09-12T18:53:05.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.2_1 2024-09-12T18:53:05.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.3 2024-09-12T18:53:05.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9998496195536834723', time=2024-09-12T20:45:24.690467+0000, chain.objs.size()=1 2024-09-12T18:53:05.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.v4vQpNg-QrYpLMnwNa7wncRdyVTs2B6_0 2024-09-12T18:53:05.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.956401979874804792', time=2024-09-12T20:46:35.898552+0000, chain.objs.size()=1 2024-09-12T18:53:05.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.XrvIFSjzlcL2Z8U5nKRlkuwg3BBkMuV_0 2024-09-12T18:53:05.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5130714679237169419', time=2024-09-12T20:46:38.123732+0000, chain.objs.size()=1 2024-09-12T18:53:05.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.9BxJHNmNYpHVBxTqPiq8fyuywgZXgxI_0 2024-09-12T18:53:05.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14627972897998200945', time=2024-09-12T20:47:13.125745+0000, chain.objs.size()=1 2024-09-12T18:53:05.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.cVkIrMHHf_ORblU2pCNtvBsQhUByHjA_0 2024-09-12T18:53:05.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18127520076987218745', time=2024-09-12T20:47:13.138012+0000, chain.objs.size()=1 2024-09-12T18:53:05.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.Jsh4_K7KGRQb9uapGaX0292qoaLL8SX_0 2024-09-12T18:53:05.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2654745897067446110', time=2024-09-12T20:47:49.721521+0000, chain.objs.size()=1 2024-09-12T18:53:05.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.567+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.A7ly4Z6NLGoDS4tuOLvh6fKEE0GgrXS_0 2024-09-12T18:53:05.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.571+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10593839113206672683', time=2024-09-12T20:47:52.839692+0000, chain.objs.size()=1 2024-09-12T18:53:05.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.571+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.4U3zhadWU84dFhKR5Ia20xfV4PjrGX0_0 2024-09-12T18:53:05.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.571+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5427248529772050767', time=2024-09-12T20:47:55.051220+0000, chain.objs.size()=1 2024-09-12T18:53:05.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.571+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.Eaa5JTLq_4-EcZEQvgWL_KMghKbufq5_0 2024-09-12T18:53:05.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.571+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9604430916809923730', time=2024-09-12T20:47:55.058843+0000, chain.objs.size()=1 2024-09-12T18:53:05.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.571+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.DQAHsfS_ioOvcZh4CAOAEPlzTk_AfCA_0 2024-09-12T18:53:05.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.571+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3080765011866741843', time=2024-09-12T20:48:27.992158+0000, chain.objs.size()=1 2024-09-12T18:53:05.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.571+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.hN2QU2puYXbK1OlOnivW-oaPP_W_aCF_0 2024-09-12T18:53:05.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.571+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12152521027777550160', time=2024-09-12T20:48:30.937071+0000, chain.objs.size()=1 2024-09-12T18:53:05.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.571+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.iuHDnxFiLpp7NWqn84KuwcC6lURid3W_0 2024-09-12T18:53:05.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.571+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15850969140385494531', time=2024-09-12T20:48:30.940571+0000, chain.objs.size()=1 2024-09-12T18:53:05.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.571+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.iV8p7DyCA_sTJl3aRJ8gOZ_-wvmGV1a_0 2024-09-12T18:53:05.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.571+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10821167925526506604', time=2024-09-12T20:49:04.006714+0000, chain.objs.size()=1 2024-09-12T18:53:05.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.571+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.AYh1EBs6Nmy-XVsXisDrPse2KLxarba_0 2024-09-12T18:53:05.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.575+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1019708270287700252', time=2024-09-12T20:49:04.012825+0000, chain.objs.size()=1 2024-09-12T18:53:05.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.575+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.7BpQe8v6CUt0KiKscn4ly9pBRNOq3PP_0 2024-09-12T18:53:05.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.575+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13846511914306681617', time=2024-09-12T20:49:43.428946+0000, chain.objs.size()=1 2024-09-12T18:53:05.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.575+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.T14OplkmSUlcRjR2DkoV5Kpqy-QtVrL_0 2024-09-12T18:53:05.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.575+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1141620498759182649', time=2024-09-12T20:49:47.141940+0000, chain.objs.size()=1 2024-09-12T18:53:05.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.575+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.ccBzQo3gGRkC6VWe7zVf0M1tIWTTgJI_0 2024-09-12T18:53:05.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.575+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10345198493504969982', time=2024-09-12T20:50:19.106901+0000, chain.objs.size()=1 2024-09-12T18:53:05.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.575+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.i9sxAsWIZon9Kt1VKNtay6JHKPsPFOO_0 2024-09-12T18:53:05.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.579+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.579+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:53:05.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:53:05.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15275725136874123704', time=2024-09-12T20:45:22.927979+0000, chain.objs.size()=1 2024-09-12T18:53:05.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.OnxUUJ_XyB21QGixIGjng3Nhe248eU5_0 2024-09-12T18:53:05.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2794010289980303389', time=2024-09-12T20:46:01.155973+0000, chain.objs.size()=1 2024-09-12T18:53:05.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.LrIuZOlaOsptBhaDU0bJ7w16GAouGiG_0 2024-09-12T18:53:05.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2325449878404600880', time=2024-09-12T20:47:13.133615+0000, chain.objs.size()=1 2024-09-12T18:53:05.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.UV0qgLslCgzeyCaLWK8_tSBSM21OlVQ_0 2024-09-12T18:53:05.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6857552484999625596', time=2024-09-12T20:47:16.240716+0000, chain.objs.size()=1 2024-09-12T18:53:05.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.cD71xsw213zB_goFLDdRKC7qcDCzDrP_0 2024-09-12T18:53:05.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5972621132695429502', time=2024-09-12T20:47:49.711663+0000, chain.objs.size()=1 2024-09-12T18:53:05.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.JA5XYR1UDjNAYiueW-Dcz0G8EI-3wW__0 2024-09-12T18:53:05.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10039757397358130511', time=2024-09-12T20:47:51.501799+0000, chain.objs.size()=1 2024-09-12T18:53:05.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.J-2iC5dOysNiLQfitNxcqTHQPFbtPWG_0 2024-09-12T18:53:05.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8741099263650841948', time=2024-09-12T20:48:27.993293+0000, chain.objs.size()=1 2024-09-12T18:53:05.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.yB4vlZsMC8ezjmRU7i-BxLmaGwYUUwk_0 2024-09-12T18:53:05.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7070145752657693286', time=2024-09-12T20:48:27.994389+0000, chain.objs.size()=1 2024-09-12T18:53:05.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.3QAs4SUptyHnNZ3aZhaIhoLj4l_R_QN_0 2024-09-12T18:53:05.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3342685347018029891', time=2024-09-12T20:48:30.944304+0000, chain.objs.size()=1 2024-09-12T18:53:05.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.dNyrBWV9KrMy8Cyjm6dIwESnpH-pwe2_0 2024-09-12T18:53:05.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5104441900993499683', time=2024-09-12T20:49:04.003572+0000, chain.objs.size()=1 2024-09-12T18:53:05.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.Jbzgz_HKS78AiymkHpCTSaavfB5gOBk_0 2024-09-12T18:53:05.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4333609839797214849', time=2024-09-12T20:49:04.004640+0000, chain.objs.size()=1 2024-09-12T18:53:05.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.TG0fleEeyRqgVk5eeCSeRxanBYUN3Jj_0 2024-09-12T18:53:05.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11659085444138077063', time=2024-09-12T20:49:07.105089+0000, chain.objs.size()=1 2024-09-12T18:53:05.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.583+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.ucrqL5cJ46HMJRvl8CepDs3dKDS5s_l_0 2024-09-12T18:53:05.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.587+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3113738457531773224', time=2024-09-12T20:49:40.322432+0000, chain.objs.size()=1 2024-09-12T18:53:05.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.587+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.rTTkcKT9hcnlUKQ4X9stsgjtKlvJmlM_0 2024-09-12T18:53:05.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.587+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5133154162441912365', time=2024-09-12T20:49:42.490104+0000, chain.objs.size()=1 2024-09-12T18:53:05.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.587+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.9WGuddGjPls4Wukm58D9TH9HmmJCwQY_0 2024-09-12T18:53:05.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.587+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8979642819409518752', time=2024-09-12T20:52:43.328970+0000, chain.objs.size()=1 2024-09-12T18:53:05.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.587+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.18__shadow:A1RBqtebdpCj9o0YL7kBbeLlBDIm1gk_.SICq4cRHLDyU0TlWnSYV0ZvbNxlHvXM_0 2024-09-12T18:53:05.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.591+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.595+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:53:05.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T18:53:05.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9631380537803902259', time=2024-09-12T20:43:46.026677+0000, chain.objs.size()=4 2024-09-12T18:53:05.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.10__multipart_foo.2~4tGtHc2T3u2Bqstf8KCRKLsgYzD1bWs.1 2024-09-12T18:53:05.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.10__multipart_foo.2~4tGtHc2T3u2Bqstf8KCRKLsgYzD1bWs.2 2024-09-12T18:53:05.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.10__multipart_foo.2~4tGtHc2T3u2Bqstf8KCRKLsgYzD1bWs.3 2024-09-12T18:53:05.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.10__multipart_foo.2~4tGtHc2T3u2Bqstf8KCRKLsgYzD1bWs.4 2024-09-12T18:53:05.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2478200505443123963', time=2024-09-12T20:43:46.462804+0000, chain.objs.size()=5 2024-09-12T18:53:05.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-FROZEN.2~gHqLahp_LPmQbcIw8EU_nX5y8k0bx8N.1 2024-09-12T18:53:05.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.14__shadow_foo-FROZEN.2~gHqLahp_LPmQbcIw8EU_nX5y8k0bx8N.1_1 2024-09-12T18:53:05.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-FROZEN.2~gHqLahp_LPmQbcIw8EU_nX5y8k0bx8N.2 2024-09-12T18:53:05.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.14__shadow_foo-FROZEN.2~gHqLahp_LPmQbcIw8EU_nX5y8k0bx8N.2_1 2024-09-12T18:53:05.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-FROZEN.2~gHqLahp_LPmQbcIw8EU_nX5y8k0bx8N.3 2024-09-12T18:53:05.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11400639650902437484', time=2024-09-12T20:45:58.134208+0000, chain.objs.size()=1 2024-09-12T18:53:05.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.wO15Nkp_y8hlQ_xaCt5CKj_jOFx7pAa_0 2024-09-12T18:53:05.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6121975904382419295', time=2024-09-12T20:46:01.146631+0000, chain.objs.size()=1 2024-09-12T18:53:05.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.me4gz1mdAmiUW_fml0VeJnJHKheO3wy_0 2024-09-12T18:53:05.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.809290766336228943', time=2024-09-12T20:47:13.138954+0000, chain.objs.size()=1 2024-09-12T18:53:05.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.599+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.pTaKylSLZk9RZ2RsXxsbdkUtczKlGUg_0 2024-09-12T18:53:05.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.607+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4984701914327870747', time=2024-09-12T20:47:16.246425+0000, chain.objs.size()=1 2024-09-12T18:53:05.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.607+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.aw9GifYKzXziuqrZWOh4igqgK5CCgYF_0 2024-09-12T18:53:05.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.607+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10158082922112804702', time=2024-09-12T20:47:55.063077+0000, chain.objs.size()=1 2024-09-12T18:53:05.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.607+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.iv0QOvQJNku36H8T2Dz8YFsrABkInDd_0 2024-09-12T18:53:05.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.607+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5679039506868483898', time=2024-09-12T20:49:07.085573+0000, chain.objs.size()=1 2024-09-12T18:53:05.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.607+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.rneSwzr0QTwQ8IoguINj9ZGhhjVJjw7_0 2024-09-12T18:53:05.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.607+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13345467569056723617', time=2024-09-12T20:49:07.097060+0000, chain.objs.size()=1 2024-09-12T18:53:05.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.607+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.JDa5J6SVQDj4joC9DrXHyfMHFqoft1d_0 2024-09-12T18:53:05.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.607+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13311350162785314630', time=2024-09-12T20:50:19.103044+0000, chain.objs.size()=1 2024-09-12T18:53:05.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.607+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.8J1PoMomH2guzO_EPKz8TCiNGAnVfBS_0 2024-09-12T18:53:05.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.611+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.615+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:53:05.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T18:53:05.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2035632215276871814', time=2024-09-12T20:43:45.848623+0000, chain.objs.size()=1 2024-09-12T18:53:05.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.7JytkotfHIa-hE6YjchQWgt3m4jy5md_0 2024-09-12T18:53:05.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='_cyw4VwB132CupC299p72sl42t408iwN', time=2024-09-12T20:43:46.319085+0000, chain.objs.size()=3 2024-09-12T18:53:05.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.bB2uHQ1V8mj0xAzuUO2UqxnsSVs9WZc_0 2024-09-12T18:53:05.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.bB2uHQ1V8mj0xAzuUO2UqxnsSVs9WZc_1 2024-09-12T18:53:05.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.bB2uHQ1V8mj0xAzuUO2UqxnsSVs9WZc_2 2024-09-12T18:53:05.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4798136523961795867', time=2024-09-12T20:43:46.541411+0000, chain.objs.size()=3 2024-09-12T18:53:05.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.13__shadow_.hJ-9029EWPBPwZWYAOgaUpOfvA1DJNW_0 2024-09-12T18:53:05.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.13__shadow_.hJ-9029EWPBPwZWYAOgaUpOfvA1DJNW_1 2024-09-12T18:53:05.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.13__shadow_.hJ-9029EWPBPwZWYAOgaUpOfvA1DJNW_2 2024-09-12T18:53:05.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5219436195127772713', time=2024-09-12T20:43:46.711841+0000, chain.objs.size()=1 2024-09-12T18:53:05.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.7__shadow_.RhekEOUAt7cnqAO1TA8hovqUKcm_ngn_0 2024-09-12T18:53:05.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.247673999682750641', time=2024-09-12T20:45:58.131228+0000, chain.objs.size()=1 2024-09-12T18:53:05.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.DwFjQCp6s-pV0jPdNn6gpXR0MEp9pJm_0 2024-09-12T18:53:05.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6552804537574051353', time=2024-09-12T20:45:58.138972+0000, chain.objs.size()=1 2024-09-12T18:53:05.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.lAiJmARgyoka9lBt2cuO4CDvfGQpMtk_0 2024-09-12T18:53:05.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3379759191393263408', time=2024-09-12T20:46:01.147837+0000, chain.objs.size()=1 2024-09-12T18:53:05.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.TZAaCYwmKc7m4ecGM6E8B6PoMbkfoxR_0 2024-09-12T18:53:05.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12432047499363786682', time=2024-09-12T20:46:03.140728+0000, chain.objs.size()=1 2024-09-12T18:53:05.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.619+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.ALYERM5pV46iAbNSVUGbsS6z2PuO-_b_0 2024-09-12T18:53:05.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.623+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14331227095611109856', time=2024-09-12T20:46:38.135967+0000, chain.objs.size()=1 2024-09-12T18:53:05.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.623+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.9kaaqXgFqlZkI4RdEAltV_odlURiFTN_0 2024-09-12T18:53:05.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16321607595807180109', time=2024-09-12T20:46:39.896927+0000, chain.objs.size()=1 2024-09-12T18:53:05.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.bpoBBG9kUVoU4-VJIkwkVgwZtb69_Qk_0 2024-09-12T18:53:05.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11028982643896270682', time=2024-09-12T20:47:13.125836+0000, chain.objs.size()=1 2024-09-12T18:53:05.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.QE4yKORuiL_h8gWDj1pDyHzlRuzolMQ_0 2024-09-12T18:53:05.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3824496040402092123', time=2024-09-12T20:47:49.715101+0000, chain.objs.size()=1 2024-09-12T18:53:05.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.VDigHgJ-k5-l96HIy87Lc--0HH0ihjr_0 2024-09-12T18:53:05.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6146527022922799477', time=2024-09-12T20:48:30.939401+0000, chain.objs.size()=1 2024-09-12T18:53:05.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.S7YEdvw3RMYQSic6v_Km_loDfIs-JP6_0 2024-09-12T18:53:05.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14861052095903890875', time=2024-09-12T20:49:04.014612+0000, chain.objs.size()=1 2024-09-12T18:53:05.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.lkKlLGhhVz7zIRH_mQINSwlnkZ5g1cN_0 2024-09-12T18:53:05.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14000579734370641263', time=2024-09-12T20:49:08.989943+0000, chain.objs.size()=1 2024-09-12T18:53:05.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.FJwBnMO41rp6yaVaSHECpQ8aUrx2dhH_0 2024-09-12T18:53:05.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14362151596061296318', time=2024-09-12T20:49:40.313251+0000, chain.objs.size()=1 2024-09-12T18:53:05.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.LkGYFLULhgZpz1HrNiEMVU8C__2bPX7_0 2024-09-12T18:53:05.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9173344259291329656', time=2024-09-12T20:49:40.322359+0000, chain.objs.size()=1 2024-09-12T18:53:05.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.ThRDxewGhtXtU4WkuP6lkhbvJa5IlNG_0 2024-09-12T18:53:05.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4546741606078908619', time=2024-09-12T20:49:40.327867+0000, chain.objs.size()=1 2024-09-12T18:53:05.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.iQ7QAx1XtxrB9j6b3uvwfEqnuA43sZT_0 2024-09-12T18:53:05.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7094709603728276111', time=2024-09-12T20:49:45.196285+0000, chain.objs.size()=1 2024-09-12T18:53:05.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.FMQYo73UC8VJe73-wk5Lpb2lTEw5Kr5_0 2024-09-12T18:53:05.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14561193010569873142', time=2024-09-12T20:50:19.113923+0000, chain.objs.size()=1 2024-09-12T18:53:05.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.627+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.a8-9C6z8IMp2oQHP4fCqAmp0C4n4125_0 2024-09-12T18:53:05.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.631+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12881853776597294665', time=2024-09-12T20:50:19.120853+0000, chain.objs.size()=1 2024-09-12T18:53:05.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.631+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.BJxfJIhP1L7IY85NZ6k-k_TqMNNdOxl_0 2024-09-12T18:53:05.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.635+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.639+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:53:05.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:53:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16381898703241342418', time=2024-09-12T20:43:46.307721+0000, chain.objs.size()=5 2024-09-12T18:53:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.1 2024-09-12T18:53:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.1_1 2024-09-12T18:53:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.2 2024-09-12T18:53:05.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.2_1 2024-09-12T18:53:05.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-FROZEN.2~a9EMzBTK8TGgSBgpP7vRuNTLLWKhAdF.3 2024-09-12T18:53:05.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13569440310618399720', time=2024-09-12T20:45:22.929511+0000, chain.objs.size()=1 2024-09-12T18:53:05.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.JqFdPGN5wlWRBJqB_a59r_mNYkHUpH7_0 2024-09-12T18:53:05.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3048894782281993299', time=2024-09-12T20:45:58.151547+0000, chain.objs.size()=1 2024-09-12T18:53:05.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.lpJMaWfCCgPd4wk4aah_rzIur80mwdw_0 2024-09-12T18:53:05.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10175613548136841596', time=2024-09-12T20:46:39.905388+0000, chain.objs.size()=1 2024-09-12T18:53:05.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.wcfJUK9WinWHywO5F3fNBJ_pio2KCWE_0 2024-09-12T18:53:05.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9488758259495021183', time=2024-09-12T20:47:13.144554+0000, chain.objs.size()=1 2024-09-12T18:53:05.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.ppTSDR_i4WX0QSX1kX9n3tIFjgOlx5B_0 2024-09-12T18:53:05.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7924784283179984668', time=2024-09-12T20:47:16.259545+0000, chain.objs.size()=1 2024-09-12T18:53:05.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.2O7maA_ETJ7xysUs02cQO5Oi7zRaue6_0 2024-09-12T18:53:05.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7895429388663479483', time=2024-09-12T20:47:52.845872+0000, chain.objs.size()=1 2024-09-12T18:53:05.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.CCvVe21knvFPyAszeqNyewVQ6-M3bdr_0 2024-09-12T18:53:05.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2313928166955971659', time=2024-09-12T20:47:55.049476+0000, chain.objs.size()=1 2024-09-12T18:53:05.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.643+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.zHUOm8PPLvm8AHHwoUNvYl5AFV7Z0sL_0 2024-09-12T18:53:05.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.647+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2743086051237587046', time=2024-09-12T20:48:27.998981+0000, chain.objs.size()=1 2024-09-12T18:53:05.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.647+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.KV5_ASpv_4yVY1ysdy_HQmEfK4HsjU3_0 2024-09-12T18:53:05.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.647+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1604391070870706633', time=2024-09-12T20:48:28.004970+0000, chain.objs.size()=1 2024-09-12T18:53:05.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.647+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.865jkkqSCNSmJFOcZhbf37Ew-I1HXDv_0 2024-09-12T18:53:05.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.647+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14353081161889897919', time=2024-09-12T20:49:04.015047+0000, chain.objs.size()=1 2024-09-12T18:53:05.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.647+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.2Swr5PPE2CcjcIj9nkqIX2FWd3zeoNr_0 2024-09-12T18:53:05.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.647+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12204625287954250885', time=2024-09-12T20:49:07.078419+0000, chain.objs.size()=1 2024-09-12T18:53:05.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.647+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.l0Bf4OgYp4LmyZ6i4kfiPIIrbvCOaUh_0 2024-09-12T18:53:05.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.647+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7461078047268538619', time=2024-09-12T20:49:07.099878+0000, chain.objs.size()=1 2024-09-12T18:53:05.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.647+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.eQPOnG1K1jv-q8c_0PX2XiInxDlje_Z_0 2024-09-12T18:53:05.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.647+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.156660052828424029', time=2024-09-12T20:52:28.709708+0000, chain.objs.size()=1 2024-09-12T18:53:05.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.647+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.17__shadow_.vNuP-3W4vnNUUpHVgHx5LUJy6IPnqXt_0 2024-09-12T18:53:05.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.647+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15695150203354548336', time=2024-09-12T20:52:28.714091+0000, chain.objs.size()=1 2024-09-12T18:53:05.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.647+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.17__shadow_.2VhZIwmArcwNKY7bVYLhAWFtwuxKdBw_0 2024-09-12T18:53:05.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.651+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.655+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:53:05.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.659+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.659+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:53:05.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12984744036617568023', time=2024-09-12T20:43:46.806628+0000, chain.objs.size()=1 2024-09-12T18:53:05.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.8__shadow_.-SVnn2sBgDJ84RfAK7noD8_SrSH25g2_0 2024-09-12T18:53:05.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12157708635099658471', time=2024-09-12T20:45:22.928925+0000, chain.objs.size()=1 2024-09-12T18:53:05.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.PKflJRXvog6gGsnAPIAHzzmFS92IJQY_0 2024-09-12T18:53:05.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8411858216704609418', time=2024-09-12T20:45:58.134593+0000, chain.objs.size()=1 2024-09-12T18:53:05.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.p7N0I16uGDEvG1Xbeng4resb29Qqse__0 2024-09-12T18:53:05.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11130353461445927584', time=2024-09-12T20:46:01.157322+0000, chain.objs.size()=1 2024-09-12T18:53:05.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.Z6DDmTOTOz2j8dkF1PzeuQqtqftUz_I_0 2024-09-12T18:53:05.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4076582341760838620', time=2024-09-12T20:46:03.127090+0000, chain.objs.size()=1 2024-09-12T18:53:05.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.hp5O3VAEyeDFgplPZnKo_Uz-rjzfN6u_0 2024-09-12T18:53:05.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6680617188898055863', time=2024-09-12T20:46:39.894646+0000, chain.objs.size()=1 2024-09-12T18:53:05.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.jzDs4p-2_Zmzoo9udDQWR3Csnwgda4G_0 2024-09-12T18:53:05.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12787943777204381430', time=2024-09-12T20:46:39.896632+0000, chain.objs.size()=1 2024-09-12T18:53:05.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.Wenvmtw8jGemMnHOhgMj1pSepcHxOwr_0 2024-09-12T18:53:05.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5201183457043877786', time=2024-09-12T20:46:39.902468+0000, chain.objs.size()=1 2024-09-12T18:53:05.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.VlkFlnHin0NlNOkucEQCAst5-EZ01Db_0 2024-09-12T18:53:05.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4632457888360411124', time=2024-09-12T20:47:49.724864+0000, chain.objs.size()=1 2024-09-12T18:53:05.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.1696hyWuq2E7Azac77_X5Eqna_6UmqZ_0 2024-09-12T18:53:05.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16546601319214292320', time=2024-09-12T20:47:49.734690+0000, chain.objs.size()=1 2024-09-12T18:53:05.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.8AFt85q3kLA4M9GIVqQ5C_fATJAphK4_0 2024-09-12T18:53:05.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6127964168593454114', time=2024-09-12T20:47:55.052148+0000, chain.objs.size()=1 2024-09-12T18:53:05.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.s8izgct3QzoByocUYcBNlgLn3uaUSW4_0 2024-09-12T18:53:05.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3124979338198646376', time=2024-09-12T20:47:55.064467+0000, chain.objs.size()=1 2024-09-12T18:53:05.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.663+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.3nXlDpU-C-av-LC3xhBJKSqeROSV4Y__0 2024-09-12T18:53:05.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.667+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7997153334745159958', time=2024-09-12T20:48:27.985952+0000, chain.objs.size()=1 2024-09-12T18:53:05.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.667+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.nd9cEArcQSyVktDbrKrrASBkZarfXl1_0 2024-09-12T18:53:05.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.667+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8325140093249225201', time=2024-09-12T20:49:04.021392+0000, chain.objs.size()=1 2024-09-12T18:53:05.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.667+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.vAkeQqBcUkfvPGv1kOuYr4on9Y9K-jD_0 2024-09-12T18:53:05.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.667+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3589432369540174046', time=2024-09-12T20:49:43.415885+0000, chain.objs.size()=1 2024-09-12T18:53:05.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.667+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.OPfErtpNeSfejhRaGmXc65TE1MQIjUd_0 2024-09-12T18:53:05.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.667+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5237472518853516565', time=2024-09-12T20:49:45.191772+0000, chain.objs.size()=1 2024-09-12T18:53:05.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.667+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.mUDQ4A0e5VxBoxHJ9_VNAXzjVZx-Q93_0 2024-09-12T18:53:05.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.667+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9233525062512257686', time=2024-09-12T20:50:19.097306+0000, chain.objs.size()=1 2024-09-12T18:53:05.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.667+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.pCsCcA8hgKskelCeE7dqQPt52X3PPTy_0 2024-09-12T18:53:05.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.667+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.671+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:53:05.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T18:53:05.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9990337323767791176', time=2024-09-12T20:45:22.923763+0000, chain.objs.size()=1 2024-09-12T18:53:05.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.O6Fj_8Pf49trMJVfYtu8W0lGRZnz56q_0 2024-09-12T18:53:05.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2058060740074388248', time=2024-09-12T20:45:24.691363+0000, chain.objs.size()=1 2024-09-12T18:53:05.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.8UGXNu34kOV6XgQ_QqH0yTejY-EQEj__0 2024-09-12T18:53:05.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5901286010255921457', time=2024-09-12T20:46:01.147601+0000, chain.objs.size()=1 2024-09-12T18:53:05.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.IVBIgHs2vOsEkHp5iATkbVQCMO01Cue_0 2024-09-12T18:53:05.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18308838870341241857', time=2024-09-12T20:46:01.154743+0000, chain.objs.size()=1 2024-09-12T18:53:05.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.gkVLyEmy9zJ2X5I4cDHq6rvhEjDV8d5_0 2024-09-12T18:53:05.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.306084654787644023', time=2024-09-12T20:46:01.158210+0000, chain.objs.size()=1 2024-09-12T18:53:05.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.t2eiZP65NleVDnhQrnzmkj0i4V2QyPl_0 2024-09-12T18:53:05.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16397633692466501620', time=2024-09-12T20:46:03.117684+0000, chain.objs.size()=1 2024-09-12T18:53:05.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.jiAbeEaPGKLeLGyyBDHbXwI8lZXI06L_0 2024-09-12T18:53:05.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5580385930232177768', time=2024-09-12T20:46:03.125805+0000, chain.objs.size()=1 2024-09-12T18:53:05.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.BZq_I-fJwtaDmOHSjT1GfTQPkEJI29b_0 2024-09-12T18:53:05.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11918000150540164163', time=2024-09-12T20:46:03.139906+0000, chain.objs.size()=1 2024-09-12T18:53:05.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.oAvaSFANvBIeA7ktNsccRmm_AUXUQ4s_0 2024-09-12T18:53:05.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8479936994012012865', time=2024-09-12T20:46:35.896667+0000, chain.objs.size()=1 2024-09-12T18:53:05.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.RsWDV1ju9t2IErq55vubJ2ZQ3OJe0vH_0 2024-09-12T18:53:05.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12480614250764073331', time=2024-09-12T20:46:35.898980+0000, chain.objs.size()=1 2024-09-12T18:53:05.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.675+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.NL3xoRElL8rw5IdDWgNGAgU7GsRu6-2_0 2024-09-12T18:53:05.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.679+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5224144321433721096', time=2024-09-12T20:46:35.908904+0000, chain.objs.size()=1 2024-09-12T18:53:05.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.679+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.xrpnPCVwxdmGaCmV-xo7pOlSMC7Y-jv_0 2024-09-12T18:53:05.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.679+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10914122025222695543', time=2024-09-12T20:46:39.894738+0000, chain.objs.size()=1 2024-09-12T18:53:05.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.679+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.Ua3ohOEA6V13K0SbJkXkwCX2SUH58LX_0 2024-09-12T18:53:05.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.679+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5181831711980571096', time=2024-09-12T20:46:39.896313+0000, chain.objs.size()=1 2024-09-12T18:53:05.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.679+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.NlLdXRJR0L_ATFOEY59ihwUGmL3FM_t_0 2024-09-12T18:53:05.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9817797984716269516', time=2024-09-12T20:47:55.042683+0000, chain.objs.size()=1 2024-09-12T18:53:05.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.riJzeKWLwdShBpS0cIma0FKqPLR72go_0 2024-09-12T18:53:05.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13304889360427050820', time=2024-09-12T20:47:55.047953+0000, chain.objs.size()=1 2024-09-12T18:53:05.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.a6O1HDRICka2iv9svW20zFm4T33uMqj_0 2024-09-12T18:53:05.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10212773649015270311', time=2024-09-12T20:48:30.933130+0000, chain.objs.size()=1 2024-09-12T18:53:05.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.7y8oxMEBWlhHRmY6HxurYzn918ftXuY_0 2024-09-12T18:53:05.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16319074372060146454', time=2024-09-12T20:49:45.177727+0000, chain.objs.size()=1 2024-09-12T18:53:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.N2VMN69Ouesckg66SrVOPZ7s2rIV8JW_0 2024-09-12T18:53:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10989970972422148631', time=2024-09-12T20:49:45.181456+0000, chain.objs.size()=1 2024-09-12T18:53:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.P_EI9mFBU9op9LPkZDKesnbbzI03NJw_0 2024-09-12T18:53:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7511556436999689467', time=2024-09-12T20:49:45.188037+0000, chain.objs.size()=1 2024-09-12T18:53:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.7tQN2mULz9KXV_0rbpBArOwFi96kT3I_0 2024-09-12T18:53:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15304282056729751372', time=2024-09-12T20:50:19.107972+0000, chain.objs.size()=1 2024-09-12T18:53:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.GPxHVSgn3KRvrGDDbwPxWIAsp8X0YKD_0 2024-09-12T18:53:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6052692572595839588', time=2024-09-12T20:52:28.716683+0000, chain.objs.size()=1 2024-09-12T18:53:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.683+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.17__shadow_.kfy9K59jFWWGb2z5CfECLxjxKQ8Do6u_0 2024-09-12T18:53:05.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.687+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.691+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:53:05.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.691+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:53:05.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='_imIDvnmyCzijw1tDN7SR3at7REs3umT', time=2024-09-12T20:43:46.129297+0000, chain.objs.size()=2 2024-09-12T18:53:05.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.mPUaACFMhbTugBGLjAT2n8NONSk8RIJ_0 2024-09-12T18:53:05.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.mPUaACFMhbTugBGLjAT2n8NONSk8RIJ_1 2024-09-12T18:53:05.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10555273284301631574', time=2024-09-12T20:43:46.231152+0000, chain.objs.size()=2 2024-09-12T18:53:05.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.Y4MpRgpPAyfI4cyGIXy4x-hg4TkkO7A_0 2024-09-12T18:53:05.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.Y4MpRgpPAyfI4cyGIXy4x-hg4TkkO7A_1 2024-09-12T18:53:05.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='_iUDcryP0VOZOLGQeJHA5BHmSY3daT5U', time=2024-09-12T20:43:46.287288+0000, chain.objs.size()=3 2024-09-12T18:53:05.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.rsjGqy_2gw3uq-WBJ5cP5XMUhCivtOm_0 2024-09-12T18:53:05.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.rsjGqy_2gw3uq-WBJ5cP5XMUhCivtOm_1 2024-09-12T18:53:05.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.rsjGqy_2gw3uq-WBJ5cP5XMUhCivtOm_2 2024-09-12T18:53:05.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8176762953963527258', time=2024-09-12T20:46:03.133519+0000, chain.objs.size()=1 2024-09-12T18:53:05.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.yRaSQiWJDssMXrJnH-KhDGZLzGv5Zc6_0 2024-09-12T18:53:05.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3907951466419031768', time=2024-09-12T20:46:35.900736+0000, chain.objs.size()=1 2024-09-12T18:53:05.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.oS5IRgcCWhlRA3a3jBcp4IgXEqvYlXu_0 2024-09-12T18:53:05.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5084122588863541160', time=2024-09-12T20:47:16.248513+0000, chain.objs.size()=1 2024-09-12T18:53:05.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.DPQymj81XHok9AHmJfBGUHxmhWpiNjZ_0 2024-09-12T18:53:05.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10864168027184695018', time=2024-09-12T20:47:49.725355+0000, chain.objs.size()=1 2024-09-12T18:53:05.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.GAz68Ha_B_QWTTNUtBxJ9iPVTWE0XRV_0 2024-09-12T18:53:05.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3217307559625293924', time=2024-09-12T20:47:49.727749+0000, chain.objs.size()=1 2024-09-12T18:53:05.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.695+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.Dckjm7K_Z4FsVDSU5hg6rdyihbrInM1_0 2024-09-12T18:53:05.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.699+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7888372719354488151', time=2024-09-12T20:47:55.057208+0000, chain.objs.size()=1 2024-09-12T18:53:05.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.699+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.1cGWCNmLlqOIaSfiio5c8BxusBZcKa9_0 2024-09-12T18:53:05.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.699+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10891195630362640142', time=2024-09-12T20:48:27.986768+0000, chain.objs.size()=1 2024-09-12T18:53:05.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.699+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.Pc0Q2eLEK3dJI39sbduBwxpIkujwa7O_0 2024-09-12T18:53:05.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.703+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6848063210929859083', time=2024-09-12T20:48:27.992050+0000, chain.objs.size()=1 2024-09-12T18:53:05.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.703+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.O4sbCQWG9cfYREi_NIMTEnNNblDj8Bj_0 2024-09-12T18:53:05.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.703+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14135625860863433048', time=2024-09-12T20:49:43.403583+0000, chain.objs.size()=1 2024-09-12T18:53:05.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.703+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_._WH1ekvxr4QgpUWZFoW9GbqKQJCzlSW_0 2024-09-12T18:53:05.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.703+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17512049679107904652', time=2024-09-12T20:49:43.424512+0000, chain.objs.size()=1 2024-09-12T18:53:05.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.703+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.Nc637jpkAdwG1nsif_BhKK70Wgf9QKD_0 2024-09-12T18:53:05.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.703+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.707+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:53:05.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.711+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.711+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:53:05.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='_iBL88CqYZGIp6TVuhAHEPKDrhxJkZc9', time=2024-09-12T20:43:46.219861+0000, chain.objs.size()=2 2024-09-12T18:53:05.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.9VUf1WRSgC3eqD9m1aSvTUqwiArowek_0 2024-09-12T18:53:05.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.9VUf1WRSgC3eqD9m1aSvTUqwiArowek_1 2024-09-12T18:53:05.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.323833831932799533', time=2024-09-12T20:45:22.942312+0000, chain.objs.size()=1 2024-09-12T18:53:05.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.OlSyq8EE8CA-klPAal8pr_eopkFqn0h_0 2024-09-12T18:53:05.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17341347043506440209', time=2024-09-12T20:45:24.709666+0000, chain.objs.size()=1 2024-09-12T18:53:05.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.hbMLpx9q2a1XeV0ZAnZkj5ByRzivRWu_0 2024-09-12T18:53:05.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2587222315199674012', time=2024-09-12T20:47:15.330911+0000, chain.objs.size()=1 2024-09-12T18:53:05.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.HveZTP5HaygK9ZxudeCmKhkzgemaK5a_0 2024-09-12T18:53:05.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16319806293902090597', time=2024-09-12T20:47:16.245100+0000, chain.objs.size()=1 2024-09-12T18:53:05.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.UYhCMI-U2r2wrmZcWDho-E5BGPuvod__0 2024-09-12T18:53:05.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2212151830453256602', time=2024-09-12T20:47:49.709780+0000, chain.objs.size()=1 2024-09-12T18:53:05.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.6Yxw3Rt0yQ3ogDPPOSumftORrwWlGYb_0 2024-09-12T18:53:05.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15837074947746272770', time=2024-09-12T20:47:52.835206+0000, chain.objs.size()=1 2024-09-12T18:53:05.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.GZ4S7QztPCjYdDgLgBYn_TswoWhVzT5_0 2024-09-12T18:53:05.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4844267232453065276', time=2024-09-12T20:47:52.851226+0000, chain.objs.size()=1 2024-09-12T18:53:05.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.KACTrZePEjAlATugQCLS_mHbjxxlshg_0 2024-09-12T18:53:05.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3029360183997615018', time=2024-09-12T20:49:07.087847+0000, chain.objs.size()=1 2024-09-12T18:53:05.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.aiFdOa41KyORGYRQmKbx7C_4NtKG3MI_0 2024-09-12T18:53:05.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6021773771611838582', time=2024-09-12T20:49:40.311108+0000, chain.objs.size()=1 2024-09-12T18:53:05.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.7Rf4L_9gw0PzPwj0sm1_GaFyiyYLty3_0 2024-09-12T18:53:05.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7905466505131343079', time=2024-09-12T20:49:40.317546+0000, chain.objs.size()=1 2024-09-12T18:53:05.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.715+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.yq5dU0k7z_R2WG57MEoemuEr5Cnk3xm_0 2024-09-12T18:53:05.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.719+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11364765542015363695', time=2024-09-12T20:49:43.408923+0000, chain.objs.size()=1 2024-09-12T18:53:05.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.719+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.0ck9jEFHBYqLJMaoUV6xpQ4sgiWCwsR_0 2024-09-12T18:53:05.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.719+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1879619324595012471', time=2024-09-12T20:50:19.109605+0000, chain.objs.size()=1 2024-09-12T18:53:05.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.719+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.YBWLNK22Le22-1o0466dhvNDbufzISw_0 2024-09-12T18:53:05.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.719+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.727+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:53:05.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.727+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.727+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T18:53:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12989435964327582621', time=2024-09-12T20:43:45.973589+0000, chain.objs.size()=4 2024-09-12T18:53:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.12__multipart_foo.2~lR0Sc3bxqIybbFtuqFsdIgwi6ycObkT.1 2024-09-12T18:53:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.12__multipart_foo.2~lR0Sc3bxqIybbFtuqFsdIgwi6ycObkT.2 2024-09-12T18:53:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.12__multipart_foo.2~lR0Sc3bxqIybbFtuqFsdIgwi6ycObkT.3 2024-09-12T18:53:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.12__multipart_foo.2~lR0Sc3bxqIybbFtuqFsdIgwi6ycObkT.4 2024-09-12T18:53:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6382250405923912766', time=2024-09-12T20:43:46.485614+0000, chain.objs.size()=5 2024-09-12T18:53:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-LUKEWARM.2~UQ-6sdKtsHlprUJsDuy2lqp1927Qndm.1 2024-09-12T18:53:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.14__shadow_foo-LUKEWARM.2~UQ-6sdKtsHlprUJsDuy2lqp1927Qndm.1_1 2024-09-12T18:53:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-LUKEWARM.2~UQ-6sdKtsHlprUJsDuy2lqp1927Qndm.2 2024-09-12T18:53:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.14__shadow_foo-LUKEWARM.2~UQ-6sdKtsHlprUJsDuy2lqp1927Qndm.2_1 2024-09-12T18:53:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-LUKEWARM.2~UQ-6sdKtsHlprUJsDuy2lqp1927Qndm.3 2024-09-12T18:53:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6764900199312118989', time=2024-09-12T20:45:58.128671+0000, chain.objs.size()=1 2024-09-12T18:53:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.2UAFqDhjj9GnUcjtGLx5RpexSPFN8wv_0 2024-09-12T18:53:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14166576230104093154', time=2024-09-12T20:45:58.136978+0000, chain.objs.size()=1 2024-09-12T18:53:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.zsoo4IPgJqF3OXJ9pWP4lxmEGBRaf0o_0 2024-09-12T18:53:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17567423955404610579', time=2024-09-12T20:45:58.141746+0000, chain.objs.size()=1 2024-09-12T18:53:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.731+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.1Jzh-eZBclYYCKngYcVeQUkP2gD4sW7_0 2024-09-12T18:53:05.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8923169847520983553', time=2024-09-12T20:46:01.152817+0000, chain.objs.size()=1 2024-09-12T18:53:05.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.IzHdPtD5_mV-LwTjW2UBRMhfGIZKJMm_0 2024-09-12T18:53:05.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14104027487656047486', time=2024-09-12T20:46:03.116132+0000, chain.objs.size()=1 2024-09-12T18:53:05.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.YN9rsCv1AorlgE-g8UgLx-qvhTIfz4R_0 2024-09-12T18:53:05.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17979612155813032649', time=2024-09-12T20:46:35.893492+0000, chain.objs.size()=1 2024-09-12T18:53:05.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.9O2feFSjfyyTdDJds0nxZT3sHi4f_KG_0 2024-09-12T18:53:05.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1005991121880824717', time=2024-09-12T20:46:38.115438+0000, chain.objs.size()=1 2024-09-12T18:53:05.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.GlKre1XbngnYl_Uw-uCHl0_qaxXezZ9_0 2024-09-12T18:53:05.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14442387852326490054', time=2024-09-12T20:46:38.120727+0000, chain.objs.size()=1 2024-09-12T18:53:05.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.I2jof_5VEoXuTleC4EzgaGH2hpjO06k_0 2024-09-12T18:53:05.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11579566508859264329', time=2024-09-12T20:46:39.908614+0000, chain.objs.size()=1 2024-09-12T18:53:05.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.6sANJioFZ3xYzwXQdErpD8xOQuMCWUg_0 2024-09-12T18:53:05.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18039322572682185593', time=2024-09-12T20:47:16.245135+0000, chain.objs.size()=1 2024-09-12T18:53:05.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.pgxdO91EaiABOpojksOPUssZ8RFGm1y_0 2024-09-12T18:53:05.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8341034813558078543', time=2024-09-12T20:47:16.247890+0000, chain.objs.size()=1 2024-09-12T18:53:05.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.eHqhwmRnufc9XGCuek5cJsSpow0aDed_0 2024-09-12T18:53:05.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5785474536364219731', time=2024-09-12T20:47:16.250173+0000, chain.objs.size()=1 2024-09-12T18:53:05.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.RYrMf0rT7yixMEuGaRbBSKc8UNTNwv-_0 2024-09-12T18:53:05.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2948617955150673146', time=2024-09-12T20:47:49.717005+0000, chain.objs.size()=1 2024-09-12T18:53:05.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.J0gnhHuaioh1pe9VcPC4ew0cECH5MOE_0 2024-09-12T18:53:05.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15041613901790682428', time=2024-09-12T20:48:30.937569+0000, chain.objs.size()=1 2024-09-12T18:53:05.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.735+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.x1NuMjAV1NYqf1TrbziwByL6GYJiwtw_0 2024-09-12T18:53:05.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.739+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8079248967770176879', time=2024-09-12T20:49:04.009293+0000, chain.objs.size()=1 2024-09-12T18:53:05.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.739+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.KO-Jgrv9k_xM417zEfPvnwmHhPlTr_f_0 2024-09-12T18:53:05.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.739+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10133000063132724031', time=2024-09-12T20:49:07.087029+0000, chain.objs.size()=1 2024-09-12T18:53:05.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.739+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.So0zWifvUgOGDGU_nRT3zxVEuS4FdEN_0 2024-09-12T18:53:05.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.739+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2402824429253453275', time=2024-09-12T20:49:43.410941+0000, chain.objs.size()=1 2024-09-12T18:53:05.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.739+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.mSYbBXyMfRb0n7VXjgbqATYQO9kYbVn_0 2024-09-12T18:53:05.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.739+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3129125467930995147', time=2024-09-12T20:49:45.177080+0000, chain.objs.size()=1 2024-09-12T18:53:05.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.739+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.wW-1qOlxfiaOWAGRJO9ImDQ3H7PaajN_0 2024-09-12T18:53:05.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.739+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3339984903853222485', time=2024-09-12T20:49:45.198218+0000, chain.objs.size()=1 2024-09-12T18:53:05.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.739+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.a-Bnmk4pp_5229PtSJknCXxcCzyNhlT_0 2024-09-12T18:53:05.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.739+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17583070632968624256', time=2024-09-12T20:50:19.103800+0000, chain.objs.size()=1 2024-09-12T18:53:05.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.739+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.cjrtpFMD2j9_M3Krx7cJImcoUy3_i06_0 2024-09-12T18:53:05.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.743+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.747+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:53:05.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T18:53:05.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7716383947879138431', time=2024-09-12T20:43:46.196647+0000, chain.objs.size()=2 2024-09-12T18:53:05.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.qIk5xFPB23EAiHqTmrezm1m3WIMEb8z_0 2024-09-12T18:53:05.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.qIk5xFPB23EAiHqTmrezm1m3WIMEb8z_1 2024-09-12T18:53:05.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4900887226517613761', time=2024-09-12T20:45:22.934816+0000, chain.objs.size()=1 2024-09-12T18:53:05.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.w6Bpyla4rCzZslPQlO_HXH-bHr51ltD_0 2024-09-12T18:53:05.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11700221762365512736', time=2024-09-12T20:45:24.695574+0000, chain.objs.size()=1 2024-09-12T18:53:05.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.NNb0gXINolwA8hiQQsULxEroYsOLVfD_0 2024-09-12T18:53:05.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16507148806699644364', time=2024-09-12T20:45:26.829305+0000, chain.objs.size()=1 2024-09-12T18:53:05.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.R2dbbw1UZIV1LIkxJ0ixr7K5Bbs_NM5_0 2024-09-12T18:53:05.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11161284412987491664', time=2024-09-12T20:45:58.127773+0000, chain.objs.size()=1 2024-09-12T18:53:05.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.G2KwcWiCpnEN_tBzDy8Cxgj_dVu6Zdj_0 2024-09-12T18:53:05.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15416084729248072771', time=2024-09-12T20:45:58.147031+0000, chain.objs.size()=1 2024-09-12T18:53:05.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.XvZzaHp_f_xTzHqUJQP8rxIZCFA8aNn_0 2024-09-12T18:53:05.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1176735990226197858', time=2024-09-12T20:46:01.156782+0000, chain.objs.size()=1 2024-09-12T18:53:05.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.UR5EKkALFYR060vrvydMQgJ-8MywWUX_0 2024-09-12T18:53:05.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17731909710339281570', time=2024-09-12T20:46:35.899916+0000, chain.objs.size()=1 2024-09-12T18:53:05.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.kCfmJJI5yt09C7soIXdvhIqz3iIrUBK_0 2024-09-12T18:53:05.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4092106633274035827', time=2024-09-12T20:47:13.125401+0000, chain.objs.size()=1 2024-09-12T18:53:05.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.hfNtRvK6d0fnNglFpT3Z0_8Gnv_Q58a_0 2024-09-12T18:53:05.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6184105392464492614', time=2024-09-12T20:47:16.250351+0000, chain.objs.size()=1 2024-09-12T18:53:05.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.h9xO3wJzo2NeiLpmuadX0iJeAYGOpVW_0 2024-09-12T18:53:05.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10009383348519074721', time=2024-09-12T20:47:52.854583+0000, chain.objs.size()=1 2024-09-12T18:53:05.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.751+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.2wBg6fw6gHypoyepLsilM4SxKzbY_sk_0 2024-09-12T18:53:05.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2277400917281072032', time=2024-09-12T20:47:55.050472+0000, chain.objs.size()=1 2024-09-12T18:53:05.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.OfCDWROOBlqF79eW51f92gnhm6EpNJm_0 2024-09-12T18:53:05.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9213237320786441909', time=2024-09-12T20:47:55.051712+0000, chain.objs.size()=1 2024-09-12T18:53:05.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.d840oQCcVm3DF7ftJo4zZDpY2KKobuf_0 2024-09-12T18:53:05.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12963705868038421409', time=2024-09-12T20:48:30.933909+0000, chain.objs.size()=1 2024-09-12T18:53:05.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.u33AgGdLgFSD4Bokvm6ZQtc3vFYlTKq_0 2024-09-12T18:53:05.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.384461330280454733', time=2024-09-12T20:49:04.019852+0000, chain.objs.size()=1 2024-09-12T18:53:05.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.eVf9F2Zez3DtfkJgV3QLope5gf7lZvD_0 2024-09-12T18:53:05.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2707040588994333869', time=2024-09-12T20:49:43.410054+0000, chain.objs.size()=1 2024-09-12T18:53:05.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.D3IYl52jDY1qSwBFupieQ5_W_bN6Z7j_0 2024-09-12T18:53:05.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2340896355238883632', time=2024-09-12T20:49:43.423551+0000, chain.objs.size()=1 2024-09-12T18:53:05.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.Llw1spH_ri1WyQpybZuds8qgKhzlYxW_0 2024-09-12T18:53:05.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13702225378981602870', time=2024-09-12T20:50:19.103383+0000, chain.objs.size()=1 2024-09-12T18:53:05.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.P6DntMTdnWTweD05B4xsDRVZsMY3izy_0 2024-09-12T18:53:05.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7963815441073217241', time=2024-09-12T20:52:28.722221+0000, chain.objs.size()=1 2024-09-12T18:53:05.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.759+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.17__shadow_.371pBOYGuqLxG3sx7tFIDZ9f8wIhPp1_0 2024-09-12T18:53:05.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.763+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.767+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:53:05.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:53:05.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='_CJVbb-wBt_bbMEEbTVpwSx8ocCPWiB4', time=2024-09-12T20:43:46.120157+0000, chain.objs.size()=2 2024-09-12T18:53:05.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.YTH8zyZeBBRZZ-hFmzc5XvysVUFPE6R_0 2024-09-12T18:53:05.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.YTH8zyZeBBRZZ-hFmzc5XvysVUFPE6R_1 2024-09-12T18:53:05.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='_qSR2d7u-D8M3ESrSiKbpmADuACNndcG', time=2024-09-12T20:43:46.158284+0000, chain.objs.size()=2 2024-09-12T18:53:05.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.vZeeAt51myeq0foZu-jvBhvK0F7rLmN_0 2024-09-12T18:53:05.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.vZeeAt51myeq0foZu-jvBhvK0F7rLmN_1 2024-09-12T18:53:05.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7751574808022068934', time=2024-09-12T20:43:46.689930+0000, chain.objs.size()=1 2024-09-12T18:53:05.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.7__shadow_.VmvdontdF2c6bd8hPQiqPPw9QJA9MNm_0 2024-09-12T18:53:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15126682150040436328', time=2024-09-12T20:45:22.944089+0000, chain.objs.size()=1 2024-09-12T18:53:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.6Ot9xouCe5oNKfAO-k15SGOBJV_SayB_0 2024-09-12T18:53:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6303192736562417614', time=2024-09-12T20:45:24.687509+0000, chain.objs.size()=1 2024-09-12T18:53:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.iqHk8NYOAJD6_dvIcJ0f3Xx4We4HwM5_0 2024-09-12T18:53:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11807235592625876100', time=2024-09-12T20:45:24.703643+0000, chain.objs.size()=1 2024-09-12T18:53:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.cu12xJYQEZXevj7lCRBwZJXlNJbuQQ8_0 2024-09-12T18:53:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9834191762655429140', time=2024-09-12T20:45:58.149061+0000, chain.objs.size()=1 2024-09-12T18:53:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.fzdbG-qy8CwoKLXgB4T_TZwkezJKIT9_0 2024-09-12T18:53:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10351470884910973031', time=2024-09-12T20:46:00.471894+0000, chain.objs.size()=1 2024-09-12T18:53:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.O4v-_KEy-EMMB0NlWst-AAk5H4hNLZ4_0 2024-09-12T18:53:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17128218468410419597', time=2024-09-12T20:46:01.152771+0000, chain.objs.size()=1 2024-09-12T18:53:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.9r2wdTs44IdIJ88eFamFSUAQsLJ6uQC_0 2024-09-12T18:53:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3456304139194566502', time=2024-09-12T20:46:03.135882+0000, chain.objs.size()=1 2024-09-12T18:53:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.771+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.z_DUJkmkqPhaVYiOn_YCv8otmjLMzOu_0 2024-09-12T18:53:05.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7512610556924615818', time=2024-09-12T20:46:35.917804+0000, chain.objs.size()=1 2024-09-12T18:53:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.anhik9rHUKl0H0NvgNmzmLg_ViuRtBv_0 2024-09-12T18:53:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4725629632932544319', time=2024-09-12T20:46:38.133291+0000, chain.objs.size()=1 2024-09-12T18:53:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.WDeBvB0tLjq9Tdr0mIoyuHcfOelCQMx_0 2024-09-12T18:53:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17781293735987016847', time=2024-09-12T20:46:39.901838+0000, chain.objs.size()=1 2024-09-12T18:53:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.TZ-Uzj5AV1JKDrThqX5IQSKnF811WkZ_0 2024-09-12T18:53:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10679312852491995655', time=2024-09-12T20:47:49.725392+0000, chain.objs.size()=1 2024-09-12T18:53:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.rB8h1iezqU2UcVjjRdO3R_XBhJNq7Yy_0 2024-09-12T18:53:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.259045461262185717', time=2024-09-12T20:48:28.000737+0000, chain.objs.size()=1 2024-09-12T18:53:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.lNK7EylvCnAHvfqSnjeWnwAKa7ygrfv_0 2024-09-12T18:53:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7358526549002241458', time=2024-09-12T20:49:07.092648+0000, chain.objs.size()=1 2024-09-12T18:53:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.KHs72WJSRtgCXBcMm7gSDS2NUEK497B_0 2024-09-12T18:53:05.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.761732685161281353', time=2024-09-12T20:49:07.099926+0000, chain.objs.size()=1 2024-09-12T18:53:05.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.Gk2uIfyQf1NAzBM-P-nEnnLV-ImFSdx_0 2024-09-12T18:53:05.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13633054481728757237', time=2024-09-12T20:49:40.317535+0000, chain.objs.size()=1 2024-09-12T18:53:05.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.779+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.MKQwicW0GpVa5ELUwS3KT_dt91LegRA_0 2024-09-12T18:53:05.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.859+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.867+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:53:05.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:53:05.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='_LEMFb6wkFSNBpO7-vYn0BIOJ45GwbOj', time=2024-09-12T20:43:46.350471+0000, chain.objs.size()=3 2024-09-12T18:53:05.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.ajsYEmMg6QmMEu3oYQzjFkcJ2KpCWh__0 2024-09-12T18:53:05.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.ajsYEmMg6QmMEu3oYQzjFkcJ2KpCWh__1 2024-09-12T18:53:05.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.ajsYEmMg6QmMEu3oYQzjFkcJ2KpCWh__2 2024-09-12T18:53:05.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4293358573079024937', time=2024-09-12T20:47:52.844822+0000, chain.objs.size()=1 2024-09-12T18:53:05.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.Kbo-UIa-Sqo0VduXM5XQdM8MMZz-dzm_0 2024-09-12T18:53:05.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14825570279514568408', time=2024-09-12T20:49:04.003724+0000, chain.objs.size()=1 2024-09-12T18:53:05.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.WO6HwJTNuUgW4lvJWxMz3euGRwDCbRs_0 2024-09-12T18:53:05.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14351819191838627057', time=2024-09-12T20:49:40.306441+0000, chain.objs.size()=1 2024-09-12T18:53:05.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.EwC2zs9Xik-3wvGXlJgeiEiSHi_WkcX_0 2024-09-12T18:53:05.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9418812995053777862', time=2024-09-12T20:49:40.309752+0000, chain.objs.size()=1 2024-09-12T18:53:05.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.871+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.hNv0W2g1lZzkwc8kNboMISdvInAng-s_0 2024-09-12T18:53:05.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.879+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.887+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:53:05.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T18:53:05.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13874924481329359078', time=2024-09-12T20:43:45.816592+0000, chain.objs.size()=1 2024-09-12T18:53:05.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.I3mL-_69j0w4scucwPjprJZtr9d36x8_0 2024-09-12T18:53:05.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1184455178457476473', time=2024-09-12T20:46:03.137090+0000, chain.objs.size()=1 2024-09-12T18:53:05.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.Yyal706CGAC_YkT2wuiuO3JcqcrgZSX_0 2024-09-12T18:53:05.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2522518521686917954', time=2024-09-12T20:46:39.912801+0000, chain.objs.size()=1 2024-09-12T18:53:05.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.ZhqVBbV6px64pFQS00FqSKx-dT06lJU_0 2024-09-12T18:53:05.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7986296278981768755', time=2024-09-12T20:47:49.718703+0000, chain.objs.size()=1 2024-09-12T18:53:05.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.a4f00oeptcIF4gk3FfyBEHJS9Y-N9mR_0 2024-09-12T18:53:05.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13553292801588722389', time=2024-09-12T20:47:49.720132+0000, chain.objs.size()=1 2024-09-12T18:53:05.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.6ren38BKQhSMHLLOc8_PZe_0DjXFVjo_0 2024-09-12T18:53:05.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17561863282156289849', time=2024-09-12T20:48:30.926101+0000, chain.objs.size()=1 2024-09-12T18:53:05.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.2EUSKv2Y4tZjgyGeyBUYfn_xNfMSqVz_0 2024-09-12T18:53:05.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10970171658199413593', time=2024-09-12T20:49:40.311319+0000, chain.objs.size()=1 2024-09-12T18:53:05.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.A7RG5bIcird24e_6EO238vcirRs3UqZ_0 2024-09-12T18:53:05.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7552492163652294963', time=2024-09-12T20:49:40.321706+0000, chain.objs.size()=1 2024-09-12T18:53:05.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.5rnJL8oSKOhRN9uKk46JtFg9i-r4spS_0 2024-09-12T18:53:05.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11119111073233736426', time=2024-09-12T20:49:43.408263+0000, chain.objs.size()=1 2024-09-12T18:53:05.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.4Rhlgs-Oouks3AjPY8OrMBTJf1wO1bE_0 2024-09-12T18:53:05.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5082340633790049531', time=2024-09-12T20:49:45.183836+0000, chain.objs.size()=1 2024-09-12T18:53:05.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.kBL0l05GervROk2uhgCkPXiWrjeyY-1_0 2024-09-12T18:53:05.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4711082705383082337', time=2024-09-12T20:52:28.721489+0000, chain.objs.size()=1 2024-09-12T18:53:05.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.891+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.17__shadow_.UqxNcTLvde6o6dHDl5jvLmU2zWDQhvc_0 2024-09-12T18:53:05.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.899+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.907+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:53:05.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T18:53:05.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12614683790688310683', time=2024-09-12T20:45:22.929029+0000, chain.objs.size()=1 2024-09-12T18:53:05.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.AMHP4B2BpSUaiYlCtm6k5H2kDLzoFsm_0 2024-09-12T18:53:05.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7293497853703416059', time=2024-09-12T20:45:24.693741+0000, chain.objs.size()=1 2024-09-12T18:53:05.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.q3dfIiOHpcl3GDhcRMe_7ciDdeJ9zoi_0 2024-09-12T18:53:05.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5370529329776558688', time=2024-09-12T20:45:58.128437+0000, chain.objs.size()=1 2024-09-12T18:53:05.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.i-8Barx_szFGCodVmdncw2Sce2lZQQL_0 2024-09-12T18:53:05.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6597667997457919620', time=2024-09-12T20:46:03.135594+0000, chain.objs.size()=1 2024-09-12T18:53:05.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.xyiFAkuJwMWgisTb-U_U1MDtDTNMtRo_0 2024-09-12T18:53:05.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18363017740510701304', time=2024-09-12T20:46:35.901269+0000, chain.objs.size()=1 2024-09-12T18:53:05.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.LMUPg7uQ0oNpuGeab3m-hbrwOtz7I6K_0 2024-09-12T18:53:05.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5327343022649074744', time=2024-09-12T20:46:35.912115+0000, chain.objs.size()=1 2024-09-12T18:53:05.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.Xf8nmnkooBEROfuGrT6ugKH-UJlvCZE_0 2024-09-12T18:53:05.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7298117788608244285', time=2024-09-12T20:46:38.124232+0000, chain.objs.size()=1 2024-09-12T18:53:05.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.7kdBWHqP-sIXzz3embbsp38VzwyNxS7_0 2024-09-12T18:53:05.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7070565891793852271', time=2024-09-12T20:46:39.895757+0000, chain.objs.size()=1 2024-09-12T18:53:05.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.7dw264YQktX17cQI8QaxdJ7VF12jUA4_0 2024-09-12T18:53:05.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14939410135387753645', time=2024-09-12T20:47:13.118019+0000, chain.objs.size()=1 2024-09-12T18:53:05.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.-VodNZYDFQXPIhnp8r2HoW-oojXLdpg_0 2024-09-12T18:53:05.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3209798278825793794', time=2024-09-12T20:47:13.142488+0000, chain.objs.size()=1 2024-09-12T18:53:05.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.f641G5M-5XHu4sbt_jB0lweNgireT5F_0 2024-09-12T18:53:05.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12897230781791906061', time=2024-09-12T20:48:27.993487+0000, chain.objs.size()=1 2024-09-12T18:53:05.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.sjaCrkaBKRVsNGAXv3LwdonNbJy-GwU_0 2024-09-12T18:53:05.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11297010715151312104', time=2024-09-12T20:49:04.015966+0000, chain.objs.size()=1 2024-09-12T18:53:05.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.911+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.NEj8zdO3C0DG8Gmdbo1ip6WjGQ2hymw_0 2024-09-12T18:53:05.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.919+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15885132230434056993', time=2024-09-12T20:49:40.305377+0000, chain.objs.size()=1 2024-09-12T18:53:05.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.919+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.j2EdPhA7QRCazurXxvf9U5ysafWhTtG_0 2024-09-12T18:53:05.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.919+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10302032658499304487', time=2024-09-12T20:49:40.324190+0000, chain.objs.size()=1 2024-09-12T18:53:05.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.919+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.bSdmEA1spdmELX6xMz6jihcRP1rSB0p_0 2024-09-12T18:53:05.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.919+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14681000589812260253', time=2024-09-12T20:49:45.193127+0000, chain.objs.size()=1 2024-09-12T18:53:05.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.919+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.PM5OBZD-0jx_t5hcoEXOGjIkgyMr8KS_0 2024-09-12T18:53:05.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.919+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6174507274481749443', time=2024-09-12T20:52:28.717470+0000, chain.objs.size()=1 2024-09-12T18:53:05.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.919+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.17__shadow_.CmVm-oxOBVxgbP8lHOpjAEGHnVCcr26_0 2024-09-12T18:53:05.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.919+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17492728576728578625', time=2024-09-12T20:52:37.849672+0000, chain.objs.size()=1 2024-09-12T18:53:05.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.919+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.18__shadow:NH72O8NI-5M6IGYIL-SdnyInWlCsqVg_.ViCigqCHvB5JSDKfX7Y4qZSkn3MiRo-_0 2024-09-12T18:53:05.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.923+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.931+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:53:05.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T18:53:05.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.443397631218746184', time=2024-09-12T20:45:22.936867+0000, chain.objs.size()=1 2024-09-12T18:53:05.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.cBLg4wOMzBaTcpMRTXX2mArt4AbAoI0_0 2024-09-12T18:53:05.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10569502016708938934', time=2024-09-12T20:45:24.707185+0000, chain.objs.size()=1 2024-09-12T18:53:05.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.--cCWuGlsfZLyEcA7w19wbWUZKZ6hpm_0 2024-09-12T18:53:05.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12027354281696831862', time=2024-09-12T20:46:03.122542+0000, chain.objs.size()=1 2024-09-12T18:53:05.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.rgbbEOWgHLqcARGisqpiJlDpwRbvJTC_0 2024-09-12T18:53:05.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14209617778521041274', time=2024-09-12T20:46:38.112899+0000, chain.objs.size()=1 2024-09-12T18:53:05.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.Pl5NwIkRQrZTIh55uJChyV-zl_yHW4Y_0 2024-09-12T18:53:05.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15622929449580672220', time=2024-09-12T20:46:38.130466+0000, chain.objs.size()=1 2024-09-12T18:53:05.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.hYvi_owDTfAJ_JxKDpdHjuuM-RfZPyR_0 2024-09-12T18:53:05.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11974208118725281903', time=2024-09-12T20:46:39.894813+0000, chain.objs.size()=1 2024-09-12T18:53:05.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.xy3qyMdQQLNCMbuACJuQkzRhCI63IG5_0 2024-09-12T18:53:05.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15659484341881419669', time=2024-09-12T20:46:39.911308+0000, chain.objs.size()=1 2024-09-12T18:53:05.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.LZfbcpLgqlT8SqkeBRQvEd4nHsfutgL_0 2024-09-12T18:53:05.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6808198036875646294', time=2024-09-12T20:47:52.835792+0000, chain.objs.size()=1 2024-09-12T18:53:05.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.JZW8CKq-TBaXlpMv8xH5fCnb-JBQQPP_0 2024-09-12T18:53:05.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5904203501291530379', time=2024-09-12T20:47:52.846554+0000, chain.objs.size()=1 2024-09-12T18:53:05.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.UwEEXOmSUm6B-YQ4V5NMfqe4koQ-mFW_0 2024-09-12T18:53:05.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1811316803510395054', time=2024-09-12T20:47:55.051297+0000, chain.objs.size()=1 2024-09-12T18:53:05.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.eK-cUE68MVQlpEYfp4WI-TMibwkBVDL_0 2024-09-12T18:53:05.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13882809508135636971', time=2024-09-12T20:48:27.982353+0000, chain.objs.size()=1 2024-09-12T18:53:05.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.fGiHzxU-kGj4-0TAQNUROsxYEMxkrtC_0 2024-09-12T18:53:05.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6291745043011901944', time=2024-09-12T20:48:27.999316+0000, chain.objs.size()=1 2024-09-12T18:53:05.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.935+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.DEgE8BoEJ1Yd1a3jUWAkiE7jWt8YYZu_0 2024-09-12T18:53:05.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.939+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4801107474873681771', time=2024-09-12T20:49:04.011668+0000, chain.objs.size()=1 2024-09-12T18:53:05.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.939+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.I76n-bz5XMPgvpitKXDtoZ6PsndopjR_0 2024-09-12T18:53:05.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.943+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15275712032826359498', time=2024-09-12T20:49:04.019078+0000, chain.objs.size()=1 2024-09-12T18:53:05.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.943+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.ol8rkwziPTuEMN2nq8GktcNdCJn1b-m_0 2024-09-12T18:53:05.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.943+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1153316559327106387', time=2024-09-12T20:49:07.076704+0000, chain.objs.size()=1 2024-09-12T18:53:05.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.943+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.ncAFBP8rdW4QQ2tc83IIxya4Gln_veG_0 2024-09-12T18:53:05.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.943+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.114797707647804504', time=2024-09-12T20:49:07.079046+0000, chain.objs.size()=1 2024-09-12T18:53:05.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.943+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.MAZoGk-AH2iHxbFZa-UAa9tUmik-m9l_0 2024-09-12T18:53:05.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.943+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13664353884218060239', time=2024-09-12T20:49:40.330124+0000, chain.objs.size()=1 2024-09-12T18:53:05.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.943+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.36__shadow_.EBxNqBEYY2dwKDQB-dgvnYR-mGL8Sl0_0 2024-09-12T18:53:05.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.943+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17046564780241161423', time=2024-09-12T20:52:43.329666+0000, chain.objs.size()=1 2024-09-12T18:53:05.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.943+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.18__shadow:Nql780kBG4Bq9lGgEkdoFXicv7wkYX-_.WLewRQ2Qlb4tXczl06m373H-QEfGt3S_0 2024-09-12T18:53:05.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.947+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.951+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:53:05.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.955+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T18:53:05.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10861553196272963716', time=2024-09-12T20:43:45.824047+0000, chain.objs.size()=1 2024-09-12T18:53:05.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.chIyMEQxs16rp4fcm6rD5Ur1dCtGEtn_0 2024-09-12T18:53:05.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5544350876923637088', time=2024-09-12T20:43:46.373310+0000, chain.objs.size()=5 2024-09-12T18:53:05.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.1 2024-09-12T18:53:05.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.1_1 2024-09-12T18:53:05.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.2 2024-09-12T18:53:05.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.2_1 2024-09-12T18:53:05.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__multipart_foo-STANDARD.2~xzVpWfU0nvvYeTMHG0pAie5_M-ttuIA.3 2024-09-12T18:53:05.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2604881477715841574', time=2024-09-12T20:43:46.549948+0000, chain.objs.size()=1 2024-09-12T18:53:05.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.13__shadow_.FQAojOZylJJfJzEtqU1vYlFJ3QhbL_L_0 2024-09-12T18:53:05.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16354581876849887707', time=2024-09-12T20:43:46.721041+0000, chain.objs.size()=1 2024-09-12T18:53:05.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.7__shadow_.Hz0cHw9DgtVDSbEzUh6bEyzazGDVEFz_0 2024-09-12T18:53:05.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3617518606688980921', time=2024-09-12T20:46:35.901799+0000, chain.objs.size()=1 2024-09-12T18:53:05.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.eoswTMsxkcarEB9P4UucHomamn1_Rbn_0 2024-09-12T18:53:05.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15375247592193780858', time=2024-09-12T20:47:16.254390+0000, chain.objs.size()=1 2024-09-12T18:53:05.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.i4nQEhrS2jLUsE_-i-8-WOsOH0W9rdE_0 2024-09-12T18:53:05.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10761865007605829481', time=2024-09-12T20:47:49.724320+0000, chain.objs.size()=1 2024-09-12T18:53:05.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.dYvVC-K-Gy9QodbfFfo3s-07gEKsDrD_0 2024-09-12T18:53:05.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17131756275689413446', time=2024-09-12T20:49:07.089801+0000, chain.objs.size()=1 2024-09-12T18:53:05.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.959+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.Ej48SucP77iGHn68WAHCsS8SngsBslI_0 2024-09-12T18:53:05.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.967+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10877667380390611393', time=2024-09-12T20:49:45.179114+0000, chain.objs.size()=1 2024-09-12T18:53:05.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.967+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.L_WEHC4Md_6QSp3vJoFNcvyKLrorSjM_0 2024-09-12T18:53:05.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.967+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6549622964112719309', time=2024-09-12T20:49:45.193575+0000, chain.objs.size()=1 2024-09-12T18:53:05.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.967+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.--c6nl9-ADvCTEG3zLawiKcTMdRquTx_0 2024-09-12T18:53:05.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.967+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10993702791334567859', time=2024-09-12T20:50:19.106308+0000, chain.objs.size()=1 2024-09-12T18:53:05.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.967+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.oi0nfx19EfHFyClNLDki1QaCKcTSWkb_0 2024-09-12T18:53:05.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.967+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12291889376892353069', time=2024-09-12T20:50:19.109677+0000, chain.objs.size()=1 2024-09-12T18:53:05.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.967+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.1cai6FGH0Cs4bmdJxD12EWGiWDCh7N5_0 2024-09-12T18:53:05.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.971+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:05.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.979+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:53:05.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.983+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:05.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.983+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:05.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.983+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T18:53:05.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.983+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='_4dDMAjImfSZoXcw3d_29pC92he3yWXY', time=2024-09-12T20:43:46.298616+0000, chain.objs.size()=3 2024-09-12T18:53:05.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.983+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.ma88JgYYdCYmcbuzfn8CfG-FagfiCm5_0 2024-09-12T18:53:05.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.983+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.ma88JgYYdCYmcbuzfn8CfG-FagfiCm5_1 2024-09-12T18:53:05.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.983+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.ma88JgYYdCYmcbuzfn8CfG-FagfiCm5_2 2024-09-12T18:53:05.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.983+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='_IQuOAEFCjfsFRJvTbRp3yDEyUOOJFQm', time=2024-09-12T20:43:46.329553+0000, chain.objs.size()=3 2024-09-12T18:53:05.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.983+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.NhMcRFLc3BWHsmXcOOZ52hjd_8p5gNq_0 2024-09-12T18:53:05.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.983+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.NhMcRFLc3BWHsmXcOOZ52hjd_8p5gNq_1 2024-09-12T18:53:05.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.983+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.16__shadow_.NhMcRFLc3BWHsmXcOOZ52hjd_8p5gNq_2 2024-09-12T18:53:05.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.983+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12380210283015916960', time=2024-09-12T20:43:46.561945+0000, chain.objs.size()=3 2024-09-12T18:53:05.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.983+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.13__shadow_.Gwl8CJmcLcKBmFQsMHZM52yHLFQ9P-U_0 2024-09-12T18:53:05.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.983+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.13__shadow_.Gwl8CJmcLcKBmFQsMHZM52yHLFQ9P-U_1 2024-09-12T18:53:05.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.987+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.13__shadow_.Gwl8CJmcLcKBmFQsMHZM52yHLFQ9P-U_2 2024-09-12T18:53:05.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.987+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17086730411083770248', time=2024-09-12T20:45:22.940844+0000, chain.objs.size()=1 2024-09-12T18:53:05.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.987+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.n2EIhozJGaAGoXvmDIbJYRP3ycylYd4_0 2024-09-12T18:53:05.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.987+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3716531445118604392', time=2024-09-12T20:45:24.712308+0000, chain.objs.size()=1 2024-09-12T18:53:05.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.987+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.czdzffIgukqiDClPfYKyg9fTXyCPbRX_0 2024-09-12T18:53:05.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.987+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10909574143253083179', time=2024-09-12T20:45:58.142596+0000, chain.objs.size()=1 2024-09-12T18:53:05.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.987+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.pJHjBBsbqW4-oJIUjrjs1J9qpsKypkc_0 2024-09-12T18:53:05.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17566043870680907458', time=2024-09-12T20:46:03.120523+0000, chain.objs.size()=1 2024-09-12T18:53:05.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.23__shadow_.yeQIiiAaPomFV9ye310xdAWIL3bNQNy_0 2024-09-12T18:53:05.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.834737070440509399', time=2024-09-12T20:46:35.897882+0000, chain.objs.size()=1 2024-09-12T18:53:05.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.SciGIg-3TcUVgsC6hfs_vIQHIgRRGu0_0 2024-09-12T18:53:05.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5518185581077640002', time=2024-09-12T20:46:35.905168+0000, chain.objs.size()=1 2024-09-12T18:53:05.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.O-OoWyoNvmdQQbJvHWIMzl6BHEJtn0E_0 2024-09-12T18:53:05.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1448449801476438487', time=2024-09-12T20:46:35.911604+0000, chain.objs.size()=1 2024-09-12T18:53:05.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.6H0vK6HNiHvscxugnkuOC3bBXcPbvTJ_0 2024-09-12T18:53:05.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4629192104963815591', time=2024-09-12T20:46:38.129549+0000, chain.objs.size()=1 2024-09-12T18:53:05.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.ps5b1XztnTrVfpcnc08BZ_q288rQXwV_0 2024-09-12T18:53:05.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17869174337945201695', time=2024-09-12T20:47:52.837709+0000, chain.objs.size()=1 2024-09-12T18:53:05.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.ZxSISg8KUI8CJL8kgTFxEQUzHAWsFAT_0 2024-09-12T18:53:05.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.30264753951000808', time=2024-09-12T20:47:52.849574+0000, chain.objs.size()=1 2024-09-12T18:53:05.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.B0uyYmPsT-mSsYS-60piWXzOpvT78BS_0 2024-09-12T18:53:06.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9779323658658030284', time=2024-09-12T20:48:27.062751+0000, chain.objs.size()=1 2024-09-12T18:53:06.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.8JYyU_7u4jdCapzSsU1RMkrqY8a4VEo_0 2024-09-12T18:53:06.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7608803411576698832', time=2024-09-12T20:48:27.981396+0000, chain.objs.size()=1 2024-09-12T18:53:06.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.LfBWFELeVV9AEtFkJ6ZA7rNXMtG2jVT_0 2024-09-12T18:53:06.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.275578382198196570', time=2024-09-12T20:48:27.993603+0000, chain.objs.size()=1 2024-09-12T18:53:06.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.995+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.UowJNCi6VGBMU-Dzy7MBSFtgLTIrWky_0 2024-09-12T18:53:06.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.999+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2468155771791153576', time=2024-09-12T20:48:30.927736+0000, chain.objs.size()=1 2024-09-12T18:53:06.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.999+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.mmU54k1zeA2-n83emJ3sPbWHlhXPDYZ_0 2024-09-12T18:53:06.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.999+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5253874008466802912', time=2024-09-12T20:48:30.931360+0000, chain.objs.size()=1 2024-09-12T18:53:06.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.999+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.sie46oNLX0dhW4F92jf8VoX4lhn2P2g_0 2024-09-12T18:53:06.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.999+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.293992732576199271', time=2024-09-12T20:49:45.194954+0000, chain.objs.size()=1 2024-09-12T18:53:06.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.999+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.GG-Ve5q7wMb9IDrONGViAS_h6x7VVDS_0 2024-09-12T18:53:06.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.999+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1835125520406620453', time=2024-09-12T20:49:45.200695+0000, chain.objs.size()=1 2024-09-12T18:53:06.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.999+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.mabe6J33d9fnchEJeRMeJ9XqvGoKiYv_0 2024-09-12T18:53:06.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.999+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5057122617573941593', time=2024-09-12T20:50:19.103315+0000, chain.objs.size()=1 2024-09-12T18:53:06.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.999+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.OJKHyXYyr42AlT1aDb_PwY7CKgSH8c-_0 2024-09-12T18:53:06.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.999+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10258601072460047083', time=2024-09-12T20:52:28.717377+0000, chain.objs.size()=1 2024-09-12T18:53:06.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:05.999+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.17__shadow_.eHU1vDA3ReAHaEAVAztiwgH433zJmhl_0 2024-09-12T18:53:06.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.003+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:06.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.007+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:53:06.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.011+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.011+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T18:53:06.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9734402158279401980', time=2024-09-12T20:43:45.856283+0000, chain.objs.size()=1 2024-09-12T18:53:06.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.3V-VjH9GBUKiJAW_8Y1yRVdhP0UVxkP_0 2024-09-12T18:53:06.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.412243260172553343', time=2024-09-12T20:43:45.929165+0000, chain.objs.size()=4 2024-09-12T18:53:06.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.11__multipart_foo.2~hL1ofrm3bhwQV2qm2fTjISDy8gg_4bX.1 2024-09-12T18:53:06.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.11__multipart_foo.2~hL1ofrm3bhwQV2qm2fTjISDy8gg_4bX.2 2024-09-12T18:53:06.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.11__multipart_foo.2~hL1ofrm3bhwQV2qm2fTjISDy8gg_4bX.3 2024-09-12T18:53:06.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.11__multipart_foo.2~hL1ofrm3bhwQV2qm2fTjISDy8gg_4bX.4 2024-09-12T18:53:06.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11417255789628519346', time=2024-09-12T20:45:22.924485+0000, chain.objs.size()=1 2024-09-12T18:53:06.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.iQk0q73A2G4kaj8B9Vp6R43VUN9QmKH_0 2024-09-12T18:53:06.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8851208050089249248', time=2024-09-12T20:45:24.692830+0000, chain.objs.size()=1 2024-09-12T18:53:06.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.5SrQxF37DPenl9eB4q4cMnoCrHCreuW_0 2024-09-12T18:53:06.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8044107457187673122', time=2024-09-12T20:45:24.694138+0000, chain.objs.size()=1 2024-09-12T18:53:06.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.GuuF9o_iz2HAVUkh3f3RKM7RmDuOxg4_0 2024-09-12T18:53:06.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2305825995641388671', time=2024-09-12T20:45:24.695903+0000, chain.objs.size()=1 2024-09-12T18:53:06.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.vCLX4vjclqCUqts6-dnw0_-7555UrDp_0 2024-09-12T18:53:06.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7346311811239889636', time=2024-09-12T20:45:58.130714+0000, chain.objs.size()=1 2024-09-12T18:53:06.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.OJa4Pf-pT_ylkk79tL4Qwko1jBSFwqc_0 2024-09-12T18:53:06.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11650546988778929436', time=2024-09-12T20:46:01.157953+0000, chain.objs.size()=1 2024-09-12T18:53:06.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.aejzGO6YEEz55kTFQB6az10tCxo_P8b_0 2024-09-12T18:53:06.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14222377721550933895', time=2024-09-12T20:46:01.161655+0000, chain.objs.size()=1 2024-09-12T18:53:06.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.015+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.dE3ersY1aUvtIlsgyZHCjr2yd7cGKf8_0 2024-09-12T18:53:06.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.019+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14117617016553485784', time=2024-09-12T20:46:35.909471+0000, chain.objs.size()=1 2024-09-12T18:53:06.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.019+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.L4x_0Hr0vsjqm_iXUCcblaQUMiO0eWT_0 2024-09-12T18:53:06.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.019+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5701552368303790548', time=2024-09-12T20:46:38.120799+0000, chain.objs.size()=1 2024-09-12T18:53:06.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.019+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.BP_z7ztGyTZNRQVVIL-gMrR1xVgdCrN_0 2024-09-12T18:53:06.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.019+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2984969827053561269', time=2024-09-12T20:47:13.143469+0000, chain.objs.size()=1 2024-09-12T18:53:06.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.019+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.NiZOivOPKg-82NzHBzsCbkLjazASSJo_0 2024-09-12T18:53:06.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.019+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7061778240482121718', time=2024-09-12T20:47:55.041244+0000, chain.objs.size()=1 2024-09-12T18:53:06.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.019+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.40G6MHY-9gmCHpEwvoL6fzfKvb1WKb0_0 2024-09-12T18:53:06.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.019+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8677564285914689712', time=2024-09-12T20:49:43.413901+0000, chain.objs.size()=1 2024-09-12T18:53:06.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.019+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.zQinh1Ou6IcVozBt8ufm_wZXcHYWaOQ_0 2024-09-12T18:53:06.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.019+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7617588651245420666', time=2024-09-12T20:49:45.188328+0000, chain.objs.size()=1 2024-09-12T18:53:06.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.019+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.szEMzc6Korw4daoWlCMw756M83wKrWu_0 2024-09-12T18:53:06.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.023+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:06.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.027+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:53:06.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.031+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.031+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:53:06.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1109016895622183734', time=2024-09-12T20:43:46.475067+0000, chain.objs.size()=3 2024-09-12T18:53:06.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-STANDARD.2~usqWn5HZbNYxA4LMI-ZTH1nIItKxz4Y.1 2024-09-12T18:53:06.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-STANDARD.2~usqWn5HZbNYxA4LMI-ZTH1nIItKxz4Y.2 2024-09-12T18:53:06.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.14__multipart_foo-STANDARD.2~usqWn5HZbNYxA4LMI-ZTH1nIItKxz4Y.3 2024-09-12T18:53:06.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4231052493887184169', time=2024-09-12T20:46:35.896765+0000, chain.objs.size()=1 2024-09-12T18:53:06.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.J7Yej4T7wp-uY2yRbWBIYFkpc5Kri24_0 2024-09-12T18:53:06.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11402804518191735343', time=2024-09-12T20:47:49.721265+0000, chain.objs.size()=1 2024-09-12T18:53:06.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.qER__QJosb662Hj43zWf3cUW-THjjQc_0 2024-09-12T18:53:06.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12038955751312302309', time=2024-09-12T20:47:52.850358+0000, chain.objs.size()=1 2024-09-12T18:53:06.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.BuVP9FqCqP1eilb5yF-3WcJoyVzWIjz_0 2024-09-12T18:53:06.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14310343849862159921', time=2024-09-12T20:47:52.852484+0000, chain.objs.size()=1 2024-09-12T18:53:06.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.MNKm5YYElWb2Jh4lAB1eV3sp5ZHu8El_0 2024-09-12T18:53:06.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18127298658952995374', time=2024-09-12T20:48:29.800748+0000, chain.objs.size()=1 2024-09-12T18:53:06.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.azBYI3qRjuBByMlq60qK0totQ6-Dw_t_0 2024-09-12T18:53:06.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6532971129634124487', time=2024-09-12T20:50:19.105448+0000, chain.objs.size()=1 2024-09-12T18:53:06.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.035+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.OH3JXG9_s_ku1XciZcv52NVFRjSR_0-_0 2024-09-12T18:53:06.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.039+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:06.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.043+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:53:06.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.047+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.047+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T18:53:06.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4945388497565080860', time=2024-09-12T20:43:45.865836+0000, chain.objs.size()=1 2024-09-12T18:53:06.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.4__shadow_.G6k5tBL3NB13bfVggqwu0-9nF0Epb5E_0 2024-09-12T18:53:06.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11686266045985796172', time=2024-09-12T20:45:22.943388+0000, chain.objs.size()=1 2024-09-12T18:53:06.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.6J2QnXvu-Xan9GYNasWOYrREdwW9rLS_0 2024-09-12T18:53:06.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3126083277986581874', time=2024-09-12T20:46:35.902931+0000, chain.objs.size()=1 2024-09-12T18:53:06.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.24__shadow_.A-tkL0eRhk0nWumCxTTOgco3hzmERkQ_0 2024-09-12T18:53:06.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.475332227834589303', time=2024-09-12T20:46:38.138058+0000, chain.objs.size()=1 2024-09-12T18:53:06.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.25__shadow_.sFSfXSsuVIFcAQP0yH1zH-fwiRGlVRu_0 2024-09-12T18:53:06.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6194968757584214731', time=2024-09-12T20:47:13.129645+0000, chain.objs.size()=1 2024-09-12T18:53:06.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.G91rCgGOBebcz_SbNL3OMjzbPiKKNhw_0 2024-09-12T18:53:06.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4699333908646534278', time=2024-09-12T20:47:13.135533+0000, chain.objs.size()=1 2024-09-12T18:53:06.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.27__shadow_.UUzOZ9zHPWf5IMJ48DwI-5xsrtAUyow_0 2024-09-12T18:53:06.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16811231312454814791', time=2024-09-12T20:47:49.730904+0000, chain.objs.size()=1 2024-09-12T18:53:06.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.lwtOYHR3yN6HBTuuBfDzEIZMETUTw7p_0 2024-09-12T18:53:06.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3919470235792040379', time=2024-09-12T20:47:55.063083+0000, chain.objs.size()=1 2024-09-12T18:53:06.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.31__shadow_.hqv4IfZg4scpiMZ8sEMBsU2e_rZKsx6_0 2024-09-12T18:53:06.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8981649525437953614', time=2024-09-12T20:48:30.934749+0000, chain.objs.size()=1 2024-09-12T18:53:06.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.xbf7V5X-DKB8kc7FVuj_-3UyQJ8Rv2U_0 2024-09-12T18:53:06.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13243716568764336248', time=2024-09-12T20:49:04.026631+0000, chain.objs.size()=1 2024-09-12T18:53:06.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.9Pdb-JgyytFx71WzY_QKPbJ5W6h8z74_0 2024-09-12T18:53:06.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7457237891253249641', time=2024-09-12T20:49:07.081955+0000, chain.objs.size()=1 2024-09-12T18:53:06.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.ctHSTBipj3vwk2zNRy-V-2Y0gKwpYWC_0 2024-09-12T18:53:06.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15068656853154348337', time=2024-09-12T20:49:07.083921+0000, chain.objs.size()=1 2024-09-12T18:53:06.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.051+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.ubFycu8yEWZTUiZ6QeyPZ4KPdnr2Q2o_0 2024-09-12T18:53:06.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.055+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8315713225542622868', time=2024-09-12T20:49:43.416758+0000, chain.objs.size()=1 2024-09-12T18:53:06.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.055+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.lS3eSLe60_zoCX47jpMGfjQMVZ2U7At_0 2024-09-12T18:53:06.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.055+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:06.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.063+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:53:06.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T18:53:06.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15184175931974354589', time=2024-09-12T20:43:46.074103+0000, chain.objs.size()=4 2024-09-12T18:53:06.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.9__multipart_foo.2~3FiBQEkZhKVXIbyUqi2_BmYiHz_FSSB.1 2024-09-12T18:53:06.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.9__multipart_foo.2~3FiBQEkZhKVXIbyUqi2_BmYiHz_FSSB.2 2024-09-12T18:53:06.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.9__multipart_foo.2~3FiBQEkZhKVXIbyUqi2_BmYiHz_FSSB.3 2024-09-12T18:53:06.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.9__multipart_foo.2~3FiBQEkZhKVXIbyUqi2_BmYiHz_FSSB.4 2024-09-12T18:53:06.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='_VGXttEkkC-yUPigoHW2KQkQursDReyb', time=2024-09-12T20:43:46.146733+0000, chain.objs.size()=2 2024-09-12T18:53:06.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.hGjant0gTw1yHueKUg9qX4h-paOqNUo_0 2024-09-12T18:53:06.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.15__shadow_.hGjant0gTw1yHueKUg9qX4h-paOqNUo_1 2024-09-12T18:53:06.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2381204210741510547', time=2024-09-12T20:45:22.930212+0000, chain.objs.size()=1 2024-09-12T18:53:06.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.19__shadow_.nOEBWzVAB_lFEV2Dd4amCdHheU62FNS_0 2024-09-12T18:53:06.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1392749867473520569', time=2024-09-12T20:45:58.127255+0000, chain.objs.size()=1 2024-09-12T18:53:06.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.MnpKUY8JZJyzLy89iVgGhf9gcqahFjH_0 2024-09-12T18:53:06.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13258627059550522930', time=2024-09-12T20:45:58.130477+0000, chain.objs.size()=1 2024-09-12T18:53:06.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.WOBW9CA8y9LdzYfAAK5bFQDN4cuN9Bd_0 2024-09-12T18:53:06.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14844771957246202652', time=2024-09-12T20:45:58.143166+0000, chain.objs.size()=1 2024-09-12T18:53:06.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.21__shadow_.ASOPALdDu2BTLOK0hH1QevL5AQPbAqT_0 2024-09-12T18:53:06.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8097401724675481485', time=2024-09-12T20:47:49.727575+0000, chain.objs.size()=1 2024-09-12T18:53:06.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.29__shadow_.lFetfRhPjF5uMfvgBqm91npdJkVUGQv_0 2024-09-12T18:53:06.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12371984020535141014', time=2024-09-12T20:47:52.841826+0000, chain.objs.size()=1 2024-09-12T18:53:06.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.067+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.30__shadow_.3aBVmBCx-Nn-kM2jvukI26ohw16vuOw_0 2024-09-12T18:53:06.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18293824713265687506', time=2024-09-12T20:48:27.996098+0000, chain.objs.size()=1 2024-09-12T18:53:06.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.32__shadow_.6Zg5MkdFRi2zDsRXI7r5-0ro7HhUXle_0 2024-09-12T18:53:06.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4412394207513542150', time=2024-09-12T20:48:30.931687+0000, chain.objs.size()=1 2024-09-12T18:53:06.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.rixe0bpnjzEwiHitRyJUTJdsqHr20EI_0 2024-09-12T18:53:06.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11267837664530665600', time=2024-09-12T20:48:30.937866+0000, chain.objs.size()=1 2024-09-12T18:53:06.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.33__shadow_.ioqmfYIkghLjRHcUOLeibucb-x9_bEn_0 2024-09-12T18:53:06.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4123199104767171396', time=2024-09-12T20:48:32.670327+0000, chain.objs.size()=1 2024-09-12T18:53:06.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.34__shadow_.gBuVm9M0JpIhxqW-Nbem6KDXRTlbjhQ_0 2024-09-12T18:53:06.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6752359967053572798', time=2024-09-12T20:49:43.412555+0000, chain.objs.size()=1 2024-09-12T18:53:06.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.BmoN1x1C2K5nL1mrC6MkKCrGpJvDud__0 2024-09-12T18:53:06.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16874403126389326585', time=2024-09-12T20:49:43.421380+0000, chain.objs.size()=1 2024-09-12T18:53:06.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.37__shadow_.nmuJY6YuGM7cGcgCK7rh4F3TinwMNct_0 2024-09-12T18:53:06.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15709472431489111569', time=2024-09-12T20:49:45.181702+0000, chain.objs.size()=1 2024-09-12T18:53:06.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.j65HfIHOLFXZLVHotRCaKTm0SDFt8-4_0 2024-09-12T18:53:06.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13603388397216591922', time=2024-09-12T20:49:45.186977+0000, chain.objs.size()=1 2024-09-12T18:53:06.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.075+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.38__shadow_.FsvGh3HlVO1bdQrxWPvxkBN51VUIACN_0 2024-09-12T18:53:06.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.079+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:06.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.087+0000 7fc1089909c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:53:06.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T18:53:06.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6955954007360262663', time=2024-09-12T20:43:46.774874+0000, chain.objs.size()=1 2024-09-12T18:53:06.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.8__shadow_.nc6DTQw241e0Vy1xNT9JgfWKU8lmPG7_0 2024-09-12T18:53:06.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15274418099378329378', time=2024-09-12T20:43:46.786189+0000, chain.objs.size()=1 2024-09-12T18:53:06.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.8__shadow_.pzVRk5FnsO4V9dVoXssjZm6K9qNuBVF_0 2024-09-12T18:53:06.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6685745608960162235', time=2024-09-12T20:45:24.707982+0000, chain.objs.size()=1 2024-09-12T18:53:06.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.20__shadow_.aFWtqhBmAcJhnPtqvjRjrbPuJ51aPK5_0 2024-09-12T18:53:06.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.807327008169370434', time=2024-09-12T20:46:01.171862+0000, chain.objs.size()=1 2024-09-12T18:53:06.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.22__shadow_.n90ZhHZl3OoeXrYJnhPwVyjCnSfJ2E4_0 2024-09-12T18:53:06.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3411270668142318778', time=2024-09-12T20:46:39.894828+0000, chain.objs.size()=1 2024-09-12T18:53:06.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.26__shadow_.OKEi_K-xKytfpbEL34OuGgUsKOgPiSr_0 2024-09-12T18:53:06.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3504614693790793445', time=2024-09-12T20:47:16.247824+0000, chain.objs.size()=1 2024-09-12T18:53:06.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.28__shadow_.bQebmXABuI2g7-jyO0feSviT5TBdVS9_0 2024-09-12T18:53:06.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11267360558650006690', time=2024-09-12T20:49:07.079148+0000, chain.objs.size()=1 2024-09-12T18:53:06.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.35__shadow_.1SmYIO_Drd1Dv-tBIwqEITNpI2QwZ09_0 2024-09-12T18:53:06.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3673597020466770077', time=2024-09-12T20:50:19.109740+0000, chain.objs.size()=1 2024-09-12T18:53:06.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.091+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.39__shadow_.VKapaHzh9iP8rr0DIbHPWXzY52jngpA_0 2024-09-12T18:53:06.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.095+0000 7fc1089909c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:53:06.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.103+0000 7fbfbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:53:06.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.111+0000 7fc1089909c0 20 remove_watcher() i=0 2024-09-12T18:53:06.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.111+0000 7fc1089909c0 2 removed watcher, disabling cache 2024-09-12T18:53:06.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.115+0000 7fc1089909c0 20 remove_watcher() i=1 2024-09-12T18:53:06.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.119+0000 7fc1089909c0 20 remove_watcher() i=2 2024-09-12T18:53:06.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.119+0000 7fc1089909c0 20 remove_watcher() i=3 2024-09-12T18:53:06.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.127+0000 7fc1089909c0 20 remove_watcher() i=4 2024-09-12T18:53:06.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.127+0000 7fc1089909c0 20 remove_watcher() i=5 2024-09-12T18:53:06.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.131+0000 7fc1089909c0 20 remove_watcher() i=6 2024-09-12T18:53:06.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.131+0000 7fc1089909c0 20 remove_watcher() i=7 2024-09-12T18:53:06.155 DEBUG:teuthology.orchestra.run.smithi111:> radosgw-admin gc process --include-all 2024-09-12T18:53:06.232 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:53:06.232 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:53:06.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.275+0000 7f4574ca99c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:06.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.279+0000 7f4574ca99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:06.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.279+0000 7f4574ca99c0 20 realm 2024-09-12T18:53:06.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.279+0000 7f4574ca99c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:06.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.279+0000 7f4574ca99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:06.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.279+0000 7f4574ca99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:53:06.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.279+0000 7f4574ca99c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:06.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.279+0000 7f4574ca99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:06.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.279+0000 7f4574ca99c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:06.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.279+0000 7f4574ca99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:53:06.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.279+0000 7f4574ca99c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:06.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.279+0000 7f4574ca99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:53:06.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.279+0000 7f4574ca99c0 20 searching for the correct realm 2024-09-12T18:53:06.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.283+0000 7f4572fb0640 0 -- 172.21.15.111:0/626201730 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f456803d060 msgr2=0x7f45680660a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:53:06.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.499+0000 7f4571fae640 0 -- 172.21.15.111:0/626201730 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f456c089240 msgr2=0x7f456c099130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:53:06.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.715+0000 7f4574ca99c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:53:06.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.715+0000 7f4574ca99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:53:06.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.715+0000 7f4574ca99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:53:06.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.715+0000 7f4574ca99c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:53:06.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.715+0000 7f4574ca99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:53:06.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.715+0000 7f4574ca99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:53:06.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.715+0000 7f4574ca99c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:06.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.715+0000 7f4574ca99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:06.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.715+0000 7f4574ca99c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:06.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.719+0000 7f4574ca99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:53:06.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.719+0000 7f4574ca99c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:06.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.719+0000 7f4574ca99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:53:06.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.719+0000 7f4574ca99c0 20 zone default found 2024-09-12T18:53:06.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.719+0000 7f4574ca99c0 4 Realm: () 2024-09-12T18:53:06.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.719+0000 7f4574ca99c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:53:06.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.719+0000 7f4574ca99c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:53:06.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.719+0000 7f4574ca99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:53:06.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.719+0000 7f4574ca99c0 20 zonegroup default 2024-09-12T18:53:06.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.719+0000 7f4574ca99c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:06.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.719+0000 7f4574ca99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:06.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.719+0000 7f4574ca99c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:06.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.719+0000 7f4574ca99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:06.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.719+0000 7f4574ca99c0 20 rados->read ofs=0 len=0 2024-09-12T18:53:06.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.723+0000 7f4574ca99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:53:06.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.723+0000 7f4574ca99c0 20 started sync module instance, tier type = 2024-09-12T18:53:06.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.723+0000 7f4574ca99c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:53:06.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.747+0000 7f4574ca99c0 20 add_watcher() i=0 2024-09-12T18:53:06.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.747+0000 7f4574ca99c0 20 add_watcher() i=1 2024-09-12T18:53:06.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.747+0000 7f4574ca99c0 20 add_watcher() i=2 2024-09-12T18:53:06.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.747+0000 7f4574ca99c0 20 add_watcher() i=3 2024-09-12T18:53:06.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.747+0000 7f4574ca99c0 20 add_watcher() i=4 2024-09-12T18:53:06.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.747+0000 7f4574ca99c0 20 add_watcher() i=5 2024-09-12T18:53:06.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.747+0000 7f4574ca99c0 20 add_watcher() i=6 2024-09-12T18:53:06.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.747+0000 7f4574ca99c0 20 add_watcher() i=7 2024-09-12T18:53:06.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.747+0000 7f4574ca99c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:53:06.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.751+0000 7f4428fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:53:06.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.751+0000 7f4574ca99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:53:06.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.751+0000 7f4574ca99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:53:06.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.839+0000 7f43a37fe640 20 reqs_thread_entry: start 2024-09-12T18:53:06.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.839+0000 7f4574ca99c0 20 init_complete bucket index max shards: 11 2024-09-12T18:53:06.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.839+0000 7f4574ca99c0 20 Filter name: none 2024-09-12T18:53:06.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.839+0000 7f43a17fa640 20 reqs_thread_entry: start 2024-09-12T18:53:06.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.839+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:53:06.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.843+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.843+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.843+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.847+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:53:06.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.851+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.851+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.851+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.851+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:53:06.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.855+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.855+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.855+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.859+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:53:06.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.863+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.863+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.863+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.867+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:53:06.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.871+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.871+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.871+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.875+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:53:06.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.875+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.879+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.879+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.879+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:53:06.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.883+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.883+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.887+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.887+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:53:06.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.891+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.891+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.891+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.895+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:53:06.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.899+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.899+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.899+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.903+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:53:06.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.907+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.907+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.907+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.911+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:53:06.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.915+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.915+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.915+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.919+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:53:06.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.919+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.923+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.923+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.927+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:53:06.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.931+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.931+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.935+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.935+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:53:06.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.939+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.939+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.939+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.943+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:53:06.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.943+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.947+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.947+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.947+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:53:06.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.951+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.955+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.955+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.959+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:53:06.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.959+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.963+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.963+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.963+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:53:06.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.967+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.971+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.971+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.971+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:53:06.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.975+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.975+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.975+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.975+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:53:06.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.979+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.979+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.979+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.983+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:53:06.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.983+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.987+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.987+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.991+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:53:06.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.991+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.991+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:06.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.991+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:06.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.995+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:53:07.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.995+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.999+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:07.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.999+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:06.999+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:53:07.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.003+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.007+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:07.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.007+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.007+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:53:07.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.011+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.011+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:07.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.015+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.019+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:53:07.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.023+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.023+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:07.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.023+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.027+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:53:07.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.031+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.031+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:07.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.031+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.035+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:53:07.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.043+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.043+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:07.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.043+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.047+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:53:07.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.051+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.055+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:07.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.055+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.059+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:53:07.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.063+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.063+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:07.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.063+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.067+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:53:07.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.071+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.071+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:07.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.075+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.075+0000 7f4574ca99c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:53:07.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.079+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.079+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:53:07.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.079+0000 7f4574ca99c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:53:07.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.083+0000 7f4428fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:53:07.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.087+0000 7f4574ca99c0 20 remove_watcher() i=0 2024-09-12T18:53:07.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.087+0000 7f4574ca99c0 2 removed watcher, disabling cache 2024-09-12T18:53:07.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.091+0000 7f4574ca99c0 20 remove_watcher() i=1 2024-09-12T18:53:07.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.095+0000 7f4574ca99c0 20 remove_watcher() i=2 2024-09-12T18:53:07.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.095+0000 7f4574ca99c0 20 remove_watcher() i=3 2024-09-12T18:53:07.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.099+0000 7f4574ca99c0 20 remove_watcher() i=4 2024-09-12T18:53:07.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.099+0000 7f4574ca99c0 20 remove_watcher() i=5 2024-09-12T18:53:07.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.099+0000 7f4574ca99c0 20 remove_watcher() i=6 2024-09-12T18:53:07.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:53:07.103+0000 7f4574ca99c0 20 remove_watcher() i=7 2024-09-12T18:53:07.124 DEBUG:teuthology.orchestra.run.smithi111:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T18:53:07.701 INFO:teuthology.orchestra.run.smithi111.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T18:53:12.299 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :clean UP-TO-DATE 2024-09-12T18:53:31.098 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :compileJava 2024-09-12T18:53:31.099 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :processResources 2024-09-12T18:53:31.099 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :classes 2024-09-12T18:53:31.999 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:31.999 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :compileTestJava 2024-09-12T18:53:32.000 INFO:teuthology.orchestra.run.smithi111.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:53:32.000 INFO:teuthology.orchestra.run.smithi111.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:53:32.001 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:32.002 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:53:32.002 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :testClasses 2024-09-12T18:53:38.099 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:38.099 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :test 2024-09-12T18:53:38.099 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:38.099 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T18:53:39.098 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:39.099 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T18:53:39.298 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:39.299 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T18:53:39.399 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:39.399 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T18:53:39.698 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:39.699 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T18:53:40.498 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:40.499 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T18:53:40.899 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:40.899 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T18:53:40.899 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:40.899 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T18:53:41.099 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:41.099 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T18:53:41.099 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:41.099 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T18:53:41.398 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:41.399 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T18:53:41.898 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:41.899 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T18:53:42.398 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:42.398 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T18:53:42.698 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:42.699 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T18:53:42.699 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12 18:53:42,648 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:53:47.599 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:47.599 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T18:53:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:48.099 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T18:53:48.099 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:48.099 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T18:53:48.399 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:48.399 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T18:53:48.399 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:48.399 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T18:53:48.898 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:48.898 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T18:53:49.298 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:49.299 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T18:53:49.598 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:49.598 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T18:53:49.698 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:49.699 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T18:53:49.798 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:49.799 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T18:53:52.198 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:52.199 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T18:53:52.501 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:52.501 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T18:53:53.098 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:53.098 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T18:53:53.499 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:53.499 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T18:53:53.899 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:53.899 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T18:53:54.098 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:53:54.098 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T18:54:01.998 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:01.999 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T18:54:02.298 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:02.299 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T18:54:03.698 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:03.699 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T18:54:03.998 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:03.999 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T18:54:04.798 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:04.799 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T18:54:05.098 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:05.099 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T18:54:05.498 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:05.499 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T18:54:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:05.799 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T18:54:05.799 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:05.799 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T18:54:06.098 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:06.098 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T18:54:06.198 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:06.199 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T18:54:06.398 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:06.398 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T18:54:06.498 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:06.498 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T18:54:06.698 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:06.698 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T18:54:06.798 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:06.799 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T18:54:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:07.099 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T18:54:07.099 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:07.099 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T18:54:07.398 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:07.399 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T18:54:07.498 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:07.499 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T18:54:07.698 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:07.699 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T18:54:07.798 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:07.799 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T18:54:08.098 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:08.099 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T18:54:08.799 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:08.799 INFO:teuthology.orchestra.run.smithi111.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T18:54:09.189 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:09.189 INFO:teuthology.orchestra.run.smithi111.stdout:---------------------------------------------------------------------- 2024-09-12T18:54:09.190 INFO:teuthology.orchestra.run.smithi111.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T18:54:09.190 INFO:teuthology.orchestra.run.smithi111.stdout:---------------------------------------------------------------------- 2024-09-12T18:54:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:09.190 INFO:teuthology.orchestra.run.smithi111.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:54:09.190 INFO:teuthology.orchestra.run.smithi111.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:54:09.190 INFO:teuthology.orchestra.run.smithi111.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:54:09.190 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:09.190 INFO:teuthology.orchestra.run.smithi111.stdout:BUILD SUCCESSFUL in 1m 1s 2024-09-12T18:54:09.190 INFO:teuthology.orchestra.run.smithi111.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T18:54:09.513 DEBUG:teuthology.orchestra.run.smithi111:> radosgw-admin gc process --include-all 2024-09-12T18:54:09.545 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:54:09.546 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:54:09.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.586+0000 7fcd8e4bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:09.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.590+0000 7fcd8e4bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:09.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.590+0000 7fcd8e4bd9c0 20 realm 2024-09-12T18:54:09.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.590+0000 7fcd8e4bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:09.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.590+0000 7fcd8e4bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:09.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.590+0000 7fcd8e4bd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:54:09.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.590+0000 7fcd8e4bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:09.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.590+0000 7fcd8e4bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:09.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.590+0000 7fcd8e4bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:09.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.594+0000 7fcd8e4bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:09.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.594+0000 7fcd8e4bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:09.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.594+0000 7fcd8e4bd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:54:09.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.594+0000 7fcd8e4bd9c0 20 searching for the correct realm 2024-09-12T18:54:09.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.598+0000 7fcd8c7c4640 0 -- 172.21.15.111:0/3573301398 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7fcd80137040 msgr2=0x7fcd8012aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:54:09.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:09.814+0000 7fcd8b7c2640 0 -- 172.21.15.111:0/3573301398 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fcd8405b150 msgr2=0x7fcd8404a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:54:10.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.030+0000 7fcd8e4bd9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:54:10.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.030+0000 7fcd8e4bd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:54:10.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.030+0000 7fcd8e4bd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:54:10.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.030+0000 7fcd8e4bd9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:54:10.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.030+0000 7fcd8e4bd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:54:10.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.030+0000 7fcd8e4bd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:54:10.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.030+0000 7fcd8e4bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:10.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.030+0000 7fcd8e4bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:10.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.030+0000 7fcd8e4bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:10.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.030+0000 7fcd8e4bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:10.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.030+0000 7fcd8e4bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:10.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:54:10.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 20 zone default found 2024-09-12T18:54:10.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 4 Realm: () 2024-09-12T18:54:10.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:54:10.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:54:10.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:54:10.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 20 zonegroup default 2024-09-12T18:54:10.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:10.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:10.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:10.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:10.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:10.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:10.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 20 started sync module instance, tier type = 2024-09-12T18:54:10.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.034+0000 7fcd8e4bd9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:54:10.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.058+0000 7fcd8e4bd9c0 20 add_watcher() i=0 2024-09-12T18:54:10.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.058+0000 7fcd8e4bd9c0 20 add_watcher() i=1 2024-09-12T18:54:10.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.058+0000 7fcd8e4bd9c0 20 add_watcher() i=2 2024-09-12T18:54:10.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.058+0000 7fcd8e4bd9c0 20 add_watcher() i=3 2024-09-12T18:54:10.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.058+0000 7fcd8e4bd9c0 20 add_watcher() i=4 2024-09-12T18:54:10.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.058+0000 7fcd8e4bd9c0 20 add_watcher() i=5 2024-09-12T18:54:10.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.058+0000 7fcd8e4bd9c0 20 add_watcher() i=6 2024-09-12T18:54:10.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.058+0000 7fcd8e4bd9c0 20 add_watcher() i=7 2024-09-12T18:54:10.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.058+0000 7fcd8e4bd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:54:10.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.062+0000 7fcc41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:10.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.066+0000 7fcd8e4bd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:54:10.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.066+0000 7fcd8e4bd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:54:10.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.150+0000 7fcc40fe1640 20 reqs_thread_entry: start 2024-09-12T18:54:10.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.150+0000 7fcd8e4bd9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:54:10.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.150+0000 7fcd8e4bd9c0 20 Filter name: none 2024-09-12T18:54:10.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.150+0000 7fcbba7fc640 20 reqs_thread_entry: start 2024-09-12T18:54:10.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.150+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:54:10.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.154+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.154+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.158+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:54:10.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.158+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14434018553430524784', time=2024-09-12T20:53:47.454762+0000, chain.objs.size()=7 2024-09-12T18:54:10.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.158+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~cnLrx2cbeCjbeeOBSMPgUt3ZWxGRv95.1 2024-09-12T18:54:10.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.158+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~cnLrx2cbeCjbeeOBSMPgUt3ZWxGRv95.1_1 2024-09-12T18:54:10.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.158+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~cnLrx2cbeCjbeeOBSMPgUt3ZWxGRv95.1_2 2024-09-12T18:54:10.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.158+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~cnLrx2cbeCjbeeOBSMPgUt3ZWxGRv95.2 2024-09-12T18:54:10.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.158+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~cnLrx2cbeCjbeeOBSMPgUt3ZWxGRv95.2_1 2024-09-12T18:54:10.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.158+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~cnLrx2cbeCjbeeOBSMPgUt3ZWxGRv95.2_2 2024-09-12T18:54:10.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.158+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~cnLrx2cbeCjbeeOBSMPgUt3ZWxGRv95.3 2024-09-12T18:54:10.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.158+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7745248065527100908', time=2024-09-12T20:53:47.820233+0000, chain.objs.size()=7 2024-09-12T18:54:10.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.158+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~kPnJOZyqhQoV7CquOt0U9_ET21S_w0Q.1 2024-09-12T18:54:10.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.158+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~kPnJOZyqhQoV7CquOt0U9_ET21S_w0Q.1_1 2024-09-12T18:54:10.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.158+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~kPnJOZyqhQoV7CquOt0U9_ET21S_w0Q.1_2 2024-09-12T18:54:10.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.158+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~kPnJOZyqhQoV7CquOt0U9_ET21S_w0Q.2 2024-09-12T18:54:10.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.162+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~kPnJOZyqhQoV7CquOt0U9_ET21S_w0Q.2_1 2024-09-12T18:54:10.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.162+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~kPnJOZyqhQoV7CquOt0U9_ET21S_w0Q.2_2 2024-09-12T18:54:10.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.166+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~kPnJOZyqhQoV7CquOt0U9_ET21S_w0Q.3 2024-09-12T18:54:10.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.170+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.174+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:54:10.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.178+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.178+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.182+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:54:10.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.182+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8112285255740964399', time=2024-09-12T20:53:52.296044+0000, chain.objs.size()=9 2024-09-12T18:54:10.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.182+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.52__multipart_key1.2~LVQR3OAz79_5TCZfRu5YdYAx-3amRI6.1 2024-09-12T18:54:10.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.182+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.52__shadow_key1.2~LVQR3OAz79_5TCZfRu5YdYAx-3amRI6.1_1 2024-09-12T18:54:10.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.182+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.52__multipart_key1.2~LVQR3OAz79_5TCZfRu5YdYAx-3amRI6.2 2024-09-12T18:54:10.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.182+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.52__shadow_key1.2~LVQR3OAz79_5TCZfRu5YdYAx-3amRI6.2_1 2024-09-12T18:54:10.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.182+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.52__multipart_key1.2~LVQR3OAz79_5TCZfRu5YdYAx-3amRI6.3 2024-09-12T18:54:10.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.182+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.52__shadow_key1.2~LVQR3OAz79_5TCZfRu5YdYAx-3amRI6.3_1 2024-09-12T18:54:10.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.182+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.52__multipart_key1.2~LVQR3OAz79_5TCZfRu5YdYAx-3amRI6.4 2024-09-12T18:54:10.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.182+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.52__shadow_key1.2~LVQR3OAz79_5TCZfRu5YdYAx-3amRI6.4_1 2024-09-12T18:54:10.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.182+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.52__multipart_key1.2~LVQR3OAz79_5TCZfRu5YdYAx-3amRI6.5 2024-09-12T18:54:10.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.190+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.198+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:54:10.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.198+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:54:10.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb', time=2024-09-12T20:54:05.662272+0000, chain.objs.size()=87 2024-09-12T18:54:10.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.1 2024-09-12T18:54:10.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.2 2024-09-12T18:54:10.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.3 2024-09-12T18:54:10.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.4 2024-09-12T18:54:10.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.5 2024-09-12T18:54:10.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.6 2024-09-12T18:54:10.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.7 2024-09-12T18:54:10.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.8 2024-09-12T18:54:10.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.9 2024-09-12T18:54:10.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.10 2024-09-12T18:54:10.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.11 2024-09-12T18:54:10.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.202+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.12 2024-09-12T18:54:10.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.206+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.13 2024-09-12T18:54:10.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.206+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.14 2024-09-12T18:54:10.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.206+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.15 2024-09-12T18:54:10.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.206+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.16 2024-09-12T18:54:10.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.206+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.17 2024-09-12T18:54:10.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.206+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.18 2024-09-12T18:54:10.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.206+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.19 2024-09-12T18:54:10.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.206+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.20 2024-09-12T18:54:10.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.206+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.21 2024-09-12T18:54:10.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.206+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.22 2024-09-12T18:54:10.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.206+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.23 2024-09-12T18:54:10.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.206+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.24 2024-09-12T18:54:10.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.214+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.25 2024-09-12T18:54:10.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.214+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.26 2024-09-12T18:54:10.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.214+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.27 2024-09-12T18:54:10.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.214+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.28 2024-09-12T18:54:10.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.214+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.29 2024-09-12T18:54:10.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.214+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.30 2024-09-12T18:54:10.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.214+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.31 2024-09-12T18:54:10.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.214+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.32 2024-09-12T18:54:10.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.214+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.33 2024-09-12T18:54:10.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.214+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.34 2024-09-12T18:54:10.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.214+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.35 2024-09-12T18:54:10.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.222+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.36 2024-09-12T18:54:10.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.222+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.37 2024-09-12T18:54:10.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.222+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.38 2024-09-12T18:54:10.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.222+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.39 2024-09-12T18:54:10.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.222+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.40 2024-09-12T18:54:10.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.222+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.41 2024-09-12T18:54:10.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.222+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.42 2024-09-12T18:54:10.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.222+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.43 2024-09-12T18:54:10.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.222+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.44 2024-09-12T18:54:10.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.222+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.45 2024-09-12T18:54:10.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.222+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.46 2024-09-12T18:54:10.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.226+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.47 2024-09-12T18:54:10.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.226+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.48 2024-09-12T18:54:10.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.226+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.49 2024-09-12T18:54:10.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.226+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.50 2024-09-12T18:54:10.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.226+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.51 2024-09-12T18:54:10.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.226+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.52 2024-09-12T18:54:10.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.226+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.53 2024-09-12T18:54:10.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.226+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.54 2024-09-12T18:54:10.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.226+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.55 2024-09-12T18:54:10.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.226+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.56 2024-09-12T18:54:10.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.226+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.57 2024-09-12T18:54:10.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.226+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.58 2024-09-12T18:54:10.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.226+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.59 2024-09-12T18:54:10.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.230+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.60 2024-09-12T18:54:10.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.230+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.61 2024-09-12T18:54:10.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.230+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.62 2024-09-12T18:54:10.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.234+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.63 2024-09-12T18:54:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.234+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.64 2024-09-12T18:54:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.234+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.65 2024-09-12T18:54:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.234+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.66 2024-09-12T18:54:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.234+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.67 2024-09-12T18:54:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.234+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.68 2024-09-12T18:54:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.234+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.69 2024-09-12T18:54:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.234+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.70 2024-09-12T18:54:10.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.234+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.71 2024-09-12T18:54:10.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.234+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.72 2024-09-12T18:54:10.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.234+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.73 2024-09-12T18:54:10.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.234+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.74 2024-09-12T18:54:10.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.238+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.75 2024-09-12T18:54:10.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.238+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.76 2024-09-12T18:54:10.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.238+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.77 2024-09-12T18:54:10.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.238+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.78 2024-09-12T18:54:10.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.238+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.79 2024-09-12T18:54:10.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.238+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.80 2024-09-12T18:54:10.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.238+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.81 2024-09-12T18:54:10.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.238+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.82 2024-09-12T18:54:10.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.238+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.83 2024-09-12T18:54:10.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.238+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.84 2024-09-12T18:54:10.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.238+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.85 2024-09-12T18:54:10.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.242+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.86 2024-09-12T18:54:10.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.242+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.58__multipart_key1.2~ilu1VDjZjoB7JQ6AwAJhnP4DdKfBzlb.88 2024-09-12T18:54:10.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.246+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.250+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:54:10.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.250+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:54:10.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12410294350573786448', time=2024-09-12T20:54:02.084626+0000, chain.objs.size()=16 2024-09-12T18:54:10.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.1 2024-09-12T18:54:10.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.1_1 2024-09-12T18:54:10.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.1_2 2024-09-12T18:54:10.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.2 2024-09-12T18:54:10.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.2_1 2024-09-12T18:54:10.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.2_2 2024-09-12T18:54:10.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.3 2024-09-12T18:54:10.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.3_1 2024-09-12T18:54:10.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.3_2 2024-09-12T18:54:10.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.4 2024-09-12T18:54:10.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.4_1 2024-09-12T18:54:10.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.254+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.4_2 2024-09-12T18:54:10.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.258+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.5 2024-09-12T18:54:10.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.258+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.5_1 2024-09-12T18:54:10.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.258+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.5_2 2024-09-12T18:54:10.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.258+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~RUaYW7yHVNhUzZaL7u3G9oPbMZr3a4P.6 2024-09-12T18:54:10.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.262+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.266+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:54:10.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.270+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.270+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.270+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:54:10.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.270+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13927267500606457955', time=2024-09-12T20:54:04.824297+0000, chain.objs.size()=9 2024-09-12T18:54:10.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.270+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.57__multipart_key1.2~QDer4skUHfahvdt2sV1cca5z4JiOa79.1 2024-09-12T18:54:10.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.270+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.57__shadow_key1.2~QDer4skUHfahvdt2sV1cca5z4JiOa79.1_1 2024-09-12T18:54:10.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.270+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.57__multipart_key1.2~QDer4skUHfahvdt2sV1cca5z4JiOa79.2 2024-09-12T18:54:10.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.270+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.57__shadow_key1.2~QDer4skUHfahvdt2sV1cca5z4JiOa79.2_1 2024-09-12T18:54:10.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.270+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.57__multipart_key1.2~QDer4skUHfahvdt2sV1cca5z4JiOa79.3 2024-09-12T18:54:10.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.270+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.57__shadow_key1.2~QDer4skUHfahvdt2sV1cca5z4JiOa79.3_1 2024-09-12T18:54:10.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.270+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.57__multipart_key1.2~QDer4skUHfahvdt2sV1cca5z4JiOa79.4 2024-09-12T18:54:10.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.270+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.57__shadow_key1.2~QDer4skUHfahvdt2sV1cca5z4JiOa79.4_1 2024-09-12T18:54:10.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.270+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.57__multipart_key1.2~QDer4skUHfahvdt2sV1cca5z4JiOa79.5 2024-09-12T18:54:10.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.278+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.282+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:54:10.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.282+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.282+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:54:10.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.781607814740009103', time=2024-09-12T20:53:53.213257+0000, chain.objs.size()=1 2024-09-12T18:54:10.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__shadow_.Ccx0Zy0scbkS1ByQmXN7ky-ivPsr6Te_0 2024-09-12T18:54:10.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7506846549743386430', time=2024-09-12T20:54:00.735351+0000, chain.objs.size()=16 2024-09-12T18:54:10.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.1 2024-09-12T18:54:10.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.1_1 2024-09-12T18:54:10.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.1_2 2024-09-12T18:54:10.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.2 2024-09-12T18:54:10.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.2_1 2024-09-12T18:54:10.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.2_2 2024-09-12T18:54:10.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.3 2024-09-12T18:54:10.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.3_1 2024-09-12T18:54:10.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.3_2 2024-09-12T18:54:10.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.4 2024-09-12T18:54:10.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.286+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.4_1 2024-09-12T18:54:10.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.290+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.4_2 2024-09-12T18:54:10.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.290+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.5 2024-09-12T18:54:10.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.294+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.5_1 2024-09-12T18:54:10.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.294+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.5_2 2024-09-12T18:54:10.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.294+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~G0o0pxl-tHN3kiegmjpmPUsx2X6g00r.6 2024-09-12T18:54:10.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.294+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1873059150948286992', time=2024-09-12T20:54:03.145495+0000, chain.objs.size()=1 2024-09-12T18:54:10.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.294+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.56__shadow_.DIikMwCuTUAQrsZKw4_aAYyEKqWLlbX_0 2024-09-12T18:54:10.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.298+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.298+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:54:10.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.302+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.302+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.302+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.302+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:54:10.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.306+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.306+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.306+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:54:10.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.306+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1660622171930704089', time=2024-09-12T20:53:46.114511+0000, chain.objs.size()=9 2024-09-12T18:54:10.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.306+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~m_2yxeMCBOWXd0x8ArsM-T5QnpIn2d8.1 2024-09-12T18:54:10.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.306+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~m_2yxeMCBOWXd0x8ArsM-T5QnpIn2d8.1_1 2024-09-12T18:54:10.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.306+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~m_2yxeMCBOWXd0x8ArsM-T5QnpIn2d8.2 2024-09-12T18:54:10.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.306+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~m_2yxeMCBOWXd0x8ArsM-T5QnpIn2d8.2_1 2024-09-12T18:54:10.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.306+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~m_2yxeMCBOWXd0x8ArsM-T5QnpIn2d8.3 2024-09-12T18:54:10.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.306+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~m_2yxeMCBOWXd0x8ArsM-T5QnpIn2d8.3_1 2024-09-12T18:54:10.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.306+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~m_2yxeMCBOWXd0x8ArsM-T5QnpIn2d8.4 2024-09-12T18:54:10.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.306+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~m_2yxeMCBOWXd0x8ArsM-T5QnpIn2d8.4_1 2024-09-12T18:54:10.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.306+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~m_2yxeMCBOWXd0x8ArsM-T5QnpIn2d8.5 2024-09-12T18:54:10.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.310+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.314+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:54:10.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.318+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.318+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.318+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.322+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:54:10.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.322+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.328 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.322+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.322+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:54:10.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.322+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2321779368482614349', time=2024-09-12T20:53:53.201164+0000, chain.objs.size()=9 2024-09-12T18:54:10.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.322+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__multipart_file.mpg.2~z-69iwRUWAqdAiLvNMPcRYu77waYGGw.1 2024-09-12T18:54:10.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.322+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__shadow_file.mpg.2~z-69iwRUWAqdAiLvNMPcRYu77waYGGw.1_1 2024-09-12T18:54:10.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.322+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__multipart_file.mpg.2~z-69iwRUWAqdAiLvNMPcRYu77waYGGw.2 2024-09-12T18:54:10.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.322+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__shadow_file.mpg.2~z-69iwRUWAqdAiLvNMPcRYu77waYGGw.2_1 2024-09-12T18:54:10.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.322+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__multipart_file.mpg.2~z-69iwRUWAqdAiLvNMPcRYu77waYGGw.3 2024-09-12T18:54:10.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.322+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__shadow_file.mpg.2~z-69iwRUWAqdAiLvNMPcRYu77waYGGw.3_1 2024-09-12T18:54:10.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.322+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__multipart_file.mpg.2~z-69iwRUWAqdAiLvNMPcRYu77waYGGw.4 2024-09-12T18:54:10.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.326+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__shadow_file.mpg.2~z-69iwRUWAqdAiLvNMPcRYu77waYGGw.4_1 2024-09-12T18:54:10.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.326+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__multipart_file.mpg.2~z-69iwRUWAqdAiLvNMPcRYu77waYGGw.5 2024-09-12T18:54:10.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.330+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.334+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:54:10.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.338+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.338+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.338+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.338+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:54:10.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:54:10.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16345867115998532880', time=2024-09-12T20:53:59.564191+0000, chain.objs.size()=19 2024-09-12T18:54:10.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.1 2024-09-12T18:54:10.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.1_1 2024-09-12T18:54:10.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.2 2024-09-12T18:54:10.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.2_1 2024-09-12T18:54:10.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.3 2024-09-12T18:54:10.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.3_1 2024-09-12T18:54:10.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.4 2024-09-12T18:54:10.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.4_1 2024-09-12T18:54:10.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.5 2024-09-12T18:54:10.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.5_1 2024-09-12T18:54:10.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.6 2024-09-12T18:54:10.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.342+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.6_1 2024-09-12T18:54:10.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.346+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.7 2024-09-12T18:54:10.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.346+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.7_1 2024-09-12T18:54:10.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.350+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.8 2024-09-12T18:54:10.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.350+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.8_1 2024-09-12T18:54:10.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.350+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.9 2024-09-12T18:54:10.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.350+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.9_1 2024-09-12T18:54:10.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.350+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~1X8kriG9JF8LHmtoBDs7cQ418GiLkLK.10 2024-09-12T18:54:10.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.350+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2038954557392898008', time=2024-09-12T20:54:06.520939+0000, chain.objs.size()=1 2024-09-12T18:54:10.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.350+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.61__shadow_.jWvFtuosSoXiEJPrEPsjdzutU9cT00g_0 2024-09-12T18:54:10.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.354+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.358+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:54:10.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.358+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:54:10.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~AZjVKYzzF25BfoyIJmC06qCDiEHof_E', time=2024-09-12T20:53:38.981823+0000, chain.objs.size()=9 2024-09-12T18:54:10.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.40__multipart_key1.2~AZjVKYzzF25BfoyIJmC06qCDiEHof_E.1 2024-09-12T18:54:10.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.40__shadow_key1.2~AZjVKYzzF25BfoyIJmC06qCDiEHof_E.1_1 2024-09-12T18:54:10.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.40__multipart_key1.2~AZjVKYzzF25BfoyIJmC06qCDiEHof_E.2 2024-09-12T18:54:10.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.40__shadow_key1.2~AZjVKYzzF25BfoyIJmC06qCDiEHof_E.2_1 2024-09-12T18:54:10.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.40__multipart_key1.2~AZjVKYzzF25BfoyIJmC06qCDiEHof_E.3 2024-09-12T18:54:10.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.40__shadow_key1.2~AZjVKYzzF25BfoyIJmC06qCDiEHof_E.3_1 2024-09-12T18:54:10.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.40__multipart_key1.2~AZjVKYzzF25BfoyIJmC06qCDiEHof_E.4 2024-09-12T18:54:10.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.40__shadow_key1.2~AZjVKYzzF25BfoyIJmC06qCDiEHof_E.4_1 2024-09-12T18:54:10.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.40__multipart_key1.2~AZjVKYzzF25BfoyIJmC06qCDiEHof_E.5 2024-09-12T18:54:10.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8649477417400749655', time=2024-09-12T20:53:58.516502+0000, chain.objs.size()=21 2024-09-12T18:54:10.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.1 2024-09-12T18:54:10.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.1_1 2024-09-12T18:54:10.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.362+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.2 2024-09-12T18:54:10.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.370+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.2_1 2024-09-12T18:54:10.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.370+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.3 2024-09-12T18:54:10.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.370+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.3_1 2024-09-12T18:54:10.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.370+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.4 2024-09-12T18:54:10.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.370+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.4_1 2024-09-12T18:54:10.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.370+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.5 2024-09-12T18:54:10.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.370+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.5_1 2024-09-12T18:54:10.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.370+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.6 2024-09-12T18:54:10.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.370+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.6_1 2024-09-12T18:54:10.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.370+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.7 2024-09-12T18:54:10.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.370+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.7_1 2024-09-12T18:54:10.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.374+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.8 2024-09-12T18:54:10.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.374+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.8_1 2024-09-12T18:54:10.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.374+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.9 2024-09-12T18:54:10.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.374+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.9_1 2024-09-12T18:54:10.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.374+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.10 2024-09-12T18:54:10.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.374+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.10_1 2024-09-12T18:54:10.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.378+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~_RzmQ5G7o8d9jSE7d-t25DydcsvfMRn.11 2024-09-12T18:54:10.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.382+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.386+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:54:10.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.386+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.386+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.386+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:54:10.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.386+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5352016430602767817', time=2024-09-12T20:54:05.875408+0000, chain.objs.size()=1 2024-09-12T18:54:10.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.386+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.59__shadow_.q2UN5rrwSI0G4Zj-Xxik08rSSagbj0l_0 2024-09-12T18:54:10.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.386+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15091242864897602332', time=2024-09-12T20:54:07.187830+0000, chain.objs.size()=1 2024-09-12T18:54:10.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.386+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.63__shadow_.O33q6n2J9Z8I9TJXqPutqqRW4DI-0FV_0 2024-09-12T18:54:10.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.390+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.394+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:54:10.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.394+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.398+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.398+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.398+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:54:10.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.402+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.402+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.402+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.402+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:54:10.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.406+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.406+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.406+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:54:10.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.406+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16711315027027065161', time=2024-09-12T20:54:06.198738+0000, chain.objs.size()=1 2024-09-12T18:54:10.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.406+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.60__shadow_.4pQFDlztO68FTC9vZiAVIpo49ksbsWQ_0 2024-09-12T18:54:10.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.410+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.414+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:54:10.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.414+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.418+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.418+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:54:10.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.418+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~DWJ5gX333LMkSXTtQ6F6fkWNabOOh6V', time=2024-09-12T20:53:53.992690+0000, chain.objs.size()=5 2024-09-12T18:54:10.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.418+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.54__multipart_key1.2~DWJ5gX333LMkSXTtQ6F6fkWNabOOh6V.7 2024-09-12T18:54:10.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.418+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.54__shadow_key1.2~DWJ5gX333LMkSXTtQ6F6fkWNabOOh6V.7_1 2024-09-12T18:54:10.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.418+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.54__multipart_key1.2~DWJ5gX333LMkSXTtQ6F6fkWNabOOh6V.10 2024-09-12T18:54:10.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.418+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.54__shadow_key1.2~DWJ5gX333LMkSXTtQ6F6fkWNabOOh6V.10_1 2024-09-12T18:54:10.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.418+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.54__multipart_key1.2~DWJ5gX333LMkSXTtQ6F6fkWNabOOh6V.13 2024-09-12T18:54:10.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.422+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.426+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:54:10.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.430+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.430+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.430+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.434+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:54:10.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.434+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.438+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.438+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.438+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:54:10.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.442+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.447 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.442+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.447 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.442+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:54:10.447 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.442+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5140632895047451764', time=2024-09-12T20:53:40.711057+0000, chain.objs.size()=9 2024-09-12T18:54:10.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.442+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.42__multipart_key1.2~JYZMzhU9YKATB7_oqLuSWwkSWMkV3MU.1 2024-09-12T18:54:10.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.442+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.42__shadow_key1.2~JYZMzhU9YKATB7_oqLuSWwkSWMkV3MU.1_1 2024-09-12T18:54:10.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.442+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.42__multipart_key1.2~JYZMzhU9YKATB7_oqLuSWwkSWMkV3MU.2 2024-09-12T18:54:10.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.442+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.42__shadow_key1.2~JYZMzhU9YKATB7_oqLuSWwkSWMkV3MU.2_1 2024-09-12T18:54:10.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.442+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.42__multipart_key1.2~JYZMzhU9YKATB7_oqLuSWwkSWMkV3MU.3 2024-09-12T18:54:10.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.442+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.42__shadow_key1.2~JYZMzhU9YKATB7_oqLuSWwkSWMkV3MU.3_1 2024-09-12T18:54:10.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.442+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.42__multipart_key1.2~JYZMzhU9YKATB7_oqLuSWwkSWMkV3MU.4 2024-09-12T18:54:10.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.442+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.42__shadow_key1.2~JYZMzhU9YKATB7_oqLuSWwkSWMkV3MU.4_1 2024-09-12T18:54:10.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.442+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.42__multipart_key1.2~JYZMzhU9YKATB7_oqLuSWwkSWMkV3MU.5 2024-09-12T18:54:10.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.450+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.454+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:54:10.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:54:10.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8036048568744703543', time=2024-09-12T20:53:57.182959+0000, chain.objs.size()=21 2024-09-12T18:54:10.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.1 2024-09-12T18:54:10.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.1_1 2024-09-12T18:54:10.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.2 2024-09-12T18:54:10.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.2_1 2024-09-12T18:54:10.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.3 2024-09-12T18:54:10.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.3_1 2024-09-12T18:54:10.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.4 2024-09-12T18:54:10.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.4_1 2024-09-12T18:54:10.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.5 2024-09-12T18:54:10.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.5_1 2024-09-12T18:54:10.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.6 2024-09-12T18:54:10.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.458+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.6_1 2024-09-12T18:54:10.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.466+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.7 2024-09-12T18:54:10.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.466+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.7_1 2024-09-12T18:54:10.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.466+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.8 2024-09-12T18:54:10.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.466+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.8_1 2024-09-12T18:54:10.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.466+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.9 2024-09-12T18:54:10.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.466+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.9_1 2024-09-12T18:54:10.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.466+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.10 2024-09-12T18:54:10.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.466+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.10_1 2024-09-12T18:54:10.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.466+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~x5CyqEGxYLxV0CHbreQtsgWJ_Ops_BA.11 2024-09-12T18:54:10.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.466+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8491859353882689643', time=2024-09-12T20:54:06.848469+0000, chain.objs.size()=1 2024-09-12T18:54:10.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.466+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.62__shadow_.gjkvqbXgw4vl6RUzrH3HEgnl0b28bA5_0 2024-09-12T18:54:10.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.474+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.478+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:54:10.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.478+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:54:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6846911652466878763', time=2024-09-12T20:54:01.918383+0000, chain.objs.size()=16 2024-09-12T18:54:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.1 2024-09-12T18:54:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.1_1 2024-09-12T18:54:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.1_2 2024-09-12T18:54:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.2 2024-09-12T18:54:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.2_1 2024-09-12T18:54:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.2_2 2024-09-12T18:54:10.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.3 2024-09-12T18:54:10.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.3_1 2024-09-12T18:54:10.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.3_2 2024-09-12T18:54:10.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.4 2024-09-12T18:54:10.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.4_1 2024-09-12T18:54:10.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.482+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.4_2 2024-09-12T18:54:10.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.486+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.5 2024-09-12T18:54:10.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.486+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.5_1 2024-09-12T18:54:10.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.490+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__shadow_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.5_2 2024-09-12T18:54:10.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.490+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.55__multipart_key1.2~Q8KGo9A0L0ulkkYhwTJa0Jluk2oPacR.6 2024-09-12T18:54:10.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.494+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.498+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:54:10.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.498+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.502+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.502+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:54:10.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.502+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2962073310367308457', time=2024-09-12T20:53:53.225068+0000, chain.objs.size()=9 2024-09-12T18:54:10.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.502+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__multipart_file2.mpg.2~aJyRjJ493JAA7jdPevIAYA1QgKP6GyU.1 2024-09-12T18:54:10.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.502+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__shadow_file2.mpg.2~aJyRjJ493JAA7jdPevIAYA1QgKP6GyU.1_1 2024-09-12T18:54:10.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.502+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__multipart_file2.mpg.2~aJyRjJ493JAA7jdPevIAYA1QgKP6GyU.2 2024-09-12T18:54:10.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.502+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__shadow_file2.mpg.2~aJyRjJ493JAA7jdPevIAYA1QgKP6GyU.2_1 2024-09-12T18:54:10.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.502+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__multipart_file2.mpg.2~aJyRjJ493JAA7jdPevIAYA1QgKP6GyU.3 2024-09-12T18:54:10.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.502+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__shadow_file2.mpg.2~aJyRjJ493JAA7jdPevIAYA1QgKP6GyU.3_1 2024-09-12T18:54:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.502+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__multipart_file2.mpg.2~aJyRjJ493JAA7jdPevIAYA1QgKP6GyU.4 2024-09-12T18:54:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.502+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__shadow_file2.mpg.2~aJyRjJ493JAA7jdPevIAYA1QgKP6GyU.4_1 2024-09-12T18:54:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.502+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__multipart_file2.mpg.2~aJyRjJ493JAA7jdPevIAYA1QgKP6GyU.5 2024-09-12T18:54:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.502+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15362453832474238040', time=2024-09-12T20:53:53.236426+0000, chain.objs.size()=1 2024-09-12T18:54:10.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.502+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__shadow_.VZuXFCAOl0dt3aTBOCWy7kN-jamNLvr_0 2024-09-12T18:54:10.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.510+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.510+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:54:10.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.514+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.514+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.514+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:54:10.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.514+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16787981916346590954', time=2024-09-12T20:53:46.754485+0000, chain.objs.size()=7 2024-09-12T18:54:10.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.514+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~8g5qB_cjwopLdlfmyaQk6YMViGvE7I2.1 2024-09-12T18:54:10.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.514+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~8g5qB_cjwopLdlfmyaQk6YMViGvE7I2.1_1 2024-09-12T18:54:10.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.514+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~8g5qB_cjwopLdlfmyaQk6YMViGvE7I2.1_2 2024-09-12T18:54:10.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.514+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~8g5qB_cjwopLdlfmyaQk6YMViGvE7I2.2 2024-09-12T18:54:10.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.514+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~8g5qB_cjwopLdlfmyaQk6YMViGvE7I2.2_1 2024-09-12T18:54:10.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.514+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~8g5qB_cjwopLdlfmyaQk6YMViGvE7I2.2_2 2024-09-12T18:54:10.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.514+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~8g5qB_cjwopLdlfmyaQk6YMViGvE7I2.3 2024-09-12T18:54:10.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.514+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15138322482971587910', time=2024-09-12T20:54:07.511193+0000, chain.objs.size()=1 2024-09-12T18:54:10.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.514+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.64__shadow_.1i7qFgo4bwsXDHrzSIPTAM5Pgz2dEfY_0 2024-09-12T18:54:10.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.522+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.526+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:54:10.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.530+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.530+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.530+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.534+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:54:10.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.534+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.534+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:54:10.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3395720232958606749', time=2024-09-12T20:53:41.990504+0000, chain.objs.size()=9 2024-09-12T18:54:10.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__multipart_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.1 2024-09-12T18:54:10.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__shadow_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.1_1 2024-09-12T18:54:10.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__multipart_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.2 2024-09-12T18:54:10.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__shadow_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.2_1 2024-09-12T18:54:10.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__multipart_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.3 2024-09-12T18:54:10.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__shadow_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.3_1 2024-09-12T18:54:10.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__multipart_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.4 2024-09-12T18:54:10.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__shadow_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.4_1 2024-09-12T18:54:10.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__multipart_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.5 2024-09-12T18:54:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.347307813638398110', time=2024-09-12T20:53:42.182120+0000, chain.objs.size()=9 2024-09-12T18:54:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__multipart_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.1 2024-09-12T18:54:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__shadow_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.1_1 2024-09-12T18:54:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.538+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__multipart_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.2 2024-09-12T18:54:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.542+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__shadow_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.2_1 2024-09-12T18:54:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.542+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__multipart_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.3 2024-09-12T18:54:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.542+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__shadow_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.3_1 2024-09-12T18:54:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.542+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__multipart_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.4 2024-09-12T18:54:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.542+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__shadow_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.4_1 2024-09-12T18:54:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.542+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.44__multipart_key1.2~_0KZGdCwf1Tvt-WGQMkF3_gFWLLQ1tr.5 2024-09-12T18:54:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.542+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12036684988628149761', time=2024-09-12T20:53:45.453383+0000, chain.objs.size()=9 2024-09-12T18:54:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.542+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~ENf4btJaDapkoXPVKQ5Ar_5_K0GLGwj.1 2024-09-12T18:54:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.542+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~ENf4btJaDapkoXPVKQ5Ar_5_K0GLGwj.1_1 2024-09-12T18:54:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.542+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~ENf4btJaDapkoXPVKQ5Ar_5_K0GLGwj.2 2024-09-12T18:54:10.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.542+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~ENf4btJaDapkoXPVKQ5Ar_5_K0GLGwj.2_1 2024-09-12T18:54:10.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.542+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~ENf4btJaDapkoXPVKQ5Ar_5_K0GLGwj.3 2024-09-12T18:54:10.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.550+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~ENf4btJaDapkoXPVKQ5Ar_5_K0GLGwj.3_1 2024-09-12T18:54:10.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.550+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~ENf4btJaDapkoXPVKQ5Ar_5_K0GLGwj.4 2024-09-12T18:54:10.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.550+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~ENf4btJaDapkoXPVKQ5Ar_5_K0GLGwj.4_1 2024-09-12T18:54:10.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.550+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~ENf4btJaDapkoXPVKQ5Ar_5_K0GLGwj.5 2024-09-12T18:54:10.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.550+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4990402630375749319', time=2024-09-12T20:54:08.863515+0000, chain.objs.size()=21 2024-09-12T18:54:10.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.550+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__multipart_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.1 2024-09-12T18:54:10.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.550+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__shadow_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.1_1 2024-09-12T18:54:10.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.550+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__multipart_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.2 2024-09-12T18:54:10.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.550+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__shadow_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.2_1 2024-09-12T18:54:10.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.550+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__multipart_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.3 2024-09-12T18:54:10.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.550+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__shadow_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.3_1 2024-09-12T18:54:10.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.550+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__multipart_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.4 2024-09-12T18:54:10.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.554+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__shadow_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.4_1 2024-09-12T18:54:10.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.558+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__multipart_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.5 2024-09-12T18:54:10.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.558+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__shadow_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.5_1 2024-09-12T18:54:10.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.558+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__multipart_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.6 2024-09-12T18:54:10.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.558+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__shadow_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.6_1 2024-09-12T18:54:10.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.558+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__multipart_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.7 2024-09-12T18:54:10.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.558+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__shadow_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.7_1 2024-09-12T18:54:10.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.558+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__multipart_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.8 2024-09-12T18:54:10.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.558+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__shadow_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.8_1 2024-09-12T18:54:10.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.558+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__multipart_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.9 2024-09-12T18:54:10.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.558+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__shadow_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.9_1 2024-09-12T18:54:10.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.562+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__multipart_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.10 2024-09-12T18:54:10.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.566+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__shadow_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.10_1 2024-09-12T18:54:10.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.566+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.66__multipart_key1.2~7ZR3YMjQS-oe5eVIRMyWVdERzL7gleG.11 2024-09-12T18:54:10.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.570+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.574+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:54:10.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.578+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.578+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.578+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.578+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:54:10.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.582+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:54:10.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11537082896092542392', time=2024-09-12T20:53:49.392087+0000, chain.objs.size()=9 2024-09-12T18:54:10.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.51__multipart_key1.2~zo5sUhmFjpIk7uGzZjCJ9YYIOClJD8a.1 2024-09-12T18:54:10.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.51__shadow_key1.2~zo5sUhmFjpIk7uGzZjCJ9YYIOClJD8a.1_1 2024-09-12T18:54:10.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.51__multipart_key1.2~zo5sUhmFjpIk7uGzZjCJ9YYIOClJD8a.2 2024-09-12T18:54:10.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.51__shadow_key1.2~zo5sUhmFjpIk7uGzZjCJ9YYIOClJD8a.2_1 2024-09-12T18:54:10.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.51__multipart_key1.2~zo5sUhmFjpIk7uGzZjCJ9YYIOClJD8a.3 2024-09-12T18:54:10.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.51__shadow_key1.2~zo5sUhmFjpIk7uGzZjCJ9YYIOClJD8a.3_1 2024-09-12T18:54:10.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.51__multipart_key1.2~zo5sUhmFjpIk7uGzZjCJ9YYIOClJD8a.4 2024-09-12T18:54:10.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.51__shadow_key1.2~zo5sUhmFjpIk7uGzZjCJ9YYIOClJD8a.4_1 2024-09-12T18:54:10.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.51__multipart_key1.2~zo5sUhmFjpIk7uGzZjCJ9YYIOClJD8a.5 2024-09-12T18:54:10.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17953795173803043510', time=2024-09-12T20:54:03.735067+0000, chain.objs.size()=9 2024-09-12T18:54:10.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.56__multipart_key1.2~Szm0QJD6WmZuDFJYs3zc6ge0rj1_tM2.1 2024-09-12T18:54:10.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.56__shadow_key1.2~Szm0QJD6WmZuDFJYs3zc6ge0rj1_tM2.1_1 2024-09-12T18:54:10.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.586+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.56__multipart_key1.2~Szm0QJD6WmZuDFJYs3zc6ge0rj1_tM2.2 2024-09-12T18:54:10.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.590+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.56__shadow_key1.2~Szm0QJD6WmZuDFJYs3zc6ge0rj1_tM2.2_1 2024-09-12T18:54:10.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.590+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.56__multipart_key1.2~Szm0QJD6WmZuDFJYs3zc6ge0rj1_tM2.3 2024-09-12T18:54:10.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.590+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.56__shadow_key1.2~Szm0QJD6WmZuDFJYs3zc6ge0rj1_tM2.3_1 2024-09-12T18:54:10.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.590+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.56__multipart_key1.2~Szm0QJD6WmZuDFJYs3zc6ge0rj1_tM2.4 2024-09-12T18:54:10.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.590+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.56__shadow_key1.2~Szm0QJD6WmZuDFJYs3zc6ge0rj1_tM2.4_1 2024-09-12T18:54:10.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.590+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.56__multipart_key1.2~Szm0QJD6WmZuDFJYs3zc6ge0rj1_tM2.5 2024-09-12T18:54:10.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.598+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.602+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:54:10.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.606+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.606+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.606+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.610+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:54:10.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.610+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.610+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.614+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.614+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:54:10.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:10.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:10.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:54:10.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17861301167488924815', time=2024-09-12T20:53:44.606651+0000, chain.objs.size()=9 2024-09-12T18:54:10.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~tfXJm1cfSRQEInMbMd-uDN9-xuriU2G.1 2024-09-12T18:54:10.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~tfXJm1cfSRQEInMbMd-uDN9-xuriU2G.1_1 2024-09-12T18:54:10.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~tfXJm1cfSRQEInMbMd-uDN9-xuriU2G.2 2024-09-12T18:54:10.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~tfXJm1cfSRQEInMbMd-uDN9-xuriU2G.2_1 2024-09-12T18:54:10.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~tfXJm1cfSRQEInMbMd-uDN9-xuriU2G.3 2024-09-12T18:54:10.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~tfXJm1cfSRQEInMbMd-uDN9-xuriU2G.3_1 2024-09-12T18:54:10.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~tfXJm1cfSRQEInMbMd-uDN9-xuriU2G.4 2024-09-12T18:54:10.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__shadow_key1.2~tfXJm1cfSRQEInMbMd-uDN9-xuriU2G.4_1 2024-09-12T18:54:10.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.47__multipart_key1.2~tfXJm1cfSRQEInMbMd-uDN9-xuriU2G.5 2024-09-12T18:54:10.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11009904449588184391', time=2024-09-12T20:53:47.632418+0000, chain.objs.size()=6 2024-09-12T18:54:10.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.46__shadow_.xgyYGMPzafANhE4b9AeKWSCrxtouJIg_0 2024-09-12T18:54:10.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.46__shadow_.xgyYGMPzafANhE4b9AeKWSCrxtouJIg_1 2024-09-12T18:54:10.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.618+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.46__shadow_.xgyYGMPzafANhE4b9AeKWSCrxtouJIg_2 2024-09-12T18:54:10.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.626+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.46__shadow_.xgyYGMPzafANhE4b9AeKWSCrxtouJIg_3 2024-09-12T18:54:10.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.626+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.46__shadow_.xgyYGMPzafANhE4b9AeKWSCrxtouJIg_4 2024-09-12T18:54:10.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.626+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.46__shadow_.xgyYGMPzafANhE4b9AeKWSCrxtouJIg_5 2024-09-12T18:54:10.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.626+0000 7fcd8e4bd9c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12469265857634521187', time=2024-09-12T20:53:53.248989+0000, chain.objs.size()=1 2024-09-12T18:54:10.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.626+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.53__shadow_.QE0mnCI2RU3par0wbtlQZE5JfTxy9dg_0 2024-09-12T18:54:10.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.634+0000 7fcd8e4bd9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:10.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.638+0000 7fcc41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:10.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.642+0000 7fcd8e4bd9c0 20 remove_watcher() i=0 2024-09-12T18:54:10.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.642+0000 7fcd8e4bd9c0 2 removed watcher, disabling cache 2024-09-12T18:54:10.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.646+0000 7fcd8e4bd9c0 20 remove_watcher() i=1 2024-09-12T18:54:10.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.646+0000 7fcd8e4bd9c0 20 remove_watcher() i=2 2024-09-12T18:54:10.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.646+0000 7fcd8e4bd9c0 20 remove_watcher() i=3 2024-09-12T18:54:10.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.650+0000 7fcd8e4bd9c0 20 remove_watcher() i=4 2024-09-12T18:54:10.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.650+0000 7fcd8e4bd9c0 20 remove_watcher() i=5 2024-09-12T18:54:10.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.654+0000 7fcd8e4bd9c0 20 remove_watcher() i=6 2024-09-12T18:54:10.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.654+0000 7fcd8e4bd9c0 20 remove_watcher() i=7 2024-09-12T18:54:10.676 DEBUG:teuthology.orchestra.run.smithi111:> radosgw-admin gc process --include-all 2024-09-12T18:54:10.751 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:54:10.751 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:54:10.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.794+0000 7f5fa4ef69c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:10.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.794+0000 7f5fa4ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:10.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.794+0000 7f5fa4ef69c0 20 realm 2024-09-12T18:54:10.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.794+0000 7f5fa4ef69c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:10.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.794+0000 7f5fa4ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:10.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.794+0000 7f5fa4ef69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:54:10.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.794+0000 7f5fa4ef69c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:10.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.794+0000 7f5fa4ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:10.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.794+0000 7f5fa4ef69c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:10.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.798+0000 7f5fa4ef69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:10.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.798+0000 7f5fa4ef69c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:10.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.798+0000 7f5fa4ef69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:54:10.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.798+0000 7f5fa4ef69c0 20 searching for the correct realm 2024-09-12T18:54:10.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.802+0000 7f5fa31fd640 0 -- 172.21.15.111:0/1121527113 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f5f9812b2f0 msgr2=0x7f5f98115730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:54:10.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:10.806+0000 7f5fa21fb640 0 -- 172.21.15.111:0/1121527113 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f5f9c024400 msgr2=0x7f5f9c024880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:54:11.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.022+0000 7f5fa4ef69c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:54:11.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.022+0000 7f5fa4ef69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:54:11.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.022+0000 7f5fa4ef69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:54:11.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.022+0000 7f5fa4ef69c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:54:11.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.022+0000 7f5fa4ef69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:54:11.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.022+0000 7f5fa4ef69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:54:11.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.022+0000 7f5fa4ef69c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.022+0000 7f5fa4ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.022+0000 7f5fa4ef69c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.022+0000 7f5fa4ef69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:11.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.022+0000 7f5fa4ef69c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:54:11.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 20 zone default found 2024-09-12T18:54:11.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 4 Realm: () 2024-09-12T18:54:11.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:54:11.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:54:11.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:54:11.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 20 zonegroup default 2024-09-12T18:54:11.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:11.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:11.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:11.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 20 started sync module instance, tier type = 2024-09-12T18:54:11.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.026+0000 7f5fa4ef69c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:54:11.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.050+0000 7f5fa4ef69c0 20 add_watcher() i=0 2024-09-12T18:54:11.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.050+0000 7f5fa4ef69c0 20 add_watcher() i=1 2024-09-12T18:54:11.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.050+0000 7f5fa4ef69c0 20 add_watcher() i=2 2024-09-12T18:54:11.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.050+0000 7f5fa4ef69c0 20 add_watcher() i=3 2024-09-12T18:54:11.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.050+0000 7f5fa4ef69c0 20 add_watcher() i=4 2024-09-12T18:54:11.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.050+0000 7f5fa4ef69c0 20 add_watcher() i=5 2024-09-12T18:54:11.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.050+0000 7f5fa4ef69c0 20 add_watcher() i=6 2024-09-12T18:54:11.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.050+0000 7f5fa4ef69c0 20 add_watcher() i=7 2024-09-12T18:54:11.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.050+0000 7f5fa4ef69c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:54:11.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.054+0000 7f5e597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:11.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.054+0000 7f5fa4ef69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:54:11.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.054+0000 7f5fa4ef69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:54:11.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.146+0000 7f5dd3fff640 20 reqs_thread_entry: start 2024-09-12T18:54:11.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.146+0000 7f5fa4ef69c0 20 init_complete bucket index max shards: 11 2024-09-12T18:54:11.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.146+0000 7f5fa4ef69c0 20 Filter name: none 2024-09-12T18:54:11.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.146+0000 7f5dd1ffb640 20 reqs_thread_entry: start 2024-09-12T18:54:11.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.146+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:54:11.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.150+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.150+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.150+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.154+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:54:11.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.154+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.158+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.158+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.158+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:54:11.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.162+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.162+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.162+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.166+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:54:11.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.166+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.170+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.170+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.174+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:54:11.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.174+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.178+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.178+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.182+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:54:11.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.186+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.186+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.186+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.190+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:54:11.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.194+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.194+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.194+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.198+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:54:11.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.202+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.202+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.202+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.206+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:54:11.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.206+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.210+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.210+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.210+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:54:11.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.214+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.218+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.218+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.222+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:54:11.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.226+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.226+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.226+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.230+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:54:11.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.234+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.238+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.238+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.238+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:54:11.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.242+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.246+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.246+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.250+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:54:11.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.250+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.254+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.254+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.258+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:54:11.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.258+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.262+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.262+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.266+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:54:11.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.270+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.270+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.274+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.274+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:54:11.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.278+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.282+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.282+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.286+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:54:11.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.286+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.290+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.290+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.294+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:54:11.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.298+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.298+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.302+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.306+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:54:11.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.306+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.310+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.310+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.310+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:54:11.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.314+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.314+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.318+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.318+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:54:11.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.322+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.322+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.328 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.322+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.326+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:54:11.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.330+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.330+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.330+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.334+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:54:11.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.338+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.338+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.338+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.342+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:54:11.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.346+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.350+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.350+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.350+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:54:11.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.354+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.358+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.358+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.358+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:54:11.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.362+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.362+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.362+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.366+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:54:11.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.370+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.370+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.370+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.374+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:54:11.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.378+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.378+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.378+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.382+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:54:11.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.382+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.386+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.386+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.390+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:54:11.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.390+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.394+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.394+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.398+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:54:11.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.402+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.402+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.402+0000 7f5fa4ef69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.406+0000 7f5e597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:11.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.414+0000 7f5fa4ef69c0 20 remove_watcher() i=0 2024-09-12T18:54:11.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.414+0000 7f5fa4ef69c0 2 removed watcher, disabling cache 2024-09-12T18:54:11.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.414+0000 7f5fa4ef69c0 20 remove_watcher() i=1 2024-09-12T18:54:11.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.418+0000 7f5fa4ef69c0 20 remove_watcher() i=2 2024-09-12T18:54:11.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.422+0000 7f5fa4ef69c0 20 remove_watcher() i=3 2024-09-12T18:54:11.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.422+0000 7f5fa4ef69c0 20 remove_watcher() i=4 2024-09-12T18:54:11.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.426+0000 7f5fa4ef69c0 20 remove_watcher() i=5 2024-09-12T18:54:11.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.426+0000 7f5fa4ef69c0 20 remove_watcher() i=6 2024-09-12T18:54:11.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.426+0000 7f5fa4ef69c0 20 remove_watcher() i=7 2024-09-12T18:54:11.450 DEBUG:teuthology.orchestra.run.smithi111:> radosgw-admin gc process --include-all 2024-09-12T18:54:11.527 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:54:11.528 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:54:11.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.570+0000 7f24c361f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.570+0000 7f24c361f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:11.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.570+0000 7f24c361f9c0 20 realm 2024-09-12T18:54:11.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.570+0000 7f24c361f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.570+0000 7f24c361f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:11.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.570+0000 7f24c361f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:54:11.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.570+0000 7f24c361f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.570+0000 7f24c361f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:11.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.570+0000 7f24c361f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.574+0000 7f24c361f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:11.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.574+0000 7f24c361f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.574+0000 7f24c361f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:54:11.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.574+0000 7f24c361f9c0 20 searching for the correct realm 2024-09-12T18:54:11.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.578+0000 7f24c1125640 0 -- 172.21.15.111:0/3806689398 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f24b4004040 msgr2=0x7f24b405c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:54:11.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.586+0000 7f24c0924640 0 -- 172.21.15.111:0/3806689398 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f24b4064340 msgr2=0x7f24b4082130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:54:11.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.802+0000 7f24c361f9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:54:11.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.802+0000 7f24c361f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:54:11.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.802+0000 7f24c361f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:54:11.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.802+0000 7f24c361f9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:54:11.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.802+0000 7f24c361f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:54:11.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.802+0000 7f24c361f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:54:11.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.802+0000 7f24c361f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.802+0000 7f24c361f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:11.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.802+0000 7f24c361f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:11.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:54:11.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 20 zone default found 2024-09-12T18:54:11.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 4 Realm: () 2024-09-12T18:54:11.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:54:11.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:54:11.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:54:11.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 20 zonegroup default 2024-09-12T18:54:11.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:11.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:11.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:11.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.806+0000 7f24c361f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:11.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.810+0000 7f24c361f9c0 20 started sync module instance, tier type = 2024-09-12T18:54:11.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.810+0000 7f24c361f9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:54:11.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.834+0000 7f24c361f9c0 20 add_watcher() i=0 2024-09-12T18:54:11.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.834+0000 7f24c361f9c0 20 add_watcher() i=1 2024-09-12T18:54:11.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.834+0000 7f24c361f9c0 20 add_watcher() i=2 2024-09-12T18:54:11.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.834+0000 7f24c361f9c0 20 add_watcher() i=3 2024-09-12T18:54:11.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.834+0000 7f24c361f9c0 20 add_watcher() i=4 2024-09-12T18:54:11.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.834+0000 7f24c361f9c0 20 add_watcher() i=5 2024-09-12T18:54:11.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.834+0000 7f24c361f9c0 20 add_watcher() i=6 2024-09-12T18:54:11.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.834+0000 7f24c361f9c0 20 add_watcher() i=7 2024-09-12T18:54:11.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.834+0000 7f24c361f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:54:11.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.838+0000 7f23777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:11.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.838+0000 7f24c361f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:54:11.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.838+0000 7f24c361f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:54:11.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.926+0000 7f23767e4640 20 reqs_thread_entry: start 2024-09-12T18:54:11.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.926+0000 7f24c361f9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:54:11.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.926+0000 7f24c361f9c0 20 Filter name: none 2024-09-12T18:54:11.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.926+0000 7f22e7fff640 20 reqs_thread_entry: start 2024-09-12T18:54:11.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.926+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:54:11.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.930+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.930+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.930+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.934+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:54:11.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.938+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.938+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.938+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.942+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:54:11.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.942+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.946+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.946+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.950+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:54:11.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.950+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.954+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.954+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.954+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:54:11.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.958+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.958+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.958+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.958+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:54:11.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.962+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.962+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.966+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.966+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:54:11.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.970+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.970+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.970+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.970+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:54:11.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.974+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.974+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.974+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.978+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:54:11.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.978+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.982+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.982+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.986+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:54:11.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.990+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.990+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:11.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.990+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:11.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.994+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:54:12.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.994+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.998+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.998+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:11.998+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:54:12.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.002+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.002+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.006+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.006+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:54:12.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.010+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.010+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.010+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.014+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:54:12.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.018+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.018+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.018+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.022+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:54:12.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.026+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.026+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.026+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.030+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:54:12.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.034+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.034+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.034+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.038+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:54:12.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.042+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.042+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.042+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.046+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:54:12.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.050+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.050+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.050+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.054+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:54:12.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.058+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.058+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.058+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.062+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:54:12.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.066+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.066+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.066+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.070+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:54:12.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.074+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.074+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.074+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.078+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:54:12.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.082+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.082+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.082+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.086+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:54:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.090+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.090+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.090+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.094+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:54:12.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.098+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.098+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.102+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.102+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:54:12.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.106+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.106+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.110+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.110+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:54:12.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.114+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.114+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.118+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.118+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:54:12.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.122+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.126+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.126+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.126+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:54:12.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.130+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.130+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.134+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.134+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:54:12.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.138+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.142+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.142+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.146+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:54:12.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.150+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.150+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.154+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.154+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:54:12.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.158+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.162+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.162+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.166+0000 7f24c361f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:54:12.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.166+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.170+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.170+0000 7f24c361f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.174+0000 7f23777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:12.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.178+0000 7f24c361f9c0 20 remove_watcher() i=0 2024-09-12T18:54:12.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.178+0000 7f24c361f9c0 2 removed watcher, disabling cache 2024-09-12T18:54:12.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.182+0000 7f24c361f9c0 20 remove_watcher() i=1 2024-09-12T18:54:12.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.186+0000 7f24c361f9c0 20 remove_watcher() i=2 2024-09-12T18:54:12.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.186+0000 7f24c361f9c0 20 remove_watcher() i=3 2024-09-12T18:54:12.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.190+0000 7f24c361f9c0 20 remove_watcher() i=4 2024-09-12T18:54:12.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.190+0000 7f24c361f9c0 20 remove_watcher() i=5 2024-09-12T18:54:12.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.194+0000 7f24c361f9c0 20 remove_watcher() i=6 2024-09-12T18:54:12.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.194+0000 7f24c361f9c0 20 remove_watcher() i=7 2024-09-12T18:54:12.218 DEBUG:teuthology.orchestra.run.smithi111:> radosgw-admin gc process --include-all 2024-09-12T18:54:12.291 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:54:12.292 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:54:12.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.334+0000 7fb17d4209c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:12.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.334+0000 7fb17d4209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:12.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.334+0000 7fb17d4209c0 20 realm 2024-09-12T18:54:12.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.334+0000 7fb17d4209c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:12.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.334+0000 7fb17d4209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:12.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.334+0000 7fb17d4209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:54:12.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.334+0000 7fb17d4209c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:12.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.334+0000 7fb17d4209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:12.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.334+0000 7fb17d4209c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:12.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.338+0000 7fb17d4209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:12.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.338+0000 7fb17d4209c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:12.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.338+0000 7fb17d4209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:54:12.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.338+0000 7fb17d4209c0 20 searching for the correct realm 2024-09-12T18:54:12.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.338+0000 7fb17af26640 0 -- 172.21.15.111:0/3029565728 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x56333b2b8b50 msgr2=0x7fb174021a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:54:12.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.346+0000 7fb17af26640 0 -- 172.21.15.111:0/3029565728 >> [v2:172.21.15.153:6808/1571723771,v1:172.21.15.153:6809/1571723771] conn(0x56333b34d660 msgr2=0x7fb1740169d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:54:12.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:54:12.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:54:12.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:54:12.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:54:12.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:54:12.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:54:12.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:12.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:12.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:12.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:12.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:12.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:54:12.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 zone default found 2024-09-12T18:54:12.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 4 Realm: () 2024-09-12T18:54:12.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:54:12.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:54:12.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:54:12.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 zonegroup default 2024-09-12T18:54:12.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.570+0000 7fb17d4209c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:12.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.574+0000 7fb17d4209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:12.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.574+0000 7fb17d4209c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:12.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.574+0000 7fb17d4209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:12.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.574+0000 7fb17d4209c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:12.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.574+0000 7fb17d4209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:12.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.574+0000 7fb17d4209c0 20 started sync module instance, tier type = 2024-09-12T18:54:12.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.574+0000 7fb17d4209c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:54:12.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.594+0000 7fb17d4209c0 20 add_watcher() i=0 2024-09-12T18:54:12.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.594+0000 7fb17d4209c0 20 add_watcher() i=1 2024-09-12T18:54:12.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.594+0000 7fb17d4209c0 20 add_watcher() i=2 2024-09-12T18:54:12.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.594+0000 7fb17d4209c0 20 add_watcher() i=3 2024-09-12T18:54:12.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.594+0000 7fb17d4209c0 20 add_watcher() i=4 2024-09-12T18:54:12.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.594+0000 7fb17d4209c0 20 add_watcher() i=5 2024-09-12T18:54:12.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.594+0000 7fb17d4209c0 20 add_watcher() i=6 2024-09-12T18:54:12.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.598+0000 7fb17d4209c0 20 add_watcher() i=7 2024-09-12T18:54:12.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.598+0000 7fb17d4209c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:54:12.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.602+0000 7fb031fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:12.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.602+0000 7fb17d4209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:54:12.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.602+0000 7fb17d4209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:54:12.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.686+0000 7fb030fe1640 20 reqs_thread_entry: start 2024-09-12T18:54:12.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.686+0000 7fb17d4209c0 20 init_complete bucket index max shards: 11 2024-09-12T18:54:12.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.686+0000 7fb17d4209c0 20 Filter name: none 2024-09-12T18:54:12.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.686+0000 7fb029ffb640 20 reqs_thread_entry: start 2024-09-12T18:54:12.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.686+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:54:12.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.690+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.694+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.694+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.698+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:54:12.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.698+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.698+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.702+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.702+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:54:12.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.706+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.706+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.710+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.710+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:54:12.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.714+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.714+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.714+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.714+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:54:12.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.718+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.718+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.718+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.722+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:54:12.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.722+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.726+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.726+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.726+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:54:12.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.730+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.734+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.734+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.738+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:54:12.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.738+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.742+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.742+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.742+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:54:12.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.746+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.750+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.750+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.754+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:54:12.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.754+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.758+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.758+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.762+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:54:12.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.762+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.766+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.766+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.770+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:54:12.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.770+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.774+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.774+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.774+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:54:12.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.778+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.778+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.778+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.782+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:54:12.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.786+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.786+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.786+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.790+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:54:12.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.794+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.794+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.794+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.794+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:54:12.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.798+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.798+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.798+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.802+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:54:12.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.806+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.806+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.806+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.810+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:54:12.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.814+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.814+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.814+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.818+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:54:12.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.822+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.822+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.822+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.826+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:54:12.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.830+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.830+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.834+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.834+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:54:12.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.838+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.842+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.842+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.842+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:54:12.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.846+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.846+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.846+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.850+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:54:12.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.854+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.854+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.858+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.858+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:54:12.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.862+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.862+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.866+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.866+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:54:12.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.870+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.870+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.870+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.874+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:54:12.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.878+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.878+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.878+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.882+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:54:12.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.886+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.886+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.886+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.890+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:54:12.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.894+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.894+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.894+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.898+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:54:12.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.898+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.902+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.902+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.902+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:54:12.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.906+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.910+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.910+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.910+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:54:12.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.914+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.918+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.918+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.922+0000 7fb17d4209c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:54:12.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.926+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.926+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:12.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.926+0000 7fb17d4209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:12.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.930+0000 7fb031fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:12.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.938+0000 7fb17d4209c0 20 remove_watcher() i=0 2024-09-12T18:54:12.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.938+0000 7fb17d4209c0 2 removed watcher, disabling cache 2024-09-12T18:54:12.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.938+0000 7fb17d4209c0 20 remove_watcher() i=1 2024-09-12T18:54:12.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.942+0000 7fb17d4209c0 20 remove_watcher() i=2 2024-09-12T18:54:12.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.946+0000 7fb17d4209c0 20 remove_watcher() i=3 2024-09-12T18:54:12.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.946+0000 7fb17d4209c0 20 remove_watcher() i=4 2024-09-12T18:54:12.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.950+0000 7fb17d4209c0 20 remove_watcher() i=5 2024-09-12T18:54:12.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.950+0000 7fb17d4209c0 20 remove_watcher() i=6 2024-09-12T18:54:12.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:12.954+0000 7fb17d4209c0 20 remove_watcher() i=7 2024-09-12T18:54:12.979 DEBUG:teuthology.orchestra.run.smithi111:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T18:54:13.701 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :clean 2024-09-12T18:54:14.600 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :compileJava 2024-09-12T18:54:14.600 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :processResources 2024-09-12T18:54:14.600 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :classes 2024-09-12T18:54:15.099 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:15.099 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :compileTestJava 2024-09-12T18:54:15.100 INFO:teuthology.orchestra.run.smithi111.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:54:15.100 INFO:teuthology.orchestra.run.smithi111.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:54:15.101 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:15.101 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:54:15.101 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :testClasses 2024-09-12T18:54:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:17.100 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :test 2024-09-12T18:54:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:17.100 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T18:54:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12 18:54:16,476 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:54:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:17.101 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T18:54:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:17.102 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T18:54:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:17.102 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T18:54:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:17.102 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T18:54:17.401 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:17.401 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T18:54:17.401 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:17.401 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T18:54:17.699 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:17.699 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T18:54:17.799 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:17.799 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T18:54:17.899 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:17.899 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T18:54:18.099 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:18.099 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T18:54:18.399 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:18.399 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T18:54:18.400 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:18.400 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T18:54:18.499 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:18.499 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T18:54:18.699 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:18.699 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T18:54:19.100 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:19.100 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T18:54:19.199 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:19.199 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T18:54:19.499 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:19.499 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T18:54:19.599 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:19.599 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T18:54:19.668 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:19.668 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------- 2024-09-12T18:54:19.668 INFO:teuthology.orchestra.run.smithi111.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T18:54:19.668 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------- 2024-09-12T18:54:19.668 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:19.668 INFO:teuthology.orchestra.run.smithi111.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:54:19.668 INFO:teuthology.orchestra.run.smithi111.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:54:19.668 INFO:teuthology.orchestra.run.smithi111.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:54:19.668 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:19.668 INFO:teuthology.orchestra.run.smithi111.stdout:BUILD SUCCESSFUL in 6s 2024-09-12T18:54:19.668 INFO:teuthology.orchestra.run.smithi111.stdout:5 actionable tasks: 5 executed 2024-09-12T18:54:19.675 DEBUG:teuthology.orchestra.run.smithi111:> radosgw-admin gc process --include-all 2024-09-12T18:54:19.701 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:54:19.701 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:54:19.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.742+0000 7f0b532159c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:19.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.742+0000 7f0b532159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:19.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.742+0000 7f0b532159c0 20 realm 2024-09-12T18:54:19.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.742+0000 7f0b532159c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:19.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.742+0000 7f0b532159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:19.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.742+0000 7f0b532159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:54:19.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.742+0000 7f0b532159c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:19.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.742+0000 7f0b532159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:19.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.742+0000 7f0b532159c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:19.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.746+0000 7f0b532159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:19.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.746+0000 7f0b532159c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:19.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.746+0000 7f0b532159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:54:19.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.746+0000 7f0b532159c0 20 searching for the correct realm 2024-09-12T18:54:19.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.750+0000 7f0b5051a640 0 -- 172.21.15.111:0/3949139727 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f0b400fe290 msgr2=0x7f0b400cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:54:19.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.966+0000 7f0b50d1b640 0 -- 172.21.15.111:0/3949139727 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x55c7bc9ee230 msgr2=0x7f0b4805b470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:54:19.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:54:19.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:54:19.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:54:19.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:54:19.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:54:19.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:54:19.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:19.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:19.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:19.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:19.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:19.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:54:19.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 zone default found 2024-09-12T18:54:19.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 4 Realm: () 2024-09-12T18:54:19.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:54:19.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:54:19.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:54:19.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 zonegroup default 2024-09-12T18:54:19.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:19.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:19.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.982+0000 7f0b532159c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:19.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.986+0000 7f0b532159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:19.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.986+0000 7f0b532159c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:19.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.986+0000 7f0b532159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:19.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.986+0000 7f0b532159c0 20 started sync module instance, tier type = 2024-09-12T18:54:19.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:19.986+0000 7f0b532159c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:54:20.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.006+0000 7f0b532159c0 20 add_watcher() i=0 2024-09-12T18:54:20.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.006+0000 7f0b532159c0 20 add_watcher() i=1 2024-09-12T18:54:20.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.006+0000 7f0b532159c0 20 add_watcher() i=2 2024-09-12T18:54:20.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.006+0000 7f0b532159c0 20 add_watcher() i=3 2024-09-12T18:54:20.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.006+0000 7f0b532159c0 20 add_watcher() i=4 2024-09-12T18:54:20.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.006+0000 7f0b532159c0 20 add_watcher() i=5 2024-09-12T18:54:20.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.006+0000 7f0b532159c0 20 add_watcher() i=6 2024-09-12T18:54:20.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.006+0000 7f0b532159c0 20 add_watcher() i=7 2024-09-12T18:54:20.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.006+0000 7f0b532159c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:54:20.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.010+0000 7f0a06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:20.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.010+0000 7f0b532159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:54:20.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.010+0000 7f0b532159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:54:20.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.098+0000 7f0a05fe3640 20 reqs_thread_entry: start 2024-09-12T18:54:20.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.098+0000 7f0b532159c0 20 init_complete bucket index max shards: 11 2024-09-12T18:54:20.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.098+0000 7f0b532159c0 20 Filter name: none 2024-09-12T18:54:20.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.098+0000 7f09777fe640 20 reqs_thread_entry: start 2024-09-12T18:54:20.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.098+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:54:20.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.102+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.102+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.102+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.106+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:54:20.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.106+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.110+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.110+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.110+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:54:20.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.114+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.118+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.118+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.122+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:54:20.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.122+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.122+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.122+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:54:20.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.122+0000 7f0b532159c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8279131266146165807', time=2024-09-12T20:54:18.141598+0000, chain.objs.size()=1 2024-09-12T18:54:20.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.122+0000 7f0b532159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.71__shadow_.RjvwTHrjqjgM9dSJLZNuOnk60SNqbOk_0 2024-09-12T18:54:20.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.126+0000 7f0b532159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:20.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.130+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:54:20.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.134+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.134+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.134+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.138+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:54:20.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.138+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.138+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.138+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:54:20.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.138+0000 7f0b532159c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.53415858963474029', time=2024-09-12T20:54:18.721737+0000, chain.objs.size()=1 2024-09-12T18:54:20.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.138+0000 7f0b532159c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.72__shadow_.22deOE1jilCFUTS5i2tvNDthWQDDVVr_0 2024-09-12T18:54:20.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.142+0000 7f0b532159c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:54:20.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.146+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:54:20.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.150+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.150+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.150+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.154+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:54:20.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.154+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.158+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.158+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.158+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:54:20.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.162+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.166+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.166+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.170+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:54:20.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.174+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.174+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.174+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.178+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:54:20.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.182+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.182+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.182+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.186+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:54:20.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.190+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.190+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.190+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.194+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:54:20.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.194+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.198+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.198+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.198+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:54:20.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.202+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.206+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.206+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.206+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:54:20.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.210+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.210+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.214+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.214+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:54:20.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.218+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.218+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.222+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.222+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:54:20.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.226+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.226+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.230+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.230+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:54:20.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.234+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.238+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.238+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.242+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:54:20.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.242+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.246+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.246+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.250+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:54:20.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.254+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.254+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.254+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.258+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:54:20.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.262+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.262+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.262+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.266+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:54:20.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.270+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.270+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.274+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.274+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:54:20.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.278+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.282+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.282+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.286+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:54:20.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.290+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.294+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.294+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.298+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:54:20.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.298+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.302+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.302+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.302+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:54:20.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.306+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.310+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.310+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.314+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:54:20.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.318+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.318+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.318+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.322+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:54:20.328 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.322+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.326+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.326+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.330+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:54:20.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.334+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.334+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.334+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.338+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:54:20.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.342+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.346+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.346+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.350+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:54:20.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.350+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.354+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.354+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.358+0000 7f0b532159c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:54:20.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.358+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.362+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.362+0000 7f0b532159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.366+0000 7f0a06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:20.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.370+0000 7f0b532159c0 20 remove_watcher() i=0 2024-09-12T18:54:20.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.370+0000 7f0b532159c0 2 removed watcher, disabling cache 2024-09-12T18:54:20.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.374+0000 7f0b532159c0 20 remove_watcher() i=1 2024-09-12T18:54:20.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.374+0000 7f0b532159c0 20 remove_watcher() i=2 2024-09-12T18:54:20.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.378+0000 7f0b532159c0 20 remove_watcher() i=3 2024-09-12T18:54:20.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.382+0000 7f0b532159c0 20 remove_watcher() i=4 2024-09-12T18:54:20.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.382+0000 7f0b532159c0 20 remove_watcher() i=5 2024-09-12T18:54:20.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.386+0000 7f0b532159c0 20 remove_watcher() i=6 2024-09-12T18:54:20.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.386+0000 7f0b532159c0 20 remove_watcher() i=7 2024-09-12T18:54:20.409 DEBUG:teuthology.orchestra.run.smithi111:> radosgw-admin gc process --include-all 2024-09-12T18:54:20.483 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:54:20.484 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:54:20.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.526+0000 7f56bc4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:20.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.530+0000 7f56bc4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:20.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.530+0000 7f56bc4cd9c0 20 realm 2024-09-12T18:54:20.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.530+0000 7f56bc4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:20.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.530+0000 7f56bc4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:20.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.530+0000 7f56bc4cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:54:20.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.530+0000 7f56bc4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:20.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.530+0000 7f56bc4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:20.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.530+0000 7f56bc4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:20.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.530+0000 7f56bc4cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:20.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.530+0000 7f56bc4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:20.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.530+0000 7f56bc4cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:54:20.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.530+0000 7f56bc4cd9c0 20 searching for the correct realm 2024-09-12T18:54:20.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.534+0000 7f56b9fd3640 0 -- 172.21.15.111:0/2578226336 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f56a8003ac0 msgr2=0x7f56b401e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:54:20.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.538+0000 7f56b9fd3640 0 -- 172.21.15.111:0/2578226336 >> [v2:172.21.15.153:6808/1571723771,v1:172.21.15.153:6809/1571723771] conn(0x561d41b06b50 msgr2=0x7f56b401e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:54:20.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:54:20.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:54:20.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:54:20.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:54:20.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:54:20.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:54:20.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:20.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:20.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:20.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:20.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:20.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:54:20.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 zone default found 2024-09-12T18:54:20.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 4 Realm: () 2024-09-12T18:54:20.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:54:20.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:54:20.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:54:20.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 zonegroup default 2024-09-12T18:54:20.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:20.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:20.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.762+0000 7f56bc4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:20.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.766+0000 7f56bc4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:20.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.766+0000 7f56bc4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:20.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.766+0000 7f56bc4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:20.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.766+0000 7f56bc4cd9c0 20 started sync module instance, tier type = 2024-09-12T18:54:20.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.766+0000 7f56bc4cd9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:54:20.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.786+0000 7f56bc4cd9c0 20 add_watcher() i=0 2024-09-12T18:54:20.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.786+0000 7f56bc4cd9c0 20 add_watcher() i=1 2024-09-12T18:54:20.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.786+0000 7f56bc4cd9c0 20 add_watcher() i=2 2024-09-12T18:54:20.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.786+0000 7f56bc4cd9c0 20 add_watcher() i=3 2024-09-12T18:54:20.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.786+0000 7f56bc4cd9c0 20 add_watcher() i=4 2024-09-12T18:54:20.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.786+0000 7f56bc4cd9c0 20 add_watcher() i=5 2024-09-12T18:54:20.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.786+0000 7f56bc4cd9c0 20 add_watcher() i=6 2024-09-12T18:54:20.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.790+0000 7f56bc4cd9c0 20 add_watcher() i=7 2024-09-12T18:54:20.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.790+0000 7f56bc4cd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:54:20.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.794+0000 7f556b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:20.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.794+0000 7f56bc4cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:54:20.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.794+0000 7f56bc4cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:54:20.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.882+0000 7f556a7fc640 20 reqs_thread_entry: start 2024-09-12T18:54:20.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.882+0000 7f56bc4cd9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:54:20.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.882+0000 7f56bc4cd9c0 20 Filter name: none 2024-09-12T18:54:20.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.882+0000 7f54dbfff640 20 reqs_thread_entry: start 2024-09-12T18:54:20.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.882+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:54:20.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.882+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.886+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.886+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.886+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:54:20.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.890+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.890+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.890+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.894+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:54:20.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.894+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.898+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.898+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.898+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:54:20.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.902+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.902+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.902+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.906+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:54:20.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.906+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.910+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.910+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.910+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:54:20.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.914+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.914+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.914+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.918+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:54:20.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.922+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.922+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.922+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.926+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:54:20.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.930+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.930+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.930+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.930+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:54:20.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.934+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.938+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.938+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.942+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:54:20.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.942+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.946+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.946+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.946+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:54:20.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.950+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.950+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.954+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.954+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:54:20.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.958+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.958+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.958+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.962+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:54:20.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.966+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.966+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.966+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.970+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:54:20.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.974+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.974+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.974+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.978+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:54:20.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.978+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.982+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.982+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.986+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:54:20.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.986+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.990+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.990+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.990+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:54:20.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.994+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:20.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.994+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:20.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.994+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.998+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:54:21.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:20.998+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.002+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.002+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.002+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:54:21.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.006+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.006+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.006+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.010+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:54:21.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.014+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.014+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.014+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.014+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:54:21.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.018+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.018+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.022+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.022+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:54:21.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.026+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.026+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.026+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.030+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:54:21.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.030+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.034+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.034+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.034+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:54:21.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.038+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.042+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.042+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.042+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:54:21.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.046+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.046+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.046+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.050+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:54:21.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.054+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.054+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.054+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.058+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:54:21.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.062+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.062+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.062+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.062+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:54:21.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.066+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.066+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.066+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.070+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:54:21.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.074+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.074+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.074+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.074+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:54:21.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.078+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.082+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.082+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.086+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:54:21.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.086+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.090+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.090+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.090+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:54:21.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.094+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.098+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.098+0000 7f56bc4cd9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.102+0000 7f556b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:21.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.106+0000 7f56bc4cd9c0 20 remove_watcher() i=0 2024-09-12T18:54:21.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.106+0000 7f56bc4cd9c0 2 removed watcher, disabling cache 2024-09-12T18:54:21.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.110+0000 7f56bc4cd9c0 20 remove_watcher() i=1 2024-09-12T18:54:21.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.114+0000 7f56bc4cd9c0 20 remove_watcher() i=2 2024-09-12T18:54:21.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.114+0000 7f56bc4cd9c0 20 remove_watcher() i=3 2024-09-12T18:54:21.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.118+0000 7f56bc4cd9c0 20 remove_watcher() i=4 2024-09-12T18:54:21.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.122+0000 7f56bc4cd9c0 20 remove_watcher() i=5 2024-09-12T18:54:21.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.122+0000 7f56bc4cd9c0 20 remove_watcher() i=6 2024-09-12T18:54:21.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.126+0000 7f56bc4cd9c0 20 remove_watcher() i=7 2024-09-12T18:54:21.149 DEBUG:teuthology.orchestra.run.smithi111:> radosgw-admin gc process --include-all 2024-09-12T18:54:21.225 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:54:21.225 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:54:21.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.266+0000 7f04f333f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:21.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.266+0000 7f04f333f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:21.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.266+0000 7f04f333f9c0 20 realm 2024-09-12T18:54:21.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.266+0000 7f04f333f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:21.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.270+0000 7f04f333f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:21.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.270+0000 7f04f333f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:54:21.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.270+0000 7f04f333f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:21.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.270+0000 7f04f333f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:21.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.270+0000 7f04f333f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:21.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.270+0000 7f04f333f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:21.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.270+0000 7f04f333f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:21.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.270+0000 7f04f333f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:54:21.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.270+0000 7f04f333f9c0 20 searching for the correct realm 2024-09-12T18:54:21.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.274+0000 7f04f1646640 0 -- 172.21.15.111:0/4046453569 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f04e411f320 msgr2=0x7f04e41230e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:54:21.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.282+0000 7f04f0644640 0 -- 172.21.15.111:0/4046453569 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f04e8072130 msgr2=0x7f04e8072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:54:21.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.498+0000 7f04f333f9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:54:21.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.498+0000 7f04f333f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:54:21.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.498+0000 7f04f333f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:54:21.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.498+0000 7f04f333f9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:54:21.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.498+0000 7f04f333f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:54:21.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.498+0000 7f04f333f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:54:21.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.498+0000 7f04f333f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:21.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.502+0000 7f04f333f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:21.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.502+0000 7f04f333f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:21.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.502+0000 7f04f333f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:21.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.502+0000 7f04f333f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:21.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.502+0000 7f04f333f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:54:21.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.502+0000 7f04f333f9c0 20 zone default found 2024-09-12T18:54:21.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.502+0000 7f04f333f9c0 4 Realm: () 2024-09-12T18:54:21.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.502+0000 7f04f333f9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:54:21.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.502+0000 7f04f333f9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:54:21.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.502+0000 7f04f333f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:54:21.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.502+0000 7f04f333f9c0 20 zonegroup default 2024-09-12T18:54:21.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.502+0000 7f04f333f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:21.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.502+0000 7f04f333f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:21.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.502+0000 7f04f333f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:21.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.506+0000 7f04f333f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:21.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.506+0000 7f04f333f9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:21.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.506+0000 7f04f333f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:21.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.506+0000 7f04f333f9c0 20 started sync module instance, tier type = 2024-09-12T18:54:21.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.506+0000 7f04f333f9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:54:21.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.526+0000 7f04f333f9c0 20 add_watcher() i=0 2024-09-12T18:54:21.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.526+0000 7f04f333f9c0 20 add_watcher() i=1 2024-09-12T18:54:21.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.526+0000 7f04f333f9c0 20 add_watcher() i=2 2024-09-12T18:54:21.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.526+0000 7f04f333f9c0 20 add_watcher() i=3 2024-09-12T18:54:21.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.526+0000 7f04f333f9c0 20 add_watcher() i=4 2024-09-12T18:54:21.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.526+0000 7f04f333f9c0 20 add_watcher() i=5 2024-09-12T18:54:21.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.526+0000 7f04f333f9c0 20 add_watcher() i=6 2024-09-12T18:54:21.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.530+0000 7f04f333f9c0 20 add_watcher() i=7 2024-09-12T18:54:21.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.530+0000 7f04f333f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:54:21.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.534+0000 7f03a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:21.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.534+0000 7f04f333f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:54:21.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.534+0000 7f04f333f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:54:21.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.622+0000 7f03a67e4640 20 reqs_thread_entry: start 2024-09-12T18:54:21.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.622+0000 7f04f333f9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:54:21.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.622+0000 7f04f333f9c0 20 Filter name: none 2024-09-12T18:54:21.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.622+0000 7f039f7fe640 20 reqs_thread_entry: start 2024-09-12T18:54:21.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.622+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:54:21.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.626+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.626+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.626+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.630+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:54:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.634+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.634+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.634+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.634+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:54:21.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.638+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.642+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.642+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.646+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:54:21.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.646+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.650+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.650+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.650+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:54:21.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.654+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.654+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.654+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.654+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:54:21.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.658+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.662+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.662+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.662+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:54:21.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.666+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.670+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.670+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.674+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:54:21.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.674+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.678+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.678+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.678+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:54:21.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.682+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.686+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.686+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.690+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:54:21.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.690+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.694+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.694+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.694+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:54:21.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.698+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.698+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.702+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.702+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:54:21.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.706+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.710+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.710+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.714+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:54:21.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.714+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.714+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.718+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.718+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:54:21.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.722+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.722+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.722+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.726+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:54:21.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.730+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.730+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.730+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.730+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:54:21.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.734+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.734+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.734+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.738+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:54:21.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.742+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.742+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.742+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.746+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:54:21.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.746+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.750+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.750+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.754+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:54:21.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.754+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.754+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.758+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.758+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:54:21.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.762+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.762+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.762+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.766+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:54:21.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.766+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.770+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.770+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.770+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:54:21.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.774+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.774+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.774+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.778+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:54:21.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.782+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.782+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.782+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.786+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:54:21.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.786+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.790+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.790+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.790+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:54:21.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.794+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.794+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.794+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.798+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:54:21.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.798+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.802+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.802+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.806+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:54:21.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.806+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.810+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.810+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.814+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:54:21.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.818+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.818+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.818+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.818+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:54:21.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.822+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.826+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.826+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.830+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:54:21.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.834+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.834+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.834+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.838+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:54:21.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.842+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.842+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.842+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.846+0000 7f04f333f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:54:21.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.850+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.850+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:21.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.850+0000 7f04f333f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:21.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.858+0000 7f03a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:21.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.862+0000 7f04f333f9c0 20 remove_watcher() i=0 2024-09-12T18:54:21.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.862+0000 7f04f333f9c0 2 removed watcher, disabling cache 2024-09-12T18:54:21.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.866+0000 7f04f333f9c0 20 remove_watcher() i=1 2024-09-12T18:54:21.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.866+0000 7f04f333f9c0 20 remove_watcher() i=2 2024-09-12T18:54:21.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.870+0000 7f04f333f9c0 20 remove_watcher() i=3 2024-09-12T18:54:21.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.874+0000 7f04f333f9c0 20 remove_watcher() i=4 2024-09-12T18:54:21.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.874+0000 7f04f333f9c0 20 remove_watcher() i=5 2024-09-12T18:54:21.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.878+0000 7f04f333f9c0 20 remove_watcher() i=6 2024-09-12T18:54:21.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:21.878+0000 7f04f333f9c0 20 remove_watcher() i=7 2024-09-12T18:54:21.902 DEBUG:teuthology.orchestra.run.smithi111:> radosgw-admin gc process --include-all 2024-09-12T18:54:21.976 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:54:21.976 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:54:22.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.018+0000 7f55d31be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:22.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.018+0000 7f55d31be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:22.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.018+0000 7f55d31be9c0 20 realm 2024-09-12T18:54:22.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.018+0000 7f55d31be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:22.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.018+0000 7f55d31be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:22.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.018+0000 7f55d31be9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:54:22.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.018+0000 7f55d31be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:22.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.018+0000 7f55d31be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:22.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.018+0000 7f55d31be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:22.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.022+0000 7f55d31be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:22.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.022+0000 7f55d31be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:22.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.022+0000 7f55d31be9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:54:22.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.022+0000 7f55d31be9c0 20 searching for the correct realm 2024-09-12T18:54:22.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.026+0000 7f55d0cc4640 0 -- 172.21.15.111:0/2865870354 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f55c802a070 msgr2=0x7f55c802a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:54:22.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.034+0000 7f55d04c3640 0 -- 172.21.15.111:0/2865870354 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f55c802b910 msgr2=0x7f55c8038400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:54:22.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.250+0000 7f55d31be9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:54:22.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.250+0000 7f55d31be9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:54:22.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.250+0000 7f55d31be9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:54:22.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.250+0000 7f55d31be9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:54:22.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.250+0000 7f55d31be9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:54:22.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.250+0000 7f55d31be9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:54:22.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.250+0000 7f55d31be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:22.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.254+0000 7f55d31be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:22.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.254+0000 7f55d31be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:22.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.254+0000 7f55d31be9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:54:22.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.254+0000 7f55d31be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:22.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.254+0000 7f55d31be9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:54:22.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.254+0000 7f55d31be9c0 20 zone default found 2024-09-12T18:54:22.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.254+0000 7f55d31be9c0 4 Realm: () 2024-09-12T18:54:22.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.254+0000 7f55d31be9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:54:22.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.254+0000 7f55d31be9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:54:22.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.254+0000 7f55d31be9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:54:22.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.254+0000 7f55d31be9c0 20 zonegroup default 2024-09-12T18:54:22.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.254+0000 7f55d31be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:22.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.254+0000 7f55d31be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:22.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.254+0000 7f55d31be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:22.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.258+0000 7f55d31be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:22.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.258+0000 7f55d31be9c0 20 rados->read ofs=0 len=0 2024-09-12T18:54:22.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.258+0000 7f55d31be9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:54:22.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.258+0000 7f55d31be9c0 20 started sync module instance, tier type = 2024-09-12T18:54:22.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.258+0000 7f55d31be9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:54:22.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.282+0000 7f55d31be9c0 20 add_watcher() i=0 2024-09-12T18:54:22.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.282+0000 7f55d31be9c0 20 add_watcher() i=1 2024-09-12T18:54:22.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.282+0000 7f55d31be9c0 20 add_watcher() i=2 2024-09-12T18:54:22.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.282+0000 7f55d31be9c0 20 add_watcher() i=3 2024-09-12T18:54:22.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.282+0000 7f55d31be9c0 20 add_watcher() i=4 2024-09-12T18:54:22.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.282+0000 7f55d31be9c0 20 add_watcher() i=5 2024-09-12T18:54:22.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.282+0000 7f55d31be9c0 20 add_watcher() i=6 2024-09-12T18:54:22.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.282+0000 7f55d31be9c0 20 add_watcher() i=7 2024-09-12T18:54:22.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.282+0000 7f55d31be9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:54:22.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.286+0000 7f5486fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:22.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.290+0000 7f55d31be9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:54:22.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.290+0000 7f55d31be9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:54:22.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.382+0000 7f5485fe3640 20 reqs_thread_entry: start 2024-09-12T18:54:22.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.382+0000 7f55d31be9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:54:22.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.382+0000 7f55d31be9c0 20 Filter name: none 2024-09-12T18:54:22.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.382+0000 7f53f77fe640 20 reqs_thread_entry: start 2024-09-12T18:54:22.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.382+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:54:22.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.386+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.386+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.386+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.386+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:54:22.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.390+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.394+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.394+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.394+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:54:22.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.398+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.398+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.398+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.402+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:54:22.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.406+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.406+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.406+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.410+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:54:22.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.414+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.414+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.418+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.418+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:54:22.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.422+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.422+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.422+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.426+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:54:22.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.430+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.430+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.430+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.430+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:54:22.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.434+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.434+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.434+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.434+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:54:22.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.438+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.442+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.442+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.442+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:54:22.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.446+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.446+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.446+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.450+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:54:22.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.450+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.450+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.454+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.454+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:54:22.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.458+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.458+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.458+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.462+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:54:22.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.466+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.466+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.466+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.470+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:54:22.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.474+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.474+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.474+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.478+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:54:22.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.482+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.482+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.482+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.486+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:54:22.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.490+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.490+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.490+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.494+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:54:22.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.498+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.498+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.502+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.502+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:54:22.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.506+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.506+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.510+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.510+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:54:22.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.514+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.518+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.518+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.518+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:54:22.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.522+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.526+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.526+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.526+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:54:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.530+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.534+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.534+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.538+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:54:22.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.542+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.542+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.542+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.546+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:54:22.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.546+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.550+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.550+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.550+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:54:22.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.554+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.558+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.558+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.562+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:54:22.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.562+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.566+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.566+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.570+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:54:22.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.574+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.574+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.574+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.578+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:54:22.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.582+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.586+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.586+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.586+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:54:22.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.590+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.594+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.594+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.598+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:54:22.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.602+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.602+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.602+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.606+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:54:22.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.610+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.610+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.614+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.614+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:54:22.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.618+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.618+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.618+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.622+0000 7f55d31be9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:54:22.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.626+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.630+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:54:22.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.630+0000 7f55d31be9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:54:22.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.634+0000 7f5486fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:54:22.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.638+0000 7f55d31be9c0 20 remove_watcher() i=0 2024-09-12T18:54:22.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.638+0000 7f55d31be9c0 2 removed watcher, disabling cache 2024-09-12T18:54:22.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.642+0000 7f55d31be9c0 20 remove_watcher() i=1 2024-09-12T18:54:22.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.642+0000 7f55d31be9c0 20 remove_watcher() i=2 2024-09-12T18:54:22.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.646+0000 7f55d31be9c0 20 remove_watcher() i=3 2024-09-12T18:54:22.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.646+0000 7f55d31be9c0 20 remove_watcher() i=4 2024-09-12T18:54:22.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.650+0000 7f55d31be9c0 20 remove_watcher() i=5 2024-09-12T18:54:22.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.654+0000 7f55d31be9c0 20 remove_watcher() i=6 2024-09-12T18:54:22.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:54:22.654+0000 7f55d31be9c0 20 remove_watcher() i=7 2024-09-12T18:54:22.686 DEBUG:teuthology.orchestra.run.smithi111:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T18:54:23.416 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :clean 2024-09-12T18:54:24.114 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :compileJava 2024-09-12T18:54:24.114 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :processResources 2024-09-12T18:54:24.114 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :classes 2024-09-12T18:54:24.614 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:24.614 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :compileTestJava 2024-09-12T18:54:24.615 INFO:teuthology.orchestra.run.smithi111.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T18:54:24.615 INFO:teuthology.orchestra.run.smithi111.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T18:54:24.615 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:24.616 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T18:54:24.616 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :testClasses 2024-09-12T18:54:26.614 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:26.614 INFO:teuthology.orchestra.run.smithi111.stdout:> Task :test 2024-09-12T18:54:26.614 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:26.614 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests STANDARD_OUT 2024-09-12T18:54:26.615 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12 18:54:25,945 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T18:54:26.616 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:26.616 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T18:54:26.616 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:26.616 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T18:54:26.914 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:26.914 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T18:54:26.914 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:26.914 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T18:54:27.214 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:27.214 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T18:54:27.214 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:27.214 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T18:54:27.513 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:27.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T18:54:28.513 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:28.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T18:54:28.814 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:28.814 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T18:54:28.814 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:28.814 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T18:54:29.113 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:29.114 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T18:54:29.313 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:29.314 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T18:54:29.614 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:29.614 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T18:54:29.614 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:29.614 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T18:54:29.714 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:29.714 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T18:54:29.714 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:29.714 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T18:54:30.013 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:30.013 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T18:54:30.413 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:30.414 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T18:54:30.714 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:30.714 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T18:54:30.814 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:30.814 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T18:54:31.113 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:31.114 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T18:54:31.213 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:31.213 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T18:54:31.514 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:31.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T18:54:31.514 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:31.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T18:54:31.813 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:31.813 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T18:54:31.913 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:31.914 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T18:54:32.113 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:32.113 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T18:54:32.214 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:32.214 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T18:54:32.514 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:32.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T18:54:32.515 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:32.515 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T18:54:32.813 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:32.814 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T18:54:32.914 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:32.914 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T18:54:33.213 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:33.213 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T18:54:34.013 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:34.014 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T18:54:34.513 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:34.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T18:54:40.514 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:40.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T18:54:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:41.014 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T18:54:41.014 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:41.014 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T18:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:41.213 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T18:54:41.313 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:41.314 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T18:54:41.713 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:41.714 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T18:54:42.213 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:42.214 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T18:54:42.513 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:42.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T18:54:42.514 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:42.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T18:54:42.613 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:42.614 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T18:54:43.513 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:43.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T18:54:43.713 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:43.714 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T18:54:44.514 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:44.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T18:54:44.813 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:44.814 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T18:54:45.613 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:45.614 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T18:54:45.913 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:45.914 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T18:54:51.614 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:51.614 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T18:54:51.914 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:51.914 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T18:54:54.113 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:54.114 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T18:54:54.414 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:54.414 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T18:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:55.214 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T18:54:55.514 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:55.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T18:54:56.013 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:56.013 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T18:54:56.414 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:56.414 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T18:54:56.414 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:56.414 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T18:54:56.514 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:56.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T18:54:56.514 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:56.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T18:54:56.813 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:56.814 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T18:54:56.913 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:56.914 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T18:54:57.114 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:57.114 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T18:54:57.213 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:57.214 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T18:54:57.413 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:57.414 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T18:54:57.513 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:57.513 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T18:54:57.813 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:57.814 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T18:54:57.913 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:57.914 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T18:54:58.113 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:58.114 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T18:54:58.213 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:58.214 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T18:54:58.513 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:58.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T18:54:58.613 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:58.614 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T18:54:58.913 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:58.914 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T18:54:59.013 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:59.014 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T18:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:59.414 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T18:54:59.513 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:59.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T18:54:59.813 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:59.814 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T18:54:59.913 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:54:59.913 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T18:55:00.313 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:00.314 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T18:55:00.414 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:00.414 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T18:55:00.713 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:00.713 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T18:55:00.813 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:00.813 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T18:55:01.213 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:01.213 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T18:55:01.313 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:01.313 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T18:55:01.613 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:01.614 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T18:55:01.713 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:01.713 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T18:55:02.013 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:02.013 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T18:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:02.113 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T18:55:02.513 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:02.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T18:55:02.613 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:02.613 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T18:55:02.913 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:02.913 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T18:55:03.013 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:03.013 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T18:55:03.314 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:03.314 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T18:55:03.513 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:03.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T18:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:03.814 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T18:55:03.913 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:03.914 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T18:55:04.213 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:04.214 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T18:55:04.313 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:04.313 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T18:55:04.613 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:04.654 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T18:55:04.814 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:04.814 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T18:55:05.113 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:05.114 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T18:55:05.213 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:05.214 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T18:55:05.513 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:05.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T18:55:05.713 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:05.713 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T18:55:06.013 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:06.014 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T18:55:06.113 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:06.114 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T18:55:06.413 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:06.414 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T18:55:06.613 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:06.613 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T18:55:06.913 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:06.913 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T18:55:07.013 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:07.014 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T18:55:07.313 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:07.313 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T18:55:07.413 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:07.413 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T18:55:07.713 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:07.714 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T18:55:07.813 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:07.813 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T18:55:08.113 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:08.114 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T18:55:08.213 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:08.214 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T18:55:08.413 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:08.414 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T18:55:08.514 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:08.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T18:55:08.814 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:08.814 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T18:55:08.814 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:08.814 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T18:55:09.113 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:09.113 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T18:55:09.214 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:09.214 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T18:55:09.413 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:09.414 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T18:55:09.613 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:09.613 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T18:55:09.913 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:09.914 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T18:55:10.013 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:10.014 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T18:55:10.113 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:10.113 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T18:55:10.214 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:10.214 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T18:55:10.413 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:10.413 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T18:55:10.513 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:10.513 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T18:55:10.813 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:10.813 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T18:55:10.913 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:10.913 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T18:55:11.113 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:11.114 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T18:55:11.213 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:11.214 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T18:55:11.513 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:11.514 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T18:55:11.914 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:11.914 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T18:55:12.214 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:12.214 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T18:55:12.613 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:12.614 INFO:teuthology.orchestra.run.smithi111.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T18:55:12.913 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:12.913 INFO:teuthology.orchestra.run.smithi111.stdout:---------------------------------------------------------------------- 2024-09-12T18:55:12.914 INFO:teuthology.orchestra.run.smithi111.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T18:55:12.914 INFO:teuthology.orchestra.run.smithi111.stdout:---------------------------------------------------------------------- 2024-09-12T18:55:12.917 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:12.917 INFO:teuthology.orchestra.run.smithi111.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T18:55:12.917 INFO:teuthology.orchestra.run.smithi111.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T18:55:12.917 INFO:teuthology.orchestra.run.smithi111.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T18:55:12.917 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:12.917 INFO:teuthology.orchestra.run.smithi111.stdout:BUILD SUCCESSFUL in 50s 2024-09-12T18:55:12.917 INFO:teuthology.orchestra.run.smithi111.stdout:5 actionable tasks: 5 executed 2024-09-12T18:55:12.935 DEBUG:teuthology.orchestra.run.smithi111:> radosgw-admin gc process --include-all 2024-09-12T18:55:12.961 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:12.961 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:13.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:12.996+0000 7ff2a6a659c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:13.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.000+0000 7ff2a6a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:13.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.000+0000 7ff2a6a659c0 20 realm 2024-09-12T18:55:13.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.000+0000 7ff2a6a659c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:13.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.000+0000 7ff2a6a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:13.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.000+0000 7ff2a6a659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:13.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.000+0000 7ff2a6a659c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:13.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.000+0000 7ff2a6a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:13.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.000+0000 7ff2a6a659c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:13.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.000+0000 7ff2a6a659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:13.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.000+0000 7ff2a6a659c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:13.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.000+0000 7ff2a6a659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:13.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.000+0000 7ff2a6a659c0 20 searching for the correct realm 2024-09-12T18:55:13.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.004+0000 7ff2a4d6c640 0 -- 172.21.15.111:0/1066627494 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7ff2980bf030 msgr2=0x7ff2980f63b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:55:13.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.012+0000 7ff2a3d6a640 0 -- 172.21.15.111:0/1066627494 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7ff29c0691a0 msgr2=0x7ff29c0898b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:55:13.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.228+0000 7ff2a6a659c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:13.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.228+0000 7ff2a6a659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:13.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.228+0000 7ff2a6a659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:13.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.228+0000 7ff2a6a659c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:13.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.228+0000 7ff2a6a659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:13.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.228+0000 7ff2a6a659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:13.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.228+0000 7ff2a6a659c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:13.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.228+0000 7ff2a6a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:13.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.228+0000 7ff2a6a659c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:13.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:13.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:13.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:13.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 20 zone default found 2024-09-12T18:55:13.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 4 Realm: () 2024-09-12T18:55:13.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:13.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:13.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:13.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 20 zonegroup default 2024-09-12T18:55:13.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:13.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:13.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:13.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:13.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:13.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:13.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 20 started sync module instance, tier type = 2024-09-12T18:55:13.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.232+0000 7ff2a6a659c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:13.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.256+0000 7ff2a6a659c0 20 add_watcher() i=0 2024-09-12T18:55:13.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.256+0000 7ff2a6a659c0 20 add_watcher() i=1 2024-09-12T18:55:13.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.256+0000 7ff2a6a659c0 20 add_watcher() i=2 2024-09-12T18:55:13.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.256+0000 7ff2a6a659c0 20 add_watcher() i=3 2024-09-12T18:55:13.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.256+0000 7ff2a6a659c0 20 add_watcher() i=4 2024-09-12T18:55:13.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.256+0000 7ff2a6a659c0 20 add_watcher() i=5 2024-09-12T18:55:13.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.256+0000 7ff2a6a659c0 20 add_watcher() i=6 2024-09-12T18:55:13.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.260+0000 7ff2a6a659c0 20 add_watcher() i=7 2024-09-12T18:55:13.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.260+0000 7ff2a6a659c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:13.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.264+0000 7ff15a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:13.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.264+0000 7ff2a6a659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:13.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.264+0000 7ff2a6a659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:13.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.356+0000 7ff1597e2640 20 reqs_thread_entry: start 2024-09-12T18:55:13.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.360+0000 7ff2a6a659c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:13.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.360+0000 7ff2a6a659c0 20 Filter name: none 2024-09-12T18:55:13.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.360+0000 7ff0caffd640 20 reqs_thread_entry: start 2024-09-12T18:55:13.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.360+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:55:13.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.364+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.364+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.364+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:55:13.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.364+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10861631305159440232', time=2024-09-12T20:55:03.539695+0000, chain.objs.size()=1 2024-09-12T18:55:13.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.364+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.123__shadow_.giu4WMWJJrjuztSubjNY0ISN27dwSvS_0 2024-09-12T18:55:13.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.364+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17989710753071381988', time=2024-09-12T20:55:07.434844+0000, chain.objs.size()=1 2024-09-12T18:55:13.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.364+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.132__shadow_.sX1Azthl3kp6iG6WW1dcj8zFi89Ip96_0 2024-09-12T18:55:13.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.368+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.376+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:55:13.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.376+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:55:13.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1018710234484604449', time=2024-09-12T20:54:47.295551+0000, chain.objs.size()=9 2024-09-12T18:55:13.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~L7_168-GMIhBxtdyruAzq5hDWDtxMw2.1 2024-09-12T18:55:13.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~L7_168-GMIhBxtdyruAzq5hDWDtxMw2.1_1 2024-09-12T18:55:13.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~L7_168-GMIhBxtdyruAzq5hDWDtxMw2.2 2024-09-12T18:55:13.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~L7_168-GMIhBxtdyruAzq5hDWDtxMw2.2_1 2024-09-12T18:55:13.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~L7_168-GMIhBxtdyruAzq5hDWDtxMw2.3 2024-09-12T18:55:13.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~L7_168-GMIhBxtdyruAzq5hDWDtxMw2.3_1 2024-09-12T18:55:13.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~L7_168-GMIhBxtdyruAzq5hDWDtxMw2.4 2024-09-12T18:55:13.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~L7_168-GMIhBxtdyruAzq5hDWDtxMw2.4_1 2024-09-12T18:55:13.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~L7_168-GMIhBxtdyruAzq5hDWDtxMw2.5 2024-09-12T18:55:13.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15744956985941494805', time=2024-09-12T20:54:59.577544+0000, chain.objs.size()=1 2024-09-12T18:55:13.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.114__shadow_.lHOe_wNxKu8tfVB6IXQ1bBwwL5DFU4Y_0 2024-09-12T18:55:13.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7520161256565336153', time=2024-09-12T20:55:05.290795+0000, chain.objs.size()=1 2024-09-12T18:55:13.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.127__shadow_.z6-JQ_cTNd7tDLpEUnJRZqgAQzfLk3S_0 2024-09-12T18:55:13.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7978740380242451707', time=2024-09-12T20:55:08.893777+0000, chain.objs.size()=1 2024-09-12T18:55:13.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.380+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.136__shadow_.TSqHGsbuxgWCv9KH9-l1tuXKWexGjZf_0 2024-09-12T18:55:13.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.432+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.444+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:55:13.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:55:13.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FgWDxWKl6Y8CIjb9cDL9myXEBWRfSVE', time=2024-09-12T20:54:28.427679+0000, chain.objs.size()=9 2024-09-12T18:55:13.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.79__multipart_key1.2~FgWDxWKl6Y8CIjb9cDL9myXEBWRfSVE.1 2024-09-12T18:55:13.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.79__shadow_key1.2~FgWDxWKl6Y8CIjb9cDL9myXEBWRfSVE.1_1 2024-09-12T18:55:13.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.79__multipart_key1.2~FgWDxWKl6Y8CIjb9cDL9myXEBWRfSVE.2 2024-09-12T18:55:13.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.79__shadow_key1.2~FgWDxWKl6Y8CIjb9cDL9myXEBWRfSVE.2_1 2024-09-12T18:55:13.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.79__multipart_key1.2~FgWDxWKl6Y8CIjb9cDL9myXEBWRfSVE.3 2024-09-12T18:55:13.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.79__shadow_key1.2~FgWDxWKl6Y8CIjb9cDL9myXEBWRfSVE.3_1 2024-09-12T18:55:13.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.79__multipart_key1.2~FgWDxWKl6Y8CIjb9cDL9myXEBWRfSVE.4 2024-09-12T18:55:13.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.79__shadow_key1.2~FgWDxWKl6Y8CIjb9cDL9myXEBWRfSVE.4_1 2024-09-12T18:55:13.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.79__multipart_key1.2~FgWDxWKl6Y8CIjb9cDL9myXEBWRfSVE.5 2024-09-12T18:55:13.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4718026897208330535', time=2024-09-12T20:54:53.515229+0000, chain.objs.size()=1 2024-09-12T18:55:13.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.103__shadow_.mNXFZmY929_jHA_cPAnE8Dzq8L3bKjT_0 2024-09-12T18:55:13.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4840628670895318026', time=2024-09-12T20:55:00.030556+0000, chain.objs.size()=1 2024-09-12T18:55:13.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.115__shadow_.a5Ny4bjhxVYuzsKnFLAhCaR89lbg2Fb_0 2024-09-12T18:55:13.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5064898020924578389', time=2024-09-12T20:55:06.199862+0000, chain.objs.size()=1 2024-09-12T18:55:13.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.448+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.129__shadow_.iT21fKuYKZvtKNZhwaBLvU09WK86_kD_0 2024-09-12T18:55:13.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.452+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15154735006442201771', time=2024-09-12T20:55:06.214057+0000, chain.objs.size()=1 2024-09-12T18:55:13.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.452+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.129__shadow_.L9SNqr40AmuGNcf1C7qUkDpmwugawmm_0 2024-09-12T18:55:13.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.452+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16034376176065152009', time=2024-09-12T20:55:09.501120+0000, chain.objs.size()=1 2024-09-12T18:55:13.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.452+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.138__shadow_.KxPlWLWKNQQcQZwjAqgXw61z8sfPNYP_0 2024-09-12T18:55:13.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.456+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.460+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:55:13.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.464+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.464+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:55:13.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3701862243188349496', time=2024-09-12T20:54:40.547081+0000, chain.objs.size()=7 2024-09-12T18:55:13.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~vOCK0ibgfnon3Uo1SFO445u4C-Prt9k.1 2024-09-12T18:55:13.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~vOCK0ibgfnon3Uo1SFO445u4C-Prt9k.1_1 2024-09-12T18:55:13.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~vOCK0ibgfnon3Uo1SFO445u4C-Prt9k.1_2 2024-09-12T18:55:13.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~vOCK0ibgfnon3Uo1SFO445u4C-Prt9k.2 2024-09-12T18:55:13.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~vOCK0ibgfnon3Uo1SFO445u4C-Prt9k.2_1 2024-09-12T18:55:13.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~vOCK0ibgfnon3Uo1SFO445u4C-Prt9k.2_2 2024-09-12T18:55:13.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~vOCK0ibgfnon3Uo1SFO445u4C-Prt9k.3 2024-09-12T18:55:13.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8990273090535054537', time=2024-09-12T20:54:44.540981+0000, chain.objs.size()=9 2024-09-12T18:55:13.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__multipart_file.mpg.2~Yd2AZAh1qVLnk3LXKSNdIiDE86nOX5f.1 2024-09-12T18:55:13.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__shadow_file.mpg.2~Yd2AZAh1qVLnk3LXKSNdIiDE86nOX5f.1_1 2024-09-12T18:55:13.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__multipart_file.mpg.2~Yd2AZAh1qVLnk3LXKSNdIiDE86nOX5f.2 2024-09-12T18:55:13.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__shadow_file.mpg.2~Yd2AZAh1qVLnk3LXKSNdIiDE86nOX5f.2_1 2024-09-12T18:55:13.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.468+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__multipart_file.mpg.2~Yd2AZAh1qVLnk3LXKSNdIiDE86nOX5f.3 2024-09-12T18:55:13.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.472+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__shadow_file.mpg.2~Yd2AZAh1qVLnk3LXKSNdIiDE86nOX5f.3_1 2024-09-12T18:55:13.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.476+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__multipart_file.mpg.2~Yd2AZAh1qVLnk3LXKSNdIiDE86nOX5f.4 2024-09-12T18:55:13.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.476+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__shadow_file.mpg.2~Yd2AZAh1qVLnk3LXKSNdIiDE86nOX5f.4_1 2024-09-12T18:55:13.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.476+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__multipart_file.mpg.2~Yd2AZAh1qVLnk3LXKSNdIiDE86nOX5f.5 2024-09-12T18:55:13.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.476+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15546145710466480985', time=2024-09-12T20:54:44.554013+0000, chain.objs.size()=1 2024-09-12T18:55:13.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.476+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__shadow_.lmQw4wvNb4X9JtMbw2mEJ9De13d_ZKR_0 2024-09-12T18:55:13.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.476+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11196804521457391574', time=2024-09-12T20:55:03.972070+0000, chain.objs.size()=1 2024-09-12T18:55:13.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.476+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.124__shadow_.Ma8E2sVNk_yuSzbufrvvSTPLoZExPXm_0 2024-09-12T18:55:13.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.476+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16185944359289162920', time=2024-09-12T20:55:05.303572+0000, chain.objs.size()=1 2024-09-12T18:55:13.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.476+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.127__shadow_.pwSR37t0M_gI_oX5ubJitSfSxmrIGKT_0 2024-09-12T18:55:13.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.484+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.488+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:55:13.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.492+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T18:55:13.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14912323353539842006', time=2024-09-12T20:54:40.377809+0000, chain.objs.size()=7 2024-09-12T18:55:13.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~UTmTo-VUEIJRq0pKxo3KiRkIRVPuEHI.1 2024-09-12T18:55:13.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~UTmTo-VUEIJRq0pKxo3KiRkIRVPuEHI.1_1 2024-09-12T18:55:13.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~UTmTo-VUEIJRq0pKxo3KiRkIRVPuEHI.1_2 2024-09-12T18:55:13.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~UTmTo-VUEIJRq0pKxo3KiRkIRVPuEHI.2 2024-09-12T18:55:13.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~UTmTo-VUEIJRq0pKxo3KiRkIRVPuEHI.2_1 2024-09-12T18:55:13.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~UTmTo-VUEIJRq0pKxo3KiRkIRVPuEHI.2_2 2024-09-12T18:55:13.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~UTmTo-VUEIJRq0pKxo3KiRkIRVPuEHI.3 2024-09-12T18:55:13.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7677016540807459671', time=2024-09-12T20:54:48.066809+0000, chain.objs.size()=9 2024-09-12T18:55:13.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~LA8vX4jgoIKKoVJ-OcggYlAmgYTTnyj.1 2024-09-12T18:55:13.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~LA8vX4jgoIKKoVJ-OcggYlAmgYTTnyj.1_1 2024-09-12T18:55:13.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~LA8vX4jgoIKKoVJ-OcggYlAmgYTTnyj.2 2024-09-12T18:55:13.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~LA8vX4jgoIKKoVJ-OcggYlAmgYTTnyj.2_1 2024-09-12T18:55:13.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.500+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~LA8vX4jgoIKKoVJ-OcggYlAmgYTTnyj.3 2024-09-12T18:55:13.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~LA8vX4jgoIKKoVJ-OcggYlAmgYTTnyj.3_1 2024-09-12T18:55:13.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~LA8vX4jgoIKKoVJ-OcggYlAmgYTTnyj.4 2024-09-12T18:55:13.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~LA8vX4jgoIKKoVJ-OcggYlAmgYTTnyj.4_1 2024-09-12T18:55:13.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~LA8vX4jgoIKKoVJ-OcggYlAmgYTTnyj.5 2024-09-12T18:55:13.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7904696636956411232', time=2024-09-12T20:54:58.699103+0000, chain.objs.size()=1 2024-09-12T18:55:13.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.112__shadow_.2kO8wpujxtVn-8Y5am5puNpI0dyT4rq_0 2024-09-12T18:55:13.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1720306535324344431', time=2024-09-12T20:54:59.564140+0000, chain.objs.size()=1 2024-09-12T18:55:13.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.114__shadow_.pscNovF9f7UoUxfvnPSgWHjRFS5pCPm_0 2024-09-12T18:55:13.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3549801852860477373', time=2024-09-12T20:55:00.045147+0000, chain.objs.size()=1 2024-09-12T18:55:13.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.115__shadow_.Pi3m_ht6vj94DzS7Ucbve17p6hrpWQd_0 2024-09-12T18:55:13.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3434681927802186584', time=2024-09-12T20:55:00.895118+0000, chain.objs.size()=1 2024-09-12T18:55:13.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.117__shadow_.0bC1pHEBku_plGijb-1n6S4I1fmD6hW_0 2024-09-12T18:55:13.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8500011574842830249', time=2024-09-12T20:55:01.807961+0000, chain.objs.size()=1 2024-09-12T18:55:13.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.119__shadow_.beoS8FYX8OhBp57LH2ORMb5vHV-4KTr_0 2024-09-12T18:55:13.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3883485002346508846', time=2024-09-12T20:55:02.669456+0000, chain.objs.size()=1 2024-09-12T18:55:13.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.504+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.121__shadow_.0W2JrUbmD7VY-AzDLmUfNw9XNdK7Y7B_0 2024-09-12T18:55:13.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.508+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14220612093923386425', time=2024-09-12T20:55:04.382265+0000, chain.objs.size()=1 2024-09-12T18:55:13.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.508+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.125__shadow_.LbJO63tTe5ffaM8bmBbGBZeesWazKKf_0 2024-09-12T18:55:13.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.508+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3159242186085752047', time=2024-09-12T20:55:06.618000+0000, chain.objs.size()=1 2024-09-12T18:55:13.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.508+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.130__shadow_.4dayljtMFBu00UO8GJWE2nlcIQQvixv_0 2024-09-12T18:55:13.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.512+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.520+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:55:13.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.520+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.524+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.524+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:55:13.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.524+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7288317290182793588', time=2024-09-12T20:55:00.062880+0000, chain.objs.size()=1 2024-09-12T18:55:13.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.524+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.115__shadow_.qubUQYZtQI4MQoCucVYOOFpubwXxowJ_0 2024-09-12T18:55:13.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.524+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15233013983549386893', time=2024-09-12T20:55:00.490892+0000, chain.objs.size()=1 2024-09-12T18:55:13.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.524+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.116__shadow_.mXIQDgZ3EIiQSz_0c1tNvfnExM8BfFe_0 2024-09-12T18:55:13.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.524+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14765840685466386980', time=2024-09-12T20:55:00.934220+0000, chain.objs.size()=1 2024-09-12T18:55:13.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.524+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.117__shadow_.FiBR04RogRd27uxhls4h1w5mL6lLzZ4_0 2024-09-12T18:55:13.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.524+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.771151025143584823', time=2024-09-12T20:55:03.138163+0000, chain.objs.size()=1 2024-09-12T18:55:13.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.524+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.122__shadow_.mfLP2xgP2uULLUa-blPd2R4Pb4jfwNx_0 2024-09-12T18:55:13.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.524+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15118871274277300072', time=2024-09-12T20:55:04.866613+0000, chain.objs.size()=1 2024-09-12T18:55:13.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.524+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.126__shadow_.DYKhzJZV1Uz5fSs0wOUImVQkuMMSvF8_0 2024-09-12T18:55:13.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.528+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.532+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:55:13.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.536+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.540+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.540+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:55:13.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.540+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.344827575170058130', time=2024-09-12T20:54:30.492293+0000, chain.objs.size()=3 2024-09-12T18:55:13.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.540+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.83__shadow_.MPLuOsDUpTK01hwExiZUjd_G5goRJ3X_0 2024-09-12T18:55:13.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.540+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.83__shadow_.MPLuOsDUpTK01hwExiZUjd_G5goRJ3X_1 2024-09-12T18:55:13.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.540+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.83__shadow_.MPLuOsDUpTK01hwExiZUjd_G5goRJ3X_2 2024-09-12T18:55:13.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.540+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12866237681587232161', time=2024-09-12T20:54:58.671970+0000, chain.objs.size()=1 2024-09-12T18:55:13.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.540+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.112__shadow_.Q3OEh3mK1RdEGOSAJ9ObN6-RQ2EpZOY_0 2024-09-12T18:55:13.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.540+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11227556985646288206', time=2024-09-12T20:55:00.463915+0000, chain.objs.size()=1 2024-09-12T18:55:13.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.540+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.116__shadow_.qis1IQWLkH075v_3eDv2fYNL6CgROWf_0 2024-09-12T18:55:13.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.540+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.792782586752937103', time=2024-09-12T20:55:01.786749+0000, chain.objs.size()=1 2024-09-12T18:55:13.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.540+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.119__shadow_.PnRig0Hqui6kMEkqdhmq76odG5Y4tUt_0 2024-09-12T18:55:13.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.540+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13350305449487542713', time=2024-09-12T20:55:03.553181+0000, chain.objs.size()=1 2024-09-12T18:55:13.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.540+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.123__shadow_.9agHttu2d72gkI4vRpGQE85z2WAAw_W_0 2024-09-12T18:55:13.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.548+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.552+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:55:13.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.556+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.560+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.560+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:55:13.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.560+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6089659739886070330', time=2024-09-12T20:55:02.210118+0000, chain.objs.size()=1 2024-09-12T18:55:13.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.560+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.120__shadow_.7JEmfquutMp--QAXMSaXE5QRCU-yAli_0 2024-09-12T18:55:13.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.560+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.568+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:55:13.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.572+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.572+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T18:55:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15349943454766989455', time=2024-09-12T20:54:54.187103+0000, chain.objs.size()=9 2024-09-12T18:55:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.103__multipart_key1.2~qqbu4nMWWBvbOia6aZ0ZcN73fBJPGwT.1 2024-09-12T18:55:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.103__shadow_key1.2~qqbu4nMWWBvbOia6aZ0ZcN73fBJPGwT.1_1 2024-09-12T18:55:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.103__multipart_key1.2~qqbu4nMWWBvbOia6aZ0ZcN73fBJPGwT.2 2024-09-12T18:55:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.103__shadow_key1.2~qqbu4nMWWBvbOia6aZ0ZcN73fBJPGwT.2_1 2024-09-12T18:55:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.103__multipart_key1.2~qqbu4nMWWBvbOia6aZ0ZcN73fBJPGwT.3 2024-09-12T18:55:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.103__shadow_key1.2~qqbu4nMWWBvbOia6aZ0ZcN73fBJPGwT.3_1 2024-09-12T18:55:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.103__multipart_key1.2~qqbu4nMWWBvbOia6aZ0ZcN73fBJPGwT.4 2024-09-12T18:55:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.103__shadow_key1.2~qqbu4nMWWBvbOia6aZ0ZcN73fBJPGwT.4_1 2024-09-12T18:55:13.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.103__multipart_key1.2~qqbu4nMWWBvbOia6aZ0ZcN73fBJPGwT.5 2024-09-12T18:55:13.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10797810334050442915', time=2024-09-12T20:54:58.658461+0000, chain.objs.size()=1 2024-09-12T18:55:13.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.112__shadow_.p51_4XCZf5YgQLyERWS7yatfM0q5UVX_0 2024-09-12T18:55:13.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15843065136117730283', time=2024-09-12T20:54:59.126616+0000, chain.objs.size()=1 2024-09-12T18:55:13.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.113__shadow_.1cjNKCkLB4MYM1faGo0m-FBdTBpPQgX_0 2024-09-12T18:55:13.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14180894545492814215', time=2024-09-12T20:54:59.590709+0000, chain.objs.size()=1 2024-09-12T18:55:13.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.576+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.114__shadow_.aBk_ghNtSfkAgP1du_LD9NFJCon06vQ_0 2024-09-12T18:55:13.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.580+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13997641522103161344', time=2024-09-12T20:55:03.124267+0000, chain.objs.size()=1 2024-09-12T18:55:13.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.580+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.122__shadow_.7yX1RETrtD-wn7XwXzr1-0cejKwWAoC_0 2024-09-12T18:55:13.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.580+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4631535751665842506', time=2024-09-12T20:55:03.946701+0000, chain.objs.size()=1 2024-09-12T18:55:13.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.580+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.124__shadow_.dpwdtrGMxtr_9OYbyg78YHqd1xAT5uz_0 2024-09-12T18:55:13.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.580+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5538074091731707201', time=2024-09-12T20:55:04.852549+0000, chain.objs.size()=1 2024-09-12T18:55:13.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.580+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.126__shadow_.DBrOJjGGRmP93RpW6e4C_yVpycjkG-4_0 2024-09-12T18:55:13.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.580+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17110710620923687674', time=2024-09-12T20:55:04.882298+0000, chain.objs.size()=1 2024-09-12T18:55:13.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.580+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.126__shadow_.Re6EPInJtWxFH7qLrvcmi2F73bUjgiA_0 2024-09-12T18:55:13.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.580+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6084775941600565188', time=2024-09-12T20:55:05.750234+0000, chain.objs.size()=1 2024-09-12T18:55:13.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.580+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.128__shadow_.Kc56jqnnEHeuG48WIFIGhpZF1h7Jxxe_0 2024-09-12T18:55:13.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.580+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8753022746664238839', time=2024-09-12T20:55:12.662625+0000, chain.objs.size()=9 2024-09-12T18:55:13.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.580+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.144__multipart_key1/data/file.mpg.2~182Ubr7vKWX9p7Qki9FPE_-6v05o7hF.1 2024-09-12T18:55:13.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.584+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.144__shadow_key1/data/file.mpg.2~182Ubr7vKWX9p7Qki9FPE_-6v05o7hF.1_1 2024-09-12T18:55:13.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.584+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.144__multipart_key1/data/file.mpg.2~182Ubr7vKWX9p7Qki9FPE_-6v05o7hF.2 2024-09-12T18:55:13.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.584+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.144__shadow_key1/data/file.mpg.2~182Ubr7vKWX9p7Qki9FPE_-6v05o7hF.2_1 2024-09-12T18:55:13.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.584+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.144__multipart_key1/data/file.mpg.2~182Ubr7vKWX9p7Qki9FPE_-6v05o7hF.3 2024-09-12T18:55:13.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.588+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.144__shadow_key1/data/file.mpg.2~182Ubr7vKWX9p7Qki9FPE_-6v05o7hF.3_1 2024-09-12T18:55:13.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.588+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.144__multipart_key1/data/file.mpg.2~182Ubr7vKWX9p7Qki9FPE_-6v05o7hF.4 2024-09-12T18:55:13.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.588+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.144__shadow_key1/data/file.mpg.2~182Ubr7vKWX9p7Qki9FPE_-6v05o7hF.4_1 2024-09-12T18:55:13.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.588+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.144__multipart_key1/data/file.mpg.2~182Ubr7vKWX9p7Qki9FPE_-6v05o7hF.5 2024-09-12T18:55:13.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.588+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7295064004308885265', time=2024-09-12T20:55:12.675795+0000, chain.objs.size()=1 2024-09-12T18:55:13.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.588+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.144__shadow_.7UsCgf4SYwcGy1l7O7Pr45eVh6OnmUr_0 2024-09-12T18:55:13.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.592+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.600+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:55:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.604+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.604+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.604+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:55:13.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.604+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5199807555651057109', time=2024-09-12T20:54:49.509337+0000, chain.objs.size()=9 2024-09-12T18:55:13.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.604+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~y18zH3HjS3oZdNugqyGMhxBWy_PUBEX.1 2024-09-12T18:55:13.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.604+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~y18zH3HjS3oZdNugqyGMhxBWy_PUBEX.1_1 2024-09-12T18:55:13.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.604+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~y18zH3HjS3oZdNugqyGMhxBWy_PUBEX.2 2024-09-12T18:55:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.604+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~y18zH3HjS3oZdNugqyGMhxBWy_PUBEX.2_1 2024-09-12T18:55:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.604+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~y18zH3HjS3oZdNugqyGMhxBWy_PUBEX.3 2024-09-12T18:55:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.604+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~y18zH3HjS3oZdNugqyGMhxBWy_PUBEX.3_1 2024-09-12T18:55:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.604+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~y18zH3HjS3oZdNugqyGMhxBWy_PUBEX.4 2024-09-12T18:55:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.604+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~y18zH3HjS3oZdNugqyGMhxBWy_PUBEX.4_1 2024-09-12T18:55:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.608+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~y18zH3HjS3oZdNugqyGMhxBWy_PUBEX.5 2024-09-12T18:55:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.608+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10120411202873920108', time=2024-09-12T20:55:03.958919+0000, chain.objs.size()=1 2024-09-12T18:55:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.608+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.124__shadow_.PkdFHJ_dk7bQcYmmIQ8UDHtYdQoPzqq_0 2024-09-12T18:55:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.608+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15796020938916199681', time=2024-09-12T20:55:10.577975+0000, chain.objs.size()=1 2024-09-12T18:55:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.608+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.140__shadow_.kWroquQnHnzTOdYiCS9mSp8kHlB12d5_0 2024-09-12T18:55:13.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.612+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.620+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:55:13.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.620+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.624+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.624+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:55:13.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.624+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15620670066501436925', time=2024-09-12T20:54:56.594364+0000, chain.objs.size()=1 2024-09-12T18:55:13.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.624+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.106__shadow_.a6AtwLV16rhVU5qul09oM6MHpoY--0l_0 2024-09-12T18:55:13.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.624+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7711801617854759494', time=2024-09-12T20:55:01.774394+0000, chain.objs.size()=1 2024-09-12T18:55:13.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.624+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.119__shadow_.Y4fjh1univu75s7rcuWfO9BqSEEMauE_0 2024-09-12T18:55:13.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.628+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.632+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:55:13.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.636+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.636+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.640+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:55:13.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.640+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5938891197783271658', time=2024-09-12T20:55:02.655949+0000, chain.objs.size()=1 2024-09-12T18:55:13.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.640+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.121__shadow_.feSwMRPB5qHclRVLBsQ_tSptVr4uTRw_0 2024-09-12T18:55:13.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.640+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10298521518880935992', time=2024-09-12T20:55:07.037708+0000, chain.objs.size()=1 2024-09-12T18:55:13.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.640+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.131__shadow_.CpLfImZbrWWyfL9HE3pLEobJk6cZhfA_0 2024-09-12T18:55:13.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.640+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7047971259983779934', time=2024-09-12T20:55:07.049587+0000, chain.objs.size()=1 2024-09-12T18:55:13.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.640+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.131__shadow_.CMcTQiHHB_SGe_lBdVKuAYNX0W-0xaa_0 2024-09-12T18:55:13.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.640+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2618666749132087175', time=2024-09-12T20:55:07.885295+0000, chain.objs.size()=1 2024-09-12T18:55:13.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.640+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.133__shadow_.kYE2x_op-IRWs4LgUTM4qGbqIuj-j5v_0 2024-09-12T18:55:13.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.640+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.648+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:55:13.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.648+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.652+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.652+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:55:13.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.652+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7785162305671663841', time=2024-09-12T20:55:01.372394+0000, chain.objs.size()=1 2024-09-12T18:55:13.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.652+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.118__shadow_.SrQCch23QRCk3euE2vKMHkBNIUyIQyg_0 2024-09-12T18:55:13.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.652+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12445812547768266382', time=2024-09-12T20:55:04.395961+0000, chain.objs.size()=1 2024-09-12T18:55:13.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.652+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.125__shadow_.PsyDwhtTXSFKiKKDNBfsc3-1csiGwGY_0 2024-09-12T18:55:13.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.652+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12576575274152253183', time=2024-09-12T20:55:09.559780+0000, chain.objs.size()=1 2024-09-12T18:55:13.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.652+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.138__shadow_.yBSu2-fxikqJPTm2uWUOCAq2z6xgWZ5_0 2024-09-12T18:55:13.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.656+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.660+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:55:13.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.664+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.664+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.664+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:55:13.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.664+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8269366708288313324', time=2024-09-12T20:54:58.685719+0000, chain.objs.size()=1 2024-09-12T18:55:13.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.664+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.112__shadow_.M2fDmWMb7HNvZVMFZiUXrajk_AmjlMm_0 2024-09-12T18:55:13.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.664+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4673074981780786392', time=2024-09-12T20:55:01.346875+0000, chain.objs.size()=1 2024-09-12T18:55:13.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.664+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.118__shadow_.JoAMiazQssYMM1c0maFDi6Ao2eDwMfg_0 2024-09-12T18:55:13.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.664+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12164774145667997998', time=2024-09-12T20:55:05.775784+0000, chain.objs.size()=1 2024-09-12T18:55:13.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.664+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.128__shadow_.iIU-9cZvj9IG3qqODCO0xYIP3dt0O38_0 2024-09-12T18:55:13.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.668+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.672+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:55:13.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.676+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.680+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.680+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:55:13.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.680+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14717067451897527575', time=2024-09-12T20:54:43.490682+0000, chain.objs.size()=9 2024-09-12T18:55:13.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.680+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.99__multipart_key1.2~Fa3gt__nef0riiCQjzITkGyFMzPGHuh.1 2024-09-12T18:55:13.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.680+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.99__shadow_key1.2~Fa3gt__nef0riiCQjzITkGyFMzPGHuh.1_1 2024-09-12T18:55:13.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.680+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.99__multipart_key1.2~Fa3gt__nef0riiCQjzITkGyFMzPGHuh.2 2024-09-12T18:55:13.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.680+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.99__shadow_key1.2~Fa3gt__nef0riiCQjzITkGyFMzPGHuh.2_1 2024-09-12T18:55:13.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.680+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.99__multipart_key1.2~Fa3gt__nef0riiCQjzITkGyFMzPGHuh.3 2024-09-12T18:55:13.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.680+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.99__shadow_key1.2~Fa3gt__nef0riiCQjzITkGyFMzPGHuh.3_1 2024-09-12T18:55:13.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.680+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.99__multipart_key1.2~Fa3gt__nef0riiCQjzITkGyFMzPGHuh.4 2024-09-12T18:55:13.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.680+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.99__shadow_key1.2~Fa3gt__nef0riiCQjzITkGyFMzPGHuh.4_1 2024-09-12T18:55:13.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.680+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.99__multipart_key1.2~Fa3gt__nef0riiCQjzITkGyFMzPGHuh.5 2024-09-12T18:55:13.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.688+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.696+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:55:13.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.696+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:55:13.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6154830782252422834', time=2024-09-12T20:54:34.268135+0000, chain.objs.size()=9 2024-09-12T18:55:13.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__multipart_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.1 2024-09-12T18:55:13.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__shadow_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.1_1 2024-09-12T18:55:13.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__multipart_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.2 2024-09-12T18:55:13.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__shadow_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.2_1 2024-09-12T18:55:13.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__multipart_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.3 2024-09-12T18:55:13.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__shadow_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.3_1 2024-09-12T18:55:13.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__multipart_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.4 2024-09-12T18:55:13.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__shadow_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.4_1 2024-09-12T18:55:13.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__multipart_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.5 2024-09-12T18:55:13.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T', time=2024-09-12T20:54:56.205401+0000, chain.objs.size()=75 2024-09-12T18:55:13.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.1 2024-09-12T18:55:13.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.2 2024-09-12T18:55:13.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.700+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.3 2024-09-12T18:55:13.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.704+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.4 2024-09-12T18:55:13.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.704+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.5 2024-09-12T18:55:13.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.708+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.6 2024-09-12T18:55:13.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.708+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.7 2024-09-12T18:55:13.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.708+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.8 2024-09-12T18:55:13.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.708+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.9 2024-09-12T18:55:13.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.708+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.10 2024-09-12T18:55:13.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.708+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.11 2024-09-12T18:55:13.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.708+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.12 2024-09-12T18:55:13.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.708+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.13 2024-09-12T18:55:13.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.708+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.14 2024-09-12T18:55:13.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.712+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.15 2024-09-12T18:55:13.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.712+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.16 2024-09-12T18:55:13.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.712+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.17 2024-09-12T18:55:13.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.712+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.18 2024-09-12T18:55:13.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.712+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.19 2024-09-12T18:55:13.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.712+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.20 2024-09-12T18:55:13.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.712+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.21 2024-09-12T18:55:13.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.712+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.22 2024-09-12T18:55:13.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.712+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.23 2024-09-12T18:55:13.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.712+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.24 2024-09-12T18:55:13.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.712+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.25 2024-09-12T18:55:13.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.716+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.26 2024-09-12T18:55:13.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.716+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.27 2024-09-12T18:55:13.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.28 2024-09-12T18:55:13.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.29 2024-09-12T18:55:13.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.30 2024-09-12T18:55:13.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.31 2024-09-12T18:55:13.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.32 2024-09-12T18:55:13.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.33 2024-09-12T18:55:13.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.34 2024-09-12T18:55:13.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.35 2024-09-12T18:55:13.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.36 2024-09-12T18:55:13.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.37 2024-09-12T18:55:13.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.38 2024-09-12T18:55:13.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.39 2024-09-12T18:55:13.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.40 2024-09-12T18:55:13.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.41 2024-09-12T18:55:13.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.42 2024-09-12T18:55:13.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.43 2024-09-12T18:55:13.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.44 2024-09-12T18:55:13.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.45 2024-09-12T18:55:13.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.46 2024-09-12T18:55:13.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.47 2024-09-12T18:55:13.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.48 2024-09-12T18:55:13.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.724+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.49 2024-09-12T18:55:13.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.728+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.50 2024-09-12T18:55:13.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.732+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.51 2024-09-12T18:55:13.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.732+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.52 2024-09-12T18:55:13.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.732+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.53 2024-09-12T18:55:13.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.732+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.54 2024-09-12T18:55:13.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.732+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.55 2024-09-12T18:55:13.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.732+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.56 2024-09-12T18:55:13.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.732+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.57 2024-09-12T18:55:13.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.732+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.58 2024-09-12T18:55:13.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.732+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.59 2024-09-12T18:55:13.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.732+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.60 2024-09-12T18:55:13.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.736+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.61 2024-09-12T18:55:13.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.736+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.62 2024-09-12T18:55:13.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.736+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.63 2024-09-12T18:55:13.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.736+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.64 2024-09-12T18:55:13.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.736+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.65 2024-09-12T18:55:13.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.736+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.66 2024-09-12T18:55:13.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.736+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.67 2024-09-12T18:55:13.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.736+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.68 2024-09-12T18:55:13.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.736+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.69 2024-09-12T18:55:13.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.736+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.70 2024-09-12T18:55:13.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.736+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.71 2024-09-12T18:55:13.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.740+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.72 2024-09-12T18:55:13.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.744+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.73 2024-09-12T18:55:13.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.744+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.74 2024-09-12T18:55:13.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.744+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.105__multipart_key1.2~O2nQKlAIg-qjwhyfQcsn44O4xeQlZ8T.75 2024-09-12T18:55:13.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.744+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7690267408883443063', time=2024-09-12T20:54:59.140153+0000, chain.objs.size()=1 2024-09-12T18:55:13.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.744+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.113__shadow_.DEEMNtGxVVxZRW0YE2wIrVOOqO3TbrN_0 2024-09-12T18:55:13.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.744+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3467201366101414717', time=2024-09-12T20:55:07.462266+0000, chain.objs.size()=1 2024-09-12T18:55:13.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.744+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.132__shadow_.AyLQvXSMK16K2QxNYT3YN7bgyUE2-dG_0 2024-09-12T18:55:13.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.744+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11721404839980226884', time=2024-09-12T20:55:09.225198+0000, chain.objs.size()=1 2024-09-12T18:55:13.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.744+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.137__shadow_.W6bhLcFeKBWyBfg6DfNcPpun9xmjTF9_0 2024-09-12T18:55:13.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.748+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.752+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:55:13.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:55:13.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11446006444090030762', time=2024-09-12T20:54:29.329448+0000, chain.objs.size()=1 2024-09-12T18:55:13.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.81__shadow_.xD7qZEcaHe18Z686e9HXlhZsfgphBmK_0 2024-09-12T18:55:13.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4985494352732580430', time=2024-09-12T20:54:39.704916+0000, chain.objs.size()=7 2024-09-12T18:55:13.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~GCduXNcIvWGcyoEh0B_2c7QkOMCC8R-.1 2024-09-12T18:55:13.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~GCduXNcIvWGcyoEh0B_2c7QkOMCC8R-.1_1 2024-09-12T18:55:13.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~GCduXNcIvWGcyoEh0B_2c7QkOMCC8R-.1_2 2024-09-12T18:55:13.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~GCduXNcIvWGcyoEh0B_2c7QkOMCC8R-.2 2024-09-12T18:55:13.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~GCduXNcIvWGcyoEh0B_2c7QkOMCC8R-.2_1 2024-09-12T18:55:13.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~GCduXNcIvWGcyoEh0B_2c7QkOMCC8R-.2_2 2024-09-12T18:55:13.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~GCduXNcIvWGcyoEh0B_2c7QkOMCC8R-.3 2024-09-12T18:55:13.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11926699464420760561', time=2024-09-12T20:55:07.025032+0000, chain.objs.size()=1 2024-09-12T18:55:13.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.756+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.131__shadow_.tOkV4MZN2Ede1yeaU9ssHmH061r3Dqd_0 2024-09-12T18:55:13.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.764+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.768+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:55:13.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.772+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.772+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.772+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.772+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:55:13.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.776+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.776+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.780+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T18:55:13.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.780+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9655034190134934693', time=2024-09-12T20:54:26.981027+0000, chain.objs.size()=1 2024-09-12T18:55:13.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.780+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.77__shadow_.Kuu6skLL-QN1S8QswluMruU-FqInoCT_0 2024-09-12T18:55:13.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.780+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13490723806063904478', time=2024-09-12T20:55:01.358308+0000, chain.objs.size()=1 2024-09-12T18:55:13.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.780+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.118__shadow_.1e_mCgMnAbifn__mb_QwQeASQCbVl1h_0 2024-09-12T18:55:13.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.780+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8964832876742058789', time=2024-09-12T20:55:01.384510+0000, chain.objs.size()=1 2024-09-12T18:55:13.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.780+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.118__shadow_.Je7jY8FEgvkWxdpUcmBvVEObXw-TtEA_0 2024-09-12T18:55:13.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.780+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5895942049868331575', time=2024-09-12T20:55:02.223089+0000, chain.objs.size()=1 2024-09-12T18:55:13.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.780+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.120__shadow_.A446Y21m6PIMq_SjCXMoxkVWskaTrsk_0 2024-09-12T18:55:13.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.780+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11572839474427323944', time=2024-09-12T20:55:04.837796+0000, chain.objs.size()=1 2024-09-12T18:55:13.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.780+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.126__shadow_.9U_MAZmyX9QdZmcL2SIvRMRKXzGxDq__0 2024-09-12T18:55:13.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.780+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16945405452831116867', time=2024-09-12T20:55:05.737527+0000, chain.objs.size()=1 2024-09-12T18:55:13.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.780+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.128__shadow_.2jQ-g12Z7PPPZQdSdQJcJgtva7WTEx__0 2024-09-12T18:55:13.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.780+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.784+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:55:13.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.788+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.788+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T18:55:13.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2724058984620285779', time=2024-09-12T20:54:38.186165+0000, chain.objs.size()=9 2024-09-12T18:55:13.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~1nKfOq5QKdLZx-xkQHbxXiIBvmH7W0B.1 2024-09-12T18:55:13.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~1nKfOq5QKdLZx-xkQHbxXiIBvmH7W0B.1_1 2024-09-12T18:55:13.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~1nKfOq5QKdLZx-xkQHbxXiIBvmH7W0B.2 2024-09-12T18:55:13.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~1nKfOq5QKdLZx-xkQHbxXiIBvmH7W0B.2_1 2024-09-12T18:55:13.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~1nKfOq5QKdLZx-xkQHbxXiIBvmH7W0B.3 2024-09-12T18:55:13.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~1nKfOq5QKdLZx-xkQHbxXiIBvmH7W0B.3_1 2024-09-12T18:55:13.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~1nKfOq5QKdLZx-xkQHbxXiIBvmH7W0B.4 2024-09-12T18:55:13.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~1nKfOq5QKdLZx-xkQHbxXiIBvmH7W0B.4_1 2024-09-12T18:55:13.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~1nKfOq5QKdLZx-xkQHbxXiIBvmH7W0B.5 2024-09-12T18:55:13.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6112652634245170135', time=2024-09-12T20:55:05.317689+0000, chain.objs.size()=1 2024-09-12T18:55:13.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.127__shadow_.Y_-B3yyXc7sZHNuAr7dXD0IK-5yBlwQ_0 2024-09-12T18:55:13.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3940115467623266159', time=2024-09-12T20:55:07.858872+0000, chain.objs.size()=1 2024-09-12T18:55:13.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.792+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.133__shadow_.ORWZcyh-QDgbNAItGR3ss3BnV0jkayE_0 2024-09-12T18:55:13.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.796+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.800+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:55:13.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.804+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.804+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.804+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:55:13.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.804+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17752818337396102318', time=2024-09-12T20:54:30.876207+0000, chain.objs.size()=1 2024-09-12T18:55:13.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.804+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.84__shadow_.4E1c9ns4MMhO3_7n-rsRf0qrY8txO0z_0 2024-09-12T18:55:13.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.808+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.812+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:55:13.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:55:13.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.437537358034710165', time=2024-09-12T20:54:55.251308+0000, chain.objs.size()=9 2024-09-12T18:55:13.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.104__multipart_key1.2~Hz0bp6ZkVQRZoVPXXqkaNwPhDb0Ddod.1 2024-09-12T18:55:13.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.104__shadow_key1.2~Hz0bp6ZkVQRZoVPXXqkaNwPhDb0Ddod.1_1 2024-09-12T18:55:13.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.104__multipart_key1.2~Hz0bp6ZkVQRZoVPXXqkaNwPhDb0Ddod.2 2024-09-12T18:55:13.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.104__shadow_key1.2~Hz0bp6ZkVQRZoVPXXqkaNwPhDb0Ddod.2_1 2024-09-12T18:55:13.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.104__multipart_key1.2~Hz0bp6ZkVQRZoVPXXqkaNwPhDb0Ddod.3 2024-09-12T18:55:13.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.104__shadow_key1.2~Hz0bp6ZkVQRZoVPXXqkaNwPhDb0Ddod.3_1 2024-09-12T18:55:13.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.104__multipart_key1.2~Hz0bp6ZkVQRZoVPXXqkaNwPhDb0Ddod.4 2024-09-12T18:55:13.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.104__shadow_key1.2~Hz0bp6ZkVQRZoVPXXqkaNwPhDb0Ddod.4_1 2024-09-12T18:55:13.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.104__multipart_key1.2~Hz0bp6ZkVQRZoVPXXqkaNwPhDb0Ddod.5 2024-09-12T18:55:13.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10067180394024497895', time=2024-09-12T20:55:02.642645+0000, chain.objs.size()=1 2024-09-12T18:55:13.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.121__shadow_.DBDOKyLGyQ3bycBAg9IE5jyKV0iANou_0 2024-09-12T18:55:13.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5622712936528347874', time=2024-09-12T20:55:02.682294+0000, chain.objs.size()=1 2024-09-12T18:55:13.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.121__shadow_.AiXUMr1QPFN6OcOFmt5R7dUNhxgck-Z_0 2024-09-12T18:55:13.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18152619527555816100', time=2024-09-12T20:55:03.111558+0000, chain.objs.size()=1 2024-09-12T18:55:13.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.816+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.122__shadow_.9lIazgQQ-H0d961RW8Y-sjDvpUXZjoC_0 2024-09-12T18:55:13.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.824+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11735066222095338915', time=2024-09-12T20:55:06.186460+0000, chain.objs.size()=1 2024-09-12T18:55:13.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.824+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.129__shadow_.4aeM9fxvAugpHDqZuMfitFuGuCkRoF__0 2024-09-12T18:55:13.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.824+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.832+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:55:13.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.832+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T18:55:13.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.170886676390303349', time=2024-09-12T20:54:42.283495+0000, chain.objs.size()=9 2024-09-12T18:55:13.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.98__multipart_key1.2~GKxXB7D7_5GWqrHFeFtY8LuMlwFuMz_.1 2024-09-12T18:55:13.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.98__shadow_key1.2~GKxXB7D7_5GWqrHFeFtY8LuMlwFuMz_.1_1 2024-09-12T18:55:13.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.98__multipart_key1.2~GKxXB7D7_5GWqrHFeFtY8LuMlwFuMz_.2 2024-09-12T18:55:13.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.98__shadow_key1.2~GKxXB7D7_5GWqrHFeFtY8LuMlwFuMz_.2_1 2024-09-12T18:55:13.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.98__multipart_key1.2~GKxXB7D7_5GWqrHFeFtY8LuMlwFuMz_.3 2024-09-12T18:55:13.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.98__shadow_key1.2~GKxXB7D7_5GWqrHFeFtY8LuMlwFuMz_.3_1 2024-09-12T18:55:13.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.98__multipart_key1.2~GKxXB7D7_5GWqrHFeFtY8LuMlwFuMz_.4 2024-09-12T18:55:13.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.98__shadow_key1.2~GKxXB7D7_5GWqrHFeFtY8LuMlwFuMz_.4_1 2024-09-12T18:55:13.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.98__multipart_key1.2~GKxXB7D7_5GWqrHFeFtY8LuMlwFuMz_.5 2024-09-12T18:55:13.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7408699970046544517', time=2024-09-12T20:54:51.634694+0000, chain.objs.size()=7 2024-09-12T18:55:13.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~sxYLpo2llqNdOjrsJY465Xa5fn52woY.1 2024-09-12T18:55:13.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~sxYLpo2llqNdOjrsJY465Xa5fn52woY.1_1 2024-09-12T18:55:13.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.836+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~sxYLpo2llqNdOjrsJY465Xa5fn52woY.1_2 2024-09-12T18:55:13.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.844+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~sxYLpo2llqNdOjrsJY465Xa5fn52woY.2 2024-09-12T18:55:13.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.844+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~sxYLpo2llqNdOjrsJY465Xa5fn52woY.2_1 2024-09-12T18:55:13.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.844+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~sxYLpo2llqNdOjrsJY465Xa5fn52woY.2_2 2024-09-12T18:55:13.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.844+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~sxYLpo2llqNdOjrsJY465Xa5fn52woY.3 2024-09-12T18:55:13.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.844+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14055954109452368028', time=2024-09-12T20:55:00.450196+0000, chain.objs.size()=1 2024-09-12T18:55:13.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.844+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.116__shadow_.8CGO_MDQ1jyeq1e5c4jfkMPIaE-MvBn_0 2024-09-12T18:55:13.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.844+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9593952048761342157', time=2024-09-12T20:55:00.477855+0000, chain.objs.size()=1 2024-09-12T18:55:13.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.844+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.116__shadow_.rzAlG2bTT5Gdjp0r7KWcJ9D_a4J1qld_0 2024-09-12T18:55:13.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.844+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12200402584798249493', time=2024-09-12T20:55:04.421848+0000, chain.objs.size()=1 2024-09-12T18:55:13.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.844+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.125__shadow_.DCZVE57PAvuDZtb2V0U4D1nd6man6JO_0 2024-09-12T18:55:13.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.848+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11784408281289221666', time=2024-09-12T20:55:05.762346+0000, chain.objs.size()=1 2024-09-12T18:55:13.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.848+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.128__shadow_.2PpvzxJI7tUzBab5pz8zYzzJACkdu1O_0 2024-09-12T18:55:13.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.848+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10310561233208867861', time=2024-09-12T20:55:07.448238+0000, chain.objs.size()=1 2024-09-12T18:55:13.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.848+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.132__shadow_.toziBAUH7FAT2jkqByFcP1yk41sf9LL_0 2024-09-12T18:55:13.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.856+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:55:13.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:55:13.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1978022981571083014', time=2024-09-12T20:54:32.791285+0000, chain.objs.size()=1 2024-09-12T18:55:13.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.90__shadow_.bA7HU5FSoJuoFNBX4MTrJN1CNXxXpaq_0 2024-09-12T18:55:13.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2017596239446218154', time=2024-09-12T20:54:44.568761+0000, chain.objs.size()=9 2024-09-12T18:55:13.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__multipart_file2.mpg.2~KgEKK4h1Zj1p32ND1TzIe8e1Md4oc17.1 2024-09-12T18:55:13.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__shadow_file2.mpg.2~KgEKK4h1Zj1p32ND1TzIe8e1Md4oc17.1_1 2024-09-12T18:55:13.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__multipart_file2.mpg.2~KgEKK4h1Zj1p32ND1TzIe8e1Md4oc17.2 2024-09-12T18:55:13.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__shadow_file2.mpg.2~KgEKK4h1Zj1p32ND1TzIe8e1Md4oc17.2_1 2024-09-12T18:55:13.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__multipart_file2.mpg.2~KgEKK4h1Zj1p32ND1TzIe8e1Md4oc17.3 2024-09-12T18:55:13.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__shadow_file2.mpg.2~KgEKK4h1Zj1p32ND1TzIe8e1Md4oc17.3_1 2024-09-12T18:55:13.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__multipart_file2.mpg.2~KgEKK4h1Zj1p32ND1TzIe8e1Md4oc17.4 2024-09-12T18:55:13.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__shadow_file2.mpg.2~KgEKK4h1Zj1p32ND1TzIe8e1Md4oc17.4_1 2024-09-12T18:55:13.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__multipart_file2.mpg.2~KgEKK4h1Zj1p32ND1TzIe8e1Md4oc17.5 2024-09-12T18:55:13.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6679415245779430451', time=2024-09-12T20:54:59.603521+0000, chain.objs.size()=1 2024-09-12T18:55:13.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.114__shadow_.rj0MogjYJQHAptVaYtDKa7sJlzye8H1_0 2024-09-12T18:55:13.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6894352608967119733', time=2024-09-12T20:55:03.096088+0000, chain.objs.size()=1 2024-09-12T18:55:13.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.860+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.122__shadow_.W6qRGSJaWuJzwPEULPib73Irftau7Fn_0 2024-09-12T18:55:13.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.868+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16928870599144698314', time=2024-09-12T20:55:06.642999+0000, chain.objs.size()=1 2024-09-12T18:55:13.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.868+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.130__shadow_.5fFQLuAFPYEhNTCYHaE7gBng1eUMO-Y_0 2024-09-12T18:55:13.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.872+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:55:13.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T18:55:13.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1295898118879898130', time=2024-09-12T20:54:37.521636+0000, chain.objs.size()=9 2024-09-12T18:55:13.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~Zc42JLNWEwxtxJd0wV2NHeyuKleCkk8.1 2024-09-12T18:55:13.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~Zc42JLNWEwxtxJd0wV2NHeyuKleCkk8.1_1 2024-09-12T18:55:13.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~Zc42JLNWEwxtxJd0wV2NHeyuKleCkk8.2 2024-09-12T18:55:13.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~Zc42JLNWEwxtxJd0wV2NHeyuKleCkk8.2_1 2024-09-12T18:55:13.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~Zc42JLNWEwxtxJd0wV2NHeyuKleCkk8.3 2024-09-12T18:55:13.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~Zc42JLNWEwxtxJd0wV2NHeyuKleCkk8.3_1 2024-09-12T18:55:13.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~Zc42JLNWEwxtxJd0wV2NHeyuKleCkk8.4 2024-09-12T18:55:13.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~Zc42JLNWEwxtxJd0wV2NHeyuKleCkk8.4_1 2024-09-12T18:55:13.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~Zc42JLNWEwxtxJd0wV2NHeyuKleCkk8.5 2024-09-12T18:55:13.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16366837127208285374', time=2024-09-12T20:55:00.908052+0000, chain.objs.size()=1 2024-09-12T18:55:13.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.117__shadow_.ADxABW5hdfezzfcU11wn9uBuEUiWgSz_0 2024-09-12T18:55:13.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6233652993221749707', time=2024-09-12T20:55:02.235681+0000, chain.objs.size()=1 2024-09-12T18:55:13.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.120__shadow_.fNtJd8fdBJE585SNURkVWQhE97CFvHY_0 2024-09-12T18:55:13.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4295629778148270803', time=2024-09-12T20:55:05.330310+0000, chain.objs.size()=1 2024-09-12T18:55:13.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.880+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.127__shadow_.C2wnmyjsrLXz8dmDIRNyB_54JQzhyuv_0 2024-09-12T18:55:13.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.888+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8017208429156866820', time=2024-09-12T20:55:07.872548+0000, chain.objs.size()=1 2024-09-12T18:55:13.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.888+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.133__shadow_.xjqMD4fVbUTAuthjYtbJvhbFHdYG-xW_0 2024-09-12T18:55:13.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.888+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.900+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:55:13.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.904+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.908+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.908+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:55:13.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.908+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14145725561937015229', time=2024-09-12T20:54:59.112282+0000, chain.objs.size()=1 2024-09-12T18:55:13.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.908+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.113__shadow_.AT_uWHHYsOVqOfzOYQOXiPWD26Jnq66_0 2024-09-12T18:55:13.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.908+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18270174593572917063', time=2024-09-12T20:55:01.796387+0000, chain.objs.size()=1 2024-09-12T18:55:13.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.908+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.119__shadow_.vhYuZNuNV9X6ZchkoO--oi9kI7hPNpC_0 2024-09-12T18:55:13.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.912+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.916+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:55:13.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.920+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.920+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.920+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T18:55:13.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.920+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8967700721862195257', time=2024-09-12T20:55:02.197483+0000, chain.objs.size()=1 2024-09-12T18:55:13.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.920+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.120__shadow_.1uS4d5lnE6MqDzuUwi2UAy1qpARboBu_0 2024-09-12T18:55:13.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.920+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2927171271855319636', time=2024-09-12T20:55:06.226948+0000, chain.objs.size()=1 2024-09-12T18:55:13.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.920+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.129__shadow_.AGl40JJckvOnzh_kR0gIXdNKuFvXXY0_0 2024-09-12T18:55:13.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.924+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.928+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:55:13.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:55:13.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5303802472724417267', time=2024-09-12T20:54:36.611849+0000, chain.objs.size()=9 2024-09-12T18:55:13.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~AFqmwHdIXbWpRU2R9-fEnB1sidC1XgE.1 2024-09-12T18:55:13.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~AFqmwHdIXbWpRU2R9-fEnB1sidC1XgE.1_1 2024-09-12T18:55:13.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~AFqmwHdIXbWpRU2R9-fEnB1sidC1XgE.2 2024-09-12T18:55:13.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~AFqmwHdIXbWpRU2R9-fEnB1sidC1XgE.2_1 2024-09-12T18:55:13.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~AFqmwHdIXbWpRU2R9-fEnB1sidC1XgE.3 2024-09-12T18:55:13.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~AFqmwHdIXbWpRU2R9-fEnB1sidC1XgE.3_1 2024-09-12T18:55:13.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~AFqmwHdIXbWpRU2R9-fEnB1sidC1XgE.4 2024-09-12T18:55:13.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__shadow_key1.2~AFqmwHdIXbWpRU2R9-fEnB1sidC1XgE.4_1 2024-09-12T18:55:13.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.94__multipart_key1.2~AFqmwHdIXbWpRU2R9-fEnB1sidC1XgE.5 2024-09-12T18:55:13.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15137124321601277037', time=2024-09-12T20:54:40.726849+0000, chain.objs.size()=6 2024-09-12T18:55:13.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.93__shadow_.DLKFeYPAZa0IaDFS1wLicNUlhpY_6pd_0 2024-09-12T18:55:13.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.93__shadow_.DLKFeYPAZa0IaDFS1wLicNUlhpY_6pd_1 2024-09-12T18:55:13.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.932+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.93__shadow_.DLKFeYPAZa0IaDFS1wLicNUlhpY_6pd_2 2024-09-12T18:55:13.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.940+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.93__shadow_.DLKFeYPAZa0IaDFS1wLicNUlhpY_6pd_3 2024-09-12T18:55:13.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.940+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.93__shadow_.DLKFeYPAZa0IaDFS1wLicNUlhpY_6pd_4 2024-09-12T18:55:13.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.940+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.93__shadow_.DLKFeYPAZa0IaDFS1wLicNUlhpY_6pd_5 2024-09-12T18:55:13.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.940+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16983798017104609030', time=2024-09-12T20:54:44.583644+0000, chain.objs.size()=1 2024-09-12T18:55:13.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.940+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__shadow_.FHSY2MDVTYxqnu4XRiOssuyeQw8h0Eq_0 2024-09-12T18:55:13.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.940+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='2~YXRElnyCbganBPM5uZkjLUPdm34J0GM', time=2024-09-12T20:54:45.722957+0000, chain.objs.size()=9 2024-09-12T18:55:13.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.940+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.101__multipart_key1.2~YXRElnyCbganBPM5uZkjLUPdm34J0GM.7 2024-09-12T18:55:13.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.940+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.101__shadow_key1.2~YXRElnyCbganBPM5uZkjLUPdm34J0GM.7_1 2024-09-12T18:55:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.940+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.101__multipart_key1.2~YXRElnyCbganBPM5uZkjLUPdm34J0GM.8 2024-09-12T18:55:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.940+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.101__shadow_key1.2~YXRElnyCbganBPM5uZkjLUPdm34J0GM.8_1 2024-09-12T18:55:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.940+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.101__multipart_key1.2~YXRElnyCbganBPM5uZkjLUPdm34J0GM.9 2024-09-12T18:55:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.940+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.101__shadow_key1.2~YXRElnyCbganBPM5uZkjLUPdm34J0GM.9_1 2024-09-12T18:55:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.940+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.101__multipart_key1.2~YXRElnyCbganBPM5uZkjLUPdm34J0GM.10 2024-09-12T18:55:13.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.948+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.101__shadow_key1.2~YXRElnyCbganBPM5uZkjLUPdm34J0GM.10_1 2024-09-12T18:55:13.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.948+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.101__multipart_key1.2~YXRElnyCbganBPM5uZkjLUPdm34J0GM.11 2024-09-12T18:55:13.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.952+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.956+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:55:13.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.956+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:55:13.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10257755161294057700', time=2024-09-12T20:54:31.260967+0000, chain.objs.size()=1 2024-09-12T18:55:13.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.85__shadow_.metzZ2u_3IrQs0jSGxxLvDedWF-6Xbh_0 2024-09-12T18:55:13.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8757835774072315366', time=2024-09-12T20:54:51.470990+0000, chain.objs.size()=7 2024-09-12T18:55:13.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~tBAGylFooqua8tMPTfLwkPyC_4uSTDR.1 2024-09-12T18:55:13.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~tBAGylFooqua8tMPTfLwkPyC_4uSTDR.1_1 2024-09-12T18:55:13.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~tBAGylFooqua8tMPTfLwkPyC_4uSTDR.1_2 2024-09-12T18:55:13.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~tBAGylFooqua8tMPTfLwkPyC_4uSTDR.2 2024-09-12T18:55:13.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~tBAGylFooqua8tMPTfLwkPyC_4uSTDR.2_1 2024-09-12T18:55:13.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~tBAGylFooqua8tMPTfLwkPyC_4uSTDR.2_2 2024-09-12T18:55:13.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~tBAGylFooqua8tMPTfLwkPyC_4uSTDR.3 2024-09-12T18:55:13.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10260122582973599778', time=2024-09-12T20:54:59.154273+0000, chain.objs.size()=1 2024-09-12T18:55:13.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.113__shadow_.TTKYyL7CXraHUytHOaW8StYu3NFND38_0 2024-09-12T18:55:13.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9366852696864928092', time=2024-09-12T20:55:11.981339+0000, chain.objs.size()=9 2024-09-12T18:55:13.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.143__multipart_key1.2~18fcM-NVuaKkX6C7d_zDmKm6yrHvtT1.1 2024-09-12T18:55:13.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.143__shadow_key1.2~18fcM-NVuaKkX6C7d_zDmKm6yrHvtT1.1_1 2024-09-12T18:55:13.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.960+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.143__multipart_key1.2~18fcM-NVuaKkX6C7d_zDmKm6yrHvtT1.2 2024-09-12T18:55:13.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.964+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.143__shadow_key1.2~18fcM-NVuaKkX6C7d_zDmKm6yrHvtT1.2_1 2024-09-12T18:55:13.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.968+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.143__multipart_key1.2~18fcM-NVuaKkX6C7d_zDmKm6yrHvtT1.3 2024-09-12T18:55:13.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.968+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.143__shadow_key1.2~18fcM-NVuaKkX6C7d_zDmKm6yrHvtT1.3_1 2024-09-12T18:55:13.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.968+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.143__multipart_key1.2~18fcM-NVuaKkX6C7d_zDmKm6yrHvtT1.4 2024-09-12T18:55:13.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.968+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.143__shadow_key1.2~18fcM-NVuaKkX6C7d_zDmKm6yrHvtT1.4_1 2024-09-12T18:55:13.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.968+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.143__multipart_key1.2~18fcM-NVuaKkX6C7d_zDmKm6yrHvtT1.5 2024-09-12T18:55:13.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.972+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.980+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:55:13.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.984+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.984+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.984+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T18:55:13.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.984+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11433536802318875134', time=2024-09-12T20:55:00.920501+0000, chain.objs.size()=1 2024-09-12T18:55:13.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.984+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.117__shadow_.-Ji6Icvp4y3Vmqh1fsdcblqpT5cvk5q_0 2024-09-12T18:55:13.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.984+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:13.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.992+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:55:13.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.992+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:13.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.996+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:13.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.996+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:55:13.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.996+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11814227912083793287', time=2024-09-12T20:54:44.599122+0000, chain.objs.size()=1 2024-09-12T18:55:13.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.996+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.100__shadow_.8sbyvNHjYvY5NqryXLeW0Br9k5gmXpZ_0 2024-09-12T18:55:13.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.996+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13597846918327320106', time=2024-09-12T20:55:00.016622+0000, chain.objs.size()=1 2024-09-12T18:55:13.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.996+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.115__shadow_.G6MQMOzY63xBtQTBtk6-ATqV4ZiJp05_0 2024-09-12T18:55:13.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.996+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9602496070441663960', time=2024-09-12T20:55:04.408854+0000, chain.objs.size()=1 2024-09-12T18:55:13.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.996+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.125__shadow_.cM27VvuT1gX-gTaYL42JhSYc0vzNBfw_0 2024-09-12T18:55:13.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.996+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9310044435730649197', time=2024-09-12T20:55:06.631984+0000, chain.objs.size()=1 2024-09-12T18:55:13.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.996+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.130__shadow_.pZ8TZyPTO6WCy1P__3KKnYsogi1J2DH_0 2024-09-12T18:55:14.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:13.996+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:14.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.004+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:55:14.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.004+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.004+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T18:55:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4364475135807429360', time=2024-09-12T20:54:34.080169+0000, chain.objs.size()=9 2024-09-12T18:55:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__multipart_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.1 2024-09-12T18:55:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__shadow_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.1_1 2024-09-12T18:55:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__multipart_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.2 2024-09-12T18:55:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__shadow_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.2_1 2024-09-12T18:55:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__multipart_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.3 2024-09-12T18:55:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__shadow_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.3_1 2024-09-12T18:55:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__multipart_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.4 2024-09-12T18:55:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__shadow_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.4_1 2024-09-12T18:55:14.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.91__multipart_key1.2~3T99J_YLE6UVUYPXNcU0aFSP5A4hmEC.5 2024-09-12T18:55:14.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5422259456719338659', time=2024-09-12T20:54:50.087352+0000, chain.objs.size()=7 2024-09-12T18:55:14.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~R4-_B-aME_2ALyx8QFO-M29M-NV8BMY.1 2024-09-12T18:55:14.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~R4-_B-aME_2ALyx8QFO-M29M-NV8BMY.1_1 2024-09-12T18:55:14.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.008+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~R4-_B-aME_2ALyx8QFO-M29M-NV8BMY.1_2 2024-09-12T18:55:14.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.012+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~R4-_B-aME_2ALyx8QFO-M29M-NV8BMY.2 2024-09-12T18:55:14.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.012+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~R4-_B-aME_2ALyx8QFO-M29M-NV8BMY.2_1 2024-09-12T18:55:14.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.012+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__shadow_key1.2~R4-_B-aME_2ALyx8QFO-M29M-NV8BMY.2_2 2024-09-12T18:55:14.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.012+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.102__multipart_key1.2~R4-_B-aME_2ALyx8QFO-M29M-NV8BMY.3 2024-09-12T18:55:14.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.012+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17136213189539836730', time=2024-09-12T20:55:03.526164+0000, chain.objs.size()=1 2024-09-12T18:55:14.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.012+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.123__shadow_.rsGhE8F02j3mfbPt46426ohg_sofkSw_0 2024-09-12T18:55:14.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.012+0000 7ff2a6a659c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14674271757922457513', time=2024-09-12T20:55:10.213427+0000, chain.objs.size()=1 2024-09-12T18:55:14.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.012+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.139__shadow_.BBA5TjwL2smzA07Eps2DYCAxECPsgch_0 2024-09-12T18:55:14.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.020+0000 7ff2a6a659c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T18:55:14.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.024+0000 7ff15a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:14.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.028+0000 7ff2a6a659c0 20 remove_watcher() i=0 2024-09-12T18:55:14.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.028+0000 7ff2a6a659c0 2 removed watcher, disabling cache 2024-09-12T18:55:14.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.032+0000 7ff2a6a659c0 20 remove_watcher() i=1 2024-09-12T18:55:14.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.032+0000 7ff2a6a659c0 20 remove_watcher() i=2 2024-09-12T18:55:14.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.036+0000 7ff2a6a659c0 20 remove_watcher() i=3 2024-09-12T18:55:14.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.036+0000 7ff2a6a659c0 20 remove_watcher() i=4 2024-09-12T18:55:14.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.040+0000 7ff2a6a659c0 20 remove_watcher() i=5 2024-09-12T18:55:14.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.040+0000 7ff2a6a659c0 20 remove_watcher() i=6 2024-09-12T18:55:14.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.044+0000 7ff2a6a659c0 20 remove_watcher() i=7 2024-09-12T18:55:14.065 DEBUG:teuthology.orchestra.run.smithi111:> radosgw-admin gc process --include-all 2024-09-12T18:55:14.141 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:14.142 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:14.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.184+0000 7f0b6ee2b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:14.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.188+0000 7f0b6ee2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:14.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.188+0000 7f0b6ee2b9c0 20 realm 2024-09-12T18:55:14.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.188+0000 7f0b6ee2b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:14.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.188+0000 7f0b6ee2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:14.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.188+0000 7f0b6ee2b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:14.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.188+0000 7f0b6ee2b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:14.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.188+0000 7f0b6ee2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:14.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.188+0000 7f0b6ee2b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:14.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.188+0000 7f0b6ee2b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:14.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.188+0000 7f0b6ee2b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:14.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.188+0000 7f0b6ee2b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:14.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.188+0000 7f0b6ee2b9c0 20 searching for the correct realm 2024-09-12T18:55:14.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.192+0000 7f0b6c130640 0 -- 172.21.15.111:0/2432660472 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f0b640c1040 msgr2=0x7f0b640c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:14.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.408+0000 7f0b6c931640 0 -- 172.21.15.111:0/2432660472 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x5652bed87560 msgr2=0x7f0b5c05b910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:14.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:14.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:14.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:14.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:14.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:14.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:14.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:14.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:14.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:14.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:14.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:14.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:14.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 zone default found 2024-09-12T18:55:14.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 4 Realm: () 2024-09-12T18:55:14.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:14.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:14.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:14.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 zonegroup default 2024-09-12T18:55:14.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:14.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:14.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.424+0000 7f0b6ee2b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:14.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.428+0000 7f0b6ee2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:14.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.428+0000 7f0b6ee2b9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:14.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.428+0000 7f0b6ee2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:14.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.428+0000 7f0b6ee2b9c0 20 started sync module instance, tier type = 2024-09-12T18:55:14.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.428+0000 7f0b6ee2b9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:14.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.448+0000 7f0b6ee2b9c0 20 add_watcher() i=0 2024-09-12T18:55:14.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.448+0000 7f0b6ee2b9c0 20 add_watcher() i=1 2024-09-12T18:55:14.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.448+0000 7f0b6ee2b9c0 20 add_watcher() i=2 2024-09-12T18:55:14.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.448+0000 7f0b6ee2b9c0 20 add_watcher() i=3 2024-09-12T18:55:14.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.448+0000 7f0b6ee2b9c0 20 add_watcher() i=4 2024-09-12T18:55:14.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.448+0000 7f0b6ee2b9c0 20 add_watcher() i=5 2024-09-12T18:55:14.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.448+0000 7f0b6ee2b9c0 20 add_watcher() i=6 2024-09-12T18:55:14.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.452+0000 7f0b6ee2b9c0 20 add_watcher() i=7 2024-09-12T18:55:14.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.452+0000 7f0b6ee2b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:14.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.456+0000 7f0a237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:14.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.456+0000 7f0b6ee2b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:14.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.456+0000 7f0b6ee2b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:14.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.548+0000 7f0a227e4640 20 reqs_thread_entry: start 2024-09-12T18:55:14.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.548+0000 7f0b6ee2b9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:14.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.548+0000 7f0b6ee2b9c0 20 Filter name: none 2024-09-12T18:55:14.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.548+0000 7f0a1b7fe640 20 reqs_thread_entry: start 2024-09-12T18:55:14.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.548+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T18:55:14.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.552+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.552+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.552+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.556+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T18:55:14.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.560+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.560+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.560+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.564+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T18:55:14.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.564+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.568+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.568+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.572+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T18:55:14.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.576+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.576+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.576+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.580+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T18:55:14.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.580+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.584+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.584+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.584+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T18:55:14.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.588+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.588+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.588+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.592+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T18:55:14.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.596+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.596+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.596+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.596+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T18:55:14.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.600+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.600+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.600+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.604+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T18:55:14.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.608+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.608+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.612+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.612+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T18:55:14.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.616+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.616+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.620+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.620+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T18:55:14.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.624+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.624+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.624+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.628+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T18:55:14.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.632+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.632+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.636+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.636+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T18:55:14.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.640+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.640+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.640+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.644+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T18:55:14.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.644+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.648+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.648+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.648+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T18:55:14.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.652+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.656+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.656+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.660+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T18:55:14.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.660+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.660+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.660+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.664+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T18:55:14.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.664+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.668+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.668+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.672+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T18:55:14.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.672+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.676+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.676+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.680+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T18:55:14.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.680+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.684+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.684+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.684+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T18:55:14.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.688+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.688+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.688+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.692+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T18:55:14.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.696+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.696+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.696+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.700+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T18:55:14.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.704+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.704+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.704+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.708+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T18:55:14.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.712+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.712+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.716+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.716+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T18:55:14.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.720+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.720+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.724+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.724+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T18:55:14.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.728+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.728+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.732+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.732+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T18:55:14.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.736+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.740+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.740+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.744+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T18:55:14.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.744+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.748+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.748+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.748+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T18:55:14.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.752+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.752+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.756+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.756+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T18:55:14.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.760+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.760+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.760+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.764+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T18:55:14.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.768+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.768+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.772+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.772+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T18:55:14.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.776+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.776+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.776+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.780+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T18:55:14.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.784+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.784+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T18:55:14.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.784+0000 7f0b6ee2b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T18:55:14.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.792+0000 7f0a237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:14.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.796+0000 7f0b6ee2b9c0 20 remove_watcher() i=0 2024-09-12T18:55:14.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.796+0000 7f0b6ee2b9c0 2 removed watcher, disabling cache 2024-09-12T18:55:14.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.800+0000 7f0b6ee2b9c0 20 remove_watcher() i=1 2024-09-12T18:55:14.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.804+0000 7f0b6ee2b9c0 20 remove_watcher() i=2 2024-09-12T18:55:14.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.804+0000 7f0b6ee2b9c0 20 remove_watcher() i=3 2024-09-12T18:55:14.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.808+0000 7f0b6ee2b9c0 20 remove_watcher() i=4 2024-09-12T18:55:14.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.812+0000 7f0b6ee2b9c0 20 remove_watcher() i=5 2024-09-12T18:55:14.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.812+0000 7f0b6ee2b9c0 20 remove_watcher() i=6 2024-09-12T18:55:14.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:14.816+0000 7f0b6ee2b9c0 20 remove_watcher() i=7 2024-09-12T18:55:14.845 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T18:55:14.870 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T18:55:14.870 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T18:55:14.870 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T18:55:14.871 DEBUG:teuthology.orchestra.run.smithi111:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:55:14.898 INFO:teuthology.orchestra.run.smithi111.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T18:55:15.826 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T18:55:15.826 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-12T18:55:15.826 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key EGDNARYHIIHQETICVJNG --secret u7QNiJlfusXd9GF51jx6xCfta9BlgR25NdIFjWz9rqZDb6uJgZzrNg== --cluster ceph 2024-09-12T18:55:15.914 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:15.914 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:15.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:15.952+0000 7f54e89159c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:15.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:15.952+0000 7f54e89159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:15.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:15.952+0000 7f54e89159c0 20 realm 2024-09-12T18:55:15.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:15.952+0000 7f54e89159c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:15.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:15.952+0000 7f54e89159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:15.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:15.952+0000 7f54e89159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:15.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:15.952+0000 7f54e89159c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:15.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:15.952+0000 7f54e89159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:15.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:15.952+0000 7f54e89159c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:15.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:15.956+0000 7f54e89159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:15.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:15.956+0000 7f54e89159c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:15.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:15.956+0000 7f54e89159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:15.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:15.956+0000 7f54e89159c0 20 searching for the correct realm 2024-09-12T18:55:15.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:15.960+0000 7f54e6c1c640 0 -- 172.21.15.111:0/1596216933 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f54e00882f0 msgr2=0x7f54e0079400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:16.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.176+0000 7f54e5c1a640 0 -- 172.21.15.111:0/1596216933 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f54d80d6920 msgr2=0x7f54d80fb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:16.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.392+0000 7f54e89159c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:16.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.392+0000 7f54e89159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:16.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.392+0000 7f54e89159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:16.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.392+0000 7f54e89159c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:16.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.392+0000 7f54e89159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:16.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.392+0000 7f54e89159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:16.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.392+0000 7f54e89159c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:16.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.392+0000 7f54e89159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:16.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.392+0000 7f54e89159c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:16.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:16.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:16.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:16.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 20 zone default found 2024-09-12T18:55:16.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 4 Realm: () 2024-09-12T18:55:16.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:16.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:16.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:16.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 20 zonegroup default 2024-09-12T18:55:16.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:16.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:16.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:16.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:16.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:16.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:16.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 20 started sync module instance, tier type = 2024-09-12T18:55:16.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.396+0000 7f54e89159c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:16.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.420+0000 7f54e89159c0 20 add_watcher() i=0 2024-09-12T18:55:16.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.420+0000 7f54e89159c0 20 add_watcher() i=1 2024-09-12T18:55:16.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.420+0000 7f54e89159c0 20 add_watcher() i=2 2024-09-12T18:55:16.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.420+0000 7f54e89159c0 20 add_watcher() i=3 2024-09-12T18:55:16.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.420+0000 7f54e89159c0 20 add_watcher() i=4 2024-09-12T18:55:16.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.420+0000 7f54e89159c0 20 add_watcher() i=5 2024-09-12T18:55:16.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.420+0000 7f54e89159c0 20 add_watcher() i=6 2024-09-12T18:55:16.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.424+0000 7f54e89159c0 20 add_watcher() i=7 2024-09-12T18:55:16.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.424+0000 7f54e89159c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:16.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f539cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:16.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:16.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:16.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 5 note: GC not initialized 2024-09-12T18:55:16.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f53177fe640 20 reqs_thread_entry: start 2024-09-12T18:55:16.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:16.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 20 Filter name: none 2024-09-12T18:55:16.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f53157fa640 20 reqs_thread_entry: start 2024-09-12T18:55:16.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T18:55:16.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:16.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:16.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T18:55:16.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:55:16.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T18:55:16.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:16.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:16.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T18:55:16.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:55:16.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 10 cache get: name=default.rgw.meta+users.keys+EGDNARYHIIHQETICVJNG : miss 2024-09-12T18:55:16.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:16.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:16.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 10 cache put: name=default.rgw.meta+users.keys+EGDNARYHIIHQETICVJNG info.flags=0x0 2024-09-12T18:55:16.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 10 adding default.rgw.meta+users.keys+EGDNARYHIIHQETICVJNG to cache LRU end 2024-09-12T18:55:16.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 10 cache get: name=default.rgw.meta+users.keys+EGDNARYHIIHQETICVJNG : hit (negative entry) 2024-09-12T18:55:16.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.428+0000 7f54e89159c0 10 cache get: name=default.rgw.meta+users.keys+EGDNARYHIIHQETICVJNG : hit (negative entry) 2024-09-12T18:55:16.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.432+0000 7f54e89159c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:55:16.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.432+0000 7f54e89159c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:55:16.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.432+0000 7f54e89159c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T18:55:16.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.432+0000 7f53c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431732 cookie 93985285142192 notifier 9096 bl.length()=645 2024-09-12T18:55:16.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.432+0000 7f53c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:55:16.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.432+0000 7f53c9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:55:16.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.436+0000 7f54e89159c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T18:55:16.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.436+0000 7f54e89159c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:55:16.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.436+0000 7f54e89159c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T18:55:16.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.436+0000 7f53c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431733 cookie 93985285161680 notifier 9096 bl.length()=185 2024-09-12T18:55:16.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.436+0000 7f53c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T18:55:16.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.436+0000 7f53c9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T18:55:16.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.440+0000 7f54e89159c0 10 cache put: name=default.rgw.meta+users.keys+EGDNARYHIIHQETICVJNG info.flags=0x7 2024-09-12T18:55:16.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.440+0000 7f54e89159c0 10 moving default.rgw.meta+users.keys+EGDNARYHIIHQETICVJNG to cache LRU end 2024-09-12T18:55:16.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.440+0000 7f54e89159c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:EGDNARYHIIHQETICVJNG, ofs0, ns] 2024-09-12T18:55:16.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.440+0000 7f53c9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431734 cookie 93985285142192 notifier 9096 bl.length()=186 2024-09-12T18:55:16.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.440+0000 7f53c9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EGDNARYHIIHQETICVJNG info.flags=0x7 2024-09-12T18:55:16.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.440+0000 7f53c9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EGDNARYHIIHQETICVJNG to cache LRU end 2024-09-12T18:55:16.445 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:55:16.445 INFO:teuthology.orchestra.run.smithi111.stdout: "user_id": "foo.client.0", 2024-09-12T18:55:16.445 INFO:teuthology.orchestra.run.smithi111.stdout: "display_name": "Mr.foo.client.0", 2024-09-12T18:55:16.445 INFO:teuthology.orchestra.run.smithi111.stdout: "email": "foo+test@test.test", 2024-09-12T18:55:16.446 INFO:teuthology.orchestra.run.smithi111.stdout: "suspended": 0, 2024-09-12T18:55:16.446 INFO:teuthology.orchestra.run.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:55:16.446 INFO:teuthology.orchestra.run.smithi111.stdout: "subusers": [], 2024-09-12T18:55:16.446 INFO:teuthology.orchestra.run.smithi111.stdout: "keys": [ 2024-09-12T18:55:16.446 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:55:16.446 INFO:teuthology.orchestra.run.smithi111.stdout: "user": "foo.client.0", 2024-09-12T18:55:16.446 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "EGDNARYHIIHQETICVJNG", 2024-09-12T18:55:16.446 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "u7QNiJlfusXd9GF51jx6xCfta9BlgR25NdIFjWz9rqZDb6uJgZzrNg==", 2024-09-12T18:55:16.446 INFO:teuthology.orchestra.run.smithi111.stdout: "active": true, 2024-09-12T18:55:16.446 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:55:16.432817Z" 2024-09-12T18:55:16.446 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:55:16.446 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:55:16.446 INFO:teuthology.orchestra.run.smithi111.stdout: "swift_keys": [], 2024-09-12T18:55:16.446 INFO:teuthology.orchestra.run.smithi111.stdout: "caps": [], 2024-09-12T18:55:16.447 INFO:teuthology.orchestra.run.smithi111.stdout: "op_mask": "read, write, delete", 2024-09-12T18:55:16.447 INFO:teuthology.orchestra.run.smithi111.stdout: "default_placement": "", 2024-09-12T18:55:16.447 INFO:teuthology.orchestra.run.smithi111.stdout: "default_storage_class": "", 2024-09-12T18:55:16.447 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_tags": [], 2024-09-12T18:55:16.447 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2024-09-12T18:55:16.447 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:16.447 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:16.447 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:16.447 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:16.447 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:16.447 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:16.447 INFO:teuthology.orchestra.run.smithi111.stdout: "user_quota": { 2024-09-12T18:55:16.447 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:16.447 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:16.448 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:16.448 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:16.448 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:16.448 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:16.448 INFO:teuthology.orchestra.run.smithi111.stdout: "temp_url_keys": [], 2024-09-12T18:55:16.448 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "rgw", 2024-09-12T18:55:16.448 INFO:teuthology.orchestra.run.smithi111.stdout: "mfa_ids": [], 2024-09-12T18:55:16.448 INFO:teuthology.orchestra.run.smithi111.stdout: "account_id": "", 2024-09-12T18:55:16.448 INFO:teuthology.orchestra.run.smithi111.stdout: "path": "/", 2024-09-12T18:55:16.448 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:55:16.432764Z", 2024-09-12T18:55:16.448 INFO:teuthology.orchestra.run.smithi111.stdout: "tags": [], 2024-09-12T18:55:16.448 INFO:teuthology.orchestra.run.smithi111.stdout: "group_ids": [] 2024-09-12T18:55:16.448 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:55:16.449 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:16.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.444+0000 7f539cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:16.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.448+0000 7f54e89159c0 20 remove_watcher() i=0 2024-09-12T18:55:16.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.448+0000 7f54e89159c0 2 removed watcher, disabling cache 2024-09-12T18:55:16.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.452+0000 7f54e89159c0 20 remove_watcher() i=1 2024-09-12T18:55:16.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.452+0000 7f54e89159c0 20 remove_watcher() i=2 2024-09-12T18:55:16.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.456+0000 7f54e89159c0 20 remove_watcher() i=3 2024-09-12T18:55:16.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.456+0000 7f54e89159c0 20 remove_watcher() i=4 2024-09-12T18:55:16.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.460+0000 7f54e89159c0 20 remove_watcher() i=5 2024-09-12T18:55:16.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.460+0000 7f54e89159c0 20 remove_watcher() i=6 2024-09-12T18:55:16.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.460+0000 7f54e89159c0 20 remove_watcher() i=7 2024-09-12T18:55:16.480 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 2001956832 --totp-seed VBX2NL27RACGB6ZNST36XOPIYZPYJEWRE5QQHGYFXD65HUAEMHASPCN37JHHL36M --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:55:16.522 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:16.522 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:16.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.560+0000 7f66edf759c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:16.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.768+0000 7f66edf759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:16.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.768+0000 7f66edf759c0 20 realm 2024-09-12T18:55:16.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.768+0000 7f66edf759c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:16.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.768+0000 7f66edf759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:16.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.768+0000 7f66edf759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:16.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.768+0000 7f66edf759c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:16.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.768+0000 7f66edf759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:16.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.768+0000 7f66edf759c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:16.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.772+0000 7f66edf759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:16.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.772+0000 7f66edf759c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:16.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.772+0000 7f66edf759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:16.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.772+0000 7f66edf759c0 20 searching for the correct realm 2024-09-12T18:55:16.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.780+0000 7f66ec27c640 0 -- 172.21.15.111:0/318114154 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f66dc028040 msgr2=0x7f66dc039750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:16.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:16.996+0000 7f66eb27a640 0 -- 172.21.15.111:0/318114154 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f66e4048410 msgr2=0x7f66e4048890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:17.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.212+0000 7f66edf759c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:17.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.212+0000 7f66edf759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:17.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.212+0000 7f66edf759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:17.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.212+0000 7f66edf759c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:17.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.212+0000 7f66edf759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:17.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.212+0000 7f66edf759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:17.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.212+0000 7f66edf759c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:17.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.216+0000 7f66edf759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:17.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.216+0000 7f66edf759c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:17.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.216+0000 7f66edf759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:17.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.216+0000 7f66edf759c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:17.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.216+0000 7f66edf759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:17.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.216+0000 7f66edf759c0 20 zone default found 2024-09-12T18:55:17.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.216+0000 7f66edf759c0 4 Realm: () 2024-09-12T18:55:17.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.216+0000 7f66edf759c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:17.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.216+0000 7f66edf759c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:17.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.216+0000 7f66edf759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:17.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.216+0000 7f66edf759c0 20 zonegroup default 2024-09-12T18:55:17.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.216+0000 7f66edf759c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:17.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.216+0000 7f66edf759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:17.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.216+0000 7f66edf759c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:17.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.220+0000 7f66edf759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:17.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.220+0000 7f66edf759c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:17.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.220+0000 7f66edf759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:17.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.220+0000 7f66edf759c0 20 started sync module instance, tier type = 2024-09-12T18:55:17.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.220+0000 7f66edf759c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:17.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.244+0000 7f66edf759c0 20 add_watcher() i=0 2024-09-12T18:55:17.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.244+0000 7f66edf759c0 20 add_watcher() i=1 2024-09-12T18:55:17.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.244+0000 7f66edf759c0 20 add_watcher() i=2 2024-09-12T18:55:17.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.244+0000 7f66edf759c0 20 add_watcher() i=3 2024-09-12T18:55:17.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.244+0000 7f66edf759c0 20 add_watcher() i=4 2024-09-12T18:55:17.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.244+0000 7f66edf759c0 20 add_watcher() i=5 2024-09-12T18:55:17.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.244+0000 7f66edf759c0 20 add_watcher() i=6 2024-09-12T18:55:17.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.244+0000 7f66edf759c0 20 add_watcher() i=7 2024-09-12T18:55:17.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.244+0000 7f66edf759c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:17.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.248+0000 7f65a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:17.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.248+0000 7f66edf759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:17.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.248+0000 7f66edf759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:17.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.248+0000 7f66edf759c0 5 note: GC not initialized 2024-09-12T18:55:17.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.248+0000 7f65a0fe1640 20 reqs_thread_entry: start 2024-09-12T18:55:17.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.252+0000 7f66edf759c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:17.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.252+0000 7f66edf759c0 20 Filter name: none 2024-09-12T18:55:17.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.252+0000 7f651a7fc640 20 reqs_thread_entry: start 2024-09-12T18:55:17.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.252+0000 7f66edf759c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T18:55:17.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.252+0000 7f66edf759c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:17.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.252+0000 7f66edf759c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T18:55:17.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.252+0000 7f66edf759c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T18:55:17.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.252+0000 7f66edf759c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:55:17.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:17.252+0000 7f66edf759c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:55:19.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.156+0000 7f66edf759c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:55:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.156+0000 7f66edf759c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:55:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.156+0000 7f66edf759c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T18:55:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.156+0000 7f65ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366327 cookie 94906412172880 notifier 9114 bl.length()=659 2024-09-12T18:55:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.156+0000 7f65ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T18:55:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.156+0000 7f65ca7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T18:55:19.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.160+0000 7f65a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:19.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.164+0000 7f66edf759c0 20 remove_watcher() i=0 2024-09-12T18:55:19.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.164+0000 7f66edf759c0 2 removed watcher, disabling cache 2024-09-12T18:55:19.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.168+0000 7f66edf759c0 20 remove_watcher() i=1 2024-09-12T18:55:19.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.168+0000 7f66edf759c0 20 remove_watcher() i=2 2024-09-12T18:55:19.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.172+0000 7f66edf759c0 20 remove_watcher() i=3 2024-09-12T18:55:19.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.172+0000 7f66edf759c0 20 remove_watcher() i=4 2024-09-12T18:55:19.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.176+0000 7f66edf759c0 20 remove_watcher() i=5 2024-09-12T18:55:19.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.176+0000 7f66edf759c0 20 remove_watcher() i=6 2024-09-12T18:55:19.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.180+0000 7f66edf759c0 20 remove_watcher() i=7 2024-09-12T18:55:19.201 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T18:55:19.201 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key CBZJLQTIQSNWJMUSUCUX --secret aZ/BUprkMNehK1o7LBPbRRmu3mJwyHEdUytzZngHzt1+vJ+QTEQ/DQ== --cluster ceph 2024-09-12T18:55:19.290 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:19.290 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:19.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.328+0000 7fb359e269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.332+0000 7fb359e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.332+0000 7fb359e269c0 20 realm 2024-09-12T18:55:19.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.332+0000 7fb359e269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.332+0000 7fb359e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.332+0000 7fb359e269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:19.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.332+0000 7fb359e269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.332+0000 7fb359e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.332+0000 7fb359e269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.332+0000 7fb359e269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:19.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.332+0000 7fb359e269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.336+0000 7fb359e269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:19.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.336+0000 7fb359e269c0 20 searching for the correct realm 2024-09-12T18:55:19.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.340+0000 7fb35792c640 0 -- 172.21.15.111:0/2213323419 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fb350008030 msgr2=0x7fb35005bb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:19.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.344+0000 7fb35712b640 0 -- 172.21.15.111:0/2213323419 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fb350062870 msgr2=0x7fb350092210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:19.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.560+0000 7fb359e269c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:19.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.560+0000 7fb359e269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:19.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.560+0000 7fb359e269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:19.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.560+0000 7fb359e269c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:19.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.560+0000 7fb359e269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:19.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.560+0000 7fb359e269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:19.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.560+0000 7fb359e269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.560+0000 7fb359e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.560+0000 7fb359e269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.564+0000 7fb359e269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:19.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.564+0000 7fb359e269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.564+0000 7fb359e269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:19.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.564+0000 7fb359e269c0 20 zone default found 2024-09-12T18:55:19.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.564+0000 7fb359e269c0 4 Realm: () 2024-09-12T18:55:19.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.564+0000 7fb359e269c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:19.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.564+0000 7fb359e269c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:19.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.564+0000 7fb359e269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:19.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.564+0000 7fb359e269c0 20 zonegroup default 2024-09-12T18:55:19.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.564+0000 7fb359e269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.564+0000 7fb359e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.564+0000 7fb359e269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.564+0000 7fb359e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.564+0000 7fb359e269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.568+0000 7fb359e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.568+0000 7fb359e269c0 20 started sync module instance, tier type = 2024-09-12T18:55:19.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.568+0000 7fb359e269c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:19.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.588+0000 7fb359e269c0 20 add_watcher() i=0 2024-09-12T18:55:19.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.588+0000 7fb359e269c0 20 add_watcher() i=1 2024-09-12T18:55:19.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.588+0000 7fb359e269c0 20 add_watcher() i=2 2024-09-12T18:55:19.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.588+0000 7fb359e269c0 20 add_watcher() i=3 2024-09-12T18:55:19.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.588+0000 7fb359e269c0 20 add_watcher() i=4 2024-09-12T18:55:19.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.588+0000 7fb359e269c0 20 add_watcher() i=5 2024-09-12T18:55:19.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.588+0000 7fb359e269c0 20 add_watcher() i=6 2024-09-12T18:55:19.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.592+0000 7fb359e269c0 20 add_watcher() i=7 2024-09-12T18:55:19.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.592+0000 7fb359e269c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:19.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.596+0000 7fb20dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:19.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.596+0000 7fb359e269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:19.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.596+0000 7fb359e269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:19.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.596+0000 7fb359e269c0 5 note: GC not initialized 2024-09-12T18:55:19.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.596+0000 7fb20cfe1640 20 reqs_thread_entry: start 2024-09-12T18:55:19.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.596+0000 7fb359e269c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:19.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.596+0000 7fb359e269c0 20 Filter name: none 2024-09-12T18:55:19.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.596+0000 7fb1867fc640 20 reqs_thread_entry: start 2024-09-12T18:55:19.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.596+0000 7fb359e269c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T18:55:19.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.596+0000 7fb359e269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T18:55:19.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:55:19.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T18:55:19.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T18:55:19.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:55:19.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 10 cache get: name=default.rgw.meta+users.keys+CBZJLQTIQSNWJMUSUCUX : miss 2024-09-12T18:55:19.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 10 cache put: name=default.rgw.meta+users.keys+CBZJLQTIQSNWJMUSUCUX info.flags=0x0 2024-09-12T18:55:19.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 10 adding default.rgw.meta+users.keys+CBZJLQTIQSNWJMUSUCUX to cache LRU end 2024-09-12T18:55:19.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 10 cache get: name=default.rgw.meta+users.keys+CBZJLQTIQSNWJMUSUCUX : hit (negative entry) 2024-09-12T18:55:19.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.600+0000 7fb359e269c0 10 cache get: name=default.rgw.meta+users.keys+CBZJLQTIQSNWJMUSUCUX : hit (negative entry) 2024-09-12T18:55:19.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.604+0000 7fb359e269c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:55:19.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.604+0000 7fb359e269c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:55:19.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.604+0000 7fb359e269c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T18:55:19.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.604+0000 7fb236ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366253 cookie 94784899693568 notifier 8501 bl.length()=645 2024-09-12T18:55:19.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.604+0000 7fb236ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:55:19.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.604+0000 7fb236ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:55:19.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.608+0000 7fb359e269c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T18:55:19.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.608+0000 7fb359e269c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:55:19.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.608+0000 7fb359e269c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T18:55:19.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.608+0000 7fb2367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366432 cookie 94784899703568 notifier 8501 bl.length()=185 2024-09-12T18:55:19.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.608+0000 7fb2367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T18:55:19.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.608+0000 7fb2367fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T18:55:19.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.612+0000 7fb359e269c0 10 cache put: name=default.rgw.meta+users.keys+CBZJLQTIQSNWJMUSUCUX info.flags=0x7 2024-09-12T18:55:19.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.612+0000 7fb359e269c0 10 moving default.rgw.meta+users.keys+CBZJLQTIQSNWJMUSUCUX to cache LRU end 2024-09-12T18:55:19.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.612+0000 7fb359e269c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:CBZJLQTIQSNWJMUSUCUX, ofs0, ns] 2024-09-12T18:55:19.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.612+0000 7fb236ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366223 cookie 94784899698368 notifier 8501 bl.length()=186 2024-09-12T18:55:19.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.612+0000 7fb236ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CBZJLQTIQSNWJMUSUCUX info.flags=0x7 2024-09-12T18:55:19.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.612+0000 7fb236ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CBZJLQTIQSNWJMUSUCUX to cache LRU end 2024-09-12T18:55:19.616 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:55:19.616 INFO:teuthology.orchestra.run.smithi111.stdout: "user_id": "bar.client.0", 2024-09-12T18:55:19.616 INFO:teuthology.orchestra.run.smithi111.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T18:55:19.616 INFO:teuthology.orchestra.run.smithi111.stdout: "email": "bar+test@test.test", 2024-09-12T18:55:19.616 INFO:teuthology.orchestra.run.smithi111.stdout: "suspended": 0, 2024-09-12T18:55:19.616 INFO:teuthology.orchestra.run.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:55:19.616 INFO:teuthology.orchestra.run.smithi111.stdout: "subusers": [], 2024-09-12T18:55:19.616 INFO:teuthology.orchestra.run.smithi111.stdout: "keys": [ 2024-09-12T18:55:19.616 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:55:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: "user": "bar.client.0", 2024-09-12T18:55:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "CBZJLQTIQSNWJMUSUCUX", 2024-09-12T18:55:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "aZ/BUprkMNehK1o7LBPbRRmu3mJwyHEdUytzZngHzt1+vJ+QTEQ/DQ==", 2024-09-12T18:55:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: "active": true, 2024-09-12T18:55:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:55:19.602309Z" 2024-09-12T18:55:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:55:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:55:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: "swift_keys": [], 2024-09-12T18:55:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: "caps": [], 2024-09-12T18:55:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: "op_mask": "read, write, delete", 2024-09-12T18:55:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: "default_placement": "", 2024-09-12T18:55:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: "default_storage_class": "", 2024-09-12T18:55:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_tags": [], 2024-09-12T18:55:19.617 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2024-09-12T18:55:19.618 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:19.618 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:19.618 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:19.618 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:19.618 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:19.618 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:19.618 INFO:teuthology.orchestra.run.smithi111.stdout: "user_quota": { 2024-09-12T18:55:19.618 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:19.618 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:19.618 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: "temp_url_keys": [], 2024-09-12T18:55:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "rgw", 2024-09-12T18:55:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: "mfa_ids": [], 2024-09-12T18:55:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: "account_id": "", 2024-09-12T18:55:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: "path": "/", 2024-09-12T18:55:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:55:19.602270Z", 2024-09-12T18:55:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: "tags": [], 2024-09-12T18:55:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: "group_ids": [] 2024-09-12T18:55:19.619 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:55:19.619 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:19.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.616+0000 7fb20dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:19.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.620+0000 7fb359e269c0 20 remove_watcher() i=0 2024-09-12T18:55:19.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.620+0000 7fb359e269c0 2 removed watcher, disabling cache 2024-09-12T18:55:19.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.620+0000 7fb359e269c0 20 remove_watcher() i=1 2024-09-12T18:55:19.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.624+0000 7fb359e269c0 20 remove_watcher() i=2 2024-09-12T18:55:19.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.628+0000 7fb359e269c0 20 remove_watcher() i=3 2024-09-12T18:55:19.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.628+0000 7fb359e269c0 20 remove_watcher() i=4 2024-09-12T18:55:19.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.632+0000 7fb359e269c0 20 remove_watcher() i=5 2024-09-12T18:55:19.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.632+0000 7fb359e269c0 20 remove_watcher() i=6 2024-09-12T18:55:19.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.632+0000 7fb359e269c0 20 remove_watcher() i=7 2024-09-12T18:55:19.653 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 5591350790 --totp-seed AIFHE5CTY2CGH43YOF2EZ6XLPXLED5SAHIXY57WEDL5BXGGXJPOII4D33APC7TV2 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:55:19.699 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:19.699 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:19.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.736+0000 7f306ef949c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.740+0000 7f306ef949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.740+0000 7f306ef949c0 20 realm 2024-09-12T18:55:19.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.740+0000 7f306ef949c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.740+0000 7f306ef949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.740+0000 7f306ef949c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:19.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.740+0000 7f306ef949c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.740+0000 7f306ef949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.740+0000 7f306ef949c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.740+0000 7f306ef949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:19.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.740+0000 7f306ef949c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.740+0000 7f306ef949c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:19.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.740+0000 7f306ef949c0 20 searching for the correct realm 2024-09-12T18:55:19.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.748+0000 7f306ca9a640 0 -- 172.21.15.111:0/3179349484 >> [v2:172.21.15.111:6800/2832238944,v1:172.21.15.111:6801/2832238944] conn(0x560ac7045460 msgr2=0x560ac70478d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:19.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.752+0000 7f306d29b640 0 -- 172.21.15.111:0/3179349484 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f3060118330 msgr2=0x7f30600093d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:55:19.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.760+0000 7f306ef949c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:19.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.760+0000 7f306ef949c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:19.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.760+0000 7f306ef949c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:19.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.760+0000 7f306ef949c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:19.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.760+0000 7f306ef949c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:19.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.760+0000 7f306ef949c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:19.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.760+0000 7f306ef949c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.760+0000 7f306ef949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.760+0000 7f306ef949c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:19.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:19.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 20 zone default found 2024-09-12T18:55:19.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 4 Realm: () 2024-09-12T18:55:19.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:19.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:19.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:19.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 20 zonegroup default 2024-09-12T18:55:19.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 20 started sync module instance, tier type = 2024-09-12T18:55:19.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.764+0000 7f306ef949c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:19.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.780+0000 7f306ef949c0 20 add_watcher() i=0 2024-09-12T18:55:19.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.780+0000 7f306ef949c0 20 add_watcher() i=1 2024-09-12T18:55:19.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.780+0000 7f306ef949c0 20 add_watcher() i=2 2024-09-12T18:55:19.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.780+0000 7f306ef949c0 20 add_watcher() i=3 2024-09-12T18:55:19.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.780+0000 7f306ef949c0 20 add_watcher() i=4 2024-09-12T18:55:19.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.780+0000 7f306ef949c0 20 add_watcher() i=5 2024-09-12T18:55:19.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.780+0000 7f306ef949c0 20 add_watcher() i=6 2024-09-12T18:55:19.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.780+0000 7f306ef949c0 20 add_watcher() i=7 2024-09-12T18:55:19.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.780+0000 7f306ef949c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:19.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.784+0000 7f2f22fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:19.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.784+0000 7f306ef949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:19.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.784+0000 7f306ef949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:19.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.784+0000 7f306ef949c0 5 note: GC not initialized 2024-09-12T18:55:19.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.784+0000 7f2f21fe3640 20 reqs_thread_entry: start 2024-09-12T18:55:19.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.784+0000 7f306ef949c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:19.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.784+0000 7f306ef949c0 20 Filter name: none 2024-09-12T18:55:19.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.784+0000 7f2e937fe640 20 reqs_thread_entry: start 2024-09-12T18:55:19.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.784+0000 7f306ef949c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T18:55:19.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.784+0000 7f306ef949c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.784+0000 7f306ef949c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T18:55:19.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.784+0000 7f306ef949c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T18:55:19.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.784+0000 7f306ef949c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:55:19.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.784+0000 7f306ef949c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:55:19.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.792+0000 7f306ef949c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:55:19.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.792+0000 7f306ef949c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:55:19.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.792+0000 7f306ef949c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T18:55:19.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.792+0000 7f2f43fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366254 cookie 94604288664224 notifier 9144 bl.length()=659 2024-09-12T18:55:19.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.792+0000 7f2f43fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T18:55:19.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.792+0000 7f2f43fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T18:55:19.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.792+0000 7f2f22fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:19.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.800+0000 7f306ef949c0 20 remove_watcher() i=0 2024-09-12T18:55:19.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.800+0000 7f306ef949c0 2 removed watcher, disabling cache 2024-09-12T18:55:19.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.800+0000 7f306ef949c0 20 remove_watcher() i=1 2024-09-12T18:55:19.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.804+0000 7f306ef949c0 20 remove_watcher() i=2 2024-09-12T18:55:19.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.804+0000 7f306ef949c0 20 remove_watcher() i=3 2024-09-12T18:55:19.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.808+0000 7f306ef949c0 20 remove_watcher() i=4 2024-09-12T18:55:19.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.808+0000 7f306ef949c0 20 remove_watcher() i=5 2024-09-12T18:55:19.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.808+0000 7f306ef949c0 20 remove_watcher() i=6 2024-09-12T18:55:19.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.812+0000 7f306ef949c0 20 remove_watcher() i=7 2024-09-12T18:55:19.829 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-12T18:55:19.866 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:19.866 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:19.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.908+0000 7f3b22cd39c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.908+0000 7f3b22cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.908+0000 7f3b22cd39c0 20 realm 2024-09-12T18:55:19.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.908+0000 7f3b22cd39c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.908+0000 7f3b22cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.908+0000 7f3b22cd39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:19.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.908+0000 7f3b22cd39c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.908+0000 7f3b22cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:19.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.908+0000 7f3b22cd39c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.912+0000 7f3b22cd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:19.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.912+0000 7f3b22cd39c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:19.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.912+0000 7f3b22cd39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:19.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.912+0000 7f3b22cd39c0 20 searching for the correct realm 2024-09-12T18:55:19.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.912+0000 7f3b207d9640 0 -- 172.21.15.111:0/3344757866 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f3b18056040 msgr2=0x7f3b18033950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:19.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:19.920+0000 7f3b207d9640 0 -- 172.21.15.111:0/3344757866 >> [v2:172.21.15.153:6808/1571723771,v1:172.21.15.153:6809/1571723771] conn(0x7f3b18008050 msgr2=0x7f3b18057940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:20.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.192+0000 7f3b22cd39c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:20.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.192+0000 7f3b22cd39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:20.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.192+0000 7f3b22cd39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:20.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.192+0000 7f3b22cd39c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:20.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.192+0000 7f3b22cd39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:20.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.192+0000 7f3b22cd39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:20.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.192+0000 7f3b22cd39c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:20.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.192+0000 7f3b22cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:20.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.192+0000 7f3b22cd39c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:20.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.192+0000 7f3b22cd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:20.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.192+0000 7f3b22cd39c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:20.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:20.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 20 zone default found 2024-09-12T18:55:20.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 4 Realm: () 2024-09-12T18:55:20.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:20.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:20.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:20.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 20 zonegroup default 2024-09-12T18:55:20.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:20.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:20.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:20.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:20.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:20.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:20.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 20 started sync module instance, tier type = 2024-09-12T18:55:20.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.196+0000 7f3b22cd39c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:20.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.220+0000 7f3b22cd39c0 20 add_watcher() i=0 2024-09-12T18:55:20.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.220+0000 7f3b22cd39c0 20 add_watcher() i=1 2024-09-12T18:55:20.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.220+0000 7f3b22cd39c0 20 add_watcher() i=2 2024-09-12T18:55:20.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.220+0000 7f3b22cd39c0 20 add_watcher() i=3 2024-09-12T18:55:20.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.220+0000 7f3b22cd39c0 20 add_watcher() i=4 2024-09-12T18:55:20.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.220+0000 7f3b22cd39c0 20 add_watcher() i=5 2024-09-12T18:55:20.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.220+0000 7f3b22cd39c0 20 add_watcher() i=6 2024-09-12T18:55:20.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.224+0000 7f3b22cd39c0 20 add_watcher() i=7 2024-09-12T18:55:20.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.224+0000 7f3b22cd39c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:20.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.228+0000 7f39d6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:20.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.228+0000 7f3b22cd39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:20.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.228+0000 7f3b22cd39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:20.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.228+0000 7f3b22cd39c0 5 note: GC not initialized 2024-09-12T18:55:20.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.228+0000 7f39d5fdb640 20 reqs_thread_entry: start 2024-09-12T18:55:20.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f3b22cd39c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:20.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f3b22cd39c0 20 Filter name: none 2024-09-12T18:55:20.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f39477fe640 20 reqs_thread_entry: start 2024-09-12T18:55:20.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f3b22cd39c0 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-12T18:55:20.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f3b22cd39c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:20.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f3b22cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:20.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f3b22cd39c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-12T18:55:20.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f3b22cd39c0 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T18:55:20.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f3b22cd39c0 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-12T18:55:20.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f3b22cd39c0 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-12T18:55:20.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f3b22cd39c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:20.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f3b22cd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:20.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f3b22cd39c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-12T18:55:20.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f3b22cd39c0 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T18:55:20.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.232+0000 7f3b22cd39c0 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-12T18:55:20.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.236+0000 7f3b22cd39c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T18:55:20.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.236+0000 7f3b22cd39c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T18:55:20.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.236+0000 7f3b22cd39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-12T18:55:20.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.236+0000 7f39f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333551 cookie 93971006869392 notifier 9162 bl.length()=389 2024-09-12T18:55:20.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.236+0000 7f39f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T18:55:20.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.236+0000 7f39f77fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T18:55:20.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.240+0000 7f3b22cd39c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T18:55:20.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.240+0000 7f3b22cd39c0 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T18:55:20.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.240+0000 7f3b22cd39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-12T18:55:20.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.240+0000 7f39f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333624 cookie 93971006879360 notifier 9162 bl.length()=230 2024-09-12T18:55:20.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.240+0000 7f39f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T18:55:20.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.240+0000 7f39f77fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T18:55:20.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.244+0000 7f3b22cd39c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T18:55:20.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.244+0000 7f3b22cd39c0 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T18:55:20.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.244+0000 7f3b22cd39c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-12T18:55:20.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.248+0000 7f39f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 93971006882640 notifier 9162 bl.length()=234 2024-09-12T18:55:20.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.248+0000 7f39f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T18:55:20.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.248+0000 7f39f6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T18:55:20.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.248+0000 7f39d6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:20.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.252+0000 7f3b22cd39c0 20 remove_watcher() i=0 2024-09-12T18:55:20.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.252+0000 7f3b22cd39c0 2 removed watcher, disabling cache 2024-09-12T18:55:20.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.256+0000 7f3b22cd39c0 20 remove_watcher() i=1 2024-09-12T18:55:20.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.260+0000 7f3b22cd39c0 20 remove_watcher() i=2 2024-09-12T18:55:20.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.260+0000 7f3b22cd39c0 20 remove_watcher() i=3 2024-09-12T18:55:20.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.264+0000 7f3b22cd39c0 20 remove_watcher() i=4 2024-09-12T18:55:20.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.264+0000 7f3b22cd39c0 20 remove_watcher() i=5 2024-09-12T18:55:20.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.264+0000 7f3b22cd39c0 20 remove_watcher() i=6 2024-09-12T18:55:20.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.268+0000 7f3b22cd39c0 20 remove_watcher() i=7 2024-09-12T18:55:20.285 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:55:20.285 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "RGW33333333333333333", 2024-09-12T18:55:20.285 INFO:teuthology.orchestra.run.smithi111.stdout: "tenant": "testx", 2024-09-12T18:55:20.285 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "Mr.RGW33333333333333333", 2024-09-12T18:55:20.285 INFO:teuthology.orchestra.run.smithi111.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-12T18:55:20.285 INFO:teuthology.orchestra.run.smithi111.stdout: "quota": { 2024-09-12T18:55:20.285 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:20.285 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:20.285 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:20.285 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:20.285 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:20.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:20.286 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2024-09-12T18:55:20.286 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:20.286 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:20.286 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:20.286 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:20.286 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:20.286 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:20.286 INFO:teuthology.orchestra.run.smithi111.stdout: "max_users": 1000, 2024-09-12T18:55:20.286 INFO:teuthology.orchestra.run.smithi111.stdout: "max_roles": 1000, 2024-09-12T18:55:20.286 INFO:teuthology.orchestra.run.smithi111.stdout: "max_groups": 1000, 2024-09-12T18:55:20.286 INFO:teuthology.orchestra.run.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:55:20.286 INFO:teuthology.orchestra.run.smithi111.stdout: "max_access_keys": 4 2024-09-12T18:55:20.287 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:55:20.288 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-12T18:55:20.288 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key JRXLINYJOFZJFTZTYHIE --secret 24msqSYeOXF7KwnRG5ACvatl81uLHmqB+AALko4CeKf6YOgDUpXMqA== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-12T18:55:20.377 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:20.377 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:20.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.624+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:20.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.628+0000 7efc97d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:20.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.628+0000 7efc97d399c0 20 realm 2024-09-12T18:55:20.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.628+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:20.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.628+0000 7efc97d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:20.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.628+0000 7efc97d399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:20.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.628+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:20.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.628+0000 7efc97d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:20.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.628+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:20.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.632+0000 7efc97d399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:20.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.632+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:20.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.632+0000 7efc97d399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:20.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.632+0000 7efc97d399c0 20 searching for the correct realm 2024-09-12T18:55:20.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.632+0000 7efc9583f640 0 -- 172.21.15.111:0/850226508 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7efc90004050 msgr2=0x7efc90100830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:20.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:20.844+0000 7efc9583f640 0 -- 172.21.15.111:0/850226508 >> [v2:172.21.15.153:6808/1571723771,v1:172.21.15.153:6809/1571723771] conn(0x556ae2e55de0 msgr2=0x7efc900fd900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:21.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:21.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:21.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:21.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:21.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:21.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:21.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:21.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:21.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 zone default found 2024-09-12T18:55:21.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 4 Realm: () 2024-09-12T18:55:21.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:21.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:21.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:21.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 zonegroup default 2024-09-12T18:55:21.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.068+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.072+0000 7efc97d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.072+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.072+0000 7efc97d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.072+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.072+0000 7efc97d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.072+0000 7efc97d399c0 20 started sync module instance, tier type = 2024-09-12T18:55:21.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.072+0000 7efc97d399c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:21.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.092+0000 7efc97d399c0 20 add_watcher() i=0 2024-09-12T18:55:21.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.092+0000 7efc97d399c0 20 add_watcher() i=1 2024-09-12T18:55:21.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.092+0000 7efc97d399c0 20 add_watcher() i=2 2024-09-12T18:55:21.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.092+0000 7efc97d399c0 20 add_watcher() i=3 2024-09-12T18:55:21.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.092+0000 7efc97d399c0 20 add_watcher() i=4 2024-09-12T18:55:21.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.092+0000 7efc97d399c0 20 add_watcher() i=5 2024-09-12T18:55:21.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.092+0000 7efc97d399c0 20 add_watcher() i=6 2024-09-12T18:55:21.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.096+0000 7efc97d399c0 20 add_watcher() i=7 2024-09-12T18:55:21.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.096+0000 7efc97d399c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:21.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efb477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:21.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efc97d399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:21.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efc97d399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:21.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efc97d399c0 5 note: GC not initialized 2024-09-12T18:55:21.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efb467fc640 20 reqs_thread_entry: start 2024-09-12T18:55:21.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efc97d399c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:21.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efc97d399c0 20 Filter name: none 2024-09-12T18:55:21.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efc97d399c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T18:55:21.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efab7fff640 20 reqs_thread_entry: start 2024-09-12T18:55:21.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efc97d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efc97d399c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T18:55:21.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efc97d399c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:55:21.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efc97d399c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T18:55:21.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.100+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T18:55:21.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:55:21.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 10 cache get: name=default.rgw.meta+users.keys+JRXLINYJOFZJFTZTYHIE : miss 2024-09-12T18:55:21.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 10 cache put: name=default.rgw.meta+users.keys+JRXLINYJOFZJFTZTYHIE info.flags=0x0 2024-09-12T18:55:21.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 10 adding default.rgw.meta+users.keys+JRXLINYJOFZJFTZTYHIE to cache LRU end 2024-09-12T18:55:21.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-12T18:55:21.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T18:55:21.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T18:55:21.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T18:55:21.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:55:21.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 10 cache get: name=default.rgw.meta+users.keys+JRXLINYJOFZJFTZTYHIE : hit (negative entry) 2024-09-12T18:55:21.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.104+0000 7efc97d399c0 10 cache get: name=default.rgw.meta+users.keys+JRXLINYJOFZJFTZTYHIE : hit (negative entry) 2024-09-12T18:55:21.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.108+0000 7efc97d399c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:55:21.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.108+0000 7efc97d399c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:55:21.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.108+0000 7efc97d399c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T18:55:21.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.108+0000 7efb797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333729 cookie 93917563561664 notifier 9180 bl.length()=732 2024-09-12T18:55:21.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.108+0000 7efb797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:55:21.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.108+0000 7efb797fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:55:21.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.112+0000 7efc97d399c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T18:55:21.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.112+0000 7efc97d399c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:55:21.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.112+0000 7efc97d399c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T18:55:21.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.112+0000 7efb78ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333548 cookie 93917563570992 notifier 9180 bl.length()=215 2024-09-12T18:55:21.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.112+0000 7efb78ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T18:55:21.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.112+0000 7efb78ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T18:55:21.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.116+0000 7efc97d399c0 10 cache put: name=default.rgw.meta+users.keys+JRXLINYJOFZJFTZTYHIE info.flags=0x7 2024-09-12T18:55:21.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.116+0000 7efc97d399c0 10 moving default.rgw.meta+users.keys+JRXLINYJOFZJFTZTYHIE to cache LRU end 2024-09-12T18:55:21.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.116+0000 7efc97d399c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:JRXLINYJOFZJFTZTYHIE, ofs0, ns] 2024-09-12T18:55:21.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.116+0000 7efb78ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 93917563557824 notifier 9180 bl.length()=201 2024-09-12T18:55:21.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.116+0000 7efb78ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JRXLINYJOFZJFTZTYHIE info.flags=0x7 2024-09-12T18:55:21.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.116+0000 7efb78ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JRXLINYJOFZJFTZTYHIE to cache LRU end 2024-09-12T18:55:21.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.120+0000 7efc97d399c0 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-12T18:55:21.123 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:55:21.123 INFO:teuthology.orchestra.run.smithi111.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T18:55:21.123 INFO:teuthology.orchestra.run.smithi111.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-12T18:55:21.123 INFO:teuthology.orchestra.run.smithi111.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T18:55:21.123 INFO:teuthology.orchestra.run.smithi111.stdout: "suspended": 0, 2024-09-12T18:55:21.123 INFO:teuthology.orchestra.run.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:55:21.124 INFO:teuthology.orchestra.run.smithi111.stdout: "subusers": [], 2024-09-12T18:55:21.124 INFO:teuthology.orchestra.run.smithi111.stdout: "keys": [ 2024-09-12T18:55:21.124 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:55:21.124 INFO:teuthology.orchestra.run.smithi111.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T18:55:21.124 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "JRXLINYJOFZJFTZTYHIE", 2024-09-12T18:55:21.124 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "24msqSYeOXF7KwnRG5ACvatl81uLHmqB+AALko4CeKf6YOgDUpXMqA==", 2024-09-12T18:55:21.124 INFO:teuthology.orchestra.run.smithi111.stdout: "active": true, 2024-09-12T18:55:21.124 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:55:21.107989Z" 2024-09-12T18:55:21.124 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:55:21.124 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:55:21.124 INFO:teuthology.orchestra.run.smithi111.stdout: "swift_keys": [], 2024-09-12T18:55:21.124 INFO:teuthology.orchestra.run.smithi111.stdout: "caps": [], 2024-09-12T18:55:21.125 INFO:teuthology.orchestra.run.smithi111.stdout: "op_mask": "read, write, delete", 2024-09-12T18:55:21.125 INFO:teuthology.orchestra.run.smithi111.stdout: "default_placement": "", 2024-09-12T18:55:21.125 INFO:teuthology.orchestra.run.smithi111.stdout: "default_storage_class": "", 2024-09-12T18:55:21.125 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_tags": [], 2024-09-12T18:55:21.125 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2024-09-12T18:55:21.125 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:21.125 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:21.125 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:21.125 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:21.125 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:21.125 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:21.125 INFO:teuthology.orchestra.run.smithi111.stdout: "user_quota": { 2024-09-12T18:55:21.125 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:21.125 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:21.126 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:21.126 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:21.126 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:21.126 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:21.126 INFO:teuthology.orchestra.run.smithi111.stdout: "temp_url_keys": [], 2024-09-12T18:55:21.126 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "root", 2024-09-12T18:55:21.126 INFO:teuthology.orchestra.run.smithi111.stdout: "mfa_ids": [], 2024-09-12T18:55:21.126 INFO:teuthology.orchestra.run.smithi111.stdout: "account_id": "RGW33333333333333333", 2024-09-12T18:55:21.126 INFO:teuthology.orchestra.run.smithi111.stdout: "path": "/", 2024-09-12T18:55:21.126 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:55:21.107958Z", 2024-09-12T18:55:21.126 INFO:teuthology.orchestra.run.smithi111.stdout: "tags": [], 2024-09-12T18:55:21.126 INFO:teuthology.orchestra.run.smithi111.stdout: "group_ids": [] 2024-09-12T18:55:21.127 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:55:21.127 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:21.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.120+0000 7efb477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:21.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.128+0000 7efc97d399c0 20 remove_watcher() i=0 2024-09-12T18:55:21.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.128+0000 7efc97d399c0 2 removed watcher, disabling cache 2024-09-12T18:55:21.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.128+0000 7efc97d399c0 20 remove_watcher() i=1 2024-09-12T18:55:21.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.132+0000 7efc97d399c0 20 remove_watcher() i=2 2024-09-12T18:55:21.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.132+0000 7efc97d399c0 20 remove_watcher() i=3 2024-09-12T18:55:21.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.136+0000 7efc97d399c0 20 remove_watcher() i=4 2024-09-12T18:55:21.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.136+0000 7efc97d399c0 20 remove_watcher() i=5 2024-09-12T18:55:21.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.136+0000 7efc97d399c0 20 remove_watcher() i=6 2024-09-12T18:55:21.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.140+0000 7efc97d399c0 20 remove_watcher() i=7 2024-09-12T18:55:21.157 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 3088371496 --totp-seed NNE24SYW4AUK3AZWDR4FIRSUPK4YGXUBFAWB4GSZKGZAXQMUWKA5HAN5UISTXCPZ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:55:21.199 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:21.199 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:21.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.236+0000 7f40217b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.240+0000 7f40217b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.240+0000 7f40217b09c0 20 realm 2024-09-12T18:55:21.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.240+0000 7f40217b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.240+0000 7f40217b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.240+0000 7f40217b09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:21.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.240+0000 7f40217b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.240+0000 7f40217b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.240+0000 7f40217b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.240+0000 7f40217b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:21.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.240+0000 7f40217b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.244+0000 7f40217b09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:21.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.244+0000 7f40217b09c0 20 searching for the correct realm 2024-09-12T18:55:21.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.248+0000 7f401f2b6640 0 -- 172.21.15.111:0/3474876601 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f40180ec040 msgr2=0x7f40180ec930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:21.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.252+0000 7f401eab5640 0 -- 172.21.15.111:0/3474876601 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f40180fd920 msgr2=0x7f40180b2400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:21.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.468+0000 7f40217b09c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:21.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.468+0000 7f40217b09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:21.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.468+0000 7f40217b09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:21.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.468+0000 7f40217b09c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:21.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.468+0000 7f40217b09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:21.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.468+0000 7f40217b09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:21.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.468+0000 7f40217b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.468+0000 7f40217b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.468+0000 7f40217b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.472+0000 7f40217b09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:21.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.472+0000 7f40217b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.472+0000 7f40217b09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:21.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.472+0000 7f40217b09c0 20 zone default found 2024-09-12T18:55:21.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.472+0000 7f40217b09c0 4 Realm: () 2024-09-12T18:55:21.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.472+0000 7f40217b09c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:21.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.472+0000 7f40217b09c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:21.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.472+0000 7f40217b09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:21.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.472+0000 7f40217b09c0 20 zonegroup default 2024-09-12T18:55:21.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.472+0000 7f40217b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.472+0000 7f40217b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.472+0000 7f40217b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.472+0000 7f40217b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.472+0000 7f40217b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.476+0000 7f40217b09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.476+0000 7f40217b09c0 20 started sync module instance, tier type = 2024-09-12T18:55:21.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.476+0000 7f40217b09c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:21.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.500+0000 7f40217b09c0 20 add_watcher() i=0 2024-09-12T18:55:21.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.500+0000 7f40217b09c0 20 add_watcher() i=1 2024-09-12T18:55:21.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.500+0000 7f40217b09c0 20 add_watcher() i=2 2024-09-12T18:55:21.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.500+0000 7f40217b09c0 20 add_watcher() i=3 2024-09-12T18:55:21.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.500+0000 7f40217b09c0 20 add_watcher() i=4 2024-09-12T18:55:21.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.500+0000 7f40217b09c0 20 add_watcher() i=5 2024-09-12T18:55:21.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.500+0000 7f40217b09c0 20 add_watcher() i=6 2024-09-12T18:55:21.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.500+0000 7f40217b09c0 20 add_watcher() i=7 2024-09-12T18:55:21.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.500+0000 7f40217b09c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:21.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.504+0000 7f3ed5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:21.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.504+0000 7f40217b09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:21.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.504+0000 7f40217b09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:21.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.504+0000 7f40217b09c0 5 note: GC not initialized 2024-09-12T18:55:21.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.504+0000 7f3ed4fe1640 20 reqs_thread_entry: start 2024-09-12T18:55:21.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.508+0000 7f40217b09c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:21.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.508+0000 7f40217b09c0 20 Filter name: none 2024-09-12T18:55:21.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.508+0000 7f3e4e7fc640 20 reqs_thread_entry: start 2024-09-12T18:55:21.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.508+0000 7f40217b09c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T18:55:21.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.508+0000 7f40217b09c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.508+0000 7f40217b09c0 20 rados_obj.operate() r=0 bl.length=532 2024-09-12T18:55:21.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.508+0000 7f40217b09c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T18:55:21.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.508+0000 7f40217b09c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:55:21.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.508+0000 7f40217b09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:55:21.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.512+0000 7f40217b09c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:55:21.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.512+0000 7f40217b09c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:55:21.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.512+0000 7f40217b09c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T18:55:21.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.512+0000 7f3f02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333730 cookie 93836175603632 notifier 9198 bl.length()=746 2024-09-12T18:55:21.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.512+0000 7f3f02ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T18:55:21.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.512+0000 7f3f02ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T18:55:21.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.516+0000 7f3ed5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:21.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.520+0000 7f40217b09c0 20 remove_watcher() i=0 2024-09-12T18:55:21.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.520+0000 7f40217b09c0 2 removed watcher, disabling cache 2024-09-12T18:55:21.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.524+0000 7f40217b09c0 20 remove_watcher() i=1 2024-09-12T18:55:21.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.524+0000 7f40217b09c0 20 remove_watcher() i=2 2024-09-12T18:55:21.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.528+0000 7f40217b09c0 20 remove_watcher() i=3 2024-09-12T18:55:21.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.528+0000 7f40217b09c0 20 remove_watcher() i=4 2024-09-12T18:55:21.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.532+0000 7f40217b09c0 20 remove_watcher() i=5 2024-09-12T18:55:21.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.532+0000 7f40217b09c0 20 remove_watcher() i=6 2024-09-12T18:55:21.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.536+0000 7f40217b09c0 20 remove_watcher() i=7 2024-09-12T18:55:21.556 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T18:55:21.556 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key XHOKMXKNPWNHXEJUIQMG --secret 6aH0TAwOYU8/U13R15tGeDadTGN+a0H1XVIlfwj1eiaUk94BFZ2S5A== --cluster ceph 2024-09-12T18:55:21.642 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:21.642 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:21.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.684+0000 7f391fc059c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.684+0000 7f391fc059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.684+0000 7f391fc059c0 20 realm 2024-09-12T18:55:21.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.684+0000 7f391fc059c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.684+0000 7f391fc059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.684+0000 7f391fc059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:21.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.684+0000 7f391fc059c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.684+0000 7f391fc059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.684+0000 7f391fc059c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.688+0000 7f391fc059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:21.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.688+0000 7f391fc059c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.688+0000 7f391fc059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:21.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.688+0000 7f391fc059c0 20 searching for the correct realm 2024-09-12T18:55:21.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.688+0000 7f391cf0a640 0 -- 172.21.15.111:0/1540661272 >> [v2:172.21.15.111:6824/1702084661,v1:172.21.15.111:6825/1702084661] conn(0x7f3910008040 msgr2=0x7f391005baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:55:21.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.900+0000 7f391d70b640 0 -- 172.21.15.111:0/1540661272 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x55c33c0671d0 msgr2=0x7f39180fca20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:21.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.920+0000 7f391fc059c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:21.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.920+0000 7f391fc059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:21.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.920+0000 7f391fc059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:21.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.920+0000 7f391fc059c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:21.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.920+0000 7f391fc059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:21.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.920+0000 7f391fc059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:21.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.920+0000 7f391fc059c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.920+0000 7f391fc059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.920+0000 7f391fc059c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.920+0000 7f391fc059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:21.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.920+0000 7f391fc059c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.920+0000 7f391fc059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:21.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.924+0000 7f391fc059c0 20 zone default found 2024-09-12T18:55:21.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.924+0000 7f391fc059c0 4 Realm: () 2024-09-12T18:55:21.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.924+0000 7f391fc059c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:21.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.924+0000 7f391fc059c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:21.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.924+0000 7f391fc059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:21.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.924+0000 7f391fc059c0 20 zonegroup default 2024-09-12T18:55:21.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.924+0000 7f391fc059c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.924+0000 7f391fc059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.924+0000 7f391fc059c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.924+0000 7f391fc059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.924+0000 7f391fc059c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.924+0000 7f391fc059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.924+0000 7f391fc059c0 20 started sync module instance, tier type = 2024-09-12T18:55:21.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.924+0000 7f391fc059c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:21.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.944+0000 7f391fc059c0 20 add_watcher() i=0 2024-09-12T18:55:21.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.944+0000 7f391fc059c0 20 add_watcher() i=1 2024-09-12T18:55:21.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.944+0000 7f391fc059c0 20 add_watcher() i=2 2024-09-12T18:55:21.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.944+0000 7f391fc059c0 20 add_watcher() i=3 2024-09-12T18:55:21.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.944+0000 7f391fc059c0 20 add_watcher() i=4 2024-09-12T18:55:21.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.944+0000 7f391fc059c0 20 add_watcher() i=5 2024-09-12T18:55:21.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.944+0000 7f391fc059c0 20 add_watcher() i=6 2024-09-12T18:55:21.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.948+0000 7f391fc059c0 20 add_watcher() i=7 2024-09-12T18:55:21.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.948+0000 7f391fc059c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:21.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.948+0000 7f37d3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:21.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:21.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:21.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 5 note: GC not initialized 2024-09-12T18:55:21.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f37d2fe5640 20 reqs_thread_entry: start 2024-09-12T18:55:21.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:21.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 20 Filter name: none 2024-09-12T18:55:21.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f37d0fe1640 20 reqs_thread_entry: start 2024-09-12T18:55:21.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:55:21.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T18:55:21.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:55:21.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T18:55:21.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T18:55:21.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:55:21.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 10 cache get: name=default.rgw.meta+users.keys+XHOKMXKNPWNHXEJUIQMG : miss 2024-09-12T18:55:21.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:21.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:21.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 10 cache put: name=default.rgw.meta+users.keys+XHOKMXKNPWNHXEJUIQMG info.flags=0x0 2024-09-12T18:55:21.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 10 adding default.rgw.meta+users.keys+XHOKMXKNPWNHXEJUIQMG to cache LRU end 2024-09-12T18:55:21.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 10 cache get: name=default.rgw.meta+users.keys+XHOKMXKNPWNHXEJUIQMG : hit (negative entry) 2024-09-12T18:55:21.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.952+0000 7f391fc059c0 10 cache get: name=default.rgw.meta+users.keys+XHOKMXKNPWNHXEJUIQMG : hit (negative entry) 2024-09-12T18:55:21.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.956+0000 7f391fc059c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:55:21.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.956+0000 7f391fc059c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:55:21.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.956+0000 7f391fc059c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:55:21.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.956+0000 7f3800ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333549 cookie 94297015451728 notifier 9216 bl.length()=660 2024-09-12T18:55:21.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.956+0000 7f3800ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:55:21.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.956+0000 7f3800ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:55:21.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.960+0000 7f391fc059c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T18:55:21.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.960+0000 7f391fc059c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:55:21.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.960+0000 7f391fc059c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T18:55:21.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.960+0000 7f3800ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333552 cookie 94297015432320 notifier 9216 bl.length()=191 2024-09-12T18:55:21.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.960+0000 7f3800ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T18:55:21.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.960+0000 7f3800ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T18:55:21.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.964+0000 7f391fc059c0 10 cache put: name=default.rgw.meta+users.keys+XHOKMXKNPWNHXEJUIQMG info.flags=0x7 2024-09-12T18:55:21.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.964+0000 7f391fc059c0 10 moving default.rgw.meta+users.keys+XHOKMXKNPWNHXEJUIQMG to cache LRU end 2024-09-12T18:55:21.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.964+0000 7f391fc059c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:XHOKMXKNPWNHXEJUIQMG, ofs0, ns] 2024-09-12T18:55:21.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.964+0000 7f3800ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333625 cookie 94297015439360 notifier 9216 bl.length()=189 2024-09-12T18:55:21.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.964+0000 7f3800ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XHOKMXKNPWNHXEJUIQMG info.flags=0x7 2024-09-12T18:55:21.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.964+0000 7f3800ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XHOKMXKNPWNHXEJUIQMG to cache LRU end 2024-09-12T18:55:21.969 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:55:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "user_id": "foobar.client.0", 2024-09-12T18:55:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T18:55:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "email": "foobar+test@test.test", 2024-09-12T18:55:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "suspended": 0, 2024-09-12T18:55:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:55:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "subusers": [], 2024-09-12T18:55:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: "keys": [ 2024-09-12T18:55:21.969 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "user": "foobar.client.0", 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "XHOKMXKNPWNHXEJUIQMG", 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "6aH0TAwOYU8/U13R15tGeDadTGN+a0H1XVIlfwj1eiaUk94BFZ2S5A==", 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "active": true, 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:55:21.955627Z" 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "swift_keys": [], 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "caps": [], 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "op_mask": "read, write, delete", 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "default_placement": "", 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "default_storage_class": "", 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_tags": [], 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2024-09-12T18:55:21.970 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "user_quota": { 2024-09-12T18:55:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:21.971 INFO:teuthology.orchestra.run.smithi111.stdout: "temp_url_keys": [], 2024-09-12T18:55:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "rgw", 2024-09-12T18:55:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: "mfa_ids": [], 2024-09-12T18:55:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: "account_id": "", 2024-09-12T18:55:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: "path": "/", 2024-09-12T18:55:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:55:21.955610Z", 2024-09-12T18:55:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: "tags": [], 2024-09-12T18:55:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: "group_ids": [] 2024-09-12T18:55:21.972 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:55:21.972 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:21.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.968+0000 7f37d3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:21.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.972+0000 7f391fc059c0 20 remove_watcher() i=0 2024-09-12T18:55:21.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.972+0000 7f391fc059c0 2 removed watcher, disabling cache 2024-09-12T18:55:21.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.976+0000 7f391fc059c0 20 remove_watcher() i=1 2024-09-12T18:55:21.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.976+0000 7f391fc059c0 20 remove_watcher() i=2 2024-09-12T18:55:21.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.980+0000 7f391fc059c0 20 remove_watcher() i=3 2024-09-12T18:55:21.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.980+0000 7f391fc059c0 20 remove_watcher() i=4 2024-09-12T18:55:21.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.984+0000 7f391fc059c0 20 remove_watcher() i=5 2024-09-12T18:55:21.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.984+0000 7f391fc059c0 20 remove_watcher() i=6 2024-09-12T18:55:21.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:21.984+0000 7f391fc059c0 20 remove_watcher() i=7 2024-09-12T18:55:22.004 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 6281743520 --totp-seed ESRB2Y5YSE7STNFUMATH3BV6CPD2WJBGZIDJFHF7BDKJDZYG4KWWQOENVQZ545VN --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:55:22.087 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:22.087 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:22.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.128+0000 7fad1303e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.128+0000 7fad1303e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:22.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.128+0000 7fad1303e9c0 20 realm 2024-09-12T18:55:22.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.128+0000 7fad1303e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.128+0000 7fad1303e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:22.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.128+0000 7fad1303e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:22.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.128+0000 7fad1303e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.128+0000 7fad1303e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:22.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.128+0000 7fad1303e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.132+0000 7fad1303e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:22.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.132+0000 7fad1303e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.132+0000 7fad1303e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:22.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.132+0000 7fad1303e9c0 20 searching for the correct realm 2024-09-12T18:55:22.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.136+0000 7fad10b44640 0 -- 172.21.15.111:0/839056070 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fad0807b900 msgr2=0x7fad0800d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:22.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.144+0000 7fad10343640 0 -- 172.21.15.111:0/839056070 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fad08078100 msgr2=0x7fad08029970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:22.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.360+0000 7fad1303e9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:22.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.360+0000 7fad1303e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:22.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.360+0000 7fad1303e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:22.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.360+0000 7fad1303e9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:22.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.360+0000 7fad1303e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:22.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.360+0000 7fad1303e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:22.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.360+0000 7fad1303e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.360+0000 7fad1303e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:22.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.360+0000 7fad1303e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:22.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:22.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 20 zone default found 2024-09-12T18:55:22.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 4 Realm: () 2024-09-12T18:55:22.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:22.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:22.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:22.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 20 zonegroup default 2024-09-12T18:55:22.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:22.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:22.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:22.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 20 started sync module instance, tier type = 2024-09-12T18:55:22.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.364+0000 7fad1303e9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:22.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.388+0000 7fad1303e9c0 20 add_watcher() i=0 2024-09-12T18:55:22.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.388+0000 7fad1303e9c0 20 add_watcher() i=1 2024-09-12T18:55:22.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.388+0000 7fad1303e9c0 20 add_watcher() i=2 2024-09-12T18:55:22.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.388+0000 7fad1303e9c0 20 add_watcher() i=3 2024-09-12T18:55:22.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.388+0000 7fad1303e9c0 20 add_watcher() i=4 2024-09-12T18:55:22.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.388+0000 7fad1303e9c0 20 add_watcher() i=5 2024-09-12T18:55:22.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.388+0000 7fad1303e9c0 20 add_watcher() i=6 2024-09-12T18:55:22.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.392+0000 7fad1303e9c0 20 add_watcher() i=7 2024-09-12T18:55:22.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.392+0000 7fad1303e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:22.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.396+0000 7fabc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:22.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.396+0000 7fad1303e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:22.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.396+0000 7fad1303e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:22.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.396+0000 7fad1303e9c0 5 note: GC not initialized 2024-09-12T18:55:22.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.396+0000 7fabc5fe3640 20 reqs_thread_entry: start 2024-09-12T18:55:22.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.396+0000 7fad1303e9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:22.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.396+0000 7fad1303e9c0 20 Filter name: none 2024-09-12T18:55:22.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.396+0000 7fab377fe640 20 reqs_thread_entry: start 2024-09-12T18:55:22.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.396+0000 7fad1303e9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:55:22.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.396+0000 7fad1303e9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.400+0000 7fad1303e9c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T18:55:22.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.400+0000 7fad1303e9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T18:55:22.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.400+0000 7fad1303e9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:55:22.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.400+0000 7fad1303e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:55:22.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.404+0000 7fad1303e9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:55:22.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.404+0000 7fad1303e9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:55:22.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.404+0000 7fad1303e9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:55:22.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.404+0000 7fabe7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333550 cookie 94559975198864 notifier 8597 bl.length()=674 2024-09-12T18:55:22.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.404+0000 7fabe7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:55:22.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.404+0000 7fabe7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:55:22.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.408+0000 7fabc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:22.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.412+0000 7fad1303e9c0 20 remove_watcher() i=0 2024-09-12T18:55:22.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.412+0000 7fad1303e9c0 2 removed watcher, disabling cache 2024-09-12T18:55:22.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.416+0000 7fad1303e9c0 20 remove_watcher() i=1 2024-09-12T18:55:22.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.416+0000 7fad1303e9c0 20 remove_watcher() i=2 2024-09-12T18:55:22.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.420+0000 7fad1303e9c0 20 remove_watcher() i=3 2024-09-12T18:55:22.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.420+0000 7fad1303e9c0 20 remove_watcher() i=4 2024-09-12T18:55:22.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.424+0000 7fad1303e9c0 20 remove_watcher() i=5 2024-09-12T18:55:22.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.424+0000 7fad1303e9c0 20 remove_watcher() i=6 2024-09-12T18:55:22.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.424+0000 7fad1303e9c0 20 remove_watcher() i=7 2024-09-12T18:55:22.446 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T18:55:22.526 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:22.527 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:22.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.564+0000 7f26749f49c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.568+0000 7f26749f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:22.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.568+0000 7f26749f49c0 20 realm 2024-09-12T18:55:22.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.568+0000 7f26749f49c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.568+0000 7f26749f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:22.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.568+0000 7f26749f49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:22.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.568+0000 7f26749f49c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.568+0000 7f26749f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:22.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.568+0000 7f26749f49c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.572+0000 7f26749f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:22.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.572+0000 7f26749f49c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.572+0000 7f26749f49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:22.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.572+0000 7f26749f49c0 20 searching for the correct realm 2024-09-12T18:55:22.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.576+0000 7f26724fa640 0 -- 172.21.15.111:0/352175556 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f2664018070 msgr2=0x7f2664099ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:22.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.584+0000 7f2671cf9640 0 -- 172.21.15.111:0/352175556 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f266407c250 msgr2=0x7f2664063800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:22.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.800+0000 7f26749f49c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:22.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.800+0000 7f26749f49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:22.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.800+0000 7f26749f49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:22.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.800+0000 7f26749f49c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:22.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.800+0000 7f26749f49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:22.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.800+0000 7f26749f49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:22.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.800+0000 7f26749f49c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.800+0000 7f26749f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:22.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.800+0000 7f26749f49c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.804+0000 7f26749f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:22.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.804+0000 7f26749f49c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.804+0000 7f26749f49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:22.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.804+0000 7f26749f49c0 20 zone default found 2024-09-12T18:55:22.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.804+0000 7f26749f49c0 4 Realm: () 2024-09-12T18:55:22.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.804+0000 7f26749f49c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:22.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.804+0000 7f26749f49c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:22.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.804+0000 7f26749f49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:22.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.804+0000 7f26749f49c0 20 zonegroup default 2024-09-12T18:55:22.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.804+0000 7f26749f49c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.804+0000 7f26749f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:22.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.804+0000 7f26749f49c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.804+0000 7f26749f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:22.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.804+0000 7f26749f49c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.808+0000 7f26749f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:22.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.808+0000 7f26749f49c0 20 started sync module instance, tier type = 2024-09-12T18:55:22.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.808+0000 7f26749f49c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:22.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.832+0000 7f26749f49c0 20 add_watcher() i=0 2024-09-12T18:55:22.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.832+0000 7f26749f49c0 20 add_watcher() i=1 2024-09-12T18:55:22.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.832+0000 7f26749f49c0 20 add_watcher() i=2 2024-09-12T18:55:22.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.832+0000 7f26749f49c0 20 add_watcher() i=3 2024-09-12T18:55:22.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.832+0000 7f26749f49c0 20 add_watcher() i=4 2024-09-12T18:55:22.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.832+0000 7f26749f49c0 20 add_watcher() i=5 2024-09-12T18:55:22.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.832+0000 7f26749f49c0 20 add_watcher() i=6 2024-09-12T18:55:22.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.832+0000 7f26749f49c0 20 add_watcher() i=7 2024-09-12T18:55:22.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.832+0000 7f26749f49c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:22.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.836+0000 7f2528fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:22.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.836+0000 7f26749f49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:22.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.836+0000 7f26749f49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:22.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.836+0000 7f26749f49c0 5 note: GC not initialized 2024-09-12T18:55:22.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.836+0000 7f24a37fe640 20 reqs_thread_entry: start 2024-09-12T18:55:22.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.836+0000 7f26749f49c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:22.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.840+0000 7f26749f49c0 20 Filter name: none 2024-09-12T18:55:22.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.840+0000 7f24a17fa640 20 reqs_thread_entry: start 2024-09-12T18:55:22.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.840+0000 7f26749f49c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T18:55:22.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.840+0000 7f26749f49c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:22.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.840+0000 7f26749f49c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T18:55:22.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.840+0000 7f26749f49c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T18:55:22.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.840+0000 7f26749f49c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:55:22.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.840+0000 7f26749f49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:55:22.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.840+0000 7f26749f49c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:55:22.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.840+0000 7f26749f49c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:55:22.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.840+0000 7f26749f49c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T18:55:22.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.840+0000 7f2555ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333551 cookie 94726796989024 notifier 8612 bl.length()=727 2024-09-12T18:55:22.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.840+0000 7f2555ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T18:55:22.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.840+0000 7f2555ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T18:55:22.845 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:55:22.845 INFO:teuthology.orchestra.run.smithi111.stdout: "user_id": "foobar.client.0", 2024-09-12T18:55:22.845 INFO:teuthology.orchestra.run.smithi111.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T18:55:22.845 INFO:teuthology.orchestra.run.smithi111.stdout: "email": "foobar+test@test.test", 2024-09-12T18:55:22.846 INFO:teuthology.orchestra.run.smithi111.stdout: "suspended": 0, 2024-09-12T18:55:22.846 INFO:teuthology.orchestra.run.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:55:22.846 INFO:teuthology.orchestra.run.smithi111.stdout: "subusers": [], 2024-09-12T18:55:22.846 INFO:teuthology.orchestra.run.smithi111.stdout: "keys": [ 2024-09-12T18:55:22.846 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:55:22.846 INFO:teuthology.orchestra.run.smithi111.stdout: "user": "foobar.client.0", 2024-09-12T18:55:22.846 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "XHOKMXKNPWNHXEJUIQMG", 2024-09-12T18:55:22.846 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "6aH0TAwOYU8/U13R15tGeDadTGN+a0H1XVIlfwj1eiaUk94BFZ2S5A==", 2024-09-12T18:55:22.846 INFO:teuthology.orchestra.run.smithi111.stdout: "active": true, 2024-09-12T18:55:22.846 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:55:21.955627Z" 2024-09-12T18:55:22.846 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:55:22.846 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:55:22.846 INFO:teuthology.orchestra.run.smithi111.stdout: "swift_keys": [], 2024-09-12T18:55:22.847 INFO:teuthology.orchestra.run.smithi111.stdout: "caps": [ 2024-09-12T18:55:22.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:55:22.847 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "oidc-provider", 2024-09-12T18:55:22.847 INFO:teuthology.orchestra.run.smithi111.stdout: "perm": "*" 2024-09-12T18:55:22.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:22.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:55:22.847 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "roles", 2024-09-12T18:55:22.847 INFO:teuthology.orchestra.run.smithi111.stdout: "perm": "*" 2024-09-12T18:55:22.847 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:22.847 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:55:22.847 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "user-policy", 2024-09-12T18:55:22.847 INFO:teuthology.orchestra.run.smithi111.stdout: "perm": "*" 2024-09-12T18:55:22.847 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: "op_mask": "read, write, delete", 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: "default_placement": "", 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: "default_storage_class": "", 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_tags": [], 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: "user_quota": { 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:22.848 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:22.849 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:22.849 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:22.849 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:22.849 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:22.849 INFO:teuthology.orchestra.run.smithi111.stdout: "temp_url_keys": [], 2024-09-12T18:55:22.849 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "rgw", 2024-09-12T18:55:22.849 INFO:teuthology.orchestra.run.smithi111.stdout: "mfa_ids": [ 2024-09-12T18:55:22.849 INFO:teuthology.orchestra.run.smithi111.stdout: "6281743520" 2024-09-12T18:55:22.849 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:55:22.849 INFO:teuthology.orchestra.run.smithi111.stdout: "account_id": "", 2024-09-12T18:55:22.849 INFO:teuthology.orchestra.run.smithi111.stdout: "path": "/", 2024-09-12T18:55:22.849 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:55:21.955610Z", 2024-09-12T18:55:22.849 INFO:teuthology.orchestra.run.smithi111.stdout: "tags": [], 2024-09-12T18:55:22.849 INFO:teuthology.orchestra.run.smithi111.stdout: "group_ids": [] 2024-09-12T18:55:22.850 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:55:22.850 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:22.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.844+0000 7f2528fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:22.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.848+0000 7f26749f49c0 20 remove_watcher() i=0 2024-09-12T18:55:22.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.848+0000 7f26749f49c0 2 removed watcher, disabling cache 2024-09-12T18:55:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.852+0000 7f26749f49c0 20 remove_watcher() i=1 2024-09-12T18:55:22.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.852+0000 7f26749f49c0 20 remove_watcher() i=2 2024-09-12T18:55:22.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.856+0000 7f26749f49c0 20 remove_watcher() i=3 2024-09-12T18:55:22.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.860+0000 7f26749f49c0 20 remove_watcher() i=4 2024-09-12T18:55:22.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.860+0000 7f26749f49c0 20 remove_watcher() i=5 2024-09-12T18:55:22.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.860+0000 7f26749f49c0 20 remove_watcher() i=6 2024-09-12T18:55:22.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:22.864+0000 7f26749f49c0 20 remove_watcher() i=7 2024-09-12T18:55:22.881 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T18:55:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:23.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.000+0000 7f131e6269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.004+0000 7f131e6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.004+0000 7f131e6269c0 20 realm 2024-09-12T18:55:23.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.004+0000 7f131e6269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.004+0000 7f131e6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.004+0000 7f131e6269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:23.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.004+0000 7f131e6269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.004+0000 7f131e6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.004+0000 7f131e6269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.004+0000 7f131e6269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:23.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.004+0000 7f131e6269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.004+0000 7f131e6269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.004+0000 7f131e6269c0 20 searching for the correct realm 2024-09-12T18:55:23.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.012+0000 7f131c12c640 0 -- 172.21.15.111:0/3150670923 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f130c030040 msgr2=0x7f130c067660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:23.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.016+0000 7f131b92b640 0 -- 172.21.15.111:0/3150670923 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f130c068bf0 msgr2=0x7f130c071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.232+0000 7f131e6269c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.232+0000 7f131e6269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.232+0000 7f131e6269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.232+0000 7f131e6269c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.232+0000 7f131e6269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.232+0000 7f131e6269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.232+0000 7f131e6269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.232+0000 7f131e6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.232+0000 7f131e6269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:23.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:23.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 20 zone default found 2024-09-12T18:55:23.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 4 Realm: () 2024-09-12T18:55:23.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:23.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:23.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:23.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 20 zonegroup default 2024-09-12T18:55:23.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 20 started sync module instance, tier type = 2024-09-12T18:55:23.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.236+0000 7f131e6269c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:23.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.260+0000 7f131e6269c0 20 add_watcher() i=0 2024-09-12T18:55:23.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.260+0000 7f131e6269c0 20 add_watcher() i=1 2024-09-12T18:55:23.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.260+0000 7f131e6269c0 20 add_watcher() i=2 2024-09-12T18:55:23.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.260+0000 7f131e6269c0 20 add_watcher() i=3 2024-09-12T18:55:23.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.260+0000 7f131e6269c0 20 add_watcher() i=4 2024-09-12T18:55:23.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.260+0000 7f131e6269c0 20 add_watcher() i=5 2024-09-12T18:55:23.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.260+0000 7f131e6269c0 20 add_watcher() i=6 2024-09-12T18:55:23.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.264+0000 7f131e6269c0 20 add_watcher() i=7 2024-09-12T18:55:23.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.264+0000 7f131e6269c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:23.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.268+0000 7f11d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:23.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.268+0000 7f131e6269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:23.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.268+0000 7f131e6269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:23.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.268+0000 7f131e6269c0 5 note: GC not initialized 2024-09-12T18:55:23.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.268+0000 7f11d1fdb640 20 reqs_thread_entry: start 2024-09-12T18:55:23.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.268+0000 7f131e6269c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:23.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.268+0000 7f131e6269c0 20 Filter name: none 2024-09-12T18:55:23.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.268+0000 7f11437fe640 20 reqs_thread_entry: start 2024-09-12T18:55:23.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.268+0000 7f131e6269c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T18:55:23.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.268+0000 7f131e6269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.272+0000 7f131e6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.272+0000 7f131e6269c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T18:55:23.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.272+0000 7f131e6269c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:55:23.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.272+0000 7f131e6269c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T18:55:23.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.272+0000 7f131e6269c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T18:55:23.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.272+0000 7f131e6269c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.272+0000 7f131e6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.272+0000 7f131e6269c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T18:55:23.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.272+0000 7f131e6269c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:55:23.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.272+0000 7f131e6269c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T18:55:23.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.272+0000 7f131e6269c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:55:23.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.272+0000 7f131e6269c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:55:23.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.272+0000 7f131e6269c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T18:55:23.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.276+0000 7f11f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333553 cookie 94785432821392 notifier 9273 bl.length()=384 2024-09-12T18:55:23.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.276+0000 7f11f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:55:23.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.276+0000 7f11f37fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:55:23.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.280+0000 7f131e6269c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T18:55:23.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.280+0000 7f131e6269c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:55:23.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.280+0000 7f131e6269c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T18:55:23.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.280+0000 7f11f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333626 cookie 94785432835616 notifier 9273 bl.length()=225 2024-09-12T18:55:23.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.280+0000 7f11f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T18:55:23.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.280+0000 7f11f37fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T18:55:23.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.284+0000 7f131e6269c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T18:55:23.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.284+0000 7f131e6269c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:55:23.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.284+0000 7f131e6269c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T18:55:23.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.284+0000 7f11f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333529 cookie 94785432834560 notifier 9273 bl.length()=234 2024-09-12T18:55:23.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.284+0000 7f11f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T18:55:23.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.284+0000 7f11f37fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T18:55:23.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.284+0000 7f11d2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:23.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.292+0000 7f131e6269c0 20 remove_watcher() i=0 2024-09-12T18:55:23.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.292+0000 7f131e6269c0 2 removed watcher, disabling cache 2024-09-12T18:55:23.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.292+0000 7f131e6269c0 20 remove_watcher() i=1 2024-09-12T18:55:23.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.296+0000 7f131e6269c0 20 remove_watcher() i=2 2024-09-12T18:55:23.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.296+0000 7f131e6269c0 20 remove_watcher() i=3 2024-09-12T18:55:23.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.300+0000 7f131e6269c0 20 remove_watcher() i=4 2024-09-12T18:55:23.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.300+0000 7f131e6269c0 20 remove_watcher() i=5 2024-09-12T18:55:23.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.304+0000 7f131e6269c0 20 remove_watcher() i=6 2024-09-12T18:55:23.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.304+0000 7f131e6269c0 20 remove_watcher() i=7 2024-09-12T18:55:23.323 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:55:23.324 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "RGW88888888888888888", 2024-09-12T18:55:23.324 INFO:teuthology.orchestra.run.smithi111.stdout: "tenant": "", 2024-09-12T18:55:23.324 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T18:55:23.324 INFO:teuthology.orchestra.run.smithi111.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T18:55:23.324 INFO:teuthology.orchestra.run.smithi111.stdout: "quota": { 2024-09-12T18:55:23.324 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:23.324 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:23.324 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:23.324 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:23.324 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:23.324 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:23.324 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2024-09-12T18:55:23.324 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:23.325 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:23.325 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:23.325 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:23.325 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:23.325 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:23.325 INFO:teuthology.orchestra.run.smithi111.stdout: "max_users": 1000, 2024-09-12T18:55:23.325 INFO:teuthology.orchestra.run.smithi111.stdout: "max_roles": 1000, 2024-09-12T18:55:23.325 INFO:teuthology.orchestra.run.smithi111.stdout: "max_groups": 1000, 2024-09-12T18:55:23.325 INFO:teuthology.orchestra.run.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:55:23.325 INFO:teuthology.orchestra.run.smithi111.stdout: "max_access_keys": 4 2024-09-12T18:55:23.325 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:55:23.327 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T18:55:23.327 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key KJOGWFONZPPRTCWBIIVP --secret QBeCt51pVIi+GYJBuyHqcaaYvjxIz7dJ+oud0VfltEvbMIQAaGabpQ== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T18:55:23.417 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:23.417 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:23.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.456+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.456+0000 7f457431c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.456+0000 7f457431c9c0 20 realm 2024-09-12T18:55:23.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.456+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.456+0000 7f457431c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.456+0000 7f457431c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:23.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.456+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.456+0000 7f457431c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.456+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.460+0000 7f457431c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:23.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.460+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.460+0000 7f457431c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:23.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.460+0000 7f457431c9c0 20 searching for the correct realm 2024-09-12T18:55:23.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.464+0000 7f4572623640 0 -- 172.21.15.111:0/1089170659 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x5613d6c9f290 msgr2=0x5613d6ca1680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:55:23.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.472+0000 7f4571621640 0 -- 172.21.15.111:0/1089170659 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f456c072230 msgr2=0x7f456c067800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T18:55:23.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.688+0000 7f457431c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:23.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.688+0000 7f457431c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:23.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.688+0000 7f457431c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:23.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.688+0000 7f457431c9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:23.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.688+0000 7f457431c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:23.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.688+0000 7f457431c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:23.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.688+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.688+0000 7f457431c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.688+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:23.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:23.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 20 zone default found 2024-09-12T18:55:23.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 4 Realm: () 2024-09-12T18:55:23.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:23.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:23.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:23.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 20 zonegroup default 2024-09-12T18:55:23.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 20 started sync module instance, tier type = 2024-09-12T18:55:23.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.692+0000 7f457431c9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:23.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.716+0000 7f457431c9c0 20 add_watcher() i=0 2024-09-12T18:55:23.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.716+0000 7f457431c9c0 20 add_watcher() i=1 2024-09-12T18:55:23.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.716+0000 7f457431c9c0 20 add_watcher() i=2 2024-09-12T18:55:23.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.716+0000 7f457431c9c0 20 add_watcher() i=3 2024-09-12T18:55:23.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.716+0000 7f457431c9c0 20 add_watcher() i=4 2024-09-12T18:55:23.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.716+0000 7f457431c9c0 20 add_watcher() i=5 2024-09-12T18:55:23.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.716+0000 7f457431c9c0 20 add_watcher() i=6 2024-09-12T18:55:23.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.720+0000 7f457431c9c0 20 add_watcher() i=7 2024-09-12T18:55:23.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.720+0000 7f457431c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:23.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f4423fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:23.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:23.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:23.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 5 note: GC not initialized 2024-09-12T18:55:23.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f4422ffd640 20 reqs_thread_entry: start 2024-09-12T18:55:23.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:23.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 20 Filter name: none 2024-09-12T18:55:23.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f4420ff9640 20 reqs_thread_entry: start 2024-09-12T18:55:23.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T18:55:23.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T18:55:23.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:55:23.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T18:55:23.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T18:55:23.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:55:23.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 10 cache get: name=default.rgw.meta+users.keys+KJOGWFONZPPRTCWBIIVP : miss 2024-09-12T18:55:23.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.724+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.728+0000 7f457431c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.728+0000 7f457431c9c0 10 cache put: name=default.rgw.meta+users.keys+KJOGWFONZPPRTCWBIIVP info.flags=0x0 2024-09-12T18:55:23.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.728+0000 7f457431c9c0 10 adding default.rgw.meta+users.keys+KJOGWFONZPPRTCWBIIVP to cache LRU end 2024-09-12T18:55:23.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.728+0000 7f457431c9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T18:55:23.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.728+0000 7f457431c9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.728+0000 7f457431c9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T18:55:23.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.728+0000 7f457431c9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T18:55:23.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.728+0000 7f457431c9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T18:55:23.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.728+0000 7f457431c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:55:23.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.728+0000 7f457431c9c0 10 cache get: name=default.rgw.meta+users.keys+KJOGWFONZPPRTCWBIIVP : hit (negative entry) 2024-09-12T18:55:23.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.728+0000 7f457431c9c0 10 cache get: name=default.rgw.meta+users.keys+KJOGWFONZPPRTCWBIIVP : hit (negative entry) 2024-09-12T18:55:23.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.732+0000 7f457431c9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:55:23.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.732+0000 7f457431c9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:55:23.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.732+0000 7f457431c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T18:55:23.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.732+0000 7f44557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333554 cookie 94643207947824 notifier 9291 bl.length()=681 2024-09-12T18:55:23.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.732+0000 7f44557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:55:23.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.732+0000 7f44557fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:55:23.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.732+0000 7f457431c9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T18:55:23.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.732+0000 7f457431c9c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:55:23.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.732+0000 7f457431c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T18:55:23.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.736+0000 7f4454ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333731 cookie 94643207960496 notifier 9291 bl.length()=189 2024-09-12T18:55:23.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.736+0000 7f4454ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T18:55:23.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.736+0000 7f4454ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T18:55:23.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.736+0000 7f457431c9c0 10 cache put: name=default.rgw.meta+users.keys+KJOGWFONZPPRTCWBIIVP info.flags=0x7 2024-09-12T18:55:23.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.736+0000 7f457431c9c0 10 moving default.rgw.meta+users.keys+KJOGWFONZPPRTCWBIIVP to cache LRU end 2024-09-12T18:55:23.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.736+0000 7f457431c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:KJOGWFONZPPRTCWBIIVP, ofs0, ns] 2024-09-12T18:55:23.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.740+0000 7f44557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333627 cookie 94643207953840 notifier 9291 bl.length()=188 2024-09-12T18:55:23.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.740+0000 7f44557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KJOGWFONZPPRTCWBIIVP info.flags=0x7 2024-09-12T18:55:23.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.740+0000 7f44557fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KJOGWFONZPPRTCWBIIVP to cache LRU end 2024-09-12T18:55:23.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.740+0000 7f457431c9c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T18:55:23.745 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:55:23.745 INFO:teuthology.orchestra.run.smithi111.stdout: "user_id": "root1.client.0", 2024-09-12T18:55:23.745 INFO:teuthology.orchestra.run.smithi111.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T18:55:23.745 INFO:teuthology.orchestra.run.smithi111.stdout: "email": "root1+test@test.test", 2024-09-12T18:55:23.745 INFO:teuthology.orchestra.run.smithi111.stdout: "suspended": 0, 2024-09-12T18:55:23.745 INFO:teuthology.orchestra.run.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:55:23.745 INFO:teuthology.orchestra.run.smithi111.stdout: "subusers": [], 2024-09-12T18:55:23.746 INFO:teuthology.orchestra.run.smithi111.stdout: "keys": [ 2024-09-12T18:55:23.746 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:55:23.746 INFO:teuthology.orchestra.run.smithi111.stdout: "user": "root1.client.0", 2024-09-12T18:55:23.746 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "KJOGWFONZPPRTCWBIIVP", 2024-09-12T18:55:23.746 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "QBeCt51pVIi+GYJBuyHqcaaYvjxIz7dJ+oud0VfltEvbMIQAaGabpQ==", 2024-09-12T18:55:23.746 INFO:teuthology.orchestra.run.smithi111.stdout: "active": true, 2024-09-12T18:55:23.746 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:55:23.730536Z" 2024-09-12T18:55:23.746 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:55:23.746 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:55:23.746 INFO:teuthology.orchestra.run.smithi111.stdout: "swift_keys": [], 2024-09-12T18:55:23.746 INFO:teuthology.orchestra.run.smithi111.stdout: "caps": [], 2024-09-12T18:55:23.746 INFO:teuthology.orchestra.run.smithi111.stdout: "op_mask": "read, write, delete", 2024-09-12T18:55:23.746 INFO:teuthology.orchestra.run.smithi111.stdout: "default_placement": "", 2024-09-12T18:55:23.747 INFO:teuthology.orchestra.run.smithi111.stdout: "default_storage_class": "", 2024-09-12T18:55:23.747 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_tags": [], 2024-09-12T18:55:23.747 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2024-09-12T18:55:23.747 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:23.747 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:23.747 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:23.747 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:23.747 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:23.747 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:23.747 INFO:teuthology.orchestra.run.smithi111.stdout: "user_quota": { 2024-09-12T18:55:23.747 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:23.747 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:23.747 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:23.748 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:23.748 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:23.748 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:23.748 INFO:teuthology.orchestra.run.smithi111.stdout: "temp_url_keys": [], 2024-09-12T18:55:23.748 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "root", 2024-09-12T18:55:23.748 INFO:teuthology.orchestra.run.smithi111.stdout: "mfa_ids": [], 2024-09-12T18:55:23.748 INFO:teuthology.orchestra.run.smithi111.stdout: "account_id": "RGW88888888888888888", 2024-09-12T18:55:23.748 INFO:teuthology.orchestra.run.smithi111.stdout: "path": "/", 2024-09-12T18:55:23.748 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:55:23.730502Z", 2024-09-12T18:55:23.748 INFO:teuthology.orchestra.run.smithi111.stdout: "tags": [], 2024-09-12T18:55:23.748 INFO:teuthology.orchestra.run.smithi111.stdout: "group_ids": [] 2024-09-12T18:55:23.748 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:55:23.748 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:23.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.744+0000 7f4423fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:23.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.748+0000 7f457431c9c0 20 remove_watcher() i=0 2024-09-12T18:55:23.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.748+0000 7f457431c9c0 2 removed watcher, disabling cache 2024-09-12T18:55:23.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.752+0000 7f457431c9c0 20 remove_watcher() i=1 2024-09-12T18:55:23.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.752+0000 7f457431c9c0 20 remove_watcher() i=2 2024-09-12T18:55:23.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.756+0000 7f457431c9c0 20 remove_watcher() i=3 2024-09-12T18:55:23.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.756+0000 7f457431c9c0 20 remove_watcher() i=4 2024-09-12T18:55:23.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.760+0000 7f457431c9c0 20 remove_watcher() i=5 2024-09-12T18:55:23.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.760+0000 7f457431c9c0 20 remove_watcher() i=6 2024-09-12T18:55:23.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.760+0000 7f457431c9c0 20 remove_watcher() i=7 2024-09-12T18:55:23.781 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 7591484670 --totp-seed 7RHWNGVK2MBU6GCTNYVTJ5TXOA4BTRJRMLS6UFYB7XOUKYEV7CBHTGJSZMQMHFYM --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:55:23.826 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:23.826 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:23.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.864+0000 7f77bccca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.864+0000 7f77bccca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.864+0000 7f77bccca9c0 20 realm 2024-09-12T18:55:23.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.864+0000 7f77bccca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.868+0000 7f77bccca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.868+0000 7f77bccca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:23.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.868+0000 7f77bccca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.868+0000 7f77bccca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.868+0000 7f77bccca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.868+0000 7f77bccca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:23.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.868+0000 7f77bccca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.868+0000 7f77bccca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:23.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.868+0000 7f77bccca9c0 20 searching for the correct realm 2024-09-12T18:55:23.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.876+0000 7f77bafd1640 0 -- 172.21.15.111:0/754178416 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x55e43641c090 msgr2=0x55e43641e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:23.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.880+0000 7f77b9fcf640 0 -- 172.21.15.111:0/754178416 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f77ac11db20 msgr2=0x7f77ac0c3a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:23.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.888+0000 7f77bccca9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:23.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.888+0000 7f77bccca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:23.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.888+0000 7f77bccca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:23.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.888+0000 7f77bccca9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:23.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.888+0000 7f77bccca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:23.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.888+0000 7f77bccca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:23.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.888+0000 7f77bccca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.888+0000 7f77bccca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.888+0000 7f77bccca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.888+0000 7f77bccca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:23.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.888+0000 7f77bccca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:23.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 20 zone default found 2024-09-12T18:55:23.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 4 Realm: () 2024-09-12T18:55:23.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:23.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:23.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:23.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 20 zonegroup default 2024-09-12T18:55:23.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:23.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 20 started sync module instance, tier type = 2024-09-12T18:55:23.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.892+0000 7f77bccca9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:23.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.908+0000 7f77bccca9c0 20 add_watcher() i=0 2024-09-12T18:55:23.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.908+0000 7f77bccca9c0 20 add_watcher() i=1 2024-09-12T18:55:23.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.908+0000 7f77bccca9c0 20 add_watcher() i=2 2024-09-12T18:55:23.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.908+0000 7f77bccca9c0 20 add_watcher() i=3 2024-09-12T18:55:23.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.908+0000 7f77bccca9c0 20 add_watcher() i=4 2024-09-12T18:55:23.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.908+0000 7f77bccca9c0 20 add_watcher() i=5 2024-09-12T18:55:23.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.908+0000 7f77bccca9c0 20 add_watcher() i=6 2024-09-12T18:55:23.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.908+0000 7f77bccca9c0 20 add_watcher() i=7 2024-09-12T18:55:23.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.908+0000 7f77bccca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:23.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.912+0000 7f7670fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:23.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.912+0000 7f77bccca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:23.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.912+0000 7f77bccca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:23.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.912+0000 7f77bccca9c0 5 note: GC not initialized 2024-09-12T18:55:23.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.912+0000 7f75eb7fe640 20 reqs_thread_entry: start 2024-09-12T18:55:23.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.912+0000 7f77bccca9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:23.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.912+0000 7f77bccca9c0 20 Filter name: none 2024-09-12T18:55:23.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.912+0000 7f75e97fa640 20 reqs_thread_entry: start 2024-09-12T18:55:23.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.912+0000 7f77bccca9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T18:55:23.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.912+0000 7f77bccca9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:23.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.912+0000 7f77bccca9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T18:55:23.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.912+0000 7f77bccca9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T18:55:23.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.912+0000 7f77bccca9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:55:23.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.912+0000 7f77bccca9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:55:23.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.916+0000 7f77bccca9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:55:23.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.916+0000 7f77bccca9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:55:23.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.916+0000 7f77bccca9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T18:55:23.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.916+0000 7f769dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333555 cookie 94438651188800 notifier 8657 bl.length()=695 2024-09-12T18:55:23.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.916+0000 7f769dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T18:55:23.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.916+0000 7f769dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T18:55:23.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.920+0000 7f7670fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:23.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.924+0000 7f77bccca9c0 20 remove_watcher() i=0 2024-09-12T18:55:23.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.924+0000 7f77bccca9c0 2 removed watcher, disabling cache 2024-09-12T18:55:23.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.928+0000 7f77bccca9c0 20 remove_watcher() i=1 2024-09-12T18:55:23.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.928+0000 7f77bccca9c0 20 remove_watcher() i=2 2024-09-12T18:55:23.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.932+0000 7f77bccca9c0 20 remove_watcher() i=3 2024-09-12T18:55:23.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.932+0000 7f77bccca9c0 20 remove_watcher() i=4 2024-09-12T18:55:23.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.936+0000 7f77bccca9c0 20 remove_watcher() i=5 2024-09-12T18:55:23.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.936+0000 7f77bccca9c0 20 remove_watcher() i=6 2024-09-12T18:55:23.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:23.936+0000 7f77bccca9c0 20 remove_watcher() i=7 2024-09-12T18:55:23.954 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T18:55:24.031 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:24.031 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:24.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.072+0000 7f7d704259c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.072+0000 7f7d704259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:24.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.072+0000 7f7d704259c0 20 realm 2024-09-12T18:55:24.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.072+0000 7f7d704259c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.072+0000 7f7d704259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:24.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.072+0000 7f7d704259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:24.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.072+0000 7f7d704259c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.072+0000 7f7d704259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:24.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.072+0000 7f7d704259c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.076+0000 7f7d704259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:24.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.076+0000 7f7d704259c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.076+0000 7f7d704259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:24.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.076+0000 7f7d704259c0 20 searching for the correct realm 2024-09-12T18:55:24.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.080+0000 7f7d6e72c640 0 -- 172.21.15.111:0/1921327740 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f7d5813a130 msgr2=0x7f7d580f8e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:24.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.296+0000 7f7d6d72a640 0 -- 172.21.15.111:0/1921327740 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f7d60055800 msgr2=0x7f7d600570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:24.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.512+0000 7f7d704259c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:24.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.512+0000 7f7d704259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:24.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.512+0000 7f7d704259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:24.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.512+0000 7f7d704259c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:24.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.512+0000 7f7d704259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:24.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.512+0000 7f7d704259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:24.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.512+0000 7f7d704259c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.512+0000 7f7d704259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:24.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.512+0000 7f7d704259c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.516+0000 7f7d704259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:24.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.516+0000 7f7d704259c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.516+0000 7f7d704259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:24.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.516+0000 7f7d704259c0 20 zone default found 2024-09-12T18:55:24.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.516+0000 7f7d704259c0 4 Realm: () 2024-09-12T18:55:24.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.516+0000 7f7d704259c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:24.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.516+0000 7f7d704259c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:24.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.516+0000 7f7d704259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:24.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.516+0000 7f7d704259c0 20 zonegroup default 2024-09-12T18:55:24.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.516+0000 7f7d704259c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.516+0000 7f7d704259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:24.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.516+0000 7f7d704259c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.516+0000 7f7d704259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:24.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.516+0000 7f7d704259c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.520+0000 7f7d704259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:24.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.520+0000 7f7d704259c0 20 started sync module instance, tier type = 2024-09-12T18:55:24.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.520+0000 7f7d704259c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:24.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.544+0000 7f7d704259c0 20 add_watcher() i=0 2024-09-12T18:55:24.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.544+0000 7f7d704259c0 20 add_watcher() i=1 2024-09-12T18:55:24.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.544+0000 7f7d704259c0 20 add_watcher() i=2 2024-09-12T18:55:24.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.544+0000 7f7d704259c0 20 add_watcher() i=3 2024-09-12T18:55:24.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.544+0000 7f7d704259c0 20 add_watcher() i=4 2024-09-12T18:55:24.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.544+0000 7f7d704259c0 20 add_watcher() i=5 2024-09-12T18:55:24.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.544+0000 7f7d704259c0 20 add_watcher() i=6 2024-09-12T18:55:24.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.544+0000 7f7d704259c0 20 add_watcher() i=7 2024-09-12T18:55:24.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.544+0000 7f7d704259c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:24.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7c23fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:24.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:24.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:24.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 5 note: GC not initialized 2024-09-12T18:55:24.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7c22fe5640 20 reqs_thread_entry: start 2024-09-12T18:55:24.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:24.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 20 Filter name: none 2024-09-12T18:55:24.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7c20fe1640 20 reqs_thread_entry: start 2024-09-12T18:55:24.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T18:55:24.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:24.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T18:55:24.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:55:24.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T18:55:24.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T18:55:24.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T18:55:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:55:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.548+0000 7f7d704259c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T18:55:24.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.552+0000 7f7d704259c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:55:24.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.552+0000 7f7d704259c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:55:24.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.552+0000 7f7d704259c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T18:55:24.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.552+0000 7f7c517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333556 cookie 94415122432944 notifier 9327 bl.length()=384 2024-09-12T18:55:24.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.552+0000 7f7c517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:55:24.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.552+0000 7f7c517fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:55:24.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.556+0000 7f7d704259c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T18:55:24.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.556+0000 7f7d704259c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:55:24.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.556+0000 7f7d704259c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T18:55:24.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.556+0000 7f7c50ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333628 cookie 94415122450544 notifier 9327 bl.length()=225 2024-09-12T18:55:24.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.556+0000 7f7c50ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T18:55:24.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.556+0000 7f7c50ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T18:55:24.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.560+0000 7f7d704259c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T18:55:24.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.560+0000 7f7d704259c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:55:24.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.560+0000 7f7d704259c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T18:55:24.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.564+0000 7f7c517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333530 cookie 94415122446944 notifier 9327 bl.length()=234 2024-09-12T18:55:24.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.564+0000 7f7c517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T18:55:24.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.564+0000 7f7c517fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T18:55:24.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.564+0000 7f7c23fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:24.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.568+0000 7f7d704259c0 20 remove_watcher() i=0 2024-09-12T18:55:24.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.568+0000 7f7d704259c0 2 removed watcher, disabling cache 2024-09-12T18:55:24.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.572+0000 7f7d704259c0 20 remove_watcher() i=1 2024-09-12T18:55:24.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.572+0000 7f7d704259c0 20 remove_watcher() i=2 2024-09-12T18:55:24.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.576+0000 7f7d704259c0 20 remove_watcher() i=3 2024-09-12T18:55:24.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.576+0000 7f7d704259c0 20 remove_watcher() i=4 2024-09-12T18:55:24.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.580+0000 7f7d704259c0 20 remove_watcher() i=5 2024-09-12T18:55:24.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.580+0000 7f7d704259c0 20 remove_watcher() i=6 2024-09-12T18:55:24.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.584+0000 7f7d704259c0 20 remove_watcher() i=7 2024-09-12T18:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "id": "RGW99999999999999999", 2024-09-12T18:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "tenant": "", 2024-09-12T18:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T18:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T18:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "quota": { 2024-09-12T18:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:24.599 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2024-09-12T18:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout: "max_users": 1000, 2024-09-12T18:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout: "max_roles": 1000, 2024-09-12T18:55:24.600 INFO:teuthology.orchestra.run.smithi111.stdout: "max_groups": 1000, 2024-09-12T18:55:24.601 INFO:teuthology.orchestra.run.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:55:24.601 INFO:teuthology.orchestra.run.smithi111.stdout: "max_access_keys": 4 2024-09-12T18:55:24.601 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:55:24.602 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T18:55:24.602 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key FZBQNJUPMSJLYQUMIDCE --secret 69Qdwke0wsrT6aYDYdDOIHp87h2+t/0LAgQMg73SJluPWCVYO+OBfg== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T18:55:24.693 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:24.693 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:24.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.732+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.732+0000 7f700a28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:24.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.732+0000 7f700a28d9c0 20 realm 2024-09-12T18:55:24.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.732+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.732+0000 7f700a28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:24.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.732+0000 7f700a28d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:24.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.732+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.732+0000 7f700a28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:24.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.732+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.736+0000 7f700a28d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:24.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.736+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:24.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.736+0000 7f700a28d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:24.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.736+0000 7f700a28d9c0 20 searching for the correct realm 2024-09-12T18:55:24.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.740+0000 7f7008594640 0 -- 172.21.15.111:0/1972186808 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f6ffc135070 msgr2=0x7f6ffc0e2340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:24.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:24.956+0000 7f7007592640 0 -- 172.21.15.111:0/1972186808 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f700001a930 msgr2=0x7f70000583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:25.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.172+0000 7f700a28d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:25.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.172+0000 7f700a28d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:25.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.172+0000 7f700a28d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:25.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.172+0000 7f700a28d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:25.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.172+0000 7f700a28d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:25.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.172+0000 7f700a28d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:25.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.172+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.172+0000 7f700a28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:25.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.172+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:25.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:25.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 20 zone default found 2024-09-12T18:55:25.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 4 Realm: () 2024-09-12T18:55:25.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:25.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:25.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:25.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 20 zonegroup default 2024-09-12T18:55:25.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:25.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:25.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:25.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 20 started sync module instance, tier type = 2024-09-12T18:55:25.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.176+0000 7f700a28d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:25.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.200+0000 7f700a28d9c0 20 add_watcher() i=0 2024-09-12T18:55:25.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.200+0000 7f700a28d9c0 20 add_watcher() i=1 2024-09-12T18:55:25.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.200+0000 7f700a28d9c0 20 add_watcher() i=2 2024-09-12T18:55:25.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.200+0000 7f700a28d9c0 20 add_watcher() i=3 2024-09-12T18:55:25.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.200+0000 7f700a28d9c0 20 add_watcher() i=4 2024-09-12T18:55:25.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.200+0000 7f700a28d9c0 20 add_watcher() i=5 2024-09-12T18:55:25.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.204+0000 7f700a28d9c0 20 add_watcher() i=6 2024-09-12T18:55:25.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.204+0000 7f700a28d9c0 20 add_watcher() i=7 2024-09-12T18:55:25.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.204+0000 7f700a28d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:25.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.208+0000 7f6ebe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:25.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.208+0000 7f700a28d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:25.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.208+0000 7f700a28d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:25.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.208+0000 7f700a28d9c0 5 note: GC not initialized 2024-09-12T18:55:25.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.208+0000 7f6ebd7e2640 20 reqs_thread_entry: start 2024-09-12T18:55:25.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.208+0000 7f700a28d9c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:25.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.208+0000 7f700a28d9c0 20 Filter name: none 2024-09-12T18:55:25.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.208+0000 7f6eb67fc640 20 reqs_thread_entry: start 2024-09-12T18:55:25.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.208+0000 7f700a28d9c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T18:55:25.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.208+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:25.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T18:55:25.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:55:25.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T18:55:25.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:25.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T18:55:25.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:55:25.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 10 cache get: name=default.rgw.meta+users.keys+FZBQNJUPMSJLYQUMIDCE : miss 2024-09-12T18:55:25.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:25.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 10 cache put: name=default.rgw.meta+users.keys+FZBQNJUPMSJLYQUMIDCE info.flags=0x0 2024-09-12T18:55:25.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 10 adding default.rgw.meta+users.keys+FZBQNJUPMSJLYQUMIDCE to cache LRU end 2024-09-12T18:55:25.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T18:55:25.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T18:55:25.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T18:55:25.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T18:55:25.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:55:25.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 10 cache get: name=default.rgw.meta+users.keys+FZBQNJUPMSJLYQUMIDCE : hit (negative entry) 2024-09-12T18:55:25.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.212+0000 7f700a28d9c0 10 cache get: name=default.rgw.meta+users.keys+FZBQNJUPMSJLYQUMIDCE : hit (negative entry) 2024-09-12T18:55:25.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.216+0000 7f700a28d9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:55:25.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.216+0000 7f700a28d9c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:55:25.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.216+0000 7f700a28d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T18:55:25.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.216+0000 7f6ee6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333557 cookie 94756181866416 notifier 8690 bl.length()=681 2024-09-12T18:55:25.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.216+0000 7f6ee6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:55:25.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.216+0000 7f6ee6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:55:25.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.220+0000 7f700a28d9c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T18:55:25.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.220+0000 7f700a28d9c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:55:25.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.220+0000 7f700a28d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T18:55:25.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.220+0000 7f6ee6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333732 cookie 94756181878784 notifier 8690 bl.length()=189 2024-09-12T18:55:25.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.220+0000 7f6ee6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T18:55:25.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.220+0000 7f6ee6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T18:55:25.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.224+0000 7f700a28d9c0 10 cache put: name=default.rgw.meta+users.keys+FZBQNJUPMSJLYQUMIDCE info.flags=0x7 2024-09-12T18:55:25.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.224+0000 7f700a28d9c0 10 moving default.rgw.meta+users.keys+FZBQNJUPMSJLYQUMIDCE to cache LRU end 2024-09-12T18:55:25.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.224+0000 7f700a28d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:FZBQNJUPMSJLYQUMIDCE, ofs0, ns] 2024-09-12T18:55:25.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.224+0000 7f6ee67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333552 cookie 94756181884832 notifier 8690 bl.length()=188 2024-09-12T18:55:25.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.224+0000 7f6ee67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FZBQNJUPMSJLYQUMIDCE info.flags=0x7 2024-09-12T18:55:25.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.224+0000 7f6ee67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FZBQNJUPMSJLYQUMIDCE to cache LRU end 2024-09-12T18:55:25.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.228+0000 7f700a28d9c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T18:55:25.231 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T18:55:25.231 INFO:teuthology.orchestra.run.smithi111.stdout: "user_id": "root2.client.0", 2024-09-12T18:55:25.231 INFO:teuthology.orchestra.run.smithi111.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T18:55:25.231 INFO:teuthology.orchestra.run.smithi111.stdout: "email": "root2+test@test.test", 2024-09-12T18:55:25.231 INFO:teuthology.orchestra.run.smithi111.stdout: "suspended": 0, 2024-09-12T18:55:25.231 INFO:teuthology.orchestra.run.smithi111.stdout: "max_buckets": 1000, 2024-09-12T18:55:25.231 INFO:teuthology.orchestra.run.smithi111.stdout: "subusers": [], 2024-09-12T18:55:25.231 INFO:teuthology.orchestra.run.smithi111.stdout: "keys": [ 2024-09-12T18:55:25.231 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-09-12T18:55:25.232 INFO:teuthology.orchestra.run.smithi111.stdout: "user": "root2.client.0", 2024-09-12T18:55:25.232 INFO:teuthology.orchestra.run.smithi111.stdout: "access_key": "FZBQNJUPMSJLYQUMIDCE", 2024-09-12T18:55:25.232 INFO:teuthology.orchestra.run.smithi111.stdout: "secret_key": "69Qdwke0wsrT6aYDYdDOIHp87h2+t/0LAgQMg73SJluPWCVYO+OBfg==", 2024-09-12T18:55:25.232 INFO:teuthology.orchestra.run.smithi111.stdout: "active": true, 2024-09-12T18:55:25.232 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:55:25.215564Z" 2024-09-12T18:55:25.232 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-12T18:55:25.232 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-12T18:55:25.232 INFO:teuthology.orchestra.run.smithi111.stdout: "swift_keys": [], 2024-09-12T18:55:25.232 INFO:teuthology.orchestra.run.smithi111.stdout: "caps": [], 2024-09-12T18:55:25.232 INFO:teuthology.orchestra.run.smithi111.stdout: "op_mask": "read, write, delete", 2024-09-12T18:55:25.232 INFO:teuthology.orchestra.run.smithi111.stdout: "default_placement": "", 2024-09-12T18:55:25.233 INFO:teuthology.orchestra.run.smithi111.stdout: "default_storage_class": "", 2024-09-12T18:55:25.233 INFO:teuthology.orchestra.run.smithi111.stdout: "placement_tags": [], 2024-09-12T18:55:25.233 INFO:teuthology.orchestra.run.smithi111.stdout: "bucket_quota": { 2024-09-12T18:55:25.233 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:25.233 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:25.233 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:25.233 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:25.233 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:25.233 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:25.233 INFO:teuthology.orchestra.run.smithi111.stdout: "user_quota": { 2024-09-12T18:55:25.233 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": false, 2024-09-12T18:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout: "check_on_raw": false, 2024-09-12T18:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size": -1, 2024-09-12T18:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout: "max_size_kb": 0, 2024-09-12T18:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout: "max_objects": -1 2024-09-12T18:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-12T18:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout: "temp_url_keys": [], 2024-09-12T18:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "root", 2024-09-12T18:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout: "mfa_ids": [], 2024-09-12T18:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout: "account_id": "RGW99999999999999999", 2024-09-12T18:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout: "path": "/", 2024-09-12T18:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout: "create_date": "2024-09-12T18:55:25.215534Z", 2024-09-12T18:55:25.234 INFO:teuthology.orchestra.run.smithi111.stdout: "tags": [], 2024-09-12T18:55:25.235 INFO:teuthology.orchestra.run.smithi111.stdout: "group_ids": [] 2024-09-12T18:55:25.235 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T18:55:25.235 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:55:25.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.228+0000 7f6ebe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:25.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.236+0000 7f700a28d9c0 20 remove_watcher() i=0 2024-09-12T18:55:25.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.236+0000 7f700a28d9c0 2 removed watcher, disabling cache 2024-09-12T18:55:25.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.236+0000 7f700a28d9c0 20 remove_watcher() i=1 2024-09-12T18:55:25.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.240+0000 7f700a28d9c0 20 remove_watcher() i=2 2024-09-12T18:55:25.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.240+0000 7f700a28d9c0 20 remove_watcher() i=3 2024-09-12T18:55:25.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.244+0000 7f700a28d9c0 20 remove_watcher() i=4 2024-09-12T18:55:25.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.244+0000 7f700a28d9c0 20 remove_watcher() i=5 2024-09-12T18:55:25.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.248+0000 7f700a28d9c0 20 remove_watcher() i=6 2024-09-12T18:55:25.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.248+0000 7f700a28d9c0 20 remove_watcher() i=7 2024-09-12T18:55:25.268 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 9205565321 --totp-seed XOKEURWOHGKU6BAOQMSPGZ543D4UCKRXXHNBLOFMQLH5VM6ZYW4JTMLVBBLNPTV4 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T18:55:25.314 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T18:55:25.314 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T18:55:25.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.352+0000 7f47dbf709c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.352+0000 7f47dbf709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:25.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.352+0000 7f47dbf709c0 20 realm 2024-09-12T18:55:25.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.352+0000 7f47dbf709c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.352+0000 7f47dbf709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:25.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.352+0000 7f47dbf709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T18:55:25.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.352+0000 7f47dbf709c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.352+0000 7f47dbf709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:25.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.352+0000 7f47dbf709c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.356+0000 7f47dbf709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:25.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.356+0000 7f47dbf709c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.356+0000 7f47dbf709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T18:55:25.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.356+0000 7f47dbf709c0 20 searching for the correct realm 2024-09-12T18:55:25.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.360+0000 7f47da277640 0 -- 172.21.15.111:0/3535565188 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f47d004c070 msgr2=0x7f47d0000ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:25.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.368+0000 7f47d9275640 0 -- 172.21.15.111:0/3535565188 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f47d402b040 msgr2=0x7f47d402b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T18:55:25.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.584+0000 7f47dbf709c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T18:55:25.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.584+0000 7f47dbf709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T18:55:25.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.584+0000 7f47dbf709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T18:55:25.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.584+0000 7f47dbf709c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T18:55:25.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.584+0000 7f47dbf709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T18:55:25.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.584+0000 7f47dbf709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T18:55:25.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.584+0000 7f47dbf709c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.588+0000 7f47dbf709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:25.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.588+0000 7f47dbf709c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.588+0000 7f47dbf709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T18:55:25.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.588+0000 7f47dbf709c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.588+0000 7f47dbf709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T18:55:25.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.588+0000 7f47dbf709c0 20 zone default found 2024-09-12T18:55:25.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.588+0000 7f47dbf709c0 4 Realm: () 2024-09-12T18:55:25.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.588+0000 7f47dbf709c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T18:55:25.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.588+0000 7f47dbf709c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T18:55:25.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.588+0000 7f47dbf709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T18:55:25.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.588+0000 7f47dbf709c0 20 zonegroup default 2024-09-12T18:55:25.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.588+0000 7f47dbf709c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.588+0000 7f47dbf709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:25.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.592+0000 7f47dbf709c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.592+0000 7f47dbf709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:25.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.592+0000 7f47dbf709c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.592+0000 7f47dbf709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T18:55:25.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.592+0000 7f47dbf709c0 20 started sync module instance, tier type = 2024-09-12T18:55:25.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.592+0000 7f47dbf709c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T18:55:25.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.616+0000 7f47dbf709c0 20 add_watcher() i=0 2024-09-12T18:55:25.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.616+0000 7f47dbf709c0 20 add_watcher() i=1 2024-09-12T18:55:25.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.616+0000 7f47dbf709c0 20 add_watcher() i=2 2024-09-12T18:55:25.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.616+0000 7f47dbf709c0 20 add_watcher() i=3 2024-09-12T18:55:25.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.616+0000 7f47dbf709c0 20 add_watcher() i=4 2024-09-12T18:55:25.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.616+0000 7f47dbf709c0 20 add_watcher() i=5 2024-09-12T18:55:25.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.616+0000 7f47dbf709c0 20 add_watcher() i=6 2024-09-12T18:55:25.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.616+0000 7f47dbf709c0 20 add_watcher() i=7 2024-09-12T18:55:25.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.616+0000 7f47dbf709c0 2 all 8 watchers are set, enabling cache 2024-09-12T18:55:25.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.620+0000 7f468b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:25.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.620+0000 7f47dbf709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T18:55:25.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.620+0000 7f47dbf709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T18:55:25.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.620+0000 7f47dbf709c0 5 note: GC not initialized 2024-09-12T18:55:25.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.620+0000 7f468a7fc640 20 reqs_thread_entry: start 2024-09-12T18:55:25.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.620+0000 7f47dbf709c0 20 init_complete bucket index max shards: 11 2024-09-12T18:55:25.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.620+0000 7f47dbf709c0 20 Filter name: none 2024-09-12T18:55:25.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.624+0000 7f45fbfff640 20 reqs_thread_entry: start 2024-09-12T18:55:25.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.624+0000 7f47dbf709c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T18:55:25.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.624+0000 7f47dbf709c0 20 rados->read ofs=0 len=0 2024-09-12T18:55:25.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.624+0000 7f47dbf709c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T18:55:25.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.624+0000 7f47dbf709c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T18:55:25.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.624+0000 7f47dbf709c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:55:25.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.624+0000 7f47dbf709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T18:55:25.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.628+0000 7f47dbf709c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:55:25.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.628+0000 7f47dbf709c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:55:25.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.628+0000 7f47dbf709c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T18:55:25.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.628+0000 7f46bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333558 cookie 94175234086480 notifier 8705 bl.length()=695 2024-09-12T18:55:25.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.628+0000 7f46bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T18:55:25.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.628+0000 7f46bd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T18:55:25.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.632+0000 7f468b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T18:55:25.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.636+0000 7f47dbf709c0 20 remove_watcher() i=0 2024-09-12T18:55:25.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.636+0000 7f47dbf709c0 2 removed watcher, disabling cache 2024-09-12T18:55:25.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.640+0000 7f47dbf709c0 20 remove_watcher() i=1 2024-09-12T18:55:25.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.640+0000 7f47dbf709c0 20 remove_watcher() i=2 2024-09-12T18:55:25.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.644+0000 7f47dbf709c0 20 remove_watcher() i=3 2024-09-12T18:55:25.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.644+0000 7f47dbf709c0 20 remove_watcher() i=4 2024-09-12T18:55:25.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.648+0000 7f47dbf709c0 20 remove_watcher() i=5 2024-09-12T18:55:25.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.652+0000 7f47dbf709c0 20 remove_watcher() i=6 2024-09-12T18:55:25.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T18:55:25.652+0000 7f47dbf709c0 20 remove_watcher() i=7 2024-09-12T18:55:25.674 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T18:55:25.675 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:55:25.675 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T18:55:25.680 INFO:tasks.s3tests:Configuring boto... 2024-09-12T18:55:25.680 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T18:55:25.680 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T18:55:25.727 DEBUG:teuthology.orchestra.run.smithi111:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T18:55:25.901 INFO:teuthology.orchestra.run.smithi111.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T18:55:26.097 INFO:teuthology.orchestra.run.smithi111.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T18:55:26.432 INFO:teuthology.orchestra.run.smithi111.stdout:py installdeps: -rrequirements.txt 2024-09-12T18:57:19.576 INFO:teuthology.orchestra.run.smithi111.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T18:57:21.377 INFO:teuthology.orchestra.run.smithi111.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=1d9bfa565b8cbb60caaf58c82dbe333906db0c188ca87c3e0dbfd0beabfe0615,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T18:57:21.377 INFO:teuthology.orchestra.run.smithi111.stdout:py run-test-pre: PYTHONHASHSEED='3979879379' 2024-09-12T18:57:21.378 INFO:teuthology.orchestra.run.smithi111.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T18:57:21.549 INFO:teuthology.orchestra.run.smithi111.stdout:============================= test session starts ============================== 2024-09-12T18:57:21.549 INFO:teuthology.orchestra.run.smithi111.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T18:57:21.549 INFO:teuthology.orchestra.run.smithi111.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T18:57:21.549 INFO:teuthology.orchestra.run.smithi111.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T18:57:21.549 INFO:teuthology.orchestra.run.smithi111.stdout:configfile: pytest.ini 2024-09-12T18:57:23.339 INFO:teuthology.orchestra.run.smithi111.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T18:57:23.340 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T18:57:23.738 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T18:57:23.987 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T18:57:24.244 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T18:57:24.507 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T18:57:24.761 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T18:57:24.959 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T18:57:25.231 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T18:57:25.427 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T18:57:25.526 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T18:57:25.621 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T18:57:25.882 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T18:57:26.133 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T18:57:26.383 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T18:57:26.638 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T18:57:26.734 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T18:57:26.830 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T18:57:26.885 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T18:57:26.945 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T18:57:26.997 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T18:57:27.054 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T18:57:27.109 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T18:57:27.166 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T18:57:27.221 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T18:57:27.278 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T18:57:27.334 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T18:57:27.394 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T18:57:27.450 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T18:57:27.506 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T18:57:27.561 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T18:57:27.618 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T18:57:27.678 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T18:57:27.734 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T18:57:27.792 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T18:57:27.846 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T18:57:27.904 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T18:57:27.957 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T18:57:28.013 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T18:57:28.069 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T18:57:28.126 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:57:28.181 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T18:57:28.237 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T18:57:28.293 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:57:28.349 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T18:57:28.405 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T18:57:28.461 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T18:57:28.518 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T18:57:28.574 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T18:57:28.634 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T18:57:28.693 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T18:57:28.750 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T18:57:28.805 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T18:57:28.861 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T18:57:28.918 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T18:57:29.461 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T18:57:30.457 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T18:57:32.287 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T18:57:33.970 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T18:57:36.672 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T18:57:37.642 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T18:57:38.824 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T18:57:39.322 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T18:57:39.545 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T18:57:39.890 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T18:57:40.242 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T18:57:40.693 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T18:57:40.988 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T18:57:41.292 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T18:57:41.294 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T18:57:41.296 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T18:57:41.298 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T18:57:41.305 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T18:57:41.307 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T18:57:41.309 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T18:57:41.311 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T18:57:41.313 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:57:41.315 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:57:41.318 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T18:57:41.320 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:57:41.322 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T18:57:41.325 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:57:41.327 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:57:41.329 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T18:57:41.331 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:57:41.333 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:57:41.335 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:57:41.337 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T18:57:41.339 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T18:57:41.341 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T18:57:41.342 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T18:57:41.344 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T18:57:41.345 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T18:57:41.347 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T18:57:41.349 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T18:57:41.350 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T18:57:41.452 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T18:57:41.462 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T18:57:42.325 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T18:57:54.337 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T18:57:54.861 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T18:57:55.565 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T18:57:56.253 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T18:57:56.913 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T18:57:57.613 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T18:57:58.229 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T18:57:58.985 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T18:57:59.625 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T18:58:00.253 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T18:58:00.845 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T18:58:01.393 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T18:58:01.893 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T18:58:02.253 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T18:58:02.829 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T18:58:03.429 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T18:58:04.137 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T18:58:04.709 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T18:58:05.325 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T18:58:05.913 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T18:58:06.537 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T18:58:07.097 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T18:58:07.633 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T18:58:08.145 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T18:58:08.537 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T18:58:09.005 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T18:58:09.421 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T18:58:09.817 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T18:58:10.217 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T18:58:10.869 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T18:58:11.273 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:58:11.681 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T18:58:12.201 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T18:58:12.753 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T18:58:13.229 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:58:13.741 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T18:58:14.301 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T18:58:14.965 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T18:58:15.417 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T18:58:15.941 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T18:58:16.465 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T18:58:17.233 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T18:58:17.945 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T18:58:18.629 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T18:58:19.293 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:58:20.073 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:58:20.825 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:58:21.661 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:58:22.445 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:58:23.213 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T18:58:23.857 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T18:58:24.673 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T18:58:25.261 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T18:58:26.493 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T18:58:27.373 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T18:58:28.421 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T18:58:30.433 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T18:58:33.061 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T18:58:34.646 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T18:58:36.041 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T18:58:37.113 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T18:58:37.882 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T18:58:39.129 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T18:58:40.077 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T18:58:41.285 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T18:58:42.177 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T18:58:43.753 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T18:58:45.005 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T18:58:46.673 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T18:58:48.297 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T18:58:49.453 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T18:58:50.529 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T18:58:51.433 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T18:58:53.409 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T18:58:54.933 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T18:58:56.613 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T18:58:58.193 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T18:58:59.689 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T18:59:01.197 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T18:59:02.405 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T18:59:03.309 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T18:59:04.313 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T18:59:06.201 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T18:59:08.556 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T18:59:09.585 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T18:59:11.125 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T18:59:12.669 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T18:59:14.137 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T18:59:15.734 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T18:59:17.397 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T18:59:18.946 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T18:59:20.442 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T18:59:21.489 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T18:59:22.381 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T18:59:23.237 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T18:59:24.137 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T18:59:25.578 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T18:59:27.070 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T18:59:28.574 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T18:59:30.022 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T18:59:31.518 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T18:59:33.014 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T18:59:34.478 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T18:59:35.985 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T18:59:37.406 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T18:59:38.838 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T18:59:40.330 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T18:59:41.794 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T18:59:42.834 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T18:59:43.853 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T18:59:44.833 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T18:59:45.830 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T18:59:46.681 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T18:59:47.529 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T18:59:48.313 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T18:59:49.045 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T18:59:49.757 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T18:59:50.469 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T18:59:51.201 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T18:59:52.017 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T18:59:52.733 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T18:59:53.973 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T18:59:55.153 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T18:59:55.853 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T18:59:56.561 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T18:59:57.293 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T18:59:58.021 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T18:59:59.249 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T19:00:00.425 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T19:00:01.125 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T19:00:01.893 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T19:00:02.617 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T19:00:03.325 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T19:00:04.049 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T19:00:04.781 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T19:00:05.533 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T19:00:06.317 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T19:00:07.037 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T19:00:07.737 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T19:00:08.457 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T19:00:09.213 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T19:00:09.926 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T19:00:10.600 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T19:00:11.365 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T19:00:12.101 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T19:00:12.849 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T19:00:34.257 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T19:00:34.981 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T19:00:35.681 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T19:00:36.373 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T19:00:37.081 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T19:00:37.773 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T19:00:38.505 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T19:00:39.252 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T19:00:39.961 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T19:00:40.661 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T19:00:41.393 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T19:00:42.121 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T19:00:42.857 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T19:00:43.585 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T19:00:44.381 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T19:00:45.101 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T19:00:45.808 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T19:00:46.549 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T19:00:47.249 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T19:00:47.973 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T19:00:48.777 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T19:00:49.481 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T19:00:50.201 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T19:00:50.949 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T19:00:51.729 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T19:00:52.453 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T19:00:53.156 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T19:00:53.913 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T19:00:54.609 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T19:00:55.029 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T19:00:55.685 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T19:00:57.069 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T19:00:58.497 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T19:00:59.225 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T19:00:59.954 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T19:01:00.632 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T19:01:01.361 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T19:01:02.145 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T19:01:02.957 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T19:01:03.741 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T19:01:04.473 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T19:01:05.229 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T19:01:05.949 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T19:01:06.665 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T19:01:07.377 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T19:01:08.353 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T19:01:09.441 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T19:01:10.108 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T19:01:10.741 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T19:01:11.337 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T19:01:11.957 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T19:01:12.353 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T19:01:12.777 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T19:01:13.233 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T19:01:13.909 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T19:01:14.500 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T19:01:14.897 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T19:01:15.544 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T19:01:16.065 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T19:01:16.641 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T19:01:17.233 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T19:01:18.397 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T19:01:19.249 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T19:01:20.125 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T19:01:41.373 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T19:02:02.481 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T19:02:03.137 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T19:02:03.785 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T19:02:04.413 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T19:02:05.105 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T19:02:05.900 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T19:02:06.496 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T19:02:07.121 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T19:02:07.820 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T19:02:08.477 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T19:02:09.161 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T19:02:09.797 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T19:02:10.465 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T19:02:11.153 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T19:02:11.752 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T19:02:12.384 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T19:02:13.017 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T19:02:13.741 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T19:02:14.401 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T19:02:15.037 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T19:02:15.672 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T19:02:16.348 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T19:02:17.068 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T19:02:17.649 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T19:02:18.280 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T19:02:18.905 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T19:02:19.472 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T19:02:20.077 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T19:02:20.680 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T19:02:21.388 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T19:02:22.009 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T19:02:22.588 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T19:02:23.233 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T19:02:23.856 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T19:02:24.625 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T19:02:25.201 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T19:02:25.784 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T19:02:26.360 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T19:02:26.957 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T19:02:27.529 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T19:02:28.189 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T19:02:28.765 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T19:02:29.448 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T19:02:30.040 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T19:02:30.724 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T19:02:31.384 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T19:02:32.021 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T19:02:32.721 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T19:02:33.441 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T19:02:35.177 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T19:02:35.888 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T19:02:36.565 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T19:02:37.324 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T19:02:38.105 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T19:02:38.869 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T19:02:39.541 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T19:02:40.341 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T19:02:41.221 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T19:02:41.908 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T19:02:42.736 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T19:02:43.380 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T19:02:43.988 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T19:02:44.593 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T19:02:45.221 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T19:02:45.796 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T19:02:46.233 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T19:02:46.944 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T19:02:47.585 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T19:02:48.245 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T19:02:51.248 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T19:02:51.848 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T19:02:52.493 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T19:02:53.085 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T19:02:53.765 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T19:02:54.333 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T19:02:54.977 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T19:02:55.677 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T19:02:56.368 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T19:02:57.020 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T19:02:57.689 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T19:02:58.345 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T19:02:59.065 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T19:02:59.752 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T19:03:00.421 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T19:03:01.136 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T19:03:01.885 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T19:03:02.536 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T19:03:02.969 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T19:03:03.368 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T19:03:03.769 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T19:03:04.293 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T19:03:04.801 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T19:03:05.324 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T19:03:05.848 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T19:03:06.425 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T19:03:06.849 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T19:03:07.244 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T19:03:07.797 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T19:03:08.205 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T19:03:08.633 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T19:03:09.028 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T19:03:09.429 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T19:03:09.993 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T19:03:10.564 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T19:03:11.253 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T19:03:11.813 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T19:03:12.428 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T19:03:13.009 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T19:03:13.589 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T19:03:14.233 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T19:03:14.837 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T19:03:15.409 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T19:03:16.145 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T19:03:16.833 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T19:03:17.636 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T19:03:18.317 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T19:03:19.025 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T19:03:19.752 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T19:03:20.509 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T19:03:21.216 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T19:03:21.965 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T19:03:22.525 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T19:03:23.329 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T19:03:24.069 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T19:03:24.824 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T19:03:25.604 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T19:03:26.360 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T19:03:27.393 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T19:03:28.309 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T19:03:29.336 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T19:03:30.373 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T19:03:31.277 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T19:03:31.917 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T19:03:32.577 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T19:03:33.233 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T19:03:34.001 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T19:03:34.680 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T19:03:35.405 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T19:03:36.437 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T19:03:37.413 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T19:03:38.453 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T19:03:39.569 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T19:03:40.584 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T19:03:41.625 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T19:03:42.676 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T19:03:43.681 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T19:03:44.725 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T19:03:45.633 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T19:03:46.561 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T19:03:47.477 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T19:03:48.717 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T19:03:49.881 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T19:03:50.269 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T19:03:50.669 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T19:03:51.060 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T19:03:51.781 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T19:03:52.405 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T19:03:52.941 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T19:03:53.461 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T19:03:54.285 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T19:03:55.921 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T19:03:56.720 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T19:03:57.465 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T19:03:58.424 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T19:03:59.181 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T19:03:59.893 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T19:04:00.633 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T19:04:01.377 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T19:04:02.353 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T19:04:03.129 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T19:04:04.097 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T19:04:04.901 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T19:04:06.023 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T19:04:07.025 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T19:04:07.609 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T19:04:08.221 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T19:04:10.128 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T19:04:10.945 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T19:04:13.861 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T19:04:14.517 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T19:04:15.321 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T19:04:16.685 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T19:04:17.501 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T19:04:18.873 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T19:04:22.065 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T19:04:25.665 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T19:04:30.201 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T19:04:47.065 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T19:04:49.453 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T19:04:53.925 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T19:04:54.929 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T19:04:56.137 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T19:04:57.293 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T19:04:58.297 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T19:04:59.021 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T19:05:00.337 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T19:05:01.133 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T19:05:01.889 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T19:05:02.621 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T19:05:17.861 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T19:05:20.413 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T19:05:21.125 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T19:05:21.923 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T19:05:22.621 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T19:05:28.073 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T19:05:31.885 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T19:05:35.541 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T19:05:36.245 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T19:05:36.945 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T19:05:37.677 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T19:05:38.401 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T19:05:39.153 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T19:05:39.849 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T19:05:40.577 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T19:05:41.445 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T19:05:42.541 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T19:05:43.693 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T19:05:44.857 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T19:05:46.033 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T19:05:47.513 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T19:05:48.401 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T19:05:49.453 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T19:05:50.788 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T19:05:51.757 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T19:05:52.565 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T19:05:53.637 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T19:05:54.405 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T19:05:59.537 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T19:06:00.208 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T19:06:00.933 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T19:06:01.621 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T19:06:02.293 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T19:06:03.457 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T19:06:11.861 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T19:06:12.949 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T19:06:13.773 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T19:06:14.833 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T19:06:15.989 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T19:06:19.773 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T19:06:20.821 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T19:06:25.301 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T19:06:41.097 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T19:06:45.121 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T19:06:46.769 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T19:06:48.597 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T19:06:49.569 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T19:06:50.553 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T19:06:51.433 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T19:06:52.469 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T19:06:53.433 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T19:06:54.441 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T19:06:54.989 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T19:06:55.637 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T19:06:56.317 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T19:06:56.921 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T19:06:57.565 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T19:06:58.249 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T19:06:58.877 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T19:06:59.505 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T19:07:00.173 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T19:07:00.733 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T19:07:01.329 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T19:07:01.897 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T19:07:02.493 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T19:07:03.161 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T19:07:03.809 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T19:07:04.501 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T19:07:05.157 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T19:07:05.865 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T19:07:06.549 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T19:07:07.261 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T19:07:07.901 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T19:07:08.581 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T19:07:09.185 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T19:07:09.757 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T19:07:10.329 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T19:07:15.541 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T19:07:20.797 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T19:07:22.741 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T19:07:23.417 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T19:08:25.257 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T19:09:26.449 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T19:09:27.097 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T19:09:27.809 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T19:09:28.393 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T19:09:28.997 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T19:09:32.953 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T19:09:34.537 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T19:09:36.221 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T19:09:36.905 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T19:09:37.641 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T19:09:38.305 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T19:09:39.009 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T19:09:39.713 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T19:09:40.425 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T19:09:41.129 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T19:09:41.921 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T19:09:42.661 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T19:09:43.441 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T19:09:44.149 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T19:09:44.817 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T19:09:45.909 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T19:09:47.005 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T19:09:47.993 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T19:09:48.893 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T19:09:49.769 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T19:09:50.717 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T19:09:51.637 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T19:09:52.557 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T19:09:53.513 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T19:09:54.553 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T19:09:55.481 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T19:09:56.165 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T19:09:56.849 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T19:09:57.569 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T19:09:58.589 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T19:09:59.513 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T19:10:00.593 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T19:10:01.987 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T19:10:05.669 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T19:10:06.589 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T19:10:07.585 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T19:10:08.469 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T19:10:09.757 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T19:10:10.861 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T19:10:11.661 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T19:10:12.653 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T19:10:13.285 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T19:10:13.869 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T19:10:14.473 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T19:10:15.065 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T19:10:15.833 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T19:10:16.493 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T19:10:17.469 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T19:10:18.045 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T19:10:18.653 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T19:10:19.241 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T19:10:19.817 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T19:10:20.397 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T19:10:21.021 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T19:10:21.697 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T19:10:22.249 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T19:10:22.813 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T19:10:23.393 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T19:10:24.069 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T19:10:24.713 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T19:10:25.425 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T19:10:26.089 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T19:10:26.733 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T19:10:27.369 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T19:10:28.101 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T19:10:28.789 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T19:10:29.577 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T19:10:30.257 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T19:10:30.953 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T19:10:31.617 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T19:10:32.389 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T19:10:33.125 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T19:10:33.837 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T19:10:34.509 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T19:10:35.157 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T19:10:35.893 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T19:10:36.617 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T19:10:37.241 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T19:10:37.937 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T19:10:38.937 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T19:10:39.533 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T19:10:40.169 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T19:10:40.777 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T19:10:51.237 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T19:10:51.949 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T19:11:01.385 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T19:11:02.129 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T19:11:02.849 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T19:11:03.429 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T19:11:04.073 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T19:11:04.685 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T19:11:05.337 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T19:11:05.985 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T19:11:06.573 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T19:11:07.249 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T19:11:07.869 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T19:11:08.561 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T19:11:09.205 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T19:11:09.945 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T19:11:10.669 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T19:11:11.329 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T19:11:11.957 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T19:11:12.853 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T19:11:15.069 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T19:11:15.601 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T19:11:16.249 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T19:11:16.881 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T19:11:17.629 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T19:11:18.473 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T19:11:19.133 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T19:11:20.189 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T19:11:21.473 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T19:11:22.233 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T19:11:29.453 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T19:11:36.605 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T19:11:37.228 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T19:11:38.037 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T19:11:40.001 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T19:11:42.409 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T19:11:43.974 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T19:11:45.037 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T19:11:46.097 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T19:11:47.193 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T19:11:47.841 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T19:11:49.177 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T19:11:50.697 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T19:11:53.289 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T19:11:54.773 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T19:11:55.749 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T19:11:56.529 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T19:11:57.173 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T19:11:58.073 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T19:11:59.141 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T19:12:00.077 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T19:12:00.937 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T19:12:01.913 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T19:12:02.877 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T19:12:03.861 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T19:12:04.761 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T19:12:05.089 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T19:12:06.377 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T19:12:07.701 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T19:12:08.593 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T19:12:09.385 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T19:12:10.181 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T19:12:20.889 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T19:12:21.257 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T19:12:22.164 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T19:12:22.905 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T19:12:23.557 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T19:12:24.445 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T19:12:24.488 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T19:12:24.488 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.488 INFO:teuthology.orchestra.run.smithi111.stdout:=============================== warnings summary =============================== 2024-09-12T19:12:24.488 INFO:teuthology.orchestra.run.smithi111.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T19:12:24.488 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T19:12:24.488 INFO:teuthology.orchestra.run.smithi111.stdout: import imp 2024-09-12T19:12:24.488 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.489 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py:120 2024-09-12T19:12:24.489 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T19:12:24.489 INFO:teuthology.orchestra.run.smithi111.stdout: if boto_type is 'S3Connection': 2024-09-12T19:12:24.489 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.489 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_headers.py:124 2024-09-12T19:12:24.489 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T19:12:24.489 INFO:teuthology.orchestra.run.smithi111.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T19:12:24.489 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.489 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3.py:359 2024-09-12T19:12:24.489 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-12T19:12:24.490 INFO:teuthology.orchestra.run.smithi111.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T19:12:24.490 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.490 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T19:12:24.490 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T19:12:24.490 INFO:teuthology.orchestra.run.smithi111.stdout: if k is 'BucketName': 2024-09-12T19:12:24.490 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.490 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T19:12:24.490 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T19:12:24.490 INFO:teuthology.orchestra.run.smithi111.stdout: @pytest.mark.timeout(10) 2024-09-12T19:12:24.490 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.491 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T19:12:24.491 INFO:teuthology.orchestra.run.smithi111.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T19:12:24.491 INFO:teuthology.orchestra.run.smithi111.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T19:12:24.491 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.491 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T19:12:24.491 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:12:24.491 INFO:teuthology.orchestra.run.smithi111.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:12:24.491 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.491 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T19:12:24.491 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:12:24.491 INFO:teuthology.orchestra.run.smithi111.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T19:12:24.492 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.492 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T19:12:24.492 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:12:24.492 INFO:teuthology.orchestra.run.smithi111.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T19:12:24.492 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.492 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T19:12:24.492 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:12:24.492 INFO:teuthology.orchestra.run.smithi111.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:12:24.492 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.492 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T19:12:24.492 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:12:24.493 INFO:teuthology.orchestra.run.smithi111.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T19:12:24.493 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.493 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T19:12:24.493 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:12:24.496 INFO:teuthology.orchestra.run.smithi111.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:12:24.496 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.496 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T19:12:24.496 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:12:24.496 INFO:teuthology.orchestra.run.smithi111.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T19:12:24.497 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.497 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T19:12:24.497 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:12:24.497 INFO:teuthology.orchestra.run.smithi111.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:12:24.497 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.497 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T19:12:24.497 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:12:24.497 INFO:teuthology.orchestra.run.smithi111.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T19:12:24.497 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.498 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T19:12:24.498 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:12:24.498 INFO:teuthology.orchestra.run.smithi111.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:12:24.498 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.498 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T19:12:24.498 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T19:12:24.498 INFO:teuthology.orchestra.run.smithi111.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T19:12:24.498 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.498 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-12T19:12:24.498 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-12T19:12:24.498 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-12T19:12:24.498 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-12T19:12:24.499 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-12T19:12:24.499 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi111.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T19:12:24.499 INFO:teuthology.orchestra.run.smithi111.stdout: warnings.warn( 2024-09-12T19:12:24.499 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.499 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T19:12:24.499 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T19:12:24.499 INFO:teuthology.orchestra.run.smithi111.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:6540: DeprecationWarning: ssl.wrap_socket() is deprecated, use SSLContext.wrap_socket() 2024-09-12T19:12:24.499 INFO:teuthology.orchestra.run.smithi111.stdout: s = ssl.wrap_socket(s); 2024-09-12T19:12:24.499 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.499 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T19:12:24.499 INFO:teuthology.orchestra.run.smithi111.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T19:12:24.500 INFO:teuthology.orchestra.run.smithi111.stdout: /usr/lib/python3.10/ssl.py:1434: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated 2024-09-12T19:12:24.500 INFO:teuthology.orchestra.run.smithi111.stdout: context = SSLContext(ssl_version) 2024-09-12T19:12:24.500 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:12:24.500 INFO:teuthology.orchestra.run.smithi111.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T19:12:24.500 INFO:teuthology.orchestra.run.smithi111.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 666 warnings in 902.94s (0:15:02) = 2024-09-12T19:12:24.660 INFO:teuthology.orchestra.run.smithi111.stdout:___________________________________ summary ____________________________________ 2024-09-12T19:12:24.661 INFO:teuthology.orchestra.run.smithi111.stdout: py: commands succeeded 2024-09-12T19:12:24.661 INFO:teuthology.orchestra.run.smithi111.stdout: congratulations :) 2024-09-12T19:12:24.698 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T19:12:24.699 DEBUG:teuthology.orchestra.run.smithi111:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T19:12:24.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T19:12:24.805 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T19:12:24.805 DEBUG:teuthology.orchestra.run.smithi111:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T19:12:24.811 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T19:12:24.811 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T19:12:24.998 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T19:12:25.013 INFO:tasks.workunit:Pulling workunits from ref d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T19:12:25.014 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T19:12:25.014 DEBUG:teuthology.orchestra.run.smithi111:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T19:12:25.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T19:12:25.020 INFO:teuthology.orchestra.run.smithi111.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T19:12:25.021 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T19:12:25.066 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T19:12:25.066 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T19:12:25.117 INFO:tasks.workunit:timeout=3h 2024-09-12T19:12:25.117 INFO:tasks.workunit:cleanup=True 2024-09-12T19:12:25.118 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T19:12:25.168 INFO:tasks.workunit.client.0.smithi111.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T19:13:22.976 INFO:tasks.workunit.client.0.smithi111.stderr:Updating files: 98% (12466/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T19:13:23.882 INFO:tasks.workunit.client.0.smithi111.stderr:Note: switching to 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'. 2024-09-12T19:13:23.882 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T19:13:23.883 INFO:tasks.workunit.client.0.smithi111.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T19:13:23.883 INFO:tasks.workunit.client.0.smithi111.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T19:13:23.883 INFO:tasks.workunit.client.0.smithi111.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T19:13:23.883 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T19:13:23.883 INFO:tasks.workunit.client.0.smithi111.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T19:13:23.883 INFO:tasks.workunit.client.0.smithi111.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T19:13:23.883 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T19:13:23.883 INFO:tasks.workunit.client.0.smithi111.stderr: git switch -c 2024-09-12T19:13:23.883 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T19:13:23.883 INFO:tasks.workunit.client.0.smithi111.stderr:Or undo this operation with: 2024-09-12T19:13:23.883 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T19:13:23.883 INFO:tasks.workunit.client.0.smithi111.stderr: git switch - 2024-09-12T19:13:23.884 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T19:13:23.884 INFO:tasks.workunit.client.0.smithi111.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T19:13:23.884 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T19:13:23.884 INFO:tasks.workunit.client.0.smithi111.stderr:HEAD is now at d011c522bb1 cls/rgw: duplicate reshard checks in all cls_rgw write operations 2024-09-12T19:13:23.890 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T19:13:23.938 INFO:tasks.workunit.client.0.smithi111.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T19:13:23.942 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T19:13:23.942 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T19:13:23.995 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T19:13:24.045 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T19:13:24.085 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T19:13:24.086 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T19:13:24.086 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T19:13:24.126 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T19:13:24.129 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-12T19:13:24.130 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T19:13:24.177 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T19:13:24.178 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T19:13:24.179 DEBUG:teuthology.orchestra.run.smithi111:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d011c522bb171e70fc5782f1e7a71ce5f37e573f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T19:13:24.233 INFO:tasks.workunit.client.0.smithi111.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T19:13:24.234 INFO:tasks.workunit.client.0.smithi111.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T19:13:24.234 INFO:tasks.workunit.client.0.smithi111.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T19:13:27.155 INFO:tasks.workunit.client.0.smithi111.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T19:13:27.155 INFO:tasks.workunit.client.0.smithi111.stderr:++ deactivate nondestructive 2024-09-12T19:13:27.156 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n '' ']' 2024-09-12T19:13:27.156 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n '' ']' 2024-09-12T19:13:27.156 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T19:13:27.156 INFO:tasks.workunit.client.0.smithi111.stderr:++ hash -r 2024-09-12T19:13:27.156 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n '' ']' 2024-09-12T19:13:27.156 INFO:tasks.workunit.client.0.smithi111.stderr:++ unset VIRTUAL_ENV 2024-09-12T19:13:27.156 INFO:tasks.workunit.client.0.smithi111.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T19:13:27.156 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T19:13:27.156 INFO:tasks.workunit.client.0.smithi111.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T19:13:27.156 INFO:tasks.workunit.client.0.smithi111.stderr:++ export VIRTUAL_ENV 2024-09-12T19:13:27.156 INFO:tasks.workunit.client.0.smithi111.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T19:13:27.156 INFO:tasks.workunit.client.0.smithi111.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T19:13:27.156 INFO:tasks.workunit.client.0.smithi111.stderr:++ export PATH 2024-09-12T19:13:27.157 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n '' ']' 2024-09-12T19:13:27.157 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -z '' ']' 2024-09-12T19:13:27.157 INFO:tasks.workunit.client.0.smithi111.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T19:13:27.157 INFO:tasks.workunit.client.0.smithi111.stderr:++ PS1='(rgw) ' 2024-09-12T19:13:27.157 INFO:tasks.workunit.client.0.smithi111.stderr:++ export PS1 2024-09-12T19:13:27.157 INFO:tasks.workunit.client.0.smithi111.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T19:13:27.157 INFO:tasks.workunit.client.0.smithi111.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T19:13:27.157 INFO:tasks.workunit.client.0.smithi111.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T19:13:27.157 INFO:tasks.workunit.client.0.smithi111.stderr:++ hash -r 2024-09-12T19:13:27.157 INFO:tasks.workunit.client.0.smithi111.stderr:+ pip install pip --upgrade 2024-09-12T19:13:27.545 INFO:tasks.workunit.client.0.smithi111.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T19:13:27.746 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting pip 2024-09-12T19:13:27.752 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T19:13:27.786 INFO:tasks.workunit.client.0.smithi111.stdout:Installing collected packages: pip 2024-09-12T19:13:27.786 INFO:tasks.workunit.client.0.smithi111.stdout: Attempting uninstall: pip 2024-09-12T19:13:27.786 INFO:tasks.workunit.client.0.smithi111.stdout: Found existing installation: pip 22.0.2 2024-09-12T19:13:28.054 INFO:tasks.workunit.client.0.smithi111.stdout: Uninstalling pip-22.0.2: 2024-09-12T19:13:28.059 INFO:tasks.workunit.client.0.smithi111.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T19:13:29.079 INFO:tasks.workunit.client.0.smithi111.stdout:Successfully installed pip-24.2 2024-09-12T19:13:29.153 INFO:tasks.workunit.client.0.smithi111.stderr:+ pip install boto3 2024-09-12T19:13:30.140 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting boto3 2024-09-12T19:13:30.141 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T19:13:30.691 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T19:13:30.693 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T19:13:30.747 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T19:13:30.748 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T19:13:30.803 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T19:13:30.804 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T19:13:30.853 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T19:13:30.854 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T19:13:30.932 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T19:13:30.933 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-12T19:13:31.166 INFO:tasks.workunit.client.0.smithi111.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T19:13:31.167 INFO:tasks.workunit.client.0.smithi111.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T19:13:31.171 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T19:13:31.172 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T19:13:31.181 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T19:13:31.182 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T19:13:31.184 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T19:13:31.185 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-12T19:13:31.186 INFO:tasks.workunit.client.0.smithi111.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T19:13:31.255 INFO:tasks.workunit.client.0.smithi111.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T19:13:32.306 INFO:tasks.workunit.client.0.smithi111.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-12T19:13:32.490 INFO:tasks.workunit.client.0.smithi111.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T19:13:32.613 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T19:13:32.651 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:13:32.652 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:13:32.900 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:32.896+0000 7f30ad4469c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:32.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:32.900+0000 7f30ad4469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:32.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:32.900+0000 7f30ad4469c0 20 realm 2024-09-12T19:13:32.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:32.900+0000 7f30ad4469c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:32.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:32.900+0000 7f30ad4469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:32.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:32.900+0000 7f30ad4469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:13:32.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:32.900+0000 7f30ad4469c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:32.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:32.900+0000 7f30ad4469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:32.903 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:32.900+0000 7f30ad4469c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:32.904 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:32.900+0000 7f30ad4469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:13:32.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:32.900+0000 7f30ad4469c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:32.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:32.904+0000 7f30ad4469c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:13:32.905 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:32.904+0000 7f30ad4469c0 20 searching for the correct realm 2024-09-12T19:13:32.909 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:32.904+0000 7f30ab74d640 0 -- 172.21.15.111:0/1004727946 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7f30a0049040 msgr2=0x7f30a0049930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:33.124 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.120+0000 7f30aa74b640 0 -- 172.21.15.111:0/1004727946 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f30a40ad2a0 msgr2=0x7f30a40ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:33.341 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.336+0000 7f30ad4469c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T19:13:33.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.336+0000 7f30ad4469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:13:33.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.336+0000 7f30ad4469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:13:33.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.336+0000 7f30ad4469c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T19:13:33.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.336+0000 7f30ad4469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:13:33.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.336+0000 7f30ad4469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:13:33.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:33.342 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:13:33.343 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:13:33.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 20 zone default found 2024-09-12T19:13:33.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 4 Realm: () 2024-09-12T19:13:33.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T19:13:33.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T19:13:33.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:13:33.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 20 zonegroup default 2024-09-12T19:13:33.345 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:33.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.340+0000 7f30ad4469c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.344+0000 7f30ad4469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:33.346 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.344+0000 7f30ad4469c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.344+0000 7f30ad4469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:33.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.344+0000 7f30ad4469c0 20 started sync module instance, tier type = 2024-09-12T19:13:33.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.344+0000 7f30ad4469c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T19:13:33.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.368+0000 7f30ad4469c0 20 add_watcher() i=0 2024-09-12T19:13:33.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.368+0000 7f30ad4469c0 20 add_watcher() i=1 2024-09-12T19:13:33.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.368+0000 7f30ad4469c0 20 add_watcher() i=2 2024-09-12T19:13:33.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.368+0000 7f30ad4469c0 20 add_watcher() i=3 2024-09-12T19:13:33.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.368+0000 7f30ad4469c0 20 add_watcher() i=4 2024-09-12T19:13:33.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.368+0000 7f30ad4469c0 20 add_watcher() i=5 2024-09-12T19:13:33.373 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.368+0000 7f30ad4469c0 20 add_watcher() i=6 2024-09-12T19:13:33.375 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.372+0000 7f30ad4469c0 20 add_watcher() i=7 2024-09-12T19:13:33.375 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.372+0000 7f30ad4469c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:13:33.379 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.376+0000 7f2f617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:13:33.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.376+0000 7f30ad4469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:13:33.380 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.376+0000 7f30ad4469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:13:33.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.376+0000 7f30ad4469c0 5 note: GC not initialized 2024-09-12T19:13:33.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.376+0000 7f2edbfff640 20 reqs_thread_entry: start 2024-09-12T19:13:33.381 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.376+0000 7f30ad4469c0 20 init_complete bucket index max shards: 11 2024-09-12T19:13:33.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.380+0000 7f30ad4469c0 20 Filter name: none 2024-09-12T19:13:33.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.380+0000 7f2ed9ffb640 20 reqs_thread_entry: start 2024-09-12T19:13:33.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.380+0000 7f30ad4469c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T19:13:33.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.380+0000 7f30ad4469c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.382 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.380+0000 7f30ad4469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:33.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.380+0000 7f30ad4469c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T19:13:33.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.380+0000 7f30ad4469c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T19:13:33.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.380+0000 7f30ad4469c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T19:13:33.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.380+0000 7f30ad4469c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.380+0000 7f30ad4469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:33.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.380+0000 7f30ad4469c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T19:13:33.383 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.380+0000 7f30ad4469c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T19:13:33.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.380+0000 7f30ad4469c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T19:13:33.384 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.380+0000 7f30ad4469c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T19:13:33.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.384+0000 7f30ad4469c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T19:13:33.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.384+0000 7f30ad4469c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T19:13:33.386 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.384+0000 7f30ad4469c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T19:13:33.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.384+0000 7f2f8e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333822 cookie 94319008194656 notifier 9384 bl.length()=613 2024-09-12T19:13:33.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.384+0000 7f2f8e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T19:13:33.387 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.384+0000 7f2f8e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T19:13:33.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.388+0000 7f30ad4469c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T19:13:33.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.388+0000 7f30ad4469c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T19:13:33.390 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.388+0000 7f30ad4469c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T19:13:33.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.388+0000 7f2f8e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333964 cookie 94319008191328 notifier 9384 bl.length()=191 2024-09-12T19:13:33.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.388+0000 7f2f8e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T19:13:33.391 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.388+0000 7f2f8e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T19:13:33.392 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.388+0000 7f2f617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:13:33.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.392+0000 7f30ad4469c0 20 remove_watcher() i=0 2024-09-12T19:13:33.397 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.392+0000 7f30ad4469c0 2 removed watcher, disabling cache 2024-09-12T19:13:33.400 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.396+0000 7f30ad4469c0 20 remove_watcher() i=1 2024-09-12T19:13:33.401 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.396+0000 7f30ad4469c0 20 remove_watcher() i=2 2024-09-12T19:13:33.403 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.400+0000 7f30ad4469c0 20 remove_watcher() i=3 2024-09-12T19:13:33.405 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.404+0000 7f30ad4469c0 20 remove_watcher() i=4 2024-09-12T19:13:33.407 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.404+0000 7f30ad4469c0 20 remove_watcher() i=5 2024-09-12T19:13:33.408 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.404+0000 7f30ad4469c0 20 remove_watcher() i=6 2024-09-12T19:13:33.409 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.408+0000 7f30ad4469c0 20 remove_watcher() i=7 2024-09-12T19:13:33.552 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:33.552 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:33.599 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:33.600 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:33.649 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:33.650 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:33.676 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:33.676 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:33.684 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T19:13:33.684 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T19:13:33.688 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:33.689 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:33.709 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:33.709 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:33.724 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:33.725 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:33.747 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T19:13:33.779 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:13:33.779 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:13:33.821 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.816+0000 7f2b66dec9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.820+0000 7f2b66dec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:33.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.820+0000 7f2b66dec9c0 20 realm 2024-09-12T19:13:33.823 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.820+0000 7f2b66dec9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.820+0000 7f2b66dec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:33.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.820+0000 7f2b66dec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:13:33.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.820+0000 7f2b66dec9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.820+0000 7f2b66dec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:33.824 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.820+0000 7f2b66dec9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.820+0000 7f2b66dec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:13:33.825 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.820+0000 7f2b66dec9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.824+0000 7f2b66dec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:13:33.826 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.824+0000 7f2b66dec9c0 20 searching for the correct realm 2024-09-12T19:13:33.831 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.828+0000 7f2b650f3640 0 -- 172.21.15.111:0/1457728855 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x55923865a330 msgr2=0x55923865c720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:33.838 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.836+0000 7f2b5c0f1640 0 -- 172.21.15.111:0/1457728855 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f2b60017040 msgr2=0x7f2b60091060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:33.844 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.840+0000 7f2b66dec9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T19:13:33.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.840+0000 7f2b66dec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:13:33.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.840+0000 7f2b66dec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:13:33.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.840+0000 7f2b66dec9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T19:13:33.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.840+0000 7f2b66dec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:13:33.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.840+0000 7f2b66dec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:13:33.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.840+0000 7f2b66dec9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.840+0000 7f2b66dec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:33.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.840+0000 7f2b66dec9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.845 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.840+0000 7f2b66dec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:13:33.846 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.840+0000 7f2b66dec9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:13:33.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 20 zone default found 2024-09-12T19:13:33.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 4 Realm: () 2024-09-12T19:13:33.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T19:13:33.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T19:13:33.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:13:33.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 20 zonegroup default 2024-09-12T19:13:33.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:33.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:33.847 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.848 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:33.848 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 20 started sync module instance, tier type = 2024-09-12T19:13:33.848 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.844+0000 7f2b66dec9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T19:13:33.861 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.860+0000 7f2b66dec9c0 20 add_watcher() i=0 2024-09-12T19:13:33.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.860+0000 7f2b66dec9c0 20 add_watcher() i=1 2024-09-12T19:13:33.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.860+0000 7f2b66dec9c0 20 add_watcher() i=2 2024-09-12T19:13:33.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.860+0000 7f2b66dec9c0 20 add_watcher() i=3 2024-09-12T19:13:33.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.860+0000 7f2b66dec9c0 20 add_watcher() i=4 2024-09-12T19:13:33.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.860+0000 7f2b66dec9c0 20 add_watcher() i=5 2024-09-12T19:13:33.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.860+0000 7f2b66dec9c0 20 add_watcher() i=6 2024-09-12T19:13:33.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.860+0000 7f2b66dec9c0 20 add_watcher() i=7 2024-09-12T19:13:33.862 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.860+0000 7f2b66dec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:13:33.865 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.860+0000 7f2a1afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:13:33.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.860+0000 7f2b66dec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:13:33.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.860+0000 7f2b66dec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:13:33.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.860+0000 7f2b66dec9c0 5 note: GC not initialized 2024-09-12T19:13:33.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2a19fe3640 20 reqs_thread_entry: start 2024-09-12T19:13:33.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 init_complete bucket index max shards: 11 2024-09-12T19:13:33.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 Filter name: none 2024-09-12T19:13:33.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f298b7fe640 20 reqs_thread_entry: start 2024-09-12T19:13:33.866 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T19:13:33.867 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:33.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T19:13:33.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T19:13:33.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T19:13:33.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 INFO: main: starting shard=0 2024-09-12T19:13:33.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.0 2024-09-12T19:13:33.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:33.868 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 INFO: main: starting shard=1 2024-09-12T19:13:33.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.1 2024-09-12T19:13:33.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:33.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 INFO: main: starting shard=2 2024-09-12T19:13:33.869 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.864+0000 7f2b66dec9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.2 2024-09-12T19:13:33.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.868+0000 7f2b66dec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:33.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.868+0000 7f2b66dec9c0 20 INFO: main: starting shard=3 2024-09-12T19:13:33.870 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.868+0000 7f2b66dec9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.3 2024-09-12T19:13:33.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.868+0000 7f2b66dec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:33.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.868+0000 7f2b66dec9c0 20 INFO: main: starting shard=4 2024-09-12T19:13:33.871 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.868+0000 7f2b66dec9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.4 2024-09-12T19:13:33.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.868+0000 7f2b66dec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:33.872 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.868+0000 7f2b66dec9c0 20 INFO: main: starting shard=5 2024-09-12T19:13:33.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.868+0000 7f2b66dec9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.5 2024-09-12T19:13:33.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.868+0000 7f2b66dec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:33.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.868+0000 7f2b66dec9c0 20 INFO: main: starting shard=6 2024-09-12T19:13:33.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.868+0000 7f2b66dec9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.6 2024-09-12T19:13:33.873 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.872+0000 7f2b66dec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:33.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.872+0000 7f2b66dec9c0 20 INFO: main: starting shard=7 2024-09-12T19:13:33.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.872+0000 7f2b66dec9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.7 2024-09-12T19:13:33.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.872+0000 7f2b66dec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:33.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.872+0000 7f2b66dec9c0 20 INFO: main: starting shard=8 2024-09-12T19:13:33.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.872+0000 7f2b66dec9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.8 2024-09-12T19:13:33.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.872+0000 7f2b66dec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:33.874 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.872+0000 7f2b66dec9c0 20 INFO: main: starting shard=9 2024-09-12T19:13:33.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.872+0000 7f2b66dec9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.9 2024-09-12T19:13:33.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.872+0000 7f2b66dec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:33.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.872+0000 7f2b66dec9c0 20 INFO: main: starting shard=10 2024-09-12T19:13:33.875 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.872+0000 7f2b66dec9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.10 2024-09-12T19:13:33.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.872+0000 7f2b66dec9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:33.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.872+0000 7f2b66dec9c0 20 INFO: main: done 2024-09-12T19:13:33.877 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.876+0000 7f2a1afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:13:33.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.880+0000 7f2b66dec9c0 20 remove_watcher() i=0 2024-09-12T19:13:33.882 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.880+0000 7f2b66dec9c0 2 removed watcher, disabling cache 2024-09-12T19:13:33.884 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.880+0000 7f2b66dec9c0 20 remove_watcher() i=1 2024-09-12T19:13:33.886 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.884+0000 7f2b66dec9c0 20 remove_watcher() i=2 2024-09-12T19:13:33.888 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.884+0000 7f2b66dec9c0 20 remove_watcher() i=3 2024-09-12T19:13:33.890 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.888+0000 7f2b66dec9c0 20 remove_watcher() i=4 2024-09-12T19:13:33.891 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.888+0000 7f2b66dec9c0 20 remove_watcher() i=5 2024-09-12T19:13:33.892 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.888+0000 7f2b66dec9c0 20 remove_watcher() i=6 2024-09-12T19:13:33.893 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:33.888+0000 7f2b66dec9c0 20 remove_watcher() i=7 2024-09-12T19:13:33.904 INFO:tasks.workunit.client.0.smithi111.stderr:rados -p default.rgw.buckets.data ls | grep 7f3b957e-66d1-4cd2-859c-b45671bbe3d4 2024-09-12T19:13:33.923 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:13:33.924 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:13:34.059 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:34.056+0000 7fd60a59b640 0 -- 172.21.15.111:0/4248009545 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x7fd6000bf3d0 msgr2=0x7fd6000bf850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:34.083 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T19:13:34.084 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T19:13:34.084 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T19:13:35.526 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:35.526 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:35.542 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T19:13:35.992 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T19:13:36.018 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:13:36.018 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:13:36.060 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.056+0000 7f6bb227d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:36.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.060+0000 7f6bb227d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:36.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.060+0000 7f6bb227d9c0 20 realm 2024-09-12T19:13:36.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.060+0000 7f6bb227d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:36.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.060+0000 7f6bb227d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:36.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.060+0000 7f6bb227d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:13:36.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.060+0000 7f6bb227d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:36.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.060+0000 7f6bb227d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:36.062 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.060+0000 7f6bb227d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:36.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.060+0000 7f6bb227d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:13:36.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.060+0000 7f6bb227d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:36.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.060+0000 7f6bb227d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:13:36.064 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.060+0000 7f6bb227d9c0 20 searching for the correct realm 2024-09-12T19:13:36.069 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.064+0000 7f6bafd83640 0 -- 172.21.15.111:0/830932600 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7f6ba800e070 msgr2=0x7f6ba805bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T19:13:36.077 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.072+0000 7f6baf582640 0 -- 172.21.15.111:0/830932600 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7f6ba806a0e0 msgr2=0x7f6ba8058120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:36.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.288+0000 7f6bb227d9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T19:13:36.293 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.288+0000 7f6bb227d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:13:36.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.288+0000 7f6bb227d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:13:36.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.288+0000 7f6bb227d9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T19:13:36.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.288+0000 7f6bb227d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:13:36.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.288+0000 7f6bb227d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:13:36.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.288+0000 7f6bb227d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:36.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:36.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:36.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:13:36.294 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:36.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:13:36.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 zone default found 2024-09-12T19:13:36.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 4 Realm: () 2024-09-12T19:13:36.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T19:13:36.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T19:13:36.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:13:36.295 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 zonegroup default 2024-09-12T19:13:36.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:36.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:36.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:36.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:36.296 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:36.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:36.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 started sync module instance, tier type = 2024-09-12T19:13:36.297 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.292+0000 7f6bb227d9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T19:13:36.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.316+0000 7f6bb227d9c0 20 add_watcher() i=0 2024-09-12T19:13:36.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.316+0000 7f6bb227d9c0 20 add_watcher() i=1 2024-09-12T19:13:36.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.316+0000 7f6bb227d9c0 20 add_watcher() i=2 2024-09-12T19:13:36.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.316+0000 7f6bb227d9c0 20 add_watcher() i=3 2024-09-12T19:13:36.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.316+0000 7f6bb227d9c0 20 add_watcher() i=4 2024-09-12T19:13:36.318 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.316+0000 7f6bb227d9c0 20 add_watcher() i=5 2024-09-12T19:13:36.319 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.316+0000 7f6bb227d9c0 20 add_watcher() i=6 2024-09-12T19:13:36.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.316+0000 7f6bb227d9c0 20 add_watcher() i=7 2024-09-12T19:13:36.320 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.316+0000 7f6bb227d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:13:36.323 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.320+0000 7f6a65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:13:36.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.320+0000 7f6bb227d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:13:36.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.320+0000 7f6bb227d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:13:36.324 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.320+0000 7f6bb227d9c0 5 note: GC not initialized 2024-09-12T19:13:36.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.320+0000 7f6a64fe1640 20 reqs_thread_entry: start 2024-09-12T19:13:36.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.320+0000 7f6bb227d9c0 20 init_complete bucket index max shards: 11 2024-09-12T19:13:36.325 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.320+0000 7f6bb227d9c0 20 Filter name: none 2024-09-12T19:13:36.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f69de7fc640 20 reqs_thread_entry: start 2024-09-12T19:13:36.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f6bb227d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:36.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f6bb227d9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T19:13:36.326 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f6bb227d9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:36.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f6bb227d9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T19:13:36.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f6bb227d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T19:13:36.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f6bb227d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T19:13:36.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f6bb227d9c0 20 INFO: main: starting shard=0 2024-09-12T19:13:36.328 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f6bb227d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.0 2024-09-12T19:13:36.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f6bb227d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:36.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f6bb227d9c0 20 INFO: main: starting shard=1 2024-09-12T19:13:36.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f6bb227d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.1 2024-09-12T19:13:36.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f6bb227d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:36.329 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f6bb227d9c0 20 INFO: main: starting shard=2 2024-09-12T19:13:36.330 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.324+0000 7f6bb227d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.2 2024-09-12T19:13:36.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.328+0000 7f6bb227d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:36.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.328+0000 7f6bb227d9c0 20 INFO: main: starting shard=3 2024-09-12T19:13:36.331 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.328+0000 7f6bb227d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.3 2024-09-12T19:13:36.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.328+0000 7f6bb227d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:36.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.328+0000 7f6bb227d9c0 20 INFO: main: starting shard=4 2024-09-12T19:13:36.332 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.328+0000 7f6bb227d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.4 2024-09-12T19:13:36.333 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.332+0000 7f6bb227d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:36.334 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.332+0000 7f6bb227d9c0 20 INFO: main: starting shard=5 2024-09-12T19:13:36.334 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.332+0000 7f6bb227d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.5 2024-09-12T19:13:36.334 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.332+0000 7f6bb227d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:36.334 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.332+0000 7f6bb227d9c0 20 INFO: main: starting shard=6 2024-09-12T19:13:36.334 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.332+0000 7f6bb227d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.6 2024-09-12T19:13:36.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.332+0000 7f6bb227d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:36.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.332+0000 7f6bb227d9c0 20 INFO: main: starting shard=7 2024-09-12T19:13:36.335 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.332+0000 7f6bb227d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.7 2024-09-12T19:13:36.336 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.332+0000 7f6bb227d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:36.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.332+0000 7f6bb227d9c0 20 INFO: main: starting shard=8 2024-09-12T19:13:36.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.332+0000 7f6bb227d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.8 2024-09-12T19:13:36.337 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.336+0000 7f6bb227d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:36.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.336+0000 7f6bb227d9c0 20 INFO: main: starting shard=9 2024-09-12T19:13:36.338 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.336+0000 7f6bb227d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.9 2024-09-12T19:13:36.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.336+0000 7f6bb227d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:36.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.336+0000 7f6bb227d9c0 20 INFO: main: starting shard=10 2024-09-12T19:13:36.339 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.336+0000 7f6bb227d9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.10 2024-09-12T19:13:36.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.336+0000 7f6bb227d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T19:13:36.340 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.336+0000 7f6bb227d9c0 20 INFO: main: done 2024-09-12T19:13:36.341 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.340+0000 7f6a65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:13:36.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.344+0000 7f6bb227d9c0 20 remove_watcher() i=0 2024-09-12T19:13:36.347 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.344+0000 7f6bb227d9c0 2 removed watcher, disabling cache 2024-09-12T19:13:36.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.348+0000 7f6bb227d9c0 20 remove_watcher() i=1 2024-09-12T19:13:36.352 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.348+0000 7f6bb227d9c0 20 remove_watcher() i=2 2024-09-12T19:13:36.354 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.352+0000 7f6bb227d9c0 20 remove_watcher() i=3 2024-09-12T19:13:36.357 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.352+0000 7f6bb227d9c0 20 remove_watcher() i=4 2024-09-12T19:13:36.358 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.356+0000 7f6bb227d9c0 20 remove_watcher() i=5 2024-09-12T19:13:36.360 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.356+0000 7f6bb227d9c0 20 remove_watcher() i=6 2024-09-12T19:13:36.361 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.360+0000 7f6bb227d9c0 20 remove_watcher() i=7 2024-09-12T19:13:36.381 INFO:tasks.workunit.client.0.smithi111.stderr:rados -p default.rgw.buckets.data ls | grep a1c50c05-02a7-4c83-827b-c4f53e1d2011 2024-09-12T19:13:36.403 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:13:36.403 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:13:36.560 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:36.556+0000 7f789c262640 0 -- 172.21.15.111:0/3716248275 >> [v2:172.21.15.111:6808/2609694328,v1:172.21.15.111:6809/2609694328] conn(0x7f78840bebb0 msgr2=0x7f78840a9380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:36.584 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T19:13:36.584 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T19:13:36.586 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:36.586 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:36.598 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:36.598 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:36.613 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:36.614 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:36.622 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T19:13:38.066 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:38.066 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:38.138 INFO:tasks.workunit.client.0.smithi111.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T19:13:38.139 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T19:13:38.577 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:38.577 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:38.591 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:38.591 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:38.636 INFO:tasks.workunit.client.0.smithi111.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T19:13:38.636 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-12T19:13:38.639 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:38.639 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:38.693 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:38.693 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:38.745 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:38.745 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:38.765 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T19:13:40.207 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:40.207 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:40.217 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:40.217 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:42.244 INFO:tasks.workunit.client.0.smithi111.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T19:13:42.677 INFO:tasks.workunit.client.0.smithi111.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T19:13:42.708 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:13:42.708 INFO:tasks.workunit.client.0.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:13:42.748 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.744+0000 7ffbe4a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:42.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.744+0000 7ffbe4a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:42.749 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.744+0000 7ffbe4a9c9c0 20 realm 2024-09-12T19:13:42.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.744+0000 7ffbe4a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:42.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.748+0000 7ffbe4a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:42.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.748+0000 7ffbe4a9c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:13:42.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.748+0000 7ffbe4a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:42.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.748+0000 7ffbe4a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:42.750 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.748+0000 7ffbe4a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:42.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.748+0000 7ffbe4a9c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:13:42.751 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.748+0000 7ffbe4a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:42.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.748+0000 7ffbe4a9c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:13:42.752 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.748+0000 7ffbe4a9c9c0 20 searching for the correct realm 2024-09-12T19:13:42.757 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.752+0000 7ffbe25a2640 0 -- 172.21.15.111:0/1714587909 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7ffbdc0ef030 msgr2=0x7ffbdc001000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:42.763 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.760+0000 7ffbe1da1640 0 -- 172.21.15.111:0/1714587909 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7ffbdc0b70b0 msgr2=0x7ffbdc0cf7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:42.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.976+0000 7ffbe4a9c9c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T19:13:42.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.976+0000 7ffbe4a9c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:13:42.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.976+0000 7ffbe4a9c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:13:42.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.976+0000 7ffbe4a9c9c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T19:13:42.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.976+0000 7ffbe4a9c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:13:42.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.976+0000 7ffbe4a9c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:13:42.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.976+0000 7ffbe4a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:42.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.976+0000 7ffbe4a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:42.981 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.976+0000 7ffbe4a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:42.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.980+0000 7ffbe4a9c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:13:42.982 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.980+0000 7ffbe4a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:42.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.980+0000 7ffbe4a9c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:13:42.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.980+0000 7ffbe4a9c9c0 20 zone default found 2024-09-12T19:13:42.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.980+0000 7ffbe4a9c9c0 4 Realm: () 2024-09-12T19:13:42.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.980+0000 7ffbe4a9c9c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T19:13:42.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.980+0000 7ffbe4a9c9c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T19:13:42.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.980+0000 7ffbe4a9c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:13:42.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.980+0000 7ffbe4a9c9c0 20 zonegroup default 2024-09-12T19:13:42.983 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.980+0000 7ffbe4a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:42.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.980+0000 7ffbe4a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:42.984 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.980+0000 7ffbe4a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:42.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.980+0000 7ffbe4a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:42.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.980+0000 7ffbe4a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:42.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.984+0000 7ffbe4a9c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:42.985 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.984+0000 7ffbe4a9c9c0 20 started sync module instance, tier type = 2024-09-12T19:13:42.986 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:42.984+0000 7ffbe4a9c9c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T19:13:43.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.004+0000 7ffbe4a9c9c0 20 add_watcher() i=0 2024-09-12T19:13:43.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.004+0000 7ffbe4a9c9c0 20 add_watcher() i=1 2024-09-12T19:13:43.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.004+0000 7ffbe4a9c9c0 20 add_watcher() i=2 2024-09-12T19:13:43.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.004+0000 7ffbe4a9c9c0 20 add_watcher() i=3 2024-09-12T19:13:43.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.004+0000 7ffbe4a9c9c0 20 add_watcher() i=4 2024-09-12T19:13:43.009 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.004+0000 7ffbe4a9c9c0 20 add_watcher() i=5 2024-09-12T19:13:43.010 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.004+0000 7ffbe4a9c9c0 20 add_watcher() i=6 2024-09-12T19:13:43.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.008+0000 7ffbe4a9c9c0 20 add_watcher() i=7 2024-09-12T19:13:43.011 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.008+0000 7ffbe4a9c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:13:43.015 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.012+0000 7ffa98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:13:43.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.012+0000 7ffbe4a9c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:13:43.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.012+0000 7ffbe4a9c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:13:43.016 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.012+0000 7ffbe4a9c9c0 5 note: GC not initialized 2024-09-12T19:13:43.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.012+0000 7ffa137fe640 20 reqs_thread_entry: start 2024-09-12T19:13:43.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.012+0000 7ffbe4a9c9c0 20 init_complete bucket index max shards: 11 2024-09-12T19:13:43.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.012+0000 7ffbe4a9c9c0 20 Filter name: none 2024-09-12T19:13:43.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.012+0000 7ffa117fa640 20 reqs_thread_entry: start 2024-09-12T19:13:43.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.012+0000 7ffbe4a9c9c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T19:13:43.017 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.012+0000 7ffbe4a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:43.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T19:13:43.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T19:13:43.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T19:13:43.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.782 : miss 2024-09-12T19:13:43.018 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:43.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T19:13:43.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.782 info.flags=0x17 2024-09-12T19:13:43.019 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.782 to cache LRU end 2024-09-12T19:13:43.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T19:13:43.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T19:13:43.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:97c2b296-1395-4700-8053-4f06c4c86557.4689.782 2024-09-12T19:13:43.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.0 2024-09-12T19:13:43.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T19:13:43.020 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.1 2024-09-12T19:13:43.021 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T19:13:43.021 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.016+0000 7ffbe4a9c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.2 2024-09-12T19:13:43.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.020+0000 7ffbe4a9c9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T19:13:43.023 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.020+0000 7ffbe4a9c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.3 2024-09-12T19:13:43.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.020+0000 7ffbe4a9c9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T19:13:43.024 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.020+0000 7ffbe4a9c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.4 2024-09-12T19:13:43.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.020+0000 7ffbe4a9c9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T19:13:43.025 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.020+0000 7ffbe4a9c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.5 2024-09-12T19:13:43.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.024+0000 7ffbe4a9c9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T19:13:43.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.024+0000 7ffbe4a9c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.6 2024-09-12T19:13:43.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.024+0000 7ffbe4a9c9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T19:13:43.026 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.024+0000 7ffbe4a9c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.7 2024-09-12T19:13:43.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.024+0000 7ffbe4a9c9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T19:13:43.027 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.024+0000 7ffbe4a9c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.8 2024-09-12T19:13:43.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.024+0000 7ffbe4a9c9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T19:13:43.028 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.024+0000 7ffbe4a9c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.9 2024-09-12T19:13:43.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.028+0000 7ffbe4a9c9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T19:13:43.029 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.028+0000 7ffbe4a9c9c0 20 bucket index object: :.dir.97c2b296-1395-4700-8053-4f06c4c86557.4689.782.10 2024-09-12T19:13:43.030 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.028+0000 7ffbe4a9c9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T19:13:43.031 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.028+0000 7ffbe4a9c9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T19:13:43.032 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.028+0000 7ffa98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:13:43.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.032+0000 7ffbe4a9c9c0 20 remove_watcher() i=0 2024-09-12T19:13:43.037 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.032+0000 7ffbe4a9c9c0 2 removed watcher, disabling cache 2024-09-12T19:13:43.039 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.036+0000 7ffbe4a9c9c0 20 remove_watcher() i=1 2024-09-12T19:13:43.042 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.040+0000 7ffbe4a9c9c0 20 remove_watcher() i=2 2024-09-12T19:13:43.044 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.040+0000 7ffbe4a9c9c0 20 remove_watcher() i=3 2024-09-12T19:13:43.046 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.044+0000 7ffbe4a9c9c0 20 remove_watcher() i=4 2024-09-12T19:13:43.049 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.044+0000 7ffbe4a9c9c0 20 remove_watcher() i=5 2024-09-12T19:13:43.050 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.048+0000 7ffbe4a9c9c0 20 remove_watcher() i=6 2024-09-12T19:13:43.052 INFO:tasks.workunit.client.0.smithi111.stderr:2024-09-12T19:13:43.048+0000 7ffbe4a9c9c0 20 remove_watcher() i=7 2024-09-12T19:13:43.071 INFO:tasks.workunit.client.0.smithi111.stderr:Deleting bucket versioning-bucket 2024-09-12T19:13:43.072 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:43.072 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:43.077 INFO:tasks.workunit.client.0.smithi111.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T19:13:43.077 INFO:tasks.workunit.client.0.smithi111.stderr: warnings.warn( 2024-09-12T19:13:43.130 INFO:tasks.workunit.client.0.smithi111.stderr:Completed bucket versioning tests 2024-09-12T19:13:43.131 INFO:tasks.workunit.client.0.smithi111.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T19:13:43.131 INFO:tasks.workunit.client.0.smithi111.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T19:13:43.131 INFO:tasks.workunit.client.0.smithi111.stdout:connected to https://localhost:443 2024-09-12T19:13:43.200 INFO:tasks.workunit.client.0.smithi111.stderr:+ deactivate 2024-09-12T19:13:43.200 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T19:13:43.200 INFO:tasks.workunit.client.0.smithi111.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T19:13:43.200 INFO:tasks.workunit.client.0.smithi111.stderr:+ export PATH 2024-09-12T19:13:43.200 INFO:tasks.workunit.client.0.smithi111.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T19:13:43.201 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' -n '' ']' 2024-09-12T19:13:43.201 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T19:13:43.201 INFO:tasks.workunit.client.0.smithi111.stderr:+ hash -r 2024-09-12T19:13:43.201 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' -n '' ']' 2024-09-12T19:13:43.201 INFO:tasks.workunit.client.0.smithi111.stderr:+ unset VIRTUAL_ENV 2024-09-12T19:13:43.201 INFO:tasks.workunit.client.0.smithi111.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T19:13:43.201 INFO:tasks.workunit.client.0.smithi111.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T19:13:43.201 INFO:tasks.workunit.client.0.smithi111.stderr:+ unset -f deactivate 2024-09-12T19:13:43.201 INFO:tasks.workunit.client.0.smithi111.stderr:+ echo OK. 2024-09-12T19:13:43.202 INFO:tasks.workunit.client.0.smithi111.stdout:OK. 2024-09-12T19:13:43.202 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T19:13:43.202 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T19:13:43.258 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T19:13:43.258 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T19:13:43.642 DEBUG:teuthology.parallel:result is None 2024-09-12T19:13:43.643 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T19:13:43.654 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T19:13:43.655 DEBUG:teuthology.orchestra.run.smithi111:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T19:13:43.702 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T19:13:43.703 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T19:13:43.715 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T19:13:43.756 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T19:13:43.756 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T19:13:43.756 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T19:13:43.807 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T19:13:43.807 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T19:13:43.843 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:13:43.843 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:13:43.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.880+0000 7faebe1679c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:43.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.880+0000 7faebe1679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:43.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.880+0000 7faebe1679c0 20 realm 2024-09-12T19:13:43.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.880+0000 7faebe1679c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:43.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.880+0000 7faebe1679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:43.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.880+0000 7faebe1679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:13:43.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.880+0000 7faebe1679c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:43.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.880+0000 7faebe1679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:43.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.880+0000 7faebe1679c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:43.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.884+0000 7faebe1679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:13:43.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.884+0000 7faebe1679c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:43.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.884+0000 7faebe1679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:13:43.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.884+0000 7faebe1679c0 20 searching for the correct realm 2024-09-12T19:13:43.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.892+0000 7faebc46e640 0 -- 172.21.15.111:0/2124505116 >> [v2:172.21.15.111:6800/2832238944,v1:172.21.15.111:6801/2832238944] conn(0x563ad024c2e0 msgr2=0x563ad024e750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:43.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.896+0000 7faebc46e640 0 -- 172.21.15.111:0/2124505116 >> [v2:172.21.15.153:6816/2228313878,v1:172.21.15.153:6817/2228313878] conn(0x7faea40eb040 msgr2=0x7faea40c2050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:43.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T19:13:43.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:13:43.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:13:43.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T19:13:43.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:13:43.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:13:43.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:43.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:43.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:43.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:13:43.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:43.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:13:43.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 zone default found 2024-09-12T19:13:43.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 4 Realm: () 2024-09-12T19:13:43.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T19:13:43.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T19:13:43.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:13:43.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 zonegroup default 2024-09-12T19:13:43.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:43.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:43.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.904+0000 7faebe1679c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:43.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.908+0000 7faebe1679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:43.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.908+0000 7faebe1679c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:43.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.908+0000 7faebe1679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:43.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.908+0000 7faebe1679c0 20 started sync module instance, tier type = 2024-09-12T19:13:43.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.908+0000 7faebe1679c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T19:13:43.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.924+0000 7faebe1679c0 20 add_watcher() i=0 2024-09-12T19:13:43.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.924+0000 7faebe1679c0 20 add_watcher() i=1 2024-09-12T19:13:43.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.924+0000 7faebe1679c0 20 add_watcher() i=2 2024-09-12T19:13:43.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.924+0000 7faebe1679c0 20 add_watcher() i=3 2024-09-12T19:13:43.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.924+0000 7faebe1679c0 20 add_watcher() i=4 2024-09-12T19:13:43.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.924+0000 7faebe1679c0 20 add_watcher() i=5 2024-09-12T19:13:43.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.924+0000 7faebe1679c0 20 add_watcher() i=6 2024-09-12T19:13:43.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.924+0000 7faebe1679c0 20 add_watcher() i=7 2024-09-12T19:13:43.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.924+0000 7faebe1679c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:13:43.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.928+0000 7fad727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:13:43.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.928+0000 7faebe1679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:13:43.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.928+0000 7faebe1679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:13:43.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.996+0000 7fad717e2640 20 reqs_thread_entry: start 2024-09-12T19:13:44.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.996+0000 7faebe1679c0 20 init_complete bucket index max shards: 11 2024-09-12T19:13:44.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.996+0000 7faebe1679c0 20 Filter name: none 2024-09-12T19:13:44.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.996+0000 7fad6a7fc640 20 reqs_thread_entry: start 2024-09-12T19:13:44.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.996+0000 7faebe1679c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T19:13:44.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.996+0000 7faebe1679c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:44.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.996+0000 7faebe1679c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T19:13:44.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.996+0000 7faebe1679c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T19:13:44.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.996+0000 7faebe1679c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T19:13:44.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:43.996+0000 7faebe1679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T19:13:44.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.000+0000 7faebe1679c0 10 removing key index: GRMLAJZNMYVUCGQZMOEU 2024-09-12T19:13:44.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.000+0000 7faebe1679c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:GRMLAJZNMYVUCGQZMOEU, ofs0, ns] 2024-09-12T19:13:44.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.000+0000 7fad9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333823 cookie 94810600229712 notifier 8840 bl.length()=170 2024-09-12T19:13:44.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.000+0000 7faebe1679c0 10 removing email index: tester.client.0_test@test.test 2024-09-12T19:13:44.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.004+0000 7faebe1679c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T19:13:44.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.004+0000 7fad9a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333710 cookie 94810600221824 notifier 8840 bl.length()=181 2024-09-12T19:13:44.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.004+0000 7faebe1679c0 10 removing user buckets index 2024-09-12T19:13:44.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.008+0000 7faebe1679c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T19:13:44.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.008+0000 7fad9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333824 cookie 94810600229712 notifier 8840 bl.length()=172 2024-09-12T19:13:44.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.008+0000 7faebe1679c0 10 removing user index: tester.client.0 2024-09-12T19:13:44.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.008+0000 7faebe1679c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T19:13:44.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.008+0000 7faebe1679c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T19:13:44.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.008+0000 7fad9affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333967 cookie 94810600227216 notifier 8840 bl.length()=164 2024-09-12T19:13:44.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.012+0000 7fad727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:13:44.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.016+0000 7faebe1679c0 20 remove_watcher() i=0 2024-09-12T19:13:44.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.016+0000 7faebe1679c0 2 removed watcher, disabling cache 2024-09-12T19:13:44.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.016+0000 7faebe1679c0 20 remove_watcher() i=1 2024-09-12T19:13:44.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.020+0000 7faebe1679c0 20 remove_watcher() i=2 2024-09-12T19:13:44.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.020+0000 7faebe1679c0 20 remove_watcher() i=3 2024-09-12T19:13:44.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.024+0000 7faebe1679c0 20 remove_watcher() i=4 2024-09-12T19:13:44.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.024+0000 7faebe1679c0 20 remove_watcher() i=5 2024-09-12T19:13:44.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.024+0000 7faebe1679c0 20 remove_watcher() i=6 2024-09-12T19:13:44.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:44.028+0000 7faebe1679c0 20 remove_watcher() i=7 2024-09-12T19:13:44.042 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T19:13:44.054 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T19:13:44.088 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T19:13:44.131 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T19:13:44.141 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T19:13:44.141 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:13:44.174 INFO:tasks.rgw.client.0.smithi111.stdout:2024-09-12T19:13:44.172+0000 7fbe8880f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 39957) UID: 0 2024-09-12T19:13:44.174 INFO:tasks.rgw.client.0.smithi111.stdout:2024-09-12T19:13:44.172+0000 7fbe8c057a40 -1 shutting down 2024-09-12T19:13:55.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-12T19:13:56.345 INFO:tasks.rgw.client.0:Stopped 2024-09-12T19:13:56.345 DEBUG:teuthology.orchestra.run.smithi111:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T19:13:56.352 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T19:13:56.407 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T19:13:56.462 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T19:13:56.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T19:13:56.463 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T19:13:56.541 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setuser ceph since I am not root 2024-09-12T19:13:56.542 INFO:teuthology.orchestra.run.smithi111.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T19:13:56.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.580+0000 7fe6722349c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:56.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.580+0000 7fe6722349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:56.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.580+0000 7fe6722349c0 20 realm 2024-09-12T19:13:56.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.580+0000 7fe6722349c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:56.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.580+0000 7fe6722349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:56.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.580+0000 7fe6722349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T19:13:56.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.580+0000 7fe6722349c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:56.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.580+0000 7fe6722349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:56.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.580+0000 7fe6722349c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:56.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.584+0000 7fe6722349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:13:56.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.584+0000 7fe6722349c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:56.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.584+0000 7fe6722349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T19:13:56.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.584+0000 7fe6722349c0 20 searching for the correct realm 2024-09-12T19:13:56.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.588+0000 7fe66fd3a640 0 -- 172.21.15.111:0/2662903071 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fe660008040 msgr2=0x7fe660019ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:56.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.596+0000 7fe66f539640 0 -- 172.21.15.111:0/2662903071 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fe6600173f0 msgr2=0x7fe660017870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:56.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.812+0000 7fe6722349c0 20 RGWRados::pool_iterate: got zonegroup_info.1bef21cc-0987-457f-b3ed-63242bec6ffb 2024-09-12T19:13:56.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.812+0000 7fe6722349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T19:13:56.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.812+0000 7fe6722349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T19:13:56.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.812+0000 7fe6722349c0 20 RGWRados::pool_iterate: got zone_info.97c2b296-1395-4700-8053-4f06c4c86557 2024-09-12T19:13:56.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.812+0000 7fe6722349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T19:13:56.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.812+0000 7fe6722349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T19:13:56.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.812+0000 7fe6722349c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:56.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.816+0000 7fe6722349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:56.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.816+0000 7fe6722349c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:56.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.816+0000 7fe6722349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T19:13:56.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.816+0000 7fe6722349c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:56.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.816+0000 7fe6722349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T19:13:56.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.816+0000 7fe6722349c0 20 zone default found 2024-09-12T19:13:56.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.816+0000 7fe6722349c0 4 Realm: () 2024-09-12T19:13:56.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.816+0000 7fe6722349c0 4 ZoneGroup: default (1bef21cc-0987-457f-b3ed-63242bec6ffb) 2024-09-12T19:13:56.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.816+0000 7fe6722349c0 4 Zone: default (97c2b296-1395-4700-8053-4f06c4c86557) 2024-09-12T19:13:56.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.816+0000 7fe6722349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T19:13:56.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.816+0000 7fe6722349c0 20 zonegroup default 2024-09-12T19:13:56.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.816+0000 7fe6722349c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:56.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.816+0000 7fe6722349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:56.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.816+0000 7fe6722349c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:56.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.820+0000 7fe6722349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:56.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.820+0000 7fe6722349c0 20 rados->read ofs=0 len=0 2024-09-12T19:13:56.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.820+0000 7fe6722349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T19:13:56.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.820+0000 7fe6722349c0 20 started sync module instance, tier type = 2024-09-12T19:13:56.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.820+0000 7fe6722349c0 20 started zone id=97c2b296-1395-4700-8053-4f06c4c86557 (name=default) with tier type = 2024-09-12T19:13:56.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.844+0000 7fe6722349c0 20 add_watcher() i=0 2024-09-12T19:13:56.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.844+0000 7fe6722349c0 20 add_watcher() i=1 2024-09-12T19:13:56.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.844+0000 7fe6722349c0 20 add_watcher() i=2 2024-09-12T19:13:56.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.844+0000 7fe6722349c0 20 add_watcher() i=3 2024-09-12T19:13:56.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.844+0000 7fe6722349c0 20 add_watcher() i=4 2024-09-12T19:13:56.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.844+0000 7fe6722349c0 20 add_watcher() i=5 2024-09-12T19:13:56.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.844+0000 7fe6722349c0 20 add_watcher() i=6 2024-09-12T19:13:56.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.848+0000 7fe6722349c0 20 add_watcher() i=7 2024-09-12T19:13:56.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.848+0000 7fe6722349c0 2 all 8 watchers are set, enabling cache 2024-09-12T19:13:56.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.852+0000 7fe525fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:13:56.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.852+0000 7fe6722349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T19:13:56.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.852+0000 7fe6722349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T19:13:56.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.944+0000 7fe524fe1640 20 reqs_thread_entry: start 2024-09-12T19:13:56.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.944+0000 7fe6722349c0 20 init_complete bucket index max shards: 11 2024-09-12T19:13:56.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.944+0000 7fe6722349c0 20 Filter name: none 2024-09-12T19:13:56.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.944+0000 7fe49e7fc640 20 reqs_thread_entry: start 2024-09-12T19:13:56.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T19:13:56.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.948+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:56.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.948+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:56.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45533' 2024-09-12T19:13:56.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13957973986810639051', time=2024-09-12T20:59:50.806882+0000, chain.objs.size()=1 2024-09-12T19:13:56.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.234__shadow_.KWqhapEMe7gEXtomNDCdTE5-usb8M_T_0 2024-09-12T19:13:56.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11835755197513632440', time=2024-09-12T20:59:52.376646+0000, chain.objs.size()=1 2024-09-12T19:13:56.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.236__shadow_.AeOkwY_XxcM_qucTzRDztytzRO5OpT7_0 2024-09-12T19:13:56.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7819556672929012591', time=2024-09-12T20:59:56.923535+0000, chain.objs.size()=1 2024-09-12T19:13:56.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.241__shadow_.sUK338d7wz__IM8fSpkEEL_d_UQ5PJ4_0 2024-09-12T19:13:56.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13071649439292457464', time=2024-09-12T21:00:08.819881+0000, chain.objs.size()=1 2024-09-12T19:13:56.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.256__shadow_.mCCFzzR_FEAgyJoIa4ieVYZV1ar12rh_0 2024-09-12T19:13:56.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16017519077050724476', time=2024-09-12T21:00:09.555391+0000, chain.objs.size()=1 2024-09-12T19:13:56.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.257__shadow_.MI9J6EeLnUhfQU7ajPCbssKR0CeypLS_0 2024-09-12T19:13:56.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17730171746812569646', time=2024-09-12T21:00:32.042019+0000, chain.objs.size()=1 2024-09-12T19:13:56.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qlSYz5irqcdyuEDjUL2hmXKNgJHHguV_0 2024-09-12T19:13:56.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5141350117248795122', time=2024-09-12T21:00:32.112879+0000, chain.objs.size()=1 2024-09-12T19:13:56.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.j4FbU4drSAPbmVdl-k_T0O34YYhFiek_0 2024-09-12T19:13:56.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5034758026012411422', time=2024-09-12T21:00:32.119885+0000, chain.objs.size()=1 2024-09-12T19:13:56.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LvSLH7vt8mDorez_0ehc-ZSwCPjFjGg_0 2024-09-12T19:13:56.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12325220821620418621', time=2024-09-12T21:00:32.126542+0000, chain.objs.size()=1 2024-09-12T19:13:56.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.w2NWgtoyf8Pkga4jd6vjQzNoAYAAIr1_0 2024-09-12T19:13:56.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17727674165130571238', time=2024-09-12T21:00:32.273140+0000, chain.objs.size()=1 2024-09-12T19:13:56.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tGMKPLVZPrN15tJx8QiVr5Dh88_eRQn_0 2024-09-12T19:13:56.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2293521831665156217', time=2024-09-12T21:00:32.287013+0000, chain.objs.size()=1 2024-09-12T19:13:56.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DkxshnJ-6GU77kMKxy5HXi7sZa73vKu_0 2024-09-12T19:13:56.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10100432284598282062', time=2024-09-12T21:00:32.288843+0000, chain.objs.size()=1 2024-09-12T19:13:56.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.fQOR8P8GyuOx2_ZpYfK3CSeHU5J72eQ_0 2024-09-12T19:13:56.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3139577114263834492', time=2024-09-12T21:00:32.506119+0000, chain.objs.size()=1 2024-09-12T19:13:56.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.nZIZOksem0vru7PWXcvC6c2DstrxH-I_0 2024-09-12T19:13:56.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1890217567898775408', time=2024-09-12T21:00:32.518340+0000, chain.objs.size()=1 2024-09-12T19:13:56.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.uO4BWovFQHPcFQ-eQwSWfqOiivSISTy_0 2024-09-12T19:13:56.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17391052861359572077', time=2024-09-12T21:00:32.528846+0000, chain.objs.size()=1 2024-09-12T19:13:56.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.8va2x7C5wjQeeVc1XMyaXJGn4joai3t_0 2024-09-12T19:13:56.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10041872378211888374', time=2024-09-12T21:00:32.765822+0000, chain.objs.size()=1 2024-09-12T19:13:56.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.wR8rEWTUDSupeWGLxrGvtFDWo_Iz2N__0 2024-09-12T19:13:56.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17822241422069661906', time=2024-09-12T21:00:32.766525+0000, chain.objs.size()=1 2024-09-12T19:13:56.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.c6_JNuckbyoL1CKAMeJ8L3cgg-YuHOR_0 2024-09-12T19:13:56.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6330048739421648061', time=2024-09-12T21:00:32.767286+0000, chain.objs.size()=1 2024-09-12T19:13:56.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.OBmzwNdeg-MjFaMQDoSsm0qlHtahd1c_0 2024-09-12T19:13:56.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9985799036830186010', time=2024-09-12T21:00:32.923708+0000, chain.objs.size()=1 2024-09-12T19:13:56.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.EKiCJd_Szi_BtYplx8RveYfCvw-E94H_0 2024-09-12T19:13:56.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14643038844194679844', time=2024-09-12T21:00:32.961580+0000, chain.objs.size()=1 2024-09-12T19:13:56.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JRQEDEgRWhmMQEHWKaRfvi4hpqbm1qN_0 2024-09-12T19:13:56.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1470046633708464851', time=2024-09-12T21:00:33.110548+0000, chain.objs.size()=1 2024-09-12T19:13:56.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3wsT8fvEdRy5kWja60srkx8iYIkzauy_0 2024-09-12T19:13:56.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11816643862978572259', time=2024-09-12T21:00:33.130291+0000, chain.objs.size()=1 2024-09-12T19:13:56.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-KWwN8vE9mHkGqgh3p_FDRVZ3mbU9mV_0 2024-09-12T19:13:56.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.960+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3908136724840610719', time=2024-09-12T21:00:33.141457+0000, chain.objs.size()=1 2024-09-12T19:13:56.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.960+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Bq34TmUnxGjQ4Ssna2EfnqQvQx1tjyc_0 2024-09-12T19:13:56.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.960+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13895064459991471671', time=2024-09-12T21:00:33.188603+0000, chain.objs.size()=1 2024-09-12T19:13:56.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.960+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.jBVyNAH0rHcJspddjgRYafmWus4xq3Y_0 2024-09-12T19:13:56.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.960+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17346616219338254819', time=2024-09-12T21:00:33.190216+0000, chain.objs.size()=1 2024-09-12T19:13:56.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.960+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ZqWEDUQd_yFY3VZXZiCDIBoYCIcFhby_0 2024-09-12T19:13:56.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.960+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15297447241397575370', time=2024-09-12T21:00:33.361748+0000, chain.objs.size()=1 2024-09-12T19:13:56.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.960+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.dKxnLW5RFoteNI7kXEHb0fNQQfAY8Wv_0 2024-09-12T19:13:56.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.960+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3928043532198537478', time=2024-09-12T21:00:33.468561+0000, chain.objs.size()=1 2024-09-12T19:13:56.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.960+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.TXrN6nrJeu2qe6jRknXxJgT5s9pKhli_0 2024-09-12T19:13:56.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.960+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9173055179960333614', time=2024-09-12T21:00:33.489168+0000, chain.objs.size()=1 2024-09-12T19:13:56.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.960+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.cBm9_ibdD-fjbFP19odh5B_vzA5XSAq_0 2024-09-12T19:13:56.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.960+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1647979385788008077', time=2024-09-12T21:00:33.579492+0000, chain.objs.size()=1 2024-09-12T19:13:56.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.960+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qzKm1g71PB0V51o4itQOp42pnXqkScQ_0 2024-09-12T19:13:56.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18171009840961248372', time=2024-09-12T21:00:33.583814+0000, chain.objs.size()=1 2024-09-12T19:13:56.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.9_Bn4eYjTIlOlfZeuhR3OR-pAlpfM95_0 2024-09-12T19:13:56.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5363514195273828829', time=2024-09-12T21:00:33.626938+0000, chain.objs.size()=1 2024-09-12T19:13:56.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WOLNtYL2z-47ajZSKhhvKIjOw0NDkr4_0 2024-09-12T19:13:56.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7730562828210946655', time=2024-09-12T21:00:33.641040+0000, chain.objs.size()=1 2024-09-12T19:13:56.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7bO7ORAzjVnsPqMDhHcJrZuHeQYaZav_0 2024-09-12T19:13:56.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16763244102706811958', time=2024-09-12T21:00:33.644246+0000, chain.objs.size()=1 2024-09-12T19:13:56.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JqB3kXkZmV4PHJbFQRWA3Wj0fVPpUNj_0 2024-09-12T19:13:56.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14950143641155066046', time=2024-09-12T21:00:33.854241+0000, chain.objs.size()=1 2024-09-12T19:13:56.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.KWXgHERL_OknTCkakraDuyBj-EakI-s_0 2024-09-12T19:13:56.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15694982236606616941', time=2024-09-12T21:00:44.743944+0000, chain.objs.size()=1 2024-09-12T19:13:56.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.277__shadow_.8abXsf-McLmHzadsHoXEFCACDkljzn8_0 2024-09-12T19:13:56.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15071410550035389237', time=2024-09-12T21:00:45.450488+0000, chain.objs.size()=1 2024-09-12T19:13:56.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.278__shadow_.MYJDlqRQzUOqPguPy8J8VaURtcVQbUh_0 2024-09-12T19:13:56.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11504529591711153643', time=2024-09-12T21:00:48.389891+0000, chain.objs.size()=1 2024-09-12T19:13:56.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.282__shadow_.L2ORTPXYMkVHxNrWDDwOEI9VQn3Jwjc_0 2024-09-12T19:13:56.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8579290662238548772', time=2024-09-12T21:00:56.708400+0000, chain.objs.size()=1 2024-09-12T19:13:56.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.ptrpJNM1nP63zRjOISz4gs-nOLIzCtK_0 2024-09-12T19:13:56.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9774114900603960376', time=2024-09-12T21:00:56.744878+0000, chain.objs.size()=1 2024-09-12T19:13:56.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.8qsxflmp7UCj5bJR9cgmrzcD05mCLZV_0 2024-09-12T19:13:56.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12408030960258705855', time=2024-09-12T21:01:00.283108+0000, chain.objs.size()=1 2024-09-12T19:13:56.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.296__shadow_.LEzosL-pwgGoFpwNg62Ftx4Rf1s4urw_0 2024-09-12T19:13:56.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14958718923999498976', time=2024-09-12T21:01:01.002788+0000, chain.objs.size()=1 2024-09-12T19:13:56.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.297__shadow_.zadI5HYLdwCWoSh9baKajmaHv1zWc_R_0 2024-09-12T19:13:56.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4146741905272303617', time=2024-09-12T21:01:39.424877+0000, chain.objs.size()=1 2024-09-12T19:13:56.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ZXaz6DWaLfHaPQ8dA97W9AOdbK41Ky0_0 2024-09-12T19:13:56.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16425058484443247712', time=2024-09-12T21:01:39.462510+0000, chain.objs.size()=1 2024-09-12T19:13:56.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ff6bv-lAwe68wMBFig9q6vovTqi3IBU_0 2024-09-12T19:13:56.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11216498833645460371', time=2024-09-12T21:01:39.471339+0000, chain.objs.size()=1 2024-09-12T19:13:56.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.uKy8IIqkF-3LHI8ePmrOip_kOU7NrrS_0 2024-09-12T19:13:56.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5888539106848779452', time=2024-09-12T21:01:39.664249+0000, chain.objs.size()=1 2024-09-12T19:13:56.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.PnaAbdI0I5QFc2rgZiT8ZAsFQciQ1zB_0 2024-09-12T19:13:56.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11024967509544054458', time=2024-09-12T21:01:39.723342+0000, chain.objs.size()=1 2024-09-12T19:13:56.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.CMQXMNfrJIcc3yghk_g1H7ZQENa1A6z_0 2024-09-12T19:13:56.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13211029788639791737', time=2024-09-12T21:01:39.784004+0000, chain.objs.size()=1 2024-09-12T19:13:56.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.qN1kAvEK2m4CgGVEsI6W6H4Nvo15O4T_0 2024-09-12T19:13:56.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2307422017978159107', time=2024-09-12T21:01:39.786822+0000, chain.objs.size()=1 2024-09-12T19:13:56.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Uvgw0Mym1m1P6f1cADow7O9tH549V-q_0 2024-09-12T19:13:56.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11798655694802986479', time=2024-09-12T21:01:39.789464+0000, chain.objs.size()=1 2024-09-12T19:13:56.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.5fem8R3SlWPBn8ZTKUxMR6nlO7XNv4n_0 2024-09-12T19:13:56.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5992625322756398452', time=2024-09-12T21:01:39.796981+0000, chain.objs.size()=1 2024-09-12T19:13:56.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.sceDaEs22cT7vUmLF5FoMAHW2jxHNun_0 2024-09-12T19:13:56.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2827188946493639350', time=2024-09-12T21:01:39.914859+0000, chain.objs.size()=1 2024-09-12T19:13:56.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.PeUQVii2im30ddHfs-LJnXHXxLIlcea_0 2024-09-12T19:13:56.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10926550679800205213', time=2024-09-12T21:01:39.968265+0000, chain.objs.size()=1 2024-09-12T19:13:56.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.g9VmrInNoOhrW-eJTLiJ0yBr_1t2XTp_0 2024-09-12T19:13:56.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5524602061174054345', time=2024-09-12T21:01:39.971165+0000, chain.objs.size()=1 2024-09-12T19:13:56.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.SIZF5-vGrd9gFCgp2Ul9oJMCCMNnSrQ_0 2024-09-12T19:13:56.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3264519848129782195', time=2024-09-12T21:01:39.975200+0000, chain.objs.size()=1 2024-09-12T19:13:56.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.WKlGhJfDOvzu8v1np3ognpoRhyn9Zoh_0 2024-09-12T19:13:56.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9534704927197451686', time=2024-09-12T21:01:40.160888+0000, chain.objs.size()=1 2024-09-12T19:13:56.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.JBhOoXVasnK-FhwlJu1n1TjRqImJ4_G_0 2024-09-12T19:13:56.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8031563715913386729', time=2024-09-12T21:01:40.178583+0000, chain.objs.size()=1 2024-09-12T19:13:56.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.lXF3TU9Sf2To_1L0YYxeiicXEe9Alxi_0 2024-09-12T19:13:56.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9102032089336663275', time=2024-09-12T21:01:40.188901+0000, chain.objs.size()=1 2024-09-12T19:13:56.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.VIaYMzzYn7-oRDmkv5hsagiwtZk4S5n_0 2024-09-12T19:13:56.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1924165605104457191', time=2024-09-12T21:01:40.218697+0000, chain.objs.size()=1 2024-09-12T19:13:56.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DPRrS7P0Zt6bNqc-YcKSfvIqa7Nmlyp_0 2024-09-12T19:13:56.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16460900956353647905', time=2024-09-12T21:01:40.229227+0000, chain.objs.size()=1 2024-09-12T19:13:56.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.wh9CseqaC0QaP7m4Z_bAKfq2_4slc-R_0 2024-09-12T19:13:56.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3269585002828543187', time=2024-09-12T21:01:40.455243+0000, chain.objs.size()=1 2024-09-12T19:13:56.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.KBVsDaE0RH0GZe60N5-jLu-ZqGXeuhN_0 2024-09-12T19:13:56.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6203974929952040752', time=2024-09-12T21:01:40.632864+0000, chain.objs.size()=1 2024-09-12T19:13:56.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.eRSz8fJOsSkawyb8mQjS6NcYZQzrVUu_0 2024-09-12T19:13:56.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5037305406082431253', time=2024-09-12T21:01:40.832740+0000, chain.objs.size()=1 2024-09-12T19:13:56.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.7pV5f3zvec2uCMIwAq-yEo-yrKDmCQN_0 2024-09-12T19:13:56.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.554409752985272893', time=2024-09-12T21:01:40.848003+0000, chain.objs.size()=1 2024-09-12T19:13:56.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.buha_zQvpdFi-g2IrjiDogEP-3_3czi_0 2024-09-12T19:13:56.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7515907820530351878', time=2024-09-12T21:01:40.857989+0000, chain.objs.size()=1 2024-09-12T19:13:56.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.yB84NJXxYK7tkxcVqj3npPVdMPtQouZ_0 2024-09-12T19:13:56.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7388311027361897922', time=2024-09-12T21:01:40.881042+0000, chain.objs.size()=1 2024-09-12T19:13:56.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.nBg7NuOazwo7bRkeVeDRynWgA1kNLRR_0 2024-09-12T19:13:56.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.844412472669555134', time=2024-09-12T21:01:40.884530+0000, chain.objs.size()=1 2024-09-12T19:13:56.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.JTqCwFDbtJQ6k_hjK_bihXioySgs86r_0 2024-09-12T19:13:56.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.234311725725750162', time=2024-09-12T21:01:40.892195+0000, chain.objs.size()=1 2024-09-12T19:13:56.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.q5mEC2OaVAr7NfWuAeFIfUcTz49PxXM_0 2024-09-12T19:13:56.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16330513256563803918', time=2024-09-12T21:01:41.076400+0000, chain.objs.size()=1 2024-09-12T19:13:56.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.lML8l3j1rhVFt-4MYxxTCDRU78wHhyU_0 2024-09-12T19:13:56.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13613589812501629995', time=2024-09-12T21:02:00.507329+0000, chain.objs.size()=1 2024-09-12T19:13:56.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.xTQzM-_VdyQr4qWw17iKg3olsGHJN7-_0 2024-09-12T19:13:56.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12748597215919599941', time=2024-09-12T21:02:00.587766+0000, chain.objs.size()=1 2024-09-12T19:13:56.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1PR7CfGIHq32bUzdNUEV9lJdMYfskyn_0 2024-09-12T19:13:56.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4301312588337355455', time=2024-09-12T21:02:00.606846+0000, chain.objs.size()=1 2024-09-12T19:13:56.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.IFy1OogjiX5iQaFL5yLaObZwtvT6W2j_0 2024-09-12T19:13:56.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16218368921018377513', time=2024-09-12T21:02:00.624047+0000, chain.objs.size()=1 2024-09-12T19:13:56.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0qblj3VYmPRTpmf7z1NPGU1X-PnekW7_0 2024-09-12T19:13:56.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2299814538425444646', time=2024-09-12T21:02:00.800606+0000, chain.objs.size()=1 2024-09-12T19:13:56.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.AGryOEv7wP_DTdEHA_IFl35amN-6iU__0 2024-09-12T19:13:56.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13715896523633774239', time=2024-09-12T21:02:00.837309+0000, chain.objs.size()=1 2024-09-12T19:13:56.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7eFBj-fR5MGAuq20cmKoS9iTiOapRiz_0 2024-09-12T19:13:56.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17075260469428561498', time=2024-09-12T21:02:00.996221+0000, chain.objs.size()=1 2024-09-12T19:13:56.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.LGO1uXtfQZmO7TSlbk5BOMLTb4Oette_0 2024-09-12T19:13:56.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7533123313747880128', time=2024-09-12T21:02:01.043269+0000, chain.objs.size()=1 2024-09-12T19:13:56.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ayMiji2zzi-qZDmaGycxJu825wqyNjU_0 2024-09-12T19:13:56.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17220486811081919340', time=2024-09-12T21:02:01.095495+0000, chain.objs.size()=1 2024-09-12T19:13:56.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.YZQtvy_xdIxCIpuomsaKPKcvxwAqgkB_0 2024-09-12T19:13:56.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5908621360698715405', time=2024-09-12T21:02:01.443685+0000, chain.objs.size()=1 2024-09-12T19:13:56.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.9nLLMJIOWTni86DfW3-Mxtr2K-OPxUk_0 2024-09-12T19:13:56.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18508133870302470', time=2024-09-12T21:02:01.497971+0000, chain.objs.size()=1 2024-09-12T19:13:56.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.t-NDFuJowuaSs5zQvflEXckfZKCcjVT_0 2024-09-12T19:13:56.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15001256570025118846', time=2024-09-12T21:02:01.696982+0000, chain.objs.size()=1 2024-09-12T19:13:56.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0-Qs-Zs6OXW5mBV7E1jQL4863VIi7Ff_0 2024-09-12T19:13:56.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4036852417285172577', time=2024-09-12T21:02:01.751981+0000, chain.objs.size()=1 2024-09-12T19:13:56.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._x9TSITmfT2PVmZad_lhLqaFGgA1NSl_0 2024-09-12T19:13:56.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1547363305125107990', time=2024-09-12T21:02:01.752874+0000, chain.objs.size()=1 2024-09-12T19:13:56.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0eS24UIWORQlbPHJQygl2q4lrraFa8z_0 2024-09-12T19:13:56.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15811819816279835633', time=2024-09-12T21:02:01.763440+0000, chain.objs.size()=1 2024-09-12T19:13:56.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.YDjt5oWqmWzC-XTsHBc47284UXNRIeG_0 2024-09-12T19:13:56.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1009107467163380533', time=2024-09-12T21:02:01.771886+0000, chain.objs.size()=1 2024-09-12T19:13:56.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.mNxeKjtB2eKDDF6bBsM-H7H_WNY4Teb_0 2024-09-12T19:13:56.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3333585552220438076', time=2024-09-12T21:02:01.780392+0000, chain.objs.size()=1 2024-09-12T19:13:56.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.TLe0mBNPNM4hgzU90V-ssi_TlylBtA0_0 2024-09-12T19:13:56.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14707244512092343028', time=2024-09-12T21:02:01.786821+0000, chain.objs.size()=1 2024-09-12T19:13:56.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.YzhF_e4fK3VJjRIbDWQ95a-lnO2WjDm_0 2024-09-12T19:13:56.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6899058630722607370', time=2024-09-12T21:02:01.934525+0000, chain.objs.size()=1 2024-09-12T19:13:56.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.N_03MrqVO3r9ys8IXTF6v3Q6eTY19I7_0 2024-09-12T19:13:56.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.992+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7725359063095429972', time=2024-09-12T21:02:02.138035+0000, chain.objs.size()=1 2024-09-12T19:13:56.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.LGHyL9uD_p_KSYPfYpgou6rs9ZgwDZM_0 2024-09-12T19:13:56.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.992+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.588081645255187053', time=2024-09-12T21:02:02.142058+0000, chain.objs.size()=1 2024-09-12T19:13:56.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.exsFBNb7Y_ifSKAr_dIxopQXd9Ggx-T_0 2024-09-12T19:13:56.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.992+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6358268918321225805', time=2024-09-12T21:02:02.156062+0000, chain.objs.size()=1 2024-09-12T19:13:56.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.OwupspAL1DJf-yoO8rqMI1G_1Hm0TDJ_0 2024-09-12T19:13:56.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.992+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1781890180331242410', time=2024-09-12T21:02:02.161987+0000, chain.objs.size()=1 2024-09-12T19:13:56.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.lOzyDevA2pCSuTffIIsWGPh_BmeENO4_0 2024-09-12T19:13:56.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.996+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14554593496862349156', time=2024-09-12T21:02:02.203958+0000, chain.objs.size()=1 2024-09-12T19:13:56.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.IatM78_MDCk0Fdmr0a7DcMChW7fmGec_0 2024-09-12T19:13:56.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.996+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5026756054921464961', time=2024-09-12T21:02:02.204925+0000, chain.objs.size()=1 2024-09-12T19:13:56.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7-ZslL7hYLte2Z0ulMq79EjzqdTKZCo_0 2024-09-12T19:13:56.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.996+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7150853060999768925', time=2024-09-12T21:02:31.025623+0000, chain.objs.size()=1 2024-09-12T19:13:56.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.370__shadow_.TdILyPGxbboMff4C8V4vX0aUTDzkufZ_0 2024-09-12T19:13:56.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.996+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12789413953867105613', time=2024-09-12T21:03:40.226946+0000, chain.objs.size()=1 2024-09-12T19:13:56.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.459__shadow_.Ziho0R-xzOe3Xc4FUD7VtjhghDSIqaO_0 2024-09-12T19:13:56.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.996+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15508590714319735106', time=2024-09-12T21:03:55.564134+0000, chain.objs.size()=1 2024-09-12T19:13:56.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.483__shadow_.SnZwETfP27hjxBrWOmrlWM8Dh3vVlIu_0 2024-09-12T19:13:56.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.996+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4771240880391703493', time=2024-09-12T21:04:13.505504+0000, chain.objs.size()=6 2024-09-12T19:13:56.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.1 2024-09-12T19:13:57.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:56.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.2 2024-09-12T19:13:57.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.3 2024-09-12T19:13:57.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.4 2024-09-12T19:13:57.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.5 2024-09-12T19:13:57.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.6 2024-09-12T19:13:57.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.000+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14709314751921679895', time=2024-09-12T21:04:47.897879+0000, chain.objs.size()=2 2024-09-12T19:13:57.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.523__multipart_mymultipart.2~870rBcKdYFcX_V-XaPaxOKc3WvJOFFR.1 2024-09-12T19:13:57.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.523__multipart_mymultipart.2~870rBcKdYFcX_V-XaPaxOKc3WvJOFFR.2 2024-09-12T19:13:57.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.000+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12529859438360021705', time=2024-09-12T21:06:05.090957+0000, chain.objs.size()=1 2024-09-12T19:13:57.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:qvKh4jOTguAwQbSbdiqNgNzHpUy8vTb_.82WkEKkcVCfTlyOoCq7apAHbtG8ugG4_0 2024-09-12T19:13:57.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.000+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1000520974366599749', time=2024-09-12T21:06:11.308227+0000, chain.objs.size()=1 2024-09-12T19:13:57.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:n.O5UJs9mOwoTBtxdtW7afKdsWbYAYb_.sqpPMOHhIDrBgTF-GlMp76pEh8dWxFN_0 2024-09-12T19:13:57.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.004+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45533 2024-09-12T19:13:57.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T19:13:57.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6372481765667699130', time=2024-09-12T21:06:49.872693+0000, chain.objs.size()=1 2024-09-12T19:13:57.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.583__shadow:.n-i45d8.nJXxjINx8XXJEdJnW77Pdr_.lX47tKCsNYsTrLRQftbxfpz6xkD8Ru7_0 2024-09-12T19:13:57.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4088329018914439568', time=2024-09-12T21:07:15.181996+0000, chain.objs.size()=12 2024-09-12T19:13:57.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.613__multipart_multipart_enc.2~nqSMugnxHGqfmgOaK8iHDvXvOVBeKt3.1 2024-09-12T19:13:57.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.613__shadow_multipart_enc.2~nqSMugnxHGqfmgOaK8iHDvXvOVBeKt3.1_1 2024-09-12T19:13:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.613__multipart_multipart_enc.2~nqSMugnxHGqfmgOaK8iHDvXvOVBeKt3.2 2024-09-12T19:13:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.613__shadow_multipart_enc.2~nqSMugnxHGqfmgOaK8iHDvXvOVBeKt3.2_1 2024-09-12T19:13:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.613__multipart_multipart_enc.2~nqSMugnxHGqfmgOaK8iHDvXvOVBeKt3.3 2024-09-12T19:13:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.613__shadow_multipart_enc.2~nqSMugnxHGqfmgOaK8iHDvXvOVBeKt3.3_1 2024-09-12T19:13:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.613__multipart_multipart_enc.2~nqSMugnxHGqfmgOaK8iHDvXvOVBeKt3.4 2024-09-12T19:13:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.613__shadow_multipart_enc.2~nqSMugnxHGqfmgOaK8iHDvXvOVBeKt3.4_1 2024-09-12T19:13:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.613__multipart_multipart_enc.2~nqSMugnxHGqfmgOaK8iHDvXvOVBeKt3.5 2024-09-12T19:13:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.613__shadow_multipart_enc.2~nqSMugnxHGqfmgOaK8iHDvXvOVBeKt3.5_1 2024-09-12T19:13:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.613__multipart_multipart_enc.2~nqSMugnxHGqfmgOaK8iHDvXvOVBeKt3.6 2024-09-12T19:13:57.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.012+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.613__shadow_multipart_enc.2~nqSMugnxHGqfmgOaK8iHDvXvOVBeKt3.6_1 2024-09-12T19:13:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7552100085904572135', time=2024-09-12T21:07:22.350099+0000, chain.objs.size()=12 2024-09-12T19:13:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.615__multipart_multipart_enc.2~rMDMLRem6xfWA0BOWYD5c5FHw0WMv8v.1 2024-09-12T19:13:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.615__shadow_multipart_enc.2~rMDMLRem6xfWA0BOWYD5c5FHw0WMv8v.1_1 2024-09-12T19:13:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.615__multipart_multipart_enc.2~rMDMLRem6xfWA0BOWYD5c5FHw0WMv8v.2 2024-09-12T19:13:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.615__shadow_multipart_enc.2~rMDMLRem6xfWA0BOWYD5c5FHw0WMv8v.2_1 2024-09-12T19:13:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.615__multipart_multipart_enc.2~rMDMLRem6xfWA0BOWYD5c5FHw0WMv8v.3 2024-09-12T19:13:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.615__shadow_multipart_enc.2~rMDMLRem6xfWA0BOWYD5c5FHw0WMv8v.3_1 2024-09-12T19:13:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.615__multipart_multipart_enc.2~rMDMLRem6xfWA0BOWYD5c5FHw0WMv8v.4 2024-09-12T19:13:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.615__shadow_multipart_enc.2~rMDMLRem6xfWA0BOWYD5c5FHw0WMv8v.4_1 2024-09-12T19:13:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.615__multipart_multipart_enc.2~rMDMLRem6xfWA0BOWYD5c5FHw0WMv8v.5 2024-09-12T19:13:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.615__shadow_multipart_enc.2~rMDMLRem6xfWA0BOWYD5c5FHw0WMv8v.5_1 2024-09-12T19:13:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.615__multipart_multipart_enc.2~rMDMLRem6xfWA0BOWYD5c5FHw0WMv8v.6 2024-09-12T19:13:57.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.615__shadow_multipart_enc.2~rMDMLRem6xfWA0BOWYD5c5FHw0WMv8v.6_1 2024-09-12T19:13:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17196746689645163667', time=2024-09-12T21:09:37.949982+0000, chain.objs.size()=1 2024-09-12T19:13:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.628__shadow_.FYNR90yHvlKLFQT0pzPackqeRmL_tDD_0 2024-09-12T19:13:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18247144042793373903', time=2024-09-12T21:10:05.127654+0000, chain.objs.size()=6 2024-09-12T19:13:57.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.661__multipart_baz.2~Mqz-ezebAP_D8wL5cDvSst4sjjVzqci.1 2024-09-12T19:13:57.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.661__multipart_baz.2~Mqz-ezebAP_D8wL5cDvSst4sjjVzqci.2 2024-09-12T19:13:57.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.661__multipart_baz.2~Mqz-ezebAP_D8wL5cDvSst4sjjVzqci.3 2024-09-12T19:13:57.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.661__multipart_baz.2~Mqz-ezebAP_D8wL5cDvSst4sjjVzqci.4 2024-09-12T19:13:57.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.661__multipart_baz.2~Mqz-ezebAP_D8wL5cDvSst4sjjVzqci.5 2024-09-12T19:13:57.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.661__multipart_baz.2~Mqz-ezebAP_D8wL5cDvSst4sjjVzqci.6 2024-09-12T19:13:57.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.028+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.302305107677640064', time=2024-09-12T21:10:10.333460+0000, chain.objs.size()=1 2024-09-12T19:13:57.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.028+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.668__shadow_.hNdl5UaAwKiZoqeWq97uOhOf2VWm7NY_0 2024-09-12T19:13:57.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.032+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.032+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T19:13:57.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46778' 2024-09-12T19:13:57.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6301993245889326334', time=2024-09-12T20:57:29.369908+0000, chain.objs.size()=1 2024-09-12T19:13:57.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.157__shadow:01X5JZW3Th9VMyBxqnGffcIeV9-nv63_.jpWV92Rgo9OIEBIaHqgw0uNYipYKinU_0 2024-09-12T19:13:57.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1141936737528407782', time=2024-09-12T20:57:38.973518+0000, chain.objs.size()=1 2024-09-12T19:13:57.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.166__shadow_.k5Hm0LsDSeh_A8O0eyODJOk6IzrnoNA_0 2024-09-12T19:13:57.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14678227157402056283', time=2024-09-12T20:59:57.653724+0000, chain.objs.size()=1 2024-09-12T19:13:57.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.242__shadow_.VfGN533Dl27NuH7-CvFQxTqrACjJtsF_0 2024-09-12T19:13:57.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11938123159653697150', time=2024-09-12T21:00:04.391888+0000, chain.objs.size()=1 2024-09-12T19:13:57.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.250__shadow_.O9xJQS6qOsUEBc7F4w3UJJZL4WxtUFF_0 2024-09-12T19:13:57.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10829042274960515375', time=2024-09-12T21:00:08.098315+0000, chain.objs.size()=1 2024-09-12T19:13:57.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.255__shadow_.RJl-HXOna_emS-VZhScfWkM5AEd8IXp_0 2024-09-12T19:13:57.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11803320512467282405', time=2024-09-12T21:00:32.073852+0000, chain.objs.size()=1 2024-09-12T19:13:57.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.OnpnjeBptN1dPLtQYF3g32QZzExTugF_0 2024-09-12T19:13:57.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2084488724618297653', time=2024-09-12T21:00:32.121472+0000, chain.objs.size()=1 2024-09-12T19:13:57.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qe9gKbqD1oFDNLOqfv0q_mHY_lDDi7e_0 2024-09-12T19:13:57.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2747032117680217078', time=2024-09-12T21:00:32.228080+0000, chain.objs.size()=1 2024-09-12T19:13:57.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.b1xujkIQbYEUXJZpBZzDFinofFSYZVN_0 2024-09-12T19:13:57.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4251034004195868986', time=2024-09-12T21:00:32.260924+0000, chain.objs.size()=1 2024-09-12T19:13:57.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.PDatubZGcKiJ8BC_JitdsNMrlqAr7Jz_0 2024-09-12T19:13:57.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5671703063347976179', time=2024-09-12T21:00:32.306108+0000, chain.objs.size()=1 2024-09-12T19:13:57.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.NSBPwV5w0kdoya96fg6_Y1oOHGae7hJ_0 2024-09-12T19:13:57.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.436356662285583541', time=2024-09-12T21:00:32.328632+0000, chain.objs.size()=1 2024-09-12T19:13:57.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.HN1UeH_YlE44SwV6e0Fj6gBOSHMPBg8_0 2024-09-12T19:13:57.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1006788009906473016', time=2024-09-12T21:00:32.444720+0000, chain.objs.size()=1 2024-09-12T19:13:57.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.040+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.gWjwF-zFrAMyaTsm8N1UdAa3UkCDfeU_0 2024-09-12T19:13:57.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.64346778004946167', time=2024-09-12T21:00:32.482878+0000, chain.objs.size()=1 2024-09-12T19:13:57.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.oR3YakpvVASNsJL1vd_m9ykluGYoYH6_0 2024-09-12T19:13:57.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.636712379283970384', time=2024-09-12T21:00:32.530169+0000, chain.objs.size()=1 2024-09-12T19:13:57.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2Yj_Goof4eOegNtTR2m_BM0ODRTEH6m_0 2024-09-12T19:13:57.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1877346229725367965', time=2024-09-12T21:00:32.663829+0000, chain.objs.size()=1 2024-09-12T19:13:57.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.8Mno7zSK_yWPyN2D91A14nN1WK1LN4u_0 2024-09-12T19:13:57.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5806867562213237777', time=2024-09-12T21:00:32.741430+0000, chain.objs.size()=1 2024-09-12T19:13:57.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Vb-5sYkVGToDR82lhC4CQuG_rBBDq_Y_0 2024-09-12T19:13:57.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.730943264637072238', time=2024-09-12T21:00:32.745854+0000, chain.objs.size()=1 2024-09-12T19:13:57.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.hqgAHhxlmqlY-4xny-Z2utUaBkIpTIJ_0 2024-09-12T19:13:57.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5401337528044712029', time=2024-09-12T21:00:32.777681+0000, chain.objs.size()=1 2024-09-12T19:13:57.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tyiqgDD9CKwEso7ql5-esH3Ph08tDIv_0 2024-09-12T19:13:57.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12518047681205192592', time=2024-09-12T21:00:32.871500+0000, chain.objs.size()=1 2024-09-12T19:13:57.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tSRYXA0Bxz2MBn6vHRQv4_SxNCvxxwB_0 2024-09-12T19:13:57.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11131363871146633573', time=2024-09-12T21:00:32.934716+0000, chain.objs.size()=1 2024-09-12T19:13:57.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.C3yDs-XiUZnGD-ndHDHDybSJwdpE-VP_0 2024-09-12T19:13:57.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5034405406438012016', time=2024-09-12T21:00:32.937643+0000, chain.objs.size()=1 2024-09-12T19:13:57.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.6o3mPKOJT3xrutVnnBcyGW8tTmpVTz4_0 2024-09-12T19:13:57.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14312877088641679941', time=2024-09-12T21:00:33.117764+0000, chain.objs.size()=1 2024-09-12T19:13:57.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.m7BC7E3fENSS4-UXtTBRuT262R3Tw0N_0 2024-09-12T19:13:57.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2134285819830700639', time=2024-09-12T21:00:33.124541+0000, chain.objs.size()=1 2024-09-12T19:13:57.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qH-ERGRZvtgL4sr1FL-dhJmOVaKYZSr_0 2024-09-12T19:13:57.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6981959144769958656', time=2024-09-12T21:00:33.358424+0000, chain.objs.size()=1 2024-09-12T19:13:57.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.cceHNVCdg2eoLPAqKruW6h1Ek3GVRaM_0 2024-09-12T19:13:57.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5954564815740485026', time=2024-09-12T21:00:33.394346+0000, chain.objs.size()=1 2024-09-12T19:13:57.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Qn9y69gwKmspbLH_yUbMxnId285CdB7_0 2024-09-12T19:13:57.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12368546237384763352', time=2024-09-12T21:00:33.420972+0000, chain.objs.size()=1 2024-09-12T19:13:57.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.QDxYHq7cUY5PM8BW-nk3UPCn91AG2UJ_0 2024-09-12T19:13:57.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12168250525844034235', time=2024-09-12T21:00:33.458199+0000, chain.objs.size()=1 2024-09-12T19:13:57.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.vc0pcLdEbKPynC-GfWhGNRtdf37E3TP_0 2024-09-12T19:13:57.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2310189634957136353', time=2024-09-12T21:00:33.468633+0000, chain.objs.size()=1 2024-09-12T19:13:57.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.FYI1U7HiwxtQZhr8HQ8nLhv3vvUSq3O_0 2024-09-12T19:13:57.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7708815557129686282', time=2024-09-12T21:00:33.473425+0000, chain.objs.size()=1 2024-09-12T19:13:57.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ob9XZdFeItgPYdrMVGKjYzTHcJNf4MN_0 2024-09-12T19:13:57.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15964854413745760265', time=2024-09-12T21:00:33.486505+0000, chain.objs.size()=1 2024-09-12T19:13:57.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.fwrb1nWbcPQb2l3JBYKPUGWUO46TLpN_0 2024-09-12T19:13:57.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9925447352703228671', time=2024-09-12T21:00:33.630220+0000, chain.objs.size()=1 2024-09-12T19:13:57.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.HT61Vm49JiIE73lEcD13UeCYcadg79N_0 2024-09-12T19:13:57.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8076221883343950008', time=2024-09-12T21:00:33.860867+0000, chain.objs.size()=1 2024-09-12T19:13:57.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ZwHGy3brQ-6I16G5dG5WehYJNboI6sB_0 2024-09-12T19:13:57.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13801143888453828316', time=2024-09-12T21:00:36.002557+0000, chain.objs.size()=1 2024-09-12T19:13:57.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.265__shadow_.gylW16F16bzE1I9wiv_CKsnVecKKzlm_0 2024-09-12T19:13:57.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16134257321942989200', time=2024-09-12T21:00:38.118940+0000, chain.objs.size()=1 2024-09-12T19:13:57.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.268__shadow_.JLkM_UfufRxQrTQS2d1B1YOjjsAohCG_0 2024-09-12T19:13:57.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7953041708327419244', time=2024-09-12T21:00:41.002182+0000, chain.objs.size()=1 2024-09-12T19:13:57.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.272__shadow_.CwhP5uwfbx4w4eLOIMFNKxm4y7h0kko_0 2024-09-12T19:13:57.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14578100530747419856', time=2024-09-12T21:00:51.336807+0000, chain.objs.size()=1 2024-09-12T19:13:57.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.286__shadow_.xlHDb1iX0g5UF_ISQSU-i2GQwXTIc20_0 2024-09-12T19:13:57.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9092799067905968246', time=2024-09-12T21:00:56.707371+0000, chain.objs.size()=1 2024-09-12T19:13:57.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.aJ7AzJy-go3MJW0TdqeyCZ_KijdscX9_0 2024-09-12T19:13:57.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4047316306518094475', time=2024-09-12T21:01:04.829112+0000, chain.objs.size()=1 2024-09-12T19:13:57.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.302__shadow_.ScPjeePlYZBBjimu8UanJKJ5PQFBn_y_0 2024-09-12T19:13:57.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11793885733369011220', time=2024-09-12T21:01:39.412658+0000, chain.objs.size()=1 2024-09-12T19:13:57.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.yjwx9USuStPEU0kralAeD7x5zLSg877_0 2024-09-12T19:13:57.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17827587665250233327', time=2024-09-12T21:01:39.417280+0000, chain.objs.size()=1 2024-09-12T19:13:57.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.R4QfWNeGvnuU6DFMR1WQ8zZ-ysyMQOi_0 2024-09-12T19:13:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.231062484525160894', time=2024-09-12T21:01:39.525468+0000, chain.objs.size()=1 2024-09-12T19:13:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.3u1T48nB-r6cbB_yDjiroXGLJU78t-U_0 2024-09-12T19:13:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17461331357741125120', time=2024-09-12T21:01:39.545468+0000, chain.objs.size()=1 2024-09-12T19:13:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.pwE8WBGryAiFzHtso0GyyplFWb4Omn2_0 2024-09-12T19:13:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8379293386688289418', time=2024-09-12T21:01:39.701039+0000, chain.objs.size()=1 2024-09-12T19:13:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.J5XPi379ushkPAAMYMN6WZnQQJl8aLF_0 2024-09-12T19:13:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6119786757452999818', time=2024-09-12T21:01:39.750341+0000, chain.objs.size()=1 2024-09-12T19:13:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.2zUg6WvSfP0N6cpxPtcMpG9IGeir7l5_0 2024-09-12T19:13:57.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.976373242311327893', time=2024-09-12T21:01:39.767815+0000, chain.objs.size()=1 2024-09-12T19:13:57.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.rMbRBpLqWJ5kBwBqSPBNG87lD3pjeW__0 2024-09-12T19:13:57.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16814003909487342544', time=2024-09-12T21:01:39.792755+0000, chain.objs.size()=1 2024-09-12T19:13:57.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.AdxrwW0pEta0s4kwh3SUjuger_o_h8a_0 2024-09-12T19:13:57.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10599620388439044644', time=2024-09-12T21:01:39.795372+0000, chain.objs.size()=1 2024-09-12T19:13:57.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.CUL-3qBwSOGX7yBI6ObL_3OAZIPbZaS_0 2024-09-12T19:13:57.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9119126390513643729', time=2024-09-12T21:01:39.798046+0000, chain.objs.size()=1 2024-09-12T19:13:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-MVExQP0L_R6_dhhMt59tEwe_bRNJbu_0 2024-09-12T19:13:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17236506247479597463', time=2024-09-12T21:01:39.923848+0000, chain.objs.size()=1 2024-09-12T19:13:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.NT8WeNgwWSCbv-Y63ULANHjDAH5kZj3_0 2024-09-12T19:13:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9122101252023837740', time=2024-09-12T21:01:40.007372+0000, chain.objs.size()=1 2024-09-12T19:13:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.kpoQTwuwY6_zaHo_6r3OYtQiQEKOXJ1_0 2024-09-12T19:13:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5469541949161135953', time=2024-09-12T21:01:40.016149+0000, chain.objs.size()=1 2024-09-12T19:13:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.6as_MHnHQ-olqwJPFBl79Uli_x_FTpI_0 2024-09-12T19:13:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3187156717688338854', time=2024-09-12T21:01:40.147719+0000, chain.objs.size()=1 2024-09-12T19:13:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QzeuufRE2JvbVoUEUWhrX1ZKLugdjZC_0 2024-09-12T19:13:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15007816655624325752', time=2024-09-12T21:01:40.176936+0000, chain.objs.size()=1 2024-09-12T19:13:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.WWqmJ_p7t5QTqseTVlgNfKizDHPtGQG_0 2024-09-12T19:13:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18191006733815661222', time=2024-09-12T21:01:40.186832+0000, chain.objs.size()=1 2024-09-12T19:13:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.nkOEghFUZvsckK6HmV--OmVG1ar_zzh_0 2024-09-12T19:13:57.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7299190398512070966', time=2024-09-12T21:01:40.193985+0000, chain.objs.size()=1 2024-09-12T19:13:57.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.OmTF1SYFPJSz7jcmD7WDeuoOxlcavgw_0 2024-09-12T19:13:57.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1051879678220997040', time=2024-09-12T21:01:40.195536+0000, chain.objs.size()=1 2024-09-12T19:13:57.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.e4jmErWTrB2S2M46xNO5H2wdidRbcxd_0 2024-09-12T19:13:57.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17588338485940159818', time=2024-09-12T21:01:40.202321+0000, chain.objs.size()=1 2024-09-12T19:13:57.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.D7zL2gbRyG1KfSuQ6U--LUAVIWH3OqX_0 2024-09-12T19:13:57.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15679002982089931707', time=2024-09-12T21:01:40.203739+0000, chain.objs.size()=1 2024-09-12T19:13:57.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.WSon2ClZl_kmrE_Dv1l-2GibVlCDebc_0 2024-09-12T19:13:57.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12847524628928686719', time=2024-09-12T21:01:40.344420+0000, chain.objs.size()=1 2024-09-12T19:13:57.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Kx54GG5RNrcf-J3-jJJLOd5Bt8ltbtt_0 2024-09-12T19:13:57.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11742637496937916249', time=2024-09-12T21:01:40.372162+0000, chain.objs.size()=1 2024-09-12T19:13:57.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hcTfmWz7q2AUee0J2tfyY5pzkjnVgsE_0 2024-09-12T19:13:57.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11867600099478038302', time=2024-09-12T21:01:40.384295+0000, chain.objs.size()=1 2024-09-12T19:13:57.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0lCG7-Mydd8FzIbMJlkSHYMdBvBk4YM_0 2024-09-12T19:13:57.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11415236357512416812', time=2024-09-12T21:01:40.411001+0000, chain.objs.size()=1 2024-09-12T19:13:57.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.JFszrl3HavgQmngjHZkn_VkwW6HQ2nW_0 2024-09-12T19:13:57.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7241360543494726858', time=2024-09-12T21:01:40.420690+0000, chain.objs.size()=1 2024-09-12T19:13:57.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.au6AFlHnKli1CklkJOeBFR0FpNrJw2o_0 2024-09-12T19:13:57.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15517327371085691915', time=2024-09-12T21:01:40.599804+0000, chain.objs.size()=1 2024-09-12T19:13:57.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.nBmB3kRZGCOmQxtitFXlFpByY8BCMzy_0 2024-09-12T19:13:57.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13140825853473966854', time=2024-09-12T21:01:40.624635+0000, chain.objs.size()=1 2024-09-12T19:13:57.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Fbtw96cS9BuLFsKuM4Ydu-yVOcTRdhY_0 2024-09-12T19:13:57.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7424782210094970625', time=2024-09-12T21:01:40.774673+0000, chain.objs.size()=1 2024-09-12T19:13:57.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.B6T5TkcefZ2ZgeE4_xGnPDOhCgM2DGK_0 2024-09-12T19:13:57.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2886516670192032270', time=2024-09-12T21:01:40.825511+0000, chain.objs.size()=1 2024-09-12T19:13:57.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ODmfomGaATBSioqPZoMZRJUZD_CyW7O_0 2024-09-12T19:13:57.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9578453761331147133', time=2024-09-12T21:01:40.839625+0000, chain.objs.size()=1 2024-09-12T19:13:57.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9jLs3FuvKMiLIPULsHjwRnBZ4l-OiqI_0 2024-09-12T19:13:57.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14171477601385805195', time=2024-09-12T21:01:40.853215+0000, chain.objs.size()=1 2024-09-12T19:13:57.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.EwD7rhKMcRQgVghtHj-EA0Vr6aSqWhm_0 2024-09-12T19:13:57.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8493962003788846380', time=2024-09-12T21:01:40.854784+0000, chain.objs.size()=1 2024-09-12T19:13:57.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.MrgoexoRXCXATS0VDt2YXBDlTteI6vm_0 2024-09-12T19:13:57.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.405015145164896756', time=2024-09-12T21:01:40.891956+0000, chain.objs.size()=1 2024-09-12T19:13:57.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.X_bF_lij2l8-OmGFjtuwVhVc2nVOtZ__0 2024-09-12T19:13:57.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1294878425534750628', time=2024-09-12T21:01:41.029352+0000, chain.objs.size()=1 2024-09-12T19:13:57.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Dx6V7d_VLCzwmdrRSebIXqqSNAviJNV_0 2024-09-12T19:13:57.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.743336798992173546', time=2024-09-12T21:01:41.035806+0000, chain.objs.size()=1 2024-09-12T19:13:57.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.pxV7LaQwrYOSuiiHp2I0_oM-QXL7mp7_0 2024-09-12T19:13:57.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7570805864979066460', time=2024-09-12T21:01:41.068638+0000, chain.objs.size()=1 2024-09-12T19:13:57.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.4gS8wFNZ6Je5Nzku5nSA1S-o91BCRjf_0 2024-09-12T19:13:57.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7621196132029111647', time=2024-09-12T21:01:41.081385+0000, chain.objs.size()=1 2024-09-12T19:13:57.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.YYuzzraEymykDtvCZ-DenXeMooPurlA_0 2024-09-12T19:13:57.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11580656294471697298', time=2024-09-12T21:02:00.549851+0000, chain.objs.size()=1 2024-09-12T19:13:57.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.j2rAsk4L5iBOjtn7o0fUHRApyeJ0Qwq_0 2024-09-12T19:13:57.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16262992266729095397', time=2024-09-12T21:02:00.813516+0000, chain.objs.size()=1 2024-09-12T19:13:57.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.mbTWD9P49CLCV_Uj8rne4GVKH_bqBgQ_0 2024-09-12T19:13:57.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2339101779305212916', time=2024-09-12T21:02:00.849461+0000, chain.objs.size()=1 2024-09-12T19:13:57.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.rBCxqSsx7cmn02u_XezRNoSgo-Mg8VU_0 2024-09-12T19:13:57.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8913186446481950846', time=2024-09-12T21:02:00.874748+0000, chain.objs.size()=1 2024-09-12T19:13:57.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.3JOvb_xD5XC-DZqGVsYaTb_UFnsuBxG_0 2024-09-12T19:13:57.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11838136384671078248', time=2024-09-12T21:02:01.084417+0000, chain.objs.size()=1 2024-09-12T19:13:57.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.c4OEKlbhN5gEElragNf-GmIYs3G5ym-_0 2024-09-12T19:13:57.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17980848409546395642', time=2024-09-12T21:02:01.088979+0000, chain.objs.size()=1 2024-09-12T19:13:57.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.pgmP5FXKu3R3IWP0BE02buOVkAHJiP5_0 2024-09-12T19:13:57.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1420891327596493145', time=2024-09-12T21:02:01.237604+0000, chain.objs.size()=1 2024-09-12T19:13:57.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.dUnUvz_KyRmpvzgrJtmbsTEsni4xvDo_0 2024-09-12T19:13:57.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6607353634674141159', time=2024-09-12T21:02:01.262231+0000, chain.objs.size()=1 2024-09-12T19:13:57.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1wQrtp95D5lAxWA1iuj-YF2p-17-7JB_0 2024-09-12T19:13:57.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9486945094797429299', time=2024-09-12T21:02:01.277340+0000, chain.objs.size()=1 2024-09-12T19:13:57.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.6DWhfs9XRnOEVTTwyEBqxq2h5ccP3kR_0 2024-09-12T19:13:57.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17750988478029988812', time=2024-09-12T21:02:01.282193+0000, chain.objs.size()=1 2024-09-12T19:13:57.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7KVVMvzC-yidpDHrsOxKPmFg8tq6WPg_0 2024-09-12T19:13:57.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17947294045681273266', time=2024-09-12T21:02:01.283095+0000, chain.objs.size()=1 2024-09-12T19:13:57.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Sxg2unkizEe9r9G9xqlWJ7oC_Usv2QX_0 2024-09-12T19:13:57.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6371525782218473973', time=2024-09-12T21:02:01.298630+0000, chain.objs.size()=1 2024-09-12T19:13:57.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.tfXeA_stMeAnXbFt5JNclAOUDkcSsGK_0 2024-09-12T19:13:57.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11188107870477356896', time=2024-09-12T21:02:01.341703+0000, chain.objs.size()=1 2024-09-12T19:13:57.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WADrz2FVlz98hTqbvo4uD0fGl09PLgj_0 2024-09-12T19:13:57.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5966919622072400126', time=2024-09-12T21:02:01.459250+0000, chain.objs.size()=1 2024-09-12T19:13:57.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.FE_kr-_pG26q9qSsSGy7P7BY1B4l_d-_0 2024-09-12T19:13:57.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8225810717547813630', time=2024-09-12T21:02:01.477003+0000, chain.objs.size()=1 2024-09-12T19:13:57.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WXYY-Fn7hrN9xRnO7lOd3ZoHJhVCDhe_0 2024-09-12T19:13:57.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6789029896658586551', time=2024-09-12T21:02:01.547752+0000, chain.objs.size()=1 2024-09-12T19:13:57.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.SHrVA6R9N5Bz5cB7qRdG6FJKEtI1Q1v_0 2024-09-12T19:13:57.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6771387278485908901', time=2024-09-12T21:02:01.662578+0000, chain.objs.size()=1 2024-09-12T19:13:57.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.VoBJrkLgvAo6zAspf7h7t1JGv_20j4l_0 2024-09-12T19:13:57.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7387789957851948390', time=2024-09-12T21:02:01.746780+0000, chain.objs.size()=1 2024-09-12T19:13:57.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.076+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WdpA1GTlob9cPKpxFDi3kcqAXlLmbuy_0 2024-09-12T19:13:57.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6084524445674997099', time=2024-09-12T21:02:01.747510+0000, chain.objs.size()=1 2024-09-12T19:13:57.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.bu5zZxI1OEQ4XjKcdWlPlV-3F1Yd7La_0 2024-09-12T19:13:57.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7839165873231644445', time=2024-09-12T21:02:01.771612+0000, chain.objs.size()=1 2024-09-12T19:13:57.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.kqQpzuIXESa3WF-BjbxGJ1tKxCEYXD2_0 2024-09-12T19:13:57.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1069162293712701064', time=2024-09-12T21:02:01.788523+0000, chain.objs.size()=1 2024-09-12T19:13:57.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.QdT5qRgxazOOeWj3pwX5uEyGIBaoNQm_0 2024-09-12T19:13:57.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10869850953338820938', time=2024-09-12T21:02:01.882436+0000, chain.objs.size()=1 2024-09-12T19:13:57.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.az0O1MKt-R9blVvD-GYgrb1XcUK-0pY_0 2024-09-12T19:13:57.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16611602900172381335', time=2024-09-12T21:02:01.916216+0000, chain.objs.size()=1 2024-09-12T19:13:57.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.euANm1YWEVLjCzlt8TZLlWS2EvJqRYg_0 2024-09-12T19:13:57.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7746577933100194271', time=2024-09-12T21:02:01.952835+0000, chain.objs.size()=1 2024-09-12T19:13:57.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.tJkjF4UpV6aTyfMJga7runOmhxSoAgx_0 2024-09-12T19:13:57.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.170032145157495624', time=2024-09-12T21:02:01.985829+0000, chain.objs.size()=1 2024-09-12T19:13:57.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.zPDEWiwekFHrpaxZ2nhvMPWTWIHsk9o_0 2024-09-12T19:13:57.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46778 2024-09-12T19:13:57.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T19:13:57.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3998230916578371090', time=2024-09-12T21:02:01.988859+0000, chain.objs.size()=1 2024-09-12T19:13:57.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.CyzaJbkGbojZHEIBWvob8UtfI6Otycw_0 2024-09-12T19:13:57.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4040000236334367561', time=2024-09-12T21:02:02.147907+0000, chain.objs.size()=1 2024-09-12T19:13:57.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.vP5RbY1IzkAc5uT5-5c_86WZzvgGfEn_0 2024-09-12T19:13:57.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17167719037690204787', time=2024-09-12T21:02:02.202644+0000, chain.objs.size()=1 2024-09-12T19:13:57.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1jWDPeXpZADxoJSjZGJI33BHKGpds0P_0 2024-09-12T19:13:57.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.191866274042094841', time=2024-09-12T21:02:10.788213+0000, chain.objs.size()=1 2024-09-12T19:13:57.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.337__shadow_.tzmRSj1DdMEqUuj5yFZ-vHKLR4j6LtC_0 2024-09-12T19:13:57.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2650932140275225861', time=2024-09-12T21:03:32.212268+0000, chain.objs.size()=1 2024-09-12T19:13:57.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.450__shadow_.C7WwtF_ooCYhTAlTUSpzswfaGqq6qbm_0 2024-09-12T19:13:57.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.36888399121115155', time=2024-09-12T21:03:36.085649+0000, chain.objs.size()=1 2024-09-12T19:13:57.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.455__shadow_.g13LL3YyBb2y9cF2FAgaDTxjBVLUSSf_0 2024-09-12T19:13:57.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1091392582743384262', time=2024-09-12T21:03:45.047490+0000, chain.objs.size()=1 2024-09-12T19:13:57.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.464__shadow_.z0u_9KbC9d4mkjCB0pv_TsQhdt9R57b_0 2024-09-12T19:13:57.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15709166266644511459', time=2024-09-12T21:04:09.345883+0000, chain.objs.size()=1 2024-09-12T19:13:57.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.503__shadow:36QYX6qQ2gzMos2OEErLcQNuKaa5Xm._.oMtp76uo7bZ28BaGhD6Iv-dVMP_rpSx_0 2024-09-12T19:13:57.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6744656687505650007', time=2024-09-12T21:04:09.351045+0000, chain.objs.size()=1 2024-09-12T19:13:57.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.503__shadow:36QYX6qQ2gzMos2OEErLcQNuKaa5Xm._.oMtp76uo7bZ28BaGhD6Iv-dVMP_rpSx_0 2024-09-12T19:13:57.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15243124151540176996', time=2024-09-12T21:04:48.269761+0000, chain.objs.size()=2 2024-09-12T19:13:57.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.523__multipart_mymultipart.2~ohwGsjt8VD9ePkktkfFEH5Z7IYsQIKn.1 2024-09-12T19:13:57.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.523__multipart_mymultipart.2~ohwGsjt8VD9ePkktkfFEH5Z7IYsQIKn.2 2024-09-12T19:13:57.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10736528427889711413', time=2024-09-12T21:04:55.764818+0000, chain.objs.size()=4 2024-09-12T19:13:57.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.527__multipart_mymultipart.2~qKBfU3AE_NUmIAovrV6UIe9MAUH93WB.1 2024-09-12T19:13:57.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.527__multipart_mymultipart.2~qKBfU3AE_NUmIAovrV6UIe9MAUH93WB.2 2024-09-12T19:13:57.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.527__multipart_mymultipart.2~qKBfU3AE_NUmIAovrV6UIe9MAUH93WB.3 2024-09-12T19:13:57.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.527__multipart_mymultipart.2~qKBfU3AE_NUmIAovrV6UIe9MAUH93WB.4 2024-09-12T19:13:57.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~SCc-B6e1YgqOieSRZR-AY0wzwUq5Jjt', time=2024-09-12T21:05:03.290837+0000, chain.objs.size()=1 2024-09-12T19:13:57.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.535__multipart_mymultipart.2~SCc-B6e1YgqOieSRZR-AY0wzwUq5Jjt.3 2024-09-12T19:13:57.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6556024714503526525', time=2024-09-12T21:06:53.063777+0000, chain.objs.size()=1 2024-09-12T19:13:57.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.586__shadow:Gtskvu7A2Quzxw-3NFpU8pJu44fturb_.p95EgExh_7p9ksL2HOEihaXjF2OniyW_0 2024-09-12T19:13:57.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8500841676110484646', time=2024-09-12T21:09:43.045359+0000, chain.objs.size()=1 2024-09-12T19:13:57.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.635__shadow_.fUf-AvOarBsexUUAm0xPiMSvcE8_lgx_0 2024-09-12T19:13:57.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10543702708627677985', time=2024-09-12T21:10:06.224164+0000, chain.objs.size()=1 2024-09-12T19:13:57.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.663__shadow_.Ig8DwtvmoUOCmjfKflX5ShUb2r2WTI__0 2024-09-12T19:13:57.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10629068407165193721', time=2024-09-12T21:10:17.099436+0000, chain.objs.size()=1 2024-09-12T19:13:57.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.679__shadow_.Vbjfx5ZRCAAisoniWUnPKn4NwT8A7MJ_0 2024-09-12T19:13:57.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T19:13:57.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/57708' 2024-09-12T19:13:57.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_IUmZ6MhFh-StHid9ox2-DU1b0NevuAL', time=2024-09-12T20:57:33.859626+0000, chain.objs.size()=3 2024-09-12T19:13:57.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.L1NrzDX_JWVpr7m39Vb8HzgVGc04tVW_0 2024-09-12T19:13:57.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.L1NrzDX_JWVpr7m39Vb8HzgVGc04tVW_1 2024-09-12T19:13:57.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.L1NrzDX_JWVpr7m39Vb8HzgVGc04tVW_2 2024-09-12T19:13:57.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11691167443037513649', time=2024-09-12T21:00:01.523258+0000, chain.objs.size()=1 2024-09-12T19:13:57.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.246__shadow_.2ODv7Z04qx7Ms7q7EfMIatSjFo2oIDB_0 2024-09-12T19:13:57.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1834227839447210599', time=2024-09-12T21:00:32.057583+0000, chain.objs.size()=1 2024-09-12T19:13:57.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CwTaTCCK21PbEPZp0s8_qK2AA8OHnZS_0 2024-09-12T19:13:57.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10186933360182864763', time=2024-09-12T21:00:32.074551+0000, chain.objs.size()=1 2024-09-12T19:13:57.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.5M-jJGj9t9AyDsAskHdSdv39Bz7UbDC_0 2024-09-12T19:13:57.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17936463294650947666', time=2024-09-12T21:00:32.102613+0000, chain.objs.size()=1 2024-09-12T19:13:57.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.C3TbZybRiSYIo_2LfD7-s-5dDWsOnuX_0 2024-09-12T19:13:57.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2186254929213892262', time=2024-09-12T21:00:32.122223+0000, chain.objs.size()=1 2024-09-12T19:13:57.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.TXj2QqzIpTyGvjfjUSrZ84Nog-DvunN_0 2024-09-12T19:13:57.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17529011374279396003', time=2024-09-12T21:00:32.123931+0000, chain.objs.size()=1 2024-09-12T19:13:57.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.adkv3JCo9mbeezhkwaD6wMPWl2gGPwl_0 2024-09-12T19:13:57.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7167924615851951203', time=2024-09-12T21:00:32.316097+0000, chain.objs.size()=1 2024-09-12T19:13:57.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.t_ziP1_4VSux5rd2vhSBA0Uh9r4gk7b_0 2024-09-12T19:13:57.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5240003818440127526', time=2024-09-12T21:00:32.320693+0000, chain.objs.size()=1 2024-09-12T19:13:57.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.VWq0_0XxGeheqVhEEKym0GNvJDCZYsq_0 2024-09-12T19:13:57.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8843211497141945706', time=2024-09-12T21:00:32.324609+0000, chain.objs.size()=1 2024-09-12T19:13:57.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.lm4bRMQb7I9hXsbTLYqhobknCIYr-1l_0 2024-09-12T19:13:57.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13795026239487983894', time=2024-09-12T21:00:32.340167+0000, chain.objs.size()=1 2024-09-12T19:13:57.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.GI_md7cZMLh_TEwjvihQS0kWGjqmpUE_0 2024-09-12T19:13:57.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9161559163354624538', time=2024-09-12T21:00:32.444439+0000, chain.objs.size()=1 2024-09-12T19:13:57.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.oBHYfM-kbSe2jJ0om0UHVdiiAOhXJgD_0 2024-09-12T19:13:57.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3631153739906055933', time=2024-09-12T21:00:32.514856+0000, chain.objs.size()=1 2024-09-12T19:13:57.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.R97UnL0-w2szMU-Fz-UrGU_4aRBzx9A_0 2024-09-12T19:13:57.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2280938039507421374', time=2024-09-12T21:00:32.527703+0000, chain.objs.size()=1 2024-09-12T19:13:57.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.0v54YoLJE2YWwVvJMPgpMh-eQAXkXTT_0 2024-09-12T19:13:57.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1219235249681220353', time=2024-09-12T21:00:32.552612+0000, chain.objs.size()=1 2024-09-12T19:13:57.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.GmZw0D6C74PEEcaUEkjVts8xY-HtQ8Z_0 2024-09-12T19:13:57.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1290652894120635829', time=2024-09-12T21:00:32.561997+0000, chain.objs.size()=1 2024-09-12T19:13:57.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.FJbOFQXyVuFED686vH8rvZXVunBFS09_0 2024-09-12T19:13:57.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7073487673535349481', time=2024-09-12T21:00:32.563805+0000, chain.objs.size()=1 2024-09-12T19:13:57.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Ceq_VPVtAJaDfBoywpXO9rZYTJYi8e7_0 2024-09-12T19:13:57.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4815911035169795418', time=2024-09-12T21:00:32.665821+0000, chain.objs.size()=1 2024-09-12T19:13:57.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.IIdh6_7LrHuNapT6Gy8UPIpiZ4kfNfG_0 2024-09-12T19:13:57.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3531662139872907483', time=2024-09-12T21:00:32.715675+0000, chain.objs.size()=1 2024-09-12T19:13:57.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.8OrXOl5t_9MEHiqgaaeAHjVt4Q9tn5h_0 2024-09-12T19:13:57.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17751049020362759788', time=2024-09-12T21:00:32.748442+0000, chain.objs.size()=1 2024-09-12T19:13:57.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sRve6YHQBR326d3-FRruColMqNGKYh9_0 2024-09-12T19:13:57.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2110019457702887804', time=2024-09-12T21:00:32.889354+0000, chain.objs.size()=1 2024-09-12T19:13:57.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.9HuDDaRKO8VNBYcGAc5DSPsiGY4ZCu1_0 2024-09-12T19:13:57.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14918675354935138218', time=2024-09-12T21:00:32.909411+0000, chain.objs.size()=1 2024-09-12T19:13:57.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_._q2TBbf2s-wvGDYaSreSzf00U8ayHyV_0 2024-09-12T19:13:57.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9400041296305361443', time=2024-09-12T21:00:32.918224+0000, chain.objs.size()=1 2024-09-12T19:13:57.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.112+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Ahx9JzH7wKerAUGnDMj0M3A-AXuVrkQ_0 2024-09-12T19:13:57.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12893116980531376752', time=2024-09-12T21:00:32.958473+0000, chain.objs.size()=1 2024-09-12T19:13:57.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ZfbKyhKu5F3TEi3xzGZc9z2QWdqYeS0_0 2024-09-12T19:13:57.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8352760352864720612', time=2024-09-12T21:00:32.969625+0000, chain.objs.size()=1 2024-09-12T19:13:57.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.5BtN3qPlnZM7aimPQGA88-Qf4RPHl1G_0 2024-09-12T19:13:57.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3670322522513336270', time=2024-09-12T21:00:33.168291+0000, chain.objs.size()=1 2024-09-12T19:13:57.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2evzUx97057UeHoUrA1kR0lDTbTidFT_0 2024-09-12T19:13:57.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4897366279264693221', time=2024-09-12T21:00:33.197393+0000, chain.objs.size()=1 2024-09-12T19:13:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Cx1gUs6oNOijH0AVoPYSpy32KvVtBqz_0 2024-09-12T19:13:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10474734608432627760', time=2024-09-12T21:00:33.212414+0000, chain.objs.size()=1 2024-09-12T19:13:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.caEnUL4bp0MQ0LsArCn_xmGPioASqde_0 2024-09-12T19:13:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14667999179683915053', time=2024-09-12T21:00:33.398665+0000, chain.objs.size()=1 2024-09-12T19:13:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.0A5FXXu2SghjNxDEm0sahxsUJoyA-9S_0 2024-09-12T19:13:57.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6837381818556039633', time=2024-09-12T21:00:33.444184+0000, chain.objs.size()=1 2024-09-12T19:13:57.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sMSp2xSxdtlNLwMD0CQROG4LJDEDSPp_0 2024-09-12T19:13:57.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11791557752682788940', time=2024-09-12T21:00:33.479244+0000, chain.objs.size()=1 2024-09-12T19:13:57.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.lGzll2SmvVwv365lJSNG8n2Jes1YqD6_0 2024-09-12T19:13:57.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6613214680958340258', time=2024-09-12T21:00:33.579925+0000, chain.objs.size()=1 2024-09-12T19:13:57.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.iiHucRYDOggAukATx8p3_qKkdebuX7U_0 2024-09-12T19:13:57.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9434109784663968349', time=2024-09-12T21:00:33.585699+0000, chain.objs.size()=1 2024-09-12T19:13:57.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.I0Sw06MmPQUMaTeGXA1S_od8alRVg8I_0 2024-09-12T19:13:57.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1527117568508169700', time=2024-09-12T21:00:33.610406+0000, chain.objs.size()=1 2024-09-12T19:13:57.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SN_3g-a05YE6tfA8KUSbNS3WcaAGSDM_0 2024-09-12T19:13:57.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17591503439895486095', time=2024-09-12T21:00:33.640357+0000, chain.objs.size()=1 2024-09-12T19:13:57.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.PGNQRQAif_2gHGp63SJsku6zujiUd9Y_0 2024-09-12T19:13:57.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13878493307104896059', time=2024-09-12T21:00:33.660487+0000, chain.objs.size()=1 2024-09-12T19:13:57.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.OOTZ8R94Oe4wLqRfMVPTiLwfETRcLQi_0 2024-09-12T19:13:57.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1015834812982886603', time=2024-09-12T21:00:33.853460+0000, chain.objs.size()=1 2024-09-12T19:13:57.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qq7KskZ9kBjlOPLCNoOz7bbkMY0T2Kj_0 2024-09-12T19:13:57.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9899057698894904863', time=2024-09-12T21:00:33.899380+0000, chain.objs.size()=1 2024-09-12T19:13:57.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qjY_zSXuT_whfRyml44CSWQR9kvTYRu_0 2024-09-12T19:13:57.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6485157259680186455', time=2024-09-12T21:00:46.179960+0000, chain.objs.size()=1 2024-09-12T19:13:57.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.279__shadow_.iaDsWYknQLDRePCfrHK69kIh-e7MFmE_0 2024-09-12T19:13:57.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1392646220511656977', time=2024-09-12T21:00:47.584510+0000, chain.objs.size()=1 2024-09-12T19:13:57.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.281__shadow_.RElueURsut_6atkViy8zs1-4lpVwGR5_0 2024-09-12T19:13:57.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12564847778472698431', time=2024-09-12T21:00:56.744751+0000, chain.objs.size()=1 2024-09-12T19:13:57.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.1ZYsWvtBiCTv8QRp3rMTzFM0doQqEEz_0 2024-09-12T19:13:57.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11140612530675644154', time=2024-09-12T21:01:01.000963+0000, chain.objs.size()=1 2024-09-12T19:13:57.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.297__shadow_.BEWIL4Ty6bwNnnhe0gU9ud7K7tMSj8S_0 2024-09-12T19:13:57.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8602497724670342620', time=2024-09-12T21:01:39.401692+0000, chain.objs.size()=1 2024-09-12T19:13:57.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.yA0LRLYibVmBe7KfA-ECpgVUw_bHXbJ_0 2024-09-12T19:13:57.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.124+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12469665148836265642', time=2024-09-12T21:01:39.468871+0000, chain.objs.size()=1 2024-09-12T19:13:57.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.124+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.esz9HK1cXBr_K0kmE0L_4eE5MYO2OFx_0 2024-09-12T19:13:57.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.124+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10884997289067257439', time=2024-09-12T21:01:39.480852+0000, chain.objs.size()=1 2024-09-12T19:13:57.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.124+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.TZk4fF48CznKdEheDl9osi1l1c_z9dr_0 2024-09-12T19:13:57.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.124+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11416653911824023877', time=2024-09-12T21:01:39.495316+0000, chain.objs.size()=1 2024-09-12T19:13:57.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.124+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.VnZg-6BC8RUUS5vzmdlm0mWeWj--5K1_0 2024-09-12T19:13:57.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7327714255450724246', time=2024-09-12T21:01:39.546182+0000, chain.objs.size()=1 2024-09-12T19:13:57.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.YSeyTZ8o0lXd5tRIcIrgivELqPNGReH_0 2024-09-12T19:13:57.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.362932193705208288', time=2024-09-12T21:01:39.665242+0000, chain.objs.size()=1 2024-09-12T19:13:57.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.NMuuxbzkTR9JZ_Vhs9nKUOwEkKijML6_0 2024-09-12T19:13:57.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13262307012032001302', time=2024-09-12T21:01:39.716869+0000, chain.objs.size()=1 2024-09-12T19:13:57.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.m8byH6DXQTGSl07VssC-yDP_YLKndZz_0 2024-09-12T19:13:57.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8446832829994390568', time=2024-09-12T21:01:39.721474+0000, chain.objs.size()=1 2024-09-12T19:13:57.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.r-Nec5ISF9b0OFgKGrwmHT9TMyLH8VH_0 2024-09-12T19:13:57.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3462936790981580731', time=2024-09-12T21:01:39.749265+0000, chain.objs.size()=1 2024-09-12T19:13:57.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.az4i3ldP3D2Kprv6PZgBPATw2FxB5qw_0 2024-09-12T19:13:57.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7999992371146702625', time=2024-09-12T21:01:39.762231+0000, chain.objs.size()=1 2024-09-12T19:13:57.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._oHlx-R4c1qvXee3PYk-FqBljYfcw3b_0 2024-09-12T19:13:57.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15829827118684440837', time=2024-09-12T21:01:39.773197+0000, chain.objs.size()=1 2024-09-12T19:13:57.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.kkUimFg11Hqo7F4MM4LxJjgNVHIHZ8Y_0 2024-09-12T19:13:57.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13234562154440222831', time=2024-09-12T21:01:39.890100+0000, chain.objs.size()=1 2024-09-12T19:13:57.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.uGrTBkE79p3tfzn8YTfEIkvsB6Ah7tV_0 2024-09-12T19:13:57.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12771224401689022499', time=2024-09-12T21:01:39.960713+0000, chain.objs.size()=1 2024-09-12T19:13:57.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.1qldku5bS83-u6HUB94wTGFHYYC6xTA_0 2024-09-12T19:13:57.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17312891608079719962', time=2024-09-12T21:01:40.139980+0000, chain.objs.size()=1 2024-09-12T19:13:57.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ENXiWXmDb8vD2jD0pVJHtJEyC13P2fA_0 2024-09-12T19:13:57.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1456973009582369814', time=2024-09-12T21:01:40.184219+0000, chain.objs.size()=1 2024-09-12T19:13:57.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.idsd6XBoQdM0-VDv8FowPZoXV-a4FQM_0 2024-09-12T19:13:57.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18305402311266105599', time=2024-09-12T21:01:40.195080+0000, chain.objs.size()=1 2024-09-12T19:13:57.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.OLwBX2aD07tNcA90rSpzX6mwZZc526I_0 2024-09-12T19:13:57.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1062588792678164267', time=2024-09-12T21:01:40.212753+0000, chain.objs.size()=1 2024-09-12T19:13:57.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.C8DmWaIEMSbTRxQM-FhFMU36ySeCwbc_0 2024-09-12T19:13:57.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3181339499740885032', time=2024-09-12T21:01:40.369775+0000, chain.objs.size()=1 2024-09-12T19:13:57.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.B4Pvuw0g-GEUVPFZEQMbS6zu8Jnyp5R_0 2024-09-12T19:13:57.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2643977820837824509', time=2024-09-12T21:01:40.372689+0000, chain.objs.size()=1 2024-09-12T19:13:57.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.aZIw22Jvmq_jGoig3l2-5Yi7sAdYBOO_0 2024-09-12T19:13:57.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3891693616668562038', time=2024-09-12T21:01:40.415165+0000, chain.objs.size()=1 2024-09-12T19:13:57.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hU3PINfTxbMulxxy7NJxXfTqUalHhU__0 2024-09-12T19:13:57.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7601478394906101526', time=2024-09-12T21:01:40.448615+0000, chain.objs.size()=1 2024-09-12T19:13:57.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._uPegIQ-wmrobO7ARGUKWBg1L3-N9J1_0 2024-09-12T19:13:57.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7298121143003951871', time=2024-09-12T21:01:40.456224+0000, chain.objs.size()=1 2024-09-12T19:13:57.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Lyla3t9W3M-vBgrQd8BTXv5hwOlWn9L_0 2024-09-12T19:13:57.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4738962466805817815', time=2024-09-12T21:01:40.576337+0000, chain.objs.size()=1 2024-09-12T19:13:57.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.xU8X6pWu7QcB7QJYnMW7dy8eZkjwXoH_0 2024-09-12T19:13:57.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12901188923629583312', time=2024-09-12T21:01:40.594100+0000, chain.objs.size()=1 2024-09-12T19:13:57.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.fKz5NApfB9JiUNeF4Umr825vxCsHSWT_0 2024-09-12T19:13:57.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10505511620699202635', time=2024-09-12T21:01:40.637815+0000, chain.objs.size()=1 2024-09-12T19:13:57.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0FLnKk2Ed8XxUwdeP76IgqlQXu6nbEX_0 2024-09-12T19:13:57.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15183903527984376092', time=2024-09-12T21:01:40.842823+0000, chain.objs.size()=1 2024-09-12T19:13:57.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.h3hU5civefZyU-AHYHr86wh96oYjjss_0 2024-09-12T19:13:57.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2523404352738828154', time=2024-09-12T21:01:40.850917+0000, chain.objs.size()=1 2024-09-12T19:13:57.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ta0sonYXZkCHpZB4A3GwyI0uooIdHh7_0 2024-09-12T19:13:57.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13722594777264643518', time=2024-09-12T21:01:41.053800+0000, chain.objs.size()=1 2024-09-12T19:13:57.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.lZRzaoYbnVbfL9pBPvA2xKHFZqftZdZ_0 2024-09-12T19:13:57.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15748960394941237649', time=2024-09-12T21:01:41.096916+0000, chain.objs.size()=1 2024-09-12T19:13:57.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.nN5bWzqJ7kFFb9DWxsUzTMG2ipu5qy1_0 2024-09-12T19:13:57.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8265200200924166036', time=2024-09-12T21:02:00.507683+0000, chain.objs.size()=1 2024-09-12T19:13:57.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.pQeL0bUjV6bnxaoqz9sSo3432kfUZXN_0 2024-09-12T19:13:57.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10953571133949125494', time=2024-09-12T21:02:00.514814+0000, chain.objs.size()=1 2024-09-12T19:13:57.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.tWKlW-kYA5tEnf3mUI_qMwLAwOSINwb_0 2024-09-12T19:13:57.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12716005499197608381', time=2024-09-12T21:02:00.543665+0000, chain.objs.size()=1 2024-09-12T19:13:57.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5gYTmVZcNySjZrNsTPLpdv62TmyLjK0_0 2024-09-12T19:13:57.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6529402829996181685', time=2024-09-12T21:02:00.551565+0000, chain.objs.size()=1 2024-09-12T19:13:57.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.G5d8bZ_DuA_4mKa3XNqoWzbRp9EQ8f5_0 2024-09-12T19:13:57.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18399704145739190473', time=2024-09-12T21:02:00.555025+0000, chain.objs.size()=1 2024-09-12T19:13:57.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ZtDfXHBh08oFlTJOWrL6GqToDeZQDBc_0 2024-09-12T19:13:57.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12824841844372535991', time=2024-09-12T21:02:00.558192+0000, chain.objs.size()=1 2024-09-12T19:13:57.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.y-R5A5hW3ExkqLEcnh7gm_qlaeILmcn_0 2024-09-12T19:13:57.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4791513009789209153', time=2024-09-12T21:02:00.574000+0000, chain.objs.size()=1 2024-09-12T19:13:57.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.mhDfKkKcUO8y86YrtFDc7V0I9SBD1jv_0 2024-09-12T19:13:57.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9829383124738278545', time=2024-09-12T21:02:00.635336+0000, chain.objs.size()=1 2024-09-12T19:13:57.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7hVBNaY1fpaxBFbdiTY4lngrxqfDp0n_0 2024-09-12T19:13:57.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.530972710434966369', time=2024-09-12T21:02:00.770691+0000, chain.objs.size()=1 2024-09-12T19:13:57.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.L09DmdPiRgU4OtB0d1SPxOBh0DzxRmM_0 2024-09-12T19:13:57.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11408814553762379482', time=2024-09-12T21:02:00.793319+0000, chain.objs.size()=1 2024-09-12T19:13:57.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.o3PaVc12BX7ptTiS9eR4lxuctpJSHCe_0 2024-09-12T19:13:57.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2599100284088486827', time=2024-09-12T21:02:00.865760+0000, chain.objs.size()=1 2024-09-12T19:13:57.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.CB5rFQ5ypBbZlGZ_376Lexrm8VSa31M_0 2024-09-12T19:13:57.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2706618695350321589', time=2024-09-12T21:02:01.096853+0000, chain.objs.size()=1 2024-09-12T19:13:57.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.PLSJRAnU3kPBaJj6SNtC_5djFQW6dTZ_0 2024-09-12T19:13:57.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2926426145033106802', time=2024-09-12T21:02:01.245342+0000, chain.objs.size()=1 2024-09-12T19:13:57.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.nCD5wzTvTmkTavl6eDjatsPRiCbf3tu_0 2024-09-12T19:13:57.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1337020480501889756', time=2024-09-12T21:02:01.279580+0000, chain.objs.size()=1 2024-09-12T19:13:57.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.KZTs-lv6cuADvMIEOXGb-0xxgT4ASVs_0 2024-09-12T19:13:57.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3594521571949024538', time=2024-09-12T21:02:01.468329+0000, chain.objs.size()=1 2024-09-12T19:13:57.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ISv_9DIkyrkI852vEBrSHFQzGa_HRkM_0 2024-09-12T19:13:57.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9720914188973386958', time=2024-09-12T21:02:01.511829+0000, chain.objs.size()=1 2024-09-12T19:13:57.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.fJ0OfUeLOic0bcLJx5A0T0Dou4XhWlw_0 2024-09-12T19:13:57.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14990846415548531914', time=2024-09-12T21:02:01.536183+0000, chain.objs.size()=1 2024-09-12T19:13:57.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.CsOO_SSa0HPsILY1ZM6d83J5ykXgEuX_0 2024-09-12T19:13:57.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4835683052514272373', time=2024-09-12T21:02:01.545981+0000, chain.objs.size()=1 2024-09-12T19:13:57.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.H7Pi6Y_qu5LZVKZF_h3Nnl-X-IR-URS_0 2024-09-12T19:13:57.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1933619071751670382', time=2024-09-12T21:02:01.664599+0000, chain.objs.size()=1 2024-09-12T19:13:57.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Y5OQBGw36Je7-F03P9hyWOlwxCaZHnZ_0 2024-09-12T19:13:57.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1919210679456448236', time=2024-09-12T21:02:01.678685+0000, chain.objs.size()=1 2024-09-12T19:13:57.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.k2z89fGOYBUS0fKa0E1ezu1wIdSxgLy_0 2024-09-12T19:13:57.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3133162506787831971', time=2024-09-12T21:02:01.709076+0000, chain.objs.size()=1 2024-09-12T19:13:57.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qK8K6nxd51xCyen2gv_w8fKSOl5xyi0_0 2024-09-12T19:13:57.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10565544454696383993', time=2024-09-12T21:02:01.907898+0000, chain.objs.size()=1 2024-09-12T19:13:57.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.zJS66SDcWp21jo5bOIjDrUGrDhcDu8f_0 2024-09-12T19:13:57.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8194188966650496710', time=2024-09-12T21:02:01.938584+0000, chain.objs.size()=1 2024-09-12T19:13:57.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WEmnYq1gwyjT96_RxiK1t6d0vDHqwd1_0 2024-09-12T19:13:57.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1986873348486059785', time=2024-09-12T21:02:01.956297+0000, chain.objs.size()=1 2024-09-12T19:13:57.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.OhRdF6F7WL7p7WvPx6vrgJ34Q6RyqWg_0 2024-09-12T19:13:57.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12708617985968811063', time=2024-09-12T21:02:01.996139+0000, chain.objs.size()=1 2024-09-12T19:13:57.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.b66L11WiZzkOCfsAMvS0pqacOgjOI_p_0 2024-09-12T19:13:57.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1444999880653500469', time=2024-09-12T21:02:02.007113+0000, chain.objs.size()=1 2024-09-12T19:13:57.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Bx7gZpDKA0XjJxFk7Pf0JqpCgwDezVU_0 2024-09-12T19:13:57.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15313795339854599231', time=2024-09-12T21:02:02.010952+0000, chain.objs.size()=1 2024-09-12T19:13:57.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.iRCF1jqWH1vXNKtBTrYzJcsNBt_9-cW_0 2024-09-12T19:13:57.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.152+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10334325791053278221', time=2024-09-12T21:02:02.164640+0000, chain.objs.size()=1 2024-09-12T19:13:57.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.152+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.QV0QHqbSLqdAa5uu_TwkYavG2TfDU4Y_0 2024-09-12T19:13:57.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.152+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11115510848854076132', time=2024-09-12T21:02:02.200411+0000, chain.objs.size()=1 2024-09-12T19:13:57.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.152+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.XHdxuaXHFVZ8Ud5zKApZhbnfqXXghD8_0 2024-09-12T19:13:57.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.156+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/57708 2024-09-12T19:13:57.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T19:13:57.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9989031495314751889', time=2024-09-12T21:02:13.381031+0000, chain.objs.size()=1 2024-09-12T19:13:57.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.341__shadow_.w4pjCLdgYzLKtM92alpKY1yx2SoXgNj_0 2024-09-12T19:13:57.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13575563324040392542', time=2024-09-12T21:02:29.088230+0000, chain.objs.size()=1 2024-09-12T19:13:57.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.367__shadow_.RzyORZIPUuy06VgdQeT9-5km7_e8YyD_0 2024-09-12T19:13:57.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16035062044759864761', time=2024-09-12T21:03:36.086060+0000, chain.objs.size()=1 2024-09-12T19:13:57.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.455__shadow_.ykxCf41cHzwyYWhmZBI1ruRkN2v1wQZ_0 2024-09-12T19:13:57.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10963049241016553213', time=2024-09-12T21:03:45.270511+0000, chain.objs.size()=1 2024-09-12T19:13:57.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.464__shadow_.AavGmd0O8CUMH1n_rH70JvQOlozgcsq_0 2024-09-12T19:13:57.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16027041474167494867', time=2024-09-12T21:03:46.202525+0000, chain.objs.size()=1 2024-09-12T19:13:57.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.465__shadow_.M9SDXK3i-tSwX3aVVxYURBkSAd_Yqwl_0 2024-09-12T19:13:57.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3092562226148503240', time=2024-09-12T21:03:47.081715+0000, chain.objs.size()=1 2024-09-12T19:13:57.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.466__shadow_.X5MgHsGi_NvRIVay8D3lcRmUQECx215_0 2024-09-12T19:13:57.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16809477551914770599', time=2024-09-12T21:04:06.500935+0000, chain.objs.size()=1 2024-09-12T19:13:57.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.499__shadow_.walyWA-Sfomvc2aHgmaHh1n_x-kGuyH_0 2024-09-12T19:13:57.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9384244654489713870', time=2024-09-12T21:06:08.995116+0000, chain.objs.size()=1 2024-09-12T19:13:57.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:QnE-lLcO.5c8lXBt-vyEetIShi7qKXw_.p_ARaSzEVicXThN81dCadmPUHWy_QBp_0 2024-09-12T19:13:57.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8234881862541861972', time=2024-09-12T21:06:16.682058+0000, chain.objs.size()=1 2024-09-12T19:13:57.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.574__shadow_.2WN13HW-MyjQuQ1AfB488AcERP4XZlM_0 2024-09-12T19:13:57.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14721039956218234490', time=2024-09-12T21:06:32.387168+0000, chain.objs.size()=1 2024-09-12T19:13:57.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:Lm78LZSnJn-D6qoh3SNdNCQQyP5hHy1_.nZ4hK-5XFkDLfeS0pAqfYrh0FZWPyv-_0 2024-09-12T19:13:57.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.980974221229657488', time=2024-09-12T21:06:33.480211+0000, chain.objs.size()=1 2024-09-12T19:13:57.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:h9DM1wGwIOJlb-h-bxozANcHHsT0nfK_.bcJ4BihFOfXVSpGs6BO6UmjIrg-wYhQ_0 2024-09-12T19:13:57.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2650663782176100816', time=2024-09-12T21:06:44.611906+0000, chain.objs.size()=4 2024-09-12T19:13:57.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.578__multipart_testobj.2~ynA8gmEeEgKgSqNYSc91RdCrNMl8AoN.1 2024-09-12T19:13:57.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.578__multipart_testobj.2~ynA8gmEeEgKgSqNYSc91RdCrNMl8AoN.2 2024-09-12T19:13:57.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.578__multipart_testobj.2~ynA8gmEeEgKgSqNYSc91RdCrNMl8AoN.3 2024-09-12T19:13:57.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.578__multipart_testobj.2~ynA8gmEeEgKgSqNYSc91RdCrNMl8AoN.4 2024-09-12T19:13:57.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10757887647786598333', time=2024-09-12T21:06:48.233644+0000, chain.objs.size()=1 2024-09-12T19:13:57.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.580__shadow:9q6P91zd0JX3R5WE-b9cYVX.o6oWBac_.8AuNbFOcdSZcUECMAZYdK6jU2NPYud5_0 2024-09-12T19:13:57.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9316628171752344992', time=2024-09-12T21:06:53.771214+0000, chain.objs.size()=1 2024-09-12T19:13:57.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.587__shadow:fNpli5fxkhQeLqi6YFkvTeOp4BzLQzm_.wQ9TokuMZrJ7YgbqcrTiTZVK57CxBDE_0 2024-09-12T19:13:57.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12268822479667626078', time=2024-09-12T21:10:00.207643+0000, chain.objs.size()=1 2024-09-12T19:13:57.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.656__shadow_.Jf5jpMNfSPKw_A7y88NvoiVjqoVyhhr_0 2024-09-12T19:13:57.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T19:13:57.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48204' 2024-09-12T19:13:57.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_s-ShZW3s7-qWXGdCjCJWvrgQxXoEGjP', time=2024-09-12T20:57:36.383142+0000, chain.objs.size()=3 2024-09-12T19:13:57.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_.tdM5eiYX1uM2SwawmJWLRnVqHyXk907_0 2024-09-12T19:13:57.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_.tdM5eiYX1uM2SwawmJWLRnVqHyXk907_1 2024-09-12T19:13:57.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_.tdM5eiYX1uM2SwawmJWLRnVqHyXk907_2 2024-09-12T19:13:57.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_VNXEiUKLmahSMS2TqTbdYxzemrgHUnJ', time=2024-09-12T20:57:38.723898+0000, chain.objs.size()=1 2024-09-12T19:13:57.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.165__shadow_.0RYIWX6WAs92ls-zLvsvZh3g2jxGqNR_0 2024-09-12T19:13:57.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5965427714852592036', time=2024-09-12T20:58:18.846101+0000, chain.objs.size()=1 2024-09-12T19:13:57.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.199__shadow_.oKRTCtDv_asATHC3MDEJgmCNm_PvTIW_0 2024-09-12T19:13:57.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7557830581341232458', time=2024-09-12T20:59:50.108102+0000, chain.objs.size()=1 2024-09-12T19:13:57.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.233__shadow_.reWF1U005t5gd8TAi3-GAPF-qt5JNoZ_0 2024-09-12T19:13:57.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11805487087019440399', time=2024-09-12T20:59:50.808577+0000, chain.objs.size()=1 2024-09-12T19:13:57.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.234__shadow_.ksKVmeANkMBzft3l1zRYG7dAZ3NfP7W_0 2024-09-12T19:13:57.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1552974470404079656', time=2024-09-12T21:00:05.145060+0000, chain.objs.size()=1 2024-09-12T19:13:57.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.251__shadow_.XDOayXgiYD5YK27hD6EhY1tMNU9x2-u_0 2024-09-12T19:13:57.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17268913092330074806', time=2024-09-12T21:00:06.677062+0000, chain.objs.size()=1 2024-09-12T19:13:57.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.253__shadow_.6HmIGCEIuBjMvt0voLhMCf8A-4mPvOk_0 2024-09-12T19:13:57.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.327287236001472317', time=2024-09-12T21:00:08.095246+0000, chain.objs.size()=1 2024-09-12T19:13:57.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.255__shadow_.MgW33ySX-AUBg3SYAX-1kSIR3G-ff99_0 2024-09-12T19:13:57.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8470204184800857534', time=2024-09-12T21:00:11.703831+0000, chain.objs.size()=1 2024-09-12T19:13:57.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.260__shadow_.Z60p8t5Tc0oEuC4g9dd_jh5oTmXpY10_0 2024-09-12T19:13:57.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17831621437758881138', time=2024-09-12T21:00:31.980231+0000, chain.objs.size()=1 2024-09-12T19:13:57.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qXp4GXu4bEA6yYDEdkn1WyIqknBFxCg_0 2024-09-12T19:13:57.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2924895015865025120', time=2024-09-12T21:00:32.053983+0000, chain.objs.size()=1 2024-09-12T19:13:57.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2D9ptla75VWSvRn4zTzKrYRl4YaTsL3_0 2024-09-12T19:13:57.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12222333497233264514', time=2024-09-12T21:00:32.111708+0000, chain.objs.size()=1 2024-09-12T19:13:57.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XD1qnvW7wQLWaKix9VWXRQWHkfrMSfj_0 2024-09-12T19:13:57.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7305871311076765464', time=2024-09-12T21:00:32.232714+0000, chain.objs.size()=1 2024-09-12T19:13:57.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-R2nX9B2xf8cWtjzheQgplnSvNhH148_0 2024-09-12T19:13:57.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18421397128008999006', time=2024-09-12T21:00:32.261046+0000, chain.objs.size()=1 2024-09-12T19:13:57.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Umxx09hGp08kTe2CJACPnwe-WJbYUqa_0 2024-09-12T19:13:57.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4419416729417830329', time=2024-09-12T21:00:32.298246+0000, chain.objs.size()=1 2024-09-12T19:13:57.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.GzMzxJCBJKvHbpJ8c7PLTXB6O_zfJMv_0 2024-09-12T19:13:57.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11666754507561282205', time=2024-09-12T21:00:32.325595+0000, chain.objs.size()=1 2024-09-12T19:13:57.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.rfeC7xxoXDu2ToxENkYMgL1poPLT_-r_0 2024-09-12T19:13:57.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11674429566805752123', time=2024-09-12T21:00:32.344952+0000, chain.objs.size()=1 2024-09-12T19:13:57.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.PazoMNeqmPQtCgTvFTHrlWksMBuJ4Fd_0 2024-09-12T19:13:57.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15436654465700873336', time=2024-09-12T21:00:32.444185+0000, chain.objs.size()=1 2024-09-12T19:13:57.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.RUE87ahuLmqKE6ZfFT-hRbFSui1n8Oo_0 2024-09-12T19:13:57.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10156774239631663378', time=2024-09-12T21:00:32.484853+0000, chain.objs.size()=1 2024-09-12T19:13:57.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.KqKp7gb5eUTUqVozh2oLaHD0X1zYIcD_0 2024-09-12T19:13:57.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3989248102572955544', time=2024-09-12T21:00:32.553395+0000, chain.objs.size()=1 2024-09-12T19:13:57.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LvNvp6QTK7dCfbN6CxJF4sVEZzpSH2O_0 2024-09-12T19:13:57.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10697947046786372872', time=2024-09-12T21:00:32.741765+0000, chain.objs.size()=1 2024-09-12T19:13:57.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.nQ2b7i4iq9qo33lVc3MuqvgPPOqBqMR_0 2024-09-12T19:13:57.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.184+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15802700998923214338', time=2024-09-12T21:00:32.899203+0000, chain.objs.size()=1 2024-09-12T19:13:57.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.184+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.FT9hK5zUI2cX1K_MiMcACJxul6I-ezY_0 2024-09-12T19:13:57.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.184+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1817090130843590462', time=2024-09-12T21:00:32.941938+0000, chain.objs.size()=1 2024-09-12T19:13:57.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.184+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.u9iUrXhpcM-DyfpUmr674giYvY8BZ2I_0 2024-09-12T19:13:57.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18281712239474907544', time=2024-09-12T21:00:32.948718+0000, chain.objs.size()=1 2024-09-12T19:13:57.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tTRx2N4JeXq6ndykHwcFdTPAFfBmzbU_0 2024-09-12T19:13:57.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17982260951591945405', time=2024-09-12T21:00:32.970417+0000, chain.objs.size()=1 2024-09-12T19:13:57.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qEzyYYP-tbWL2evndUYnQjQk2XdYNUS_0 2024-09-12T19:13:57.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4819470497843357319', time=2024-09-12T21:00:32.975839+0000, chain.objs.size()=1 2024-09-12T19:13:57.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.0PcUIMKSy2eVvIpRRTyOQoCY-GPzuQr_0 2024-09-12T19:13:57.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18109532211609213644', time=2024-09-12T21:00:32.991907+0000, chain.objs.size()=1 2024-09-12T19:13:57.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.z3HqU_-faEXWie9FTeBie3heuS-LYvH_0 2024-09-12T19:13:57.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15859630602423106351', time=2024-09-12T21:00:32.992862+0000, chain.objs.size()=1 2024-09-12T19:13:57.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.YgI5_NOfbPhXaBQHU_Lu6iYgmzyQ-Uv_0 2024-09-12T19:13:57.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12830694775252523203', time=2024-09-12T21:00:33.097231+0000, chain.objs.size()=1 2024-09-12T19:13:57.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.90kfo7naxafIPDLUDB500T-KCSbahl5_0 2024-09-12T19:13:57.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14477133675213009490', time=2024-09-12T21:00:33.156049+0000, chain.objs.size()=1 2024-09-12T19:13:57.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.g_Muc5eNTn_Qap3k4AlMkfN3Xa_ys4-_0 2024-09-12T19:13:57.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7714122539706975957', time=2024-09-12T21:00:33.179760+0000, chain.objs.size()=1 2024-09-12T19:13:57.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-miqTgEFWuhpU8iOC5EwAx7CXDEcUrz_0 2024-09-12T19:13:57.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6430875111918924526', time=2024-09-12T21:00:33.187959+0000, chain.objs.size()=1 2024-09-12T19:13:57.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.kzJUDuIlt6fsR1HAt9drAaI76KQQ8Wz_0 2024-09-12T19:13:57.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14825901159941898901', time=2024-09-12T21:00:33.194336+0000, chain.objs.size()=1 2024-09-12T19:13:57.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ho9Ieji9sA5HgyTCZcW3ha9lejdmXYd_0 2024-09-12T19:13:57.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3753886408040654680', time=2024-09-12T21:00:33.211221+0000, chain.objs.size()=1 2024-09-12T19:13:57.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tdW4FdbNJ7GD_umaLgkTLv01xeaXsyD_0 2024-09-12T19:13:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9120390561752878916', time=2024-09-12T21:00:33.380162+0000, chain.objs.size()=1 2024-09-12T19:13:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.bmPu_FfkOMMZhlAA4z6Y-F6zm_Ko7UI_0 2024-09-12T19:13:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6920618051349225215', time=2024-09-12T21:00:33.447167+0000, chain.objs.size()=1 2024-09-12T19:13:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.PMPNdW1UYPRRlFCJouHKPeRBSJvVKaA_0 2024-09-12T19:13:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8092642011113667942', time=2024-09-12T21:00:33.467427+0000, chain.objs.size()=1 2024-09-12T19:13:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.rdmhHdi1JZbPzQ2OnhJVnGRutJKfOTo_0 2024-09-12T19:13:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15252263610671135721', time=2024-09-12T21:00:36.003089+0000, chain.objs.size()=1 2024-09-12T19:13:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.265__shadow_.npc92dvuO6Q4lDTzJAe6BegHVW7eVal_0 2024-09-12T19:13:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15596618383551425947', time=2024-09-12T21:00:39.602662+0000, chain.objs.size()=1 2024-09-12T19:13:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.270__shadow_.s58o_xq7nFW5gjjhT3-TlCT5YyyMbEX_0 2024-09-12T19:13:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11425990777786640980', time=2024-09-12T21:00:45.447987+0000, chain.objs.size()=1 2024-09-12T19:13:57.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.278__shadow_.j4TbBHo5Cq0nf-d5eLRHmbJODXN351c_0 2024-09-12T19:13:57.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17960298782287836969', time=2024-09-12T21:00:53.557492+0000, chain.objs.size()=1 2024-09-12T19:13:57.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.289__shadow_.7RRVd-rvZLZ3sR1JlU_p8FZX-Rl26fy_0 2024-09-12T19:13:57.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11167689150551412197', time=2024-09-12T21:01:04.827701+0000, chain.objs.size()=1 2024-09-12T19:13:57.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.302__shadow_.cIevfZXwAHypjT7ufRyc-pk90y7cskJ_0 2024-09-12T19:13:57.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8613990051870273442', time=2024-09-12T21:01:39.543583+0000, chain.objs.size()=1 2024-09-12T19:13:57.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.EtesytodYFBSedRcTWUwsAd-esTdhg5_0 2024-09-12T19:13:57.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16514758717222871621', time=2024-09-12T21:01:39.664877+0000, chain.objs.size()=1 2024-09-12T19:13:57.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.D9BbQVtfo1U0RROitOUjmmxbzA2c5Fk_0 2024-09-12T19:13:57.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14163067547226242891', time=2024-09-12T21:01:39.666309+0000, chain.objs.size()=1 2024-09-12T19:13:57.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ayNzGh1cHP21nYxUncDLC5M_T5VbAEb_0 2024-09-12T19:13:57.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2255941653928081654', time=2024-09-12T21:01:39.696200+0000, chain.objs.size()=1 2024-09-12T19:13:57.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.MmrVj2jDS-q3T2mOTW4o1WBHC16SuFx_0 2024-09-12T19:13:57.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18208175727205897469', time=2024-09-12T21:01:39.706711+0000, chain.objs.size()=1 2024-09-12T19:13:57.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9JxLijKyx7nJ3sc1TaBVtxmwP5vzflw_0 2024-09-12T19:13:57.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10736984853341024739', time=2024-09-12T21:01:39.726362+0000, chain.objs.size()=1 2024-09-12T19:13:57.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.6kZEl64EcEPMQDXZR7z9Nv5mg4WvESf_0 2024-09-12T19:13:57.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9130477863158845475', time=2024-09-12T21:01:39.728211+0000, chain.objs.size()=1 2024-09-12T19:13:57.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ePPurYVFiTmnIUNx21KsaX8pOC5VxmT_0 2024-09-12T19:13:57.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15141784245112040576', time=2024-09-12T21:01:39.906094+0000, chain.objs.size()=1 2024-09-12T19:13:57.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.4mCk4WVorQwwYY4n5Eno2s3J9g7iKB1_0 2024-09-12T19:13:57.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.345153724653873858', time=2024-09-12T21:01:39.955318+0000, chain.objs.size()=1 2024-09-12T19:13:57.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0KJbGBeJSuiBdit98OuLgzDcYcJSkGn_0 2024-09-12T19:13:57.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18272030714722070306', time=2024-09-12T21:01:40.020972+0000, chain.objs.size()=1 2024-09-12T19:13:57.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.p0Wy9it4MHWIja8fKBncGLYOLmruzKf_0 2024-09-12T19:13:57.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17351337176959393071', time=2024-09-12T21:01:40.022317+0000, chain.objs.size()=1 2024-09-12T19:13:57.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.98pYVAR0AfEWu2KUckPvCcWbBAtOVu4_0 2024-09-12T19:13:57.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5704124476841526674', time=2024-09-12T21:01:40.172405+0000, chain.objs.size()=1 2024-09-12T19:13:57.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ERoP4qZ9d24ntyY35A-IBNGU5V5xP8v_0 2024-09-12T19:13:57.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4762296734279444665', time=2024-09-12T21:01:40.187182+0000, chain.objs.size()=1 2024-09-12T19:13:57.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-JPJz0o3eG2CB4M5-RqW7Lepa6dOatx_0 2024-09-12T19:13:57.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1528232417598406438', time=2024-09-12T21:01:40.358202+0000, chain.objs.size()=1 2024-09-12T19:13:57.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.16aJnNhWQkhnDaQdMo8kVIrWj3UrrGA_0 2024-09-12T19:13:57.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15999564792137302936', time=2024-09-12T21:01:40.427315+0000, chain.objs.size()=1 2024-09-12T19:13:57.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.7U1hmVrOAvJS_9Jjzl2c7ukUgNhg129_0 2024-09-12T19:13:57.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3910763989779981697', time=2024-09-12T21:01:40.453069+0000, chain.objs.size()=1 2024-09-12T19:13:57.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.2J6NZ3xRSPnEjpOLlFTqHH6GXM2yzEU_0 2024-09-12T19:13:57.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17729393471173347498', time=2024-09-12T21:01:40.659678+0000, chain.objs.size()=1 2024-09-12T19:13:57.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.GwmsZqMTX6C5jw0-At9jGHn9rylW5Tn_0 2024-09-12T19:13:57.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9414769502958079773', time=2024-09-12T21:01:40.670497+0000, chain.objs.size()=1 2024-09-12T19:13:57.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.tiAQX6Zh2lRtwGlGWH6V7z8FpEEQ_sA_0 2024-09-12T19:13:57.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6100526553891503159', time=2024-09-12T21:01:40.768231+0000, chain.objs.size()=1 2024-09-12T19:13:57.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.k9PveDVEQWh4ZTRdO5_B8QcSp7HMkjG_0 2024-09-12T19:13:57.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.182944350264523657', time=2024-09-12T21:01:40.873080+0000, chain.objs.size()=1 2024-09-12T19:13:57.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.yVU-DxrGE2ZCDiO1098hdaqYwZosCGJ_0 2024-09-12T19:13:57.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2826373886319157765', time=2024-09-12T21:01:40.874022+0000, chain.objs.size()=1 2024-09-12T19:13:57.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hbaeBo_qMIN4QUyeUNMfA-44t_nA4re_0 2024-09-12T19:13:57.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11895136591543363542', time=2024-09-12T21:01:40.994443+0000, chain.objs.size()=1 2024-09-12T19:13:57.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.lfaJ9D14YRRJGm7gOPelDSLzvTYju1g_0 2024-09-12T19:13:57.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18110898556625018471', time=2024-09-12T21:01:40.995846+0000, chain.objs.size()=1 2024-09-12T19:13:57.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.HM_eB5fgLlARGDnmdf05MFt0LjeyjZB_0 2024-09-12T19:13:57.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13829355228241541512', time=2024-09-12T21:01:41.017280+0000, chain.objs.size()=1 2024-09-12T19:13:57.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.oq5TSpiUcEggJhDdLuhZTU3-L6GqEub_0 2024-09-12T19:13:57.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4184993103885958890', time=2024-09-12T21:01:41.019714+0000, chain.objs.size()=1 2024-09-12T19:13:57.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9V0g5i5zWQmSEtIpdcPzV-IsLjznRB5_0 2024-09-12T19:13:57.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6976976679576140429', time=2024-09-12T21:01:41.098397+0000, chain.objs.size()=1 2024-09-12T19:13:57.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.uJ-j9jufm3C34ClbOKrOyf1-W7msoZQ_0 2024-09-12T19:13:57.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18129595247477595700', time=2024-09-12T21:02:00.512240+0000, chain.objs.size()=1 2024-09-12T19:13:57.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.h-fpB8SClLc407gfPDfZj9kRlkEhjY9_0 2024-09-12T19:13:57.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10578564764976216046', time=2024-09-12T21:02:00.580598+0000, chain.objs.size()=1 2024-09-12T19:13:57.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.13RXCKUMUwbVP4qJhIRkCDQgK5pdDs__0 2024-09-12T19:13:57.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14875517987523742096', time=2024-09-12T21:02:00.583595+0000, chain.objs.size()=1 2024-09-12T19:13:57.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.POTB6vL0NUyWdasR7KsDgP5FmvhfasD_0 2024-09-12T19:13:57.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11442096182922453599', time=2024-09-12T21:02:00.595805+0000, chain.objs.size()=1 2024-09-12T19:13:57.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.B_zOBP6pFVGwREJ3gUi-9npk16ed4xW_0 2024-09-12T19:13:57.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4919978168388389060', time=2024-09-12T21:02:00.631757+0000, chain.objs.size()=1 2024-09-12T19:13:57.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.X_0wKwdCnIFBXO5QjLD74DlqPAobakH_0 2024-09-12T19:13:57.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11885731961203935218', time=2024-09-12T21:02:00.888337+0000, chain.objs.size()=1 2024-09-12T19:13:57.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.rWsAFpWEsOv3cbvfUXz_o6QXCnV34VE_0 2024-09-12T19:13:57.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13947591906607490994', time=2024-09-12T21:02:00.897020+0000, chain.objs.size()=1 2024-09-12T19:13:57.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-P_k_0K-P-VFkbPx-gHq0hA81B7-s8h_0 2024-09-12T19:13:57.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2036376261906373595', time=2024-09-12T21:02:00.898894+0000, chain.objs.size()=1 2024-09-12T19:13:57.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Uw2u97CP8RfUXrHaVuN7kua0mjKh61e_0 2024-09-12T19:13:57.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.76208279860268572', time=2024-09-12T21:02:01.108715+0000, chain.objs.size()=1 2024-09-12T19:13:57.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.uaDLNUXBjtn9_Pjdh5T4oV76wlzkojT_0 2024-09-12T19:13:57.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17457056826809191026', time=2024-09-12T21:02:01.113562+0000, chain.objs.size()=1 2024-09-12T19:13:57.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jY7FCKRc7cWEUSkiYtBa8uQC6G3OqS6_0 2024-09-12T19:13:57.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16815557093485076536', time=2024-09-12T21:02:01.231867+0000, chain.objs.size()=1 2024-09-12T19:13:57.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.nncp_j8KDc-rMdB1TbHOBOl156rPm-C_0 2024-09-12T19:13:57.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6572452450867332632', time=2024-09-12T21:02:01.248756+0000, chain.objs.size()=1 2024-09-12T19:13:57.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.AAUzLG7reNk-c-0ABwCShI6TLU3pWM7_0 2024-09-12T19:13:57.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.208+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18220521550543417670', time=2024-09-12T21:02:01.278550+0000, chain.objs.size()=1 2024-09-12T19:13:57.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.208+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.mZXBeWV3vriEzam3CSbSEYpY3X3Dxx3_0 2024-09-12T19:13:57.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15006250112026273647', time=2024-09-12T21:02:01.295846+0000, chain.objs.size()=1 2024-09-12T19:13:57.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.IZ6qCVSgkUzaPcDEI_NroHSgyO4GPXO_0 2024-09-12T19:13:57.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12114099276825401274', time=2024-09-12T21:02:01.320075+0000, chain.objs.size()=1 2024-09-12T19:13:57.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.sLogkQA7bzr3UXJW1DWWTks89eClPE6_0 2024-09-12T19:13:57.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.547697302228925637', time=2024-09-12T21:02:01.321337+0000, chain.objs.size()=1 2024-09-12T19:13:57.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yA6662LwBO5pcUxSkn0zob05WJ31BDz_0 2024-09-12T19:13:57.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.32678853700389294', time=2024-09-12T21:02:01.335032+0000, chain.objs.size()=1 2024-09-12T19:13:57.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.tFogPdPTJOEeYXXSS7H7i_elYiUQlTa_0 2024-09-12T19:13:57.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5093328141615958672', time=2024-09-12T21:02:01.352833+0000, chain.objs.size()=1 2024-09-12T19:13:57.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.myLQvm4yOAcQ3IgVNTK95Bsk_blwoSw_0 2024-09-12T19:13:57.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4768797931121229405', time=2024-09-12T21:02:01.439948+0000, chain.objs.size()=1 2024-09-12T19:13:57.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WqQC2QFFdRkymPGSwCbvvqXnQnyKQbm_0 2024-09-12T19:13:57.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1595001707111998686', time=2024-09-12T21:02:01.445647+0000, chain.objs.size()=1 2024-09-12T19:13:57.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.vkFzaekDccKrq6YxcGcz8mr8I8RWxz0_0 2024-09-12T19:13:57.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14505788950589384558', time=2024-09-12T21:02:01.476400+0000, chain.objs.size()=1 2024-09-12T19:13:57.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-xFdjzKvKmsVIByBssIIDIOHFcycgpf_0 2024-09-12T19:13:57.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.255095580858734351', time=2024-09-12T21:02:01.490579+0000, chain.objs.size()=1 2024-09-12T19:13:57.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2Q_jpq-JdxavW8LNASFCQsLxMau1fNx_0 2024-09-12T19:13:57.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9172475545965530319', time=2024-09-12T21:02:01.667170+0000, chain.objs.size()=1 2024-09-12T19:13:57.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.RtXu5P5la1X7lOxxUsUNgP9yG_cUeXd_0 2024-09-12T19:13:57.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4467653148003418806', time=2024-09-12T21:02:01.670523+0000, chain.objs.size()=1 2024-09-12T19:13:57.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NWB3saVmjOvl4KuDWvlcXMoqvT7hh8T_0 2024-09-12T19:13:57.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5614098242755618294', time=2024-09-12T21:02:01.701293+0000, chain.objs.size()=1 2024-09-12T19:13:57.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jK2wi094IsYqq5UdVyUPPH34aazdlpZ_0 2024-09-12T19:13:57.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7927950890710642949', time=2024-09-12T21:02:01.733287+0000, chain.objs.size()=1 2024-09-12T19:13:57.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.R0J_xBR_UctvPPdtveWBJhR0z1mNWJC_0 2024-09-12T19:13:57.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7110514180558097519', time=2024-09-12T21:02:01.746918+0000, chain.objs.size()=1 2024-09-12T19:13:57.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NG139z7Dn_zI6IlHOaKhH6TC2kAprLw_0 2024-09-12T19:13:57.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9723762631426913765', time=2024-09-12T21:02:01.789574+0000, chain.objs.size()=1 2024-09-12T19:13:57.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2C2wlL2oZ-7ol2FrCYYY-0Si9nJMcqc_0 2024-09-12T19:13:57.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15013039346661334724', time=2024-09-12T21:02:01.892780+0000, chain.objs.size()=1 2024-09-12T19:13:57.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.hwqZrqwBJKkdHkIV2qNk7-jeHOejPtE_0 2024-09-12T19:13:57.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15792738293346047192', time=2024-09-12T21:02:01.908962+0000, chain.objs.size()=1 2024-09-12T19:13:57.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.9hgjkGAuDnTgyGEJrFQRhaU1Gp8jhLe_0 2024-09-12T19:13:57.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7236328576267966528', time=2024-09-12T21:02:01.932168+0000, chain.objs.size()=1 2024-09-12T19:13:57.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.wluo-UveI_M0UolrnQfrnVRT812_rDK_0 2024-09-12T19:13:57.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.216+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14088006698333083973', time=2024-09-12T21:02:09.440839+0000, chain.objs.size()=1 2024-09-12T19:13:57.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.216+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.335__shadow_.PoJXsCy2-DZO8hKfeISg5lfSbyRJ8s3_0 2024-09-12T19:13:57.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.220+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48204 2024-09-12T19:13:57.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T19:13:57.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4075003671227745230', time=2024-09-12T21:02:15.985274+0000, chain.objs.size()=1 2024-09-12T19:13:57.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.345__shadow_.t3AhDnCGyr9jXFqRIlk52x_6KOZzwl7_0 2024-09-12T19:13:57.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10569163330117478592', time=2024-09-12T21:02:36.214526+0000, chain.objs.size()=1 2024-09-12T19:13:57.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.376__shadow_.GvPonmRP0v0PGUSYF03wIf0upue0sH7_0 2024-09-12T19:13:57.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6755012703495816809', time=2024-09-12T21:03:43.329867+0000, chain.objs.size()=1 2024-09-12T19:13:57.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.462__shadow_.JQZtqk7N-08I2X0nxmexM_MNMFem1zv_0 2024-09-12T19:13:57.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2638142469396545555', time=2024-09-12T21:03:45.892756+0000, chain.objs.size()=1 2024-09-12T19:13:57.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.465__shadow_.0rqj9Un3GwCODSZzLL2P2zPZyA3_IS__0 2024-09-12T19:13:57.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5370075751910846040', time=2024-09-12T21:04:13.155691+0000, chain.objs.size()=6 2024-09-12T19:13:57.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.1 2024-09-12T19:13:57.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.2 2024-09-12T19:13:57.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.3 2024-09-12T19:13:57.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.4 2024-09-12T19:13:57.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.5 2024-09-12T19:13:57.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.6 2024-09-12T19:13:57.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10217863100534173351', time=2024-09-12T21:04:29.648788+0000, chain.objs.size()=1 2024-09-12T19:13:57.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.520__shadow:OLmJ05UwC9y2YMNHhctVG55b.QY-AxG_.QDW6XAdM6aeZuPsJ8AIE1PCxy8IPvt0_0 2024-09-12T19:13:57.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13869796106364745413', time=2024-09-12T21:04:34.285780+0000, chain.objs.size()=12 2024-09-12T19:13:57.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.UyiakpRgmI8reL8ky09LiYV55HwXIfvV.1 2024-09-12T19:13:57.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__shadow_mymultipart.UyiakpRgmI8reL8ky09LiYV55HwXIfvV.1_1 2024-09-12T19:13:57.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~wLyHzl2HUoZw_Pyi4ich8GzyA6B4P8t.2 2024-09-12T19:13:57.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__shadow_mymultipart.2~wLyHzl2HUoZw_Pyi4ich8GzyA6B4P8t.2_1 2024-09-12T19:13:57.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~wLyHzl2HUoZw_Pyi4ich8GzyA6B4P8t.3 2024-09-12T19:13:57.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__shadow_mymultipart.2~wLyHzl2HUoZw_Pyi4ich8GzyA6B4P8t.3_1 2024-09-12T19:13:57.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~wLyHzl2HUoZw_Pyi4ich8GzyA6B4P8t.4 2024-09-12T19:13:57.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__shadow_mymultipart.2~wLyHzl2HUoZw_Pyi4ich8GzyA6B4P8t.4_1 2024-09-12T19:13:57.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~wLyHzl2HUoZw_Pyi4ich8GzyA6B4P8t.5 2024-09-12T19:13:57.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__shadow_mymultipart.2~wLyHzl2HUoZw_Pyi4ich8GzyA6B4P8t.5_1 2024-09-12T19:13:57.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~wLyHzl2HUoZw_Pyi4ich8GzyA6B4P8t.6 2024-09-12T19:13:57.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__shadow_mymultipart.2~wLyHzl2HUoZw_Pyi4ich8GzyA6B4P8t.6_1 2024-09-12T19:13:57.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10066222641034899466', time=2024-09-12T21:05:20.761506+0000, chain.objs.size()=1 2024-09-12T19:13:57.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.537__shadow_.tY7jJ3x4Hig9CX5Vw20bDSAZb8slYGL_0 2024-09-12T19:13:57.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13860894553776488193', time=2024-09-12T21:05:43.026320+0000, chain.objs.size()=1 2024-09-12T19:13:57.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.552__shadow_.Gxu5BSyaFg906aJ55PTb1dC29gNI0W-_0 2024-09-12T19:13:57.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7989763190828307715', time=2024-09-12T21:06:07.698472+0000, chain.objs.size()=1 2024-09-12T19:13:57.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:p5UnFL7nfiwohsbHnVg9SBaHvmfnK84_.ZywWEWpXSSdrXmgplH_rZwXjJe3DMgw_0 2024-09-12T19:13:57.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4977134603771129651', time=2024-09-12T21:06:12.315395+0000, chain.objs.size()=1 2024-09-12T19:13:57.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.570__shadow:tN8MYzxb4fJyx9kcxcRFNYsCMdap24Q_.50aNO83wDKLyUNvrDUoCqJwnkGmkQGX_0 2024-09-12T19:13:57.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.360551193380318697', time=2024-09-12T21:06:23.387253+0000, chain.objs.size()=1 2024-09-12T19:13:57.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.576__shadow:R75jlMVAtMAsLBErVey2JU2FU.Umt6l_.GfRsbCtbHR5fSsYtwKv26V6gs9NdMh__0 2024-09-12T19:13:57.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15754182014375520574', time=2024-09-12T21:06:27.892314+0000, chain.objs.size()=1 2024-09-12T19:13:57.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:JzC3xWCaWhRgRw9teLmIj2l0bDpSELu_.FTz6s8ZEBq5JPtO-7pVQD4fh6gVN72s_0 2024-09-12T19:13:57.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13743654603385841831', time=2024-09-12T21:06:48.052688+0000, chain.objs.size()=1 2024-09-12T19:13:57.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.580__shadow:SoK8CGL2RvlvMgpfgvbm16iFD-nAV-u_.-memFDaAcDg4Rj0OinoQ_ucRnRnl_Rk_0 2024-09-12T19:13:57.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13319186063371212889', time=2024-09-12T21:06:48.077259+0000, chain.objs.size()=1 2024-09-12T19:13:57.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.580__shadow:9q6P91zd0JX3R5WE-b9cYVX.o6oWBac_.8AuNbFOcdSZcUECMAZYdK6jU2NPYud5_0 2024-09-12T19:13:57.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3648247332407870091', time=2024-09-12T21:10:39.695282+0000, chain.objs.size()=1 2024-09-12T19:13:57.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.713__shadow:MY5QoLx0v894OV4RGvasdhUJojR4jGk_.0CTvll_H18n6ixgVPhly2azTueRXRuk_0 2024-09-12T19:13:57.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12838491625690200916', time=2024-09-12T21:10:50.888236+0000, chain.objs.size()=1 2024-09-12T19:13:57.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.715__shadow:FYRP3b0RVCPqGE0m8HW9hQkpCBH6GR9_.DMbrEhDG5JmL2XR85KXNFbQfTdgZYbF_0 2024-09-12T19:13:57.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.240+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T19:13:57.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47428' 2024-09-12T19:13:57.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10853949824888615844', time=2024-09-12T20:57:24.424515+0000, chain.objs.size()=1 2024-09-12T19:13:57.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.148__shadow_.Xap_oon4l9aFYf1ds1eJUdpYpjfRd92_0 2024-09-12T19:13:57.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11457357268190095702', time=2024-09-12T20:57:30.371369+0000, chain.objs.size()=3 2024-09-12T19:13:57.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.158__shadow_.ByO8Os7GA67C43vkc3yQxNp8WqCHmhr_0 2024-09-12T19:13:57.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.158__shadow_.ByO8Os7GA67C43vkc3yQxNp8WqCHmhr_1 2024-09-12T19:13:57.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.158__shadow_.ByO8Os7GA67C43vkc3yQxNp8WqCHmhr_2 2024-09-12T19:13:57.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16185234352689358448', time=2024-09-12T20:57:56.552700+0000, chain.objs.size()=1 2024-09-12T19:13:57.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.178__shadow_.q2p4f4IHImlakXpW-BrIG8Rf1iUPxQn_0 2024-09-12T19:13:57.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14949958681236050062', time=2024-09-12T20:58:21.986696+0000, chain.objs.size()=1 2024-09-12T19:13:57.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.203__shadow_.pECMMrqNm3LH70FZBM2kckX0kWO6F6Z_0 2024-09-12T19:13:57.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8750966031792771772', time=2024-09-12T21:00:00.765425+0000, chain.objs.size()=1 2024-09-12T19:13:57.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.245__shadow_.llP3w6LYgE0DPNQO6fiw9FWYbEmv06N_0 2024-09-12T19:13:57.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16897443894976025119', time=2024-09-12T21:00:09.556268+0000, chain.objs.size()=1 2024-09-12T19:13:57.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.257__shadow_.VplTm58lGJbT7ET8RTM2XDIdwdfTCWP_0 2024-09-12T19:13:57.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.942388351850372177', time=2024-09-12T21:00:10.246709+0000, chain.objs.size()=1 2024-09-12T19:13:57.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.258__shadow_.tv-LteQ44xi5fm1vY__MZYxvThAF1Vk_0 2024-09-12T19:13:57.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.234999812788447669', time=2024-09-12T21:00:32.050667+0000, chain.objs.size()=1 2024-09-12T19:13:57.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CPrclShH6_UksmZKypZgY-lFWaZVYpK_0 2024-09-12T19:13:57.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9475460915214217159', time=2024-09-12T21:00:32.064308+0000, chain.objs.size()=1 2024-09-12T19:13:57.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3MzBZ0CWCcCMwLdJWC2aSPbfab7qKFi_0 2024-09-12T19:13:57.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3355586730870275257', time=2024-09-12T21:00:32.068476+0000, chain.objs.size()=1 2024-09-12T19:13:57.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.9B_0sQCz3-QKnRmA0OFngkOimdIAj9j_0 2024-09-12T19:13:57.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4877518287649173226', time=2024-09-12T21:00:32.083784+0000, chain.objs.size()=1 2024-09-12T19:13:57.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LIlruygnYvSn3AFZX8wJtWRy_eIoPf-_0 2024-09-12T19:13:57.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2151410020656471406', time=2024-09-12T21:00:32.241507+0000, chain.objs.size()=1 2024-09-12T19:13:57.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LMzvh-jPdvB-2Yoefa9SPeSAICWZWtw_0 2024-09-12T19:13:57.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8190486873439331102', time=2024-09-12T21:00:32.290954+0000, chain.objs.size()=1 2024-09-12T19:13:57.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.YPIIaHhOzDiHQfV1dKsCPauygTUyLae_0 2024-09-12T19:13:57.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12440424926548966557', time=2024-09-12T21:00:32.478737+0000, chain.objs.size()=1 2024-09-12T19:13:57.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SrXbYE7F2PSytlPiFdfb9UoqKJunHdk_0 2024-09-12T19:13:57.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18434479810292004797', time=2024-09-12T21:00:32.500097+0000, chain.objs.size()=1 2024-09-12T19:13:57.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Ivwh3YPHe_rFkhA5VkW28VnJy2dfaOZ_0 2024-09-12T19:13:57.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17291524103126085368', time=2024-09-12T21:00:32.508835+0000, chain.objs.size()=1 2024-09-12T19:13:57.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.pCxZTgJ9f0iU7PkySg3xO39aqiUPNtB_0 2024-09-12T19:13:57.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12052144756342736130', time=2024-09-12T21:00:32.538198+0000, chain.objs.size()=1 2024-09-12T19:13:57.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.OCnDBW5nbi8JVV1kbWI5DXBt-tLxepc_0 2024-09-12T19:13:57.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12281529665053906654', time=2024-09-12T21:00:32.686706+0000, chain.objs.size()=1 2024-09-12T19:13:57.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.248+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.EYaw-xkgiFgceWxc6kkhxKyL44PyWGw_0 2024-09-12T19:13:57.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9670901173327920281', time=2024-09-12T21:00:32.688010+0000, chain.objs.size()=1 2024-09-12T19:13:57.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.9qwja87m-t8o4lKXIM0cKKP1VHA18Kd_0 2024-09-12T19:13:57.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6493086477750786182', time=2024-09-12T21:00:32.710973+0000, chain.objs.size()=1 2024-09-12T19:13:57.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Cw9kGEoEF-8V8W3h-4tEs9jEhw17E1T_0 2024-09-12T19:13:57.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6268543488918786847', time=2024-09-12T21:00:32.759584+0000, chain.objs.size()=1 2024-09-12T19:13:57.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.QrRIWa6ohCialq9JY1XlvaIv8O4FQBr_0 2024-09-12T19:13:57.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4110524793317842150', time=2024-09-12T21:00:32.896697+0000, chain.objs.size()=1 2024-09-12T19:13:57.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.S9nHAQnLMKeFBYfTr9r2_K-iIpfucrc_0 2024-09-12T19:13:57.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12020880811233412611', time=2024-09-12T21:00:32.898040+0000, chain.objs.size()=1 2024-09-12T19:13:57.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.usE6hJsIQnjJWATrrsva02V0jMFAxOM_0 2024-09-12T19:13:57.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12445191284477181682', time=2024-09-12T21:00:32.902093+0000, chain.objs.size()=1 2024-09-12T19:13:57.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XkuZg9KnVJmItDsHzkTHSdAri7piHPX_0 2024-09-12T19:13:57.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7475009048065541606', time=2024-09-12T21:00:32.954693+0000, chain.objs.size()=1 2024-09-12T19:13:57.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Je3zdARDC0rllPO6F02szUX0GGefAs0_0 2024-09-12T19:13:57.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17119886544612355145', time=2024-09-12T21:00:32.958050+0000, chain.objs.size()=1 2024-09-12T19:13:57.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.yuQZvFHS-QAEbgd2jUzZKjn32Mk8Dfz_0 2024-09-12T19:13:57.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18429874916480349383', time=2024-09-12T21:00:32.970030+0000, chain.objs.size()=1 2024-09-12T19:13:57.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.weZnfWuRAIcDcTWkCOokbPj2NS2eBQb_0 2024-09-12T19:13:57.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1405149812117457276', time=2024-09-12T21:00:33.100808+0000, chain.objs.size()=1 2024-09-12T19:13:57.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JWWohy5SgSSwPqFnYiuFx9Uai3JWHae_0 2024-09-12T19:13:57.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10157926440197279145', time=2024-09-12T21:00:33.125698+0000, chain.objs.size()=1 2024-09-12T19:13:57.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.dkHtW_MyuzIbqqypJyhbVNQObDctWrU_0 2024-09-12T19:13:57.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3523570510638048272', time=2024-09-12T21:00:33.172383+0000, chain.objs.size()=1 2024-09-12T19:13:57.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.gnQXnV6jRqZ69LIrDg1NhGnDyC5onbg_0 2024-09-12T19:13:57.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4824139964846133990', time=2024-09-12T21:00:33.191608+0000, chain.objs.size()=1 2024-09-12T19:13:57.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.wneYrWtidfFgNRh88ASfWy8pfJX-Pzc_0 2024-09-12T19:13:57.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13843725098673654551', time=2024-09-12T21:00:33.192505+0000, chain.objs.size()=1 2024-09-12T19:13:57.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2Ap-rHSd3VghQxf4jta2waXDWmb0LNt_0 2024-09-12T19:13:57.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1970048084018347524', time=2024-09-12T21:00:33.199313+0000, chain.objs.size()=1 2024-09-12T19:13:57.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.MkewLhtSOdXbYtYxUGJoQe_Jcmk7N98_0 2024-09-12T19:13:57.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3698794646166076780', time=2024-09-12T21:00:33.368795+0000, chain.objs.size()=1 2024-09-12T19:13:57.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.6bLxDueKOqk9DRatoeQ48FopQ7pdRma_0 2024-09-12T19:13:57.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18353370719647642417', time=2024-09-12T21:00:33.404337+0000, chain.objs.size()=1 2024-09-12T19:13:57.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.FlBaEcayMZZHMI1ybIGDIPA1d4wgBSr_0 2024-09-12T19:13:57.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18074349404592981891', time=2024-09-12T21:00:33.431212+0000, chain.objs.size()=1 2024-09-12T19:13:57.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.EtGAjUJpkrzOXv1OSfcBkRsmCk4JO7L_0 2024-09-12T19:13:57.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12512151098083480443', time=2024-09-12T21:00:33.493202+0000, chain.objs.size()=1 2024-09-12T19:13:57.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CxIyUgup1BBmEduh9SkpCbbXvm-XffH_0 2024-09-12T19:13:57.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5043669843652850788', time=2024-09-12T21:00:33.601722+0000, chain.objs.size()=1 2024-09-12T19:13:57.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.KqwxTbVtKedFX7s3lmit8ojdhf3npbU_0 2024-09-12T19:13:57.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17376880058454045843', time=2024-09-12T21:00:33.623464+0000, chain.objs.size()=1 2024-09-12T19:13:57.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.4pg7xRk4V9rdWu9wjdIyZEmS4MoE7hn_0 2024-09-12T19:13:57.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1661120559540852229', time=2024-09-12T21:00:33.624678+0000, chain.objs.size()=1 2024-09-12T19:13:57.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.AEfbigTSy8EDPNdbgm2StA9U_YyoIBd_0 2024-09-12T19:13:57.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1798378317292823207', time=2024-09-12T21:00:38.898084+0000, chain.objs.size()=1 2024-09-12T19:13:57.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.269__shadow_.eqRPxrFbukhxr4sd32wo99b_rpCoFB1_0 2024-09-12T19:13:57.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9943543744164143386', time=2024-09-12T21:00:44.740409+0000, chain.objs.size()=1 2024-09-12T19:13:57.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.277__shadow_.2pnpPP0RoUFDMrM-TUlANXn0YsSWQ2y_0 2024-09-12T19:13:57.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2224612822092570740', time=2024-09-12T21:00:49.119268+0000, chain.objs.size()=1 2024-09-12T19:13:57.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.283__shadow_.Wmuut6bHaFJaW-5MRHAIOYSdAD2BHLm_0 2024-09-12T19:13:57.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4077518190245816449', time=2024-09-12T21:00:56.704029+0000, chain.objs.size()=1 2024-09-12T19:13:57.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.-c3P71myioAy8fCVK6Dupt1LnNEMN70_0 2024-09-12T19:13:57.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10670586235290639815', time=2024-09-12T21:00:56.748472+0000, chain.objs.size()=1 2024-09-12T19:13:57.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.ACsdIOayb-DQ8us9ygHfk3vw-AOnor2_0 2024-09-12T19:13:57.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12559349734927588993', time=2024-09-12T21:00:58.119749+0000, chain.objs.size()=1 2024-09-12T19:13:57.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.greM2aaRI2IqF-REjcsMRXsfFneDb60_0 2024-09-12T19:13:57.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.739878421312434808', time=2024-09-12T21:00:59.586438+0000, chain.objs.size()=1 2024-09-12T19:13:57.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.295__shadow_.w-s_itLIULQuBUcZePkVm3FYy3xAosz_0 2024-09-12T19:13:57.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13007819115819004138', time=2024-09-12T21:01:07.007877+0000, chain.objs.size()=1 2024-09-12T19:13:57.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.305__shadow_.UBeemZ8wgmT78eqNXvNYxVOGbPa-4uV_0 2024-09-12T19:13:57.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7705084644462441414', time=2024-09-12T21:01:07.009627+0000, chain.objs.size()=1 2024-09-12T19:13:57.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.305__shadow_.vQwpIOyz0bXc9hhrwkcZKeepKWOQbux_0 2024-09-12T19:13:57.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17055497216033433236', time=2024-09-12T21:01:39.432572+0000, chain.objs.size()=1 2024-09-12T19:13:57.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ARIN340g0q0gpIR3VHXhd74yr-_ukXG_0 2024-09-12T19:13:57.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7736013856528638564', time=2024-09-12T21:01:39.447343+0000, chain.objs.size()=1 2024-09-12T19:13:57.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.foiI-SCgwJ7pSzWDci5-b8VifsbQQOM_0 2024-09-12T19:13:57.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6947965078039567271', time=2024-09-12T21:01:39.469719+0000, chain.objs.size()=1 2024-09-12T19:13:57.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Tj9nZNWybL8BOuvgaGLo7TLFsbSIZEe_0 2024-09-12T19:13:57.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1448722235531423326', time=2024-09-12T21:01:39.490052+0000, chain.objs.size()=1 2024-09-12T19:13:57.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.4ns-T-ZQPNWkEPhjevJ5dXNdKIjiq1m_0 2024-09-12T19:13:57.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4327425790117363667', time=2024-09-12T21:01:39.512982+0000, chain.objs.size()=1 2024-09-12T19:13:57.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.aVleTVAOIzzDY-TdhYhcQxP6B_bMxoC_0 2024-09-12T19:13:57.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12398402564667075837', time=2024-09-12T21:01:39.520327+0000, chain.objs.size()=1 2024-09-12T19:13:57.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.d2lSMiEa6Rwpzib-szYaJgePY6Igsh-_0 2024-09-12T19:13:57.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7845033084989644107', time=2024-09-12T21:01:39.670238+0000, chain.objs.size()=1 2024-09-12T19:13:57.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.5XQuGSfi6wyVgc5DGxAg_RniBGRnTUM_0 2024-09-12T19:13:57.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16756136310002036508', time=2024-09-12T21:01:39.721770+0000, chain.objs.size()=1 2024-09-12T19:13:57.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.SeG9SNgrBj2-fPDP_43iDFiTSgsGBTn_0 2024-09-12T19:13:57.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9581327344572477211', time=2024-09-12T21:01:39.767888+0000, chain.objs.size()=1 2024-09-12T19:13:57.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.WQYmu8TEwT4ah2ecLQJI1iWi83j92x5_0 2024-09-12T19:13:57.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8708598708323080238', time=2024-09-12T21:01:39.785210+0000, chain.objs.size()=1 2024-09-12T19:13:57.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.syTgodt11VEJUjWw49WI68i8UuAdjmR_0 2024-09-12T19:13:57.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17992689370559885102', time=2024-09-12T21:01:39.923180+0000, chain.objs.size()=1 2024-09-12T19:13:57.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.5yFIcq97X8XfR7COAsA1u9z8ebZ4swc_0 2024-09-12T19:13:57.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5438606397673601547', time=2024-09-12T21:01:39.933926+0000, chain.objs.size()=1 2024-09-12T19:13:57.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.YnpqwZI3Fn9lSdsJvQ2dU7RNPLGK84K_0 2024-09-12T19:13:57.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17519000908292137331', time=2024-09-12T21:01:40.132613+0000, chain.objs.size()=1 2024-09-12T19:13:57.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.UsHFLb8EvHjsoS3bPpVZTuelDJCzc4n_0 2024-09-12T19:13:57.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10382497322912679303', time=2024-09-12T21:01:40.199615+0000, chain.objs.size()=1 2024-09-12T19:13:57.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.quHhzMEfupIwOFaj8OmTPj8zSkimwJw_0 2024-09-12T19:13:57.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8986477484416663044', time=2024-09-12T21:01:40.230545+0000, chain.objs.size()=1 2024-09-12T19:13:57.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ulduSvXWxLKWYH22yar8w8Ve61KYsXR_0 2024-09-12T19:13:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3906389348819413296', time=2024-09-12T21:01:40.356079+0000, chain.objs.size()=1 2024-09-12T19:13:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.8rAuE0mEHS_q26lQoyh15Xf3-mjD844_0 2024-09-12T19:13:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6396997282945569478', time=2024-09-12T21:01:40.377466+0000, chain.objs.size()=1 2024-09-12T19:13:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.r7cZMu6nmcm_8_EoAvO6DrQqeSN2MEH_0 2024-09-12T19:13:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16570365527016128841', time=2024-09-12T21:01:40.410773+0000, chain.objs.size()=1 2024-09-12T19:13:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.SPgv_TdlZVanYpdJ3T9dj4H_RG009yV_0 2024-09-12T19:13:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2668334148202114873', time=2024-09-12T21:01:40.456886+0000, chain.objs.size()=1 2024-09-12T19:13:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mY7pdgEuwQ3j5wclj7f7Ns9idDlY24u_0 2024-09-12T19:13:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.492153205891380570', time=2024-09-12T21:01:40.461731+0000, chain.objs.size()=1 2024-09-12T19:13:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ARRwrHizJ3ueaMFwcDLZL02fv8oziHP_0 2024-09-12T19:13:57.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17397165055674265879', time=2024-09-12T21:01:40.552544+0000, chain.objs.size()=1 2024-09-12T19:13:57.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.OC41BI4h9XUDdp10ic0YcZ0tKaXWQL4_0 2024-09-12T19:13:57.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1577012046423614877', time=2024-09-12T21:01:40.570210+0000, chain.objs.size()=1 2024-09-12T19:13:57.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.GxilqKupFdtWNh1BNrU5OZa7HZf06J-_0 2024-09-12T19:13:57.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13027014297361768057', time=2024-09-12T21:01:40.592945+0000, chain.objs.size()=1 2024-09-12T19:13:57.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9R_CZkwi0EX_BJiXgeF9vXM0ZaOuFEG_0 2024-09-12T19:13:57.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15636753528477620790', time=2024-09-12T21:01:40.627112+0000, chain.objs.size()=1 2024-09-12T19:13:57.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.OK07JWjcTY0CQMSts4rDdij9YazM51G_0 2024-09-12T19:13:57.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.562494830196250001', time=2024-09-12T21:01:40.665892+0000, chain.objs.size()=1 2024-09-12T19:13:57.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BZwQudS730kPSWJPKAlTA6RA883N6IO_0 2024-09-12T19:13:57.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3956321590530324478', time=2024-09-12T21:01:40.773187+0000, chain.objs.size()=1 2024-09-12T19:13:57.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.S78sswJULRYJYi24WDVYwY83Z8Qm5D-_0 2024-09-12T19:13:57.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1875819848680804672', time=2024-09-12T21:01:40.791724+0000, chain.objs.size()=1 2024-09-12T19:13:57.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.78qRdD8ezFqap3xwfjtLSOzb2OwbNNh_0 2024-09-12T19:13:57.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17015832122448942810', time=2024-09-12T21:01:40.823020+0000, chain.objs.size()=1 2024-09-12T19:13:57.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.w5hA2TiFuCSHhUeD2RU9gxMKkzLv8jV_0 2024-09-12T19:13:57.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16348577718987983429', time=2024-09-12T21:01:40.878722+0000, chain.objs.size()=1 2024-09-12T19:13:57.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.NYh9n6BKuCHbg5dyDyUc6xpG_ccKyg3_0 2024-09-12T19:13:57.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12230082320970794529', time=2024-09-12T21:01:40.893637+0000, chain.objs.size()=1 2024-09-12T19:13:57.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.HnljGmTo4crYDyqdyMR70R7xeqrbZMR_0 2024-09-12T19:13:57.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11121091760146682740', time=2024-09-12T21:01:41.059608+0000, chain.objs.size()=1 2024-09-12T19:13:57.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.5AiMOpIiAd23pnDYQyeESAG2mFeai6t_0 2024-09-12T19:13:57.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7351966699628084382', time=2024-09-12T21:02:00.563959+0000, chain.objs.size()=1 2024-09-12T19:13:57.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._cmznty2rjBLS6OdbJ4Mlnr4nHCvnuX_0 2024-09-12T19:13:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15465736301239761859', time=2024-09-12T21:02:00.585952+0000, chain.objs.size()=1 2024-09-12T19:13:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.PCTmP22ugwTL7egYZeNBqzQTo2k7qj7_0 2024-09-12T19:13:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8617994435835205142', time=2024-09-12T21:02:00.611817+0000, chain.objs.size()=1 2024-09-12T19:13:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.gFwI910vsU5keSjFG9CyP7mTJzer3du_0 2024-09-12T19:13:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8411695588642787375', time=2024-09-12T21:02:00.615412+0000, chain.objs.size()=1 2024-09-12T19:13:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.bxog3w_gtBtW8dG1M1iiNugf8t6k6yL_0 2024-09-12T19:13:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1983009666603291386', time=2024-09-12T21:02:00.647973+0000, chain.objs.size()=1 2024-09-12T19:13:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.d_MmXXdAtOPJ4MeiHzBCbEHBv9nC9a-_0 2024-09-12T19:13:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17430290065478785447', time=2024-09-12T21:02:00.651475+0000, chain.objs.size()=1 2024-09-12T19:13:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.lE8c4eoKcFm9O2v0aSA7DxLCwuirVJ2_0 2024-09-12T19:13:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17621029485903094474', time=2024-09-12T21:02:00.817712+0000, chain.objs.size()=1 2024-09-12T19:13:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.gHnYqm5X0wj8GwiB_HPQ9jXf-N3t9FE_0 2024-09-12T19:13:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9553278521176562502', time=2024-09-12T21:02:00.829142+0000, chain.objs.size()=1 2024-09-12T19:13:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.gcAXsubMV1Exkj-90GhO2fLlRn0_NFN_0 2024-09-12T19:13:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9616728891689850638', time=2024-09-12T21:02:00.852164+0000, chain.objs.size()=1 2024-09-12T19:13:57.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.FzA2I5fb7PycRbkP2ZAaTDTv0OXSl4l_0 2024-09-12T19:13:57.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16167924710904436613', time=2024-09-12T21:02:00.856377+0000, chain.objs.size()=1 2024-09-12T19:13:57.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.nQGbwyQOLLUHZHl9Ga8U-rUz426wg39_0 2024-09-12T19:13:57.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3228938873054542906', time=2024-09-12T21:02:00.992277+0000, chain.objs.size()=1 2024-09-12T19:13:57.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.RiHRiVkf73FsedTUJbW9Bm8nMMVitDv_0 2024-09-12T19:13:57.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5593562892080071165', time=2024-09-12T21:02:01.298906+0000, chain.objs.size()=1 2024-09-12T19:13:57.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.t_zBvHpiSLsp8eRlYz7SMFNQsm6rJFj_0 2024-09-12T19:13:57.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15630205636385986018', time=2024-09-12T21:02:01.303977+0000, chain.objs.size()=1 2024-09-12T19:13:57.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.BVCnnW7dqZhbpyo77RphIhWwcz76pfQ_0 2024-09-12T19:13:57.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3324118914952929830', time=2024-09-12T21:02:01.342328+0000, chain.objs.size()=1 2024-09-12T19:13:57.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0El_txRwl6ZgAhChMQ8HwYTRsPTnCBH_0 2024-09-12T19:13:57.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16386375638238505827', time=2024-09-12T21:02:01.345185+0000, chain.objs.size()=1 2024-09-12T19:13:57.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.BuW60_HUOtLMgGYuJpdWOhahLgb9iFE_0 2024-09-12T19:13:57.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16828151496442549652', time=2024-09-12T21:02:01.455885+0000, chain.objs.size()=1 2024-09-12T19:13:57.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.AURocsIwrMez-fzM91G3cpfcfX35tLF_0 2024-09-12T19:13:57.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10096414519558010913', time=2024-09-12T21:02:01.507051+0000, chain.objs.size()=1 2024-09-12T19:13:57.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.cdzx0ORlcfN91kchTBXknclPK3dQPkW_0 2024-09-12T19:13:57.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12361359178290767219', time=2024-09-12T21:02:01.531136+0000, chain.objs.size()=1 2024-09-12T19:13:57.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.aw0GEswaV35DCdKwQFHFfoP3QG27NUw_0 2024-09-12T19:13:57.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16995096702041175583', time=2024-09-12T21:02:01.545478+0000, chain.objs.size()=1 2024-09-12T19:13:57.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.pPNVbZyCDhNQRmhWgH1krINyeAKy96F_0 2024-09-12T19:13:57.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17802878905144082968', time=2024-09-12T21:02:01.728360+0000, chain.objs.size()=1 2024-09-12T19:13:57.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7_ftMGlWeKmOYPwWIM04wU4YB21zhhs_0 2024-09-12T19:13:57.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47428 2024-09-12T19:13:57.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T19:13:57.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11456970799713556110', time=2024-09-12T21:02:01.776837+0000, chain.objs.size()=1 2024-09-12T19:13:57.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WSdu6cZatZMn0D09c60LAagdDpwhk_B_0 2024-09-12T19:13:57.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9656129808358614816', time=2024-09-12T21:02:01.782257+0000, chain.objs.size()=1 2024-09-12T19:13:57.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.YTzpBUL0oxYCpzvChPNISsQqS0zDfj-_0 2024-09-12T19:13:57.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6185592250910735701', time=2024-09-12T21:02:01.889628+0000, chain.objs.size()=1 2024-09-12T19:13:57.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.O8EnKoGCHqR5SLw0O3792lU0NPzwspM_0 2024-09-12T19:13:57.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7703314646671472089', time=2024-09-12T21:02:01.907366+0000, chain.objs.size()=1 2024-09-12T19:13:57.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.lGkYtOhw8vc7yln8ZyweI751a8zVq7y_0 2024-09-12T19:13:57.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12924365603224968116', time=2024-09-12T21:02:01.955830+0000, chain.objs.size()=1 2024-09-12T19:13:57.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.c3ekqGIDZlpAbqD21Wc24FG2j0nxO5c_0 2024-09-12T19:13:57.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6334404424395717831', time=2024-09-12T21:02:01.977242+0000, chain.objs.size()=1 2024-09-12T19:13:57.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0XsodzhZ2n_BYi74fr_iLZWrjcdpZ_-_0 2024-09-12T19:13:57.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2321296911030809757', time=2024-09-12T21:02:01.985339+0000, chain.objs.size()=1 2024-09-12T19:13:57.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7ARM3edXBjncdHTt8RvPo3JlhD_WxM-_0 2024-09-12T19:13:57.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3908573988145381926', time=2024-09-12T21:02:02.000975+0000, chain.objs.size()=1 2024-09-12T19:13:57.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.IKZinBbnM8aH6WCPt_k2nQBUcWrAdNG_0 2024-09-12T19:13:57.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8326762845524134128', time=2024-09-12T21:02:02.004879+0000, chain.objs.size()=1 2024-09-12T19:13:57.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5Rxoz4xCQpxRcJUzTAvf5sWYJz59Rez_0 2024-09-12T19:13:57.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.961017619778727018', time=2024-09-12T21:02:02.194207+0000, chain.objs.size()=1 2024-09-12T19:13:57.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.MniHoXzzv5oxiAHbjubDYvA_IHAZ8WC_0 2024-09-12T19:13:57.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11250024253499477213', time=2024-09-12T21:02:46.583506+0000, chain.objs.size()=1 2024-09-12T19:13:57.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.390__shadow_.8YZjprRLGGkc1dq-HXrKcfrhOZlbNz__0 2024-09-12T19:13:57.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12965136139847711140', time=2024-09-12T21:03:01.628358+0000, chain.objs.size()=1 2024-09-12T19:13:57.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.410__shadow_.mGaFsqJfl0GWK-Z2o-6NsS9gD-Smbxo_0 2024-09-12T19:13:57.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11267517802928176256', time=2024-09-12T21:03:19.187984+0000, chain.objs.size()=1 2024-09-12T19:13:57.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.434__shadow_.J1FaLXlUlV-ffXXyLTCi316QxB-Kn6x_0 2024-09-12T19:13:57.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8529014442495061056', time=2024-09-12T21:03:21.592126+0000, chain.objs.size()=1 2024-09-12T19:13:57.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.437__shadow_.E3o7bySJY6Mjnphgw1S1H6-RVtcOvKg_0 2024-09-12T19:13:57.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.866793692327076078', time=2024-09-12T21:03:37.052806+0000, chain.objs.size()=1 2024-09-12T19:13:57.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.456__shadow_.IsVruWo__A67DtX6fn3E8QYYwdZDl9Z_0 2024-09-12T19:13:57.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11916250953438582596', time=2024-09-12T21:03:58.068980+0000, chain.objs.size()=1 2024-09-12T19:13:57.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.486__shadow_.kSPHoTaXmEH-GG-1KyCLl0PQSKt4aCx_0 2024-09-12T19:13:57.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12238945091848387828', time=2024-09-12T21:04:01.990932+0000, chain.objs.size()=1 2024-09-12T19:13:57.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.491__shadow_.cenkekWPCvAs8zojO4hOR6P-aZLeGRN_0 2024-09-12T19:13:57.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9948938138599888779', time=2024-09-12T21:04:21.532385+0000, chain.objs.size()=1 2024-09-12T19:13:57.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.517__shadow_.twQDwXHFlaWWmwarzIqCaM_NowKzJJI_0 2024-09-12T19:13:57.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16064115131710188973', time=2024-09-12T21:05:51.165822+0000, chain.objs.size()=1 2024-09-12T19:13:57.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.559__shadow_.mnXIC-Ca4ORfLYvPN0fkhlgTSx75Drm_0 2024-09-12T19:13:57.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3865086515554352456', time=2024-09-12T21:06:16.617081+0000, chain.objs.size()=1 2024-09-12T19:13:57.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.574__shadow_.Ec6IsB5sHYlxpQLJs86eCDjDCihwohH_0 2024-09-12T19:13:57.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2651991620361282900', time=2024-09-12T21:09:38.645489+0000, chain.objs.size()=1 2024-09-12T19:13:57.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.629__shadow_.2wBoiI7OLzQTMzz0DUMInzyghWUdOlk_0 2024-09-12T19:13:57.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12967623703440096303', time=2024-09-12T21:09:51.281605+0000, chain.objs.size()=2 2024-09-12T19:13:57.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.646__shadow_.r7MMw-KiLyjPG0RGehxyzds_3pM84uF_0 2024-09-12T19:13:57.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.646__shadow_.r7MMw-KiLyjPG0RGehxyzds_3pM84uF_1 2024-09-12T19:13:57.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.284+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18158906582094895427', time=2024-09-12T21:10:10.334869+0000, chain.objs.size()=1 2024-09-12T19:13:57.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.284+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.668__shadow_.WLidjNNXGoEPgsrwYnZ3zdAtShQYsfC_0 2024-09-12T19:13:57.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.284+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.288+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T19:13:57.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50390' 2024-09-12T19:13:57.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_GyJ6Q8wO6J1kzEQSy9F49cwaOUCTeo_', time=2024-09-12T20:57:35.526618+0000, chain.objs.size()=3 2024-09-12T19:13:57.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_.upQq8EVJCrMz4nKJdC4EsED1ZBsIESw_0 2024-09-12T19:13:57.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_.upQq8EVJCrMz4nKJdC4EsED1ZBsIESw_1 2024-09-12T19:13:57.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_.upQq8EVJCrMz4nKJdC4EsED1ZBsIESw_2 2024-09-12T19:13:57.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4071954888456924441', time=2024-09-12T20:59:47.040099+0000, chain.objs.size()=1 2024-09-12T19:13:57.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.228__shadow_.HiWVy_YGY1wTQ-A92ogwO_RJ4uUUCoy_0 2024-09-12T19:13:57.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17542901699270318717', time=2024-09-12T20:59:52.374660+0000, chain.objs.size()=1 2024-09-12T19:13:57.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.236__shadow_.lScRj1Iqxp_w_C8JcqqjVcypcobZjbF_0 2024-09-12T19:13:57.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4795075882693490418', time=2024-09-12T20:59:56.925058+0000, chain.objs.size()=1 2024-09-12T19:13:57.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.241__shadow_.OS7PxyDyugKD0tU2-0vK2EHDC6F2JGJ_0 2024-09-12T19:13:57.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16498798944830279197', time=2024-09-12T20:59:57.651699+0000, chain.objs.size()=1 2024-09-12T19:13:57.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.242__shadow_.2WHIicY8t-JE0qGYqdERq1zbjsSjiPq_0 2024-09-12T19:13:57.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7172864773139344877', time=2024-09-12T21:00:02.968361+0000, chain.objs.size()=1 2024-09-12T19:13:57.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.248__shadow_.6KbNN7T8BQor0v2iBAvajT3yNXJ7bGL_0 2024-09-12T19:13:57.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12740289460091633551', time=2024-09-12T21:00:05.891891+0000, chain.objs.size()=1 2024-09-12T19:13:57.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.252__shadow_.mE3aSzRLsUAIS1PJLoZ_SXVltqEmuCy_0 2024-09-12T19:13:57.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4140915717215457614', time=2024-09-12T21:00:31.996621+0000, chain.objs.size()=1 2024-09-12T19:13:57.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.noqy07kMO4WIs0jwwCQ6uRAcQBbDerb_0 2024-09-12T19:13:57.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13294263689247502167', time=2024-09-12T21:00:32.004621+0000, chain.objs.size()=1 2024-09-12T19:13:57.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.mWebMeo-XML_jFJcnypzU4UaGu60Ve3_0 2024-09-12T19:13:57.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17636726719922772677', time=2024-09-12T21:00:32.012684+0000, chain.objs.size()=1 2024-09-12T19:13:57.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sXjw1loC5XHkUfboEJI_b8JkIvV_UJC_0 2024-09-12T19:13:57.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13868056229415129866', time=2024-09-12T21:00:32.120620+0000, chain.objs.size()=1 2024-09-12T19:13:57.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.PUeOVf5WXfUOOf3-B3bIR-vOb0NMlyq_0 2024-09-12T19:13:57.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1204346375634610375', time=2024-09-12T21:00:32.229461+0000, chain.objs.size()=1 2024-09-12T19:13:57.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CHwJuNvOtWHUHcpX_PS1dIL9nRGz0lR_0 2024-09-12T19:13:57.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14851746330042834118', time=2024-09-12T21:00:32.306331+0000, chain.objs.size()=1 2024-09-12T19:13:57.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.bgmbx0bf8wKxn8YHp_So9uwIh_gnk0x_0 2024-09-12T19:13:57.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1385825069724863414', time=2024-09-12T21:00:32.321663+0000, chain.objs.size()=1 2024-09-12T19:13:57.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2mHGSSfsafk2pN0rTtB371NixNdBJne_0 2024-09-12T19:13:57.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2175881627992579263', time=2024-09-12T21:00:32.328230+0000, chain.objs.size()=1 2024-09-12T19:13:57.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.0HN10Wbtfwe68qBAaeBDXNldzZ7i2Sm_0 2024-09-12T19:13:57.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5823776194796035951', time=2024-09-12T21:00:32.329384+0000, chain.objs.size()=1 2024-09-12T19:13:57.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.UFwqYqLCTYxNT9akLqvdop0wkf8qYYY_0 2024-09-12T19:13:57.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9357836886515069007', time=2024-09-12T21:00:32.347238+0000, chain.objs.size()=1 2024-09-12T19:13:57.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.QkVT-XiO_p4zHq1X5x3StspUblUCsaH_0 2024-09-12T19:13:57.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13342003610023324338', time=2024-09-12T21:00:32.525621+0000, chain.objs.size()=1 2024-09-12T19:13:57.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.zW6XJ-SqxZWrnMXgivPSGRGvD-VFMg__0 2024-09-12T19:13:57.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14158245785933824013', time=2024-09-12T21:00:32.561125+0000, chain.objs.size()=1 2024-09-12T19:13:57.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.kYwhx3N7lAfUFgmntr2NlQs-YV-_Thz_0 2024-09-12T19:13:57.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12446054637641850331', time=2024-09-12T21:00:32.662915+0000, chain.objs.size()=1 2024-09-12T19:13:57.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.8tle5gFCfmPAEZJ9Q4r5ZTFEe-hUAcN_0 2024-09-12T19:13:57.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16780754774156639576', time=2024-09-12T21:00:32.686305+0000, chain.objs.size()=1 2024-09-12T19:13:57.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.KKhfcxYBQn660esOvKVPD0_w4rlcdEf_0 2024-09-12T19:13:57.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4020690734752488640', time=2024-09-12T21:00:32.721979+0000, chain.objs.size()=1 2024-09-12T19:13:57.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ILpHQv0XPMwkwVS2ydSGkgrvn6gzLhl_0 2024-09-12T19:13:57.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6241137410260988197', time=2024-09-12T21:00:32.747226+0000, chain.objs.size()=1 2024-09-12T19:13:57.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-XRToLA5aR0ZIenXtspTKJc42vgIpkl_0 2024-09-12T19:13:57.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14403029997336809432', time=2024-09-12T21:00:32.903137+0000, chain.objs.size()=1 2024-09-12T19:13:57.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.YWckNM-GwvtYdjLkIq9_huMTCiz6L7p_0 2024-09-12T19:13:57.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1568264789595405254', time=2024-09-12T21:00:32.966288+0000, chain.objs.size()=1 2024-09-12T19:13:57.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.4YdpoLOfo8fFYIRfD2X4kfgjmkN8sPQ_0 2024-09-12T19:13:57.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3028854960893508173', time=2024-09-12T21:00:33.142636+0000, chain.objs.size()=1 2024-09-12T19:13:57.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ZOyvMJZwFNZr37FZ3o_p23eMMor2CcA_0 2024-09-12T19:13:57.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6735076073799099239', time=2024-09-12T21:00:33.157539+0000, chain.objs.size()=1 2024-09-12T19:13:57.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.zno-E0ll2f8Ab5-5wny9zIgi-NP30be_0 2024-09-12T19:13:57.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.724238027334746609', time=2024-09-12T21:00:33.186859+0000, chain.objs.size()=1 2024-09-12T19:13:57.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sxIK7qKp_uxnmO1vZ574u5H5mZcufCD_0 2024-09-12T19:13:57.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3882972198565802911', time=2024-09-12T21:00:33.200405+0000, chain.objs.size()=1 2024-09-12T19:13:57.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.wAlssO7z7-8eeSzZqzFbI-AuKUp4jGk_0 2024-09-12T19:13:57.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2294163479030540793', time=2024-09-12T21:00:33.205600+0000, chain.objs.size()=1 2024-09-12T19:13:57.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WXoHYKkWrCjFdgw1x-kf1bwj7e32elZ_0 2024-09-12T19:13:57.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11668170696062601162', time=2024-09-12T21:00:33.432308+0000, chain.objs.size()=1 2024-09-12T19:13:57.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7e3UnR0ooBkezRUuFo6zpfsplNyHW21_0 2024-09-12T19:13:57.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3505061210674999823', time=2024-09-12T21:00:33.478300+0000, chain.objs.size()=1 2024-09-12T19:13:57.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.fU-KpqOeNtLHr8Xq5zpZOGxrd2wxrJR_0 2024-09-12T19:13:57.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12325195768880133923', time=2024-09-12T21:00:33.480903+0000, chain.objs.size()=1 2024-09-12T19:13:57.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.MlfWShl4B9s2suxBSU4bjT4J7I_OzdK_0 2024-09-12T19:13:57.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10676263328833518581', time=2024-09-12T21:00:33.588027+0000, chain.objs.size()=1 2024-09-12T19:13:57.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.GcDxLE53lL1RGKyLHQeKklOvxDKRAVX_0 2024-09-12T19:13:57.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10390129438590590580', time=2024-09-12T21:00:33.607218+0000, chain.objs.size()=1 2024-09-12T19:13:57.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.a7MpkrNRQ014UYlCgSGVFmMzs73kvE8_0 2024-09-12T19:13:57.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1864318856316545995', time=2024-09-12T21:00:33.616186+0000, chain.objs.size()=1 2024-09-12T19:13:57.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.BYSRTPQ0Xzsk8sM2Oqt_bI3zRjqWaQs_0 2024-09-12T19:13:57.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14043458740625785460', time=2024-09-12T21:00:33.621758+0000, chain.objs.size()=1 2024-09-12T19:13:57.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.rsaLlD2cCSSUa0zWiKPbaWcTt3m-UYS_0 2024-09-12T19:13:57.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16570743852170967463', time=2024-09-12T21:00:33.625024+0000, chain.objs.size()=1 2024-09-12T19:13:57.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.TONVvQc9k-YevBrPk1Ok_N3JaHHYa-F_0 2024-09-12T19:13:57.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16347342569069853278', time=2024-09-12T21:00:33.856311+0000, chain.objs.size()=1 2024-09-12T19:13:57.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tP_49vCQcwfiQNuu_tON9vM2Sm4SePn_0 2024-09-12T19:13:57.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1787183128993088536', time=2024-09-12T21:00:33.882106+0000, chain.objs.size()=1 2024-09-12T19:13:57.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.UBwUXGFUYMK3JnbEwD4DUKSXWt7aVmn_0 2024-09-12T19:13:57.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15150138223739757338', time=2024-09-12T21:00:34.598223+0000, chain.objs.size()=1 2024-09-12T19:13:57.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.263__shadow_._UhFc_weskz2tcQbkStBfsIbExtGz_S_0 2024-09-12T19:13:57.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5634597577701051354', time=2024-09-12T21:00:34.600541+0000, chain.objs.size()=1 2024-09-12T19:13:57.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.263__shadow_.H0w6P1Dgk_moYgUIT9tx7Uud5NHSSuu_0 2024-09-12T19:13:57.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3794852322107144803', time=2024-09-12T21:00:46.891550+0000, chain.objs.size()=1 2024-09-12T19:13:57.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.280__shadow_.4cvJKdxM1hWnHHkp_eF1nj9EJ6RgXuP_0 2024-09-12T19:13:57.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14008157881214651391', time=2024-09-12T21:00:49.833975+0000, chain.objs.size()=1 2024-09-12T19:13:57.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.284__shadow_.M731qlI8NG3u4YvrfMtHAgsfKcNBw2T_0 2024-09-12T19:13:57.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7872953170028402372', time=2024-09-12T21:00:56.720232+0000, chain.objs.size()=1 2024-09-12T19:13:57.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.EHUYlnkYwYdxIIeiLaC4dKzdLsXk91__0 2024-09-12T19:13:57.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7283917770429477182', time=2024-09-12T21:00:58.145034+0000, chain.objs.size()=1 2024-09-12T19:13:57.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.Dde88dqm1t8fkPHFJ_mDA1uSRgTfjUI_0 2024-09-12T19:13:57.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12960420467225187721', time=2024-09-12T21:01:03.383724+0000, chain.objs.size()=1 2024-09-12T19:13:57.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.300__shadow_.TQIsYGkng6jIrIra32C28Anmr0S9B4r_0 2024-09-12T19:13:57.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11387568167834310894', time=2024-09-12T21:01:09.094024+0000, chain.objs.size()=1 2024-09-12T19:13:57.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.307__shadow:EtdMPILnwDWBWveRi8zABht7LaP5PvH_.hfqcbZQDO2csxuvrFocv7RyABGJq8mu_0 2024-09-12T19:13:57.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6848153755991458922', time=2024-09-12T21:01:39.441894+0000, chain.objs.size()=1 2024-09-12T19:13:57.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.H0deaWOETNG9KbXY4Pd9yeggiKD5x8f_0 2024-09-12T19:13:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5111333367387625825', time=2024-09-12T21:01:39.489032+0000, chain.objs.size()=1 2024-09-12T19:13:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ObfVwmCP_mTSZ5E3hw2SS8nlDUYndTG_0 2024-09-12T19:13:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8409827566046140412', time=2024-09-12T21:01:39.520401+0000, chain.objs.size()=1 2024-09-12T19:13:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-DfJrcsPHanMX8-Dvi_trX2Jnlmy-7m_0 2024-09-12T19:13:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11509438966727054015', time=2024-09-12T21:01:39.522292+0000, chain.objs.size()=1 2024-09-12T19:13:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Mp8VGMVVSj4nY_b3thz6RpjA4LwBsQ__0 2024-09-12T19:13:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17996326755287384108', time=2024-09-12T21:01:39.544204+0000, chain.objs.size()=1 2024-09-12T19:13:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.C60MAxhDBQHUG6dCdiyrHjQ03fe9Hoo_0 2024-09-12T19:13:57.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5584620852665756730', time=2024-09-12T21:01:39.708612+0000, chain.objs.size()=1 2024-09-12T19:13:57.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.izMx0JTl5J50aMnIz4YzoBjt3EFBts6_0 2024-09-12T19:13:57.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14270727156642862403', time=2024-09-12T21:01:39.724756+0000, chain.objs.size()=1 2024-09-12T19:13:57.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ndqrdW-K8ak5fCEgMhstjSmiYb-FymO_0 2024-09-12T19:13:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10221069009470638791', time=2024-09-12T21:01:39.749120+0000, chain.objs.size()=1 2024-09-12T19:13:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.CXPPf-rSLCtN3fz2Sxteof4U4x0hh75_0 2024-09-12T19:13:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7913412759323036455', time=2024-09-12T21:01:39.759551+0000, chain.objs.size()=1 2024-09-12T19:13:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.O3N_lAgkcx7ovrYqBgpkLYpb1T-Ee3u_0 2024-09-12T19:13:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16251242677564880181', time=2024-09-12T21:01:39.769348+0000, chain.objs.size()=1 2024-09-12T19:13:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.1UQ-4mpLrVah5j2xi3p4-o6JFG4E8Ia_0 2024-09-12T19:13:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6069801547643415391', time=2024-09-12T21:01:39.780967+0000, chain.objs.size()=1 2024-09-12T19:13:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.SSGRqPaLClZjBAbY8lfHPLIAgV9GxOo_0 2024-09-12T19:13:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9722995819145109731', time=2024-09-12T21:01:39.793045+0000, chain.objs.size()=1 2024-09-12T19:13:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.KWKiPPYolQagrMYzEj5gmkawKTPngK6_0 2024-09-12T19:13:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3082549644873315169', time=2024-09-12T21:01:39.920954+0000, chain.objs.size()=1 2024-09-12T19:13:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BjYLPZ7MYjGYTEg3qfsyEIgjiTHC8YK_0 2024-09-12T19:13:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16905403719223081002', time=2024-09-12T21:01:39.924199+0000, chain.objs.size()=1 2024-09-12T19:13:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ehDN8zmDrBidlciIAr-sKFq4Xn0JhuN_0 2024-09-12T19:13:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5853385982583825871', time=2024-09-12T21:01:39.977746+0000, chain.objs.size()=1 2024-09-12T19:13:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.h37I8OXKstyTLUyZ46Ks0vrr8jBZ5fR_0 2024-09-12T19:13:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1777877025974460658', time=2024-09-12T21:01:39.980439+0000, chain.objs.size()=1 2024-09-12T19:13:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.6-VzzrEqiIwegi91227iuClG10jcEMc_0 2024-09-12T19:13:57.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17761982245819718448', time=2024-09-12T21:01:40.186998+0000, chain.objs.size()=1 2024-09-12T19:13:57.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QZ4NZ57O3V78Io_Zu1FLYBtHUhUbwVh_0 2024-09-12T19:13:57.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14077131113935801092', time=2024-09-12T21:01:40.217445+0000, chain.objs.size()=1 2024-09-12T19:13:57.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.G5MQtlCBqlv7YeRiLLkdnxQNMT4kimC_0 2024-09-12T19:13:57.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4064953160799539467', time=2024-09-12T21:01:40.228445+0000, chain.objs.size()=1 2024-09-12T19:13:57.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ajIab0LoiPw6fPjKmUOFqSUPt4D_qFL_0 2024-09-12T19:13:57.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11263847056781139895', time=2024-09-12T21:01:40.333080+0000, chain.objs.size()=1 2024-09-12T19:13:57.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-sUy0wroXDdzY7xgm3DJ9RX9lQhUaDi_0 2024-09-12T19:13:57.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1290965941704187804', time=2024-09-12T21:01:40.335987+0000, chain.objs.size()=1 2024-09-12T19:13:57.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.G38xIz55nd9tZYEMwGLP9YW4FCdMNbD_0 2024-09-12T19:13:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3201688683602144785', time=2024-09-12T21:01:40.391553+0000, chain.objs.size()=1 2024-09-12T19:13:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._f4MobAgjBquMh6p_7fPpIdFkEgN3i1_0 2024-09-12T19:13:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7759582407711702708', time=2024-09-12T21:01:40.395040+0000, chain.objs.size()=1 2024-09-12T19:13:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.cHrsmVq4SNH8ZJbOBSjeoezP_5riEfg_0 2024-09-12T19:13:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9883956376923463695', time=2024-09-12T21:01:40.443429+0000, chain.objs.size()=1 2024-09-12T19:13:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.MuqcnZC4hg4xP1UyMaCsgkvs_cRKFTV_0 2024-09-12T19:13:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6619850238313467396', time=2024-09-12T21:01:40.457452+0000, chain.objs.size()=1 2024-09-12T19:13:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9I5HlPP5gYN19U3HNpDLAj1XfSTXoGE_0 2024-09-12T19:13:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.306934324079426156', time=2024-09-12T21:01:40.460087+0000, chain.objs.size()=1 2024-09-12T19:13:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.R5dT1Fky-8X_8TZE8QVGj1hSqEgKD0f_0 2024-09-12T19:13:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10342539991024009666', time=2024-09-12T21:01:40.580917+0000, chain.objs.size()=1 2024-09-12T19:13:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.uroAftXeDk9liCMrj5HWNboVMSBh3En_0 2024-09-12T19:13:57.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14828078849956401623', time=2024-09-12T21:01:40.586013+0000, chain.objs.size()=1 2024-09-12T19:13:57.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.8XFlq13p08XOHUlqDTaSIMFDSI-uH_1_0 2024-09-12T19:13:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15863693961045495143', time=2024-09-12T21:01:40.598700+0000, chain.objs.size()=1 2024-09-12T19:13:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.6m28aMTbS3JQn1UoqpUPZowPa2X5PyL_0 2024-09-12T19:13:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16291177037641204077', time=2024-09-12T21:01:40.615583+0000, chain.objs.size()=1 2024-09-12T19:13:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.L4BZGILCoFiApVrZL1Qk4zKaKNnxn6u_0 2024-09-12T19:13:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8811843928693263578', time=2024-09-12T21:01:40.618773+0000, chain.objs.size()=1 2024-09-12T19:13:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.MZEjem37XG92Euck7xBLBfo__6ppcfM_0 2024-09-12T19:13:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1446733156186723494', time=2024-09-12T21:01:40.619456+0000, chain.objs.size()=1 2024-09-12T19:13:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.cyDoqlSAN3I9-PsgvgwUQVY7yASAhhe_0 2024-09-12T19:13:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14832059482566323143', time=2024-09-12T21:01:40.626423+0000, chain.objs.size()=1 2024-09-12T19:13:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.J2eOgdOtzctqM_k24wK1POtHiEalPmh_0 2024-09-12T19:13:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8445454248521004547', time=2024-09-12T21:01:40.656352+0000, chain.objs.size()=1 2024-09-12T19:13:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.wBFdTzT1qblk4I48vXDCS_QgxWUXhbJ_0 2024-09-12T19:13:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7109455484309705825', time=2024-09-12T21:01:40.799863+0000, chain.objs.size()=1 2024-09-12T19:13:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.F3zM_4JHLi7BFHbFqrVXamRfe-2tj1Z_0 2024-09-12T19:13:57.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12076945431615775342', time=2024-09-12T21:01:40.835425+0000, chain.objs.size()=1 2024-09-12T19:13:57.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.YklqafNP0EAqgWWsspOuthQtMM4Ks96_0 2024-09-12T19:13:57.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4853742528442400018', time=2024-09-12T21:01:40.860035+0000, chain.objs.size()=1 2024-09-12T19:13:57.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QXfyO-6lABTUuCyL2bMPMc3860Xfjhl_0 2024-09-12T19:13:57.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1577376640460540211', time=2024-09-12T21:01:40.992161+0000, chain.objs.size()=1 2024-09-12T19:13:57.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.32SHLGdgUP1alJOWX_PdIzTqz5MUOuK_0 2024-09-12T19:13:57.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11701026387835293194', time=2024-09-12T21:01:40.994867+0000, chain.objs.size()=1 2024-09-12T19:13:57.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BQ9Wb0NaJEscyxjnMD2eEs4xEq6FEog_0 2024-09-12T19:13:57.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.612095585884719750', time=2024-09-12T21:01:41.074977+0000, chain.objs.size()=1 2024-09-12T19:13:57.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Hf6JMkXIsuF5SxVU_No6yt26AUSm5Qw_0 2024-09-12T19:13:57.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10257107155179831791', time=2024-09-12T21:01:41.093790+0000, chain.objs.size()=1 2024-09-12T19:13:57.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.XiYrSCjRxMt2nG1TSqCW72f1JZ00Ui8_0 2024-09-12T19:13:57.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4971828089348938730', time=2024-09-12T21:02:00.588876+0000, chain.objs.size()=1 2024-09-12T19:13:57.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.cf3E44Ce5FR-G-OIrrI3M7Pe-a7kcBp_0 2024-09-12T19:13:57.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2298830111332719504', time=2024-09-12T21:02:00.589966+0000, chain.objs.size()=1 2024-09-12T19:13:57.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.MjeCBeXLdNod71E4E8EJq9ZIS1bfB4I_0 2024-09-12T19:13:57.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5004277572820910388', time=2024-09-12T21:02:00.619322+0000, chain.objs.size()=1 2024-09-12T19:13:57.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.MiRMNGlzXTFCIp4fKaCU6mLw1KbUIzP_0 2024-09-12T19:13:57.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17444364377571018936', time=2024-09-12T21:02:00.626785+0000, chain.objs.size()=1 2024-09-12T19:13:57.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.UtsWk72Rt8JO7b_W2rnUVaODud3m7U6_0 2024-09-12T19:13:57.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.986734687182639879', time=2024-09-12T21:02:00.644110+0000, chain.objs.size()=1 2024-09-12T19:13:57.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Zc0njgJR2TGyiC0YqxIpm5Xv7lTavso_0 2024-09-12T19:13:57.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7875642422568349195', time=2024-09-12T21:02:00.801794+0000, chain.objs.size()=1 2024-09-12T19:13:57.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.L_h_nEMoMXnDDnoljyYWo-FcIQln_yO_0 2024-09-12T19:13:57.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12180740802947025934', time=2024-09-12T21:02:00.858865+0000, chain.objs.size()=1 2024-09-12T19:13:57.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.4lTEOT-85dLdvSl6TFKRYFQqXFjf6ta_0 2024-09-12T19:13:57.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7383795538289101804', time=2024-09-12T21:02:00.887921+0000, chain.objs.size()=1 2024-09-12T19:13:57.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.6Xc8alfjmaSe6EaHDX24mICqks5duc3_0 2024-09-12T19:13:57.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16316619291559613369', time=2024-09-12T21:02:00.889750+0000, chain.objs.size()=1 2024-09-12T19:13:57.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.fES5fIVh75IaVjgaiDlswwFgQUnZTXT_0 2024-09-12T19:13:57.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14695761636041905859', time=2024-09-12T21:02:00.892989+0000, chain.objs.size()=1 2024-09-12T19:13:57.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.YIJP5jMFpZo99U_DqFx0fzve__8Ib1L_0 2024-09-12T19:13:57.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14698345115594540620', time=2024-09-12T21:02:00.897626+0000, chain.objs.size()=1 2024-09-12T19:13:57.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NRcVgDwVA4tphdHLirMQPcv4QFRs1g6_0 2024-09-12T19:13:57.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50390 2024-09-12T19:13:57.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-12T19:13:57.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11109805107655137540', time=2024-09-12T21:02:00.999588+0000, chain.objs.size()=1 2024-09-12T19:13:57.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.GUMbXQzYj3aINVHT_VtsVWYeEdRH1ug_0 2024-09-12T19:13:57.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5146808339693004581', time=2024-09-12T21:02:01.062191+0000, chain.objs.size()=1 2024-09-12T19:13:57.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.6wfRLvK95yssd_9S87RV-HrcBAxAiHy_0 2024-09-12T19:13:57.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15757892126353360878', time=2024-09-12T21:02:01.104794+0000, chain.objs.size()=1 2024-09-12T19:13:57.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.kJ25dUrayh-D3XG6PfrKlvnl5TIH2RY_0 2024-09-12T19:13:57.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13507247724678016355', time=2024-09-12T21:02:01.244953+0000, chain.objs.size()=1 2024-09-12T19:13:57.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5UxAJg0Rfoh4IEIS5KrC6yMQ_xv-CAd_0 2024-09-12T19:13:57.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4857993327346828009', time=2024-09-12T21:02:01.281976+0000, chain.objs.size()=1 2024-09-12T19:13:57.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ZMx3S9vzY1G177tUNtT3bSAMYR9TX9v_0 2024-09-12T19:13:57.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8189279696862118535', time=2024-09-12T21:02:01.304660+0000, chain.objs.size()=1 2024-09-12T19:13:57.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.bkKVp5Mpisa9tUJTePYszjf4IJOcgCD_0 2024-09-12T19:13:57.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16094608892961997248', time=2024-09-12T21:02:01.351761+0000, chain.objs.size()=1 2024-09-12T19:13:57.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.J3XXfglsUKlZ28w2_UM1YC67g6qCmBZ_0 2024-09-12T19:13:57.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14116984270577478893', time=2024-09-12T21:02:01.493690+0000, chain.objs.size()=1 2024-09-12T19:13:57.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.lekv3__SXHZmASkRYxgLuftgl-6xDI2_0 2024-09-12T19:13:57.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.584490633652470129', time=2024-09-12T21:02:01.502248+0000, chain.objs.size()=1 2024-09-12T19:13:57.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.dmusPLODAhpl4UHdv4XtGzjzv3J31EB_0 2024-09-12T19:13:57.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16747877751261947895', time=2024-09-12T21:02:01.512428+0000, chain.objs.size()=1 2024-09-12T19:13:57.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._7Y17_nhPKhxN_HW-crPey1DlVlVxFm_0 2024-09-12T19:13:57.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17918303743054209768', time=2024-09-12T21:02:01.548388+0000, chain.objs.size()=1 2024-09-12T19:13:57.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.RKMC-ZAhtZZF6ucYihL92B8YL3S9Bzt_0 2024-09-12T19:13:57.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11393906917004311643', time=2024-09-12T21:02:01.667316+0000, chain.objs.size()=1 2024-09-12T19:13:57.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8ePMZFB-D1cvqqn6f3jIBZjJqo1S4Gh_0 2024-09-12T19:13:57.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6147128849187284074', time=2024-09-12T21:02:01.672378+0000, chain.objs.size()=1 2024-09-12T19:13:57.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.zoX0uKMdSz9xZilDPje0Y3bLbU8KMMf_0 2024-09-12T19:13:57.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1713845593378567982', time=2024-09-12T21:02:01.694063+0000, chain.objs.size()=1 2024-09-12T19:13:57.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1wKsgD3OgM-KBES488au0i8ib0Xbq-r_0 2024-09-12T19:13:57.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3652944508608991821', time=2024-09-12T21:02:01.715847+0000, chain.objs.size()=1 2024-09-12T19:13:57.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.i-rcXnvVFwMeb3S6YqH-yZh0XvbL_EU_0 2024-09-12T19:13:57.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8555211276532694094', time=2024-09-12T21:02:01.727363+0000, chain.objs.size()=1 2024-09-12T19:13:57.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Ma-QvJgX5BETBuFMkisaxKbkfDj8yBT_0 2024-09-12T19:13:57.328 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8011875859111662844', time=2024-09-12T21:02:01.759009+0000, chain.objs.size()=1 2024-09-12T19:13:57.328 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.fE0mjEdWQBAOwU7oPzz07MsptzRVKuu_0 2024-09-12T19:13:57.328 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17499671858013634751', time=2024-09-12T21:02:01.777478+0000, chain.objs.size()=1 2024-09-12T19:13:57.328 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.eIfz1v1MRVABbGDI-bogfjXLRF2bm3d_0 2024-09-12T19:13:57.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2912368585591890360', time=2024-09-12T21:02:01.937367+0000, chain.objs.size()=1 2024-09-12T19:13:57.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.RV0XRB5fYSb2X8g-MVWfBtwX0VVCH3W_0 2024-09-12T19:13:57.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2149315567759543770', time=2024-09-12T21:02:01.995282+0000, chain.objs.size()=1 2024-09-12T19:13:57.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.LtbRna7ZVuWdvPqXx7D7N9_CAI8oz0h_0 2024-09-12T19:13:57.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2045200530248328251', time=2024-09-12T21:02:02.007540+0000, chain.objs.size()=1 2024-09-12T19:13:57.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0avDPTBgrrwJzukurHdP4IJZ1T8Z_Li_0 2024-09-12T19:13:57.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14715326464690177827', time=2024-09-12T21:02:02.124162+0000, chain.objs.size()=1 2024-09-12T19:13:57.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.tBtSsSpXRuVcLrTjg9xZHIUXPP14fCc_0 2024-09-12T19:13:57.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11701144925565314694', time=2024-09-12T21:02:02.184085+0000, chain.objs.size()=1 2024-09-12T19:13:57.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.324+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yVMUf70z-6INmxk3wu0dqUv76TS6qBQ_0 2024-09-12T19:13:57.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.834797337893222391', time=2024-09-12T21:02:06.758274+0000, chain.objs.size()=1 2024-09-12T19:13:57.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.331__shadow_.d8TgW_W_eU_OE26-kf8g3i7wp2NX0gA_0 2024-09-12T19:13:57.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6279972121255264883', time=2024-09-12T21:03:15.749575+0000, chain.objs.size()=1 2024-09-12T19:13:57.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.429__shadow_.3eWm8HUEbuMNsylS71VKrUf5xqFraiC_0 2024-09-12T19:13:57.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17268773790418173249', time=2024-09-12T21:03:55.576134+0000, chain.objs.size()=1 2024-09-12T19:13:57.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.483__shadow_.usvdlhnTSTbZymiGMwDxbgWkdA3Tyoa_0 2024-09-12T19:13:57.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14913040079668563915', time=2024-09-12T21:04:00.246800+0000, chain.objs.size()=1 2024-09-12T19:13:57.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.489__shadow_.eLuJ82pAqxR9b8XNBq3GFSVUkpXXhYU_0 2024-09-12T19:13:57.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~iF8Z7IdNBQdpDYXeuAITHX6PXN_WZu0', time=2024-09-12T21:04:36.980993+0000, chain.objs.size()=1 2024-09-12T19:13:57.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~iF8Z7IdNBQdpDYXeuAITHX6PXN_WZu0.3 2024-09-12T19:13:57.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11923171164126272143', time=2024-09-12T21:05:49.065450+0000, chain.objs.size()=1 2024-09-12T19:13:57.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.557__shadow_.BquBeVpQZBjp8kq4utyiYfehL6mPIff_0 2024-09-12T19:13:57.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5458699056163232285', time=2024-09-12T21:05:53.967061+0000, chain.objs.size()=1 2024-09-12T19:13:57.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.562__shadow_.lJ99nkh_bTdbou7ZmxAiUY7f7HM1xQu_0 2024-09-12T19:13:57.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7889653774242301630', time=2024-09-12T21:05:59.177442+0000, chain.objs.size()=2 2024-09-12T19:13:57.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.563__shadow_.G5Wyr_2afQ5dCSuMcIgtaGF8ULj04NH_0 2024-09-12T19:13:57.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.563__shadow_.G5Wyr_2afQ5dCSuMcIgtaGF8ULj04NH_1 2024-09-12T19:13:57.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11547189578690097276', time=2024-09-12T21:06:08.528092+0000, chain.objs.size()=1 2024-09-12T19:13:57.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:ENvmd1NRIGZZ.TUww0IIfTnsJ-hrPTF_.J-KQOYdMVoQJouGSA1ER8YKa0dvN2J4_0 2024-09-12T19:13:57.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16584323569138836004', time=2024-09-12T21:06:18.567397+0000, chain.objs.size()=1 2024-09-12T19:13:57.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.574__shadow:Eq57AxnWZ75jLBeaIlc7QgKSd6Bmlou_.g9jljYJUKptpyMKLvg7PWeJPlRn2pQV_0 2024-09-12T19:13:57.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7497264179381465108', time=2024-09-12T21:10:35.514332+0000, chain.objs.size()=1 2024-09-12T19:13:57.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.707__shadow:sbED.ly7qXQM0-XfuO7IV8Gq8xC3Vqw_.KnuJJ5QmAOS0iqhSKewMrzzPMcV_g6C_0 2024-09-12T19:13:57.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T19:13:57.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51816' 2024-09-12T19:13:57.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.749362556413634098', time=2024-09-12T20:57:32.176095+0000, chain.objs.size()=5 2024-09-12T19:13:57.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__multipart_mymultipart-FROZEN.2~2cOG-lSiH7sRaBfRrxHKko45oI2J6_j.1 2024-09-12T19:13:57.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__shadow_mymultipart-FROZEN.2~2cOG-lSiH7sRaBfRrxHKko45oI2J6_j.1_1 2024-09-12T19:13:57.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__multipart_mymultipart-FROZEN.2~2cOG-lSiH7sRaBfRrxHKko45oI2J6_j.2 2024-09-12T19:13:57.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__shadow_mymultipart-FROZEN.2~2cOG-lSiH7sRaBfRrxHKko45oI2J6_j.2_1 2024-09-12T19:13:57.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__multipart_mymultipart-FROZEN.2~2cOG-lSiH7sRaBfRrxHKko45oI2J6_j.3 2024-09-12T19:13:57.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10367538421023780642', time=2024-09-12T20:57:36.241827+0000, chain.objs.size()=5 2024-09-12T19:13:57.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__multipart_foo-FROZEN.2~WX03-H3FGQOCWOPNCXh_mFgv_B3Q1Bb.1 2024-09-12T19:13:57.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_foo-FROZEN.2~WX03-H3FGQOCWOPNCXh_mFgv_B3Q1Bb.1_1 2024-09-12T19:13:57.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__multipart_foo-FROZEN.2~WX03-H3FGQOCWOPNCXh_mFgv_B3Q1Bb.2 2024-09-12T19:13:57.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_foo-FROZEN.2~WX03-H3FGQOCWOPNCXh_mFgv_B3Q1Bb.2_1 2024-09-12T19:13:57.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__multipart_foo-FROZEN.2~WX03-H3FGQOCWOPNCXh_mFgv_B3Q1Bb.3 2024-09-12T19:13:57.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.438205539915708815', time=2024-09-12T20:59:50.808027+0000, chain.objs.size()=1 2024-09-12T19:13:57.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.234__shadow_.viwvrSFZv49B_Kqxc91O5LZUNQ4Lllc_0 2024-09-12T19:13:57.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15004461907726446982', time=2024-09-12T21:00:08.820110+0000, chain.objs.size()=1 2024-09-12T19:13:57.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.256__shadow_.rXchkaX7isc-y_L0hkzhglBwhoIpGho_0 2024-09-12T19:13:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5464081370908929553', time=2024-09-12T21:00:10.245366+0000, chain.objs.size()=1 2024-09-12T19:13:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.258__shadow_.PUDSpAfQack_GuXumr3MRomrU6PF2f5_0 2024-09-12T19:13:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1666146434308844204', time=2024-09-12T21:00:31.985723+0000, chain.objs.size()=1 2024-09-12T19:13:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DPoyCwwWQ3AE3gPaZcslWO_1TymKwTD_0 2024-09-12T19:13:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6949226043060642935', time=2024-09-12T21:00:32.017742+0000, chain.objs.size()=1 2024-09-12T19:13:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.5ok938w3CsUhZyb5dtTlP1c24nu-hyx_0 2024-09-12T19:13:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16389623408401284790', time=2024-09-12T21:00:32.043197+0000, chain.objs.size()=1 2024-09-12T19:13:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Deo_v1klIYoHZBTF8MICuOXaGWWHBFX_0 2024-09-12T19:13:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8323014523070716789', time=2024-09-12T21:00:32.079842+0000, chain.objs.size()=1 2024-09-12T19:13:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CNVtevR1HPaVLjFiHYyqXtfjb4pR4rZ_0 2024-09-12T19:13:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3478279859226533368', time=2024-09-12T21:00:32.118781+0000, chain.objs.size()=1 2024-09-12T19:13:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ED1SEBZdsUEUm--h6flzHlZStbmTP7N_0 2024-09-12T19:13:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9514536056064244431', time=2024-09-12T21:00:32.119871+0000, chain.objs.size()=1 2024-09-12T19:13:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WdJOOf2aHrteTlvQjF_ir74AQXF0riW_0 2024-09-12T19:13:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17619610810596250943', time=2024-09-12T21:00:32.225969+0000, chain.objs.size()=1 2024-09-12T19:13:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3jY8iK4oRPWiVYj9Px1az7XWVD2JBxp_0 2024-09-12T19:13:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3227019286824502154', time=2024-09-12T21:00:32.232594+0000, chain.objs.size()=1 2024-09-12T19:13:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.4iDZjG1FYptntXgz8xLlo65qnYYJ3S-_0 2024-09-12T19:13:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3933604540456928876', time=2024-09-12T21:00:32.248926+0000, chain.objs.size()=1 2024-09-12T19:13:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.1CZpT0LN4SfduPWjE0ZgCO2ZaSn0fHU_0 2024-09-12T19:13:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11982041607668171443', time=2024-09-12T21:00:32.251648+0000, chain.objs.size()=1 2024-09-12T19:13:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.72M8_lfBTudiM6C4TLi4eIiTl8F7nML_0 2024-09-12T19:13:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8990130296787416402', time=2024-09-12T21:00:32.297575+0000, chain.objs.size()=1 2024-09-12T19:13:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ilz1KYmDzqNjunbdNV90R5lm8e4MUAn_0 2024-09-12T19:13:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15583327814634567944', time=2024-09-12T21:00:32.311571+0000, chain.objs.size()=1 2024-09-12T19:13:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.r_LeQ4YYdsgEIaA4VR7dpEnr3xVVou1_0 2024-09-12T19:13:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6895395267682111617', time=2024-09-12T21:00:32.319406+0000, chain.objs.size()=1 2024-09-12T19:13:57.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LpOtDM-6yg0-SAjicfmEx3VOQrpMkR1_0 2024-09-12T19:13:57.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.685999638561293481', time=2024-09-12T21:00:32.511425+0000, chain.objs.size()=1 2024-09-12T19:13:57.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.oEM5q-QIdQ0FuwqYMcyCcOxMyHUSdqC_0 2024-09-12T19:13:57.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14979462380353944523', time=2024-09-12T21:00:32.524096+0000, chain.objs.size()=1 2024-09-12T19:13:57.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SbTszXZWp7he_bapy2qQFNLMUDYYkbc_0 2024-09-12T19:13:57.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12409028585889198329', time=2024-09-12T21:00:32.532013+0000, chain.objs.size()=1 2024-09-12T19:13:57.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CP8nQiIZ7nWZ6Y80Z9EPDGXl8cg7cnc_0 2024-09-12T19:13:57.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3629115925186075719', time=2024-09-12T21:00:32.540630+0000, chain.objs.size()=1 2024-09-12T19:13:57.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.vtSU_JIuFXXUOlLCoxkTh7ZudIvkb1x_0 2024-09-12T19:13:57.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7023322647070334005', time=2024-09-12T21:00:32.559158+0000, chain.objs.size()=1 2024-09-12T19:13:57.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.25LQl_-nQYZc_JPuKTDEdaxZeAGcIN2_0 2024-09-12T19:13:57.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5459458350045950366', time=2024-09-12T21:00:32.700982+0000, chain.objs.size()=1 2024-09-12T19:13:57.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JHbfOlbyH0-TMrACt-COZAmQK-iH8Ac_0 2024-09-12T19:13:57.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2105196803050297284', time=2024-09-12T21:00:32.744918+0000, chain.objs.size()=1 2024-09-12T19:13:57.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LNHrDWxHEZprgJYPQsUgl5UjKOJfvFj_0 2024-09-12T19:13:57.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.861195212333280283', time=2024-09-12T21:00:32.753855+0000, chain.objs.size()=1 2024-09-12T19:13:57.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DoGwegJ0jNqzEei4RQjapzPLpiE5tJW_0 2024-09-12T19:13:57.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17721115432456649722', time=2024-09-12T21:00:32.777039+0000, chain.objs.size()=1 2024-09-12T19:13:57.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.A0_KIPG8_f635DumgGysTxLD5xgR0Kz_0 2024-09-12T19:13:57.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10143567101107404425', time=2024-09-12T21:00:32.968210+0000, chain.objs.size()=1 2024-09-12T19:13:57.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LC7jNpwkAWfaf37strWSeyHRz58FDED_0 2024-09-12T19:13:57.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16734412272728177142', time=2024-09-12T21:00:33.119235+0000, chain.objs.size()=1 2024-09-12T19:13:57.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Igl8thklVohkeKU3m-MnTR_896SV1U0_0 2024-09-12T19:13:57.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12159452570825130188', time=2024-09-12T21:00:33.123151+0000, chain.objs.size()=1 2024-09-12T19:13:57.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.eqTUc5Djz1YqyBQxdTJPOf0p8ZE1jSb_0 2024-09-12T19:13:57.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5510317775077511522', time=2024-09-12T21:00:33.138183+0000, chain.objs.size()=1 2024-09-12T19:13:57.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.82XxtMpdslBwTKDyBJAdEsnwGYz9Cee_0 2024-09-12T19:13:57.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12561499859626277007', time=2024-09-12T21:00:33.148032+0000, chain.objs.size()=1 2024-09-12T19:13:57.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.fiYjYZO6xE0fdl_oOawubFprMivNVTg_0 2024-09-12T19:13:57.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6014648442418380740', time=2024-09-12T21:00:33.210516+0000, chain.objs.size()=1 2024-09-12T19:13:57.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CxsqdJwlawZW8ECLAuqP5_Su6VkUdyY_0 2024-09-12T19:13:57.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12984788028164347728', time=2024-09-12T21:00:33.217416+0000, chain.objs.size()=1 2024-09-12T19:13:57.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.lcMIpUIE30NWIoCdBbm-owv8Y68N0OM_0 2024-09-12T19:13:57.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16575993653253695107', time=2024-09-12T21:00:33.427932+0000, chain.objs.size()=1 2024-09-12T19:13:57.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.hmgffvgLI0Ak-AwWolR_yR4HMGG7Pgt_0 2024-09-12T19:13:57.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8732534183581078027', time=2024-09-12T21:00:33.448653+0000, chain.objs.size()=1 2024-09-12T19:13:57.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.AjnGn2aGvhuaAN0vfCmN09DwJRJosl6_0 2024-09-12T19:13:57.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14777305617003022075', time=2024-09-12T21:00:41.735865+0000, chain.objs.size()=1 2024-09-12T19:13:57.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.273__shadow_.T13WeQP0rmg3fJxhBZhfYYpx6PsTKJn_0 2024-09-12T19:13:57.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11912595538297263396', time=2024-09-12T21:00:43.992505+0000, chain.objs.size()=1 2024-09-12T19:13:57.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.276__shadow_.N68ZDJPAtYueTjhkkM-rEOMPV5ffZK6_0 2024-09-12T19:13:57.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10088615976889993042', time=2024-09-12T21:00:51.334627+0000, chain.objs.size()=1 2024-09-12T19:13:57.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.286__shadow_.aciBaN90zKfKb1PPxv2RHm_MqC8QaJ0_0 2024-09-12T19:13:57.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.31044382515508346', time=2024-09-12T21:00:56.699557+0000, chain.objs.size()=1 2024-09-12T19:13:57.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.WUsJfYwJxTrVsxxq94dAbKnuGiMuO1m_0 2024-09-12T19:13:57.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17349993410763351086', time=2024-09-12T21:00:58.124835+0000, chain.objs.size()=1 2024-09-12T19:13:57.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.fwxTW77KPFyhlZPwP3WRWYPn-vcLs2T_0 2024-09-12T19:13:57.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7526109143472870472', time=2024-09-12T21:00:58.152707+0000, chain.objs.size()=1 2024-09-12T19:13:57.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.-6-31OL4rfRnsOLpy2Bh4y6b6MX-TJj_0 2024-09-12T19:13:57.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7520305066080688557', time=2024-09-12T21:01:05.587529+0000, chain.objs.size()=1 2024-09-12T19:13:57.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.303__shadow_.5i22SinfV0Oi9UIouairfX7_gb2yQ4M_0 2024-09-12T19:13:57.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11240694225178302462', time=2024-09-12T21:01:39.410462+0000, chain.objs.size()=1 2024-09-12T19:13:57.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.csgt73OhkvxaCb5GTfP49fVEeR5PEnV_0 2024-09-12T19:13:57.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18172072454250449532', time=2024-09-12T21:01:39.469382+0000, chain.objs.size()=1 2024-09-12T19:13:57.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.D2YipWCSPZzU41DaBE1buEyLsZrI9oP_0 2024-09-12T19:13:57.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9979532767947974464', time=2024-09-12T21:01:39.527705+0000, chain.objs.size()=1 2024-09-12T19:13:57.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hKuGqDAcDjtEgtEpe4aAcA-sxbFKntE_0 2024-09-12T19:13:57.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8223692378003330469', time=2024-09-12T21:01:39.529820+0000, chain.objs.size()=1 2024-09-12T19:13:57.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.xZX42evncF64ErjEV-UaXRt7BItX3Lg_0 2024-09-12T19:13:57.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6838241293334890164', time=2024-09-12T21:01:39.659110+0000, chain.objs.size()=1 2024-09-12T19:13:57.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.1bJk4EzKWfxAm4vHMDenTvcy56jYq_A_0 2024-09-12T19:13:57.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2455125632401731336', time=2024-09-12T21:01:39.713593+0000, chain.objs.size()=1 2024-09-12T19:13:57.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.uGAbR1my7M2kSsxqToxlzJSQoNRfWjc_0 2024-09-12T19:13:57.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2541370910617338589', time=2024-09-12T21:01:39.723634+0000, chain.objs.size()=1 2024-09-12T19:13:57.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._Skret72M7NynMJQ1_gJCCq3L2e8D03_0 2024-09-12T19:13:57.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15096111293522348547', time=2024-09-12T21:01:39.725072+0000, chain.objs.size()=1 2024-09-12T19:13:57.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.OYqc9XwpzyCs-G7OxZK5AlZCzDSzl7o_0 2024-09-12T19:13:57.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14205351715183376553', time=2024-09-12T21:01:39.751190+0000, chain.objs.size()=1 2024-09-12T19:13:57.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.CzsTL3_IohRNqv1nrgDHEbgnd8b7owJ_0 2024-09-12T19:13:57.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2614734420249854984', time=2024-09-12T21:01:39.754881+0000, chain.objs.size()=1 2024-09-12T19:13:57.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.IdFVNmiD7zxeto-dzB5yrbsEMORhv6l_0 2024-09-12T19:13:57.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4600388559713630431', time=2024-09-12T21:01:39.764942+0000, chain.objs.size()=1 2024-09-12T19:13:57.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.y3moCSB9PWco9F6lMjVoQDFYyuCIey2_0 2024-09-12T19:13:57.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10048486540020019079', time=2024-09-12T21:01:39.897254+0000, chain.objs.size()=1 2024-09-12T19:13:57.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-jGp9nh-Iy1Kt9AqYI-w69DmtS9XkAQ_0 2024-09-12T19:13:57.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14478606504038776322', time=2024-09-12T21:01:39.900209+0000, chain.objs.size()=1 2024-09-12T19:13:57.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.WWChbDTvNBjjAVEZOuiKNu1J-5hCefY_0 2024-09-12T19:13:57.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3558992061722141394', time=2024-09-12T21:01:39.902909+0000, chain.objs.size()=1 2024-09-12T19:13:57.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.dmSRIZKEIg96u3trYQeJzsDN8BR9Yvi_0 2024-09-12T19:13:57.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4326600649575755700', time=2024-09-12T21:01:39.954508+0000, chain.objs.size()=1 2024-09-12T19:13:57.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.B1mM5aVCm-aizgZvOjANfXgkjnO-F6H_0 2024-09-12T19:13:57.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4104552021175058467', time=2024-09-12T21:01:39.986112+0000, chain.objs.size()=1 2024-09-12T19:13:57.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.pPb3BLlKp4CtcXdIr6O_RwAkCDNGQRH_0 2024-09-12T19:13:57.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16395390482213161062', time=2024-09-12T21:01:40.194858+0000, chain.objs.size()=1 2024-09-12T19:13:57.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.xIzplr-VhLnc2ibyaAq-9w3rAsAWVx9_0 2024-09-12T19:13:57.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15969363743787257179', time=2024-09-12T21:01:40.334470+0000, chain.objs.size()=1 2024-09-12T19:13:57.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.jsKChLQ59rgKSDF42TIFWdw3l0q4LBn_0 2024-09-12T19:13:57.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1192801456148585583', time=2024-09-12T21:01:40.354615+0000, chain.objs.size()=1 2024-09-12T19:13:57.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hiftcIwDBGSuQnYZsszhod4EuEmiSip_0 2024-09-12T19:13:57.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15999960361720762342', time=2024-09-12T21:01:40.374756+0000, chain.objs.size()=1 2024-09-12T19:13:57.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.KWYU0Bn1syNEhEL7qvCswavjlXpW4Xf_0 2024-09-12T19:13:57.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10884543135671440193', time=2024-09-12T21:01:40.435307+0000, chain.objs.size()=1 2024-09-12T19:13:57.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QJ-Kz001l0Pme8qyfl8tT1epvVpUwlL_0 2024-09-12T19:13:57.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11977207962108262469', time=2024-09-12T21:01:40.545850+0000, chain.objs.size()=1 2024-09-12T19:13:57.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.zt8qYDgelabOXRwAUi-IsADU3DfXpwD_0 2024-09-12T19:13:57.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5033904678052353300', time=2024-09-12T21:01:40.555613+0000, chain.objs.size()=1 2024-09-12T19:13:57.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Shni4BzIHzRwybVK20n-DEifu_rzF6q_0 2024-09-12T19:13:57.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14636481606181073616', time=2024-09-12T21:01:40.598799+0000, chain.objs.size()=1 2024-09-12T19:13:57.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._yQ7ys61NqPPzY8CLfrvRcrTNdXV2iD_0 2024-09-12T19:13:57.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6119913258114684236', time=2024-09-12T21:01:40.796720+0000, chain.objs.size()=1 2024-09-12T19:13:57.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.qxJLWGXvlkMlYSswLrEW_RxVWno_KM1_0 2024-09-12T19:13:57.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14300745676044404972', time=2024-09-12T21:01:40.799149+0000, chain.objs.size()=1 2024-09-12T19:13:57.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ja_E3rWr5ClWHoRI-OO1VfdelusCLuS_0 2024-09-12T19:13:57.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15331692411060951945', time=2024-09-12T21:01:40.815922+0000, chain.objs.size()=1 2024-09-12T19:13:57.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.V2DN5kHB5IUOGA1Hgml7LACiAJLS-67_0 2024-09-12T19:13:57.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6127797436658283194', time=2024-09-12T21:01:40.851330+0000, chain.objs.size()=1 2024-09-12T19:13:57.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.wXxrV0-3dA_YBvSlDVK20K9IyezQSe0_0 2024-09-12T19:13:57.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16702748276201948806', time=2024-09-12T21:01:40.852404+0000, chain.objs.size()=1 2024-09-12T19:13:57.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.CxF5mHs2QNjtEij8FSnurJS8ngLyaVZ_0 2024-09-12T19:13:57.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7956216918744892243', time=2024-09-12T21:01:40.995586+0000, chain.objs.size()=1 2024-09-12T19:13:57.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.YxkoTQ8RXtUwHGYJd4BWQiSeR9A6JZy_0 2024-09-12T19:13:57.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14157006437652325053', time=2024-09-12T21:01:41.021466+0000, chain.objs.size()=1 2024-09-12T19:13:57.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.3ZNqU_tWr7sIgfA4XVjVlRRmkYrUyPG_0 2024-09-12T19:13:57.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.47514461145763060', time=2024-09-12T21:01:41.095289+0000, chain.objs.size()=1 2024-09-12T19:13:57.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.F0cjytv-j1DW9161AH1gDljmokA27Ey_0 2024-09-12T19:13:57.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10194826004173249447', time=2024-09-12T21:02:00.517587+0000, chain.objs.size()=1 2024-09-12T19:13:57.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._70HLqFeUuI6GQExn73AZbn19rcdInL_0 2024-09-12T19:13:57.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10049905745759474501', time=2024-09-12T21:02:00.613711+0000, chain.objs.size()=1 2024-09-12T19:13:57.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.MgK8fJ9xyF9nQthaoBehlvW_atDor88_0 2024-09-12T19:13:57.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13665589744958840333', time=2024-09-12T21:02:00.645679+0000, chain.objs.size()=1 2024-09-12T19:13:57.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jZ7NxtutJqkV9vqZkRhoacwTOAGyTV5_0 2024-09-12T19:13:57.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5580189191273160273', time=2024-09-12T21:02:00.764806+0000, chain.objs.size()=1 2024-09-12T19:13:57.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qdJPKZlTdUKCMSTXcocs7uQV0_lqyC__0 2024-09-12T19:13:57.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12351810424900937159', time=2024-09-12T21:02:00.798021+0000, chain.objs.size()=1 2024-09-12T19:13:57.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.C-0HkMKjjl-yeilxl_3fmd_q0cv-6Le_0 2024-09-12T19:13:57.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14817146041114530845', time=2024-09-12T21:02:00.992247+0000, chain.objs.size()=1 2024-09-12T19:13:57.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.CpSHtw3RKmsTsqNB9FV04lBEwA30hFL_0 2024-09-12T19:13:57.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12577867113787341628', time=2024-09-12T21:02:01.075743+0000, chain.objs.size()=1 2024-09-12T19:13:57.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-ivC7SgRD9AB_AMv3JalBBgjvn9IxEx_0 2024-09-12T19:13:57.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4300934454310073956', time=2024-09-12T21:02:01.083579+0000, chain.objs.size()=1 2024-09-12T19:13:57.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.lcKvjy6wfBky1LW0mt1MBPzoBToDYgY_0 2024-09-12T19:13:57.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16478155974317030426', time=2024-09-12T21:02:01.100030+0000, chain.objs.size()=1 2024-09-12T19:13:57.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.H_RXk8OQf8UviAUbANqqyLyksC9EZwZ_0 2024-09-12T19:13:57.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3292659813592422677', time=2024-09-12T21:02:01.230469+0000, chain.objs.size()=1 2024-09-12T19:13:57.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Q1CbNzFz_SbnGYM9_FRF4LnO-f_Hx-K_0 2024-09-12T19:13:57.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14003921307353224072', time=2024-09-12T21:02:01.244081+0000, chain.objs.size()=1 2024-09-12T19:13:57.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._64tsukzTNAKM-jPRuSPewOfMMLaEy8_0 2024-09-12T19:13:57.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4984405361695298265', time=2024-09-12T21:02:01.323079+0000, chain.objs.size()=1 2024-09-12T19:13:57.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Rb_ZXZQ0R3hL5b4sWgFHQ5TsVp-8DcY_0 2024-09-12T19:13:57.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5683657708740446553', time=2024-09-12T21:02:01.325162+0000, chain.objs.size()=1 2024-09-12T19:13:57.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NFoPRvQ1UrQGVqZodA1utzamcag5_zo_0 2024-09-12T19:13:57.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1988193715517149076', time=2024-09-12T21:02:01.492687+0000, chain.objs.size()=1 2024-09-12T19:13:57.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WM6_mtb1yy7bckaLKipzeoULMjxe48C_0 2024-09-12T19:13:57.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9178188330965954751', time=2024-09-12T21:02:01.504450+0000, chain.objs.size()=1 2024-09-12T19:13:57.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.XqYANmGSR5SuMzMCYi1S2iw-viYa9Ym_0 2024-09-12T19:13:57.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15980288185967363069', time=2024-09-12T21:02:01.525731+0000, chain.objs.size()=1 2024-09-12T19:13:57.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.k3qQOaRH7VuDD-qH8vtrkrioKbUJfJx_0 2024-09-12T19:13:57.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9142119873287850850', time=2024-09-12T21:02:01.678478+0000, chain.objs.size()=1 2024-09-12T19:13:57.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.dRQMjXX0VJW4qpeUMlgV1U2vT-2FUL-_0 2024-09-12T19:13:57.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10058209773526654483', time=2024-09-12T21:02:01.696556+0000, chain.objs.size()=1 2024-09-12T19:13:57.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.cWTKaiJQdwTAIUMHTrwLMs2Uue6vuf9_0 2024-09-12T19:13:57.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1148696143382176689', time=2024-09-12T21:02:01.729839+0000, chain.objs.size()=1 2024-09-12T19:13:57.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.lea5L0oIcSRuPTt4t-E-2ftxT0mhXrO_0 2024-09-12T19:13:57.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7559976456136507179', time=2024-09-12T21:02:01.738131+0000, chain.objs.size()=1 2024-09-12T19:13:57.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.zoWyLn9fnmFiVG7UNsXSMnYxCGjgeQr_0 2024-09-12T19:13:57.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8544222759381572043', time=2024-09-12T21:02:01.911645+0000, chain.objs.size()=1 2024-09-12T19:13:57.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.SZ-SefPK8mtUdFDfsp9Z_jV3fQecFe2_0 2024-09-12T19:13:57.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18012163944059101580', time=2024-09-12T21:02:01.950730+0000, chain.objs.size()=1 2024-09-12T19:13:57.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.dPDamuj-jOVQeHTPvdzzjamXcRbxINn_0 2024-09-12T19:13:57.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9466554356802403996', time=2024-09-12T21:02:01.954257+0000, chain.objs.size()=1 2024-09-12T19:13:57.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.I7mgaicSm80DZz0X9d5O7yv-EqMIhJV_0 2024-09-12T19:13:57.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.538919656121805611', time=2024-09-12T21:02:01.956406+0000, chain.objs.size()=1 2024-09-12T19:13:57.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1nj-p6iXlAyO-3lpavOpDjxC9Kb1Y7O_0 2024-09-12T19:13:57.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14318200553284946391', time=2024-09-12T21:02:02.126587+0000, chain.objs.size()=1 2024-09-12T19:13:57.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7Dn-XYUrW92zP0OzwwjyqGWCUeSHV_G_0 2024-09-12T19:13:57.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51816 2024-09-12T19:13:57.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T19:13:57.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11287946203786163079', time=2024-09-12T21:02:02.138302+0000, chain.objs.size()=1 2024-09-12T19:13:57.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.3M3gq31gn0SkAqsF5DQM6DyLjYcDdsx_0 2024-09-12T19:13:57.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6855511030266377547', time=2024-09-12T21:02:02.187439+0000, chain.objs.size()=1 2024-09-12T19:13:57.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.EA8GDf3KEGyG1dyqKwwRa8wU9hKHXyK_0 2024-09-12T19:13:57.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8777883088089881009', time=2024-09-12T21:02:04.712642+0000, chain.objs.size()=1 2024-09-12T19:13:57.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.328__shadow_.-sa5AOU3V0uKyiGBy4zZcoo9QXFMdk-_0 2024-09-12T19:13:57.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10913660903187908312', time=2024-09-12T21:02:39.733082+0000, chain.objs.size()=1 2024-09-12T19:13:57.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.381__shadow_.W32ak81v6rOgZj0VddsJ5jD1EzAcsOC_0 2024-09-12T19:13:57.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5171297051870220583', time=2024-09-12T21:03:22.963504+0000, chain.objs.size()=1 2024-09-12T19:13:57.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.439__shadow_.83kGixoc6pndFiuKgZF17c1hWcloNHb_0 2024-09-12T19:13:57.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3776688372429462355', time=2024-09-12T21:03:38.092788+0000, chain.objs.size()=1 2024-09-12T19:13:57.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.457__shadow_.5b8W_KWkLjN-dTTpm-8ZvLvksEh3VdR_0 2024-09-12T19:13:57.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1607274515434116887', time=2024-09-12T21:03:45.270749+0000, chain.objs.size()=1 2024-09-12T19:13:57.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.464__shadow_.Y8uFoc3SloIDBtUP1YC6xEEH0d2RloM_0 2024-09-12T19:13:57.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8466475411044063854', time=2024-09-12T21:04:25.269666+0000, chain.objs.size()=6 2024-09-12T19:13:57.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.519__multipart_mymultipart.2~UhRdQJpeBRYvcQRNXMYFErH9MPNn2Ha.1 2024-09-12T19:13:57.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.519__multipart_mymultipart.2~UhRdQJpeBRYvcQRNXMYFErH9MPNn2Ha.2 2024-09-12T19:13:57.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.519__multipart_mymultipart.2~UhRdQJpeBRYvcQRNXMYFErH9MPNn2Ha.3 2024-09-12T19:13:57.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.519__multipart_mymultipart.2~UhRdQJpeBRYvcQRNXMYFErH9MPNn2Ha.4 2024-09-12T19:13:57.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.519__multipart_mymultipart.2~UhRdQJpeBRYvcQRNXMYFErH9MPNn2Ha.5 2024-09-12T19:13:57.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.519__multipart_mymultipart.2~UhRdQJpeBRYvcQRNXMYFErH9MPNn2Ha.6 2024-09-12T19:13:57.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~mkY7OZbKlvdK0_vyDyjO31tFi4gB9m6', time=2024-09-12T21:04:59.792722+0000, chain.objs.size()=1 2024-09-12T19:13:57.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.531__multipart_mymultipart.2~mkY7OZbKlvdK0_vyDyjO31tFi4gB9m6.1 2024-09-12T19:13:57.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6581129591805751805', time=2024-09-12T21:05:52.790841+0000, chain.objs.size()=1 2024-09-12T19:13:57.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.561__multipart_mymultipart.2~ov3VQ9skAYo3WJxOkjnDRqkFrfsNA7l.1 2024-09-12T19:13:57.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9900430308169531091', time=2024-09-12T21:05:59.838192+0000, chain.objs.size()=1 2024-09-12T19:13:57.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.564__shadow_.jtIhoYP1CLMTBs0ON7SqJAy2OfywDL8_0 2024-09-12T19:13:57.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8540799624331784294', time=2024-09-12T21:06:07.000364+0000, chain.objs.size()=1 2024-09-12T19:13:57.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:Mfq.sW51R.6HafNUGoEcobiwZrEbUt5_.FV74Dfn6-lOhj1bPeMn6IMnvMJCdzUI_0 2024-09-12T19:13:57.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14072241605446591423', time=2024-09-12T21:06:10.295082+0000, chain.objs.size()=1 2024-09-12T19:13:57.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:Gh58X6dboXcp1tC27-pVm9o-KSjkGlR_.amBbhjMKX0wiY2LSSSj7C6WUzuAE7V6_0 2024-09-12T19:13:57.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4765586286211054002', time=2024-09-12T21:06:15.237785+0000, chain.objs.size()=1 2024-09-12T19:13:57.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.573__shadow_.x5RCBBz4df7ctl2m_qXztFGXpwcoNfR_0 2024-09-12T19:13:57.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16559830132460623402', time=2024-09-12T21:06:36.678494+0000, chain.objs.size()=1 2024-09-12T19:13:57.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:RSAa55g.C.45Xu8-A9-UmO05L6Pn5DN_.1f6OGhoKVW8BMJZ2ATFQrq3HGnSeHcP_0 2024-09-12T19:13:57.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4947900510450123428', time=2024-09-12T21:06:36.854603+0000, chain.objs.size()=1 2024-09-12T19:13:57.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:GoWeyc1q7rvJgDhK4h2VPF7s7sjIQv2_.OAAEMt3NjSD7G5VFNFaa1hOLq1WAHgR_0 2024-09-12T19:13:57.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7187148011255666636', time=2024-09-12T21:07:05.501116+0000, chain.objs.size()=1 2024-09-12T19:13:57.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.605__shadow_.-j4AzNWPv-nm4CVwllqyPTm8YitUn2d_0 2024-09-12T19:13:57.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~MCcRgkjh3GYaSdFwRLXVBBy8yFaLBH_', time=2024-09-12T21:09:35.880448+0000, chain.objs.size()=12 2024-09-12T19:13:57.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.625__multipart_multipart_enc.2~MCcRgkjh3GYaSdFwRLXVBBy8yFaLBH_.1 2024-09-12T19:13:57.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.625__shadow_multipart_enc.2~MCcRgkjh3GYaSdFwRLXVBBy8yFaLBH_.1_1 2024-09-12T19:13:57.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.625__multipart_multipart_enc.2~MCcRgkjh3GYaSdFwRLXVBBy8yFaLBH_.2 2024-09-12T19:13:57.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.625__shadow_multipart_enc.2~MCcRgkjh3GYaSdFwRLXVBBy8yFaLBH_.2_1 2024-09-12T19:13:57.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.625__multipart_multipart_enc.2~MCcRgkjh3GYaSdFwRLXVBBy8yFaLBH_.3 2024-09-12T19:13:57.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.625__shadow_multipart_enc.2~MCcRgkjh3GYaSdFwRLXVBBy8yFaLBH_.3_1 2024-09-12T19:13:57.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.625__multipart_multipart_enc.2~MCcRgkjh3GYaSdFwRLXVBBy8yFaLBH_.4 2024-09-12T19:13:57.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.625__shadow_multipart_enc.2~MCcRgkjh3GYaSdFwRLXVBBy8yFaLBH_.4_1 2024-09-12T19:13:57.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.625__multipart_multipart_enc.2~MCcRgkjh3GYaSdFwRLXVBBy8yFaLBH_.5 2024-09-12T19:13:57.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.625__shadow_multipart_enc.2~MCcRgkjh3GYaSdFwRLXVBBy8yFaLBH_.5_1 2024-09-12T19:13:57.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.625__multipart_multipart_enc.2~MCcRgkjh3GYaSdFwRLXVBBy8yFaLBH_.6 2024-09-12T19:13:57.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.625__shadow_multipart_enc.2~MCcRgkjh3GYaSdFwRLXVBBy8yFaLBH_.6_1 2024-09-12T19:13:57.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.380+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T19:13:57.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43291' 2024-09-12T19:13:57.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9068274713663716997', time=2024-09-12T20:57:58.629446+0000, chain.objs.size()=1 2024-09-12T19:13:57.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.181__shadow_.06DMtcxqeY5CQkHePUgEtSHYiV8f2kX_0 2024-09-12T19:13:57.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15332848696172429318', time=2024-09-12T20:58:19.773794+0000, chain.objs.size()=1 2024-09-12T19:13:57.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.200__shadow_.0QsnR0bkb4ODpUhh-nQ4TrO2vElaBbW_0 2024-09-12T19:13:57.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4315260225820367833', time=2024-09-12T20:59:51.619157+0000, chain.objs.size()=1 2024-09-12T19:13:57.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.235__shadow_.iTnsUwprkSs1xNhNqbFCYl_jMB3p92S_0 2024-09-12T19:13:57.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14087822606004251001', time=2024-09-12T21:00:02.968793+0000, chain.objs.size()=1 2024-09-12T19:13:57.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.248__shadow_.2Enf6MJxHrqB3F5mzMsYwy3t2xXh-s2_0 2024-09-12T19:13:57.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7220371737361009708', time=2024-09-12T21:00:03.683330+0000, chain.objs.size()=1 2024-09-12T19:13:57.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.249__shadow_.NZu6JoYiuaLmJZi6c-zJgkKRRilRSVz_0 2024-09-12T19:13:57.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9477901502234192947', time=2024-09-12T21:00:04.392039+0000, chain.objs.size()=1 2024-09-12T19:13:57.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.250__shadow_.AiMllz49HB5bfhAVa__NRUP95zQl8UH_0 2024-09-12T19:13:57.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16739964884259797310', time=2024-09-12T21:00:05.143562+0000, chain.objs.size()=1 2024-09-12T19:13:57.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.251__shadow_.cUykEvp7slecuz4sLdll04y8P5hjE-G_0 2024-09-12T19:13:57.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15136272401729020160', time=2024-09-12T21:00:07.380617+0000, chain.objs.size()=1 2024-09-12T19:13:57.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.254__shadow_.Xu89uh8oYxR5VE7UHYHdEu13RW5W-xO_0 2024-09-12T19:13:57.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13173018921096849406', time=2024-09-12T21:00:12.458838+0000, chain.objs.size()=1 2024-09-12T19:13:57.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.261__shadow_.-fjfWFrXuxyyLPHvjorpmJu3OUhWOO6_0 2024-09-12T19:13:57.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.149014532452701932', time=2024-09-12T21:00:31.984176+0000, chain.objs.size()=1 2024-09-12T19:13:57.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ej8bWiDDTIFPY7i884YwvH46xhIReIs_0 2024-09-12T19:13:57.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1554756148450029654', time=2024-09-12T21:00:32.036211+0000, chain.objs.size()=1 2024-09-12T19:13:57.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.9VZQJEjqn_Z2fJjPioi9FhWtp-n3y6N_0 2024-09-12T19:13:57.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4394680285883340347', time=2024-09-12T21:00:32.042175+0000, chain.objs.size()=1 2024-09-12T19:13:57.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LJdnKX7riCjq2hiz92TgoBHhxZyDt_-_0 2024-09-12T19:13:57.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7983120323381621759', time=2024-09-12T21:00:32.111520+0000, chain.objs.size()=1 2024-09-12T19:13:57.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.FjhXw8z-5fwjq_gXx69p9oAn23tOfr6_0 2024-09-12T19:13:57.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7764276641837203828', time=2024-09-12T21:00:32.254860+0000, chain.objs.size()=1 2024-09-12T19:13:57.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.YiA7OxDwfAYDHkE6I2zaDv32Bv2MzjM_0 2024-09-12T19:13:57.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16457285845500847415', time=2024-09-12T21:00:32.267707+0000, chain.objs.size()=1 2024-09-12T19:13:57.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.L5G5JI2fTvQgBUPWpVyo8DHGhKemyV0_0 2024-09-12T19:13:57.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7638624487639075322', time=2024-09-12T21:00:32.310124+0000, chain.objs.size()=1 2024-09-12T19:13:57.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ck8R8_hHwpyhhvJ3ssBMTAef5x0AF-v_0 2024-09-12T19:13:57.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5038160094082772047', time=2024-09-12T21:00:32.346896+0000, chain.objs.size()=1 2024-09-12T19:13:57.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.yiNqZl4cBSwY8l968GBvrCHInNAXgZH_0 2024-09-12T19:13:57.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14783789994621258919', time=2024-09-12T21:00:32.348038+0000, chain.objs.size()=1 2024-09-12T19:13:57.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.UV_FgKO7EmDgM5tQualz1EsxwlrYgj7_0 2024-09-12T19:13:57.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10018878354267567097', time=2024-09-12T21:00:32.462738+0000, chain.objs.size()=1 2024-09-12T19:13:57.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.wEAzlmzTiPm_G1-QvVtIud_RBtV-XMK_0 2024-09-12T19:13:57.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6755658901414661292', time=2024-09-12T21:00:32.513653+0000, chain.objs.size()=1 2024-09-12T19:13:57.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.259352pM7AGarN3J4SuuP6Fd4HDJekd_0 2024-09-12T19:13:57.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3592201300789428528', time=2024-09-12T21:00:32.527084+0000, chain.objs.size()=1 2024-09-12T19:13:57.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.446hJfLhCLjjd25_MXQdO4DIjdDeC9S_0 2024-09-12T19:13:57.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13072533092778925128', time=2024-09-12T21:00:32.552828+0000, chain.objs.size()=1 2024-09-12T19:13:57.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.388+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_._hUGiWZcurhmieqjsrwUBrOBjxomDVT_0 2024-09-12T19:13:57.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15206722498429271074', time=2024-09-12T21:00:32.712448+0000, chain.objs.size()=1 2024-09-12T19:13:57.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.yASKh71-9jsRFwHsuR9eVxqJGZC1JDw_0 2024-09-12T19:13:57.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5188841791267234593', time=2024-09-12T21:00:32.745797+0000, chain.objs.size()=1 2024-09-12T19:13:57.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.uFqtRYk2SL3FXOyj65CYyWM_e87Fazz_0 2024-09-12T19:13:57.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17708628623566872812', time=2024-09-12T21:00:32.877838+0000, chain.objs.size()=1 2024-09-12T19:13:57.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.VLvIQ9h8dlBtnn3wspMSjKdf4eWo3Uk_0 2024-09-12T19:13:57.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9001585738519566496', time=2024-09-12T21:00:32.885353+0000, chain.objs.size()=1 2024-09-12T19:13:57.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DaSvjvacySEPsQJDew63V-OJ7SAn-y0_0 2024-09-12T19:13:57.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7072566466708477012', time=2024-09-12T21:00:32.898012+0000, chain.objs.size()=1 2024-09-12T19:13:57.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.lXXTND3Si2mZrQU9rCVoO53FwBDtHxs_0 2024-09-12T19:13:57.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11549321271392380385', time=2024-09-12T21:00:32.922118+0000, chain.objs.size()=1 2024-09-12T19:13:57.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.fL7Tljc-E_Va8ubXFLDiyO5HCXpBVdo_0 2024-09-12T19:13:57.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3462389957908696558', time=2024-09-12T21:00:33.095579+0000, chain.objs.size()=1 2024-09-12T19:13:57.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.TyPIGwOTSGyKnByGGlaBW1BR-Pask2N_0 2024-09-12T19:13:57.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17827189739858776980', time=2024-09-12T21:00:33.212217+0000, chain.objs.size()=1 2024-09-12T19:13:57.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XH86d5aAuds4ArWm7ed0TuYb_ylVLhL_0 2024-09-12T19:13:57.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10727656727705251346', time=2024-09-12T21:00:33.359943+0000, chain.objs.size()=1 2024-09-12T19:13:57.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DQtwmMrCztzsUzxyHG5tdCbfku7Uh-k_0 2024-09-12T19:13:57.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10855523530400678704', time=2024-09-12T21:00:33.385630+0000, chain.objs.size()=1 2024-09-12T19:13:57.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.cMdMJvgEmWV7tZ94TccT2WmFqWbosSy_0 2024-09-12T19:13:57.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6257181171396280645', time=2024-09-12T21:00:33.445322+0000, chain.objs.size()=1 2024-09-12T19:13:57.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.RvqZ8rCrYwweKMsF_yHEQXk56zb_aJG_0 2024-09-12T19:13:57.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1095843524395047753', time=2024-09-12T21:00:33.462742+0000, chain.objs.size()=1 2024-09-12T19:13:57.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.C-cRLny4XTOGnn8iCE15HErSQw1DMzq_0 2024-09-12T19:13:57.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11677047262483104533', time=2024-09-12T21:00:33.482656+0000, chain.objs.size()=1 2024-09-12T19:13:57.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2vTnm9-aAWtf6lwfGBTDFXXOSlKhm17_0 2024-09-12T19:13:57.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13324395987518028776', time=2024-09-12T21:00:33.490235+0000, chain.objs.size()=1 2024-09-12T19:13:57.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.oZBXgRvfJ5WQc-4jipwangQIv4dCodT_0 2024-09-12T19:13:57.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10660290256970637534', time=2024-09-12T21:00:33.584019+0000, chain.objs.size()=1 2024-09-12T19:13:57.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Aud2yDrULP9egK-07TovusjE2LYFb0z_0 2024-09-12T19:13:57.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11277277739365070689', time=2024-09-12T21:00:33.837310+0000, chain.objs.size()=1 2024-09-12T19:13:57.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.AfjpUOeud_HKcHhNmGHfzJS7TLNRHOd_0 2024-09-12T19:13:57.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14150890884646922759', time=2024-09-12T21:00:33.840641+0000, chain.objs.size()=1 2024-09-12T19:13:57.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WtOS9ukvrFNUJLoKdelefK-FNvd4TGj_0 2024-09-12T19:13:57.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12260823057659717328', time=2024-09-12T21:00:33.868944+0000, chain.objs.size()=1 2024-09-12T19:13:57.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.392+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.bfmYNEmd4GwhKDB1RK3x5pVksLDVu1a_0 2024-09-12T19:13:57.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9942530048787744307', time=2024-09-12T21:00:49.831091+0000, chain.objs.size()=1 2024-09-12T19:13:57.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.284__shadow_.m7Z02ObKsrzsyAaVPJTVeNYPVjcm5Id_0 2024-09-12T19:13:57.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5363358160038414302', time=2024-09-12T21:00:52.791626+0000, chain.objs.size()=1 2024-09-12T19:13:57.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.288__shadow_.tujWOwBili2dcrAjGgCkZE_HQdMVxee_0 2024-09-12T19:13:57.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3755004903586660612', time=2024-09-12T21:00:53.556889+0000, chain.objs.size()=1 2024-09-12T19:13:57.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.289__shadow_.qYKwfc-HsD92FdFgUm3grR3zfui7NPI_0 2024-09-12T19:13:57.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16575285968101863522', time=2024-09-12T21:00:56.733008+0000, chain.objs.size()=1 2024-09-12T19:13:57.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.Fi_3vB0YBu9ol8il63yJs54j8Rvkwqn_0 2024-09-12T19:13:57.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4226749985319348391', time=2024-09-12T21:01:01.754642+0000, chain.objs.size()=1 2024-09-12T19:13:57.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.298__shadow_.eeze2T0oar7DqBdn_bKFbV1G5nV3mX8_0 2024-09-12T19:13:57.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10535830060014027990', time=2024-09-12T21:01:03.383081+0000, chain.objs.size()=1 2024-09-12T19:13:57.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.300__shadow_.55wF1UvHNT1f6FaRqXoj9ep3Zcc7pWt_0 2024-09-12T19:13:57.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11133686697831768653', time=2024-09-12T21:01:39.440510+0000, chain.objs.size()=1 2024-09-12T19:13:57.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.rK3W-cVq78mk-MpzRT0GAUBfPaNoavf_0 2024-09-12T19:13:57.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8747220078032354092', time=2024-09-12T21:01:39.447284+0000, chain.objs.size()=1 2024-09-12T19:13:57.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.HysjtpT46G0i-3ov7xuEfGLaAoLAej5_0 2024-09-12T19:13:57.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7361829847084250448', time=2024-09-12T21:01:39.472492+0000, chain.objs.size()=1 2024-09-12T19:13:57.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.6-YKwFF_1bHfHAQ6KGEXLQJJwzfJxdV_0 2024-09-12T19:13:57.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1478097975834825782', time=2024-09-12T21:01:39.543143+0000, chain.objs.size()=1 2024-09-12T19:13:57.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.AwVrLY9c5Ax69KvK194CZL2rVJ2YMAQ_0 2024-09-12T19:13:57.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11766525579008399975', time=2024-09-12T21:01:39.664297+0000, chain.objs.size()=1 2024-09-12T19:13:57.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.LvKLjZsZYPivio_yh4EGGDqIDv8tNeC_0 2024-09-12T19:13:57.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1525078607022947584', time=2024-09-12T21:01:39.726963+0000, chain.objs.size()=1 2024-09-12T19:13:57.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.YGu85doLTKTtYWI_w_8dPhGat0yRjTL_0 2024-09-12T19:13:57.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1920164191132635184', time=2024-09-12T21:01:39.765253+0000, chain.objs.size()=1 2024-09-12T19:13:57.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9jWSvCEeijLsTRhOUKe42IBZ2OH8D7V_0 2024-09-12T19:13:57.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7110558215054886284', time=2024-09-12T21:01:39.934457+0000, chain.objs.size()=1 2024-09-12T19:13:57.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ylvPIrAExkZt_1fTb16mEy_GwmJH_hJ_0 2024-09-12T19:13:57.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18267265207204017763', time=2024-09-12T21:01:39.969330+0000, chain.objs.size()=1 2024-09-12T19:13:57.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.401lu2EkSY16q9JHjOfsvJigSW7UK4v_0 2024-09-12T19:13:57.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15382964392404555737', time=2024-09-12T21:01:39.986036+0000, chain.objs.size()=1 2024-09-12T19:13:57.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.aEqkbQDwRUhRNjNpPu1PpbrM3qGSJ2r_0 2024-09-12T19:13:57.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6968830757234811666', time=2024-09-12T21:01:40.142441+0000, chain.objs.size()=1 2024-09-12T19:13:57.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.396+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.xY0LQv7xdvR4sQoZXjFao_VkOheeKS__0 2024-09-12T19:13:57.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14469964171935199826', time=2024-09-12T21:01:40.145680+0000, chain.objs.size()=1 2024-09-12T19:13:57.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.GEr7DtKeXQV9Kb6an7UCNx_vg1m32qQ_0 2024-09-12T19:13:57.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3073229621756750945', time=2024-09-12T21:01:40.359120+0000, chain.objs.size()=1 2024-09-12T19:13:57.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.1iuFEKubahd5ht60Rw6uDJOjj4DYhMY_0 2024-09-12T19:13:57.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18124721903224295762', time=2024-09-12T21:01:40.418951+0000, chain.objs.size()=1 2024-09-12T19:13:57.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.YEp8mDKqGqjXqYl3gzWqsHixOiWGIew_0 2024-09-12T19:13:57.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8062828142062811720', time=2024-09-12T21:01:40.440316+0000, chain.objs.size()=1 2024-09-12T19:13:57.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.zXrHGpxCNo3T1vdgKHCZ-vx81ghOc40_0 2024-09-12T19:13:57.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4030862740018822878', time=2024-09-12T21:01:40.444833+0000, chain.objs.size()=1 2024-09-12T19:13:57.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.lxqjhQXgYD6QPdJshZEz5VVyOJKhe0p_0 2024-09-12T19:13:57.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3937063485076787206', time=2024-09-12T21:01:40.546525+0000, chain.objs.size()=1 2024-09-12T19:13:57.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.OaDsUHjDzOf1MX624pmzDopf3yrg3sf_0 2024-09-12T19:13:57.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15831402675341894183', time=2024-09-12T21:01:40.593034+0000, chain.objs.size()=1 2024-09-12T19:13:57.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.C7wENeFe3vz3uWZfwoYlp-riolYg9Kh_0 2024-09-12T19:13:57.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15876837179218770551', time=2024-09-12T21:01:40.639257+0000, chain.objs.size()=1 2024-09-12T19:13:57.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.emiCG_OIobAXyDC3WBwfZv76iYcHQ63_0 2024-09-12T19:13:57.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2220060565664518809', time=2024-09-12T21:01:40.642079+0000, chain.objs.size()=1 2024-09-12T19:13:57.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.J8r7rUdi44KwG4xeGjK9JJ5WJuVIBnV_0 2024-09-12T19:13:57.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12986999086040889164', time=2024-09-12T21:01:40.643562+0000, chain.objs.size()=1 2024-09-12T19:13:57.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.nLtz1cPKOBxgULUl8M_wfZic77UAWLV_0 2024-09-12T19:13:57.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4826935851521074528', time=2024-09-12T21:01:40.806001+0000, chain.objs.size()=1 2024-09-12T19:13:57.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.TzbRA0GSF0juCiF2xpqLTXTNj9KLtWB_0 2024-09-12T19:13:57.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2752174500790285662', time=2024-09-12T21:01:40.831873+0000, chain.objs.size()=1 2024-09-12T19:13:57.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.D2SLbMmPWoCR6nmc4jn_uJBazgzV5s6_0 2024-09-12T19:13:57.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7480996904251507161', time=2024-09-12T21:01:40.866211+0000, chain.objs.size()=1 2024-09-12T19:13:57.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DGtWjQDrfabzjGS8Sni3d5IUImdcp7V_0 2024-09-12T19:13:57.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9605619614145755038', time=2024-09-12T21:01:40.879269+0000, chain.objs.size()=1 2024-09-12T19:13:57.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.8ZppCwErElBTWENFhL0uoY6e9ThDGMW_0 2024-09-12T19:13:57.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13830390231117418451', time=2024-09-12T21:01:41.055713+0000, chain.objs.size()=1 2024-09-12T19:13:57.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.E4brNR5mSobfykY7o2JdmvhP4VhQJbQ_0 2024-09-12T19:13:57.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17666641656787448438', time=2024-09-12T21:01:41.081458+0000, chain.objs.size()=1 2024-09-12T19:13:57.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.nP43yA-fBxVj8rWy8LcfgDDWHPdLuxI_0 2024-09-12T19:13:57.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12618038796286227007', time=2024-09-12T21:02:00.507939+0000, chain.objs.size()=1 2024-09-12T19:13:57.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.400+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.OG0_a16q27QA8MX0HYkcn7F03jY3R_c_0 2024-09-12T19:13:57.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14516964950972571674', time=2024-09-12T21:02:00.579331+0000, chain.objs.size()=1 2024-09-12T19:13:57.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.aeF0uC4pzRKWhLXRB0RZ_40vUGjcMaG_0 2024-09-12T19:13:57.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8135615352768711523', time=2024-09-12T21:02:00.581151+0000, chain.objs.size()=1 2024-09-12T19:13:57.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.KTxD59Wf1WkqDoCsCXe2cjJwYr7Emgq_0 2024-09-12T19:13:57.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11354218890262466824', time=2024-09-12T21:02:00.596579+0000, chain.objs.size()=1 2024-09-12T19:13:57.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Bpe84appbYqtu3L49ucgikKcrjRBZEO_0 2024-09-12T19:13:57.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2666376929174135749', time=2024-09-12T21:02:00.603828+0000, chain.objs.size()=1 2024-09-12T19:13:57.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.SqHRbiW3SpEXfd91I2F6Az_o_fzBHhV_0 2024-09-12T19:13:57.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5696970935934600965', time=2024-09-12T21:02:00.625854+0000, chain.objs.size()=1 2024-09-12T19:13:57.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qsZa6nfPDnoOdpomIXu5m8eThgTSSAw_0 2024-09-12T19:13:57.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3167460824939919843', time=2024-09-12T21:02:00.773575+0000, chain.objs.size()=1 2024-09-12T19:13:57.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.UoXH71T7TQfOLXEhSWwIo_eX99rKjKK_0 2024-09-12T19:13:57.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18416835774769044973', time=2024-09-12T21:02:00.835605+0000, chain.objs.size()=1 2024-09-12T19:13:57.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.kK2xd25Ojv8Cu_JH2IF0ZwPLYHHGuaB_0 2024-09-12T19:13:57.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13725338842606152713', time=2024-09-12T21:02:00.848601+0000, chain.objs.size()=1 2024-09-12T19:13:57.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.dJmK9CAxLqDFJWEQNCuMVNDX4KfcmZj_0 2024-09-12T19:13:57.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18027062642920284033', time=2024-09-12T21:02:00.865544+0000, chain.objs.size()=1 2024-09-12T19:13:57.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.K0ygiZaoDY3u9uy4p3nn6xzGTlJK5xW_0 2024-09-12T19:13:57.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1013899442624516301', time=2024-09-12T21:02:00.870328+0000, chain.objs.size()=1 2024-09-12T19:13:57.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Njcr2I_OPZt8ckxfLL_ISDTEJ3V3LlQ_0 2024-09-12T19:13:57.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9122723954140242756', time=2024-09-12T21:02:00.888924+0000, chain.objs.size()=1 2024-09-12T19:13:57.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.404+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.A__KJJu62TmfhYuzRMPEW0AwYK26R4t_0 2024-09-12T19:13:57.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17317324789902637143', time=2024-09-12T21:02:00.893043+0000, chain.objs.size()=1 2024-09-12T19:13:57.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.LgE04IlSACKWQTNvBW3r2dJqwtZq5xj_0 2024-09-12T19:13:57.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12126151953466050645', time=2024-09-12T21:02:01.001409+0000, chain.objs.size()=1 2024-09-12T19:13:57.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0nXaImn4l3AS8QmDJcSEI3Us5QLc943_0 2024-09-12T19:13:57.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2613118898608971308', time=2024-09-12T21:02:01.017902+0000, chain.objs.size()=1 2024-09-12T19:13:57.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.PROmJsFtix-EezYF0loR5iwR7uXzLbP_0 2024-09-12T19:13:57.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13202824945328534013', time=2024-09-12T21:02:01.051419+0000, chain.objs.size()=1 2024-09-12T19:13:57.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NcmJbKWq10G9ybGxrWot1y7EmV7FHd4_0 2024-09-12T19:13:57.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2408366174432798069', time=2024-09-12T21:02:01.068689+0000, chain.objs.size()=1 2024-09-12T19:13:57.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.CYsvvqn_IRMw8TqseE90Hq7oylF8QEf_0 2024-09-12T19:13:57.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9340620186402269365', time=2024-09-12T21:02:01.087102+0000, chain.objs.size()=1 2024-09-12T19:13:57.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.OnaLNxCSv06s45XrTKyoQAq4hDxaa6h_0 2024-09-12T19:13:57.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9854767166361925172', time=2024-09-12T21:02:01.099796+0000, chain.objs.size()=1 2024-09-12T19:13:57.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ptsaPtiMzUvDHguI6TpaIvyP37Sa_Rp_0 2024-09-12T19:13:57.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13322499482622873674', time=2024-09-12T21:02:01.100698+0000, chain.objs.size()=1 2024-09-12T19:13:57.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.INa387jNlEq95tQfQvHByZVpEVT8Mf0_0 2024-09-12T19:13:57.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17207828981698566869', time=2024-09-12T21:02:01.223945+0000, chain.objs.size()=1 2024-09-12T19:13:57.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._ddeOBOYOOwhXNvIRZmO8Nf8CNajJ-g_0 2024-09-12T19:13:57.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9795738129911538210', time=2024-09-12T21:02:01.317643+0000, chain.objs.size()=1 2024-09-12T19:13:57.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.M5nB4tAMKiEV3qCmcwna6UJ1tpJ-8bS_0 2024-09-12T19:13:57.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1399410121083874013', time=2024-09-12T21:02:01.319458+0000, chain.objs.size()=1 2024-09-12T19:13:57.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Ar353j5HyUb01C9quwo1oluH0Exj9dB_0 2024-09-12T19:13:57.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2351553779360147149', time=2024-09-12T21:02:01.320641+0000, chain.objs.size()=1 2024-09-12T19:13:57.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.m5cOyBoBsh_agPy5jox6UHQjlYrsFIJ_0 2024-09-12T19:13:57.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1967193613531049146', time=2024-09-12T21:02:01.325142+0000, chain.objs.size()=1 2024-09-12T19:13:57.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yByUcHumVH5CmObNSYg1yhwSWJyPv1v_0 2024-09-12T19:13:57.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15378877016137100593', time=2024-09-12T21:02:01.334865+0000, chain.objs.size()=1 2024-09-12T19:13:57.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Jk5yij_Exyl13_bd0D8mui9LPqRRRQr_0 2024-09-12T19:13:57.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11210687575011763624', time=2024-09-12T21:02:01.504824+0000, chain.objs.size()=1 2024-09-12T19:13:57.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.408+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.vdBb4PVoceFxBkl2C_mzrSewJ2i_6wj_0 2024-09-12T19:13:57.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.412+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43291 2024-09-12T19:13:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-12T19:13:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12031047175016056818', time=2024-09-12T21:02:01.549733+0000, chain.objs.size()=1 2024-09-12T19:13:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.c3kfaOCEbxz97j0xQPwOisZurmsEqgt_0 2024-09-12T19:13:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16930293502879933802', time=2024-09-12T21:02:01.695517+0000, chain.objs.size()=1 2024-09-12T19:13:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.cDwEi2YLBqRymDY5_McipAILCJ-k4At_0 2024-09-12T19:13:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17547632101598449263', time=2024-09-12T21:02:01.697503+0000, chain.objs.size()=1 2024-09-12T19:13:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.cT8eTAp5yRbjC6h9qbGKA6EYGuUoE-n_0 2024-09-12T19:13:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10371540889418325072', time=2024-09-12T21:02:01.756811+0000, chain.objs.size()=1 2024-09-12T19:13:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WkyJNMEQ-r2s8DWd1AUFZHUrPIgRRE__0 2024-09-12T19:13:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10517368909158636254', time=2024-09-12T21:02:01.763442+0000, chain.objs.size()=1 2024-09-12T19:13:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Kwr3HL0G4quLKa0NOJkFr6iZQNl0hQC_0 2024-09-12T19:13:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.485373315030790496', time=2024-09-12T21:02:01.778465+0000, chain.objs.size()=1 2024-09-12T19:13:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.K0dI8ASJiM_ooBZ-F7o-blyP3IkBSQ0_0 2024-09-12T19:13:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9918519829776496659', time=2024-09-12T21:02:01.954563+0000, chain.objs.size()=1 2024-09-12T19:13:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.DbXa7e3vhsMAz1i6Zfo4LIu17diKcWF_0 2024-09-12T19:13:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13504087042101091095', time=2024-09-12T21:02:01.985453+0000, chain.objs.size()=1 2024-09-12T19:13:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.l8ImUp6wmei2Ezj2Te5yzeKawvu7lkj_0 2024-09-12T19:13:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3255396508137223688', time=2024-09-12T21:02:01.989751+0000, chain.objs.size()=1 2024-09-12T19:13:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Sl53wG4fsrVqBSqhPzihttAEW19RACq_0 2024-09-12T19:13:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10733825878026959614', time=2024-09-12T21:02:02.003513+0000, chain.objs.size()=1 2024-09-12T19:13:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yd5qhItXXLJDQR64jnn9I3I8-8Kx4Ua_0 2024-09-12T19:13:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14053714758257341511', time=2024-09-12T21:02:02.150446+0000, chain.objs.size()=1 2024-09-12T19:13:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qb1dyv2QeeCfGxxoHAPKaVp_LxUD62f_0 2024-09-12T19:13:57.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15433060698855075213', time=2024-09-12T21:02:02.158270+0000, chain.objs.size()=1 2024-09-12T19:13:57.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.416+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.sC3p9tDHzP9MxxoQyDhvlrMz5wl3WCt_0 2024-09-12T19:13:57.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9623971163020493401', time=2024-09-12T21:02:02.173126+0000, chain.objs.size()=1 2024-09-12T19:13:57.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.xtpKrLJ3eFPeHPbTh2PsBFxKhOTswjA_0 2024-09-12T19:13:57.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17035995457325982231', time=2024-09-12T21:02:02.208094+0000, chain.objs.size()=1 2024-09-12T19:13:57.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.muFpJp-cObJlyjGhIo2bqpQU8x6lraC_0 2024-09-12T19:13:57.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7561636025159182338', time=2024-09-12T21:02:07.295076+0000, chain.objs.size()=1 2024-09-12T19:13:57.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.332__shadow_.m2Ps0P8ISbKDBojNWGndPcxkWaeTaJu_0 2024-09-12T19:13:57.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6727175419632024865', time=2024-09-12T21:02:07.918731+0000, chain.objs.size()=1 2024-09-12T19:13:57.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.333__shadow_.PyVEbQ6bIjzeh0lUVvEZWUAXsyeVm0H_0 2024-09-12T19:13:57.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3496689914603630069', time=2024-09-12T21:02:36.757706+0000, chain.objs.size()=1 2024-09-12T19:13:57.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.377__shadow_.TTSh6BT8p40UVOwPHVpknH9q4gQ7njH_0 2024-09-12T19:13:57.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5392984728394743964', time=2024-09-12T21:02:41.549161+0000, chain.objs.size()=1 2024-09-12T19:13:57.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.383__shadow_.QrU06d4dp7yBeIkvPOHH3mIW-NDlOHb_0 2024-09-12T19:13:57.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14446518515760576319', time=2024-09-12T21:02:46.583410+0000, chain.objs.size()=1 2024-09-12T19:13:57.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.390__shadow_.U5S_0_phu-IIgwMeNrZ_kYY5n7vJBvF_0 2024-09-12T19:13:57.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8382424766621533493', time=2024-09-12T21:03:59.537397+0000, chain.objs.size()=1 2024-09-12T19:13:57.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.488__shadow_.5rPcXgYioi8fN0UtnvbCSmHbF6QG7nD_0 2024-09-12T19:13:57.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14914200715615959066', time=2024-09-12T21:04:20.626734+0000, chain.objs.size()=1 2024-09-12T19:13:57.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.518__multipart_mymultipart.2~aK-JKKTjqSWp2g0UuVweTaXPb4HwB2d.1 2024-09-12T19:13:57.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17825965074037858375', time=2024-09-12T21:04:49.097147+0000, chain.objs.size()=2 2024-09-12T19:13:57.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.523__multipart_mymultipart.2~f6yT6wn3BRRj5_43ik3IYZ_OmIRab4B.1 2024-09-12T19:13:57.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.523__multipart_mymultipart.2~f6yT6wn3BRRj5_43ik3IYZ_OmIRab4B.2 2024-09-12T19:13:57.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12893003360577392622', time=2024-09-12T21:05:41.084885+0000, chain.objs.size()=1 2024-09-12T19:13:57.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.550__shadow_.CbYtXNRo6kGTE1V_woBhHhx6zW7zzL0_0 2024-09-12T19:13:57.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4443571747942139214', time=2024-09-12T21:06:05.420424+0000, chain.objs.size()=1 2024-09-12T19:13:57.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.420+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:7G2.nQVpIFQIuLf2.K2749A--mkk46o_.Jje7Rr8sboP9431rGeK70y_NfTh56st_0 2024-09-12T19:13:57.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12021425256285793048', time=2024-09-12T21:06:06.096452+0000, chain.objs.size()=1 2024-09-12T19:13:57.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:7x3oOtldGwmR5vfLhVqXsCYu82uTasG_.0Sq_Pr6RA-VFaMTkg2eDKm_2naEap31_0 2024-09-12T19:13:57.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6404737402863763484', time=2024-09-12T21:06:07.232604+0000, chain.objs.size()=1 2024-09-12T19:13:57.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:DUyAwHV0UoL279cxuZLHi0k0dQUhSUp_.81eaeROnd3s0N93o_V-HGriO6VST56j_0 2024-09-12T19:13:57.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14340772936990325648', time=2024-09-12T21:06:09.822790+0000, chain.objs.size()=1 2024-09-12T19:13:57.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:xqRz3rZeQT6zKDMm0qENI47Vv8KKbd7_.RSOl-EZVDyrl1OB-Sp5bsCV05qF_qGS_0 2024-09-12T19:13:57.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14883608598843403391', time=2024-09-12T21:06:28.268829+0000, chain.objs.size()=1 2024-09-12T19:13:57.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:eu8CptRg3ZY24eGgzFnr4h9BZfQoa1Z_.sv741hY1xgjlhlsxGgqSDTrtpX3DW4J_0 2024-09-12T19:13:57.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9897899358625493969', time=2024-09-12T21:06:33.071731+0000, chain.objs.size()=1 2024-09-12T19:13:57.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:2YwF7kAnGZUCBmMTi.U9oZw9u9Ek5xP_.Dyvw8sluucDCTlYxoPY64AEh8Q3jVFK_0 2024-09-12T19:13:57.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8143620390490304868', time=2024-09-12T21:06:35.040926+0000, chain.objs.size()=1 2024-09-12T19:13:57.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:o8yWhCV5E0mN4QTJtNrDDUbotusaN51_.7H2kB_PXZ6oFCTAqUZIGZ11m4ecbgt3_0 2024-09-12T19:13:57.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1673292656534226089', time=2024-09-12T21:06:35.464793+0000, chain.objs.size()=1 2024-09-12T19:13:57.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:7O9.RuDuZUYGEtEh3RabQvJ2lYYq.Ay_.-bq8BziuAIMBczuFHZ3__OhYEZTC6zq_0 2024-09-12T19:13:57.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10206667259394300968', time=2024-09-12T21:07:06.188770+0000, chain.objs.size()=1 2024-09-12T19:13:57.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.606__shadow_.nxJoul3ZE-d_9gE_t5WClrDUIPVcAdx_0 2024-09-12T19:13:57.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2558045122050670477', time=2024-09-12T21:09:40.736712+0000, chain.objs.size()=1 2024-09-12T19:13:57.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.632__shadow_.t6rJny8njpxPrU2LdC8chjZeE3SQHGm_0 2024-09-12T19:13:57.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6852034630762837233', time=2024-09-12T21:10:08.105190+0000, chain.objs.size()=1 2024-09-12T19:13:57.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.424+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.665__shadow_.2McpdT31gOpQ2sREJBlzpx4sKf6tj7q_0 2024-09-12T19:13:57.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.432+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.432+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T19:13:57.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47061' 2024-09-12T19:13:57.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1505700649569111576', time=2024-09-12T20:57:30.358290+0000, chain.objs.size()=3 2024-09-12T19:13:57.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.158__shadow_.YQ3S28SZCoSR19dhajzKxDNzWM54r-A_0 2024-09-12T19:13:57.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.158__shadow_.YQ3S28SZCoSR19dhajzKxDNzWM54r-A_1 2024-09-12T19:13:57.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.158__shadow_.YQ3S28SZCoSR19dhajzKxDNzWM54r-A_2 2024-09-12T19:13:57.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10985969807560379172', time=2024-09-12T20:59:50.103972+0000, chain.objs.size()=1 2024-09-12T19:13:57.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.233__shadow_.1c0Ky_G1h421hYeo5cBoZ5QQUXleGKy_0 2024-09-12T19:13:57.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.176272906029326436', time=2024-09-12T21:00:00.763696+0000, chain.objs.size()=1 2024-09-12T19:13:57.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.245__shadow_.R08VcnbDa1FDHPh1qZ8LXf9a68lDEFu_0 2024-09-12T19:13:57.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11305035501287071237', time=2024-09-12T21:00:00.766679+0000, chain.objs.size()=1 2024-09-12T19:13:57.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.245__shadow_.m0bfZ13VxBXzbmIr7KVV2VwQJHVygRW_0 2024-09-12T19:13:57.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6517751420257693529', time=2024-09-12T21:00:11.708832+0000, chain.objs.size()=1 2024-09-12T19:13:57.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.260__shadow_.5A1MQ6EVzAq26JAf-4inBzvyVzN9-2O_0 2024-09-12T19:13:57.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17764758895185601012', time=2024-09-12T21:00:32.075577+0000, chain.objs.size()=1 2024-09-12T19:13:57.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.oB_7miNDPRyP9XQwuiSYxHLmae-_ohA_0 2024-09-12T19:13:57.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2267704426597577837', time=2024-09-12T21:00:32.224320+0000, chain.objs.size()=1 2024-09-12T19:13:57.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.w4Llkevrd4gslo6W30ZStJbir6vHpzT_0 2024-09-12T19:13:57.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3451200348815138781', time=2024-09-12T21:00:32.253920+0000, chain.objs.size()=1 2024-09-12T19:13:57.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XNEykWLFlHgAHeUrDKNKgtlNoG2PuF-_0 2024-09-12T19:13:57.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1817828712084422552', time=2024-09-12T21:00:32.269655+0000, chain.objs.size()=1 2024-09-12T19:13:57.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ucJjEkwZ878uU1czUNiR0pm__y_3duA_0 2024-09-12T19:13:57.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8641568360064402692', time=2024-09-12T21:00:32.273875+0000, chain.objs.size()=1 2024-09-12T19:13:57.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.436+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Io-fiqP6HgERhZ_lmh4W5mRRcgBzMVW_0 2024-09-12T19:13:57.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.440+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2617667036131137579', time=2024-09-12T21:00:32.309459+0000, chain.objs.size()=1 2024-09-12T19:13:57.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.440+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.GWcOLkZMdwV2xwLnwJXA9h0tRaUH885_0 2024-09-12T19:13:57.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.440+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10628314896501212375', time=2024-09-12T21:00:32.348852+0000, chain.objs.size()=1 2024-09-12T19:13:57.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.440+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.BlTYnZxuk3vzRkvzUYXHeyBaxeqC7tn_0 2024-09-12T19:13:57.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.440+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4011358599733369496', time=2024-09-12T21:00:32.440571+0000, chain.objs.size()=1 2024-09-12T19:13:57.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.440+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.hH9fNzFztykA9XBNXUPlOV57buJNXwE_0 2024-09-12T19:13:57.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.440+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9530365193856746800', time=2024-09-12T21:00:32.489317+0000, chain.objs.size()=1 2024-09-12T19:13:57.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.440+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.uUQkkftu-qG_dmhuFh0RaL4uMgly2Jb_0 2024-09-12T19:13:57.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10195623946621620169', time=2024-09-12T21:00:32.494766+0000, chain.objs.size()=1 2024-09-12T19:13:57.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.coa-h03BgzEwgFSIdIOo7azAw7DafUe_0 2024-09-12T19:13:57.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2200654860357346394', time=2024-09-12T21:00:32.516841+0000, chain.objs.size()=1 2024-09-12T19:13:57.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qFfie-hO2AtLuew4TqzkpMhmpA0HL8Z_0 2024-09-12T19:13:57.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7169795269136653091', time=2024-09-12T21:00:32.524025+0000, chain.objs.size()=1 2024-09-12T19:13:57.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.81g0l0jcKkyfsZNQnncOcvWtS7gsRrB_0 2024-09-12T19:13:57.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14094655842923594048', time=2024-09-12T21:00:32.553393+0000, chain.objs.size()=1 2024-09-12T19:13:57.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.b3MUQPVp5P3Srsyr8tNy8oTNh4C5z--_0 2024-09-12T19:13:57.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.739442229610389648', time=2024-09-12T21:00:32.691499+0000, chain.objs.size()=1 2024-09-12T19:13:57.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.F1gXyxh8NmbJQ7U-5BS756vqB8q81iQ_0 2024-09-12T19:13:57.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13556698468869825436', time=2024-09-12T21:00:32.703966+0000, chain.objs.size()=1 2024-09-12T19:13:57.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7BqicRsZMpdNdQnL1sbhMdGw5vCMXYs_0 2024-09-12T19:13:57.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.212001002065599849', time=2024-09-12T21:00:32.730882+0000, chain.objs.size()=1 2024-09-12T19:13:57.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.OVmR1SWldEP8CeY3AHxeFBOqMGUWdpz_0 2024-09-12T19:13:57.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9839452485925460742', time=2024-09-12T21:00:32.756787+0000, chain.objs.size()=1 2024-09-12T19:13:57.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.444+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.HyeCuFhBEN48kSFlfVlpujjeTnxrybP_0 2024-09-12T19:13:57.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16686798289968920703', time=2024-09-12T21:00:32.873582+0000, chain.objs.size()=1 2024-09-12T19:13:57.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.y1fLJmXWIWf3CV3nm6A6U_aky7HVIro_0 2024-09-12T19:13:57.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12860042668917551608', time=2024-09-12T21:00:32.922205+0000, chain.objs.size()=1 2024-09-12T19:13:57.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3ArOLGiG_-5-uXLvQL3uStabpivZefH_0 2024-09-12T19:13:57.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2926412126150149618', time=2024-09-12T21:00:32.942610+0000, chain.objs.size()=1 2024-09-12T19:13:57.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.faFrY2qFg64Z0dZyG1eLSIeLG8o5EaA_0 2024-09-12T19:13:57.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10835503738748918709', time=2024-09-12T21:00:32.981835+0000, chain.objs.size()=1 2024-09-12T19:13:57.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3OaZrNBcWlOvaxFRXhppju-Rt4QUuHt_0 2024-09-12T19:13:57.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16311523541421898486', time=2024-09-12T21:00:32.989443+0000, chain.objs.size()=1 2024-09-12T19:13:57.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ow3Tv1HZZR7JPyR3LAlA2JX_XmcrENS_0 2024-09-12T19:13:57.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1668096459210305778', time=2024-09-12T21:00:32.990189+0000, chain.objs.size()=1 2024-09-12T19:13:57.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WjAFZ-trVqshNK3OBmsHggiE-tvYol1_0 2024-09-12T19:13:57.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16375594359176099182', time=2024-09-12T21:00:33.118883+0000, chain.objs.size()=1 2024-09-12T19:13:57.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.6f-UqQfh8t2Rs7j8kRORwpWztVD2F12_0 2024-09-12T19:13:57.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4697617020689268096', time=2024-09-12T21:00:33.124886+0000, chain.objs.size()=1 2024-09-12T19:13:57.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_._48bVfQ8yI2kC8IqiOdkRD3rL6kI5IV_0 2024-09-12T19:13:57.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3378382742387827216', time=2024-09-12T21:00:33.167332+0000, chain.objs.size()=1 2024-09-12T19:13:57.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SAW94afISVNmvibgfI1vaqzk5T82Pe-_0 2024-09-12T19:13:57.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2241025706343260705', time=2024-09-12T21:00:33.357127+0000, chain.objs.size()=1 2024-09-12T19:13:57.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.EqY54xuunSs5TmJ4ddmtXWtauCmpEhg_0 2024-09-12T19:13:57.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12344341137002390054', time=2024-09-12T21:00:33.361709+0000, chain.objs.size()=1 2024-09-12T19:13:57.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.YBu-gZoMqZrIheIn1yKYIuylno5Hsxk_0 2024-09-12T19:13:57.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17727038227968891189', time=2024-09-12T21:00:33.414851+0000, chain.objs.size()=1 2024-09-12T19:13:57.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.UgIzrT3LkrEsos-un10Nm92wa-z_9-u_0 2024-09-12T19:13:57.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17938445940084290310', time=2024-09-12T21:00:33.433992+0000, chain.objs.size()=1 2024-09-12T19:13:57.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.5VrZky6Nn4TtE-OBrHCCJJwGxwxzS2B_0 2024-09-12T19:13:57.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7347591609839921304', time=2024-09-12T21:00:33.454080+0000, chain.objs.size()=1 2024-09-12T19:13:57.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.UjsOWejWDJT_qzQFFdo0FcSHT9RI3c4_0 2024-09-12T19:13:57.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11341668173906709087', time=2024-09-12T21:00:33.618546+0000, chain.objs.size()=1 2024-09-12T19:13:57.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.HwzNF9_24UiJMjyDsuFQHj9FELNMZMF_0 2024-09-12T19:13:57.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16979287950470456737', time=2024-09-12T21:00:33.619853+0000, chain.objs.size()=1 2024-09-12T19:13:57.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.448+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.bc9RnE-kM9_H4Pmg5343_iW22ByaOec_0 2024-09-12T19:13:57.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.197818599833048705', time=2024-09-12T21:00:33.643557+0000, chain.objs.size()=1 2024-09-12T19:13:57.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.xbRXTKeVd8vI9ItAi8CtQSDXLwbsYbH_0 2024-09-12T19:13:57.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17732455396646923841', time=2024-09-12T21:00:33.647664+0000, chain.objs.size()=1 2024-09-12T19:13:57.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.NXlf4jny5NqUqNWx897nzptKUSXKEEs_0 2024-09-12T19:13:57.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5515555807857756726', time=2024-09-12T21:00:33.883888+0000, chain.objs.size()=1 2024-09-12T19:13:57.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.rG1uTdOIw82tT-BqtwMwV5SeWmKkSmt_0 2024-09-12T19:13:57.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11499618228109833793', time=2024-09-12T21:00:34.599156+0000, chain.objs.size()=1 2024-09-12T19:13:57.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.263__shadow_.poCMzc3cGzN7YN6cZDp5g-9IsV8Hk1I_0 2024-09-12T19:13:57.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15822988276788915460', time=2024-09-12T21:00:38.117928+0000, chain.objs.size()=1 2024-09-12T19:13:57.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.268__shadow_.trxEwiD3hHwmH_uTa_Rfj3BB7N-vmTu_0 2024-09-12T19:13:57.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10368250046838943482', time=2024-09-12T21:00:40.305335+0000, chain.objs.size()=1 2024-09-12T19:13:57.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.271__shadow_.oUorz3O_oSEDHxP2hDd27r-4zS5TCBb_0 2024-09-12T19:13:57.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14531252516302306228', time=2024-09-12T21:00:41.731997+0000, chain.objs.size()=1 2024-09-12T19:13:57.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.273__shadow_.1TkMrHcWWDg5wgn81eCOeAFstHQuVDJ_0 2024-09-12T19:13:57.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6026582360136478758', time=2024-09-12T21:00:41.734892+0000, chain.objs.size()=1 2024-09-12T19:13:57.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.273__shadow_.6StiuWBuQNwPa14IEABZMZiLTL3WeA1_0 2024-09-12T19:13:57.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7834829006804044314', time=2024-09-12T21:00:50.591586+0000, chain.objs.size()=1 2024-09-12T19:13:57.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.285__shadow_.bs6D4wKEGjlCp-4z3YcSUm3zmn1cp1c_0 2024-09-12T19:13:57.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13090479391138161961', time=2024-09-12T21:00:51.334925+0000, chain.objs.size()=1 2024-09-12T19:13:57.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.286__shadow_.dntcUCRIHHLBfhMc1KhG45htKRa6zSz_0 2024-09-12T19:13:57.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15178390262956055790', time=2024-09-12T21:00:52.093804+0000, chain.objs.size()=1 2024-09-12T19:13:57.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.287__shadow_.ZiZznph1pERLRPFg0lbWa2u_XINAA8l_0 2024-09-12T19:13:57.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14436580938086209726', time=2024-09-12T21:00:56.713250+0000, chain.objs.size()=1 2024-09-12T19:13:57.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.lOqXUHgpqGza1Ws4aBp5m5gJkKICT1Y_0 2024-09-12T19:13:57.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18250939354704203335', time=2024-09-12T21:01:01.000928+0000, chain.objs.size()=1 2024-09-12T19:13:57.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.452+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.297__shadow_.coRwjG0tV45S2rB5clMoy4YZXaYgBfT_0 2024-09-12T19:13:57.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12592860788003558459', time=2024-09-12T21:01:39.455185+0000, chain.objs.size()=1 2024-09-12T19:13:57.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DPC7CBIW6Cq5GFbrJqNZhRFuNuHeNC8_0 2024-09-12T19:13:57.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15939227064615789644', time=2024-09-12T21:01:39.476182+0000, chain.objs.size()=1 2024-09-12T19:13:57.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.m01FZStXdkOCHNdmuPzH9zh_4cty3FY_0 2024-09-12T19:13:57.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2066164567111837305', time=2024-09-12T21:01:39.491163+0000, chain.objs.size()=1 2024-09-12T19:13:57.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._vYITkGEyA8bpo4J8E5o5zhImgzxWNt_0 2024-09-12T19:13:57.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5737164866538179424', time=2024-09-12T21:01:39.512955+0000, chain.objs.size()=1 2024-09-12T19:13:57.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Kei7Q2w830LxHfh2owZDr0FpUQRX4Sr_0 2024-09-12T19:13:57.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7211330476983265314', time=2024-09-12T21:01:39.531946+0000, chain.objs.size()=1 2024-09-12T19:13:57.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.CaRMSDp_UkIcWHdcPEWcWmMjVBlfrR0_0 2024-09-12T19:13:57.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9480789845246153300', time=2024-09-12T21:01:39.711716+0000, chain.objs.size()=1 2024-09-12T19:13:57.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QqHB6xoY-oR3GYblu7W51u6IGwIm0c9_0 2024-09-12T19:13:57.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1302365342264516410', time=2024-09-12T21:01:39.742816+0000, chain.objs.size()=1 2024-09-12T19:13:57.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ub9f72i5DiMriShVHUpRP5vZGhJVluk_0 2024-09-12T19:13:57.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14933739374823710776', time=2024-09-12T21:01:39.752027+0000, chain.objs.size()=1 2024-09-12T19:13:57.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.bc_6zU9pUOMYbYXV_A0lf7z2hkMnfYB_0 2024-09-12T19:13:57.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15853381431939501591', time=2024-09-12T21:01:39.895101+0000, chain.objs.size()=1 2024-09-12T19:13:57.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.456+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.XUvUUF_lKEuN5mAv893gN3JfVWlw0Rp_0 2024-09-12T19:13:57.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1614255758084697500', time=2024-09-12T21:01:39.958663+0000, chain.objs.size()=1 2024-09-12T19:13:57.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.b7InTBxkXJ1Qhe7q1dgQZ7PDOHv6ylA_0 2024-09-12T19:13:57.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.971521671565120922', time=2024-09-12T21:01:39.972466+0000, chain.objs.size()=1 2024-09-12T19:13:57.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mVibLuhHkl88cmxIuHsMixjihHLyj5f_0 2024-09-12T19:13:57.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13556288893288411564', time=2024-09-12T21:01:39.973405+0000, chain.objs.size()=1 2024-09-12T19:13:57.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Q1LChc6lUiqhVDhBZrTpcGoU-3sPcOl_0 2024-09-12T19:13:57.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8433147009324140203', time=2024-09-12T21:01:39.996094+0000, chain.objs.size()=1 2024-09-12T19:13:57.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.p6-_FAXuUWVKQtyQtGzWPgOvsbntlQm_0 2024-09-12T19:13:57.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12540213646154807081', time=2024-09-12T21:01:40.154088+0000, chain.objs.size()=1 2024-09-12T19:13:57.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QuWE6YCMKrXMoyqCdONZxu1XDPiyLXu_0 2024-09-12T19:13:57.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5718887380659064125', time=2024-09-12T21:01:40.166883+0000, chain.objs.size()=1 2024-09-12T19:13:57.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.kvXh-V_QAkJku8MgAkg1Vlb6gdauekT_0 2024-09-12T19:13:57.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6158566855363256261', time=2024-09-12T21:01:40.192935+0000, chain.objs.size()=1 2024-09-12T19:13:57.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.WOAIEpAIj2fe5_BF31emZdoCFzBHWTv_0 2024-09-12T19:13:57.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11268989875833800438', time=2024-09-12T21:01:40.217464+0000, chain.objs.size()=1 2024-09-12T19:13:57.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.5oGArSCe3vIjwsbPDSW-b-3nvGyWd7D_0 2024-09-12T19:13:57.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10680004843710499910', time=2024-09-12T21:01:40.224495+0000, chain.objs.size()=1 2024-09-12T19:13:57.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QboTZrZ35pUs-TbJFDL4uoso3VhtQkC_0 2024-09-12T19:13:57.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2013071666446505846', time=2024-09-12T21:01:40.226693+0000, chain.objs.size()=1 2024-09-12T19:13:57.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.jfcFDnQZZLYdrt-FJgE4Cuifpxv7sHa_0 2024-09-12T19:13:57.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8319397692070053446', time=2024-09-12T21:01:40.380632+0000, chain.objs.size()=1 2024-09-12T19:13:57.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-QJcrqP25V4Fg1kp8lUezD_oPKmmsBF_0 2024-09-12T19:13:57.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10358198432595504877', time=2024-09-12T21:01:40.400387+0000, chain.objs.size()=1 2024-09-12T19:13:57.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DQSwJ4mvK8E07y3jpfxuFWv1-j9cs6z_0 2024-09-12T19:13:57.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17672840384632912681', time=2024-09-12T21:01:40.437563+0000, chain.objs.size()=1 2024-09-12T19:13:57.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Dl7Fvq-f8r6sCt5x9PE5bYoVUHVZEjD_0 2024-09-12T19:13:57.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10433500347004531663', time=2024-09-12T21:01:40.450152+0000, chain.objs.size()=1 2024-09-12T19:13:57.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.PRz0Br0f7JZ_PqCImZWz1MEwSStWuU-_0 2024-09-12T19:13:57.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.480036099942123487', time=2024-09-12T21:01:40.571459+0000, chain.objs.size()=1 2024-09-12T19:13:57.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9XWbkoCZ2-Fd2edOv6gEzo0LAygFI9j_0 2024-09-12T19:13:57.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3139484262786748131', time=2024-09-12T21:01:40.616618+0000, chain.objs.size()=1 2024-09-12T19:13:57.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.460+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0lalAKSNqrBUYFV__EUQpDCRsulEGUk_0 2024-09-12T19:13:57.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12474179995806426313', time=2024-09-12T21:01:40.670302+0000, chain.objs.size()=1 2024-09-12T19:13:57.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.uotW80ETJIQud4Q0XUJUzzz5ZDwzGeu_0 2024-09-12T19:13:57.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5736495666741982858', time=2024-09-12T21:01:40.774938+0000, chain.objs.size()=1 2024-09-12T19:13:57.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Ce7fcDgfYcbg_id8AiIbNG1s0vtOpyV_0 2024-09-12T19:13:57.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6162414437435111713', time=2024-09-12T21:01:40.840353+0000, chain.objs.size()=1 2024-09-12T19:13:57.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.q9sKxJLNpq2FMsgX5180COoAK7Lj7aL_0 2024-09-12T19:13:57.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7371380881119561594', time=2024-09-12T21:01:40.895676+0000, chain.objs.size()=1 2024-09-12T19:13:57.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.xrNgKRaV5ZqG-SjDyWogJUj0L7z_yIE_0 2024-09-12T19:13:57.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.496865635788219959', time=2024-09-12T21:01:41.053200+0000, chain.objs.size()=1 2024-09-12T19:13:57.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.rqbhYQLYo34oPvGR5z8W9PGYMeVGlxA_0 2024-09-12T19:13:57.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6051922500408347900', time=2024-09-12T21:01:41.089347+0000, chain.objs.size()=1 2024-09-12T19:13:57.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BiFDRSGZcJyCruMcEpm10k71PfDOcPR_0 2024-09-12T19:13:57.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9020191474137957363', time=2024-09-12T21:01:41.096204+0000, chain.objs.size()=1 2024-09-12T19:13:57.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.S-df4KJNmL6hlg7YT3ij7A4jTgxRnph_0 2024-09-12T19:13:57.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7063047323054892916', time=2024-09-12T21:02:00.534279+0000, chain.objs.size()=1 2024-09-12T19:13:57.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.83N2OhNXTTE5-MeJ1W7_M3kJ86GPpYU_0 2024-09-12T19:13:57.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13942512765238262807', time=2024-09-12T21:02:00.633020+0000, chain.objs.size()=1 2024-09-12T19:13:57.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.pV7eVLXmFcER705rgfsfm9CeaFzNKbN_0 2024-09-12T19:13:57.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14791156975598225104', time=2024-09-12T21:02:00.640153+0000, chain.objs.size()=1 2024-09-12T19:13:57.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.9Y87adlG0m69xytcUw2VowmDK7sTKvD_0 2024-09-12T19:13:57.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.46802169605459790', time=2024-09-12T21:02:00.643031+0000, chain.objs.size()=1 2024-09-12T19:13:57.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Wf0dAfgEmc8miHJOqYOXrG0pE1WUoa4_0 2024-09-12T19:13:57.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12556763497984389386', time=2024-09-12T21:02:00.821753+0000, chain.objs.size()=1 2024-09-12T19:13:57.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.E-BwHuzTXtOAmlaGuU6SFbZtvPlpuyH_0 2024-09-12T19:13:57.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6256960219369672381', time=2024-09-12T21:02:00.869364+0000, chain.objs.size()=1 2024-09-12T19:13:57.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.GeNIDBOysA22P1rHtAQuG9bvfy61EGb_0 2024-09-12T19:13:57.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5000685302782928006', time=2024-09-12T21:02:00.883944+0000, chain.objs.size()=1 2024-09-12T19:13:57.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.4TF0tbavV13DWyCAGl_uOsIowH8r2DM_0 2024-09-12T19:13:57.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15906083871924934525', time=2024-09-12T21:02:00.890792+0000, chain.objs.size()=1 2024-09-12T19:13:57.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5G-aQzQ0cCVGUQGoT_JDrAASgwHWdom_0 2024-09-12T19:13:57.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10476746154927066878', time=2024-09-12T21:02:00.892781+0000, chain.objs.size()=1 2024-09-12T19:13:57.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7ZppyyDKaXPxaJYtrk2v9OS26QJPwoU_0 2024-09-12T19:13:57.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11124557750715510557', time=2024-09-12T21:02:01.021505+0000, chain.objs.size()=1 2024-09-12T19:13:57.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Id06oyu9lWMmddliuF_P9k2aOumiMw5_0 2024-09-12T19:13:57.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8620179019326161994', time=2024-09-12T21:02:01.038486+0000, chain.objs.size()=1 2024-09-12T19:13:57.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.eaW90jP5Uzlu54FrAr3lCDovG1N7cGH_0 2024-09-12T19:13:57.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12533850750489695994', time=2024-09-12T21:02:01.052475+0000, chain.objs.size()=1 2024-09-12T19:13:57.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.itg7vppod4meRD-rLUxsQBbjs5DvqhE_0 2024-09-12T19:13:57.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15972244059442507412', time=2024-09-12T21:02:01.274150+0000, chain.objs.size()=1 2024-09-12T19:13:57.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.464+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ngRTeGKgvZ3HZjFdiL02zGNtPgEY7Ge_0 2024-09-12T19:13:57.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.468+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2950695683314072818', time=2024-09-12T21:02:01.324121+0000, chain.objs.size()=1 2024-09-12T19:13:57.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.468+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.y_MTqwPqITjDYr_xe6b0yFUp2wXTLoi_0 2024-09-12T19:13:57.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.468+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.908272511106793427', time=2024-09-12T21:02:01.334069+0000, chain.objs.size()=1 2024-09-12T19:13:57.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.468+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.X7IC6FcThOQ0dQCj69nCQGL4HDxvyvv_0 2024-09-12T19:13:57.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.468+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11807928322584552993', time=2024-09-12T21:02:01.462834+0000, chain.objs.size()=1 2024-09-12T19:13:57.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.468+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.oYAANQ4nNDE7xKKHhQYllRrtdD3ZpwQ_0 2024-09-12T19:13:57.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.468+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.621942893377544488', time=2024-09-12T21:02:01.479890+0000, chain.objs.size()=1 2024-09-12T19:13:57.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.468+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.pnpsXF-B7Hp8wB-Enx3yo83K8bQ4vY__0 2024-09-12T19:13:57.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.468+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47061 2024-09-12T19:13:57.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T19:13:57.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13105081973309363891', time=2024-09-12T21:02:01.526947+0000, chain.objs.size()=1 2024-09-12T19:13:57.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0NxD7qV1fPyx-fLun_zjM9gCPsHkUDR_0 2024-09-12T19:13:57.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2153721495654211928', time=2024-09-12T21:02:01.542249+0000, chain.objs.size()=1 2024-09-12T19:13:57.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ZSKobpxm5IOZr9TduauTLa1Q8scW9ML_0 2024-09-12T19:13:57.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7344226111554791622', time=2024-09-12T21:02:01.547155+0000, chain.objs.size()=1 2024-09-12T19:13:57.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.BT0a5KDJmm2V7h-2mznh6yoVeKSF40F_0 2024-09-12T19:13:57.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15466608834968883889', time=2024-09-12T21:02:01.665480+0000, chain.objs.size()=1 2024-09-12T19:13:57.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.xXs5PtXKf7aCoYjF5h3y5OADq5wpXpD_0 2024-09-12T19:13:57.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10524602133069887334', time=2024-09-12T21:02:01.693997+0000, chain.objs.size()=1 2024-09-12T19:13:57.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.a9nXeqJQB8-G9a8eVPs8xufki-TmPOl_0 2024-09-12T19:13:57.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8486127492635741212', time=2024-09-12T21:02:01.747811+0000, chain.objs.size()=1 2024-09-12T19:13:57.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.9SnNxXx4lb4KNqztHNUpbfEAI75r5eZ_0 2024-09-12T19:13:57.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16908357116466264084', time=2024-09-12T21:02:01.894900+0000, chain.objs.size()=1 2024-09-12T19:13:57.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.PWuCx_pzKhZ0XMx883dvv6gogUKnllR_0 2024-09-12T19:13:57.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15779818058734825392', time=2024-09-12T21:02:01.897713+0000, chain.objs.size()=1 2024-09-12T19:13:57.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.q6PwumGx9A2X4O_QSkL97TtYrB0NgVo_0 2024-09-12T19:13:57.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.273266726810417996', time=2024-09-12T21:02:01.999081+0000, chain.objs.size()=1 2024-09-12T19:13:57.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.9j54fUM4VzR-7npwmXxlQQWUnMp8bua_0 2024-09-12T19:13:57.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8008304104145507971', time=2024-09-12T21:02:02.179226+0000, chain.objs.size()=1 2024-09-12T19:13:57.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.AoQAJ9YhW2gDQN6r-kADxtvUVSUL2c2_0 2024-09-12T19:13:57.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8824881900016821103', time=2024-09-12T21:02:02.184759+0000, chain.objs.size()=1 2024-09-12T19:13:57.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.tgmhVI1QQ_r2NEqiF9O7GXg05vfUmfY_0 2024-09-12T19:13:57.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15467346960939619943', time=2024-09-12T21:02:02.189360+0000, chain.objs.size()=1 2024-09-12T19:13:57.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qvMHCl2rI4vQbAKiEABYynAMcEDMZ1r_0 2024-09-12T19:13:57.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.278297270244394793', time=2024-09-12T21:02:02.197269+0000, chain.objs.size()=1 2024-09-12T19:13:57.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.OKyPQq2xCIDQuEDGCHT8tfnz6THksyU_0 2024-09-12T19:13:57.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5232480933225274447', time=2024-09-12T21:02:46.583619+0000, chain.objs.size()=1 2024-09-12T19:13:57.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.390__shadow_.oStkHInrxbpJ_CvHfEbyBK-hg3xtA9P_0 2024-09-12T19:13:57.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12292273083683310103', time=2024-09-12T21:03:23.678411+0000, chain.objs.size()=1 2024-09-12T19:13:57.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.440__shadow_.lnDDFSVKIu_ZskVtfg9_eC8Ttx7X0S2_0 2024-09-12T19:13:57.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5513571697829088330', time=2024-09-12T21:03:53.923026+0000, chain.objs.size()=1 2024-09-12T19:13:57.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.481__shadow_.UpBmws-qU8_AuN311djSDGKnAT-Tu-F_0 2024-09-12T19:13:57.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3121642073101972285', time=2024-09-12T21:04:18.309380+0000, chain.objs.size()=1 2024-09-12T19:13:57.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.472+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.515__shadow_.uzUQPbRhkC7Ig_tt8V7KsDpDovFjstB_0 2024-09-12T19:13:57.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-lKQlx-AED4_S-m07z6TjnVrPSqLG9F', time=2024-09-12T21:04:44.025069+0000, chain.objs.size()=1 2024-09-12T19:13:57.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~-lKQlx-AED4_S-m07z6TjnVrPSqLG9F.1 2024-09-12T19:13:57.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-lKQlx-AED4_S-m07z6TjnVrPSqLG9F', time=2024-09-12T21:04:44.028085+0000, chain.objs.size()=1 2024-09-12T19:13:57.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~-lKQlx-AED4_S-m07z6TjnVrPSqLG9F.2 2024-09-12T19:13:57.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-lKQlx-AED4_S-m07z6TjnVrPSqLG9F', time=2024-09-12T21:04:44.031170+0000, chain.objs.size()=1 2024-09-12T19:13:57.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~-lKQlx-AED4_S-m07z6TjnVrPSqLG9F.3 2024-09-12T19:13:57.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-lKQlx-AED4_S-m07z6TjnVrPSqLG9F', time=2024-09-12T21:04:44.034207+0000, chain.objs.size()=1 2024-09-12T19:13:57.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~-lKQlx-AED4_S-m07z6TjnVrPSqLG9F.4 2024-09-12T19:13:57.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-lKQlx-AED4_S-m07z6TjnVrPSqLG9F', time=2024-09-12T21:04:44.037163+0000, chain.objs.size()=1 2024-09-12T19:13:57.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~-lKQlx-AED4_S-m07z6TjnVrPSqLG9F.5 2024-09-12T19:13:57.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-lKQlx-AED4_S-m07z6TjnVrPSqLG9F', time=2024-09-12T21:04:44.040200+0000, chain.objs.size()=1 2024-09-12T19:13:57.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~-lKQlx-AED4_S-m07z6TjnVrPSqLG9F.6 2024-09-12T19:13:57.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16520671136012907386', time=2024-09-12T21:04:44.051867+0000, chain.objs.size()=6 2024-09-12T19:13:57.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~xyTjIADqDpLw296djO2Wsq1SEMN-0yM.1 2024-09-12T19:13:57.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.vodaSabru4lOYeJ988MTdZmAqQEEh1h6.2 2024-09-12T19:13:57.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.TBW0Qx2momeci7hxTi0UZ74rUUr1nUy3.3 2024-09-12T19:13:57.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~xyTjIADqDpLw296djO2Wsq1SEMN-0yM.4 2024-09-12T19:13:57.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~xyTjIADqDpLw296djO2Wsq1SEMN-0yM.5 2024-09-12T19:13:57.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~xyTjIADqDpLw296djO2Wsq1SEMN-0yM.6 2024-09-12T19:13:57.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6791067000555916822', time=2024-09-12T21:06:12.155244+0000, chain.objs.size()=1 2024-09-12T19:13:57.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.570__shadow:0LHD.9LZd47a29BQas6pwRTMhl74gXa_.Nlf3N1hJpQAFsm25aP0UEWDepnoGLsF_0 2024-09-12T19:13:57.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18330506063278110313', time=2024-09-12T21:06:40.626398+0000, chain.objs.size()=1 2024-09-12T19:13:57.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:AUwwbOkmUfMpklT.utwTfVPQY.IYJfx_.izXImDseuMjt3Vj_sgCZo_SwVoOpw5m_0 2024-09-12T19:13:57.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16864131855062052875', time=2024-09-12T21:07:04.793462+0000, chain.objs.size()=1 2024-09-12T19:13:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.604__shadow_.GRtAum26NCEELJqMj1NZx2yAFcRkTYc_0 2024-09-12T19:13:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6112938359180458591', time=2024-09-12T21:09:55.809392+0000, chain.objs.size()=1 2024-09-12T19:13:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.651__shadow_.tLslwtOScp96DWcaj8cfBWkbvdupJxZ_0 2024-09-12T19:13:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9852019534022163544', time=2024-09-12T21:10:10.506944+0000, chain.objs.size()=1 2024-09-12T19:13:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.668__shadow_.WLidjNNXGoEPgsrwYnZ3zdAtShQYsfC_0 2024-09-12T19:13:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1707584192879883387', time=2024-09-12T21:11:21.118117+0000, chain.objs.size()=3 2024-09-12T19:13:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.476+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.743__multipart_mymultipart3.2~HF76auHla7nARkAoUq3ReCu3ae9_jV4.1 2024-09-12T19:13:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.480+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.743__multipart_mymultipart3.2~HF76auHla7nARkAoUq3ReCu3ae9_jV4.2 2024-09-12T19:13:57.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.480+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.743__multipart_mymultipart3.2~HF76auHla7nARkAoUq3ReCu3ae9_jV4.3 2024-09-12T19:13:57.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.480+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.484+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T19:13:57.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.484+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.484+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/64639' 2024-09-12T19:13:57.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14544723711482282867', time=2024-09-12T20:57:33.103271+0000, chain.objs.size()=3 2024-09-12T19:13:57.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.mzfuLFv3LrchD32WdOZo-Ivc457wBUr_0 2024-09-12T19:13:57.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.mzfuLFv3LrchD32WdOZo-Ivc457wBUr_1 2024-09-12T19:13:57.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.mzfuLFv3LrchD32WdOZo-Ivc457wBUr_2 2024-09-12T19:13:57.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_2OT7pljlCxGgthJcq2LNtKJObhNmo3L', time=2024-09-12T20:57:37.555436+0000, chain.objs.size()=1 2024-09-12T19:13:57.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.163__shadow_.onGs8eJti3WTt7okMArSwH36Bx6Gag3_0 2024-09-12T19:13:57.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13868194698096838853', time=2024-09-12T20:59:54.793258+0000, chain.objs.size()=1 2024-09-12T19:13:57.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.238__shadow_.rkHBiqkU_DcKnFasdpTfnhIn2a3gq9Y_0 2024-09-12T19:13:57.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7300985992360939598', time=2024-09-12T20:59:56.923804+0000, chain.objs.size()=1 2024-09-12T19:13:57.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.241__shadow_.-i2vLTYESbm7DYg3-em06jnB16BNFYq_0 2024-09-12T19:13:57.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10826196282805005441', time=2024-09-12T20:59:58.865861+0000, chain.objs.size()=1 2024-09-12T19:13:57.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.243__shadow_.kldOlgyZOYTjeUzdTY96TmzC8yxTxY6_0 2024-09-12T19:13:57.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15630876431775019163', time=2024-09-12T21:00:07.379029+0000, chain.objs.size()=1 2024-09-12T19:13:57.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.254__shadow_.fU2KJYqIHRRYaZngRvq2LTXlbDvxuGs_0 2024-09-12T19:13:57.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3178780387875890462', time=2024-09-12T21:00:32.012128+0000, chain.objs.size()=1 2024-09-12T19:13:57.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.1PdTry7OYjJSQUsNO10f0memaGk-g2A_0 2024-09-12T19:13:57.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13451180376970061508', time=2024-09-12T21:00:32.025881+0000, chain.objs.size()=1 2024-09-12T19:13:57.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.u2ucq5gVlnT0hPplTJEjaKCjDFaYrgU_0 2024-09-12T19:13:57.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6722371074568296623', time=2024-09-12T21:00:32.045005+0000, chain.objs.size()=1 2024-09-12T19:13:57.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sfk7iVPRYQ_dJliLl2af2K4SphUuZIC_0 2024-09-12T19:13:57.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8242536462549516159', time=2024-09-12T21:00:32.080000+0000, chain.objs.size()=1 2024-09-12T19:13:57.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WsXK2II819WTzW7xPy4y6dAPsr8DIxl_0 2024-09-12T19:13:57.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4735241595850707981', time=2024-09-12T21:00:32.107545+0000, chain.objs.size()=1 2024-09-12T19:13:57.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7uP0t-I-6vKe8WrXUu5v_ii0MUXXMSs_0 2024-09-12T19:13:57.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4172617651484688648', time=2024-09-12T21:00:32.110188+0000, chain.objs.size()=1 2024-09-12T19:13:57.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3EY4UHOfpc3PNeTPUN-0hDT37YTwnwg_0 2024-09-12T19:13:57.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2235033991098981109', time=2024-09-12T21:00:32.271392+0000, chain.objs.size()=1 2024-09-12T19:13:57.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Vsql3KjOFcIZxFeFdcvARSkp-tCgcFu_0 2024-09-12T19:13:57.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16586091666391904424', time=2024-09-12T21:00:32.291574+0000, chain.objs.size()=1 2024-09-12T19:13:57.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tKOR2NbKXSfiq52Fc0E_rDEuG_j6gRj_0 2024-09-12T19:13:57.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15128409865694986536', time=2024-09-12T21:00:32.488152+0000, chain.objs.size()=1 2024-09-12T19:13:57.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.8PIf5rVUp_aQPG9H4WbYh4qOfIb_GC8_0 2024-09-12T19:13:57.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14762416949116455585', time=2024-09-12T21:00:32.532376+0000, chain.objs.size()=1 2024-09-12T19:13:57.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.GRdg28Th7oTSxJtlt-omWMsah3oc3N1_0 2024-09-12T19:13:57.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9567207675123175909', time=2024-09-12T21:00:32.550114+0000, chain.objs.size()=1 2024-09-12T19:13:57.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.488+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ifETmujevLWXAbiHmMymBMAdFxnnaSV_0 2024-09-12T19:13:57.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6036709826243417776', time=2024-09-12T21:00:32.559345+0000, chain.objs.size()=1 2024-09-12T19:13:57.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.VWUBExOdnKZLPRJfzm_nCcqIk0RiYf4_0 2024-09-12T19:13:57.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13536563639913799137', time=2024-09-12T21:00:32.668090+0000, chain.objs.size()=1 2024-09-12T19:13:57.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.L7biwESpnmWmu_yZKqy00e0O2qnaVLu_0 2024-09-12T19:13:57.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3585362864771488768', time=2024-09-12T21:00:32.680894+0000, chain.objs.size()=1 2024-09-12T19:13:57.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JTvoldPmrqmDaBSKleEcNNy2tkPxHvW_0 2024-09-12T19:13:57.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6360097781247112313', time=2024-09-12T21:00:32.750816+0000, chain.objs.size()=1 2024-09-12T19:13:57.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.6ttB7c6Hge6YpTcDk8lDUfOT5UqRcQy_0 2024-09-12T19:13:57.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8579251240572733051', time=2024-09-12T21:00:32.762075+0000, chain.objs.size()=1 2024-09-12T19:13:57.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_._hLpaSay9hy7GHbvhV4YvEsAO8enzkP_0 2024-09-12T19:13:57.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5301187680467677313', time=2024-09-12T21:00:32.767667+0000, chain.objs.size()=1 2024-09-12T19:13:57.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.8ZYYC_OfbIVT84p3KiKvAGCEZS0PHOP_0 2024-09-12T19:13:57.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12954344902825720740', time=2024-09-12T21:00:32.906341+0000, chain.objs.size()=1 2024-09-12T19:13:57.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DQAO7ep37934u8BppMfKQiJNt3xw0e3_0 2024-09-12T19:13:57.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.697573538565931508', time=2024-09-12T21:00:32.968955+0000, chain.objs.size()=1 2024-09-12T19:13:57.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.pOHXZwZTvELrgUQxQi-Nb75F5W1_gPw_0 2024-09-12T19:13:57.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5491233123235563060', time=2024-09-12T21:00:32.979359+0000, chain.objs.size()=1 2024-09-12T19:13:57.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sJA2CeiaE95C4SW3AlgLMHmhnWo0tka_0 2024-09-12T19:13:57.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2248065135518598547', time=2024-09-12T21:00:32.990651+0000, chain.objs.size()=1 2024-09-12T19:13:57.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.492+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sVdK5WLs9NRtRJtvEcz-HvaSIoF6hPG_0 2024-09-12T19:13:57.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2357575840933328088', time=2024-09-12T21:00:33.089566+0000, chain.objs.size()=1 2024-09-12T19:13:57.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.BXhj7CqqXcgebHXszgt-IDZ5n8g_ny7_0 2024-09-12T19:13:57.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12527443418745228237', time=2024-09-12T21:00:33.098263+0000, chain.objs.size()=1 2024-09-12T19:13:57.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.0YLGlv9gb_tsUEqHXbpB9zgIm907uMl_0 2024-09-12T19:13:57.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5252097883857024372', time=2024-09-12T21:00:33.107383+0000, chain.objs.size()=1 2024-09-12T19:13:57.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2pKnjg7k835SNR2VnaWGMIxVUA7yFkU_0 2024-09-12T19:13:57.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10131821819829097927', time=2024-09-12T21:00:33.142396+0000, chain.objs.size()=1 2024-09-12T19:13:57.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.GnCe-TvVFezHy2hVl9yCLZlfqWGhL23_0 2024-09-12T19:13:57.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12965401418431186583', time=2024-09-12T21:00:33.210664+0000, chain.objs.size()=1 2024-09-12T19:13:57.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.04xwx8EaTKwMBwVM5ek89zktyCZoMme_0 2024-09-12T19:13:57.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3068572197936514698', time=2024-09-12T21:00:33.217981+0000, chain.objs.size()=1 2024-09-12T19:13:57.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.vhdQi2HsQVCxr35ng6SwyShR4do_UpB_0 2024-09-12T19:13:57.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14801485580892609814', time=2024-09-12T21:00:33.402672+0000, chain.objs.size()=1 2024-09-12T19:13:57.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.fl2kDLxHvKRaeh3z5nWKl1pdmbrvU-n_0 2024-09-12T19:13:57.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2333172268559071724', time=2024-09-12T21:00:33.425386+0000, chain.objs.size()=1 2024-09-12T19:13:57.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Xqo060RCBEW-EEkqf-_S6cVX_8OiNXg_0 2024-09-12T19:13:57.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10302254858223675944', time=2024-09-12T21:00:33.426819+0000, chain.objs.size()=1 2024-09-12T19:13:57.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tFsksNjl8UNxg1FJ11a-1rCQfvFkr0Y_0 2024-09-12T19:13:57.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1288448910110586575', time=2024-09-12T21:00:33.449373+0000, chain.objs.size()=1 2024-09-12T19:13:57.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.496+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.4jxGrOjHfybudX1oXz93CE3GAEfTmeN_0 2024-09-12T19:13:57.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.500+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3390951755447444513', time=2024-09-12T21:00:33.468008+0000, chain.objs.size()=1 2024-09-12T19:13:57.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.500+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Hptw4N74UkPRn7NNvX2kEgWxUSHZ8_I_0 2024-09-12T19:13:57.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.500+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2939018808515212988', time=2024-09-12T21:00:33.608340+0000, chain.objs.size()=1 2024-09-12T19:13:57.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.500+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.oSK1idyUEDvyd0gkaSgBqJfs3opn7tu_0 2024-09-12T19:13:57.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.500+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4793292140899605087', time=2024-09-12T21:00:33.647177+0000, chain.objs.size()=1 2024-09-12T19:13:57.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.500+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.paofno-3X7qjOolwesqfifpzU4YRj8c_0 2024-09-12T19:13:57.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.500+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16090894492425752303', time=2024-09-12T21:00:33.870130+0000, chain.objs.size()=1 2024-09-12T19:13:57.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.500+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.uXe7Yq5Bhk8SwcRDnQKKzOTzjitHK-E_0 2024-09-12T19:13:57.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.500+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8465240445810989467', time=2024-09-12T21:00:33.880996+0000, chain.objs.size()=1 2024-09-12T19:13:57.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.500+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sbslu6SbjaYoYLjU8sL9G54c7xGSsQn_0 2024-09-12T19:13:57.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.504+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6344573225591376193', time=2024-09-12T21:00:33.899424+0000, chain.objs.size()=1 2024-09-12T19:13:57.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.504+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.uX-NRKzPto-ATwZ1kQJWAlsFQl0PdnN_0 2024-09-12T19:13:57.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.504+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2807236914923672864', time=2024-09-12T21:00:33.906459+0000, chain.objs.size()=1 2024-09-12T19:13:57.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.504+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.bXj06QNSnNn28nQCdpMzML-kB7MBXlh_0 2024-09-12T19:13:57.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.504+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5657112028286693224', time=2024-09-12T21:00:45.450218+0000, chain.objs.size()=1 2024-09-12T19:13:57.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.504+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.278__shadow_.rLU6-QanYGAyGZOqcyRpg68VNR-PaoP_0 2024-09-12T19:13:57.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.504+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12693358552129017317', time=2024-09-12T21:00:50.591580+0000, chain.objs.size()=1 2024-09-12T19:13:57.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.504+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.285__shadow_.zf8da-VmfeY8fCCCxnALb3OiA1J3qdo_0 2024-09-12T19:13:57.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.504+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11652990088374435234', time=2024-09-12T21:00:54.256549+0000, chain.objs.size()=1 2024-09-12T19:13:57.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.504+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.290__shadow_.FCrAfN83E0ngIx4MZhwwbu9tICXsbi-_0 2024-09-12T19:13:57.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.504+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5311985503873573870', time=2024-09-12T21:01:02.564352+0000, chain.objs.size()=1 2024-09-12T19:13:57.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.504+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.299__shadow_.rENHuNpcbcOoDc_hn1WKc6rCnF3h4oH_0 2024-09-12T19:13:57.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13623320437704841431', time=2024-09-12T21:01:04.827938+0000, chain.objs.size()=1 2024-09-12T19:13:57.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.302__shadow_.niUKgi9y5W2Y_pCHqH2IJmcnYlyyoJE_0 2024-09-12T19:13:57.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11617234132814785052', time=2024-09-12T21:01:06.303583+0000, chain.objs.size()=1 2024-09-12T19:13:57.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.304__shadow_.ff23vZYS2BU7pScZBiP9EemNvVNxe7N_0 2024-09-12T19:13:57.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13457991241229685201', time=2024-09-12T21:01:17.731010+0000, chain.objs.size()=1 2024-09-12T19:13:57.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.319__shadow:c9mEibdhihDHEmYXuxBy8-.uE.QJHV5_.U1BBxOyUMEnKtg4B60f5b5oPI-YAj18_0 2024-09-12T19:13:57.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2805188066346365136', time=2024-09-12T21:01:18.604798+0000, chain.objs.size()=1 2024-09-12T19:13:57.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.321__shadow_.ucY5cGfdd46iHYLf-2_Oexdk5IbsyXv_0 2024-09-12T19:13:57.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1777284307259397234', time=2024-09-12T21:01:39.463337+0000, chain.objs.size()=1 2024-09-12T19:13:57.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RUJ0u3WmG4MiGoVKrwF3z2QYtR7eNHh_0 2024-09-12T19:13:57.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14840392634734646711', time=2024-09-12T21:01:39.497631+0000, chain.objs.size()=1 2024-09-12T19:13:57.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.rfJnFgRjL5gUIc-eV7XhBpq31tvPhU0_0 2024-09-12T19:13:57.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3788819982596795806', time=2024-09-12T21:01:39.702058+0000, chain.objs.size()=1 2024-09-12T19:13:57.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.tBZ5VB9JltG01xqFJYrQL4LpszvA2p7_0 2024-09-12T19:13:57.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.943314852265861291', time=2024-09-12T21:01:39.896845+0000, chain.objs.size()=1 2024-09-12T19:13:57.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Z3MsHCXS8oZ5gxpN6xp-81tfMr0ua3m_0 2024-09-12T19:13:57.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10737841411814260096', time=2024-09-12T21:01:39.908172+0000, chain.objs.size()=1 2024-09-12T19:13:57.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Iu2hRy0Pd7Oe4Nme-BEYCf0W_Tlo8AV_0 2024-09-12T19:13:57.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4086877042318071366', time=2024-09-12T21:01:39.929160+0000, chain.objs.size()=1 2024-09-12T19:13:57.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.SLtyizxJgbljlGaZYQE-G4dDq6Y5k8A_0 2024-09-12T19:13:57.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16055197601718561433', time=2024-09-12T21:01:39.950080+0000, chain.objs.size()=1 2024-09-12T19:13:57.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ngqCkxLCr6GeNrTC-nlHeGpmdXhMTVF_0 2024-09-12T19:13:57.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6353788880185907811', time=2024-09-12T21:01:39.981589+0000, chain.objs.size()=1 2024-09-12T19:13:57.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.508+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.YQr1OcmKD0pTbrcTszJfB7T1KsY8cre_0 2024-09-12T19:13:57.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17224086429866468694', time=2024-09-12T21:01:39.984757+0000, chain.objs.size()=1 2024-09-12T19:13:57.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.41XeFyCCCEGMCJrNvXvEP4HOnrqehrx_0 2024-09-12T19:13:57.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2278839708224675620', time=2024-09-12T21:01:39.995718+0000, chain.objs.size()=1 2024-09-12T19:13:57.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.eRfAPUGICJdQSz2qgy623yYX2Jj2SrL_0 2024-09-12T19:13:57.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16161795959361250181', time=2024-09-12T21:01:40.199432+0000, chain.objs.size()=1 2024-09-12T19:13:57.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QvyF5liHqyjx2C8rFQJ8OnrHpuKoBlh_0 2024-09-12T19:13:57.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9460365421559005433', time=2024-09-12T21:01:40.215641+0000, chain.objs.size()=1 2024-09-12T19:13:57.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9SVU7qP7bx1eVHCuxQt2b2Kodz_rXy0_0 2024-09-12T19:13:57.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6175223133020305146', time=2024-09-12T21:01:40.226779+0000, chain.objs.size()=1 2024-09-12T19:13:57.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.xa1mVmPISm-F8BX8eel4tsNozV-ouHD_0 2024-09-12T19:13:57.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15548829907790361446', time=2024-09-12T21:01:40.227612+0000, chain.objs.size()=1 2024-09-12T19:13:57.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.oZbmhsKf-YUV1C6Q1WiM51aCVZM29ig_0 2024-09-12T19:13:57.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5468820998899006187', time=2024-09-12T21:01:40.228917+0000, chain.objs.size()=1 2024-09-12T19:13:57.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.CfCngzqvH83aptalmYN5fb45z7myKTi_0 2024-09-12T19:13:57.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5752798871702019948', time=2024-09-12T21:01:40.359133+0000, chain.objs.size()=1 2024-09-12T19:13:57.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.8gnJcUzbmH9gDoGhTJ9KVAPLKgPtzLv_0 2024-09-12T19:13:57.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16308961163208714903', time=2024-09-12T21:01:40.360998+0000, chain.objs.size()=1 2024-09-12T19:13:57.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.D8q6cWEi0eDqC3bMc8wQjBOhD1ZAL36_0 2024-09-12T19:13:57.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6160875508545384735', time=2024-09-12T21:01:40.390301+0000, chain.objs.size()=1 2024-09-12T19:13:57.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.z6B85ukaXzvlLADAv1p5J80Og2IS5Yz_0 2024-09-12T19:13:57.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7706030766589586395', time=2024-09-12T21:01:40.394282+0000, chain.objs.size()=1 2024-09-12T19:13:57.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hk8vbSTEXlPdZ65J_TlbdmoOfrvnayc_0 2024-09-12T19:13:57.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4624957375805277399', time=2024-09-12T21:01:40.407942+0000, chain.objs.size()=1 2024-09-12T19:13:57.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9TgTfXnb59HQL6_mzogQUDH7tAxy8Lj_0 2024-09-12T19:13:57.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.186798353362733579', time=2024-09-12T21:01:40.438190+0000, chain.objs.size()=1 2024-09-12T19:13:57.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.2RQ65fTFZaoGnxTFiPI_3Hy0Lqfvney_0 2024-09-12T19:13:57.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1926776083032787068', time=2024-09-12T21:01:40.448810+0000, chain.objs.size()=1 2024-09-12T19:13:57.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.512+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hMNkLKGBq9khD6HLuA-JufVEClvQ9_9_0 2024-09-12T19:13:57.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6582303535813454197', time=2024-09-12T21:01:40.449552+0000, chain.objs.size()=1 2024-09-12T19:13:57.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.PiasVnN9WweERtC-lsUQY8EBK9PpNZM_0 2024-09-12T19:13:57.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13307888400644861964', time=2024-09-12T21:01:40.451275+0000, chain.objs.size()=1 2024-09-12T19:13:57.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.7ziUGmnOUA0EgUUpngUl5EOFdbotwcQ_0 2024-09-12T19:13:57.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10786205645331810227', time=2024-09-12T21:01:40.629959+0000, chain.objs.size()=1 2024-09-12T19:13:57.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.TzfLPOVZonSObZmoCThKuzvGaExphPE_0 2024-09-12T19:13:57.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8792214045813768881', time=2024-09-12T21:01:40.644762+0000, chain.objs.size()=1 2024-09-12T19:13:57.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.yvru7UOd8GODjWUgvvZ5W7x9eX1GA-C_0 2024-09-12T19:13:57.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13424837008239001209', time=2024-09-12T21:01:40.645729+0000, chain.objs.size()=1 2024-09-12T19:13:57.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.djQ4z1nqJMbJsQPoWuu2UthuJffWaDe_0 2024-09-12T19:13:57.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6478273373962659403', time=2024-09-12T21:01:40.785183+0000, chain.objs.size()=1 2024-09-12T19:13:57.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.dKQTBXjafFmiteWEIbBIvgu195mt5Dw_0 2024-09-12T19:13:57.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.526461765473128799', time=2024-09-12T21:01:40.863820+0000, chain.objs.size()=1 2024-09-12T19:13:57.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.jAV50i9lGuPWRzpDyy3eKqF4ywPR0ff_0 2024-09-12T19:13:57.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11399887467393736092', time=2024-09-12T21:01:41.021153+0000, chain.objs.size()=1 2024-09-12T19:13:57.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0gZZFh2d8QIl4mOKN5GC1wUtDKmJTx4_0 2024-09-12T19:13:57.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1108930166668888876', time=2024-09-12T21:01:41.047570+0000, chain.objs.size()=1 2024-09-12T19:13:57.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.iHdU1H_zecgE9aSdWQ9TvgGiwZcMZhd_0 2024-09-12T19:13:57.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8890943770668654744', time=2024-09-12T21:01:41.065681+0000, chain.objs.size()=1 2024-09-12T19:13:57.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Rcvc1Y70R3pPuhEDar97fNdxWm7hwQn_0 2024-09-12T19:13:57.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18202734828647842361', time=2024-09-12T21:01:41.070099+0000, chain.objs.size()=1 2024-09-12T19:13:57.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._wFnvm408ftWeZqqwjB1Z7stpWrU-Gq_0 2024-09-12T19:13:57.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7772552039128344414', time=2024-09-12T21:01:41.085584+0000, chain.objs.size()=1 2024-09-12T19:13:57.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.vkAWUejMCINGmUBLxyMLlIssr-GiyaL_0 2024-09-12T19:13:57.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17923448222124703674', time=2024-09-12T21:02:00.530153+0000, chain.objs.size()=1 2024-09-12T19:13:57.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.S-Df55REk4B7X6WOMsU4fLk80LniZtZ_0 2024-09-12T19:13:57.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2511521300716459894', time=2024-09-12T21:02:00.595149+0000, chain.objs.size()=1 2024-09-12T19:13:57.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.F97m5zAHvnn2qGAmy4_J3iW0VoUszzi_0 2024-09-12T19:13:57.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4994198541439205138', time=2024-09-12T21:02:00.598817+0000, chain.objs.size()=1 2024-09-12T19:13:57.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.34SKIuKHYdJSpJlF72NLqgyItbsa9UR_0 2024-09-12T19:13:57.522 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9831382239352595246', time=2024-09-12T21:02:00.788803+0000, chain.objs.size()=1 2024-09-12T19:13:57.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jyNRCEH55a9zvmNV_BHt7yKuqPkcIXO_0 2024-09-12T19:13:57.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.964659771957231684', time=2024-09-12T21:02:00.819850+0000, chain.objs.size()=1 2024-09-12T19:13:57.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.516+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.PILS-_ppl9u2P84eKylqolEOEORKj35_0 2024-09-12T19:13:57.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6471424395864995866', time=2024-09-12T21:02:00.875427+0000, chain.objs.size()=1 2024-09-12T19:13:57.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.JHzW7gIHsRdINclRbaYGosxUJdfgV7j_0 2024-09-12T19:13:57.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16660358573630036559', time=2024-09-12T21:02:00.896815+0000, chain.objs.size()=1 2024-09-12T19:13:57.523 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5kzQO1mTL-cAOPTbR-QKo_TO2xmfB-3_0 2024-09-12T19:13:57.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14552627176727450218', time=2024-09-12T21:02:00.998237+0000, chain.objs.size()=1 2024-09-12T19:13:57.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2IXDI5z4REI090Kzdn-624HaTlDGiUL_0 2024-09-12T19:13:57.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3315216301499448828', time=2024-09-12T21:02:01.021665+0000, chain.objs.size()=1 2024-09-12T19:13:57.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ckO9OPLhbYjp4PcaVSu9UXkKIdO10u5_0 2024-09-12T19:13:57.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14150116380018496079', time=2024-09-12T21:02:01.038770+0000, chain.objs.size()=1 2024-09-12T19:13:57.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Y7eMCTze9EhZ8hBsUV66zu7OAEdq_T6_0 2024-09-12T19:13:57.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15177526873283879440', time=2024-09-12T21:02:01.042936+0000, chain.objs.size()=1 2024-09-12T19:13:57.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.MStaiDnQQXDpenqHNi8I-QBDtG9T_dd_0 2024-09-12T19:13:57.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8999736611779388674', time=2024-09-12T21:02:01.056131+0000, chain.objs.size()=1 2024-09-12T19:13:57.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yP_eLXAShq8IC-fDnemoS-fMl2GRHku_0 2024-09-12T19:13:57.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.206465413770070612', time=2024-09-12T21:02:01.060968+0000, chain.objs.size()=1 2024-09-12T19:13:57.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.9EQG5plaqfjOBWhUYm_t_UYdknS25D__0 2024-09-12T19:13:57.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5488968828822791754', time=2024-09-12T21:02:01.079124+0000, chain.objs.size()=1 2024-09-12T19:13:57.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.520+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.nIj2iur_i13fBiBMVIx9RmP1SYSCVfi_0 2024-09-12T19:13:57.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/64639 2024-09-12T19:13:57.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=41, truncated=0, next_marker='' 2024-09-12T19:13:57.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14019577734569294369', time=2024-09-12T21:02:01.237499+0000, chain.objs.size()=1 2024-09-12T19:13:57.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5drjA-rxQH0G5ULTdTmsJgeXe1Xzowy_0 2024-09-12T19:13:57.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7932214922512879132', time=2024-09-12T21:02:01.265161+0000, chain.objs.size()=1 2024-09-12T19:13:57.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.UG5EFHeQCM-AdN66EVq4XCPg_nFRQYd_0 2024-09-12T19:13:57.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17607990674906859826', time=2024-09-12T21:02:01.296131+0000, chain.objs.size()=1 2024-09-12T19:13:57.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2MSIRlWULe-MTEcdTsuBROV8AykJMVu_0 2024-09-12T19:13:57.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4384691271278106692', time=2024-09-12T21:02:01.308907+0000, chain.objs.size()=1 2024-09-12T19:13:57.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.LqGENLRDqEToY2Cbvx5mtT2CWq9U-7E_0 2024-09-12T19:13:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2602648981342277839', time=2024-09-12T21:02:01.443134+0000, chain.objs.size()=1 2024-09-12T19:13:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._OR0pCC3nQ3nqtTD4VBOnmM6yTNjEcY_0 2024-09-12T19:13:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3542790976851145813', time=2024-09-12T21:02:01.446101+0000, chain.objs.size()=1 2024-09-12T19:13:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.H2qravENMWSRYkt78h6V9M0EZ9_gPIM_0 2024-09-12T19:13:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3817541920682232900', time=2024-09-12T21:02:01.449068+0000, chain.objs.size()=1 2024-09-12T19:13:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.W82Z0WIRVL5i2h0ATw_q4VS8UewjmA9_0 2024-09-12T19:13:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3319055529794542110', time=2024-09-12T21:02:01.518554+0000, chain.objs.size()=1 2024-09-12T19:13:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.W030K2QMYulMt_2mTX3RkK-LnSvYpYD_0 2024-09-12T19:13:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6818336375777362045', time=2024-09-12T21:02:01.537778+0000, chain.objs.size()=1 2024-09-12T19:13:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.V95FSzayps0mofqYLZKajw8M4bvtD2a_0 2024-09-12T19:13:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6556523881656339104', time=2024-09-12T21:02:01.540498+0000, chain.objs.size()=1 2024-09-12T19:13:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.fcVMMtjAUYF2T5EUo2l2su3sQFZG7AO_0 2024-09-12T19:13:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1261193710539631605', time=2024-09-12T21:02:01.743852+0000, chain.objs.size()=1 2024-09-12T19:13:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Okr8rEPQBwUPYqJp2Ia_rYcvXwrT9Di_0 2024-09-12T19:13:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9872051718899037802', time=2024-09-12T21:02:01.790014+0000, chain.objs.size()=1 2024-09-12T19:13:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.528+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.v0zBZLIfGmnPhgGxH3YOfveTh3W4UQr_0 2024-09-12T19:13:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.532+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16756104181247759175', time=2024-09-12T21:02:01.791175+0000, chain.objs.size()=1 2024-09-12T19:13:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.532+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.oo7NhJdlnt65H-MrCdj2TRnPeetQPWt_0 2024-09-12T19:13:57.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7341153034111362850', time=2024-09-12T21:02:01.793768+0000, chain.objs.size()=1 2024-09-12T19:13:57.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.m1wnrwYP7gvLwFovQFpCbjqnQkKDxA7_0 2024-09-12T19:13:57.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9347031289157532590', time=2024-09-12T21:02:01.951230+0000, chain.objs.size()=1 2024-09-12T19:13:57.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8HpUNa0nBrnMqds1znNo24SVChCSqHH_0 2024-09-12T19:13:57.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7260350003084078383', time=2024-09-12T21:02:01.998926+0000, chain.objs.size()=1 2024-09-12T19:13:57.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.YETqLZxKQFNjKPMQ8pbtDT4FrOtLdvA_0 2024-09-12T19:13:57.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5786053904068966854', time=2024-09-12T21:02:02.158078+0000, chain.objs.size()=1 2024-09-12T19:13:57.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.O0VT5pV-SFrKqKxbUkA3YbtsTIlWoW8_0 2024-09-12T19:13:57.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17001870869813058412', time=2024-09-12T21:02:02.158970+0000, chain.objs.size()=1 2024-09-12T19:13:57.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ziNmBuzCXUIRDb1hRLgsk4h-RdTErdz_0 2024-09-12T19:13:57.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11792688976463979803', time=2024-09-12T21:02:02.177411+0000, chain.objs.size()=1 2024-09-12T19:13:57.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.krM0o7okR6QMyf6aCEh6YYddll4j0dh_0 2024-09-12T19:13:57.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11173980828658983639', time=2024-09-12T21:02:02.194681+0000, chain.objs.size()=1 2024-09-12T19:13:57.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ewhOjytQoDRD87LrfQrA11S1f-Rjmmw_0 2024-09-12T19:13:57.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9990280075700698296', time=2024-09-12T21:02:30.363724+0000, chain.objs.size()=1 2024-09-12T19:13:57.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.369__shadow_.X2vSIkK50TRT2byQD6aJLgB26ajFHhy_0 2024-09-12T19:13:57.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10457452175478462241', time=2024-09-12T21:02:33.041815+0000, chain.objs.size()=1 2024-09-12T19:13:57.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.373__shadow_.sMYjBlpFEd0cijd3QF2PFuBG3xJwlpn_0 2024-09-12T19:13:57.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.156200120508887760', time=2024-09-12T21:02:59.368735+0000, chain.objs.size()=1 2024-09-12T19:13:57.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.407__shadow_.Mj0Rg2M44X6HfgAfHnTBzkhNPmc04f4_0 2024-09-12T19:13:57.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.102587702976434288', time=2024-09-12T21:03:55.570051+0000, chain.objs.size()=1 2024-09-12T19:13:57.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.483__shadow_.CtSHy1tJnBua6rhiQm0jGI0a3bk3P2p_0 2024-09-12T19:13:57.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1535487996989356442', time=2024-09-12T21:03:55.572400+0000, chain.objs.size()=1 2024-09-12T19:13:57.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.536+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.483__shadow_.igG2MFnPwDo1XXnHijIUpDRrPs5a4OH_0 2024-09-12T19:13:57.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5512491447118649875', time=2024-09-12T21:04:13.157070+0000, chain.objs.size()=6 2024-09-12T19:13:57.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.1 2024-09-12T19:13:57.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.2 2024-09-12T19:13:57.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.3 2024-09-12T19:13:57.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.4 2024-09-12T19:13:57.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.5 2024-09-12T19:13:57.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.6 2024-09-12T19:13:57.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17595097213183785577', time=2024-09-12T21:04:13.336228+0000, chain.objs.size()=6 2024-09-12T19:13:57.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.1 2024-09-12T19:13:57.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.2 2024-09-12T19:13:57.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.3 2024-09-12T19:13:57.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.4 2024-09-12T19:13:57.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.5 2024-09-12T19:13:57.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.6 2024-09-12T19:13:57.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3608252883121387608', time=2024-09-12T21:04:21.531750+0000, chain.objs.size()=2 2024-09-12T19:13:57.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.517__shadow_.YqEq_RT7Th0Vm_dK5EYXBhdPY1wAiLL_0 2024-09-12T19:13:57.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.517__shadow_.YqEq_RT7Th0Vm_dK5EYXBhdPY1wAiLL_1 2024-09-12T19:13:57.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15298691412965108574', time=2024-09-12T21:06:08.024066+0000, chain.objs.size()=1 2024-09-12T19:13:57.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:kA8O1EqkopwP5Ya51MShuWDBS.0bs17_.lFhQSaVQ4HCPzGcXTmYee7C-MFamcTo_0 2024-09-12T19:13:57.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10887570658187759476', time=2024-09-12T21:06:08.702765+0000, chain.objs.size()=1 2024-09-12T19:13:57.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:ul3f6nPl0jhx7Hmd09I.qjAgZcepieo_.-PicfkTt2GX1nW5zXAwys46meC1VVsk_0 2024-09-12T19:13:57.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9097134053123154743', time=2024-09-12T21:06:10.618931+0000, chain.objs.size()=1 2024-09-12T19:13:57.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:.qstri.kzsVl3A4JmGfS9aE6Jo92jDy_.g0hXyJUXnoe20eYeZHnSyRLwb2ENiMe_0 2024-09-12T19:13:57.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11239726971646699961', time=2024-09-12T21:06:20.237183+0000, chain.objs.size()=1 2024-09-12T19:13:57.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.575__shadow_.EAiuBwTJ8HZHeav3tRaaPxtXr2GFDHW_0 2024-09-12T19:13:57.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7381609713542883118', time=2024-09-12T21:06:21.970964+0000, chain.objs.size()=1 2024-09-12T19:13:57.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.540+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.576__shadow:C8k8uuYAu63cKaIheUP.ISItXY5rrrR_.eK_XsyqKtO2Bq6GUz_DaSXaQAFuCbqS_0 2024-09-12T19:13:57.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.544+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3567799392728023239', time=2024-09-12T21:06:46.356818+0000, chain.objs.size()=1 2024-09-12T19:13:57.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.544+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.579__shadow:uLv.M8TbTuL5Q4SSILxiOK0RQLxGKxv_.4UIQYasU0aGWTqvc-PtjlwrPCNsDsAb_0 2024-09-12T19:13:57.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.544+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2111919538186313957', time=2024-09-12T21:06:49.887924+0000, chain.objs.size()=1 2024-09-12T19:13:57.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.544+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.583__shadow:R75wxyy5sFY3FiQPjwShC0EiCc..qD3_.Sc3OmXw0uWMDKgLfZ539yGgabBTu0OL_0 2024-09-12T19:13:57.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.544+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12956592279229923312', time=2024-09-12T21:07:04.137449+0000, chain.objs.size()=1 2024-09-12T19:13:57.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.544+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.603__shadow_.wxzgS1naB4ZwvQPkIuZwOymnBNQzphN_0 2024-09-12T19:13:57.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.544+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.821914454757379620', time=2024-09-12T21:07:06.893482+0000, chain.objs.size()=1 2024-09-12T19:13:57.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.544+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.607__shadow_.sbDFNhtuyYMYbUsYT7Z-rNzZ_Q56eo7_0 2024-09-12T19:13:57.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.544+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13545551753950315881', time=2024-09-12T21:09:26.065949+0000, chain.objs.size()=1 2024-09-12T19:13:57.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.544+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.618__shadow_.-NVeKCQfYZX11SJsq2IHW-NSIoQ0Ibj_0 2024-09-12T19:13:57.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.544+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6145231193231869358', time=2024-09-12T21:09:46.639489+0000, chain.objs.size()=1 2024-09-12T19:13:57.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.544+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.641__shadow_.S6lvqr1f-psnbshacXGJu2h_pBgTjJA_0 2024-09-12T19:13:57.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.544+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16064152577675587934', time=2024-09-12T21:10:25.075794+0000, chain.objs.size()=1 2024-09-12T19:13:57.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.544+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.692__shadow:ppKItLNe-5J2RuVBjXFTUDfHtv1R0aB_.oRFcoqs7e1Inu-0OQDjxGNbaHvs7P8K_0 2024-09-12T19:13:57.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.548+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6383884398216192695', time=2024-09-12T21:10:25.609383+0000, chain.objs.size()=1 2024-09-12T19:13:57.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.548+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.693__shadow:Wwv9iifOQNr4ZYZ3-NUYLSVB0YbMc5K_.qFVLIkSuCWQXPDugn5LLl0-nK5Sck3f_0 2024-09-12T19:13:57.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.552+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T19:13:57.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49732' 2024-09-12T19:13:57.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.445524092609942591', time=2024-09-12T20:57:30.344227+0000, chain.objs.size()=3 2024-09-12T19:13:57.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.158__shadow_.g57PDoh1S4Kie3Z9PAHubKFwPmlG03N_0 2024-09-12T19:13:57.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.158__shadow_.g57PDoh1S4Kie3Z9PAHubKFwPmlG03N_1 2024-09-12T19:13:57.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.158__shadow_.g57PDoh1S4Kie3Z9PAHubKFwPmlG03N_2 2024-09-12T19:13:57.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_nvgV5dVOpz_IE167EhbTjVNLLLW5zc0', time=2024-09-12T20:57:33.685914+0000, chain.objs.size()=3 2024-09-12T19:13:57.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.9MHaQP4cmTdwpOOvuxL50aIU-Ldoitr_0 2024-09-12T19:13:57.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.9MHaQP4cmTdwpOOvuxL50aIU-Ldoitr_1 2024-09-12T19:13:57.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.9MHaQP4cmTdwpOOvuxL50aIU-Ldoitr_2 2024-09-12T19:13:57.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16957772079005525279', time=2024-09-12T20:59:48.691320+0000, chain.objs.size()=1 2024-09-12T19:13:57.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.231__shadow_.tzeDNmrL03Q6EJpMP7ttByhsooK1w91_0 2024-09-12T19:13:57.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11639005191758563306', time=2024-09-12T20:59:54.794955+0000, chain.objs.size()=1 2024-09-12T19:13:57.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.238__shadow_.B8TRuOtxvvNZTq1AkoHoJmubvVAfHmg_0 2024-09-12T19:13:57.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3506089360876948045', time=2024-09-12T21:00:02.968852+0000, chain.objs.size()=1 2024-09-12T19:13:57.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.248__shadow_.eeZesaWFA3yFrSwMxdy80JGHm8J1qwo_0 2024-09-12T19:13:57.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12402107808261389190', time=2024-09-12T21:00:31.982189+0000, chain.objs.size()=1 2024-09-12T19:13:57.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qqmk4KxNlH8ySD7b7ns0m718mDZhYyU_0 2024-09-12T19:13:57.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9465678062800005569', time=2024-09-12T21:00:31.994964+0000, chain.objs.size()=1 2024-09-12T19:13:57.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ZlNcAL8DrsLJcKmG2-u0zgLiCbKmXa6_0 2024-09-12T19:13:57.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4267906064845952570', time=2024-09-12T21:00:32.022114+0000, chain.objs.size()=1 2024-09-12T19:13:57.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.556+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.GNKguOXb_WZM9kveoZHQRPq1EOjh1un_0 2024-09-12T19:13:57.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.560+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12282206215744153839', time=2024-09-12T21:00:32.078420+0000, chain.objs.size()=1 2024-09-12T19:13:57.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.560+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WrmgwSoGoIFzJrqLVU_nEr_Ps-AdbWZ_0 2024-09-12T19:13:57.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.560+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7618863491266923163', time=2024-09-12T21:00:32.108290+0000, chain.objs.size()=1 2024-09-12T19:13:57.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.560+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.upoRiENF67RAcOVtY16JfNx0VF7yv7S_0 2024-09-12T19:13:57.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.560+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11238761369542945817', time=2024-09-12T21:00:32.129512+0000, chain.objs.size()=1 2024-09-12T19:13:57.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.560+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.e-1bT0dthyJmiIVd97HaRR3NUDvgGWC_0 2024-09-12T19:13:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7539504424511833561', time=2024-09-12T21:00:32.228847+0000, chain.objs.size()=1 2024-09-12T19:13:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.V0wqzftTjm0S6h58K3spGujkHN-qQR0_0 2024-09-12T19:13:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14351849007734916509', time=2024-09-12T21:00:32.279914+0000, chain.objs.size()=1 2024-09-12T19:13:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.mrfr1jcyksxJGHWIoVzJnkCGnJDJ7hK_0 2024-09-12T19:13:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.309777904591927371', time=2024-09-12T21:00:32.312516+0000, chain.objs.size()=1 2024-09-12T19:13:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.C1qhJn8lG7DID_sIKb5gVdSaCyWWvnR_0 2024-09-12T19:13:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8289637267862987841', time=2024-09-12T21:00:32.333167+0000, chain.objs.size()=1 2024-09-12T19:13:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.OUgijGQNeOmQKbuyc_j1HPlcmxefR32_0 2024-09-12T19:13:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.218518942968416630', time=2024-09-12T21:00:32.339763+0000, chain.objs.size()=1 2024-09-12T19:13:57.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sslk5odWPRx9NCjc-gEudZ9KFTGbggZ_0 2024-09-12T19:13:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14660249864168781301', time=2024-09-12T21:00:32.340695+0000, chain.objs.size()=1 2024-09-12T19:13:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.MEurPE3h622n1Tv1HVvafw8Wnl87BAx_0 2024-09-12T19:13:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5061189062154481346', time=2024-09-12T21:00:32.345073+0000, chain.objs.size()=1 2024-09-12T19:13:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.489CQnCgxm-Md6uKcaJ_RU3D9ihD1pP_0 2024-09-12T19:13:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2248130874802482589', time=2024-09-12T21:00:32.468969+0000, chain.objs.size()=1 2024-09-12T19:13:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DYERMLRIEVFzSgAUnnfnJgMI_tcN4I0_0 2024-09-12T19:13:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6223732090888400659', time=2024-09-12T21:00:32.516827+0000, chain.objs.size()=1 2024-09-12T19:13:57.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ZuCrhHFOzh5OQIi9Np7cG809URLf2aB_0 2024-09-12T19:13:57.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16252557257082265443', time=2024-09-12T21:00:32.522433+0000, chain.objs.size()=1 2024-09-12T19:13:57.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ERBiYti5udb1WQPTbc_uFnPXl3klplp_0 2024-09-12T19:13:57.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1332113137021417922', time=2024-09-12T21:00:32.536839+0000, chain.objs.size()=1 2024-09-12T19:13:57.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2EEvIbt4iJsDkiREhb1XBRkDvDLG86p_0 2024-09-12T19:13:57.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17494810831822933221', time=2024-09-12T21:00:32.663730+0000, chain.objs.size()=1 2024-09-12T19:13:57.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.1ibJ1syq0y25riI0WweZfzOABjoZGi-_0 2024-09-12T19:13:57.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1204805610016499419', time=2024-09-12T21:00:32.674361+0000, chain.objs.size()=1 2024-09-12T19:13:57.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.564+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.lJF0r9-SCdtfkT9m5qHYoT775G-dBBd_0 2024-09-12T19:13:57.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8545037551118497003', time=2024-09-12T21:00:32.701155+0000, chain.objs.size()=1 2024-09-12T19:13:57.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.zXDL1fGh-Uz5BXn_QnJN6YNA8z_Pz5J_0 2024-09-12T19:13:57.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6617716277850689113', time=2024-09-12T21:00:32.725528+0000, chain.objs.size()=1 2024-09-12T19:13:57.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.6Nvw_o87SNzOe6UejO7YP9nxxa1rwof_0 2024-09-12T19:13:57.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17414561419969981213', time=2024-09-12T21:00:32.735768+0000, chain.objs.size()=1 2024-09-12T19:13:57.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.cqvBxboQnvLZHlFslxw4dOSPW-_4SdC_0 2024-09-12T19:13:57.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1240361493696445856', time=2024-09-12T21:00:32.756865+0000, chain.objs.size()=1 2024-09-12T19:13:57.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.0grDztfFeg8oMGgSmQX9zxt-ruzjA5V_0 2024-09-12T19:13:57.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7203036080755617037', time=2024-09-12T21:00:32.757737+0000, chain.objs.size()=1 2024-09-12T19:13:57.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.j42drB2KIrQDpKrhGtj8e54LiJipgbS_0 2024-09-12T19:13:57.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1452091771117421454', time=2024-09-12T21:00:32.771514+0000, chain.objs.size()=1 2024-09-12T19:13:57.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tFhsBuS2DiecouMhUhQTY0jF1qqzMyr_0 2024-09-12T19:13:57.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9866466269937974005', time=2024-09-12T21:00:32.776047+0000, chain.objs.size()=1 2024-09-12T19:13:57.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qSDm10qRMcxxY9yuyXSpZ-bZX9HTyga_0 2024-09-12T19:13:57.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16751600982320072382', time=2024-09-12T21:00:32.948395+0000, chain.objs.size()=1 2024-09-12T19:13:57.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_._K32dhS5-58nREZEZLxoBBfNfUTRdSp_0 2024-09-12T19:13:57.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9312834528449384347', time=2024-09-12T21:00:32.968314+0000, chain.objs.size()=1 2024-09-12T19:13:57.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.U5iMz9EuqvqlleilozMbVGesvqQF9EV_0 2024-09-12T19:13:57.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16139396163824810787', time=2024-09-12T21:00:32.969234+0000, chain.objs.size()=1 2024-09-12T19:13:57.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SHZoXLdvnRksO1hYKP4SmXlGY7E9dpo_0 2024-09-12T19:13:57.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9670875459157496059', time=2024-09-12T21:00:33.171910+0000, chain.objs.size()=1 2024-09-12T19:13:57.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ul6NRFb8sBa6UQBnBCT3wTsg8CiaVbT_0 2024-09-12T19:13:57.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14645185116277555176', time=2024-09-12T21:00:33.411189+0000, chain.objs.size()=1 2024-09-12T19:13:57.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.568+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ei_NM4j6GAQ8lqq3UzcN4JYb95IHWPs_0 2024-09-12T19:13:57.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.572+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5609186803991782589', time=2024-09-12T21:00:33.456575+0000, chain.objs.size()=1 2024-09-12T19:13:57.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.572+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.L_zGM6GODsGIFhdnHG8RaBJQvwLuZbI_0 2024-09-12T19:13:57.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.572+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9718052801387112661', time=2024-09-12T21:00:33.476708+0000, chain.objs.size()=1 2024-09-12T19:13:57.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.572+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2goGZRu0qTb7BidlXijKSLZpR7xpwCs_0 2024-09-12T19:13:57.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.572+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7997416880295769830', time=2024-09-12T21:00:33.487715+0000, chain.objs.size()=1 2024-09-12T19:13:57.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.572+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Nh5Yesa6quL42lf_-amxXOoNaVZTXYV_0 2024-09-12T19:13:57.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.572+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13505225653283840278', time=2024-09-12T21:00:33.605521+0000, chain.objs.size()=1 2024-09-12T19:13:57.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.572+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.FwGKvoYnCtI6vZzycIfriFTZklDlIt2_0 2024-09-12T19:13:57.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2309858778152327649', time=2024-09-12T21:00:33.628130+0000, chain.objs.size()=1 2024-09-12T19:13:57.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SNKVCUXmAYEWi_Gr3uiTBZg6Y7XNseL_0 2024-09-12T19:13:57.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8500762010286179705', time=2024-09-12T21:00:33.896594+0000, chain.objs.size()=1 2024-09-12T19:13:57.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.svBXzIiF5qcqXRP8k-42Q5tmRa1aWVu_0 2024-09-12T19:13:57.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17135586458712598692', time=2024-09-12T21:00:33.909475+0000, chain.objs.size()=1 2024-09-12T19:13:57.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JefnEtmBiX-p0ljr9o75qmrgW-NZFiu_0 2024-09-12T19:13:57.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3229602379827055375', time=2024-09-12T21:00:37.423109+0000, chain.objs.size()=1 2024-09-12T19:13:57.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.267__shadow_.0ZnkVht6n-hdl2ZvlZaXZDXdh3lh2q7_0 2024-09-12T19:13:57.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.324961969755839435', time=2024-09-12T21:00:47.584611+0000, chain.objs.size()=1 2024-09-12T19:13:57.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.281__shadow_.2WitrftiVQo5RWNM_XHfL7F7JIcAZXA_0 2024-09-12T19:13:57.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17940619826875490769', time=2024-09-12T21:00:58.145234+0000, chain.objs.size()=1 2024-09-12T19:13:57.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.Jtfx8R8xfElzBxbD69lhcK4N7QgvxpT_0 2024-09-12T19:13:57.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14866141493735265784', time=2024-09-12T21:00:59.584085+0000, chain.objs.size()=1 2024-09-12T19:13:57.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.295__shadow_.izsMu0P6YjntFEh0WEg8265zzoI6wiD_0 2024-09-12T19:13:57.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9446324060713722776', time=2024-09-12T21:01:00.286274+0000, chain.objs.size()=1 2024-09-12T19:13:57.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.296__shadow_.tT8vD-9L3lXu9HCSDLFF06UP91Xxted_0 2024-09-12T19:13:57.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7121965314404338895', time=2024-09-12T21:01:02.563580+0000, chain.objs.size()=1 2024-09-12T19:13:57.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.299__shadow_.qYsqY-dQ30RV-cSzbDc40WVzM681u33_0 2024-09-12T19:13:57.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.537906504063021141', time=2024-09-12T21:01:39.401256+0000, chain.objs.size()=1 2024-09-12T19:13:57.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.qnMXJ-cx9nW6OLLgHub1ZMMXUvV0l9A_0 2024-09-12T19:13:57.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7813371450713914071', time=2024-09-12T21:01:39.412998+0000, chain.objs.size()=1 2024-09-12T19:13:57.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-TXki7BJ68YF1WTkhkG3fcy5enr1Kg0_0 2024-09-12T19:13:57.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6008075302163920047', time=2024-09-12T21:01:39.459456+0000, chain.objs.size()=1 2024-09-12T19:13:57.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hSPTVpdd3Y696F6uYN5oYqUrdlzJzXG_0 2024-09-12T19:13:57.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3520383458903060625', time=2024-09-12T21:01:39.506509+0000, chain.objs.size()=1 2024-09-12T19:13:57.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.59PLEKRPz-w2_juucVpm5GZNMib8aCt_0 2024-09-12T19:13:57.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.475629953002409123', time=2024-09-12T21:01:39.547951+0000, chain.objs.size()=1 2024-09-12T19:13:57.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.LK9XwGLs_ByZh7kBLJqQoWjxDvWEBAB_0 2024-09-12T19:13:57.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9790516405249733088', time=2024-09-12T21:01:39.549702+0000, chain.objs.size()=1 2024-09-12T19:13:57.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.vZOxREVe32pmycq8pJ_jXp970GIiBbh_0 2024-09-12T19:13:57.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9696344608371595529', time=2024-09-12T21:01:39.552993+0000, chain.objs.size()=1 2024-09-12T19:13:57.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.92p4yCN2cVXafxHgYMDfSvhDTsMGo1A_0 2024-09-12T19:13:57.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2942671951601036108', time=2024-09-12T21:01:39.692734+0000, chain.objs.size()=1 2024-09-12T19:13:57.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.sqD--bHoHuJnTBbUll1wMK5cK8VBIN5_0 2024-09-12T19:13:57.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4942754431491775231', time=2024-09-12T21:01:39.784418+0000, chain.objs.size()=1 2024-09-12T19:13:57.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.d6OaCFJs_3Xu_lCliQharR7t1s7oz2D_0 2024-09-12T19:13:57.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8567545318682729137', time=2024-09-12T21:01:39.796168+0000, chain.objs.size()=1 2024-09-12T19:13:57.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.576+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.HZAd85rD0BkjvKg47VOn3YvptkhPki5_0 2024-09-12T19:13:57.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.580+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6943391247821964502', time=2024-09-12T21:01:39.800657+0000, chain.objs.size()=1 2024-09-12T19:13:57.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.580+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.79PlyuXR4CducJ7dW6FUYJY4XMSbda0_0 2024-09-12T19:13:57.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.580+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3188076273087362966', time=2024-09-12T21:01:39.890330+0000, chain.objs.size()=1 2024-09-12T19:13:57.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.580+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.eFQFYpoAusOHMyIDZS0o_r18wXU1uS-_0 2024-09-12T19:13:57.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.580+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2324582623231609130', time=2024-09-12T21:01:39.891646+0000, chain.objs.size()=1 2024-09-12T19:13:57.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.580+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.knbtV8Uzpj3RE64wdmMjBPtnbo13VAa_0 2024-09-12T19:13:57.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.580+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3777324320328661475', time=2024-09-12T21:01:39.923798+0000, chain.objs.size()=1 2024-09-12T19:13:57.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.580+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RA7tCdtvaGwb7RHQnyCnDu7lcwYED6R_0 2024-09-12T19:13:57.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.580+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2860428332172285698', time=2024-09-12T21:01:39.955051+0000, chain.objs.size()=1 2024-09-12T19:13:57.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.580+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.6ym2QNeYwr_uDSdSa7h5RdW8oah41tw_0 2024-09-12T19:13:57.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2657787245191681807', time=2024-09-12T21:01:39.963513+0000, chain.objs.size()=1 2024-09-12T19:13:57.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.AMx9l-Zlcze6SuiKgSWMuNG2E-zDQwn_0 2024-09-12T19:13:57.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14157499125796287737', time=2024-09-12T21:01:39.976201+0000, chain.objs.size()=1 2024-09-12T19:13:57.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.dtlCwflBD5PucCWho66tmQabFjlhPCT_0 2024-09-12T19:13:57.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16654647334829938287', time=2024-09-12T21:01:39.985622+0000, chain.objs.size()=1 2024-09-12T19:13:57.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Hz07V57S1rkfSL8BpzK7FT6fb94S1Pv_0 2024-09-12T19:13:57.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1190167177472735107', time=2024-09-12T21:01:39.986489+0000, chain.objs.size()=1 2024-09-12T19:13:57.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.WA0tRKLc5YD_jCzJokm-EyN_rVlCrm-_0 2024-09-12T19:13:57.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.943535834357492703', time=2024-09-12T21:01:40.000862+0000, chain.objs.size()=1 2024-09-12T19:13:57.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.KHYyFfQSqqvqMn9EsIhlAt7nLfOLjB8_0 2024-09-12T19:13:57.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2238429279510394807', time=2024-09-12T21:01:40.020287+0000, chain.objs.size()=1 2024-09-12T19:13:57.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._GOv4PUZgPxoSAc0iahbG3tV59u2XbZ_0 2024-09-12T19:13:57.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10965846792004344826', time=2024-09-12T21:01:40.137234+0000, chain.objs.size()=1 2024-09-12T19:13:57.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.zm4g120D0LHIHRhCc1N1PkpAQVAPCBW_0 2024-09-12T19:13:57.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4686571173866035951', time=2024-09-12T21:01:40.174763+0000, chain.objs.size()=1 2024-09-12T19:13:57.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.aG4I-gOngbnV0NsioONSOtHuXShKEhv_0 2024-09-12T19:13:57.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.472177341361386690', time=2024-09-12T21:01:40.213563+0000, chain.objs.size()=1 2024-09-12T19:13:57.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.nRnDweu873QdV8RpaFwK4XVNK9-ojAe_0 2024-09-12T19:13:57.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2944658063100109894', time=2024-09-12T21:01:40.332375+0000, chain.objs.size()=1 2024-09-12T19:13:57.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.K90uPKpvu8SjKIxPTID1OuW803RR8kS_0 2024-09-12T19:13:57.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12984791992450183966', time=2024-09-12T21:01:40.375471+0000, chain.objs.size()=1 2024-09-12T19:13:57.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.iCEAj9aInwzxipSt3bM02YI4-9cmptc_0 2024-09-12T19:13:57.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17115224576681160350', time=2024-09-12T21:01:40.584607+0000, chain.objs.size()=1 2024-09-12T19:13:57.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.SNvxn1DZYM9p27HQNWFgqUb8yQ3g_EY_0 2024-09-12T19:13:57.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4895828460632700444', time=2024-09-12T21:01:40.626925+0000, chain.objs.size()=1 2024-09-12T19:13:57.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.1mGNvBafjUyswiCr71PGba3eWra_enX_0 2024-09-12T19:13:57.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16176250984628826028', time=2024-09-12T21:01:40.631493+0000, chain.objs.size()=1 2024-09-12T19:13:57.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QaC0baEeeZs6jtWbmGDUcAKZrT8olOW_0 2024-09-12T19:13:57.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2933022723107511537', time=2024-09-12T21:01:40.638497+0000, chain.objs.size()=1 2024-09-12T19:13:57.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.zCSIXln-nE3G5GBHk8CgWCWFhkA8fcV_0 2024-09-12T19:13:57.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6391765503686643410', time=2024-09-12T21:01:40.675199+0000, chain.objs.size()=1 2024-09-12T19:13:57.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.x50PPjsH9yEeilB0IPzJbl4VUi40N6q_0 2024-09-12T19:13:57.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16925355314850455529', time=2024-09-12T21:01:40.676019+0000, chain.objs.size()=1 2024-09-12T19:13:57.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ZWrxkyoAqiPfdnbXl8dh0XWrwvUb-5A_0 2024-09-12T19:13:57.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11844566537902860036', time=2024-09-12T21:01:40.800822+0000, chain.objs.size()=1 2024-09-12T19:13:57.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ZwpsZktsELAmgwYfs8dz30IKTbTFnNB_0 2024-09-12T19:13:57.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10566103661666878352', time=2024-09-12T21:01:40.810803+0000, chain.objs.size()=1 2024-09-12T19:13:57.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RdIXJWxSglfbaK96EPZgRQVkhJvvaXm_0 2024-09-12T19:13:57.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14089501455285993194', time=2024-09-12T21:01:40.863737+0000, chain.objs.size()=1 2024-09-12T19:13:57.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.584+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.YSNqSgcCv7EAyqTRUU36mDxdqvnvuWU_0 2024-09-12T19:13:57.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16985264798569100214', time=2024-09-12T21:01:41.001686+0000, chain.objs.size()=1 2024-09-12T19:13:57.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.060_pOqEBq3_E0E8oE0EwpXMygBTlFE_0 2024-09-12T19:13:57.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5901896387867226706', time=2024-09-12T21:01:41.042091+0000, chain.objs.size()=1 2024-09-12T19:13:57.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mq0t7GcDuGzAxv8Wg9EaSSPXuBG2Vp-_0 2024-09-12T19:13:57.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7538143802584735979', time=2024-09-12T21:01:41.045450+0000, chain.objs.size()=1 2024-09-12T19:13:57.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.xHDWp2WZ2MAWbxNave3fF9Z4mw2mRFw_0 2024-09-12T19:13:57.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5973449395702696131', time=2024-09-12T21:01:41.066144+0000, chain.objs.size()=1 2024-09-12T19:13:57.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.co71TRwREMusFsMm6RW1j7BNvar3bNb_0 2024-09-12T19:13:57.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13732463845379558505', time=2024-09-12T21:02:00.769171+0000, chain.objs.size()=1 2024-09-12T19:13:57.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.E_jPswnfZQkgCJHnc1_cqmnxKU7BV19_0 2024-09-12T19:13:57.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12318097358604837630', time=2024-09-12T21:02:00.772400+0000, chain.objs.size()=1 2024-09-12T19:13:57.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.feELQZR8Ytc_Q9GkqN_Xuy8lryqQtfL_0 2024-09-12T19:13:57.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5134227837505963734', time=2024-09-12T21:02:00.815362+0000, chain.objs.size()=1 2024-09-12T19:13:57.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.VyFth5rTQt1wH3Np4nhgRBQr6ckiL7r_0 2024-09-12T19:13:57.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6257187102795809', time=2024-09-12T21:02:00.819785+0000, chain.objs.size()=1 2024-09-12T19:13:57.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.vtPXceQaJTUlRgc-VQsHtmvh7llMGWN_0 2024-09-12T19:13:57.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7652470387288110019', time=2024-09-12T21:02:00.838717+0000, chain.objs.size()=1 2024-09-12T19:13:57.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.588+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.kWhQ9vtElo6sIMpuF-Zx8VifUtfECMq_0 2024-09-12T19:13:57.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7900128566335023409', time=2024-09-12T21:02:00.845608+0000, chain.objs.size()=1 2024-09-12T19:13:57.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.11lV5qGvs0w_T2dlu71QuUVilCorpvK_0 2024-09-12T19:13:57.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11368351000181909161', time=2024-09-12T21:02:00.853154+0000, chain.objs.size()=1 2024-09-12T19:13:57.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.nTwulhGJ1SGtMMugDk65Fp3cexrt5w6_0 2024-09-12T19:13:57.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3609984595274280849', time=2024-09-12T21:02:00.869834+0000, chain.objs.size()=1 2024-09-12T19:13:57.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.P9hvd1Y_pBmnPYm3_CTzXwVU2JcYFHL_0 2024-09-12T19:13:57.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11498908034677489910', time=2024-09-12T21:02:00.893230+0000, chain.objs.size()=1 2024-09-12T19:13:57.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7nmGBqzby3K-HvtxeJoPrhfiKHSxl-T_0 2024-09-12T19:13:57.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6878240802132456721', time=2024-09-12T21:02:00.987809+0000, chain.objs.size()=1 2024-09-12T19:13:57.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.bXL2ZeXGRY545hxofB-1f9qPCw1sR1__0 2024-09-12T19:13:57.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15416397574966598970', time=2024-09-12T21:02:01.030827+0000, chain.objs.size()=1 2024-09-12T19:13:57.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.TJXpor3Nar4_JhFqx6lMXvpuUlgRbKb_0 2024-09-12T19:13:57.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8388288243876245388', time=2024-09-12T21:02:01.033525+0000, chain.objs.size()=1 2024-09-12T19:13:57.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.E9nToKeEey3bhq9Yiz5S0SRXoU0-WKD_0 2024-09-12T19:13:57.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.592+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49732 2024-09-12T19:13:57.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=41, truncated=0, next_marker='' 2024-09-12T19:13:57.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10745116496951824699', time=2024-09-12T21:02:01.088211+0000, chain.objs.size()=1 2024-09-12T19:13:57.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.MpgA1qClU2lSOrfXAlEsME8ino-v_Qx_0 2024-09-12T19:13:57.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16179578568793457995', time=2024-09-12T21:02:01.240195+0000, chain.objs.size()=1 2024-09-12T19:13:57.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.kvEwAywshuQki7sL_ymdCCirgest2gp_0 2024-09-12T19:13:57.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6438863092044436498', time=2024-09-12T21:02:01.302888+0000, chain.objs.size()=1 2024-09-12T19:13:57.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.93om11vH2hOVahhg1VPXcc4aoTQbPHL_0 2024-09-12T19:13:57.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8655340546760388164', time=2024-09-12T21:02:01.315683+0000, chain.objs.size()=1 2024-09-12T19:13:57.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.dc7Ukd2961OQXF7WpasplvjI7XFlFGQ_0 2024-09-12T19:13:57.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7245523659955658859', time=2024-09-12T21:02:01.345279+0000, chain.objs.size()=1 2024-09-12T19:13:57.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.maahsgQKS2C-iI7C7UcBGZ4p-a7akEh_0 2024-09-12T19:13:57.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16276742939765542715', time=2024-09-12T21:02:01.467539+0000, chain.objs.size()=1 2024-09-12T19:13:57.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.VAXaItQk6OLF0mhe132HLd1IArew7Hq_0 2024-09-12T19:13:57.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17003000087828826173', time=2024-09-12T21:02:01.512964+0000, chain.objs.size()=1 2024-09-12T19:13:57.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.b9jgxXExEhu1T2UxaU3RTRO6OlRU8Zj_0 2024-09-12T19:13:57.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11414863070393640928', time=2024-09-12T21:02:01.546815+0000, chain.objs.size()=1 2024-09-12T19:13:57.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.DRq66XOb_EI4oVnh2d3KfTqxLiPDHd5_0 2024-09-12T19:13:57.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1580801749063261073', time=2024-09-12T21:02:01.690209+0000, chain.objs.size()=1 2024-09-12T19:13:57.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.aeul4LxsnV6-yOiSq7tlRqPbgO8-gMh_0 2024-09-12T19:13:57.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14225067012745888872', time=2024-09-12T21:02:01.712868+0000, chain.objs.size()=1 2024-09-12T19:13:57.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.IaCRzhFSahMpkgSzCCzgJicLgYFZppR_0 2024-09-12T19:13:57.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16680199972419149038', time=2024-09-12T21:02:01.717801+0000, chain.objs.size()=1 2024-09-12T19:13:57.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ohipicpBqikLH7OWTTgzdzZfC0K-4lk_0 2024-09-12T19:13:57.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15068505125804842528', time=2024-09-12T21:02:01.728692+0000, chain.objs.size()=1 2024-09-12T19:13:57.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.CEoqx-BQCX_YOWU5Q8yxb2xXfu8F6va_0 2024-09-12T19:13:57.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.571409304294749728', time=2024-09-12T21:02:01.742844+0000, chain.objs.size()=1 2024-09-12T19:13:57.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-p3AfEtCFE__RUW-y9k8Zm9xWyriDDa_0 2024-09-12T19:13:57.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12702087097785763145', time=2024-09-12T21:02:01.756483+0000, chain.objs.size()=1 2024-09-12T19:13:57.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.3oIcfn8-lHud3c3Ssx4PpTXNJ1PHT9S_0 2024-09-12T19:13:57.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2802367008818614985', time=2024-09-12T21:02:01.763054+0000, chain.objs.size()=1 2024-09-12T19:13:57.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ghqkWGu0BLIX8LLkn9dYKPlRpKn5_wl_0 2024-09-12T19:13:57.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14059167362840365922', time=2024-09-12T21:02:01.780165+0000, chain.objs.size()=1 2024-09-12T19:13:57.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.596+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.RrPfk2dO54UC1UCNVGxKIlLG7ueKEQq_0 2024-09-12T19:13:57.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2638988056289966535', time=2024-09-12T21:02:01.889928+0000, chain.objs.size()=1 2024-09-12T19:13:57.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.UB3pcfms7N0iqhwcYBXamMI-EiGY_fE_0 2024-09-12T19:13:57.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14345119516562457892', time=2024-09-12T21:02:01.901561+0000, chain.objs.size()=1 2024-09-12T19:13:57.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.BFNGAg69WqfC1aH2Z65tQGosUayHvWG_0 2024-09-12T19:13:57.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.476388113004888020', time=2024-09-12T21:02:01.926866+0000, chain.objs.size()=1 2024-09-12T19:13:57.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.guZwy2KTnCgBrM1i_nAyOjF-oow1GVp_0 2024-09-12T19:13:57.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7604857768191658041', time=2024-09-12T21:02:01.954257+0000, chain.objs.size()=1 2024-09-12T19:13:57.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.GU5ZZsYnrEGCcPpSPPj26BsihIvflnk_0 2024-09-12T19:13:57.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17131101399721238390', time=2024-09-12T21:02:01.962604+0000, chain.objs.size()=1 2024-09-12T19:13:57.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.N5NdJJ80TS7zrFsWAjY-1noQ3pLsvWE_0 2024-09-12T19:13:57.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7227310773037670253', time=2024-09-12T21:02:01.970726+0000, chain.objs.size()=1 2024-09-12T19:13:57.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.q-NtIoQKG8cGJqqTZnd7Aoc-cf4L40C_0 2024-09-12T19:13:57.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18002702469382682346', time=2024-09-12T21:02:02.010413+0000, chain.objs.size()=1 2024-09-12T19:13:57.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.KyGAHf60W977EPPg6GnsvsWiEb7I0BG_0 2024-09-12T19:13:57.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17985896184523990505', time=2024-09-12T21:02:02.151516+0000, chain.objs.size()=1 2024-09-12T19:13:57.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jDvlRXJs0ZBqZrPOJCRqbms-lpY1kGT_0 2024-09-12T19:13:57.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4513759594034570221', time=2024-09-12T21:02:02.169628+0000, chain.objs.size()=1 2024-09-12T19:13:57.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2c4rls5zRwervEVJ5Tb_y9u4mHgV016_0 2024-09-12T19:13:57.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11780896856053292922', time=2024-09-12T21:02:08.089461+0000, chain.objs.size()=1 2024-09-12T19:13:57.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.333__shadow_.VJmH5CfBhEupjhb8hC9igTkP-FZmuc-_0 2024-09-12T19:13:57.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7291897673805768615', time=2024-09-12T21:02:39.938069+0000, chain.objs.size()=1 2024-09-12T19:13:57.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.381__shadow_.jXcXas6mUawSjFYKW-Vaw6waNHKt1eM_0 2024-09-12T19:13:57.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15415233301153419631', time=2024-09-12T21:03:55.567860+0000, chain.objs.size()=1 2024-09-12T19:13:57.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.483__shadow_.z2R5rEcNpFqULLJC3NUPpZohzahs0df_0 2024-09-12T19:13:57.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2597585100111268670', time=2024-09-12T21:04:29.624622+0000, chain.objs.size()=1 2024-09-12T19:13:57.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.520__shadow:AKymlsLCUhvSMvUo7gEcBLzwOlVchR5_.1PbWv4hOpAhEPup8Fk571Z9IxDPobw8_0 2024-09-12T19:13:57.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12624321579446922123', time=2024-09-12T21:04:29.807453+0000, chain.objs.size()=6 2024-09-12T19:13:57.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.521__multipart_mymultipart.2~DZtnM4rBtjLHV7aqRTKGV2FaU8o36W2.1 2024-09-12T19:13:57.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.521__shadow_mymultipart.2~DZtnM4rBtjLHV7aqRTKGV2FaU8o36W2.1_1 2024-09-12T19:13:57.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.521__multipart_mymultipart.2~DZtnM4rBtjLHV7aqRTKGV2FaU8o36W2.2 2024-09-12T19:13:57.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.600+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.521__shadow_mymultipart.2~DZtnM4rBtjLHV7aqRTKGV2FaU8o36W2.2_1 2024-09-12T19:13:57.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.521__multipart_mymultipart.2~DZtnM4rBtjLHV7aqRTKGV2FaU8o36W2.3 2024-09-12T19:13:57.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.521__shadow_mymultipart.2~DZtnM4rBtjLHV7aqRTKGV2FaU8o36W2.3_1 2024-09-12T19:13:57.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~xyTjIADqDpLw296djO2Wsq1SEMN-0yM', time=2024-09-12T21:04:39.935054+0000, chain.objs.size()=1 2024-09-12T19:13:57.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~xyTjIADqDpLw296djO2Wsq1SEMN-0yM.2 2024-09-12T19:13:57.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~xyTjIADqDpLw296djO2Wsq1SEMN-0yM', time=2024-09-12T21:04:39.938693+0000, chain.objs.size()=1 2024-09-12T19:13:57.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~xyTjIADqDpLw296djO2Wsq1SEMN-0yM.3 2024-09-12T19:13:57.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8833930466191106603', time=2024-09-12T21:06:11.127771+0000, chain.objs.size()=1 2024-09-12T19:13:57.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:3NEmpHCdUlJX9JAmmNfIfpz76a75mAC_.4sCJgnnD2lF3Jm0niEy4idCpHAEStKm_0 2024-09-12T19:13:57.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6599863004916075334', time=2024-09-12T21:06:19.251945+0000, chain.objs.size()=1 2024-09-12T19:13:57.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.574__shadow:N5tUGkKG1QsWtGT3bFb46nL0OJ-ex1D_.8CYRTvgxsYs1iMH31YsW2Fc2cm4TUmN_0 2024-09-12T19:13:57.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16245675628387714494', time=2024-09-12T21:06:21.399723+0000, chain.objs.size()=1 2024-09-12T19:13:57.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.576__shadow:AGzbSjDXOIDnRw7spfqugJnW4mtdfm._.GBzhMC1sobiXoZRyKS8GUCf-JqH5F7t_0 2024-09-12T19:13:57.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2521155711456858765', time=2024-09-12T21:06:23.760015+0000, chain.objs.size()=1 2024-09-12T19:13:57.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.576__shadow:3EsMhPbO2Z8leVmE0TqE2Ae06NBnlIX_.p182MqjenO2XhWKdWnHe573vf346wC6_0 2024-09-12T19:13:57.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12562574239070476960', time=2024-09-12T21:06:32.063484+0000, chain.objs.size()=1 2024-09-12T19:13:57.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:GovFDM4fMoLjJOqzBVhKOibFbI8Ldtg_.0tYRHOQnA6OshaE7sUcjSWvx1GHJEJN_0 2024-09-12T19:13:57.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.120690745246251944', time=2024-09-12T21:06:37.252401+0000, chain.objs.size()=1 2024-09-12T19:13:57.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:XcYO5gTo3RM4Ln8sBkHjVM6eKQIqBwf_.iUq6jbBq4daYgKhnBmvl4F85ux8V-TW_0 2024-09-12T19:13:57.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7304846811625604148', time=2024-09-12T21:06:48.046923+0000, chain.objs.size()=1 2024-09-12T19:13:57.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.580__shadow:.abm629bZ7ep2z837Zi-5YuMG53mXIa_.i1dJDUU169PNEZ1pTvFndQH-IsLZdr6_0 2024-09-12T19:13:57.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10716849328594834862', time=2024-09-12T21:07:23.057816+0000, chain.objs.size()=1 2024-09-12T19:13:57.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.604+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.616__shadow_.mSSwLOKCH620sbH3rttYlytXJQkfaB3_0 2024-09-12T19:13:57.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.608+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-haocQSPBhCNNrWSkl4zQgkFqsfF3uO', time=2024-09-12T21:11:19.880541+0000, chain.objs.size()=1 2024-09-12T19:13:57.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.608+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.742__multipart_mymultipart2.2~-haocQSPBhCNNrWSkl4zQgkFqsfF3uO.1 2024-09-12T19:13:57.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.608+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T19:13:57.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44880' 2024-09-12T19:13:57.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_jWjnnIwg7rFgszuFWZS7A_xUi47ylx0', time=2024-09-12T20:57:36.580197+0000, chain.objs.size()=3 2024-09-12T19:13:57.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_.V63gMr0eeJUHuOOpnuqtC1NWLOJO9Ek_0 2024-09-12T19:13:57.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_.V63gMr0eeJUHuOOpnuqtC1NWLOJO9Ek_1 2024-09-12T19:13:57.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_.V63gMr0eeJUHuOOpnuqtC1NWLOJO9Ek_2 2024-09-12T19:13:57.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~mwYrO2Uea9192HocfuV_0EAtothauSu', time=2024-09-12T20:58:20.382035+0000, chain.objs.size()=1 2024-09-12T19:13:57.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.201__multipart_mymultipart.2~mwYrO2Uea9192HocfuV_0EAtothauSu.1 2024-09-12T19:13:57.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5878743633574388775', time=2024-09-12T21:00:00.084203+0000, chain.objs.size()=1 2024-09-12T19:13:57.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.244__shadow_.16jiw6sXyD6HeN_xwXpkYOn94e9qECt_0 2024-09-12T19:13:57.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2719563871031804531', time=2024-09-12T21:00:01.523440+0000, chain.objs.size()=1 2024-09-12T19:13:57.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.246__shadow_.QnkG0o-ehG0ldPmi0R-30kYGfty2krm_0 2024-09-12T19:13:57.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8042492397259386841', time=2024-09-12T21:00:05.143491+0000, chain.objs.size()=1 2024-09-12T19:13:57.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.251__shadow_.h467d7pLm5mKILoq4lA9o2axiVvX35L_0 2024-09-12T19:13:57.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13697066268990522675', time=2024-09-12T21:00:12.459547+0000, chain.objs.size()=1 2024-09-12T19:13:57.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.261__shadow_.o8YQx4btcHNzYKpraKRVwGb9W6YssO8_0 2024-09-12T19:13:57.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9019198051165834604', time=2024-09-12T21:00:32.018218+0000, chain.objs.size()=1 2024-09-12T19:13:57.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.6ndbs35Cf_EjlwsVcI8I9dXLn-mCCHo_0 2024-09-12T19:13:57.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9725782864560702074', time=2024-09-12T21:00:32.080778+0000, chain.objs.size()=1 2024-09-12T19:13:57.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.IfxXHYRNLqjrpsrte8YTKYObBQ6bLEQ_0 2024-09-12T19:13:57.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14997918284865712774', time=2024-09-12T21:00:32.293244+0000, chain.objs.size()=1 2024-09-12T19:13:57.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.BNqMgoXMFMm8hssPMTgETF3sfH2HpME_0 2024-09-12T19:13:57.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15625938656065627866', time=2024-09-12T21:00:32.341900+0000, chain.objs.size()=1 2024-09-12T19:13:57.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.612+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.kgb4yH5Lvy7EpzA3Zkf_TddXRui8rOu_0 2024-09-12T19:13:57.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18282649056482572870', time=2024-09-12T21:00:32.467212+0000, chain.objs.size()=1 2024-09-12T19:13:57.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.EndPcH7TyfcpSs8UYGaJRa44DUfTE4m_0 2024-09-12T19:13:57.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5956930538747151975', time=2024-09-12T21:00:32.511884+0000, chain.objs.size()=1 2024-09-12T19:13:57.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LaiO3uiISyCojGxQ3hhWpSYHm_Af0x0_0 2024-09-12T19:13:57.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12284192209130702710', time=2024-09-12T21:00:32.522000+0000, chain.objs.size()=1 2024-09-12T19:13:57.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ayUO2i5IKOYu5GIFX19B8pXift09mr2_0 2024-09-12T19:13:57.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1745214639307561774', time=2024-09-12T21:00:32.523349+0000, chain.objs.size()=1 2024-09-12T19:13:57.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.0npeSpGXoj-QQJVWJYtvZRGeUJUK525_0 2024-09-12T19:13:57.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18183519630253356029', time=2024-09-12T21:00:32.556258+0000, chain.objs.size()=1 2024-09-12T19:13:57.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.0SEg3U1KrX304jBr_6JxR_F04FYayzd_0 2024-09-12T19:13:57.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9634549967150172588', time=2024-09-12T21:00:32.661497+0000, chain.objs.size()=1 2024-09-12T19:13:57.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.909WZwT4PJxZYgspMq_wKWZEiTqPucY_0 2024-09-12T19:13:57.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6914090648559412516', time=2024-09-12T21:00:32.716725+0000, chain.objs.size()=1 2024-09-12T19:13:57.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Sfz3JMeaDExQaiheprbqSkUudN5FTpA_0 2024-09-12T19:13:57.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12685497014682694338', time=2024-09-12T21:00:32.728369+0000, chain.objs.size()=1 2024-09-12T19:13:57.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.kDzWO4GNsjiKSduj0AJWcPP2KdnOVHV_0 2024-09-12T19:13:57.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15389183774909360128', time=2024-09-12T21:00:32.758062+0000, chain.objs.size()=1 2024-09-12T19:13:57.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.k-POzL7as0bx3vYO_5DNOInij9v_4Xj_0 2024-09-12T19:13:57.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14398075608563913727', time=2024-09-12T21:00:32.872656+0000, chain.objs.size()=1 2024-09-12T19:13:57.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.1DYYYyezhqQREpvgysGhrprR8iw4YN4_0 2024-09-12T19:13:57.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2531367505611586187', time=2024-09-12T21:00:32.882716+0000, chain.objs.size()=1 2024-09-12T19:13:57.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.l8mgCIW0bac3Uc0CItOzXUI6jEcDQAD_0 2024-09-12T19:13:57.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.897148873227151810', time=2024-09-12T21:00:32.934906+0000, chain.objs.size()=1 2024-09-12T19:13:57.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.616+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.pfmCYgaj2QV4J9ym9BU_BwEg5Rlvt27_0 2024-09-12T19:13:57.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12452721673058634349', time=2024-09-12T21:00:32.958038+0000, chain.objs.size()=1 2024-09-12T19:13:57.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.QazU87N5uC1am19XOpFCF6GTjsJJR8u_0 2024-09-12T19:13:57.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15630320572757731031', time=2024-09-12T21:00:32.983016+0000, chain.objs.size()=1 2024-09-12T19:13:57.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_._LoulfgrXxWPZnKINRZcWBGn_cfpE0l_0 2024-09-12T19:13:57.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11687711481295801342', time=2024-09-12T21:00:33.163033+0000, chain.objs.size()=1 2024-09-12T19:13:57.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7TPCNkCLS0tKda3D61lguGe3R601eWp_0 2024-09-12T19:13:57.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7458666591092207776', time=2024-09-12T21:00:33.172256+0000, chain.objs.size()=1 2024-09-12T19:13:57.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.g-Cn_Jo1IaYbh36C-x-enH27jZRkjRa_0 2024-09-12T19:13:57.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8690813081652752765', time=2024-09-12T21:00:33.174549+0000, chain.objs.size()=1 2024-09-12T19:13:57.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ZoELVRrtZiSOsWYtTFKUKxh7z9-1FcC_0 2024-09-12T19:13:57.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11154576188512035912', time=2024-09-12T21:00:33.181481+0000, chain.objs.size()=1 2024-09-12T19:13:57.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.OQMSd6ZCI4LF46-VTWQ8IazZTcCGPxw_0 2024-09-12T19:13:57.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7942107211550192408', time=2024-09-12T21:00:33.366910+0000, chain.objs.size()=1 2024-09-12T19:13:57.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qzQH6LbL-_lfz_bur1eqJ1gxBqdFxbg_0 2024-09-12T19:13:57.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11235280636383508155', time=2024-09-12T21:00:33.370780+0000, chain.objs.size()=1 2024-09-12T19:13:57.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ZE2rKSpWKkt_BuK6_39hNUxlA2_SAdX_0 2024-09-12T19:13:57.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14753215532449927357', time=2024-09-12T21:00:33.418968+0000, chain.objs.size()=1 2024-09-12T19:13:57.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WGT_eZydpo_Rzs7277DnsbfAzvgePad_0 2024-09-12T19:13:57.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11571424488526258667', time=2024-09-12T21:00:33.436460+0000, chain.objs.size()=1 2024-09-12T19:13:57.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.bXvcpuSCMx9AQpjqBKhsQsMvgcooqnY_0 2024-09-12T19:13:57.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.423963892440660307', time=2024-09-12T21:00:33.475064+0000, chain.objs.size()=1 2024-09-12T19:13:57.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DJDlpkfvD3bVbSHkMLjfVM1O_pmiz5U_0 2024-09-12T19:13:57.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1979719990116655775', time=2024-09-12T21:00:33.585458+0000, chain.objs.size()=1 2024-09-12T19:13:57.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.8FzTdN46haHJ8NvrBnl1gnARljADpUx_0 2024-09-12T19:13:57.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13206283260730759614', time=2024-09-12T21:00:33.630626+0000, chain.objs.size()=1 2024-09-12T19:13:57.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.620+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.6e-IbReptNRjV-QWD4tt4_KJ2pq32al_0 2024-09-12T19:13:57.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16907684083381742107', time=2024-09-12T21:00:33.649664+0000, chain.objs.size()=1 2024-09-12T19:13:57.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ey6gWsRlb4B85iDC26rpltm0FAm8t4e_0 2024-09-12T19:13:57.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14281891500393590635', time=2024-09-12T21:00:33.654537+0000, chain.objs.size()=1 2024-09-12T19:13:57.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7QkfYvw41aSIIAUTGVsol0syvKja7Yo_0 2024-09-12T19:13:57.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2629902984755480488', time=2024-09-12T21:00:48.389929+0000, chain.objs.size()=1 2024-09-12T19:13:57.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.282__shadow_.Kg9L2Pe5W9EUsGARLStRSoeEjxsj0sy_0 2024-09-12T19:13:57.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9259867527145627272', time=2024-09-12T21:00:49.832478+0000, chain.objs.size()=1 2024-09-12T19:13:57.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.284__shadow_.E5npQYOlv4Yqy2fSyunQ3gbyIbEx6Og_0 2024-09-12T19:13:57.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10263038555726371623', time=2024-09-12T21:00:56.750993+0000, chain.objs.size()=1 2024-09-12T19:13:57.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.fIKgQy-_SrLuiQZk4pr53LBKaCNYx1u_0 2024-09-12T19:13:57.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9525062935780453725', time=2024-09-12T21:00:58.113368+0000, chain.objs.size()=1 2024-09-12T19:13:57.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.wPFmzi5qWUQnyKMtUqQ5Q80cpr8ciw6_0 2024-09-12T19:13:57.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3084334161914847227', time=2024-09-12T21:00:58.116484+0000, chain.objs.size()=1 2024-09-12T19:13:57.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.mYr2Nkby4UybnVAUJY8LDn16zzmkqs5_0 2024-09-12T19:13:57.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13413604715426456410', time=2024-09-12T21:00:58.148775+0000, chain.objs.size()=1 2024-09-12T19:13:57.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.ljHbUJooSWgKFZGoItGD1TUYgXUD_rB_0 2024-09-12T19:13:57.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9857938180563513009', time=2024-09-12T21:00:58.838011+0000, chain.objs.size()=1 2024-09-12T19:13:57.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.294__shadow_.XqNX0KImqxnLWdaScQmCmg4p2bI_kle_0 2024-09-12T19:13:57.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12396266746616405709', time=2024-09-12T21:01:03.385138+0000, chain.objs.size()=1 2024-09-12T19:13:57.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.300__shadow_.z4x_OFgkxHbws34Wq0ZcsHhGz2FWWmb_0 2024-09-12T19:13:57.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12351668354860951685', time=2024-09-12T21:01:06.304243+0000, chain.objs.size()=1 2024-09-12T19:13:57.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.304__shadow_.QihFV4_bT3q2NgSmXN9LgRDXh0qmS9e_0 2024-09-12T19:13:57.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1764838646625800257', time=2024-09-12T21:01:17.731300+0000, chain.objs.size()=1 2024-09-12T19:13:57.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.319__shadow:bjszTLuHoddW2VaFGykD85JoKpxuLZ1_.Jm3iKDPskEZx5UbOgscFeErS7r5kntY_0 2024-09-12T19:13:57.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13978940362302141422', time=2024-09-12T21:01:39.460776+0000, chain.objs.size()=1 2024-09-12T19:13:57.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.VRbqpipeEwK4A6nE-InzJFqVWXm-TyU_0 2024-09-12T19:13:57.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17322629152529390964', time=2024-09-12T21:01:39.492569+0000, chain.objs.size()=1 2024-09-12T19:13:57.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.IF1_2tTfOEfdlYOhfTWFMeUzK-pdVVG_0 2024-09-12T19:13:57.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10039493160312374773', time=2024-09-12T21:01:39.659886+0000, chain.objs.size()=1 2024-09-12T19:13:57.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.V6l1uBy6qaZsp1avN2uXYsEetR6S3Wq_0 2024-09-12T19:13:57.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12762403294467734659', time=2024-09-12T21:01:39.938846+0000, chain.objs.size()=1 2024-09-12T19:13:57.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.94WbTGkVLG_4ULLt0mya0PbOTOvJ8vx_0 2024-09-12T19:13:57.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18273928570395027151', time=2024-09-12T21:01:39.947338+0000, chain.objs.size()=1 2024-09-12T19:13:57.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.EtMzWMHe_wK16CgMp-elOhhd61UCd_j_0 2024-09-12T19:13:57.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4815684398709471257', time=2024-09-12T21:01:40.016385+0000, chain.objs.size()=1 2024-09-12T19:13:57.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._wqlIu4lkvvChIvG4JyEiPFpUnxLwpd_0 2024-09-12T19:13:57.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3020914000290431442', time=2024-09-12T21:01:40.123535+0000, chain.objs.size()=1 2024-09-12T19:13:57.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.624+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.B_yXuNB5J-co78EZHAXUefYKCYjtWGP_0 2024-09-12T19:13:57.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12114559582810016365', time=2024-09-12T21:01:40.161035+0000, chain.objs.size()=1 2024-09-12T19:13:57.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9uE7iSUNT8CJQSTEg55foWQWZP63isE_0 2024-09-12T19:13:57.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4986784384172287449', time=2024-09-12T21:01:40.205199+0000, chain.objs.size()=1 2024-09-12T19:13:57.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.dY1YRLE9o8El5CkHQckX8ipLeCvyFn9_0 2024-09-12T19:13:57.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4782920196898595190', time=2024-09-12T21:01:40.329297+0000, chain.objs.size()=1 2024-09-12T19:13:57.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.FI1g3YAZtqD3hof-UhwEmgDJdLzGtLd_0 2024-09-12T19:13:57.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2715699184118840934', time=2024-09-12T21:01:40.337386+0000, chain.objs.size()=1 2024-09-12T19:13:57.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.HOh7Q9Z303MMtfDHMW4eXc2xM9WgzFL_0 2024-09-12T19:13:57.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13987955223456817087', time=2024-09-12T21:01:40.404420+0000, chain.objs.size()=1 2024-09-12T19:13:57.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hPxqOtrlwZIu91-ynQDocZYj6SkETlB_0 2024-09-12T19:13:57.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18227041729141706477', time=2024-09-12T21:01:40.442143+0000, chain.objs.size()=1 2024-09-12T19:13:57.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.--J0yP9SdDQmxyMu9q02Vyh5nt4SIor_0 2024-09-12T19:13:57.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1652064979630087231', time=2024-09-12T21:01:40.453926+0000, chain.objs.size()=1 2024-09-12T19:13:57.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.WlFwUTgC543xyZQxTeXe13evT4dpeDA_0 2024-09-12T19:13:57.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16142607274007356587', time=2024-09-12T21:01:40.578340+0000, chain.objs.size()=1 2024-09-12T19:13:57.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Ht5XIMfCTA7YJs34FnsfzGpXMvp22ps_0 2024-09-12T19:13:57.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1207658912263568171', time=2024-09-12T21:01:40.602935+0000, chain.objs.size()=1 2024-09-12T19:13:57.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.4g7VirYR3FFRcZ--QYmY6v5e1fTwoSp_0 2024-09-12T19:13:57.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14342624116740919732', time=2024-09-12T21:01:40.768953+0000, chain.objs.size()=1 2024-09-12T19:13:57.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.lOtVQ_QSfPtGTAz8Lwuo3SkI4Ed9z6M_0 2024-09-12T19:13:57.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3923645090490448478', time=2024-09-12T21:01:40.791909+0000, chain.objs.size()=1 2024-09-12T19:13:57.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.KeqWm3BkcKlYR8Oy5EWSHD4eugo8kyr_0 2024-09-12T19:13:57.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15391262398580465507', time=2024-09-12T21:01:40.825935+0000, chain.objs.size()=1 2024-09-12T19:13:57.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.i_kjcnE0v3pA5xHKkWA1Wdnc7I1OkwT_0 2024-09-12T19:13:57.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18240897732780372539', time=2024-09-12T21:01:40.833532+0000, chain.objs.size()=1 2024-09-12T19:13:57.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.XZfnFT5x7wkveVTENPxPSPX2XZR8PfH_0 2024-09-12T19:13:57.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8351140080952834900', time=2024-09-12T21:01:40.860209+0000, chain.objs.size()=1 2024-09-12T19:13:57.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.K6pejMyR6rtCpD-p89DsvLd9RO9HAkc_0 2024-09-12T19:13:57.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16424600880014185689', time=2024-09-12T21:01:41.028714+0000, chain.objs.size()=1 2024-09-12T19:13:57.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Pkb3Mu5Y3dj8F_G5wq4Vi38PNMAJ4fr_0 2024-09-12T19:13:57.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18157062154085725575', time=2024-09-12T21:01:41.039509+0000, chain.objs.size()=1 2024-09-12T19:13:57.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-SeGgNIxvYUoCDy4DkeqsbHLN6EDUZX_0 2024-09-12T19:13:57.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15281152832599393768', time=2024-09-12T21:01:41.059721+0000, chain.objs.size()=1 2024-09-12T19:13:57.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.upvSJ48vd1byScnn1o2ZnDUslvlF6eD_0 2024-09-12T19:13:57.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8664114988796832314', time=2024-09-12T21:01:41.085314+0000, chain.objs.size()=1 2024-09-12T19:13:57.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.caryknpLkfiolLSYzM9-Io8hiaTixTA_0 2024-09-12T19:13:57.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17175552548108115663', time=2024-09-12T21:02:00.518926+0000, chain.objs.size()=1 2024-09-12T19:13:57.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.628+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yItw-oX5TrkY-EMxphngu7e_EdP2Thz_0 2024-09-12T19:13:57.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6808808266309403480', time=2024-09-12T21:02:00.568257+0000, chain.objs.size()=1 2024-09-12T19:13:57.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.vIiaVUSsgiCjJs3ew33ZFW3vX3x8KJR_0 2024-09-12T19:13:57.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13140892608525565165', time=2024-09-12T21:02:00.583737+0000, chain.objs.size()=1 2024-09-12T19:13:57.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.LA8DFndV0tdLbDG2iVZziF5qOzYyQ9C_0 2024-09-12T19:13:57.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6430622288838076483', time=2024-09-12T21:02:00.616130+0000, chain.objs.size()=1 2024-09-12T19:13:57.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.P1Ge4cKNBp1AVyUPVWccmesaLW1djyX_0 2024-09-12T19:13:57.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2687176349390403282', time=2024-09-12T21:02:00.617552+0000, chain.objs.size()=1 2024-09-12T19:13:57.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5PShO3M9BPrWfD0ESWsdcdrSY1rpEU-_0 2024-09-12T19:13:57.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13665551794330834917', time=2024-09-12T21:02:00.631759+0000, chain.objs.size()=1 2024-09-12T19:13:57.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1Jund6YggSkQCvjN92YgE8QqsPRkDQh_0 2024-09-12T19:13:57.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11903154295222628681', time=2024-09-12T21:02:00.649267+0000, chain.objs.size()=1 2024-09-12T19:13:57.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.QYPGmtA759c7DOu0DWMYsL0NLGT3w9x_0 2024-09-12T19:13:57.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7747001607022098894', time=2024-09-12T21:02:00.864542+0000, chain.objs.size()=1 2024-09-12T19:13:57.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.3AzYGpxE6GfmjCn6fpOj_Yj_4h9bWT9_0 2024-09-12T19:13:57.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1880836480606830129', time=2024-09-12T21:02:00.988843+0000, chain.objs.size()=1 2024-09-12T19:13:57.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.nSJxJQSfiXEWgIMUVcbQY3NmneQW2c5_0 2024-09-12T19:13:57.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1259086791402557498', time=2024-09-12T21:02:00.996306+0000, chain.objs.size()=1 2024-09-12T19:13:57.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.KaZkrG6kWZ69GankqLjRleGfTXG5dmE_0 2024-09-12T19:13:57.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12684793736201792309', time=2024-09-12T21:02:01.018292+0000, chain.objs.size()=1 2024-09-12T19:13:57.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2XRY5yciNcZRcV_1rJVs6CbbjaBjhPJ_0 2024-09-12T19:13:57.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12378932374216283932', time=2024-09-12T21:02:01.061142+0000, chain.objs.size()=1 2024-09-12T19:13:57.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.mWR_XpZSyAFzlOi28DlCDCaAu3gBUH7_0 2024-09-12T19:13:57.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4916511325261864596', time=2024-09-12T21:02:01.062112+0000, chain.objs.size()=1 2024-09-12T19:13:57.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.sLqqJHvWN-QyS3nO7SVJWwnUqvpiDzf_0 2024-09-12T19:13:57.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12201394723565101358', time=2024-09-12T21:02:01.068269+0000, chain.objs.size()=1 2024-09-12T19:13:57.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.dI9rZVYo_7leBlmcEAFncFILRe6VX-t_0 2024-09-12T19:13:57.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7911061355849390110', time=2024-09-12T21:02:01.082504+0000, chain.objs.size()=1 2024-09-12T19:13:57.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.pgy-C95oi2PeCDT1AJrlluM9RJ8rrge_0 2024-09-12T19:13:57.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2680554662740702071', time=2024-09-12T21:02:01.100921+0000, chain.objs.size()=1 2024-09-12T19:13:57.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.dM9BLBGN7QsvMd4a9QQU0J5z7Seke8__0 2024-09-12T19:13:57.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.428867735495376945', time=2024-09-12T21:02:01.110487+0000, chain.objs.size()=1 2024-09-12T19:13:57.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.TIDDaJF1ivlh_BZ6FqUntU2DZtd4ckZ_0 2024-09-12T19:13:57.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6537756233093793849', time=2024-09-12T21:02:01.232098+0000, chain.objs.size()=1 2024-09-12T19:13:57.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.oxcUbVdhOM1kf-k7wDnzXylFjnpdLgx_0 2024-09-12T19:13:57.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15725693539654330922', time=2024-09-12T21:02:01.329193+0000, chain.objs.size()=1 2024-09-12T19:13:57.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.DShKYsOcxuqYTnMjb4nOAFZW4rUnxpv_0 2024-09-12T19:13:57.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12193968379233112894', time=2024-09-12T21:02:01.333547+0000, chain.objs.size()=1 2024-09-12T19:13:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.632+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.RPdINRoWewPmWBCOdL_uSSlEUXS7tCX_0 2024-09-12T19:13:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12821866716572269002', time=2024-09-12T21:02:01.344475+0000, chain.objs.size()=1 2024-09-12T19:13:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.nsVvpKd09KEOu_yHKBO3IrzYnhMo7Rw_0 2024-09-12T19:13:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12242835044104180970', time=2024-09-12T21:02:01.468810+0000, chain.objs.size()=1 2024-09-12T19:13:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.6l6RWT-E_fN6NlCTeq6V-5IQ6MKIP5p_0 2024-09-12T19:13:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15546041670512034494', time=2024-09-12T21:02:01.712426+0000, chain.objs.size()=1 2024-09-12T19:13:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.lO1H20mvjCk3f2XmNhLa9ojXG_Iuk2m_0 2024-09-12T19:13:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1566234299999470223', time=2024-09-12T21:02:01.731441+0000, chain.objs.size()=1 2024-09-12T19:13:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Wn4JPPUCY1_dwlBIIek-HjBdZUOMQlG_0 2024-09-12T19:13:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4511443955033451332', time=2024-09-12T21:02:01.735686+0000, chain.objs.size()=1 2024-09-12T19:13:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.EIVOCQpAf2iyEJfXhIebMQvdawVYKep_0 2024-09-12T19:13:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8070724419623962880', time=2024-09-12T21:02:01.750064+0000, chain.objs.size()=1 2024-09-12T19:13:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.6bORvN9jZsUYZwtLlgyRzIqyKQ92RRy_0 2024-09-12T19:13:57.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5430033887252270246', time=2024-09-12T21:02:01.767899+0000, chain.objs.size()=1 2024-09-12T19:13:57.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.g30prjNGC_h9wKDDmdOuWqWEn7HRxlk_0 2024-09-12T19:13:57.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3749634960591089883', time=2024-09-12T21:02:01.913087+0000, chain.objs.size()=1 2024-09-12T19:13:57.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.xo1GPxMtgAhcjDVFd7pblno5OPPSQRM_0 2024-09-12T19:13:57.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.636+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44880 2024-09-12T19:13:57.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T19:13:57.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12739278614448335603', time=2024-09-12T21:02:01.964628+0000, chain.objs.size()=1 2024-09-12T19:13:57.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.4Wz7Em5ApT9wMbGt7ShlGjQBmMTgcZZ_0 2024-09-12T19:13:57.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12067872160596278530', time=2024-09-12T21:02:01.968255+0000, chain.objs.size()=1 2024-09-12T19:13:57.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qiNihEreYcUwYTlHV0wJIcRIrwBFRl-_0 2024-09-12T19:13:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10427024572273109537', time=2024-09-12T21:02:01.977234+0000, chain.objs.size()=1 2024-09-12T19:13:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.djiekYRD55nNFSzCew-uM0poUPF3qc2_0 2024-09-12T19:13:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13638238504872609491', time=2024-09-12T21:02:01.982091+0000, chain.objs.size()=1 2024-09-12T19:13:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WyQYyWf9IqLWiTMLjsmtDWrsf-JGhOF_0 2024-09-12T19:13:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2367328890336252944', time=2024-09-12T21:02:02.011144+0000, chain.objs.size()=1 2024-09-12T19:13:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7A0qIC21ezPnsw3nC0Qqxgyx67JCLmB_0 2024-09-12T19:13:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1080645717375753748', time=2024-09-12T21:02:02.108340+0000, chain.objs.size()=1 2024-09-12T19:13:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.O7YYjipDff7Lghpj-EnSxzyl8u2OMgs_0 2024-09-12T19:13:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7907740347331145229', time=2024-09-12T21:02:02.136194+0000, chain.objs.size()=1 2024-09-12T19:13:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1DYgdSeGZK0Y4NsGCPTMsXqnsa4JGZ6_0 2024-09-12T19:13:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18134048495544745713', time=2024-09-12T21:02:02.165114+0000, chain.objs.size()=1 2024-09-12T19:13:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.3cmRL_4IS6bogyrJDaeonCXtevwJ5V9_0 2024-09-12T19:13:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12935080028450755612', time=2024-09-12T21:02:02.171631+0000, chain.objs.size()=1 2024-09-12T19:13:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.6K-ZUd7xKAGrb7i7i5eYnSkNChJxKWg_0 2024-09-12T19:13:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12290022945593524973', time=2024-09-12T21:02:02.187574+0000, chain.objs.size()=1 2024-09-12T19:13:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.fDRA4T0N7Mp8DMTmiSxrnYslaILcK1h_0 2024-09-12T19:13:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7701085528316120923', time=2024-09-12T21:02:16.653071+0000, chain.objs.size()=1 2024-09-12T19:13:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.346__shadow_.saeSNXx0EQRbaHVCs6pO_K7ipbT5-JP_0 2024-09-12T19:13:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15842047401292979111', time=2024-09-12T21:02:31.665434+0000, chain.objs.size()=1 2024-09-12T19:13:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.371__shadow_.Y_Z6hOj_Q55sy3rslhAPZadv4iWtefG_0 2024-09-12T19:13:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13369467780715877091', time=2024-09-12T21:03:00.045720+0000, chain.objs.size()=1 2024-09-12T19:13:57.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.408__shadow_.Op8vSVpTVZMTEeTjBFo3nUJXP3r1GVz_0 2024-09-12T19:13:57.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10015169597362495830', time=2024-09-12T21:03:45.969395+0000, chain.objs.size()=1 2024-09-12T19:13:57.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.465__shadow_.sjFYoSV0SYVInjl8sUhlOqx5G1glL17_0 2024-09-12T19:13:57.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16050490705930389425', time=2024-09-12T21:03:55.569136+0000, chain.objs.size()=1 2024-09-12T19:13:57.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.483__shadow_.X1NHmkkhpb7R5Al02Dj_5_SVMeG3vgI_0 2024-09-12T19:13:57.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8365349857373643629', time=2024-09-12T21:04:21.536236+0000, chain.objs.size()=1 2024-09-12T19:13:57.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.517__shadow_.ZUPflDEntfrr9DNexN1Ay8TldTnPMkQ_0 2024-09-12T19:13:57.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-CkEzIh-Yu1J_uZZDO3P-q5DHtsfdZ4', time=2024-09-12T21:05:01.514878+0000, chain.objs.size()=1 2024-09-12T19:13:57.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.533__multipart_mymultipart.2~-CkEzIh-Yu1J_uZZDO3P-q5DHtsfdZ4.1 2024-09-12T19:13:57.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5234678028053870477', time=2024-09-12T21:05:48.767171+0000, chain.objs.size()=1 2024-09-12T19:13:57.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.557__shadow_.3eWBcN9xIpDOB2a0_pss4tCDRYBzzJL_0 2024-09-12T19:13:57.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5314922771240837663', time=2024-09-12T21:05:48.820641+0000, chain.objs.size()=1 2024-09-12T19:13:57.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.557__shadow_.2p6XnuToanHx_gctsuY02AdW3aw2TjJ_0 2024-09-12T19:13:57.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7923966212209867977', time=2024-09-12T21:05:52.169244+0000, chain.objs.size()=1 2024-09-12T19:13:57.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.640+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.560__shadow_.yrylbusv59jMijMk_WZPpSpmX7s1u5F_0 2024-09-12T19:13:57.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15158925750496461617', time=2024-09-12T21:06:10.899191+0000, chain.objs.size()=1 2024-09-12T19:13:57.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:0kZCE4PtQeYrAdguXPKzkI3Knx8osap_.lvqCiHna5da4rAUQgVPrVW5q6yju4dO_0 2024-09-12T19:13:57.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17337650254621393511', time=2024-09-12T21:06:19.075045+0000, chain.objs.size()=1 2024-09-12T19:13:57.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.574__shadow:qGFmCkVicUkmUoiyz5peWDSkO5.Gj5S_.Ontbf9f5Xhd_VPBPxjhkXduLFilKdNW_0 2024-09-12T19:13:57.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17003336173797237932', time=2024-09-12T21:06:34.564891+0000, chain.objs.size()=1 2024-09-12T19:13:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:CZTQZ2uRCvGH7IKgkpdh0RAO1y0u0mW_.0diBON5gJiVbIVIhOGp0bfrzWcH0IqQ_0 2024-09-12T19:13:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1325976794064130135', time=2024-09-12T21:06:48.065148+0000, chain.objs.size()=1 2024-09-12T19:13:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.580__shadow:.abm629bZ7ep2z837Zi-5YuMG53mXIa_.i1dJDUU169PNEZ1pTvFndQH-IsLZdr6_0 2024-09-12T19:13:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4650375223381055152', time=2024-09-12T21:06:52.121452+0000, chain.objs.size()=1 2024-09-12T19:13:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.585__shadow:48I-989UbH-aX9xjvTojrDitYgY.3I8_.B5EAs2-OWBNWoqExcgjxOQZ5ad2aDNe_0 2024-09-12T19:13:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1184744700173565833', time=2024-09-12T21:10:07.190660+0000, chain.objs.size()=1 2024-09-12T19:13:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.664__shadow_.I6zuxkozpeA9yM8p3IhX16I_fFrRteo_0 2024-09-12T19:13:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1351582081921947087', time=2024-09-12T21:10:36.262963+0000, chain.objs.size()=1 2024-09-12T19:13:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.708__shadow:sM4jYfIVPx00Mi4Znk3KsEMX.rivG7B_.o6MRUPhxTGP4J2nxU0I11F0dYVFXi-3_0 2024-09-12T19:13:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10957268945044387820', time=2024-09-12T21:10:51.533987+0000, chain.objs.size()=1 2024-09-12T19:13:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.716__shadow:aeniJ1oqE-k05UyxdHRNLkFoxaXZXv4_.HUs0XqJaGpN4SOTIp8t4byz9VDpHIhG_0 2024-09-12T19:13:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.644+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.648+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T19:13:57.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.648+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.648+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44021' 2024-09-12T19:13:57.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2212620732882185052', time=2024-09-12T20:57:24.163569+0000, chain.objs.size()=1 2024-09-12T19:13:57.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.147__shadow_.VUFlgzzRNUWQ9WoLShXmKXKhJIsuTB7_0 2024-09-12T19:13:57.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3839987264703297230', time=2024-09-12T20:59:53.582089+0000, chain.objs.size()=1 2024-09-12T19:13:57.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.237__shadow_.Cj0r7Tqv9VSnB3KQ50UhbzHwCY0d1en_0 2024-09-12T19:13:57.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3885094940486197916', time=2024-09-12T20:59:53.586433+0000, chain.objs.size()=1 2024-09-12T19:13:57.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.237__shadow_.c_v96URQI7lySS1pL5AZmh9WGy_dkuE_0 2024-09-12T19:13:57.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16268079332374978348', time=2024-09-12T20:59:54.793045+0000, chain.objs.size()=1 2024-09-12T19:13:57.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.238__shadow_.K27DcnRWG6qWi7j2wfVYVbJZf6wtBMT_0 2024-09-12T19:13:57.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14779967186114629275', time=2024-09-12T20:59:58.864522+0000, chain.objs.size()=1 2024-09-12T19:13:57.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.243__shadow_.HFw1pamu8tjL9yvxTmr-8wPG828dSF0_0 2024-09-12T19:13:57.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.431024006340361445', time=2024-09-12T21:00:04.394591+0000, chain.objs.size()=1 2024-09-12T19:13:57.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.250__shadow_.o5OfvHL3Ds9yjPi1P3k2KeceWYHMqZ8_0 2024-09-12T19:13:57.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2626992314181310294', time=2024-09-12T21:00:05.891821+0000, chain.objs.size()=1 2024-09-12T19:13:57.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.252__shadow_.Q9j2_--Zy9T1YntRn4m-oP7BweLJSjK_0 2024-09-12T19:13:57.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16973663339691148838', time=2024-09-12T21:00:08.819687+0000, chain.objs.size()=1 2024-09-12T19:13:57.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.256__shadow_.Zza2BqOsDEuyxzS7GjrjXBQdoARw7Yl_0 2024-09-12T19:13:57.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3305182286022222558', time=2024-09-12T21:00:32.023628+0000, chain.objs.size()=1 2024-09-12T19:13:57.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DCyEATFE1r-ProwlqWknpwUBDhWjlXA_0 2024-09-12T19:13:57.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16237594216959993851', time=2024-09-12T21:00:32.025111+0000, chain.objs.size()=1 2024-09-12T19:13:57.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tJ1XuF9d1c0aNO09b9kkFVE8i8eE02Q_0 2024-09-12T19:13:57.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1556744385974551910', time=2024-09-12T21:00:32.040785+0000, chain.objs.size()=1 2024-09-12T19:13:57.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.91BG4k8JNlDhdqzO2VqphsJ8eeKkN0G_0 2024-09-12T19:13:57.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10171009577750380972', time=2024-09-12T21:00:32.042805+0000, chain.objs.size()=1 2024-09-12T19:13:57.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.vgnKULatvgvZopPlivAAgFH0F9wEVB0_0 2024-09-12T19:13:57.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4435722571508423703', time=2024-09-12T21:00:32.080321+0000, chain.objs.size()=1 2024-09-12T19:13:57.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.nHIgn50N41BAx6zAidb3ij3AHzqRQYf_0 2024-09-12T19:13:57.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.618555932972887524', time=2024-09-12T21:00:32.097450+0000, chain.objs.size()=1 2024-09-12T19:13:57.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Wspe-NN4gJHd4JVCigdlI4xBy9v1Ax-_0 2024-09-12T19:13:57.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7247002383670185982', time=2024-09-12T21:00:32.120018+0000, chain.objs.size()=1 2024-09-12T19:13:57.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.UFrqItLInhMdCtXmLkTU4wb_PULwesm_0 2024-09-12T19:13:57.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10650666935922577955', time=2024-09-12T21:00:32.228912+0000, chain.objs.size()=1 2024-09-12T19:13:57.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.KYH_73MMFntWgwotF1FYpEYpGJxjVSh_0 2024-09-12T19:13:57.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13111421096144443462', time=2024-09-12T21:00:32.313519+0000, chain.objs.size()=1 2024-09-12T19:13:57.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.D6wc9r-yAzKk5aNkVDP_7Cll4RGj8h-_0 2024-09-12T19:13:57.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9805927748976604760', time=2024-09-12T21:00:32.315136+0000, chain.objs.size()=1 2024-09-12T19:13:57.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tK_-7bleDl8TIX2a2k1cU1VS9fNrnQ-_0 2024-09-12T19:13:57.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16413225497098923435', time=2024-09-12T21:00:32.507028+0000, chain.objs.size()=1 2024-09-12T19:13:57.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Qz7Qf4lWFPtgeq2hDqOzsQJ8cvUtUMp_0 2024-09-12T19:13:57.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14866573203603865533', time=2024-09-12T21:00:32.519745+0000, chain.objs.size()=1 2024-09-12T19:13:57.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.vtnjlF2vV_FtiKN-AMrkB-_nC7RmEZY_0 2024-09-12T19:13:57.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12771832610324870218', time=2024-09-12T21:00:32.532301+0000, chain.objs.size()=1 2024-09-12T19:13:57.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.I1yEFAIsFo1kd9qZLekB8SytpA5d0v8_0 2024-09-12T19:13:57.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6970471574283531229', time=2024-09-12T21:00:32.730003+0000, chain.objs.size()=1 2024-09-12T19:13:57.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qFeWY0CfO51MxLHmYYc4VU-YeaDCbWz_0 2024-09-12T19:13:57.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2503343324783369653', time=2024-09-12T21:00:32.752918+0000, chain.objs.size()=1 2024-09-12T19:13:57.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.652+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.V2ov_MeYtjzcrSl_7aMPqnzhrIzWsHk_0 2024-09-12T19:13:57.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8866146492741332178', time=2024-09-12T21:00:32.876613+0000, chain.objs.size()=1 2024-09-12T19:13:57.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LwxlQXV_Ih0A9VeR3RFsyLojvrMZ62O_0 2024-09-12T19:13:57.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3163718143970192535', time=2024-09-12T21:00:32.914411+0000, chain.objs.size()=1 2024-09-12T19:13:57.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.xDtQg2DRoIJyHE3JxmCwE-hzezsaxJU_0 2024-09-12T19:13:57.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16539107154670480857', time=2024-09-12T21:00:32.925246+0000, chain.objs.size()=1 2024-09-12T19:13:57.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.0lSVnxgUDXpXyibmRQlMJN8Xfljyurb_0 2024-09-12T19:13:57.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17846124854801664887', time=2024-09-12T21:00:32.949854+0000, chain.objs.size()=1 2024-09-12T19:13:57.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.YdwUc9BB6BiKZQ3k1a4VQIvRkZm0lf9_0 2024-09-12T19:13:57.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17055058921928461395', time=2024-09-12T21:00:32.953865+0000, chain.objs.size()=1 2024-09-12T19:13:57.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.BYNM59O292PlTVV9vcMT-fuu8QYogX8_0 2024-09-12T19:13:57.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12231897461368803173', time=2024-09-12T21:00:32.980450+0000, chain.objs.size()=1 2024-09-12T19:13:57.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.L_Ejpp9AtSfaZ1IUpi-yHzA0thcuKJC_0 2024-09-12T19:13:57.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4388922774890981284', time=2024-09-12T21:00:32.990267+0000, chain.objs.size()=1 2024-09-12T19:13:57.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.QfYPjw1TntCxNqVjI-pHm5q-JyMDUWb_0 2024-09-12T19:13:57.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2988182206408891598', time=2024-09-12T21:00:33.126868+0000, chain.objs.size()=1 2024-09-12T19:13:57.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2m9NNUmwH4MaK8Oi2M-eJ5mYnC16mkq_0 2024-09-12T19:13:57.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3384766672819858632', time=2024-09-12T21:00:33.155059+0000, chain.objs.size()=1 2024-09-12T19:13:57.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.F3lkz48a52270HS9mkQEYVFBCtjV_Mu_0 2024-09-12T19:13:57.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15627385787900990906', time=2024-09-12T21:00:33.158819+0000, chain.objs.size()=1 2024-09-12T19:13:57.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ZyrXhKmYjLk72ETZ70fIzNewde-CsVh_0 2024-09-12T19:13:57.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.912347371741591681', time=2024-09-12T21:00:33.161345+0000, chain.objs.size()=1 2024-09-12T19:13:57.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.656+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Nfz1HH1yqZhhTiD8SESc9ypMNxu8KE6_0 2024-09-12T19:13:57.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16549840355492728932', time=2024-09-12T21:00:33.370420+0000, chain.objs.size()=1 2024-09-12T19:13:57.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.UA0HCYVV6DU_t7bsGHzzNwX4CbBf0Bn_0 2024-09-12T19:13:57.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2691864214029560804', time=2024-09-12T21:00:33.410036+0000, chain.objs.size()=1 2024-09-12T19:13:57.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.gUbfV2q8Qe0idXIttnQqydLSicvElCd_0 2024-09-12T19:13:57.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17223030888296242457', time=2024-09-12T21:00:33.457884+0000, chain.objs.size()=1 2024-09-12T19:13:57.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.aSYJ9_lEVUa8tuCE_TEch8QL6uRi-CC_0 2024-09-12T19:13:57.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9829933990817013452', time=2024-09-12T21:00:33.589685+0000, chain.objs.size()=1 2024-09-12T19:13:57.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.vNU1O1ipXrq9XAqLFuhP2ouUDZSTXBk_0 2024-09-12T19:13:57.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17134778972772214838', time=2024-09-12T21:00:33.631841+0000, chain.objs.size()=1 2024-09-12T19:13:57.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.OQOwBFY9UzwSdMpHZhVX5SFLnbsj2ox_0 2024-09-12T19:13:57.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14053888400848986991', time=2024-09-12T21:00:33.652516+0000, chain.objs.size()=1 2024-09-12T19:13:57.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.G1cNps_x4oElFe_dTIxLWaoXL7LsLvU_0 2024-09-12T19:13:57.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14033323794774768643', time=2024-09-12T21:00:44.739962+0000, chain.objs.size()=1 2024-09-12T19:13:57.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.277__shadow_.uboCQiaSx4igfNdAjF1W0CBbWIKZusr_0 2024-09-12T19:13:57.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15559199906155977731', time=2024-09-12T21:00:49.832242+0000, chain.objs.size()=1 2024-09-12T19:13:57.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.284__shadow_.R8rrni-jyt2enMbSMaewnaO9eMLVIjM_0 2024-09-12T19:13:57.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1583472103599204690', time=2024-09-12T21:00:53.555961+0000, chain.objs.size()=1 2024-09-12T19:13:57.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.289__shadow_.tu4RvhzwXiDuBKEVlX9odwVtCFE6QDJ_0 2024-09-12T19:13:57.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6570860845939010823', time=2024-09-12T21:00:56.714058+0000, chain.objs.size()=1 2024-09-12T19:13:57.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.mZJUvF3fQa__XoYL1CTH9g99u-46DWK_0 2024-09-12T19:13:57.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18207012548617965966', time=2024-09-12T21:00:58.126470+0000, chain.objs.size()=1 2024-09-12T19:13:57.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.YtymaaqVOVdqFNpVqeP7N_O-rVl9wMX_0 2024-09-12T19:13:57.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5954645349154972979', time=2024-09-12T21:00:58.130627+0000, chain.objs.size()=1 2024-09-12T19:13:57.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.b16dU7gZHArl1nBOAVIsSQI0iezrC2a_0 2024-09-12T19:13:57.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7936416812094490048', time=2024-09-12T21:00:58.146016+0000, chain.objs.size()=1 2024-09-12T19:13:57.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.TAm5VOPu7yArk6CsACEWJBFL1HKMory_0 2024-09-12T19:13:57.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5169951359366272257', time=2024-09-12T21:01:18.602731+0000, chain.objs.size()=1 2024-09-12T19:13:57.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.321__shadow_.WGEuBt5aIrj9_6oW5s44viZc_AQgASi_0 2024-09-12T19:13:57.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.352596791571906639', time=2024-09-12T21:01:39.452588+0000, chain.objs.size()=1 2024-09-12T19:13:57.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.t-DT6GlBQ2KUqFYEY_xmXNl8gPEiYvW_0 2024-09-12T19:13:57.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17138824221523283481', time=2024-09-12T21:01:39.534341+0000, chain.objs.size()=1 2024-09-12T19:13:57.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.G2YcTlJObVNQrKu6LmghFoFrLq1SDbp_0 2024-09-12T19:13:57.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3584166715609102356', time=2024-09-12T21:01:39.547055+0000, chain.objs.size()=1 2024-09-12T19:13:57.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.NAI3zNFsQUGSjtr45OxSBZYITTI1m63_0 2024-09-12T19:13:57.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17187155503793882780', time=2024-09-12T21:01:39.666247+0000, chain.objs.size()=1 2024-09-12T19:13:57.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.HX3UztaKYi-AXJZyA7c5ExgjyAKzOQb_0 2024-09-12T19:13:57.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13717440151254492381', time=2024-09-12T21:01:39.685671+0000, chain.objs.size()=1 2024-09-12T19:13:57.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.R-VYtZvfKkXxbRMemBP0I-9nSg8DUL1_0 2024-09-12T19:13:57.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6313274783034775682', time=2024-09-12T21:01:39.761503+0000, chain.objs.size()=1 2024-09-12T19:13:57.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.KaFx5A3xUhesb6txz8BOOu3QRbIsVID_0 2024-09-12T19:13:57.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5203447289744051697', time=2024-09-12T21:01:39.772314+0000, chain.objs.size()=1 2024-09-12T19:13:57.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.xf2xiuAW_snddmyarFKjvUlXN81TpuF_0 2024-09-12T19:13:57.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4556577405116805730', time=2024-09-12T21:01:39.791405+0000, chain.objs.size()=1 2024-09-12T19:13:57.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.i8uGFDIbSf3cso2ZMTDwjpRQqlkPBVD_0 2024-09-12T19:13:57.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6985535020789482836', time=2024-09-12T21:01:39.801914+0000, chain.objs.size()=1 2024-09-12T19:13:57.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.660+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.1_wKVt-qJhSmmY3zzC-xD-yUBNptMUl_0 2024-09-12T19:13:57.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3372997953721608092', time=2024-09-12T21:01:39.915259+0000, chain.objs.size()=1 2024-09-12T19:13:57.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.UDxyKcszp-BNg4YiE7yzvFiD1WfK3OX_0 2024-09-12T19:13:57.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14906727014603981046', time=2024-09-12T21:01:39.938734+0000, chain.objs.size()=1 2024-09-12T19:13:57.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0Q8eSuiYeNAyUOy4cLmqEap5iQBORzD_0 2024-09-12T19:13:57.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11905002449145101294', time=2024-09-12T21:01:39.942337+0000, chain.objs.size()=1 2024-09-12T19:13:57.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BlH4XCOOJPjUfY5Gh1EyPYJgKH_OW_e_0 2024-09-12T19:13:57.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3414507174665221756', time=2024-09-12T21:01:39.958683+0000, chain.objs.size()=1 2024-09-12T19:13:57.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0ERjFJVvak-fsxmdPtixnVy8umvBAGq_0 2024-09-12T19:13:57.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15372498583306228857', time=2024-09-12T21:01:40.017928+0000, chain.objs.size()=1 2024-09-12T19:13:57.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.5m66yh-DkDCFgJkbtzG_xTEoi5teAHP_0 2024-09-12T19:13:57.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8714031684751964229', time=2024-09-12T21:01:40.158206+0000, chain.objs.size()=1 2024-09-12T19:13:57.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.iH1U1VWNSc82GtFLwtFag9zOJchzdYt_0 2024-09-12T19:13:57.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16295677212888253046', time=2024-09-12T21:01:40.210470+0000, chain.objs.size()=1 2024-09-12T19:13:57.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.JgSy9PeiEEy-bYOivp_LEx1K7crFF8J_0 2024-09-12T19:13:57.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13594095522800754524', time=2024-09-12T21:01:40.360090+0000, chain.objs.size()=1 2024-09-12T19:13:57.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.EAtXHhmo_WO-Frqoc7kw8mYPRQ3sWd0_0 2024-09-12T19:13:57.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17038128389136043527', time=2024-09-12T21:01:40.378942+0000, chain.objs.size()=1 2024-09-12T19:13:57.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QND28YFB5KVYlJseS2KMASuq8RxpX_G_0 2024-09-12T19:13:57.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14118060763162124598', time=2024-09-12T21:01:40.395841+0000, chain.objs.size()=1 2024-09-12T19:13:57.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BzDDv4zruVnOVVITgbjGBBR3xIwfJ-0_0 2024-09-12T19:13:57.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16714333852166549794', time=2024-09-12T21:01:40.397417+0000, chain.objs.size()=1 2024-09-12T19:13:57.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.N_UzfrauPoeowZyPhNVq1mc8cOV45kW_0 2024-09-12T19:13:57.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12450712460897170836', time=2024-09-12T21:01:40.400969+0000, chain.objs.size()=1 2024-09-12T19:13:57.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.has1WMZO7H0v85T03SF7a7axdtW0mqP_0 2024-09-12T19:13:57.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10312493206221521517', time=2024-09-12T21:01:40.406823+0000, chain.objs.size()=1 2024-09-12T19:13:57.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DZuIHpHLQuBcTK8lhtbC84jRzDW0R-G_0 2024-09-12T19:13:57.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6827834355813981826', time=2024-09-12T21:01:40.425068+0000, chain.objs.size()=1 2024-09-12T19:13:57.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.664+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.iGRqaYRuJuJOdfFaeDxMVSFPHqnfyIJ_0 2024-09-12T19:13:57.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14117556038278122849', time=2024-09-12T21:01:40.429778+0000, chain.objs.size()=1 2024-09-12T19:13:57.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BXaWsxDX7AVeLg4saNmqmB8fh3e6OLj_0 2024-09-12T19:13:57.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11725041404362569650', time=2024-09-12T21:01:40.553860+0000, chain.objs.size()=1 2024-09-12T19:13:57.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.YHrE5HJU5mcnDPyHReU1h7t9r3MBYU-_0 2024-09-12T19:13:57.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7463362309140521919', time=2024-09-12T21:01:40.555620+0000, chain.objs.size()=1 2024-09-12T19:13:57.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.kAZ1HXgw0nVxTpDvJWB0J_eKlVIsWaE_0 2024-09-12T19:13:57.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4523953198860460733', time=2024-09-12T21:01:40.572747+0000, chain.objs.size()=1 2024-09-12T19:13:57.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RKitHOGp7QdYpRhTif8cnccq3MoX35D_0 2024-09-12T19:13:57.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11598595976382055244', time=2024-09-12T21:01:40.620236+0000, chain.objs.size()=1 2024-09-12T19:13:57.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.8_xfst-9Cofw4hGMbaq_kYmDsiEbw7y_0 2024-09-12T19:13:57.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18289622001191403091', time=2024-09-12T21:01:40.639493+0000, chain.objs.size()=1 2024-09-12T19:13:57.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.tyHAU34dB0_2mij4k9zxYyY8AKtJ7Pn_0 2024-09-12T19:13:57.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16291682722457908317', time=2024-09-12T21:01:40.649025+0000, chain.objs.size()=1 2024-09-12T19:13:57.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.f_6RDcZX-ATc_y_AZtPNWqKjefK4Zuy_0 2024-09-12T19:13:57.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9719175828159074423', time=2024-09-12T21:01:40.657487+0000, chain.objs.size()=1 2024-09-12T19:13:57.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.TjxPsZEh0CoSeDfzUk8C_eE_KtehXOd_0 2024-09-12T19:13:57.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6286082511669594971', time=2024-09-12T21:01:40.658993+0000, chain.objs.size()=1 2024-09-12T19:13:57.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.E6zL9P9yTxsoOa52IrRBn2bRNrB25kR_0 2024-09-12T19:13:57.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14551056980231127560', time=2024-09-12T21:01:40.661511+0000, chain.objs.size()=1 2024-09-12T19:13:57.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.bcQKwau5E6wxXQbMEY2HtPIRNS_-AvS_0 2024-09-12T19:13:57.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.187197017494362564', time=2024-09-12T21:01:40.674126+0000, chain.objs.size()=1 2024-09-12T19:13:57.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ToUFIsn_zVPn4Hz86g0jwyEQqTMkPgN_0 2024-09-12T19:13:57.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12356562214186079132', time=2024-09-12T21:01:40.769886+0000, chain.objs.size()=1 2024-09-12T19:13:57.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mEHzQERygZgqvoF-RwE80evC7grgS6J_0 2024-09-12T19:13:57.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12666345150371567882', time=2024-09-12T21:01:40.810167+0000, chain.objs.size()=1 2024-09-12T19:13:57.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.CnmMmrnwX-yh94K97ougDxFCfUZZt14_0 2024-09-12T19:13:57.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18082924605832397607', time=2024-09-12T21:01:40.811049+0000, chain.objs.size()=1 2024-09-12T19:13:57.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.D4ebWXQ5iTSGZUuQ02OaFcD6Re2FQ24_0 2024-09-12T19:13:57.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3675898797352448045', time=2024-09-12T21:01:40.822379+0000, chain.objs.size()=1 2024-09-12T19:13:57.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.2ANrpAXY_i6gvIsCx6u172LKbaH7eCk_0 2024-09-12T19:13:57.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10362644241721102504', time=2024-09-12T21:01:40.825110+0000, chain.objs.size()=1 2024-09-12T19:13:57.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-kUOgxGh8B1hFhGgz1ZQCbWuRva2-vN_0 2024-09-12T19:13:57.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7993342913021143218', time=2024-09-12T21:01:40.841421+0000, chain.objs.size()=1 2024-09-12T19:13:57.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Jvfsk3mSydfNnNbYWeB-Qivse4WQWbV_0 2024-09-12T19:13:57.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15777862104584613085', time=2024-09-12T21:01:40.847397+0000, chain.objs.size()=1 2024-09-12T19:13:57.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.NkxN6aq2T_wBoviVokzBAxO0HmKMJbw_0 2024-09-12T19:13:57.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6608137465897018412', time=2024-09-12T21:01:40.993514+0000, chain.objs.size()=1 2024-09-12T19:13:57.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.EfJxi3yczcbpWKp__Eag2onXjvQNciL_0 2024-09-12T19:13:57.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10759711571461459747', time=2024-09-12T21:01:40.996001+0000, chain.objs.size()=1 2024-09-12T19:13:57.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.668+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.sH64rkvw8WC_x2ccHrhmJ2vs9TuP4MI_0 2024-09-12T19:13:57.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11236441551505962196', time=2024-09-12T21:01:41.074084+0000, chain.objs.size()=1 2024-09-12T19:13:57.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.S8sBZt3kT-_Bs7Q1d_GppmwfQCf-6bj_0 2024-09-12T19:13:57.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6368339114886084219', time=2024-09-12T21:01:41.079068+0000, chain.objs.size()=1 2024-09-12T19:13:57.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.3g8al8XQ_KzsOFUWFduMHG3bKUxvv8h_0 2024-09-12T19:13:57.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2811290704284043088', time=2024-09-12T21:02:00.557740+0000, chain.objs.size()=1 2024-09-12T19:13:57.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NIl0BQP5A9BCptbiN__uvdUvQpo7i0h_0 2024-09-12T19:13:57.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9393400726684177003', time=2024-09-12T21:02:00.591577+0000, chain.objs.size()=1 2024-09-12T19:13:57.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.L4F5-VumW01r48s3i75hjli4o7jigH-_0 2024-09-12T19:13:57.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2748410469371054628', time=2024-09-12T21:02:00.810862+0000, chain.objs.size()=1 2024-09-12T19:13:57.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.aIEKyRxhfTF7SY0xKhyRKPY9HXQJZoW_0 2024-09-12T19:13:57.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12178143302363950342', time=2024-09-12T21:02:00.877666+0000, chain.objs.size()=1 2024-09-12T19:13:57.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.S9nRHWM1RoYdO66hvAtyX3nAJ8bYW6d_0 2024-09-12T19:13:57.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15777278100426387935', time=2024-09-12T21:02:00.879635+0000, chain.objs.size()=1 2024-09-12T19:13:57.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8Ol7enivwq2NP1KcuL7cA0qz-OGbAL7_0 2024-09-12T19:13:57.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7313687119648442261', time=2024-09-12T21:02:00.996635+0000, chain.objs.size()=1 2024-09-12T19:13:57.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Sf1KzcXFYc43_1ZUb_Br51-I7ojJBGA_0 2024-09-12T19:13:57.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15863852191026372636', time=2024-09-12T21:02:01.049373+0000, chain.objs.size()=1 2024-09-12T19:13:57.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.HWNEolmpprCQeUN0BxMUnrV53URUJCU_0 2024-09-12T19:13:57.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.672+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44021 2024-09-12T19:13:57.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-12T19:13:57.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18103520554675727490', time=2024-09-12T21:02:01.074204+0000, chain.objs.size()=1 2024-09-12T19:13:57.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NsJrPphIW1pYRYTG1JtJe8rExd_ofcc_0 2024-09-12T19:13:57.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3685094177395219696', time=2024-09-12T21:02:01.104490+0000, chain.objs.size()=1 2024-09-12T19:13:57.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.nW1r2BX8W9fJiDaCwTGuEtuIg83_b5s_0 2024-09-12T19:13:57.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4279139240281200358', time=2024-09-12T21:02:01.109701+0000, chain.objs.size()=1 2024-09-12T19:13:57.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._UxZhXiDWqaij5USCEj-BjCJseyDhvN_0 2024-09-12T19:13:57.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.47273019817315917', time=2024-09-12T21:02:01.257943+0000, chain.objs.size()=1 2024-09-12T19:13:57.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.BPcXZMiLZMwoalSB7cjRmmVeAAskgWT_0 2024-09-12T19:13:57.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4421851662069113368', time=2024-09-12T21:02:01.278459+0000, chain.objs.size()=1 2024-09-12T19:13:57.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.r2gVLJjo3-SFWQ_E_5d7T9iN_fA8eMR_0 2024-09-12T19:13:57.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6486478940981569788', time=2024-09-12T21:02:01.284817+0000, chain.objs.size()=1 2024-09-12T19:13:57.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.G0zKVMtrcKPPudXI440kt87Hhtx6m3L_0 2024-09-12T19:13:57.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9256677258454961031', time=2024-09-12T21:02:01.289471+0000, chain.objs.size()=1 2024-09-12T19:13:57.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.3WU-unhiKi8_LNVSMAZ4wcRV4AsGMBz_0 2024-09-12T19:13:57.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16509989088651449771', time=2024-09-12T21:02:01.348283+0000, chain.objs.size()=1 2024-09-12T19:13:57.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.gy_-CpVJNj7yZDYAfsz4T7NVFJRTfkR_0 2024-09-12T19:13:57.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1441414336586936883', time=2024-09-12T21:02:01.502230+0000, chain.objs.size()=1 2024-09-12T19:13:57.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.SJFNAs026TfbTWGXa5SQAbVCe6MtMDC_0 2024-09-12T19:13:57.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3148209814827879283', time=2024-09-12T21:02:01.509573+0000, chain.objs.size()=1 2024-09-12T19:13:57.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.JrJTfaEwj142sIBXAyHhWnkrqjR0YSm_0 2024-09-12T19:13:57.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2201728067266299009', time=2024-09-12T21:02:01.542314+0000, chain.objs.size()=1 2024-09-12T19:13:57.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.mbc6qxJF_aQx30EoCNS9vz0VxdW0uHo_0 2024-09-12T19:13:57.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6266458064113746817', time=2024-09-12T21:02:01.550199+0000, chain.objs.size()=1 2024-09-12T19:13:57.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.3Xc1ZxdtwWL8NzNlAlWUhO_W8oynkBn_0 2024-09-12T19:13:57.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10957650905917476565', time=2024-09-12T21:02:01.673619+0000, chain.objs.size()=1 2024-09-12T19:13:57.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._bXzPHnk7aID2RP2fUi3fSsynuDk9WR_0 2024-09-12T19:13:57.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5211466621228660210', time=2024-09-12T21:02:01.682423+0000, chain.objs.size()=1 2024-09-12T19:13:57.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.TK5_aR3aV2IH7wzxiavgecBP0tjN5pV_0 2024-09-12T19:13:57.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16241396018617192249', time=2024-09-12T21:02:01.695714+0000, chain.objs.size()=1 2024-09-12T19:13:57.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.676+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.DS5ghA9M_T8UQLjGbuQeCPh_CmbtLIQ_0 2024-09-12T19:13:57.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14706428859207736415', time=2024-09-12T21:02:01.715190+0000, chain.objs.size()=1 2024-09-12T19:13:57.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.MwNpAmIYUCBloXpAqLkZTDzcOavnHpf_0 2024-09-12T19:13:57.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10672729889570462940', time=2024-09-12T21:02:01.717801+0000, chain.objs.size()=1 2024-09-12T19:13:57.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.kAry-Lh5weAzBSxvybaHjEpW-_dlB7i_0 2024-09-12T19:13:57.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6999594210183526299', time=2024-09-12T21:02:01.734274+0000, chain.objs.size()=1 2024-09-12T19:13:57.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.4sJQ0XcUeqxShzt5Sl4eczg_slq5gBV_0 2024-09-12T19:13:57.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1816128705628217403', time=2024-09-12T21:02:01.761753+0000, chain.objs.size()=1 2024-09-12T19:13:57.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1ZimmiCBVIAkD1K1qXpPyU7ubjro8UJ_0 2024-09-12T19:13:57.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15631370217291713330', time=2024-09-12T21:02:01.884807+0000, chain.objs.size()=1 2024-09-12T19:13:57.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.oyADLLCaC0s7imn7zBUD0yIGKCcCAU__0 2024-09-12T19:13:57.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17396703141211811491', time=2024-09-12T21:02:01.960527+0000, chain.objs.size()=1 2024-09-12T19:13:57.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.FqDituuPShhDYCXwU13VJvYNc3qpzag_0 2024-09-12T19:13:57.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18087284575069854306', time=2024-09-12T21:02:01.972119+0000, chain.objs.size()=1 2024-09-12T19:13:57.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.mqMrK_bMsoQPc5PCKShnCnkF1HGSxZg_0 2024-09-12T19:13:57.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5380658827418926244', time=2024-09-12T21:02:01.996478+0000, chain.objs.size()=1 2024-09-12T19:13:57.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.K92HsgNro-qqCsDUNreWiv_6MtIEnPA_0 2024-09-12T19:13:57.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9051127654843124498', time=2024-09-12T21:02:02.124993+0000, chain.objs.size()=1 2024-09-12T19:13:57.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5MoxvV7D58vIoeWznjXrPkZghDq_YpA_0 2024-09-12T19:13:57.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3810999687254291783', time=2024-09-12T21:02:02.177976+0000, chain.objs.size()=1 2024-09-12T19:13:57.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.aBFSYBCL33kkRzpDYpn2LEGJDE9eb_y_0 2024-09-12T19:13:57.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11206064167598702897', time=2024-09-12T21:02:02.179293+0000, chain.objs.size()=1 2024-09-12T19:13:57.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.LoeGZ2zQlHzkJlek0BBebzoD-72-07P_0 2024-09-12T19:13:57.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15514072325191378188', time=2024-09-12T21:03:16.441415+0000, chain.objs.size()=1 2024-09-12T19:13:57.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.430__shadow_.oKghZkfdGJWFsmQg61Hp2WwOOCRUII9_0 2024-09-12T19:13:57.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14689244734529325136', time=2024-09-12T21:03:38.093489+0000, chain.objs.size()=1 2024-09-12T19:13:57.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.457__shadow_.0YG7g96gmpO3x-SCObtj-QW9ClQinrs_0 2024-09-12T19:13:57.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13631439645140518068', time=2024-09-12T21:05:50.086589+0000, chain.objs.size()=1 2024-09-12T19:13:57.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.558__shadow_.30ZqWldcef_2SS2ML5LJC-AsXXWxPCe_0 2024-09-12T19:13:57.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6936893534225931334', time=2024-09-12T21:05:51.401395+0000, chain.objs.size()=1 2024-09-12T19:13:57.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.559__shadow_.CbXPoXMoScsV1Vkmy80Ok3AZQDwNo76_0 2024-09-12T19:13:57.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15583828749180270148', time=2024-09-12T21:06:09.597057+0000, chain.objs.size()=1 2024-09-12T19:13:57.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:o5phxi7XtSo4h4.HQwPVMd1AKIBO41E_.nn2CuiSmSVHKuUjLa3hYEyBzfwshRtP_0 2024-09-12T19:13:57.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4686656586401569926', time=2024-09-12T21:06:30.276287+0000, chain.objs.size()=1 2024-09-12T19:13:57.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:XNQXyHf17NZR68KSjbS-wTrEA5rwUJz_.r-5B5IAfct-CsH4--C_KEayqPsyA_71_0 2024-09-12T19:13:57.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11159327829619646628', time=2024-09-12T21:06:31.267810+0000, chain.objs.size()=1 2024-09-12T19:13:57.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:Jt.21PPw-ulTqMPZyJ6OmiD3G80TFTF_._65NmGEhTf9_OP3RyKI2hyOnyIx6Qlj_0 2024-09-12T19:13:57.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2353066940391921774', time=2024-09-12T21:06:32.663011+0000, chain.objs.size()=1 2024-09-12T19:13:57.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.680+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:s9Prbj.S9-ZZtW0jWRAOIABjUcZM1Af_.g9h_kFlmBeFO_Lngm6V-cg2isdKVAVm_0 2024-09-12T19:13:57.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.684+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8909268885960333936', time=2024-09-12T21:07:20.401639+0000, chain.objs.size()=12 2024-09-12T19:13:57.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.684+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.614__multipart_multipart_enc.2~-Jj7g0FffzuGBT-IUokNIqX01cJGzo-.1 2024-09-12T19:13:57.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.684+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.614__shadow_multipart_enc.2~-Jj7g0FffzuGBT-IUokNIqX01cJGzo-.1_1 2024-09-12T19:13:57.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.684+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.614__multipart_multipart_enc.2~-Jj7g0FffzuGBT-IUokNIqX01cJGzo-.2 2024-09-12T19:13:57.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.684+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.614__shadow_multipart_enc.2~-Jj7g0FffzuGBT-IUokNIqX01cJGzo-.2_1 2024-09-12T19:13:57.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.684+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.614__multipart_multipart_enc.2~-Jj7g0FffzuGBT-IUokNIqX01cJGzo-.3 2024-09-12T19:13:57.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.684+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.614__shadow_multipart_enc.2~-Jj7g0FffzuGBT-IUokNIqX01cJGzo-.3_1 2024-09-12T19:13:57.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.684+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.614__multipart_multipart_enc.2~-Jj7g0FffzuGBT-IUokNIqX01cJGzo-.4 2024-09-12T19:13:57.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.684+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.614__shadow_multipart_enc.2~-Jj7g0FffzuGBT-IUokNIqX01cJGzo-.4_1 2024-09-12T19:13:57.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.684+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.614__multipart_multipart_enc.2~-Jj7g0FffzuGBT-IUokNIqX01cJGzo-.5 2024-09-12T19:13:57.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.684+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.614__shadow_multipart_enc.2~-Jj7g0FffzuGBT-IUokNIqX01cJGzo-.5_1 2024-09-12T19:13:57.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.684+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.614__multipart_multipart_enc.2~-Jj7g0FffzuGBT-IUokNIqX01cJGzo-.6 2024-09-12T19:13:57.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.688+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.614__shadow_multipart_enc.2~-Jj7g0FffzuGBT-IUokNIqX01cJGzo-.6_1 2024-09-12T19:13:57.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.688+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15118317876295531078', time=2024-09-12T21:11:01.773804+0000, chain.objs.size()=1 2024-09-12T19:13:57.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.688+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.718__shadow_.tS7_0pvse01BCChbxcsjhdwu3XoxI11_0 2024-09-12T19:13:57.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.688+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.913107818832053023', time=2024-09-12T21:11:17.263650+0000, chain.objs.size()=1 2024-09-12T19:13:57.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.688+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.739__shadow_.Scp0h0bvNNFgnfBixs7x6ol0zObigXD_0 2024-09-12T19:13:57.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.688+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~l4tyDlPjnQsjXQrSSXLsBuLFL56z108', time=2024-09-12T21:11:19.867752+0000, chain.objs.size()=1 2024-09-12T19:13:57.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.688+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.742__multipart_mymultipart.2~l4tyDlPjnQsjXQrSSXLsBuLFL56z108.1 2024-09-12T19:13:57.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.688+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.692+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T19:13:57.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.692+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47780' 2024-09-12T19:13:57.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_5oEZ-OJfyLEhTpVLhn4nHRLAk66VaF9', time=2024-09-12T20:57:33.886600+0000, chain.objs.size()=3 2024-09-12T19:13:57.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.CLPnUG05fbHiiz-Ygx6GxdvA-qfV_ec_0 2024-09-12T19:13:57.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.CLPnUG05fbHiiz-Ygx6GxdvA-qfV_ec_1 2024-09-12T19:13:57.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.CLPnUG05fbHiiz-Ygx6GxdvA-qfV_ec_2 2024-09-12T19:13:57.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6273132884219672960', time=2024-09-12T20:57:34.602621+0000, chain.objs.size()=3 2024-09-12T19:13:57.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__multipart_foo-STANDARD.2~lYLo2CTcac8wiOze8VaSvv7QsCS5r0d.1 2024-09-12T19:13:57.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__multipart_foo-STANDARD.2~lYLo2CTcac8wiOze8VaSvv7QsCS5r0d.2 2024-09-12T19:13:57.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__multipart_foo-STANDARD.2~lYLo2CTcac8wiOze8VaSvv7QsCS5r0d.3 2024-09-12T19:13:57.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8615115928375336335', time=2024-09-12T20:59:56.923351+0000, chain.objs.size()=1 2024-09-12T19:13:57.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.241__shadow_.Pvwm23NMWxPZuXzpFfIT5wuJUnRszCw_0 2024-09-12T19:13:57.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15715410931672149019', time=2024-09-12T21:00:02.257534+0000, chain.objs.size()=1 2024-09-12T19:13:57.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.247__shadow_.16ezU9tw4KDAHmKw0hyD_yAKrFnFP_5_0 2024-09-12T19:13:57.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15452588551840530621', time=2024-09-12T21:00:03.684229+0000, chain.objs.size()=1 2024-09-12T19:13:57.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.249__shadow_.jgYlClUnkBp3rVFJsxuPlIccTCoQVCS_0 2024-09-12T19:13:57.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4084037003033817148', time=2024-09-12T21:00:08.819014+0000, chain.objs.size()=1 2024-09-12T19:13:57.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.256__shadow_.Cib7k0r0lV7y-JFrNqiaEUu_8swfj46_0 2024-09-12T19:13:57.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16914472308691590274', time=2024-09-12T21:00:10.245980+0000, chain.objs.size()=1 2024-09-12T19:13:57.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.258__shadow_.J4vhMkvNlKbHWgpJbmYyJnFpsMdgs9Y_0 2024-09-12T19:13:57.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13974430314995493206', time=2024-09-12T21:00:11.704666+0000, chain.objs.size()=1 2024-09-12T19:13:57.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.696+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.260__shadow_.ltqqDBHgLLGhBiwhX3ZGaphSn0qm1q7_0 2024-09-12T19:13:57.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17461751054492190787', time=2024-09-12T21:00:32.088012+0000, chain.objs.size()=1 2024-09-12T19:13:57.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WWIMZ7zeSfq3VhUaS_XRemcElGkGbFz_0 2024-09-12T19:13:57.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12791720998571394790', time=2024-09-12T21:00:32.094346+0000, chain.objs.size()=1 2024-09-12T19:13:57.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.pqENoyQ3It-OAh__iWwGJ4w3h2bftW5_0 2024-09-12T19:13:57.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5963179122963133066', time=2024-09-12T21:00:32.095060+0000, chain.objs.size()=1 2024-09-12T19:13:57.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.fViaBCnxMYWIe1gyWuzL-mdqVrEEGsZ_0 2024-09-12T19:13:57.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8747092299607900139', time=2024-09-12T21:00:32.254068+0000, chain.objs.size()=1 2024-09-12T19:13:57.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.5sU_vrH-vqJ2SWpPjW5XEtyRdrGNA4G_0 2024-09-12T19:13:57.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14589214094702436450', time=2024-09-12T21:00:32.255616+0000, chain.objs.size()=1 2024-09-12T19:13:57.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.iEKAvnVQ6QX_vnSQlSV2CmxpW6A0NSC_0 2024-09-12T19:13:57.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2135836882097970261', time=2024-09-12T21:00:32.257455+0000, chain.objs.size()=1 2024-09-12T19:13:57.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.M6a0iJGJt4f9HiAW7QKwsl8WP2UekVC_0 2024-09-12T19:13:57.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18384153160795362476', time=2024-09-12T21:00:32.274700+0000, chain.objs.size()=1 2024-09-12T19:13:57.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qlq9fcrCuH6PF6knL5FrOqzqA6ni8lp_0 2024-09-12T19:13:57.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17078173734183278916', time=2024-09-12T21:00:32.305579+0000, chain.objs.size()=1 2024-09-12T19:13:57.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.rTk6ePaEQWIEE-PGp7O-1praRUneaJz_0 2024-09-12T19:13:57.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1848350878324739464', time=2024-09-12T21:00:32.445398+0000, chain.objs.size()=1 2024-09-12T19:13:57.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.T03XiBFbXWjRyNraXlN07S1bOuAINJM_0 2024-09-12T19:13:57.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14521745304161239000', time=2024-09-12T21:00:32.482129+0000, chain.objs.size()=1 2024-09-12T19:13:57.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.AHgS8l3sfB4CzZU0DbjkTEilSjnA281_0 2024-09-12T19:13:57.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1521300095008161971', time=2024-09-12T21:00:32.512355+0000, chain.objs.size()=1 2024-09-12T19:13:57.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ANqxCj0saPj24MVK_Ydt9xjEhr3enc-_0 2024-09-12T19:13:57.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2950545719062438922', time=2024-09-12T21:00:32.554967+0000, chain.objs.size()=1 2024-09-12T19:13:57.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7YeYC6mW3b4BdZoZjZiTV4tQPLBK9Az_0 2024-09-12T19:13:57.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3117848599451530621', time=2024-09-12T21:00:32.555868+0000, chain.objs.size()=1 2024-09-12T19:13:57.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-OMZRvGYQCpW47P93yO5Md60nkFKGaG_0 2024-09-12T19:13:57.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11661738629407915751', time=2024-09-12T21:00:32.563937+0000, chain.objs.size()=1 2024-09-12T19:13:57.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.OTzWikt0vvg8vdQn7yhzkV5qXqradNf_0 2024-09-12T19:13:57.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9118721043360605008', time=2024-09-12T21:00:32.733664+0000, chain.objs.size()=1 2024-09-12T19:13:57.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-qp3bgkPaZI-ZAAYNA_OUtDnMSV0XBI_0 2024-09-12T19:13:57.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6861659858791299076', time=2024-09-12T21:00:32.879103+0000, chain.objs.size()=1 2024-09-12T19:13:57.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ErWEXtZm-wPwddn-_92bswtqVmeNWkr_0 2024-09-12T19:13:57.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6414551552949593902', time=2024-09-12T21:00:32.928280+0000, chain.objs.size()=1 2024-09-12T19:13:57.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.kYjwkZj1xHo5O7UPMUE08pFCEc7rqnU_0 2024-09-12T19:13:57.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16535789307272902792', time=2024-09-12T21:00:32.945194+0000, chain.objs.size()=1 2024-09-12T19:13:57.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.5f009WtG1uSpw8Gzh9Fz9RPdEhHLqbz_0 2024-09-12T19:13:57.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13424131315967606814', time=2024-09-12T21:00:32.977465+0000, chain.objs.size()=1 2024-09-12T19:13:57.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.fIoYVAUwhdAjkjdRzBPikzv5fMj9KIe_0 2024-09-12T19:13:57.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.696441977627169524', time=2024-09-12T21:00:32.978623+0000, chain.objs.size()=1 2024-09-12T19:13:57.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tSJZDfuucs4yinXcf-ICpT42zaFiDgz_0 2024-09-12T19:13:57.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4820290164406310589', time=2024-09-12T21:00:32.982581+0000, chain.objs.size()=1 2024-09-12T19:13:57.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.VXwjJGA6z67beSvgnXdv_txvd9ZHBHO_0 2024-09-12T19:13:57.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8134110365123661016', time=2024-09-12T21:00:33.099552+0000, chain.objs.size()=1 2024-09-12T19:13:57.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.700+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LYAD1I0XSONolaaiNrtZ9khBcb0xkZf_0 2024-09-12T19:13:57.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14657036076053153804', time=2024-09-12T21:00:33.101116+0000, chain.objs.size()=1 2024-09-12T19:13:57.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.y10sLfyLntPECTCeLTQe3Q-jAOrEw7s_0 2024-09-12T19:13:57.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4570796115139498939', time=2024-09-12T21:00:33.120598+0000, chain.objs.size()=1 2024-09-12T19:13:57.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.MbyW6eOiyC5nfSXU0KnjvgBy_W4gcvB_0 2024-09-12T19:13:57.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15187153097752551475', time=2024-09-12T21:00:33.180561+0000, chain.objs.size()=1 2024-09-12T19:13:57.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qScLRzr5kz5cmYI-tatMV3bX3MM44hs_0 2024-09-12T19:13:57.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6326128361379436815', time=2024-09-12T21:00:33.183644+0000, chain.objs.size()=1 2024-09-12T19:13:57.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.MJL5BK2Y3ZyL9uzUCzp7ZHoNhgSKr6A_0 2024-09-12T19:13:57.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.563907133869266287', time=2024-09-12T21:00:33.191576+0000, chain.objs.size()=1 2024-09-12T19:13:57.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.KslbBTP0KhlJk-Ri_7M3cYWsFF0L_I8_0 2024-09-12T19:13:57.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1556981407747066779', time=2024-09-12T21:00:33.212448+0000, chain.objs.size()=1 2024-09-12T19:13:57.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.VNL1GQm0NhlVHFf9oUQw3yzQtvfB8Rt_0 2024-09-12T19:13:57.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16543052671353011727', time=2024-09-12T21:00:33.401188+0000, chain.objs.size()=1 2024-09-12T19:13:57.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.HKAS-qBdgc3Fm2wbKuyUmf_5llqaTbE_0 2024-09-12T19:13:57.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2546451486516869380', time=2024-09-12T21:00:33.430534+0000, chain.objs.size()=1 2024-09-12T19:13:57.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sXwtK3rvsiOqm7cbHgUtyqk9OfhzohI_0 2024-09-12T19:13:57.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9715869338891392275', time=2024-09-12T21:00:33.440327+0000, chain.objs.size()=1 2024-09-12T19:13:57.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3vzNGgA01chbcY4Y3ZcXLaKAAQSjrBy_0 2024-09-12T19:13:57.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12726514034964948149', time=2024-09-12T21:00:33.442632+0000, chain.objs.size()=1 2024-09-12T19:13:57.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SFi181gjxUc0Ma-LxBXuhPCbMVt855W_0 2024-09-12T19:13:57.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8731900411099837796', time=2024-09-12T21:00:33.466704+0000, chain.objs.size()=1 2024-09-12T19:13:57.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.4knJlYCd5_YaITb60yz0A0a_LkFBHOW_0 2024-09-12T19:13:57.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5078438949739281650', time=2024-09-12T21:00:33.489503+0000, chain.objs.size()=1 2024-09-12T19:13:57.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.cQYlqpQGIKj1g_vaMSrCe35fE8rQIFA_0 2024-09-12T19:13:57.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13542488612991483140', time=2024-09-12T21:00:33.659855+0000, chain.objs.size()=1 2024-09-12T19:13:57.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.1fOaPo9a9smJhJIeC2QaodMRejeI9fX_0 2024-09-12T19:13:57.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9971390395424911316', time=2024-09-12T21:00:33.877824+0000, chain.objs.size()=1 2024-09-12T19:13:57.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.4_F35tPTLzMcXb7fLFOqZMWPrb9ef6s_0 2024-09-12T19:13:57.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15421624498727000805', time=2024-09-12T21:00:33.882669+0000, chain.objs.size()=1 2024-09-12T19:13:57.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.704+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7-EN27y_rA6iRY7JLmWuzcy3UX0FSWa_0 2024-09-12T19:13:57.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5783423095753865232', time=2024-09-12T21:00:58.118718+0000, chain.objs.size()=1 2024-09-12T19:13:57.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.LoobOr36Z9TprKvdyUZTLm5th-JPrK3_0 2024-09-12T19:13:57.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6944839294492520520', time=2024-09-12T21:00:58.838186+0000, chain.objs.size()=1 2024-09-12T19:13:57.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.294__shadow_.g6fc7nrO0uU5bNMgDQl7UnVBP7AgRCx_0 2024-09-12T19:13:57.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14816168146718183729', time=2024-09-12T21:01:04.827323+0000, chain.objs.size()=1 2024-09-12T19:13:57.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.302__shadow_.KuQLk4ujRA8TEc4VQ6h0JXihlaulr86_0 2024-09-12T19:13:57.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17846665460123235360', time=2024-09-12T21:01:39.405759+0000, chain.objs.size()=1 2024-09-12T19:13:57.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.wb0CZZGIpI9WQPthMGMxkJJbFMFAaF1_0 2024-09-12T19:13:57.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6083349174512014753', time=2024-09-12T21:01:39.463344+0000, chain.objs.size()=1 2024-09-12T19:13:57.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.HzbSuyFVoJZrGbMWFiXfV1biGxdbwuv_0 2024-09-12T19:13:57.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.657328456649046236', time=2024-09-12T21:01:39.707493+0000, chain.objs.size()=1 2024-09-12T19:13:57.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Ay_-TKoroZgQ3a8Y9Tf1xMypfFSC46t_0 2024-09-12T19:13:57.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.650777976819365599', time=2024-09-12T21:01:39.736202+0000, chain.objs.size()=1 2024-09-12T19:13:57.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.rKF90Ivauchgk1hW22oH7McC_9zdtNV_0 2024-09-12T19:13:57.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15432160760872689256', time=2024-09-12T21:01:39.751003+0000, chain.objs.size()=1 2024-09-12T19:13:57.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.p_kk4j7_67XhOIV4_jRIQs9HkOn6Eud_0 2024-09-12T19:13:57.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13560709327548639737', time=2024-09-12T21:01:39.752705+0000, chain.objs.size()=1 2024-09-12T19:13:57.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Cimbnl0PKrTB28da6yceYsO13AgBCrn_0 2024-09-12T19:13:57.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15248519836623694642', time=2024-09-12T21:01:39.779790+0000, chain.objs.size()=1 2024-09-12T19:13:57.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.wVq6rcr4soD6qEnsRaVc2nh4E1cPm0C_0 2024-09-12T19:13:57.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12378907226985979302', time=2024-09-12T21:01:39.785395+0000, chain.objs.size()=1 2024-09-12T19:13:57.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.gLzuxGQPqUeJeGIC9snXpDNMTKSAfb4_0 2024-09-12T19:13:57.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15049950513582235779', time=2024-09-12T21:01:39.942003+0000, chain.objs.size()=1 2024-09-12T19:13:57.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.TRHj_Dlf7pqvbY56vXm2V2q8O_oS83e_0 2024-09-12T19:13:57.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16473705213055404987', time=2024-09-12T21:01:39.951254+0000, chain.objs.size()=1 2024-09-12T19:13:57.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.15-XUhbJ6CY_vLMH90hCWLjy_t3u4aP_0 2024-09-12T19:13:57.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16898565712705231842', time=2024-09-12T21:01:39.959765+0000, chain.objs.size()=1 2024-09-12T19:13:57.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.AQGrqzoK-ki8pX2659SKMtvKpEa4Tfi_0 2024-09-12T19:13:57.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14712016142134187074', time=2024-09-12T21:01:39.970134+0000, chain.objs.size()=1 2024-09-12T19:13:57.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.8zbt0hNnpopONeYQ73SRplMNfYG53xJ_0 2024-09-12T19:13:57.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.781173985288462243', time=2024-09-12T21:01:40.019221+0000, chain.objs.size()=1 2024-09-12T19:13:57.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.dAC52e9FIZo4zsKADsZ321a3j7LDlXm_0 2024-09-12T19:13:57.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16809605542941769399', time=2024-09-12T21:01:40.174070+0000, chain.objs.size()=1 2024-09-12T19:13:57.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.8UTQNxebNGBsIjBlYfi7YkbTuFKkmAj_0 2024-09-12T19:13:57.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3831668930288099362', time=2024-09-12T21:01:40.201756+0000, chain.objs.size()=1 2024-09-12T19:13:57.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QVwZulw7BvhG0IiA-h9VJEzKG-0hRJG_0 2024-09-12T19:13:57.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12163375772830437129', time=2024-09-12T21:01:40.223684+0000, chain.objs.size()=1 2024-09-12T19:13:57.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.HcZJeDN8iU30oLP17g_U8Bg-YdeVZIC_0 2024-09-12T19:13:57.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14338824018051580563', time=2024-09-12T21:01:40.346210+0000, chain.objs.size()=1 2024-09-12T19:13:57.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-_dK5jcQ3UxeVbJsuPMwA2VacyXJ9RC_0 2024-09-12T19:13:57.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13830361325761321071', time=2024-09-12T21:01:40.383225+0000, chain.objs.size()=1 2024-09-12T19:13:57.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.708+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.bAaZXjvnOr74lbpzafz0HtHBkFXTPEU_0 2024-09-12T19:13:57.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9364249696533192367', time=2024-09-12T21:01:40.546519+0000, chain.objs.size()=1 2024-09-12T19:13:57.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.lj9ndD8NDb6mAb9HmFZ0AGX4V8KKaB1_0 2024-09-12T19:13:57.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16525160041177579011', time=2024-09-12T21:01:40.554130+0000, chain.objs.size()=1 2024-09-12T19:13:57.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.koyA-B-_vru7Aw5iAvQ35NRUBNvq4QM_0 2024-09-12T19:13:57.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9635275025580668943', time=2024-09-12T21:01:40.559373+0000, chain.objs.size()=1 2024-09-12T19:13:57.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.qvM5HS8EZ-u3cqz5qtki7mp92pVxugQ_0 2024-09-12T19:13:57.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3969592443245523488', time=2024-09-12T21:01:40.567401+0000, chain.objs.size()=1 2024-09-12T19:13:57.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.a0cimjJ_bklxO-xBW9iqe4SQaPzWBZh_0 2024-09-12T19:13:57.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7289659828008576457', time=2024-09-12T21:01:40.604831+0000, chain.objs.size()=1 2024-09-12T19:13:57.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.A5nYqP8Z-11dBjAE1RCkTb-Anaazj2x_0 2024-09-12T19:13:57.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5203744609034285900', time=2024-09-12T21:01:40.775691+0000, chain.objs.size()=1 2024-09-12T19:13:57.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0LPDswIG5vmRoOyfWn6TAOv12GaQDR6_0 2024-09-12T19:13:57.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.380007354210634347', time=2024-09-12T21:01:40.889268+0000, chain.objs.size()=1 2024-09-12T19:13:57.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.wVRha-6gz5GB7PMI4uquWHA1909uSiu_0 2024-09-12T19:13:57.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8272860270615457208', time=2024-09-12T21:01:40.891958+0000, chain.objs.size()=1 2024-09-12T19:13:57.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.GSH1czYX-HELuuo_qqF-3k7i9_H6IH2_0 2024-09-12T19:13:57.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5882217357292364651', time=2024-09-12T21:01:41.074612+0000, chain.objs.size()=1 2024-09-12T19:13:57.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ckm6CM3ovd4GOmY24ukY9pI-x6auHo3_0 2024-09-12T19:13:57.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3005642263420525653', time=2024-09-12T21:01:41.091077+0000, chain.objs.size()=1 2024-09-12T19:13:57.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.VxD507p0KttwlKfaOasnn-OFdNluUyY_0 2024-09-12T19:13:57.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10900682041814302806', time=2024-09-12T21:01:41.091850+0000, chain.objs.size()=1 2024-09-12T19:13:57.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.cfnjb0zxx0v879b4EAv3ztH6tD6N72S_0 2024-09-12T19:13:57.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2974164102993514931', time=2024-09-12T21:01:41.092736+0000, chain.objs.size()=1 2024-09-12T19:13:57.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.JKdkgHVDq7vY0zFDnD8vwwn-2Sh3lO5_0 2024-09-12T19:13:57.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4177449978479336286', time=2024-09-12T21:01:41.093798+0000, chain.objs.size()=1 2024-09-12T19:13:57.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.HD-6hNMUQGQG0HUl3FnpCx2ES7viAhl_0 2024-09-12T19:13:57.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.176585622897808649', time=2024-09-12T21:02:00.556722+0000, chain.objs.size()=1 2024-09-12T19:13:57.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.D-MDH8EtszZndCpQSoW-4wnw38cMSrA_0 2024-09-12T19:13:57.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3378535006612446275', time=2024-09-12T21:02:00.598073+0000, chain.objs.size()=1 2024-09-12T19:13:57.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WOekoKH9hyGHbpHqLY4MV2di1-HFde8_0 2024-09-12T19:13:57.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1792340634801347146', time=2024-09-12T21:02:00.628725+0000, chain.objs.size()=1 2024-09-12T19:13:57.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.B0wM9KzF73twnkjjYcq0thjgpp_IFg__0 2024-09-12T19:13:57.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14057032972877497039', time=2024-09-12T21:02:00.782267+0000, chain.objs.size()=1 2024-09-12T19:13:57.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.712+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qU6P5Z72QNamtQt_-JoaWJEngmKVBlC_0 2024-09-12T19:13:57.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7871705190942565999', time=2024-09-12T21:02:00.800689+0000, chain.objs.size()=1 2024-09-12T19:13:57.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8O7g5_hrpxFjUGQ-os9765gv0WQaYeR_0 2024-09-12T19:13:57.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7858549150044085728', time=2024-09-12T21:02:00.868289+0000, chain.objs.size()=1 2024-09-12T19:13:57.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1i_34saWUSOL_EbR-AVmRmtdG15D-zb_0 2024-09-12T19:13:57.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10533844996495158462', time=2024-09-12T21:02:01.022022+0000, chain.objs.size()=1 2024-09-12T19:13:57.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.oScg62P50kLeO0nb7hEWeCfBW_-7cRY_0 2024-09-12T19:13:57.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12108253729051954670', time=2024-09-12T21:02:01.064263+0000, chain.objs.size()=1 2024-09-12T19:13:57.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.YoxRPNK9osfdEftrlh9gwhHB82qHXQb_0 2024-09-12T19:13:57.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5931156345683688861', time=2024-09-12T21:02:01.114954+0000, chain.objs.size()=1 2024-09-12T19:13:57.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.CHdgHZ3DCqITltRprYCm91RZcuIwwjw_0 2024-09-12T19:13:57.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.885387895868034335', time=2024-09-12T21:02:01.251751+0000, chain.objs.size()=1 2024-09-12T19:13:57.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.LOi2tdVyHhDzQ5eEi1Ly8J-T36DVJMr_0 2024-09-12T19:13:57.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6993061913240181213', time=2024-09-12T21:02:01.269077+0000, chain.objs.size()=1 2024-09-12T19:13:57.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.RwQRD0fPegr9N9VsWDeAWOySdW_54WR_0 2024-09-12T19:13:57.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6626940408629525528', time=2024-09-12T21:02:01.279421+0000, chain.objs.size()=1 2024-09-12T19:13:57.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.LfxkDDdviQeC0Tzn5H1rjdrGVqutgMW_0 2024-09-12T19:13:57.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4497540480897271705', time=2024-09-12T21:02:01.351103+0000, chain.objs.size()=1 2024-09-12T19:13:57.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.h0NYooGYOfqfYsZsDLSMlXgooQshgy5_0 2024-09-12T19:13:57.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1627593142511430903', time=2024-09-12T21:02:01.499175+0000, chain.objs.size()=1 2024-09-12T19:13:57.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.lbNszcb32QY2epwViWJkfkD__Sq4l9s_0 2024-09-12T19:13:57.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15422983561568769509', time=2024-09-12T21:02:01.515764+0000, chain.objs.size()=1 2024-09-12T19:13:57.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.TGqb-HLaQV_HmlGl-QdjcsNrXQ_q1i-_0 2024-09-12T19:13:57.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10571333078675306120', time=2024-09-12T21:02:01.519429+0000, chain.objs.size()=1 2024-09-12T19:13:57.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.nWMN6so14tW3CCsDdFmB4MX-a768hVm_0 2024-09-12T19:13:57.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5489495782483982506', time=2024-09-12T21:02:01.525366+0000, chain.objs.size()=1 2024-09-12T19:13:57.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.09-WYAWUmuzgLPsj8qDtw7I86nFpicS_0 2024-09-12T19:13:57.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3908534330254516375', time=2024-09-12T21:02:01.529280+0000, chain.objs.size()=1 2024-09-12T19:13:57.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.hDSeC2wnJ8OQRS7WSyKkcrOzTZGEwZU_0 2024-09-12T19:13:57.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13105766325868773631', time=2024-09-12T21:02:01.765033+0000, chain.objs.size()=1 2024-09-12T19:13:57.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.zEyWhBk5XNypdaSeH8lGcWqkf8pNrZg_0 2024-09-12T19:13:57.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11755593057931589899', time=2024-09-12T21:02:01.767177+0000, chain.objs.size()=1 2024-09-12T19:13:57.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.PPV9ysV9smmG8pxwCxfNHYbBflJcgjF_0 2024-09-12T19:13:57.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16840814917917081735', time=2024-09-12T21:02:01.782964+0000, chain.objs.size()=1 2024-09-12T19:13:57.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.716+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.wSFBgCpgrQaDw1-tUa2TMua0xPGSj2E_0 2024-09-12T19:13:57.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47780 2024-09-12T19:13:57.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T19:13:57.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10686411166129754757', time=2024-09-12T21:02:01.885983+0000, chain.objs.size()=1 2024-09-12T19:13:57.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ujprLSgHKxQ237bSEWO7f7jrRhbBZIz_0 2024-09-12T19:13:57.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3807897829009791905', time=2024-09-12T21:02:01.912933+0000, chain.objs.size()=1 2024-09-12T19:13:57.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.XPNLr3lLJwy_aBfysJth7whQKRtVthA_0 2024-09-12T19:13:57.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7951960216361718955', time=2024-09-12T21:02:01.955705+0000, chain.objs.size()=1 2024-09-12T19:13:57.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.IzzWG2Q2hjfE6MWMubl_w_V_nSNK8QP_0 2024-09-12T19:13:57.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2057665320815960552', time=2024-09-12T21:02:01.967817+0000, chain.objs.size()=1 2024-09-12T19:13:57.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ePLtof3xAuG0N5p6yq-EeqeD_remkMk_0 2024-09-12T19:13:57.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13653966031533694518', time=2024-09-12T21:02:01.976705+0000, chain.objs.size()=1 2024-09-12T19:13:57.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.lyECAUxeSA0rP1IfaM33y-8KGzR9YrJ_0 2024-09-12T19:13:57.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5371829946245998544', time=2024-09-12T21:02:01.982221+0000, chain.objs.size()=1 2024-09-12T19:13:57.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.rForfQbWcr4oj10tVjnmfPHwl1xAWO0_0 2024-09-12T19:13:57.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1941415292971715366', time=2024-09-12T21:02:01.986968+0000, chain.objs.size()=1 2024-09-12T19:13:57.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ajdofDDRPFk_EKaTsiG8nZoIRSbNhxc_0 2024-09-12T19:13:57.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17493872213062387828', time=2024-09-12T21:02:01.998306+0000, chain.objs.size()=1 2024-09-12T19:13:57.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.MNlwpw0SvVaafxGsu8zdP2nyKkpFvqY_0 2024-09-12T19:13:57.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.73255400164694663', time=2024-09-12T21:02:02.000088+0000, chain.objs.size()=1 2024-09-12T19:13:57.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.UL4WZzpN2SkL3kVDj7pRV4wI3E3IbF9_0 2024-09-12T19:13:57.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5660979275020213603', time=2024-09-12T21:02:02.003841+0000, chain.objs.size()=1 2024-09-12T19:13:57.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.11QHsUE-ao7yiieMCSk356QvgBRozWn_0 2024-09-12T19:13:57.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8749615296957759802', time=2024-09-12T21:02:02.011147+0000, chain.objs.size()=1 2024-09-12T19:13:57.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.q5CWsj9Dnx4Vbnv1hsVVLsqhqST6mg2_0 2024-09-12T19:13:57.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5030497464570924093', time=2024-09-12T21:02:02.112106+0000, chain.objs.size()=1 2024-09-12T19:13:57.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.720+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.QhyPWsb3jJIbV9lqRZFWEFi4D_6yLY-_0 2024-09-12T19:13:57.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3146245975056003560', time=2024-09-12T21:02:02.142613+0000, chain.objs.size()=1 2024-09-12T19:13:57.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.hpzZAoMpb9TKIzUAqesc6fw3uZbWt3X_0 2024-09-12T19:13:57.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12177528215284168470', time=2024-09-12T21:02:02.162894+0000, chain.objs.size()=1 2024-09-12T19:13:57.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.w7yfTtCS6hYRpK5qjzdGv6N7-WWbun8_0 2024-09-12T19:13:57.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16567135843102148238', time=2024-09-12T21:02:02.194774+0000, chain.objs.size()=1 2024-09-12T19:13:57.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.9il0RfpFRyMESOTcISHsAjrnrT6kLpn_0 2024-09-12T19:13:57.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11837662092015995962', time=2024-09-12T21:02:50.900395+0000, chain.objs.size()=1 2024-09-12T19:13:57.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.394__shadow:Rip2eJKXVq9-fwdIYbPTuKO3Y3uNESy_.hSCeccYmdO3Urv-u7j2VZRphY510eAX_0 2024-09-12T19:13:57.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14422667873212990195', time=2024-09-12T21:03:45.270283+0000, chain.objs.size()=1 2024-09-12T19:13:57.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.464__shadow_.osLxeYfA5Gzp0z9XyzsTwRzQ3qmSuFm_0 2024-09-12T19:13:57.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15205787876167068714', time=2024-09-12T21:04:00.778693+0000, chain.objs.size()=1 2024-09-12T19:13:57.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.490__shadow_.ArdD0S2mBVBwOkW_0gjvwe9ToMyHxuL_0 2024-09-12T19:13:57.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15205787876167068714', time=2024-09-12T21:04:00.984461+0000, chain.objs.size()=1 2024-09-12T19:13:57.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.490__shadow_.ArdD0S2mBVBwOkW_0gjvwe9ToMyHxuL_0 2024-09-12T19:13:57.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16778727701233925268', time=2024-09-12T21:04:04.513259+0000, chain.objs.size()=1 2024-09-12T19:13:57.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.496__shadow_.YAYpI0Cf-L6_Ax8FAlL8ovEnTCwK5hX_0 2024-09-12T19:13:57.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5664976520693639531', time=2024-09-12T21:04:16.148373+0000, chain.objs.size()=1 2024-09-12T19:13:57.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.512__shadow_.5hqRTDgnew98onEVcc4kO_j3A-50dBn_0 2024-09-12T19:13:57.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.162759271945397611', time=2024-09-12T21:05:47.756213+0000, chain.objs.size()=1 2024-09-12T19:13:57.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.556__shadow_.YmkI923wUYvHafShPlNmaiGj0FAKHbX_0 2024-09-12T19:13:57.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3943247079486542352', time=2024-09-12T21:06:05.692082+0000, chain.objs.size()=1 2024-09-12T19:13:57.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:GVsgSZd65cg7Ij5qwIxU51HRCVdNwLO_.6KnMIvVzWbiWnsnoHD9_qfeIaLrYdkt_0 2024-09-12T19:13:57.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2352147814492988262', time=2024-09-12T21:06:12.348614+0000, chain.objs.size()=1 2024-09-12T19:13:57.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.570__shadow:46s4kIUtgKnYV2skY4qDapjV4joXCpA_.zVsYOH0_RkYmYCCGFrE3vx_cJ-dZlkc_0 2024-09-12T19:13:57.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10736207999347102477', time=2024-09-12T21:06:37.827746+0000, chain.objs.size()=1 2024-09-12T19:13:57.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:8dg3N4OgHWjf2xaaYGcaApVmlLZVBRA_.ImMDROM2BYsOeJ6qx2OVqN5x1OzbnKO_0 2024-09-12T19:13:57.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12458270152799382945', time=2024-09-12T21:06:40.450321+0000, chain.objs.size()=1 2024-09-12T19:13:57.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:XsTvladmy.RjJK.6i-69sRZfL8laD0P_.dajD4r1iIP-MyDMKy6q2p4A0Z7Pbrjm_0 2024-09-12T19:13:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16268053231654472586', time=2024-09-12T21:06:59.809431+0000, chain.objs.size()=1 2024-09-12T19:13:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.596__shadow_.udo3UQ56idkPJGgAshLaQDW7iq2u56i_0 2024-09-12T19:13:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7076271688827802641', time=2024-09-12T21:07:07.545947+0000, chain.objs.size()=1 2024-09-12T19:13:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.608__shadow_.Mkvr6TB1eDJY96ZXrSMOc229m387z4u_0 2024-09-12T19:13:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9604972363951671779', time=2024-09-12T21:09:25.908959+0000, chain.objs.size()=1 2024-09-12T19:13:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.724+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.618__shadow_.RlolKrnvGCwEo2cDPb8rojrAiYP8ZFk_0 2024-09-12T19:13:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.728+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16153445590681794912', time=2024-09-12T21:10:04.969002+0000, chain.objs.size()=6 2024-09-12T19:13:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.728+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.660__multipart_bar.2~txt3IeWngAWnwk-CzzXn2QtIFIavIdK.1 2024-09-12T19:13:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.728+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.660__multipart_bar.2~txt3IeWngAWnwk-CzzXn2QtIFIavIdK.2 2024-09-12T19:13:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.728+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.660__multipart_bar.2~txt3IeWngAWnwk-CzzXn2QtIFIavIdK.3 2024-09-12T19:13:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.728+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.660__multipart_bar.2~txt3IeWngAWnwk-CzzXn2QtIFIavIdK.4 2024-09-12T19:13:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.728+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.660__multipart_bar.2~txt3IeWngAWnwk-CzzXn2QtIFIavIdK.5 2024-09-12T19:13:57.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.728+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.660__multipart_bar.2~txt3IeWngAWnwk-CzzXn2QtIFIavIdK.6 2024-09-12T19:13:57.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.728+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16674898133105444298', time=2024-09-12T21:10:09.396918+0000, chain.objs.size()=1 2024-09-12T19:13:57.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.728+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.666__shadow_.w3GfZ0h9GrSoFPmWA3jcU9jxo8HniWM_0 2024-09-12T19:13:57.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.728+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15648809593874001801', time=2024-09-12T21:10:09.399224+0000, chain.objs.size()=1 2024-09-12T19:13:57.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.728+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.666__shadow_.Zgjoq8PYcU5tX6-L3D3IA7Pa0d7y7b__0 2024-09-12T19:13:57.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.728+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18431213715507843579', time=2024-09-12T21:11:21.865126+0000, chain.objs.size()=1 2024-09-12T19:13:57.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.728+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.744__shadow_.ccqOnCZXuTHDOqPgE8Pdqy74MdGw8bz_0 2024-09-12T19:13:57.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.728+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.732+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T19:13:57.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.732+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.732+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46919' 2024-09-12T19:13:57.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11082252088426342818', time=2024-09-12T20:57:37.403380+0000, chain.objs.size()=1 2024-09-12T19:13:57.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.162__shadow_.kVnRuDYECH6mRp-9H719i79CQnRAMmI_0 2024-09-12T19:13:57.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4965981609560312330', time=2024-09-12T21:00:32.021831+0000, chain.objs.size()=1 2024-09-12T19:13:57.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.KdLRqO90I9HMl0Nje3TMDr8IPPlcr0a_0 2024-09-12T19:13:57.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6400080483706133692', time=2024-09-12T21:00:32.042226+0000, chain.objs.size()=1 2024-09-12T19:13:57.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.uJlt25zkVdDYjPCGVF3MSA4zcXMUT4q_0 2024-09-12T19:13:57.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8051552869176183773', time=2024-09-12T21:00:32.084577+0000, chain.objs.size()=1 2024-09-12T19:13:57.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.HSAi2SvuFxJPkCtuJY-BnEO48inZFfC_0 2024-09-12T19:13:57.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1672575470840390432', time=2024-09-12T21:00:32.088111+0000, chain.objs.size()=1 2024-09-12T19:13:57.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.w1EedG98duo-eib6pF6Ny7sk7J899rG_0 2024-09-12T19:13:57.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13442980586727386499', time=2024-09-12T21:00:32.116854+0000, chain.objs.size()=1 2024-09-12T19:13:57.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tntvplaf2ZiozXH-ptl4G5JQyL9t35u_0 2024-09-12T19:13:57.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16790859412333763204', time=2024-09-12T21:00:32.122795+0000, chain.objs.size()=1 2024-09-12T19:13:57.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.1SqVPB9izbqwymjn8R6HGlLJfbdkhWX_0 2024-09-12T19:13:57.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18232852126627721571', time=2024-09-12T21:00:32.264588+0000, chain.objs.size()=1 2024-09-12T19:13:57.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.rx68Tfs3nzUXS3y3SXEUowDNLFcMcvn_0 2024-09-12T19:13:57.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10285808659798458590', time=2024-09-12T21:00:32.294149+0000, chain.objs.size()=1 2024-09-12T19:13:57.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.N5RRjenkQKfAE4FmDi_tHs1xI2EPD85_0 2024-09-12T19:13:57.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2958318809555087837', time=2024-09-12T21:00:32.344214+0000, chain.objs.size()=1 2024-09-12T19:13:57.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.83PkIk5fGMkWYuyQe_JQAgm8jA4vf2E_0 2024-09-12T19:13:57.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9611563257592377423', time=2024-09-12T21:00:32.346850+0000, chain.objs.size()=1 2024-09-12T19:13:57.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.4Gq9UdWG2-AwHpOgKrqDik6ZJWwlZHq_0 2024-09-12T19:13:57.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1455314069777327384', time=2024-09-12T21:00:32.467666+0000, chain.objs.size()=1 2024-09-12T19:13:57.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.X3dmE9tGVJ1KTwxYUyaQz7TwfLYYGQ8_0 2024-09-12T19:13:57.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9480233865968839800', time=2024-09-12T21:00:32.543059+0000, chain.objs.size()=1 2024-09-12T19:13:57.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.b2BBTHbej5wOKiT0CZ--eNsPAbZMK-j_0 2024-09-12T19:13:57.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15546952655236750683', time=2024-09-12T21:00:32.544643+0000, chain.objs.size()=1 2024-09-12T19:13:57.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.BrZNeMt-Mi3kbbKiBIzHuj_AE9g6GZH_0 2024-09-12T19:13:57.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18052016215930592745', time=2024-09-12T21:00:32.545637+0000, chain.objs.size()=1 2024-09-12T19:13:57.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.bHjZ0AN-L1PNiPIKrXM_fVLx_MVTBK7_0 2024-09-12T19:13:57.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5569786329708111729', time=2024-09-12T21:00:32.547648+0000, chain.objs.size()=1 2024-09-12T19:13:57.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.eNndJLqrSbJQfrAPlXdd2p0vfrwgVs1_0 2024-09-12T19:13:57.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1056750771893822234', time=2024-09-12T21:00:32.904226+0000, chain.objs.size()=1 2024-09-12T19:13:57.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.5GtdFYp9peEpX08P-d2ADTn3M5RqMwo_0 2024-09-12T19:13:57.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15741809622162395857', time=2024-09-12T21:00:32.936755+0000, chain.objs.size()=1 2024-09-12T19:13:57.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-vPrjeAf0U9u241Z-68Qo8jA0f9eeCD_0 2024-09-12T19:13:57.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2187222575738077662', time=2024-09-12T21:00:33.092134+0000, chain.objs.size()=1 2024-09-12T19:13:57.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.p_Am1bam2afY5uFo2R1QvuX3j5SheKE_0 2024-09-12T19:13:57.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15094176932489191155', time=2024-09-12T21:00:33.391891+0000, chain.objs.size()=1 2024-09-12T19:13:57.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LdkFlVEuuGEsvx8My0juGWRgjSKna82_0 2024-09-12T19:13:57.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5780433680633084434', time=2024-09-12T21:00:33.435661+0000, chain.objs.size()=1 2024-09-12T19:13:57.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.xxnIPx9dA5u2WuojcOrDMBajYOFxzHq_0 2024-09-12T19:13:57.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10318365984300695355', time=2024-09-12T21:00:33.445973+0000, chain.objs.size()=1 2024-09-12T19:13:57.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.vA7BFKsjZPSQKy3LSWsOEEyYApeHV6d_0 2024-09-12T19:13:57.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8153575493915885200', time=2024-09-12T21:00:33.584649+0000, chain.objs.size()=1 2024-09-12T19:13:57.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.736+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.IFmO1A55appUk6o9htyiqhD3YTRmT06_0 2024-09-12T19:13:57.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2641300547055421326', time=2024-09-12T21:00:33.870939+0000, chain.objs.size()=1 2024-09-12T19:13:57.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.v2Rz6GXvru3EMYQZCljTc6MTvzA2_i2_0 2024-09-12T19:13:57.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7019998724393957597', time=2024-09-12T21:00:33.900045+0000, chain.objs.size()=1 2024-09-12T19:13:57.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.nSfdun4jHiFZxahms3tLSHLv42nChlC_0 2024-09-12T19:13:57.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14441345133481468680', time=2024-09-12T21:00:43.992613+0000, chain.objs.size()=1 2024-09-12T19:13:57.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.276__shadow_.zWZkxZlCaeN1_jEEWgV1SbQRLf13JC0_0 2024-09-12T19:13:57.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8387253560977919140', time=2024-09-12T21:00:46.891272+0000, chain.objs.size()=1 2024-09-12T19:13:57.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.280__shadow_.KOfC03WWBNFUS7mYmi705OW9TuW3kQI_0 2024-09-12T19:13:57.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17685519246635701834', time=2024-09-12T21:00:51.336521+0000, chain.objs.size()=1 2024-09-12T19:13:57.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.286__shadow_.Hl_xGv5o_So4Eiz3W1naLm2GLE37r2H_0 2024-09-12T19:13:57.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15093533322308392537', time=2024-09-12T21:00:52.790800+0000, chain.objs.size()=1 2024-09-12T19:13:57.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.288__shadow_.QMYvUkMCgEmfJhQV8tjrmKqlhY7hiRi_0 2024-09-12T19:13:57.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10974504429343633047', time=2024-09-12T21:00:53.555786+0000, chain.objs.size()=1 2024-09-12T19:13:57.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.289__shadow_.iqTcWAcJEEDqwTbO7jZ2w7NdUZdbS0g_0 2024-09-12T19:13:57.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1291584198494655110', time=2024-09-12T21:01:04.107591+0000, chain.objs.size()=1 2024-09-12T19:13:57.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.301__shadow_.9aYICyz_4Wp5sml35FqjEKusqWeabzc_0 2024-09-12T19:13:57.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1415372146204424828', time=2024-09-12T21:01:04.109566+0000, chain.objs.size()=1 2024-09-12T19:13:57.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.301__shadow_.TdOffbWAr1MPoTDRalp9M4wlgsz94S8_0 2024-09-12T19:13:57.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10141788861209696486', time=2024-09-12T21:01:05.587498+0000, chain.objs.size()=1 2024-09-12T19:13:57.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.303__shadow_.y2CV3jxPW1L6ok2FuHsJTN8CQ_ukXc__0 2024-09-12T19:13:57.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7477401786627907295', time=2024-09-12T21:01:05.589519+0000, chain.objs.size()=1 2024-09-12T19:13:57.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.303__shadow_.tjl7sqGa-LvD9LY0utuDkupFrWMpmZu_0 2024-09-12T19:13:57.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11978897782969819039', time=2024-09-12T21:01:07.969274+0000, chain.objs.size()=1 2024-09-12T19:13:57.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.306__shadow_.Yzf8wcjdSeyjqbRd_5QTPPqLGAk_AEl_0 2024-09-12T19:13:57.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1170345071827692380', time=2024-09-12T21:01:39.402307+0000, chain.objs.size()=1 2024-09-12T19:13:57.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.XUbXqTYxftbUbQe0ZquYJl0SjOoNJCB_0 2024-09-12T19:13:57.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17262375012168009791', time=2024-09-12T21:01:39.435256+0000, chain.objs.size()=1 2024-09-12T19:13:57.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.S9jic9wQ-ppEVzzudR7OUnYCMvbL5nm_0 2024-09-12T19:13:57.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17611933674718842974', time=2024-09-12T21:01:39.469188+0000, chain.objs.size()=1 2024-09-12T19:13:57.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ycVSrEnrOmCwxcVZLMAVJbpAgFbOjSC_0 2024-09-12T19:13:57.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2307858349267716906', time=2024-09-12T21:01:39.528565+0000, chain.objs.size()=1 2024-09-12T19:13:57.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.f0ArBztqjvke98G1x9ATcZkEJFHEs7Z_0 2024-09-12T19:13:57.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12929726936891222768', time=2024-09-12T21:01:39.537428+0000, chain.objs.size()=1 2024-09-12T19:13:57.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.PwOMs-dBd9JpuurX0UB6lKHLvE-TdgL_0 2024-09-12T19:13:57.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7464954528253990092', time=2024-09-12T21:01:39.549678+0000, chain.objs.size()=1 2024-09-12T19:13:57.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.6L6m9j4dJUXyZX4qiB_r5TR3NBtpCRl_0 2024-09-12T19:13:57.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15533076802251397542', time=2024-09-12T21:01:39.741730+0000, chain.objs.size()=1 2024-09-12T19:13:57.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.L164RNcczrW0pKnP0319GaIrk_AzDUC_0 2024-09-12T19:13:57.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6486811324659200575', time=2024-09-12T21:01:39.753418+0000, chain.objs.size()=1 2024-09-12T19:13:57.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.OSgKyhZYrCiCrtQY7tCGbC3dojmYIPg_0 2024-09-12T19:13:57.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1593708649844170196', time=2024-09-12T21:01:39.770607+0000, chain.objs.size()=1 2024-09-12T19:13:57.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.5lVRvPA2EMiieYwaiJNNPjYWinWdHWQ_0 2024-09-12T19:13:57.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2767218810919683780', time=2024-09-12T21:01:39.773595+0000, chain.objs.size()=1 2024-09-12T19:13:57.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.740+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.C4r2jw1DfHrvTUg-eRlL40etF2P1kU__0 2024-09-12T19:13:57.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11827377955013508329', time=2024-09-12T21:01:39.965654+0000, chain.objs.size()=1 2024-09-12T19:13:57.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.bHYMaX4bxZ6S_8jWaDgeFBNQtLlZa8v_0 2024-09-12T19:13:57.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9586101519402341256', time=2024-09-12T21:01:39.991728+0000, chain.objs.size()=1 2024-09-12T19:13:57.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.xG6i0VtdHiLtJ8tCIEeyC7WO3Vn4st7_0 2024-09-12T19:13:57.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8458716459694397491', time=2024-09-12T21:01:40.116987+0000, chain.objs.size()=1 2024-09-12T19:13:57.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.llXjwQgLeFJi0pvc5GU9GbLCz1IOqtG_0 2024-09-12T19:13:57.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.157503449271399755', time=2024-09-12T21:01:40.121988+0000, chain.objs.size()=1 2024-09-12T19:13:57.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.weRK6h6tsSI6kKQjxONNa2lhTFXFBDt_0 2024-09-12T19:13:57.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9140597050651538178', time=2024-09-12T21:01:40.164331+0000, chain.objs.size()=1 2024-09-12T19:13:57.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.V5IfdHFcwCqEmZj4NTZ52TxFzLWUST1_0 2024-09-12T19:13:57.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11974893420479875063', time=2024-09-12T21:01:40.330910+0000, chain.objs.size()=1 2024-09-12T19:13:57.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mXrpj07T9dGNsl9Nc2dRnmTOc5YeoDw_0 2024-09-12T19:13:57.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14443373054666861923', time=2024-09-12T21:01:40.333882+0000, chain.objs.size()=1 2024-09-12T19:13:57.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.aYe0rwzakXpPT5cNAiiOzmqNmVs8632_0 2024-09-12T19:13:57.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8590026706351396619', time=2024-09-12T21:01:40.367937+0000, chain.objs.size()=1 2024-09-12T19:13:57.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.gKOxa5hFLt7SdZJvINQGx-k7CWksIx1_0 2024-09-12T19:13:57.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.689911046494112546', time=2024-09-12T21:01:40.422762+0000, chain.objs.size()=1 2024-09-12T19:13:57.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QGbTDguiNMMT1cOM5Kj5XvkZ7dReeOr_0 2024-09-12T19:13:57.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1157703561300282256', time=2024-09-12T21:01:40.547699+0000, chain.objs.size()=1 2024-09-12T19:13:57.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.YnHiN8-HqtavckWeVkE4714eugx3z2y_0 2024-09-12T19:13:57.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15123508775735833838', time=2024-09-12T21:01:40.594929+0000, chain.objs.size()=1 2024-09-12T19:13:57.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.omFmqJrnXubgo3rF12KRh0z7eJ-KT4__0 2024-09-12T19:13:57.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12074044257288625120', time=2024-09-12T21:01:40.609711+0000, chain.objs.size()=1 2024-09-12T19:13:57.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ctfe_DdtbUntLHPnP6Bd7aPDsGhjbjm_0 2024-09-12T19:13:57.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7596037751900600325', time=2024-09-12T21:01:40.649064+0000, chain.objs.size()=1 2024-09-12T19:13:57.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RMItPlnLK8JyCpQQimpDOJkygeURDn9_0 2024-09-12T19:13:57.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16097506255475860201', time=2024-09-12T21:01:40.774175+0000, chain.objs.size()=1 2024-09-12T19:13:57.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.PGgKUzrgM7n7Nj3FZPYOKw_iNBBqQQV_0 2024-09-12T19:13:57.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17920288147290423419', time=2024-09-12T21:01:40.792131+0000, chain.objs.size()=1 2024-09-12T19:13:57.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.g_kEUk4wzD_VrooEuNQIAbIUCwYzPTQ_0 2024-09-12T19:13:57.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10089830564491268912', time=2024-09-12T21:01:40.820362+0000, chain.objs.size()=1 2024-09-12T19:13:57.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.744+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.czVK4go9_pFBcXMyuut3oBTJ7qIhUXg_0 2024-09-12T19:13:57.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4351140534541266239', time=2024-09-12T21:01:40.843209+0000, chain.objs.size()=1 2024-09-12T19:13:57.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.zzAOEcpddQgxdXyHoi7tGjbSsehn-qU_0 2024-09-12T19:13:57.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5040411434772810857', time=2024-09-12T21:01:40.873940+0000, chain.objs.size()=1 2024-09-12T19:13:57.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.dtbGnnfeRRiwoq-eGoVxWBRabXwEuwV_0 2024-09-12T19:13:57.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13243738443203950506', time=2024-09-12T21:01:40.876260+0000, chain.objs.size()=1 2024-09-12T19:13:57.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.pTgIUIJqWHd6NWeBYA8mNDU4b4j2iJd_0 2024-09-12T19:13:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5384496971226290761', time=2024-09-12T21:01:40.995802+0000, chain.objs.size()=1 2024-09-12T19:13:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ckFgfu32g3JO1AwWxwbqzE-Jxhv6YRX_0 2024-09-12T19:13:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18383554669599081388', time=2024-09-12T21:01:41.013549+0000, chain.objs.size()=1 2024-09-12T19:13:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.I4vQwufvE6tjHLVcjIJQp3cHFfXQPW7_0 2024-09-12T19:13:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11766587809276527009', time=2024-09-12T21:01:41.030056+0000, chain.objs.size()=1 2024-09-12T19:13:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._3lYUYE177wMVZ_Vzy7a5QmY5S8HusN_0 2024-09-12T19:13:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14161795168240259532', time=2024-09-12T21:01:41.054911+0000, chain.objs.size()=1 2024-09-12T19:13:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.IlWPShD5Rkna9j_2BCE3IEO7d8m7lRh_0 2024-09-12T19:13:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6537401962091546086', time=2024-09-12T21:01:41.074009+0000, chain.objs.size()=1 2024-09-12T19:13:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.CXYRTK7c_yzZB_E6g6crtKS7rTbxXG4_0 2024-09-12T19:13:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14802635930312835095', time=2024-09-12T21:02:00.502850+0000, chain.objs.size()=1 2024-09-12T19:13:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yXlUpth6NBO3mIrLRFhfxlHzvknYO4Q_0 2024-09-12T19:13:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.320588432610503876', time=2024-09-12T21:02:00.507598+0000, chain.objs.size()=1 2024-09-12T19:13:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.LdMTli6JGkbYFDgV3Hmu02_29M3mMKG_0 2024-09-12T19:13:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6039564047620663606', time=2024-09-12T21:02:00.517136+0000, chain.objs.size()=1 2024-09-12T19:13:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jVz0F3BMSJmAoDbi8f6Jqt44yYpGeSj_0 2024-09-12T19:13:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14255398906151035466', time=2024-09-12T21:02:00.609497+0000, chain.objs.size()=1 2024-09-12T19:13:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.OJudrTq9IiZvyA7uqoqgVItPvp5h-7l_0 2024-09-12T19:13:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5026622516900796062', time=2024-09-12T21:02:00.620059+0000, chain.objs.size()=1 2024-09-12T19:13:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.cUI_eMwcZ3rWWG0pOxQlfRkPCUdm8Qz_0 2024-09-12T19:13:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8864735024445992109', time=2024-09-12T21:02:00.627942+0000, chain.objs.size()=1 2024-09-12T19:13:57.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Ul1nTl0OV01JyBwt0RB7OThRCIx-0Ya_0 2024-09-12T19:13:57.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1187465855980242424', time=2024-09-12T21:02:00.648714+0000, chain.objs.size()=1 2024-09-12T19:13:57.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-p_Boi5AJZOh2RZnPl21vwRx_pfw03O_0 2024-09-12T19:13:57.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1829520625828971547', time=2024-09-12T21:02:00.826827+0000, chain.objs.size()=1 2024-09-12T19:13:57.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5gkT_Mo8A5RphSjOR-NOvZwn7jhcVqL_0 2024-09-12T19:13:57.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1358890839866631536', time=2024-09-12T21:02:00.849733+0000, chain.objs.size()=1 2024-09-12T19:13:57.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.748+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.bqZu871SusfUq3IXfZ6_xYUwph1X6K8_0 2024-09-12T19:13:57.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16524228741098577442', time=2024-09-12T21:02:00.875200+0000, chain.objs.size()=1 2024-09-12T19:13:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.O5tF7mHTKCQk23W-kGFFR-e7Yz8VJoF_0 2024-09-12T19:13:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15705928478063821234', time=2024-09-12T21:02:00.878795+0000, chain.objs.size()=1 2024-09-12T19:13:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.E80aqHxPB_U0OcJzUTYIEwGjcFlGp1n_0 2024-09-12T19:13:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14448565979200091862', time=2024-09-12T21:02:01.037763+0000, chain.objs.size()=1 2024-09-12T19:13:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.IFAwMLDeXotG5j9TRTIkK2UiLnlakv6_0 2024-09-12T19:13:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1088647432914146302', time=2024-09-12T21:02:01.069874+0000, chain.objs.size()=1 2024-09-12T19:13:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.X0ivV5o5medvTPjQ1RlY-uQUIe_5Qne_0 2024-09-12T19:13:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1827540817243727316', time=2024-09-12T21:02:01.516443+0000, chain.objs.size()=1 2024-09-12T19:13:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.fmuv7zkKVdl-EYwsd-v6wG2OdGyp5sL_0 2024-09-12T19:13:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5000418933269222439', time=2024-09-12T21:02:01.530144+0000, chain.objs.size()=1 2024-09-12T19:13:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.3K3xMDdeqyE-79rls6FKeZ5fhVgeYR4_0 2024-09-12T19:13:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2987053138718155547', time=2024-09-12T21:02:01.890747+0000, chain.objs.size()=1 2024-09-12T19:13:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7I_XIItq38E0vTkOufqoau3DBCKct-g_0 2024-09-12T19:13:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.317102408009933216', time=2024-09-12T21:02:02.111148+0000, chain.objs.size()=1 2024-09-12T19:13:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.S3FPol1TzBUjodakVmbexXFl7IQRS0Z_0 2024-09-12T19:13:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3811908032700968041', time=2024-09-12T21:02:02.136972+0000, chain.objs.size()=1 2024-09-12T19:13:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.hbxgp10LFrM4eGfCJ8erOWWmDNO1lir_0 2024-09-12T19:13:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9495964768500620137', time=2024-09-12T21:02:02.199521+0000, chain.objs.size()=1 2024-09-12T19:13:57.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.m_dZ7Y3_45jvOlNm51vHkP22hz7A2KY_0 2024-09-12T19:13:57.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6242505973644760973', time=2024-09-12T21:02:02.204664+0000, chain.objs.size()=1 2024-09-12T19:13:57.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.xGhaWPSIDSEMNbOfnPK2_vjXjBqd_0K_0 2024-09-12T19:13:57.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9117394083503108201', time=2024-09-12T21:02:21.018920+0000, chain.objs.size()=1 2024-09-12T19:13:57.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.353__shadow_.o58Z14VfG8bk0uamXhrS52kNWZ3xZvF_0 2024-09-12T19:13:57.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13599411024512358056', time=2024-09-12T21:02:35.523056+0000, chain.objs.size()=1 2024-09-12T19:13:57.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.375__shadow_.KMBasv7BzvkKQnU2Q_AUbRGnvbEqJ50_0 2024-09-12T19:13:57.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13687123545905053888', time=2024-09-12T21:03:35.044833+0000, chain.objs.size()=1 2024-09-12T19:13:57.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.454__shadow_.qInoA1GJDPdpZhAIJwDnq4k7J4P5ThA_0 2024-09-12T19:13:57.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17563076667157312039', time=2024-09-12T21:04:01.816757+0000, chain.objs.size()=1 2024-09-12T19:13:57.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.491__shadow_.cenkekWPCvAs8zojO4hOR6P-aZLeGRN_0 2024-09-12T19:13:57.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9646403933426405416', time=2024-09-12T21:04:06.502288+0000, chain.objs.size()=1 2024-09-12T19:13:57.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.499__shadow_.walyWA-Sfomvc2aHgmaHh1n_x-kGuyH_0 2024-09-12T19:13:57.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16056541224032073067', time=2024-09-12T21:04:29.219990+0000, chain.objs.size()=3 2024-09-12T19:13:57.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.752+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.521__multipart_mymultipart.2~To3rKc6sTcOwyg6kvIwx3MiGGy451az.1 2024-09-12T19:13:57.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.756+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.521__multipart_mymultipart.2~To3rKc6sTcOwyg6kvIwx3MiGGy451az.2 2024-09-12T19:13:57.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.756+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.521__multipart_mymultipart.2~To3rKc6sTcOwyg6kvIwx3MiGGy451az.3 2024-09-12T19:13:57.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.756+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.902122237314050223', time=2024-09-12T21:04:53.572085+0000, chain.objs.size()=2 2024-09-12T19:13:57.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.756+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.525__multipart_mymultipart.2~W-d7_e5MUysAkTF3U4VXYzEqp47m9RK.1 2024-09-12T19:13:57.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.756+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.525__multipart_mymultipart.2~W-d7_e5MUysAkTF3U4VXYzEqp47m9RK.2 2024-09-12T19:13:57.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.756+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5167324998524591992', time=2024-09-12T21:05:44.187836+0000, chain.objs.size()=1 2024-09-12T19:13:57.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.756+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.553__shadow_.IiCgkumXXtcjp5k0Wop1lOo5s12NNJv_0 2024-09-12T19:13:57.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.756+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1401853602934443639', time=2024-09-12T21:05:50.397245+0000, chain.objs.size()=2 2024-09-12T19:13:57.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.756+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.558__shadow_.udPb2ex2Th0jKFeiEfelI1jnKMHYGKh_0 2024-09-12T19:13:57.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.756+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.558__shadow_.udPb2ex2Th0jKFeiEfelI1jnKMHYGKh_1 2024-09-12T19:13:57.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.756+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2605108281681201069', time=2024-09-12T21:06:05.917852+0000, chain.objs.size()=1 2024-09-12T19:13:57.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.756+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:0L5RRLaJ7yar4FsD0drzwDu8SHYUl-3_.OdkmimjNfFOrTBnsm4jn4s2EItEqrDF_0 2024-09-12T19:13:57.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.756+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1375074414018933355', time=2024-09-12T21:06:12.418071+0000, chain.objs.size()=1 2024-09-12T19:13:57.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.756+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.570__shadow:ZTF-H8rHtidocyxQfSedsBMSljV7soJ_.-6xuldMgs_mSfCRxyfTRyxC2J3q2r9o_0 2024-09-12T19:13:57.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46919 2024-09-12T19:13:57.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T19:13:57.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11348219096121483042', time=2024-09-12T21:06:20.320339+0000, chain.objs.size()=1 2024-09-12T19:13:57.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.575__shadow_.EAiuBwTJ8HZHeav3tRaaPxtXr2GFDHW_0 2024-09-12T19:13:57.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15153669416717355947', time=2024-09-12T21:06:24.368569+0000, chain.objs.size()=1 2024-09-12T19:13:57.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.576__shadow:3ytpAQNT3Fuly9AVO.52myXQm34XvWS_.4fmDY33_LILYpNi-OWlJeqFs8NU7NgG_0 2024-09-12T19:13:57.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16636661906864947341', time=2024-09-12T21:06:24.775817+0000, chain.objs.size()=1 2024-09-12T19:13:57.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.576__shadow:x2OkB.qAsg5FEI2h.0iSfZAzdY.to1t_.lTV2menBUe4h0syotukJXGojkbDoUB5_0 2024-09-12T19:13:57.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2573877861201449333', time=2024-09-12T21:06:26.468821+0000, chain.objs.size()=1 2024-09-12T19:13:57.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:TklQldybUudvss9FtUSET0Oi4foLRlr_.QDlrzDc1p6rEG_sbmpRefngUzDlGQ2l_0 2024-09-12T19:13:57.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12895431593027262301', time=2024-09-12T21:06:46.384788+0000, chain.objs.size()=1 2024-09-12T19:13:57.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.579__shadow:e1qcAoWXPw6vEcXhW4dLkmimxHNuy31_.WhJhOHyDGXWXrAVR7Vt1ajyqWlFswis_0 2024-09-12T19:13:57.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Co8lSvlgFVG8oGIa2zeZXguqsxSEaEO', time=2024-09-12T21:09:34.237108+0000, chain.objs.size()=12 2024-09-12T19:13:57.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.624__multipart_multipart_enc.2~Co8lSvlgFVG8oGIa2zeZXguqsxSEaEO.1 2024-09-12T19:13:57.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.624__shadow_multipart_enc.2~Co8lSvlgFVG8oGIa2zeZXguqsxSEaEO.1_1 2024-09-12T19:13:57.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.624__multipart_multipart_enc.2~Co8lSvlgFVG8oGIa2zeZXguqsxSEaEO.2 2024-09-12T19:13:57.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.624__shadow_multipart_enc.2~Co8lSvlgFVG8oGIa2zeZXguqsxSEaEO.2_1 2024-09-12T19:13:57.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.624__multipart_multipart_enc.2~Co8lSvlgFVG8oGIa2zeZXguqsxSEaEO.3 2024-09-12T19:13:57.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.624__shadow_multipart_enc.2~Co8lSvlgFVG8oGIa2zeZXguqsxSEaEO.3_1 2024-09-12T19:13:57.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.760+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.624__multipart_multipart_enc.2~Co8lSvlgFVG8oGIa2zeZXguqsxSEaEO.4 2024-09-12T19:13:57.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.764+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.624__shadow_multipart_enc.2~Co8lSvlgFVG8oGIa2zeZXguqsxSEaEO.4_1 2024-09-12T19:13:57.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.764+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.624__multipart_multipart_enc.2~Co8lSvlgFVG8oGIa2zeZXguqsxSEaEO.5 2024-09-12T19:13:57.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.764+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.624__shadow_multipart_enc.2~Co8lSvlgFVG8oGIa2zeZXguqsxSEaEO.5_1 2024-09-12T19:13:57.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.764+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.624__multipart_multipart_enc.2~Co8lSvlgFVG8oGIa2zeZXguqsxSEaEO.6 2024-09-12T19:13:57.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.764+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.624__shadow_multipart_enc.2~Co8lSvlgFVG8oGIa2zeZXguqsxSEaEO.6_1 2024-09-12T19:13:57.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.764+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14129823031169014326', time=2024-09-12T21:09:45.554499+0000, chain.objs.size()=1 2024-09-12T19:13:57.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.764+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.639__shadow_.1-1gXIbkVhRt-40O-jX00ySI1RVgOVB_0 2024-09-12T19:13:57.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.764+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14904224364820913558', time=2024-09-12T21:10:06.222580+0000, chain.objs.size()=1 2024-09-12T19:13:57.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.764+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.663__shadow_.171Ir4blOwYVNj9OYWN_5jH9O-eZnGm_0 2024-09-12T19:13:57.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.764+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12609899773863853733', time=2024-09-12T21:10:28.286341+0000, chain.objs.size()=1 2024-09-12T19:13:57.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.764+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.697__shadow:KZaSBf9sS.EICro9BCZLImumXaLePC4_.fpB8bEvQdbguG-8E20sHTurzFYHjolf_0 2024-09-12T19:13:57.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.768+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.768+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T19:13:57.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53570' 2024-09-12T19:13:57.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_AuFk-ayQ-UuxY-CRGPpfv-RJOznReg8', time=2024-09-12T20:57:36.563442+0000, chain.objs.size()=3 2024-09-12T19:13:57.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_.gVvx5tXSs7rE1tbt5ZwawZQwEubEnkJ_0 2024-09-12T19:13:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_.gVvx5tXSs7rE1tbt5ZwawZQwEubEnkJ_1 2024-09-12T19:13:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_.gVvx5tXSs7rE1tbt5ZwawZQwEubEnkJ_2 2024-09-12T19:13:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6949892375943734746', time=2024-09-12T20:57:57.229568+0000, chain.objs.size()=1 2024-09-12T19:13:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.179__shadow_.7vXaDo6YTt3hMk-LbrHYY8i0d4qBMa3_0 2024-09-12T19:13:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5584589522781647913', time=2024-09-12T20:58:03.073222+0000, chain.objs.size()=1 2024-09-12T19:13:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.188__shadow_.l_c4yv3--zuJUMKsHYN02pZdK3tpxaY_0 2024-09-12T19:13:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18007935133411795050', time=2024-09-12T20:59:48.690666+0000, chain.objs.size()=1 2024-09-12T19:13:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.231__shadow_.d1c7LGLSJDxiA6Eg7an8ZMpMqzaU2_V_0 2024-09-12T19:13:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.413423743319135120', time=2024-09-12T21:00:11.704437+0000, chain.objs.size()=1 2024-09-12T19:13:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.260__shadow_.KGxuyRmNTtQzbwsxu9yddFbO7tnBhu2_0 2024-09-12T19:13:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7805133413488154326', time=2024-09-12T21:00:32.014183+0000, chain.objs.size()=1 2024-09-12T19:13:57.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.kEHndzwBuxeTJBGojN5CeULrM1SsXpY_0 2024-09-12T19:13:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7257830778892514641', time=2024-09-12T21:00:32.033907+0000, chain.objs.size()=1 2024-09-12T19:13:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JF1iGSZ4aT_2oYuyoFvtqshaX5-fPCl_0 2024-09-12T19:13:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7166110373109131913', time=2024-09-12T21:00:32.057500+0000, chain.objs.size()=1 2024-09-12T19:13:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.wAq3A_3dninKoXe09Ajnq0sO5N7Jq_n_0 2024-09-12T19:13:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18087788490346185274', time=2024-09-12T21:00:32.081669+0000, chain.objs.size()=1 2024-09-12T19:13:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SvKdMcWb-jS3yYSOA8DJxyxyznNt0po_0 2024-09-12T19:13:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7097194418520081434', time=2024-09-12T21:00:32.112897+0000, chain.objs.size()=1 2024-09-12T19:13:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.772+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LvsnQtZHLp6IoDleDHEvjtGHgHY8JSB_0 2024-09-12T19:13:57.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11398440878875987661', time=2024-09-12T21:00:32.234455+0000, chain.objs.size()=1 2024-09-12T19:13:57.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.bc8Qh1y43dfbvOkb6VlBME7RsYpkIsT_0 2024-09-12T19:13:57.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13718206115273617480', time=2024-09-12T21:00:32.282511+0000, chain.objs.size()=1 2024-09-12T19:13:57.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3J93UPoyusFnUqWU7QJK38VNL0-GKm9_0 2024-09-12T19:13:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.886156870682794540', time=2024-09-12T21:00:32.298507+0000, chain.objs.size()=1 2024-09-12T19:13:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.OXga0prllTf7SoSvtv0AqedxOKIyYRG_0 2024-09-12T19:13:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12217066928466999846', time=2024-09-12T21:00:32.302042+0000, chain.objs.size()=1 2024-09-12T19:13:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.r28wIX5-xa7wbpQxdukUy0vW7SwAH_A_0 2024-09-12T19:13:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17825227847869795322', time=2024-09-12T21:00:32.347106+0000, chain.objs.size()=1 2024-09-12T19:13:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qIs3raH4RJW7lwkdCOb7ivP3k0RyumX_0 2024-09-12T19:13:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1438282121276016591', time=2024-09-12T21:00:32.455041+0000, chain.objs.size()=1 2024-09-12T19:13:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.IVz11m7fl06W8rM8G_vgJHHBl5NTwwO_0 2024-09-12T19:13:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8681331102642008287', time=2024-09-12T21:00:32.502625+0000, chain.objs.size()=1 2024-09-12T19:13:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.h2DcdBuC2yuaiSYCXLo9ZdDM_BVeLQc_0 2024-09-12T19:13:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7367508390189951795', time=2024-09-12T21:00:32.503695+0000, chain.objs.size()=1 2024-09-12T19:13:57.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CKJzr1si7QYg1tYIZGEGpuogpgC8YVs_0 2024-09-12T19:13:57.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2023729558722868117', time=2024-09-12T21:00:32.505665+0000, chain.objs.size()=1 2024-09-12T19:13:57.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.W6pp-PCOQIkfROPYjsVqAZY3oDBEd8X_0 2024-09-12T19:13:57.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11967357538592280428', time=2024-09-12T21:00:32.554975+0000, chain.objs.size()=1 2024-09-12T19:13:57.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.g5tr7N2yVPJkaNQcW3Fy7jLhIodTxz2_0 2024-09-12T19:13:57.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3027203172264974233', time=2024-09-12T21:00:32.567413+0000, chain.objs.size()=1 2024-09-12T19:13:57.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2an0bo1jrVrpGDJb6NA9Ka3VBpoQ6M9_0 2024-09-12T19:13:57.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15014218427490120692', time=2024-09-12T21:00:32.684975+0000, chain.objs.size()=1 2024-09-12T19:13:57.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3P2CXw3lJt-TIQiDKfQxzZISQ9yp_Di_0 2024-09-12T19:13:57.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10400757877898223150', time=2024-09-12T21:00:32.703290+0000, chain.objs.size()=1 2024-09-12T19:13:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_._W-e2p9TYo6Iyx2rg68u5JSVNjbU1lu_0 2024-09-12T19:13:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3283577529513524624', time=2024-09-12T21:00:32.729050+0000, chain.objs.size()=1 2024-09-12T19:13:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.gJelu6cy7OYyP3XLYi1rvM60W4LL4pw_0 2024-09-12T19:13:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1969430523018043796', time=2024-09-12T21:00:32.748426+0000, chain.objs.size()=1 2024-09-12T19:13:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.hBe4Cj0Pwbi1y6O5x7tyuTXSwpt67hy_0 2024-09-12T19:13:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14112893962971905404', time=2024-09-12T21:00:32.894356+0000, chain.objs.size()=1 2024-09-12T19:13:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WL3lhcShDE6Cx7nd34wYotNBsbPwTmL_0 2024-09-12T19:13:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12071227939294357934', time=2024-09-12T21:00:32.908810+0000, chain.objs.size()=1 2024-09-12T19:13:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.I4ZjtrT5EZRZLRVjm-rrtX21deW0BHo_0 2024-09-12T19:13:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12097810597558411470', time=2024-09-12T21:00:32.933809+0000, chain.objs.size()=1 2024-09-12T19:13:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sypJh3hI9nZAKeZCqFdNh2grC-bkJMd_0 2024-09-12T19:13:57.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5058103183460835435', time=2024-09-12T21:00:32.953534+0000, chain.objs.size()=1 2024-09-12T19:13:57.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.zVJKRrI8CXEXtajy4d4yDnavunmQB-u_0 2024-09-12T19:13:57.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16758044033439574888', time=2024-09-12T21:00:32.982654+0000, chain.objs.size()=1 2024-09-12T19:13:57.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.J9EMHAYDXJ4JcnPKd1IxKAEufLMW4bu_0 2024-09-12T19:13:57.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6317930598377172632', time=2024-09-12T21:00:33.129802+0000, chain.objs.size()=1 2024-09-12T19:13:57.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.0JkkI4lPiMj_rN4w1fKMVxEMCbeSMdu_0 2024-09-12T19:13:57.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2526585853185127990', time=2024-09-12T21:00:33.203067+0000, chain.objs.size()=1 2024-09-12T19:13:57.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.776+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.176xvrFWeijwqwn_X_GxDG6gVh-LxL1_0 2024-09-12T19:13:57.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10051479079753942186', time=2024-09-12T21:00:33.205041+0000, chain.objs.size()=1 2024-09-12T19:13:57.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.d8q2lJr4RLN71JIJzaabdHxA_OrYxDv_0 2024-09-12T19:13:57.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12980302584770389533', time=2024-09-12T21:00:33.215141+0000, chain.objs.size()=1 2024-09-12T19:13:57.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.rntpK44q7APq1ensIHNfR4NeXUTizgc_0 2024-09-12T19:13:57.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9178491547292432892', time=2024-09-12T21:00:33.410107+0000, chain.objs.size()=1 2024-09-12T19:13:57.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.NA7mZRIRqhfA6FSrNK1NGeUH5p8PAlT_0 2024-09-12T19:13:57.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10321467344325090137', time=2024-09-12T21:00:33.461045+0000, chain.objs.size()=1 2024-09-12T19:13:57.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.EF0wGmoJ-R4XrrbzBK2Z1oaqvgGnpIu_0 2024-09-12T19:13:57.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4992747763148072904', time=2024-09-12T21:00:33.465832+0000, chain.objs.size()=1 2024-09-12T19:13:57.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.GxGZ-wyichVgQtsKgl-mOyKhIRjghEO_0 2024-09-12T19:13:57.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10628859174048557478', time=2024-09-12T21:00:33.482617+0000, chain.objs.size()=1 2024-09-12T19:13:57.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.yD5KFti5IW_HIHcEnjvNF49UzcMXbyA_0 2024-09-12T19:13:57.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2632826572544875477', time=2024-09-12T21:00:33.483506+0000, chain.objs.size()=1 2024-09-12T19:13:57.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Erpf-KPfEv7l2IgLk7u2asPang22DBw_0 2024-09-12T19:13:57.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18169005827898381572', time=2024-09-12T21:00:33.592467+0000, chain.objs.size()=1 2024-09-12T19:13:57.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.5HKa5rON5lxk57_cAFOjC6BsG__3m36_0 2024-09-12T19:13:57.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1232957298684129634', time=2024-09-12T21:00:33.836335+0000, chain.objs.size()=1 2024-09-12T19:13:57.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.AGsK5AYM0d5NwfovJAMzB2AG5x5wtM2_0 2024-09-12T19:13:57.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14559585593595699088', time=2024-09-12T21:00:33.842461+0000, chain.objs.size()=1 2024-09-12T19:13:57.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.T7r4BtD-8h9BzlPa8nGbmoVeJcmIjga_0 2024-09-12T19:13:57.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17176752841946376365', time=2024-09-12T21:00:33.869020+0000, chain.objs.size()=1 2024-09-12T19:13:57.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.s2ue3A2ChtwE3vGAFkzCn-ob0r3Owsp_0 2024-09-12T19:13:57.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13594747982830936761', time=2024-09-12T21:00:36.710003+0000, chain.objs.size()=1 2024-09-12T19:13:57.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.266__shadow_.dnCc0juk6dwkJ5gPRXFVpwjQspAbSeW_0 2024-09-12T19:13:57.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12089314568218213311', time=2024-09-12T21:00:38.897679+0000, chain.objs.size()=1 2024-09-12T19:13:57.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.780+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.269__shadow_.44Q0hXgOD7CEKTdvS_v3637bkQhUWBd_0 2024-09-12T19:13:57.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1915094279720370797', time=2024-09-12T21:00:54.254861+0000, chain.objs.size()=1 2024-09-12T19:13:57.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.290__shadow_.5DUZ1WnmDiBW9bmK1EZiOq_MsK0hi4j_0 2024-09-12T19:13:57.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.831750073405238679', time=2024-09-12T21:00:58.119969+0000, chain.objs.size()=1 2024-09-12T19:13:57.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.RshkVP9ktglWz_G-5NvykYkKH434fEk_0 2024-09-12T19:13:57.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10977448345372316134', time=2024-09-12T21:00:58.131700+0000, chain.objs.size()=1 2024-09-12T19:13:57.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.yllZtsyrhVuq7gK4hubcn8NpVNkuvhx_0 2024-09-12T19:13:57.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13982293441592151405', time=2024-09-12T21:00:58.145723+0000, chain.objs.size()=1 2024-09-12T19:13:57.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.VVnJ4YxsN40Gu88SKTifQIpEr2atDlq_0 2024-09-12T19:13:57.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7551675134219897977', time=2024-09-12T21:01:39.440821+0000, chain.objs.size()=1 2024-09-12T19:13:57.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.KgeeATY86XWUwFgrY5PqJbiydqneImb_0 2024-09-12T19:13:57.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1601047462057677574', time=2024-09-12T21:01:39.457158+0000, chain.objs.size()=1 2024-09-12T19:13:57.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.FqbvTmMHam__JZerJxYc1MGVozO_Jip_0 2024-09-12T19:13:57.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14968399207497074380', time=2024-09-12T21:01:39.505655+0000, chain.objs.size()=1 2024-09-12T19:13:57.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.34o5gRekzQrC6Wm6eoRjg2Tj-vbPs5o_0 2024-09-12T19:13:57.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5683712154319431462', time=2024-09-12T21:01:39.510083+0000, chain.objs.size()=1 2024-09-12T19:13:57.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.iPhkzzwG1Mi8yfPV9hM6DSKmOneADF0_0 2024-09-12T19:13:57.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2622543230117538648', time=2024-09-12T21:01:39.551156+0000, chain.objs.size()=1 2024-09-12T19:13:57.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Nng8SVf3qJSkVYxxz4uVLGhCSBcc7H4_0 2024-09-12T19:13:57.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8899761038159132620', time=2024-09-12T21:01:39.661193+0000, chain.objs.size()=1 2024-09-12T19:13:57.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.JdWnfW6SoyakjT_Eu5Cd80Ntx9rDOEH_0 2024-09-12T19:13:57.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1025299500319966719', time=2024-09-12T21:01:39.687837+0000, chain.objs.size()=1 2024-09-12T19:13:57.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.okK04yNeuvKwrAzzvjV7i15wYEvI37-_0 2024-09-12T19:13:57.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5049669313521266167', time=2024-09-12T21:01:39.691206+0000, chain.objs.size()=1 2024-09-12T19:13:57.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.62Z9DUyr9wyEVjLMi-QPnpxRy755stq_0 2024-09-12T19:13:57.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13800501891045869901', time=2024-09-12T21:01:39.722469+0000, chain.objs.size()=1 2024-09-12T19:13:57.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.4Ou1VExBstLweb00mQfGjeP0bQsoZAQ_0 2024-09-12T19:13:57.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4931748109414397357', time=2024-09-12T21:01:39.760635+0000, chain.objs.size()=1 2024-09-12T19:13:57.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.dQ-s7JCxQ_w3VO7EbvLjvw4cGVS9O2w_0 2024-09-12T19:13:57.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8689243701206602247', time=2024-09-12T21:01:39.777830+0000, chain.objs.size()=1 2024-09-12T19:13:57.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.IwFsfxwri9F6S5FCVRc2-5dDu39OqG4_0 2024-09-12T19:13:57.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8837925160634011173', time=2024-09-12T21:01:39.952526+0000, chain.objs.size()=1 2024-09-12T19:13:57.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.784+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.PaLhcZESMoZeaAG7x2Eh5gZUG25Sw7M_0 2024-09-12T19:13:57.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.521541917097519146', time=2024-09-12T21:01:40.009665+0000, chain.objs.size()=1 2024-09-12T19:13:57.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BME33HSYyUr6e1S_AAG9Zph_eCdCepf_0 2024-09-12T19:13:57.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16920809436498749008', time=2024-09-12T21:01:40.149888+0000, chain.objs.size()=1 2024-09-12T19:13:57.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0Kk1DnwGiJamJ2oUy5JAIlRpz8sv6Xe_0 2024-09-12T19:13:57.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1991393976527423126', time=2024-09-12T21:01:40.162360+0000, chain.objs.size()=1 2024-09-12T19:13:57.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.7aImd0suCVVzFr4xba_0dQE6BVoXGYE_0 2024-09-12T19:13:57.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16937200603077357784', time=2024-09-12T21:01:40.210842+0000, chain.objs.size()=1 2024-09-12T19:13:57.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ZKB85el28g6JnfQYzm5X5TT-b5Bj6xN_0 2024-09-12T19:13:57.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14650103012575253052', time=2024-09-12T21:01:40.213146+0000, chain.objs.size()=1 2024-09-12T19:13:57.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.iHkpkLivDYPskRnX79h5Nt-7CzijoRG_0 2024-09-12T19:13:57.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2879827148298021695', time=2024-09-12T21:01:40.213879+0000, chain.objs.size()=1 2024-09-12T19:13:57.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.t-R2oqYOLtHsoLA8AyFK2kVUP29cjhi_0 2024-09-12T19:13:57.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13801640141448542980', time=2024-09-12T21:01:40.336556+0000, chain.objs.size()=1 2024-09-12T19:13:57.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hRCQ0KcWnn5PxMtM-s4M4hB6z_WQWcy_0 2024-09-12T19:13:57.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7836815680948236786', time=2024-09-12T21:01:40.378851+0000, chain.objs.size()=1 2024-09-12T19:13:57.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.biAJeY3Ux583GuFM4Ojyujw_-MTpwLQ_0 2024-09-12T19:13:57.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16301434107547982098', time=2024-09-12T21:01:40.387054+0000, chain.objs.size()=1 2024-09-12T19:13:57.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.gi1SNjyqY1RSh_TQlIsYXIy9eRRhiNw_0 2024-09-12T19:13:57.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2475958983125156269', time=2024-09-12T21:01:40.393116+0000, chain.objs.size()=1 2024-09-12T19:13:57.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.t6ypZHW8ByfoSPLDqhyaVVdw32ivmrx_0 2024-09-12T19:13:57.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3181247711276506100', time=2024-09-12T21:01:40.394088+0000, chain.objs.size()=1 2024-09-12T19:13:57.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.GArnCJ58NKeRgMX9DkFXJlrewcNlvuJ_0 2024-09-12T19:13:57.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15623480901927030796', time=2024-09-12T21:01:40.419226+0000, chain.objs.size()=1 2024-09-12T19:13:57.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.W1It419hRjAvRSbcooSKo2NoWH_btPy_0 2024-09-12T19:13:57.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17100251151246698050', time=2024-09-12T21:01:40.441527+0000, chain.objs.size()=1 2024-09-12T19:13:57.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.3yK1SDCNdT8VwlgKULmXTAPZvMz03jr_0 2024-09-12T19:13:57.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8743662591059208951', time=2024-09-12T21:01:40.447756+0000, chain.objs.size()=1 2024-09-12T19:13:57.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.x5WFzeAF32LvRFquXtOEIMb7w8TP9g4_0 2024-09-12T19:13:57.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11521564170900519361', time=2024-09-12T21:01:40.548908+0000, chain.objs.size()=1 2024-09-12T19:13:57.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.VRlQaPNIBUn6Dq2Ut8sAmYjNf6Rj9U9_0 2024-09-12T19:13:57.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11281171275799119888', time=2024-09-12T21:01:40.576741+0000, chain.objs.size()=1 2024-09-12T19:13:57.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.JTRjlRPhU6SK2Fe_r-a2kl09uhw8FzC_0 2024-09-12T19:13:57.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2459094750114240676', time=2024-09-12T21:01:40.581453+0000, chain.objs.size()=1 2024-09-12T19:13:57.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.tYOPTPNxfQE5d-sQdKlEaoLPAxphW7S_0 2024-09-12T19:13:57.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6709266809905738182', time=2024-09-12T21:01:40.628703+0000, chain.objs.size()=1 2024-09-12T19:13:57.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.wsvbSr4bWro5g0V-h39ZUL6dp-GjsOK_0 2024-09-12T19:13:57.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.385336838297687362', time=2024-09-12T21:01:40.629556+0000, chain.objs.size()=1 2024-09-12T19:13:57.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.788+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Ba7c7_6kPJ7kq06XJuJ3KCe_XROkpzY_0 2024-09-12T19:13:57.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10925246934422605336', time=2024-09-12T21:01:40.642171+0000, chain.objs.size()=1 2024-09-12T19:13:57.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._GViTxWUrp7Stxb-it4RwYVJ69zFe2g_0 2024-09-12T19:13:57.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13809625997696090129', time=2024-09-12T21:01:40.803700+0000, chain.objs.size()=1 2024-09-12T19:13:57.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.IXIUpFU2Kb-PxJFgg917tOtjyqRqbeB_0 2024-09-12T19:13:57.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5956623119762287313', time=2024-09-12T21:01:40.831553+0000, chain.objs.size()=1 2024-09-12T19:13:57.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-yHJIZRknf8DaOJKEUuddRt6qslnvVW_0 2024-09-12T19:13:57.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11396416647096372672', time=2024-09-12T21:01:40.888892+0000, chain.objs.size()=1 2024-09-12T19:13:57.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.5pQ-udfszOyjXwVV6yR7cBa4fS_QAzk_0 2024-09-12T19:13:57.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1639009031580237643', time=2024-09-12T21:01:40.993432+0000, chain.objs.size()=1 2024-09-12T19:13:57.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.jq6OStccVK3g6_1XnfrAMXCVLElX_KU_0 2024-09-12T19:13:57.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14847803418278352737', time=2024-09-12T21:01:41.019532+0000, chain.objs.size()=1 2024-09-12T19:13:57.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-t6_umDHkPGbygiSuOM4-3P0SfE2Oxc_0 2024-09-12T19:13:57.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15370157118464662190', time=2024-09-12T21:01:41.041053+0000, chain.objs.size()=1 2024-09-12T19:13:57.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.CiuaEwKGUEa6BxynlZBsfq0sGFn4FH1_0 2024-09-12T19:13:57.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7434769526027329151', time=2024-09-12T21:01:41.052773+0000, chain.objs.size()=1 2024-09-12T19:13:57.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.G_dJp8gjTHwgefNcNjjOSa40Jx7rkyN_0 2024-09-12T19:13:57.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7446751753915634663', time=2024-09-12T21:01:41.060448+0000, chain.objs.size()=1 2024-09-12T19:13:57.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ZXk6RNH4m2mNSbjqQFLVTJUTHbSC1hu_0 2024-09-12T19:13:57.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10813283976765456117', time=2024-09-12T21:01:41.074436+0000, chain.objs.size()=1 2024-09-12T19:13:57.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.y_ugbQBzY7cMr08mBfUR9DOUFLJFpsQ_0 2024-09-12T19:13:57.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13540100356262562862', time=2024-09-12T21:02:00.565739+0000, chain.objs.size()=1 2024-09-12T19:13:57.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8xrfXxK7OqGg6x3QZ-44Y2qlYjjYqM0_0 2024-09-12T19:13:57.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3215343234518315823', time=2024-09-12T21:02:00.577825+0000, chain.objs.size()=1 2024-09-12T19:13:57.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.355MhRHXZONGZiDMWWsj4CZ0mIVXJ6v_0 2024-09-12T19:13:57.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15483411172721743116', time=2024-09-12T21:02:00.597278+0000, chain.objs.size()=1 2024-09-12T19:13:57.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.hXaI5EsKXo06_VWlYfuj_oenrejFOAB_0 2024-09-12T19:13:57.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15217145232963511680', time=2024-09-12T21:02:00.616029+0000, chain.objs.size()=1 2024-09-12T19:13:57.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.QsXzN4_q2SPxkuj5p1uugg7Hc5LoLLc_0 2024-09-12T19:13:57.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.457824062517790336', time=2024-09-12T21:02:00.772586+0000, chain.objs.size()=1 2024-09-12T19:13:57.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.792+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.V6s6VSwhFdsH_ZgJ3xE8NgHXXbiC1dz_0 2024-09-12T19:13:57.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.796+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13231261611601295040', time=2024-09-12T21:02:00.800118+0000, chain.objs.size()=1 2024-09-12T19:13:57.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.796+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ao5Bk6RCFzv0D01cCtC4gFoRpJyofFF_0 2024-09-12T19:13:57.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.796+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10055936515446992355', time=2024-09-12T21:02:00.815304+0000, chain.objs.size()=1 2024-09-12T19:13:57.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.796+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.tDqiQHUxigQ0-ZskbZ5EfYNozu1Aa8l_0 2024-09-12T19:13:57.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.796+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.285900925098785655', time=2024-09-12T21:02:00.834468+0000, chain.objs.size()=1 2024-09-12T19:13:57.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.796+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.QkD7KkcPVnaLrvsRdRUbokzDCY-wFEi_0 2024-09-12T19:13:57.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.796+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5009135558150970470', time=2024-09-12T21:02:00.840858+0000, chain.objs.size()=1 2024-09-12T19:13:57.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.796+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.O_LmmWHTK4DN-uI_lgvB2jkx9McP9rA_0 2024-09-12T19:13:57.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.796+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14660573191837001787', time=2024-09-12T21:02:01.034734+0000, chain.objs.size()=1 2024-09-12T19:13:57.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.796+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yH40cGb9ypqF2srUE9s6_IqBNzX9GCy_0 2024-09-12T19:13:57.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.796+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53570 2024-09-12T19:13:57.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=43, truncated=0, next_marker='' 2024-09-12T19:13:57.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12817681869554253094', time=2024-09-12T21:02:01.039975+0000, chain.objs.size()=1 2024-09-12T19:13:57.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.q8HZk-Zr8AiKdp5ZCGCSiwsdFjmekdr_0 2024-09-12T19:13:57.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9931424512189437833', time=2024-09-12T21:02:01.109874+0000, chain.objs.size()=1 2024-09-12T19:13:57.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.UVCOaLOCDBfiPebGyfTxDcH7rhGI_ik_0 2024-09-12T19:13:57.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3870860583775204149', time=2024-09-12T21:02:01.261117+0000, chain.objs.size()=1 2024-09-12T19:13:57.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.bhI5lFvYaT14J0zY39eV9vSIY-vRzmZ_0 2024-09-12T19:13:57.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16544866798130789749', time=2024-09-12T21:02:01.264647+0000, chain.objs.size()=1 2024-09-12T19:13:57.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.O8cnhJOeAEnUdAJffZcOLj6Zx8paNCy_0 2024-09-12T19:13:57.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8494862665478884998', time=2024-09-12T21:02:01.312102+0000, chain.objs.size()=1 2024-09-12T19:13:57.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jgJKohbCTNLCnTZLyEn9opMZ09ET6ch_0 2024-09-12T19:13:57.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3391618904380708464', time=2024-09-12T21:02:01.333568+0000, chain.objs.size()=1 2024-09-12T19:13:57.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.46GjfanJ0YguIQ8_8S51O_UmSEaUNxo_0 2024-09-12T19:13:57.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10064568402108348653', time=2024-09-12T21:02:01.334683+0000, chain.objs.size()=1 2024-09-12T19:13:57.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.z2JlzW2Vfvf_alpu-MR-4q0vjlQAWYV_0 2024-09-12T19:13:57.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13051917204393872334', time=2024-09-12T21:02:01.335375+0000, chain.objs.size()=1 2024-09-12T19:13:57.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.HUBCympiuXG4euaVqB3H7cZW06fGHxd_0 2024-09-12T19:13:57.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12206600028438442842', time=2024-09-12T21:02:01.450380+0000, chain.objs.size()=1 2024-09-12T19:13:57.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.pW_8PeKbhluWKCRKJiq8culmmmSoBUn_0 2024-09-12T19:13:57.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1170042510488852404', time=2024-09-12T21:02:01.503476+0000, chain.objs.size()=1 2024-09-12T19:13:57.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Mzusrk89rSMjhb-Raj3yPD7UAmYzU2j_0 2024-09-12T19:13:57.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2348008604007099057', time=2024-09-12T21:02:01.689004+0000, chain.objs.size()=1 2024-09-12T19:13:57.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.wyOAQ95U5zVCKPhfSSHmJiG7VtNnUIq_0 2024-09-12T19:13:57.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7913953839242207041', time=2024-09-12T21:02:01.707581+0000, chain.objs.size()=1 2024-09-12T19:13:57.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.OQTU91oHsI0hQHdPFjePEor5cRnfeu3_0 2024-09-12T19:13:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7298988123296885637', time=2024-09-12T21:02:01.913095+0000, chain.objs.size()=1 2024-09-12T19:13:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.HFCvmar3rAlwwqMyuTm5lEkjm8xPt_2_0 2024-09-12T19:13:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9943087797605431079', time=2024-09-12T21:02:01.968980+0000, chain.objs.size()=1 2024-09-12T19:13:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Iz6ZK8hXBv7gK8W71ao3MGtzEcqJEmV_0 2024-09-12T19:13:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15409838180862537930', time=2024-09-12T21:02:01.974319+0000, chain.objs.size()=1 2024-09-12T19:13:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.UclHc2oCAzdoz3d8ThmgX8cof0CoBRd_0 2024-09-12T19:13:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6731813127250602119', time=2024-09-12T21:02:01.988072+0000, chain.objs.size()=1 2024-09-12T19:13:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.h_Y7TpjpcYuGCZ7-f0yoyB9Gd0bWgmd_0 2024-09-12T19:13:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8262559982262062562', time=2024-09-12T21:02:02.001154+0000, chain.objs.size()=1 2024-09-12T19:13:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.RJEiTCs8lXXUE5WO4o2C7pg9T84yZQ1_0 2024-09-12T19:13:57.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7514432975201642873', time=2024-09-12T21:02:02.128025+0000, chain.objs.size()=1 2024-09-12T19:13:57.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.hACve6FrobZTt4RF6K6Kj35NmTZ6f3L_0 2024-09-12T19:13:57.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15904141625270113717', time=2024-09-12T21:02:02.154763+0000, chain.objs.size()=1 2024-09-12T19:13:57.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.UCHKTnUF4BM9gtAzbp9YgbcErBBrqjD_0 2024-09-12T19:13:57.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13034638798003056190', time=2024-09-12T21:02:02.172204+0000, chain.objs.size()=1 2024-09-12T19:13:57.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.KJhXekL5SqtscQu3ZUMdHvPi-flGtRE_0 2024-09-12T19:13:57.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16751442911254211605', time=2024-09-12T21:02:02.183093+0000, chain.objs.size()=1 2024-09-12T19:13:57.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.pEd88BLHv-tG1swGF0SQN7c0QiIpOlP_0 2024-09-12T19:13:57.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8717959883990842107', time=2024-09-12T21:02:40.831749+0000, chain.objs.size()=1 2024-09-12T19:13:57.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.382__shadow_.OgyMIeHojAznKjYDqlWrg4t0IrRlOJr_0 2024-09-12T19:13:57.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15822749725996094861', time=2024-09-12T21:03:18.660983+0000, chain.objs.size()=1 2024-09-12T19:13:57.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.800+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.433__shadow_.oJk-2ibQJ1q0ElzmL9xe3j5upKUutzU_0 2024-09-12T19:13:57.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9000580912320055113', time=2024-09-12T21:03:20.864213+0000, chain.objs.size()=1 2024-09-12T19:13:57.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.436__shadow_.QBgIjOv3CqsNre2KMpDmLIIJuFbmTWF_0 2024-09-12T19:13:57.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13654840373458181168', time=2024-09-12T21:03:24.468256+0000, chain.objs.size()=1 2024-09-12T19:13:57.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.441__shadow_._zDIomnqMlkPm7rdEkAguP_LIflJU6b_0 2024-09-12T19:13:57.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12874260859245151997', time=2024-09-12T21:03:25.964496+0000, chain.objs.size()=1 2024-09-12T19:13:57.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.443__shadow_.CD8OrjnROIqAOmXb5APTZpH-bY56aUD_0 2024-09-12T19:13:57.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10860761999123515867', time=2024-09-12T21:03:56.361462+0000, chain.objs.size()=1 2024-09-12T19:13:57.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.484__shadow_.4F6IrtB1g_4WvxUXy7SspcXzKqqGesr_0 2024-09-12T19:13:57.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17912271508771382968', time=2024-09-12T21:04:48.611780+0000, chain.objs.size()=3 2024-09-12T19:13:57.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.523__multipart_mymultipart.2~E-SN-txmJiyrq5mVwTKNCUwCSpMys1t.1 2024-09-12T19:13:57.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.523__multipart_mymultipart.2~E-SN-txmJiyrq5mVwTKNCUwCSpMys1t.2 2024-09-12T19:13:57.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.523__multipart_mymultipart.2~E-SN-txmJiyrq5mVwTKNCUwCSpMys1t.3 2024-09-12T19:13:57.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10591177307870015653', time=2024-09-12T21:04:52.529706+0000, chain.objs.size()=3 2024-09-12T19:13:57.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.525__multipart_mymultipart.2~rM2_wDXU7ARXVI2VyCFdFJ2qethm2JW.1 2024-09-12T19:13:57.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.525__multipart_mymultipart.2~rM2_wDXU7ARXVI2VyCFdFJ2qethm2JW.2 2024-09-12T19:13:57.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.525__multipart_mymultipart.2~rM2_wDXU7ARXVI2VyCFdFJ2qethm2JW.3 2024-09-12T19:13:57.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11185257353538375685', time=2024-09-12T21:05:44.465130+0000, chain.objs.size()=1 2024-09-12T19:13:57.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.553__shadow_.-0y4bws7-UrFioxZ4dZxwIs6oXdZCtK_0 2024-09-12T19:13:57.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9198558223174082783', time=2024-09-12T21:05:45.384142+0000, chain.objs.size()=1 2024-09-12T19:13:57.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.554__shadow_.zbF9aVo9i6zwEumvI0o5o3ZspwgJVZZ_0 2024-09-12T19:13:57.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~GBnNmBWNGgvpPBbpnF8v3vFoGyqcPcb', time=2024-09-12T21:05:52.949344+0000, chain.objs.size()=1 2024-09-12T19:13:57.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.561__multipart_mymultipart.2~GBnNmBWNGgvpPBbpnF8v3vFoGyqcPcb.1 2024-09-12T19:13:57.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6860320703278746488', time=2024-09-12T21:06:06.391782+0000, chain.objs.size()=1 2024-09-12T19:13:57.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:AxfzyCK3K59-ruIwyJ7hF9Dit38W5Ju_.z8gHn_vhJoyrAiZRgi0DiZULZNfG4V4_0 2024-09-12T19:13:57.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9119837438651167906', time=2024-09-12T21:06:10.003160+0000, chain.objs.size()=1 2024-09-12T19:13:57.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:ZT-auqtFmpEN7pVN2A2Ogf8xCWWGQnM_.TJAZeRYQoiplBkhypaIWle3Df_Rc8lG_0 2024-09-12T19:13:57.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9627074945425415973', time=2024-09-12T21:06:15.369160+0000, chain.objs.size()=1 2024-09-12T19:13:57.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.573__shadow_.gAB7gOfWyfnLpXQ7KQRUo9XNXGl6Rfd_0 2024-09-12T19:13:57.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11656628725094698339', time=2024-09-12T21:06:16.577119+0000, chain.objs.size()=1 2024-09-12T19:13:57.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.574__shadow_.azZVhVYa88UQTAa110o5BAick_9Oh1n_0 2024-09-12T19:13:57.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17059546012455250235', time=2024-09-12T21:06:22.958135+0000, chain.objs.size()=1 2024-09-12T19:13:57.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.576__shadow:AvVChAVfTpsI876Ucnvi-Ga0Uy1IFzu_.nGQ2idH4EHOjYjf51ePFDj4dBkR38ag_0 2024-09-12T19:13:57.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10577016640489566128', time=2024-09-12T21:06:28.599198+0000, chain.objs.size()=1 2024-09-12T19:13:57.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.804+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:kjRHgqry33k6mP0Bo1eK4BDLTD9MJYw_.ggF1nI9jjsdEeoHmHQOR_U6joQPkgMl_0 2024-09-12T19:13:57.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.808+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6912271286175530080', time=2024-09-12T21:06:46.408734+0000, chain.objs.size()=1 2024-09-12T19:13:57.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.808+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.579__shadow:uSkH9cY69RkAOZhyOlRCRVvGq18jKVU_.natzuzTwmTLtUAr9iU-GscSUyf6HE4M_0 2024-09-12T19:13:57.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.808+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4458073425509556033', time=2024-09-12T21:06:48.239157+0000, chain.objs.size()=1 2024-09-12T19:13:57.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.808+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.580__shadow:.abm629bZ7ep2z837Zi-5YuMG53mXIa_.i1dJDUU169PNEZ1pTvFndQH-IsLZdr6_0 2024-09-12T19:13:57.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.808+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3365765524385541428', time=2024-09-12T21:09:49.376856+0000, chain.objs.size()=1 2024-09-12T19:13:57.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.808+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.644__shadow_.LeL5NYwlhZwKO4QarTYVmRFaTGxcwCM_0 2024-09-12T19:13:57.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.808+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18416013969295640515', time=2024-09-12T21:10:09.224738+0000, chain.objs.size()=1 2024-09-12T19:13:57.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.808+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.666__shadow_.w3GfZ0h9GrSoFPmWA3jcU9jxo8HniWM_0 2024-09-12T19:13:57.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.808+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5509691465160345466', time=2024-09-12T21:10:17.101413+0000, chain.objs.size()=1 2024-09-12T19:13:57.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.808+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.679__shadow_.8GfskPWqdVYTayEPRDfi75eXa3OZi9V_0 2024-09-12T19:13:57.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.812+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.812+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T19:13:57.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.812+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/55544' 2024-09-12T19:13:57.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_q34CNLOjRm9OYSXgi9OQqTx-ixFPjkR', time=2024-09-12T20:57:33.873654+0000, chain.objs.size()=3 2024-09-12T19:13:57.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.f2aEEzOluaZs8P_JTqwpvq6zvD6_Tus_0 2024-09-12T19:13:57.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.f2aEEzOluaZs8P_JTqwpvq6zvD6_Tus_1 2024-09-12T19:13:57.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.f2aEEzOluaZs8P_JTqwpvq6zvD6_Tus_2 2024-09-12T19:13:57.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3121723422566632378', time=2024-09-12T20:57:35.400604+0000, chain.objs.size()=5 2024-09-12T19:13:57.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__multipart_foo-LUKEWARM.2~L0MoDnsrjm3s997KQotBSEUPOg1deKm.1 2024-09-12T19:13:57.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_foo-LUKEWARM.2~L0MoDnsrjm3s997KQotBSEUPOg1deKm.1_1 2024-09-12T19:13:57.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__multipart_foo-LUKEWARM.2~L0MoDnsrjm3s997KQotBSEUPOg1deKm.2 2024-09-12T19:13:57.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_foo-LUKEWARM.2~L0MoDnsrjm3s997KQotBSEUPOg1deKm.2_1 2024-09-12T19:13:57.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__multipart_foo-LUKEWARM.2~L0MoDnsrjm3s997KQotBSEUPOg1deKm.3 2024-09-12T19:13:57.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_OpWAsvExH2TbISf8RirTtvqd5YQHcyj', time=2024-09-12T20:57:36.592830+0000, chain.objs.size()=1 2024-09-12T19:13:57.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_.PBQ3n7qXQeNqZMFqvwla8DgCsJEyu67_0 2024-09-12T19:13:57.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_z2lWTfnYJhPszBi7-LaN9t1jvw7XVvv', time=2024-09-12T20:57:38.737972+0000, chain.objs.size()=1 2024-09-12T19:13:57.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.165__shadow_.xqiP26pIJoIiRtQ-7FLXo4kChWht7LX_0 2024-09-12T19:13:57.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15376740611818806796', time=2024-09-12T20:59:50.807489+0000, chain.objs.size()=1 2024-09-12T19:13:57.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.234__shadow_.mnwvoFIvLPEn3c85j_9_pND-b1oZNDq_0 2024-09-12T19:13:57.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7772379380091906408', time=2024-09-12T20:59:57.654105+0000, chain.objs.size()=1 2024-09-12T19:13:57.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.816+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.242__shadow_.WAkP-7HXJRVJrnQlU-HprOKuKSVAL1C_0 2024-09-12T19:13:57.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14348821167388530182', time=2024-09-12T21:00:02.970702+0000, chain.objs.size()=1 2024-09-12T19:13:57.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.248__shadow_.n00boihbOjaI__R1tmY0r2DkUyIWCyC_0 2024-09-12T19:13:57.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1340876646133055849', time=2024-09-12T21:00:08.096186+0000, chain.objs.size()=1 2024-09-12T19:13:57.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.255__shadow_.MKFplCvvCFcEmh3QvG3oUTBrhC1-pI-_0 2024-09-12T19:13:57.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17018582963154381220', time=2024-09-12T21:00:08.098233+0000, chain.objs.size()=1 2024-09-12T19:13:57.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.255__shadow_.bBDkGviXO8fSxFyiwqH2I9FKR7jqQHT_0 2024-09-12T19:13:57.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9846548720782798146', time=2024-09-12T21:00:32.065273+0000, chain.objs.size()=1 2024-09-12T19:13:57.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LMSiAh3bp77fmeTYpm2pKI926746nh2_0 2024-09-12T19:13:57.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14274403050348501411', time=2024-09-12T21:00:32.089442+0000, chain.objs.size()=1 2024-09-12T19:13:57.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.HHS_OZbMS1MgwGsoktcWma4d9YpzZ3b_0 2024-09-12T19:13:57.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6328955908653555932', time=2024-09-12T21:00:32.104456+0000, chain.objs.size()=1 2024-09-12T19:13:57.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Y-cMOUT-XjuTGxuuntZ1MZycoeiLSY-_0 2024-09-12T19:13:57.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14828465148780405428', time=2024-09-12T21:00:32.249315+0000, chain.objs.size()=1 2024-09-12T19:13:57.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2rzL-5zzz_PIa0u4CESgVQRFivDPaDO_0 2024-09-12T19:13:57.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14415148185626311633', time=2024-09-12T21:00:32.295192+0000, chain.objs.size()=1 2024-09-12T19:13:57.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tNMJv_OjYw9jzsMW7JN4d1DWTJ_B4dy_0 2024-09-12T19:13:57.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16205229716523448762', time=2024-09-12T21:00:32.329854+0000, chain.objs.size()=1 2024-09-12T19:13:57.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.W2LfZIlPPP35RS9m4gBMGWeDo4Ock1E_0 2024-09-12T19:13:57.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15843003131337134008', time=2024-09-12T21:00:32.334567+0000, chain.objs.size()=1 2024-09-12T19:13:57.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Yq0kGief0DolGyYprTY_TEVJgmHhkkK_0 2024-09-12T19:13:57.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10427732948920086988', time=2024-09-12T21:00:32.443314+0000, chain.objs.size()=1 2024-09-12T19:13:57.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.8J4tHoPjPaKA5FlmfxHRhpepfnOFKOF_0 2024-09-12T19:13:57.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9463325793883659859', time=2024-09-12T21:00:32.466669+0000, chain.objs.size()=1 2024-09-12T19:13:57.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.om54_D5C7-3xVk_AYdscXaiHTqB5niy_0 2024-09-12T19:13:57.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12724211852201684564', time=2024-09-12T21:00:32.491955+0000, chain.objs.size()=1 2024-09-12T19:13:57.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.773lZNtRDyAeX3eLwXxvZVQM9z-IHks_0 2024-09-12T19:13:57.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10368240297186886862', time=2024-09-12T21:00:32.547702+0000, chain.objs.size()=1 2024-09-12T19:13:57.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-LZEcmZcbsuaQIyK_Z7U53im60EHweI_0 2024-09-12T19:13:57.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18304651654630226290', time=2024-09-12T21:00:32.566562+0000, chain.objs.size()=1 2024-09-12T19:13:57.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.k38oUD_5OVWKPX5qddQWCfCatsiybF9_0 2024-09-12T19:13:57.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8809038395446271358', time=2024-09-12T21:00:32.699246+0000, chain.objs.size()=1 2024-09-12T19:13:57.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.HynNvlUgIif2C0hRPguvgMmyVhW19pQ_0 2024-09-12T19:13:57.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8427438643879648045', time=2024-09-12T21:00:32.719514+0000, chain.objs.size()=1 2024-09-12T19:13:57.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.eijZk09_mCVjeiQvTCmlutybh4IKgrJ_0 2024-09-12T19:13:57.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15861299783657809138', time=2024-09-12T21:00:32.907532+0000, chain.objs.size()=1 2024-09-12T19:13:57.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CsQc9MnoEWB6zujV0IK9Q70gj9CSH4T_0 2024-09-12T19:13:57.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7135413232826905467', time=2024-09-12T21:00:32.925349+0000, chain.objs.size()=1 2024-09-12T19:13:57.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7IJc676BPUcbAi9qn3tw6bnbs_G57Wk_0 2024-09-12T19:13:57.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3119225404942042011', time=2024-09-12T21:00:32.939044+0000, chain.objs.size()=1 2024-09-12T19:13:57.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Ddc3g0UzZLhcTXOUqFMSJOG99E9d6eA_0 2024-09-12T19:13:57.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1993821472384637426', time=2024-09-12T21:00:32.946230+0000, chain.objs.size()=1 2024-09-12T19:13:57.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.I6Pjc8_N68NhvkRakWQ26feI9zELdUu_0 2024-09-12T19:13:57.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7075456622210819697', time=2024-09-12T21:00:32.964803+0000, chain.objs.size()=1 2024-09-12T19:13:57.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.4W0ieaieGPFolS58kWbY4ulwOScAaIZ_0 2024-09-12T19:13:57.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.942790061137626710', time=2024-09-12T21:00:33.102309+0000, chain.objs.size()=1 2024-09-12T19:13:57.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.820+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JRU37I4WmxvGeNxKoemDGYXV7Q9uA-I_0 2024-09-12T19:13:57.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2517825047776577196', time=2024-09-12T21:00:33.166589+0000, chain.objs.size()=1 2024-09-12T19:13:57.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.lpR2YgLupQjznLpLJTQk-A_OwGD5T2Z_0 2024-09-12T19:13:57.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10416209976888691856', time=2024-09-12T21:00:33.173292+0000, chain.objs.size()=1 2024-09-12T19:13:57.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LVhX4ubT1G5dop1xhFqdntPVA2IyoIm_0 2024-09-12T19:13:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15657612331376414679', time=2024-09-12T21:00:33.216002+0000, chain.objs.size()=1 2024-09-12T19:13:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.dRdZn_L1ZrSek6BGXQCXc_nC8qXAUNh_0 2024-09-12T19:13:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11511176002533570243', time=2024-09-12T21:00:33.419653+0000, chain.objs.size()=1 2024-09-12T19:13:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.xQEy5InRhq2XCiB-6XmnSGDNWn0e-DS_0 2024-09-12T19:13:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15964516893247045902', time=2024-09-12T21:00:33.433954+0000, chain.objs.size()=1 2024-09-12T19:13:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3gifjA6kMJCb-UiNhbs5dAVHgohHhKK_0 2024-09-12T19:13:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7219440452314494504', time=2024-09-12T21:00:33.441352+0000, chain.objs.size()=1 2024-09-12T19:13:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Jb86suQiVYz5KBq-qyiivD9Wx7CVlUZ_0 2024-09-12T19:13:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3708386699607523873', time=2024-09-12T21:00:33.445973+0000, chain.objs.size()=1 2024-09-12T19:13:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.vqOa53eKUHsJc8K5dd7jUoeP3x4_lr1_0 2024-09-12T19:13:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16065236762606856285', time=2024-09-12T21:00:33.447152+0000, chain.objs.size()=1 2024-09-12T19:13:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.92EPZxfsKZGlNm76E1vMOmjw6Kdyirm_0 2024-09-12T19:13:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7531061874375416461', time=2024-09-12T21:00:33.472297+0000, chain.objs.size()=1 2024-09-12T19:13:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JuFDciVsG-2opTA9_R3I5I0j1k1FUBb_0 2024-09-12T19:13:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12072814922801721693', time=2024-09-12T21:00:33.589613+0000, chain.objs.size()=1 2024-09-12T19:13:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DqPVgHnqOQqpiDzYoxSwUXugo0XaxOo_0 2024-09-12T19:13:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12211807845887314336', time=2024-09-12T21:00:33.636995+0000, chain.objs.size()=1 2024-09-12T19:13:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LO3xhLFmvBJHihUO4R_I5C69gBIPJHz_0 2024-09-12T19:13:57.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15225019612462543599', time=2024-09-12T21:00:33.655823+0000, chain.objs.size()=1 2024-09-12T19:13:57.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SUYq_vPsKwwlaCxkxO_zqhuaiHzojPC_0 2024-09-12T19:13:57.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11024754267044072464', time=2024-09-12T21:00:33.856421+0000, chain.objs.size()=1 2024-09-12T19:13:57.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.824+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.inKCgsTCrbz8WZRiq01SuPcEq4p4CcS_0 2024-09-12T19:13:57.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6454466959186902814', time=2024-09-12T21:00:33.905755+0000, chain.objs.size()=1 2024-09-12T19:13:57.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.uQ4QHmoNkjoX-caIEnWnrQFlWZmFgTP_0 2024-09-12T19:13:57.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5931875569355454415', time=2024-09-12T21:00:36.002567+0000, chain.objs.size()=1 2024-09-12T19:13:57.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.265__shadow_.B70BEE8HWMz6yrTB5S1Mxl9QiooQMjb_0 2024-09-12T19:13:57.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6884272469475163929', time=2024-09-12T21:00:43.221725+0000, chain.objs.size()=1 2024-09-12T19:13:57.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.275__shadow_._KlrTASx1vWrOCKMojmjjD_vf-K5SaD_0 2024-09-12T19:13:57.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10417668118958860621', time=2024-09-12T21:00:43.991875+0000, chain.objs.size()=1 2024-09-12T19:13:57.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.276__shadow_.pxFx90bdQENF0EkitDbDpxFyz9S_q9K_0 2024-09-12T19:13:57.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17926014541001218512', time=2024-09-12T21:00:46.181979+0000, chain.objs.size()=1 2024-09-12T19:13:57.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.279__shadow_.Jb5xK-Dzi3wkFb0Gs-agfP_-vkYeHoH_0 2024-09-12T19:13:57.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1610073930452301704', time=2024-09-12T21:00:58.122569+0000, chain.objs.size()=1 2024-09-12T19:13:57.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.lTgMHDwHYf1M8ZTgGvvJ0bxMRv-IWZK_0 2024-09-12T19:13:57.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.725305861197565818', time=2024-09-12T21:01:39.405672+0000, chain.objs.size()=1 2024-09-12T19:13:57.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0oldwnsoHk3bbtIx18HFQ-gV8D6O159_0 2024-09-12T19:13:57.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16330028030983915409', time=2024-09-12T21:01:39.514052+0000, chain.objs.size()=1 2024-09-12T19:13:57.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.l4E-RSw6dDhyXZq_TDM5KmD6Ivw7JIc_0 2024-09-12T19:13:57.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15256062476695214868', time=2024-09-12T21:01:39.521928+0000, chain.objs.size()=1 2024-09-12T19:13:57.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.cJwGQ0vllhWlDxw43xr7OD7KddmlofT_0 2024-09-12T19:13:57.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9430322525879837667', time=2024-09-12T21:01:39.689616+0000, chain.objs.size()=1 2024-09-12T19:13:57.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9eaa74xiCZPMiMGLWaqzuYUc97XdeYE_0 2024-09-12T19:13:57.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11833708992509382355', time=2024-09-12T21:01:39.715064+0000, chain.objs.size()=1 2024-09-12T19:13:57.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.cAi-k5d5CPFuWEqa-l6b_MO1TG3q0cO_0 2024-09-12T19:13:57.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6089363082025975651', time=2024-09-12T21:01:39.802329+0000, chain.objs.size()=1 2024-09-12T19:13:57.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.D5ha5EbnGd_MaOzdhQ0HkEexRjpBlIJ_0 2024-09-12T19:13:57.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13911727188739881368', time=2024-09-12T21:01:39.803066+0000, chain.objs.size()=1 2024-09-12T19:13:57.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.EJFj4OSNZSzLMRuy9xtNPbfeQgXisHi_0 2024-09-12T19:13:57.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13689042097039876294', time=2024-09-12T21:01:39.999255+0000, chain.objs.size()=1 2024-09-12T19:13:57.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Wip4oxBQWZj3ER410G3MImyfQgewCwF_0 2024-09-12T19:13:57.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6754694413863659061', time=2024-09-12T21:01:40.138226+0000, chain.objs.size()=1 2024-09-12T19:13:57.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.qlOfh9y-c_dv1xuK-SDcSh1DIXO7CXQ_0 2024-09-12T19:13:57.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10344303361628597839', time=2024-09-12T21:01:40.141185+0000, chain.objs.size()=1 2024-09-12T19:13:57.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.z1JNOctk2lH4gCL38BzgjfsbZlZLD0-_0 2024-09-12T19:13:57.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7592776050902365945', time=2024-09-12T21:01:40.181162+0000, chain.objs.size()=1 2024-09-12T19:13:57.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.FGMx9XNGmRSBlJQ-_PRMA1RnVyLYFfn_0 2024-09-12T19:13:57.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11566777349085691837', time=2024-09-12T21:01:40.202365+0000, chain.objs.size()=1 2024-09-12T19:13:57.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.JOY6ZYeJT1-1zsW8q4JPatvGb9aFGgy_0 2024-09-12T19:13:57.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15119693839965864892', time=2024-09-12T21:01:40.227894+0000, chain.objs.size()=1 2024-09-12T19:13:57.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.EH7tseo7t271I_Xbw3LVrEePxPwYIFW_0 2024-09-12T19:13:57.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14649421945691536402', time=2024-09-12T21:01:40.337929+0000, chain.objs.size()=1 2024-09-12T19:13:57.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.N2rHLNQ76sg4Kpl45uuV89dg9FJddla_0 2024-09-12T19:13:57.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11447653639215095735', time=2024-09-12T21:01:40.356146+0000, chain.objs.size()=1 2024-09-12T19:13:57.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.bCcnqDfB8XG6CupKQCDLHjIjOFcushg_0 2024-09-12T19:13:57.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.683271636523172726', time=2024-09-12T21:01:40.428253+0000, chain.objs.size()=1 2024-09-12T19:13:57.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.oCCBclqws05fgdniM8_yMMjBWHV4Ylv_0 2024-09-12T19:13:57.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14862837428995595073', time=2024-09-12T21:01:40.633308+0000, chain.objs.size()=1 2024-09-12T19:13:57.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.828+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.TfY0sll2lbpxSvmvb2i-UAllskq38WS_0 2024-09-12T19:13:57.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8066800508943489643', time=2024-09-12T21:01:40.671731+0000, chain.objs.size()=1 2024-09-12T19:13:57.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.LMxcbW_80e7mouo33G4srn8dR1x75Fy_0 2024-09-12T19:13:57.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1342491381788773727', time=2024-09-12T21:01:40.824010+0000, chain.objs.size()=1 2024-09-12T19:13:57.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.lHO757LEzTM0EWrisrcGZr3Q9XuGOs0_0 2024-09-12T19:13:57.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7967323095298350517', time=2024-09-12T21:01:40.827631+0000, chain.objs.size()=1 2024-09-12T19:13:57.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-mrz8r1HjmTFf9zR3n0ApUrSqlB9zUn_0 2024-09-12T19:13:57.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11111255922453777475', time=2024-09-12T21:01:40.836989+0000, chain.objs.size()=1 2024-09-12T19:13:57.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.j5nRHeu-bFABdWVafvJ3MY6xUGJN4WD_0 2024-09-12T19:13:57.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8145795037496665689', time=2024-09-12T21:01:40.862599+0000, chain.objs.size()=1 2024-09-12T19:13:57.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Png3PC_g5NeC_SFs2eNSHlWxFsy4g3l_0 2024-09-12T19:13:57.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16042258497020859122', time=2024-09-12T21:01:40.869040+0000, chain.objs.size()=1 2024-09-12T19:13:57.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.L_fmxigjINFMq-rniORoiyIKz8w8n-b_0 2024-09-12T19:13:57.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18259501024543247892', time=2024-09-12T21:01:41.050169+0000, chain.objs.size()=1 2024-09-12T19:13:57.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.vwDFX6eAkCm1ywMl-9URoENg7yXNTd5_0 2024-09-12T19:13:57.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9591653974166445161', time=2024-09-12T21:01:41.079003+0000, chain.objs.size()=1 2024-09-12T19:13:57.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.IQvGacmU_Q1vw8J_idCjSg0GU5QqiZH_0 2024-09-12T19:13:57.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16513600988991073026', time=2024-09-12T21:01:41.084329+0000, chain.objs.size()=1 2024-09-12T19:13:57.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.2Z3URXqHeBAMvNmOpG5nTw4tqLctUTi_0 2024-09-12T19:13:57.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16572255716112468476', time=2024-09-12T21:01:41.096316+0000, chain.objs.size()=1 2024-09-12T19:13:57.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BY9hPLEEOlgjkGr_eiGO1rMRbk7Glz__0 2024-09-12T19:13:57.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4460842880748921047', time=2024-09-12T21:02:00.547929+0000, chain.objs.size()=1 2024-09-12T19:13:57.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.6K_Tn8s8UsSMzRht-8dONfzUCOkfT_L_0 2024-09-12T19:13:57.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18329202498290548488', time=2024-09-12T21:02:00.568125+0000, chain.objs.size()=1 2024-09-12T19:13:57.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ntLVR3vcqHinaBgKZhwOKGCm_6tmBi9_0 2024-09-12T19:13:57.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14747434158432534558', time=2024-09-12T21:02:00.574526+0000, chain.objs.size()=1 2024-09-12T19:13:57.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._9Ctv1GZb7OfQZLzMh3QA_AeM1TPUf7_0 2024-09-12T19:13:57.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13612362657727703169', time=2024-09-12T21:02:00.612421+0000, chain.objs.size()=1 2024-09-12T19:13:57.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ZBt4JPB4Q2wfaSIPKgV8HArqe98P-WW_0 2024-09-12T19:13:57.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16518192162422334223', time=2024-09-12T21:02:00.641331+0000, chain.objs.size()=1 2024-09-12T19:13:57.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ZJfAmd1tsZVGgWf8nohDVJGcpXZRnb2_0 2024-09-12T19:13:57.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11582148021301467336', time=2024-09-12T21:02:00.857696+0000, chain.objs.size()=1 2024-09-12T19:13:57.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0_kvS757ImC_bDNZfrA5fb27o4AwdM8_0 2024-09-12T19:13:57.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.832+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13862942934198697167', time=2024-09-12T21:02:00.898821+0000, chain.objs.size()=1 2024-09-12T19:13:57.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.kYfVdSkDiD81X55iI6gBPCz6VIJWGXQ_0 2024-09-12T19:13:57.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14170846882650209130', time=2024-09-12T21:02:01.035837+0000, chain.objs.size()=1 2024-09-12T19:13:57.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.VRmUQuPTSMLvldNL9KF6DoACeGkyNOX_0 2024-09-12T19:13:57.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9525131563452430246', time=2024-09-12T21:02:01.047022+0000, chain.objs.size()=1 2024-09-12T19:13:57.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ttivT9kBG-g_YCS0tGSy_jdr1pPfPxq_0 2024-09-12T19:13:57.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9392618667149156669', time=2024-09-12T21:02:01.074424+0000, chain.objs.size()=1 2024-09-12T19:13:57.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.s-qoqBvFZiyZE5iPKAkt8gtcHMGtUZi_0 2024-09-12T19:13:57.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5138243633288319482', time=2024-09-12T21:02:01.077798+0000, chain.objs.size()=1 2024-09-12T19:13:57.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.cxyx3YcHRDjy5T_gUcZ79Gwya0Ws0CG_0 2024-09-12T19:13:57.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5804499869948655427', time=2024-09-12T21:02:01.081658+0000, chain.objs.size()=1 2024-09-12T19:13:57.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.OuXQnveG2cLGhvkkQp8K1oEXDyaixDP_0 2024-09-12T19:13:57.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18216157606282605662', time=2024-09-12T21:02:01.099610+0000, chain.objs.size()=1 2024-09-12T19:13:57.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.SYyUw5Ekfc5Cz-inkR1nm-RLCIj7hM0_0 2024-09-12T19:13:57.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1681554307674967022', time=2024-09-12T21:02:01.107830+0000, chain.objs.size()=1 2024-09-12T19:13:57.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1nvFrvrzDGPgwrIrZAnaaL-qKfUw13i_0 2024-09-12T19:13:57.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8839469245672308998', time=2024-09-12T21:02:01.232227+0000, chain.objs.size()=1 2024-09-12T19:13:57.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.CpAhBHFXRNnpqcWtAG0s09nLRyRojo4_0 2024-09-12T19:13:57.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10461298758962607048', time=2024-09-12T21:02:01.293232+0000, chain.objs.size()=1 2024-09-12T19:13:57.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.FWdAZyBWp4evccEsPvfuc-Npi3mW_TB_0 2024-09-12T19:13:57.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9003459351059909424', time=2024-09-12T21:02:01.319623+0000, chain.objs.size()=1 2024-09-12T19:13:57.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.X_KovpO--weYMyGcGyrV4NzgZPNB7Se_0 2024-09-12T19:13:57.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5445973110213011107', time=2024-09-12T21:02:01.335470+0000, chain.objs.size()=1 2024-09-12T19:13:57.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.4_DTXVRZhlfVyUQVVYiTl7LE-LWiT4q_0 2024-09-12T19:13:57.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1794258262510974762', time=2024-09-12T21:02:01.342790+0000, chain.objs.size()=1 2024-09-12T19:13:57.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.U_coB2vxvMnWPuHKOl33K8z9-wXYhJg_0 2024-09-12T19:13:57.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6164595587072844218', time=2024-09-12T21:02:01.463622+0000, chain.objs.size()=1 2024-09-12T19:13:57.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.epeOMMdMhqvhTSkb55t42HOyGyDDlaz_0 2024-09-12T19:13:57.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12834726503340739758', time=2024-09-12T21:02:01.483891+0000, chain.objs.size()=1 2024-09-12T19:13:57.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.zKqZwswwN5F39OijKk5B-oeBVC3keRB_0 2024-09-12T19:13:57.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8024160717058822828', time=2024-09-12T21:02:01.531073+0000, chain.objs.size()=1 2024-09-12T19:13:57.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Wb2J2DeIRHNQ_NG-IucF2lPokEKJU2b_0 2024-09-12T19:13:57.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10794113910240490033', time=2024-09-12T21:02:01.666940+0000, chain.objs.size()=1 2024-09-12T19:13:57.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.UnVRY-SogrI4rlpLnzuCJBSb9aBJPgv_0 2024-09-12T19:13:57.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16058224774192306877', time=2024-09-12T21:02:01.717552+0000, chain.objs.size()=1 2024-09-12T19:13:57.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.836+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.rrVLD6siineJ3spbhosa-qQTLoEzFsp_0 2024-09-12T19:13:57.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15715937019890657212', time=2024-09-12T21:02:01.887389+0000, chain.objs.size()=1 2024-09-12T19:13:57.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0LGxfElWnWLInIKLXa5ZtRL1Flu6vqX_0 2024-09-12T19:13:57.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/55544 2024-09-12T19:13:57.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T19:13:57.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10740873003843937814', time=2024-09-12T21:02:01.910366+0000, chain.objs.size()=1 2024-09-12T19:13:57.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2jAnPDyV48dgvAu4V_ZX9FHA4r5P01b_0 2024-09-12T19:13:57.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11881053783939321179', time=2024-09-12T21:02:01.931598+0000, chain.objs.size()=1 2024-09-12T19:13:57.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.tcYyZmGF1yLco-EwhJTZD2GnLxTQ42Z_0 2024-09-12T19:13:57.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13463095916379299558', time=2024-09-12T21:02:01.944417+0000, chain.objs.size()=1 2024-09-12T19:13:57.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.sKsPGC1tR8KM4TxNs8IQh9PGMoLLwMs_0 2024-09-12T19:13:57.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.698111627016971065', time=2024-09-12T21:02:01.948399+0000, chain.objs.size()=1 2024-09-12T19:13:57.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.n7LcZS9TPAMnSDNv185o3cmgct08rtI_0 2024-09-12T19:13:57.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8172133905066776500', time=2024-09-12T21:02:01.979071+0000, chain.objs.size()=1 2024-09-12T19:13:57.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.m3R2mjsh3OKAdRNXrpl4994i5gO3-hg_0 2024-09-12T19:13:57.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13763340160214580553', time=2024-09-12T21:02:02.123618+0000, chain.objs.size()=1 2024-09-12T19:13:57.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.RJ5rcpW7g0ifA1Nq_-Xgt0RoQVqsLPr_0 2024-09-12T19:13:57.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10822050159515158029', time=2024-09-12T21:02:02.168950+0000, chain.objs.size()=1 2024-09-12T19:13:57.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.cTtOMHtU5M0MlaT0onUKLXNBNu2BPyY_0 2024-09-12T19:13:57.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8963524159900927023', time=2024-09-12T21:02:02.171176+0000, chain.objs.size()=1 2024-09-12T19:13:57.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.SqvqtBvnVznRaOKE0lQx8qiMoNBjKs4_0 2024-09-12T19:13:57.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.721645178237635409', time=2024-09-12T21:02:02.182623+0000, chain.objs.size()=1 2024-09-12T19:13:57.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qK3-iPCLIBWckJo0rbEHF-TDNw_Mb9d_0 2024-09-12T19:13:57.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2360740371831048318', time=2024-09-12T21:02:02.200364+0000, chain.objs.size()=1 2024-09-12T19:13:57.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5OUIIxTYp66GUA4jLRL7Pfxtf7nN5gW_0 2024-09-12T19:13:57.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11263108166300225767', time=2024-09-12T21:03:32.869256+0000, chain.objs.size()=1 2024-09-12T19:13:57.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.451__shadow_.gnlSyBBlfv-r57-YCPKIcIZeyQI0qz3_0 2024-09-12T19:13:57.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16416228327655034124', time=2024-09-12T21:04:21.532144+0000, chain.objs.size()=2 2024-09-12T19:13:57.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.840+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.517__shadow_.oSE3XIjctrDCt3IQis7Wjbd6iFJdWOA_0 2024-09-12T19:13:57.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.517__shadow_.oSE3XIjctrDCt3IQis7Wjbd6iFJdWOA_1 2024-09-12T19:13:57.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9415474825859413058', time=2024-09-12T21:04:46.668947+0000, chain.objs.size()=6 2024-09-12T19:13:57.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.ePZsYI3NReIQfQ-i2WpaALTaAUnGJjD1.1 2024-09-12T19:13:57.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.iuSyPCNulANwQKSKQ5Hk1Mg8Ci31250A.2 2024-09-12T19:13:57.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.m2CG1_DG6zeJiBV1J4gf3J_So1vNOq20.3 2024-09-12T19:13:57.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.gLiL9T78RLdjE5KlLOSHFoR4acepvHTj.4 2024-09-12T19:13:57.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.uEOMWcnzOUTavwb63eLqj0_Wg8MQcP5I.5 2024-09-12T19:13:57.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.rsYpOAJqpXijSyqm2LXyVZblOBnfZg5v.6 2024-09-12T19:13:57.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~L3YLGELcqLrqvr07B5YLPRrpPdVZ6YK', time=2024-09-12T21:05:02.284084+0000, chain.objs.size()=1 2024-09-12T19:13:57.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.534__multipart_mymultipart.2~L3YLGELcqLrqvr07B5YLPRrpPdVZ6YK.1 2024-09-12T19:13:57.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17244829673618369394', time=2024-09-12T21:05:47.125310+0000, chain.objs.size()=2 2024-09-12T19:13:57.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.555__shadow_.h3GdBzVQ3ZoYmCxoUzpZwl87wnur5Vi_0 2024-09-12T19:13:57.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.555__shadow_.h3GdBzVQ3ZoYmCxoUzpZwl87wnur5Vi_1 2024-09-12T19:13:57.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1487107176178307339', time=2024-09-12T21:06:00.540301+0000, chain.objs.size()=1 2024-09-12T19:13:57.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.844+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.565__shadow_.MYJxy2WxovCz8IsQFFmgM_ZB8uvVSVm_0 2024-09-12T19:13:57.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.848+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11607966878079351944', time=2024-09-12T21:06:04.402214+0000, chain.objs.size()=1 2024-09-12T19:13:57.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.848+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:jUHHJ7p.bfgqTzXcA8OFW9oIDZZDAGc_.Qybke-T1xDX2Wki_pl6HN6-Rj75LPJB_0 2024-09-12T19:13:57.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.848+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12405393883389765120', time=2024-09-12T21:06:24.087994+0000, chain.objs.size()=1 2024-09-12T19:13:57.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.848+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.576__shadow:gk1dH0TfARS0BF-.2cIP8YGW.buIU4S_.XnvopeAtT7xA8lJISTX6BS8Ylh0DMy1_0 2024-09-12T19:13:57.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.848+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4646554777124923808', time=2024-09-12T21:09:36.541424+0000, chain.objs.size()=1 2024-09-12T19:13:57.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.848+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.626__shadow_.NIfp86cIXQm36s7_yI60P0iSHdDjrub_0 2024-09-12T19:13:57.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.848+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13025984669679508171', time=2024-09-12T21:10:07.189893+0000, chain.objs.size()=1 2024-09-12T19:13:57.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.848+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.664__shadow_._V4cDDpij9Bls3KgQjL-_2T1TrPIhW9_0 2024-09-12T19:13:57.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.848+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17720490634379819384', time=2024-09-12T21:10:24.353741+0000, chain.objs.size()=1 2024-09-12T19:13:57.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.848+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.691__shadow_.tYlfidRDzzFnCUUHoiHcnAasCLl_Mv6_0 2024-09-12T19:13:57.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.848+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7372356825585497386', time=2024-09-12T21:11:12.494384+0000, chain.objs.size()=1 2024-09-12T19:13:57.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.848+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.734__shadow_.lJiogkF5HE0UWHILwZEIUgTnx96Hsqm_0 2024-09-12T19:13:57.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.848+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T19:13:57.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50433' 2024-09-12T19:13:57.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3295357849409222270', time=2024-09-12T20:57:59.262296+0000, chain.objs.size()=1 2024-09-12T19:13:57.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.182__shadow_.Y13jOGvvY5rbputCOpBCJxmyY-eP3j6_0 2024-09-12T19:13:57.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15131362309447968486', time=2024-09-12T20:59:53.581404+0000, chain.objs.size()=1 2024-09-12T19:13:57.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.237__shadow_.5ciSDmpDOpJcW30uUcWh0koqNj8kaQK_0 2024-09-12T19:13:57.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10765334356865382596', time=2024-09-12T21:00:01.525011+0000, chain.objs.size()=1 2024-09-12T19:13:57.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.246__shadow_.7_LOYkTiS-nCOvMT6qhlPOb23Xuc5it_0 2024-09-12T19:13:57.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1217007372581131021', time=2024-09-12T21:00:03.683539+0000, chain.objs.size()=1 2024-09-12T19:13:57.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.249__shadow_.qTSvyXQpyZVW5PXFxoTACiOEQs1D5wb_0 2024-09-12T19:13:57.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7561138915311803733', time=2024-09-12T21:00:12.459386+0000, chain.objs.size()=1 2024-09-12T19:13:57.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.261__shadow_.uadq4KFw1l03ljINmbeHOoD-cAF2V-4_0 2024-09-12T19:13:57.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6917782362900888775', time=2024-09-12T21:00:31.991115+0000, chain.objs.size()=1 2024-09-12T19:13:57.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.luetSv9nla3JXWCVB8MyQmzCYTI3Qgg_0 2024-09-12T19:13:57.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2878066221548949036', time=2024-09-12T21:00:32.013977+0000, chain.objs.size()=1 2024-09-12T19:13:57.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.yGOamLO4LSNeaW0g5eHbiO8tj5mobxV_0 2024-09-12T19:13:57.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11614889601342571501', time=2024-09-12T21:00:32.053095+0000, chain.objs.size()=1 2024-09-12T19:13:57.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.hL3go7w7s2auWSwXG2qzk8S1R2LQsm5_0 2024-09-12T19:13:57.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13007230080067217609', time=2024-09-12T21:00:32.067264+0000, chain.objs.size()=1 2024-09-12T19:13:57.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DTqlXp7-CelU-cGBqleZz2wVeSCNPCK_0 2024-09-12T19:13:57.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11824200390935522036', time=2024-09-12T21:00:32.086605+0000, chain.objs.size()=1 2024-09-12T19:13:57.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.wuFvVMOk05ifQXbNYTXrQafzHbya0Iq_0 2024-09-12T19:13:57.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1338011652893537771', time=2024-09-12T21:00:32.100361+0000, chain.objs.size()=1 2024-09-12T19:13:57.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2oD7AetVbzhwE04TpQt6EwUbW9B-V-v_0 2024-09-12T19:13:57.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14994551184545245154', time=2024-09-12T21:00:32.329511+0000, chain.objs.size()=1 2024-09-12T19:13:57.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.852+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.lQ-NzAVILbbHrA34I9d6FwdpCTB4Ln0_0 2024-09-12T19:13:57.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4336323640414839915', time=2024-09-12T21:00:32.335484+0000, chain.objs.size()=1 2024-09-12T19:13:57.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.c3yhi4C4Ic-v1fW1rIr1uE7KFxUF6_8_0 2024-09-12T19:13:57.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6851574923930848529', time=2024-09-12T21:00:32.542544+0000, chain.objs.size()=1 2024-09-12T19:13:57.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Ook9grjeok7OeIgVaYYjC49FGZ0ddK__0 2024-09-12T19:13:57.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13632902977719298540', time=2024-09-12T21:00:32.715661+0000, chain.objs.size()=1 2024-09-12T19:13:57.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XJSZGitkMaGQX97Uh6URtkV7691P9tx_0 2024-09-12T19:13:57.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9354285096860625675', time=2024-09-12T21:00:32.910876+0000, chain.objs.size()=1 2024-09-12T19:13:57.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-Xo39LsjG155-DYOTIQjAq6S0Wjxc7Y_0 2024-09-12T19:13:57.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17692756915872890624', time=2024-09-12T21:00:32.928098+0000, chain.objs.size()=1 2024-09-12T19:13:57.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.RQlcDesX79ICyVQeyYXOpZ5k4lNZWAx_0 2024-09-12T19:13:57.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14524756917994202459', time=2024-09-12T21:00:32.930240+0000, chain.objs.size()=1 2024-09-12T19:13:57.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WH501qBMIpRAuKDdyR_wSM4H1A-o7Jo_0 2024-09-12T19:13:57.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15445643412967582650', time=2024-09-12T21:00:32.931806+0000, chain.objs.size()=1 2024-09-12T19:13:57.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-6LY_gim3hQQCxrBvYpE1tiUYwS9Ixy_0 2024-09-12T19:13:57.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5203101447681081959', time=2024-09-12T21:00:32.959143+0000, chain.objs.size()=1 2024-09-12T19:13:57.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.u6zDbHuAl3jciXK5WxDKo8S6yvMa6tp_0 2024-09-12T19:13:57.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17926544194070478685', time=2024-09-12T21:00:32.994123+0000, chain.objs.size()=1 2024-09-12T19:13:57.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.MceWIlIpiM7mqv-aEt1Zx3sAxGGnE_G_0 2024-09-12T19:13:57.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8778242994133317444', time=2024-09-12T21:00:33.164389+0000, chain.objs.size()=1 2024-09-12T19:13:57.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.xs9frBPDwAbiIeiOCnNMeuO9Q4V8Vam_0 2024-09-12T19:13:57.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8536925980194431234', time=2024-09-12T21:00:33.415748+0000, chain.objs.size()=1 2024-09-12T19:13:57.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Z28odeD7_6GAxQzAId71eQ91o9M1uOY_0 2024-09-12T19:13:57.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12325891580501944065', time=2024-09-12T21:00:33.461389+0000, chain.objs.size()=1 2024-09-12T19:13:57.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.856+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.TWTOk894X7sk2PdqA_lXIukQJjCav81_0 2024-09-12T19:13:57.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9319443267818854421', time=2024-09-12T21:00:33.462558+0000, chain.objs.size()=1 2024-09-12T19:13:57.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7wOHmOSKQGOqTEM5gLLBljDg-kHseJA_0 2024-09-12T19:13:57.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15697802490969197670', time=2024-09-12T21:00:33.477951+0000, chain.objs.size()=1 2024-09-12T19:13:57.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.avY6Ym-poneQ3Zzy3Ij3OX1lBrZBOuH_0 2024-09-12T19:13:57.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1615847861233124405', time=2024-09-12T21:00:33.646054+0000, chain.objs.size()=1 2024-09-12T19:13:57.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.lEwJc_4xhBGuBsBXRmE0UbUTMyFOidc_0 2024-09-12T19:13:57.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5543930164404857152', time=2024-09-12T21:00:33.655176+0000, chain.objs.size()=1 2024-09-12T19:13:57.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_._TAJXxJfoy1aBqGqWMjFg3YEagVSEic_0 2024-09-12T19:13:57.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14881045806162649185', time=2024-09-12T21:00:33.891494+0000, chain.objs.size()=1 2024-09-12T19:13:57.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-6QidpG942kPjxqMjBhh_ZW8f82tcik_0 2024-09-12T19:13:57.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3047550056153248823', time=2024-09-12T21:00:43.219884+0000, chain.objs.size()=1 2024-09-12T19:13:57.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.275__shadow_.io9XZ40Aj2hKDjVDfYguKKfLOCQ9Rb4_0 2024-09-12T19:13:57.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14994981734763600283', time=2024-09-12T21:00:44.740765+0000, chain.objs.size()=1 2024-09-12T19:13:57.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.277__shadow_.YjKnXvu_Q-jSt641W1G0Sha4YvkHqe3_0 2024-09-12T19:13:57.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7872785542585525745', time=2024-09-12T21:00:46.895251+0000, chain.objs.size()=1 2024-09-12T19:13:57.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.280__shadow_.2eiBnFBQvdbpgqVGlJGr1uUIOmHTQDi_0 2024-09-12T19:13:57.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9718441709424183667', time=2024-09-12T21:00:55.328774+0000, chain.objs.size()=1 2024-09-12T19:13:57.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.291__shadow_.S1WAKI20eXckCt_l1MRNZGOrN5AH338_0 2024-09-12T19:13:57.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15229267024758774015', time=2024-09-12T21:00:56.719486+0000, chain.objs.size()=1 2024-09-12T19:13:57.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.yOfhmb61y6xINXHIMTHJEFb1IIp98KI_0 2024-09-12T19:13:57.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8409897731328441281', time=2024-09-12T21:00:56.737317+0000, chain.objs.size()=1 2024-09-12T19:13:57.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.LdeoRR6PWfGRYdkTltYFDyDxNi1SqXX_0 2024-09-12T19:13:57.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12191612309240965374', time=2024-09-12T21:01:07.008212+0000, chain.objs.size()=1 2024-09-12T19:13:57.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.305__shadow_.1LwHH-lSZp4GLj92mWB62mXj-DD7a9O_0 2024-09-12T19:13:57.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15230848375372432749', time=2024-09-12T21:01:13.541530+0000, chain.objs.size()=1 2024-09-12T19:13:57.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.313__shadow_.A8hUUr0zU1Xf5KqcpnjapOUbsFobkzO_0 2024-09-12T19:13:57.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17419212729856427769', time=2024-09-12T21:01:18.602797+0000, chain.objs.size()=1 2024-09-12T19:13:57.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.321__shadow_.3_oOXo6DgOhnQtDzUHl-IIGJAiRWp1H_0 2024-09-12T19:13:57.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6206070460894212600', time=2024-09-12T21:01:39.436048+0000, chain.objs.size()=1 2024-09-12T19:13:57.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.U1sspuYbPckYYOyEwl0j1O25QGEQEVg_0 2024-09-12T19:13:57.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15102263137137922894', time=2024-09-12T21:01:39.534152+0000, chain.objs.size()=1 2024-09-12T19:13:57.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.K89uO6adp51GnoWWEE4bHa4i7urkOfD_0 2024-09-12T19:13:57.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16068071370862481672', time=2024-09-12T21:01:39.537045+0000, chain.objs.size()=1 2024-09-12T19:13:57.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.2aJboMs3eRC6Z9JhnC9T2XwpVU602rV_0 2024-09-12T19:13:57.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5208725684795311036', time=2024-09-12T21:01:39.549868+0000, chain.objs.size()=1 2024-09-12T19:13:57.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.860+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.LUXYRrSjhgx7PhozD91LcmZVT-WVGsj_0 2024-09-12T19:13:57.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2503245551235228210', time=2024-09-12T21:01:39.685925+0000, chain.objs.size()=1 2024-09-12T19:13:57.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.eNfLatiV7bB0T85a_SaZTrZ8sbDWCl8_0 2024-09-12T19:13:57.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3549416509674158347', time=2024-09-12T21:01:39.768666+0000, chain.objs.size()=1 2024-09-12T19:13:57.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BbXAHGitOmu1SIhh0V3VL5uYuAEB-MG_0 2024-09-12T19:13:57.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14175984165446701839', time=2024-09-12T21:01:39.912080+0000, chain.objs.size()=1 2024-09-12T19:13:57.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.gxcYR2sCjyKs94kwb_FOjGFdkbIiPAH_0 2024-09-12T19:13:57.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1517729025094651605', time=2024-09-12T21:01:39.925122+0000, chain.objs.size()=1 2024-09-12T19:13:57.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.F7S8alCQUXJ-o34MRdTbvtIiM7oOpxE_0 2024-09-12T19:13:57.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16177109437197460931', time=2024-09-12T21:01:39.991724+0000, chain.objs.size()=1 2024-09-12T19:13:57.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.kjQDZWI6mkqigX0XoXa_5i-BnYv8Vat_0 2024-09-12T19:13:57.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8229122642139142321', time=2024-09-12T21:01:40.001847+0000, chain.objs.size()=1 2024-09-12T19:13:57.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.i9QcEFraIokOOC4OgoSHKXCL3xKLp0W_0 2024-09-12T19:13:57.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3125750887866449728', time=2024-09-12T21:01:40.159209+0000, chain.objs.size()=1 2024-09-12T19:13:57.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.q4OOltjQ-f0xkWl5zPsIdB0CKh1x0FD_0 2024-09-12T19:13:57.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9599382050902098743', time=2024-09-12T21:01:40.168337+0000, chain.objs.size()=1 2024-09-12T19:13:57.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.45YuuxoYiiPn-7Ih1C9Rmf2uobPpabI_0 2024-09-12T19:13:57.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6303398190078273383', time=2024-09-12T21:01:40.176857+0000, chain.objs.size()=1 2024-09-12T19:13:57.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.LmAY-1OoXi8peSN8Hs10_0ivDCOLGf2_0 2024-09-12T19:13:57.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15243301017530002429', time=2024-09-12T21:01:40.191653+0000, chain.objs.size()=1 2024-09-12T19:13:57.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.aH7VHjYwEH7AG6oivuYgviCJhC8yyz0_0 2024-09-12T19:13:57.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.193826596208228550', time=2024-09-12T21:01:40.196170+0000, chain.objs.size()=1 2024-09-12T19:13:57.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.xRM3w2r3S_16HnI2hvzU4ov9s96Rs4s_0 2024-09-12T19:13:57.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4831694965930261684', time=2024-09-12T21:01:40.396347+0000, chain.objs.size()=1 2024-09-12T19:13:57.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.VQm_rGGS-l5EVw0t5TxxQ4J31bkOnWr_0 2024-09-12T19:13:57.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13515699788241440245', time=2024-09-12T21:01:40.430730+0000, chain.objs.size()=1 2024-09-12T19:13:57.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.IsWwypG3qAz2k8lzxmzci0SJyJYkH-N_0 2024-09-12T19:13:57.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13285451653068110993', time=2024-09-12T21:01:40.439569+0000, chain.objs.size()=1 2024-09-12T19:13:57.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mYki5Ur-bfGwG2W2r6-CUEjSc7QooCc_0 2024-09-12T19:13:57.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7095578566164127996', time=2024-09-12T21:01:40.462085+0000, chain.objs.size()=1 2024-09-12T19:13:57.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.nhvCCzL6l6s2WXE-B90pDnRg8AYCYMo_0 2024-09-12T19:13:57.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4850880148710916435', time=2024-09-12T21:01:40.552799+0000, chain.objs.size()=1 2024-09-12T19:13:57.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DQRRAhb8h40pBXVZ2AuXwswWLjuFA-s_0 2024-09-12T19:13:57.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4752428842994777922', time=2024-09-12T21:01:40.585958+0000, chain.objs.size()=1 2024-09-12T19:13:57.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0HVc6fSKgVSy-6fF9EhFd0KKTCi-Z6E_0 2024-09-12T19:13:57.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.173981301853294329', time=2024-09-12T21:01:40.612107+0000, chain.objs.size()=1 2024-09-12T19:13:57.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.bmZbAUrPc-jfDs6NopqEQvfHrjgeBf6_0 2024-09-12T19:13:57.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9307831344171178770', time=2024-09-12T21:01:40.671844+0000, chain.objs.size()=1 2024-09-12T19:13:57.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.8kNb_3-valX2dQ1IzyWm5bR4KfKwot4_0 2024-09-12T19:13:57.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3686022355008562603', time=2024-09-12T21:01:40.769517+0000, chain.objs.size()=1 2024-09-12T19:13:57.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.rsh_S_e5eJZ5nvVAhXkP5Sn15M57UEe_0 2024-09-12T19:13:57.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8578101546140145935', time=2024-09-12T21:01:40.776675+0000, chain.objs.size()=1 2024-09-12T19:13:57.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.nCxCMnWVba-oxHagkuJbrN5jA3Z8qgz_0 2024-09-12T19:13:57.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13139002002814137648', time=2024-09-12T21:01:40.788743+0000, chain.objs.size()=1 2024-09-12T19:13:57.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.gii6DvSY5pQujMN-Mo8M3zhQRw8y4vT_0 2024-09-12T19:13:57.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.56921662043216819', time=2024-09-12T21:01:40.790138+0000, chain.objs.size()=1 2024-09-12T19:13:57.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Bqu_dKt11J9BgqYPo43mWmg2F43P4AI_0 2024-09-12T19:13:57.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1137728957353054287', time=2024-09-12T21:01:40.806291+0000, chain.objs.size()=1 2024-09-12T19:13:57.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.864+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RNWu_TO96Khy3Tec83Oi3HMCxmNSR6U_0 2024-09-12T19:13:57.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1250939309975899857', time=2024-09-12T21:01:40.865525+0000, chain.objs.size()=1 2024-09-12T19:13:57.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.FD5_4d1Hjq74FcvM9J9JtbDG5SmptKD_0 2024-09-12T19:13:57.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14818850742006726252', time=2024-09-12T21:01:40.991317+0000, chain.objs.size()=1 2024-09-12T19:13:57.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mYQPOyZVIZzAUnDFmbpgEFxVNjSgy3I_0 2024-09-12T19:13:57.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13305589084794703134', time=2024-09-12T21:01:41.010947+0000, chain.objs.size()=1 2024-09-12T19:13:57.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.WpFS3_TwBGl9YNFnvQmkj931bOXyJ1l_0 2024-09-12T19:13:57.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4661694217229405726', time=2024-09-12T21:01:41.065418+0000, chain.objs.size()=1 2024-09-12T19:13:57.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.T0rBi0NnVWbBXjCdDVljvKw7rwiy4dj_0 2024-09-12T19:13:57.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4470128930408318811', time=2024-09-12T21:01:41.090136+0000, chain.objs.size()=1 2024-09-12T19:13:57.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.bi10W4xyFaVsxxHBlnSmjh-t1ci5u-K_0 2024-09-12T19:13:57.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16981998435347382371', time=2024-09-12T21:02:00.551185+0000, chain.objs.size()=1 2024-09-12T19:13:57.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.OQT6H1gv8FyEjtA_9njlJ4ZmcbM0ojm_0 2024-09-12T19:13:57.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3887482628127514955', time=2024-09-12T21:02:00.642255+0000, chain.objs.size()=1 2024-09-12T19:13:57.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Zp2aHKtPXN3c_3oyP1FUr-Cq3MTJw98_0 2024-09-12T19:13:57.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3069513795280188402', time=2024-09-12T21:02:00.882919+0000, chain.objs.size()=1 2024-09-12T19:13:57.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Z1T5OmPp1qZpoPVY3SPDKbEIBzF63RR_0 2024-09-12T19:13:57.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15915746644703816167', time=2024-09-12T21:02:01.065595+0000, chain.objs.size()=1 2024-09-12T19:13:57.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.GAQ49X_SW0dXFIg0GA61pjrdHugSmKD_0 2024-09-12T19:13:57.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12442111605617360388', time=2024-09-12T21:02:01.260577+0000, chain.objs.size()=1 2024-09-12T19:13:57.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.AdKHd3O_676DzaBimiGhhkPau760V0a_0 2024-09-12T19:13:57.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17960564791021466432', time=2024-09-12T21:02:01.310967+0000, chain.objs.size()=1 2024-09-12T19:13:57.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7ICRdPZqoZskdUURCbdLyK_MCdzClrA_0 2024-09-12T19:13:57.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4156580180378223037', time=2024-09-12T21:02:01.322148+0000, chain.objs.size()=1 2024-09-12T19:13:57.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.rZoo8W_FyAkBZzWS26_Vl7mpRD_eTU2_0 2024-09-12T19:13:57.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17927744101358657847', time=2024-09-12T21:02:01.345228+0000, chain.objs.size()=1 2024-09-12T19:13:57.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.FTGaBYDruUuOHNu_30t_k9T44-jDhS0_0 2024-09-12T19:13:57.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11418745834965417879', time=2024-09-12T21:02:01.349078+0000, chain.objs.size()=1 2024-09-12T19:13:57.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.pnVRx3ZkOR06-8IZHbXtnQhTZusMnBQ_0 2024-09-12T19:13:57.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14016934030513955676', time=2024-09-12T21:02:01.478363+0000, chain.objs.size()=1 2024-09-12T19:13:57.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.wJx_xN9zWc4gkdcz2J3QnSd1kRxyFFf_0 2024-09-12T19:13:57.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14406842433416251086', time=2024-09-12T21:02:01.501802+0000, chain.objs.size()=1 2024-09-12T19:13:57.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2MgWEG9VREbsI5ei6fDIHIXwjaDZLuE_0 2024-09-12T19:13:57.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2804312096616535112', time=2024-09-12T21:02:01.528088+0000, chain.objs.size()=1 2024-09-12T19:13:57.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.868+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.HfNhUioyYKULpaEoTaUB0XchDmi7GuK_0 2024-09-12T19:13:57.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5405048915637838221', time=2024-09-12T21:02:01.549967+0000, chain.objs.size()=1 2024-09-12T19:13:57.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0ESEK9pHyStD5peu2L-aEm9CXq79X8u_0 2024-09-12T19:13:57.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15590429035987957214', time=2024-09-12T21:02:01.661138+0000, chain.objs.size()=1 2024-09-12T19:13:57.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.uAGxkmHidkspXytVfEEQAiFYqwl5VOz_0 2024-09-12T19:13:57.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17179888254885471174', time=2024-09-12T21:02:01.715277+0000, chain.objs.size()=1 2024-09-12T19:13:57.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.YvU0J8lzqr_2Pm1YAlp7tgF2958RV3d_0 2024-09-12T19:13:57.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3604249418286632986', time=2024-09-12T21:02:01.729105+0000, chain.objs.size()=1 2024-09-12T19:13:57.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.LGvX09Gejig8iLICMomgKpRH9Xfrq9A_0 2024-09-12T19:13:57.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13856545270501268816', time=2024-09-12T21:02:01.914193+0000, chain.objs.size()=1 2024-09-12T19:13:57.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Elfc5081cJVp382QBQRD7fa7hI40pbw_0 2024-09-12T19:13:57.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6607372010835517480', time=2024-09-12T21:02:01.934153+0000, chain.objs.size()=1 2024-09-12T19:13:57.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.DGEoHixL2j0eBg6E49gjKNr9iSjSqgH_0 2024-09-12T19:13:57.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17354739257914756414', time=2024-09-12T21:02:01.982880+0000, chain.objs.size()=1 2024-09-12T19:13:57.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NaDFT6i5Vf0F3W4uCPTwNwm4FYtpkBz_0 2024-09-12T19:13:57.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16532216061941433537', time=2024-09-12T21:02:02.142723+0000, chain.objs.size()=1 2024-09-12T19:13:57.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WeZFuzAa2MGLYvzAJI10rl7lea85-rW_0 2024-09-12T19:13:57.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5987491297718109750', time=2024-09-12T21:02:02.197141+0000, chain.objs.size()=1 2024-09-12T19:13:57.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.3cQxbzrDAHxf7Ynd-GCkEP_G3NdTh_d_0 2024-09-12T19:13:57.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2720567881181143774', time=2024-09-12T21:02:02.199225+0000, chain.objs.size()=1 2024-09-12T19:13:57.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._XIOlxbeO-QmPo4hwY3q_abtrbgV5qY_0 2024-09-12T19:13:57.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13885248065767667868', time=2024-09-12T21:02:06.137964+0000, chain.objs.size()=1 2024-09-12T19:13:57.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.330__shadow_.v2vO5dxJ-kDVtKWTex9HyDxjfBmMjsA_0 2024-09-12T19:13:57.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10067734620941441747', time=2024-09-12T21:02:07.465858+0000, chain.objs.size()=1 2024-09-12T19:13:57.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.332__shadow_.3U6m8LnSlpXNESSNp6mOUs9gMk4MuoA_0 2024-09-12T19:13:57.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13960845903591634407', time=2024-09-12T21:03:25.213872+0000, chain.objs.size()=1 2024-09-12T19:13:57.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.442__shadow_.SgEoUqYdXiltPZ2iRhU4-x4_hE-fDh-_0 2024-09-12T19:13:57.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4146409957537264789', time=2024-09-12T21:03:56.360513+0000, chain.objs.size()=1 2024-09-12T19:13:57.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.484__shadow_.pbcxOH9DhmkF_4TxZ0KDAiUKuqCxNFi_0 2024-09-12T19:13:57.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11144055575202131666', time=2024-09-12T21:03:58.069566+0000, chain.objs.size()=1 2024-09-12T19:13:57.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.486__shadow_.kSPHoTaXmEH-GG-1KyCLl0PQSKt4aCx_0 2024-09-12T19:13:57.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10027708126653182792', time=2024-09-12T21:04:05.491291+0000, chain.objs.size()=1 2024-09-12T19:13:57.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.872+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.497__shadow_.xdAM53zXldD17-wWq3LjMqrk0C6u0D2_0 2024-09-12T19:13:57.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.876+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1730470324253945491', time=2024-09-12T21:04:09.348767+0000, chain.objs.size()=1 2024-09-12T19:13:57.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.876+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.503__shadow:36QYX6qQ2gzMos2OEErLcQNuKaa5Xm._.oMtp76uo7bZ28BaGhD6Iv-dVMP_rpSx_0 2024-09-12T19:13:57.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.876+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50433 2024-09-12T19:13:57.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T19:13:57.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14986412136352883250', time=2024-09-12T21:04:16.318983+0000, chain.objs.size()=1 2024-09-12T19:13:57.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.513__multipart_mymultipart.2~ajiHWkOoxqzYT8tOqGYMvSYhWrXXYie.1 2024-09-12T19:13:57.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12432729483230196763', time=2024-09-12T21:05:40.809485+0000, chain.objs.size()=1 2024-09-12T19:13:57.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.550__shadow_.64MUaMaX5vV07NuadDS1keXOmdLwR15_0 2024-09-12T19:13:57.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3294304433864444503', time=2024-09-12T21:05:45.641373+0000, chain.objs.size()=1 2024-09-12T19:13:57.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.554__shadow_.mz0j8ycivRrn627Yk5_UN32N79Th9-i_0 2024-09-12T19:13:57.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16986820258917314386', time=2024-09-12T21:06:18.244873+0000, chain.objs.size()=1 2024-09-12T19:13:57.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.574__shadow:bo6ArTKD6MCCcWA3aEUMYsf63riXr8O_.1zQuzrWv69K-UAIEOsKc1m_dcEBWy1z_0 2024-09-12T19:13:57.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6859623416324108329', time=2024-09-12T21:06:22.487860+0000, chain.objs.size()=1 2024-09-12T19:13:57.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.576__shadow:Z3jsvzOKoX0l3mdJBDjAyuQGhVhXgyT_.VZiVd0PhbbU7Xbh5CgpPguNL0VE48wb_0 2024-09-12T19:13:57.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12317321065108533601', time=2024-09-12T21:06:27.464384+0000, chain.objs.size()=1 2024-09-12T19:13:57.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:zHeoJZtuE.6G5RAG8BIB.H1h07pndXn_.sn83fU7ZSVRlIuq_iFSmaWYI_862-zk_0 2024-09-12T19:13:57.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4841015942537027040', time=2024-09-12T21:06:39.235268+0000, chain.objs.size()=1 2024-09-12T19:13:57.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:2978Whw7SdbHupnPm.PN84Mlxvf3aVj_.leH3yOil9AO1qUzkqeNrnQSrdE2DzJd_0 2024-09-12T19:13:57.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3603325237171633112', time=2024-09-12T21:06:46.333094+0000, chain.objs.size()=1 2024-09-12T19:13:57.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.579__shadow:dpyaNjST5qsN6u0YnV5KccGf7w6ag2R_.PYg23TmDW-ip66-eg12XM_SQMOsJf3e_0 2024-09-12T19:13:57.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12978401643139281727', time=2024-09-12T21:09:54.197524+0000, chain.objs.size()=2 2024-09-12T19:13:57.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.649__shadow_.E4OvuhZoTBmnkAVZeZRkavI8B_Ifm6W_0 2024-09-12T19:13:57.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.649__shadow_.E4OvuhZoTBmnkAVZeZRkavI8B_Ifm6W_1 2024-09-12T19:13:57.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3804251270160357683', time=2024-09-12T21:09:55.127118+0000, chain.objs.size()=1 2024-09-12T19:13:57.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.650__shadow_.5NG8aGNOcHLK7hcaWl_1w4opmvwZ81n_0 2024-09-12T19:13:57.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1502036187008400693', time=2024-09-12T21:10:05.315280+0000, chain.objs.size()=6 2024-09-12T19:13:57.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.662__multipart_foo.2~vmE_8EcBnDOVQ-Aslifn_-jc03Y2uIV.1 2024-09-12T19:13:57.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.662__multipart_foo.2~vmE_8EcBnDOVQ-Aslifn_-jc03Y2uIV.2 2024-09-12T19:13:57.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.662__multipart_foo.2~vmE_8EcBnDOVQ-Aslifn_-jc03Y2uIV.3 2024-09-12T19:13:57.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.662__multipart_foo.2~vmE_8EcBnDOVQ-Aslifn_-jc03Y2uIV.4 2024-09-12T19:13:57.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.662__multipart_foo.2~vmE_8EcBnDOVQ-Aslifn_-jc03Y2uIV.5 2024-09-12T19:13:57.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.662__multipart_foo.2~vmE_8EcBnDOVQ-Aslifn_-jc03Y2uIV.6 2024-09-12T19:13:57.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11015143553971155642', time=2024-09-12T21:10:31.140174+0000, chain.objs.size()=1 2024-09-12T19:13:57.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.701__shadow:sHjU.uig-BwFpNhRYt898PDF2rYUiB1_.ZKn37FIxALKCC1fBSREoA3soUXVwOVW_0 2024-09-12T19:13:57.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1321967363473117079', time=2024-09-12T21:11:01.773920+0000, chain.objs.size()=1 2024-09-12T19:13:57.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.718__shadow_.tS7_0pvse01BCChbxcsjhdwu3XoxI11_0 2024-09-12T19:13:57.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16206534149101193599', time=2024-09-12T21:11:37.571735+0000, chain.objs.size()=1 2024-09-12T19:13:57.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.880+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.745__shadow_.6kekPf1fTq6sYeO2I99p8nah_VOd8t3_0 2024-09-12T19:13:57.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.884+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.884+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T19:13:57.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48239' 2024-09-12T19:13:57.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_XMmI4P9ocHu8WBG68gmO1Rs0kYCm9dX', time=2024-09-12T20:57:32.771064+0000, chain.objs.size()=3 2024-09-12T19:13:57.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.XX12nCH1NiXMpY3S07wzbjnGRwOs-VS_0 2024-09-12T19:13:57.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.XX12nCH1NiXMpY3S07wzbjnGRwOs-VS_1 2024-09-12T19:13:57.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.XX12nCH1NiXMpY3S07wzbjnGRwOs-VS_2 2024-09-12T19:13:57.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~8FfqmL_XVeQMloPLBEFmJbZBQSJC5xz', time=2024-09-12T20:58:21.251877+0000, chain.objs.size()=1 2024-09-12T19:13:57.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.202__multipart_mymultipart.2~8FfqmL_XVeQMloPLBEFmJbZBQSJC5xz.1 2024-09-12T19:13:57.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14175087395027484057', time=2024-09-12T21:00:02.257207+0000, chain.objs.size()=1 2024-09-12T19:13:57.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.247__shadow_.wKexPp0nR_wkjCCxGwuBgTLmNUz-y1K_0 2024-09-12T19:13:57.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4812026262685094912', time=2024-09-12T21:00:12.458665+0000, chain.objs.size()=1 2024-09-12T19:13:57.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.261__shadow_.z4uukNJOc_rmPcMVK38J3_7Rg_RH0s5_0 2024-09-12T19:13:57.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15718648022315192019', time=2024-09-12T21:00:32.017920+0000, chain.objs.size()=1 2024-09-12T19:13:57.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.jxQ0O4oruHYDwydd0BpYsvulVOH_J9Z_0 2024-09-12T19:13:57.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6495050167197630195', time=2024-09-12T21:00:32.066090+0000, chain.objs.size()=1 2024-09-12T19:13:57.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.W_LrNMiybINT0tnwRycXLlh4JOu__g__0 2024-09-12T19:13:57.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16198101447401853957', time=2024-09-12T21:00:32.108992+0000, chain.objs.size()=1 2024-09-12T19:13:57.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.V7YQNFnLLOj0wRaRyHxU29llkqF5rXU_0 2024-09-12T19:13:57.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11336998474973883492', time=2024-09-12T21:00:32.303431+0000, chain.objs.size()=1 2024-09-12T19:13:57.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.MMlCbbmctJI3uInZ-SeitjMDtxEqTpb_0 2024-09-12T19:13:57.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5044944567709312017', time=2024-09-12T21:00:32.327767+0000, chain.objs.size()=1 2024-09-12T19:13:57.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.4W_yAZ0P_n_rAJ9kd1UWr8kybTrM4ye_0 2024-09-12T19:13:57.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13319058703709347271', time=2024-09-12T21:00:32.444448+0000, chain.objs.size()=1 2024-09-12T19:13:57.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.888+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.fM-fpxzkdkiroHt5LStiNIFO92RtVAK_0 2024-09-12T19:13:57.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6438542416539258661', time=2024-09-12T21:00:32.686835+0000, chain.objs.size()=1 2024-09-12T19:13:57.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.uvFT5mJcFKY9ml5XqbwZntZx8EbgrSy_0 2024-09-12T19:13:57.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10767744554606447981', time=2024-09-12T21:00:32.696486+0000, chain.objs.size()=1 2024-09-12T19:13:57.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.hSAhALu1D9kt3BbVh9CNqccuoCbBn2u_0 2024-09-12T19:13:57.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.132035876322632787', time=2024-09-12T21:00:32.697401+0000, chain.objs.size()=1 2024-09-12T19:13:57.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.nmjEMrr1wwePFS-EZyRG3OWVgmmV8_W_0 2024-09-12T19:13:57.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13808277176283981782', time=2024-09-12T21:00:32.717831+0000, chain.objs.size()=1 2024-09-12T19:13:57.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2TT_ynSE8ESRSo8Jz1y3hLzi11ortuI_0 2024-09-12T19:13:57.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5778011813374557447', time=2024-09-12T21:00:32.734513+0000, chain.objs.size()=1 2024-09-12T19:13:57.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Y-Pb9-JEapTKjI7glqVziikeBXzXCn9_0 2024-09-12T19:13:57.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4815235047124650113', time=2024-09-12T21:00:32.742581+0000, chain.objs.size()=1 2024-09-12T19:13:57.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Kr8aoeH-fZ-h-ETg3QyL9MCP647vrPo_0 2024-09-12T19:13:57.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12125000051402997845', time=2024-09-12T21:00:32.758345+0000, chain.objs.size()=1 2024-09-12T19:13:57.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Bz6qsdmPVXwXcKMm28D28TSnxZsSIkr_0 2024-09-12T19:13:57.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8371413844598185293', time=2024-09-12T21:00:32.766693+0000, chain.objs.size()=1 2024-09-12T19:13:57.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.IH0lAkxlBNbqBnInt-0fsen_vF1zKF1_0 2024-09-12T19:13:57.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9368440777745023334', time=2024-09-12T21:00:32.772009+0000, chain.objs.size()=1 2024-09-12T19:13:57.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DRbHSj6gTjuFqSdqem9VSFAIEjmj93J_0 2024-09-12T19:13:57.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11648786246714912541', time=2024-09-12T21:00:32.878969+0000, chain.objs.size()=1 2024-09-12T19:13:57.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.8d84M-bPdE2MzSpFYMO3n1Zc92amhRN_0 2024-09-12T19:13:57.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7533258818878980781', time=2024-09-12T21:00:32.880720+0000, chain.objs.size()=1 2024-09-12T19:13:57.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.06jbiCTvQglIWX5OfWPut2oaMkntHjt_0 2024-09-12T19:13:57.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5767166369146132421', time=2024-09-12T21:00:32.917477+0000, chain.objs.size()=1 2024-09-12T19:13:57.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-r_lukO_JnWtTIhP6zgS5LGR_kEAye1_0 2024-09-12T19:13:57.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18390706483915642885', time=2024-09-12T21:00:32.922396+0000, chain.objs.size()=1 2024-09-12T19:13:57.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.1c-6G8jtPQogLZz1wDamuoypuj-CuXr_0 2024-09-12T19:13:57.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10423737874369602237', time=2024-09-12T21:00:32.933748+0000, chain.objs.size()=1 2024-09-12T19:13:57.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CZCaVahZh4GplSpLfwKpoqj7qjnSWDW_0 2024-09-12T19:13:57.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5372930950400814791', time=2024-09-12T21:00:32.969964+0000, chain.objs.size()=1 2024-09-12T19:13:57.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.hM5y2zGrP1SaIcspeDAZot17mXiBHsl_0 2024-09-12T19:13:57.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5055058942653489547', time=2024-09-12T21:00:33.093795+0000, chain.objs.size()=1 2024-09-12T19:13:57.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.6cGZI2acuOHqNHqT49g__kfqXWhJQm7_0 2024-09-12T19:13:57.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13003355160314578661', time=2024-09-12T21:00:33.098666+0000, chain.objs.size()=1 2024-09-12T19:13:57.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.09PUDnZGbIl8LVYL6hIdIGSWI6tziHH_0 2024-09-12T19:13:57.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11975811279353558111', time=2024-09-12T21:00:33.143242+0000, chain.objs.size()=1 2024-09-12T19:13:57.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.yXobpOua3ykFvbsB5Dnjx7r3ywmrSvU_0 2024-09-12T19:13:57.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12505375682613851227', time=2024-09-12T21:00:33.147419+0000, chain.objs.size()=1 2024-09-12T19:13:57.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3c9ftjO8eHWXhd3yAocb2uJI5qEfDNf_0 2024-09-12T19:13:57.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17419358160734605382', time=2024-09-12T21:00:33.198703+0000, chain.objs.size()=1 2024-09-12T19:13:57.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.QLOkmD6jxOp8KIk85e5YmgQTy43yeKc_0 2024-09-12T19:13:57.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4392628971975495769', time=2024-09-12T21:00:33.359064+0000, chain.objs.size()=1 2024-09-12T19:13:57.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CC7VUviaGdsPcti5seN59eW1ohe_PWn_0 2024-09-12T19:13:57.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2916829605469398', time=2024-09-12T21:00:33.361947+0000, chain.objs.size()=1 2024-09-12T19:13:57.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.892+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.dccDgyayDqXKcKx6oiWJZpclj9DPQ5z_0 2024-09-12T19:13:57.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6052070903427169271', time=2024-09-12T21:00:33.372923+0000, chain.objs.size()=1 2024-09-12T19:13:57.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DLtcJ6wlOBJGAK4tR8U_M95Lx_0l6XB_0 2024-09-12T19:13:57.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7250908592504408334', time=2024-09-12T21:00:33.455577+0000, chain.objs.size()=1 2024-09-12T19:13:57.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.r_EypPtkMIkMhnhy2Je07JuwU2Qf52p_0 2024-09-12T19:13:57.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5114474290812883032', time=2024-09-12T21:00:33.482539+0000, chain.objs.size()=1 2024-09-12T19:13:57.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WSDstLTp7HRHIoqVWScwDMZHxiSVpbQ_0 2024-09-12T19:13:57.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9727904945050957555', time=2024-09-12T21:00:33.609938+0000, chain.objs.size()=1 2024-09-12T19:13:57.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ZzvOGoumB5mmJfDxC96wu5u49Fpmozd_0 2024-09-12T19:13:57.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17573106580908673079', time=2024-09-12T21:00:33.615227+0000, chain.objs.size()=1 2024-09-12T19:13:57.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.g67S6iYwtwCKFUuWiq-dCVXYgsavw_H_0 2024-09-12T19:13:57.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5635622693484859487', time=2024-09-12T21:00:33.626412+0000, chain.objs.size()=1 2024-09-12T19:13:57.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.mUoPoc5PizVWHcgnvXl-nVab3LFnSFD_0 2024-09-12T19:13:57.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17519509672624491173', time=2024-09-12T21:00:35.302215+0000, chain.objs.size()=1 2024-09-12T19:13:57.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.264__shadow_.uHDJpNYaOkAt5Q3OkCMYbLLhhJLuFTn_0 2024-09-12T19:13:57.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2053697175921156421', time=2024-09-12T21:00:36.709945+0000, chain.objs.size()=1 2024-09-12T19:13:57.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.266__shadow_.aCEKQV1tDYhLeMYAEDYJgSoldPhzsT1_0 2024-09-12T19:13:57.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2891609843329220359', time=2024-09-12T21:00:43.219643+0000, chain.objs.size()=1 2024-09-12T19:13:57.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.275__shadow_.VbeeUserx3My1aT5EjgZjEWnZo83gXU_0 2024-09-12T19:13:57.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2175652371581719248', time=2024-09-12T21:00:49.119966+0000, chain.objs.size()=1 2024-09-12T19:13:57.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.283__shadow_.rLWWCqWkDiAYy5JpC7ddAvt7dZYoP2O_0 2024-09-12T19:13:57.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10792099011497843782', time=2024-09-12T21:00:52.091459+0000, chain.objs.size()=1 2024-09-12T19:13:57.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.896+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.287__shadow_.d0i7aEbbHfEMrkFd7YU9ZQT_jwzz59x_0 2024-09-12T19:13:57.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3085598285909089254', time=2024-09-12T21:00:54.254060+0000, chain.objs.size()=1 2024-09-12T19:13:57.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.290__shadow_.YaCnBru3nGkO5xNHQax-4ZaybntYKiR_0 2024-09-12T19:13:57.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5857156304031883742', time=2024-09-12T21:01:39.407822+0000, chain.objs.size()=1 2024-09-12T19:13:57.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.FCFt8LIDxgHz8yg3YYjngXXfA9SDM1N_0 2024-09-12T19:13:57.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12649091672166010162', time=2024-09-12T21:01:39.487537+0000, chain.objs.size()=1 2024-09-12T19:13:57.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.3Cn45KeUI3F2wPfX0xNTX9QMRArkgLb_0 2024-09-12T19:13:57.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16712695073095760128', time=2024-09-12T21:01:39.500243+0000, chain.objs.size()=1 2024-09-12T19:13:57.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.AImJc2XD6CVI3H3J3LzJVNKgmCJFZlR_0 2024-09-12T19:13:57.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15745915484113733619', time=2024-09-12T21:01:39.513038+0000, chain.objs.size()=1 2024-09-12T19:13:57.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.D63SLnoU9pVs4RUVRkfHyg5Q6RiUDG3_0 2024-09-12T19:13:57.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16369819236532525066', time=2024-09-12T21:01:39.523406+0000, chain.objs.size()=1 2024-09-12T19:13:57.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.MS5E6dhmab1MQNVEdJxsD3wz19bYqcX_0 2024-09-12T19:13:57.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10195808981703152008', time=2024-09-12T21:01:39.687749+0000, chain.objs.size()=1 2024-09-12T19:13:57.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.JvsWWimso3_MVp4OPDTzXOav9OgjncT_0 2024-09-12T19:13:57.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.812850890439930368', time=2024-09-12T21:01:39.757619+0000, chain.objs.size()=1 2024-09-12T19:13:57.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.M8M0cS-rC461eDfKZSbPilBrKkwxAW-_0 2024-09-12T19:13:57.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7682569371384126045', time=2024-09-12T21:01:39.782261+0000, chain.objs.size()=1 2024-09-12T19:13:57.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ZGsqKUE1gRxI1CiBXTFwEHiHb1Z171m_0 2024-09-12T19:13:57.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16407027110706048025', time=2024-09-12T21:01:39.992791+0000, chain.objs.size()=1 2024-09-12T19:13:57.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.zSR3hFrZPOTqXfeNjhs3bn1CNHWowmX_0 2024-09-12T19:13:57.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10090060785129849130', time=2024-09-12T21:01:40.128853+0000, chain.objs.size()=1 2024-09-12T19:13:57.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.pvScQ4BQKRebqo6Pzc9zVzB9UjHCRXu_0 2024-09-12T19:13:57.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9135598545776836494', time=2024-09-12T21:01:40.138851+0000, chain.objs.size()=1 2024-09-12T19:13:57.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.MIdX4GpY0eKLdZ3wTHitE1k2R8ZYI8P_0 2024-09-12T19:13:57.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10563252034470179746', time=2024-09-12T21:01:40.140752+0000, chain.objs.size()=1 2024-09-12T19:13:57.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.uvvBNh3uyICD1wcp--H3z9iE8bd7qGh_0 2024-09-12T19:13:57.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13360804222717823143', time=2024-09-12T21:01:40.371651+0000, chain.objs.size()=1 2024-09-12T19:13:57.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.D9qGDDnz_v-Tpp2izzgFpW9UpKSQQ07_0 2024-09-12T19:13:57.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14586216587799948748', time=2024-09-12T21:01:40.410650+0000, chain.objs.size()=1 2024-09-12T19:13:57.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RlA_zWNqXAPOYfQSXQ-n5Jf1_P8E2F1_0 2024-09-12T19:13:57.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.39093884233981056', time=2024-09-12T21:01:40.453322+0000, chain.objs.size()=1 2024-09-12T19:13:57.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RWD0hrd3keiVT_dqdsdMocJi7XCYSoQ_0 2024-09-12T19:13:57.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.857702899851383239', time=2024-09-12T21:01:40.594143+0000, chain.objs.size()=1 2024-09-12T19:13:57.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.VDP9ngk9HqbHCYE6AG1WxFv3bIG0Evb_0 2024-09-12T19:13:57.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17970839794704527456', time=2024-09-12T21:01:40.640778+0000, chain.objs.size()=1 2024-09-12T19:13:57.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._drMjjsTYI9srDWAtRRA9ix3A2NczQh_0 2024-09-12T19:13:57.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5485461404380206949', time=2024-09-12T21:01:40.653033+0000, chain.objs.size()=1 2024-09-12T19:13:57.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RRYFnUl-LSNn9QV9yrt5nVA9fSOQ3Qj_0 2024-09-12T19:13:57.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10867243767528685510', time=2024-09-12T21:01:40.657593+0000, chain.objs.size()=1 2024-09-12T19:13:57.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.LoMJEYi9UazC21swW26-oGgH-Ccn7tT_0 2024-09-12T19:13:57.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17572083217485234594', time=2024-09-12T21:01:40.658457+0000, chain.objs.size()=1 2024-09-12T19:13:57.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.gWCwvFkxQzm7Q4VrCV-JOdrog0iJrVl_0 2024-09-12T19:13:57.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13165152502381996758', time=2024-09-12T21:01:40.669104+0000, chain.objs.size()=1 2024-09-12T19:13:57.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.LI2XgQ2g6VcOPY5z67H_FN9jFfzwpEg_0 2024-09-12T19:13:57.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1222195677840886557', time=2024-09-12T21:01:40.813788+0000, chain.objs.size()=1 2024-09-12T19:13:57.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.900+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.E13rA-08Gku8X0d8W-9ogq2_ZiXRI-A_0 2024-09-12T19:13:57.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7303633110941998561', time=2024-09-12T21:01:40.815277+0000, chain.objs.size()=1 2024-09-12T19:13:57.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.S-bj3J0JH2wqvjU9-Fe72QnPIa8zdKF_0 2024-09-12T19:13:57.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14496119045961498503', time=2024-09-12T21:01:40.851368+0000, chain.objs.size()=1 2024-09-12T19:13:57.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.INpvYawuYVT6bJUrWLNK-SsVhzMRzqc_0 2024-09-12T19:13:57.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17838209108001406829', time=2024-09-12T21:01:41.019632+0000, chain.objs.size()=1 2024-09-12T19:13:57.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Cr4HEz_wuzPRn3CMscdioZfcLurfNVL_0 2024-09-12T19:13:57.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1398211916763537274', time=2024-09-12T21:01:41.033585+0000, chain.objs.size()=1 2024-09-12T19:13:57.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.7yB_d9KImhONsbYZ7kbC3A2RSip14za_0 2024-09-12T19:13:57.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8092803245447679182', time=2024-09-12T21:01:41.035086+0000, chain.objs.size()=1 2024-09-12T19:13:57.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Yrl-EH5RObD8QR3HD5dYnWBuU--_FRY_0 2024-09-12T19:13:57.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13472598565081904161', time=2024-09-12T21:01:41.042511+0000, chain.objs.size()=1 2024-09-12T19:13:57.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.FceqtgU1ygFHx2zvTuXEDRxeA7rUcnn_0 2024-09-12T19:13:57.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11338259420667455079', time=2024-09-12T21:01:41.095232+0000, chain.objs.size()=1 2024-09-12T19:13:57.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.nYIOKA5DO-O5VbMzs6ZnJN4GaawHwDb_0 2024-09-12T19:13:57.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8225419979840373474', time=2024-09-12T21:02:00.512630+0000, chain.objs.size()=1 2024-09-12T19:13:57.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.C7H-f5o8_nbhUISWJsdGx_ItyngWkh-_0 2024-09-12T19:13:57.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5232198910580766963', time=2024-09-12T21:02:00.542977+0000, chain.objs.size()=1 2024-09-12T19:13:57.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ZMS3CIxwTOmw1OpBq1a5ujmZZQXotEy_0 2024-09-12T19:13:57.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16746363306024902376', time=2024-09-12T21:02:00.556407+0000, chain.objs.size()=1 2024-09-12T19:13:57.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2alLZL_s0vd5079MHeTXs8gEXj07KMD_0 2024-09-12T19:13:57.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3128336018846932846', time=2024-09-12T21:02:00.559509+0000, chain.objs.size()=1 2024-09-12T19:13:57.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.xrOyBaPsvM5z2M_F_hAGNgbuJMINwn5_0 2024-09-12T19:13:57.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7368472978673475317', time=2024-09-12T21:02:00.600140+0000, chain.objs.size()=1 2024-09-12T19:13:57.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._U0iZ_qELuoHXMY2gkSsd51Wda2KHZz_0 2024-09-12T19:13:57.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9386898526959680712', time=2024-09-12T21:02:00.799050+0000, chain.objs.size()=1 2024-09-12T19:13:57.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WZKH89qE-JJRaoKNwgR7iQ4jUja1-QH_0 2024-09-12T19:13:57.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11429510943349413434', time=2024-09-12T21:02:00.839346+0000, chain.objs.size()=1 2024-09-12T19:13:57.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.904+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.vnhvX3J8BCT-s8TOUsBWMguRZjWlnaq_0 2024-09-12T19:13:57.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7254369643822211057', time=2024-09-12T21:02:00.858469+0000, chain.objs.size()=1 2024-09-12T19:13:57.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.iMzE8Tz3fqCCcCDA0hmZLLGjLcrEQS-_0 2024-09-12T19:13:57.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7870952696046298922', time=2024-09-12T21:02:00.998998+0000, chain.objs.size()=1 2024-09-12T19:13:57.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.BauGiKXZhqrZtpYH1-RpjTkp0CnDk3G_0 2024-09-12T19:13:57.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2820495647146331948', time=2024-09-12T21:02:01.031484+0000, chain.objs.size()=1 2024-09-12T19:13:57.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-DkoiTlvfUsbw4WKEGyuQQN7BCzYTzP_0 2024-09-12T19:13:57.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11503066987135043544', time=2024-09-12T21:02:01.056021+0000, chain.objs.size()=1 2024-09-12T19:13:57.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.4GOIKkFxqjuhWC7qI5_ORYek6Js_aCv_0 2024-09-12T19:13:57.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14342761629784943940', time=2024-09-12T21:02:01.110607+0000, chain.objs.size()=1 2024-09-12T19:13:57.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WHUWthRmgpCA8Kl_fOOGaQoHlswj0tk_0 2024-09-12T19:13:57.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4887466173325731025', time=2024-09-12T21:02:01.221180+0000, chain.objs.size()=1 2024-09-12T19:13:57.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.DAg_Oi-dLPs0z31OB4M02OQA7xIrDBr_0 2024-09-12T19:13:57.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3210069591885542167', time=2024-09-12T21:02:01.224583+0000, chain.objs.size()=1 2024-09-12T19:13:57.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.MSDdL41nTHbtKxy81HPtETiKokjemqO_0 2024-09-12T19:13:57.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3698281430065283869', time=2024-09-12T21:02:01.226273+0000, chain.objs.size()=1 2024-09-12T19:13:57.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.R_dAWEWiEDZ1--FkFo7hvmnxwjIkGEa_0 2024-09-12T19:13:57.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13933153408503401435', time=2024-09-12T21:02:01.289090+0000, chain.objs.size()=1 2024-09-12T19:13:57.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.GYzoI7XimbCMiGw2oHuCH7NmXxGNqpF_0 2024-09-12T19:13:57.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3523048655142932942', time=2024-09-12T21:02:01.296196+0000, chain.objs.size()=1 2024-09-12T19:13:57.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.n91ZRnbNMcqvLizrEywq2R1a_bG-Hr1_0 2024-09-12T19:13:57.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9051447976010710784', time=2024-09-12T21:02:01.346027+0000, chain.objs.size()=1 2024-09-12T19:13:57.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.j_Zexma0EE9d73fxqjHaB84GyYW8xHv_0 2024-09-12T19:13:57.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3069081735369031620', time=2024-09-12T21:02:01.350872+0000, chain.objs.size()=1 2024-09-12T19:13:57.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.uq4C6rYek0CjJWysHxSbGu1YF7agt0P_0 2024-09-12T19:13:57.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13318239254043939754', time=2024-09-12T21:02:01.454970+0000, chain.objs.size()=1 2024-09-12T19:13:57.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.VPg1cWvgdWhWmOScKbDAJBQ3SnusE4j_0 2024-09-12T19:13:57.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8132998333554018614', time=2024-09-12T21:02:01.521505+0000, chain.objs.size()=1 2024-09-12T19:13:57.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.CTboareor_8q1x5fPSLBZqYulqzJNho_0 2024-09-12T19:13:57.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8625345220363754801', time=2024-09-12T21:02:01.532386+0000, chain.objs.size()=1 2024-09-12T19:13:57.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Eete9WsUASTrVD3jUi5Ol9RoShOI8qm_0 2024-09-12T19:13:57.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15770830887450990709', time=2024-09-12T21:02:01.535236+0000, chain.objs.size()=1 2024-09-12T19:13:57.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.PwL48g18nXLpWTftfqIQGHzdDH02TV6_0 2024-09-12T19:13:57.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2360114695426532703', time=2024-09-12T21:02:01.548352+0000, chain.objs.size()=1 2024-09-12T19:13:57.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.UNY1esfE9VhMXVkMFeuM9XmAcri7ZSW_0 2024-09-12T19:13:57.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11334862942540790419', time=2024-09-12T21:02:01.676525+0000, chain.objs.size()=1 2024-09-12T19:13:57.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.kgqNXrpZFijABi0rHiWZpKsFOMC5n13_0 2024-09-12T19:13:57.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8609814638821730757', time=2024-09-12T21:02:01.695262+0000, chain.objs.size()=1 2024-09-12T19:13:57.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.TWGtppkO1ix6Uy3zypO0ZbAtbXBY-ZC_0 2024-09-12T19:13:57.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17051969594349087966', time=2024-09-12T21:02:01.738967+0000, chain.objs.size()=1 2024-09-12T19:13:57.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.908+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.6lM4PEylWuQCZePb3sgi8kjiKE5JJlT_0 2024-09-12T19:13:57.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.912+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48239 2024-09-12T19:13:57.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T19:13:57.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.191439046006940503', time=2024-09-12T21:02:01.748687+0000, chain.objs.size()=1 2024-09-12T19:13:57.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Adcxv2ZGormy6DMUayq7NhEPE-f1aWt_0 2024-09-12T19:13:57.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6743550759132295031', time=2024-09-12T21:02:01.761600+0000, chain.objs.size()=1 2024-09-12T19:13:57.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.W8IpGjK3QVsxlLb96alr4b8BHg7iMHP_0 2024-09-12T19:13:57.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11894024678086246055', time=2024-09-12T21:02:01.771478+0000, chain.objs.size()=1 2024-09-12T19:13:57.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WUqlRBZjPmhH_xiFNqLpKKkCKyQV9Rv_0 2024-09-12T19:13:57.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5421546385636370950', time=2024-09-12T21:02:01.773131+0000, chain.objs.size()=1 2024-09-12T19:13:57.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.nn5C4gh3obCLuOh4tyJvx0K9hUPbhFr_0 2024-09-12T19:13:57.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3771109335904768022', time=2024-09-12T21:02:01.942822+0000, chain.objs.size()=1 2024-09-12T19:13:57.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.TrIiASUwYWFbDDDlzYITfkyzqmrU4lb_0 2024-09-12T19:13:57.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8092548184671359113', time=2024-09-12T21:02:02.107446+0000, chain.objs.size()=1 2024-09-12T19:13:57.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.plneQOMaGppHH050_Qp2hS6dN6Cu41g_0 2024-09-12T19:13:57.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18000370290333091257', time=2024-09-12T21:02:02.110951+0000, chain.objs.size()=1 2024-09-12T19:13:57.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.OCyZAhzmXPv0btsFBKXqX0EqTVOGzNw_0 2024-09-12T19:13:57.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9250768232715624200', time=2024-09-12T21:02:02.144030+0000, chain.objs.size()=1 2024-09-12T19:13:57.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.t6emP1DrH3xRitm2byt718Z__otoLvU_0 2024-09-12T19:13:57.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14974594782811856813', time=2024-09-12T21:02:02.175432+0000, chain.objs.size()=1 2024-09-12T19:13:57.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.cqENnJ6kAlQ10Mis2nMYUONCqMev5kn_0 2024-09-12T19:13:57.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12721238974981892319', time=2024-09-12T21:02:10.104647+0000, chain.objs.size()=1 2024-09-12T19:13:57.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.336__shadow_.qayyS7W2zPcLc7zxcKeX6vgPHyftbzL_0 2024-09-12T19:13:57.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7841855843036742570', time=2024-09-12T21:02:37.732587+0000, chain.objs.size()=1 2024-09-12T19:13:57.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.378__shadow_.ZXzpBgjAzZkWxnz6NOuzBgHhzmbGn0x_0 2024-09-12T19:13:57.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1323137603042554852', time=2024-09-12T21:03:40.225811+0000, chain.objs.size()=1 2024-09-12T19:13:57.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.459__shadow_.QqbT2o2vH__TZD_lFEdAfwCGeKz59Fu_0 2024-09-12T19:13:57.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11943450992312901808', time=2024-09-12T21:03:44.365836+0000, chain.objs.size()=1 2024-09-12T19:13:57.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.463__shadow_.jTefnspyZOwPsrb6AqA7YgwakfZKJof_0 2024-09-12T19:13:57.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~JVTDDnhYg4Mjh75h4EfxDzit86JRtSg', time=2024-09-12T21:04:59.830210+0000, chain.objs.size()=1 2024-09-12T19:13:57.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.531__multipart_mymultipart2.2~JVTDDnhYg4Mjh75h4EfxDzit86JRtSg.1 2024-09-12T19:13:57.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9709708883799018204', time=2024-09-12T21:05:50.017595+0000, chain.objs.size()=1 2024-09-12T19:13:57.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.558__shadow_.5zsikb6wqEBMDEd68dhEu5CjNQgyOpu_0 2024-09-12T19:13:57.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17239786187199179172', time=2024-09-12T21:06:04.803825+0000, chain.objs.size()=1 2024-09-12T19:13:57.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:lcthfX0dm8T0AJoV0xbaZJ1-QN.-cUM_.Uf5LN4NBjIY__bRp3LLmSDqGrRb-ip2_0 2024-09-12T19:13:57.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1776926198673823154', time=2024-09-12T21:06:39.613893+0000, chain.objs.size()=1 2024-09-12T19:13:57.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:KDTHt8QaeG7VL7GOMyEXrgKW-uV7aTR_.nTrgapm17-xQKc4vzT5jT7taqFGi8Cu_0 2024-09-12T19:13:57.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6806215348492277784', time=2024-09-12T21:06:46.426283+0000, chain.objs.size()=1 2024-09-12T19:13:57.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.579__shadow:IyRUkYo5Q4stLV4Xoly8uSfj1Tq2lBr_.QltP52MKNkqvnKRbrShYDW_sv0abHEs_0 2024-09-12T19:13:57.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16609602613022817296', time=2024-09-12T21:06:48.235427+0000, chain.objs.size()=1 2024-09-12T19:13:57.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.580__shadow:SoK8CGL2RvlvMgpfgvbm16iFD-nAV-u_.-memFDaAcDg4Rj0OinoQ_ucRnRnl_Rk_0 2024-09-12T19:13:57.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11830372700230413473', time=2024-09-12T21:06:48.913225+0000, chain.objs.size()=1 2024-09-12T19:13:57.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.582__shadow:YvL5QleGT03WF4wVXfF4DZ8JmLGxCtw_.1PbkCq6bssesjrmU8JC7JEC5ZQqm5XQ_0 2024-09-12T19:13:57.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.391048463647867174', time=2024-09-12T21:06:53.922486+0000, chain.objs.size()=1 2024-09-12T19:13:57.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.587__shadow:oPAM0T8JYbY4FnXRbi8MZH1HeBCvQX4_.P4J-8kVn_Rnlf3WPhWVSnfjNX0pU7VU_0 2024-09-12T19:13:57.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4260352343672078058', time=2024-09-12T21:09:47.641182+0000, chain.objs.size()=1 2024-09-12T19:13:57.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.642__shadow_.V8S4GaodlfjiMj66nmqKPLq4np_n-UW_0 2024-09-12T19:13:57.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9861823562938342167', time=2024-09-12T21:09:50.355086+0000, chain.objs.size()=1 2024-09-12T19:13:57.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.645__shadow_.jrXva7xEs-B7BpYEfo4gQJq8Nu-GWhJ_0 2024-09-12T19:13:57.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8896826753669981238', time=2024-09-12T21:10:09.223856+0000, chain.objs.size()=1 2024-09-12T19:13:57.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.666__shadow_.4lnR1mtpJwuYO5pPll5etDF49sTBhRB_0 2024-09-12T19:13:57.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6101733079776095273', time=2024-09-12T21:10:29.769543+0000, chain.objs.size()=1 2024-09-12T19:13:57.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.916+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.699__shadow:oBDh1N78bS8UjI3Rm.NwVu8SCdX.r6b_.6OALmlF7WKxFsCwtNlNFzVvSsz_G8-L_0 2024-09-12T19:13:57.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.920+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.920+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T19:13:57.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45772' 2024-09-12T19:13:57.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8335449798392123058', time=2024-09-12T20:58:17.472786+0000, chain.objs.size()=1 2024-09-12T19:13:57.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.197__shadow_.dEPobGJMBGwAPXSltS-FYUpffZf3r9I_0 2024-09-12T19:13:57.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18158576399605228965', time=2024-09-12T20:59:47.923241+0000, chain.objs.size()=1 2024-09-12T19:13:57.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.230__shadow_.ox9tZ23XgFIWMJmdhGBVHfZOOuefMwQ_0 2024-09-12T19:13:57.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5419846323345154023', time=2024-09-12T21:00:00.763558+0000, chain.objs.size()=1 2024-09-12T19:13:57.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.245__shadow_.FIPa_IFt24KI8NLPbbm2NI2cPJU4bLU_0 2024-09-12T19:13:57.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11024315824761552560', time=2024-09-12T21:00:05.891372+0000, chain.objs.size()=1 2024-09-12T19:13:57.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.252__shadow_.ggzKt6bkw2wRAhGy4BaAakbVcUhyVZH_0 2024-09-12T19:13:57.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11193168150350089578', time=2024-09-12T21:00:32.055549+0000, chain.objs.size()=1 2024-09-12T19:13:57.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ARpgrJP6wmzgTtR3d_u4vvPKSRL_uQH_0 2024-09-12T19:13:57.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14088897296836016639', time=2024-09-12T21:00:32.069586+0000, chain.objs.size()=1 2024-09-12T19:13:57.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.gfE9EX00EROLuz97u4LifPeyAcrGEhV_0 2024-09-12T19:13:57.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1229200205838862243', time=2024-09-12T21:00:32.094224+0000, chain.objs.size()=1 2024-09-12T19:13:57.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Q8wR9c78oaj-YJ9NuaXOeHSC3uekKlP_0 2024-09-12T19:13:57.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17444864788126610608', time=2024-09-12T21:00:32.099952+0000, chain.objs.size()=1 2024-09-12T19:13:57.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.58WR7GKooKvsbn4lvPJaKDS8IF0ECPI_0 2024-09-12T19:13:57.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17483433857609852100', time=2024-09-12T21:00:32.234900+0000, chain.objs.size()=1 2024-09-12T19:13:57.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.j-RExJ3oxHUQsNE9QRU-Nl70woOT6HJ_0 2024-09-12T19:13:57.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8867286836956946932', time=2024-09-12T21:00:32.289021+0000, chain.objs.size()=1 2024-09-12T19:13:57.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.hWQlpZSNA2x5g9sL0GmMnDm-2uYuZgf_0 2024-09-12T19:13:57.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3661595031279296059', time=2024-09-12T21:00:32.298343+0000, chain.objs.size()=1 2024-09-12T19:13:57.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.rSxYc7B2k4cAUhKIZCKDtKlNYj8aq2i_0 2024-09-12T19:13:57.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6536056325422609538', time=2024-09-12T21:00:32.304100+0000, chain.objs.size()=1 2024-09-12T19:13:57.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.924+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.hH7wyhKPlTqKx-JVFMQnaCALJ2xWcnS_0 2024-09-12T19:13:57.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11630262584268834428', time=2024-09-12T21:00:32.308740+0000, chain.objs.size()=1 2024-09-12T19:13:57.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JQ-jRqDKZrcNXCX5DBQrLCSLQMdSmqV_0 2024-09-12T19:13:57.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6530000067052215027', time=2024-09-12T21:00:32.320353+0000, chain.objs.size()=1 2024-09-12T19:13:57.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Uegt0YDs8ePHouPVESNA6MdxtmCXZVX_0 2024-09-12T19:13:57.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15482728173087618766', time=2024-09-12T21:00:32.337394+0000, chain.objs.size()=1 2024-09-12T19:13:57.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.uAeByGz1tMUFo0C2Z47TteYLF69EaH4_0 2024-09-12T19:13:57.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5309268866407850391', time=2024-09-12T21:00:32.350916+0000, chain.objs.size()=1 2024-09-12T19:13:57.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.nI8AYTBwSqPrWaqQTigyHiOwejkgWUE_0 2024-09-12T19:13:57.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2654795667537944838', time=2024-09-12T21:00:32.446998+0000, chain.objs.size()=1 2024-09-12T19:13:57.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.k0HAKUreSxzxSMJkOWw07vfTQu-Bz-u_0 2024-09-12T19:13:57.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.375575712145541967', time=2024-09-12T21:00:32.477730+0000, chain.objs.size()=1 2024-09-12T19:13:57.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.4-aldwuqRxpL7-hZYpNQBvhKJxhiWHh_0 2024-09-12T19:13:57.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3248675682129092926', time=2024-09-12T21:00:32.535291+0000, chain.objs.size()=1 2024-09-12T19:13:57.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.KHBc3o_JZGQ8HiJ27cLN7cdHsKPJyRE_0 2024-09-12T19:13:57.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16299126757898628595', time=2024-09-12T21:00:32.680621+0000, chain.objs.size()=1 2024-09-12T19:13:57.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.av-j4I4UcTnlQ8Qf8iJbt2U5nr1oJUd_0 2024-09-12T19:13:57.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6665912289067753942', time=2024-09-12T21:00:32.688223+0000, chain.objs.size()=1 2024-09-12T19:13:57.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.HxJERbk9H4pTUlEEXU6dxW5De7Lz0aK_0 2024-09-12T19:13:57.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12365037423509385456', time=2024-09-12T21:00:32.732972+0000, chain.objs.size()=1 2024-09-12T19:13:57.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.yjXdh2B4FOZNTgsVLV_QsmtOrLua1Ik_0 2024-09-12T19:13:57.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12553261970578048519', time=2024-09-12T21:00:32.741874+0000, chain.objs.size()=1 2024-09-12T19:13:57.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.TvOpQGE9Ph9-oUhCwvaH5s6qCZx5mFX_0 2024-09-12T19:13:57.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5392572242950199471', time=2024-09-12T21:00:32.753157+0000, chain.objs.size()=1 2024-09-12T19:13:57.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Z3OvImAPTcEaudEBSpvD0kB7JBw4uFh_0 2024-09-12T19:13:57.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17073783283324375529', time=2024-09-12T21:00:32.763423+0000, chain.objs.size()=1 2024-09-12T19:13:57.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.jWK67bcOLPHn1G9UqxT-2T9UGO2dhuh_0 2024-09-12T19:13:57.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8728367403484356402', time=2024-09-12T21:00:32.773031+0000, chain.objs.size()=1 2024-09-12T19:13:57.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.TYtS1ShdoUyJHQMZIHQdikq5RkQaplf_0 2024-09-12T19:13:57.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8124363345901991378', time=2024-09-12T21:00:33.091989+0000, chain.objs.size()=1 2024-09-12T19:13:57.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.MVAPJ9DxNtJjqTVQkNT0oQsZrauSSls_0 2024-09-12T19:13:57.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15178888117986108392', time=2024-09-12T21:00:33.126181+0000, chain.objs.size()=1 2024-09-12T19:13:57.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.MpE3MnhoeixIwoBMJfaz0rH_LEZXjqx_0 2024-09-12T19:13:57.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10515313066172353105', time=2024-09-12T21:00:33.181015+0000, chain.objs.size()=1 2024-09-12T19:13:57.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SwWDsdaIzKiHPe0z-qPUXmc9fsy-cSi_0 2024-09-12T19:13:57.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10587535398359062176', time=2024-09-12T21:00:33.181745+0000, chain.objs.size()=1 2024-09-12T19:13:57.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.kXYKeeqepBh0N7tDtbdVExtbSzZqSzt_0 2024-09-12T19:13:57.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15236959463724410062', time=2024-09-12T21:00:33.197072+0000, chain.objs.size()=1 2024-09-12T19:13:57.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.928+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Vq2vz_Pl1n88eUGRQ65m2tjx2eIxsuO_0 2024-09-12T19:13:57.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9060841331972744052', time=2024-09-12T21:00:33.207984+0000, chain.objs.size()=1 2024-09-12T19:13:57.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.pREI_69vZpEK38iCfVvLqrE8dxBj9Qg_0 2024-09-12T19:13:57.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12630328230556852334', time=2024-09-12T21:00:33.455270+0000, chain.objs.size()=1 2024-09-12T19:13:57.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JfqRQ2JixRPKzacbPTb-KdwgTgRVO9Z_0 2024-09-12T19:13:57.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7615961902472168706', time=2024-09-12T21:00:33.456470+0000, chain.objs.size()=1 2024-09-12T19:13:57.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.shocTzcMjI9Rlo09ma_wyn49UGBMgmj_0 2024-09-12T19:13:57.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.505462112314623546', time=2024-09-12T21:00:33.491979+0000, chain.objs.size()=1 2024-09-12T19:13:57.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.X5y-8WeUQZG60sbJwluuolHkJh7J3dD_0 2024-09-12T19:13:57.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18225115011062661312', time=2024-09-12T21:00:33.581308+0000, chain.objs.size()=1 2024-09-12T19:13:57.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.GmiO3v1HqmM6Xk1e0umFLbit6egeICd_0 2024-09-12T19:13:57.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.21033654533194408', time=2024-09-12T21:00:33.608700+0000, chain.objs.size()=1 2024-09-12T19:13:57.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.RkK4MHOduny-epKHPNe3fn7HMGomw1n_0 2024-09-12T19:13:57.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11290086628225304892', time=2024-09-12T21:00:33.635967+0000, chain.objs.size()=1 2024-09-12T19:13:57.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.b4NnNhPgCaZyHwhWjbwDEnXxrnEQm8v_0 2024-09-12T19:13:57.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5535091907244951654', time=2024-09-12T21:00:33.639301+0000, chain.objs.size()=1 2024-09-12T19:13:57.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.NrnFtZrvMOJ_l2CU46mHzdyrnYfkB0E_0 2024-09-12T19:13:57.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12704717753628349410', time=2024-09-12T21:00:38.898498+0000, chain.objs.size()=1 2024-09-12T19:13:57.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.269__shadow_.MJzuQ5LmtWdaKQ5r2sNe9rxaXgjdR8d_0 2024-09-12T19:13:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17955277365730785422', time=2024-09-12T21:00:42.459215+0000, chain.objs.size()=1 2024-09-12T19:13:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.274__shadow_.ueDoR8qLa4FbTe1SMZNKg6FV7qzWq3V_0 2024-09-12T19:13:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14509950845122558802', time=2024-09-12T21:00:49.118649+0000, chain.objs.size()=1 2024-09-12T19:13:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.283__shadow_.2lS5Fo4turidVoOH2tVL6ixG6Y0VvgR_0 2024-09-12T19:13:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16244065155520395821', time=2024-09-12T21:01:07.007735+0000, chain.objs.size()=1 2024-09-12T19:13:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.305__shadow_.ol4gBmwjhbitUpGfap9X-3NVyUqehgP_0 2024-09-12T19:13:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13368204410494294067', time=2024-09-12T21:01:07.969014+0000, chain.objs.size()=1 2024-09-12T19:13:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.306__shadow_.KvyFwlz8qLYfAJL26u2ZBSNDyqHn-Iq_0 2024-09-12T19:13:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5080061274661583624', time=2024-09-12T21:01:15.156499+0000, chain.objs.size()=1 2024-09-12T19:13:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.315__shadow_.NBCRizWSYVsSd97TlF6q81sfrbacYIR_0 2024-09-12T19:13:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4973223582388392126', time=2024-09-12T21:01:17.734186+0000, chain.objs.size()=1 2024-09-12T19:13:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.932+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.319__shadow:nb9KOa798wjTx5SvmHqC5P0zSLfJXiz_.ugcOYmbwEh7PhvaUc_HuTyRhPfs2AIs_0 2024-09-12T19:13:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3539978346115173234', time=2024-09-12T21:01:39.441705+0000, chain.objs.size()=1 2024-09-12T19:13:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.pzimuIQri_Cp5D4-eOgrxrw4EJFJsvY_0 2024-09-12T19:13:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11808028660248218512', time=2024-09-12T21:01:39.497852+0000, chain.objs.size()=1 2024-09-12T19:13:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.kISldPT7mi_kVm8BJ2zAsHDRdNFwe6N_0 2024-09-12T19:13:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18366747549362713330', time=2024-09-12T21:01:39.702884+0000, chain.objs.size()=1 2024-09-12T19:13:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.5xLoaZpbA-yn_LD5Tq0v-aD9Hbn4aNh_0 2024-09-12T19:13:57.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12208476134226811703', time=2024-09-12T21:01:39.719082+0000, chain.objs.size()=1 2024-09-12T19:13:57.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ebr5fH8OeCHhmtvm7YKpfJ47eXSoQV4_0 2024-09-12T19:13:57.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17738607540912561608', time=2024-09-12T21:01:39.749496+0000, chain.objs.size()=1 2024-09-12T19:13:57.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.cbrYwyuZd7dTxV6CUUo-g7FNGwJC5UB_0 2024-09-12T19:13:57.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9308724324252113813', time=2024-09-12T21:01:39.895570+0000, chain.objs.size()=1 2024-09-12T19:13:57.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.gh8THHBc5DFVpdd61W6H0sw8C6hk3Nb_0 2024-09-12T19:13:57.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9321573515253332661', time=2024-09-12T21:01:39.911961+0000, chain.objs.size()=1 2024-09-12T19:13:57.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DWAj_ATnRfk05ZP9p7fovlwC1GbmXUx_0 2024-09-12T19:13:57.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7063605140592594184', time=2024-09-12T21:01:39.918512+0000, chain.objs.size()=1 2024-09-12T19:13:57.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.kEtelWnMxuXaJfQGqViTJUVkOt7J-DP_0 2024-09-12T19:13:57.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1067261283361578762', time=2024-09-12T21:01:40.010375+0000, chain.objs.size()=1 2024-09-12T19:13:57.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BN_EvIKY199WPgDECiU_NETSncrU4Lb_0 2024-09-12T19:13:57.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16870825959722030152', time=2024-09-12T21:01:40.020459+0000, chain.objs.size()=1 2024-09-12T19:13:57.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.JHn1Zvf12cEPXj83psniY-wjXpmeb-C_0 2024-09-12T19:13:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14372870107980462679', time=2024-09-12T21:01:40.185746+0000, chain.objs.size()=1 2024-09-12T19:13:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.YVI5NpvAs9DIRf1tOeMf-pTav_VPa4S_0 2024-09-12T19:13:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17146607972208181088', time=2024-09-12T21:01:40.197574+0000, chain.objs.size()=1 2024-09-12T19:13:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.PG6ML4HhgfUngoMvb_V9BzvBad5Fbir_0 2024-09-12T19:13:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10600200559308961189', time=2024-09-12T21:01:40.383502+0000, chain.objs.size()=1 2024-09-12T19:13:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.auTz2doqgiTATgsRoNaHWhsbjp6ZgpE_0 2024-09-12T19:13:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13617703233654579123', time=2024-09-12T21:01:40.406397+0000, chain.objs.size()=1 2024-09-12T19:13:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.48r0oz75H7DRj2Slcr1qH99vvcCOFUn_0 2024-09-12T19:13:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5440434904114429663', time=2024-09-12T21:01:40.413302+0000, chain.objs.size()=1 2024-09-12T19:13:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.i6RfLnGlBzwSxuPB-GyfQCYZNLQbLTs_0 2024-09-12T19:13:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1028716847856050439', time=2024-09-12T21:01:40.415966+0000, chain.objs.size()=1 2024-09-12T19:13:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.yUGGddo9RoSWkx75FwQ6Q5ntgqe6SOV_0 2024-09-12T19:13:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5852479806112607143', time=2024-09-12T21:01:40.461135+0000, chain.objs.size()=1 2024-09-12T19:13:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.zAjuu4KkFaU9Kch3hIBpyFG_P4WZ2jN_0 2024-09-12T19:13:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3209808365635421535', time=2024-09-12T21:01:40.553569+0000, chain.objs.size()=1 2024-09-12T19:13:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ufGICXWXWYwtSUzQj-rpjgypzhiZo8r_0 2024-09-12T19:13:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10798924375680526131', time=2024-09-12T21:01:40.599654+0000, chain.objs.size()=1 2024-09-12T19:13:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.GdrZ1Zy_dFf0kIc5tXbjwfBmcHZtsbH_0 2024-09-12T19:13:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15522926284874596022', time=2024-09-12T21:01:40.615853+0000, chain.objs.size()=1 2024-09-12T19:13:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Qn-PtdupqzliXbaFokNwG-u5Xnu3Jnt_0 2024-09-12T19:13:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12756345801284579673', time=2024-09-12T21:01:40.625973+0000, chain.objs.size()=1 2024-09-12T19:13:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.936+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0ypPtGkBcGbUAvSQ3_aBXhQADKr5r9d_0 2024-09-12T19:13:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10757794560084462142', time=2024-09-12T21:01:40.644390+0000, chain.objs.size()=1 2024-09-12T19:13:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.qxlK-3DoypKjLqVB9R3Txw5BOghdbgr_0 2024-09-12T19:13:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10499104095679694108', time=2024-09-12T21:01:40.647115+0000, chain.objs.size()=1 2024-09-12T19:13:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.6iTCwJOBi9Yo-PGONfuSBfanKEHGzkE_0 2024-09-12T19:13:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17168527857228369954', time=2024-09-12T21:01:40.656710+0000, chain.objs.size()=1 2024-09-12T19:13:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.VpmBb3U6JVy9iGl0UaXH2jzRC9g_V0m_0 2024-09-12T19:13:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2901805580623060700', time=2024-09-12T21:01:40.768706+0000, chain.objs.size()=1 2024-09-12T19:13:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.llbe9DdWvHrpsE0vF82q73eLI_ApzqP_0 2024-09-12T19:13:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10824003407814799556', time=2024-09-12T21:01:40.816523+0000, chain.objs.size()=1 2024-09-12T19:13:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.qte2DeInlEO5xgiCxizXRETeB9Xhgcx_0 2024-09-12T19:13:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16785478381793336830', time=2024-09-12T21:01:40.828360+0000, chain.objs.size()=1 2024-09-12T19:13:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0GzusO22tpvH_x6H_culN7i29mnLxw0_0 2024-09-12T19:13:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16638831885205323340', time=2024-09-12T21:01:40.871976+0000, chain.objs.size()=1 2024-09-12T19:13:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hwk9IrWKLRLdRul59BOnPrL4MN3Qjuo_0 2024-09-12T19:13:57.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1361387946951029831', time=2024-09-12T21:01:40.885491+0000, chain.objs.size()=1 2024-09-12T19:13:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.bFohVW16sEgZNT3Dw2eaKdmIz7A6nY6_0 2024-09-12T19:13:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12090746261672802928', time=2024-09-12T21:01:40.890507+0000, chain.objs.size()=1 2024-09-12T19:13:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.yjwwcI0DWe2_La2LD3xbFz37xl9czUa_0 2024-09-12T19:13:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.637246271519124779', time=2024-09-12T21:01:41.015191+0000, chain.objs.size()=1 2024-09-12T19:13:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._83NoWwsiEdG9Nv5WPmYBqqoqTuo1Zs_0 2024-09-12T19:13:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8547880500265881842', time=2024-09-12T21:01:41.043410+0000, chain.objs.size()=1 2024-09-12T19:13:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.FI821Axj_5y33cZx8VLtVCWpuTsrfar_0 2024-09-12T19:13:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16508064945425447753', time=2024-09-12T21:01:41.073615+0000, chain.objs.size()=1 2024-09-12T19:13:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.NoKOPIEvUyTvkB1OpJFSEi3SX9RdJjf_0 2024-09-12T19:13:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4904086639265208876', time=2024-09-12T21:02:00.610149+0000, chain.objs.size()=1 2024-09-12T19:13:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.XoJcUul_AZznunIwBduxR2FRkrSW8lC_0 2024-09-12T19:13:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8109537799496239917', time=2024-09-12T21:02:00.624306+0000, chain.objs.size()=1 2024-09-12T19:13:57.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.KGYJEcirSlgDlxLg0AsJs_7LY7-YHaJ_0 2024-09-12T19:13:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4143275592578391044', time=2024-09-12T21:02:00.633144+0000, chain.objs.size()=1 2024-09-12T19:13:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.RNnR5qiAQiCwWXorvoDLAOeypKqUDzk_0 2024-09-12T19:13:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7453065798240424100', time=2024-09-12T21:02:00.642936+0000, chain.objs.size()=1 2024-09-12T19:13:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.IkTq_pdfAgzYYT8IHZu3UrB9pztDHUL_0 2024-09-12T19:13:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4998506790275751785', time=2024-09-12T21:02:00.772664+0000, chain.objs.size()=1 2024-09-12T19:13:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8vrLbg0176J-yILuQR5itUtOGevBTXa_0 2024-09-12T19:13:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.62921593624229593', time=2024-09-12T21:02:00.816830+0000, chain.objs.size()=1 2024-09-12T19:13:57.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.940+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.BTMunWCpAMCfkxbTpCIJikZe5ff9o9Z_0 2024-09-12T19:13:57.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18022398673518667042', time=2024-09-12T21:02:00.820335+0000, chain.objs.size()=1 2024-09-12T19:13:57.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-9MH83YBhT3dJLHY9ruEeEFUSJ1fk9f_0 2024-09-12T19:13:57.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9620489761988414856', time=2024-09-12T21:02:00.846301+0000, chain.objs.size()=1 2024-09-12T19:13:57.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.JNQ8puYtC9zlemz9jBfzvZcHIs6gPCJ_0 2024-09-12T19:13:57.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5844026956564034261', time=2024-09-12T21:02:01.001190+0000, chain.objs.size()=1 2024-09-12T19:13:57.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WdLhyOcRvvmLUrQddudOjl9krvIQOZP_0 2024-09-12T19:13:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13815433616316519041', time=2024-09-12T21:02:01.007169+0000, chain.objs.size()=1 2024-09-12T19:13:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.rJi4RrM8IS0W6aXXejZQPmeqdLczNLf_0 2024-09-12T19:13:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.47378825017134774', time=2024-09-12T21:02:01.030157+0000, chain.objs.size()=1 2024-09-12T19:13:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5yJrTl85iqCRq6pbrBrHaQxnbxiht03_0 2024-09-12T19:13:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16817562012793117696', time=2024-09-12T21:02:01.063660+0000, chain.objs.size()=1 2024-09-12T19:13:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.i8JalDXJji4uLqTv8nehRf_ToHfHw4c_0 2024-09-12T19:13:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.802145759596103456', time=2024-09-12T21:02:01.091429+0000, chain.objs.size()=1 2024-09-12T19:13:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.PRIOkT9ebc14-wcTDXIngiyacsvDiFL_0 2024-09-12T19:13:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.819307623284818937', time=2024-09-12T21:02:01.103083+0000, chain.objs.size()=1 2024-09-12T19:13:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.DPR1wPdyO5O96L7Iy9q8m0ZPwa680hm_0 2024-09-12T19:13:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14682593021528273273', time=2024-09-12T21:02:01.250176+0000, chain.objs.size()=1 2024-09-12T19:13:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.67pwWjqmY8Pe4CmRWHfMJJwxUjVWe68_0 2024-09-12T19:13:57.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10372534112672905702', time=2024-09-12T21:02:01.273987+0000, chain.objs.size()=1 2024-09-12T19:13:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.SQ25xnhLRleXM1_hOBeIKnCg6wMUC3f_0 2024-09-12T19:13:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5062148713534463421', time=2024-09-12T21:02:01.292115+0000, chain.objs.size()=1 2024-09-12T19:13:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.diHqsX2TXKI1mHCHBj7qRxeXM9qCYu8_0 2024-09-12T19:13:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11962078078380796401', time=2024-09-12T21:02:01.294380+0000, chain.objs.size()=1 2024-09-12T19:13:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.I2qUp1nlof9CGi79zLikPIAV6Tuujsk_0 2024-09-12T19:13:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10564191344725871005', time=2024-09-12T21:02:01.296996+0000, chain.objs.size()=1 2024-09-12T19:13:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.QP9n_cLnIB-dy2ccTU7K1xHadqW4WUG_0 2024-09-12T19:13:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11799348639511691866', time=2024-09-12T21:02:01.302193+0000, chain.objs.size()=1 2024-09-12T19:13:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.944+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.CjDXvUODg_wjfHsYC4qkGGWeT6W1-jP_0 2024-09-12T19:13:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.948+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5955139731676793080', time=2024-09-12T21:02:01.316789+0000, chain.objs.size()=1 2024-09-12T19:13:57.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.948+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5qROsOIA9tcbb019H63KT8Cu-263BEA_0 2024-09-12T19:13:57.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.948+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45772 2024-09-12T19:13:57.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T19:13:57.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5375557064279926155', time=2024-09-12T21:02:01.447321+0000, chain.objs.size()=1 2024-09-12T19:13:57.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NWKPmRPueI0gNBVd0hNSCCBdtWbbdTL_0 2024-09-12T19:13:57.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8243929226115893792', time=2024-09-12T21:02:01.448687+0000, chain.objs.size()=1 2024-09-12T19:13:57.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.x2SbCp1tn6DB_h6rMP39ngEqjzpbGGG_0 2024-09-12T19:13:57.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9559246006173230899', time=2024-09-12T21:02:01.481333+0000, chain.objs.size()=1 2024-09-12T19:13:57.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ApxSOD7N0zlzjvUgZeopMmDZKFPIvgI_0 2024-09-12T19:13:57.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17391189264145862084', time=2024-09-12T21:02:01.495851+0000, chain.objs.size()=1 2024-09-12T19:13:57.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jc-8KOwHnPpnw47r3Avb5Ysd-4_44my_0 2024-09-12T19:13:57.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3429595244411367461', time=2024-09-12T21:02:01.497828+0000, chain.objs.size()=1 2024-09-12T19:13:57.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.n-xDP-KYrgv_tbrn76TBjc_ZSQIuVoH_0 2024-09-12T19:13:57.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6916027923750701435', time=2024-09-12T21:02:01.520415+0000, chain.objs.size()=1 2024-09-12T19:13:57.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.J6z2l2cQOopA0WHVB3axEM9RTUiqyH__0 2024-09-12T19:13:57.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5626794130141998831', time=2024-09-12T21:02:01.553893+0000, chain.objs.size()=1 2024-09-12T19:13:57.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.tAqCuxsS3DSosqR-dBdp79Xfb55SH-U_0 2024-09-12T19:13:57.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16717455963487821915', time=2024-09-12T21:02:01.760556+0000, chain.objs.size()=1 2024-09-12T19:13:57.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qw_flLh53bxHBWMHosYb9_djC3SGH8B_0 2024-09-12T19:13:57.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18050543593264869401', time=2024-09-12T21:02:01.951098+0000, chain.objs.size()=1 2024-09-12T19:13:57.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.rqcP9UeEryH3BE6FJlsAdei47NAlRHL_0 2024-09-12T19:13:57.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4751643989561685041', time=2024-09-12T21:02:01.969657+0000, chain.objs.size()=1 2024-09-12T19:13:57.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-FPy9_0QbH1VRM-EfWGNr6ZUqat5y3D_0 2024-09-12T19:13:57.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15863165405348966453', time=2024-09-12T21:02:01.972012+0000, chain.objs.size()=1 2024-09-12T19:13:57.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.TBI9A6BwoMp1cZraa4MSc7sah_Hk3yU_0 2024-09-12T19:13:57.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15994974149138653630', time=2024-09-12T21:02:01.977661+0000, chain.objs.size()=1 2024-09-12T19:13:57.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.952+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.oNCdAWuUbUeC54cPEnlhwhozQwqrs4H_0 2024-09-12T19:13:57.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5507931096761407393', time=2024-09-12T21:02:01.992627+0000, chain.objs.size()=1 2024-09-12T19:13:57.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-xLN2Y91UMABC7jErsuhcjZxexBTHGz_0 2024-09-12T19:13:57.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9174913296137407694', time=2024-09-12T21:02:02.111213+0000, chain.objs.size()=1 2024-09-12T19:13:57.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yulXEmjEZy4WXPQ9nHtEiC8Z2uNGvs2_0 2024-09-12T19:13:57.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7458801660280716470', time=2024-09-12T21:02:02.153376+0000, chain.objs.size()=1 2024-09-12T19:13:57.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8X646e9YGAw9smioCVC7X6tJerO1ENb_0 2024-09-12T19:13:57.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3543755664119690173', time=2024-09-12T21:02:02.172629+0000, chain.objs.size()=1 2024-09-12T19:13:57.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.QRTPGeX0Z3FM4E7gytBFap3RR1aPNhs_0 2024-09-12T19:13:57.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.760667213548960444', time=2024-09-12T21:02:42.349474+0000, chain.objs.size()=1 2024-09-12T19:13:57.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.384__shadow_.8Rie9t6T1SHwHbfvXPYQZmzzfn0Z3oc_0 2024-09-12T19:13:57.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2042913738620811317', time=2024-09-12T21:03:00.737598+0000, chain.objs.size()=1 2024-09-12T19:13:57.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.409__shadow_.yQvWRN__VStlDsCpsdjqv85dlZoKgF3_0 2024-09-12T19:13:57.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10254919036903129301', time=2024-09-12T21:03:41.258390+0000, chain.objs.size()=1 2024-09-12T19:13:57.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.460__shadow_.TA_6p004gK3Uk3cnCxXiqeg2uwQs7Yi_0 2024-09-12T19:13:57.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17645439560908722522', time=2024-09-12T21:03:55.577783+0000, chain.objs.size()=1 2024-09-12T19:13:57.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.483__shadow_.PAnPFgryz4XP_ViAnzkTS6PcEivD25T_0 2024-09-12T19:13:57.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8063717157857893719', time=2024-09-12T21:06:20.377479+0000, chain.objs.size()=1 2024-09-12T19:13:57.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.575__shadow:gIMoquq577KRniHiYL6DpPuAvi3bD6n_.rmdZrrPqEScoQb-zt80dpzH3pcs6mHP_0 2024-09-12T19:13:57.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9648732637820280357', time=2024-09-12T21:06:24.595255+0000, chain.objs.size()=1 2024-09-12T19:13:57.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.576__shadow:snrYl.WXAMOQrptvfile2zneEOQ2lHL_.zuR02E_ZpQMuumaYG5aTc7Y1CfxpHz0_0 2024-09-12T19:13:57.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3929316121639565231', time=2024-09-12T21:06:36.452174+0000, chain.objs.size()=1 2024-09-12T19:13:57.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:iJBbgUI2b1NZtZkWE65P9YKrm3kpTlA_.jKB6JehASGm2uUsHUgaul8NMDoW7kQN_0 2024-09-12T19:13:57.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3463079767266740565', time=2024-09-12T21:06:40.223796+0000, chain.objs.size()=1 2024-09-12T19:13:57.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:BGAlbFzW-lzVGFeRhxCr3rRv24OUBku_.p1DYNNdOxHUMk6LbmBRGxnC4dnnR3H9_0 2024-09-12T19:13:57.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14155817304373901786', time=2024-09-12T21:06:44.363884+0000, chain.objs.size()=4 2024-09-12T19:13:57.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.578__multipart_testobj.2~6U47yyUO1eost1oUL2feWj8JHwuu9T0.1 2024-09-12T19:13:57.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.578__multipart_testobj.2~6U47yyUO1eost1oUL2feWj8JHwuu9T0.2 2024-09-12T19:13:57.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.578__multipart_testobj.2~6U47yyUO1eost1oUL2feWj8JHwuu9T0.3 2024-09-12T19:13:57.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.578__multipart_testobj.2~6U47yyUO1eost1oUL2feWj8JHwuu9T0.4 2024-09-12T19:13:57.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13104612145307723392', time=2024-09-12T21:06:46.408677+0000, chain.objs.size()=1 2024-09-12T19:13:57.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.579__shadow:8Q.6OwqJ-wSvNxRC2lE4-GgJfLWo83S_.4-gXkFqvcQqF4KN4buWpJman_bj7jd5_0 2024-09-12T19:13:57.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9125973779460972046', time=2024-09-12T21:10:11.270747+0000, chain.objs.size()=1 2024-09-12T19:13:57.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.670__shadow_.AkB4fp9TyRtpiwjgIeSmlziS60Se_jB_0 2024-09-12T19:13:57.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.887467597584367120', time=2024-09-12T21:10:40.307148+0000, chain.objs.size()=1 2024-09-12T19:13:57.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.714__shadow:aKnjadngm0oihn-ylniLz6x0RQRilk0_.6uCBZD2FKTeb5c8Km6iJ-b0mFXkvJSF_0 2024-09-12T19:13:57.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11386102460120029404', time=2024-09-12T21:11:02.489969+0000, chain.objs.size()=1 2024-09-12T19:13:57.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.719__shadow_.hFX22mRdYuW9pH5SpRC75S4nGz1bFU2_0 2024-09-12T19:13:57.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4045480713325771459', time=2024-09-12T21:11:02.491880+0000, chain.objs.size()=1 2024-09-12T19:13:57.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.956+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.719__shadow_.hFX22mRdYuW9pH5SpRC75S4nGz1bFU2_0 2024-09-12T19:13:57.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.960+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:57.965 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.960+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T19:13:57.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:57.966 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:57.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/55681' 2024-09-12T19:13:57.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12265422559097735259', time=2024-09-12T20:57:59.897985+0000, chain.objs.size()=1 2024-09-12T19:13:57.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.183__shadow_.JP7SaAHCTlKlz3Y7PXDcGUWsIrGMyNj_0 2024-09-12T19:13:57.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15865377000100621139', time=2024-09-12T20:59:53.581113+0000, chain.objs.size()=1 2024-09-12T19:13:57.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.237__shadow_.Heklb4gWAqQf3tcXCWguv7KLZVwQ8YJ_0 2024-09-12T19:13:57.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8480536926181097916', time=2024-09-12T20:59:58.867545+0000, chain.objs.size()=1 2024-09-12T19:13:57.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.243__shadow_.bKDygIjlXf5HcRLQoWYC6q0_7Q53fuM_0 2024-09-12T19:13:57.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8729677221993237363', time=2024-09-12T21:00:00.079805+0000, chain.objs.size()=1 2024-09-12T19:13:57.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.244__shadow_.zjqllhU_IbRTgFdWjXP6zoglGRcc_9u_0 2024-09-12T19:13:57.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3127926819078081443', time=2024-09-12T21:00:31.992701+0000, chain.objs.size()=1 2024-09-12T19:13:57.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.QARfB4XdLoEiCKKvePIcPJd5LdCDsRG_0 2024-09-12T19:13:57.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2084161084769167543', time=2024-09-12T21:00:32.046589+0000, chain.objs.size()=1 2024-09-12T19:13:57.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.93vwsOPLSPq8KjiNV6zZN6pVLT0sjUy_0 2024-09-12T19:13:57.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18275883276847476265', time=2024-09-12T21:00:32.056268+0000, chain.objs.size()=1 2024-09-12T19:13:57.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.OshRQ76JwZJTxGVeo6lDF_gRdE_n1ck_0 2024-09-12T19:13:57.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13204770894274135793', time=2024-09-12T21:00:32.277092+0000, chain.objs.size()=1 2024-09-12T19:13:57.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CXDBzUJd-vbs__Ow9N1tLGDTf6yUIlg_0 2024-09-12T19:13:57.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1882061294605279991', time=2024-09-12T21:00:32.313274+0000, chain.objs.size()=1 2024-09-12T19:13:57.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DpVJ3PmL2dcuJ1bBdGz14UAPmqd8D9-_0 2024-09-12T19:13:57.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7274184106513141557', time=2024-09-12T21:00:32.450425+0000, chain.objs.size()=1 2024-09-12T19:13:57.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.bnr7GCfCPsDGIpWqhikpQ3NXF_Q_Z5T_0 2024-09-12T19:13:57.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3351467500728600764', time=2024-09-12T21:00:32.452358+0000, chain.objs.size()=1 2024-09-12T19:13:57.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.BxeslAb411tuOhdylFz9vHy-nW1PkN3_0 2024-09-12T19:13:57.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10371559390134727667', time=2024-09-12T21:00:32.473590+0000, chain.objs.size()=1 2024-09-12T19:13:57.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Q8kntrsy0gA3Ne8uhi-55uWeSrj3SOh_0 2024-09-12T19:13:57.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14765128655921138976', time=2024-09-12T21:00:32.487346+0000, chain.objs.size()=1 2024-09-12T19:13:57.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LhNxGvN9-Trx6nBbOKcymJmXsksT7lv_0 2024-09-12T19:13:57.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2259653739458855071', time=2024-09-12T21:00:32.494689+0000, chain.objs.size()=1 2024-09-12T19:13:57.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.QOXRGV2Sf589ka1SNrSRWUGuQ_iaK3i_0 2024-09-12T19:13:57.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17566899413386428546', time=2024-09-12T21:00:32.537766+0000, chain.objs.size()=1 2024-09-12T19:13:57.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.V8fLtN5mniy73viJDCHk5RPawGXWWBk_0 2024-09-12T19:13:57.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5930911313734484302', time=2024-09-12T21:00:32.700275+0000, chain.objs.size()=1 2024-09-12T19:13:57.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.964+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WaWUKwQ_vrUEB684TAJnKxmV0W3ZUgB_0 2024-09-12T19:13:57.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9750202568958361374', time=2024-09-12T21:00:32.729441+0000, chain.objs.size()=1 2024-09-12T19:13:57.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.uK_IK5FZKOpNsDhUL-jHTDq2eXS4rL3_0 2024-09-12T19:13:57.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14350957404201788645', time=2024-09-12T21:00:32.744661+0000, chain.objs.size()=1 2024-09-12T19:13:57.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.jb7fKXS7bzRTqExQ7poSZE8PHnlTI1b_0 2024-09-12T19:13:57.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2569833952490663362', time=2024-09-12T21:00:32.774664+0000, chain.objs.size()=1 2024-09-12T19:13:57.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.FGPZyi6R1a4x4X1yn0imxEEzKYMx477_0 2024-09-12T19:13:57.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.783308089633770877', time=2024-09-12T21:00:32.906960+0000, chain.objs.size()=1 2024-09-12T19:13:57.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.pX8KgTVYatoiI_3AuHxQgMENCRNFeac_0 2024-09-12T19:13:57.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6251543033511619299', time=2024-09-12T21:00:32.912713+0000, chain.objs.size()=1 2024-09-12T19:13:57.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.lHWctvdtas1zN4lyfPEY_zkfkAW1F75_0 2024-09-12T19:13:57.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10092843430316996470', time=2024-09-12T21:00:32.991224+0000, chain.objs.size()=1 2024-09-12T19:13:57.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.cQTWeul0i81K76RMYlBwv64lJFKKYBe_0 2024-09-12T19:13:57.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12249583729635671695', time=2024-09-12T21:00:32.996484+0000, chain.objs.size()=1 2024-09-12T19:13:57.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.BZV9PcT7OjyblvTkraaMDREVZI58lll_0 2024-09-12T19:13:57.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11742787205636996238', time=2024-09-12T21:00:33.097337+0000, chain.objs.size()=1 2024-09-12T19:13:57.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Lw-IXw9B63I1Ja6cZ-gx74Tvv-JyfQ7_0 2024-09-12T19:13:57.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18116969570471025545', time=2024-09-12T21:00:33.193987+0000, chain.objs.size()=1 2024-09-12T19:13:57.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XqEQ4b2f96HS3uXeivvMNFwdsNXLg1W_0 2024-09-12T19:13:57.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6850768303433147234', time=2024-09-12T21:00:33.206254+0000, chain.objs.size()=1 2024-09-12T19:13:57.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.MjsE7fo13tfH9_lCRb6ni5EMGj60Yfz_0 2024-09-12T19:13:57.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6787263384260835639', time=2024-09-12T21:00:33.387024+0000, chain.objs.size()=1 2024-09-12T19:13:57.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sKkAyyOGVvwy5tCfEMDOvbUCkw2UtYk_0 2024-09-12T19:13:57.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3325394328357053278', time=2024-09-12T21:00:33.394248+0000, chain.objs.size()=1 2024-09-12T19:13:57.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ixK91aDfpv-5e996t8ovEKPKKaaXufW_0 2024-09-12T19:13:57.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14004130619927393882', time=2024-09-12T21:00:33.401662+0000, chain.objs.size()=1 2024-09-12T19:13:57.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.1aX_quzym1aqHpfkag_pwwcaojHXiNW_0 2024-09-12T19:13:57.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4017361990937612053', time=2024-09-12T21:00:33.405617+0000, chain.objs.size()=1 2024-09-12T19:13:57.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Cw-5Hxu0ZsrOU9onn-oqZRPmOf3kW2o_0 2024-09-12T19:13:57.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12307414898923293039', time=2024-09-12T21:00:33.408308+0000, chain.objs.size()=1 2024-09-12T19:13:57.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.9d1uwdTLzyA60cD53kYd4u_EUXGrdOE_0 2024-09-12T19:13:57.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2974946499686106386', time=2024-09-12T21:00:33.485768+0000, chain.objs.size()=1 2024-09-12T19:13:57.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Q3ioG--sCMjSRu4Za9ic_2mjffV7rih_0 2024-09-12T19:13:57.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14526117595756311819', time=2024-09-12T21:00:33.605136+0000, chain.objs.size()=1 2024-09-12T19:13:57.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.r-jvphR-S89aTXRLv63nJf3Pr_X5ko0_0 2024-09-12T19:13:57.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13001998253563264769', time=2024-09-12T21:00:33.606376+0000, chain.objs.size()=1 2024-09-12T19:13:57.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.oFtGCNN2i6BAUQWJypU2nSr7XSMXVMz_0 2024-09-12T19:13:57.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6289362451389176680', time=2024-09-12T21:00:33.609171+0000, chain.objs.size()=1 2024-09-12T19:13:57.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tslgeCOjV9yXKO27b53517bGDWmYCl3_0 2024-09-12T19:13:57.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9922238888241224161', time=2024-09-12T21:00:33.871546+0000, chain.objs.size()=1 2024-09-12T19:13:57.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.zqyaN70ZvjPftsBunJCyhw1q686Amrf_0 2024-09-12T19:13:57.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14050020142642770055', time=2024-09-12T21:00:39.603082+0000, chain.objs.size()=1 2024-09-12T19:13:57.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.968+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.270__shadow_.6gMlcdfhP0PNCk7YbG91A2nfgdYaCS9_0 2024-09-12T19:13:57.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10097838295178430319', time=2024-09-12T21:00:56.713687+0000, chain.objs.size()=1 2024-09-12T19:13:57.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.jR5ZatTW4uhoaX8w8bsGBj52k40677w_0 2024-09-12T19:13:57.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7134897031700482886', time=2024-09-12T21:01:39.437613+0000, chain.objs.size()=1 2024-09-12T19:13:57.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.rzyTu3eGYjh_K9WfzoXakR5a24Y0L2A_0 2024-09-12T19:13:57.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16232356478387310708', time=2024-09-12T21:01:39.501345+0000, chain.objs.size()=1 2024-09-12T19:13:57.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.JmatVLugixza7mm7IX1y96aAVO9b7Nh_0 2024-09-12T19:13:57.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16699179506261423603', time=2024-09-12T21:01:39.525636+0000, chain.objs.size()=1 2024-09-12T19:13:57.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.H1aXgzpALOyG_Buxvoe89NiJbJvMN7E_0 2024-09-12T19:13:57.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10000104866651273329', time=2024-09-12T21:01:39.531909+0000, chain.objs.size()=1 2024-09-12T19:13:57.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.U47KVg-MPPR67G1FbKG3dcpt5uMHfef_0 2024-09-12T19:13:57.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1970752391151966540', time=2024-09-12T21:01:39.546411+0000, chain.objs.size()=1 2024-09-12T19:13:57.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.g8l8tswc9lybQZvoUU2ylFa48K6VafR_0 2024-09-12T19:13:57.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6261304155368746982', time=2024-09-12T21:01:39.680921+0000, chain.objs.size()=1 2024-09-12T19:13:57.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.TVpZleFOuaz1Rwtio3_V64q-MRfzd-W_0 2024-09-12T19:13:57.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17083065617807989603', time=2024-09-12T21:01:39.727168+0000, chain.objs.size()=1 2024-09-12T19:13:57.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.q7d1hHsPavco5RsVJz2mMYnkSj2zB2L_0 2024-09-12T19:13:57.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6817564712292051490', time=2024-09-12T21:01:39.754095+0000, chain.objs.size()=1 2024-09-12T19:13:57.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.tRDHp7gI2ZF3KrgKtxkJ0FsR8hnq9vy_0 2024-09-12T19:13:57.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6322762609689236873', time=2024-09-12T21:01:39.777235+0000, chain.objs.size()=1 2024-09-12T19:13:57.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.FkIHFQ-1Fc5amj_F72YLPTT2H0JJ6zV_0 2024-09-12T19:13:57.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12260694351515067679', time=2024-09-12T21:01:39.964098+0000, chain.objs.size()=1 2024-09-12T19:13:57.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ZhdwW0lQMNIcCUdia6cLfvFkGkzE99e_0 2024-09-12T19:13:57.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9195777285249795578', time=2024-09-12T21:01:39.967450+0000, chain.objs.size()=1 2024-09-12T19:13:57.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.33Wyx6ybxOnG0kic81p01GgWmSgxYGE_0 2024-09-12T19:13:57.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10151395719519283367', time=2024-09-12T21:01:39.978500+0000, chain.objs.size()=1 2024-09-12T19:13:57.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.MAREJadxC563oZAbZLNjSN--2uAaoZD_0 2024-09-12T19:13:57.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2573671903022987109', time=2024-09-12T21:01:39.992218+0000, chain.objs.size()=1 2024-09-12T19:13:57.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.VUBOC9RqvR_cMqvrS4PrN7RTTGpyjq6_0 2024-09-12T19:13:57.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7148207336146520765', time=2024-09-12T21:01:40.023039+0000, chain.objs.size()=1 2024-09-12T19:13:57.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.972+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.VM3fg-VGSH5CtGHndgqAwFdBGs1I6Hx_0 2024-09-12T19:13:57.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4791376089455309973', time=2024-09-12T21:01:40.116293+0000, chain.objs.size()=1 2024-09-12T19:13:57.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._-ak93_p3oTX78edV4BiVh6SNgiRqhp_0 2024-09-12T19:13:57.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.366277101755994606', time=2024-09-12T21:01:40.151813+0000, chain.objs.size()=1 2024-09-12T19:13:57.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.7_6WP0G7_ciU9n6Ytbm4GZ-xOo_tWln_0 2024-09-12T19:13:57.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6575331355614802050', time=2024-09-12T21:01:40.163866+0000, chain.objs.size()=1 2024-09-12T19:13:57.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9osF2XtJBM3ywtBVTTKh9cLRAQbuoc2_0 2024-09-12T19:13:57.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17362152448806470253', time=2024-09-12T21:01:40.170174+0000, chain.objs.size()=1 2024-09-12T19:13:57.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.1XGc-EIt01ACN-bMN16d1pxWsfiG59Q_0 2024-09-12T19:13:57.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18203313895702526064', time=2024-09-12T21:01:40.180217+0000, chain.objs.size()=1 2024-09-12T19:13:57.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.8Dh9-GkKBLlDxCUmOhtw8zyPFfszVIm_0 2024-09-12T19:13:57.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9392582518274031320', time=2024-09-12T21:01:40.209382+0000, chain.objs.size()=1 2024-09-12T19:13:57.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.UNE-OS1hfJKx7m1p4ElKv7ilTcJSvnU_0 2024-09-12T19:13:57.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2627035966423035231', time=2024-09-12T21:01:40.393244+0000, chain.objs.size()=1 2024-09-12T19:13:57.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Jm6nxKESSEUsoiVyu67jMXFi5KrQiAh_0 2024-09-12T19:13:57.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15719226709262295541', time=2024-09-12T21:01:40.408578+0000, chain.objs.size()=1 2024-09-12T19:13:57.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.cbcpLMMGm2vZg3Q5P3VxVTJ_YhKmQLe_0 2024-09-12T19:13:57.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5573088169637313132', time=2024-09-12T21:01:40.422274+0000, chain.objs.size()=1 2024-09-12T19:13:57.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.SjeMA9g8mSV3B6_RcGarx6XdkxE7MAs_0 2024-09-12T19:13:57.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17116969646286871251', time=2024-09-12T21:01:40.556619+0000, chain.objs.size()=1 2024-09-12T19:13:57.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Fr2FBjXCH_FyytvXc62dbW5LZgDs-qE_0 2024-09-12T19:13:57.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10116980583785036848', time=2024-09-12T21:01:40.557646+0000, chain.objs.size()=1 2024-09-12T19:13:57.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.q7KKOZHPX15IQN6YPN-SRaG81395SQA_0 2024-09-12T19:13:57.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14908763317483659154', time=2024-09-12T21:01:40.661363+0000, chain.objs.size()=1 2024-09-12T19:13:57.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.969AiPyF9XOzyEMiGgoXpqI_VyJiHpb_0 2024-09-12T19:13:57.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16740123367645745063', time=2024-09-12T21:01:40.815221+0000, chain.objs.size()=1 2024-09-12T19:13:57.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.OVE4kMu6TgQ1kEYn03oYarkf3Vn5Yzv_0 2024-09-12T19:13:57.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5632591792950327635', time=2024-09-12T21:01:40.847169+0000, chain.objs.size()=1 2024-09-12T19:13:57.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.A-lvhHzsBHg-d9J8xRMJ7pq4RWn1YUp_0 2024-09-12T19:13:57.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11260467988440647706', time=2024-09-12T21:01:41.049145+0000, chain.objs.size()=1 2024-09-12T19:13:57.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.WpqlZUPnUy6yC-WB5x2MoWmzNaX0gJC_0 2024-09-12T19:13:57.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1693800263651404105', time=2024-09-12T21:01:41.064374+0000, chain.objs.size()=1 2024-09-12T19:13:57.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.F7JVVxa2WCAgmtDb5l4vp8OMftF9HuO_0 2024-09-12T19:13:57.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17038767150260819271', time=2024-09-12T21:02:00.530384+0000, chain.objs.size()=1 2024-09-12T19:13:57.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.976+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.aQJicuY0m56qVLeTAmKhGSY-RyS5lin_0 2024-09-12T19:13:57.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15614752139372722409', time=2024-09-12T21:02:00.568494+0000, chain.objs.size()=1 2024-09-12T19:13:57.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Wj5J5bDDJOsQRUV4fvVJg6Zy-WwSJAt_0 2024-09-12T19:13:57.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6738858270924662200', time=2024-09-12T21:02:00.603184+0000, chain.objs.size()=1 2024-09-12T19:13:57.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-F2Jwi2tDYGa-GBE4occ50tPBNbSlHs_0 2024-09-12T19:13:57.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15922713980141463152', time=2024-09-12T21:02:00.604085+0000, chain.objs.size()=1 2024-09-12T19:13:57.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0_r18XB1DyOUuIyppigcSVmhMzSlXPV_0 2024-09-12T19:13:57.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4441272908837064144', time=2024-09-12T21:02:00.651397+0000, chain.objs.size()=1 2024-09-12T19:13:57.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WqzBjUSwp_HH4AcFVOmXgiQpICiz6BG_0 2024-09-12T19:13:57.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5274923047693242612', time=2024-09-12T21:02:00.825406+0000, chain.objs.size()=1 2024-09-12T19:13:57.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.St7877y4TCrA8C2JIxQHU75N5J9hYG1_0 2024-09-12T19:13:57.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17991590236877963418', time=2024-09-12T21:02:00.839920+0000, chain.objs.size()=1 2024-09-12T19:13:57.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.xu04XtQdnyYf5xwuTgwIEtopOam0d1W_0 2024-09-12T19:13:57.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9520197814306388324', time=2024-09-12T21:02:00.873979+0000, chain.objs.size()=1 2024-09-12T19:13:57.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Zvjl_1LXTHSXELNqCb2RZXV5M3EiX9Q_0 2024-09-12T19:13:57.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2260046079201633165', time=2024-09-12T21:02:01.020631+0000, chain.objs.size()=1 2024-09-12T19:13:57.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.xKsCUakEOWc4pBMqWAXgqYc6pkOV7U1_0 2024-09-12T19:13:57.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4569662290735259493', time=2024-09-12T21:02:01.080062+0000, chain.objs.size()=1 2024-09-12T19:13:57.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.o7WevMKA1TgP9VnxvBHPAniPkUipJy0_0 2024-09-12T19:13:57.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6716632818064999158', time=2024-09-12T21:02:01.086625+0000, chain.objs.size()=1 2024-09-12T19:13:57.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.vHDeHGUoflkM3Wqidl09gVP_TQB-YDZ_0 2024-09-12T19:13:57.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10823905320731608781', time=2024-09-12T21:02:01.089464+0000, chain.objs.size()=1 2024-09-12T19:13:57.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Jm_IGukbyXVZ9qCaJbL3UTO7GihHN9s_0 2024-09-12T19:13:57.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16915600783672201297', time=2024-09-12T21:02:01.110812+0000, chain.objs.size()=1 2024-09-12T19:13:57.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._bck4jD0qT1kB6UgviMNmGZZsiunVgt_0 2024-09-12T19:13:57.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10916635552095557476', time=2024-09-12T21:02:01.114368+0000, chain.objs.size()=1 2024-09-12T19:13:57.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.S9HXzOb2gpyW4lagWzDJYEdDDYzsr2x_0 2024-09-12T19:13:57.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18171849206545857011', time=2024-09-12T21:02:01.318249+0000, chain.objs.size()=1 2024-09-12T19:13:57.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.74Ct8vcvloh9QfgRML7u8WNEWzZDEil_0 2024-09-12T19:13:57.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14035423844057893603', time=2024-09-12T21:02:01.345347+0000, chain.objs.size()=1 2024-09-12T19:13:57.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.VzD-MvyowQMiQ0SAopMAY576O9NDwtI_0 2024-09-12T19:13:57.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3205562677782071684', time=2024-09-12T21:02:01.348107+0000, chain.objs.size()=1 2024-09-12T19:13:57.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.KnsHH_KICLPl0O_16vHCWZvHxKUuNHA_0 2024-09-12T19:13:57.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5539747280202255286', time=2024-09-12T21:02:01.443849+0000, chain.objs.size()=1 2024-09-12T19:13:57.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jBcbwBxc-LGnyxurv6Zp1DVvA6sswv3_0 2024-09-12T19:13:57.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1554709234155133416', time=2024-09-12T21:02:01.468411+0000, chain.objs.size()=1 2024-09-12T19:13:57.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.FGuPLkFjardArQir3upz0rfmhoNM5DA_0 2024-09-12T19:13:57.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4372660632287089201', time=2024-09-12T21:02:01.483757+0000, chain.objs.size()=1 2024-09-12T19:13:57.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.980+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.PiJj-dhVsnA0fJXTcQPWM5T3nCFjDj9_0 2024-09-12T19:13:57.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10883117566888125726', time=2024-09-12T21:02:01.531590+0000, chain.objs.size()=1 2024-09-12T19:13:57.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.HaO4psF8oey6MOQnpwOYO4hh81pz5_U_0 2024-09-12T19:13:57.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12173007409000250724', time=2024-09-12T21:02:01.539675+0000, chain.objs.size()=1 2024-09-12T19:13:57.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.XiIc88cSi0HmcPad_IyTtmfMmaRh-Ng_0 2024-09-12T19:13:57.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.227811581159204198', time=2024-09-12T21:02:01.552316+0000, chain.objs.size()=1 2024-09-12T19:13:57.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.iFG_9sTjEpuQCA34u1_JHDHk5xNZcvH_0 2024-09-12T19:13:57.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.572122381820218796', time=2024-09-12T21:02:01.553923+0000, chain.objs.size()=1 2024-09-12T19:13:57.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8fAItjdSVbrqsC39wBXanQFyTAbpgTf_0 2024-09-12T19:13:57.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13835946360254814246', time=2024-09-12T21:02:01.728745+0000, chain.objs.size()=1 2024-09-12T19:13:57.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.P-9eJtLm_EwlDm0xQUdSJmsMUvIMTOj_0 2024-09-12T19:13:57.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12289157348290882939', time=2024-09-12T21:02:01.788313+0000, chain.objs.size()=1 2024-09-12T19:13:57.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.VMO5B-6B8cK5_jttIaAW89vORTeoerf_0 2024-09-12T19:13:57.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1156329431595335304', time=2024-09-12T21:02:01.793218+0000, chain.objs.size()=1 2024-09-12T19:13:57.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yQxtEVker74gPsQnZZrWYmRJ3uoVNKk_0 2024-09-12T19:13:57.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4625291430238260620', time=2024-09-12T21:02:01.903808+0000, chain.objs.size()=1 2024-09-12T19:13:57.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.3oBzhoCsB9ZZJs8uT0NM7ETCWU0PSLf_0 2024-09-12T19:13:57.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14744033722462518213', time=2024-09-12T21:02:01.938893+0000, chain.objs.size()=1 2024-09-12T19:13:57.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.AMt-xSWYLRtEWAwp9CnBN7nqNCVL26Z_0 2024-09-12T19:13:57.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11705501952727150783', time=2024-09-12T21:02:01.949390+0000, chain.objs.size()=1 2024-09-12T19:13:57.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2Wr5SMHilGR71qgIYOUp1xtpH3_9y_f_0 2024-09-12T19:13:57.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13989755554691685037', time=2024-09-12T21:02:01.964746+0000, chain.objs.size()=1 2024-09-12T19:13:57.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.P-jGOzxgMK2-YHJ80GqlsG4mN-adoqa_0 2024-09-12T19:13:57.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.984+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13924394001117628738', time=2024-09-12T21:02:01.982686+0000, chain.objs.size()=1 2024-09-12T19:13:57.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.sprG02Wcw6kxbvFjybS8-FbLTZT0yFm_0 2024-09-12T19:13:57.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/55681 2024-09-12T19:13:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T19:13:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17344392755351596402', time=2024-09-12T21:02:02.001788+0000, chain.objs.size()=1 2024-09-12T19:13:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5AnW1jl8uRYSOtR1TeQ2mMCaNZO9Vbm_0 2024-09-12T19:13:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3790014890503920384', time=2024-09-12T21:02:02.123357+0000, chain.objs.size()=1 2024-09-12T19:13:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.87gyhc3yqTAmtGjn5N9Xw2Sb6Wu1TE1_0 2024-09-12T19:13:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9370398563713122050', time=2024-09-12T21:02:02.124379+0000, chain.objs.size()=1 2024-09-12T19:13:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.P8cEfqhup_asl2NdXXPQhW_D0QIH-Zf_0 2024-09-12T19:13:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10395099379561766911', time=2024-09-12T21:02:02.188102+0000, chain.objs.size()=1 2024-09-12T19:13:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.TTU80_2_ExeBTBEIEC3gQJOjjrWlOdW_0 2024-09-12T19:13:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13342097981930731423', time=2024-09-12T21:02:04.025353+0000, chain.objs.size()=1 2024-09-12T19:13:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.327__shadow_.pfFWCFNrU1kuHZjnqUU8_QQc-d9Iu7o_0 2024-09-12T19:13:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15819048504670113171', time=2024-09-12T21:03:19.915182+0000, chain.objs.size()=1 2024-09-12T19:13:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.435__shadow_.CGeVKolGzK4Zhy9aQodufjq8FpXNcFD_0 2024-09-12T19:13:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.665808278803325604', time=2024-09-12T21:03:46.205402+0000, chain.objs.size()=1 2024-09-12T19:13:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.465__shadow_.8sPZzbwPxPF1J_2NFv63CZD8m0VE_Vq_0 2024-09-12T19:13:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12084381480502310913', time=2024-09-12T21:03:55.562732+0000, chain.objs.size()=1 2024-09-12T19:13:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.483__shadow_.dcS44QRs8Ri_YBdD5aXnNkYbxFZBP6u_0 2024-09-12T19:13:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11416220121027485171', time=2024-09-12T21:04:09.688589+0000, chain.objs.size()=1 2024-09-12T19:13:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.503__shadow:36QYX6qQ2gzMos2OEErLcQNuKaa5Xm._.oMtp76uo7bZ28BaGhD6Iv-dVMP_rpSx_0 2024-09-12T19:13:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15829720353551919489', time=2024-09-12T21:04:13.504074+0000, chain.objs.size()=6 2024-09-12T19:13:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.1 2024-09-12T19:13:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.2 2024-09-12T19:13:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.988+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.3 2024-09-12T19:13:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.4 2024-09-12T19:13:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.5 2024-09-12T19:13:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.6 2024-09-12T19:13:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16368057485143295261', time=2024-09-12T21:04:14.949409+0000, chain.objs.size()=1 2024-09-12T19:13:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.511__multipart_mymultipart.2~SV9GNt7UPeeAnnRX3v5EY8qm48wVqcx.1 2024-09-12T19:13:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1099560504079353557', time=2024-09-12T21:04:21.706690+0000, chain.objs.size()=1 2024-09-12T19:13:57.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.518__multipart_mymultipart.2~Tf2phQhdJ4ff4rXlL4W0Z4n9wO12VfP.1 2024-09-12T19:13:57.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~SSjYyMhOkdJOvGAr6HAfBAPd-CXERML', time=2024-09-12T21:04:59.812070+0000, chain.objs.size()=2 2024-09-12T19:13:57.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.531__multipart_mymultipart.2~SSjYyMhOkdJOvGAr6HAfBAPd-CXERML.1 2024-09-12T19:13:57.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.531__multipart_mymultipart.2~SSjYyMhOkdJOvGAr6HAfBAPd-CXERML.2 2024-09-12T19:13:57.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13347054814559142642', time=2024-09-12T21:06:01.259197+0000, chain.objs.size()=1 2024-09-12T19:13:57.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.566__shadow_.ZjIguji_bpO1y-kUXCcDRtspBm78wRv_0 2024-09-12T19:13:57.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14152106674848452309', time=2024-09-12T21:06:04.627849+0000, chain.objs.size()=1 2024-09-12T19:13:57.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:TQd94q.NcCZbPm2yLFB0W2M1u7jlmwT_.mQxfSGJdxwdGgxpbyqta3UvhBq3wihu_0 2024-09-12T19:13:57.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6101994623856282949', time=2024-09-12T21:06:17.866002+0000, chain.objs.size()=1 2024-09-12T19:13:57.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.574__shadow:37OHt.SErT0yK-GCPgRXNXOhvhv1.79_.Ab1oKX4S5dreenAQ3gJ9hNnhi3z10ZY_0 2024-09-12T19:13:57.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17588319386071130836', time=2024-09-12T21:06:44.006952+0000, chain.objs.size()=4 2024-09-12T19:13:57.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.578__multipart_testobj.2~o3BnEhO7lb5AIQ1Ih5PN4guSJIm_n0t.1 2024-09-12T19:13:57.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.578__multipart_testobj.2~o3BnEhO7lb5AIQ1Ih5PN4guSJIm_n0t.2 2024-09-12T19:13:57.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.578__multipart_testobj.2~o3BnEhO7lb5AIQ1Ih5PN4guSJIm_n0t.3 2024-09-12T19:13:57.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.578__multipart_testobj.2~o3BnEhO7lb5AIQ1Ih5PN4guSJIm_n0t.4 2024-09-12T19:13:57.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.32920159736291092', time=2024-09-12T21:06:48.236129+0000, chain.objs.size()=1 2024-09-12T19:13:57.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.992+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.580__shadow:SoK8CGL2RvlvMgpfgvbm16iFD-nAV-u_.-memFDaAcDg4Rj0OinoQ_ucRnRnl_Rk_0 2024-09-12T19:13:57.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.996+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.889341023292170637', time=2024-09-12T21:06:53.819440+0000, chain.objs.size()=1 2024-09-12T19:13:57.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.587__shadow:aiuV8SNAmy7IYxI37k43cf8MgKKGVVF_.KrRzvAgm39sXQmJ_SBoHrz-CeltsrLp_0 2024-09-12T19:13:57.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.996+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11760894517137714458', time=2024-09-12T21:09:32.593350+0000, chain.objs.size()=12 2024-09-12T19:13:57.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.623__multipart_multipart_enc.2~RFA732o90nI0n7jcbAxYVBBhxrbYZ9u.1 2024-09-12T19:13:58.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.623__shadow_multipart_enc.2~RFA732o90nI0n7jcbAxYVBBhxrbYZ9u.1_1 2024-09-12T19:13:58.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.623__multipart_multipart_enc.2~RFA732o90nI0n7jcbAxYVBBhxrbYZ9u.2 2024-09-12T19:13:58.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.623__shadow_multipart_enc.2~RFA732o90nI0n7jcbAxYVBBhxrbYZ9u.2_1 2024-09-12T19:13:58.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.623__multipart_multipart_enc.2~RFA732o90nI0n7jcbAxYVBBhxrbYZ9u.3 2024-09-12T19:13:58.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.623__shadow_multipart_enc.2~RFA732o90nI0n7jcbAxYVBBhxrbYZ9u.3_1 2024-09-12T19:13:58.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.623__multipart_multipart_enc.2~RFA732o90nI0n7jcbAxYVBBhxrbYZ9u.4 2024-09-12T19:13:58.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.623__shadow_multipart_enc.2~RFA732o90nI0n7jcbAxYVBBhxrbYZ9u.4_1 2024-09-12T19:13:58.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:57.996+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.623__multipart_multipart_enc.2~RFA732o90nI0n7jcbAxYVBBhxrbYZ9u.5 2024-09-12T19:13:58.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.623__shadow_multipart_enc.2~RFA732o90nI0n7jcbAxYVBBhxrbYZ9u.5_1 2024-09-12T19:13:58.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.623__multipart_multipart_enc.2~RFA732o90nI0n7jcbAxYVBBhxrbYZ9u.6 2024-09-12T19:13:58.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.623__shadow_multipart_enc.2~RFA732o90nI0n7jcbAxYVBBhxrbYZ9u.6_1 2024-09-12T19:13:58.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.000+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11467903271397855767', time=2024-09-12T21:09:45.385259+0000, chain.objs.size()=1 2024-09-12T19:13:58.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.638__shadow_.oAtcHuvLUhv0AzsMflFZFGSMl6XA0qL_0 2024-09-12T19:13:58.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.000+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5118221309733525400', time=2024-09-12T21:09:56.480874+0000, chain.objs.size()=1 2024-09-12T19:13:58.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.652__shadow_.7eNMik3tV8GiMFyd8w36XX-HvJTpSMr_0 2024-09-12T19:13:58.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.000+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8164396527506660975', time=2024-09-12T21:10:12.121687+0000, chain.objs.size()=1 2024-09-12T19:13:58.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.671__shadow_.XpXVQWCrGxHe_D1_lsKyCkZsVd2xZ4U_0 2024-09-12T19:13:58.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.000+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6937669174882080845', time=2024-09-12T21:10:27.570885+0000, chain.objs.size()=1 2024-09-12T19:13:58.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.696__shadow:zbxdyL8QjZDDil5MEE8HhWt8Pgbkm41_.BMLB5SCnBP4UNVxkTWs8gCyicJ2j8JG_0 2024-09-12T19:13:58.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.000+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8102008126032454905', time=2024-09-12T21:11:18.770812+0000, chain.objs.size()=1 2024-09-12T19:13:58.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.741__shadow_.jzwJB9-_m_wzfoScaV5MwJD4PXqowkz_0 2024-09-12T19:13:58.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.000+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:58.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.004+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T19:13:58.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.004+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:58.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.004+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:58.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49698' 2024-09-12T19:13:58.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4834888002749011842', time=2024-09-12T20:57:33.573999+0000, chain.objs.size()=3 2024-09-12T19:13:58.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.QLVvYImyCbCzsbwDCSp-rZ5JBp7D3ep_0 2024-09-12T19:13:58.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.QLVvYImyCbCzsbwDCSp-rZ5JBp7D3ep_1 2024-09-12T19:13:58.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.QLVvYImyCbCzsbwDCSp-rZ5JBp7D3ep_2 2024-09-12T19:13:58.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2554715362468079621', time=2024-09-12T20:57:38.591412+0000, chain.objs.size()=2 2024-09-12T19:13:58.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.164__multipart_foo.2~gH5V58U6K9J1_lxklcLUsK_oJ_jU-4-.1 2024-09-12T19:13:58.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.164__multipart_foo.2~gH5V58U6K9J1_lxklcLUsK_oJ_jU-4-.2 2024-09-12T19:13:58.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18015507817014669552', time=2024-09-12T20:59:47.923683+0000, chain.objs.size()=1 2024-09-12T19:13:58.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.230__shadow_.71DlcO01KRPngw4frB28Ujak16hn-vQ_0 2024-09-12T19:13:58.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3593733235270180085', time=2024-09-12T20:59:53.584200+0000, chain.objs.size()=1 2024-09-12T19:13:58.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.237__shadow_.C31SkDj5q7NSdVbUiuM_tLRpfJWuKWZ_0 2024-09-12T19:13:58.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12830175176780383976', time=2024-09-12T20:59:54.793953+0000, chain.objs.size()=1 2024-09-12T19:13:58.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.238__shadow_.XJcA2PSa9pb0sJvOXBXwskimmkraKy5_0 2024-09-12T19:13:58.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5177286722694068923', time=2024-09-12T21:00:02.258235+0000, chain.objs.size()=1 2024-09-12T19:13:58.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.247__shadow_.D6--g5a2Wkj_-ATbk2uDoYd28MdXi9Q_0 2024-09-12T19:13:58.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15647866652195027713', time=2024-09-12T21:00:31.986511+0000, chain.objs.size()=1 2024-09-12T19:13:58.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.5Z2FOzTfHE8pMMvIm-Mf_lpZ4auvxpl_0 2024-09-12T19:13:58.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1507948773303471792', time=2024-09-12T21:00:31.990305+0000, chain.objs.size()=1 2024-09-12T19:13:58.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.q2cY2L-iPgtVsfJS1yYAzU4nZ-vPqIO_0 2024-09-12T19:13:58.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1518848729683412576', time=2024-09-12T21:00:32.046418+0000, chain.objs.size()=1 2024-09-12T19:13:58.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2-85wByiqZgY7NY89OZforQ5yLYflOT_0 2024-09-12T19:13:58.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1479802704644543884', time=2024-09-12T21:00:32.074352+0000, chain.objs.size()=1 2024-09-12T19:13:58.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.onAdj6K_B5CjWvM35oV5agieDAkRqVC_0 2024-09-12T19:13:58.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6373637015683958157', time=2024-09-12T21:00:32.084566+0000, chain.objs.size()=1 2024-09-12T19:13:58.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2SSaqGdeJhrmibrxEjqlOw2kRisAroQ_0 2024-09-12T19:13:58.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17709401438112442981', time=2024-09-12T21:00:32.093700+0000, chain.objs.size()=1 2024-09-12T19:13:58.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sQzshnU22oEhhz4s6PKyZ_dSyc7gVJJ_0 2024-09-12T19:13:58.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11343814907702181814', time=2024-09-12T21:00:32.106429+0000, chain.objs.size()=1 2024-09-12T19:13:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.N2t_iVZN0O63ZvTJBjHGXIUldgXNKNS_0 2024-09-12T19:13:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1881645781185096768', time=2024-09-12T21:00:32.227301+0000, chain.objs.size()=1 2024-09-12T19:13:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.S4Cs64N5pZGpsF1hUJ6ryiIcGBbAj1G_0 2024-09-12T19:13:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12473838092259287377', time=2024-09-12T21:00:32.269770+0000, chain.objs.size()=1 2024-09-12T19:13:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2fDyYvmmIDbJXIp3IPie0D0-mLBZddK_0 2024-09-12T19:13:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13301744502780980523', time=2024-09-12T21:00:32.282005+0000, chain.objs.size()=1 2024-09-12T19:13:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DOWu6DNp5z4rPvLbNKv4B-hcGatrVxK_0 2024-09-12T19:13:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16129475469798988874', time=2024-09-12T21:00:32.299869+0000, chain.objs.size()=1 2024-09-12T19:13:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Xq-SUdBOPySbiXnCVYH5JuZJ5lIxdXb_0 2024-09-12T19:13:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10613843090665096786', time=2024-09-12T21:00:32.526321+0000, chain.objs.size()=1 2024-09-12T19:13:58.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.O6jeu8PrcHFpv9PJL_dcBvtobCAfM1W_0 2024-09-12T19:13:58.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4726242237501802523', time=2024-09-12T21:00:32.543016+0000, chain.objs.size()=1 2024-09-12T19:13:58.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.EgPwSLiga0Ed2SWpwVq26itmRB0DAFS_0 2024-09-12T19:13:58.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7987637981429875407', time=2024-09-12T21:00:32.658489+0000, chain.objs.size()=1 2024-09-12T19:13:58.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.008+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.igYLZX_FQjXOeOE6-76l08Yk-a82fDA_0 2024-09-12T19:13:58.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1467515340564355249', time=2024-09-12T21:00:32.678264+0000, chain.objs.size()=1 2024-09-12T19:13:58.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.YQSrZAX8rvx4yzRivRAAoAeIBQ-urdY_0 2024-09-12T19:13:58.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14354956644903135410', time=2024-09-12T21:00:32.687401+0000, chain.objs.size()=1 2024-09-12T19:13:58.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ITlK6BMfe2_CmrSILmmPaAV30JNUgud_0 2024-09-12T19:13:58.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.281429180610233953', time=2024-09-12T21:00:32.700994+0000, chain.objs.size()=1 2024-09-12T19:13:58.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.gddinhvbVDAUKQs4YkcJysTLhzZRWTB_0 2024-09-12T19:13:58.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10386970119676452975', time=2024-09-12T21:00:32.718333+0000, chain.objs.size()=1 2024-09-12T19:13:58.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.U4zB5Fj50D0hi5RQhH080yWjjkM7Och_0 2024-09-12T19:13:58.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16932506362509355305', time=2024-09-12T21:00:32.738606+0000, chain.objs.size()=1 2024-09-12T19:13:58.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Gp5zXAO-0Mssne8G0D415YEixGj8xoe_0 2024-09-12T19:13:58.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11658916579734956314', time=2024-09-12T21:00:32.743539+0000, chain.objs.size()=1 2024-09-12T19:13:58.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.flwnrm8_6NLbN2tMmRQrwMBVmp8NHuX_0 2024-09-12T19:13:58.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6719339456768613469', time=2024-09-12T21:00:32.754487+0000, chain.objs.size()=1 2024-09-12T19:13:58.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.By7p1wywOQeuqjd1XT0aI4EvmPfas2X_0 2024-09-12T19:13:58.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17446544423393518599', time=2024-09-12T21:00:32.760081+0000, chain.objs.size()=1 2024-09-12T19:13:58.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ujvOIyHFJQCCYFMftX_PwHTH3SJc5wr_0 2024-09-12T19:13:58.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2988433178344349155', time=2024-09-12T21:00:32.876978+0000, chain.objs.size()=1 2024-09-12T19:13:58.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.TlioOX_8-7dPJgnDV5XS_8x8G7AhS2N_0 2024-09-12T19:13:58.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11969108138011657804', time=2024-09-12T21:00:32.918676+0000, chain.objs.size()=1 2024-09-12T19:13:58.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.hUCUBuV-RFHWrr_3PhKfwjg_WNZ1hvQ_0 2024-09-12T19:13:58.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3439004743134322736', time=2024-09-12T21:00:32.919791+0000, chain.objs.size()=1 2024-09-12T19:13:58.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.IlJu7YOKRj4qvIVN7GDXrSUKjW4PoWv_0 2024-09-12T19:13:58.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8152992374527846686', time=2024-09-12T21:00:32.940601+0000, chain.objs.size()=1 2024-09-12T19:13:58.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.vHJwqk0YJlWsM_MiLNlD8GDQ05iwnaS_0 2024-09-12T19:13:58.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2343974612453405040', time=2024-09-12T21:00:32.952562+0000, chain.objs.size()=1 2024-09-12T19:13:58.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.012+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.nKyOwpPnL5PJ28g2Y2FdFaN3lExy7vc_0 2024-09-12T19:13:58.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5446238893459093005', time=2024-09-12T21:00:32.971549+0000, chain.objs.size()=1 2024-09-12T19:13:58.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2vVTBIgXGgjHNx-FUx-Gukf5TvNykfB_0 2024-09-12T19:13:58.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4176937754523752661', time=2024-09-12T21:00:32.973563+0000, chain.objs.size()=1 2024-09-12T19:13:58.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qi5ItJH9bv0lenORvLX4YbvZjZTYGFW_0 2024-09-12T19:13:58.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6871373883816008822', time=2024-09-12T21:00:33.382000+0000, chain.objs.size()=1 2024-09-12T19:13:58.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.aElT1OvQ9L0MaFvZ2hm-mLNh6NEm64W_0 2024-09-12T19:13:58.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15611679828586955358', time=2024-09-12T21:00:33.465802+0000, chain.objs.size()=1 2024-09-12T19:13:58.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.jgblDg-BcfzAzQglYk-f24e7KYOr8AD_0 2024-09-12T19:13:58.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6497797168172258641', time=2024-09-12T21:00:33.841355+0000, chain.objs.size()=1 2024-09-12T19:13:58.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.BVYptKUUBubnRT39b_eBUsqG1TT0FcO_0 2024-09-12T19:13:58.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5984072479144215725', time=2024-09-12T21:00:33.888077+0000, chain.objs.size()=1 2024-09-12T19:13:58.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XRZg6Y0k6CSHdZqC9uT3TAYe4O_ThR1_0 2024-09-12T19:13:58.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12038834683826747175', time=2024-09-12T21:00:33.904612+0000, chain.objs.size()=1 2024-09-12T19:13:58.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.9ERrk6sn3CxJaTUyrVDRk3isZ77QkAy_0 2024-09-12T19:13:58.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12681044458110690191', time=2024-09-12T21:00:40.304125+0000, chain.objs.size()=1 2024-09-12T19:13:58.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.271__shadow_.vkJPJhvO2makU7aai16-O5tIBDuBknw_0 2024-09-12T19:13:58.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12931803322866856121', time=2024-09-12T21:00:46.182930+0000, chain.objs.size()=1 2024-09-12T19:13:58.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.279__shadow_.8pTgDDuXhmc_3tWtrrZunTVMyf44qNB_0 2024-09-12T19:13:58.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8012368577320631870', time=2024-09-12T21:00:49.119614+0000, chain.objs.size()=1 2024-09-12T19:13:58.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.283__shadow_.Snve5MfXzUNuiqy7dAk3lZfTkS8Os4T_0 2024-09-12T19:13:58.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2143817549984439768', time=2024-09-12T21:00:56.716096+0000, chain.objs.size()=1 2024-09-12T19:13:58.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.XWQvis-j7xzikUlsl69jtUl70461cL3_0 2024-09-12T19:13:58.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5233164783269561379', time=2024-09-12T21:00:56.718152+0000, chain.objs.size()=1 2024-09-12T19:13:58.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_._wW1e5eoCoWddHnHnQUAIaQL7xXWI0q_0 2024-09-12T19:13:58.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12600624794569307990', time=2024-09-12T21:00:58.840021+0000, chain.objs.size()=1 2024-09-12T19:13:58.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.294__shadow_.txb5778hFsZshSslMk9ox7Np6YqgcBr_0 2024-09-12T19:13:58.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10972196860649233338', time=2024-09-12T21:00:58.841653+0000, chain.objs.size()=1 2024-09-12T19:13:58.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.294__shadow_.i6QT2hJigsz28zXIouM7hzI-KOZswks_0 2024-09-12T19:13:58.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13378389169765818672', time=2024-09-12T21:00:59.584812+0000, chain.objs.size()=1 2024-09-12T19:13:58.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.295__shadow_.kUf5Pkd1GJJ89raG8QKCS_elPMhCRMq_0 2024-09-12T19:13:58.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4089306002770594612', time=2024-09-12T21:01:01.001074+0000, chain.objs.size()=1 2024-09-12T19:13:58.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.297__shadow_.JG7Dqm50rQJ-WIroV8JZAba4PtEapck_0 2024-09-12T19:13:58.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5695017376247393753', time=2024-09-12T21:01:19.455305+0000, chain.objs.size()=1 2024-09-12T19:13:58.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.016+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.322__shadow_.a3pJlqZ-zAXv1ZG3DvTKIW4dexB2yzz_0 2024-09-12T19:13:58.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6324376984564878647', time=2024-09-12T21:01:39.475894+0000, chain.objs.size()=1 2024-09-12T19:13:58.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._iJqx1qE29Rw2j50WULjaCqcKeah_o0_0 2024-09-12T19:13:58.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5173295674706933547', time=2024-09-12T21:01:39.490868+0000, chain.objs.size()=1 2024-09-12T19:13:58.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0dzAPY2yUaxQgJv0yujEDWwD9XKFbxB_0 2024-09-12T19:13:58.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13938391402628638485', time=2024-09-12T21:01:39.510813+0000, chain.objs.size()=1 2024-09-12T19:13:58.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.UlsJ2UmNt013MZEHzZ0iJzSIrwOhv6F_0 2024-09-12T19:13:58.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11315889614974841830', time=2024-09-12T21:01:39.552181+0000, chain.objs.size()=1 2024-09-12T19:13:58.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mbbmBMfO6jAQjgVq4uoVDitdSi3wDLH_0 2024-09-12T19:13:58.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2076543630076848897', time=2024-09-12T21:01:39.672528+0000, chain.objs.size()=1 2024-09-12T19:13:58.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mJSkURW5HyKnENXw57NkWDNdpbpCqzC_0 2024-09-12T19:13:58.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.311828121127040466', time=2024-09-12T21:01:39.741021+0000, chain.objs.size()=1 2024-09-12T19:13:58.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.dk6TRhS-fvOX6jBjwHWLiNwUDfuXOE9_0 2024-09-12T19:13:58.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6485926571652517781', time=2024-09-12T21:01:39.764592+0000, chain.objs.size()=1 2024-09-12T19:13:58.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ovbgW3JjUAlWhd89B6kvCy_QN8Thlpv_0 2024-09-12T19:13:58.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8139379384187942557', time=2024-09-12T21:01:39.771915+0000, chain.objs.size()=1 2024-09-12T19:13:58.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.bTOZVIOOFiAGncOOZfVDe-O9fGYQwJz_0 2024-09-12T19:13:58.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6108087462749393862', time=2024-09-12T21:01:39.784704+0000, chain.objs.size()=1 2024-09-12T19:13:58.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hBasOtsbzAfyErz3FXvdcU9BU9LcAtK_0 2024-09-12T19:13:58.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11809769591620556482', time=2024-09-12T21:01:39.805189+0000, chain.objs.size()=1 2024-09-12T19:13:58.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.L3ocj9cCxQah1MGn0eWzE0oRJOJ_bpd_0 2024-09-12T19:13:58.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16995860104092260253', time=2024-09-12T21:01:39.901142+0000, chain.objs.size()=1 2024-09-12T19:13:58.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.jf9YtWgh78wt2voQoTcinIMxgALiIbT_0 2024-09-12T19:13:58.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16291277169144826108', time=2024-09-12T21:01:39.944413+0000, chain.objs.size()=1 2024-09-12T19:13:58.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.gHy50qymTD5GtRrDT_661w88WnrR8h3_0 2024-09-12T19:13:58.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1059370621514112197', time=2024-09-12T21:01:39.951072+0000, chain.objs.size()=1 2024-09-12T19:13:58.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.K7z7sDbOcf0OGN-6qXmXCjc9xWL68tU_0 2024-09-12T19:13:58.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16693940794871035251', time=2024-09-12T21:01:39.969844+0000, chain.objs.size()=1 2024-09-12T19:13:58.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0cHV9EIWTsuMGKEJwujXvlagRRVxpML_0 2024-09-12T19:13:58.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15655706852076849684', time=2024-09-12T21:01:39.976726+0000, chain.objs.size()=1 2024-09-12T19:13:58.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RqZkli78SW9vKacDUtkmEiARP5eeJlT_0 2024-09-12T19:13:58.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15522600476843352321', time=2024-09-12T21:01:39.986727+0000, chain.objs.size()=1 2024-09-12T19:13:58.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.vgsEQvHnbTxysC3T0VSSU3nB3hgwS-q_0 2024-09-12T19:13:58.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4434819858955452470', time=2024-09-12T21:01:39.990370+0000, chain.objs.size()=1 2024-09-12T19:13:58.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.xf9l9QJMMEAUcUTX0854s_WtlVz9TK9_0 2024-09-12T19:13:58.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11504142762454537947', time=2024-09-12T21:01:40.013944+0000, chain.objs.size()=1 2024-09-12T19:13:58.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.tAPtOvroFiap5gpUR0iqua2D75tdWIr_0 2024-09-12T19:13:58.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6175098492093996220', time=2024-09-12T21:01:40.022696+0000, chain.objs.size()=1 2024-09-12T19:13:58.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.7j1TGXcNns3ML1ODnUEsxFPTWxQ9lPZ_0 2024-09-12T19:13:58.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.020+0000 7fe66f539640 0 -- 172.21.15.111:0/2662903071 >> [v2:172.21.15.111:6816/1581955167,v1:172.21.15.111:6817/1581955167] conn(0x7fe6600173f0 msgr2=0x7fe660017870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:58.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6032808591020244572', time=2024-09-12T21:01:40.122509+0000, chain.objs.size()=1 2024-09-12T19:13:58.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Vf9QQmEMSGqE8oLm1GNEknYJj19UTL5_0 2024-09-12T19:13:58.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12877701509308634414', time=2024-09-12T21:01:40.226162+0000, chain.objs.size()=1 2024-09-12T19:13:58.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.rWNAxzUdz2j_MCVuk5FQrNBBNip3MXs_0 2024-09-12T19:13:58.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11063840362293893683', time=2024-09-12T21:01:40.381346+0000, chain.objs.size()=1 2024-09-12T19:13:58.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.3VtZrg_gULeZGnDEEv37mG9cu8UambW_0 2024-09-12T19:13:58.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9336220441161405394', time=2024-09-12T21:01:40.392433+0000, chain.objs.size()=1 2024-09-12T19:13:58.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ZpY0qI9D9GN7BpAPnhUvUffvPV9tkYx_0 2024-09-12T19:13:58.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6755173619999761005', time=2024-09-12T21:01:40.436267+0000, chain.objs.size()=1 2024-09-12T19:13:58.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Rpm7I2E2N4VBLbpJfpOFIgUt-rubgYQ_0 2024-09-12T19:13:58.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7341446483605780747', time=2024-09-12T21:01:40.454081+0000, chain.objs.size()=1 2024-09-12T19:13:58.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.6qv9qdHR8w-7Uj7fgE1xsJHJEa5hZ9s_0 2024-09-12T19:13:58.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15578669018561542230', time=2024-09-12T21:01:40.570115+0000, chain.objs.size()=1 2024-09-12T19:13:58.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.vlFwYI3X8iePRhgiF2VvfbTf9vektmR_0 2024-09-12T19:13:58.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14743992524813827861', time=2024-09-12T21:01:40.573970+0000, chain.objs.size()=1 2024-09-12T19:13:58.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.TPLJkGZziglO3bH9tfiQ1N5yyPZwf7T_0 2024-09-12T19:13:58.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10679285682316247493', time=2024-09-12T21:01:40.596301+0000, chain.objs.size()=1 2024-09-12T19:13:58.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-epYsg522WIqQFB_Pgro23mjO3jaH_c_0 2024-09-12T19:13:58.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6481738926441411614', time=2024-09-12T21:01:40.662939+0000, chain.objs.size()=1 2024-09-12T19:13:58.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.PwuCQx_EMSaSkQ2OBJV6WxupwqlFXcK_0 2024-09-12T19:13:58.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4288678664935264', time=2024-09-12T21:01:40.838160+0000, chain.objs.size()=1 2024-09-12T19:13:58.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.L9sTfp5xPAOQ27IxQilj9fATHdw3sN7_0 2024-09-12T19:13:58.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1306683119560589824', time=2024-09-12T21:01:40.868740+0000, chain.objs.size()=1 2024-09-12T19:13:58.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ljtTNXJXNq9T7goBnG9AHdSVc1jtA0j_0 2024-09-12T19:13:58.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15706300558287325726', time=2024-09-12T21:01:40.894601+0000, chain.objs.size()=1 2024-09-12T19:13:58.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.1ezg3_Cu5Zi814pIzmq7cH35UY1uNp2_0 2024-09-12T19:13:58.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9045166970980390752', time=2024-09-12T21:01:41.078453+0000, chain.objs.size()=1 2024-09-12T19:13:58.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.OBP5iIbMr0nbGyXxGLo0DaFmSjSDSIB_0 2024-09-12T19:13:58.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8299113369164975652', time=2024-09-12T21:01:41.083195+0000, chain.objs.size()=1 2024-09-12T19:13:58.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._0vnZHN5FneKlQsQRS7MJRXTU28c3sn_0 2024-09-12T19:13:58.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1356277580925215024', time=2024-09-12T21:01:41.089286+0000, chain.objs.size()=1 2024-09-12T19:13:58.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.E-47gRESNjlGx4Xcz4dpJFJmjdqSy8A_0 2024-09-12T19:13:58.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1630551345860627799', time=2024-09-12T21:02:00.618531+0000, chain.objs.size()=1 2024-09-12T19:13:58.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.gr0DqVOQWPJZWH_88el3A4v4EC6D8ZK_0 2024-09-12T19:13:58.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18390276292329880213', time=2024-09-12T21:02:00.780211+0000, chain.objs.size()=1 2024-09-12T19:13:58.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0Hwbri6YhcY9Q_xBi5ayDqE165M3jxb_0 2024-09-12T19:13:58.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10791110096129171870', time=2024-09-12T21:02:00.842193+0000, chain.objs.size()=1 2024-09-12T19:13:58.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.je-e9ZPz98_5U_pbHEmEiPlzuutG_LZ_0 2024-09-12T19:13:58.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2157275958946719245', time=2024-09-12T21:02:00.854058+0000, chain.objs.size()=1 2024-09-12T19:13:58.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1xaCJ27lL8dflExX_bursKY6s34mqg0_0 2024-09-12T19:13:58.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.828412988698602640', time=2024-09-12T21:02:00.863757+0000, chain.objs.size()=1 2024-09-12T19:13:58.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.50ML0RWLJWtKNVyXNUoaygN74METUyv_0 2024-09-12T19:13:58.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12482225863954132547', time=2024-09-12T21:02:00.883417+0000, chain.objs.size()=1 2024-09-12T19:13:58.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.024+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Vmq38nvAH0hLuiPBSvv72AculKpFhLl_0 2024-09-12T19:13:58.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15285378864381097310', time=2024-09-12T21:02:01.004089+0000, chain.objs.size()=1 2024-09-12T19:13:58.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1gD2WRZ5KYHKJdgn34WAfPQOgQvLeHc_0 2024-09-12T19:13:58.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3148655169914357394', time=2024-09-12T21:02:01.041081+0000, chain.objs.size()=1 2024-09-12T19:13:58.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.h1KddxMwCvDljr_giITkV39SYlVZn0v_0 2024-09-12T19:13:58.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15104527319880670644', time=2024-09-12T21:02:01.075683+0000, chain.objs.size()=1 2024-09-12T19:13:58.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.M5MnpNL9cTqp__LTJz3Chi5GURNj3P-_0 2024-09-12T19:13:58.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13244628803334332889', time=2024-09-12T21:02:01.097893+0000, chain.objs.size()=1 2024-09-12T19:13:58.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.LBj5s_ecBE6bEJQa5W1mwM2gYQ_ckcC_0 2024-09-12T19:13:58.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.879099484108651906', time=2024-09-12T21:02:01.106179+0000, chain.objs.size()=1 2024-09-12T19:13:58.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.4yddgV6rmEHVpRyMiDN778BAaXDfEIu_0 2024-09-12T19:13:58.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe66fd3a640 0 -- 172.21.15.111:0/2662903071 >> [v2:172.21.15.153:6808/1571723771,v1:172.21.15.153:6809/1571723771] conn(0x7fe66003d910 msgr2=0x7fe6600253f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T19:13:58.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2082813521792324654', time=2024-09-12T21:02:01.117756+0000, chain.objs.size()=1 2024-09-12T19:13:58.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.IHDuZOaWdrsUxL-j-N90tzhVffz3Mbv_0 2024-09-12T19:13:58.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17688886499428718423', time=2024-09-12T21:02:01.276316+0000, chain.objs.size()=1 2024-09-12T19:13:58.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._zCkMdtZKsyO8bCKDlak2x1JxFWFdid_0 2024-09-12T19:13:58.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12245996141148676853', time=2024-09-12T21:02:01.297245+0000, chain.objs.size()=1 2024-09-12T19:13:58.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.uRhwoAAx7IQdd_DtFD5zu58SwZ-ZdeL_0 2024-09-12T19:13:58.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2226870476433941370', time=2024-09-12T21:02:01.331218+0000, chain.objs.size()=1 2024-09-12T19:13:58.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.028+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.JtCmCWZSbgnxgvdCRThrqxjfk1m0UuO_0 2024-09-12T19:13:58.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe66fd3a640 0 -- 172.21.15.111:0/2662903071 >> [v2:172.21.15.153:6808/1571723771,v1:172.21.15.153:6809/1571723771] conn(0x7fe6600173f0 msgr2=0x7fe53808bbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:58.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49698 2024-09-12T19:13:58.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T19:13:58.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9526754371562350951', time=2024-09-12T21:02:01.478318+0000, chain.objs.size()=1 2024-09-12T19:13:58.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ly-reIkx4yB3W0ZzUiocLu4AJSX6dYt_0 2024-09-12T19:13:58.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10247264411125469678', time=2024-09-12T21:02:01.499141+0000, chain.objs.size()=1 2024-09-12T19:13:58.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Pb5S82m7_O8tw2q6LQfxQwh4oNQ51QY_0 2024-09-12T19:13:58.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14342716972513023805', time=2024-09-12T21:02:01.712636+0000, chain.objs.size()=1 2024-09-12T19:13:58.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.QFQ2GA9UL5xpVHSAC6XzClLHlDNjPbe_0 2024-09-12T19:13:58.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18403595225432721440', time=2024-09-12T21:02:01.747126+0000, chain.objs.size()=1 2024-09-12T19:13:58.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ag6cwsehQAO6SsV47swQ541x8klsYKQ_0 2024-09-12T19:13:58.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12815048327471057997', time=2024-09-12T21:02:01.885985+0000, chain.objs.size()=1 2024-09-12T19:13:58.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.v2aH_vXxcp_kA8rmtDOyFGAgVEA80IF_0 2024-09-12T19:13:58.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7596374492856650249', time=2024-09-12T21:02:01.965206+0000, chain.objs.size()=1 2024-09-12T19:13:58.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.gJ03pLl4tj9tQeg1yOJnSTQDd4XHcUt_0 2024-09-12T19:13:58.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8793873359283890133', time=2024-09-12T21:02:02.008739+0000, chain.objs.size()=1 2024-09-12T19:13:58.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.SkqCAT0pCtu1XYBQacoIVvr8rQ2TtJV_0 2024-09-12T19:13:58.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16511322594090327322', time=2024-09-12T21:02:02.144499+0000, chain.objs.size()=1 2024-09-12T19:13:58.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.AikSAAVgAyokpN_9-umAQy2_27fPw8a_0 2024-09-12T19:13:58.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14692680155429204498', time=2024-09-12T21:02:02.155141+0000, chain.objs.size()=1 2024-09-12T19:13:58.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.17H0VvuGtwxz2OMSchtek0MT6YKT79r_0 2024-09-12T19:13:58.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1658449356742229677', time=2024-09-12T21:02:08.801733+0000, chain.objs.size()=1 2024-09-12T19:13:58.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.334__shadow_.pqa5YeCxDRUqrGWnv3oXIDdJ-Fw4P4X_0 2024-09-12T19:13:58.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14770398778800653359', time=2024-09-12T21:03:39.175289+0000, chain.objs.size()=1 2024-09-12T19:13:58.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.458__shadow_.Kd4vvk1o5ZDTuQwBWCFOCfq9mobuTSi_0 2024-09-12T19:13:58.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6413639939007244984', time=2024-09-12T21:03:46.203757+0000, chain.objs.size()=1 2024-09-12T19:13:58.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.032+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.465__shadow_.7xEW_32ZHaucsJPyLK07GZrhTBEjVyG_0 2024-09-12T19:13:58.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12241890910562455467', time=2024-09-12T21:03:55.566869+0000, chain.objs.size()=1 2024-09-12T19:13:58.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.483__shadow_.xq1De0k_NLR9wp9Vd6rsqHOuRiQW5HQ_0 2024-09-12T19:13:58.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4007141664763568056', time=2024-09-12T21:03:56.360754+0000, chain.objs.size()=1 2024-09-12T19:13:58.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.484__shadow_.f2uxbforubCAweKiaKmuu_Dqe3GlcQS_0 2024-09-12T19:13:58.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16315761841873690017', time=2024-09-12T21:04:05.664653+0000, chain.objs.size()=1 2024-09-12T19:13:58.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.498__shadow_.-d2IlDd6FdjP3Mc2PBX5BPHm7DMU4jX_0 2024-09-12T19:13:58.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15058665218598578828', time=2024-09-12T21:04:21.190500+0000, chain.objs.size()=1 2024-09-12T19:13:58.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.518__multipart_mymultipart.2~FcefYu-CIMwIJATsqZrnOCIKzI3gnYx.1 2024-09-12T19:13:58.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~wLyHzl2HUoZw_Pyi4ich8GzyA6B4P8t', time=2024-09-12T21:04:31.339183+0000, chain.objs.size()=2 2024-09-12T19:13:58.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~wLyHzl2HUoZw_Pyi4ich8GzyA6B4P8t.1 2024-09-12T19:13:58.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__shadow_mymultipart.2~wLyHzl2HUoZw_Pyi4ich8GzyA6B4P8t.1_1 2024-09-12T19:13:58.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13616703288723597409', time=2024-09-12T21:04:48.941627+0000, chain.objs.size()=3 2024-09-12T19:13:58.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.523__multipart_mymultipart.2~jO-JfXW4ziAOlfk9A8h-jCGEH4zjmnz.1 2024-09-12T19:13:58.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.523__multipart_mymultipart.2~jO-JfXW4ziAOlfk9A8h-jCGEH4zjmnz.2 2024-09-12T19:13:58.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.523__multipart_mymultipart.2~jO-JfXW4ziAOlfk9A8h-jCGEH4zjmnz.3 2024-09-12T19:13:58.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4411938097744812221', time=2024-09-12T21:06:17.446614+0000, chain.objs.size()=1 2024-09-12T19:13:58.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.574__shadow:IRAuqa6dYpCpt-R35mjBB6l7zG7O-3G_.1ilG2T97kSP_34rf2pHFb_vr8iX39Ik_0 2024-09-12T19:13:58.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16428146360312298107', time=2024-09-12T21:06:29.291997+0000, chain.objs.size()=1 2024-09-12T19:13:58.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:cGxTQmMKzNrVh9coyq3TaZ54ESM21B3_.ELUM6KEmZukwCi5iGy8R2P_nXXBc42O_0 2024-09-12T19:13:58.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6313044631116209960', time=2024-09-12T21:06:36.176072+0000, chain.objs.size()=1 2024-09-12T19:13:58.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:pRzcwnUCnNSapz6wBlwWzXxEsp9HiVd_.2n32nl0F1VuBvO0H8uEYS6kJ-qrswTX_0 2024-09-12T19:13:58.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12523788355794000135', time=2024-09-12T21:07:03.448948+0000, chain.objs.size()=1 2024-09-12T19:13:58.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.602__shadow_.1ccBJgvP3TMccN4hE52gS9cvJSYpOcw_0 2024-09-12T19:13:58.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8306040118991544584', time=2024-09-12T21:08:24.673424+0000, chain.objs.size()=1 2024-09-12T19:13:58.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.617__shadow_.L--EkjdyZKvR3dHaVsIeeyKzw2NV5td_0 2024-09-12T19:13:58.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8723765563418361960', time=2024-09-12T21:09:48.532940+0000, chain.objs.size()=1 2024-09-12T19:13:58.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.643__shadow_.7cl5cqt_RpfG3iHUgMW-1NBaURPnntn_0 2024-09-12T19:13:58.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8706735367277420815', time=2024-09-12T21:09:59.118216+0000, chain.objs.size()=1 2024-09-12T19:13:58.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.036+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.655__shadow_.SRwXmtyT7_E7dkTXdmeeu13pRKy4wRf_0 2024-09-12T19:13:58.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.040+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3277248592273093632', time=2024-09-12T21:11:19.797596+0000, chain.objs.size()=1 2024-09-12T19:13:58.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.040+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.742__multipart_mymultipart3.2~bjX5YkxflMpqCYvcsY1rtR6O2QTsSIQ.1 2024-09-12T19:13:58.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.040+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:58.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T19:13:58.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:58.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:58.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/55362' 2024-09-12T19:13:58.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3034646926383135168', time=2024-09-12T20:57:39.239781+0000, chain.objs.size()=1 2024-09-12T19:13:58.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.166__shadow_.npn7iVfV2tPbgjBVWW8M4As5MdvsIcC_0 2024-09-12T19:13:58.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16138824952326767352', time=2024-09-12T20:58:03.774187+0000, chain.objs.size()=1 2024-09-12T19:13:58.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.189__shadow_.HaKhlY6Rk6mrIP40_wkEEQeWL3Ua94j_0 2024-09-12T19:13:58.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3094313570750554613', time=2024-09-12T20:58:22.758328+0000, chain.objs.size()=1 2024-09-12T19:13:58.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.204__shadow_.z34MYh0V9ye_qiTW4iKq1n_rRGdFG1Z_0 2024-09-12T19:13:58.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3539769252586049630', time=2024-09-12T21:00:04.392945+0000, chain.objs.size()=1 2024-09-12T19:13:58.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.250__shadow_.v_qzw66EYeLHCDtLweRVZdHU4oHh8HT_0 2024-09-12T19:13:58.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15598396745856676513', time=2024-09-12T21:00:06.676485+0000, chain.objs.size()=1 2024-09-12T19:13:58.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.253__shadow_.2Y-71aAknKh082dysaKO8pHwH40k8ZD_0 2024-09-12T19:13:58.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7865254902746536883', time=2024-09-12T21:00:32.089031+0000, chain.objs.size()=1 2024-09-12T19:13:58.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ve7dBMqC2dEK6j82Dzwhss74wnSFfSb_0 2024-09-12T19:13:58.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15471199447902510047', time=2024-09-12T21:00:32.103358+0000, chain.objs.size()=1 2024-09-12T19:13:58.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WVqU-8MVWhW5kwUQFdLXb_Ul2iUaIoP_0 2024-09-12T19:13:58.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6169582059502507743', time=2024-09-12T21:00:32.120770+0000, chain.objs.size()=1 2024-09-12T19:13:58.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.exu1r4sZKbw3Yeve2EzL-RItrMiCwDH_0 2024-09-12T19:13:58.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12325281930893309189', time=2024-09-12T21:00:32.123216+0000, chain.objs.size()=1 2024-09-12T19:13:58.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Ujl42ZCfxWUxWHHPxN3n1XdMl9QMXbL_0 2024-09-12T19:13:58.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17416411824472928570', time=2024-09-12T21:00:32.251808+0000, chain.objs.size()=1 2024-09-12T19:13:58.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WP4sdEc5auKJKQwVebuH3s62zbVHjTN_0 2024-09-12T19:13:58.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8252056609085811806', time=2024-09-12T21:00:32.278393+0000, chain.objs.size()=1 2024-09-12T19:13:58.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.HI3zqRk79ubdH8VmaLKs84dTe8nKuQ8_0 2024-09-12T19:13:58.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1064234634877943850', time=2024-09-12T21:00:32.318308+0000, chain.objs.size()=1 2024-09-12T19:13:58.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.044+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.u1JcygVIBJVoZ9-KN0hApr3VHxJMZQ4_0 2024-09-12T19:13:58.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8544767017601413069', time=2024-09-12T21:00:32.333653+0000, chain.objs.size()=1 2024-09-12T19:13:58.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.wWyhWIlcG7DLIqF01c84fNBcKF74pSc_0 2024-09-12T19:13:58.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.894245736084587546', time=2024-09-12T21:00:32.349287+0000, chain.objs.size()=1 2024-09-12T19:13:58.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.dJ-i-g9n-4YwCjC7oSQ8IM0kyDw_sfd_0 2024-09-12T19:13:58.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5021899897114290382', time=2024-09-12T21:00:32.489071+0000, chain.objs.size()=1 2024-09-12T19:13:58.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7js2HIGXu9-GHCJhb3rW0c-6tND5JYq_0 2024-09-12T19:13:58.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3103533906896073771', time=2024-09-12T21:00:32.565183+0000, chain.objs.size()=1 2024-09-12T19:13:58.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.8c1WiurBKcnW_Pxc8dif5SZFyY6VuHT_0 2024-09-12T19:13:58.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10625751719417860276', time=2024-09-12T21:00:32.707059+0000, chain.objs.size()=1 2024-09-12T19:13:58.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.y3BdMLFteYXtOzea8mXG0W59TUZSuPw_0 2024-09-12T19:13:58.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14232881942989863586', time=2024-09-12T21:00:32.876640+0000, chain.objs.size()=1 2024-09-12T19:13:58.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.W9EuQ58HrzHyM2hXUJFzUzV_JbhEgSB_0 2024-09-12T19:13:58.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5557844264373295029', time=2024-09-12T21:00:32.965828+0000, chain.objs.size()=1 2024-09-12T19:13:58.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.pVrMix0Hm4OGtNN3s2quysne_Aa4ZBu_0 2024-09-12T19:13:58.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10379383346323123146', time=2024-09-12T21:00:32.979912+0000, chain.objs.size()=1 2024-09-12T19:13:58.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.BAaRKv_6RhdnWMLe2ICYXZmPrt8jHIt_0 2024-09-12T19:13:58.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3639894002325290135', time=2024-09-12T21:00:33.138752+0000, chain.objs.size()=1 2024-09-12T19:13:58.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.IvTKOmVwzL1tt_hLYxTzLsbVpudvCsq_0 2024-09-12T19:13:58.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13515737302926853702', time=2024-09-12T21:00:33.148547+0000, chain.objs.size()=1 2024-09-12T19:13:58.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Jy7lfpvsbjzxzFWFTpVDA8xzf6fjO7C_0 2024-09-12T19:13:58.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18280841799558743995', time=2024-09-12T21:00:33.174480+0000, chain.objs.size()=1 2024-09-12T19:13:58.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ythz2eEWPekTC5AixEdzM34_ec_IjRN_0 2024-09-12T19:13:58.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6409621911971918569', time=2024-09-12T21:00:33.196671+0000, chain.objs.size()=1 2024-09-12T19:13:58.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.xMlyqNCRVXh2kFgPQi20_vlECSrdw1O_0 2024-09-12T19:13:58.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12816177801039379665', time=2024-09-12T21:00:33.199080+0000, chain.objs.size()=1 2024-09-12T19:13:58.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.UvESkwOMjAG8cRmi7vzTIlVqUNEJvRj_0 2024-09-12T19:13:58.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8385617081880114637', time=2024-09-12T21:00:33.368086+0000, chain.objs.size()=1 2024-09-12T19:13:58.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XVNiwHwaYhpt9TWI7c184aPuAX8dA0x_0 2024-09-12T19:13:58.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17098278042862867179', time=2024-09-12T21:00:33.413517+0000, chain.objs.size()=1 2024-09-12T19:13:58.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sKCTGppirN0V2bGhGHFaJONha7naH6e_0 2024-09-12T19:13:58.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9290245761463049153', time=2024-09-12T21:00:33.485080+0000, chain.objs.size()=1 2024-09-12T19:13:58.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.rL7RDaYDoYv5oGHsXl46Z0xXC7wOH9m_0 2024-09-12T19:13:58.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2847647543355495806', time=2024-09-12T21:00:33.490405+0000, chain.objs.size()=1 2024-09-12T19:13:58.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.9cz7svOOdJ5LFBPVc_0EdftzjkTzo1f_0 2024-09-12T19:13:58.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6664673804081420282', time=2024-09-12T21:00:33.641795+0000, chain.objs.size()=1 2024-09-12T19:13:58.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.cd1ukjrXLGl6T0GvvissGNS6Bnsphfc_0 2024-09-12T19:13:58.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14665630890414189963', time=2024-09-12T21:00:33.665029+0000, chain.objs.size()=1 2024-09-12T19:13:58.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.45puo2FtC7vkcfRDuUrE26lyzetiua8_0 2024-09-12T19:13:58.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2918816346179903101', time=2024-09-12T21:00:33.851238+0000, chain.objs.size()=1 2024-09-12T19:13:58.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CHGR42Hdq934Q1LpXD95S7ZUncX6Phn_0 2024-09-12T19:13:58.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1934694217853532056', time=2024-09-12T21:00:33.855412+0000, chain.objs.size()=1 2024-09-12T19:13:58.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.mskvx1VKy1AVkFTgnWeD-357XBr05Ud_0 2024-09-12T19:13:58.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2357112257863004913', time=2024-09-12T21:00:33.859285+0000, chain.objs.size()=1 2024-09-12T19:13:58.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.048+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.mxJIXMlGxcq3dzuHVdmxGAEb5f1ofvo_0 2024-09-12T19:13:58.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8945192194082802761', time=2024-09-12T21:00:35.302507+0000, chain.objs.size()=1 2024-09-12T19:13:58.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.264__shadow_.xdI9RzZV6sLxijE7L0vNjMoceNvLotY_0 2024-09-12T19:13:58.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11704982732215108090', time=2024-09-12T21:00:50.591807+0000, chain.objs.size()=1 2024-09-12T19:13:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.285__shadow_.mqS5Yb0lBvaMRZKlDluiOA90RSYwclx_0 2024-09-12T19:13:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10554251709746070438', time=2024-09-12T21:00:52.093642+0000, chain.objs.size()=1 2024-09-12T19:13:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.287__shadow_.YdaL4C8HZXXzhUwjyDGKK_MSWu9eckG_0 2024-09-12T19:13:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11842977851427637048', time=2024-09-12T21:00:52.793821+0000, chain.objs.size()=1 2024-09-12T19:13:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.288__shadow_.I7cj1ZWtYp-WO1ThxrmDNlqJyfnFSTH_0 2024-09-12T19:13:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6831712632109812007', time=2024-09-12T21:00:56.704938+0000, chain.objs.size()=1 2024-09-12T19:13:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.fU3Fys848h6ifOFehlYRt_TqZOO-lgh_0 2024-09-12T19:13:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8799274256351007210', time=2024-09-12T21:00:59.584906+0000, chain.objs.size()=1 2024-09-12T19:13:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.295__shadow_.1mtqbU56Kr6up5XjuPkZUBm3AJd3xqh_0 2024-09-12T19:13:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2876554956760074410', time=2024-09-12T21:01:02.563995+0000, chain.objs.size()=1 2024-09-12T19:13:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.299__shadow_.CqcXmJcbYeQiZA7NBDb9VS-t7lKRxt-_0 2024-09-12T19:13:58.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5175393741847140388', time=2024-09-12T21:01:06.303471+0000, chain.objs.size()=1 2024-09-12T19:13:58.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.304__shadow_.qN2HwTqzRKGKlgGp1J3ZIEGcAW8ZDPv_0 2024-09-12T19:13:58.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13089810835592084489', time=2024-09-12T21:01:19.455257+0000, chain.objs.size()=1 2024-09-12T19:13:58.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.322__shadow_.2R4NLlrlSDtNUj9xJ9zUEZnluCX7TN8_0 2024-09-12T19:13:58.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1019136813974621981', time=2024-09-12T21:01:39.430421+0000, chain.objs.size()=1 2024-09-12T19:13:58.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.kdf4EKVBhX3N4NDR9p9iy5B6M9DHkay_0 2024-09-12T19:13:58.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10011115644792091178', time=2024-09-12T21:01:39.496677+0000, chain.objs.size()=1 2024-09-12T19:13:58.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Bf48eYvzFnehNBqgOJWP8ZAWveLRn5y_0 2024-09-12T19:13:58.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9277372859909311926', time=2024-09-12T21:01:39.506928+0000, chain.objs.size()=1 2024-09-12T19:13:58.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.NasfgU1_3PRwYOBlbFObGsnO4x-rvJJ_0 2024-09-12T19:13:58.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12724917424213070397', time=2024-09-12T21:01:39.536026+0000, chain.objs.size()=1 2024-09-12T19:13:58.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Jin9bqPC5QJLUSqcG4MLAM3PRn6mQOZ_0 2024-09-12T19:13:58.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17767699456818576513', time=2024-09-12T21:01:39.555360+0000, chain.objs.size()=1 2024-09-12T19:13:58.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.t41QcKA8wCzzsUPG5O_YG7hI2u9auSf_0 2024-09-12T19:13:58.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8109707290969509748', time=2024-09-12T21:01:39.678275+0000, chain.objs.size()=1 2024-09-12T19:13:58.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.gJksEC0A_AP3oNvgyeuyF9Am4Ck3ZmN_0 2024-09-12T19:13:58.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17821088581548894339', time=2024-09-12T21:01:39.714019+0000, chain.objs.size()=1 2024-09-12T19:13:58.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.O_qMh5ODT_Fh3kOVAlOtp6cT06YMunY_0 2024-09-12T19:13:58.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17687844366851320718', time=2024-09-12T21:01:39.755173+0000, chain.objs.size()=1 2024-09-12T19:13:58.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.8SYS9rScg9zawN7EqW7AYK_Smf_6omc_0 2024-09-12T19:13:58.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17782658820420055763', time=2024-09-12T21:01:39.775601+0000, chain.objs.size()=1 2024-09-12T19:13:58.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.052+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.4Qtq6vzagO_EvVoMMGQEkaMwqHPkINk_0 2024-09-12T19:13:58.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4326171838832767501', time=2024-09-12T21:01:39.782441+0000, chain.objs.size()=1 2024-09-12T19:13:58.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.lM0uAIQiDA7bFwhTmEXI4P6xmx-tuyx_0 2024-09-12T19:13:58.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.568359303891188894', time=2024-09-12T21:01:39.790268+0000, chain.objs.size()=1 2024-09-12T19:13:58.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.nCVe9W_sRbxidlaYk_nYwwkxbjIT6FA_0 2024-09-12T19:13:58.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1735292839319023372', time=2024-09-12T21:01:39.801353+0000, chain.objs.size()=1 2024-09-12T19:13:58.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ndWihhaJl6hHlj8hx46QIKOo5oyeW92_0 2024-09-12T19:13:58.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12607535504714993465', time=2024-09-12T21:01:39.893863+0000, chain.objs.size()=1 2024-09-12T19:13:58.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.3s3TgHa29Ups9SHwDfN_epF0JAqhw_2_0 2024-09-12T19:13:58.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8958576649571965471', time=2024-09-12T21:01:39.934813+0000, chain.objs.size()=1 2024-09-12T19:13:58.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hbK5Id0J-HSGnlULfkn-XvLSZM90Qp6_0 2024-09-12T19:13:58.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13443077576437845791', time=2024-09-12T21:01:39.938799+0000, chain.objs.size()=1 2024-09-12T19:13:58.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.jighCBh9D_Yt5jtY_RXBtp9JJ0QNSXd_0 2024-09-12T19:13:58.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16258147890109405976', time=2024-09-12T21:01:39.998783+0000, chain.objs.size()=1 2024-09-12T19:13:58.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.L19xAJV6ATIgvgLm9TT750hOP7HxCmH_0 2024-09-12T19:13:58.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15669134779417699279', time=2024-09-12T21:01:40.135964+0000, chain.objs.size()=1 2024-09-12T19:13:58.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.UNXkNT7ehVFHYaFBxzv4lYSfTK3SXfW_0 2024-09-12T19:13:58.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4595557091719180799', time=2024-09-12T21:01:40.156410+0000, chain.objs.size()=1 2024-09-12T19:13:58.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.CWF3iOCRVZG0VyvDA3GgOBNKKTGNyzt_0 2024-09-12T19:13:58.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9364472093827622306', time=2024-09-12T21:01:40.176872+0000, chain.objs.size()=1 2024-09-12T19:13:58.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Ct-FMTBt6JTYcNPHug2IWIDDGOqotwB_0 2024-09-12T19:13:58.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7730751494715761323', time=2024-09-12T21:01:40.182328+0000, chain.objs.size()=1 2024-09-12T19:13:58.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.4HBUPLEAR6MmkzjTgHvF4M-M7qd9hPo_0 2024-09-12T19:13:58.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6481540510284540326', time=2024-09-12T21:01:40.222894+0000, chain.objs.size()=1 2024-09-12T19:13:58.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.LcmHD-mPo4kY-oNAoCBICTwdFwTA6Qd_0 2024-09-12T19:13:58.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7841038948896874123', time=2024-09-12T21:01:40.352397+0000, chain.objs.size()=1 2024-09-12T19:13:58.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.09OVgONZ11xUZwjauAC5ghIFi9Ek_we_0 2024-09-12T19:13:58.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7448100332660191821', time=2024-09-12T21:01:40.421805+0000, chain.objs.size()=1 2024-09-12T19:13:58.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.056+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.4UlqXHYg6E3-lPfW6yq4sgsPgqjwwB-_0 2024-09-12T19:13:58.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17403534103928174811', time=2024-09-12T21:01:40.629786+0000, chain.objs.size()=1 2024-09-12T19:13:58.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.XM_62fog8aVVIQOBopDzI5IdxeZXDmU_0 2024-09-12T19:13:58.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10406717870265811030', time=2024-09-12T21:01:40.659932+0000, chain.objs.size()=1 2024-09-12T19:13:58.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.m5mZnYAzFQ5c9bwBc9vgKqKxqKAtAUb_0 2024-09-12T19:13:58.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2146864320547319290', time=2024-09-12T21:01:40.778710+0000, chain.objs.size()=1 2024-09-12T19:13:58.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.JsKR-QxbNT1UY4B0ZG1tmUZzcY0owvV_0 2024-09-12T19:13:58.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7842430664483030692', time=2024-09-12T21:01:40.782919+0000, chain.objs.size()=1 2024-09-12T19:13:58.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.z1wGyRNgv7xo88J8j07ZM8VUUJAd7_u_0 2024-09-12T19:13:58.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15117131414507688149', time=2024-09-12T21:01:40.787020+0000, chain.objs.size()=1 2024-09-12T19:13:58.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.6GY6rz8MryjQ3oLjHrabiPKDDvUfqtS_0 2024-09-12T19:13:58.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16847216945335430582', time=2024-09-12T21:01:40.807559+0000, chain.objs.size()=1 2024-09-12T19:13:58.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.pSe51MvNSRpRN122rUImxmaZYQMn31B_0 2024-09-12T19:13:58.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1426299674342681679', time=2024-09-12T21:02:00.534274+0000, chain.objs.size()=1 2024-09-12T19:13:58.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jZwSvtcG4Qp3MCx_EkJz6Q03BPnaFOY_0 2024-09-12T19:13:58.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11606665003174646630', time=2024-09-12T21:02:00.600892+0000, chain.objs.size()=1 2024-09-12T19:13:58.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.L1Vs9E7lmTs_A8ks-mkybD5-wWgMoK8_0 2024-09-12T19:13:58.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11668939788989886282', time=2024-09-12T21:02:00.613064+0000, chain.objs.size()=1 2024-09-12T19:13:58.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.SpQCxqNgHYdrcuG22DBjI5RwDD35Psr_0 2024-09-12T19:13:58.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12072005130445851317', time=2024-09-12T21:02:00.622262+0000, chain.objs.size()=1 2024-09-12T19:13:58.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.e5G0-wvV7dVp7MA9ft3WsIoAfb-cphp_0 2024-09-12T19:13:58.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2059301061173592417', time=2024-09-12T21:02:00.630987+0000, chain.objs.size()=1 2024-09-12T19:13:58.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.je7lDUwO9STYMSUz-amQEAo-2Qf_KK2_0 2024-09-12T19:13:58.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3949741494521896518', time=2024-09-12T21:02:00.644239+0000, chain.objs.size()=1 2024-09-12T19:13:58.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.AtovS8f3lZDJdTWXSTrQXBn3ZJjPg7g_0 2024-09-12T19:13:58.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5935315341091251555', time=2024-09-12T21:02:00.645518+0000, chain.objs.size()=1 2024-09-12T19:13:58.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8S-rqdJGyN6dMJId2xvf_WPGutHXbAE_0 2024-09-12T19:13:58.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14394496852746282074', time=2024-09-12T21:02:00.767601+0000, chain.objs.size()=1 2024-09-12T19:13:58.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0mDsD9_1hKpTzr861BtAuEIs18VxHUT_0 2024-09-12T19:13:58.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12010891502420616895', time=2024-09-12T21:02:00.801809+0000, chain.objs.size()=1 2024-09-12T19:13:58.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.YfAvlDqYgJPVaAY_sIg2GTUNfN01iaU_0 2024-09-12T19:13:58.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1468088785462852998', time=2024-09-12T21:02:00.804880+0000, chain.objs.size()=1 2024-09-12T19:13:58.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.tP9c-8dRJ-Gomm2r7-04vqKHSvibsLw_0 2024-09-12T19:13:58.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11504145006592511332', time=2024-09-12T21:02:00.849941+0000, chain.objs.size()=1 2024-09-12T19:13:58.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.HLLBIrRlh1v8a0No9QGU23MoBjFswrw_0 2024-09-12T19:13:58.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13098919785184124249', time=2024-09-12T21:02:00.853214+0000, chain.objs.size()=1 2024-09-12T19:13:58.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.U_LCz7MqridyYFDyFLoX4xEPjKzIQq8_0 2024-09-12T19:13:58.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11990608903958419666', time=2024-09-12T21:02:00.855363+0000, chain.objs.size()=1 2024-09-12T19:13:58.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.weQ06IpYt0ezvKcytfHSmg2LZGniEfz_0 2024-09-12T19:13:58.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.678006865214770413', time=2024-09-12T21:02:00.867444+0000, chain.objs.size()=1 2024-09-12T19:13:58.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.lhdftDkktlflrauv760aQs-TqysI_2g_0 2024-09-12T19:13:58.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5811588414606853832', time=2024-09-12T21:02:01.006600+0000, chain.objs.size()=1 2024-09-12T19:13:58.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ZspgAaKqcVVJ3pI_EyKcwoGB8dpG0at_0 2024-09-12T19:13:58.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5939907143740145481', time=2024-09-12T21:02:01.090388+0000, chain.objs.size()=1 2024-09-12T19:13:58.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.060+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.XXkVNuycGakXCmHzULInGKU7uaNvdqf_0 2024-09-12T19:13:58.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6758858258327244629', time=2024-09-12T21:02:01.111095+0000, chain.objs.size()=1 2024-09-12T19:13:58.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jTz2h5NSyGpcZNhADOGWuBnAnibx09e_0 2024-09-12T19:13:58.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6351845312818308408', time=2024-09-12T21:02:01.227447+0000, chain.objs.size()=1 2024-09-12T19:13:58.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.fToYejxHQkj_8SqeI-L-EJqkQeLh0Oq_0 2024-09-12T19:13:58.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15644859359132975690', time=2024-09-12T21:02:01.235630+0000, chain.objs.size()=1 2024-09-12T19:13:58.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Pv4ynpqQNPFne63gSFFIy51Lzj-AnRo_0 2024-09-12T19:13:58.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3150458973657457845', time=2024-09-12T21:02:01.270288+0000, chain.objs.size()=1 2024-09-12T19:13:58.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.a51KA07LBsnmi8hyjXXI35CS9fK1jSx_0 2024-09-12T19:13:58.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.981523983493159553', time=2024-09-12T21:02:01.286604+0000, chain.objs.size()=1 2024-09-12T19:13:58.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.VxhFCu-cH4aF4I3ibJZpHeYwGRJXhnv_0 2024-09-12T19:13:58.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2315994236339428800', time=2024-09-12T21:02:01.323935+0000, chain.objs.size()=1 2024-09-12T19:13:58.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.JtuDSTKILjv26kjgTsQX5A6kuvWfpaw_0 2024-09-12T19:13:58.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14221211819932427988', time=2024-09-12T21:02:01.437952+0000, chain.objs.size()=1 2024-09-12T19:13:58.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.QVjIKnvihPwuzylvpesGakN7PK1OsjL_0 2024-09-12T19:13:58.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15892901966530998322', time=2024-09-12T21:02:01.441004+0000, chain.objs.size()=1 2024-09-12T19:13:58.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.kiTjMnJGOm5V3TdesjmzT3VaV-n01QD_0 2024-09-12T19:13:58.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10401105532451592026', time=2024-09-12T21:02:01.466317+0000, chain.objs.size()=1 2024-09-12T19:13:58.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.KTRoEAw5C1wmWg1iEV2WIcF-FVFpQo6_0 2024-09-12T19:13:58.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9263242949030350267', time=2024-09-12T21:02:01.502923+0000, chain.objs.size()=1 2024-09-12T19:13:58.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7gD4TOvK0lcU-9jkF33IyLN8vIBC3yh_0 2024-09-12T19:13:58.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.751609028720145957', time=2024-09-12T21:02:01.528886+0000, chain.objs.size()=1 2024-09-12T19:13:58.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.V_Sh3UhHdjy98Fr8kHj252Or3F_jE3M_0 2024-09-12T19:13:58.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6393587812441164168', time=2024-09-12T21:02:01.698895+0000, chain.objs.size()=1 2024-09-12T19:13:58.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.064+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.uaPU5v_OGzlYPDY6Z2vn25gDS1q_ZgJ_0 2024-09-12T19:13:58.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/55362 2024-09-12T19:13:58.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T19:13:58.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6079707887776192646', time=2024-09-12T21:02:01.887196+0000, chain.objs.size()=1 2024-09-12T19:13:58.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.4KlnqADW3ENarjZcOTlr9sXsujGjKSu_0 2024-09-12T19:13:58.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4162136857128200734', time=2024-09-12T21:02:01.946669+0000, chain.objs.size()=1 2024-09-12T19:13:58.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.KuLi1-EluYFm1WiEB2zEvNAp23lMYrR_0 2024-09-12T19:13:58.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11111523189622672396', time=2024-09-12T21:02:01.987201+0000, chain.objs.size()=1 2024-09-12T19:13:58.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.4WLQqMa6O2V8iiPjg5VoAsN5J4E4BFQ_0 2024-09-12T19:13:58.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15825912867461022000', time=2024-09-12T21:02:01.997910+0000, chain.objs.size()=1 2024-09-12T19:13:58.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.i_fA5L3rS6TuXdlQbqTLKR1QCgzuRnX_0 2024-09-12T19:13:58.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2182079445297851434', time=2024-09-12T21:02:02.109717+0000, chain.objs.size()=1 2024-09-12T19:13:58.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._IN7_TTLHxIq8y65VFyqZvNCHxmKPiq_0 2024-09-12T19:13:58.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5161350821916528853', time=2024-09-12T21:02:02.117613+0000, chain.objs.size()=1 2024-09-12T19:13:58.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.XWo1VG7NVkX_7I8nY8otJrL7UmeZoTl_0 2024-09-12T19:13:58.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13146551660917138278', time=2024-09-12T21:02:02.129694+0000, chain.objs.size()=1 2024-09-12T19:13:58.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Akne2Bc97eVEmyebOTo66Gjvg_onQcA_0 2024-09-12T19:13:58.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4000350432953102495', time=2024-09-12T21:02:02.137560+0000, chain.objs.size()=1 2024-09-12T19:13:58.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.B_Y6EdiIb7nUh5UCJvbiGhWcvJOQZ03_0 2024-09-12T19:13:58.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16931339780133205797', time=2024-09-12T21:02:02.165928+0000, chain.objs.size()=1 2024-09-12T19:13:58.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ZUZHV7NfVh-4xzov5pw3zwyBZSUxbnk_0 2024-09-12T19:13:58.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15736660489458403494', time=2024-09-12T21:02:02.198880+0000, chain.objs.size()=1 2024-09-12T19:13:58.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2Ffb9mbUX9QMxyoQkpXeOGbrAfql9xI_0 2024-09-12T19:13:58.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3613880150358755868', time=2024-09-12T21:02:38.309653+0000, chain.objs.size()=1 2024-09-12T19:13:58.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.379__shadow_.1d2l2zNgmJ9J6tDgwfpTRAXgjzWZii2_0 2024-09-12T19:13:58.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9565237592567466509', time=2024-09-12T21:03:58.818402+0000, chain.objs.size()=1 2024-09-12T19:13:58.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.068+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.487__shadow_.yjkCpVZ43Wmx3UxKgxfiZfVO69Gq4wH_0 2024-09-12T19:13:58.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4212457122105996286', time=2024-09-12T21:04:02.635756+0000, chain.objs.size()=1 2024-09-12T19:13:58.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.493__shadow_.4glBvUtjaNEn11AUPqilho7QxR03mr0_0 2024-09-12T19:13:58.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.376806567062766118', time=2024-09-12T21:04:56.932469+0000, chain.objs.size()=2 2024-09-12T19:13:58.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.528__multipart_mymultipart.2~bNz4CbU_OU7NlxDovSrv-gK1ry6HLWy.1 2024-09-12T19:13:58.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.528__multipart_mymultipart.2~bNz4CbU_OU7NlxDovSrv-gK1ry6HLWy.2 2024-09-12T19:13:58.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4315680060011462492', time=2024-09-12T21:06:07.411660+0000, chain.objs.size()=1 2024-09-12T19:13:58.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:JIwCJlxEr8eWXG8wz6MlZQQbGDN4CFs_.0L2aUD5nIN8-eduPWeufnNdi2kx519W_0 2024-09-12T19:13:58.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6205562954997124216', time=2024-09-12T21:06:30.792621+0000, chain.objs.size()=1 2024-09-12T19:13:58.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:sRmpU-SbyA7MxXDOUZcSm96uXEi-5zm_.q6dbznLVmU8TOf4BXGBm9qJ7ZYmPYAG_0 2024-09-12T19:13:58.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5838414096907188372', time=2024-09-12T21:06:53.752573+0000, chain.objs.size()=1 2024-09-12T19:13:58.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.587__shadow:UzDQWh9HRnvToJgqvPzlTUfyf4tQwEL_.TA3GaODJxveGiZdcyUw1Kb5bvq2-Vs__0 2024-09-12T19:13:58.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15210389009705430925', time=2024-09-12T21:09:53.113534+0000, chain.objs.size()=2 2024-09-12T19:13:58.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.648__shadow_.XEu8wKJ0jdpbN8XipAjbp1W6Q7x9X3I_0 2024-09-12T19:13:58.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.648__shadow_.XEu8wKJ0jdpbN8XipAjbp1W6Q7x9X3I_1 2024-09-12T19:13:58.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13947727937876185826', time=2024-09-12T21:09:57.213799+0000, chain.objs.size()=1 2024-09-12T19:13:58.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.653__shadow_.YnxG-GrDn6Vx3q0mTS3FzCddYwnAA-B_0 2024-09-12T19:13:58.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.670196970859357984', time=2024-09-12T21:10:26.229126+0000, chain.objs.size()=1 2024-09-12T19:13:58.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.694__shadow:37BahLO-dI3frhsehzqFybwvLiH4mO._.mYKZioCEWLuL3htrmTw-TKWCk-KO2_D_0 2024-09-12T19:13:58.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10827907778388634140', time=2024-09-12T21:10:29.061760+0000, chain.objs.size()=1 2024-09-12T19:13:58.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.698__shadow:Irn0zNxsNBH0-UDuSAH8TO64NHH9qPG_.CjvCpLLJ6QTqNTa9bEIi-uHkV80GTOM_0 2024-09-12T19:13:58.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17679488826990757819', time=2024-09-12T21:11:01.037950+0000, chain.objs.size()=1 2024-09-12T19:13:58.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.717__shadow:-CpCqJhaPF8do39Z5lorQPUXJrPeiZr_.p4VPBAl7YqDj5NGkDxHvzC_mU05OtEt_0 2024-09-12T19:13:58.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8687195404536894134', time=2024-09-12T21:13:38.712689+0000, chain.objs.size()=1 2024-09-12T19:13:58.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.072+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.782__shadow_.mYpg-xWC8t9boQkw9dnJRPJg7t201sP_0 2024-09-12T19:13:58.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.076+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:58.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.076+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T19:13:58.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.076+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:58.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:58.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45002' 2024-09-12T19:13:58.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14754966305816841426', time=2024-09-12T20:57:32.190204+0000, chain.objs.size()=5 2024-09-12T19:13:58.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__multipart_mymultipart-LUKEWARM.2~0ghfw6q1KOfzopGyS8S2g__PqsOhO72.1 2024-09-12T19:13:58.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__shadow_mymultipart-LUKEWARM.2~0ghfw6q1KOfzopGyS8S2g__PqsOhO72.1_1 2024-09-12T19:13:58.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__multipart_mymultipart-LUKEWARM.2~0ghfw6q1KOfzopGyS8S2g__PqsOhO72.2 2024-09-12T19:13:58.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__shadow_mymultipart-LUKEWARM.2~0ghfw6q1KOfzopGyS8S2g__PqsOhO72.2_1 2024-09-12T19:13:58.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__multipart_mymultipart-LUKEWARM.2~0ghfw6q1KOfzopGyS8S2g__PqsOhO72.3 2024-09-12T19:13:58.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17926585273606644122', time=2024-09-12T20:57:40.904699+0000, chain.objs.size()=1 2024-09-12T19:13:58.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.171__shadow_.Ca50xdfAaqh_cn-FFcO6s9mTiu-hjKZ_0 2024-09-12T19:13:58.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4488241322895108829', time=2024-09-12T20:57:55.176751+0000, chain.objs.size()=1 2024-09-12T19:13:58.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.176__shadow_.2oagpwL_51irANl1-OAlzjt15txk7Yl_0 2024-09-12T19:13:58.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1707133426092263716', time=2024-09-12T20:57:55.897325+0000, chain.objs.size()=1 2024-09-12T19:13:58.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.177__shadow_.-prpPHkDqWMMG0Ya5Hz1-RtAdQl-CeN_0 2024-09-12T19:13:58.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13985900050490658468', time=2024-09-12T20:59:51.620394+0000, chain.objs.size()=1 2024-09-12T19:13:58.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.235__shadow_.2OlR1CpXOPqMrUqkW5wLju35tUo-DJ2_0 2024-09-12T19:13:58.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5794150923529979901', time=2024-09-12T21:00:00.079819+0000, chain.objs.size()=1 2024-09-12T19:13:58.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.244__shadow_.V5ZZPgs2q9L_itK7ykuAWT8iXcj-dPf_0 2024-09-12T19:13:58.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12146946786621350570', time=2024-09-12T21:00:01.525771+0000, chain.objs.size()=1 2024-09-12T19:13:58.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.246__shadow_.G5IKJkfs0rv2asvLxghCuREP3SQexiD_0 2024-09-12T19:13:58.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4852774662873168412', time=2024-09-12T21:00:03.684955+0000, chain.objs.size()=1 2024-09-12T19:13:58.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.080+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.249__shadow_.w233gUIwVpG5qa8_8Cj_xCvzqRrNJzj_0 2024-09-12T19:13:58.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10578216423222719016', time=2024-09-12T21:00:32.483186+0000, chain.objs.size()=1 2024-09-12T19:13:58.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7nawRh6-WMKrNFIbGoKWsNIUdJE95Gx_0 2024-09-12T19:13:58.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5468834083619266316', time=2024-09-12T21:00:32.536728+0000, chain.objs.size()=1 2024-09-12T19:13:58.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.6nRVOOXjpEP71Cp2wXaQufnwcde6u65_0 2024-09-12T19:13:58.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.199223584824521167', time=2024-09-12T21:00:32.659747+0000, chain.objs.size()=1 2024-09-12T19:13:58.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.9GcR5kzvDT6PSB46GxLpIEwIBwM8Lko_0 2024-09-12T19:13:58.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3501245892649967049', time=2024-09-12T21:00:32.667625+0000, chain.objs.size()=1 2024-09-12T19:13:58.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CM0IUqMZimjY1OyBgnEOxwsTbHtj-0R_0 2024-09-12T19:13:58.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1107259550903883485', time=2024-09-12T21:00:32.673004+0000, chain.objs.size()=1 2024-09-12T19:13:58.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_._P_jAnt0GuhFxi99pj2cvuIQu3uA2TI_0 2024-09-12T19:13:58.087 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6405022779903978554', time=2024-09-12T21:00:32.682684+0000, chain.objs.size()=1 2024-09-12T19:13:58.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.5Abpbx7sg8RMfwP4v2ButKVvG_fKdUT_0 2024-09-12T19:13:58.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1482374493204695707', time=2024-09-12T21:00:32.773725+0000, chain.objs.size()=1 2024-09-12T19:13:58.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.C9PaFZaCFw84wNH-HWVz4lK9VIYMhSW_0 2024-09-12T19:13:58.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12181364726991188707', time=2024-09-12T21:00:32.895772+0000, chain.objs.size()=1 2024-09-12T19:13:58.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SBBmClIC7x7e91HN86CYq3kHN71f45__0 2024-09-12T19:13:58.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12594375411483158383', time=2024-09-12T21:00:32.932501+0000, chain.objs.size()=1 2024-09-12T19:13:58.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.odMDqQSkI_ZMhESARD8GjZyRDxEfl4l_0 2024-09-12T19:13:58.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5459292820711033126', time=2024-09-12T21:00:32.936504+0000, chain.objs.size()=1 2024-09-12T19:13:58.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.uuduDTdsr6g05O7NWFteG04tjO7P5mw_0 2024-09-12T19:13:58.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.665169897786130041', time=2024-09-12T21:00:33.158021+0000, chain.objs.size()=1 2024-09-12T19:13:58.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XA8rpym3hV_FpPJppfiI7cT4m7U3DdG_0 2024-09-12T19:13:58.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9460546202442156685', time=2024-09-12T21:00:33.172959+0000, chain.objs.size()=1 2024-09-12T19:13:58.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JwVlPUzVyKDp_dJPl7bHnRc6F_yAqdw_0 2024-09-12T19:13:58.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13002045084105660146', time=2024-09-12T21:00:33.175929+0000, chain.objs.size()=1 2024-09-12T19:13:58.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.uNpIkUg4YbAEzop2zdP0FfN8LNYdjLO_0 2024-09-12T19:13:58.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1688030621428986045', time=2024-09-12T21:00:33.182886+0000, chain.objs.size()=1 2024-09-12T19:13:58.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SVbNeasp8FMXNNzroRPHNYRoiF94uMw_0 2024-09-12T19:13:58.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6060399255931980384', time=2024-09-12T21:00:33.210848+0000, chain.objs.size()=1 2024-09-12T19:13:58.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.kcP7C-gQ8ZS_I67GzjtqJcWn1VhQr2S_0 2024-09-12T19:13:58.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16324532306739295211', time=2024-09-12T21:00:33.215290+0000, chain.objs.size()=1 2024-09-12T19:13:58.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.tIjhPw2k5LH_7m9G77KMmZ4XIWZo_oy_0 2024-09-12T19:13:58.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8544046146796816870', time=2024-09-12T21:00:33.431816+0000, chain.objs.size()=1 2024-09-12T19:13:58.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JM8C0G0-TzxTIhcfBoXpvmzOpRkW8eD_0 2024-09-12T19:13:58.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2471872891062972019', time=2024-09-12T21:00:33.472718+0000, chain.objs.size()=1 2024-09-12T19:13:58.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CETuSjYpUO-Sv3QkmF-eVpl0z8YIYh2_0 2024-09-12T19:13:58.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5742357361571318763', time=2024-09-12T21:00:33.481795+0000, chain.objs.size()=1 2024-09-12T19:13:58.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WJooP2tRuDCgCoDMnrJSxTgjuZybf3L_0 2024-09-12T19:13:58.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16149010757431029374', time=2024-09-12T21:00:33.592233+0000, chain.objs.size()=1 2024-09-12T19:13:58.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.5Jo4wXtfj9Ppp1bR-h32AaOFgxlWzjf_0 2024-09-12T19:13:58.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10157522866879631408', time=2024-09-12T21:00:33.621652+0000, chain.objs.size()=1 2024-09-12T19:13:58.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CyeWMVtJi1osl-mw4FLf5Tsxjhrubrq_0 2024-09-12T19:13:58.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5988256677617094827', time=2024-09-12T21:00:33.845508+0000, chain.objs.size()=1 2024-09-12T19:13:58.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.084+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.YqZJrbyzmEOXPZg2BWoo8wMCBt21gjD_0 2024-09-12T19:13:58.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11371325908937129944', time=2024-09-12T21:00:33.849659+0000, chain.objs.size()=1 2024-09-12T19:13:58.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.buK65b07gFETo4Rgj5_A-Cbyvg4nZ_k_0 2024-09-12T19:13:58.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14831970889582635081', time=2024-09-12T21:00:42.459042+0000, chain.objs.size()=1 2024-09-12T19:13:58.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.274__shadow_.YD4baeqyYddtqp5Aaw3b4nyo01mJTLI_0 2024-09-12T19:13:58.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3477814113623254022', time=2024-09-12T21:00:43.992099+0000, chain.objs.size()=1 2024-09-12T19:13:58.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.276__shadow_.rPB9mU9S3CxD0toAvnF67rk4nnSUClj_0 2024-09-12T19:13:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7708764085838828778', time=2024-09-12T21:00:52.093807+0000, chain.objs.size()=1 2024-09-12T19:13:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.287__shadow_.o4qGcIwd_CGl5-wP6m0Qk2HwN7ww3Dc_0 2024-09-12T19:13:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.667848698441355307', time=2024-09-12T21:00:56.738516+0000, chain.objs.size()=1 2024-09-12T19:13:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.g2lGjZH3OzXYqZwvEIGny9D7Yw_lpws_0 2024-09-12T19:13:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6321931660158903541', time=2024-09-12T21:00:56.742837+0000, chain.objs.size()=1 2024-09-12T19:13:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.Kvf4-JEraiEriDNwRvK8txqDRNEkfGi_0 2024-09-12T19:13:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10490866245286473774', time=2024-09-12T21:00:58.126578+0000, chain.objs.size()=1 2024-09-12T19:13:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.EEPnWHFo-U-JWNtlO9Mqjzkk26HVZPD_0 2024-09-12T19:13:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3127394080050670309', time=2024-09-12T21:01:03.383120+0000, chain.objs.size()=1 2024-09-12T19:13:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.300__shadow_.HYfIxJMxIs6fQP5XFaiyLjhY25Rp9N7_0 2024-09-12T19:13:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9563665991605864395', time=2024-09-12T21:01:09.095173+0000, chain.objs.size()=1 2024-09-12T19:13:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.307__shadow:HVkHHGRwI6nWQOXuGxoAr1ahikUOVfs_.rievKNsShsU7iau2bJYiOSt1Eq7qCxH_0 2024-09-12T19:13:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6370078356175565678', time=2024-09-12T21:01:39.498602+0000, chain.objs.size()=1 2024-09-12T19:13:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.zC3WNDBBYXM7x99S2zrTvpFtN4btMj-_0 2024-09-12T19:13:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3999886826260274337', time=2024-09-12T21:01:39.516102+0000, chain.objs.size()=1 2024-09-12T19:13:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._h6BAZUd1Rb-tiyIRLlevewbqHHWNhQ_0 2024-09-12T19:13:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9866891165787636385', time=2024-09-12T21:01:39.536707+0000, chain.objs.size()=1 2024-09-12T19:13:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.kGB9cgjLJgeYEBAGcwGscnqr0kOntWb_0 2024-09-12T19:13:58.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7041594055523167314', time=2024-09-12T21:01:39.667173+0000, chain.objs.size()=1 2024-09-12T19:13:58.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0EBF16hxsuwJodaSdIHZkqm6i1ks1Tg_0 2024-09-12T19:13:58.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10770124992286235692', time=2024-09-12T21:01:39.673484+0000, chain.objs.size()=1 2024-09-12T19:13:58.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.74pQGsBzQlroTRiazeaTjm1yRjTge8n_0 2024-09-12T19:13:58.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17277448058000986308', time=2024-09-12T21:01:39.748004+0000, chain.objs.size()=1 2024-09-12T19:13:58.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9o7zRZlyH8774JGx9g_cz6PkXB5zMOt_0 2024-09-12T19:13:58.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16404196464588775229', time=2024-09-12T21:01:39.787026+0000, chain.objs.size()=1 2024-09-12T19:13:58.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.No6EVxraqv-uGOwoHsyTdiHYnv1Yo-K_0 2024-09-12T19:13:58.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7862855470425242387', time=2024-09-12T21:01:39.797148+0000, chain.objs.size()=1 2024-09-12T19:13:58.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.kUnD5JVpD5X3KwfIoFmVFXM-S26Rspk_0 2024-09-12T19:13:58.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.347505931292706431', time=2024-09-12T21:01:39.897870+0000, chain.objs.size()=1 2024-09-12T19:13:58.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.dKGQQs7IyBQWS1IBgyoc6xpdsAwh9lX_0 2024-09-12T19:13:58.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9668766991672612145', time=2024-09-12T21:01:39.911048+0000, chain.objs.size()=1 2024-09-12T19:13:58.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.J9q3t04vNm4MsvzZOwkFRvfCkQTmeWD_0 2024-09-12T19:13:58.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11333330441119919270', time=2024-09-12T21:01:39.915926+0000, chain.objs.size()=1 2024-09-12T19:13:58.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.XhsvXYcI0MP5gkVnonvD_xQAtNaln7X_0 2024-09-12T19:13:58.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7471348296385596701', time=2024-09-12T21:01:39.931506+0000, chain.objs.size()=1 2024-09-12T19:13:58.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.088+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.saCGm6sEYYKbwnX0z7in2bys_SnO4ki_0 2024-09-12T19:13:58.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1375318941305531459', time=2024-09-12T21:01:40.001930+0000, chain.objs.size()=1 2024-09-12T19:13:58.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.guBjiykPxY7MbDKXVDIxzpuLOqcL07E_0 2024-09-12T19:13:58.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11479324043882675823', time=2024-09-12T21:01:40.017176+0000, chain.objs.size()=1 2024-09-12T19:13:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.fU8it1Mtqlnz2wcubqYim99xlto8Pa4_0 2024-09-12T19:13:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16975919205164642119', time=2024-09-12T21:01:40.116227+0000, chain.objs.size()=1 2024-09-12T19:13:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RUp15Ue1H38aQMdYVa-Gpd-CwDPL_OA_0 2024-09-12T19:13:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5367321045704592230', time=2024-09-12T21:01:40.119672+0000, chain.objs.size()=1 2024-09-12T19:13:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QnsqP-TK3_pFgws2b8gZhJFNW48NKq9_0 2024-09-12T19:13:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8132187175387860130', time=2024-09-12T21:01:40.124978+0000, chain.objs.size()=1 2024-09-12T19:13:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QIjeu2w8iR5uy80gLQgz88t07HH9J9J_0 2024-09-12T19:13:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4196791209380408282', time=2024-09-12T21:01:40.342085+0000, chain.objs.size()=1 2024-09-12T19:13:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.q1oGc8-MTOwWt-z6qeumMtEoUv-Bhnq_0 2024-09-12T19:13:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5451183558349937526', time=2024-09-12T21:01:40.459530+0000, chain.objs.size()=1 2024-09-12T19:13:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.uvIdFXqrbA97nMzl4e5uZTq1MONjVCx_0 2024-09-12T19:13:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13689771394636266871', time=2024-09-12T21:01:40.611213+0000, chain.objs.size()=1 2024-09-12T19:13:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.FhhuCE1CGrmCE2D0BHZruONoZ4bXZld_0 2024-09-12T19:13:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1283736991318855000', time=2024-09-12T21:01:40.669665+0000, chain.objs.size()=1 2024-09-12T19:13:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hiUFAiqvePLRODKBHKTAPRKIsk8Aj8t_0 2024-09-12T19:13:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3474668558039536500', time=2024-09-12T21:01:40.857060+0000, chain.objs.size()=1 2024-09-12T19:13:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9nnZpnpbPXpl241yScpG-EbIzLiyy9G_0 2024-09-12T19:13:58.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9926581469167529725', time=2024-09-12T21:01:40.885630+0000, chain.objs.size()=1 2024-09-12T19:13:58.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.4o4yd_7tkVYdJ0tDHCjxSyg5T05jdV4_0 2024-09-12T19:13:58.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15582158084022754338', time=2024-09-12T21:01:40.886358+0000, chain.objs.size()=1 2024-09-12T19:13:58.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.i_IWEEHQhh5T2VCom2nyOcY7RdcrZ9U_0 2024-09-12T19:13:58.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18414920588767432418', time=2024-09-12T21:01:40.889496+0000, chain.objs.size()=1 2024-09-12T19:13:58.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.092+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.7m1VztJDw3FVm5s0t4W8o1XW6x2Ceub_0 2024-09-12T19:13:58.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8172039159494290593', time=2024-09-12T21:01:40.991235+0000, chain.objs.size()=1 2024-09-12T19:13:58.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.dJs6A7x8YsUKed2gpiwFo1vVeOh6O-k_0 2024-09-12T19:13:58.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5630584560784298594', time=2024-09-12T21:01:41.009900+0000, chain.objs.size()=1 2024-09-12T19:13:58.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.t3fxkD5C4qngxmMqbav7YWoKKowayhm_0 2024-09-12T19:13:58.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6322416555023722288', time=2024-09-12T21:01:41.021951+0000, chain.objs.size()=1 2024-09-12T19:13:58.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.pJYKD7Gk_25hC4n3e-g5PwGe23p4ezs_0 2024-09-12T19:13:58.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3535822928443365238', time=2024-09-12T21:01:41.038442+0000, chain.objs.size()=1 2024-09-12T19:13:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.CKj0BDDAMWQOaZh0oond1z2t4C-Dwbb_0 2024-09-12T19:13:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15484460306150617601', time=2024-09-12T21:01:41.058735+0000, chain.objs.size()=1 2024-09-12T19:13:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mfE85ntzjaPHvMmjIlUSaVQVZkNdBJd_0 2024-09-12T19:13:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6978744957219246901', time=2024-09-12T21:01:41.069499+0000, chain.objs.size()=1 2024-09-12T19:13:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.h-JThqLGmA1j8JXJD4zHsv-QF1o3zSC_0 2024-09-12T19:13:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18004206170674978312', time=2024-09-12T21:01:41.086439+0000, chain.objs.size()=1 2024-09-12T19:13:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.5phUYu57_RPSAGwC9MMQwd1wJWKAc9X_0 2024-09-12T19:13:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1307844696113183389', time=2024-09-12T21:02:00.509561+0000, chain.objs.size()=1 2024-09-12T19:13:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.S8yU4qXVrFsYLIE0gVwich0p3snkQVu_0 2024-09-12T19:13:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15718302066434698272', time=2024-09-12T21:02:00.537569+0000, chain.objs.size()=1 2024-09-12T19:13:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.keb17ISApHVrdeJlCZt6m0cNUfs4YUA_0 2024-09-12T19:13:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5100951424624506760', time=2024-09-12T21:02:00.619127+0000, chain.objs.size()=1 2024-09-12T19:13:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.iMgk7CMKf4vruOnlDOr8f2iQKPW6XWo_0 2024-09-12T19:13:58.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1124942048159956539', time=2024-09-12T21:02:00.791899+0000, chain.objs.size()=1 2024-09-12T19:13:58.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.tCDuUOf3Khs-22yqErwKHgFIGvUIxJQ_0 2024-09-12T19:13:58.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7861852102378538591', time=2024-09-12T21:02:00.801627+0000, chain.objs.size()=1 2024-09-12T19:13:58.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.6jIvQX6zJV1EDnNdoz68v1KZe8i3fkG_0 2024-09-12T19:13:58.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3592330167996628958', time=2024-09-12T21:02:00.835463+0000, chain.objs.size()=1 2024-09-12T19:13:58.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yyEa67GoIMXiKGubIByi4M6PJzipyDM_0 2024-09-12T19:13:58.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15941656961378510398', time=2024-09-12T21:02:00.849978+0000, chain.objs.size()=1 2024-09-12T19:13:58.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.CPhdD2LlecnxfDyewI5Yfyq1KPaNmeR_0 2024-09-12T19:13:58.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8520787220081582619', time=2024-09-12T21:02:00.882196+0000, chain.objs.size()=1 2024-09-12T19:13:58.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.VJ13c1xq4jsExhW6eDs_DNR6i1MeWuN_0 2024-09-12T19:13:58.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11427248210169454653', time=2024-09-12T21:02:00.887961+0000, chain.objs.size()=1 2024-09-12T19:13:58.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WMR9TakHegyol3-DXPRr_4bjdqX6Hko_0 2024-09-12T19:13:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4377989362601483213', time=2024-09-12T21:02:01.011102+0000, chain.objs.size()=1 2024-09-12T19:13:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ks3UmkR-I3mDRW1_27iZ8lb3UrCA02z_0 2024-09-12T19:13:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18177925501095478012', time=2024-09-12T21:02:01.019685+0000, chain.objs.size()=1 2024-09-12T19:13:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.vcXzNLsJsyX1Z6kPe_dcJ8YavTqxwt-_0 2024-09-12T19:13:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14503863823808175066', time=2024-09-12T21:02:01.034283+0000, chain.objs.size()=1 2024-09-12T19:13:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.XwLpxF23Of44bRDs1aYJzMZzk-qsZJu_0 2024-09-12T19:13:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12794140746246974666', time=2024-09-12T21:02:01.057907+0000, chain.objs.size()=1 2024-09-12T19:13:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.frw9fnsnvtW_ylJCAcIek4PDklp2q2G_0 2024-09-12T19:13:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3208093397543560335', time=2024-09-12T21:02:01.065918+0000, chain.objs.size()=1 2024-09-12T19:13:58.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.K3XjpueiGZ1nEwPNNleQarCtHMmRBcX_0 2024-09-12T19:13:58.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16481226689509960898', time=2024-09-12T21:02:01.092582+0000, chain.objs.size()=1 2024-09-12T19:13:58.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.096+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.iSf7HhPINPEaawJbvAu9rFrhWe-O6dh_0 2024-09-12T19:13:58.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12883739790952736862', time=2024-09-12T21:02:01.230728+0000, chain.objs.size()=1 2024-09-12T19:13:58.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.QT3yp2qgerZLVxgoTNH0Emil17L9X05_0 2024-09-12T19:13:58.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6756606425859602082', time=2024-09-12T21:02:01.271576+0000, chain.objs.size()=1 2024-09-12T19:13:58.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.OieEs-6w9TebEfwy1dBJPZ1pWNZyb0P_0 2024-09-12T19:13:58.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14032471176964864541', time=2024-09-12T21:02:01.286659+0000, chain.objs.size()=1 2024-09-12T19:13:58.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.CNL90Duk-GuUTxkBv9jVpwzI4k8u3zx_0 2024-09-12T19:13:58.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16498000789779363628', time=2024-09-12T21:02:01.350717+0000, chain.objs.size()=1 2024-09-12T19:13:58.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.plZa6oqv1SgXbUk-KXNHZiKBIgyoHmf_0 2024-09-12T19:13:58.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.422377383530896661', time=2024-09-12T21:02:01.438470+0000, chain.objs.size()=1 2024-09-12T19:13:58.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.hED2vv0Z0TLmL1SRJojQC8ISn6yjcVk_0 2024-09-12T19:13:58.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8965541889049170328', time=2024-09-12T21:02:01.481107+0000, chain.objs.size()=1 2024-09-12T19:13:58.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.UyLb_ThW_1LsIr1yFADK2CvL-05oH4M_0 2024-09-12T19:13:58.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18293593240634343189', time=2024-09-12T21:02:01.483253+0000, chain.objs.size()=1 2024-09-12T19:13:58.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.r8lQvcRKmdryGWEo3pXwqvXrpXCVnWz_0 2024-09-12T19:13:58.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4581034125979773391', time=2024-09-12T21:02:01.506818+0000, chain.objs.size()=1 2024-09-12T19:13:58.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ieSDcTfycHPcEHg_XNY03xtJT0knbEu_0 2024-09-12T19:13:58.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11355611061118719429', time=2024-09-12T21:02:01.673421+0000, chain.objs.size()=1 2024-09-12T19:13:58.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.BnKTreJf-GkmSlwap6kHrhI6o0FqP4I_0 2024-09-12T19:13:58.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13924501313862765601', time=2024-09-12T21:02:01.887570+0000, chain.objs.size()=1 2024-09-12T19:13:58.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ni4NR0JMBMjh5k48arJtp1z6Q6cMQp-_0 2024-09-12T19:13:58.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3545328884296650655', time=2024-09-12T21:02:01.916523+0000, chain.objs.size()=1 2024-09-12T19:13:58.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.3S7GSNEN0HwLX1AVsLI3QaGwIw1NJj6_0 2024-09-12T19:13:58.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4383782674573894239', time=2024-09-12T21:02:01.934068+0000, chain.objs.size()=1 2024-09-12T19:13:58.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.e6qg0JuT_Mw9tiHPZRZZOPA5jXGR7fX_0 2024-09-12T19:13:58.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1359989256283401918', time=2024-09-12T21:02:01.941586+0000, chain.objs.size()=1 2024-09-12T19:13:58.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.TvU94G98TpVR1UP9jTub2n_lC0s7rJJ_0 2024-09-12T19:13:58.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11313112774481402143', time=2024-09-12T21:02:02.128397+0000, chain.objs.size()=1 2024-09-12T19:13:58.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.100+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Cx8XNpxjkl0w7uajVDHWZRZsyoweElt_0 2024-09-12T19:13:58.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45002 2024-09-12T19:13:58.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T19:13:58.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13184558755301801494', time=2024-09-12T21:02:02.133029+0000, chain.objs.size()=1 2024-09-12T19:13:58.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.9ulXqd9ZiX7EhPjQjJiMU961cKVxS1S_0 2024-09-12T19:13:58.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7888009540520361344', time=2024-09-12T21:02:02.173858+0000, chain.objs.size()=1 2024-09-12T19:13:58.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Vyp5aTAfie6ChqpB5XrdepGtOPRgS1Z_0 2024-09-12T19:13:58.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3257577732937472048', time=2024-09-12T21:02:05.368843+0000, chain.objs.size()=1 2024-09-12T19:13:58.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.329__shadow_.jYc05cqDNsH2hG92twn4nj_mNMxMgXl_0 2024-09-12T19:13:58.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17886677057200835048', time=2024-09-12T21:03:46.778542+0000, chain.objs.size()=1 2024-09-12T19:13:58.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.466__shadow_.GDeBAVSybybg1ipduLcaopZoxwRNFzZ_0 2024-09-12T19:13:58.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6177554925519814695', time=2024-09-12T21:03:55.564583+0000, chain.objs.size()=1 2024-09-12T19:13:58.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.483__shadow_.rla86IqkE-ZVZ4T1Loc2IrVXAjfhWbF_0 2024-09-12T19:13:58.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14553739002137049132', time=2024-09-12T21:03:55.571712+0000, chain.objs.size()=1 2024-09-12T19:13:58.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.483__shadow_.QBuh6jdIXHTf5lrThwzbtcVkG-tznzm_0 2024-09-12T19:13:58.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16641382939648601448', time=2024-09-12T21:04:29.635262+0000, chain.objs.size()=4 2024-09-12T19:13:58.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.520__shadow:LTFUOGZ9-4Kv68X5HaJkPtxvtQd2vgi_.8zm-GAq9dMugJnTnimIoc7ZDqEV6CDq_0 2024-09-12T19:13:58.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.520__shadow:LTFUOGZ9-4Kv68X5HaJkPtxvtQd2vgi_.8zm-GAq9dMugJnTnimIoc7ZDqEV6CDq_1 2024-09-12T19:13:58.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.520__shadow:LTFUOGZ9-4Kv68X5HaJkPtxvtQd2vgi_.8zm-GAq9dMugJnTnimIoc7ZDqEV6CDq_2 2024-09-12T19:13:58.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.520__shadow:LTFUOGZ9-4Kv68X5HaJkPtxvtQd2vgi_.8zm-GAq9dMugJnTnimIoc7ZDqEV6CDq_3 2024-09-12T19:13:58.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9822259062570071167', time=2024-09-12T21:04:53.398053+0000, chain.objs.size()=1 2024-09-12T19:13:58.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.524__shadow_.TpR0_XSXdj1K37MjTQtV9LuniZG6tZS_0 2024-09-12T19:13:58.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~TO_P6WoXhJD8neFkGGuhuBkZ0_5yeMf', time=2024-09-12T21:04:57.715826+0000, chain.objs.size()=4 2024-09-12T19:13:58.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.104+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.529__multipart_mymultipart.2~TO_P6WoXhJD8neFkGGuhuBkZ0_5yeMf.1 2024-09-12T19:13:58.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.529__shadow_mymultipart.2~TO_P6WoXhJD8neFkGGuhuBkZ0_5yeMf.1_1 2024-09-12T19:13:58.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.529__multipart_mymultipart.2~TO_P6WoXhJD8neFkGGuhuBkZ0_5yeMf.2 2024-09-12T19:13:58.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.529__shadow_mymultipart.2~TO_P6WoXhJD8neFkGGuhuBkZ0_5yeMf.2_1 2024-09-12T19:13:58.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7303182831636981721', time=2024-09-12T21:05:53.278563+0000, chain.objs.size()=1 2024-09-12T19:13:58.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.561__multipart_mymultipart.s-Dl7--J4wgKNAV1XPSTWSYRuRfHdd9n.1 2024-09-12T19:13:58.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2684312468556103052', time=2024-09-12T21:06:04.112727+0000, chain.objs.size()=1 2024-09-12T19:13:58.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:OjtQxr78ySY39viB0wtvYGYbQMAxSMg_.V3Zcuw24OmVesTL_qecbK3ztd2b6Z9B_0 2024-09-12T19:13:58.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.738815262558101780', time=2024-09-12T21:06:18.843768+0000, chain.objs.size()=1 2024-09-12T19:13:58.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.574__shadow:oszRbFTaxJ4cnPjYfjkwPzT864d9WoM_.V1r_BYIKUIbAXEnuQaebW9Skd7kIuzV_0 2024-09-12T19:13:58.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12245267994612545890', time=2024-09-12T21:06:52.103926+0000, chain.objs.size()=1 2024-09-12T19:13:58.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.585__shadow:QpF27A5z6blDIioU5a8XMrIwJa5vcUT_.ZMDYK_9tBLa4YtDbY8IPdGZXxxGLLUC_0 2024-09-12T19:13:58.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10842012982274900840', time=2024-09-12T21:06:53.913670+0000, chain.objs.size()=1 2024-09-12T19:13:58.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.587__shadow:oBvv4u3pUDU3mwh8R6t3PYWOEyKs0q0_.hHU4HIPW-J6WB9Wkdo36Ddm1hF0R1_e_0 2024-09-12T19:13:58.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9418971087594626363', time=2024-09-12T21:09:39.353069+0000, chain.objs.size()=1 2024-09-12T19:13:58.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.630__shadow_.aAHba0z9PE4v-BrviFhfXIxM22vBay8_0 2024-09-12T19:13:58.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7337414268034961361', time=2024-09-12T21:10:33.295059+0000, chain.objs.size()=1 2024-09-12T19:13:58.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.108+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.704__shadow:jZ2.m86F2HBjKMiFIPUa.r2aNpZkOGh_.RdCC0Es9lwddknnIW1BvKgRHrvEeUae_0 2024-09-12T19:13:58.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.112+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:58.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T19:13:58.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:58.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:58.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47552' 2024-09-12T19:13:58.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15126276311109793870', time=2024-09-12T20:57:32.203391+0000, chain.objs.size()=5 2024-09-12T19:13:58.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__multipart_mymultipart-STANDARD.2~rigfpoeMOn2EvBKxH7L7OBUDp0_2bYi.1 2024-09-12T19:13:58.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__shadow_mymultipart-STANDARD.2~rigfpoeMOn2EvBKxH7L7OBUDp0_2bYi.1_1 2024-09-12T19:13:58.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__multipart_mymultipart-STANDARD.2~rigfpoeMOn2EvBKxH7L7OBUDp0_2bYi.2 2024-09-12T19:13:58.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__shadow_mymultipart-STANDARD.2~rigfpoeMOn2EvBKxH7L7OBUDp0_2bYi.2_1 2024-09-12T19:13:58.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.159__multipart_mymultipart-STANDARD.2~rigfpoeMOn2EvBKxH7L7OBUDp0_2bYi.3 2024-09-12T19:13:58.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13837597831053281142', time=2024-09-12T20:57:32.647811+0000, chain.objs.size()=3 2024-09-12T19:13:58.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.X5wGb12Nl0VMqakKvKLaTyNIpt_8hKM_0 2024-09-12T19:13:58.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.X5wGb12Nl0VMqakKvKLaTyNIpt_8hKM_1 2024-09-12T19:13:58.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.X5wGb12Nl0VMqakKvKLaTyNIpt_8hKM_2 2024-09-12T19:13:58.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5139942387751760532', time=2024-09-12T20:59:51.620930+0000, chain.objs.size()=1 2024-09-12T19:13:58.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.235__shadow_.-7htx_dIg53V7XOeaXbnEpHm9zBvFqN_0 2024-09-12T19:13:58.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1607202846901498918', time=2024-09-12T20:59:52.376527+0000, chain.objs.size()=1 2024-09-12T19:13:58.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.236__shadow_.U4SqPrY3f1USn_6-1Ug3Rj8ETb3rvMt_0 2024-09-12T19:13:58.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14173508189766761064', time=2024-09-12T20:59:52.378231+0000, chain.objs.size()=1 2024-09-12T19:13:58.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.236__shadow_.3RE002BxElV2MpQn6icRqhf-CdCXKCp_0 2024-09-12T19:13:58.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12496258392130052015', time=2024-09-12T20:59:55.465339+0000, chain.objs.size()=1 2024-09-12T19:13:58.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.116+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.239__shadow_.sQzcV553_leLizLiqT-xHE-AeSQgc2H_0 2024-09-12T19:13:58.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2009454835445842503', time=2024-09-12T21:00:06.675781+0000, chain.objs.size()=1 2024-09-12T19:13:58.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.253__shadow_.kWHpCICDvVhX7e01-StQt2vyDUXbC_S_0 2024-09-12T19:13:58.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15153915464434274775', time=2024-09-12T21:00:31.979343+0000, chain.objs.size()=1 2024-09-12T19:13:58.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.U72aC0OwhFhDWbj2kWvR_iYUD4y8TXy_0 2024-09-12T19:13:58.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1644951889041694230', time=2024-09-12T21:00:32.011405+0000, chain.objs.size()=1 2024-09-12T19:13:58.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.KsbhvRvtIfk4T0LtUxAvLT49_SbldYX_0 2024-09-12T19:13:58.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9536194147894193073', time=2024-09-12T21:00:32.032906+0000, chain.objs.size()=1 2024-09-12T19:13:58.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.FpYRQAZIyhq2og4L525i_T5qWZVzyWw_0 2024-09-12T19:13:58.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6075490572698811025', time=2024-09-12T21:00:32.068510+0000, chain.objs.size()=1 2024-09-12T19:13:58.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.MEcZV_ZkFz8HFO-n2MwJH9Dj1xauLZ2_0 2024-09-12T19:13:58.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1850163914172287362', time=2024-09-12T21:00:32.095909+0000, chain.objs.size()=1 2024-09-12T19:13:58.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.xg5yUhzD__aDT9hYBVlyonKw06taTbF_0 2024-09-12T19:13:58.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10237722147482008584', time=2024-09-12T21:00:32.101896+0000, chain.objs.size()=1 2024-09-12T19:13:58.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Lew5KXTDrkW77iBjmGnHxn8xC-s5Cow_0 2024-09-12T19:13:58.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5491938701689450252', time=2024-09-12T21:00:32.114268+0000, chain.objs.size()=1 2024-09-12T19:13:58.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.d_Mr6lTk9xkXh4tO8UQ3GHjT3bqmlsi_0 2024-09-12T19:13:58.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17722575868057302291', time=2024-09-12T21:00:32.118666+0000, chain.objs.size()=1 2024-09-12T19:13:58.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CkuDIUSbB4Mp4u9Bx_rrVuVB4Hs3Gn6_0 2024-09-12T19:13:58.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12570280441366516284', time=2024-09-12T21:00:32.124885+0000, chain.objs.size()=1 2024-09-12T19:13:58.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ejh6jSygxb-amly2piUYaqu_0aqtk7f_0 2024-09-12T19:13:58.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1399998364407993385', time=2024-09-12T21:00:32.234184+0000, chain.objs.size()=1 2024-09-12T19:13:58.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.120+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.U4s4nydwrHyGJW5S0zbMR4obFSH_TXQ_0 2024-09-12T19:13:58.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe66fd3a640 0 -- 172.21.15.111:0/2662903071 >> [v2:172.21.15.153:6800/1880471407,v1:172.21.15.153:6801/1880471407] conn(0x7fe660008040 msgr2=0x7fe538086570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T19:13:58.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7502312665181709914', time=2024-09-12T21:00:32.259948+0000, chain.objs.size()=1 2024-09-12T19:13:58.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.5H1kf8EKwJufvkTvPhosyp-hWHlq8sA_0 2024-09-12T19:13:58.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17260387640086170094', time=2024-09-12T21:00:32.277001+0000, chain.objs.size()=1 2024-09-12T19:13:58.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.5O73tmJwbn34D-v-ZlxxcUup9djF0LC_0 2024-09-12T19:13:58.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12530406821193021846', time=2024-09-12T21:00:32.281938+0000, chain.objs.size()=1 2024-09-12T19:13:58.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Q0FN9Q6FTV0wR0cP0tKTXR4BQjg7GoH_0 2024-09-12T19:13:58.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14012868900203709965', time=2024-09-12T21:00:32.283004+0000, chain.objs.size()=1 2024-09-12T19:13:58.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WLK0-JbbTLYhQgpo2EQKSDQT2ZRkSvn_0 2024-09-12T19:13:58.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5330716885448468861', time=2024-09-12T21:00:32.440001+0000, chain.objs.size()=1 2024-09-12T19:13:58.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.25vxYqryoZxdBp8fnw7g_Ql-vbGB3zX_0 2024-09-12T19:13:58.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15136251169392041349', time=2024-09-12T21:00:32.462461+0000, chain.objs.size()=1 2024-09-12T19:13:58.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.a1ZJcD0qHBgt61G_-nFvDeN_AaB88L2_0 2024-09-12T19:13:58.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.890829131583660564', time=2024-09-12T21:00:32.488031+0000, chain.objs.size()=1 2024-09-12T19:13:58.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Lf5lGMzC5fUB6-2efs5hHJytbzseVXY_0 2024-09-12T19:13:58.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11438028348909120755', time=2024-09-12T21:00:32.539103+0000, chain.objs.size()=1 2024-09-12T19:13:58.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7sr2g8DEAl9TyrTL9gJPNE_ONo3Qr-p_0 2024-09-12T19:13:58.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15755549119606485763', time=2024-09-12T21:00:32.659732+0000, chain.objs.size()=1 2024-09-12T19:13:58.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.OjwqRWMi_x5lK2QzWayLN_vf_cw3xOo_0 2024-09-12T19:13:58.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1773560464163643642', time=2024-09-12T21:00:32.691962+0000, chain.objs.size()=1 2024-09-12T19:13:58.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2FZR7e5Xk0fgr1AjA_9kb1xj6HE-Ltt_0 2024-09-12T19:13:58.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4142094093664094998', time=2024-09-12T21:00:32.728526+0000, chain.objs.size()=1 2024-09-12T19:13:58.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.124+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XC2PnPJul3LjNmeGdNwwpwfg6BnILpV_0 2024-09-12T19:13:58.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13038987688285692668', time=2024-09-12T21:00:32.731505+0000, chain.objs.size()=1 2024-09-12T19:13:58.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_._W4eijnqpnFOUoU3a22LfJZVV9gJ_wg_0 2024-09-12T19:13:58.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13027766605425495723', time=2024-09-12T21:00:32.775592+0000, chain.objs.size()=1 2024-09-12T19:13:58.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.1fyglRvisKHl8ky1BKEzwSuq6Kh8E7r_0 2024-09-12T19:13:58.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4007422203485262517', time=2024-09-12T21:00:32.872677+0000, chain.objs.size()=1 2024-09-12T19:13:58.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WpZbLQylm5Kbsf_OQA43oDHEREVXBTi_0 2024-09-12T19:13:58.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15088799715909586115', time=2024-09-12T21:00:32.875144+0000, chain.objs.size()=1 2024-09-12T19:13:58.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.55MREgdK6bjIrLiFgX5T-B7vRcI-Zar_0 2024-09-12T19:13:58.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3860314849005000709', time=2024-09-12T21:00:32.941646+0000, chain.objs.size()=1 2024-09-12T19:13:58.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.YwhZbxzVN8b3deZksz8z_8fHFIDmitQ_0 2024-09-12T19:13:58.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15126989575467802349', time=2024-09-12T21:00:33.156508+0000, chain.objs.size()=1 2024-09-12T19:13:58.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.8uBp-oQ2LzI-phJqhg6_vvg9ZSXhVhn_0 2024-09-12T19:13:58.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8486389262203476453', time=2024-09-12T21:00:33.188899+0000, chain.objs.size()=1 2024-09-12T19:13:58.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.POHAsykj9VuCm2t3gGqAHMDBGXdr1Py_0 2024-09-12T19:13:58.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12673224249310585197', time=2024-09-12T21:00:33.387503+0000, chain.objs.size()=1 2024-09-12T19:13:58.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Utwa3UdmyiSedF8ZoNr5PnzOthhOXub_0 2024-09-12T19:13:58.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5464562576367970046', time=2024-09-12T21:00:33.424662+0000, chain.objs.size()=1 2024-09-12T19:13:58.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.mfuvoFE3VnS07vKUDjDi8yZhnMjFl9P_0 2024-09-12T19:13:58.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13622583155701766600', time=2024-09-12T21:00:33.476943+0000, chain.objs.size()=1 2024-09-12T19:13:58.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.d5c-INuwtBR0UnWJCw86BOymSvOGOWK_0 2024-09-12T19:13:58.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18355443134894938173', time=2024-09-12T21:00:33.625836+0000, chain.objs.size()=1 2024-09-12T19:13:58.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XI-oP8B3tw2LJiRwF-zuGMKcHqNXjqx_0 2024-09-12T19:13:58.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4515329805563379244', time=2024-09-12T21:00:33.888119+0000, chain.objs.size()=1 2024-09-12T19:13:58.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.W_YGhHLbZTSFgbHAnB_JNwp2NhbCKc8_0 2024-09-12T19:13:58.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.60137114471695391', time=2024-09-12T21:00:33.894834+0000, chain.objs.size()=1 2024-09-12T19:13:58.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.gojL6sXPsOSSBUoBfugINH6chqmWcvk_0 2024-09-12T19:13:58.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4793064997629190824', time=2024-09-12T21:00:45.448149+0000, chain.objs.size()=1 2024-09-12T19:13:58.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.278__shadow_.Ycjtjd9TDrLTc_0_-EdQ_w-YH-U_EPD_0 2024-09-12T19:13:58.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5591164344528963305', time=2024-09-12T21:00:48.390416+0000, chain.objs.size()=1 2024-09-12T19:13:58.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.128+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.282__shadow_.PV-pwnKw04NYdY3zmORAzLkv0CI7u9Y_0 2024-09-12T19:13:58.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2852160322282703432', time=2024-09-12T21:00:58.144857+0000, chain.objs.size()=1 2024-09-12T19:13:58.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.D857Tu0lIf0OR3BzOBuNsJBVGqeg_Pi_0 2024-09-12T19:13:58.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1950973864733616542', time=2024-09-12T21:01:01.754916+0000, chain.objs.size()=1 2024-09-12T19:13:58.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.298__shadow_.kdAEhgI1YmD8Wsv6yf2mxCfwsDKtU9s_0 2024-09-12T19:13:58.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4259718444488327906', time=2024-09-12T21:01:39.413376+0000, chain.objs.size()=1 2024-09-12T19:13:58.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.i0IXkyiUPbXJQHsPwEYFEWSQol3Lcey_0 2024-09-12T19:13:58.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14294380879841392980', time=2024-09-12T21:01:39.421108+0000, chain.objs.size()=1 2024-09-12T19:13:58.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DnkZCBp-NzfqPdq0he-DyCXXjMOkJ_a_0 2024-09-12T19:13:58.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16813560542986283911', time=2024-09-12T21:01:39.477563+0000, chain.objs.size()=1 2024-09-12T19:13:58.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.vUInEINFRLN3-pcnoX9FJNeZ-9-aBT5_0 2024-09-12T19:13:58.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1534766241414573607', time=2024-09-12T21:01:39.507290+0000, chain.objs.size()=1 2024-09-12T19:13:58.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QtIuXNHo-LdbrjXsItkLDNUIT1_qgFK_0 2024-09-12T19:13:58.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7491625687159212211', time=2024-09-12T21:01:39.558307+0000, chain.objs.size()=1 2024-09-12T19:13:58.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mRyGXNACrnC2RA1I6aNvGgL2EFzDVQv_0 2024-09-12T19:13:58.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3135516951122136570', time=2024-09-12T21:01:39.701866+0000, chain.objs.size()=1 2024-09-12T19:13:58.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Onhau0vYI-DRUdALsFYgV7XELoTAdpP_0 2024-09-12T19:13:58.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17227908409437923480', time=2024-09-12T21:01:39.790963+0000, chain.objs.size()=1 2024-09-12T19:13:58.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.b1ykZ813HYY5vVMOQBJWvxIH5bi0sk9_0 2024-09-12T19:13:58.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13856328763800581456', time=2024-09-12T21:01:39.794079+0000, chain.objs.size()=1 2024-09-12T19:13:58.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.pgzdA5lLxcsS8SlqEZiS_qpp2y8EBqv_0 2024-09-12T19:13:58.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14348979328649393179', time=2024-09-12T21:01:40.007121+0000, chain.objs.size()=1 2024-09-12T19:13:58.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.PFHrNeO5aRmfF9ymVAHcQo2OXVqs6DI_0 2024-09-12T19:13:58.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14830276567560129023', time=2024-09-12T21:01:40.008014+0000, chain.objs.size()=1 2024-09-12T19:13:58.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.m3aHpfn0KJq1CnDk46qlrog0zWdNG9D_0 2024-09-12T19:13:58.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11703977553825505609', time=2024-09-12T21:01:40.008863+0000, chain.objs.size()=1 2024-09-12T19:13:58.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Of896hLjZ3zOBf-ijI9JEiQKQUs_dlf_0 2024-09-12T19:13:58.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7437158903751502701', time=2024-09-12T21:01:40.115149+0000, chain.objs.size()=1 2024-09-12T19:13:58.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._EorwdxoOW_xqz3-OPpNYifeEz32IRX_0 2024-09-12T19:13:58.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4151127412585164198', time=2024-09-12T21:01:40.117089+0000, chain.objs.size()=1 2024-09-12T19:13:58.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.g-f6DWDq3cglDlELnkBYNkZrraIGily_0 2024-09-12T19:13:58.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3129287958552788198', time=2024-09-12T21:01:40.119384+0000, chain.objs.size()=1 2024-09-12T19:13:58.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.IpFSBeW4YH_Xk4gsZyKaTl1ufD8eR8d_0 2024-09-12T19:13:58.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7469793469550032970', time=2024-09-12T21:01:40.152184+0000, chain.objs.size()=1 2024-09-12T19:13:58.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ShWtzs0pNbL2D7jPKA1vBCkpxXwEvIB_0 2024-09-12T19:13:58.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6592866207919730448', time=2024-09-12T21:01:40.153010+0000, chain.objs.size()=1 2024-09-12T19:13:58.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DlKerxvD76GwMr7WAzQ3nSvRsWQ1ElV_0 2024-09-12T19:13:58.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1552001884628869162', time=2024-09-12T21:01:40.197069+0000, chain.objs.size()=1 2024-09-12T19:13:58.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.A12Q0H9JXRPUVZgwtjsniAwcj-idyTg_0 2024-09-12T19:13:58.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2792013518288980911', time=2024-09-12T21:01:40.202173+0000, chain.objs.size()=1 2024-09-12T19:13:58.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.vtnfpo8D2X8Ovfltx_e1hwDBxxIUkLA_0 2024-09-12T19:13:58.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13220839600774707095', time=2024-09-12T21:01:40.340058+0000, chain.objs.size()=1 2024-09-12T19:13:58.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DwmWd6DGlHcx_I4icMn_72Y23roF3aB_0 2024-09-12T19:13:58.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16516762620763198512', time=2024-09-12T21:01:40.411726+0000, chain.objs.size()=1 2024-09-12T19:13:58.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.132+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.oswSd3-QLadng-Ke-RZTR2iB8bsRkzR_0 2024-09-12T19:13:58.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11147880722336754627', time=2024-09-12T21:01:40.416718+0000, chain.objs.size()=1 2024-09-12T19:13:58.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.8OHQSjPBAvW6zdkHb3N1lfFNV85BlRD_0 2024-09-12T19:13:58.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16529830156725492488', time=2024-09-12T21:01:40.579183+0000, chain.objs.size()=1 2024-09-12T19:13:58.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Y64qDL0NIb7SlHHvAWx7QDTMjLJza51_0 2024-09-12T19:13:58.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4113934218724737947', time=2024-09-12T21:01:40.585681+0000, chain.objs.size()=1 2024-09-12T19:13:58.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9-G0fe4yksbfMhRLgUFQvuXZd5D9Bww_0 2024-09-12T19:13:58.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2951812694937265727', time=2024-09-12T21:01:40.594934+0000, chain.objs.size()=1 2024-09-12T19:13:58.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hhxp8Owrr_JsZp-3kXgaMJm35P0aF6I_0 2024-09-12T19:13:58.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7652789185877891934', time=2024-09-12T21:01:40.596795+0000, chain.objs.size()=1 2024-09-12T19:13:58.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.aUEBwMjQ8Fc6YSun3a1yF36acOwkK_J_0 2024-09-12T19:13:58.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13161150072642460482', time=2024-09-12T21:01:40.615636+0000, chain.objs.size()=1 2024-09-12T19:13:58.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.WzTI1df87e3KQN0uTcOEljSeR9OcjHy_0 2024-09-12T19:13:58.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14628172778750381179', time=2024-09-12T21:01:40.626094+0000, chain.objs.size()=1 2024-09-12T19:13:58.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ysNkwY8ElJSd_FfxxN1E-gHWX8QakaL_0 2024-09-12T19:13:58.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10375685977612954138', time=2024-09-12T21:01:40.666292+0000, chain.objs.size()=1 2024-09-12T19:13:58.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._3lwkmqrsi_1l6VZDJQTWuFpTGiWceY_0 2024-09-12T19:13:58.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17392346483420036512', time=2024-09-12T21:01:40.813133+0000, chain.objs.size()=1 2024-09-12T19:13:58.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0IAZIFvt4e3YUMnDTN6UIovoYBFOOk__0 2024-09-12T19:13:58.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7681609939049190176', time=2024-09-12T21:01:40.835833+0000, chain.objs.size()=1 2024-09-12T19:13:58.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.AUrVMf2QCoN0-rNnsnhFxAWCqQPkojQ_0 2024-09-12T19:13:58.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15209279267371271421', time=2024-09-12T21:01:40.879671+0000, chain.objs.size()=1 2024-09-12T19:13:58.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.n2KO1MdmKrlF0HxthABd87aawR2qDNY_0 2024-09-12T19:13:58.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16954531915289334036', time=2024-09-12T21:01:40.884323+0000, chain.objs.size()=1 2024-09-12T19:13:58.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.OGxwlIAfLkI57kW0rsAkPfPE7cE1F41_0 2024-09-12T19:13:58.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17977462555104455167', time=2024-09-12T21:01:41.014274+0000, chain.objs.size()=1 2024-09-12T19:13:58.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RPSqu-cs2rB70ovPpPEaB2xyym5dIsr_0 2024-09-12T19:13:58.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15300972245278868433', time=2024-09-12T21:01:41.058173+0000, chain.objs.size()=1 2024-09-12T19:13:58.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.P2TZDldzC2OBgPqEP7ffJDOIgXb6AA0_0 2024-09-12T19:13:58.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11445988615541269956', time=2024-09-12T21:02:00.624100+0000, chain.objs.size()=1 2024-09-12T19:13:58.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7VeGUyGcm3GexgoxaY8WfdLQLTe1VGc_0 2024-09-12T19:13:58.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9201401672689056365', time=2024-09-12T21:02:00.817071+0000, chain.objs.size()=1 2024-09-12T19:13:58.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.99BwRwsj_CzNQYb0RVWEMKUHG0sSbAj_0 2024-09-12T19:13:58.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9418411294356508335', time=2024-09-12T21:02:00.850727+0000, chain.objs.size()=1 2024-09-12T19:13:58.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.x-qiOWn70pkeXAw1UCZmDUtcGhcKAbk_0 2024-09-12T19:13:58.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.136+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6489018480527418910', time=2024-09-12T21:02:00.884834+0000, chain.objs.size()=1 2024-09-12T19:13:58.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NzD10-WKj-rA0dUUNoxGPB7HnWW0OxA_0 2024-09-12T19:13:58.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2389886615203523217', time=2024-09-12T21:02:00.898814+0000, chain.objs.size()=1 2024-09-12T19:13:58.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.s6S3Chs-rKkpJD3Tgjo4ffA6F5lT-Jr_0 2024-09-12T19:13:58.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6282849280084866012', time=2024-09-12T21:02:01.014643+0000, chain.objs.size()=1 2024-09-12T19:13:58.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.oCOsbruLl4yTxXG9jX2Q2myaNAhE5oZ_0 2024-09-12T19:13:58.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15050490221248616898', time=2024-09-12T21:02:01.025788+0000, chain.objs.size()=1 2024-09-12T19:13:58.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.iSL14U3Uh1KqG92I5sIdkpSECF_08Qb_0 2024-09-12T19:13:58.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10821111830667156985', time=2024-09-12T21:02:01.094678+0000, chain.objs.size()=1 2024-09-12T19:13:58.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.e7fNYiBuXpfk_mANxDtkuNTPv0Sb005_0 2024-09-12T19:13:58.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4014594096931059564', time=2024-09-12T21:02:01.258595+0000, chain.objs.size()=1 2024-09-12T19:13:58.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.zV8LLj793bsIHYSFAJtDOdnXcdKGG5v_0 2024-09-12T19:13:58.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8545144792996135723', time=2024-09-12T21:02:01.265463+0000, chain.objs.size()=1 2024-09-12T19:13:58.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ghmWPybGLMGYxWvb736qqFHa0TYTiEv_0 2024-09-12T19:13:58.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13167247857229131460', time=2024-09-12T21:02:01.309963+0000, chain.objs.size()=1 2024-09-12T19:13:58.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NPsC6pOvHeCbWaWv63c0HDxdf05Vp1y_0 2024-09-12T19:13:58.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1194163742388534240', time=2024-09-12T21:02:01.340617+0000, chain.objs.size()=1 2024-09-12T19:13:58.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.PNhwFBa7jTeO-fSexaKVfMp18_5dObs_0 2024-09-12T19:13:58.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7224974064909606981', time=2024-09-12T21:02:01.438969+0000, chain.objs.size()=1 2024-09-12T19:13:58.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Nvy2oBKbzlXraUs_03icc5GdNJJUbxb_0 2024-09-12T19:13:58.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6826552633053527464', time=2024-09-12T21:02:01.462407+0000, chain.objs.size()=1 2024-09-12T19:13:58.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0gofnPTPumgGAdFlsKJWqjtEqnxLdmE_0 2024-09-12T19:13:58.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12625921896784598559', time=2024-09-12T21:02:01.471161+0000, chain.objs.size()=1 2024-09-12T19:13:58.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.J2fykbLfZIj10EPHUpngP7Ja3GzzK4c_0 2024-09-12T19:13:58.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.452047157448840230', time=2024-09-12T21:02:01.500766+0000, chain.objs.size()=1 2024-09-12T19:13:58.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.nbl3UXx3I9n-zTfUnoxKc9LpWrWyfFs_0 2024-09-12T19:13:58.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6116187493006042015', time=2024-09-12T21:02:01.521248+0000, chain.objs.size()=1 2024-09-12T19:13:58.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.mUcMNh8oOvGjuCNQqYRY6HbOX_6SKDN_0 2024-09-12T19:13:58.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6677705801058734367', time=2024-09-12T21:02:01.525856+0000, chain.objs.size()=1 2024-09-12T19:13:58.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0G2NSvHT0BDpBmE0xOicbA1khfP094q_0 2024-09-12T19:13:58.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11340316002393910866', time=2024-09-12T21:02:01.540517+0000, chain.objs.size()=1 2024-09-12T19:13:58.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.j4GBIzAn_syIDl5ri2G_6N-pZsauyiz_0 2024-09-12T19:13:58.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12778450158741198498', time=2024-09-12T21:02:01.702432+0000, chain.objs.size()=1 2024-09-12T19:13:58.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.wEO3OPm5-dZRgXAamBBOci3_uMINWLt_0 2024-09-12T19:13:58.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4731598900354588706', time=2024-09-12T21:02:01.710584+0000, chain.objs.size()=1 2024-09-12T19:13:58.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.140+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.DmYt-z4bGph1GxSNkGS83l-ELwcwsDJ_0 2024-09-12T19:13:58.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47552 2024-09-12T19:13:58.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T19:13:58.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17336854442493488971', time=2024-09-12T21:02:01.744405+0000, chain.objs.size()=1 2024-09-12T19:13:58.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.MftQhaOzD8NEVT5ziT4K1-pYRJpoyG__0 2024-09-12T19:13:58.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7215868291470754014', time=2024-09-12T21:02:01.890897+0000, chain.objs.size()=1 2024-09-12T19:13:58.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.i1jtWIFTAKDA5N3iXMXISXknV_hRMKj_0 2024-09-12T19:13:58.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2716877934232557140', time=2024-09-12T21:02:01.937945+0000, chain.objs.size()=1 2024-09-12T19:13:58.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.dvIZJSm4XTfKWQqwCcpHpuusd5VNauF_0 2024-09-12T19:13:58.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11232799330607443034', time=2024-09-12T21:02:01.949756+0000, chain.objs.size()=1 2024-09-12T19:13:58.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.4r-dPu15JyiW48Q1_x5GHIFIGXytR7Y_0 2024-09-12T19:13:58.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1780310768910492735', time=2024-09-12T21:02:01.978073+0000, chain.objs.size()=1 2024-09-12T19:13:58.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.JbmgoA_8faqi3x0cSeEatV4mYPLD5Gm_0 2024-09-12T19:13:58.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2628810982922563217', time=2024-09-12T21:02:02.147654+0000, chain.objs.size()=1 2024-09-12T19:13:58.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.gJnVeh7cVXTm57OtUo2hx7M0imrOVaY_0 2024-09-12T19:13:58.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1076928419861380900', time=2024-09-12T21:02:02.174379+0000, chain.objs.size()=1 2024-09-12T19:13:58.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.L3ZvK2B2iDOR5DwALjdu0YUx3w6GzDF_0 2024-09-12T19:13:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11127957587532900515', time=2024-09-12T21:02:02.181259+0000, chain.objs.size()=1 2024-09-12T19:13:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.PmO1vLir4ErTSZXfogH0xwrPIHVaCar_0 2024-09-12T19:13:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1355530416125072293', time=2024-09-12T21:02:02.208158+0000, chain.objs.size()=1 2024-09-12T19:13:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.XzHCW4gRfA2JYhnTfM0mpuv-m06uUPF_0 2024-09-12T19:13:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10942094298817462614', time=2024-09-12T21:02:03.424764+0000, chain.objs.size()=1 2024-09-12T19:13:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.326__shadow_.uR-kBHFae-bkH4WVj8MhstqUGcZqyR5_0 2024-09-12T19:13:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8999398144232974538', time=2024-09-12T21:02:14.679944+0000, chain.objs.size()=1 2024-09-12T19:13:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.343__shadow_.EvJPDWoqrQeSbQ84flWEYTdOQ8C5mE9_0 2024-09-12T19:13:58.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13841280004050227916', time=2024-09-12T21:02:34.792354+0000, chain.objs.size()=1 2024-09-12T19:13:58.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.144+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.374__shadow_.7Ye3h84Fe1rF1LI_ou8uioIC21WH9jc_0 2024-09-12T19:13:58.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7666615562600308408', time=2024-09-12T21:03:44.366220+0000, chain.objs.size()=1 2024-09-12T19:13:58.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.463__shadow_.49NkcGYeWFcUKZkcp45yQvyFlFXYDCW_0 2024-09-12T19:13:58.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17293730256111592152', time=2024-09-12T21:03:47.082017+0000, chain.objs.size()=1 2024-09-12T19:13:58.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.466__shadow_.rF7wtKtW5KZHagceem27Rf_PyZmBOak_0 2024-09-12T19:13:58.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.319200307645104723', time=2024-09-12T21:03:47.084266+0000, chain.objs.size()=1 2024-09-12T19:13:58.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.466__shadow_.N5J3_-qSzS3yjDVakPoMzzpJkkbvCsB_0 2024-09-12T19:13:58.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15694704852563087937', time=2024-09-12T21:03:56.359569+0000, chain.objs.size()=1 2024-09-12T19:13:58.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.484__shadow_.j06thO8gFlbvsZCK0Ufz4t7kyqAPOUt_0 2024-09-12T19:13:58.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17207921493870598462', time=2024-09-12T21:03:59.536822+0000, chain.objs.size()=1 2024-09-12T19:13:58.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.488__shadow_.5rPcXgYioi8fN0UtnvbCSmHbF6QG7nD_0 2024-09-12T19:13:58.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13364671235373777339', time=2024-09-12T21:06:31.689516+0000, chain.objs.size()=1 2024-09-12T19:13:58.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:UuhL4bbtKmBgKB21MjFbuTNNanxLgl6_.nCWnevyEDjHU5xaJxLNbUPaATvotfJc_0 2024-09-12T19:13:58.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7695442717470457043', time=2024-09-12T21:06:32.887963+0000, chain.objs.size()=1 2024-09-12T19:13:58.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:-HQZPKMz5edDt40DM9cfthvKu3p9rLM_.hykTZITNyUws7IPYQMag1nrvS_CPm3R_0 2024-09-12T19:13:58.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4479317485694634022', time=2024-09-12T21:06:39.939319+0000, chain.objs.size()=1 2024-09-12T19:13:58.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:lLUOUl6.-ihUxM6esW33q328.UTjymx_.lBD2zhXxIAtvQl1c7lI2KYj5w7_HQ5d_0 2024-09-12T19:13:58.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5623726183077152276', time=2024-09-12T21:06:53.824924+0000, chain.objs.size()=1 2024-09-12T19:13:58.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.587__shadow:FZTdAc.w7gQoTClRJ06VwW5w98ynDWC_.W1e773nRLm7eCGKEtFfGCT8lNVrr5d5_0 2024-09-12T19:13:58.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9737102251401635547', time=2024-09-12T21:06:53.906871+0000, chain.objs.size()=1 2024-09-12T19:13:58.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.587__shadow:4p1CEMabntSxgJ6PHFcaZL5zCpduvxz_.TK673VysmdzzS56w68H6tZ_Dk8vZsu5_0 2024-09-12T19:13:58.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10304646385595802947', time=2024-09-12T21:09:44.565828+0000, chain.objs.size()=1 2024-09-12T19:13:58.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.637__shadow_.fm_biFt7FXM1JqRMRFt9olU26vTsLEb_0 2024-09-12T19:13:58.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11371414190533252321', time=2024-09-12T21:10:27.005984+0000, chain.objs.size()=1 2024-09-12T19:13:58.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.695__shadow_.TokNHfNON4YbzzY8_cvj8QxI7T_eCrX_0 2024-09-12T19:13:58.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11002935011747610725', time=2024-09-12T21:10:30.441776+0000, chain.objs.size()=1 2024-09-12T19:13:58.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.700__shadow:Txhe1w8CUxB-.MbC4r.ftXFrmkAtQQi_.pxkeI7tXGTgwGnkP8ml3lJKtqrsvYSE_0 2024-09-12T19:13:58.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16517877974516041705', time=2024-09-12T21:10:32.646808+0000, chain.objs.size()=1 2024-09-12T19:13:58.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.703__shadow:A9kxFEQuLfZKYq-1ViQfFjTI-z1k2vo_.6PsETcA2e0KLcFXE3nB2HGwGgx9jNfY_0 2024-09-12T19:13:58.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11389083534349050750', time=2024-09-12T21:10:36.885793+0000, chain.objs.size()=1 2024-09-12T19:13:58.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.148+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.709__shadow_.pPaYP7uExeY3zvbpX8pUkqX9ARpqZgF_0 2024-09-12T19:13:58.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.152+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:58.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T19:13:58.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:58.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:58.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54961' 2024-09-12T19:13:58.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_KZPC8QUdGCnwmlScQ7asco00qFokbTt', time=2024-09-12T20:57:37.539679+0000, chain.objs.size()=1 2024-09-12T19:13:58.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:97c2b296-1395-4700-8053-4f06c4c86557.4689.163__shadow_.1s95wuzZW4ABhH_l1Ritp-VGwhdtxrz_0 2024-09-12T19:13:58.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16730674565369498982', time=2024-09-12T21:00:02.258612+0000, chain.objs.size()=1 2024-09-12T19:13:58.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.247__shadow_.5BdLBQ70dfn_1CpMdYPwNhNSTD1R32P_0 2024-09-12T19:13:58.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5783605500147342146', time=2024-09-12T21:00:05.891594+0000, chain.objs.size()=1 2024-09-12T19:13:58.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.252__shadow_.qdxdxLyxb5vHCcPFx9CJ5WhRaFc3Oil_0 2024-09-12T19:13:58.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5245288937315322014', time=2024-09-12T21:00:32.045030+0000, chain.objs.size()=1 2024-09-12T19:13:58.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.L5SagOTjpdcT1Yeqq3mLorMi6fvbaD3_0 2024-09-12T19:13:58.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9005840725049894643', time=2024-09-12T21:00:32.056820+0000, chain.objs.size()=1 2024-09-12T19:13:58.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.aLH9oXWghaa3X-j7OD9vUAbRO7Xchag_0 2024-09-12T19:13:58.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7659464121948825733', time=2024-09-12T21:00:32.076447+0000, chain.objs.size()=1 2024-09-12T19:13:58.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.F6aqSWWkJ0kZhT6o4dO0XfVRnZZ_D1S_0 2024-09-12T19:13:58.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9949523128460821856', time=2024-09-12T21:00:32.227185+0000, chain.objs.size()=1 2024-09-12T19:13:58.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.5CKYSEFaXlIeWx4nA1_nCOUezeXXzrE_0 2024-09-12T19:13:58.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7974938554962748326', time=2024-09-12T21:00:32.327824+0000, chain.objs.size()=1 2024-09-12T19:13:58.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.FtZWUfViPoFMMDtILqTlmUQsSjMiMnL_0 2024-09-12T19:13:58.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9695057012197419018', time=2024-09-12T21:00:32.448658+0000, chain.objs.size()=1 2024-09-12T19:13:58.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.0_LgdZqAQt1AcAH8UDLtJN_lHA-RZdD_0 2024-09-12T19:13:58.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3465826126138733564', time=2024-09-12T21:00:32.499078+0000, chain.objs.size()=1 2024-09-12T19:13:58.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Ruq1JA4ZbGr5uVBKWYm4Hnn1ggNk3iB_0 2024-09-12T19:13:58.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18239344084922557505', time=2024-09-12T21:00:32.500213+0000, chain.objs.size()=1 2024-09-12T19:13:58.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Gby_T0iJ1n1z_RtWakuFEy2KgTQunSE_0 2024-09-12T19:13:58.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.931118834264958270', time=2024-09-12T21:00:32.502019+0000, chain.objs.size()=1 2024-09-12T19:13:58.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.156+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.eTw0ItEcroXFF-N00efpys2AZQ1wzSk_0 2024-09-12T19:13:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.469435264605296973', time=2024-09-12T21:00:32.507530+0000, chain.objs.size()=1 2024-09-12T19:13:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.yu8BfzpsLgABSDp7NPzRCtFwaPMHmms_0 2024-09-12T19:13:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10022450439948791732', time=2024-09-12T21:00:32.513719+0000, chain.objs.size()=1 2024-09-12T19:13:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SVbJig-_l7AFbChxoGbnqMTcB3rdR_B_0 2024-09-12T19:13:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14098033564781302206', time=2024-09-12T21:00:32.550388+0000, chain.objs.size()=1 2024-09-12T19:13:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.1AuAAem6O8dE5srZLqXNzBe5Nt6QUoz_0 2024-09-12T19:13:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1296560947042267451', time=2024-09-12T21:00:32.949607+0000, chain.objs.size()=1 2024-09-12T19:13:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.dJDqoyVGKIkmyTWPeVfHULvB8nDgMAZ_0 2024-09-12T19:13:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13467498446928251070', time=2024-09-12T21:00:32.992829+0000, chain.objs.size()=1 2024-09-12T19:13:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LWbz2_vWnJbINCLidmqpj6jdNnoP_ep_0 2024-09-12T19:13:58.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11232139745170757743', time=2024-09-12T21:00:33.095017+0000, chain.objs.size()=1 2024-09-12T19:13:58.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3sBR-zsSno7pD0rI0LcK_pL5Jy4ib1l_0 2024-09-12T19:13:58.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7959805359789583732', time=2024-09-12T21:00:33.155282+0000, chain.objs.size()=1 2024-09-12T19:13:58.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.x4KPwmES7X-DaSmSXFWKTZZdIyzkn_d_0 2024-09-12T19:13:58.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11520626462680166040', time=2024-09-12T21:00:33.166991+0000, chain.objs.size()=1 2024-09-12T19:13:58.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CrnCmPo2PGkWZvvNgMsv8HvuV5q6aFI_0 2024-09-12T19:13:58.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3319666034108357280', time=2024-09-12T21:00:33.181083+0000, chain.objs.size()=1 2024-09-12T19:13:58.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.8368ujMeew7icsaAKYE-xB0QmtBV_1e_0 2024-09-12T19:13:58.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3814437412422174020', time=2024-09-12T21:00:33.198022+0000, chain.objs.size()=1 2024-09-12T19:13:58.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3nESsrYUCBPsgzBTzPRrLSjAUjZTD6d_0 2024-09-12T19:13:58.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12860371556464444911', time=2024-09-12T21:00:33.429079+0000, chain.objs.size()=1 2024-09-12T19:13:58.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.160+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.pRUz_ahSm8jHgg54RUjaxPtFUHQ1aHg_0 2024-09-12T19:13:58.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18373039676297879449', time=2024-09-12T21:00:33.588382+0000, chain.objs.size()=1 2024-09-12T19:13:58.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.shKf-PWq4yUVNeJaNf_3vhv065-QFio_0 2024-09-12T19:13:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7384283699502109564', time=2024-09-12T21:00:37.422861+0000, chain.objs.size()=1 2024-09-12T19:13:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.267__shadow_.eGpR-onW8JXDADi4mjrrr6cvUxXtMgp_0 2024-09-12T19:13:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8621406502667674935', time=2024-09-12T21:00:56.717707+0000, chain.objs.size()=1 2024-09-12T19:13:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.XrmtIhKtmEU5Rbn6B-WRytvis6_SQI6_0 2024-09-12T19:13:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3367205981789479738', time=2024-09-12T21:00:58.120935+0000, chain.objs.size()=1 2024-09-12T19:13:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.H5DOwTGOieBCdxsL78iQ8KTCKEl8Lms_0 2024-09-12T19:13:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14074871883329081154', time=2024-09-12T21:00:58.145034+0000, chain.objs.size()=1 2024-09-12T19:13:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.hbwLiB1PrgIF_Zftj4A9bdcEcgpLPr9_0 2024-09-12T19:13:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.134450751319668000', time=2024-09-12T21:01:39.462286+0000, chain.objs.size()=1 2024-09-12T19:13:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.IEVPwytrmc9g2W8bjYpZxynd4LonwAa_0 2024-09-12T19:13:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11889370838444265865', time=2024-09-12T21:01:39.474222+0000, chain.objs.size()=1 2024-09-12T19:13:58.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.UOunkvMfo-m-oeSw1gZ-M7P4WlB7ZMu_0 2024-09-12T19:13:58.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14455180048665686282', time=2024-09-12T21:01:39.494830+0000, chain.objs.size()=1 2024-09-12T19:13:58.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.SLTMpfrz-f2-EdeYfw-GsSODoMeHDYb_0 2024-09-12T19:13:58.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5632387810472282171', time=2024-09-12T21:01:39.510914+0000, chain.objs.size()=1 2024-09-12T19:13:58.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.cs6gJtUOjMCGwHXQfTYtntreExvs-p6_0 2024-09-12T19:13:58.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16285451180805522234', time=2024-09-12T21:01:39.512512+0000, chain.objs.size()=1 2024-09-12T19:13:58.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.1uH2pRIzUGXOT0F3v9v32wGqr8uGNGp_0 2024-09-12T19:13:58.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7572850424997969547', time=2024-09-12T21:01:39.514748+0000, chain.objs.size()=1 2024-09-12T19:13:58.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.7phyfnZpnh43s9IJNd5HZ8vxM9r6MAt_0 2024-09-12T19:13:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1799476546877054178', time=2024-09-12T21:01:39.521510+0000, chain.objs.size()=1 2024-09-12T19:13:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Gk4GdcrVC_sryjcbVelmke86ALjSo3o_0 2024-09-12T19:13:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8079625693037161210', time=2024-09-12T21:01:39.690022+0000, chain.objs.size()=1 2024-09-12T19:13:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.GlCVVRI0MfrJurunJ6dWRWdCuRmeUkK_0 2024-09-12T19:13:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11842234320198260793', time=2024-09-12T21:01:39.751202+0000, chain.objs.size()=1 2024-09-12T19:13:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.2i7nGmxlRyu7Ev58ZGZJ2bJD7Pk8zeQ_0 2024-09-12T19:13:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5169850012377393828', time=2024-09-12T21:01:39.959743+0000, chain.objs.size()=1 2024-09-12T19:13:58.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Z0em47H-JEL-QRrvmoLslJo13Zfa1Td_0 2024-09-12T19:13:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7420579991945773594', time=2024-09-12T21:01:39.967716+0000, chain.objs.size()=1 2024-09-12T19:13:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Qe46prnAqvl8_n2-26hSfNR8Q_jOBqg_0 2024-09-12T19:13:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7493539363468006307', time=2024-09-12T21:01:39.987738+0000, chain.objs.size()=1 2024-09-12T19:13:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.axeb3GBjlQuXhBYZko9pVrjbZUi4kPz_0 2024-09-12T19:13:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2510112606991705101', time=2024-09-12T21:01:40.113548+0000, chain.objs.size()=1 2024-09-12T19:13:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.164+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.WZnU-dTKdF-siR0LlQ6QYnfSdLaN_rb_0 2024-09-12T19:13:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17431016083841984293', time=2024-09-12T21:01:40.115359+0000, chain.objs.size()=1 2024-09-12T19:13:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BYW7GJq4-2c1O_gMQAa1T2uQS10ma3W_0 2024-09-12T19:13:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.646472826825972631', time=2024-09-12T21:01:40.174139+0000, chain.objs.size()=1 2024-09-12T19:13:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.di1jB8UBCWVQEGvDGXB5eKsAal8JaaZ_0 2024-09-12T19:13:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11455469479999262521', time=2024-09-12T21:01:40.178375+0000, chain.objs.size()=1 2024-09-12T19:13:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.uBjtOeQFRbh-X81Q0Z_E2DwAHBWxwvT_0 2024-09-12T19:13:58.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9579297664584212961', time=2024-09-12T21:01:40.216354+0000, chain.objs.size()=1 2024-09-12T19:13:58.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RltxSKVQdxWjXuhUTQ8u0IWrCSXn8EO_0 2024-09-12T19:13:58.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13257312235218086026', time=2024-09-12T21:01:40.227644+0000, chain.objs.size()=1 2024-09-12T19:13:58.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.jqoJKID5Flne7p4bjSKkM4_5-EQY2Bw_0 2024-09-12T19:13:58.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15841553916426348364', time=2024-09-12T21:01:40.404921+0000, chain.objs.size()=1 2024-09-12T19:13:58.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Xuw9sFXtFnWIiMEm07Fw_WpO9dqaqHT_0 2024-09-12T19:13:58.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4696014658931160404', time=2024-09-12T21:01:40.441486+0000, chain.objs.size()=1 2024-09-12T19:13:58.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.vpE_aKQueIAC7ymsG5ic8OT5hloouKT_0 2024-09-12T19:13:58.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7507517639339981636', time=2024-09-12T21:01:40.564605+0000, chain.objs.size()=1 2024-09-12T19:13:58.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.aAB23jEy65y3M60kxwNrt0OdWQAy4g5_0 2024-09-12T19:13:58.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6443799029493440027', time=2024-09-12T21:01:40.613542+0000, chain.objs.size()=1 2024-09-12T19:13:58.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.S3Tr5ck3-PRjBEfR0CYGMvJ0XSQ8Vvb_0 2024-09-12T19:13:58.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4474806620190330019', time=2024-09-12T21:01:40.646640+0000, chain.objs.size()=1 2024-09-12T19:13:58.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.zroqtKKqBrJyst3UxZ7EipS7ma9mmRi_0 2024-09-12T19:13:58.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15480708088131378520', time=2024-09-12T21:01:40.672095+0000, chain.objs.size()=1 2024-09-12T19:13:58.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.iCdNifCBPGnekv_xA6MWjd8Dp5rxek4_0 2024-09-12T19:13:58.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13466998871750335615', time=2024-09-12T21:01:40.832774+0000, chain.objs.size()=1 2024-09-12T19:13:58.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.or5cgyDz9UgUbhb80_rymUgAYx7o9oQ_0 2024-09-12T19:13:58.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9457407188144802195', time=2024-09-12T21:01:40.848763+0000, chain.objs.size()=1 2024-09-12T19:13:58.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.oKOWRelrIWnD4kCJjzslzbje8738WEu_0 2024-09-12T19:13:58.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7750628020169783523', time=2024-09-12T21:01:40.850862+0000, chain.objs.size()=1 2024-09-12T19:13:58.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.M35j8kRM6yOQfxQIVZIycmMCiiGJtPN_0 2024-09-12T19:13:58.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11835489351990037405', time=2024-09-12T21:01:40.862182+0000, chain.objs.size()=1 2024-09-12T19:13:58.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hEiGj45xAO1UjnHyW2XvMdbN5_BwZfN_0 2024-09-12T19:13:58.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11774427150158167780', time=2024-09-12T21:01:40.867586+0000, chain.objs.size()=1 2024-09-12T19:13:58.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Wgn-u9F_1Rm6aaTK8xg4ekFqPXZRYfL_0 2024-09-12T19:13:58.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7201364919525479778', time=2024-09-12T21:01:40.876980+0000, chain.objs.size()=1 2024-09-12T19:13:58.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hQF4ELs7wIuTGwLOWPkKuP6c2oOW6s8_0 2024-09-12T19:13:58.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17222050605879391605', time=2024-09-12T21:01:40.990270+0000, chain.objs.size()=1 2024-09-12T19:13:58.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.lKTBwqpCznskWi4WbbC4HbB4L6AmTXm_0 2024-09-12T19:13:58.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8210509246386635603', time=2024-09-12T21:01:40.991681+0000, chain.objs.size()=1 2024-09-12T19:13:58.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hbJIkeqlEQSzkiR35rNthgalk_vMFv5_0 2024-09-12T19:13:58.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13248544401040535757', time=2024-09-12T21:01:41.021445+0000, chain.objs.size()=1 2024-09-12T19:13:58.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.UEXiA3r-62fRkrvdyMMn8q0nCkMZY0g_0 2024-09-12T19:13:58.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5291073917561128888', time=2024-09-12T21:01:41.025536+0000, chain.objs.size()=1 2024-09-12T19:13:58.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.EsFsiPabawfcwN4Ls1DfXOjhfO3YFEK_0 2024-09-12T19:13:58.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12232521168515403387', time=2024-09-12T21:01:41.052338+0000, chain.objs.size()=1 2024-09-12T19:13:58.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.i5e2AeDUVkGTdRVDygpL_AHj7w4bm_j_0 2024-09-12T19:13:58.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11776076645256217916', time=2024-09-12T21:02:00.537968+0000, chain.objs.size()=1 2024-09-12T19:13:58.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ixdaBPhuuECA4DF8oE_8KzrrpWFismz_0 2024-09-12T19:13:58.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16065033594031499314', time=2024-09-12T21:02:00.579477+0000, chain.objs.size()=1 2024-09-12T19:13:58.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.168+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.oCUzRqIuGh1Qqeodmr5Q8WvO4NibLIX_0 2024-09-12T19:13:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3433776004736038116', time=2024-09-12T21:02:00.583643+0000, chain.objs.size()=1 2024-09-12T19:13:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.RvDE_8GXoQ294sNOZ9WkqYhw9swj21c_0 2024-09-12T19:13:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11400516953464055329', time=2024-09-12T21:02:00.603453+0000, chain.objs.size()=1 2024-09-12T19:13:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ib_IsopUSEQwSg6U4WOcn4k9-Jgmfc-_0 2024-09-12T19:13:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12503244015681556748', time=2024-09-12T21:02:00.637507+0000, chain.objs.size()=1 2024-09-12T19:13:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.kNB5WZ-3PDE1lVRViQUfDIaE5TWZYde_0 2024-09-12T19:13:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8932294692911376419', time=2024-09-12T21:02:00.855421+0000, chain.objs.size()=1 2024-09-12T19:13:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.IEVfsUT0ysaHtUynVlnzjTbL5DEXseC_0 2024-09-12T19:13:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4268267248652158540', time=2024-09-12T21:02:00.895924+0000, chain.objs.size()=1 2024-09-12T19:13:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Af2bq6vWoQ6Y1yk40TqoMSeNqxQne3C_0 2024-09-12T19:13:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4451507367711589334', time=2024-09-12T21:02:00.991315+0000, chain.objs.size()=1 2024-09-12T19:13:58.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ETiEC2qJczwMzssFtb0Wv7UPt7oKw2S_0 2024-09-12T19:13:58.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9080037505660717257', time=2024-09-12T21:02:01.042712+0000, chain.objs.size()=1 2024-09-12T19:13:58.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.PcVsP11oUnOL2cI_64VAcykiQdUk7OP_0 2024-09-12T19:13:58.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9090437081550072711', time=2024-09-12T21:02:01.075426+0000, chain.objs.size()=1 2024-09-12T19:13:58.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.rhwcTOEdkSYmKpg3mOLdqNYoJP6_bXn_0 2024-09-12T19:13:58.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1082928501767425384', time=2024-09-12T21:02:01.278976+0000, chain.objs.size()=1 2024-09-12T19:13:58.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qPgGcnbMOskqOA3jHGuLebYzshrIyM1_0 2024-09-12T19:13:58.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11338469014564184232', time=2024-09-12T21:02:01.303320+0000, chain.objs.size()=1 2024-09-12T19:13:58.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.TskgVfWj7B4NwCt0QWtaVIR5gK9Q3ZD_0 2024-09-12T19:13:58.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10073251352035493191', time=2024-09-12T21:02:01.306580+0000, chain.objs.size()=1 2024-09-12T19:13:58.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1xtnbINL1Kxu6jE7kJd08ATU-PmpzxS_0 2024-09-12T19:13:58.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1948250033141375513', time=2024-09-12T21:02:01.309661+0000, chain.objs.size()=1 2024-09-12T19:13:58.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.O6_JZ_JPSpFM1QcnzMPXP0RrEhrqJEv_0 2024-09-12T19:13:58.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5963119117505475340', time=2024-09-12T21:02:01.317096+0000, chain.objs.size()=1 2024-09-12T19:13:58.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.SKQf8S8k0-T0UXCEOpahkB7ZBPVrjiJ_0 2024-09-12T19:13:58.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14960295069072059638', time=2024-09-12T21:02:01.542615+0000, chain.objs.size()=1 2024-09-12T19:13:58.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Ntsv9rWS37ZAGHnH6JZewnLVMMPdV1A_0 2024-09-12T19:13:58.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7116937461788446513', time=2024-09-12T21:02:01.723384+0000, chain.objs.size()=1 2024-09-12T19:13:58.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WeuwdtzvmukZ8d2_REt_VdHcwyKFsqd_0 2024-09-12T19:13:58.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16024626588432940583', time=2024-09-12T21:02:01.732825+0000, chain.objs.size()=1 2024-09-12T19:13:58.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.obVfFvDw_lN7qRcWoAg22_CD8yY-lcm_0 2024-09-12T19:13:58.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2913460849419862897', time=2024-09-12T21:02:01.751985+0000, chain.objs.size()=1 2024-09-12T19:13:58.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.tBy_b-a1QWuxlZHLkUn12jnMbfLeNUc_0 2024-09-12T19:13:58.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14629164704914688197', time=2024-09-12T21:02:01.761171+0000, chain.objs.size()=1 2024-09-12T19:13:58.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.172+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Bhr1Cu-b7pvQIfzypmeJ1xc9eIpaIMK_0 2024-09-12T19:13:58.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8729914673265842832', time=2024-09-12T21:02:01.769022+0000, chain.objs.size()=1 2024-09-12T19:13:58.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.eII-pMLiQ8FyQfoiL_Df94OusKgB0Kc_0 2024-09-12T19:13:58.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13492470932975049353', time=2024-09-12T21:02:01.774122+0000, chain.objs.size()=1 2024-09-12T19:13:58.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ByxDa2oXz7NzZOWwiThBUqG5ocGeFmb_0 2024-09-12T19:13:58.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3486151502809988165', time=2024-09-12T21:02:01.778635+0000, chain.objs.size()=1 2024-09-12T19:13:58.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ezSaxjw3oGys7pYxwPQny8TLOHL1FyV_0 2024-09-12T19:13:58.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15429408584421969080', time=2024-09-12T21:02:01.789426+0000, chain.objs.size()=1 2024-09-12T19:13:58.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.XooWFMU45BtFGpl-w4l--oYw9OwS4uX_0 2024-09-12T19:13:58.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3621854605526398040', time=2024-09-12T21:02:02.112869+0000, chain.objs.size()=1 2024-09-12T19:13:58.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.iO-35OfaTn1DvRZ2fIq8Pttb3fS-qyQ_0 2024-09-12T19:13:58.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17194984165155770782', time=2024-09-12T21:02:02.165384+0000, chain.objs.size()=1 2024-09-12T19:13:58.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ZRU_KxO8fzB-5mmpUYaT8Cjt7vCx0lo_0 2024-09-12T19:13:58.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8183678807372797668', time=2024-09-12T21:02:02.190113+0000, chain.objs.size()=1 2024-09-12T19:13:58.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.N8Idnjnv6lpdXnKJYWs3nnjz-xdnRWS_0 2024-09-12T19:13:58.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9526408690561915188', time=2024-09-12T21:02:14.049550+0000, chain.objs.size()=1 2024-09-12T19:13:58.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.342__shadow_.RWj33WFbwj43G9vNmzQTUkJTNBTMkEN_0 2024-09-12T19:13:58.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14301443059636546710', time=2024-09-12T21:02:38.513381+0000, chain.objs.size()=1 2024-09-12T19:13:58.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.379__shadow_.oz-YP4VZEcCswjU7L_Qjl44Dx3HB_bu_0 2024-09-12T19:13:58.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14763125450318459310', time=2024-09-12T21:03:41.257972+0000, chain.objs.size()=1 2024-09-12T19:13:58.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.460__shadow_.fQiCZQ9uYuBZcwGNU0ImZIPY-CW5S-j_0 2024-09-12T19:13:58.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18153324347942026577', time=2024-09-12T21:03:42.313598+0000, chain.objs.size()=1 2024-09-12T19:13:58.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.461__shadow_.CcMsM1-PSMuP_Hh2Vwf8bxitW0fS6a1_0 2024-09-12T19:13:58.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9740340488809920449', time=2024-09-12T21:03:58.819247+0000, chain.objs.size()=1 2024-09-12T19:13:58.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.487__shadow_.yjkCpVZ43Wmx3UxKgxfiZfVO69Gq4wH_0 2024-09-12T19:13:58.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.577763867658086369', time=2024-09-12T21:04:03.740743+0000, chain.objs.size()=1 2024-09-12T19:13:58.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.495__shadow_.2mEWo2ybUlLqj9hBE7D1wOPYz-5bX2s_0 2024-09-12T19:13:58.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12003352360627334606', time=2024-09-12T21:04:04.304285+0000, chain.objs.size()=1 2024-09-12T19:13:58.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.496__shadow_.YAYpI0Cf-L6_Ax8FAlL8ovEnTCwK5hX_0 2024-09-12T19:13:58.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16984721674229498372', time=2024-09-12T21:04:39.950475+0000, chain.objs.size()=6 2024-09-12T19:13:58.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~iF8Z7IdNBQdpDYXeuAITHX6PXN_WZu0.1 2024-09-12T19:13:58.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~iF8Z7IdNBQdpDYXeuAITHX6PXN_WZu0.2 2024-09-12T19:13:58.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.176+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.7qpKhVhqj9_q6fNKgVCm2jcgXOYE2Lkk.3 2024-09-12T19:13:58.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~iF8Z7IdNBQdpDYXeuAITHX6PXN_WZu0.4 2024-09-12T19:13:58.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~iF8Z7IdNBQdpDYXeuAITHX6PXN_WZu0.5 2024-09-12T19:13:58.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~iF8Z7IdNBQdpDYXeuAITHX6PXN_WZu0.6 2024-09-12T19:13:58.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2456766943375555089', time=2024-09-12T21:05:42.152113+0000, chain.objs.size()=1 2024-09-12T19:13:58.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.551__shadow_.5ljmTaLt6d07gz5PPyeTQPy1o5WdZhe_0 2024-09-12T19:13:58.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.375627550658976934', time=2024-09-12T21:06:03.780305+0000, chain.objs.size()=1 2024-09-12T19:13:58.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:N60N6mcUi0OA-njng9A7jQjhinSNhIt_.zI5JnQdvjl1q_zD11MB3hzaesxtIaP2_0 2024-09-12T19:13:58.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54961 2024-09-12T19:13:58.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T19:13:58.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4273619930039088055', time=2024-09-12T21:06:12.381307+0000, chain.objs.size()=1 2024-09-12T19:13:58.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.570__shadow:PZbP-whIUlGI2PgNZjrkruI6tHmZ7BR_.53Wwt5yvLWOIiZ9EZDKA1TYgmPBgAXG_0 2024-09-12T19:13:58.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17688442958980123097', time=2024-09-12T21:06:14.258923+0000, chain.objs.size()=1 2024-09-12T19:13:58.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.572__shadow_.KdY7UNO4Hso88EimBfnV0D9tKtRIsOD_0 2024-09-12T19:13:58.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8555120639128574776', time=2024-09-12T21:06:28.876382+0000, chain.objs.size()=1 2024-09-12T19:13:58.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:m1NQTbpXD5IpbZ8apOtZh3gubUb.wyH_.4soZmFs9wCteYU1DaRVqU5fmIYogX-I_0 2024-09-12T19:13:58.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3186600951013570201', time=2024-09-12T21:06:34.043945+0000, chain.objs.size()=1 2024-09-12T19:13:58.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:dDfc52AsgR4q0VGFk77rdPR3rf59UnV_.hZNQGtRSwV1vi3Ic1PyYVqNaTkcwGv2_0 2024-09-12T19:13:58.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13726626844657914841', time=2024-09-12T21:06:53.075752+0000, chain.objs.size()=1 2024-09-12T19:13:58.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.586__shadow:oug-fdDewzPFNwLBIM5NHSsJG5.NvtG_.IAU3lW4R_KKLLZNAz2mCEFzUZYHZR7w_0 2024-09-12T19:13:58.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8395018744373916915', time=2024-09-12T21:10:06.224323+0000, chain.objs.size()=1 2024-09-12T19:13:58.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.663__shadow_.nCFkCZgTO6UKInUSHI4fxvX629842dD_0 2024-09-12T19:13:58.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8578355597591253094', time=2024-09-12T21:10:17.099518+0000, chain.objs.size()=1 2024-09-12T19:13:58.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.180+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.679__shadow_.FY2OXThSeojRyKzH_SkV1nSYqJg_oB__0 2024-09-12T19:13:58.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.184+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:58.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.184+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T19:13:58.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:58.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:58.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50031' 2024-09-12T19:13:58.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_Y1-FOKkWdGT5yRyZaDN190Afmlpv_Gj', time=2024-09-12T20:57:34.691968+0000, chain.objs.size()=1 2024-09-12T19:13:58.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:97c2b296-1395-4700-8053-4f06c4c86557.4689.161__shadow_.0Yl43pGa0-Mle5CAj0-Ik5_-wTY4rp6_0 2024-09-12T19:13:58.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1324126838388777455', time=2024-09-12T20:59:50.105574+0000, chain.objs.size()=1 2024-09-12T19:13:58.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.233__shadow_.cg5k7d9pPZXZfaojhBmF4kjgR5E1E9i_0 2024-09-12T19:13:58.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.402712597326539355', time=2024-09-12T20:59:57.651658+0000, chain.objs.size()=1 2024-09-12T19:13:58.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.242__shadow_.rxGFZuU4xI6S1wN0D-3o0bZhetXjTq9_0 2024-09-12T19:13:58.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16410410834827522318', time=2024-09-12T21:00:32.101115+0000, chain.objs.size()=1 2024-09-12T19:13:58.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.TD8OvVndlWWly1hdKCJIdeeLijZdKdL_0 2024-09-12T19:13:58.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.254368082867740194', time=2024-09-12T21:00:32.107543+0000, chain.objs.size()=1 2024-09-12T19:13:58.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Emr9EpDKFYQR-IaXp1G5_9JWS6fxzF1_0 2024-09-12T19:13:58.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2557197516506823677', time=2024-09-12T21:00:32.257324+0000, chain.objs.size()=1 2024-09-12T19:13:58.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.xBwKQB22hzadd_qTrOJZcsa-NW1_9Vn_0 2024-09-12T19:13:58.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.646038398221799384', time=2024-09-12T21:00:32.272852+0000, chain.objs.size()=1 2024-09-12T19:13:58.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ul9HyfCDDP4Q7_SK3H6LkvirnpL2wls_0 2024-09-12T19:13:58.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4196165477140880889', time=2024-09-12T21:00:32.277295+0000, chain.objs.size()=1 2024-09-12T19:13:58.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7Z4pmGl0kjAq2R4Px2K3Svza702wN6L_0 2024-09-12T19:13:58.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10466737675377744037', time=2024-09-12T21:00:32.324412+0000, chain.objs.size()=1 2024-09-12T19:13:58.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.VJS4ZRqlKRFwf4lrx1-xVyVZPof807h_0 2024-09-12T19:13:58.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10871912285336278761', time=2024-09-12T21:00:32.567472+0000, chain.objs.size()=1 2024-09-12T19:13:58.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.T2IgP6mEYasQBqHQ0MdNQPY4ik9Owuz_0 2024-09-12T19:13:58.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12606651554873480093', time=2024-09-12T21:00:32.661657+0000, chain.objs.size()=1 2024-09-12T19:13:58.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.QX1-NUaHpE8vtb3Jj2JYINNmxqnhx8g_0 2024-09-12T19:13:58.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14431197289742731145', time=2024-09-12T21:00:32.687487+0000, chain.objs.size()=1 2024-09-12T19:13:58.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.4_dRxDYN-kMpg5vZ3_LPh7R0mF12PMK_0 2024-09-12T19:13:58.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7609209980657495310', time=2024-09-12T21:00:32.699687+0000, chain.objs.size()=1 2024-09-12T19:13:58.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.VlLLg1iU1rFri4_RsrSCrKRuYw8PQfT_0 2024-09-12T19:13:58.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17738870637635576803', time=2024-09-12T21:00:32.705233+0000, chain.objs.size()=1 2024-09-12T19:13:58.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.f2d3MswF5z0c_5Xc6-hBO_mYmHwyhyn_0 2024-09-12T19:13:58.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5949593773101559500', time=2024-09-12T21:00:32.707590+0000, chain.objs.size()=1 2024-09-12T19:13:58.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.188+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.AE0T9CZojqw-sLsga860iuem3T6f1HC_0 2024-09-12T19:13:58.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4047849356933071294', time=2024-09-12T21:00:32.718832+0000, chain.objs.size()=1 2024-09-12T19:13:58.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ol6kLirqu_AIQT6qf8n8KaX1TLceGWS_0 2024-09-12T19:13:58.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17536716056145114603', time=2024-09-12T21:00:32.742190+0000, chain.objs.size()=1 2024-09-12T19:13:58.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.L3C9NSnA60_E1FPT69wJJal8XSTtgSk_0 2024-09-12T19:13:58.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5845269719371253491', time=2024-09-12T21:00:32.896303+0000, chain.objs.size()=1 2024-09-12T19:13:58.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.wdfG6o8Cd49uzNWSrtevf3TwlknOFbC_0 2024-09-12T19:13:58.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10923798909227070654', time=2024-09-12T21:00:32.921585+0000, chain.objs.size()=1 2024-09-12T19:13:58.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.fyk_3gk3FQ5rTdyRkTX4j_u6u_Ytz4h_0 2024-09-12T19:13:58.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13121397058241923783', time=2024-09-12T21:00:32.954149+0000, chain.objs.size()=1 2024-09-12T19:13:58.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.oXWuXTgSF1ihXobErDLrLaMSlvUuPVd_0 2024-09-12T19:13:58.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16968350191640058600', time=2024-09-12T21:00:33.116052+0000, chain.objs.size()=1 2024-09-12T19:13:58.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Hsjskoum0bTC3i322eUH8OUjlBaelVa_0 2024-09-12T19:13:58.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11764727287898945569', time=2024-09-12T21:00:33.144787+0000, chain.objs.size()=1 2024-09-12T19:13:58.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.PuY7Ox2tlYJNeVN4kDmBpIASlMIM48l_0 2024-09-12T19:13:58.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6906535155697681085', time=2024-09-12T21:00:33.148300+0000, chain.objs.size()=1 2024-09-12T19:13:58.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.pDh6A51UGzk2cCf2-8PZpjrNoloUle9_0 2024-09-12T19:13:58.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9630437007709820855', time=2024-09-12T21:00:33.160004+0000, chain.objs.size()=1 2024-09-12T19:13:58.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.CrsLSqbfqe2BIMXs0z2pdBFpq4u6s33_0 2024-09-12T19:13:58.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6456585354566397753', time=2024-09-12T21:00:33.185657+0000, chain.objs.size()=1 2024-09-12T19:13:58.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.V-q8f4fYmQOx5HpqfSGUsmBd-mw-rV6_0 2024-09-12T19:13:58.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17977606794119898171', time=2024-09-12T21:00:33.203261+0000, chain.objs.size()=1 2024-09-12T19:13:58.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.zxEkF0geryouHLdZKQA25R1xhlQY7rC_0 2024-09-12T19:13:58.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4275972884008078272', time=2024-09-12T21:00:33.204924+0000, chain.objs.size()=1 2024-09-12T19:13:58.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.4d1Gad2LUpxi8e5gA9oYEyEYPXefwMD_0 2024-09-12T19:13:58.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1584645895134391725', time=2024-09-12T21:00:33.213977+0000, chain.objs.size()=1 2024-09-12T19:13:58.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ee-o6h1cOEA5T2IMHYrrrsgDfbV0vZN_0 2024-09-12T19:13:58.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13812179233999828485', time=2024-09-12T21:00:33.361013+0000, chain.objs.size()=1 2024-09-12T19:13:58.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.pxORX7iYCRI9sojmhW0W5YQ69hbbK4j_0 2024-09-12T19:13:58.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1763632711303849524', time=2024-09-12T21:00:33.454109+0000, chain.objs.size()=1 2024-09-12T19:13:58.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XYHckIoJfKD5Agau4KtxNggl3vsb4Xo_0 2024-09-12T19:13:58.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2187639800716105120', time=2024-09-12T21:00:33.472504+0000, chain.objs.size()=1 2024-09-12T19:13:58.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.xa5AFrCshsmm5mX2l37j3Ld93rIlWsD_0 2024-09-12T19:13:58.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18397073077576517232', time=2024-09-12T21:00:33.638543+0000, chain.objs.size()=1 2024-09-12T19:13:58.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.nwe88bQzfwmiNYRDbeC4SrZ0Vij8iQP_0 2024-09-12T19:13:58.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8507620450270839160', time=2024-09-12T21:00:33.647102+0000, chain.objs.size()=1 2024-09-12T19:13:58.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.PsS2hmlvGtw9wCfyzpHNVl0yDf7v6IW_0 2024-09-12T19:13:58.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.455727958192997537', time=2024-09-12T21:00:40.303903+0000, chain.objs.size()=1 2024-09-12T19:13:58.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.271__shadow_.JdKUPxoLO0td2PD0ZG78SzN4sPkaBfp_0 2024-09-12T19:13:58.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12366397976716468542', time=2024-09-12T21:00:58.114186+0000, chain.objs.size()=1 2024-09-12T19:13:58.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.192+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.jxsl2JAn0flWXQ22Bhw41uzfz86t75j_0 2024-09-12T19:13:58.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16788575053824242713', time=2024-09-12T21:00:58.127602+0000, chain.objs.size()=1 2024-09-12T19:13:58.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.3jCqrm0M3-DWk8fFa0v5mFrv1O8-qyh_0 2024-09-12T19:13:58.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17137824403294811688', time=2024-09-12T21:01:01.757979+0000, chain.objs.size()=1 2024-09-12T19:13:58.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.298__shadow_.B3eTRMLVXGve85Bw173ZHSDuXgCoyp8_0 2024-09-12T19:13:58.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15585236180174741771', time=2024-09-12T21:01:04.106624+0000, chain.objs.size()=1 2024-09-12T19:13:58.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.301__shadow_.tBAW3ZdoD-BRe1mPitG77wLud_VLcvA_0 2024-09-12T19:13:58.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16262730864383937619', time=2024-09-12T21:01:04.108818+0000, chain.objs.size()=1 2024-09-12T19:13:58.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.301__shadow_.ui7tk4XTP2oXvyVqBzLLrSb0nRVfaXd_0 2024-09-12T19:13:58.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.298643554980042996', time=2024-09-12T21:01:05.587926+0000, chain.objs.size()=1 2024-09-12T19:13:58.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.303__shadow_.xbny8oaxk9OnaWM2eqhg_muNrHqy6S8_0 2024-09-12T19:13:58.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10104061309106517539', time=2024-09-12T21:01:09.097741+0000, chain.objs.size()=1 2024-09-12T19:13:58.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.307__shadow:pAy-MFJLSzKrCOwo1Iz85u0Ff-nUU.0_.bGlFHNu9NB4CIpgcf2WzFNNYcRIq-jC_0 2024-09-12T19:13:58.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4004785291973873469', time=2024-09-12T21:01:39.451242+0000, chain.objs.size()=1 2024-09-12T19:13:58.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.GJ_Td2Ud61ocBleSvM-JFwOoIdOGk2E_0 2024-09-12T19:13:58.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12671072958519151204', time=2024-09-12T21:01:39.461417+0000, chain.objs.size()=1 2024-09-12T19:13:58.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.O7De6aFJYnF4bWkKiNVPTB5mLBHWjUO_0 2024-09-12T19:13:58.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5826191872958257392', time=2024-09-12T21:01:39.490538+0000, chain.objs.size()=1 2024-09-12T19:13:58.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.rPnJn5d8E2dH9H_cVfyfo8oajRlI4qX_0 2024-09-12T19:13:58.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16112202292571775785', time=2024-09-12T21:01:39.540900+0000, chain.objs.size()=1 2024-09-12T19:13:58.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.73gLSnN36ECpsTZXjbaGG_Cqr4Vu6Mb_0 2024-09-12T19:13:58.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17827400987330838137', time=2024-09-12T21:01:39.708908+0000, chain.objs.size()=1 2024-09-12T19:13:58.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.gYfSvbuMCsQ75S3lDPqTnHo3rw5Gu_V_0 2024-09-12T19:13:58.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18444133058906377384', time=2024-09-12T21:01:39.752680+0000, chain.objs.size()=1 2024-09-12T19:13:58.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0FpwH9JoAVQukvaVwSmnLdZTZz7ezLR_0 2024-09-12T19:13:58.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17865674943006810657', time=2024-09-12T21:01:39.900032+0000, chain.objs.size()=1 2024-09-12T19:13:58.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.p68lS5yVxd5IT8P5xTDTCfHxreqSHM6_0 2024-09-12T19:13:58.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.123326046132318048', time=2024-09-12T21:01:39.932874+0000, chain.objs.size()=1 2024-09-12T19:13:58.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Kt4N4rp7zxZJ8xKXS3dXPHpoCp0agFk_0 2024-09-12T19:13:58.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4827361982183497383', time=2024-09-12T21:01:39.949144+0000, chain.objs.size()=1 2024-09-12T19:13:58.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.sF-0Q-wiQLBo3N0pfGNKqe6VR7D5gJJ_0 2024-09-12T19:13:58.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14863382922028196574', time=2024-09-12T21:01:39.964410+0000, chain.objs.size()=1 2024-09-12T19:13:58.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.sk0OKVw8uq0vtNRuiWaMnGv3gEoe8B2_0 2024-09-12T19:13:58.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12504560023286743255', time=2024-09-12T21:01:40.009090+0000, chain.objs.size()=1 2024-09-12T19:13:58.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.V2X3zwt8DGIehem0ienOAUKipXOCo6Q_0 2024-09-12T19:13:58.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4496308803487374055', time=2024-09-12T21:01:40.012167+0000, chain.objs.size()=1 2024-09-12T19:13:58.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.wYqgP_tJkzEGqU1i5hVIBbRT3egSima_0 2024-09-12T19:13:58.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9410243046600486990', time=2024-09-12T21:01:40.159302+0000, chain.objs.size()=1 2024-09-12T19:13:58.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.MOs6gcQ1ZiIGqT1UIxnm1Zp4LYzZqsY_0 2024-09-12T19:13:58.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11505593454845635255', time=2024-09-12T21:01:40.167499+0000, chain.objs.size()=1 2024-09-12T19:13:58.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.E6x7uWpaBtTsq_U0FOakaFpo4NIeXuU_0 2024-09-12T19:13:58.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2759564801474670974', time=2024-09-12T21:01:40.219631+0000, chain.objs.size()=1 2024-09-12T19:13:58.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.cZpaGeGlMVHiBO-oPIWtW0Z1U22_uPH_0 2024-09-12T19:13:58.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14844524432048972160', time=2024-09-12T21:01:40.379534+0000, chain.objs.size()=1 2024-09-12T19:13:58.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.196+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.bChZUtgAHreEQYvO7XMoToXvem_-oNU_0 2024-09-12T19:13:58.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17079951319093348690', time=2024-09-12T21:01:40.407943+0000, chain.objs.size()=1 2024-09-12T19:13:58.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DqXXXBi6gMCUzoHAFMlbBhZduA8RnYE_0 2024-09-12T19:13:58.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6146189594766604593', time=2024-09-12T21:01:40.425352+0000, chain.objs.size()=1 2024-09-12T19:13:58.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.F9FKieMce_gGkwOzoJD09CbXyD6EJnQ_0 2024-09-12T19:13:58.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5672123148796607033', time=2024-09-12T21:01:40.610445+0000, chain.objs.size()=1 2024-09-12T19:13:58.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.O-rtCvyNpj-oGwcEz-wjmltMTaytn_w_0 2024-09-12T19:13:58.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8772299101576642511', time=2024-09-12T21:01:40.612933+0000, chain.objs.size()=1 2024-09-12T19:13:58.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.xyLE6cysWHavQXmSR3IAxB_qwv4RF10_0 2024-09-12T19:13:58.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9781581214214380076', time=2024-09-12T21:01:40.630535+0000, chain.objs.size()=1 2024-09-12T19:13:58.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.i6uYgsAZcMDiM5OLb1lz5rD35ObqJ2J_0 2024-09-12T19:13:58.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9506377815660317260', time=2024-09-12T21:01:40.807422+0000, chain.objs.size()=1 2024-09-12T19:13:58.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.WwJlbStfHnFPUCNFWdDJ5rfzT0-0GYH_0 2024-09-12T19:13:58.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14641117761156823351', time=2024-09-12T21:01:40.877593+0000, chain.objs.size()=1 2024-09-12T19:13:58.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.u_jnoOadbyQvhCj_APmw1krnowJCQ08_0 2024-09-12T19:13:58.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9205341236500331519', time=2024-09-12T21:01:40.879590+0000, chain.objs.size()=1 2024-09-12T19:13:58.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.l2tcJx0IlFfpo0gaWbr7p34MfipY5eJ_0 2024-09-12T19:13:58.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16104531639998235423', time=2024-09-12T21:02:00.543459+0000, chain.objs.size()=1 2024-09-12T19:13:58.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.cmfyI9DC-tgmYtQ1oQJikSY6_T99VO3_0 2024-09-12T19:13:58.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4370698508368075425', time=2024-09-12T21:02:00.561654+0000, chain.objs.size()=1 2024-09-12T19:13:58.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.bxpi_OBON0buxxFWpWHynGvHtTeYGSI_0 2024-09-12T19:13:58.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9068068416180200005', time=2024-09-12T21:02:00.564730+0000, chain.objs.size()=1 2024-09-12T19:13:58.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.s-p5WD-vIPz0iR8cXmtD19KyHucDmuE_0 2024-09-12T19:13:58.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13959727807480712733', time=2024-09-12T21:02:00.632795+0000, chain.objs.size()=1 2024-09-12T19:13:58.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.v3v7fNIRC4m-P5z47SQIy0umIqY2P9a_0 2024-09-12T19:13:58.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16842566034884068284', time=2024-09-12T21:02:00.635985+0000, chain.objs.size()=1 2024-09-12T19:13:58.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qtHFAKEAnt3SkgmdjvDx8fgOM10PNJm_0 2024-09-12T19:13:58.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1500268334570367109', time=2024-09-12T21:02:00.645298+0000, chain.objs.size()=1 2024-09-12T19:13:58.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7hggY-1_muFsjN54Z4MXw_nk-9VX7xN_0 2024-09-12T19:13:58.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2318379791512796010', time=2024-09-12T21:02:00.769826+0000, chain.objs.size()=1 2024-09-12T19:13:58.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.e_Tgx66rlQRTP5KkLVhll2rLZGvvpzj_0 2024-09-12T19:13:58.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9154721468224341063', time=2024-09-12T21:02:00.773170+0000, chain.objs.size()=1 2024-09-12T19:13:58.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.kr0u3kxejn_U2OvBBcnnij1jinRNwEq_0 2024-09-12T19:13:58.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14035862662152975976', time=2024-09-12T21:02:00.801167+0000, chain.objs.size()=1 2024-09-12T19:13:58.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.clZClWGhCPzYswVfaTGD1vQ0ZfUdv3q_0 2024-09-12T19:13:58.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8401245314562737497', time=2024-09-12T21:02:00.835188+0000, chain.objs.size()=1 2024-09-12T19:13:58.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.IkBmM4pDbZpf7un9dtwI_BZzsgqzXNS_0 2024-09-12T19:13:58.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12961386700694058241', time=2024-09-12T21:02:00.838672+0000, chain.objs.size()=1 2024-09-12T19:13:58.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.G_2ZZ9Aj5cvjBjHc1rBfixTMJfddJ3j_0 2024-09-12T19:13:58.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5879210139392828483', time=2024-09-12T21:02:00.881766+0000, chain.objs.size()=1 2024-09-12T19:13:58.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._-w9FxB3VzzWJa38VqwpylizFPi6rcj_0 2024-09-12T19:13:58.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12432687542546349673', time=2024-09-12T21:02:00.999359+0000, chain.objs.size()=1 2024-09-12T19:13:58.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8yC8keHGGx7TSgIpsJ07KqGSvia-VXY_0 2024-09-12T19:13:58.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8211903511055829883', time=2024-09-12T21:02:01.019340+0000, chain.objs.size()=1 2024-09-12T19:13:58.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.200+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.KveMDJ41PLVHPnUCDOyiCBKG7GCUuJm_0 2024-09-12T19:13:58.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11986497776335954342', time=2024-09-12T21:02:01.042424+0000, chain.objs.size()=1 2024-09-12T19:13:58.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2EaAwv-eEMK2wFnfBNzkx9KvNkdXnnK_0 2024-09-12T19:13:58.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8809347401433987593', time=2024-09-12T21:02:01.061002+0000, chain.objs.size()=1 2024-09-12T19:13:58.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.e1EhElPoAU3onrxkK9WNbqJDQm0fN3B_0 2024-09-12T19:13:58.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10107272603974119103', time=2024-09-12T21:02:01.084703+0000, chain.objs.size()=1 2024-09-12T19:13:58.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yO_AjrHwBpLR9MYKeA-bcUWpwCpOh0I_0 2024-09-12T19:13:58.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4005958943921514253', time=2024-09-12T21:02:01.302133+0000, chain.objs.size()=1 2024-09-12T19:13:58.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.zbDDYFfwHnGCG1Y3V-dd_PlzzNH5bdJ_0 2024-09-12T19:13:58.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5563177059906029764', time=2024-09-12T21:02:01.330887+0000, chain.objs.size()=1 2024-09-12T19:13:58.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_._X-CPdgA1ay1w0SEFzYtfpxPDC5Bm8h_0 2024-09-12T19:13:58.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18080466589698745271', time=2024-09-12T21:02:01.485737+0000, chain.objs.size()=1 2024-09-12T19:13:58.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8666Ct-BEt79mdqmD0uTPuat1Qg-5vg_0 2024-09-12T19:13:58.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1625813487410924437', time=2024-09-12T21:02:01.493703+0000, chain.objs.size()=1 2024-09-12T19:13:58.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Sq_hWg2TXMCAWnE8QzvDoj8nDeUSeCb_0 2024-09-12T19:13:58.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2997488938645152205', time=2024-09-12T21:02:01.519589+0000, chain.objs.size()=1 2024-09-12T19:13:58.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.slFDS3NrEv-l8Ao5YPtGyy-8tW8uXBE_0 2024-09-12T19:13:58.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13701985537541010018', time=2024-09-12T21:02:01.735415+0000, chain.objs.size()=1 2024-09-12T19:13:58.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1mSviiDnfE-b7fAhnqTGmfdm753Wkb7_0 2024-09-12T19:13:58.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.355865345244069736', time=2024-09-12T21:02:01.790687+0000, chain.objs.size()=1 2024-09-12T19:13:58.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7V83kC-RxKKevt0qf2TS0cWU-X5jsuS_0 2024-09-12T19:13:58.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7661611603074456104', time=2024-09-12T21:02:01.916761+0000, chain.objs.size()=1 2024-09-12T19:13:58.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-nbGU_bRhgGW8tU1X0a2hNnzJLxS8tT_0 2024-09-12T19:13:58.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11168058037441759884', time=2024-09-12T21:02:01.933451+0000, chain.objs.size()=1 2024-09-12T19:13:58.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-wqNN8btWlPgjYfeA8lPNy126GpOGoW_0 2024-09-12T19:13:58.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5711338304528669452', time=2024-09-12T21:02:01.938656+0000, chain.objs.size()=1 2024-09-12T19:13:58.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.CGmAA40ibp3NgwNCeyRldXL_l0bEob2_0 2024-09-12T19:13:58.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4580852198331380237', time=2024-09-12T21:02:02.168751+0000, chain.objs.size()=1 2024-09-12T19:13:58.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.P_u8su7jTSUhEvIZAsr3Iz6n0dJNi-9_0 2024-09-12T19:13:58.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10752330453489011463', time=2024-09-12T21:02:02.195309+0000, chain.objs.size()=1 2024-09-12T19:13:58.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.UOsb49ErzvhD9_cD3G2KRlZ4-Z9Pd30_0 2024-09-12T19:13:58.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1903755374247820007', time=2024-09-12T21:02:15.316394+0000, chain.objs.size()=1 2024-09-12T19:13:58.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.344__shadow_.N_8nCd58-Fb-sCFnOnQ_tpyLCY_nyCl_0 2024-09-12T19:13:58.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13793216622461140366', time=2024-09-12T21:03:44.974913+0000, chain.objs.size()=1 2024-09-12T19:13:58.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.204+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.464__shadow_.degmG2t6Gs7eLHD2Rk0m4HL5IaIS81t_0 2024-09-12T19:13:58.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15467533333913950807', time=2024-09-12T21:04:28.438966+0000, chain.objs.size()=3 2024-09-12T19:13:58.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.521__multipart_mymultipart.2~dzfePkBq8-54Ew1Vy2wPvxr1KHcEdX7.1 2024-09-12T19:13:58.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.521__multipart_mymultipart.2~dzfePkBq8-54Ew1Vy2wPvxr1KHcEdX7.2 2024-09-12T19:13:58.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.521__multipart_mymultipart.2~dzfePkBq8-54Ew1Vy2wPvxr1KHcEdX7.3 2024-09-12T19:13:58.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~an1JkIBIyVAj-cJj8NxJ1e4nbQlyeYX', time=2024-09-12T21:04:34.270961+0000, chain.objs.size()=1 2024-09-12T19:13:58.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~an1JkIBIyVAj-cJj8NxJ1e4nbQlyeYX.2 2024-09-12T19:13:58.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10410054811089916718', time=2024-09-12T21:04:36.992887+0000, chain.objs.size()=6 2024-09-12T19:13:58.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~an1JkIBIyVAj-cJj8NxJ1e4nbQlyeYX.1 2024-09-12T19:13:58.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.sovKSlW8j67WRFdMESsFaifAc2giXS9W.2 2024-09-12T19:13:58.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~an1JkIBIyVAj-cJj8NxJ1e4nbQlyeYX.3 2024-09-12T19:13:58.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~an1JkIBIyVAj-cJj8NxJ1e4nbQlyeYX.4 2024-09-12T19:13:58.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~an1JkIBIyVAj-cJj8NxJ1e4nbQlyeYX.5 2024-09-12T19:13:58.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.522__multipart_mymultipart.2~an1JkIBIyVAj-cJj8NxJ1e4nbQlyeYX.6 2024-09-12T19:13:58.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12221657801248197623', time=2024-09-12T21:04:53.078604+0000, chain.objs.size()=3 2024-09-12T19:13:58.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.525__multipart_mymultipart.2~Egm_P-rLZzYmCLMt4F5zlfNfvN3z6fC.1 2024-09-12T19:13:58.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.525__multipart_mymultipart.2~Egm_P-rLZzYmCLMt4F5zlfNfvN3z6fC.2 2024-09-12T19:13:58.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.208+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.525__multipart_mymultipart.2~Egm_P-rLZzYmCLMt4F5zlfNfvN3z6fC.3 2024-09-12T19:13:58.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50031 2024-09-12T19:13:58.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T19:13:58.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12798984543041541777', time=2024-09-12T21:05:17.467874+0000, chain.objs.size()=4 2024-09-12T19:13:58.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.535__multipart_mymultipart.2~SCc-B6e1YgqOieSRZR-AY0wzwUq5Jjt.1 2024-09-12T19:13:58.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.535__multipart_mymultipart.2~SCc-B6e1YgqOieSRZR-AY0wzwUq5Jjt.2 2024-09-12T19:13:58.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.535__multipart_mymultipart.fluAxSkL3JL-Ya2r6f6QAdEhf_Xzikwj.3 2024-09-12T19:13:58.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.535__multipart_mymultipart.2~SCc-B6e1YgqOieSRZR-AY0wzwUq5Jjt.4 2024-09-12T19:13:58.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11303053740623915229', time=2024-09-12T21:06:13.197986+0000, chain.objs.size()=1 2024-09-12T19:13:58.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.571__shadow_.Ldjd36UQ_YzzUjJke_Jl5jm09IyoDVU_0 2024-09-12T19:13:58.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7007565897223084554', time=2024-09-12T21:06:38.811606+0000, chain.objs.size()=1 2024-09-12T19:13:58.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:uWAx8GH2O6tc5dzvntB8ei-AA5NzYli_.1sN7abiM_0gyZwZhzpwtSw76aq7XSy6_0 2024-09-12T19:13:58.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18331286432730274136', time=2024-09-12T21:06:52.085304+0000, chain.objs.size()=1 2024-09-12T19:13:58.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.585__shadow:VhURoHfVmEIJbTA4ePok0QrmOxap2zi_.FsySFNZWtl6Jwi1nkNG0916s78tPLAg_0 2024-09-12T19:13:58.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7378431747882328920', time=2024-09-12T21:09:42.301024+0000, chain.objs.size()=1 2024-09-12T19:13:58.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.634__shadow_.ULAgEzg0kJvyZ-qRugrDQordrmGEd0m_0 2024-09-12T19:13:58.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3883734060859062780', time=2024-09-12T21:09:58.202431+0000, chain.objs.size()=1 2024-09-12T19:13:58.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.654__shadow_.o9NO7isbrdG0iTOwEy3MKY4vrkXo82X_0 2024-09-12T19:13:58.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11419855285239515775', time=2024-09-12T21:10:07.188263+0000, chain.objs.size()=1 2024-09-12T19:13:58.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.664__shadow_.p--b4KQ9-JK7zzjEUJX4EkSqucSaK-X_0 2024-09-12T19:13:58.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4741836546119769342', time=2024-09-12T21:10:08.103071+0000, chain.objs.size()=1 2024-09-12T19:13:58.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.665__shadow_.8wYPd7q0bkY0ISo22crs8hLfHG3gEWx_0 2024-09-12T19:13:58.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11779067655969835293', time=2024-09-12T21:10:08.104879+0000, chain.objs.size()=1 2024-09-12T19:13:58.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.212+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.665__shadow_.gA2zFAF8hKFHO5eVagcdkLYXSo15aCh_0 2024-09-12T19:13:58.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.216+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:58.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.216+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T19:13:58.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:58.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:58.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/55940' 2024-09-12T19:13:58.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17359276093142038546', time=2024-09-12T20:59:50.104872+0000, chain.objs.size()=1 2024-09-12T19:13:58.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.233__shadow_.tUd8IxHrVistMpY6fPlmkG-iGZ0jNVL_0 2024-09-12T19:13:58.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14003472093208431920', time=2024-09-12T21:00:31.981695+0000, chain.objs.size()=1 2024-09-12T19:13:58.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DMZzL8lOetz_NRRPzYJDGEEg5oUqgF9_0 2024-09-12T19:13:58.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.142522505437851502', time=2024-09-12T21:00:31.985059+0000, chain.objs.size()=1 2024-09-12T19:13:58.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.AjXijMJOno7RkKfAmL7xTPUmZT-EK6P_0 2024-09-12T19:13:58.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4470817623066127258', time=2024-09-12T21:00:32.012904+0000, chain.objs.size()=1 2024-09-12T19:13:58.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Z_wKjWb-TQK50OxnYkaWlnAU55XcBUP_0 2024-09-12T19:13:58.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2225158108965128753', time=2024-09-12T21:00:32.040218+0000, chain.objs.size()=1 2024-09-12T19:13:58.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JNYIgz25fVwLYPI5rySnCxEtU9eIkjn_0 2024-09-12T19:13:58.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18207029129468963579', time=2024-09-12T21:00:32.109162+0000, chain.objs.size()=1 2024-09-12T19:13:58.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.EWD7VgLojgkBWKazmBnSads-K0DRfAM_0 2024-09-12T19:13:58.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14579973357302596986', time=2024-09-12T21:00:32.125498+0000, chain.objs.size()=1 2024-09-12T19:13:58.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Y2p2ukuiuNIhNa9-YfmGyVM1MX-j2ff_0 2024-09-12T19:13:58.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7505418298732022972', time=2024-09-12T21:00:32.291044+0000, chain.objs.size()=1 2024-09-12T19:13:58.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SzB6dXtzW2JW9n5woHf9cifL9wZ6wpU_0 2024-09-12T19:13:58.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13600530136390993999', time=2024-09-12T21:00:32.323604+0000, chain.objs.size()=1 2024-09-12T19:13:58.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.S79XSls_r04VMMe7ghX2aA4APNmE-WX_0 2024-09-12T19:13:58.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14554027757195476771', time=2024-09-12T21:00:32.341058+0000, chain.objs.size()=1 2024-09-12T19:13:58.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Pnj6oVXNSGgbiUBzt0Ukg3NomYSoZcG_0 2024-09-12T19:13:58.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8848213654914917943', time=2024-09-12T21:00:32.350888+0000, chain.objs.size()=1 2024-09-12T19:13:58.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XGTyTDmYyCiJimxT6mPIYc5OBAn50ln_0 2024-09-12T19:13:58.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8549520900699513523', time=2024-09-12T21:00:32.735216+0000, chain.objs.size()=1 2024-09-12T19:13:58.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.220+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.TwouZDi85W7Fag-L8IP-TinZ3f7mbUD_0 2024-09-12T19:13:58.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9427546980329187945', time=2024-09-12T21:00:32.774277+0000, chain.objs.size()=1 2024-09-12T19:13:58.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.VZbU8TL5oa0dFyr0eILrCRK5zYbvmaT_0 2024-09-12T19:13:58.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3167595395908323441', time=2024-09-12T21:00:32.915601+0000, chain.objs.size()=1 2024-09-12T19:13:58.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.zoOjKNd3bwVowFkJMI3Gq2Gc7Yruzze_0 2024-09-12T19:13:58.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18410753273943097996', time=2024-09-12T21:00:32.977100+0000, chain.objs.size()=1 2024-09-12T19:13:58.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.oufMI8uLZIiyPHPa_QkydYKGy1herDg_0 2024-09-12T19:13:58.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16944346582635188480', time=2024-09-12T21:00:33.138771+0000, chain.objs.size()=1 2024-09-12T19:13:58.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.cVfbI0wZ-UcWASU0d74E4Erx6f5PKEE_0 2024-09-12T19:13:58.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12491783849448410054', time=2024-09-12T21:00:33.158188+0000, chain.objs.size()=1 2024-09-12T19:13:58.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Y7WOhQmURlSmRl7YuEKpCMNUZ4QKkim_0 2024-09-12T19:13:58.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16028235576761949570', time=2024-09-12T21:00:33.182605+0000, chain.objs.size()=1 2024-09-12T19:13:58.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.EyrUwpZ18Jtqa03IRPoN0H8VfBlRC8I_0 2024-09-12T19:13:58.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5879806704281203230', time=2024-09-12T21:00:33.198256+0000, chain.objs.size()=1 2024-09-12T19:13:58.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.B2wq8DZCNcTDS0bTomTmLWIvWXVDSOi_0 2024-09-12T19:13:58.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13364346954215355721', time=2024-09-12T21:00:33.365748+0000, chain.objs.size()=1 2024-09-12T19:13:58.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.piGWYV_I8LOd86NugIjke1hwU5WfU5K_0 2024-09-12T19:13:58.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4018214005299888862', time=2024-09-12T21:00:33.411415+0000, chain.objs.size()=1 2024-09-12T19:13:58.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Kkg2OmRyKZAXtl3yyQ64HmKOU-yNjGL_0 2024-09-12T19:13:58.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5038446261403153821', time=2024-09-12T21:00:33.430530+0000, chain.objs.size()=1 2024-09-12T19:13:58.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.EJ511t5EUGxFGIvBqKkak0tnCXiLZy6_0 2024-09-12T19:13:58.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14689362232869110578', time=2024-09-12T21:00:33.453833+0000, chain.objs.size()=1 2024-09-12T19:13:58.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LzTBhrTxz5aI-rabu-o5a9cTfDNDp8k_0 2024-09-12T19:13:58.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15414154682543325456', time=2024-09-12T21:00:33.454592+0000, chain.objs.size()=1 2024-09-12T19:13:58.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.YFx3X8dN9rMjT_ns53-Bg-OZ5epkzG0_0 2024-09-12T19:13:58.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15795943392674841851', time=2024-09-12T21:00:33.461488+0000, chain.objs.size()=1 2024-09-12T19:13:58.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.X4Sp68mOznFKmpQLI7rIGpFKsN1uN33_0 2024-09-12T19:13:58.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1048367129842331377', time=2024-09-12T21:00:33.881085+0000, chain.objs.size()=1 2024-09-12T19:13:58.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.UBwGhiAL6KQ-j-DlRMNC9F8gOmqwzhf_0 2024-09-12T19:13:58.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6409894309519395707', time=2024-09-12T21:00:33.890277+0000, chain.objs.size()=1 2024-09-12T19:13:58.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.xr97OjOAeJblSz_CFGU-QAsx4MvCD0x_0 2024-09-12T19:13:58.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9404226839113540929', time=2024-09-12T21:00:43.220781+0000, chain.objs.size()=1 2024-09-12T19:13:58.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.275__shadow_.PgezOjB75SAZv5Hhy4IC1X5AeZgG919_0 2024-09-12T19:13:58.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8140410390565493269', time=2024-09-12T21:00:46.181559+0000, chain.objs.size()=1 2024-09-12T19:13:58.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.279__shadow_.umYlIckujqDSiJNZ2ucQV2XrWFgIwgy_0 2024-09-12T19:13:58.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2187858693289795763', time=2024-09-12T21:00:46.891913+0000, chain.objs.size()=1 2024-09-12T19:13:58.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.224+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.280__shadow_.c2HzAefg5iRDbp-LWgnpF-bVnpN6NYn_0 2024-09-12T19:13:58.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14298520685184924472', time=2024-09-12T21:00:50.592010+0000, chain.objs.size()=1 2024-09-12T19:13:58.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.285__shadow_.JfcVdHGVFUCDvRPloTHH2p2VpORwC07_0 2024-09-12T19:13:58.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4631763266453851944', time=2024-09-12T21:00:52.793648+0000, chain.objs.size()=1 2024-09-12T19:13:58.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.288__shadow_.ZmBOTIRvHJ2ktTM7PKXWuRcy3dsIIEn_0 2024-09-12T19:13:58.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1476469674418746303', time=2024-09-12T21:00:58.143006+0000, chain.objs.size()=1 2024-09-12T19:13:58.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.D8NT0-iFrLMMlimDDH_0ATjuJQqXmHx_0 2024-09-12T19:13:58.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11511539795552843414', time=2024-09-12T21:00:58.145093+0000, chain.objs.size()=1 2024-09-12T19:13:58.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.VHzSiV3PPQsaAOilOFS-MI0VOe9klqa_0 2024-09-12T19:13:58.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16827465217575233571', time=2024-09-12T21:01:17.726884+0000, chain.objs.size()=1 2024-09-12T19:13:58.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.319__shadow:MHp5xhy2cmBFs.mw2NvJ0E-7eBKmnIY_.uKm6i6vMJRfV8GT_7HsB9Op0IZmMnm7_0 2024-09-12T19:13:58.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9309739329603772416', time=2024-09-12T21:01:19.454813+0000, chain.objs.size()=1 2024-09-12T19:13:58.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.322__shadow_.GDpzV13DJVZy2wasbKPrRHSgs2Ult6q_0 2024-09-12T19:13:58.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13822094413244470288', time=2024-09-12T21:01:39.505431+0000, chain.objs.size()=1 2024-09-12T19:13:58.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.x_v_3gdZ5wZSWPkPGadk9nWUsjQK2J4_0 2024-09-12T19:13:58.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.337721148275570788', time=2024-09-12T21:01:39.533240+0000, chain.objs.size()=1 2024-09-12T19:13:58.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.xz7YzE9k2n8N1o3YpK2bvbjAQoSRsLK_0 2024-09-12T19:13:58.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3241104853966626622', time=2024-09-12T21:01:39.556977+0000, chain.objs.size()=1 2024-09-12T19:13:58.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ZKkrRjf5JV6Z-vtvTr8QOYta-Z2R36n_0 2024-09-12T19:13:58.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17530165844752990591', time=2024-09-12T21:01:39.765989+0000, chain.objs.size()=1 2024-09-12T19:13:58.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.4PEe5u2Mnqzt4WHZZsvC0SwyvwCxvdJ_0 2024-09-12T19:13:58.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14879156173268926877', time=2024-09-12T21:01:39.927784+0000, chain.objs.size()=1 2024-09-12T19:13:58.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.aqOtiS8ed5HrEp8Orze_SPScv39GQyQ_0 2024-09-12T19:13:58.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3242553452544782255', time=2024-09-12T21:01:39.945329+0000, chain.objs.size()=1 2024-09-12T19:13:58.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.D0fuk7zmp5l_5mTcrUIhnzyLBog7Y5o_0 2024-09-12T19:13:58.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13097170684720046261', time=2024-09-12T21:01:39.974075+0000, chain.objs.size()=1 2024-09-12T19:13:58.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.W4rUf6NOvpb02wslgRz1Ks_GbRtx_mu_0 2024-09-12T19:13:58.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17446483320563129390', time=2024-09-12T21:01:39.993041+0000, chain.objs.size()=1 2024-09-12T19:13:58.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.H2Y0RdmH5fbey_X8K_ANV0QkWvnWYxi_0 2024-09-12T19:13:58.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.250997475679016019', time=2024-09-12T21:01:39.995187+0000, chain.objs.size()=1 2024-09-12T19:13:58.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Ekka_w1apUF0oc6SPnu4RnEdSoExrY3_0 2024-09-12T19:13:58.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5958577783264727367', time=2024-09-12T21:01:40.021176+0000, chain.objs.size()=1 2024-09-12T19:13:58.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.jIXzmh2aj800QH7q6WZkjR-wcPpjqlu_0 2024-09-12T19:13:58.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13654983156468300232', time=2024-09-12T21:01:40.133604+0000, chain.objs.size()=1 2024-09-12T19:13:58.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.YmYMOagbdNytyYrnoLJr8OqUPqdV8B7_0 2024-09-12T19:13:58.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5217978632882726258', time=2024-09-12T21:01:40.135274+0000, chain.objs.size()=1 2024-09-12T19:13:58.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.T4r0Stqoyz6XtjCwhQwcikSwY3rSeVg_0 2024-09-12T19:13:58.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13941655639824907858', time=2024-09-12T21:01:40.156335+0000, chain.objs.size()=1 2024-09-12T19:13:58.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.i9ouf3FYWW4k_woZtEctaVCayT0RN8K_0 2024-09-12T19:13:58.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11866497699447927605', time=2024-09-12T21:01:40.157553+0000, chain.objs.size()=1 2024-09-12T19:13:58.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.1RE9hi1QenJrnPnkHWSLyh_FIHJiUnK_0 2024-09-12T19:13:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2133387286313594138', time=2024-09-12T21:01:40.168759+0000, chain.objs.size()=1 2024-09-12T19:13:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.wrEdF1g9Xz1DjtSyMz_Al6GkRtJX5vN_0 2024-09-12T19:13:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12217948483845508123', time=2024-09-12T21:01:40.227968+0000, chain.objs.size()=1 2024-09-12T19:13:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BBPdZ_Px9TMoaQbizM6YB3YqHQdvoee_0 2024-09-12T19:13:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9376333408850405300', time=2024-09-12T21:01:40.419450+0000, chain.objs.size()=1 2024-09-12T19:13:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.228+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ZNkUldtJ3negW2KGm40y08NkumntaYu_0 2024-09-12T19:13:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12515548497487856246', time=2024-09-12T21:01:40.615018+0000, chain.objs.size()=1 2024-09-12T19:13:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9ktlRhVkbANDw6V6HQA5y714VMBkYkK_0 2024-09-12T19:13:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12153097015316584261', time=2024-09-12T21:01:40.659201+0000, chain.objs.size()=1 2024-09-12T19:13:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.XDRMEys3eV35Odckm-3-0-H9Il-CXkf_0 2024-09-12T19:13:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6030295686922514009', time=2024-09-12T21:01:40.795688+0000, chain.objs.size()=1 2024-09-12T19:13:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.fcEERI_ysl3vaNHLy6IHTGVfRK_ROAX_0 2024-09-12T19:13:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10857863545679422790', time=2024-09-12T21:01:40.818053+0000, chain.objs.size()=1 2024-09-12T19:13:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DS57CX9a7l_Bg7mfx6aFdkGuBrHdW75_0 2024-09-12T19:13:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11086988338398206883', time=2024-09-12T21:01:40.852467+0000, chain.objs.size()=1 2024-09-12T19:13:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.8nweh3sXMZ49RcwaIv8Prd4r4ApMa30_0 2024-09-12T19:13:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13302633288793514051', time=2024-09-12T21:01:41.026095+0000, chain.objs.size()=1 2024-09-12T19:13:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RL2YdBiPbkcAcKnw5iRssZY6iGNbFPF_0 2024-09-12T19:13:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8732368787391172067', time=2024-09-12T21:01:41.038363+0000, chain.objs.size()=1 2024-09-12T19:13:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.sMs_AX-TIxvpyNPM7QMCizHsuCdSPpd_0 2024-09-12T19:13:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10676073481203471569', time=2024-09-12T21:01:41.066202+0000, chain.objs.size()=1 2024-09-12T19:13:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Z93r7qanIWYli6VTwGGOg3e-2dQNNeQ_0 2024-09-12T19:13:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12938516409283337465', time=2024-09-12T21:02:00.521059+0000, chain.objs.size()=1 2024-09-12T19:13:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0EQ19-h4tk6bcplNsp5xKqfgpT7QsQw_0 2024-09-12T19:13:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11121351371476462716', time=2024-09-12T21:02:00.538966+0000, chain.objs.size()=1 2024-09-12T19:13:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.dqOMvOd_kbJWRxuUxvXB-UywrLAXjo8_0 2024-09-12T19:13:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2736134480600765534', time=2024-09-12T21:02:00.596589+0000, chain.objs.size()=1 2024-09-12T19:13:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1bSoaIFcj5XXcp2YmqzEvUalShakCPs_0 2024-09-12T19:13:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9371724164202832108', time=2024-09-12T21:02:00.614153+0000, chain.objs.size()=1 2024-09-12T19:13:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.iG-xBrbHHKkhl3gOdODVxUVczPjmLIR_0 2024-09-12T19:13:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3663060230035953382', time=2024-09-12T21:02:00.779756+0000, chain.objs.size()=1 2024-09-12T19:13:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.H4RP16SseJuXESLa0ZlZkQ01eIbzYGZ_0 2024-09-12T19:13:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16770483300964306478', time=2024-09-12T21:02:00.795115+0000, chain.objs.size()=1 2024-09-12T19:13:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-KL-Htrx_2b-eyhWhQ8CScdPY3yIXaL_0 2024-09-12T19:13:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1943952384367048068', time=2024-09-12T21:02:00.864397+0000, chain.objs.size()=1 2024-09-12T19:13:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.QgZnHi7rQ4tsGdYbut1svmClSnXIsxj_0 2024-09-12T19:13:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10053408819366141528', time=2024-09-12T21:02:00.880064+0000, chain.objs.size()=1 2024-09-12T19:13:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.4lb0eSMQdnbZ1opiZsF9-QmrhURok5m_0 2024-09-12T19:13:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11392834581980542946', time=2024-09-12T21:02:01.064848+0000, chain.objs.size()=1 2024-09-12T19:13:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ib-Q1UJ9oQW85UNzKkak7Tea0hnrABQ_0 2024-09-12T19:13:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9029643420354849830', time=2024-09-12T21:02:01.073313+0000, chain.objs.size()=1 2024-09-12T19:13:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Q0SVjti_P1W8Th6aOuCUyE13MtXGCFY_0 2024-09-12T19:13:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9338366663851770307', time=2024-09-12T21:02:01.255965+0000, chain.objs.size()=1 2024-09-12T19:13:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ThrEaYHcbaePR0GFq7OkiM7dyB6p85c_0 2024-09-12T19:13:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9501633486791749009', time=2024-09-12T21:02:01.329977+0000, chain.objs.size()=1 2024-09-12T19:13:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NODeQurMU35LThbVfEvPLTxwNtI33dI_0 2024-09-12T19:13:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18146762883647528845', time=2024-09-12T21:02:01.334161+0000, chain.objs.size()=1 2024-09-12T19:13:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.eoN1p0B7m0D8Uc9pdl6_1qGR_JZVmqT_0 2024-09-12T19:13:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8270539443253260677', time=2024-09-12T21:02:01.352429+0000, chain.objs.size()=1 2024-09-12T19:13:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NMI3_vvlSJxol67YZ8p4OQVgciD_WtE_0 2024-09-12T19:13:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12150209995164902956', time=2024-09-12T21:02:01.463725+0000, chain.objs.size()=1 2024-09-12T19:13:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.232+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Itbm6AIx9s2RdprhPP4tRDFh38Y2ySU_0 2024-09-12T19:13:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10370710874050688795', time=2024-09-12T21:02:01.467792+0000, chain.objs.size()=1 2024-09-12T19:13:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.TcpTnxaguXtnZK-HdABL2ofe4bAs7J0_0 2024-09-12T19:13:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10666959704030430271', time=2024-09-12T21:02:01.491401+0000, chain.objs.size()=1 2024-09-12T19:13:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ozMWpn_2ncoy4pRDelGB4HqyGLap1PP_0 2024-09-12T19:13:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.960316716433326007', time=2024-09-12T21:02:01.514009+0000, chain.objs.size()=1 2024-09-12T19:13:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.4uRUqM4Zda5RNe0orG_RiNheaI2yer8_0 2024-09-12T19:13:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16891794261521438864', time=2024-09-12T21:02:01.523713+0000, chain.objs.size()=1 2024-09-12T19:13:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ZyvEg5lGcUywsHF_U6Vc1kwDigexhkb_0 2024-09-12T19:13:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10738464807573294625', time=2024-09-12T21:02:01.694337+0000, chain.objs.size()=1 2024-09-12T19:13:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5oXXqBYDmXDe-8PVHX3TtrOOgEKyONI_0 2024-09-12T19:13:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17541131759461844817', time=2024-09-12T21:02:01.738414+0000, chain.objs.size()=1 2024-09-12T19:13:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.K_y1PT-qA_t-iAuCLJQjpZ6iWaFx8tV_0 2024-09-12T19:13:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10144080428878220892', time=2024-09-12T21:02:01.936405+0000, chain.objs.size()=1 2024-09-12T19:13:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ltqxniKrGrrsL3qHwGGlHMLek7maGSG_0 2024-09-12T19:13:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5911221391037341437', time=2024-09-12T21:02:01.958147+0000, chain.objs.size()=1 2024-09-12T19:13:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.71k7QLJxZV51z0sRtsD71s_7JR6wDbM_0 2024-09-12T19:13:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17027784504375935722', time=2024-09-12T21:02:02.183623+0000, chain.objs.size()=1 2024-09-12T19:13:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.6tBHHwP-zjxoLCly99ylzNVhTBeFvcJ_0 2024-09-12T19:13:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2264257443555242717', time=2024-09-12T21:02:02.207064+0000, chain.objs.size()=1 2024-09-12T19:13:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.sD9o_10PqF8Rql-ZG4EtEyFr0o_jHc8_0 2024-09-12T19:13:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11068530425973515077', time=2024-09-12T21:03:30.009514+0000, chain.objs.size()=1 2024-09-12T19:13:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.447__shadow_.0HkHPelxPZcQPzV4Jh8bLDmi_bVhibZ_0 2024-09-12T19:13:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2034759262785178255', time=2024-09-12T21:03:37.053255+0000, chain.objs.size()=1 2024-09-12T19:13:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.456__shadow_.QA3qeMf3HWR-gmntwv33lb-tWxYXB2V_0 2024-09-12T19:13:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18408505717148857372', time=2024-09-12T21:03:43.328016+0000, chain.objs.size()=1 2024-09-12T19:13:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.462__shadow_.YcKTrKAoK_8chiMPf3kWRbAr2UQAvqQ_0 2024-09-12T19:13:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7287388414631803456', time=2024-09-12T21:03:46.853156+0000, chain.objs.size()=1 2024-09-12T19:13:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.466__shadow_.b5k5BiOhgy9LKXLBMrJLyTNW-yhIuog_0 2024-09-12T19:13:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4267662179661989913', time=2024-09-12T21:03:56.361178+0000, chain.objs.size()=1 2024-09-12T19:13:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.236+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.484__shadow_.TXnKPCJAyw8Qp5cu3-34RI3IlwqXN18_0 2024-09-12T19:13:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16497398220479722293', time=2024-09-12T21:04:03.739079+0000, chain.objs.size()=1 2024-09-12T19:13:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.495__shadow_.2mEWo2ybUlLqj9hBE7D1wOPYz-5bX2s_0 2024-09-12T19:13:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11726509014762235692', time=2024-09-12T21:04:04.513140+0000, chain.objs.size()=1 2024-09-12T19:13:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.496__shadow_.YAYpI0Cf-L6_Ax8FAlL8ovEnTCwK5hX_0 2024-09-12T19:13:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8683008906091029869', time=2024-09-12T21:04:06.670756+0000, chain.objs.size()=1 2024-09-12T19:13:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.500__shadow_.QQpOJRxs8LtgeKVEMF-d-Sgz9qWM5_g_0 2024-09-12T19:13:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15163791821165727244', time=2024-09-12T21:04:09.347414+0000, chain.objs.size()=1 2024-09-12T19:13:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.503__shadow:36QYX6qQ2gzMos2OEErLcQNuKaa5Xm._.oMtp76uo7bZ28BaGhD6Iv-dVMP_rpSx_0 2024-09-12T19:13:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10527269781755260171', time=2024-09-12T21:04:19.978107+0000, chain.objs.size()=1 2024-09-12T19:13:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.518__multipart_mymultipart.2~QRYjRLcJvuRn8Mcl0OfUFaWjyZIWVsL.1 2024-09-12T19:13:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='2~4jCfAM0AvLsTudqrmrvtjzMAXB5ClqW', time=2024-09-12T21:04:54.562110+0000, chain.objs.size()=10 2024-09-12T19:13:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.526__multipart_mymultipart.2~4jCfAM0AvLsTudqrmrvtjzMAXB5ClqW.1 2024-09-12T19:13:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.526__multipart_mymultipart.2~4jCfAM0AvLsTudqrmrvtjzMAXB5ClqW.2 2024-09-12T19:13:58.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.526__multipart_mymultipart.2~4jCfAM0AvLsTudqrmrvtjzMAXB5ClqW.3 2024-09-12T19:13:58.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.526__multipart_mymultipart.2~4jCfAM0AvLsTudqrmrvtjzMAXB5ClqW.4 2024-09-12T19:13:58.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.526__multipart_mymultipart.2~4jCfAM0AvLsTudqrmrvtjzMAXB5ClqW.5 2024-09-12T19:13:58.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.526__multipart_mymultipart.2~4jCfAM0AvLsTudqrmrvtjzMAXB5ClqW.6 2024-09-12T19:13:58.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.526__multipart_mymultipart.2~4jCfAM0AvLsTudqrmrvtjzMAXB5ClqW.7 2024-09-12T19:13:58.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.526__multipart_mymultipart.2~4jCfAM0AvLsTudqrmrvtjzMAXB5ClqW.8 2024-09-12T19:13:58.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.526__multipart_mymultipart.2~4jCfAM0AvLsTudqrmrvtjzMAXB5ClqW.9 2024-09-12T19:13:58.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.526__multipart_mymultipart.2~4jCfAM0AvLsTudqrmrvtjzMAXB5ClqW.10 2024-09-12T19:13:58.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9408657065975834782', time=2024-09-12T21:05:41.844386+0000, chain.objs.size()=1 2024-09-12T19:13:58.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.551__shadow_.wqiTQXvYAiWDScM8VTEMmnRSBZJq3CZ_0 2024-09-12T19:13:58.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7071079868109805544', time=2024-09-12T21:06:06.723496+0000, chain.objs.size()=1 2024-09-12T19:13:58.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:MdN0N8XC8bT89tq-VpV0bk16.tWxT-Q_.4IEKXzplAF3qXoy1SmOe29ZEKbDpGmf_0 2024-09-12T19:13:58.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11418986696468742712', time=2024-09-12T21:06:08.301359+0000, chain.objs.size()=1 2024-09-12T19:13:58.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.240+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:EgQg1BjVhqKmGQ3FDsej4Pl.N.iVr4T_.b8WBjWcWEn5YjI929Id8xjlXhyy5bEW_0 2024-09-12T19:13:58.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/55940 2024-09-12T19:13:58.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T19:13:58.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16122880631199951069', time=2024-09-12T21:06:09.320005+0000, chain.objs.size()=1 2024-09-12T19:13:58.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.569__shadow:194E4Cjd8YEPbqzbnFS-dajtWpH8ynr_.BvckoXR4r0wkpTFOr1kLKTeo9P4sO3R_0 2024-09-12T19:13:58.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7995603984035734571', time=2024-09-12T21:06:16.973362+0000, chain.objs.size()=1 2024-09-12T19:13:58.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.574__shadow:pBNZNS.PcTyJuwQj1a6yGbElBjRA4lX_.UcsQKsUfXJiLtNkF6V9IAlPZT3xyJEx_0 2024-09-12T19:13:58.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16824245263985805511', time=2024-09-12T21:06:25.885792+0000, chain.objs.size()=1 2024-09-12T19:13:58.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:.0VH2ii7EDD.1lIi9BYbwaUQBgCXVCr_.ELYcvYTWzwTCWNIfIQFBtaQh7EShFQh_0 2024-09-12T19:13:58.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9282867654286235975', time=2024-09-12T21:06:29.695168+0000, chain.objs.size()=1 2024-09-12T19:13:58.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:6sA9qmh6609qYcY5QkJyR-J-LBOXPA6_.TeScC-hGZhLmKeHDZocts6ldcQQSbC1_0 2024-09-12T19:13:58.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6981541423719309749', time=2024-09-12T21:06:35.846206+0000, chain.objs.size()=1 2024-09-12T19:13:58.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:b4Wu8bSHIL-vwq8DeWbdrVWWFWqFs6y_.MzIu3ISm3v0TroP9JdflMsw9GU4_iMB_0 2024-09-12T19:13:58.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12390386128013061162', time=2024-09-12T21:06:48.044188+0000, chain.objs.size()=1 2024-09-12T19:13:58.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.580__shadow:9q6P91zd0JX3R5WE-b9cYVX.o6oWBac_.8AuNbFOcdSZcUECMAZYdK6jU2NPYud5_0 2024-09-12T19:13:58.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17406732116505457764', time=2024-09-12T21:06:48.046014+0000, chain.objs.size()=1 2024-09-12T19:13:58.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.580__shadow:SoK8CGL2RvlvMgpfgvbm16iFD-nAV-u_.-memFDaAcDg4Rj0OinoQ_ucRnRnl_Rk_0 2024-09-12T19:13:58.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9667185574486422562', time=2024-09-12T21:06:59.809795+0000, chain.objs.size()=1 2024-09-12T19:13:58.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.596__shadow_.uQssq2Qqwv_m5UOkDJWBJigedJ35rp8_0 2024-09-12T19:13:58.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10763981077242333821', time=2024-09-12T21:09:26.706228+0000, chain.objs.size()=1 2024-09-12T19:13:58.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.619__shadow_.mRairrCHhggnu-5aBqBBdAiqXXTsmGF_0 2024-09-12T19:13:58.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3436961881788261166', time=2024-09-12T21:09:52.197859+0000, chain.objs.size()=2 2024-09-12T19:13:58.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.647__shadow_.aTAKont-wAFKVCSmp_9d9jWQZVImFYf_0 2024-09-12T19:13:58.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.647__shadow_.aTAKont-wAFKVCSmp_9d9jWQZVImFYf_1 2024-09-12T19:13:58.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.797616412702884129', time=2024-09-12T21:10:09.220890+0000, chain.objs.size()=1 2024-09-12T19:13:58.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.244+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.666__shadow_.Zgjoq8PYcU5tX6-L3D3IA7Pa0d7y7b__0 2024-09-12T19:13:58.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.248+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10316003235582155811', time=2024-09-12T21:10:31.908521+0000, chain.objs.size()=1 2024-09-12T19:13:58.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.248+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.702__multipart_file1.2~sb4GWo3Itnq3dqKLCDGtbBtk0gf7du4.1 2024-09-12T19:13:58.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.248+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12010386893501656414', time=2024-09-12T21:10:37.587681+0000, chain.objs.size()=1 2024-09-12T19:13:58.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.248+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.710__shadow:9xJKxkR1rci8czKEqAypEiGJgFBohT9_.ezP6JyINPASe-IUkBzL_fzW87PXL4Zl_0 2024-09-12T19:13:58.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.248+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:58.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T19:13:58.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:58.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:58.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=98, truncated=0, next_marker='' 2024-09-12T19:13:58.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5730244937173049220', time=2024-09-12T20:57:25.147744+0000, chain.objs.size()=1 2024-09-12T19:13:58.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.151__shadow_.HpA9ojkTaq9FgJQjV_rFMyI5_NHWXwX_0 2024-09-12T19:13:58.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='_GgSnUMq8ij0D9jJLClqchwNDtnDmgYe', time=2024-09-12T20:57:33.222450+0000, chain.objs.size()=3 2024-09-12T19:13:58.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.z92ULyC6JHPMcMkrXPyR7MpnKRJuvUr_0 2024-09-12T19:13:58.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.z92ULyC6JHPMcMkrXPyR7MpnKRJuvUr_1 2024-09-12T19:13:58.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.160__shadow_.z92ULyC6JHPMcMkrXPyR7MpnKRJuvUr_2 2024-09-12T19:13:58.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1615483361686219003', time=2024-09-12T20:59:58.865237+0000, chain.objs.size()=1 2024-09-12T19:13:58.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.243__shadow_.2rN23Z3NZ4wbEt2qcjSR4WTa7jcHP1L_0 2024-09-12T19:13:58.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13668358770698114747', time=2024-09-12T20:59:58.867882+0000, chain.objs.size()=1 2024-09-12T19:13:58.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.243__shadow_.EVaJUVRAd_ZCmSN207_fInRH7igi1XT_0 2024-09-12T19:13:58.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10848792961182992681', time=2024-09-12T21:00:00.078880+0000, chain.objs.size()=1 2024-09-12T19:13:58.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.244__shadow_.hUEmOH5HOi52Q1UQ3H3uSTiof6TAFZU_0 2024-09-12T19:13:58.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9975399342828305641', time=2024-09-12T21:00:07.379055+0000, chain.objs.size()=1 2024-09-12T19:13:58.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.254__shadow_.59K6d8HINq8tXpfE6MYuseIpLnbDH5p_0 2024-09-12T19:13:58.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15094599734525911860', time=2024-09-12T21:00:09.555349+0000, chain.objs.size()=1 2024-09-12T19:13:58.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.257__shadow_.cqrJpthB27Z5JW0TUP3NhwKdmeTEteK_0 2024-09-12T19:13:58.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1060247224756592662', time=2024-09-12T21:00:32.235694+0000, chain.objs.size()=1 2024-09-12T19:13:58.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.8KrA_o7Nwpcs1MhMXLL-R-dJF_8Y60U_0 2024-09-12T19:13:58.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11851859125169133395', time=2024-09-12T21:00:32.283276+0000, chain.objs.size()=1 2024-09-12T19:13:58.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.RHyjWFqLOCkwQq9B-GUJSXTj_YqNcYy_0 2024-09-12T19:13:58.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10807190714814755963', time=2024-09-12T21:00:32.447575+0000, chain.objs.size()=1 2024-09-12T19:13:58.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.252+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.gvhfI37umrlC46dssvHZtMqi-GiR9xS_0 2024-09-12T19:13:58.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9341722193439797163', time=2024-09-12T21:00:32.454309+0000, chain.objs.size()=1 2024-09-12T19:13:58.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.trlb6VqgdQ8P9cor0L1EgP_MTSnhO5Q_0 2024-09-12T19:13:58.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13699453716111772172', time=2024-09-12T21:00:32.500143+0000, chain.objs.size()=1 2024-09-12T19:13:58.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Ux7msrL0gAdgh8mNo2leBkOa1itwisf_0 2024-09-12T19:13:58.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.174715027595602186', time=2024-09-12T21:00:32.506303+0000, chain.objs.size()=1 2024-09-12T19:13:58.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sd7QDmJUlG5-a0IOiSV6Eajev5TXkBH_0 2024-09-12T19:13:58.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15581973532128807618', time=2024-09-12T21:00:32.549356+0000, chain.objs.size()=1 2024-09-12T19:13:58.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.EynUwhPl7uVSd1seTuAXVfhbWZugVUE_0 2024-09-12T19:13:58.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2897642601602157691', time=2024-09-12T21:00:32.564455+0000, chain.objs.size()=1 2024-09-12T19:13:58.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3Ckb4OmD1A9Aae8WMIaSq5dFQBt-COL_0 2024-09-12T19:13:58.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5332288110597508506', time=2024-09-12T21:00:32.711442+0000, chain.objs.size()=1 2024-09-12T19:13:58.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.eM-9ETRiF7wQyAtafg5Flo4t6y3uOQc_0 2024-09-12T19:13:58.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5298479409663718722', time=2024-09-12T21:00:32.719676+0000, chain.objs.size()=1 2024-09-12T19:13:58.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.BWpSfU-VWZm_vyxRQUDehcYJF8VWxCd_0 2024-09-12T19:13:58.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18107803986997039269', time=2024-09-12T21:00:32.729920+0000, chain.objs.size()=1 2024-09-12T19:13:58.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.7WrqJqcvgupjGz7ulWdVANk4ZC7H6Ro_0 2024-09-12T19:13:58.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14448148193724446171', time=2024-09-12T21:00:32.956173+0000, chain.objs.size()=1 2024-09-12T19:13:58.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.vXHJwP98ClHAYZLX8lYZwj6nyg9rbVI_0 2024-09-12T19:13:58.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14904099970857173533', time=2024-09-12T21:00:32.985172+0000, chain.objs.size()=1 2024-09-12T19:13:58.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XmHaERSTKa4-TETariCRPaqGXjWq3t9_0 2024-09-12T19:13:58.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8177512773074246703', time=2024-09-12T21:00:33.109669+0000, chain.objs.size()=1 2024-09-12T19:13:58.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.wLVIYLLt8rV6LN2-6gSL7vwV4NYYyn2_0 2024-09-12T19:13:58.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17659155450880332599', time=2024-09-12T21:00:33.139685+0000, chain.objs.size()=1 2024-09-12T19:13:58.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.256+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.4-i89ay808N5FOLaY1ky5Kq7ZBRdMPQ_0 2024-09-12T19:13:58.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10896291498612879940', time=2024-09-12T21:00:33.143775+0000, chain.objs.size()=1 2024-09-12T19:13:58.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.vnrIvR5CWHhtXT1XuyuW3wnaoWcWZZY_0 2024-09-12T19:13:58.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6070596451378628312', time=2024-09-12T21:00:33.167495+0000, chain.objs.size()=1 2024-09-12T19:13:58.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.4DihCypTqVtKqcsTArjJ6EotjEFT1OT_0 2024-09-12T19:13:58.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2443337033891787375', time=2024-09-12T21:00:33.186397+0000, chain.objs.size()=1 2024-09-12T19:13:58.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ef6-YSG6MLZLFd5G1CcPHitNHbSp4xD_0 2024-09-12T19:13:58.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2078516250978093743', time=2024-09-12T21:00:33.373433+0000, chain.objs.size()=1 2024-09-12T19:13:58.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.d-rvhIr8y2k7Lso7PHUz2Eofm7jqd7G_0 2024-09-12T19:13:58.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15358875519041699705', time=2024-09-12T21:00:33.382554+0000, chain.objs.size()=1 2024-09-12T19:13:58.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3DA3bxfFKBpCNPdX6FE0egTurNstO_I_0 2024-09-12T19:13:58.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1134896554580410937', time=2024-09-12T21:00:33.396574+0000, chain.objs.size()=1 2024-09-12T19:13:58.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.1CH8r8KUriNaNiw4Lc9y7Lem5ysMR46_0 2024-09-12T19:13:58.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5100505695872949827', time=2024-09-12T21:00:33.443086+0000, chain.objs.size()=1 2024-09-12T19:13:58.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.YjAVDHyY8zEgmNPQky38ON6vZDbYgwI_0 2024-09-12T19:13:58.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1235894675573933336', time=2024-09-12T21:00:33.477980+0000, chain.objs.size()=1 2024-09-12T19:13:58.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.SiNZiGvf-5tF5DaADuZaN7LeQ-VkJll_0 2024-09-12T19:13:58.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4711723081428198737', time=2024-09-12T21:00:33.612184+0000, chain.objs.size()=1 2024-09-12T19:13:58.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.lDg82ETgLfT7Z-U-ZKmdsu9zYNwwIgT_0 2024-09-12T19:13:58.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12497214025536703333', time=2024-09-12T21:00:33.613453+0000, chain.objs.size()=1 2024-09-12T19:13:58.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.xgUSTzlIo6HeYOj31Ni7-rGsYF7OVqS_0 2024-09-12T19:13:58.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9460558726664798581', time=2024-09-12T21:00:33.632935+0000, chain.objs.size()=1 2024-09-12T19:13:58.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.hVCmcSoj10Uz49yWb_xzxybc4Ow8ZUH_0 2024-09-12T19:13:58.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14407656028995423725', time=2024-09-12T21:00:33.903302+0000, chain.objs.size()=1 2024-09-12T19:13:58.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.PDwXYJiMwy6AVFYKsD_gQN504Ua-V7H_0 2024-09-12T19:13:58.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15244354364354765700', time=2024-09-12T21:00:39.603004+0000, chain.objs.size()=1 2024-09-12T19:13:58.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.270__shadow_.pIDsf6hgEQwLRqSG51BFxpkUM1kkq6U_0 2024-09-12T19:13:58.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8991257268517727131', time=2024-09-12T21:00:41.002730+0000, chain.objs.size()=1 2024-09-12T19:13:58.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.272__shadow_.H4MvVpKjdVjduvAbxDCi6H6ZmnbOISF_0 2024-09-12T19:13:58.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5837994952063755932', time=2024-09-12T21:00:54.255265+0000, chain.objs.size()=1 2024-09-12T19:13:58.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.290__shadow_.1UulFe0-4IbFuqcETvHrm8Nt1miM_8-_0 2024-09-12T19:13:58.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2354587697132815466', time=2024-09-12T21:00:56.710819+0000, chain.objs.size()=1 2024-09-12T19:13:58.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.ji9wvQbLNHlx2yj6iUn852JS8vnAo0y_0 2024-09-12T19:13:58.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2853024006162441843', time=2024-09-12T21:00:56.746265+0000, chain.objs.size()=1 2024-09-12T19:13:58.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.0REOSVGjacUl1hkPWKraRxQiohv9i88_0 2024-09-12T19:13:58.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12229018288183777130', time=2024-09-12T21:01:01.755434+0000, chain.objs.size()=1 2024-09-12T19:13:58.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.260+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.298__shadow_._LatBNgKdCXh9T9CX1AG3ymVDsu3NXP_0 2024-09-12T19:13:58.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5448688719026017599', time=2024-09-12T21:01:07.968684+0000, chain.objs.size()=1 2024-09-12T19:13:58.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.306__shadow_.8JvORZeUGL3JuGYlxWqZsOVVHKD95y3_0 2024-09-12T19:13:58.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7335023741398062262', time=2024-09-12T21:01:39.404354+0000, chain.objs.size()=1 2024-09-12T19:13:58.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.uhY4Q7aUex_aOYDaorL1Bjc9gIetsT-_0 2024-09-12T19:13:58.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12934424083027338156', time=2024-09-12T21:01:39.434610+0000, chain.objs.size()=1 2024-09-12T19:13:58.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-GHHbbdz9CEiUjkVNwqhqhWAfufCnsi_0 2024-09-12T19:13:58.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17605677709543804922', time=2024-09-12T21:01:39.557250+0000, chain.objs.size()=1 2024-09-12T19:13:58.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.vamQ_hIQZDqJEWgHMEQ4L8wpR6QMnef_0 2024-09-12T19:13:58.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2539677580740041817', time=2024-09-12T21:01:39.689573+0000, chain.objs.size()=1 2024-09-12T19:13:58.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hJHfWf7HLzC9TsjLvyWtSJHI-RQZ1rJ_0 2024-09-12T19:13:58.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1397614497169982233', time=2024-09-12T21:01:39.694753+0000, chain.objs.size()=1 2024-09-12T19:13:58.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.zvpw6ZGrrIHhAoBl-yBNHvywhA91V7L_0 2024-09-12T19:13:58.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5326680069931679149', time=2024-09-12T21:01:39.711213+0000, chain.objs.size()=1 2024-09-12T19:13:58.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ir3JYrhHzV5Nhj2Ttqt6HGHt8pmkppr_0 2024-09-12T19:13:58.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5738475307822191755', time=2024-09-12T21:01:39.921419+0000, chain.objs.size()=1 2024-09-12T19:13:58.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.xYSHp_b75q80V3rqdQwQpRyiboeKF68_0 2024-09-12T19:13:58.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4195589581944366267', time=2024-09-12T21:01:39.952841+0000, chain.objs.size()=1 2024-09-12T19:13:58.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.LRD4_fReEeHX_yfecNmBwMkAFKvDw3Z_0 2024-09-12T19:13:58.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.160337542126899616', time=2024-09-12T21:01:40.005672+0000, chain.objs.size()=1 2024-09-12T19:13:58.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.IvRyVklu3Syn9zi177_E4-hnkkapTjh_0 2024-09-12T19:13:58.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6524139819638167638', time=2024-09-12T21:01:40.015225+0000, chain.objs.size()=1 2024-09-12T19:13:58.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.jrd_X1SYRJW5YDYpz_AYGH4XWZkAmY9_0 2024-09-12T19:13:58.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17509850782526428555', time=2024-09-12T21:01:40.152185+0000, chain.objs.size()=1 2024-09-12T19:13:58.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.a-oXpHiL4FOaraGGFF-QLZ_eP4rReKF_0 2024-09-12T19:13:58.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10572805520950991412', time=2024-09-12T21:01:40.188228+0000, chain.objs.size()=1 2024-09-12T19:13:58.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.jRxma1sZc07PXR3OftIfmr96yZukUdM_0 2024-09-12T19:13:58.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14697310033261130114', time=2024-09-12T21:01:40.333287+0000, chain.objs.size()=1 2024-09-12T19:13:58.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.IRBM9kZj8tiQNVyAvhRseT0zV2yYtMi_0 2024-09-12T19:13:58.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4055675258756860385', time=2024-09-12T21:01:40.665810+0000, chain.objs.size()=1 2024-09-12T19:13:58.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.-5qr9IwsnFfyB2C3WL0X3Z41ml_ukXs_0 2024-09-12T19:13:58.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12566570529106218109', time=2024-09-12T21:01:40.785180+0000, chain.objs.size()=1 2024-09-12T19:13:58.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.II5S-8BU1yYAJVcQwEjeecDCCov4RMZ_0 2024-09-12T19:13:58.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13833756012872624735', time=2024-09-12T21:01:40.804262+0000, chain.objs.size()=1 2024-09-12T19:13:58.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mVMTID5UToQadnNqjUerR6zKGiW3E6w_0 2024-09-12T19:13:58.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18122061517385438165', time=2024-09-12T21:01:40.989511+0000, chain.objs.size()=1 2024-09-12T19:13:58.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.264+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.C53tSowjWtujJM3hYONsgYCXu6j2lF7_0 2024-09-12T19:13:58.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17357481609550904115', time=2024-09-12T21:01:41.012818+0000, chain.objs.size()=1 2024-09-12T19:13:58.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ZiHQPHr-khwaiJxYlohGUV3CPA_7wh0_0 2024-09-12T19:13:58.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5853971620989895754', time=2024-09-12T21:01:41.022566+0000, chain.objs.size()=1 2024-09-12T19:13:58.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.tV36dY6RhGn8t-_hlQRekob_ln7CO2H_0 2024-09-12T19:13:58.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3460937257604675695', time=2024-09-12T21:01:41.059544+0000, chain.objs.size()=1 2024-09-12T19:13:58.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DxK6bJ6HF8L5k17824yiw9PtXGVzibq_0 2024-09-12T19:13:58.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8473275660208948368', time=2024-09-12T21:01:41.074620+0000, chain.objs.size()=1 2024-09-12T19:13:58.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.KmRWm7cBGhbttpHl03QepWpIWyZdKsi_0 2024-09-12T19:13:58.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6275794013093670489', time=2024-09-12T21:02:00.581272+0000, chain.objs.size()=1 2024-09-12T19:13:58.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.tLNyot3O4GFh1x-yiE8rcURngsBJFOV_0 2024-09-12T19:13:58.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15495370699382743159', time=2024-09-12T21:02:00.597602+0000, chain.objs.size()=1 2024-09-12T19:13:58.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.iwvqoVT18MA-Yg6CmfUejOwezCrBfcu_0 2024-09-12T19:13:58.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15124503457143222055', time=2024-09-12T21:02:00.773224+0000, chain.objs.size()=1 2024-09-12T19:13:58.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.mrn41QWXltQZc5tJTg0lPLpqdsf2PDr_0 2024-09-12T19:13:58.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13139867305909217621', time=2024-09-12T21:02:00.833152+0000, chain.objs.size()=1 2024-09-12T19:13:58.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.oOcAhdaskyImL96_iY9Qx-xuRtkCJvF_0 2024-09-12T19:13:58.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12593472655980178090', time=2024-09-12T21:02:00.859282+0000, chain.objs.size()=1 2024-09-12T19:13:58.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yqgFN7NBrw1IJa7vaz-ODVVTIa7Ql5w_0 2024-09-12T19:13:58.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10009591825715568314', time=2024-09-12T21:02:00.864709+0000, chain.objs.size()=1 2024-09-12T19:13:58.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NTHyEofUwgveA2-aCiu14PSZspPMF9k_0 2024-09-12T19:13:58.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5546788032237872176', time=2024-09-12T21:02:01.046377+0000, chain.objs.size()=1 2024-09-12T19:13:58.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.msfT3qjYdidBo9amupeWOJ4XYko6l2J_0 2024-09-12T19:13:58.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9140566566882607843', time=2024-09-12T21:02:01.063006+0000, chain.objs.size()=1 2024-09-12T19:13:58.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.652i8isY7HrA11qXdrf4Inn9qr7Sv_D_0 2024-09-12T19:13:58.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2577837411799423752', time=2024-09-12T21:02:01.108568+0000, chain.objs.size()=1 2024-09-12T19:13:58.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NtI9S7TWAAvBDna2QcMDyWyreB0NVxo_0 2024-09-12T19:13:58.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1498328613376079029', time=2024-09-12T21:02:01.113401+0000, chain.objs.size()=1 2024-09-12T19:13:58.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.DKSeCmuWt565SYzl8XXgN2k7vI7tLjk_0 2024-09-12T19:13:58.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9045286389185581176', time=2024-09-12T21:02:01.313541+0000, chain.objs.size()=1 2024-09-12T19:13:58.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.58L3Z_sfVLdeI4IlOcTIviQbueP3Awy_0 2024-09-12T19:13:58.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17932969672193774292', time=2024-09-12T21:02:01.338703+0000, chain.objs.size()=1 2024-09-12T19:13:58.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8gxNBGWt_nCBPbJdLOU191oFfNnPZjI_0 2024-09-12T19:13:58.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13183796673963495419', time=2024-09-12T21:02:01.349462+0000, chain.objs.size()=1 2024-09-12T19:13:58.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.42wm03RjoWx5BFTCgMtoFfgEdyimafo_0 2024-09-12T19:13:58.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5294270830618196711', time=2024-09-12T21:02:01.471121+0000, chain.objs.size()=1 2024-09-12T19:13:58.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.d-E4WMOw9SDdXgyfO3ZA5fTOBFwkb64_0 2024-09-12T19:13:58.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15459293063287719942', time=2024-09-12T21:02:01.501212+0000, chain.objs.size()=1 2024-09-12T19:13:58.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.llf8ruFExOi9fMkEEerfgJxtxg4hWXT_0 2024-09-12T19:13:58.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2339511515949177569', time=2024-09-12T21:02:01.510679+0000, chain.objs.size()=1 2024-09-12T19:13:58.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.knpjzPKfhBvCSYMFAFBcOvM7d_atBpG_0 2024-09-12T19:13:58.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8172541335295254631', time=2024-09-12T21:02:01.513721+0000, chain.objs.size()=1 2024-09-12T19:13:58.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.268+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.d8Hk9O85fdg9y0nv-k6Fh5BqI-xVpbk_0 2024-09-12T19:13:58.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10209742499370685911', time=2024-09-12T21:02:01.514443+0000, chain.objs.size()=1 2024-09-12T19:13:58.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qRk2WHa0GZJ_RTkXwK7bK0q_dAkVEEE_0 2024-09-12T19:13:58.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10359197982386420045', time=2024-09-12T21:02:01.533925+0000, chain.objs.size()=1 2024-09-12T19:13:58.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.cN2SaUMogjywkpGpWwwaUi1aAfykpB3_0 2024-09-12T19:13:58.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8377400438053867678', time=2024-09-12T21:02:01.732998+0000, chain.objs.size()=1 2024-09-12T19:13:58.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Vs8WP3j7FMC1e1QWtOrrz6gOO23QOQB_0 2024-09-12T19:13:58.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.523406516578460833', time=2024-09-12T21:02:01.898034+0000, chain.objs.size()=1 2024-09-12T19:13:58.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.sNfCrxP_KK8lyanmiGzyr0tXJAk723o_0 2024-09-12T19:13:58.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17658545650946666013', time=2024-09-12T21:02:01.927617+0000, chain.objs.size()=1 2024-09-12T19:13:58.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.W9PrPvDyFPbFmJX2RqWh31kK1v202te_0 2024-09-12T19:13:58.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13279652912214554783', time=2024-09-12T21:02:02.159819+0000, chain.objs.size()=1 2024-09-12T19:13:58.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Tm2SNuRRyFQtyH0Y-GVa_ff6T-mcdX2_0 2024-09-12T19:13:58.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2682104520260217560', time=2024-09-12T21:02:02.190109+0000, chain.objs.size()=1 2024-09-12T19:13:58.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.oQPA32Lf7sFoU3VQlEX3IeShNYFizIl_0 2024-09-12T19:13:58.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3331385800933781685', time=2024-09-12T21:02:02.207991+0000, chain.objs.size()=1 2024-09-12T19:13:58.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.xeGtU_IuysdB8SfrpSyGeROYmS2MNZF_0 2024-09-12T19:13:58.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6011691591994469234', time=2024-09-12T21:03:27.005731+0000, chain.objs.size()=1 2024-09-12T19:13:58.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.444__shadow_.U3Yt1tl7eegftOYCQzaSXD9XyV0SQDF_0 2024-09-12T19:13:58.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7859821309985022881', time=2024-09-12T21:04:05.663910+0000, chain.objs.size()=1 2024-09-12T19:13:58.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.498__shadow_.-d2IlDd6FdjP3Mc2PBX5BPHm7DMU4jX_0 2024-09-12T19:13:58.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5725451413364103645', time=2024-09-12T21:04:13.157875+0000, chain.objs.size()=6 2024-09-12T19:13:58.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.1 2024-09-12T19:13:58.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.2 2024-09-12T19:13:58.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.3 2024-09-12T19:13:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.4 2024-09-12T19:13:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.5 2024-09-12T19:13:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.507__multipart_srcmultipart.2~pEjTRS-cvKn5hk3H98WhUT61in35qU5.6 2024-09-12T19:13:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7120791445559152358', time=2024-09-12T21:04:18.482908+0000, chain.objs.size()=1 2024-09-12T19:13:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.516__multipart_mymultipartcopy.2~32IicO-druE2K_g6MPxRZbFA3kqo_3q.1 2024-09-12T19:13:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17396426835213509893', time=2024-09-12T21:04:47.602361+0000, chain.objs.size()=1 2024-09-12T19:13:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.523__multipart_mymultipart.2~MvbQh7w8SWIYoCpaMXqpArhIcYmHHjy.1 2024-09-12T19:13:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9623459572577560217', time=2024-09-12T21:06:46.426764+0000, chain.objs.size()=1 2024-09-12T19:13:58.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.579__shadow:QV-YQmxSNd7h9yMdFbLgK8usUEwwsHX_.YPlg2GFzjEX0nC1NE_5R-vAlB_ubVeH_0 2024-09-12T19:13:58.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6118703126576848341', time=2024-09-12T21:06:53.087397+0000, chain.objs.size()=1 2024-09-12T19:13:58.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.272+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.586__shadow:9vkNnRII.vfR8DDhXi8wBII7XOeu932_.YHx5BMC1CDPX3lfS2xzZDDP0VPl7JaS_0 2024-09-12T19:13:58.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15974278412391774196', time=2024-09-12T21:09:37.245946+0000, chain.objs.size()=1 2024-09-12T19:13:58.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.627__shadow_.Y3A3tRgDbT5uZvFVHI7K53nxljGI17T_0 2024-09-12T19:13:58.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14821107868062985444', time=2024-09-12T21:09:43.757769+0000, chain.objs.size()=1 2024-09-12T19:13:58.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.636__shadow_.-XTf-BZGZKzSoeDgYwwMGE1J9g2K3IB_0 2024-09-12T19:13:58.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11736963373388147176', time=2024-09-12T21:11:14.679046+0000, chain.objs.size()=20 2024-09-12T19:13:58.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__multipart_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.1 2024-09-12T19:13:58.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__shadow_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.1_1 2024-09-12T19:13:58.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__multipart_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.2 2024-09-12T19:13:58.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__shadow_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.2_1 2024-09-12T19:13:58.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__multipart_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.3 2024-09-12T19:13:58.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__shadow_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.3_1 2024-09-12T19:13:58.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__multipart_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.4 2024-09-12T19:13:58.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__shadow_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.4_1 2024-09-12T19:13:58.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__multipart_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.5 2024-09-12T19:13:58.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.276+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__shadow_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.5_1 2024-09-12T19:13:58.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__multipart_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.6 2024-09-12T19:13:58.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__shadow_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.6_1 2024-09-12T19:13:58.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__multipart_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.7 2024-09-12T19:13:58.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__shadow_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.7_1 2024-09-12T19:13:58.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__multipart_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.8 2024-09-12T19:13:58.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__shadow_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.8_1 2024-09-12T19:13:58.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__multipart_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.9 2024-09-12T19:13:58.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__shadow_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.9_1 2024-09-12T19:13:58.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__multipart_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.10 2024-09-12T19:13:58.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.735__shadow_foo.2~MLu5i2p6y3cVPsO2-Ru2pyBlcekCsvX.10_1 2024-09-12T19:13:58.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.280+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4334487634902429923', time=2024-09-12T21:11:18.114076+0000, chain.objs.size()=1 2024-09-12T19:13:58.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.280+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.740__shadow_.9i1WDCESQHwPSxso-ReI1Nczeo7TXhB_0 2024-09-12T19:13:58.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.284+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:58.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.288+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T19:13:58.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.288+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:58.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.288+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:58.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53461' 2024-09-12T19:13:58.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15067055988204056386', time=2024-09-12T20:59:48.691752+0000, chain.objs.size()=1 2024-09-12T19:13:58.294 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.231__shadow_.hKwPKCGfcN6tseXA6Z0--BrtaUaChV2_0 2024-09-12T19:13:58.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18304969675824827413', time=2024-09-12T20:59:51.618852+0000, chain.objs.size()=1 2024-09-12T19:13:58.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.235__shadow_.IFPsnJvqTYR5CXAOBvWuwWLS4bycVn5_0 2024-09-12T19:13:58.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3433074828658079574', time=2024-09-12T21:00:06.676169+0000, chain.objs.size()=1 2024-09-12T19:13:58.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.253__shadow_.dqPK6El5QzH954LCI8AcAJaYM8pki7d_0 2024-09-12T19:13:58.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17413216195621131641', time=2024-09-12T21:00:32.015020+0000, chain.objs.size()=1 2024-09-12T19:13:58.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.59DaW0JpLXnwk6tr8smo3aWlni7iqF8_0 2024-09-12T19:13:58.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15771532108626458764', time=2024-09-12T21:00:32.061830+0000, chain.objs.size()=1 2024-09-12T19:13:58.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.zTfH3gw-V5rKH_0_11aYjstmw5AgbGv_0 2024-09-12T19:13:58.295 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7607224118268474072', time=2024-09-12T21:00:32.094191+0000, chain.objs.size()=1 2024-09-12T19:13:58.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.yq8M-Jt9dEFm44mxKd6V4VZ08sgVET1_0 2024-09-12T19:13:58.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13706514113481549912', time=2024-09-12T21:00:32.230094+0000, chain.objs.size()=1 2024-09-12T19:13:58.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.EMyhpZscLvyadLmOswUVWSFmnvznVd1_0 2024-09-12T19:13:58.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10145132566660229124', time=2024-09-12T21:00:32.291302+0000, chain.objs.size()=1 2024-09-12T19:13:58.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.FLC15hpymzpX5Wnw_snncEswNC5aT9m_0 2024-09-12T19:13:58.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9189037958525262221', time=2024-09-12T21:00:32.308985+0000, chain.objs.size()=1 2024-09-12T19:13:58.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.bAMrbKwTU2jOjbQ17BfjeKCTsG9Jh9A_0 2024-09-12T19:13:58.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15084659813928551044', time=2024-09-12T21:00:32.321225+0000, chain.objs.size()=1 2024-09-12T19:13:58.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.W8JU2gq_2IGOE-doktx0CYOo3ZEjTwv_0 2024-09-12T19:13:58.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9095125025646746994', time=2024-09-12T21:00:32.347227+0000, chain.objs.size()=1 2024-09-12T19:13:58.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.9NXc7JDnL76ehZOXj1BbYkNLMzOftZ8_0 2024-09-12T19:13:58.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9311598923261158160', time=2024-09-12T21:00:32.460006+0000, chain.objs.size()=1 2024-09-12T19:13:58.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3FxVNdoPZCznA37O0UMuDYEv2DHNH6l_0 2024-09-12T19:13:58.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.252277078856523270', time=2024-09-12T21:00:32.484513+0000, chain.objs.size()=1 2024-09-12T19:13:58.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LToiZixftKyseJr8PUQr6w4-YEyqDdS_0 2024-09-12T19:13:58.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16727433390180611182', time=2024-09-12T21:00:32.485530+0000, chain.objs.size()=1 2024-09-12T19:13:58.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.DWQbPdZXOOKsYepuQBDP82yk_rNtIYw_0 2024-09-12T19:13:58.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1811276877181972878', time=2024-09-12T21:00:32.502651+0000, chain.objs.size()=1 2024-09-12T19:13:58.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.15NGUelQYyiaUCf04ZGyOjxqCkjRmsT_0 2024-09-12T19:13:58.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.489842469633812686', time=2024-09-12T21:00:32.538428+0000, chain.objs.size()=1 2024-09-12T19:13:58.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.naYh-SeXtYm4x6luiPe4lSIWrF1Iv7d_0 2024-09-12T19:13:58.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16410189210633255459', time=2024-09-12T21:00:32.543212+0000, chain.objs.size()=1 2024-09-12T19:13:58.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.mCjy20kFNgmGXv2B21aLUJHIdt2WRnD_0 2024-09-12T19:13:58.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7239513585730006566', time=2024-09-12T21:00:32.557809+0000, chain.objs.size()=1 2024-09-12T19:13:58.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.y2CAJn5Sc7RYkn09_VNECxvl-_mClUJ_0 2024-09-12T19:13:58.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17133762292370186089', time=2024-09-12T21:00:32.659390+0000, chain.objs.size()=1 2024-09-12T19:13:58.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.292+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.OVfMJCiLJ642vTsLZ9zNhlFusNyuErK_0 2024-09-12T19:13:58.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1959992945726682352', time=2024-09-12T21:00:32.661814+0000, chain.objs.size()=1 2024-09-12T19:13:58.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.YIlJ8Ll7kZVdt8FDQtPbfbSfjJTqICz_0 2024-09-12T19:13:58.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15611125558720002446', time=2024-09-12T21:00:32.667947+0000, chain.objs.size()=1 2024-09-12T19:13:58.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.REhzUkkt6q_FTr57dWTkN4-zwo5am0H_0 2024-09-12T19:13:58.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16754898383365837434', time=2024-09-12T21:00:32.717967+0000, chain.objs.size()=1 2024-09-12T19:13:58.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.18WWSiyloKUEI0zUlEcrJyDCeLP5GTn_0 2024-09-12T19:13:58.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.320590526423445551', time=2024-09-12T21:00:32.749273+0000, chain.objs.size()=1 2024-09-12T19:13:58.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.msQKjQAzE1it3ZTYYmcLqenI2hYxUMG_0 2024-09-12T19:13:58.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14245735839164591763', time=2024-09-12T21:00:32.757772+0000, chain.objs.size()=1 2024-09-12T19:13:58.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.mQdYGrZoaBC67kZ4wXf4NF6MImaK1wD_0 2024-09-12T19:13:58.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14379268869050622513', time=2024-09-12T21:00:32.758474+0000, chain.objs.size()=1 2024-09-12T19:13:58.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.9JKIMpr5xmBcK1T15dTDMk0ndfoiJrq_0 2024-09-12T19:13:58.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10888253853244408243', time=2024-09-12T21:00:32.774889+0000, chain.objs.size()=1 2024-09-12T19:13:58.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.zS2wNy5lsXrV4DC9Uk_2Y4sT0r7PznJ_0 2024-09-12T19:13:58.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2735989230112625973', time=2024-09-12T21:00:32.874497+0000, chain.objs.size()=1 2024-09-12T19:13:58.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.PmIEbsdFul-FzX43EbRutaEajgidLYS_0 2024-09-12T19:13:58.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2425195467611343352', time=2024-09-12T21:00:32.942493+0000, chain.objs.size()=1 2024-09-12T19:13:58.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3sHm6zIB3UPaJ4D3cSbKtSvnHDZaGKm_0 2024-09-12T19:13:58.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15528364421747068572', time=2024-09-12T21:00:32.946628+0000, chain.objs.size()=1 2024-09-12T19:13:58.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.0EZ_Xxauk8buEatN3ABvTNapJki5paQ_0 2024-09-12T19:13:58.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4856864040611045752', time=2024-09-12T21:00:32.961566+0000, chain.objs.size()=1 2024-09-12T19:13:58.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Hc1KTBq-A6e6xi6yLbLJXgcyqEJ03h3_0 2024-09-12T19:13:58.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.351263653355606551', time=2024-09-12T21:00:32.981811+0000, chain.objs.size()=1 2024-09-12T19:13:58.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.jfcvBiFGpzcOcxSphdO0gjprx76Mls3_0 2024-09-12T19:13:58.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11652224547412899376', time=2024-09-12T21:00:32.990863+0000, chain.objs.size()=1 2024-09-12T19:13:58.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.n3Z-8HwrYnB13bUYoB8fbkhc68oW5oh_0 2024-09-12T19:13:58.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6438507433756879291', time=2024-09-12T21:00:33.126562+0000, chain.objs.size()=1 2024-09-12T19:13:58.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.THaEb73CaDPAid_RM698KLwDT78K6ok_0 2024-09-12T19:13:58.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4445103422575319152', time=2024-09-12T21:00:33.144540+0000, chain.objs.size()=1 2024-09-12T19:13:58.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ENFXj3_XVpUkItG7O_1WU9gnk6NcjIB_0 2024-09-12T19:13:58.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11285502094865444371', time=2024-09-12T21:00:33.156164+0000, chain.objs.size()=1 2024-09-12T19:13:58.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JGJIOTC7hq_XUoOViHsAbqKyfTeGSih_0 2024-09-12T19:13:58.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5647043506772204956', time=2024-09-12T21:00:33.214624+0000, chain.objs.size()=1 2024-09-12T19:13:58.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.xK2IAH7oT-UiTMX3vAPTWZsoFyVbP03_0 2024-09-12T19:13:58.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6767776056756428794', time=2024-09-12T21:00:33.366654+0000, chain.objs.size()=1 2024-09-12T19:13:58.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.fO-uI4TNJ1Pz9brAv-SS-uY8C97oJ60_0 2024-09-12T19:13:58.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7674945852150528127', time=2024-09-12T21:00:33.444130+0000, chain.objs.size()=1 2024-09-12T19:13:58.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.zdoJGais8g91eC28Q-DgmU78pbimrz7_0 2024-09-12T19:13:58.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14443209975629961556', time=2024-09-12T21:00:33.465738+0000, chain.objs.size()=1 2024-09-12T19:13:58.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.BN26czARhz7tnX7LEr1DaxUeRy9TDVh_0 2024-09-12T19:13:58.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6369732819057660266', time=2024-09-12T21:00:33.471223+0000, chain.objs.size()=1 2024-09-12T19:13:58.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.wUfscCF8d5XmvhI9lNxItcK2jyTzvTI_0 2024-09-12T19:13:58.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10184716117505018687', time=2024-09-12T21:00:33.490800+0000, chain.objs.size()=1 2024-09-12T19:13:58.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.296+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.eIxZ8iWEba7mcxEKgAC2d1irX1yG4Nf_0 2024-09-12T19:13:58.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17052249903288233956', time=2024-09-12T21:00:33.586495+0000, chain.objs.size()=1 2024-09-12T19:13:58.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.TD0BChBTcHCgktEFD-y5SZW6FtTzh9o_0 2024-09-12T19:13:58.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6674263437289873650', time=2024-09-12T21:00:33.588157+0000, chain.objs.size()=1 2024-09-12T19:13:58.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.kGiMKvGo6Pjfzy9oc0rxBd0KFS7XGlb_0 2024-09-12T19:13:58.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18148899625123393763', time=2024-09-12T21:00:36.710843+0000, chain.objs.size()=1 2024-09-12T19:13:58.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.266__shadow_.7Z4jaYhEqDjFKYCKSqiKhff1Aiz5Tjy_0 2024-09-12T19:13:58.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18168286365854082541', time=2024-09-12T21:00:47.583455+0000, chain.objs.size()=1 2024-09-12T19:13:58.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.281__shadow_.cgsKosDKNaTcMswJILmzHQwADI3x2zV_0 2024-09-12T19:13:58.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8582300300371095471', time=2024-09-12T21:00:58.119258+0000, chain.objs.size()=1 2024-09-12T19:13:58.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.mZuA0CBbPrAlE9ZhZOYV2epySd2C2IZ_0 2024-09-12T19:13:58.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13443550496840138610', time=2024-09-12T21:01:00.280214+0000, chain.objs.size()=1 2024-09-12T19:13:58.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.296__shadow_.tHFxVxdQEH_B3GpAc2CPMx8an6dJ0sM_0 2024-09-12T19:13:58.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2633639968406505987', time=2024-09-12T21:01:00.282213+0000, chain.objs.size()=1 2024-09-12T19:13:58.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.296__shadow_.CUJVdQfjXE8f0Jz58xShcyZUMVH2Ali_0 2024-09-12T19:13:58.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6408032697211584143', time=2024-09-12T21:01:39.406977+0000, chain.objs.size()=1 2024-09-12T19:13:58.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.VPh-hBylPOwY4RMjuDG9co7iHOQfzuL_0 2024-09-12T19:13:58.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15034270491778688371', time=2024-09-12T21:01:39.408889+0000, chain.objs.size()=1 2024-09-12T19:13:58.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.FjyBj-VooYFY8YydKHnP-eDBnJ_Azwo_0 2024-09-12T19:13:58.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15741161156483056200', time=2024-09-12T21:01:39.413362+0000, chain.objs.size()=1 2024-09-12T19:13:58.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.F-7QB3sVzTT0c4c2sUapIkNWXLL_pFM_0 2024-09-12T19:13:58.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16545684963590926372', time=2024-09-12T21:01:39.445664+0000, chain.objs.size()=1 2024-09-12T19:13:58.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.6tRb2Z6_Yt8cIvJYKyQkpd052pYCjO-_0 2024-09-12T19:13:58.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1080523732907505183', time=2024-09-12T21:01:39.494526+0000, chain.objs.size()=1 2024-09-12T19:13:58.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.YIec4n2y9wIU5tbGov-l3vjeNWldrPj_0 2024-09-12T19:13:58.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17530670163759406723', time=2024-09-12T21:01:39.551658+0000, chain.objs.size()=1 2024-09-12T19:13:58.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.EQtFUNP0HcEleRZ-cZ03gA8urkFbBq-_0 2024-09-12T19:13:58.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3307795355983599206', time=2024-09-12T21:01:39.555072+0000, chain.objs.size()=1 2024-09-12T19:13:58.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.RDPP00_AW2ytF0PERi2uNraBt6ZumND_0 2024-09-12T19:13:58.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15097389543774570408', time=2024-09-12T21:01:39.672958+0000, chain.objs.size()=1 2024-09-12T19:13:58.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.300+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hCsd0aALefOdoZPghzJsViWJpKWWbh6_0 2024-09-12T19:13:58.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1913779468272936611', time=2024-09-12T21:01:39.693023+0000, chain.objs.size()=1 2024-09-12T19:13:58.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Ay9uwvEjSXnZus42X2URafArf4MqT1K_0 2024-09-12T19:13:58.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17860674649264231624', time=2024-09-12T21:01:39.719360+0000, chain.objs.size()=1 2024-09-12T19:13:58.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.H-Xcy4KaSEBeih0AWwMBuhVLIJuMkq-_0 2024-09-12T19:13:58.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16317440199377828473', time=2024-09-12T21:01:39.957710+0000, chain.objs.size()=1 2024-09-12T19:13:58.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.QpG0wVLqkRbcwjynsayuy8egvi6IQvL_0 2024-09-12T19:13:58.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15244770174129994631', time=2024-09-12T21:01:40.009788+0000, chain.objs.size()=1 2024-09-12T19:13:58.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.T7Pf_Au-e5h5Y_kLR5Z6CKMF2jXAgUN_0 2024-09-12T19:13:58.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11296651859235580380', time=2024-09-12T21:01:40.151516+0000, chain.objs.size()=1 2024-09-12T19:13:58.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.wj3TBmB0mUGSbVT-07asuD-uGmw1ha1_0 2024-09-12T19:13:58.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18105983209410358306', time=2024-09-12T21:01:40.177786+0000, chain.objs.size()=1 2024-09-12T19:13:58.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.tkl394U8hxgUrRPGXeYEufR_YPMOZPj_0 2024-09-12T19:13:58.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16644828481718132605', time=2024-09-12T21:01:40.192985+0000, chain.objs.size()=1 2024-09-12T19:13:58.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BJZDOOtkHH8F_XSpy4dU5UDRKLBqn8C_0 2024-09-12T19:13:58.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7081431496756530061', time=2024-09-12T21:01:40.198472+0000, chain.objs.size()=1 2024-09-12T19:13:58.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.k-BRe0rGNqFqcQBGnRrwvcwevsgJtXC_0 2024-09-12T19:13:58.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3602061431007458129', time=2024-09-12T21:01:40.337588+0000, chain.objs.size()=1 2024-09-12T19:13:58.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.NAB9JXsbPCsOrYxAF_UOEkusIPWz1TM_0 2024-09-12T19:13:58.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13631929159278811218', time=2024-09-12T21:01:40.357908+0000, chain.objs.size()=1 2024-09-12T19:13:58.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.vIBl_WerqhOSGT9FgiHdBez_9VnvQwR_0 2024-09-12T19:13:58.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8643466434782405743', time=2024-09-12T21:01:40.359747+0000, chain.objs.size()=1 2024-09-12T19:13:58.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.2iciRzp5HrrCBDJlYpZaDEszLPxjhWk_0 2024-09-12T19:13:58.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7165934310284475902', time=2024-09-12T21:01:40.429986+0000, chain.objs.size()=1 2024-09-12T19:13:58.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Hbo_c6i_5KQINheSW6P7n8Kn7A4KSpP_0 2024-09-12T19:13:58.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9651904906162132746', time=2024-09-12T21:01:40.441382+0000, chain.objs.size()=1 2024-09-12T19:13:58.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.VJv28wqz1SllWFhev95Kp_PnyURb5e-_0 2024-09-12T19:13:58.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5005252076314042217', time=2024-09-12T21:01:40.844060+0000, chain.objs.size()=1 2024-09-12T19:13:58.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mtKTeSYOqwozSkd53zBpcb-7z2G_CAQ_0 2024-09-12T19:13:58.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12432246252678229091', time=2024-09-12T21:01:40.890190+0000, chain.objs.size()=1 2024-09-12T19:13:58.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.PYyKfDdIaln1s5efFMHT55tVq_viPYJ_0 2024-09-12T19:13:58.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7011378638247590534', time=2024-09-12T21:01:40.988582+0000, chain.objs.size()=1 2024-09-12T19:13:58.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Fz68sYrddoavXPyEGI7DB-xQj95D343_0 2024-09-12T19:13:58.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.531182031599121185', time=2024-09-12T21:01:41.036034+0000, chain.objs.size()=1 2024-09-12T19:13:58.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.cGE6HOpfurqyhSwUVTxwA2u1id4CInO_0 2024-09-12T19:13:58.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4993068496635746166', time=2024-09-12T21:02:00.504484+0000, chain.objs.size()=1 2024-09-12T19:13:58.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.sGZJI7-JigGG4SWfEM0Yh8aj06mo60c_0 2024-09-12T19:13:58.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5726652791690093112', time=2024-09-12T21:02:00.628010+0000, chain.objs.size()=1 2024-09-12T19:13:58.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.lvpPmNt_3fPBsyaAcfWO_oO31xkGtzL_0 2024-09-12T19:13:58.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16084860718385100702', time=2024-09-12T21:02:00.631275+0000, chain.objs.size()=1 2024-09-12T19:13:58.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.HyIDNPVnNf2BqaI_0JAnDaty6hRMhZX_0 2024-09-12T19:13:58.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7607378053248445565', time=2024-09-12T21:02:00.641958+0000, chain.objs.size()=1 2024-09-12T19:13:58.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.NEotFSaX-1vMKnk6ops6h25XK2badjI_0 2024-09-12T19:13:58.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2068453173377237024', time=2024-09-12T21:02:00.644798+0000, chain.objs.size()=1 2024-09-12T19:13:58.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.304+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.werERbAaGqA8aypfYogje0v9cTPHTuH_0 2024-09-12T19:13:58.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4956022466686379905', time=2024-09-12T21:02:00.649720+0000, chain.objs.size()=1 2024-09-12T19:13:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2atNFCQa2RJGCfdU_ADA9jPnajddl3P_0 2024-09-12T19:13:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5532819490985467102', time=2024-09-12T21:02:00.819281+0000, chain.objs.size()=1 2024-09-12T19:13:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.IRO-eM5s2L8mlWshhBeyr61V0Wgz3Ac_0 2024-09-12T19:13:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14869764041382135013', time=2024-09-12T21:02:00.832667+0000, chain.objs.size()=1 2024-09-12T19:13:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.6PIWJOTOCDJIdjEJTr-EfiVe21t2zZV_0 2024-09-12T19:13:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14769466561738958359', time=2024-09-12T21:02:00.867353+0000, chain.objs.size()=1 2024-09-12T19:13:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.HpFP_kXRxVv5Ze1ldPaTP7htpCLfyIX_0 2024-09-12T19:13:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12573341082634821733', time=2024-09-12T21:02:00.875129+0000, chain.objs.size()=1 2024-09-12T19:13:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.xzFTrRmgm9LAhFh9EwtRWt1_QCqyl8c_0 2024-09-12T19:13:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.65820429323386498', time=2024-09-12T21:02:00.887867+0000, chain.objs.size()=1 2024-09-12T19:13:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Rq1TXS_DjZBErgs-nKFxmbUwHLkdS2I_0 2024-09-12T19:13:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14114090996904478452', time=2024-09-12T21:02:00.888980+0000, chain.objs.size()=1 2024-09-12T19:13:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Bs0J-8X6MjkSC0xmjitn3yxU19FTGsP_0 2024-09-12T19:13:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13680179796464899008', time=2024-09-12T21:02:00.898559+0000, chain.objs.size()=1 2024-09-12T19:13:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7CBz0qKDrJRRTbf1GyI60ZZDfT2x6zu_0 2024-09-12T19:13:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.92503167551067999', time=2024-09-12T21:02:00.989255+0000, chain.objs.size()=1 2024-09-12T19:13:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1tlGzAecACw1_lMUrxVuJvd75Fxyc7r_0 2024-09-12T19:13:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7545523561189397514', time=2024-09-12T21:02:01.055456+0000, chain.objs.size()=1 2024-09-12T19:13:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.v9pHwsLVkYw6uUvDH0sWYgzvIw-9697_0 2024-09-12T19:13:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11635896525937627418', time=2024-09-12T21:02:01.082837+0000, chain.objs.size()=1 2024-09-12T19:13:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.QQsk4Fj_RHxO6WsAsUa7dB_j7rb2AjH_0 2024-09-12T19:13:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5628642608337039847', time=2024-09-12T21:02:01.257436+0000, chain.objs.size()=1 2024-09-12T19:13:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.PVbaYl5XNourGc6oQC9AtoiZnEHoMNk_0 2024-09-12T19:13:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7659271173328107783', time=2024-09-12T21:02:01.444010+0000, chain.objs.size()=1 2024-09-12T19:13:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.L5LnAiK7iSMjQZQEs4J5vp02Gers7b4_0 2024-09-12T19:13:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.397509255268611913', time=2024-09-12T21:02:01.481293+0000, chain.objs.size()=1 2024-09-12T19:13:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.m7TuMwa3UWiI16i1-ehCKuySIh3B3tS_0 2024-09-12T19:13:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15090745072145062867', time=2024-09-12T21:02:01.483545+0000, chain.objs.size()=1 2024-09-12T19:13:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qPDlXuJMbFSaUu3Svz0Nq25oktjquE4_0 2024-09-12T19:13:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10742420103972888457', time=2024-09-12T21:02:01.518785+0000, chain.objs.size()=1 2024-09-12T19:13:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.WX75UbB-wZuI8g7oVevO66L4--n2ey7_0 2024-09-12T19:13:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.701406427439687534', time=2024-09-12T21:02:01.549369+0000, chain.objs.size()=1 2024-09-12T19:13:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.o13tK_Ai0ScaAXJAua1EQVELWbXNzOT_0 2024-09-12T19:13:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10066209749589680107', time=2024-09-12T21:02:01.552904+0000, chain.objs.size()=1 2024-09-12T19:13:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.cShVTEC603Wi27fDypaOAXJANqCzHTA_0 2024-09-12T19:13:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2921048131730816893', time=2024-09-12T21:02:01.775534+0000, chain.objs.size()=1 2024-09-12T19:13:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.308+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qAWjc4IHCdNkX6_PQp0fkkLbJbNQZlC_0 2024-09-12T19:13:58.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12956972638067674119', time=2024-09-12T21:02:01.785095+0000, chain.objs.size()=1 2024-09-12T19:13:58.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.X6YkiWQdZJnl5DNVOibeMg0nxAz5RkM_0 2024-09-12T19:13:58.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14417513017420290587', time=2024-09-12T21:02:01.790280+0000, chain.objs.size()=1 2024-09-12T19:13:58.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.wDn23pdikPiRPVCDyMkN_3o91aENxFV_0 2024-09-12T19:13:58.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12090683170256994241', time=2024-09-12T21:02:01.912488+0000, chain.objs.size()=1 2024-09-12T19:13:58.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jiCgkdTJHKcFU2NyPaToLCVlIcncGHl_0 2024-09-12T19:13:58.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53461 2024-09-12T19:13:58.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T19:13:58.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.558837941869636849', time=2024-09-12T21:02:01.967058+0000, chain.objs.size()=1 2024-09-12T19:13:58.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.nK0iU7aQnIYQV3gSHL6aMkreNlQmJEj_0 2024-09-12T19:13:58.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14871492639659388210', time=2024-09-12T21:02:01.999471+0000, chain.objs.size()=1 2024-09-12T19:13:58.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8AZWYrQWchgYxbpmGN5sNz8pZDmwtvc_0 2024-09-12T19:13:58.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15347626722688156795', time=2024-09-12T21:02:02.000402+0000, chain.objs.size()=1 2024-09-12T19:13:58.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.mBpuqwwauKsDMUp4YIWP-g0QKkYU1eD_0 2024-09-12T19:13:58.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11834520114168033138', time=2024-09-12T21:02:02.129182+0000, chain.objs.size()=1 2024-09-12T19:13:58.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jEzGFj9LArCd6Dsjsm-oaKtPty_dPN3_0 2024-09-12T19:13:58.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2595091738267660407', time=2024-09-12T21:02:02.162974+0000, chain.objs.size()=1 2024-09-12T19:13:58.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.312+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.QQKo-vg4Z5nw1OYsbozlG1CP7DhdoXW_0 2024-09-12T19:13:58.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7270936688540420080', time=2024-09-12T21:02:02.186842+0000, chain.objs.size()=1 2024-09-12T19:13:58.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.hjV3rtGApXkHpCphp7xTWN6cOOSRd8g_0 2024-09-12T19:13:58.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11839505053282373221', time=2024-09-12T21:02:02.195631+0000, chain.objs.size()=1 2024-09-12T19:13:58.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ksZ7q1b-OF4JvsL_kR7EJ7p81fO_jYa_0 2024-09-12T19:13:58.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4797193174257752515', time=2024-09-12T21:02:02.207478+0000, chain.objs.size()=1 2024-09-12T19:13:58.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.LIMA2H9SZm2rSP5gEQZahSsHdALCEzH_0 2024-09-12T19:13:58.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12675360909181432901', time=2024-09-12T21:02:02.209041+0000, chain.objs.size()=1 2024-09-12T19:13:58.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.0uRQIQ-VLQTsbMGCyCQM6p8FDHx6x0C_0 2024-09-12T19:13:58.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7393381144934205797', time=2024-09-12T21:02:05.434589+0000, chain.objs.size()=1 2024-09-12T19:13:58.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.329__shadow_.MSQETp2UyxJm4TUzUidu4sYHDc5MXEq_0 2024-09-12T19:13:58.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11463168818883854057', time=2024-09-12T21:02:12.654043+0000, chain.objs.size()=1 2024-09-12T19:13:58.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.340__shadow_.8rVJNf0zFTNwv3cSJiO4uyiGmuIm1TJ_0 2024-09-12T19:13:58.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2309736518804021100', time=2024-09-12T21:03:17.954115+0000, chain.objs.size()=1 2024-09-12T19:13:58.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.432__shadow_.ltHdWGjomWaLDGQPaIfXtciIWm5Bxcd_0 2024-09-12T19:13:58.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6702418218358156185', time=2024-09-12T21:03:53.921705+0000, chain.objs.size()=1 2024-09-12T19:13:58.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.481__shadow_.l1nkTFBSrAKXpvBiGRM3kptVrw-bqEd_0 2024-09-12T19:13:58.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12982882804417336640', time=2024-09-12T21:04:51.813377+0000, chain.objs.size()=2 2024-09-12T19:13:58.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.525__multipart_mymultipart.2~yC1qn_4v5cjt5b0w3IKMpT-1UFdL0lI.1 2024-09-12T19:13:58.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.525__multipart_mymultipart.2~yC1qn_4v5cjt5b0w3IKMpT-1UFdL0lI.2 2024-09-12T19:13:58.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15862681693756897309', time=2024-09-12T21:05:20.026531+0000, chain.objs.size()=2 2024-09-12T19:13:58.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.536__multipart_mymultipart.2~Od2S1h5pdx-fQwYQ7KZHNuI1RjrzlU8.1 2024-09-12T19:13:58.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.536__shadow_mymultipart.2~Od2S1h5pdx-fQwYQ7KZHNuI1RjrzlU8.1_1 2024-09-12T19:13:58.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9419385211582016495', time=2024-09-12T21:05:43.333948+0000, chain.objs.size()=2 2024-09-12T19:13:58.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.552__shadow_.QSyuFN2Qi9GClItH-urIp0-s0PGil5q_0 2024-09-12T19:13:58.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.552__shadow_.QSyuFN2Qi9GClItH-urIp0-s0PGil5q_1 2024-09-12T19:13:58.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12178015530381997748', time=2024-09-12T21:05:48.045350+0000, chain.objs.size()=1 2024-09-12T19:13:58.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.556__shadow_.bkqGY4isdbLS2ph4ld6MHToiLJl-kKj_0 2024-09-12T19:13:58.323 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5761624991189365090', time=2024-09-12T21:06:26.992655+0000, chain.objs.size()=1 2024-09-12T19:13:58.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:Ea82cn8pgNMiTMaIhpKLvIvAccGeKp3_.A5R_szDjc1ld5zlnsMssGEDNRPvvwJx_0 2024-09-12T19:13:58.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16570509742409066862', time=2024-09-12T21:06:46.334897+0000, chain.objs.size()=1 2024-09-12T19:13:58.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.579__shadow:P1-ttRcBXKlNQ0kVvhl0PHZlT44jYnj_.osbHRzj9SId-r-3yqiWvdOdVZ9nVy-b_0 2024-09-12T19:13:58.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2550165831218102547', time=2024-09-12T21:06:46.385365+0000, chain.objs.size()=1 2024-09-12T19:13:58.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.316+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.579__shadow:.uM85OjMqr0xKpHIo3a5xbGzTXwFir-_.zw16TMDZJhLnw0aXQPxeUjTtD4RYvhn_0 2024-09-12T19:13:58.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15562003259689993350', time=2024-09-12T21:08:24.830107+0000, chain.objs.size()=1 2024-09-12T19:13:58.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.617__shadow_.ywLyXKlP5CvxlFy-L73pfcujNaqqzMu_0 2024-09-12T19:13:58.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13177388962111447481', time=2024-09-12T21:09:27.417196+0000, chain.objs.size()=1 2024-09-12T19:13:58.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.620__shadow_.Rpzgz2nM0GUp1_ZF2HdPZPd6uMFaALD_0 2024-09-12T19:13:58.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7169808091861857954', time=2024-09-12T21:09:40.057969+0000, chain.objs.size()=1 2024-09-12T19:13:58.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.631__shadow_.GJPZW9WLJb3dn6ouQRrSoWYYwlw9hAY_0 2024-09-12T19:13:58.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15940187199183390450', time=2024-09-12T21:09:41.553312+0000, chain.objs.size()=1 2024-09-12T19:13:58.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.633__shadow_.NVNMAoMkLzAarHRqxkD3YbS_tfiTT72_0 2024-09-12T19:13:58.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.320+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12908751870465403912', time=2024-09-12T21:10:39.059162+0000, chain.objs.size()=1 2024-09-12T19:13:58.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.712__shadow:wFBkZTx2ZX0ZOlcom9a8UD1lR1EWLAc_.TZXGfI_-USoOAo5-NF3BAZOIkua3Kpb_0 2024-09-12T19:13:58.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.320+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:58.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.324+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T19:13:58.328 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.324+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:58.328 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.324+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:58.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53269' 2024-09-12T19:13:58.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2502233114294111395', time=2024-09-12T20:57:40.608706+0000, chain.objs.size()=1 2024-09-12T19:13:58.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.170__shadow_.CBmdE0vWIdU4h5lW3CKs6mhm8jjiukL_0 2024-09-12T19:13:58.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13019447592400154707', time=2024-09-12T20:59:47.922984+0000, chain.objs.size()=1 2024-09-12T19:13:58.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.230__shadow_.oQh6bGGfS08v2-2b1oh0r0y_K8ivcp2_0 2024-09-12T19:13:58.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16955725543286205432', time=2024-09-12T20:59:54.792609+0000, chain.objs.size()=1 2024-09-12T19:13:58.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.238__shadow_.bb8S8quQ5jXeF6eq-XfzCp6otFUkXEP_0 2024-09-12T19:13:58.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11545283201735342927', time=2024-09-12T20:59:56.206092+0000, chain.objs.size()=1 2024-09-12T19:13:58.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.240__shadow_.Huix5Ki8h4r89e3tSRq6WZiaLLGkBzG_0 2024-09-12T19:13:58.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2943810120398691973', time=2024-09-12T21:00:05.143846+0000, chain.objs.size()=1 2024-09-12T19:13:58.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.251__shadow_.f0nkYK649nJjv8S-uVbnZcG0jeRKr8v_0 2024-09-12T19:13:58.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3244692861216209799', time=2024-09-12T21:00:07.378154+0000, chain.objs.size()=1 2024-09-12T19:13:58.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.254__shadow_.tlLnRkcR1_KiCwTcXiK_1QLbwopXnRh_0 2024-09-12T19:13:58.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4161901643551067291', time=2024-09-12T21:00:10.977381+0000, chain.objs.size()=1 2024-09-12T19:13:58.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.259__shadow_.n-b0MarkOisxPXFMh6LX8X32xR5h5IM_0 2024-09-12T19:13:58.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16028791349879219582', time=2024-09-12T21:00:10.979340+0000, chain.objs.size()=1 2024-09-12T19:13:58.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.259__shadow_.D0G8f9igBQlHT1RQ05dgRGsoNcVIz2n_0 2024-09-12T19:13:58.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18292905668971771208', time=2024-09-12T21:00:31.984620+0000, chain.objs.size()=1 2024-09-12T19:13:58.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WZlGVGDMksd0j2a4AgdSyU7jwGyvnDF_0 2024-09-12T19:13:58.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2215117708969055714', time=2024-09-12T21:00:32.018993+0000, chain.objs.size()=1 2024-09-12T19:13:58.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.hKYqZlH0JIFBX0CgDkIzFY1HYASEjNj_0 2024-09-12T19:13:58.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12859629601500401158', time=2024-09-12T21:00:32.077453+0000, chain.objs.size()=1 2024-09-12T19:13:58.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.QeE-I1ATbajMGOolGGGR6z8nD8PXwG6_0 2024-09-12T19:13:58.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.78883625187281767', time=2024-09-12T21:00:32.248087+0000, chain.objs.size()=1 2024-09-12T19:13:58.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.F7StWwGKS_3c7YR9pmVqMbxzBbLA4a4_0 2024-09-12T19:13:58.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7425270641893018657', time=2024-09-12T21:00:32.301150+0000, chain.objs.size()=1 2024-09-12T19:13:58.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.j0XGne4xA2uEc1pWFxY2yurA_BIP0OJ_0 2024-09-12T19:13:58.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1101066365757088435', time=2024-09-12T21:00:32.302139+0000, chain.objs.size()=1 2024-09-12T19:13:58.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.LgeRLkBhqsYBMdCFpv5IxfW14KTzbXK_0 2024-09-12T19:13:58.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8775050629482225881', time=2024-09-12T21:00:32.312403+0000, chain.objs.size()=1 2024-09-12T19:13:58.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-Bc4xCQYrB9yzLRDFFgaQRzcCBCeslc_0 2024-09-12T19:13:58.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12671091261665512123', time=2024-09-12T21:00:32.314610+0000, chain.objs.size()=1 2024-09-12T19:13:58.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-GhwFxmcye17jsotphz62-cdR_VTXXG_0 2024-09-12T19:13:58.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14927888909274226802', time=2024-09-12T21:00:32.332362+0000, chain.objs.size()=1 2024-09-12T19:13:58.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.qysh2XkC5foOzupeLiCzuY_PrGeus2T_0 2024-09-12T19:13:58.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16951609104895119839', time=2024-09-12T21:00:32.470649+0000, chain.objs.size()=1 2024-09-12T19:13:58.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.xNuZmcgQEXGgtcvMawjVcfCqr2oFEMA_0 2024-09-12T19:13:58.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8129228555423575352', time=2024-09-12T21:00:32.525351+0000, chain.objs.size()=1 2024-09-12T19:13:58.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JZ4fIffyeiz1XH-ucSMwPc_Jc5O98ph_0 2024-09-12T19:13:58.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6862883639842031045', time=2024-09-12T21:00:32.537540+0000, chain.objs.size()=1 2024-09-12T19:13:58.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.EVH48-xs0Pfi4f-ORWH5ltnRnMHPSld_0 2024-09-12T19:13:58.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15172312061426032525', time=2024-09-12T21:00:32.547224+0000, chain.objs.size()=1 2024-09-12T19:13:58.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.iUWqaZO76jzxzcTRyxmZq-cDynF9Ouy_0 2024-09-12T19:13:58.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15671381706994307174', time=2024-09-12T21:00:32.558490+0000, chain.objs.size()=1 2024-09-12T19:13:58.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.8POL-FQLVxYOZ2P1hmK0moc6AaV6fjB_0 2024-09-12T19:13:58.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12975151965996100500', time=2024-09-12T21:00:32.562778+0000, chain.objs.size()=1 2024-09-12T19:13:58.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.328+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JPrrabx6_0zf4pSyeD-NfUedpgIvyld_0 2024-09-12T19:13:58.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4971710296801591227', time=2024-09-12T21:00:32.564396+0000, chain.objs.size()=1 2024-09-12T19:13:58.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.hILdT-TOXAxj7z3db-rx9wtvpxYYSKx_0 2024-09-12T19:13:58.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4581688684117881403', time=2024-09-12T21:00:32.661774+0000, chain.objs.size()=1 2024-09-12T19:13:58.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.oQ5ZNUWeBTdsMKyCEBaI0flvOMDvypO_0 2024-09-12T19:13:58.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8105527312335020791', time=2024-09-12T21:00:32.718574+0000, chain.objs.size()=1 2024-09-12T19:13:58.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.Ke7QU7xUPolZ7aAatBQ9HbVb6D8bo_m_0 2024-09-12T19:13:58.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11508075160056784634', time=2024-09-12T21:00:32.730034+0000, chain.objs.size()=1 2024-09-12T19:13:58.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.oLMySts5A2LUDaX1rKwoEbutSdFgag1_0 2024-09-12T19:13:58.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6157665938120663736', time=2024-09-12T21:00:32.769801+0000, chain.objs.size()=1 2024-09-12T19:13:58.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.uf-uFRSa1PtUhht_15ow29sxbaGm6ir_0 2024-09-12T19:13:58.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.399097142873666385', time=2024-09-12T21:00:32.874027+0000, chain.objs.size()=1 2024-09-12T19:13:58.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.BpcKGj3mqCC-oYvaqi0MBLEPn6Bw4ra_0 2024-09-12T19:13:58.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6922866954626249870', time=2024-09-12T21:00:32.893704+0000, chain.objs.size()=1 2024-09-12T19:13:58.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.N8vGvnLEtOsZW575lScy98SupK4jZZ5_0 2024-09-12T19:13:58.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18144911581489392134', time=2024-09-12T21:00:32.947070+0000, chain.objs.size()=1 2024-09-12T19:13:58.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3FQBVww0JolQfcBRz7e2L3rRetfCjEC_0 2024-09-12T19:13:58.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17541156494372062471', time=2024-09-12T21:00:32.981919+0000, chain.objs.size()=1 2024-09-12T19:13:58.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.yi270188MT76Ulxt5XzmtgOrsB4IL_S_0 2024-09-12T19:13:58.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10495613091025572941', time=2024-09-12T21:00:32.984212+0000, chain.objs.size()=1 2024-09-12T19:13:58.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.YAjnuwgwaCvVOXnccxpqvY73eZuWJpJ_0 2024-09-12T19:13:58.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15434765659594842239', time=2024-09-12T21:00:33.094257+0000, chain.objs.size()=1 2024-09-12T19:13:58.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.w9OlrzlwPovJbSRFESm9Ic4BF9KEaYZ_0 2024-09-12T19:13:58.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13860544436040099726', time=2024-09-12T21:00:33.139567+0000, chain.objs.size()=1 2024-09-12T19:13:58.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ClpNPp-7QjUvGs1-xEr-02su9lG2Nx6_0 2024-09-12T19:13:58.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17031615211389231500', time=2024-09-12T21:00:33.174514+0000, chain.objs.size()=1 2024-09-12T19:13:58.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.MSgXpP7daSODDYfVe16EuJFvBci1O5K_0 2024-09-12T19:13:58.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14176810871516140043', time=2024-09-12T21:00:33.407403+0000, chain.objs.size()=1 2024-09-12T19:13:58.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.gNgeLfd5N18-dL6kzFmjD0JRgwfxDOz_0 2024-09-12T19:13:58.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1558564676078646848', time=2024-09-12T21:00:33.419139+0000, chain.objs.size()=1 2024-09-12T19:13:58.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.kgna6WpNr9vCwNeZPOoYfgk3nWyalai_0 2024-09-12T19:13:58.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11818171498163400104', time=2024-09-12T21:00:33.431857+0000, chain.objs.size()=1 2024-09-12T19:13:58.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.19tr5uMLygHmyxR33Zr3d2STpRvfVix_0 2024-09-12T19:13:58.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16527924104043306542', time=2024-09-12T21:00:33.447263+0000, chain.objs.size()=1 2024-09-12T19:13:58.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.62es3KKHztOf5-bLcYL75oK5lgQhe-8_0 2024-09-12T19:13:58.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8747699307790977825', time=2024-09-12T21:00:35.301711+0000, chain.objs.size()=1 2024-09-12T19:13:58.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.264__shadow_.egQLkm4yLvbSpudZhpV_Y3QI0aSVlME_0 2024-09-12T19:13:58.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9935330789743674681', time=2024-09-12T21:00:37.423669+0000, chain.objs.size()=1 2024-09-12T19:13:58.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.267__shadow_.xZNFr-U43cjTxMyxzudsYtjzEgedQCW_0 2024-09-12T19:13:58.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16469376588734543470', time=2024-09-12T21:00:47.582599+0000, chain.objs.size()=1 2024-09-12T19:13:58.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.281__shadow_.6aFMUnhtaR73gYawVhwoBrZYgijxWhz_0 2024-09-12T19:13:58.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10098847807223946954', time=2024-09-12T21:00:48.394418+0000, chain.objs.size()=1 2024-09-12T19:13:58.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.282__shadow_.z6Ynf3TDvdYOJRC9OEKvWoHbUAL6eWM_0 2024-09-12T19:13:58.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6634595083799695570', time=2024-09-12T21:00:56.717909+0000, chain.objs.size()=1 2024-09-12T19:13:58.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.332+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.2BGbCb4v1KL8NMfa2wsjb5CkVXJ1lBU_0 2024-09-12T19:13:58.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15728726864716874211', time=2024-09-12T21:00:56.734305+0000, chain.objs.size()=1 2024-09-12T19:13:58.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.SWEkD00qpmS3Inv0T6uduGLHDannsYU_0 2024-09-12T19:13:58.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.261778823461437160', time=2024-09-12T21:00:58.119613+0000, chain.objs.size()=1 2024-09-12T19:13:58.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.293__shadow_.r7kv0ZvdyayuXbr69i3TsrlwkLwUP7A_0 2024-09-12T19:13:58.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14667763268169134385', time=2024-09-12T21:01:02.563497+0000, chain.objs.size()=1 2024-09-12T19:13:58.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.299__shadow_.wXAA4ohGB_30LvPNFhv3b2xTqMVBDqG_0 2024-09-12T19:13:58.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10501135171543252808', time=2024-09-12T21:01:06.302662+0000, chain.objs.size()=1 2024-09-12T19:13:58.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.304__shadow_.uUBw_rILuLsmisRIm4L3jhpYq_pb39B_0 2024-09-12T19:13:58.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14988532483810273160', time=2024-09-12T21:01:17.727160+0000, chain.objs.size()=1 2024-09-12T19:13:58.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.319__shadow:KpAATgzOtgiVxNsxOHGYD7lCS4a7Xgo_.Bt2yQUiAZ4tSXNmL1mKXV1XfE9VFs0Y_0 2024-09-12T19:13:58.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2737754385290073783', time=2024-09-12T21:01:39.546215+0000, chain.objs.size()=1 2024-09-12T19:13:58.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.GWSEK0m7O2JsTMrk53oroXcV0gNXEGy_0 2024-09-12T19:13:58.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.658029435156963102', time=2024-09-12T21:01:39.556162+0000, chain.objs.size()=1 2024-09-12T19:13:58.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.GNIMclcbA9rC2qRSnvSClTVhwuokr0S_0 2024-09-12T19:13:58.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16454858225088606841', time=2024-09-12T21:01:39.706116+0000, chain.objs.size()=1 2024-09-12T19:13:58.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0Vc6D9b9RsRAn3TrpPjjOTyoSU0L9rb_0 2024-09-12T19:13:58.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10183451987068275301', time=2024-09-12T21:01:39.738671+0000, chain.objs.size()=1 2024-09-12T19:13:58.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.gVsxTBuTSaZqYsPK53wc97RTWc-kPNz_0 2024-09-12T19:13:58.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4150778091571460600', time=2024-09-12T21:01:39.981757+0000, chain.objs.size()=1 2024-09-12T19:13:58.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.KnU5232CEIc9oZh-3ktOEb2Xfg4qIfm_0 2024-09-12T19:13:58.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13732488792892321006', time=2024-09-12T21:01:40.123945+0000, chain.objs.size()=1 2024-09-12T19:13:58.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.qc0TLUWHuCtsVQF5pvcNeW6pbplwuFN_0 2024-09-12T19:13:58.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5356259648830596718', time=2024-09-12T21:01:40.125893+0000, chain.objs.size()=1 2024-09-12T19:13:58.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._QwotNnfqB1WgfNgjCNDrKntJhRpond_0 2024-09-12T19:13:58.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12291965484308407389', time=2024-09-12T21:01:40.135129+0000, chain.objs.size()=1 2024-09-12T19:13:58.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Q8qM8Y_JYCiUAuG-nIszrVdcNq6bLeG_0 2024-09-12T19:13:58.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11689828519454993179', time=2024-09-12T21:01:40.139010+0000, chain.objs.size()=1 2024-09-12T19:13:58.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.8HRc2AF0Cnku-woXRej4_9oXU-K51D9_0 2024-09-12T19:13:58.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1934950719602656088', time=2024-09-12T21:01:40.170607+0000, chain.objs.size()=1 2024-09-12T19:13:58.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.B8njAbbWpxoArph1VaYGqU459fCLOZg_0 2024-09-12T19:13:58.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7272486986297545240', time=2024-09-12T21:01:40.215543+0000, chain.objs.size()=1 2024-09-12T19:13:58.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BQkqKwfoZ4Ccveaf9w14QekHmRHG-K4_0 2024-09-12T19:13:58.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7846844054941773025', time=2024-09-12T21:01:40.229326+0000, chain.objs.size()=1 2024-09-12T19:13:58.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.336+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.4X8bs6i5Hb9QdyU8sbZe-HxZigUC5P-_0 2024-09-12T19:13:58.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14216220345974209426', time=2024-09-12T21:01:40.369380+0000, chain.objs.size()=1 2024-09-12T19:13:58.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.GcxX827p0sjIKVefhXXfXAAVeQeSfhv_0 2024-09-12T19:13:58.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11041926479537470952', time=2024-09-12T21:01:40.404570+0000, chain.objs.size()=1 2024-09-12T19:13:58.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.cIL5NGpVxkNXKbFRjSa_PvvAwHWUX8f_0 2024-09-12T19:13:58.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17789702119391226717', time=2024-09-12T21:01:40.425487+0000, chain.objs.size()=1 2024-09-12T19:13:58.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.0hYKluqh_Hy_qVLDAHPFiktPMYrl_DQ_0 2024-09-12T19:13:58.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16346849953940922802', time=2024-09-12T21:01:40.430918+0000, chain.objs.size()=1 2024-09-12T19:13:58.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.uM62NyaxrffZC1m3RbMrtiI4XoS2H9A_0 2024-09-12T19:13:58.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13489855331110638618', time=2024-09-12T21:01:40.446287+0000, chain.objs.size()=1 2024-09-12T19:13:58.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.3E4xPv1TgQGgVXmFBIW1lsc9Oh1RL_3_0 2024-09-12T19:13:58.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16232421438128530311', time=2024-09-12T21:01:40.572723+0000, chain.objs.size()=1 2024-09-12T19:13:58.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.6fUCpeR6KRczGb2Zh4V8Yqyff5Igqyu_0 2024-09-12T19:13:58.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11451803602235753111', time=2024-09-12T21:01:40.598596+0000, chain.objs.size()=1 2024-09-12T19:13:58.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.7Z_0KRhYnkr34Ct1yMrWc8n09Ho8Az8_0 2024-09-12T19:13:58.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15196871604610706632', time=2024-09-12T21:01:40.610022+0000, chain.objs.size()=1 2024-09-12T19:13:58.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ouat2dFOPMpQN6J09NheclAZg9OnF3v_0 2024-09-12T19:13:58.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17887535460376959532', time=2024-09-12T21:01:40.611249+0000, chain.objs.size()=1 2024-09-12T19:13:58.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DwwqNyt5fKFpNvM24LMqGgWZpzmdU1c_0 2024-09-12T19:13:58.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5356976604741883904', time=2024-09-12T21:01:40.628273+0000, chain.objs.size()=1 2024-09-12T19:13:58.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Y3UxcVM1qfSC8i1uMZKHk2Wd4uIu8Uh_0 2024-09-12T19:13:58.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16735530431116611953', time=2024-09-12T21:01:40.642782+0000, chain.objs.size()=1 2024-09-12T19:13:58.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9zFbBniXDwjQwlSCeoo-aHDrviZ_0tg_0 2024-09-12T19:13:58.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15332910228502909127', time=2024-09-12T21:01:40.653607+0000, chain.objs.size()=1 2024-09-12T19:13:58.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.FsPXDe6iAg35ySQKvm-cmLIrHxH9D4v_0 2024-09-12T19:13:58.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7346287250277208675', time=2024-09-12T21:01:40.768153+0000, chain.objs.size()=1 2024-09-12T19:13:58.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.278Ri8GESaxBVf1m-5NQlaDLxJL9iy8_0 2024-09-12T19:13:58.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7507308464205840818', time=2024-09-12T21:01:40.831810+0000, chain.objs.size()=1 2024-09-12T19:13:58.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ViurDYb1Fo-KZ-Pps99jZ5vb2-OyoPc_0 2024-09-12T19:13:58.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6417237171918774249', time=2024-09-12T21:01:40.847893+0000, chain.objs.size()=1 2024-09-12T19:13:58.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.9kZuiPctRIX65GZtnc2GgwVlJTU95Ks_0 2024-09-12T19:13:58.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8626812993973455271', time=2024-09-12T21:01:40.868016+0000, chain.objs.size()=1 2024-09-12T19:13:58.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mZqae1v-o2ROI2w8Y2bDDlgc9AfxbMF_0 2024-09-12T19:13:58.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6294358823795928535', time=2024-09-12T21:01:41.034951+0000, chain.objs.size()=1 2024-09-12T19:13:58.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.340+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.cfEBISngdMv0lySp9Ku4_7OwSQmmEe4_0 2024-09-12T19:13:58.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4172231782160775443', time=2024-09-12T21:02:00.533042+0000, chain.objs.size()=1 2024-09-12T19:13:58.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.F23sYXIacA--mOOqW5hq4MIHCHogYiJ_0 2024-09-12T19:13:58.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12392744611795717854', time=2024-09-12T21:02:00.566807+0000, chain.objs.size()=1 2024-09-12T19:13:58.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8BqMu7Edq5P-XqdaZLes4opvRDmtpO__0 2024-09-12T19:13:58.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18427972224636372382', time=2024-09-12T21:02:00.583087+0000, chain.objs.size()=1 2024-09-12T19:13:58.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.LvKWkI38SlVu6kMPe7gSfB_rGwE9aBW_0 2024-09-12T19:13:58.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4457569585395740920', time=2024-09-12T21:02:00.825804+0000, chain.objs.size()=1 2024-09-12T19:13:58.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.AorvCJM_oE5WkwrxSkDSz7VeO-3F6tg_0 2024-09-12T19:13:58.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8682402097625494312', time=2024-09-12T21:02:00.833496+0000, chain.objs.size()=1 2024-09-12T19:13:58.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.H0f6QkOdN3TOuAw82Z7sOt6wLUpbf_p_0 2024-09-12T19:13:58.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2496453149037015764', time=2024-09-12T21:02:01.008689+0000, chain.objs.size()=1 2024-09-12T19:13:58.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.rT-xighNqT8_gfOYlw1smaseu60RjY__0 2024-09-12T19:13:58.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11540856017881174169', time=2024-09-12T21:02:01.024396+0000, chain.objs.size()=1 2024-09-12T19:13:58.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Z_Z2DnVeQLah1TA414sLRSmC7BJggFr_0 2024-09-12T19:13:58.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8266263187878446018', time=2024-09-12T21:02:01.034901+0000, chain.objs.size()=1 2024-09-12T19:13:58.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.g2uRhGmIni_g36PeWf_kh0zpIdfVAhl_0 2024-09-12T19:13:58.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11895320771919715087', time=2024-09-12T21:02:01.050596+0000, chain.objs.size()=1 2024-09-12T19:13:58.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jD7cadPhbk-n7pMhVB5XV7ftZQgRBwN_0 2024-09-12T19:13:58.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10222338216598436263', time=2024-09-12T21:02:01.065561+0000, chain.objs.size()=1 2024-09-12T19:13:58.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-v6i8M661s1Qq0i2uMwwYeazWgvwI0A_0 2024-09-12T19:13:58.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6671773610232011025', time=2024-09-12T21:02:01.079844+0000, chain.objs.size()=1 2024-09-12T19:13:58.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2LE8hrRS6VczgyKDE-jFbd5wGV6ga0L_0 2024-09-12T19:13:58.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13431532650509319640', time=2024-09-12T21:02:01.084738+0000, chain.objs.size()=1 2024-09-12T19:13:58.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qORtfRioVXf6LDuTjP64v3jTATyCDqN_0 2024-09-12T19:13:58.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10560944661198304454', time=2024-09-12T21:02:01.253031+0000, chain.objs.size()=1 2024-09-12T19:13:58.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.bvxHZlfMUr3PAVA6V8xMWmBSXVdXN48_0 2024-09-12T19:13:58.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18420027890310083988', time=2024-09-12T21:02:01.254231+0000, chain.objs.size()=1 2024-09-12T19:13:58.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.hvx83dHMLRGdpszGEtgIjNx4w1V-dqB_0 2024-09-12T19:13:58.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8579818352492394903', time=2024-09-12T21:02:01.302061+0000, chain.objs.size()=1 2024-09-12T19:13:58.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.jhoUQYxIcFPVjy6pGhus2RjnJMCGbG4_0 2024-09-12T19:13:58.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13963311949229480510', time=2024-09-12T21:02:01.486405+0000, chain.objs.size()=1 2024-09-12T19:13:58.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.t0yGCX6Ix673h5Ia4G9dpmxiSMohsrV_0 2024-09-12T19:13:58.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9892255903529694189', time=2024-09-12T21:02:01.527725+0000, chain.objs.size()=1 2024-09-12T19:13:58.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.eEhVmiK2wG5t6STapQ3882EeKtl1mUe_0 2024-09-12T19:13:58.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12948025534847308316', time=2024-09-12T21:02:01.537577+0000, chain.objs.size()=1 2024-09-12T19:13:58.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.OuG3zASalroR6g0Q_h-CLTgXdupPjHI_0 2024-09-12T19:13:58.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11803952341460595865', time=2024-09-12T21:02:01.713069+0000, chain.objs.size()=1 2024-09-12T19:13:58.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.GpxQjXr-HQg3V67pvbtwT56LShB3LcP_0 2024-09-12T19:13:58.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9038720178915099120', time=2024-09-12T21:02:01.716978+0000, chain.objs.size()=1 2024-09-12T19:13:58.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.4C-OVGjf9l0SXE8EtzrO4xm43CQ-xx7_0 2024-09-12T19:13:58.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16217385619215906549', time=2024-09-12T21:02:01.746932+0000, chain.objs.size()=1 2024-09-12T19:13:58.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.344+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.bKaWwdq5RncaebXu6gqfiQ62hkYlxxu_0 2024-09-12T19:13:58.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53269 2024-09-12T19:13:58.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T19:13:58.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3768654684904325537', time=2024-09-12T21:02:01.759876+0000, chain.objs.size()=1 2024-09-12T19:13:58.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1QCs9Hl-htkIo3gCC6WPz3fTplANwpf_0 2024-09-12T19:13:58.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6066557494803903765', time=2024-09-12T21:02:01.777683+0000, chain.objs.size()=1 2024-09-12T19:13:58.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.KjFIG29KQX_tdwEaVvxczZR50qauWSw_0 2024-09-12T19:13:58.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7454507756747179057', time=2024-09-12T21:02:01.788228+0000, chain.objs.size()=1 2024-09-12T19:13:58.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.GAx7q0jlmFaAlLsokQetL6gHFl3lVFv_0 2024-09-12T19:13:58.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3401003401903373107', time=2024-09-12T21:02:01.886783+0000, chain.objs.size()=1 2024-09-12T19:13:58.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.KxbRa2BSe92Uy3SJMpSvYO8uafwrNqj_0 2024-09-12T19:13:58.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7395586511934546783', time=2024-09-12T21:02:01.965490+0000, chain.objs.size()=1 2024-09-12T19:13:58.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.vWUQ1boxo9QWVhut8gV8rioUhwQz3-B_0 2024-09-12T19:13:58.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14675246323693102479', time=2024-09-12T21:02:01.971778+0000, chain.objs.size()=1 2024-09-12T19:13:58.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.bWpSq0COCxkn0tg19nr4yqxOxxBXld4_0 2024-09-12T19:13:58.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16288270019965304436', time=2024-09-12T21:02:01.981572+0000, chain.objs.size()=1 2024-09-12T19:13:58.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.OM5bC9KbudvbzD-c1102UjIc8ivUiD0_0 2024-09-12T19:13:58.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7072217981072449631', time=2024-09-12T21:02:01.987247+0000, chain.objs.size()=1 2024-09-12T19:13:58.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.V6Vj1YrIJEPCEbOXK27ToJFKhdwV0tJ_0 2024-09-12T19:13:58.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8207169425764422442', time=2024-09-12T21:02:02.005431+0000, chain.objs.size()=1 2024-09-12T19:13:58.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Qc2ztmcDamjC9Cv4kcd6FRSBVl2Xo7h_0 2024-09-12T19:13:58.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9130750696648914572', time=2024-09-12T21:02:02.151190+0000, chain.objs.size()=1 2024-09-12T19:13:58.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Dz2nht7nHY63wO05Jz8BsRLtw9wpndf_0 2024-09-12T19:13:58.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15191398203633295369', time=2024-09-12T21:02:02.209976+0000, chain.objs.size()=1 2024-09-12T19:13:58.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.nRgwSYsv_ntmLChKOPLGwAn7gcaECMe_0 2024-09-12T19:13:58.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11608063238572178507', time=2024-09-12T21:02:02.210716+0000, chain.objs.size()=1 2024-09-12T19:13:58.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.348+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.hP-PCtKyBqxV-RzWjoO1lx3BuXUQ-I7_0 2024-09-12T19:13:58.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2616066379488406375', time=2024-09-12T21:02:12.020404+0000, chain.objs.size()=1 2024-09-12T19:13:58.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.339__shadow_.l8gYZBF81OvOO1xZDr5C4cvQceqx20V_0 2024-09-12T19:13:58.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2977388727396411460', time=2024-09-12T21:02:32.363586+0000, chain.objs.size()=1 2024-09-12T19:13:58.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.372__shadow_.OVlfB2wSDkhWyJbHYVnjex-jj7GqTRL_0 2024-09-12T19:13:58.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10635166217521870135', time=2024-09-12T21:02:36.961357+0000, chain.objs.size()=1 2024-09-12T19:13:58.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.377__shadow_.iK12WX5cVgBRDopBJ_meeUSYLAThvqq_0 2024-09-12T19:13:58.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7646034805175183047', time=2024-09-12T21:04:05.488995+0000, chain.objs.size()=1 2024-09-12T19:13:58.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.497__shadow_.xdAM53zXldD17-wWq3LjMqrk0C6u0D2_0 2024-09-12T19:13:58.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17106284905959845574', time=2024-09-12T21:04:06.671129+0000, chain.objs.size()=1 2024-09-12T19:13:58.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.500__shadow_.QQpOJRxs8LtgeKVEMF-d-Sgz9qWM5_g_0 2024-09-12T19:13:58.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13087571157977005922', time=2024-09-12T21:04:56.663378+0000, chain.objs.size()=1 2024-09-12T19:13:58.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.528__shadow_.JyzZtaLj4II8PBBlj9Ya63nNDoS6ikC_0 2024-09-12T19:13:58.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10027797512064538011', time=2024-09-12T21:06:14.175162+0000, chain.objs.size()=1 2024-09-12T19:13:58.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.572__shadow:mkGay25DjChq9bIZ2gGHLS00YAcOB5T_.PeDgoF7deqqrpBvfNi4YDVqKFYB8XBL_0 2024-09-12T19:13:58.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6403938844082762751', time=2024-09-12T21:06:29.113202+0000, chain.objs.size()=1 2024-09-12T19:13:58.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:fGnZjAYB1grk.FAqMVrTShjfRPtST-1_.bmZKV2-uIiYscnrjfxOAhg9EqXeA0OA_0 2024-09-12T19:13:58.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7557255261674822434', time=2024-09-12T21:06:48.902142+0000, chain.objs.size()=1 2024-09-12T19:13:58.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.582__shadow:1B8jijaDukNKhZFCcgOLVyiZXaAKyGH_.hEM3iibqGlMgKQ80UjXTBM7cDbi50sJ_0 2024-09-12T19:13:58.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18363344119777082309', time=2024-09-12T21:06:53.830713+0000, chain.objs.size()=1 2024-09-12T19:13:58.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.587__shadow:P0GzBLWrK7k-cueCYsdEi9Sh1SvmVye_.x8tSpC1iyBFkPgWCYZh2nuaD2l9HLnj_0 2024-09-12T19:13:58.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3566302483979676918', time=2024-09-12T21:10:23.560102+0000, chain.objs.size()=1 2024-09-12T19:13:58.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.690__shadow:EY5nSczY-cXGp-wXjTlwtX4o4XsAElq_.t1A5LtWqjxKfwFHYMHgqzO6ZK2Supf__0 2024-09-12T19:13:58.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15533130605727747004', time=2024-09-12T21:10:33.344956+0000, chain.objs.size()=1 2024-09-12T19:13:58.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.704__shadow:E2ugr-a07Pxlrv9LKYBe5bSeQwLm6Zq_.gZVEGNT5lCaYYMfV5cPi7nsscAXDNDO_0 2024-09-12T19:13:58.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.471893929284086115', time=2024-09-12T21:10:34.132096+0000, chain.objs.size()=1 2024-09-12T19:13:58.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.705__shadow:JWgYB76WOHKtUvqV9PeRzDCzx0YFgQ._.o3RYYYCfGEsGoLzCz0TbRQkc7PaspnT_0 2024-09-12T19:13:58.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11405137068758921607', time=2024-09-12T21:10:38.587208+0000, chain.objs.size()=1 2024-09-12T19:13:58.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.352+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.711__multipart_file1.2~Cyv-gy42-WkwgYuu4quDTwpeOj3BUtN.1 2024-09-12T19:13:58.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.356+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:58.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.356+0000 7fe6722349c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T19:13:58.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T19:13:58.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T19:13:58.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47465' 2024-09-12T19:13:58.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9984563304939449902', time=2024-09-12T21:00:00.082308+0000, chain.objs.size()=1 2024-09-12T19:13:58.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.244__shadow_.PcvrrPW3AjiEf4Q18pD75Eu_6Qd7WVa_0 2024-09-12T19:13:58.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7416360361862920445', time=2024-09-12T21:00:10.977815+0000, chain.objs.size()=1 2024-09-12T19:13:58.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.259__shadow_.4Zc4-L-6jFgyznyxuaqJmXcenMmgBjI_0 2024-09-12T19:13:58.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10613050602867876684', time=2024-09-12T21:00:31.979538+0000, chain.objs.size()=1 2024-09-12T19:13:58.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.sLYT9lrEHXEZvtCbMQ6lv_WNdxxV6D7_0 2024-09-12T19:13:58.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13756764264717038661', time=2024-09-12T21:00:31.989086+0000, chain.objs.size()=1 2024-09-12T19:13:58.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.knehuRJWwasNsDzlGIFYz07KiAfcZRV_0 2024-09-12T19:13:58.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9077267307386195505', time=2024-09-12T21:00:32.064198+0000, chain.objs.size()=1 2024-09-12T19:13:58.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.QjSuGauvqEBbcHcPfyqaedmoIczxRIP_0 2024-09-12T19:13:58.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5783159537318252642', time=2024-09-12T21:00:32.105409+0000, chain.objs.size()=1 2024-09-12T19:13:58.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.bAKQmUh8FMRJfnn2nixB-9k-o-c0hEQ_0 2024-09-12T19:13:58.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11038474714011643807', time=2024-09-12T21:00:32.255814+0000, chain.objs.size()=1 2024-09-12T19:13:58.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.3RBQb0jXxoqFfse288NVfLJ4xiNVaBv_0 2024-09-12T19:13:58.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17731454704385784483', time=2024-09-12T21:00:32.322992+0000, chain.objs.size()=1 2024-09-12T19:13:58.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.nZkTJ4s9ni3DVKHiNfqzqiKWd5ajJYu_0 2024-09-12T19:13:58.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3446452966200926364', time=2024-09-12T21:00:32.336709+0000, chain.objs.size()=1 2024-09-12T19:13:58.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ffDpbS81ldG7kUPSponv3-Rn7tBvNZS_0 2024-09-12T19:13:58.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4282778781099154176', time=2024-09-12T21:00:32.439760+0000, chain.objs.size()=1 2024-09-12T19:13:58.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.e8cgoGokZg0EvF9EZg6N3NOvt0ZueMN_0 2024-09-12T19:13:58.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7910140490475089668', time=2024-09-12T21:00:32.489147+0000, chain.objs.size()=1 2024-09-12T19:13:58.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.dlIcKYvvsjkgCEROq71HebGCSlLyGCk_0 2024-09-12T19:13:58.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12068308519803359024', time=2024-09-12T21:00:32.514939+0000, chain.objs.size()=1 2024-09-12T19:13:58.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.mIRYd0DL2Nx_gMBaQZvQJjSsYKYA9uX_0 2024-09-12T19:13:58.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5181750143470864797', time=2024-09-12T21:00:32.524202+0000, chain.objs.size()=1 2024-09-12T19:13:58.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.MJRLll_ee-r3YJ9MU36z_s9RojNfoCQ_0 2024-09-12T19:13:58.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13265159199726334947', time=2024-09-12T21:00:32.529565+0000, chain.objs.size()=1 2024-09-12T19:13:58.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.WVTaUNwQsQyw-zcacW-eiQR-l_p-4zY_0 2024-09-12T19:13:58.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9870726348191876215', time=2024-09-12T21:00:32.689169+0000, chain.objs.size()=1 2024-09-12T19:13:58.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.lxpaYNCL60kav9anPxVVFfpORlQSqOR_0 2024-09-12T19:13:58.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8704952529581226197', time=2024-09-12T21:00:32.698427+0000, chain.objs.size()=1 2024-09-12T19:13:58.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ZYdxpkEJl4AvwsR2UmgY5-72Qm8hR6g_0 2024-09-12T19:13:58.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3266817611337113506', time=2024-09-12T21:00:32.715202+0000, chain.objs.size()=1 2024-09-12T19:13:58.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.k1sFvJ0c9FTJwceEtmjkZPtJbFsfR86_0 2024-09-12T19:13:58.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3365002515327039657', time=2024-09-12T21:00:32.736624+0000, chain.objs.size()=1 2024-09-12T19:13:58.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.YrZLS-TNir__XPtU0_uZ0acrNjxVWnC_0 2024-09-12T19:13:58.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7696935019830331679', time=2024-09-12T21:00:32.760691+0000, chain.objs.size()=1 2024-09-12T19:13:58.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.urz0RyMHvznMuAnc9LJwi_UN1kahAYL_0 2024-09-12T19:13:58.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17650073452418994795', time=2024-09-12T21:00:32.773800+0000, chain.objs.size()=1 2024-09-12T19:13:58.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.oOd7CpD5Ksx_Vrv7GbFXRo6IM9DIqG5_0 2024-09-12T19:13:58.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10587916442249457490', time=2024-09-12T21:00:32.777957+0000, chain.objs.size()=1 2024-09-12T19:13:58.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.360+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.S0C-KbZLyvEao5Zpu1rCiYBSReCO5-P_0 2024-09-12T19:13:58.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1640458265818527364', time=2024-09-12T21:00:32.959344+0000, chain.objs.size()=1 2024-09-12T19:13:58.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.rHVeyxS8_iehBMSfxFMyD0eFiZ0VSun_0 2024-09-12T19:13:58.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18382826336230411014', time=2024-09-12T21:00:32.966024+0000, chain.objs.size()=1 2024-09-12T19:13:58.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.ArdYmJm_MoJCJp6kyG_cikhv8B4ac3J_0 2024-09-12T19:13:58.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13581238609387889882', time=2024-09-12T21:00:32.994017+0000, chain.objs.size()=1 2024-09-12T19:13:58.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.mKepRimMM13kXYBO_HOO-fd3NGQsgW9_0 2024-09-12T19:13:58.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4477180596041237847', time=2024-09-12T21:00:33.120956+0000, chain.objs.size()=1 2024-09-12T19:13:58.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.-3QiQZJ4OVJJLhAZJnK5X6Swe3rWzKt_0 2024-09-12T19:13:58.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6580188529189690898', time=2024-09-12T21:00:33.196994+0000, chain.objs.size()=1 2024-09-12T19:13:58.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.2zUVHIcWrIcfwMzf4TrlRjkzKWvfgB__0 2024-09-12T19:13:58.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17826296149887713285', time=2024-09-12T21:00:33.439667+0000, chain.objs.size()=1 2024-09-12T19:13:58.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.xT3lx4ImLEpr4LTEExWTGj6hiXrqLL__0 2024-09-12T19:13:58.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13240826915777116371', time=2024-09-12T21:00:33.603489+0000, chain.objs.size()=1 2024-09-12T19:13:58.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.XquzDmMPKjtNKb1Z9geJfdq5nQBZDHJ_0 2024-09-12T19:13:58.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.285572872929568569', time=2024-09-12T21:00:33.884254+0000, chain.objs.size()=1 2024-09-12T19:13:58.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.262__shadow_.JYixkzimBEmPni19hY9n9fs6xQAse2F_0 2024-09-12T19:13:58.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16533012864067063716', time=2024-09-12T21:00:38.119744+0000, chain.objs.size()=1 2024-09-12T19:13:58.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.268__shadow_.SRhjsTeClEcZJej94dLwiFRkVDwS184_0 2024-09-12T19:13:58.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10826723442626239681', time=2024-09-12T21:00:41.003298+0000, chain.objs.size()=1 2024-09-12T19:13:58.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.272__shadow_.8xNy6g_DB0TJrBAYiNsOPWhLwg3cUBG_0 2024-09-12T19:13:58.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6435132372652232400', time=2024-09-12T21:00:42.459555+0000, chain.objs.size()=1 2024-09-12T19:13:58.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.274__shadow_.Yy-hOaUYUhIk6bKRE_Jb70OZZt84TTH_0 2024-09-12T19:13:58.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10720447789876623243', time=2024-09-12T21:00:56.710448+0000, chain.objs.size()=1 2024-09-12T19:13:58.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.292__shadow_.nVQ0AAZvPNrEizZKvZnmFpo03o6bz-4_0 2024-09-12T19:13:58.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5946676977856114156', time=2024-09-12T21:01:39.529588+0000, chain.objs.size()=1 2024-09-12T19:13:58.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.364+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.mOuTCS_gGbBLv8aJ5mk9Rf64tmZlLdp_0 2024-09-12T19:13:58.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2046342420664269165', time=2024-09-12T21:01:39.532754+0000, chain.objs.size()=1 2024-09-12T19:13:58.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Pj_RrDzp_ZjtXYnyHXQfl__khllM_MZ_0 2024-09-12T19:13:58.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8582446590249471090', time=2024-09-12T21:01:39.662402+0000, chain.objs.size()=1 2024-09-12T19:13:58.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hoYxB0fGu2aET5AUj5acTgA7hlqWLYO_0 2024-09-12T19:13:58.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11778149049765994601', time=2024-09-12T21:01:39.765325+0000, chain.objs.size()=1 2024-09-12T19:13:58.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.nZgATx4WJxioykNNvLlqWSZC_hRJ2NZ_0 2024-09-12T19:13:58.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13083322016942927647', time=2024-09-12T21:01:39.935369+0000, chain.objs.size()=1 2024-09-12T19:13:58.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.DhPOyK4_O_gd2qegK4JMdarR4dLC1Ld_0 2024-09-12T19:13:58.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13332433712344034040', time=2024-09-12T21:01:39.990447+0000, chain.objs.size()=1 2024-09-12T19:13:58.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.Nxnqo-GcrMnXTKhFTKa0oBv4x3FmhRX_0 2024-09-12T19:13:58.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14479380596347116026', time=2024-09-12T21:01:40.117188+0000, chain.objs.size()=1 2024-09-12T19:13:58.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.t7DfRenG9dSx7TdfykVBRZakbzbE_iw_0 2024-09-12T19:13:58.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2426626231198236820', time=2024-09-12T21:01:40.164491+0000, chain.objs.size()=1 2024-09-12T19:13:58.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ySoHZQ3yNqGilrSVa4FHf4ZI45mbeEB_0 2024-09-12T19:13:58.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16386262853662197914', time=2024-09-12T21:01:40.211346+0000, chain.objs.size()=1 2024-09-12T19:13:58.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.j-kvEhjmzulMgCn4okw3liz7WZzE4zt_0 2024-09-12T19:13:58.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.371069957692316104', time=2024-09-12T21:01:40.212102+0000, chain.objs.size()=1 2024-09-12T19:13:58.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.NjURREUbs_-m0EDyL2cg15Fs1Dat3zO_0 2024-09-12T19:13:58.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8482087997038386156', time=2024-09-12T21:01:40.214465+0000, chain.objs.size()=1 2024-09-12T19:13:58.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.oqXervfqEVzurbK_EHgM8IfFX1_M7a5_0 2024-09-12T19:13:58.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4196447605012910570', time=2024-09-12T21:01:40.365564+0000, chain.objs.size()=1 2024-09-12T19:13:58.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.iwMFYv3C3wJjFYy7aODpWWhkfvtGnUx_0 2024-09-12T19:13:58.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2463809879419149486', time=2024-09-12T21:01:40.418107+0000, chain.objs.size()=1 2024-09-12T19:13:58.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ZtFpAlw2BpyCuYMzGMc2BpUYZ_kdpte_0 2024-09-12T19:13:58.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8197501297119411018', time=2024-09-12T21:01:40.433493+0000, chain.objs.size()=1 2024-09-12T19:13:58.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BzTsNfhvy_huWHuVvn5Y0oDY57Ces-x_0 2024-09-12T19:13:58.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7597176537030886201', time=2024-09-12T21:01:40.436004+0000, chain.objs.size()=1 2024-09-12T19:13:58.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.BNMr3-P5DS-1RjOLnPgeG2T-KDk4bvv_0 2024-09-12T19:13:58.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14872981737948586970', time=2024-09-12T21:01:40.438802+0000, chain.objs.size()=1 2024-09-12T19:13:58.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.hgHR1dNa_mNonOldy0yiFDG9bN_eZro_0 2024-09-12T19:13:58.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16656607938318631339', time=2024-09-12T21:01:40.453488+0000, chain.objs.size()=1 2024-09-12T19:13:58.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.bTA84o22XEKmgsP-UKd7sYcOYEAxdqL_0 2024-09-12T19:13:58.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3913426918259375646', time=2024-09-12T21:01:40.556366+0000, chain.objs.size()=1 2024-09-12T19:13:58.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.bht1Be9G3akuubr_EjETDNUG8u3_Wwr_0 2024-09-12T19:13:58.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2809243870062160274', time=2024-09-12T21:01:40.581336+0000, chain.objs.size()=1 2024-09-12T19:13:58.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.51Q03qsqZn0yvnnz-9a3ef7e5gAr7L9_0 2024-09-12T19:13:58.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2423524098073678958', time=2024-09-12T21:01:40.599720+0000, chain.objs.size()=1 2024-09-12T19:13:58.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.NhZIm5vqRbHSfjd-BH-z309oKEIg5_Z_0 2024-09-12T19:13:58.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6642037796380136800', time=2024-09-12T21:01:40.643936+0000, chain.objs.size()=1 2024-09-12T19:13:58.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.ZznPFftT84KiA2KR35coQpCH4DE-agG_0 2024-09-12T19:13:58.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15838918385757733789', time=2024-09-12T21:01:40.648666+0000, chain.objs.size()=1 2024-09-12T19:13:58.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.JxdxBYOGtxSOmeX_l3-Q3pAgPlU314T_0 2024-09-12T19:13:58.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8657021322350036698', time=2024-09-12T21:01:40.673473+0000, chain.objs.size()=1 2024-09-12T19:13:58.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.368+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.HbGiTkczkYJScZ05LdeOj575iuuKkcD_0 2024-09-12T19:13:58.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10624959562335709936', time=2024-09-12T21:01:40.788995+0000, chain.objs.size()=1 2024-09-12T19:13:58.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.IqJqocJctCnwyXD3ej4VqvAyey-lq0E_0 2024-09-12T19:13:58.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11631901376224626812', time=2024-09-12T21:01:40.860512+0000, chain.objs.size()=1 2024-09-12T19:13:58.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.OiksPRX4mApZSzWK2-No7fdX-CvoeUO_0 2024-09-12T19:13:58.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5864878365618768471', time=2024-09-12T21:01:40.866003+0000, chain.objs.size()=1 2024-09-12T19:13:58.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.EKEZ31tCo2OoNeMqXI4OEiULmN82Usb_0 2024-09-12T19:13:58.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18403818788819897358', time=2024-09-12T21:01:40.870036+0000, chain.objs.size()=1 2024-09-12T19:13:58.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.pxKroWll_5LkdnDUuadu0U420rOlher_0 2024-09-12T19:13:58.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5262960986981691223', time=2024-09-12T21:01:40.879480+0000, chain.objs.size()=1 2024-09-12T19:13:58.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_._3zi3hmul7zKMoaa2xtME42kPDMvSw7_0 2024-09-12T19:13:58.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16928535275538930564', time=2024-09-12T21:01:41.086474+0000, chain.objs.size()=1 2024-09-12T19:13:58.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.323__shadow_.nkBs44IRW5oQZ3Ic2FJnaavyDt4ndZQ_0 2024-09-12T19:13:58.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15028638843640379185', time=2024-09-12T21:02:00.611065+0000, chain.objs.size()=1 2024-09-12T19:13:58.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.cYCzmZio7pJnf-hhJzGLsQLigLma1IA_0 2024-09-12T19:13:58.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8680557734041321244', time=2024-09-12T21:02:00.770024+0000, chain.objs.size()=1 2024-09-12T19:13:58.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.ml9l8CYkmLnS4I0A1Xs24LF3j9Sv2vK_0 2024-09-12T19:13:58.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3132147323193618963', time=2024-09-12T21:02:00.774647+0000, chain.objs.size()=1 2024-09-12T19:13:58.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.HyJ2FAavIdrOSGYQ40dIC4LTWxEDpmf_0 2024-09-12T19:13:58.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18073251630278846956', time=2024-09-12T21:02:00.791907+0000, chain.objs.size()=1 2024-09-12T19:13:58.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.xRB2IqAWxRAYRodZgj9csGv2nvwYNX6_0 2024-09-12T19:13:58.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.16365640679543335995', time=2024-09-12T21:02:00.868919+0000, chain.objs.size()=1 2024-09-12T19:13:58.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1HbSfQEG_iXHYsRfPnln1ANHWO0eJei_0 2024-09-12T19:13:58.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3024980419100965759', time=2024-09-12T21:02:01.019395+0000, chain.objs.size()=1 2024-09-12T19:13:58.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.h6ha1gqtJ4yQL08KXPPG3nzX7-CbKj6_0 2024-09-12T19:13:58.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6467801062232960839', time=2024-09-12T21:02:01.055116+0000, chain.objs.size()=1 2024-09-12T19:13:58.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.8UrKNVm70-UQgr6ouLHf-HLDpoZvo98_0 2024-09-12T19:13:58.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10407397672271760863', time=2024-09-12T21:02:01.109029+0000, chain.objs.size()=1 2024-09-12T19:13:58.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.dMzKdMJE3fJG2zi5ID2nHwN3dMrEIlL_0 2024-09-12T19:13:58.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5268504080791303695', time=2024-09-12T21:02:01.315128+0000, chain.objs.size()=1 2024-09-12T19:13:58.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.372+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.qUINg0NA4QdlKIn5CCHkD-SjAMCZtn8_0 2024-09-12T19:13:58.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10343765049837511170', time=2024-09-12T21:02:01.331296+0000, chain.objs.size()=1 2024-09-12T19:13:58.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.vifZoQrVNtLcsmo5JsjF61KiTEuiAcg_0 2024-09-12T19:13:58.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13242280225971265886', time=2024-09-12T21:02:01.444548+0000, chain.objs.size()=1 2024-09-12T19:13:58.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7YW1trLvc67gzYj7rx8lw-QTam4RXEA_0 2024-09-12T19:13:58.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8920833553860524516', time=2024-09-12T21:02:01.456177+0000, chain.objs.size()=1 2024-09-12T19:13:58.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.PNfu2IkZ1gXhB8dfOmYdBd6FTYxbCsb_0 2024-09-12T19:13:58.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1161216809764078791', time=2024-09-12T21:02:01.471440+0000, chain.objs.size()=1 2024-09-12T19:13:58.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.CjlXK2AijfJStpkJopGEfNISQELr3F3_0 2024-09-12T19:13:58.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2074867362090651210', time=2024-09-12T21:02:01.487291+0000, chain.objs.size()=1 2024-09-12T19:13:58.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.1YyvOmdeWXA8JK-osZFMq6Mzl7e7VBP_0 2024-09-12T19:13:58.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5947949071224520460', time=2024-09-12T21:02:01.493852+0000, chain.objs.size()=1 2024-09-12T19:13:58.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.2QIJ2Di2wxKzSuRLTRX0bllO6ien2UI_0 2024-09-12T19:13:58.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13098697338497183891', time=2024-09-12T21:02:01.503349+0000, chain.objs.size()=1 2024-09-12T19:13:58.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.BU5yl8VbMEHmXRm68SwT9dWiYREtcH7_0 2024-09-12T19:13:58.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.12143710481963473368', time=2024-09-12T21:02:01.669850+0000, chain.objs.size()=1 2024-09-12T19:13:58.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yI5yV-D-Py88Ie7kHv2Euy003YGLK9e_0 2024-09-12T19:13:58.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.1505318233425926795', time=2024-09-12T21:02:01.718804+0000, chain.objs.size()=1 2024-09-12T19:13:58.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Spga-LXHoEgcmcbS8DjLsbUFLPGSN00_0 2024-09-12T19:13:58.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5229319471105684748', time=2024-09-12T21:02:01.730369+0000, chain.objs.size()=1 2024-09-12T19:13:58.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.cL6edTccnnVSkZv6n4tb26uke_uWYYm_0 2024-09-12T19:13:58.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13113605649570393972', time=2024-09-12T21:02:01.752378+0000, chain.objs.size()=1 2024-09-12T19:13:58.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Hcalvaf3cbYGsZ9pW5z-hmnOeU7cniW_0 2024-09-12T19:13:58.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.13675878544184811429', time=2024-09-12T21:02:01.758480+0000, chain.objs.size()=1 2024-09-12T19:13:58.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.5aTSu1Xd4hyZJLWbEdqILvN1YoB74fM_0 2024-09-12T19:13:58.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.3938269888553836693', time=2024-09-12T21:02:01.762565+0000, chain.objs.size()=1 2024-09-12T19:13:58.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.Qnm1tgFJHpERtdEz2Gf-MgRDNmxxWau_0 2024-09-12T19:13:58.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5449111136660140411', time=2024-09-12T21:02:01.763346+0000, chain.objs.size()=1 2024-09-12T19:13:58.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.7UcikDwkuhm-DWuN6_9d5JNGvgDVlS8_0 2024-09-12T19:13:58.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14578686197071012434', time=2024-09-12T21:02:01.776265+0000, chain.objs.size()=1 2024-09-12T19:13:58.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.W46M2fkZ3u7ZDAh1PjWN8uyFT2EfraQ_0 2024-09-12T19:13:58.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17765035119578885396', time=2024-09-12T21:02:01.777379+0000, chain.objs.size()=1 2024-09-12T19:13:58.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.YEzUt9ow8TuyXLTaD1Kyuv8gBpP_SMH_0 2024-09-12T19:13:58.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14308281783419547172', time=2024-09-12T21:02:01.784954+0000, chain.objs.size()=1 2024-09-12T19:13:58.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.yXCB9bdeM4Nz2gLLxTJpTvWhUA823m1_0 2024-09-12T19:13:58.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8633739883387570454', time=2024-09-12T21:02:01.791834+0000, chain.objs.size()=1 2024-09-12T19:13:58.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.M2VwXjBi8N3SlNs2FvqjM_3SNIcWTZF_0 2024-09-12T19:13:58.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4479191010802955040', time=2024-09-12T21:02:01.943428+0000, chain.objs.size()=1 2024-09-12T19:13:58.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.azu39ujtFPwNd7mx2m5sF9mhKHHHSjq_0 2024-09-12T19:13:58.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11218976535915765358', time=2024-09-12T21:02:01.969723+0000, chain.objs.size()=1 2024-09-12T19:13:58.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.oEaJ5DI5BPtvzF01Q-FTMlO0BFgRHga_0 2024-09-12T19:13:58.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14962447998406339270', time=2024-09-12T21:02:02.007700+0000, chain.objs.size()=1 2024-09-12T19:13:58.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.zk2azHDRVfsD7wLZRdXime1ORoTaFSZ_0 2024-09-12T19:13:58.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2352576683218471886', time=2024-09-12T21:02:02.114195+0000, chain.objs.size()=1 2024-09-12T19:13:58.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.376+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.-BYFHyKKpGRZapTwFVLAEMpbana3cHg_0 2024-09-12T19:13:58.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.18430561401507708952', time=2024-09-12T21:02:02.181647+0000, chain.objs.size()=1 2024-09-12T19:13:58.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.lLESJ3wV8Ub4gsbuxh7C9__btUjDvEl_0 2024-09-12T19:13:58.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17735933853455898129', time=2024-09-12T21:02:02.205317+0000, chain.objs.size()=1 2024-09-12T19:13:58.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.324__shadow_.sRtpkCDvqA8V2wsvpCVezPN8CX-VV4j_0 2024-09-12T19:13:58.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9583050041518468758', time=2024-09-12T21:03:17.247677+0000, chain.objs.size()=1 2024-09-12T19:13:58.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.431__shadow_.QJ0Aj6hTqtCRgcizFSvzge9uBQIR7FN_0 2024-09-12T19:13:58.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.6929316909959725577', time=2024-09-12T21:03:39.175941+0000, chain.objs.size()=1 2024-09-12T19:13:58.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.458__shadow_.Ot_b9Fd_9dpAWgWViOwWfpN4P4eLKp2_0 2024-09-12T19:13:58.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5822570772726676679', time=2024-09-12T21:03:42.317610+0000, chain.objs.size()=1 2024-09-12T19:13:58.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.461__shadow_.-0H8AJ51YCOIZVg4u_zZkxZB3J3pVOH_0 2024-09-12T19:13:58.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.15919394642378570705', time=2024-09-12T21:03:55.575729+0000, chain.objs.size()=1 2024-09-12T19:13:58.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.483__shadow_.ZZ7Dn76p-xBvtFRz-e8iufV40hbkxD4_0 2024-09-12T19:13:58.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.17346287711898941697', time=2024-09-12T21:03:56.846841+0000, chain.objs.size()=1 2024-09-12T19:13:58.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.485__shadow_.hGecQzwUorh86o5J89fXGpHU9xRxsgx_0 2024-09-12T19:13:58.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.380+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47465 2024-09-12T19:13:58.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T19:13:58.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10195113711251456022', time=2024-09-12T21:04:09.519851+0000, chain.objs.size()=1 2024-09-12T19:13:58.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.503__shadow:36QYX6qQ2gzMos2OEErLcQNuKaa5Xm._.oMtp76uo7bZ28BaGhD6Iv-dVMP_rpSx_0 2024-09-12T19:13:58.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.11582637610602276341', time=2024-09-12T21:04:17.105608+0000, chain.objs.size()=1 2024-09-12T19:13:58.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.514__shadow_.wbVxSbgaAg2X3QvYLd-3rFy_ZYAKFk7_0 2024-09-12T19:13:58.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.244473669952462095', time=2024-09-12T21:04:50.652886+0000, chain.objs.size()=1 2024-09-12T19:13:58.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.525__multipart_mymultipart.2~pcpBFDba-h_q2x6BwFiF_B5zZws7Cdq.1 2024-09-12T19:13:58.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8880395426685417715', time=2024-09-12T21:04:51.117539+0000, chain.objs.size()=2 2024-09-12T19:13:58.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.525__multipart_mymultipart.2~IGkbLBoMf5OodRwjz9rk0LrXEROhaqz.1 2024-09-12T19:13:58.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.525__multipart_mymultipart.2~IGkbLBoMf5OodRwjz9rk0LrXEROhaqz.2 2024-09-12T19:13:58.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.14210478219675095655', time=2024-09-12T21:05:46.830862+0000, chain.objs.size()=1 2024-09-12T19:13:58.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.555__shadow_.SiEHq1tmkMWKk_oAOA_lTzwXt9VD2Wg_0 2024-09-12T19:13:58.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.9953690333762616369', time=2024-09-12T21:05:47.730639+0000, chain.objs.size()=1 2024-09-12T19:13:58.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.556__shadow_.IvEerPd2kBx6M_Nd1LhBbBANBoII7RB_0 2024-09-12T19:13:58.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8555197831032357861', time=2024-09-12T21:06:38.342239+0000, chain.objs.size()=1 2024-09-12T19:13:58.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.577__shadow:m-U.pBjjmj8vSUfzXNmvjEIClLSoIgq_.M1l6YuLBZg-pvL6kR42WYHMxggLlG4h_0 2024-09-12T19:13:58.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.2123420137557989735', time=2024-09-12T21:06:46.355425+0000, chain.objs.size()=1 2024-09-12T19:13:58.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.579__shadow:AruF50vd.eERLOPCUPn96-LW3B9PRSf_.WjFPL7dQJOSSSCTzlBhVUxuLstiYYDl_0 2024-09-12T19:13:58.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.5581681890920635520', time=2024-09-12T21:06:53.762138+0000, chain.objs.size()=1 2024-09-12T19:13:58.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.587__shadow:y2nNwTUAHTtsKeoTthI7H7JdHcN.047_.3eq5FsyDHCPMQYM0Ni35s6zIqV_H_FF_0 2024-09-12T19:13:58.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.8434486781169322802', time=2024-09-12T21:09:46.465921+0000, chain.objs.size()=1 2024-09-12T19:13:58.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.640__shadow_.gt-MSfGEx8MXOnUSX4f6GVshu-C66my_0 2024-09-12T19:13:58.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.10375702496186438614', time=2024-09-12T21:10:12.300690+0000, chain.objs.size()=1 2024-09-12T19:13:58.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.672__shadow_.pqrIrGbee0BJ5pxjJRFwhnAXek9zP93_0 2024-09-12T19:13:58.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.7463348749822661677', time=2024-09-12T21:10:27.748347+0000, chain.objs.size()=1 2024-09-12T19:13:58.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.696__shadow:f2Z5vs5q17P.Sbq-VToSH-SipdA0DdP_.JZkpCCeb2Rk7GxckB7PvnvZjPkkGHA__0 2024-09-12T19:13:58.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 20 garbage collection: RGWGC::process iterating over entry tag='97c2b296-1395-4700-8053-4f06c4c86557.4689.4277623944633958645', time=2024-09-12T21:10:34.793309+0000, chain.objs.size()=1 2024-09-12T19:13:58.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.384+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:97c2b296-1395-4700-8053-4f06c4c86557.4689.706__shadow_.Ov7Zg62xhrsF6tdDKapaVLvpKdlUTWC_0 2024-09-12T19:13:58.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.388+0000 7fe6722349c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T19:13:58.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.388+0000 7fe525fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T19:13:58.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.392+0000 7fe6722349c0 20 remove_watcher() i=0 2024-09-12T19:13:58.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.392+0000 7fe6722349c0 2 removed watcher, disabling cache 2024-09-12T19:13:58.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.392+0000 7fe6722349c0 20 remove_watcher() i=1 2024-09-12T19:13:58.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.392+0000 7fe6722349c0 20 remove_watcher() i=2 2024-09-12T19:13:58.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.396+0000 7fe6722349c0 20 remove_watcher() i=3 2024-09-12T19:13:58.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.396+0000 7fe6722349c0 20 remove_watcher() i=4 2024-09-12T19:13:58.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.396+0000 7fe6722349c0 20 remove_watcher() i=5 2024-09-12T19:13:58.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.396+0000 7fe6722349c0 20 remove_watcher() i=6 2024-09-12T19:13:58.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-12T19:13:58.400+0000 7fe6722349c0 20 remove_watcher() i=7 2024-09-12T19:13:58.413 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T19:13:58.426 DEBUG:teuthology.orchestra.run.smithi111:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-12T19:13:58.457 DEBUG:teuthology.orchestra.run.smithi111:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T19:13:58.506 DEBUG:teuthology.orchestra.run.smithi111:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-12T19:13:58.554 DEBUG:teuthology.orchestra.run.smithi111:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T19:13:58.602 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm /usr/local/share/ca-certificates/root.crt 2024-09-12T19:13:58.658 DEBUG:teuthology.orchestra.run.smithi111:> sudo update-ca-certificates 2024-09-12T19:13:58.714 INFO:teuthology.orchestra.run.smithi111.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T19:13:59.034 INFO:teuthology.orchestra.run.smithi111.stdout:0 added, 0 removed; done. 2024-09-12T19:13:59.034 INFO:teuthology.orchestra.run.smithi111.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T19:13:59.036 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:13:59.225 INFO:teuthology.orchestra.run.smithi111.stdout:done. 2024-09-12T19:13:59.225 INFO:teuthology.orchestra.run.smithi111.stdout:done. 2024-09-12T19:13:59.228 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T19:13:59.239 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T19:13:59.239 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:13:59.589 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:13:59.604 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-09-12T19:13:59.610 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":1688,"stamp":"2024-09-12T19:13:58.439072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":612115279,"num_objects":4346,"num_object_clones":0,"num_object_copies":8692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4346,"num_whiteouts":0,"num_read":286049,"num_read_kb":2547458,"num_write":157600,"num_write_kb":2466739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13558,"ondisk_log_size":13558,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2782636,"kb_used_data":1343612,"kb_used_omap":12,"kb_used_meta":1438835,"kb_avail":752192084,"statfs":{"total":773094113280,"available":770244694016,"internally_reserved":0,"allocated":1375858688,"data_stored":1333760428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1473367603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-106503838,"num_objects":-655,"num_object_clones":0,"num_object_copies":-1310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-655,"num_whiteouts":0,"num_read":814,"num_read_kb":689,"num_write":700,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007761"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.893148+0000","last_change":"2024-09-12T18:55:19.125750+0000","last_active":"2024-09-12T19:10:18.893148+0000","last_peered":"2024-09-12T19:10:18.893148+0000","last_clean":"2024-09-12T19:10:18.893148+0000","last_became_active":"2024-09-12T18:55:19.125009+0000","last_became_peered":"2024-09-12T18:55:19.125009+0000","last_unstale":"2024-09-12T19:10:18.893148+0000","last_undegraded":"2024-09-12T19:10:18.893148+0000","last_fullsized":"2024-09-12T19:10:18.893148+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:07.599229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.902941+0000","last_change":"2024-09-12T18:43:32.909745+0000","last_active":"2024-09-12T19:11:03.902941+0000","last_peered":"2024-09-12T19:11:03.902941+0000","last_clean":"2024-09-12T19:11:03.902941+0000","last_became_active":"2024-09-12T18:43:32.908691+0000","last_became_peered":"2024-09-12T18:43:32.908691+0000","last_unstale":"2024-09-12T19:11:03.902941+0000","last_undegraded":"2024-09-12T19:11:03.902941+0000","last_fullsized":"2024-09-12T19:11:03.902941+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:19.818191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.926901+0000","last_change":"2024-09-12T18:43:29.867175+0000","last_active":"2024-09-12T19:10:58.926901+0000","last_peered":"2024-09-12T19:10:58.926901+0000","last_clean":"2024-09-12T19:10:58.926901+0000","last_became_active":"2024-09-12T18:43:29.866493+0000","last_became_peered":"2024-09-12T18:43:29.866493+0000","last_unstale":"2024-09-12T19:10:58.926901+0000","last_undegraded":"2024-09-12T19:10:58.926901+0000","last_fullsized":"2024-09-12T19:10:58.926901+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:56.771077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'18","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.928758+0000","last_change":"2024-09-12T18:41:45.362583+0000","last_active":"2024-09-12T19:10:58.928758+0000","last_peered":"2024-09-12T19:10:58.928758+0000","last_clean":"2024-09-12T19:10:58.928758+0000","last_became_active":"2024-09-12T18:41:45.361841+0000","last_became_peered":"2024-09-12T18:41:45.361841+0000","last_unstale":"2024-09-12T19:10:58.928758+0000","last_undegraded":"2024-09-12T19:10:58.928758+0000","last_fullsized":"2024-09-12T19:10:58.928758+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:31.032849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":66,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.881812+0000","last_change":"2024-09-12T18:55:19.153318+0000","last_active":"2024-09-12T19:10:18.881812+0000","last_peered":"2024-09-12T19:10:18.881812+0000","last_clean":"2024-09-12T19:10:18.881812+0000","last_became_active":"2024-09-12T18:55:19.150059+0000","last_became_peered":"2024-09-12T18:55:19.150059+0000","last_unstale":"2024-09-12T19:10:18.881812+0000","last_undegraded":"2024-09-12T19:10:18.881812+0000","last_fullsized":"2024-09-12T19:10:18.881812+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:04.495819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:04.112646+0000","last_change":"2024-09-12T18:43:32.905639+0000","last_active":"2024-09-12T19:11:04.112646+0000","last_peered":"2024-09-12T19:11:04.112646+0000","last_clean":"2024-09-12T19:11:04.112646+0000","last_became_active":"2024-09-12T18:43:32.904914+0000","last_became_peered":"2024-09-12T18:43:32.904914+0000","last_unstale":"2024-09-12T19:11:04.112646+0000","last_undegraded":"2024-09-12T19:11:04.112646+0000","last_fullsized":"2024-09-12T19:11:04.112646+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:47.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:32.741144+0000","last_change":"2024-09-12T18:43:29.895683+0000","last_active":"2024-09-12T19:13:32.741144+0000","last_peered":"2024-09-12T19:13:32.741144+0000","last_clean":"2024-09-12T19:13:32.741144+0000","last_became_active":"2024-09-12T18:43:29.891221+0000","last_became_peered":"2024-09-12T18:43:29.891221+0000","last_unstale":"2024-09-12T19:13:32.741144+0000","last_undegraded":"2024-09-12T19:13:32.741144+0000","last_fullsized":"2024-09-12T19:13:32.741144+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:28.583040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'32","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.876821+0000","last_change":"2024-09-12T18:41:45.362441+0000","last_active":"2024-09-12T19:09:53.876821+0000","last_peered":"2024-09-12T19:09:53.876821+0000","last_clean":"2024-09-12T19:09:53.876821+0000","last_became_active":"2024-09-12T18:41:45.361664+0000","last_became_peered":"2024-09-12T18:41:45.361664+0000","last_unstale":"2024-09-12T19:09:53.876821+0000","last_undegraded":"2024-09-12T19:09:53.876821+0000","last_fullsized":"2024-09-12T19:09:53.876821+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:16.353573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.888584+0000","last_change":"2024-09-12T18:55:19.120410+0000","last_active":"2024-09-12T19:09:48.888584+0000","last_peered":"2024-09-12T19:09:48.888584+0000","last_clean":"2024-09-12T19:09:48.888584+0000","last_became_active":"2024-09-12T18:55:19.119601+0000","last_became_peered":"2024-09-12T18:55:19.119601+0000","last_unstale":"2024-09-12T19:09:48.888584+0000","last_undegraded":"2024-09-12T19:09:48.888584+0000","last_fullsized":"2024-09-12T19:09:48.888584+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:00.200110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.923902+0000","last_change":"2024-09-12T18:43:32.917442+0000","last_active":"2024-09-12T19:10:38.923902+0000","last_peered":"2024-09-12T19:10:38.923902+0000","last_clean":"2024-09-12T19:10:38.923902+0000","last_became_active":"2024-09-12T18:43:32.916727+0000","last_became_peered":"2024-09-12T18:43:32.916727+0000","last_unstale":"2024-09-12T19:10:38.923902+0000","last_undegraded":"2024-09-12T19:10:38.923902+0000","last_fullsized":"2024-09-12T19:10:38.923902+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:51.785407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12290,"num_write":7,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"265'14","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.714674+0000","last_change":"2024-09-12T18:43:29.884424+0000","last_active":"2024-09-12T19:11:38.714674+0000","last_peered":"2024-09-12T19:11:38.714674+0000","last_clean":"2024-09-12T19:11:38.714674+0000","last_became_active":"2024-09-12T18:43:29.881401+0000","last_became_peered":"2024-09-12T18:43:29.881401+0000","last_unstale":"2024-09-12T19:11:38.714674+0000","last_undegraded":"2024-09-12T19:11:38.714674+0000","last_fullsized":"2024-09-12T19:11:38.714674+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:45.030211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":40962,"num_write":19,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'47","reported_seq":173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:04.762249+0000","last_change":"2024-09-12T18:41:45.360114+0000","last_active":"2024-09-12T19:10:04.762249+0000","last_peered":"2024-09-12T19:10:04.762249+0000","last_clean":"2024-09-12T19:10:04.762249+0000","last_became_active":"2024-09-12T18:41:45.350377+0000","last_became_peered":"2024-09-12T18:41:45.350377+0000","last_unstale":"2024-09-12T19:10:04.762249+0000","last_undegraded":"2024-09-12T19:10:04.762249+0000","last_fullsized":"2024-09-12T19:10:04.762249+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:15.485612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":164,"num_write":88,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.910960+0000","last_change":"2024-09-12T18:55:19.136469+0000","last_active":"2024-09-12T19:09:53.910960+0000","last_peered":"2024-09-12T19:09:53.910960+0000","last_clean":"2024-09-12T19:09:53.910960+0000","last_became_active":"2024-09-12T18:55:19.135875+0000","last_became_peered":"2024-09-12T18:55:19.135875+0000","last_unstale":"2024-09-12T19:09:53.910960+0000","last_undegraded":"2024-09-12T19:09:53.910960+0000","last_fullsized":"2024-09-12T19:09:53.910960+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:50.008510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'1","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.716115+0000","last_change":"2024-09-12T18:43:32.939294+0000","last_active":"2024-09-12T19:11:43.716115+0000","last_peered":"2024-09-12T19:11:43.716115+0000","last_clean":"2024-09-12T19:11:43.716115+0000","last_became_active":"2024-09-12T18:43:32.935176+0000","last_became_peered":"2024-09-12T18:43:32.935176+0000","last_unstale":"2024-09-12T19:11:43.716115+0000","last_undegraded":"2024-09-12T19:11:43.716115+0000","last_fullsized":"2024-09-12T19:11:43.716115+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:27.896775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:39.107194+0000","last_change":"2024-09-12T18:43:29.873805+0000","last_active":"2024-09-12T19:10:39.107194+0000","last_peered":"2024-09-12T19:10:39.107194+0000","last_clean":"2024-09-12T19:10:39.107194+0000","last_became_active":"2024-09-12T18:43:29.873115+0000","last_became_peered":"2024-09-12T18:43:29.873115+0000","last_unstale":"2024-09-12T19:10:39.107194+0000","last_undegraded":"2024-09-12T19:10:39.107194+0000","last_fullsized":"2024-09-12T19:10:39.107194+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:22.098039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'47","reported_seq":168,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.878251+0000","last_change":"2024-09-12T18:41:45.350781+0000","last_active":"2024-09-12T19:11:19.878251+0000","last_peered":"2024-09-12T19:11:19.878251+0000","last_clean":"2024-09-12T19:11:19.878251+0000","last_became_active":"2024-09-12T18:41:45.350035+0000","last_became_peered":"2024-09-12T18:41:45.350035+0000","last_unstale":"2024-09-12T19:11:19.878251+0000","last_undegraded":"2024-09-12T19:11:19.878251+0000","last_fullsized":"2024-09-12T19:11:19.878251+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:07.679045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":157,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:28.712218+0000","last_change":"2024-09-12T18:55:19.157689+0000","last_active":"2024-09-12T19:11:28.712218+0000","last_peered":"2024-09-12T19:11:28.712218+0000","last_clean":"2024-09-12T19:11:28.712218+0000","last_became_active":"2024-09-12T18:55:19.156936+0000","last_became_peered":"2024-09-12T18:55:19.156936+0000","last_unstale":"2024-09-12T19:11:28.712218+0000","last_undegraded":"2024-09-12T19:11:28.712218+0000","last_fullsized":"2024-09-12T19:11:28.712218+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:02.316107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.893085+0000","last_change":"2024-09-12T18:43:32.931532+0000","last_active":"2024-09-12T19:10:18.893085+0000","last_peered":"2024-09-12T19:10:18.893085+0000","last_clean":"2024-09-12T19:10:18.893085+0000","last_became_active":"2024-09-12T18:43:32.930772+0000","last_became_peered":"2024-09-12T18:43:32.930772+0000","last_unstale":"2024-09-12T19:10:18.893085+0000","last_undegraded":"2024-09-12T19:10:18.893085+0000","last_fullsized":"2024-09-12T19:10:18.893085+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:02.364155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'1","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.915522+0000","last_change":"2024-09-12T18:43:29.884425+0000","last_active":"2024-09-12T19:10:08.915522+0000","last_peered":"2024-09-12T19:10:08.915522+0000","last_clean":"2024-09-12T19:10:08.915522+0000","last_became_active":"2024-09-12T18:43:29.883399+0000","last_became_peered":"2024-09-12T18:43:29.883399+0000","last_unstale":"2024-09-12T19:10:08.915522+0000","last_undegraded":"2024-09-12T19:10:08.915522+0000","last_fullsized":"2024-09-12T19:10:08.915522+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:31.245225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'25","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:31.792096+0000","last_change":"2024-09-12T18:41:45.359067+0000","last_active":"2024-09-12T19:10:31.792096+0000","last_peered":"2024-09-12T19:10:31.792096+0000","last_clean":"2024-09-12T19:10:31.792096+0000","last_became_active":"2024-09-12T18:41:45.355180+0000","last_became_peered":"2024-09-12T18:41:45.355180+0000","last_unstale":"2024-09-12T19:10:31.792096+0000","last_undegraded":"2024-09-12T19:10:31.792096+0000","last_fullsized":"2024-09-12T19:10:31.792096+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:27.390592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:57.900836+0000","last_change":"2024-09-12T18:55:19.139208+0000","last_active":"2024-09-12T19:09:57.900836+0000","last_peered":"2024-09-12T19:09:57.900836+0000","last_clean":"2024-09-12T19:09:57.900836+0000","last_became_active":"2024-09-12T18:55:19.138472+0000","last_became_peered":"2024-09-12T18:55:19.138472+0000","last_unstale":"2024-09-12T19:09:57.900836+0000","last_undegraded":"2024-09-12T19:09:57.900836+0000","last_fullsized":"2024-09-12T19:09:57.900836+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:46.378454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.893333+0000","last_change":"2024-09-12T18:43:32.936388+0000","last_active":"2024-09-12T19:10:08.893333+0000","last_peered":"2024-09-12T19:10:08.893333+0000","last_clean":"2024-09-12T19:10:08.893333+0000","last_became_active":"2024-09-12T18:43:32.935898+0000","last_became_peered":"2024-09-12T18:43:32.935898+0000","last_unstale":"2024-09-12T19:10:08.893333+0000","last_undegraded":"2024-09-12T19:10:08.893333+0000","last_fullsized":"2024-09-12T19:10:08.893333+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:23.395289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'1","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:09.100142+0000","last_change":"2024-09-12T18:43:29.885221+0000","last_active":"2024-09-12T19:10:09.100142+0000","last_peered":"2024-09-12T19:10:09.100142+0000","last_clean":"2024-09-12T19:10:09.100142+0000","last_became_active":"2024-09-12T18:43:29.882621+0000","last_became_peered":"2024-09-12T18:43:29.882621+0000","last_unstale":"2024-09-12T19:10:09.100142+0000","last_undegraded":"2024-09-12T19:10:09.100142+0000","last_fullsized":"2024-09-12T19:10:09.100142+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:41.071383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'16","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.882329+0000","last_change":"2024-09-12T18:41:45.358702+0000","last_active":"2024-09-12T19:09:18.882329+0000","last_peered":"2024-09-12T19:09:18.882329+0000","last_clean":"2024-09-12T19:09:18.882329+0000","last_became_active":"2024-09-12T18:41:45.357957+0000","last_became_peered":"2024-09-12T18:41:45.357957+0000","last_unstale":"2024-09-12T19:09:18.882329+0000","last_undegraded":"2024-09-12T19:09:18.882329+0000","last_fullsized":"2024-09-12T19:09:18.882329+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:45.441066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":53,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899753+0000","last_change":"2024-09-12T18:55:19.148993+0000","last_active":"2024-09-12T19:10:22.899753+0000","last_peered":"2024-09-12T19:10:22.899753+0000","last_clean":"2024-09-12T19:10:22.899753+0000","last_became_active":"2024-09-12T18:55:19.147110+0000","last_became_peered":"2024-09-12T18:55:19.147110+0000","last_unstale":"2024-09-12T19:10:22.899753+0000","last_undegraded":"2024-09-12T19:10:22.899753+0000","last_fullsized":"2024-09-12T19:10:22.899753+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:46.858987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.905541+0000","last_change":"2024-09-12T18:43:32.923207+0000","last_active":"2024-09-12T19:11:03.905541+0000","last_peered":"2024-09-12T19:11:03.905541+0000","last_clean":"2024-09-12T19:11:03.905541+0000","last_became_active":"2024-09-12T18:43:32.922514+0000","last_became_peered":"2024-09-12T18:43:32.922514+0000","last_unstale":"2024-09-12T19:11:03.905541+0000","last_undegraded":"2024-09-12T19:11:03.905541+0000","last_fullsized":"2024-09-12T19:11:03.905541+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:30.175347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:04.112553+0000","last_change":"2024-09-12T18:43:29.905017+0000","last_active":"2024-09-12T19:11:04.112553+0000","last_peered":"2024-09-12T19:11:04.112553+0000","last_clean":"2024-09-12T19:11:04.112553+0000","last_became_active":"2024-09-12T18:43:29.904226+0000","last_became_peered":"2024-09-12T18:43:29.904226+0000","last_unstale":"2024-09-12T19:11:04.112553+0000","last_undegraded":"2024-09-12T19:11:04.112553+0000","last_fullsized":"2024-09-12T19:11:04.112553+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:47.238023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'21","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:53.927298+0000","last_change":"2024-09-12T18:41:45.359716+0000","last_active":"2024-09-12T19:10:53.927298+0000","last_peered":"2024-09-12T19:10:53.927298+0000","last_clean":"2024-09-12T19:10:53.927298+0000","last_became_active":"2024-09-12T18:41:45.351791+0000","last_became_peered":"2024-09-12T18:41:45.351791+0000","last_unstale":"2024-09-12T19:10:53.927298+0000","last_undegraded":"2024-09-12T19:10:53.927298+0000","last_fullsized":"2024-09-12T19:10:53.927298+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:10.883167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899885+0000","last_change":"2024-09-12T18:55:19.149601+0000","last_active":"2024-09-12T19:10:22.899885+0000","last_peered":"2024-09-12T19:10:22.899885+0000","last_clean":"2024-09-12T19:10:22.899885+0000","last_became_active":"2024-09-12T18:55:19.148859+0000","last_became_peered":"2024-09-12T18:55:19.148859+0000","last_unstale":"2024-09-12T19:10:22.899885+0000","last_undegraded":"2024-09-12T19:10:22.899885+0000","last_fullsized":"2024-09-12T19:10:22.899885+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:12.702998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.928529+0000","last_change":"2024-09-12T18:43:32.937883+0000","last_active":"2024-09-12T19:11:03.928529+0000","last_peered":"2024-09-12T19:11:03.928529+0000","last_clean":"2024-09-12T19:11:03.928529+0000","last_became_active":"2024-09-12T18:43:32.935669+0000","last_became_peered":"2024-09-12T18:43:32.935669+0000","last_unstale":"2024-09-12T19:11:03.928529+0000","last_undegraded":"2024-09-12T19:11:03.928529+0000","last_fullsized":"2024-09-12T19:11:03.928529+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:02.525737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.930224+0000","last_change":"2024-09-12T18:43:29.884274+0000","last_active":"2024-09-12T19:11:03.930224+0000","last_peered":"2024-09-12T19:11:03.930224+0000","last_clean":"2024-09-12T19:11:03.930224+0000","last_became_active":"2024-09-12T18:43:29.883324+0000","last_became_peered":"2024-09-12T18:43:29.883324+0000","last_unstale":"2024-09-12T19:11:03.930224+0000","last_undegraded":"2024-09-12T19:11:03.930224+0000","last_fullsized":"2024-09-12T19:11:03.930224+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.971344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'60","reported_seq":219,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:14.482064+0000","last_change":"2024-09-12T18:41:45.345965+0000","last_active":"2024-09-12T19:11:14.482064+0000","last_peered":"2024-09-12T19:11:14.482064+0000","last_clean":"2024-09-12T19:11:14.482064+0000","last_became_active":"2024-09-12T18:41:45.339369+0000","last_became_peered":"2024-09-12T18:41:45.339369+0000","last_unstale":"2024-09-12T19:11:14.482064+0000","last_undegraded":"2024-09-12T19:11:14.482064+0000","last_fullsized":"2024-09-12T19:11:14.482064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:10.411652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":229,"num_write":103,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:22.892454+0000","last_change":"2024-09-12T18:55:19.123103+0000","last_active":"2024-09-12T19:09:22.892454+0000","last_peered":"2024-09-12T19:09:22.892454+0000","last_clean":"2024-09-12T19:09:22.892454+0000","last_became_active":"2024-09-12T18:55:19.122414+0000","last_became_peered":"2024-09-12T18:55:19.122414+0000","last_unstale":"2024-09-12T19:09:22.892454+0000","last_undegraded":"2024-09-12T19:09:22.892454+0000","last_fullsized":"2024-09-12T19:09:22.892454+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:12.271436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.914646+0000","last_change":"2024-09-12T18:43:32.927238+0000","last_active":"2024-09-12T19:10:08.914646+0000","last_peered":"2024-09-12T19:10:08.914646+0000","last_clean":"2024-09-12T19:10:08.914646+0000","last_became_active":"2024-09-12T18:43:32.924570+0000","last_became_peered":"2024-09-12T18:43:32.924570+0000","last_unstale":"2024-09-12T19:10:08.914646+0000","last_undegraded":"2024-09-12T19:10:08.914646+0000","last_fullsized":"2024-09-12T19:10:08.914646+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:12.682450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'1","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.879155+0000","last_change":"2024-09-12T18:43:29.869397+0000","last_active":"2024-09-12T19:09:18.879155+0000","last_peered":"2024-09-12T19:09:18.879155+0000","last_clean":"2024-09-12T19:09:18.879155+0000","last_became_active":"2024-09-12T18:43:29.868738+0000","last_became_peered":"2024-09-12T18:43:29.868738+0000","last_unstale":"2024-09-12T19:09:18.879155+0000","last_undegraded":"2024-09-12T19:09:18.879155+0000","last_fullsized":"2024-09-12T19:09:18.879155+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:27.215594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'11","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.926325+0000","last_change":"2024-09-12T18:41:45.352288+0000","last_active":"2024-09-12T19:10:48.926325+0000","last_peered":"2024-09-12T19:10:48.926325+0000","last_clean":"2024-09-12T19:10:48.926325+0000","last_became_active":"2024-09-12T18:41:45.351553+0000","last_became_peered":"2024-09-12T18:41:45.351553+0000","last_unstale":"2024-09-12T19:10:48.926325+0000","last_undegraded":"2024-09-12T19:10:48.926325+0000","last_fullsized":"2024-09-12T19:10:48.926325+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:04.726575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":29,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.869417+0000","last_change":"2024-09-12T18:55:19.139323+0000","last_active":"2024-09-12T19:09:18.869417+0000","last_peered":"2024-09-12T19:09:18.869417+0000","last_clean":"2024-09-12T19:09:18.869417+0000","last_became_active":"2024-09-12T18:55:19.138649+0000","last_became_peered":"2024-09-12T18:55:19.138649+0000","last_unstale":"2024-09-12T19:09:18.869417+0000","last_undegraded":"2024-09-12T19:09:18.869417+0000","last_fullsized":"2024-09-12T19:09:18.869417+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:14.966478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.902275+0000","last_change":"2024-09-12T18:43:32.928110+0000","last_active":"2024-09-12T19:09:18.902275+0000","last_peered":"2024-09-12T19:09:18.902275+0000","last_clean":"2024-09-12T19:09:18.902275+0000","last_became_active":"2024-09-12T18:43:32.927181+0000","last_became_peered":"2024-09-12T18:43:32.927181+0000","last_unstale":"2024-09-12T19:09:18.902275+0000","last_undegraded":"2024-09-12T19:09:18.902275+0000","last_fullsized":"2024-09-12T19:09:18.902275+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:23.355481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'8","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.896153+0000","last_change":"2024-09-12T18:43:29.895323+0000","last_active":"2024-09-12T19:10:07.896153+0000","last_peered":"2024-09-12T19:10:07.896153+0000","last_clean":"2024-09-12T19:10:07.896153+0000","last_became_active":"2024-09-12T18:43:29.894650+0000","last_became_peered":"2024-09-12T18:43:29.894650+0000","last_unstale":"2024-09-12T19:10:07.896153+0000","last_undegraded":"2024-09-12T19:10:07.896153+0000","last_fullsized":"2024-09-12T19:10:07.896153+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:51.742629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8194,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'29","reported_seq":121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.891219+0000","last_change":"2024-09-12T18:41:45.361458+0000","last_active":"2024-09-12T19:11:19.891219+0000","last_peered":"2024-09-12T19:11:19.891219+0000","last_clean":"2024-09-12T19:11:19.891219+0000","last_became_active":"2024-09-12T18:41:45.360856+0000","last_became_peered":"2024-09-12T18:41:45.360856+0000","last_unstale":"2024-09-12T19:11:19.891219+0000","last_undegraded":"2024-09-12T19:11:19.891219+0000","last_fullsized":"2024-09-12T19:11:19.891219+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.915436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":92,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:22.884390+0000","last_change":"2024-09-12T18:55:19.126091+0000","last_active":"2024-09-12T19:09:22.884390+0000","last_peered":"2024-09-12T19:09:22.884390+0000","last_clean":"2024-09-12T19:09:22.884390+0000","last_became_active":"2024-09-12T18:55:19.123727+0000","last_became_peered":"2024-09-12T18:55:19.123727+0000","last_unstale":"2024-09-12T19:09:22.884390+0000","last_undegraded":"2024-09-12T19:09:22.884390+0000","last_fullsized":"2024-09-12T19:09:22.884390+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:20.999734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.914770+0000","last_change":"2024-09-12T18:43:32.935321+0000","last_active":"2024-09-12T19:10:08.914770+0000","last_peered":"2024-09-12T19:10:08.914770+0000","last_clean":"2024-09-12T19:10:08.914770+0000","last_became_active":"2024-09-12T18:43:32.934654+0000","last_became_peered":"2024-09-12T18:43:32.934654+0000","last_unstale":"2024-09-12T19:10:08.914770+0000","last_undegraded":"2024-09-12T19:10:08.914770+0000","last_fullsized":"2024-09-12T19:10:08.914770+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:18.460691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.878771+0000","last_change":"2024-09-12T18:43:29.865882+0000","last_active":"2024-09-12T19:10:03.878771+0000","last_peered":"2024-09-12T19:10:03.878771+0000","last_clean":"2024-09-12T19:10:03.878771+0000","last_became_active":"2024-09-12T18:43:29.863876+0000","last_became_peered":"2024-09-12T18:43:29.863876+0000","last_unstale":"2024-09-12T19:10:03.878771+0000","last_undegraded":"2024-09-12T19:10:03.878771+0000","last_fullsized":"2024-09-12T19:10:03.878771+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:17.118378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'15","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.888129+0000","last_change":"2024-09-12T18:41:45.347581+0000","last_active":"2024-09-12T19:10:48.888129+0000","last_peered":"2024-09-12T19:10:48.888129+0000","last_clean":"2024-09-12T19:10:48.888129+0000","last_became_active":"2024-09-12T18:41:45.346831+0000","last_became_peered":"2024-09-12T18:41:45.346831+0000","last_unstale":"2024-09-12T19:10:48.888129+0000","last_undegraded":"2024-09-12T19:10:48.888129+0000","last_fullsized":"2024-09-12T19:10:48.888129+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:46.368160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":48,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.879056+0000","last_change":"2024-09-12T18:55:19.129602+0000","last_active":"2024-09-12T19:09:18.879056+0000","last_peered":"2024-09-12T19:09:18.879056+0000","last_clean":"2024-09-12T19:09:18.879056+0000","last_became_active":"2024-09-12T18:55:19.125607+0000","last_became_peered":"2024-09-12T18:55:19.125607+0000","last_unstale":"2024-09-12T19:09:18.879056+0000","last_undegraded":"2024-09-12T19:09:18.879056+0000","last_fullsized":"2024-09-12T19:09:18.879056+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:37.974980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:09.100279+0000","last_change":"2024-09-12T18:43:32.909634+0000","last_active":"2024-09-12T19:10:09.100279+0000","last_peered":"2024-09-12T19:10:09.100279+0000","last_clean":"2024-09-12T19:10:09.100279+0000","last_became_active":"2024-09-12T18:43:32.908905+0000","last_became_peered":"2024-09-12T18:43:32.908905+0000","last_unstale":"2024-09-12T19:10:09.100279+0000","last_undegraded":"2024-09-12T19:10:09.100279+0000","last_fullsized":"2024-09-12T19:10:09.100279+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:55.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'6","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.915861+0000","last_change":"2024-09-12T18:43:29.883172+0000","last_active":"2024-09-12T19:10:08.915861+0000","last_peered":"2024-09-12T19:10:08.915861+0000","last_clean":"2024-09-12T19:10:08.915861+0000","last_became_active":"2024-09-12T18:43:29.880462+0000","last_became_peered":"2024-09-12T18:43:29.880462+0000","last_unstale":"2024-09-12T19:10:08.915861+0000","last_undegraded":"2024-09-12T19:10:08.915861+0000","last_fullsized":"2024-09-12T19:10:08.915861+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.795034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'6","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:57.892839+0000","last_change":"2024-09-12T18:41:45.360552+0000","last_active":"2024-09-12T19:09:57.892839+0000","last_peered":"2024-09-12T19:09:57.892839+0000","last_clean":"2024-09-12T19:09:57.892839+0000","last_became_active":"2024-09-12T18:41:45.359794+0000","last_became_peered":"2024-09-12T18:41:45.359794+0000","last_unstale":"2024-09-12T19:09:57.892839+0000","last_undegraded":"2024-09-12T19:09:57.892839+0000","last_fullsized":"2024-09-12T19:09:57.892839+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:00.750042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.910032+0000","last_change":"2024-09-12T18:55:19.154082+0000","last_active":"2024-09-12T19:09:48.910032+0000","last_peered":"2024-09-12T19:09:48.910032+0000","last_clean":"2024-09-12T19:09:48.910032+0000","last_became_active":"2024-09-12T18:55:19.152807+0000","last_became_peered":"2024-09-12T18:55:19.152807+0000","last_unstale":"2024-09-12T19:09:48.910032+0000","last_undegraded":"2024-09-12T19:09:48.910032+0000","last_fullsized":"2024-09-12T19:09:48.910032+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:33.926655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715438+0000","last_change":"2024-09-12T18:43:32.903978+0000","last_active":"2024-09-12T19:11:32.715438+0000","last_peered":"2024-09-12T19:11:32.715438+0000","last_clean":"2024-09-12T19:11:32.715438+0000","last_became_active":"2024-09-12T18:43:32.899988+0000","last_became_peered":"2024-09-12T18:43:32.899988+0000","last_unstale":"2024-09-12T19:11:32.715438+0000","last_undegraded":"2024-09-12T19:11:32.715438+0000","last_fullsized":"2024-09-12T19:11:32.715438+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:49.693725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'1","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:34.118959+0000","last_change":"2024-09-12T18:43:29.881020+0000","last_active":"2024-09-12T19:11:34.118959+0000","last_peered":"2024-09-12T19:11:34.118959+0000","last_clean":"2024-09-12T19:11:34.118959+0000","last_became_active":"2024-09-12T18:43:29.880294+0000","last_became_peered":"2024-09-12T18:43:29.880294+0000","last_unstale":"2024-09-12T19:11:34.118959+0000","last_undegraded":"2024-09-12T19:11:34.118959+0000","last_fullsized":"2024-09-12T19:11:34.118959+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:23.505932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'33","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:47.890460+0000","last_change":"2024-09-12T18:41:45.360139+0000","last_active":"2024-09-12T19:09:47.890460+0000","last_peered":"2024-09-12T19:09:47.890460+0000","last_clean":"2024-09-12T19:09:47.890460+0000","last_became_active":"2024-09-12T18:41:45.359405+0000","last_became_peered":"2024-09-12T18:41:45.359405+0000","last_unstale":"2024-09-12T19:09:47.890460+0000","last_undegraded":"2024-09-12T19:09:47.890460+0000","last_fullsized":"2024-09-12T19:09:47.890460+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:10.135901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":128,"num_write":57,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.911259+0000","last_change":"2024-09-12T18:55:19.139048+0000","last_active":"2024-09-12T19:09:48.911259+0000","last_peered":"2024-09-12T19:09:48.911259+0000","last_clean":"2024-09-12T19:09:48.911259+0000","last_became_active":"2024-09-12T18:55:19.136822+0000","last_became_peered":"2024-09-12T18:55:19.136822+0000","last_unstale":"2024-09-12T19:09:48.911259+0000","last_undegraded":"2024-09-12T19:09:48.911259+0000","last_fullsized":"2024-09-12T19:09:48.911259+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:07.426373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715353+0000","last_change":"2024-09-12T18:43:32.908035+0000","last_active":"2024-09-12T19:11:32.715353+0000","last_peered":"2024-09-12T19:11:32.715353+0000","last_clean":"2024-09-12T19:11:32.715353+0000","last_became_active":"2024-09-12T18:43:32.906911+0000","last_became_peered":"2024-09-12T18:43:32.906911+0000","last_unstale":"2024-09-12T19:11:32.715353+0000","last_undegraded":"2024-09-12T19:11:32.715353+0000","last_fullsized":"2024-09-12T19:11:32.715353+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:23.186205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"265'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:28.712068+0000","last_change":"2024-09-12T18:43:29.874437+0000","last_active":"2024-09-12T19:11:28.712068+0000","last_peered":"2024-09-12T19:11:28.712068+0000","last_clean":"2024-09-12T19:11:28.712068+0000","last_became_active":"2024-09-12T18:43:29.873561+0000","last_became_peered":"2024-09-12T18:43:29.873561+0000","last_unstale":"2024-09-12T19:11:28.712068+0000","last_undegraded":"2024-09-12T19:11:28.712068+0000","last_fullsized":"2024-09-12T19:11:28.712068+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:09.170136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'40","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.911052+0000","last_change":"2024-09-12T18:41:45.359990+0000","last_active":"2024-09-12T19:09:48.911052+0000","last_peered":"2024-09-12T19:09:48.911052+0000","last_clean":"2024-09-12T19:09:48.911052+0000","last_became_active":"2024-09-12T18:41:45.352482+0000","last_became_peered":"2024-09-12T18:41:45.352482+0000","last_unstale":"2024-09-12T19:09:48.911052+0000","last_undegraded":"2024-09-12T19:09:48.911052+0000","last_fullsized":"2024-09-12T19:09:48.911052+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:23.809564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:23.904477+0000","last_change":"2024-09-12T18:55:19.135873+0000","last_active":"2024-09-12T19:09:23.904477+0000","last_peered":"2024-09-12T19:09:23.904477+0000","last_clean":"2024-09-12T19:09:23.904477+0000","last_became_active":"2024-09-12T18:55:19.132991+0000","last_became_peered":"2024-09-12T18:55:19.132991+0000","last_unstale":"2024-09-12T19:09:23.904477+0000","last_undegraded":"2024-09-12T19:09:23.904477+0000","last_fullsized":"2024-09-12T19:09:23.904477+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:18.775245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:33.713286+0000","last_change":"2024-09-12T18:43:32.934314+0000","last_active":"2024-09-12T19:11:33.713286+0000","last_peered":"2024-09-12T19:11:33.713286+0000","last_clean":"2024-09-12T19:11:33.713286+0000","last_became_active":"2024-09-12T18:43:32.927109+0000","last_became_peered":"2024-09-12T18:43:32.927109+0000","last_unstale":"2024-09-12T19:11:33.713286+0000","last_undegraded":"2024-09-12T19:11:33.713286+0000","last_fullsized":"2024-09-12T19:11:33.713286+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:58.923503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":28674,"num_write":7,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'1","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:33.911847+0000","last_change":"2024-09-12T18:43:29.881351+0000","last_active":"2024-09-12T19:11:33.911847+0000","last_peered":"2024-09-12T19:11:33.911847+0000","last_clean":"2024-09-12T19:11:33.911847+0000","last_became_active":"2024-09-12T18:43:29.880517+0000","last_became_peered":"2024-09-12T18:43:29.880517+0000","last_unstale":"2024-09-12T19:11:33.911847+0000","last_undegraded":"2024-09-12T19:11:33.911847+0000","last_fullsized":"2024-09-12T19:11:33.911847+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:07.250936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:49.095887+0000","last_change":"2024-09-12T18:41:45.351776+0000","last_active":"2024-09-12T19:09:49.095887+0000","last_peered":"2024-09-12T19:09:49.095887+0000","last_clean":"2024-09-12T19:09:49.095887+0000","last_became_active":"2024-09-12T18:41:45.350632+0000","last_became_peered":"2024-09-12T18:41:45.350632+0000","last_unstale":"2024-09-12T19:09:49.095887+0000","last_undegraded":"2024-09-12T19:09:49.095887+0000","last_fullsized":"2024-09-12T19:09:49.095887+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:16.702236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.909979+0000","last_change":"2024-09-12T18:55:19.151498+0000","last_active":"2024-09-12T19:09:48.909979+0000","last_peered":"2024-09-12T19:09:48.909979+0000","last_clean":"2024-09-12T19:09:48.909979+0000","last_became_active":"2024-09-12T18:55:19.150880+0000","last_became_peered":"2024-09-12T18:55:19.150880+0000","last_unstale":"2024-09-12T19:09:48.909979+0000","last_undegraded":"2024-09-12T19:09:48.909979+0000","last_fullsized":"2024-09-12T19:09:48.909979+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:13.724232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'13","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:33.911802+0000","last_change":"2024-09-12T18:43:32.927843+0000","last_active":"2024-09-12T19:11:33.911802+0000","last_peered":"2024-09-12T19:11:33.911802+0000","last_clean":"2024-09-12T19:11:33.911802+0000","last_became_active":"2024-09-12T18:43:32.927270+0000","last_became_peered":"2024-09-12T18:43:32.927270+0000","last_unstale":"2024-09-12T19:11:33.911802+0000","last_undegraded":"2024-09-12T19:11:33.911802+0000","last_fullsized":"2024-09-12T19:11:33.911802+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:30.970671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":38914,"num_write":23,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'1","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:28.908122+0000","last_change":"2024-09-12T18:43:29.902339+0000","last_active":"2024-09-12T19:11:28.908122+0000","last_peered":"2024-09-12T19:11:28.908122+0000","last_clean":"2024-09-12T19:11:28.908122+0000","last_became_active":"2024-09-12T18:43:29.901627+0000","last_became_peered":"2024-09-12T18:43:29.901627+0000","last_unstale":"2024-09-12T19:11:28.908122+0000","last_undegraded":"2024-09-12T19:11:28.908122+0000","last_fullsized":"2024-09-12T19:11:28.908122+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:48.203220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'30","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.583951+0000","last_change":"2024-09-12T18:41:45.353240+0000","last_active":"2024-09-12T19:11:19.583951+0000","last_peered":"2024-09-12T19:11:19.583951+0000","last_clean":"2024-09-12T19:11:19.583951+0000","last_became_active":"2024-09-12T18:41:45.350670+0000","last_became_peered":"2024-09-12T18:41:45.350670+0000","last_unstale":"2024-09-12T19:11:19.583951+0000","last_undegraded":"2024-09-12T19:11:19.583951+0000","last_fullsized":"2024-09-12T19:11:19.583951+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:05.567815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.884911+0000","last_change":"2024-09-12T18:55:19.139183+0000","last_active":"2024-09-12T19:10:33.884911+0000","last_peered":"2024-09-12T19:10:33.884911+0000","last_clean":"2024-09-12T19:10:33.884911+0000","last_became_active":"2024-09-12T18:55:19.137332+0000","last_became_peered":"2024-09-12T18:55:19.137332+0000","last_unstale":"2024-09-12T19:10:33.884911+0000","last_undegraded":"2024-09-12T19:10:33.884911+0000","last_fullsized":"2024-09-12T19:10:33.884911+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:17.893526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'1","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:13.933310+0000","last_change":"2024-09-12T18:44:13.008362+0000","last_active":"2024-09-12T19:11:13.933310+0000","last_peered":"2024-09-12T19:11:13.933310+0000","last_clean":"2024-09-12T19:11:13.933310+0000","last_became_active":"2024-09-12T18:44:13.007582+0000","last_became_peered":"2024-09-12T18:44:13.007582+0000","last_unstale":"2024-09-12T19:11:13.933310+0000","last_undegraded":"2024-09-12T19:11:13.933310+0000","last_fullsized":"2024-09-12T19:11:13.933310+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:14.811461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.c","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.902160+0000","last_change":"2024-09-12T18:43:29.889784+0000","last_active":"2024-09-12T19:10:32.902160+0000","last_peered":"2024-09-12T19:10:32.902160+0000","last_clean":"2024-09-12T19:10:32.902160+0000","last_became_active":"2024-09-12T18:43:29.888041+0000","last_became_peered":"2024-09-12T18:43:29.888041+0000","last_unstale":"2024-09-12T19:10:32.902160+0000","last_undegraded":"2024-09-12T19:10:32.902160+0000","last_fullsized":"2024-09-12T19:10:32.902160+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:54.352777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'30","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.930272+0000","last_change":"2024-09-12T18:41:45.354909+0000","last_active":"2024-09-12T19:11:08.930272+0000","last_peered":"2024-09-12T19:11:08.930272+0000","last_clean":"2024-09-12T19:11:08.930272+0000","last_became_active":"2024-09-12T18:41:45.354063+0000","last_became_peered":"2024-09-12T18:41:45.354063+0000","last_unstale":"2024-09-12T19:11:08.930272+0000","last_undegraded":"2024-09-12T19:11:08.930272+0000","last_fullsized":"2024-09-12T19:11:08.930272+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:25.031450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910297+0000","last_change":"2024-09-12T18:55:19.140991+0000","last_active":"2024-09-12T19:11:07.910297+0000","last_peered":"2024-09-12T19:11:07.910297+0000","last_clean":"2024-09-12T19:11:07.910297+0000","last_became_active":"2024-09-12T18:55:19.140331+0000","last_became_peered":"2024-09-12T18:55:19.140331+0000","last_unstale":"2024-09-12T19:11:07.910297+0000","last_undegraded":"2024-09-12T19:11:07.910297+0000","last_fullsized":"2024-09-12T19:11:07.910297+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:37.267698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.920938+0000","last_change":"2024-09-12T18:43:32.935314+0000","last_active":"2024-09-12T19:10:33.920938+0000","last_peered":"2024-09-12T19:10:33.920938+0000","last_clean":"2024-09-12T19:10:33.920938+0000","last_became_active":"2024-09-12T18:43:32.934598+0000","last_became_peered":"2024-09-12T18:43:32.934598+0000","last_unstale":"2024-09-12T19:10:33.920938+0000","last_undegraded":"2024-09-12T19:10:33.920938+0000","last_fullsized":"2024-09-12T19:10:33.920938+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:01.163337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.883826+0000","last_change":"2024-09-12T18:43:29.888854+0000","last_active":"2024-09-12T19:10:28.883826+0000","last_peered":"2024-09-12T19:10:28.883826+0000","last_clean":"2024-09-12T19:10:28.883826+0000","last_became_active":"2024-09-12T18:43:29.887500+0000","last_became_peered":"2024-09-12T18:43:29.887500+0000","last_unstale":"2024-09-12T19:10:28.883826+0000","last_undegraded":"2024-09-12T19:10:28.883826+0000","last_fullsized":"2024-09-12T19:10:28.883826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:09.260023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'32","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.902996+0000","last_change":"2024-09-12T18:41:45.359668+0000","last_active":"2024-09-12T19:11:03.902996+0000","last_peered":"2024-09-12T19:11:03.902996+0000","last_clean":"2024-09-12T19:11:03.902996+0000","last_became_active":"2024-09-12T18:41:45.358914+0000","last_became_peered":"2024-09-12T18:41:45.358914+0000","last_unstale":"2024-09-12T19:11:03.902996+0000","last_undegraded":"2024-09-12T19:11:03.902996+0000","last_fullsized":"2024-09-12T19:11:03.902996+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:07.867252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":122,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.897994+0000","last_change":"2024-09-12T18:55:19.129609+0000","last_active":"2024-09-12T19:10:28.897994+0000","last_peered":"2024-09-12T19:10:28.897994+0000","last_clean":"2024-09-12T19:10:28.897994+0000","last_became_active":"2024-09-12T18:55:19.128236+0000","last_became_peered":"2024-09-12T18:55:19.128236+0000","last_unstale":"2024-09-12T19:10:28.897994+0000","last_undegraded":"2024-09-12T19:10:28.897994+0000","last_fullsized":"2024-09-12T19:10:28.897994+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:53.557810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"265'3","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:57.735434+0000","last_change":"2024-09-12T18:43:32.900792+0000","last_active":"2024-09-12T19:12:57.735434+0000","last_peered":"2024-09-12T19:12:57.735434+0000","last_clean":"2024-09-12T19:12:57.735434+0000","last_became_active":"2024-09-12T18:43:32.899943+0000","last_became_peered":"2024-09-12T18:43:32.899943+0000","last_unstale":"2024-09-12T19:12:57.735434+0000","last_undegraded":"2024-09-12T19:12:57.735434+0000","last_fullsized":"2024-09-12T19:12:57.735434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3444,"num_write":3,"num_write_kb":1722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.922613+0000","last_change":"2024-09-12T18:43:29.878465+0000","last_active":"2024-09-12T19:10:33.922613+0000","last_peered":"2024-09-12T19:10:33.922613+0000","last_clean":"2024-09-12T19:10:33.922613+0000","last_became_active":"2024-09-12T18:43:29.877755+0000","last_became_peered":"2024-09-12T18:43:29.877755+0000","last_unstale":"2024-09-12T19:10:33.922613+0000","last_undegraded":"2024-09-12T19:10:33.922613+0000","last_fullsized":"2024-09-12T19:10:33.922613+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:15.949360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4136,"num_write":3,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'17","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.905594+0000","last_change":"2024-09-12T18:41:45.358284+0000","last_active":"2024-09-12T19:11:03.905594+0000","last_peered":"2024-09-12T19:11:03.905594+0000","last_clean":"2024-09-12T19:11:03.905594+0000","last_became_active":"2024-09-12T18:41:45.357562+0000","last_became_peered":"2024-09-12T18:41:45.357562+0000","last_unstale":"2024-09-12T19:11:03.905594+0000","last_undegraded":"2024-09-12T19:11:03.905594+0000","last_fullsized":"2024-09-12T19:11:03.905594+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:45.746519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.902028+0000","last_change":"2024-09-12T18:55:19.137683+0000","last_active":"2024-09-12T19:10:32.902028+0000","last_peered":"2024-09-12T19:10:32.902028+0000","last_clean":"2024-09-12T19:10:32.902028+0000","last_became_active":"2024-09-12T18:55:19.136882+0000","last_became_peered":"2024-09-12T18:55:19.136882+0000","last_unstale":"2024-09-12T19:10:32.902028+0000","last_undegraded":"2024-09-12T19:10:32.902028+0000","last_fullsized":"2024-09-12T19:10:32.902028+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:09.805826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.921042+0000","last_change":"2024-09-12T18:43:32.930996+0000","last_active":"2024-09-12T19:10:33.921042+0000","last_peered":"2024-09-12T19:10:33.921042+0000","last_clean":"2024-09-12T19:10:33.921042+0000","last_became_active":"2024-09-12T18:43:32.927372+0000","last_became_peered":"2024-09-12T18:43:32.927372+0000","last_unstale":"2024-09-12T19:10:33.921042+0000","last_undegraded":"2024-09-12T19:10:33.921042+0000","last_fullsized":"2024-09-12T19:10:33.921042+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:56.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.910665+0000","last_change":"2024-09-12T18:43:29.900324+0000","last_active":"2024-09-12T19:10:37.910665+0000","last_peered":"2024-09-12T19:10:37.910665+0000","last_clean":"2024-09-12T19:10:37.910665+0000","last_became_active":"2024-09-12T18:43:29.888265+0000","last_became_peered":"2024-09-12T18:43:29.888265+0000","last_unstale":"2024-09-12T19:10:37.910665+0000","last_undegraded":"2024-09-12T19:10:37.910665+0000","last_fullsized":"2024-09-12T19:10:37.910665+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:31.453582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'32","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.891215+0000","last_change":"2024-09-12T18:41:45.336479+0000","last_active":"2024-09-12T19:11:03.891215+0000","last_peered":"2024-09-12T19:11:03.891215+0000","last_clean":"2024-09-12T19:11:03.891215+0000","last_became_active":"2024-09-12T18:41:45.335675+0000","last_became_peered":"2024-09-12T18:41:45.335675+0000","last_unstale":"2024-09-12T19:11:03.891215+0000","last_undegraded":"2024-09-12T19:11:03.891215+0000","last_fullsized":"2024-09-12T19:11:03.891215+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:40.967621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":63,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.928809+0000","last_change":"2024-09-12T18:55:19.150357+0000","last_active":"2024-09-12T19:11:03.928809+0000","last_peered":"2024-09-12T19:11:03.928809+0000","last_clean":"2024-09-12T19:11:03.928809+0000","last_became_active":"2024-09-12T18:55:19.149794+0000","last_became_peered":"2024-09-12T18:55:19.149794+0000","last_unstale":"2024-09-12T19:11:03.928809+0000","last_undegraded":"2024-09-12T19:11:03.928809+0000","last_fullsized":"2024-09-12T19:11:03.928809+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:29.807238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121142+0000","last_change":"2024-09-12T18:43:32.910786+0000","last_active":"2024-09-12T19:11:44.121142+0000","last_peered":"2024-09-12T19:11:44.121142+0000","last_clean":"2024-09-12T19:11:44.121142+0000","last_became_active":"2024-09-12T18:43:32.908692+0000","last_became_peered":"2024-09-12T18:43:32.908692+0000","last_unstale":"2024-09-12T19:11:44.121142+0000","last_undegraded":"2024-09-12T19:11:44.121142+0000","last_fullsized":"2024-09-12T19:11:44.121142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:46.037235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.940357+0000","last_change":"2024-09-12T18:43:29.883687+0000","last_active":"2024-09-12T19:11:43.940357+0000","last_peered":"2024-09-12T19:11:43.940357+0000","last_clean":"2024-09-12T19:11:43.940357+0000","last_became_active":"2024-09-12T18:43:29.882915+0000","last_became_peered":"2024-09-12T18:43:29.882915+0000","last_unstale":"2024-09-12T19:11:43.940357+0000","last_undegraded":"2024-09-12T19:11:43.940357+0000","last_fullsized":"2024-09-12T19:11:43.940357+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:04.141732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":15,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'74","reported_seq":245,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.930292+0000","last_change":"2024-09-12T18:41:45.352749+0000","last_active":"2024-09-12T19:11:03.930292+0000","last_peered":"2024-09-12T19:11:03.930292+0000","last_clean":"2024-09-12T19:11:03.930292+0000","last_became_active":"2024-09-12T18:41:45.351387+0000","last_became_peered":"2024-09-12T18:41:45.351387+0000","last_unstale":"2024-09-12T19:11:03.930292+0000","last_undegraded":"2024-09-12T19:11:03.930292+0000","last_fullsized":"2024-09-12T19:11:03.930292+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:09.964195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":261,"num_write":135,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:12.911671+0000","last_change":"2024-09-12T18:55:19.150286+0000","last_active":"2024-09-12T19:11:12.911671+0000","last_peered":"2024-09-12T19:11:12.911671+0000","last_clean":"2024-09-12T19:11:12.911671+0000","last_became_active":"2024-09-12T18:55:19.149666+0000","last_became_peered":"2024-09-12T18:55:19.149666+0000","last_unstale":"2024-09-12T19:11:12.911671+0000","last_undegraded":"2024-09-12T19:11:12.911671+0000","last_fullsized":"2024-09-12T19:11:12.911671+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:09.562684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'7","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.114111+0000","last_change":"2024-09-12T18:43:32.903834+0000","last_active":"2024-09-12T19:13:57.114111+0000","last_peered":"2024-09-12T19:13:57.114111+0000","last_clean":"2024-09-12T19:13:57.114111+0000","last_became_active":"2024-09-12T18:43:32.903112+0000","last_became_peered":"2024-09-12T18:43:32.903112+0000","last_unstale":"2024-09-12T19:13:57.114111+0000","last_undegraded":"2024-09-12T19:13:57.114111+0000","last_fullsized":"2024-09-12T19:13:57.114111+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:35.198794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.717849+0000","last_change":"2024-09-12T18:43:29.899798+0000","last_active":"2024-09-12T19:11:42.717849+0000","last_peered":"2024-09-12T19:11:42.717849+0000","last_clean":"2024-09-12T19:11:42.717849+0000","last_became_active":"2024-09-12T18:43:29.887725+0000","last_became_peered":"2024-09-12T18:43:29.887725+0000","last_unstale":"2024-09-12T19:11:42.717849+0000","last_undegraded":"2024-09-12T19:11:42.717849+0000","last_fullsized":"2024-09-12T19:11:42.717849+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:12.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.895985+0000","last_change":"2024-09-12T18:41:45.354403+0000","last_active":"2024-09-12T19:10:07.895985+0000","last_peered":"2024-09-12T19:10:07.895985+0000","last_clean":"2024-09-12T19:10:07.895985+0000","last_became_active":"2024-09-12T18:41:45.353582+0000","last_became_peered":"2024-09-12T18:41:45.353582+0000","last_unstale":"2024-09-12T19:10:07.895985+0000","last_undegraded":"2024-09-12T19:10:07.895985+0000","last_fullsized":"2024-09-12T19:10:07.895985+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:11.323313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910340+0000","last_change":"2024-09-12T18:55:19.147574+0000","last_active":"2024-09-12T19:11:07.910340+0000","last_peered":"2024-09-12T19:11:07.910340+0000","last_clean":"2024-09-12T19:11:07.910340+0000","last_became_active":"2024-09-12T18:55:19.146310+0000","last_became_peered":"2024-09-12T18:55:19.146310+0000","last_unstale":"2024-09-12T19:11:07.910340+0000","last_undegraded":"2024-09-12T19:11:07.910340+0000","last_fullsized":"2024-09-12T19:11:07.910340+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:20.681513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.909363+0000","last_change":"2024-09-12T18:43:32.922885+0000","last_active":"2024-09-12T19:10:32.909363+0000","last_peered":"2024-09-12T19:10:32.909363+0000","last_clean":"2024-09-12T19:10:32.909363+0000","last_became_active":"2024-09-12T18:43:32.922056+0000","last_became_peered":"2024-09-12T18:43:32.922056+0000","last_unstale":"2024-09-12T19:10:32.909363+0000","last_undegraded":"2024-09-12T19:10:32.909363+0000","last_fullsized":"2024-09-12T19:10:32.909363+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:30.503287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:38.908388+0000","last_change":"2024-09-12T18:43:29.886237+0000","last_active":"2024-09-12T19:09:38.908388+0000","last_peered":"2024-09-12T19:09:38.908388+0000","last_clean":"2024-09-12T19:09:38.908388+0000","last_became_active":"2024-09-12T18:43:29.885595+0000","last_became_peered":"2024-09-12T18:43:29.885595+0000","last_unstale":"2024-09-12T19:09:38.908388+0000","last_undegraded":"2024-09-12T19:09:38.908388+0000","last_fullsized":"2024-09-12T19:09:38.908388+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:41.139666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5492,"num_write":3,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'29","reported_seq":122,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.912167+0000","last_change":"2024-09-12T18:41:45.336015+0000","last_active":"2024-09-12T19:09:58.912167+0000","last_peered":"2024-09-12T19:09:58.912167+0000","last_clean":"2024-09-12T19:09:58.912167+0000","last_became_active":"2024-09-12T18:41:45.335258+0000","last_became_peered":"2024-09-12T18:41:45.335258+0000","last_unstale":"2024-09-12T19:09:58.912167+0000","last_undegraded":"2024-09-12T19:09:58.912167+0000","last_fullsized":"2024-09-12T19:09:58.912167+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:50.404611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":60,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.930417+0000","last_change":"2024-09-12T18:55:19.140934+0000","last_active":"2024-09-12T19:11:03.930417+0000","last_peered":"2024-09-12T19:11:03.930417+0000","last_clean":"2024-09-12T19:11:03.930417+0000","last_became_active":"2024-09-12T18:55:19.140247+0000","last_became_peered":"2024-09-12T18:55:19.140247+0000","last_unstale":"2024-09-12T19:11:03.930417+0000","last_undegraded":"2024-09-12T19:11:03.930417+0000","last_fullsized":"2024-09-12T19:11:03.930417+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:21.925405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'9","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:52.921169+0000","last_change":"2024-09-12T18:43:32.918976+0000","last_active":"2024-09-12T19:11:52.921169+0000","last_peered":"2024-09-12T19:11:52.921169+0000","last_clean":"2024-09-12T19:11:52.921169+0000","last_became_active":"2024-09-12T18:43:32.918077+0000","last_became_peered":"2024-09-12T18:43:32.918077+0000","last_unstale":"2024-09-12T19:11:52.921169+0000","last_undegraded":"2024-09-12T19:11:52.921169+0000","last_fullsized":"2024-09-12T19:11:52.921169+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.534577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:34.105965+0000","last_change":"2024-09-12T18:43:29.903733+0000","last_active":"2024-09-12T19:10:34.105965+0000","last_peered":"2024-09-12T19:10:34.105965+0000","last_clean":"2024-09-12T19:10:34.105965+0000","last_became_active":"2024-09-12T18:43:29.902444+0000","last_became_peered":"2024-09-12T18:43:29.902444+0000","last_unstale":"2024-09-12T19:10:34.105965+0000","last_undegraded":"2024-09-12T19:10:34.105965+0000","last_fullsized":"2024-09-12T19:10:34.105965+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:28.242386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'31","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.890560+0000","last_change":"2024-09-12T18:41:45.351143+0000","last_active":"2024-09-12T19:09:58.890560+0000","last_peered":"2024-09-12T19:09:58.890560+0000","last_clean":"2024-09-12T19:09:58.890560+0000","last_became_active":"2024-09-12T18:41:45.350344+0000","last_became_peered":"2024-09-12T18:41:45.350344+0000","last_unstale":"2024-09-12T19:09:58.890560+0000","last_undegraded":"2024-09-12T19:09:58.890560+0000","last_fullsized":"2024-09-12T19:09:58.890560+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:21.975925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":107,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:57.892779+0000","last_change":"2024-09-12T18:55:19.145504+0000","last_active":"2024-09-12T19:09:57.892779+0000","last_peered":"2024-09-12T19:09:57.892779+0000","last_clean":"2024-09-12T19:09:57.892779+0000","last_became_active":"2024-09-12T18:55:19.144778+0000","last_became_peered":"2024-09-12T18:55:19.144778+0000","last_unstale":"2024-09-12T19:09:57.892779+0000","last_undegraded":"2024-09-12T19:09:57.892779+0000","last_fullsized":"2024-09-12T19:09:57.892779+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:31.693075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:43.925140+0000","last_change":"2024-09-12T18:43:32.903502+0000","last_active":"2024-09-12T19:10:43.925140+0000","last_peered":"2024-09-12T19:10:43.925140+0000","last_clean":"2024-09-12T19:10:43.925140+0000","last_became_active":"2024-09-12T18:43:32.901790+0000","last_became_peered":"2024-09-12T18:43:32.901790+0000","last_unstale":"2024-09-12T19:10:43.925140+0000","last_undegraded":"2024-09-12T19:10:43.925140+0000","last_fullsized":"2024-09-12T19:10:43.925140+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:24.176553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903364+0000","last_change":"2024-09-12T18:43:29.890565+0000","last_active":"2024-09-12T19:10:37.903364+0000","last_peered":"2024-09-12T19:10:37.903364+0000","last_clean":"2024-09-12T19:10:37.903364+0000","last_became_active":"2024-09-12T18:43:29.889097+0000","last_became_peered":"2024-09-12T18:43:29.889097+0000","last_unstale":"2024-09-12T19:10:37.903364+0000","last_undegraded":"2024-09-12T19:10:37.903364+0000","last_fullsized":"2024-09-12T19:10:37.903364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:26.725295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.913527+0000","last_change":"2024-09-12T18:41:45.364829+0000","last_active":"2024-09-12T19:09:58.913527+0000","last_peered":"2024-09-12T19:09:58.913527+0000","last_clean":"2024-09-12T19:09:58.913527+0000","last_became_active":"2024-09-12T18:41:45.364055+0000","last_became_peered":"2024-09-12T18:41:45.364055+0000","last_unstale":"2024-09-12T19:09:58.913527+0000","last_undegraded":"2024-09-12T19:09:58.913527+0000","last_fullsized":"2024-09-12T19:09:58.913527+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:18.604878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.886937+0000","last_change":"2024-09-12T18:55:19.122707+0000","last_active":"2024-09-12T19:09:53.886937+0000","last_peered":"2024-09-12T19:09:53.886937+0000","last_clean":"2024-09-12T19:09:53.886937+0000","last_became_active":"2024-09-12T18:55:19.121805+0000","last_became_peered":"2024-09-12T18:55:19.121805+0000","last_unstale":"2024-09-12T19:09:53.886937+0000","last_undegraded":"2024-09-12T19:09:53.886937+0000","last_fullsized":"2024-09-12T19:09:53.886937+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:51.523106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'10","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.923737+0000","last_change":"2024-09-12T18:43:32.899098+0000","last_active":"2024-09-12T19:10:38.923737+0000","last_peered":"2024-09-12T19:10:38.923737+0000","last_clean":"2024-09-12T19:10:38.923737+0000","last_became_active":"2024-09-12T18:43:32.898379+0000","last_became_peered":"2024-09-12T18:43:32.898379+0000","last_unstale":"2024-09-12T19:10:38.923737+0000","last_undegraded":"2024-09-12T19:10:38.923737+0000","last_fullsized":"2024-09-12T19:10:38.923737+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:40.658854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":16388,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.886048+0000","last_change":"2024-09-12T18:43:29.897947+0000","last_active":"2024-09-12T19:10:38.886048+0000","last_peered":"2024-09-12T19:10:38.886048+0000","last_clean":"2024-09-12T19:10:38.886048+0000","last_became_active":"2024-09-12T18:43:29.897326+0000","last_became_peered":"2024-09-12T18:43:29.897326+0000","last_unstale":"2024-09-12T19:10:38.886048+0000","last_undegraded":"2024-09-12T19:10:38.886048+0000","last_fullsized":"2024-09-12T19:10:38.886048+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:49.647470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'31","reported_seq":129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.890721+0000","last_change":"2024-09-12T18:41:45.351648+0000","last_active":"2024-09-12T19:09:58.890721+0000","last_peered":"2024-09-12T19:09:58.890721+0000","last_clean":"2024-09-12T19:09:58.890721+0000","last_became_active":"2024-09-12T18:41:45.350900+0000","last_became_peered":"2024-09-12T18:41:45.350900+0000","last_unstale":"2024-09-12T19:09:58.890721+0000","last_undegraded":"2024-09-12T19:09:58.890721+0000","last_fullsized":"2024-09-12T19:09:58.890721+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:50.580663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":59,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715397+0000","last_change":"2024-09-12T18:55:19.123047+0000","last_active":"2024-09-12T19:11:32.715397+0000","last_peered":"2024-09-12T19:11:32.715397+0000","last_clean":"2024-09-12T19:11:32.715397+0000","last_became_active":"2024-09-12T18:55:19.122238+0000","last_became_peered":"2024-09-12T18:55:19.122238+0000","last_unstale":"2024-09-12T19:11:32.715397+0000","last_undegraded":"2024-09-12T19:11:32.715397+0000","last_fullsized":"2024-09-12T19:11:32.715397+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:01.481082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.918909+0000","last_change":"2024-09-12T18:43:32.914014+0000","last_active":"2024-09-12T19:11:42.918909+0000","last_peered":"2024-09-12T19:11:42.918909+0000","last_clean":"2024-09-12T19:11:42.918909+0000","last_became_active":"2024-09-12T18:43:32.913108+0000","last_became_peered":"2024-09-12T18:43:32.913108+0000","last_unstale":"2024-09-12T19:11:42.918909+0000","last_undegraded":"2024-09-12T19:11:42.918909+0000","last_fullsized":"2024-09-12T19:11:42.918909+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:00.617500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":15,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'8","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.910550+0000","last_change":"2024-09-12T18:43:29.878679+0000","last_active":"2024-09-12T19:11:38.910550+0000","last_peered":"2024-09-12T19:11:38.910550+0000","last_clean":"2024-09-12T19:11:38.910550+0000","last_became_active":"2024-09-12T18:43:29.877925+0000","last_became_peered":"2024-09-12T18:43:29.877925+0000","last_unstale":"2024-09-12T19:11:38.910550+0000","last_undegraded":"2024-09-12T19:11:38.910550+0000","last_fullsized":"2024-09-12T19:11:38.910550+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:25.553737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'135","reported_seq":472,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910405+0000","last_change":"2024-09-12T18:41:45.365909+0000","last_active":"2024-09-12T19:11:07.910405+0000","last_peered":"2024-09-12T19:11:07.910405+0000","last_clean":"2024-09-12T19:11:07.910405+0000","last_became_active":"2024-09-12T18:41:45.365175+0000","last_became_peered":"2024-09-12T18:41:45.365175+0000","last_unstale":"2024-09-12T19:11:07.910405+0000","last_undegraded":"2024-09-12T19:11:07.910405+0000","last_fullsized":"2024-09-12T19:11:07.910405+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:16.010188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":832,"num_read_kb":595,"num_write":177,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:54.096968+0000","last_change":"2024-09-12T18:55:19.130989+0000","last_active":"2024-09-12T19:09:54.096968+0000","last_peered":"2024-09-12T19:09:54.096968+0000","last_clean":"2024-09-12T19:09:54.096968+0000","last_became_active":"2024-09-12T18:55:19.130130+0000","last_became_peered":"2024-09-12T18:55:19.130130+0000","last_unstale":"2024-09-12T19:09:54.096968+0000","last_undegraded":"2024-09-12T19:09:54.096968+0000","last_fullsized":"2024-09-12T19:09:54.096968+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:36.507889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121479+0000","last_change":"2024-09-12T18:43:32.906004+0000","last_active":"2024-09-12T19:11:44.121479+0000","last_peered":"2024-09-12T19:11:44.121479+0000","last_clean":"2024-09-12T19:11:44.121479+0000","last_became_active":"2024-09-12T18:43:32.904789+0000","last_became_peered":"2024-09-12T18:43:32.904789+0000","last_unstale":"2024-09-12T19:11:44.121479+0000","last_undegraded":"2024-09-12T19:11:44.121479+0000","last_fullsized":"2024-09-12T19:11:44.121479+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:44.194875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.918932+0000","last_change":"2024-09-12T18:43:29.884688+0000","last_active":"2024-09-12T19:11:42.918932+0000","last_peered":"2024-09-12T19:11:42.918932+0000","last_clean":"2024-09-12T19:11:42.918932+0000","last_became_active":"2024-09-12T18:43:29.883790+0000","last_became_peered":"2024-09-12T18:43:29.883790+0000","last_unstale":"2024-09-12T19:11:42.918932+0000","last_undegraded":"2024-09-12T19:11:42.918932+0000","last_fullsized":"2024-09-12T19:11:42.918932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:58.821497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'6","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:57.915303+0000","last_change":"2024-09-12T18:41:45.358458+0000","last_active":"2024-09-12T19:10:57.915303+0000","last_peered":"2024-09-12T19:10:57.915303+0000","last_clean":"2024-09-12T19:10:57.915303+0000","last_became_active":"2024-09-12T18:41:45.357746+0000","last_became_peered":"2024-09-12T18:41:45.357746+0000","last_unstale":"2024-09-12T19:10:57.915303+0000","last_undegraded":"2024-09-12T19:10:57.915303+0000","last_fullsized":"2024-09-12T19:10:57.915303+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:16.491434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.883887+0000","last_change":"2024-09-12T18:55:19.140383+0000","last_active":"2024-09-12T19:10:28.883887+0000","last_peered":"2024-09-12T19:10:28.883887+0000","last_clean":"2024-09-12T19:10:28.883887+0000","last_became_active":"2024-09-12T18:55:19.139565+0000","last_became_peered":"2024-09-12T18:55:19.139565+0000","last_unstale":"2024-09-12T19:10:28.883887+0000","last_undegraded":"2024-09-12T19:10:28.883887+0000","last_fullsized":"2024-09-12T19:10:28.883887+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:46.784423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'1","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.910425+0000","last_change":"2024-09-12T18:43:32.906082+0000","last_active":"2024-09-12T19:10:37.910425+0000","last_peered":"2024-09-12T19:10:37.910425+0000","last_clean":"2024-09-12T19:10:37.910425+0000","last_became_active":"2024-09-12T18:43:32.904858+0000","last_became_peered":"2024-09-12T18:43:32.904858+0000","last_unstale":"2024-09-12T19:10:37.910425+0000","last_undegraded":"2024-09-12T19:10:37.910425+0000","last_fullsized":"2024-09-12T19:10:37.910425+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:58.276689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:42.947818+0000","last_change":"2024-09-12T18:43:29.890077+0000","last_active":"2024-09-12T19:13:42.947818+0000","last_peered":"2024-09-12T19:13:42.947818+0000","last_clean":"2024-09-12T19:13:42.947818+0000","last_became_active":"2024-09-12T18:43:29.889328+0000","last_became_peered":"2024-09-12T18:43:29.889328+0000","last_unstale":"2024-09-12T19:13:42.947818+0000","last_undegraded":"2024-09-12T19:13:42.947818+0000","last_fullsized":"2024-09-12T19:13:42.947818+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:20.098869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'8","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.901798+0000","last_change":"2024-09-12T18:41:45.354082+0000","last_active":"2024-09-12T19:10:58.901798+0000","last_peered":"2024-09-12T19:10:58.901798+0000","last_clean":"2024-09-12T19:10:58.901798+0000","last_became_active":"2024-09-12T18:41:45.353369+0000","last_became_peered":"2024-09-12T18:41:45.353369+0000","last_unstale":"2024-09-12T19:10:58.901798+0000","last_undegraded":"2024-09-12T19:10:58.901798+0000","last_fullsized":"2024-09-12T19:10:58.901798+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:49.982690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.921223+0000","last_change":"2024-09-12T18:55:19.116656+0000","last_active":"2024-09-12T19:10:28.921223+0000","last_peered":"2024-09-12T19:10:28.921223+0000","last_clean":"2024-09-12T19:10:28.921223+0000","last_became_active":"2024-09-12T18:55:19.115920+0000","last_became_peered":"2024-09-12T18:55:19.115920+0000","last_unstale":"2024-09-12T19:10:28.921223+0000","last_undegraded":"2024-09-12T19:10:28.921223+0000","last_fullsized":"2024-09-12T19:10:28.921223+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:54.225077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.911420+0000","last_change":"2024-09-12T18:43:32.914128+0000","last_active":"2024-09-12T19:11:43.911420+0000","last_peered":"2024-09-12T19:11:43.911420+0000","last_clean":"2024-09-12T19:11:43.911420+0000","last_became_active":"2024-09-12T18:43:32.913259+0000","last_became_peered":"2024-09-12T18:43:32.913259+0000","last_unstale":"2024-09-12T19:11:43.911420+0000","last_undegraded":"2024-09-12T19:11:43.911420+0000","last_fullsized":"2024-09-12T19:11:43.911420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:08.421749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903278+0000","last_change":"2024-09-12T18:43:29.883036+0000","last_active":"2024-09-12T19:10:37.903278+0000","last_peered":"2024-09-12T19:10:37.903278+0000","last_clean":"2024-09-12T19:10:37.903278+0000","last_became_active":"2024-09-12T18:43:29.882039+0000","last_became_peered":"2024-09-12T18:43:29.882039+0000","last_unstale":"2024-09-12T19:10:37.903278+0000","last_undegraded":"2024-09-12T19:10:37.903278+0000","last_fullsized":"2024-09-12T19:10:37.903278+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:20.442914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'181","reported_seq":586,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:59.111456+0000","last_change":"2024-09-12T18:41:45.354928+0000","last_active":"2024-09-12T19:10:59.111456+0000","last_peered":"2024-09-12T19:10:59.111456+0000","last_clean":"2024-09-12T19:10:59.111456+0000","last_became_active":"2024-09-12T18:41:45.354142+0000","last_became_peered":"2024-09-12T18:41:45.354142+0000","last_unstale":"2024-09-12T19:10:59.111456+0000","last_undegraded":"2024-09-12T19:10:59.111456+0000","last_fullsized":"2024-09-12T19:10:59.111456+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:57.126086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":838,"num_write":233,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.912268+0000","last_change":"2024-09-12T18:55:19.143090+0000","last_active":"2024-09-12T19:09:53.912268+0000","last_peered":"2024-09-12T19:09:53.912268+0000","last_clean":"2024-09-12T19:09:53.912268+0000","last_became_active":"2024-09-12T18:55:19.142412+0000","last_became_peered":"2024-09-12T18:55:19.142412+0000","last_unstale":"2024-09-12T19:09:53.912268+0000","last_undegraded":"2024-09-12T19:09:53.912268+0000","last_fullsized":"2024-09-12T19:09:53.912268+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.561947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'4","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.900143+0000","last_change":"2024-09-12T18:43:32.939711+0000","last_active":"2024-09-12T19:10:38.900143+0000","last_peered":"2024-09-12T19:10:38.900143+0000","last_clean":"2024-09-12T19:10:38.900143+0000","last_became_active":"2024-09-12T18:43:32.939024+0000","last_became_peered":"2024-09-12T18:43:32.939024+0000","last_unstale":"2024-09-12T19:10:38.900143+0000","last_undegraded":"2024-09-12T19:10:38.900143+0000","last_fullsized":"2024-09-12T19:10:38.900143+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:08.177317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:42.732247+0000","last_change":"2024-09-12T18:43:29.900783+0000","last_active":"2024-09-12T19:12:42.732247+0000","last_peered":"2024-09-12T19:12:42.732247+0000","last_clean":"2024-09-12T19:12:42.732247+0000","last_became_active":"2024-09-12T18:43:29.892060+0000","last_became_peered":"2024-09-12T18:43:29.892060+0000","last_unstale":"2024-09-12T19:12:42.732247+0000","last_undegraded":"2024-09-12T19:12:42.732247+0000","last_fullsized":"2024-09-12T19:12:42.732247+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:21.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'50","reported_seq":183,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:20.845700+0000","last_change":"2024-09-12T18:41:45.356560+0000","last_active":"2024-09-12T19:11:20.845700+0000","last_peered":"2024-09-12T19:11:20.845700+0000","last_clean":"2024-09-12T19:11:20.845700+0000","last_became_active":"2024-09-12T18:41:45.355840+0000","last_became_peered":"2024-09-12T18:41:45.355840+0000","last_unstale":"2024-09-12T19:11:20.845700+0000","last_undegraded":"2024-09-12T19:11:20.845700+0000","last_fullsized":"2024-09-12T19:11:20.845700+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:22.223128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":177,"num_write":88,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:02.894254+0000","last_change":"2024-09-12T18:55:19.156335+0000","last_active":"2024-09-12T19:10:02.894254+0000","last_peered":"2024-09-12T19:10:02.894254+0000","last_clean":"2024-09-12T19:10:02.894254+0000","last_became_active":"2024-09-12T18:55:19.155684+0000","last_became_peered":"2024-09-12T18:55:19.155684+0000","last_unstale":"2024-09-12T19:10:02.894254+0000","last_undegraded":"2024-09-12T19:10:02.894254+0000","last_fullsized":"2024-09-12T19:10:02.894254+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:14.458956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:39.107010+0000","last_change":"2024-09-12T18:43:32.905624+0000","last_active":"2024-09-12T19:10:39.107010+0000","last_peered":"2024-09-12T19:10:39.107010+0000","last_clean":"2024-09-12T19:10:39.107010+0000","last_became_active":"2024-09-12T18:43:32.903273+0000","last_became_peered":"2024-09-12T18:43:32.903273+0000","last_unstale":"2024-09-12T19:10:39.107010+0000","last_undegraded":"2024-09-12T19:10:39.107010+0000","last_fullsized":"2024-09-12T19:10:39.107010+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:48.885568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.900184+0000","last_change":"2024-09-12T18:43:29.868919+0000","last_active":"2024-09-12T19:10:38.900184+0000","last_peered":"2024-09-12T19:10:38.900184+0000","last_clean":"2024-09-12T19:10:38.900184+0000","last_became_active":"2024-09-12T18:43:29.865413+0000","last_became_peered":"2024-09-12T18:43:29.865413+0000","last_unstale":"2024-09-12T19:10:38.900184+0000","last_undegraded":"2024-09-12T19:10:38.900184+0000","last_fullsized":"2024-09-12T19:10:38.900184+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:35.628916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'25","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:57.922311+0000","last_change":"2024-09-12T18:41:45.363243+0000","last_active":"2024-09-12T19:11:57.922311+0000","last_peered":"2024-09-12T19:11:57.922311+0000","last_clean":"2024-09-12T19:11:57.922311+0000","last_became_active":"2024-09-12T18:41:45.362445+0000","last_became_peered":"2024-09-12T18:41:45.362445+0000","last_unstale":"2024-09-12T19:11:57.922311+0000","last_undegraded":"2024-09-12T19:11:57.922311+0000","last_fullsized":"2024-09-12T19:11:57.922311+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:57.818173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'288","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.929745+0000","last_change":"2024-09-12T18:26:39.874259+0000","last_active":"2024-09-12T19:13:57.929745+0000","last_peered":"2024-09-12T19:13:57.929745+0000","last_clean":"2024-09-12T19:13:57.929745+0000","last_became_active":"2024-09-12T18:26:39.872863+0000","last_became_peered":"2024-09-12T18:26:39.872863+0000","last_unstale":"2024-09-12T19:13:57.929745+0000","last_undegraded":"2024-09-12T19:13:57.929745+0000","last_fullsized":"2024-09-12T19:13:57.929745+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:12.641934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66222,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":381,"num_read_kb":8018,"num_write":922,"num_write_kb":33098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'548","reported_seq":2200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.104685+0000","last_change":"2024-09-12T18:26:41.881378+0000","last_active":"2024-09-12T19:12:24.104685+0000","last_peered":"2024-09-12T19:12:24.104685+0000","last_clean":"2024-09-12T19:12:24.104685+0000","last_became_active":"2024-09-12T18:26:41.879711+0000","last_became_peered":"2024-09-12T18:26:41.879711+0000","last_unstale":"2024-09-12T19:12:24.104685+0000","last_undegraded":"2024-09-12T19:12:24.104685+0000","last_fullsized":"2024-09-12T19:12:24.104685+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:43.105556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2944,"num_read_kb":2757,"num_write":660,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'326","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.689223+0000","last_change":"2024-09-12T18:26:39.837876+0000","last_active":"2024-09-12T19:13:57.689223+0000","last_peered":"2024-09-12T19:13:57.689223+0000","last_clean":"2024-09-12T19:13:57.689223+0000","last_became_active":"2024-09-12T18:26:39.837462+0000","last_became_peered":"2024-09-12T18:26:39.837462+0000","last_unstale":"2024-09-12T19:13:57.689223+0000","last_undegraded":"2024-09-12T19:13:57.689223+0000","last_fullsized":"2024-09-12T19:13:57.689223+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:16.597331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10511461,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":519,"num_read_kb":60596,"num_write":1071,"num_write_kb":26482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'832","reported_seq":2227,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.108683+0000","last_change":"2024-09-12T18:26:41.864753+0000","last_active":"2024-09-12T19:12:24.108683+0000","last_peered":"2024-09-12T19:12:24.108683+0000","last_clean":"2024-09-12T19:12:24.108683+0000","last_became_active":"2024-09-12T18:26:41.863835+0000","last_became_peered":"2024-09-12T18:26:41.863835+0000","last_unstale":"2024-09-12T19:12:24.108683+0000","last_undegraded":"2024-09-12T19:12:24.108683+0000","last_fullsized":"2024-09-12T19:12:24.108683+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:50.300481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3830,"num_read_kb":3409,"num_write":1134,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'304","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:33.953361+0000","last_change":"2024-09-12T18:26:39.831857+0000","last_active":"2024-09-12T19:12:33.953361+0000","last_peered":"2024-09-12T19:12:33.953361+0000","last_clean":"2024-09-12T19:12:33.953361+0000","last_became_active":"2024-09-12T18:26:39.831522+0000","last_became_peered":"2024-09-12T18:26:39.831522+0000","last_unstale":"2024-09-12T19:12:33.953361+0000","last_undegraded":"2024-09-12T19:12:33.953361+0000","last_fullsized":"2024-09-12T19:12:33.953361+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:44.938137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5739976,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":568,"num_read_kb":27262,"num_write":1100,"num_write_kb":30891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'361","reported_seq":1822,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.752145+0000","last_change":"2024-09-12T18:26:41.850866+0000","last_active":"2024-09-12T19:12:08.752145+0000","last_peered":"2024-09-12T19:12:08.752145+0000","last_clean":"2024-09-12T19:12:08.752145+0000","last_became_active":"2024-09-12T18:26:41.850001+0000","last_became_peered":"2024-09-12T18:26:41.850001+0000","last_unstale":"2024-09-12T19:12:08.752145+0000","last_undegraded":"2024-09-12T19:12:08.752145+0000","last_fullsized":"2024-09-12T19:12:08.752145+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:23.483403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2076,"num_read_kb":1992,"num_write":405,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'283","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:20.476261+0000","last_change":"2024-09-12T18:27:11.825105+0000","last_active":"2024-09-12T19:11:20.476261+0000","last_peered":"2024-09-12T19:11:20.476261+0000","last_clean":"2024-09-12T19:11:20.476261+0000","last_became_active":"2024-09-12T18:27:11.824331+0000","last_became_peered":"2024-09-12T18:27:11.824331+0000","last_unstale":"2024-09-12T19:11:20.476261+0000","last_undegraded":"2024-09-12T19:11:20.476261+0000","last_fullsized":"2024-09-12T19:11:20.476261+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:59.462165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5516773,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":421,"num_read_kb":38329,"num_write":1023,"num_write_kb":37388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'500","reported_seq":2054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.541136+0000","last_change":"2024-09-12T18:26:41.851231+0000","last_active":"2024-09-12T19:12:09.541136+0000","last_peered":"2024-09-12T19:12:09.541136+0000","last_clean":"2024-09-12T19:12:09.541136+0000","last_became_active":"2024-09-12T18:26:41.850866+0000","last_became_peered":"2024-09-12T18:26:41.850866+0000","last_unstale":"2024-09-12T19:12:09.541136+0000","last_undegraded":"2024-09-12T19:12:09.541136+0000","last_fullsized":"2024-09-12T19:12:09.541136+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:49.632192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2664,"num_read_kb":2487,"num_write":637,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'340","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.941984+0000","last_change":"2024-09-12T18:26:39.871051+0000","last_active":"2024-09-12T19:13:57.941984+0000","last_peered":"2024-09-12T19:13:57.941984+0000","last_clean":"2024-09-12T19:13:57.941984+0000","last_became_active":"2024-09-12T18:26:39.870272+0000","last_became_peered":"2024-09-12T18:26:39.870272+0000","last_unstale":"2024-09-12T19:13:57.941984+0000","last_undegraded":"2024-09-12T19:13:57.941984+0000","last_fullsized":"2024-09-12T19:13:57.941984+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:26.496206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4440945,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":742,"num_read_kb":17788,"num_write":1144,"num_write_kb":36512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'543","reported_seq":1968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.557048+0000","last_change":"2024-09-12T18:26:41.869564+0000","last_active":"2024-09-12T19:12:09.557048+0000","last_peered":"2024-09-12T19:12:09.557048+0000","last_clean":"2024-09-12T19:12:09.557048+0000","last_became_active":"2024-09-12T18:26:41.865288+0000","last_became_peered":"2024-09-12T18:26:41.865288+0000","last_unstale":"2024-09-12T19:12:09.557048+0000","last_undegraded":"2024-09-12T19:12:09.557048+0000","last_fullsized":"2024-09-12T19:12:09.557048+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:04.903221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2721,"num_read_kb":2571,"num_write":759,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'270","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:39.387927+0000","last_change":"2024-09-12T18:26:39.851993+0000","last_active":"2024-09-12T19:11:39.387927+0000","last_peered":"2024-09-12T19:11:39.387927+0000","last_clean":"2024-09-12T19:11:39.387927+0000","last_became_active":"2024-09-12T18:26:39.851253+0000","last_became_peered":"2024-09-12T18:26:39.851253+0000","last_unstale":"2024-09-12T19:11:39.387927+0000","last_undegraded":"2024-09-12T19:11:39.387927+0000","last_fullsized":"2024-09-12T19:11:39.387927+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:26.300087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1927120,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":405,"num_read_kb":31766,"num_write":1044,"num_write_kb":25425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'807","reported_seq":2339,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.105771+0000","last_change":"2024-09-12T18:26:41.852562+0000","last_active":"2024-09-12T19:13:43.105771+0000","last_peered":"2024-09-12T19:13:43.105771+0000","last_clean":"2024-09-12T19:13:43.105771+0000","last_became_active":"2024-09-12T18:26:41.851811+0000","last_became_peered":"2024-09-12T18:26:41.851811+0000","last_unstale":"2024-09-12T19:13:43.105771+0000","last_undegraded":"2024-09-12T19:13:43.105771+0000","last_fullsized":"2024-09-12T19:13:43.105771+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:07.152668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3792,"num_read_kb":3404,"num_write":1072,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'333","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.934666+0000","last_change":"2024-09-12T18:26:39.862363+0000","last_active":"2024-09-12T19:13:57.934666+0000","last_peered":"2024-09-12T19:13:57.934666+0000","last_clean":"2024-09-12T19:13:57.934666+0000","last_became_active":"2024-09-12T18:26:39.861529+0000","last_became_peered":"2024-09-12T18:26:39.861529+0000","last_unstale":"2024-09-12T19:13:57.934666+0000","last_undegraded":"2024-09-12T19:13:57.934666+0000","last_fullsized":"2024-09-12T19:13:57.934666+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:22.532453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454843,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":487,"num_read_kb":30234,"num_write":1136,"num_write_kb":47172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'698","reported_seq":2314,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.291262+0000","last_change":"2024-09-12T18:26:41.880160+0000","last_active":"2024-09-12T19:12:23.291262+0000","last_peered":"2024-09-12T19:12:23.291262+0000","last_clean":"2024-09-12T19:12:23.291262+0000","last_became_active":"2024-09-12T18:26:41.878820+0000","last_became_peered":"2024-09-12T18:26:41.878820+0000","last_unstale":"2024-09-12T19:12:23.291262+0000","last_undegraded":"2024-09-12T19:12:23.291262+0000","last_fullsized":"2024-09-12T19:12:23.291262+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:28.637107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3429,"num_read_kb":3073,"num_write":944,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'287","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.471552+0000","last_change":"2024-09-12T18:27:11.824834+0000","last_active":"2024-09-12T19:12:01.471552+0000","last_peered":"2024-09-12T19:12:01.471552+0000","last_clean":"2024-09-12T19:12:01.471552+0000","last_became_active":"2024-09-12T18:27:11.824008+0000","last_became_peered":"2024-09-12T18:27:11.824008+0000","last_unstale":"2024-09-12T19:12:01.471552+0000","last_undegraded":"2024-09-12T19:12:01.471552+0000","last_fullsized":"2024-09-12T19:12:01.471552+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:37.834927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11535097,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":579,"num_read_kb":10155,"num_write":1074,"num_write_kb":30763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'673","reported_seq":2284,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.623890+0000","last_change":"2024-09-12T18:26:41.854820+0000","last_active":"2024-09-12T19:12:18.623890+0000","last_peered":"2024-09-12T19:12:18.623890+0000","last_clean":"2024-09-12T19:12:18.623890+0000","last_became_active":"2024-09-12T18:26:41.854487+0000","last_became_peered":"2024-09-12T18:26:41.854487+0000","last_unstale":"2024-09-12T19:12:18.623890+0000","last_undegraded":"2024-09-12T19:12:18.623890+0000","last_fullsized":"2024-09-12T19:12:18.623890+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:55.693388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3483,"num_read_kb":3149,"num_write":934,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'460","reported_seq":2065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.554629+0000","last_change":"2024-09-12T18:26:41.845783+0000","last_active":"2024-09-12T19:12:09.554629+0000","last_peered":"2024-09-12T19:12:09.554629+0000","last_clean":"2024-09-12T19:12:09.554629+0000","last_became_active":"2024-09-12T18:26:41.845080+0000","last_became_peered":"2024-09-12T18:26:41.845080+0000","last_unstale":"2024-09-12T19:12:09.554629+0000","last_undegraded":"2024-09-12T19:12:09.554629+0000","last_fullsized":"2024-09-12T19:12:09.554629+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:41.747464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2421,"num_read_kb":2289,"num_write":534,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'343","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.919407+0000","last_change":"2024-09-12T18:26:39.874340+0000","last_active":"2024-09-12T19:13:57.919407+0000","last_peered":"2024-09-12T19:13:57.919407+0000","last_clean":"2024-09-12T19:13:57.919407+0000","last_became_active":"2024-09-12T18:26:39.872936+0000","last_became_peered":"2024-09-12T18:26:39.872936+0000","last_unstale":"2024-09-12T19:13:57.919407+0000","last_undegraded":"2024-09-12T19:13:57.919407+0000","last_fullsized":"2024-09-12T19:13:57.919407+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:52.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5293439,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":480,"num_read_kb":24957,"num_write":1219,"num_write_kb":33279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'559","reported_seq":2173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.208544+0000","last_change":"2024-09-12T18:26:41.874471+0000","last_active":"2024-09-12T19:11:58.208544+0000","last_peered":"2024-09-12T19:11:58.208544+0000","last_clean":"2024-09-12T19:11:58.208544+0000","last_became_active":"2024-09-12T18:26:41.865247+0000","last_became_peered":"2024-09-12T18:26:41.865247+0000","last_unstale":"2024-09-12T19:11:58.208544+0000","last_undegraded":"2024-09-12T19:11:58.208544+0000","last_fullsized":"2024-09-12T19:11:58.208544+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:35.308473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2931,"num_read_kb":2718,"num_write":721,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'342","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.894850+0000","last_change":"2024-09-12T18:26:39.859661+0000","last_active":"2024-09-12T19:10:13.894850+0000","last_peered":"2024-09-12T19:10:13.894850+0000","last_clean":"2024-09-12T19:10:13.894850+0000","last_became_active":"2024-09-12T18:26:39.858964+0000","last_became_peered":"2024-09-12T18:26:39.858964+0000","last_unstale":"2024-09-12T19:10:13.894850+0000","last_undegraded":"2024-09-12T19:10:13.894850+0000","last_fullsized":"2024-09-12T19:10:13.894850+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:12.307545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9762525,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":749,"num_read_kb":25615,"num_write":1258,"num_write_kb":27961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'826","reported_seq":2309,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.128247+0000","last_change":"2024-09-12T18:26:41.862769+0000","last_active":"2024-09-12T19:12:24.128247+0000","last_peered":"2024-09-12T19:12:24.128247+0000","last_clean":"2024-09-12T19:12:24.128247+0000","last_became_active":"2024-09-12T18:26:41.861762+0000","last_became_peered":"2024-09-12T18:26:41.861762+0000","last_unstale":"2024-09-12T19:12:24.128247+0000","last_undegraded":"2024-09-12T19:12:24.128247+0000","last_fullsized":"2024-09-12T19:12:24.128247+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:57.802438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3868,"num_read_kb":3443,"num_write":1111,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'322","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:19.878185+0000","last_change":"2024-09-12T18:26:39.857559+0000","last_active":"2024-09-12T19:12:19.878185+0000","last_peered":"2024-09-12T19:12:19.878185+0000","last_clean":"2024-09-12T19:12:19.878185+0000","last_became_active":"2024-09-12T18:26:39.856700+0000","last_became_peered":"2024-09-12T18:26:39.856700+0000","last_unstale":"2024-09-12T19:12:19.878185+0000","last_undegraded":"2024-09-12T19:12:19.878185+0000","last_fullsized":"2024-09-12T19:12:19.878185+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:32.134581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10390340,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":516,"num_read_kb":29092,"num_write":1175,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'408","reported_seq":1973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.624204+0000","last_change":"2024-09-12T18:26:41.855114+0000","last_active":"2024-09-12T19:12:18.624204+0000","last_peered":"2024-09-12T19:12:18.624204+0000","last_clean":"2024-09-12T19:12:18.624204+0000","last_became_active":"2024-09-12T18:26:41.854687+0000","last_became_peered":"2024-09-12T18:26:41.854687+0000","last_unstale":"2024-09-12T19:12:18.624204+0000","last_undegraded":"2024-09-12T19:12:18.624204+0000","last_fullsized":"2024-09-12T19:12:18.624204+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:38.397431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2203,"num_read_kb":2114,"num_write":459,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'246","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.538284+0000","last_change":"2024-09-12T18:26:39.846009+0000","last_active":"2024-09-12T19:12:01.538284+0000","last_peered":"2024-09-12T19:12:01.538284+0000","last_clean":"2024-09-12T19:12:01.538284+0000","last_became_active":"2024-09-12T18:26:39.845295+0000","last_became_peered":"2024-09-12T18:26:39.845295+0000","last_unstale":"2024-09-12T19:12:01.538284+0000","last_undegraded":"2024-09-12T19:12:01.538284+0000","last_fullsized":"2024-09-12T19:12:01.538284+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:17.674520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12175535,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":604,"num_read_kb":23311,"num_write":911,"num_write_kb":25673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'818","reported_seq":2465,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.289955+0000","last_change":"2024-09-12T18:26:41.856646+0000","last_active":"2024-09-12T19:12:23.289955+0000","last_peered":"2024-09-12T19:12:23.289955+0000","last_clean":"2024-09-12T19:12:23.289955+0000","last_became_active":"2024-09-12T18:26:41.856280+0000","last_became_peered":"2024-09-12T18:26:41.856280+0000","last_unstale":"2024-09-12T19:12:23.289955+0000","last_undegraded":"2024-09-12T19:12:23.289955+0000","last_fullsized":"2024-09-12T19:12:23.289955+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:36.396273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4038,"num_read_kb":3655,"num_write":1078,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'333","reported_seq":1026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.702513+0000","last_change":"2024-09-12T18:26:39.842574+0000","last_active":"2024-09-12T19:11:59.702513+0000","last_peered":"2024-09-12T19:11:59.702513+0000","last_clean":"2024-09-12T19:11:59.702513+0000","last_became_active":"2024-09-12T18:26:39.842159+0000","last_became_peered":"2024-09-12T18:26:39.842159+0000","last_unstale":"2024-09-12T19:11:59.702513+0000","last_undegraded":"2024-09-12T19:11:59.702513+0000","last_fullsized":"2024-09-12T19:11:59.702513+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:57.097188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19243142,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":545,"num_read_kb":58099,"num_write":1193,"num_write_kb":62462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'845","reported_seq":2432,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.108397+0000","last_change":"2024-09-12T18:26:41.854196+0000","last_active":"2024-09-12T19:13:43.108397+0000","last_peered":"2024-09-12T19:13:43.108397+0000","last_clean":"2024-09-12T19:13:43.108397+0000","last_became_active":"2024-09-12T18:26:41.853403+0000","last_became_peered":"2024-09-12T18:26:41.853403+0000","last_unstale":"2024-09-12T19:13:43.108397+0000","last_undegraded":"2024-09-12T19:13:43.108397+0000","last_fullsized":"2024-09-12T19:13:43.108397+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:23.475163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3981,"num_read_kb":3579,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'355","reported_seq":1064,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:13.933191+0000","last_change":"2024-09-12T18:26:39.834464+0000","last_active":"2024-09-12T19:11:13.933191+0000","last_peered":"2024-09-12T19:11:13.933191+0000","last_clean":"2024-09-12T19:11:13.933191+0000","last_became_active":"2024-09-12T18:26:39.834006+0000","last_became_peered":"2024-09-12T18:26:39.834006+0000","last_unstale":"2024-09-12T19:11:13.933191+0000","last_undegraded":"2024-09-12T19:11:13.933191+0000","last_fullsized":"2024-09-12T19:11:13.933191+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:58.733603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3329482,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":670,"num_read_kb":82742,"num_write":1276,"num_write_kb":55909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'115","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.220116+0000","last_change":"2024-09-12T18:26:49.907310+0000","last_active":"2024-09-12T19:12:24.220116+0000","last_peered":"2024-09-12T19:12:24.220116+0000","last_clean":"2024-09-12T19:12:24.220116+0000","last_became_active":"2024-09-12T18:26:49.906589+0000","last_became_peered":"2024-09-12T18:26:49.906589+0000","last_unstale":"2024-09-12T19:12:24.220116+0000","last_undegraded":"2024-09-12T19:12:24.220116+0000","last_fullsized":"2024-09-12T19:12:24.220116+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:14.519874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":280,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'752","reported_seq":2162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.190816+0000","last_change":"2024-09-12T18:26:41.853179+0000","last_active":"2024-09-12T19:11:59.190816+0000","last_peered":"2024-09-12T19:11:59.190816+0000","last_clean":"2024-09-12T19:11:59.190816+0000","last_became_active":"2024-09-12T18:26:41.852831+0000","last_became_peered":"2024-09-12T18:26:41.852831+0000","last_unstale":"2024-09-12T19:11:59.190816+0000","last_undegraded":"2024-09-12T19:11:59.190816+0000","last_fullsized":"2024-09-12T19:11:59.190816+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:22.488493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3501,"num_read_kb":3138,"num_write":986,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'361","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.871106+0000","last_change":"2024-09-12T18:27:11.824441+0000","last_active":"2024-09-12T19:13:57.871106+0000","last_peered":"2024-09-12T19:13:57.871106+0000","last_clean":"2024-09-12T19:13:57.871106+0000","last_became_active":"2024-09-12T18:27:11.823705+0000","last_became_peered":"2024-09-12T18:27:11.823705+0000","last_unstale":"2024-09-12T19:13:57.871106+0000","last_undegraded":"2024-09-12T19:13:57.871106+0000","last_fullsized":"2024-09-12T19:13:57.871106+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:16.557071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221836,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":562,"num_read_kb":55935,"num_write":1231,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.891991+0000","last_change":"2024-09-12T18:26:43.859139+0000","last_active":"2024-09-12T19:10:13.891991+0000","last_peered":"2024-09-12T19:10:13.891991+0000","last_clean":"2024-09-12T19:10:13.891991+0000","last_became_active":"2024-09-12T18:26:43.857754+0000","last_became_peered":"2024-09-12T18:26:43.857754+0000","last_unstale":"2024-09-12T19:10:13.891991+0000","last_undegraded":"2024-09-12T19:10:13.891991+0000","last_fullsized":"2024-09-12T19:10:13.891991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:44.851162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'312","reported_seq":910,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.955980+0000","last_change":"2024-09-12T18:26:45.876845+0000","last_active":"2024-09-12T19:12:43.955980+0000","last_peered":"2024-09-12T19:12:43.955980+0000","last_clean":"2024-09-12T19:12:43.955980+0000","last_became_active":"2024-09-12T18:26:45.876070+0000","last_became_peered":"2024-09-12T18:26:45.876070+0000","last_unstale":"2024-09-12T19:12:43.955980+0000","last_undegraded":"2024-09-12T19:12:43.955980+0000","last_fullsized":"2024-09-12T19:12:43.955980+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:22.272564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58716,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":955,"num_write":404,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:17.898757+0000","last_change":"2024-09-12T18:26:47.896202+0000","last_active":"2024-09-12T19:10:17.898757+0000","last_peered":"2024-09-12T19:10:17.898757+0000","last_clean":"2024-09-12T19:10:17.898757+0000","last_became_active":"2024-09-12T18:26:47.895471+0000","last_became_peered":"2024-09-12T18:26:47.895471+0000","last_unstale":"2024-09-12T19:10:17.898757+0000","last_undegraded":"2024-09-12T19:10:17.898757+0000","last_fullsized":"2024-09-12T19:10:17.898757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:33.203860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'2440","reported_seq":4321,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.300739+0000","last_change":"2024-09-12T18:26:49.913977+0000","last_active":"2024-09-12T19:12:21.300739+0000","last_peered":"2024-09-12T19:12:21.300739+0000","last_clean":"2024-09-12T19:12:21.300739+0000","last_became_active":"2024-09-12T18:26:49.913125+0000","last_became_peered":"2024-09-12T18:26:49.913125+0000","last_unstale":"2024-09-12T19:12:21.300739+0000","last_undegraded":"2024-09-12T19:12:21.300739+0000","last_fullsized":"2024-09-12T19:12:21.300739+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":2400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:14.099069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6085,"num_read_kb":6089,"num_write":4865,"num_write_kb":1791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'567","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:02.090617+0000","last_change":"2024-09-12T18:26:41.872673+0000","last_active":"2024-09-12T19:12:02.090617+0000","last_peered":"2024-09-12T19:12:02.090617+0000","last_clean":"2024-09-12T19:12:02.090617+0000","last_became_active":"2024-09-12T18:26:41.871531+0000","last_became_peered":"2024-09-12T18:26:41.871531+0000","last_unstale":"2024-09-12T19:12:02.090617+0000","last_undegraded":"2024-09-12T19:12:02.090617+0000","last_fullsized":"2024-09-12T19:12:02.090617+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:58.936555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2964,"num_read_kb":2726,"num_write":725,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'299","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:56.120289+0000","last_change":"2024-09-12T18:26:39.872043+0000","last_active":"2024-09-12T19:11:56.120289+0000","last_peered":"2024-09-12T19:11:56.120289+0000","last_clean":"2024-09-12T19:11:56.120289+0000","last_became_active":"2024-09-12T18:26:39.871605+0000","last_became_peered":"2024-09-12T18:26:39.871605+0000","last_unstale":"2024-09-12T19:11:56.120289+0000","last_undegraded":"2024-09-12T19:11:56.120289+0000","last_fullsized":"2024-09-12T19:11:56.120289+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:34.631521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5057800,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":511,"num_read_kb":33405,"num_write":1134,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.930194+0000","last_change":"2024-09-12T18:26:43.866305+0000","last_active":"2024-09-12T19:11:08.930194+0000","last_peered":"2024-09-12T19:11:08.930194+0000","last_clean":"2024-09-12T19:11:08.930194+0000","last_became_active":"2024-09-12T18:26:43.865817+0000","last_became_peered":"2024-09-12T18:26:43.865817+0000","last_unstale":"2024-09-12T19:11:08.930194+0000","last_undegraded":"2024-09-12T19:11:08.930194+0000","last_fullsized":"2024-09-12T19:11:08.930194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:44.351205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'75","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:11.668505+0000","last_change":"2024-09-12T18:26:45.854845+0000","last_active":"2024-09-12T19:11:11.668505+0000","last_peered":"2024-09-12T19:11:11.668505+0000","last_clean":"2024-09-12T19:11:11.668505+0000","last_became_active":"2024-09-12T18:26:45.854087+0000","last_became_peered":"2024-09-12T18:26:45.854087+0000","last_unstale":"2024-09-12T19:11:11.668505+0000","last_undegraded":"2024-09-12T19:11:11.668505+0000","last_fullsized":"2024-09-12T19:11:11.668505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:33.838948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:19.102590+0000","last_change":"2024-09-12T18:26:47.881155+0000","last_active":"2024-09-12T19:10:19.102590+0000","last_peered":"2024-09-12T19:10:19.102590+0000","last_clean":"2024-09-12T19:10:19.102590+0000","last_became_active":"2024-09-12T18:26:47.880374+0000","last_became_peered":"2024-09-12T18:26:47.880374+0000","last_unstale":"2024-09-12T19:10:19.102590+0000","last_undegraded":"2024-09-12T19:10:19.102590+0000","last_fullsized":"2024-09-12T19:10:19.102590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:15.543833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'120","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.174257+0000","last_change":"2024-09-12T18:26:49.927396+0000","last_active":"2024-09-12T19:11:59.174257+0000","last_peered":"2024-09-12T19:11:59.174257+0000","last_clean":"2024-09-12T19:11:59.174257+0000","last_became_active":"2024-09-12T18:26:49.926650+0000","last_became_peered":"2024-09-12T18:26:49.926650+0000","last_unstale":"2024-09-12T19:11:59.174257+0000","last_undegraded":"2024-09-12T19:11:59.174257+0000","last_fullsized":"2024-09-12T19:11:59.174257+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:12.549691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'508","reported_seq":2178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.106328+0000","last_change":"2024-09-12T18:26:41.852310+0000","last_active":"2024-09-12T19:12:01.106328+0000","last_peered":"2024-09-12T19:12:01.106328+0000","last_clean":"2024-09-12T19:12:01.106328+0000","last_became_active":"2024-09-12T18:26:41.851928+0000","last_became_peered":"2024-09-12T18:26:41.851928+0000","last_unstale":"2024-09-12T19:12:01.106328+0000","last_undegraded":"2024-09-12T19:12:01.106328+0000","last_fullsized":"2024-09-12T19:12:01.106328+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:23.223986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2649,"num_read_kb":2492,"num_write":594,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'350","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.905377+0000","last_change":"2024-09-12T18:26:39.864105+0000","last_active":"2024-09-12T19:13:57.905377+0000","last_peered":"2024-09-12T19:13:57.905377+0000","last_clean":"2024-09-12T19:13:57.905377+0000","last_became_active":"2024-09-12T18:26:39.863389+0000","last_became_peered":"2024-09-12T18:26:39.863389+0000","last_unstale":"2024-09-12T19:13:57.905377+0000","last_undegraded":"2024-09-12T19:13:57.905377+0000","last_fullsized":"2024-09-12T19:13:57.905377+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:59.089104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194678,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":506,"num_read_kb":22645,"num_write":1102,"num_write_kb":31309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.916104+0000","last_change":"2024-09-12T18:26:43.855208+0000","last_active":"2024-09-12T19:10:13.916104+0000","last_peered":"2024-09-12T19:10:13.916104+0000","last_clean":"2024-09-12T19:10:13.916104+0000","last_became_active":"2024-09-12T18:26:43.853736+0000","last_became_peered":"2024-09-12T18:26:43.853736+0000","last_unstale":"2024-09-12T19:10:13.916104+0000","last_undegraded":"2024-09-12T19:10:13.916104+0000","last_fullsized":"2024-09-12T19:10:13.916104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:26.483694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'112","reported_seq":644,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:16.619773+0000","last_change":"2024-09-12T18:26:45.853889+0000","last_active":"2024-09-12T19:11:16.619773+0000","last_peered":"2024-09-12T19:11:16.619773+0000","last_clean":"2024-09-12T19:11:16.619773+0000","last_became_active":"2024-09-12T18:26:45.853143+0000","last_became_peered":"2024-09-12T18:26:45.853143+0000","last_unstale":"2024-09-12T19:11:16.619773+0000","last_undegraded":"2024-09-12T19:11:16.619773+0000","last_fullsized":"2024-09-12T19:11:16.619773+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:21.398455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'760","reported_seq":4106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.834477+0000","last_change":"2024-09-12T18:26:47.895745+0000","last_active":"2024-09-12T19:13:56.834477+0000","last_peered":"2024-09-12T19:13:56.834477+0000","last_clean":"2024-09-12T19:13:56.834477+0000","last_became_active":"2024-09-12T18:26:47.895056+0000","last_became_peered":"2024-09-12T18:26:47.895056+0000","last_unstale":"2024-09-12T19:13:56.834477+0000","last_undegraded":"2024-09-12T19:13:56.834477+0000","last_fullsized":"2024-09-12T19:13:56.834477+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":702,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:33.762580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'174","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.267501+0000","last_change":"2024-09-12T18:26:49.890859+0000","last_active":"2024-09-12T19:12:24.267501+0000","last_peered":"2024-09-12T19:12:24.267501+0000","last_clean":"2024-09-12T19:12:24.267501+0000","last_became_active":"2024-09-12T18:26:49.890325+0000","last_became_peered":"2024-09-12T18:26:49.890325+0000","last_unstale":"2024-09-12T19:12:24.267501+0000","last_undegraded":"2024-09-12T19:12:24.267501+0000","last_fullsized":"2024-09-12T19:12:24.267501+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:48.483470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":638,"num_write":360,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'755","reported_seq":2307,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:05.288203+0000","last_change":"2024-09-12T18:26:41.862710+0000","last_active":"2024-09-12T19:12:05.288203+0000","last_peered":"2024-09-12T19:12:05.288203+0000","last_clean":"2024-09-12T19:12:05.288203+0000","last_became_active":"2024-09-12T18:26:41.862240+0000","last_became_peered":"2024-09-12T18:26:41.862240+0000","last_unstale":"2024-09-12T19:12:05.288203+0000","last_undegraded":"2024-09-12T19:12:05.288203+0000","last_fullsized":"2024-09-12T19:12:05.288203+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:33.961532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3627,"num_read_kb":3298,"num_write":982,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'262","reported_seq":877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:38.071574+0000","last_change":"2024-09-12T18:26:39.844306+0000","last_active":"2024-09-12T19:13:38.071574+0000","last_peered":"2024-09-12T19:13:38.071574+0000","last_clean":"2024-09-12T19:13:38.071574+0000","last_became_active":"2024-09-12T18:26:39.843351+0000","last_became_peered":"2024-09-12T18:26:39.843351+0000","last_unstale":"2024-09-12T19:13:38.071574+0000","last_undegraded":"2024-09-12T19:13:38.071574+0000","last_fullsized":"2024-09-12T19:13:38.071574+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:35.966180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417223,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":412,"num_read_kb":20705,"num_write":966,"num_write_kb":27627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.892087+0000","last_change":"2024-09-12T18:26:43.843098+0000","last_active":"2024-09-12T19:10:13.892087+0000","last_peered":"2024-09-12T19:10:13.892087+0000","last_clean":"2024-09-12T19:10:13.892087+0000","last_became_active":"2024-09-12T18:26:43.842479+0000","last_became_peered":"2024-09-12T18:26:43.842479+0000","last_unstale":"2024-09-12T19:10:13.892087+0000","last_undegraded":"2024-09-12T19:10:13.892087+0000","last_fullsized":"2024-09-12T19:10:13.892087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:07.573346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'281","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.959185+0000","last_change":"2024-09-12T18:26:46.025157+0000","last_active":"2024-09-12T19:13:43.959185+0000","last_peered":"2024-09-12T19:13:43.959185+0000","last_clean":"2024-09-12T19:13:43.959185+0000","last_became_active":"2024-09-12T18:26:46.024425+0000","last_became_peered":"2024-09-12T18:26:46.024425+0000","last_unstale":"2024-09-12T19:13:43.959185+0000","last_undegraded":"2024-09-12T19:13:43.959185+0000","last_fullsized":"2024-09-12T19:13:43.959185+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:13.803848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62379,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":998,"num_write":390,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'801","reported_seq":2364,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.028658+0000","last_change":"2024-09-12T18:26:47.899579+0000","last_active":"2024-09-12T19:13:44.028658+0000","last_peered":"2024-09-12T19:13:44.028658+0000","last_clean":"2024-09-12T19:13:44.028658+0000","last_became_active":"2024-09-12T18:26:47.898903+0000","last_became_peered":"2024-09-12T18:26:47.898903+0000","last_unstale":"2024-09-12T19:13:44.028658+0000","last_undegraded":"2024-09-12T19:13:44.028658+0000","last_fullsized":"2024-09-12T19:13:44.028658+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:43.604475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'762","reported_seq":2249,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:03.047582+0000","last_change":"2024-09-12T18:26:41.870576+0000","last_active":"2024-09-12T19:12:03.047582+0000","last_peered":"2024-09-12T19:12:03.047582+0000","last_clean":"2024-09-12T19:12:03.047582+0000","last_became_active":"2024-09-12T18:26:41.869852+0000","last_became_peered":"2024-09-12T18:26:41.869852+0000","last_unstale":"2024-09-12T19:12:03.047582+0000","last_undegraded":"2024-09-12T19:12:03.047582+0000","last_fullsized":"2024-09-12T19:12:03.047582+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:41.656803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3529,"num_read_kb":3192,"num_write":1004,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'453","reported_seq":1174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.942166+0000","last_change":"2024-09-12T18:26:39.875011+0000","last_active":"2024-09-12T19:13:57.942166+0000","last_peered":"2024-09-12T19:13:57.942166+0000","last_clean":"2024-09-12T19:13:57.942166+0000","last_became_active":"2024-09-12T18:26:39.873512+0000","last_became_peered":"2024-09-12T18:26:39.873512+0000","last_unstale":"2024-09-12T19:13:57.942166+0000","last_undegraded":"2024-09-12T19:13:57.942166+0000","last_fullsized":"2024-09-12T19:13:57.942166+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:45.863880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5044712,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":899,"num_read_kb":13008,"num_write":1518,"num_write_kb":39306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.895938+0000","last_change":"2024-09-12T18:26:43.871922+0000","last_active":"2024-09-12T19:10:07.895938+0000","last_peered":"2024-09-12T19:10:07.895938+0000","last_clean":"2024-09-12T19:10:07.895938+0000","last_became_active":"2024-09-12T18:26:43.871192+0000","last_became_peered":"2024-09-12T18:26:43.871192+0000","last_unstale":"2024-09-12T19:10:07.895938+0000","last_undegraded":"2024-09-12T19:10:07.895938+0000","last_fullsized":"2024-09-12T19:10:07.895938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:26.666887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'360","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:28.921731+0000","last_change":"2024-09-12T18:26:46.021987+0000","last_active":"2024-09-12T19:12:28.921731+0000","last_peered":"2024-09-12T19:12:28.921731+0000","last_clean":"2024-09-12T19:12:28.921731+0000","last_became_active":"2024-09-12T18:26:46.021239+0000","last_became_peered":"2024-09-12T18:26:46.021239+0000","last_unstale":"2024-09-12T19:12:28.921731+0000","last_undegraded":"2024-09-12T19:12:28.921731+0000","last_fullsized":"2024-09-12T19:12:28.921731+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:16.999506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55436,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":568,"num_read_kb":1061,"num_write":454,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:32.894704+0000","last_change":"2024-09-12T18:26:47.879784+0000","last_active":"2024-09-12T19:09:32.894704+0000","last_peered":"2024-09-12T19:09:32.894704+0000","last_clean":"2024-09-12T19:09:32.894704+0000","last_became_active":"2024-09-12T18:26:47.879079+0000","last_became_peered":"2024-09-12T18:26:47.879079+0000","last_unstale":"2024-09-12T19:09:32.894704+0000","last_undegraded":"2024-09-12T19:09:32.894704+0000","last_fullsized":"2024-09-12T19:09:32.894704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.067221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'551","reported_seq":1359,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.001450+0000","last_change":"2024-09-12T18:26:49.913788+0000","last_active":"2024-09-12T19:13:44.001450+0000","last_peered":"2024-09-12T19:13:44.001450+0000","last_clean":"2024-09-12T19:13:44.001450+0000","last_became_active":"2024-09-12T18:26:49.913115+0000","last_became_peered":"2024-09-12T18:26:49.913115+0000","last_unstale":"2024-09-12T19:13:44.001450+0000","last_undegraded":"2024-09-12T19:13:44.001450+0000","last_fullsized":"2024-09-12T19:13:44.001450+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:49.514569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1285,"num_write":1159,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'406","reported_seq":1988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.570164+0000","last_change":"2024-09-12T18:26:41.855029+0000","last_active":"2024-09-12T19:12:06.570164+0000","last_peered":"2024-09-12T19:12:06.570164+0000","last_clean":"2024-09-12T19:12:06.570164+0000","last_became_active":"2024-09-12T18:26:41.854391+0000","last_became_peered":"2024-09-12T18:26:41.854391+0000","last_unstale":"2024-09-12T19:12:06.570164+0000","last_undegraded":"2024-09-12T19:12:06.570164+0000","last_fullsized":"2024-09-12T19:12:06.570164+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:51.832674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2438,"num_read_kb":2340,"num_write":450,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'292","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.937366+0000","last_change":"2024-09-12T18:26:39.871356+0000","last_active":"2024-09-12T19:13:57.937366+0000","last_peered":"2024-09-12T19:13:57.937366+0000","last_clean":"2024-09-12T19:13:57.937366+0000","last_became_active":"2024-09-12T18:26:39.870641+0000","last_became_peered":"2024-09-12T18:26:39.870641+0000","last_unstale":"2024-09-12T19:13:57.937366+0000","last_undegraded":"2024-09-12T19:13:57.937366+0000","last_fullsized":"2024-09-12T19:13:57.937366+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:37.867643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048963,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":389,"num_read_kb":1418,"num_write":995,"num_write_kb":24682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.878656+0000","last_change":"2024-09-12T18:26:43.854009+0000","last_active":"2024-09-12T19:10:03.878656+0000","last_peered":"2024-09-12T19:10:03.878656+0000","last_clean":"2024-09-12T19:10:03.878656+0000","last_became_active":"2024-09-12T18:26:43.853212+0000","last_became_peered":"2024-09-12T18:26:43.853212+0000","last_unstale":"2024-09-12T19:10:03.878656+0000","last_undegraded":"2024-09-12T19:10:03.878656+0000","last_fullsized":"2024-09-12T19:10:03.878656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:12.634200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'259","reported_seq":821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.717284+0000","last_change":"2024-09-12T18:26:45.866790+0000","last_active":"2024-09-12T19:11:48.717284+0000","last_peered":"2024-09-12T19:11:48.717284+0000","last_clean":"2024-09-12T19:11:48.717284+0000","last_became_active":"2024-09-12T18:26:45.865933+0000","last_became_peered":"2024-09-12T18:26:45.865933+0000","last_unstale":"2024-09-12T19:11:48.717284+0000","last_undegraded":"2024-09-12T19:11:48.717284+0000","last_fullsized":"2024-09-12T19:11:48.717284+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:47.841285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69833,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":437,"num_read_kb":950,"num_write":362,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.915818+0000","last_change":"2024-09-12T18:26:47.898805+0000","last_active":"2024-09-12T19:10:13.915818+0000","last_peered":"2024-09-12T19:10:13.915818+0000","last_clean":"2024-09-12T19:10:13.915818+0000","last_became_active":"2024-09-12T18:26:47.898056+0000","last_became_peered":"2024-09-12T18:26:47.898056+0000","last_unstale":"2024-09-12T19:10:13.915818+0000","last_undegraded":"2024-09-12T19:10:13.915818+0000","last_fullsized":"2024-09-12T19:10:13.915818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:01.722126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'128","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:53.928598+0000","last_change":"2024-09-12T18:26:49.914410+0000","last_active":"2024-09-12T19:12:53.928598+0000","last_peered":"2024-09-12T19:12:53.928598+0000","last_clean":"2024-09-12T19:12:53.928598+0000","last_became_active":"2024-09-12T18:26:49.913180+0000","last_became_peered":"2024-09-12T18:26:49.913180+0000","last_unstale":"2024-09-12T19:12:53.928598+0000","last_undegraded":"2024-09-12T19:12:53.928598+0000","last_fullsized":"2024-09-12T19:12:53.928598+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:31.008311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'514","reported_seq":2058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.768357+0000","last_change":"2024-09-12T18:26:41.874172+0000","last_active":"2024-09-12T19:12:08.768357+0000","last_peered":"2024-09-12T19:12:08.768357+0000","last_clean":"2024-09-12T19:12:08.768357+0000","last_became_active":"2024-09-12T18:26:41.873229+0000","last_became_peered":"2024-09-12T18:26:41.873229+0000","last_unstale":"2024-09-12T19:12:08.768357+0000","last_undegraded":"2024-09-12T19:12:08.768357+0000","last_fullsized":"2024-09-12T19:12:08.768357+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:55.323047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2942,"num_read_kb":2741,"num_write":656,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'341","reported_seq":1120,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.949516+0000","last_change":"2024-09-12T18:26:39.865873+0000","last_active":"2024-09-12T19:13:57.949516+0000","last_peered":"2024-09-12T19:13:57.949516+0000","last_clean":"2024-09-12T19:13:57.949516+0000","last_became_active":"2024-09-12T18:26:39.865148+0000","last_became_peered":"2024-09-12T18:26:39.865148+0000","last_unstale":"2024-09-12T19:13:57.949516+0000","last_undegraded":"2024-09-12T19:13:57.949516+0000","last_fullsized":"2024-09-12T19:13:57.949516+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:00.744853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2271991,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":857,"num_read_kb":25450,"num_write":1052,"num_write_kb":40926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:28.871439+0000","last_change":"2024-09-12T18:26:43.854880+0000","last_active":"2024-09-12T19:09:28.871439+0000","last_peered":"2024-09-12T19:09:28.871439+0000","last_clean":"2024-09-12T19:09:28.871439+0000","last_became_active":"2024-09-12T18:26:43.853084+0000","last_became_peered":"2024-09-12T18:26:43.853084+0000","last_unstale":"2024-09-12T19:09:28.871439+0000","last_undegraded":"2024-09-12T19:09:28.871439+0000","last_fullsized":"2024-09-12T19:09:28.871439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:12.477078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'307","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.556756+0000","last_change":"2024-09-12T18:26:45.867127+0000","last_active":"2024-09-12T19:13:57.556756+0000","last_peered":"2024-09-12T19:13:57.556756+0000","last_clean":"2024-09-12T19:13:57.556756+0000","last_became_active":"2024-09-12T18:26:45.866325+0000","last_became_peered":"2024-09-12T18:26:45.866325+0000","last_unstale":"2024-09-12T19:13:57.556756+0000","last_undegraded":"2024-09-12T19:13:57.556756+0000","last_fullsized":"2024-09-12T19:13:57.556756+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:45.228994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64639,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":1214,"num_write":426,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'788","reported_seq":2646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.029707+0000","last_change":"2024-09-12T18:26:47.879674+0000","last_active":"2024-09-12T19:13:44.029707+0000","last_peered":"2024-09-12T19:13:44.029707+0000","last_clean":"2024-09-12T19:13:44.029707+0000","last_became_active":"2024-09-12T18:26:47.878956+0000","last_became_peered":"2024-09-12T18:26:47.878956+0000","last_unstale":"2024-09-12T19:13:44.029707+0000","last_undegraded":"2024-09-12T19:13:44.029707+0000","last_fullsized":"2024-09-12T19:13:44.029707+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:56.898695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'146","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.017181+0000","last_change":"2024-09-12T18:26:49.927113+0000","last_active":"2024-09-12T19:13:43.017181+0000","last_peered":"2024-09-12T19:13:43.017181+0000","last_clean":"2024-09-12T19:13:43.017181+0000","last_became_active":"2024-09-12T18:26:49.926384+0000","last_became_peered":"2024-09-12T18:26:49.926384+0000","last_unstale":"2024-09-12T19:13:43.017181+0000","last_undegraded":"2024-09-12T19:13:43.017181+0000","last_fullsized":"2024-09-12T19:13:43.017181+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:14.787817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":361,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'694","reported_seq":2114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.881016+0000","last_change":"2024-09-12T18:26:41.846934+0000","last_active":"2024-09-12T19:12:07.881016+0000","last_peered":"2024-09-12T19:12:07.881016+0000","last_clean":"2024-09-12T19:12:07.881016+0000","last_became_active":"2024-09-12T18:26:41.846589+0000","last_became_peered":"2024-09-12T18:26:41.846589+0000","last_unstale":"2024-09-12T19:12:07.881016+0000","last_undegraded":"2024-09-12T19:12:07.881016+0000","last_fullsized":"2024-09-12T19:12:07.881016+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:35.741190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3315,"num_read_kb":3003,"num_write":914,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'263","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.663150+0000","last_change":"2024-09-12T18:26:39.851620+0000","last_active":"2024-09-12T19:11:58.663150+0000","last_peered":"2024-09-12T19:11:58.663150+0000","last_clean":"2024-09-12T19:11:58.663150+0000","last_became_active":"2024-09-12T18:26:39.849950+0000","last_became_peered":"2024-09-12T18:26:39.849950+0000","last_unstale":"2024-09-12T19:11:58.663150+0000","last_undegraded":"2024-09-12T19:11:58.663150+0000","last_fullsized":"2024-09-12T19:11:58.663150+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:33.362610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8457173,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":571,"num_read_kb":33808,"num_write":994,"num_write_kb":22667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.879742+0000","last_change":"2024-09-12T18:26:43.875193+0000","last_active":"2024-09-12T19:10:08.879742+0000","last_peered":"2024-09-12T19:10:08.879742+0000","last_clean":"2024-09-12T19:10:08.879742+0000","last_became_active":"2024-09-12T18:26:43.874837+0000","last_became_peered":"2024-09-12T18:26:43.874837+0000","last_unstale":"2024-09-12T19:10:08.879742+0000","last_undegraded":"2024-09-12T19:10:08.879742+0000","last_fullsized":"2024-09-12T19:10:08.879742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:28.076097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'450","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.943287+0000","last_change":"2024-09-12T18:26:45.876006+0000","last_active":"2024-09-12T19:13:43.943287+0000","last_peered":"2024-09-12T19:13:43.943287+0000","last_clean":"2024-09-12T19:13:43.943287+0000","last_became_active":"2024-09-12T18:26:45.875223+0000","last_became_peered":"2024-09-12T18:26:45.875223+0000","last_unstale":"2024-09-12T19:13:43.943287+0000","last_undegraded":"2024-09-12T19:13:43.943287+0000","last_fullsized":"2024-09-12T19:13:43.943287+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:33.224194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107054,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":782,"num_read_kb":1698,"num_write":650,"num_write_kb":561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.879675+0000","last_change":"2024-09-12T18:26:47.892554+0000","last_active":"2024-09-12T19:10:08.879675+0000","last_peered":"2024-09-12T19:10:08.879675+0000","last_clean":"2024-09-12T19:10:08.879675+0000","last_became_active":"2024-09-12T18:26:47.891736+0000","last_became_peered":"2024-09-12T18:26:47.891736+0000","last_unstale":"2024-09-12T19:10:08.879675+0000","last_undegraded":"2024-09-12T19:10:08.879675+0000","last_fullsized":"2024-09-12T19:10:08.879675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:15.740755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'131","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:19.312995+0000","last_change":"2024-09-12T18:26:49.905418+0000","last_active":"2024-09-12T19:10:19.312995+0000","last_peered":"2024-09-12T19:10:19.312995+0000","last_clean":"2024-09-12T19:10:19.312995+0000","last_became_active":"2024-09-12T18:26:49.904633+0000","last_became_peered":"2024-09-12T18:26:49.904633+0000","last_unstale":"2024-09-12T19:10:19.312995+0000","last_undegraded":"2024-09-12T19:10:19.312995+0000","last_fullsized":"2024-09-12T19:10:19.312995+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:49.072537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":176,"num_write":324,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'684","reported_seq":2216,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.579998+0000","last_change":"2024-09-12T18:26:41.853736+0000","last_active":"2024-09-12T19:11:42.579998+0000","last_peered":"2024-09-12T19:11:42.579998+0000","last_clean":"2024-09-12T19:11:42.579998+0000","last_became_active":"2024-09-12T18:26:41.852958+0000","last_became_peered":"2024-09-12T18:26:41.852958+0000","last_unstale":"2024-09-12T19:11:42.579998+0000","last_undegraded":"2024-09-12T19:11:42.579998+0000","last_fullsized":"2024-09-12T19:11:42.579998+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:03.970571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3047,"num_write":870,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'281","reported_seq":950,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:05.911940+0000","last_change":"2024-09-12T18:26:39.844241+0000","last_active":"2024-09-12T19:12:05.911940+0000","last_peered":"2024-09-12T19:12:05.911940+0000","last_clean":"2024-09-12T19:12:05.911940+0000","last_became_active":"2024-09-12T18:26:39.842671+0000","last_became_peered":"2024-09-12T18:26:39.842671+0000","last_unstale":"2024-09-12T19:12:05.911940+0000","last_undegraded":"2024-09-12T19:12:05.911940+0000","last_fullsized":"2024-09-12T19:12:05.911940+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:01.142718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7857956,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":478,"num_read_kb":38368,"num_write":1075,"num_write_kb":24127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:28.871539+0000","last_change":"2024-09-12T18:26:43.864463+0000","last_active":"2024-09-12T19:09:28.871539+0000","last_peered":"2024-09-12T19:09:28.871539+0000","last_clean":"2024-09-12T19:09:28.871539+0000","last_became_active":"2024-09-12T18:26:43.863615+0000","last_became_peered":"2024-09-12T18:26:43.863615+0000","last_unstale":"2024-09-12T19:09:28.871539+0000","last_undegraded":"2024-09-12T19:09:28.871539+0000","last_fullsized":"2024-09-12T19:09:28.871539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:49.236494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'288","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:49.122609+0000","last_change":"2024-09-12T18:26:45.865043+0000","last_active":"2024-09-12T19:11:49.122609+0000","last_peered":"2024-09-12T19:11:49.122609+0000","last_clean":"2024-09-12T19:11:49.122609+0000","last_became_active":"2024-09-12T18:26:45.864308+0000","last_became_peered":"2024-09-12T18:26:45.864308+0000","last_unstale":"2024-09-12T19:11:49.122609+0000","last_undegraded":"2024-09-12T19:11:49.122609+0000","last_fullsized":"2024-09-12T19:11:49.122609+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:23.603111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56977,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":996,"num_write":454,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:43.910003+0000","last_change":"2024-09-12T18:26:47.904622+0000","last_active":"2024-09-12T19:09:43.910003+0000","last_peered":"2024-09-12T19:09:43.910003+0000","last_clean":"2024-09-12T19:09:43.910003+0000","last_became_active":"2024-09-12T18:26:47.903984+0000","last_became_peered":"2024-09-12T18:26:47.903984+0000","last_unstale":"2024-09-12T19:09:43.910003+0000","last_undegraded":"2024-09-12T19:09:43.910003+0000","last_fullsized":"2024-09-12T19:09:43.910003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:01.445193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'130","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:03.733674+0000","last_change":"2024-09-12T18:26:49.917735+0000","last_active":"2024-09-12T19:13:03.733674+0000","last_peered":"2024-09-12T19:13:03.733674+0000","last_clean":"2024-09-12T19:13:03.733674+0000","last_became_active":"2024-09-12T18:26:49.916255+0000","last_became_peered":"2024-09-12T18:26:49.916255+0000","last_unstale":"2024-09-12T19:13:03.733674+0000","last_undegraded":"2024-09-12T19:13:03.733674+0000","last_fullsized":"2024-09-12T19:13:03.733674+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:05.827351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":172,"num_read_kb":153,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'479","reported_seq":2155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.274718+0000","last_change":"2024-09-12T18:26:41.852549+0000","last_active":"2024-09-12T19:12:23.274718+0000","last_peered":"2024-09-12T19:12:23.274718+0000","last_clean":"2024-09-12T19:12:23.274718+0000","last_became_active":"2024-09-12T18:26:41.851789+0000","last_became_peered":"2024-09-12T18:26:41.851789+0000","last_unstale":"2024-09-12T19:12:23.274718+0000","last_undegraded":"2024-09-12T19:12:23.274718+0000","last_fullsized":"2024-09-12T19:12:23.274718+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:07.659593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2754,"num_read_kb":2601,"num_write":570,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'332","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.634592+0000","last_change":"2024-09-12T18:26:39.850151+0000","last_active":"2024-09-12T19:11:44.634592+0000","last_peered":"2024-09-12T19:11:44.634592+0000","last_clean":"2024-09-12T19:11:44.634592+0000","last_became_active":"2024-09-12T18:26:39.849392+0000","last_became_peered":"2024-09-12T18:26:39.849392+0000","last_unstale":"2024-09-12T19:11:44.634592+0000","last_undegraded":"2024-09-12T19:11:44.634592+0000","last_fullsized":"2024-09-12T19:11:44.634592+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:38.297523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569204,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":603,"num_read_kb":7425,"num_write":1111,"num_write_kb":13361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:32.894780+0000","last_change":"2024-09-12T18:26:43.877842+0000","last_active":"2024-09-12T19:09:32.894780+0000","last_peered":"2024-09-12T19:09:32.894780+0000","last_clean":"2024-09-12T19:09:32.894780+0000","last_became_active":"2024-09-12T18:26:43.877257+0000","last_became_peered":"2024-09-12T18:26:43.877257+0000","last_unstale":"2024-09-12T19:09:32.894780+0000","last_undegraded":"2024-09-12T19:09:32.894780+0000","last_fullsized":"2024-09-12T19:09:32.894780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:29.743058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'283","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.719215+0000","last_change":"2024-09-12T18:26:45.862903+0000","last_active":"2024-09-12T19:11:58.719215+0000","last_peered":"2024-09-12T19:11:58.719215+0000","last_clean":"2024-09-12T19:11:58.719215+0000","last_became_active":"2024-09-12T18:26:45.861947+0000","last_became_peered":"2024-09-12T18:26:45.861947+0000","last_unstale":"2024-09-12T19:11:58.719215+0000","last_undegraded":"2024-09-12T19:11:58.719215+0000","last_fullsized":"2024-09-12T19:11:58.719215+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:08.858976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56992,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":939,"num_write":374,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'752","reported_seq":2376,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.024733+0000","last_change":"2024-09-12T18:26:47.881128+0000","last_active":"2024-09-12T19:13:44.024733+0000","last_peered":"2024-09-12T19:13:44.024733+0000","last_clean":"2024-09-12T19:13:44.024733+0000","last_became_active":"2024-09-12T18:26:47.880400+0000","last_became_peered":"2024-09-12T18:26:47.880400+0000","last_unstale":"2024-09-12T19:13:44.024733+0000","last_undegraded":"2024-09-12T19:13:44.024733+0000","last_fullsized":"2024-09-12T19:13:44.024733+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:33.420018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'139","reported_seq":636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:06.307338+0000","last_change":"2024-09-12T18:26:49.914558+0000","last_active":"2024-09-12T19:11:06.307338+0000","last_peered":"2024-09-12T19:11:06.307338+0000","last_clean":"2024-09-12T19:11:06.307338+0000","last_became_active":"2024-09-12T18:26:49.913762+0000","last_became_peered":"2024-09-12T18:26:49.913762+0000","last_unstale":"2024-09-12T19:11:06.307338+0000","last_undegraded":"2024-09-12T19:11:06.307338+0000","last_fullsized":"2024-09-12T19:11:06.307338+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:09.188110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":330,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'794","reported_seq":2361,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.094946+0000","last_change":"2024-09-12T18:26:41.867333+0000","last_active":"2024-09-12T19:12:01.094946+0000","last_peered":"2024-09-12T19:12:01.094946+0000","last_clean":"2024-09-12T19:12:01.094946+0000","last_became_active":"2024-09-12T18:26:41.866528+0000","last_became_peered":"2024-09-12T18:26:41.866528+0000","last_unstale":"2024-09-12T19:12:01.094946+0000","last_undegraded":"2024-09-12T19:12:01.094946+0000","last_fullsized":"2024-09-12T19:12:01.094946+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:17.375009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3788,"num_read_kb":3420,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'274","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.596733+0000","last_change":"2024-09-12T18:26:39.844053+0000","last_active":"2024-09-12T19:11:43.596733+0000","last_peered":"2024-09-12T19:11:43.596733+0000","last_clean":"2024-09-12T19:11:43.596733+0000","last_became_active":"2024-09-12T18:26:39.839762+0000","last_became_peered":"2024-09-12T18:26:39.839762+0000","last_unstale":"2024-09-12T19:11:43.596733+0000","last_undegraded":"2024-09-12T19:11:43.596733+0000","last_fullsized":"2024-09-12T19:11:43.596733+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:10.306869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11428025,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":349,"num_read_kb":30494,"num_write":980,"num_write_kb":26286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1443,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.886976+0000","last_change":"2024-09-12T18:26:43.862723+0000","last_active":"2024-09-12T19:13:43.886976+0000","last_peered":"2024-09-12T19:13:43.886976+0000","last_clean":"2024-09-12T19:13:43.886976+0000","last_became_active":"2024-09-12T18:26:43.861969+0000","last_became_peered":"2024-09-12T18:26:43.861969+0000","last_unstale":"2024-09-12T19:13:43.886976+0000","last_undegraded":"2024-09-12T19:13:43.886976+0000","last_fullsized":"2024-09-12T19:13:43.886976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:53.579120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":949,"num_read_kb":949,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'77","reported_seq":593,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.717443+0000","last_change":"2024-09-12T18:26:46.020701+0000","last_active":"2024-09-12T19:11:48.717443+0000","last_peered":"2024-09-12T19:11:48.717443+0000","last_clean":"2024-09-12T19:11:48.717443+0000","last_became_active":"2024-09-12T18:26:46.019895+0000","last_became_peered":"2024-09-12T18:26:46.019895+0000","last_unstale":"2024-09-12T19:11:48.717443+0000","last_undegraded":"2024-09-12T19:11:48.717443+0000","last_fullsized":"2024-09-12T19:11:48.717443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:43.067058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'765","reported_seq":4368,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.027134+0000","last_change":"2024-09-12T18:26:47.888210+0000","last_active":"2024-09-12T19:13:44.027134+0000","last_peered":"2024-09-12T19:13:44.027134+0000","last_clean":"2024-09-12T19:13:44.027134+0000","last_became_active":"2024-09-12T18:26:47.882417+0000","last_became_peered":"2024-09-12T18:26:47.882417+0000","last_unstale":"2024-09-12T19:13:44.027134+0000","last_undegraded":"2024-09-12T19:13:44.027134+0000","last_fullsized":"2024-09-12T19:13:44.027134+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:18.819184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'146","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:04.041466+0000","last_change":"2024-09-12T18:26:49.927258+0000","last_active":"2024-09-12T19:12:04.041466+0000","last_peered":"2024-09-12T19:12:04.041466+0000","last_clean":"2024-09-12T19:12:04.041466+0000","last_became_active":"2024-09-12T18:26:49.926637+0000","last_became_peered":"2024-09-12T18:26:49.926637+0000","last_unstale":"2024-09-12T19:12:04.041466+0000","last_undegraded":"2024-09-12T19:12:04.041466+0000","last_fullsized":"2024-09-12T19:12:04.041466+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:49.800769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":120,"num_write":360,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'756","reported_seq":2269,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.171030+0000","last_change":"2024-09-12T18:26:41.839495+0000","last_active":"2024-09-12T19:11:59.171030+0000","last_peered":"2024-09-12T19:11:59.171030+0000","last_clean":"2024-09-12T19:11:59.171030+0000","last_became_active":"2024-09-12T18:26:41.839152+0000","last_became_peered":"2024-09-12T18:26:41.839152+0000","last_unstale":"2024-09-12T19:11:59.171030+0000","last_undegraded":"2024-09-12T19:11:59.171030+0000","last_fullsized":"2024-09-12T19:11:59.171030+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:53.021667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3609,"num_read_kb":3261,"num_write":1016,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'299","reported_seq":1162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.198702+0000","last_change":"2024-09-12T18:26:39.842163+0000","last_active":"2024-09-12T19:12:08.198702+0000","last_peered":"2024-09-12T19:12:08.198702+0000","last_clean":"2024-09-12T19:12:08.198702+0000","last_became_active":"2024-09-12T18:26:39.839018+0000","last_became_peered":"2024-09-12T18:26:39.839018+0000","last_unstale":"2024-09-12T19:12:08.198702+0000","last_undegraded":"2024-09-12T19:12:08.198702+0000","last_fullsized":"2024-09-12T19:12:08.198702+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:01.980870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12779029,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":917,"num_read_kb":16661,"num_write":1175,"num_write_kb":29221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:29.091642+0000","last_change":"2024-09-12T18:26:43.875133+0000","last_active":"2024-09-12T19:09:29.091642+0000","last_peered":"2024-09-12T19:09:29.091642+0000","last_clean":"2024-09-12T19:09:29.091642+0000","last_became_active":"2024-09-12T18:26:43.872882+0000","last_became_peered":"2024-09-12T18:26:43.872882+0000","last_unstale":"2024-09-12T19:09:29.091642+0000","last_undegraded":"2024-09-12T19:09:29.091642+0000","last_fullsized":"2024-09-12T19:09:29.091642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:27.685683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'390","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.370347+0000","last_change":"2024-09-12T18:26:45.871763+0000","last_active":"2024-09-12T19:12:24.370347+0000","last_peered":"2024-09-12T19:12:24.370347+0000","last_clean":"2024-09-12T19:12:24.370347+0000","last_became_active":"2024-09-12T18:26:45.871011+0000","last_became_peered":"2024-09-12T18:26:45.871011+0000","last_unstale":"2024-09-12T19:12:24.370347+0000","last_undegraded":"2024-09-12T19:12:24.370347+0000","last_fullsized":"2024-09-12T19:12:24.370347+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:25.203156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55304,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1182,"num_read_kb":1667,"num_write":1694,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:33.885454+0000","last_change":"2024-09-12T18:26:47.894796+0000","last_active":"2024-09-12T19:09:33.885454+0000","last_peered":"2024-09-12T19:09:33.885454+0000","last_clean":"2024-09-12T19:09:33.885454+0000","last_became_active":"2024-09-12T18:26:47.893881+0000","last_became_peered":"2024-09-12T18:26:47.893881+0000","last_unstale":"2024-09-12T19:09:33.885454+0000","last_undegraded":"2024-09-12T19:09:33.885454+0000","last_fullsized":"2024-09-12T19:09:33.885454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:58.081365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'157","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:37.541375+0000","last_change":"2024-09-12T18:26:49.912169+0000","last_active":"2024-09-12T19:11:37.541375+0000","last_peered":"2024-09-12T19:11:37.541375+0000","last_clean":"2024-09-12T19:11:37.541375+0000","last_became_active":"2024-09-12T18:26:49.911403+0000","last_became_peered":"2024-09-12T18:26:49.911403+0000","last_unstale":"2024-09-12T19:11:37.541375+0000","last_undegraded":"2024-09-12T19:11:37.541375+0000","last_fullsized":"2024-09-12T19:11:37.541375+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:01.150938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":152,"num_write":383,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'825","reported_seq":2330,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.126584+0000","last_change":"2024-09-12T18:26:41.874124+0000","last_active":"2024-09-12T19:12:24.126584+0000","last_peered":"2024-09-12T19:12:24.126584+0000","last_clean":"2024-09-12T19:12:24.126584+0000","last_became_active":"2024-09-12T18:26:41.873329+0000","last_became_peered":"2024-09-12T18:26:41.873329+0000","last_unstale":"2024-09-12T19:12:24.126584+0000","last_undegraded":"2024-09-12T19:12:24.126584+0000","last_fullsized":"2024-09-12T19:12:24.126584+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:49.832562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3864,"num_read_kb":3455,"num_write":1112,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.901972+0000","last_change":"2024-09-12T18:26:20.490476+0000","last_active":"2024-09-12T19:10:32.901972+0000","last_peered":"2024-09-12T19:10:32.901972+0000","last_clean":"2024-09-12T19:10:32.901972+0000","last_became_active":"2024-09-12T18:26:20.488464+0000","last_became_peered":"2024-09-12T18:26:20.488464+0000","last_unstale":"2024-09-12T19:10:32.901972+0000","last_undegraded":"2024-09-12T19:10:32.901972+0000","last_fullsized":"2024-09-12T19:10:32.901972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:19.397195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:19.397195+0000","last_clean_scrub_stamp":"2024-09-12T18:26:19.397195+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:55.130875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.891893+0000","last_change":"2024-09-12T18:26:27.490424+0000","last_active":"2024-09-12T19:10:13.891893+0000","last_peered":"2024-09-12T19:10:13.891893+0000","last_clean":"2024-09-12T19:10:13.891893+0000","last_became_active":"2024-09-12T18:26:25.483072+0000","last_became_peered":"2024-09-12T18:26:25.483072+0000","last_unstale":"2024-09-12T19:10:13.891893+0000","last_undegraded":"2024-09-12T19:10:13.891893+0000","last_fullsized":"2024-09-12T19:10:13.891893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:05.867109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010071489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'306","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:04.359804+0000","last_change":"2024-09-12T18:26:39.855572+0000","last_active":"2024-09-12T19:12:04.359804+0000","last_peered":"2024-09-12T19:12:04.359804+0000","last_clean":"2024-09-12T19:12:04.359804+0000","last_became_active":"2024-09-12T18:26:39.855274+0000","last_became_peered":"2024-09-12T18:26:39.855274+0000","last_unstale":"2024-09-12T19:12:04.359804+0000","last_undegraded":"2024-09-12T19:12:04.359804+0000","last_fullsized":"2024-09-12T19:12:04.359804+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:41.652285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4633640,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":526,"num_read_kb":43410,"num_write":1089,"num_write_kb":32341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"36'3","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.574535+0000","last_change":"2024-09-12T18:26:43.863289+0000","last_active":"2024-09-12T19:13:56.574535+0000","last_peered":"2024-09-12T19:13:56.574535+0000","last_clean":"2024-09-12T19:13:56.574535+0000","last_became_active":"2024-09-12T18:26:43.862599+0000","last_became_peered":"2024-09-12T18:26:43.862599+0000","last_unstale":"2024-09-12T19:13:56.574535+0000","last_undegraded":"2024-09-12T19:13:56.574535+0000","last_fullsized":"2024-09-12T19:13:56.574535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:40.040108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'703","reported_seq":1386,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.976548+0000","last_change":"2024-09-12T18:26:45.871462+0000","last_active":"2024-09-12T19:13:43.976548+0000","last_peered":"2024-09-12T19:13:43.976548+0000","last_clean":"2024-09-12T19:13:43.976548+0000","last_became_active":"2024-09-12T18:26:45.870711+0000","last_became_peered":"2024-09-12T18:26:45.870711+0000","last_unstale":"2024-09-12T19:13:43.976548+0000","last_undegraded":"2024-09-12T19:13:43.976548+0000","last_fullsized":"2024-09-12T19:13:43.976548+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:33.052933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185163,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1361,"num_read_kb":2859,"num_write":1270,"num_write_kb":1141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.915809+0000","last_change":"2024-09-12T18:26:47.888177+0000","last_active":"2024-09-12T19:10:08.915809+0000","last_peered":"2024-09-12T19:10:08.915809+0000","last_clean":"2024-09-12T19:10:08.915809+0000","last_became_active":"2024-09-12T18:26:47.886696+0000","last_became_peered":"2024-09-12T18:26:47.886696+0000","last_unstale":"2024-09-12T19:10:08.915809+0000","last_undegraded":"2024-09-12T19:10:08.915809+0000","last_fullsized":"2024-09-12T19:10:08.915809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:07.144929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'175","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.921796+0000","last_change":"2024-09-12T18:26:49.910601+0000","last_active":"2024-09-12T19:12:23.921796+0000","last_peered":"2024-09-12T19:12:23.921796+0000","last_clean":"2024-09-12T19:12:23.921796+0000","last_became_active":"2024-09-12T18:26:49.909591+0000","last_became_peered":"2024-09-12T18:26:49.909591+0000","last_unstale":"2024-09-12T19:12:23.921796+0000","last_undegraded":"2024-09-12T19:12:23.921796+0000","last_fullsized":"2024-09-12T19:12:23.921796+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.427369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":451,"num_write":354,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'445","reported_seq":1921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.106331+0000","last_change":"2024-09-12T18:27:11.827439+0000","last_active":"2024-09-12T19:13:43.106331+0000","last_peered":"2024-09-12T19:13:43.106331+0000","last_clean":"2024-09-12T19:13:43.106331+0000","last_became_active":"2024-09-12T18:27:11.825677+0000","last_became_peered":"2024-09-12T18:27:11.825677+0000","last_unstale":"2024-09-12T19:13:43.106331+0000","last_undegraded":"2024-09-12T19:13:43.106331+0000","last_fullsized":"2024-09-12T19:13:43.106331+0000","mapping_epoch":37,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:25.109981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2226,"num_read_kb":2089,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903232+0000","last_change":"2024-09-12T18:26:28.282837+0000","last_active":"2024-09-12T19:10:37.903232+0000","last_peered":"2024-09-12T19:10:37.903232+0000","last_clean":"2024-09-12T19:10:37.903232+0000","last_became_active":"2024-09-12T18:26:25.486681+0000","last_became_peered":"2024-09-12T18:26:25.486681+0000","last_unstale":"2024-09-12T19:10:37.903232+0000","last_undegraded":"2024-09-12T19:10:37.903232+0000","last_fullsized":"2024-09-12T19:10:37.903232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:48.632695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001127308,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'354","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:35.534251+0000","last_change":"2024-09-12T18:26:39.853101+0000","last_active":"2024-09-12T19:13:35.534251+0000","last_peered":"2024-09-12T19:13:35.534251+0000","last_clean":"2024-09-12T19:13:35.534251+0000","last_became_active":"2024-09-12T18:26:39.852604+0000","last_became_peered":"2024-09-12T18:26:39.852604+0000","last_unstale":"2024-09-12T19:13:35.534251+0000","last_undegraded":"2024-09-12T19:13:35.534251+0000","last_fullsized":"2024-09-12T19:13:35.534251+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:00.197344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3657272,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":527,"num_read_kb":8880,"num_write":1199,"num_write_kb":32875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.889750+0000","last_change":"2024-09-12T18:26:43.858389+0000","last_active":"2024-09-12T19:10:03.889750+0000","last_peered":"2024-09-12T19:10:03.889750+0000","last_clean":"2024-09-12T19:10:03.889750+0000","last_became_active":"2024-09-12T18:26:43.857619+0000","last_became_peered":"2024-09-12T18:26:43.857619+0000","last_unstale":"2024-09-12T19:10:03.889750+0000","last_undegraded":"2024-09-12T19:10:03.889750+0000","last_fullsized":"2024-09-12T19:10:03.889750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:43.526191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1270","reported_seq":2772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.340316+0000","last_change":"2024-09-12T18:26:45.866866+0000","last_active":"2024-09-12T19:13:57.340316+0000","last_peered":"2024-09-12T19:13:57.340316+0000","last_clean":"2024-09-12T19:13:57.340316+0000","last_became_active":"2024-09-12T18:26:45.865530+0000","last_became_peered":"2024-09-12T18:26:45.865530+0000","last_unstale":"2024-09-12T19:13:57.340316+0000","last_undegraded":"2024-09-12T19:13:57.340316+0000","last_fullsized":"2024-09-12T19:13:57.340316+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:38.754345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155377,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1993,"num_read_kb":3658,"num_write":1108,"num_write_kb":952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:42.904610+0000","last_change":"2024-09-12T18:26:47.887431+0000","last_active":"2024-09-12T19:10:42.904610+0000","last_peered":"2024-09-12T19:10:42.904610+0000","last_clean":"2024-09-12T19:10:42.904610+0000","last_became_active":"2024-09-12T18:26:47.886707+0000","last_became_peered":"2024-09-12T18:26:47.886707+0000","last_unstale":"2024-09-12T19:10:42.904610+0000","last_undegraded":"2024-09-12T19:10:42.904610+0000","last_fullsized":"2024-09-12T19:10:42.904610+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:24.695168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'194","reported_seq":727,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:22.676957+0000","last_change":"2024-09-12T18:26:49.910993+0000","last_active":"2024-09-12T19:12:22.676957+0000","last_peered":"2024-09-12T19:12:22.676957+0000","last_clean":"2024-09-12T19:12:22.676957+0000","last_became_active":"2024-09-12T18:26:49.909802+0000","last_became_peered":"2024-09-12T18:26:49.909802+0000","last_unstale":"2024-09-12T19:12:22.676957+0000","last_undegraded":"2024-09-12T19:12:22.676957+0000","last_fullsized":"2024-09-12T19:12:22.676957+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:14.966749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":337,"num_read_kb":322,"num_write":434,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'391","reported_seq":1912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.102094+0000","last_change":"2024-09-12T18:26:41.869197+0000","last_active":"2024-09-12T19:13:43.102094+0000","last_peered":"2024-09-12T19:13:43.102094+0000","last_clean":"2024-09-12T19:13:43.102094+0000","last_became_active":"2024-09-12T18:26:41.868958+0000","last_became_peered":"2024-09-12T18:26:41.868958+0000","last_unstale":"2024-09-12T19:13:43.102094+0000","last_undegraded":"2024-09-12T19:13:43.102094+0000","last_fullsized":"2024-09-12T19:13:43.102094+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:46.271646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2137,"num_read_kb":2050,"num_write":435,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.880725+0000","last_change":"2024-09-12T18:26:27.893863+0000","last_active":"2024-09-12T19:10:13.880725+0000","last_peered":"2024-09-12T19:10:13.880725+0000","last_clean":"2024-09-12T19:10:13.880725+0000","last_became_active":"2024-09-12T18:26:25.559069+0000","last_became_peered":"2024-09-12T18:26:25.559069+0000","last_unstale":"2024-09-12T19:10:13.880725+0000","last_undegraded":"2024-09-12T19:10:13.880725+0000","last_fullsized":"2024-09-12T19:10:13.880725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:18.983449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065344600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'265","reported_seq":874,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.741585+0000","last_change":"2024-09-12T18:26:39.833083+0000","last_active":"2024-09-12T19:13:57.741585+0000","last_peered":"2024-09-12T19:13:57.741585+0000","last_clean":"2024-09-12T19:13:57.741585+0000","last_became_active":"2024-09-12T18:26:39.832766+0000","last_became_peered":"2024-09-12T18:26:39.832766+0000","last_unstale":"2024-09-12T19:13:57.741585+0000","last_undegraded":"2024-09-12T19:13:57.741585+0000","last_fullsized":"2024-09-12T19:13:57.741585+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:39.006582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9548513,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":351,"num_read_kb":10646,"num_write":844,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.878799+0000","last_change":"2024-09-12T18:26:43.844267+0000","last_active":"2024-09-12T19:10:03.878799+0000","last_peered":"2024-09-12T19:10:03.878799+0000","last_clean":"2024-09-12T19:10:03.878799+0000","last_became_active":"2024-09-12T18:26:43.843884+0000","last_became_peered":"2024-09-12T18:26:43.843884+0000","last_unstale":"2024-09-12T19:10:03.878799+0000","last_undegraded":"2024-09-12T19:10:03.878799+0000","last_fullsized":"2024-09-12T19:10:03.878799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:30.199439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'237","reported_seq":1345,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:40.758792+0000","last_change":"2024-09-12T18:26:46.025252+0000","last_active":"2024-09-12T19:13:40.758792+0000","last_peered":"2024-09-12T19:13:40.758792+0000","last_clean":"2024-09-12T19:13:40.758792+0000","last_became_active":"2024-09-12T18:26:46.024474+0000","last_became_peered":"2024-09-12T18:26:46.024474+0000","last_unstale":"2024-09-12T19:13:40.758792+0000","last_undegraded":"2024-09-12T19:13:40.758792+0000","last_fullsized":"2024-09-12T19:13:40.758792+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:08.550075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.922523+0000","last_change":"2024-09-12T18:26:47.890416+0000","last_active":"2024-09-12T19:10:33.922523+0000","last_peered":"2024-09-12T19:10:33.922523+0000","last_clean":"2024-09-12T19:10:33.922523+0000","last_became_active":"2024-09-12T18:26:47.889718+0000","last_became_peered":"2024-09-12T18:26:47.889718+0000","last_unstale":"2024-09-12T19:10:33.922523+0000","last_undegraded":"2024-09-12T19:10:33.922523+0000","last_fullsized":"2024-09-12T19:10:33.922523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:51.602872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'249","reported_seq":844,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.430831+0000","last_change":"2024-09-12T18:26:49.913279+0000","last_active":"2024-09-12T19:12:23.430831+0000","last_peered":"2024-09-12T19:12:23.430831+0000","last_clean":"2024-09-12T19:12:23.430831+0000","last_became_active":"2024-09-12T18:26:49.912488+0000","last_became_peered":"2024-09-12T18:26:49.912488+0000","last_unstale":"2024-09-12T19:12:23.430831+0000","last_undegraded":"2024-09-12T19:12:23.430831+0000","last_fullsized":"2024-09-12T19:12:23.430831+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:27.428030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":492,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'918","reported_seq":2678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:00.244376+0000","last_change":"2024-09-12T18:26:41.849621+0000","last_active":"2024-09-12T19:12:00.244376+0000","last_peered":"2024-09-12T19:12:00.244376+0000","last_clean":"2024-09-12T19:12:00.244376+0000","last_became_active":"2024-09-12T18:26:41.847403+0000","last_became_peered":"2024-09-12T18:26:41.847403+0000","last_unstale":"2024-09-12T19:12:00.244376+0000","last_undegraded":"2024-09-12T19:12:00.244376+0000","last_fullsized":"2024-09-12T19:12:00.244376+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:03.076819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4497,"num_read_kb":4050,"num_write":1227,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.891846+0000","last_change":"2024-09-12T18:26:27.491626+0000","last_active":"2024-09-12T19:10:13.891846+0000","last_peered":"2024-09-12T19:10:13.891846+0000","last_clean":"2024-09-12T19:10:13.891846+0000","last_became_active":"2024-09-12T18:26:25.483909+0000","last_became_peered":"2024-09-12T18:26:25.483909+0000","last_unstale":"2024-09-12T19:10:13.891846+0000","last_undegraded":"2024-09-12T19:10:13.891846+0000","last_fullsized":"2024-09-12T19:10:13.891846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:34.647003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002260153,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'246","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:29.074334+0000","last_change":"2024-09-12T18:26:39.847712+0000","last_active":"2024-09-12T19:11:29.074334+0000","last_peered":"2024-09-12T19:11:29.074334+0000","last_clean":"2024-09-12T19:11:29.074334+0000","last_became_active":"2024-09-12T18:26:39.847002+0000","last_became_peered":"2024-09-12T18:26:39.847002+0000","last_unstale":"2024-09-12T19:11:29.074334+0000","last_undegraded":"2024-09-12T19:11:29.074334+0000","last_fullsized":"2024-09-12T19:11:29.074334+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:18.232097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11547385,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":554,"num_read_kb":6223,"num_write":894,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.923800+0000","last_change":"2024-09-12T18:26:43.862162+0000","last_active":"2024-09-12T19:10:38.923800+0000","last_peered":"2024-09-12T19:10:38.923800+0000","last_clean":"2024-09-12T19:10:38.923800+0000","last_became_active":"2024-09-12T18:26:43.861753+0000","last_became_peered":"2024-09-12T18:26:43.861753+0000","last_unstale":"2024-09-12T19:10:38.923800+0000","last_undegraded":"2024-09-12T19:10:38.923800+0000","last_fullsized":"2024-09-12T19:10:38.923800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:33.728113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'111","reported_seq":649,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.724941+0000","last_change":"2024-09-12T18:26:45.857442+0000","last_active":"2024-09-12T19:12:18.724941+0000","last_peered":"2024-09-12T19:12:18.724941+0000","last_clean":"2024-09-12T19:12:18.724941+0000","last_became_active":"2024-09-12T18:26:45.856615+0000","last_became_peered":"2024-09-12T18:26:45.856615+0000","last_unstale":"2024-09-12T19:12:18.724941+0000","last_undegraded":"2024-09-12T19:12:18.724941+0000","last_fullsized":"2024-09-12T19:12:18.724941+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:39.665638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.893516+0000","last_change":"2024-09-12T18:26:47.885794+0000","last_active":"2024-09-12T19:10:08.893516+0000","last_peered":"2024-09-12T19:10:08.893516+0000","last_clean":"2024-09-12T19:10:08.893516+0000","last_became_active":"2024-09-12T18:26:47.884981+0000","last_became_peered":"2024-09-12T18:26:47.884981+0000","last_unstale":"2024-09-12T19:10:08.893516+0000","last_undegraded":"2024-09-12T19:10:08.893516+0000","last_fullsized":"2024-09-12T19:10:08.893516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:07.204617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'140","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.019034+0000","last_change":"2024-09-12T18:26:49.918948+0000","last_active":"2024-09-12T19:13:43.019034+0000","last_peered":"2024-09-12T19:13:43.019034+0000","last_clean":"2024-09-12T19:13:43.019034+0000","last_became_active":"2024-09-12T18:26:49.918043+0000","last_became_peered":"2024-09-12T18:26:49.918043+0000","last_unstale":"2024-09-12T19:13:43.019034+0000","last_undegraded":"2024-09-12T19:13:43.019034+0000","last_fullsized":"2024-09-12T19:13:43.019034+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:07.565002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":258,"num_write":354,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'546","reported_seq":2235,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.289400+0000","last_change":"2024-09-12T18:26:41.878502+0000","last_active":"2024-09-12T19:12:23.289400+0000","last_peered":"2024-09-12T19:12:23.289400+0000","last_clean":"2024-09-12T19:12:23.289400+0000","last_became_active":"2024-09-12T18:26:41.878269+0000","last_became_peered":"2024-09-12T18:26:41.878269+0000","last_unstale":"2024-09-12T19:12:23.289400+0000","last_undegraded":"2024-09-12T19:12:23.289400+0000","last_fullsized":"2024-09-12T19:12:23.289400+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:02.850426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2954,"num_read_kb":2745,"num_write":669,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'402","reported_seq":1095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.897624+0000","last_change":"2024-09-12T18:26:39.853539+0000","last_active":"2024-09-12T19:10:38.897624+0000","last_peered":"2024-09-12T19:10:38.897624+0000","last_clean":"2024-09-12T19:10:38.897624+0000","last_became_active":"2024-09-12T18:26:39.851739+0000","last_became_peered":"2024-09-12T18:26:39.851739+0000","last_unstale":"2024-09-12T19:10:38.897624+0000","last_undegraded":"2024-09-12T19:10:38.897624+0000","last_fullsized":"2024-09-12T19:10:38.897624+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:22.623593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8737309,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":796,"num_read_kb":21229,"num_write":1305,"num_write_kb":18457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:12.904532+0000","last_change":"2024-09-12T18:26:27.492857+0000","last_active":"2024-09-12T19:10:12.904532+0000","last_peered":"2024-09-12T19:10:12.904532+0000","last_clean":"2024-09-12T19:10:12.904532+0000","last_became_active":"2024-09-12T18:26:25.474997+0000","last_became_peered":"2024-09-12T18:26:25.474997+0000","last_unstale":"2024-09-12T19:10:12.904532+0000","last_undegraded":"2024-09-12T19:10:12.904532+0000","last_fullsized":"2024-09-12T19:10:12.904532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:39.276451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099306900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.921024+0000","last_change":"2024-09-12T18:26:43.866505+0000","last_active":"2024-09-12T19:10:28.921024+0000","last_peered":"2024-09-12T19:10:28.921024+0000","last_clean":"2024-09-12T19:10:28.921024+0000","last_became_active":"2024-09-12T18:26:43.865697+0000","last_became_peered":"2024-09-12T18:26:43.865697+0000","last_unstale":"2024-09-12T19:10:28.921024+0000","last_undegraded":"2024-09-12T19:10:28.921024+0000","last_fullsized":"2024-09-12T19:10:28.921024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:41.285586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'542","reported_seq":1197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.959962+0000","last_change":"2024-09-12T18:26:45.880984+0000","last_active":"2024-09-12T19:13:43.959962+0000","last_peered":"2024-09-12T19:13:43.959962+0000","last_clean":"2024-09-12T19:13:43.959962+0000","last_became_active":"2024-09-12T18:26:45.877100+0000","last_became_peered":"2024-09-12T18:26:45.877100+0000","last_unstale":"2024-09-12T19:13:43.959962+0000","last_undegraded":"2024-09-12T19:13:43.959962+0000","last_fullsized":"2024-09-12T19:13:43.959962+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:31.277291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117225,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":926,"num_read_kb":1878,"num_write":804,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:34.105870+0000","last_change":"2024-09-12T18:26:47.900861+0000","last_active":"2024-09-12T19:10:34.105870+0000","last_peered":"2024-09-12T19:10:34.105870+0000","last_clean":"2024-09-12T19:10:34.105870+0000","last_became_active":"2024-09-12T18:26:47.900217+0000","last_became_peered":"2024-09-12T18:26:47.900217+0000","last_unstale":"2024-09-12T19:10:34.105870+0000","last_undegraded":"2024-09-12T19:10:34.105870+0000","last_fullsized":"2024-09-12T19:10:34.105870+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:22.630784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'141","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.613946+0000","last_change":"2024-09-12T18:26:49.921916+0000","last_active":"2024-09-12T19:12:18.613946+0000","last_peered":"2024-09-12T19:12:18.613946+0000","last_clean":"2024-09-12T19:12:18.613946+0000","last_became_active":"2024-09-12T18:26:49.921123+0000","last_became_peered":"2024-09-12T18:26:49.921123+0000","last_unstale":"2024-09-12T19:12:18.613946+0000","last_undegraded":"2024-09-12T19:12:18.613946+0000","last_fullsized":"2024-09-12T19:12:18.613946+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:45.398942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":212,"num_read_kb":188,"num_write":350,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'425","reported_seq":1878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.623418+0000","last_change":"2024-09-12T18:26:41.869757+0000","last_active":"2024-09-12T19:12:18.623418+0000","last_peered":"2024-09-12T19:12:18.623418+0000","last_clean":"2024-09-12T19:12:18.623418+0000","last_became_active":"2024-09-12T18:26:41.869426+0000","last_became_peered":"2024-09-12T18:26:41.869426+0000","last_unstale":"2024-09-12T19:12:18.623418+0000","last_undegraded":"2024-09-12T19:12:18.623418+0000","last_fullsized":"2024-09-12T19:12:18.623418+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:16.916527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2246,"num_read_kb":2097,"num_write":505,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'332","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.701512+0000","last_change":"2024-09-12T18:26:39.833175+0000","last_active":"2024-09-12T19:13:57.701512+0000","last_peered":"2024-09-12T19:13:57.701512+0000","last_clean":"2024-09-12T19:13:57.701512+0000","last_became_active":"2024-09-12T18:26:39.832593+0000","last_became_peered":"2024-09-12T18:26:39.832593+0000","last_unstale":"2024-09-12T19:13:57.701512+0000","last_undegraded":"2024-09-12T19:13:57.701512+0000","last_fullsized":"2024-09-12T19:13:57.701512+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:39.366882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6812624,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":611,"num_read_kb":23528,"num_write":1181,"num_write_kb":24783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899815+0000","last_change":"2024-09-12T18:26:28.282666+0000","last_active":"2024-09-12T19:10:22.899815+0000","last_peered":"2024-09-12T19:10:22.899815+0000","last_clean":"2024-09-12T19:10:22.899815+0000","last_became_active":"2024-09-12T18:26:25.484938+0000","last_became_peered":"2024-09-12T18:26:25.484938+0000","last_unstale":"2024-09-12T19:10:22.899815+0000","last_undegraded":"2024-09-12T19:10:22.899815+0000","last_fullsized":"2024-09-12T19:10:22.899815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:50.645807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001083194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.898070+0000","last_change":"2024-09-12T18:26:43.864066+0000","last_active":"2024-09-12T19:10:28.898070+0000","last_peered":"2024-09-12T19:10:28.898070+0000","last_clean":"2024-09-12T19:10:28.898070+0000","last_became_active":"2024-09-12T18:26:43.863388+0000","last_became_peered":"2024-09-12T18:26:43.863388+0000","last_unstale":"2024-09-12T19:10:28.898070+0000","last_undegraded":"2024-09-12T19:10:28.898070+0000","last_fullsized":"2024-09-12T19:10:28.898070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:19.436463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'160","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:15.347431+0000","last_change":"2024-09-12T18:26:46.020793+0000","last_active":"2024-09-12T19:11:15.347431+0000","last_peered":"2024-09-12T19:11:15.347431+0000","last_clean":"2024-09-12T19:11:15.347431+0000","last_became_active":"2024-09-12T18:26:46.020043+0000","last_became_peered":"2024-09-12T18:26:46.020043+0000","last_unstale":"2024-09-12T19:11:15.347431+0000","last_undegraded":"2024-09-12T19:11:15.347431+0000","last_fullsized":"2024-09-12T19:11:15.347431+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:28.384889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":189,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'811","reported_seq":2654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.020813+0000","last_change":"2024-09-12T18:26:47.880379+0000","last_active":"2024-09-12T19:13:44.020813+0000","last_peered":"2024-09-12T19:13:44.020813+0000","last_clean":"2024-09-12T19:13:44.020813+0000","last_became_active":"2024-09-12T18:26:47.879630+0000","last_became_peered":"2024-09-12T18:26:47.879630+0000","last_unstale":"2024-09-12T19:13:44.020813+0000","last_undegraded":"2024-09-12T19:13:44.020813+0000","last_fullsized":"2024-09-12T19:13:44.020813+0000","mapping_epoch":32,"log_start":"265'800","ondisk_log_start":"265'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:34.644082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'140","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.115335+0000","last_change":"2024-09-12T18:26:49.920666+0000","last_active":"2024-09-12T19:12:24.115335+0000","last_peered":"2024-09-12T19:12:24.115335+0000","last_clean":"2024-09-12T19:12:24.115335+0000","last_became_active":"2024-09-12T18:26:49.919846+0000","last_became_peered":"2024-09-12T18:26:49.919846+0000","last_unstale":"2024-09-12T19:12:24.115335+0000","last_undegraded":"2024-09-12T19:12:24.115335+0000","last_fullsized":"2024-09-12T19:12:24.115335+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:00.339860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":263,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'481","reported_seq":2008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.125760+0000","last_change":"2024-09-12T18:26:41.862442+0000","last_active":"2024-09-12T19:12:24.125760+0000","last_peered":"2024-09-12T19:12:24.125760+0000","last_clean":"2024-09-12T19:12:24.125760+0000","last_became_active":"2024-09-12T18:26:41.862008+0000","last_became_peered":"2024-09-12T18:26:41.862008+0000","last_unstale":"2024-09-12T19:12:24.125760+0000","last_undegraded":"2024-09-12T19:12:24.125760+0000","last_fullsized":"2024-09-12T19:12:24.125760+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:52.293333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":2263,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'276","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:21.671305+0000","last_change":"2024-09-12T18:26:39.865325+0000","last_active":"2024-09-12T19:11:21.671305+0000","last_peered":"2024-09-12T19:11:21.671305+0000","last_clean":"2024-09-12T19:11:21.671305+0000","last_became_active":"2024-09-12T18:26:39.865123+0000","last_became_peered":"2024-09-12T18:26:39.865123+0000","last_unstale":"2024-09-12T19:11:21.671305+0000","last_undegraded":"2024-09-12T19:11:21.671305+0000","last_fullsized":"2024-09-12T19:11:21.671305+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:13.963084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9783150,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":415,"num_read_kb":68443,"num_write":1020,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:47.898557+0000","last_change":"2024-09-12T18:26:27.493293+0000","last_active":"2024-09-12T19:09:47.898557+0000","last_peered":"2024-09-12T19:09:47.898557+0000","last_clean":"2024-09-12T19:09:47.898557+0000","last_became_active":"2024-09-12T18:26:25.485137+0000","last_became_peered":"2024-09-12T18:26:25.485137+0000","last_unstale":"2024-09-12T19:09:47.898557+0000","last_undegraded":"2024-09-12T19:09:47.898557+0000","last_fullsized":"2024-09-12T19:09:47.898557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:37.081707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013350759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:29.104750+0000","last_change":"2024-09-12T18:26:43.876064+0000","last_active":"2024-09-12T19:10:29.104750+0000","last_peered":"2024-09-12T19:10:29.104750+0000","last_clean":"2024-09-12T19:10:29.104750+0000","last_became_active":"2024-09-12T18:26:43.874845+0000","last_became_peered":"2024-09-12T18:26:43.874845+0000","last_unstale":"2024-09-12T19:10:29.104750+0000","last_undegraded":"2024-09-12T19:10:29.104750+0000","last_fullsized":"2024-09-12T19:10:29.104750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:36.440895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'106","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.584442+0000","last_change":"2024-09-12T18:26:45.864296+0000","last_active":"2024-09-12T19:11:07.584442+0000","last_peered":"2024-09-12T19:11:07.584442+0000","last_clean":"2024-09-12T19:11:07.584442+0000","last_became_active":"2024-09-12T18:26:45.863254+0000","last_became_peered":"2024-09-12T18:26:45.863254+0000","last_unstale":"2024-09-12T19:11:07.584442+0000","last_undegraded":"2024-09-12T19:11:07.584442+0000","last_fullsized":"2024-09-12T19:11:07.584442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:25.709734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'802","reported_seq":2516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.027653+0000","last_change":"2024-09-12T18:26:47.900388+0000","last_active":"2024-09-12T19:13:44.027653+0000","last_peered":"2024-09-12T19:13:44.027653+0000","last_clean":"2024-09-12T19:13:44.027653+0000","last_became_active":"2024-09-12T18:26:47.899682+0000","last_became_peered":"2024-09-12T18:26:47.899682+0000","last_unstale":"2024-09-12T19:13:44.027653+0000","last_undegraded":"2024-09-12T19:13:44.027653+0000","last_fullsized":"2024-09-12T19:13:44.027653+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:26.128123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'166","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.560824+0000","last_change":"2024-09-12T18:26:49.918711+0000","last_active":"2024-09-12T19:12:06.560824+0000","last_peered":"2024-09-12T19:12:06.560824+0000","last_clean":"2024-09-12T19:12:06.560824+0000","last_became_active":"2024-09-12T18:26:49.917537+0000","last_became_peered":"2024-09-12T18:26:49.917537+0000","last_unstale":"2024-09-12T19:12:06.560824+0000","last_undegraded":"2024-09-12T19:12:06.560824+0000","last_fullsized":"2024-09-12T19:12:06.560824+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:42.696961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":124,"num_write":364,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'443","reported_seq":1936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.769155+0000","last_change":"2024-09-12T18:26:41.872406+0000","last_active":"2024-09-12T19:12:08.769155+0000","last_peered":"2024-09-12T19:12:08.769155+0000","last_clean":"2024-09-12T19:12:08.769155+0000","last_became_active":"2024-09-12T18:26:41.871518+0000","last_became_peered":"2024-09-12T18:26:41.871518+0000","last_unstale":"2024-09-12T19:12:08.769155+0000","last_undegraded":"2024-09-12T19:12:08.769155+0000","last_fullsized":"2024-09-12T19:12:08.769155+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:26.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2145,"num_write":516,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'246","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:36.603533+0000","last_change":"2024-09-12T18:26:39.834460+0000","last_active":"2024-09-12T19:13:36.603533+0000","last_peered":"2024-09-12T19:13:36.603533+0000","last_clean":"2024-09-12T19:13:36.603533+0000","last_became_active":"2024-09-12T18:26:39.833924+0000","last_became_peered":"2024-09-12T18:26:39.833924+0000","last_unstale":"2024-09-12T19:13:36.603533+0000","last_undegraded":"2024-09-12T19:13:36.603533+0000","last_fullsized":"2024-09-12T19:13:36.603533+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:19.120900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21176942,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":411,"num_read_kb":59967,"num_write":947,"num_write_kb":34278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.888730+0000","last_change":"2024-09-12T18:26:27.699071+0000","last_active":"2024-09-12T19:09:48.888730+0000","last_peered":"2024-09-12T19:09:48.888730+0000","last_clean":"2024-09-12T19:09:48.888730+0000","last_became_active":"2024-09-12T18:26:25.487465+0000","last_became_peered":"2024-09-12T18:26:25.487465+0000","last_unstale":"2024-09-12T19:09:48.888730+0000","last_undegraded":"2024-09-12T19:09:48.888730+0000","last_fullsized":"2024-09-12T19:09:48.888730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:22.342394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010368949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.924444+0000","last_change":"2024-09-12T18:26:43.851056+0000","last_active":"2024-09-12T19:10:48.924444+0000","last_peered":"2024-09-12T19:10:48.924444+0000","last_clean":"2024-09-12T19:10:48.924444+0000","last_became_active":"2024-09-12T18:26:43.850274+0000","last_became_peered":"2024-09-12T18:26:43.850274+0000","last_unstale":"2024-09-12T19:10:48.924444+0000","last_undegraded":"2024-09-12T19:10:48.924444+0000","last_fullsized":"2024-09-12T19:10:48.924444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:39.140912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'713","reported_seq":1417,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.172805+0000","last_change":"2024-09-12T18:26:46.021959+0000","last_active":"2024-09-12T19:13:57.172805+0000","last_peered":"2024-09-12T19:13:57.172805+0000","last_clean":"2024-09-12T19:13:57.172805+0000","last_became_active":"2024-09-12T18:26:46.021217+0000","last_became_peered":"2024-09-12T18:26:46.021217+0000","last_unstale":"2024-09-12T19:13:57.172805+0000","last_undegraded":"2024-09-12T19:13:57.172805+0000","last_fullsized":"2024-09-12T19:13:57.172805+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:41.193709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200250,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1278,"num_read_kb":2908,"num_write":1052,"num_write_kb":915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.920778+0000","last_change":"2024-09-12T18:26:47.903443+0000","last_active":"2024-09-12T19:10:33.920778+0000","last_peered":"2024-09-12T19:10:33.920778+0000","last_clean":"2024-09-12T19:10:33.920778+0000","last_became_active":"2024-09-12T18:26:47.902750+0000","last_became_peered":"2024-09-12T18:26:47.902750+0000","last_unstale":"2024-09-12T19:10:33.920778+0000","last_undegraded":"2024-09-12T19:10:33.920778+0000","last_fullsized":"2024-09-12T19:10:33.920778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:44.433901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'107","reported_seq":606,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:06.951330+0000","last_change":"2024-09-12T18:26:49.920307+0000","last_active":"2024-09-12T19:11:06.951330+0000","last_peered":"2024-09-12T19:11:06.951330+0000","last_clean":"2024-09-12T19:11:06.951330+0000","last_became_active":"2024-09-12T18:26:49.919630+0000","last_became_peered":"2024-09-12T18:26:49.919630+0000","last_unstale":"2024-09-12T19:11:06.951330+0000","last_undegraded":"2024-09-12T19:11:06.951330+0000","last_fullsized":"2024-09-12T19:11:06.951330+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:18.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":269,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'143","reported_seq":705,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.274239+0000","last_change":"2024-09-12T18:26:49.913310+0000","last_active":"2024-09-12T19:12:24.274239+0000","last_peered":"2024-09-12T19:12:24.274239+0000","last_clean":"2024-09-12T19:12:24.274239+0000","last_became_active":"2024-09-12T18:26:49.912589+0000","last_became_peered":"2024-09-12T18:26:49.912589+0000","last_unstale":"2024-09-12T19:12:24.274239+0000","last_undegraded":"2024-09-12T19:12:24.274239+0000","last_fullsized":"2024-09-12T19:12:24.274239+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:07.282432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":221,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'913","reported_seq":2534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.894035+0000","last_change":"2024-09-12T18:26:41.876618+0000","last_active":"2024-09-12T19:12:07.894035+0000","last_peered":"2024-09-12T19:12:07.894035+0000","last_clean":"2024-09-12T19:12:07.894035+0000","last_became_active":"2024-09-12T18:26:41.875870+0000","last_became_peered":"2024-09-12T18:26:41.875870+0000","last_unstale":"2024-09-12T19:12:07.894035+0000","last_undegraded":"2024-09-12T19:12:07.894035+0000","last_fullsized":"2024-09-12T19:12:07.894035+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:06.713897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4445,"num_read_kb":3959,"num_write":1252,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'247","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:19.876577+0000","last_change":"2024-09-12T18:26:39.871102+0000","last_active":"2024-09-12T19:12:19.876577+0000","last_peered":"2024-09-12T19:12:19.876577+0000","last_clean":"2024-09-12T19:12:19.876577+0000","last_became_active":"2024-09-12T18:26:39.870576+0000","last_became_peered":"2024-09-12T18:26:39.870576+0000","last_unstale":"2024-09-12T19:12:19.876577+0000","last_undegraded":"2024-09-12T19:12:19.876577+0000","last_fullsized":"2024-09-12T19:12:19.876577+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:00.119644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14281508,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":389,"num_read_kb":31608,"num_write":858,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.917883+0000","last_change":"2024-09-12T18:26:43.865954+0000","last_active":"2024-09-12T19:11:07.917883+0000","last_peered":"2024-09-12T19:11:07.917883+0000","last_clean":"2024-09-12T19:11:07.917883+0000","last_became_active":"2024-09-12T18:26:43.864969+0000","last_became_peered":"2024-09-12T18:26:43.864969+0000","last_unstale":"2024-09-12T19:11:07.917883+0000","last_undegraded":"2024-09-12T19:11:07.917883+0000","last_fullsized":"2024-09-12T19:11:07.917883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:54.874241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'271","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:28.737857+0000","last_change":"2024-09-12T18:26:45.866194+0000","last_active":"2024-09-12T19:13:28.737857+0000","last_peered":"2024-09-12T19:13:28.737857+0000","last_clean":"2024-09-12T19:13:28.737857+0000","last_became_active":"2024-09-12T18:26:45.865329+0000","last_became_peered":"2024-09-12T18:26:45.865329+0000","last_unstale":"2024-09-12T19:13:28.737857+0000","last_undegraded":"2024-09-12T19:13:28.737857+0000","last_fullsized":"2024-09-12T19:13:28.737857+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:49.534078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59089,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":960,"num_write":376,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.929904+0000","last_change":"2024-09-12T18:26:47.891460+0000","last_active":"2024-09-12T19:11:08.929904+0000","last_peered":"2024-09-12T19:11:08.929904+0000","last_clean":"2024-09-12T19:11:08.929904+0000","last_became_active":"2024-09-12T18:26:47.890741+0000","last_became_peered":"2024-09-12T18:26:47.890741+0000","last_unstale":"2024-09-12T19:11:08.929904+0000","last_undegraded":"2024-09-12T19:11:08.929904+0000","last_fullsized":"2024-09-12T19:11:08.929904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:13.839409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'196","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.440206+0000","last_change":"2024-09-12T18:26:49.915054+0000","last_active":"2024-09-12T19:11:38.440206+0000","last_peered":"2024-09-12T19:11:38.440206+0000","last_clean":"2024-09-12T19:11:38.440206+0000","last_became_active":"2024-09-12T18:26:49.914506+0000","last_became_peered":"2024-09-12T18:26:49.914506+0000","last_unstale":"2024-09-12T19:11:38.440206+0000","last_undegraded":"2024-09-12T19:11:38.440206+0000","last_fullsized":"2024-09-12T19:11:38.440206+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:39.521599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":157,"num_write":456,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'900","reported_seq":2436,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.125291+0000","last_change":"2024-09-12T18:26:41.868353+0000","last_active":"2024-09-12T19:12:24.125291+0000","last_peered":"2024-09-12T19:12:24.125291+0000","last_clean":"2024-09-12T19:12:24.125291+0000","last_became_active":"2024-09-12T18:26:41.868082+0000","last_became_peered":"2024-09-12T18:26:41.868082+0000","last_unstale":"2024-09-12T19:12:24.125291+0000","last_undegraded":"2024-09-12T19:12:24.125291+0000","last_fullsized":"2024-09-12T19:12:24.125291+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:35.031358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4276,"num_read_kb":3807,"num_write":1253,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'357","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.935546+0000","last_change":"2024-09-12T18:26:39.870444+0000","last_active":"2024-09-12T19:13:57.935546+0000","last_peered":"2024-09-12T19:13:57.935546+0000","last_clean":"2024-09-12T19:13:57.935546+0000","last_became_active":"2024-09-12T18:26:39.869754+0000","last_became_peered":"2024-09-12T18:26:39.869754+0000","last_unstale":"2024-09-12T19:13:57.935546+0000","last_undegraded":"2024-09-12T19:13:57.935546+0000","last_fullsized":"2024-09-12T19:13:57.935546+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:26.428249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7093992,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":495,"num_read_kb":32033,"num_write":1196,"num_write_kb":47606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"36'5","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.871279+0000","last_change":"2024-09-12T18:26:43.854895+0000","last_active":"2024-09-12T19:13:43.871279+0000","last_peered":"2024-09-12T19:13:43.871279+0000","last_clean":"2024-09-12T19:13:43.871279+0000","last_became_active":"2024-09-12T18:26:43.854155+0000","last_became_peered":"2024-09-12T18:26:43.854155+0000","last_unstale":"2024-09-12T19:13:43.871279+0000","last_undegraded":"2024-09-12T19:13:43.871279+0000","last_fullsized":"2024-09-12T19:13:43.871279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:39.758296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'67","reported_seq":571,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.295664+0000","last_change":"2024-09-12T18:26:45.880353+0000","last_active":"2024-09-12T19:12:23.295664+0000","last_peered":"2024-09-12T19:12:23.295664+0000","last_clean":"2024-09-12T19:12:23.295664+0000","last_became_active":"2024-09-12T18:26:45.876785+0000","last_became_peered":"2024-09-12T18:26:45.876785+0000","last_unstale":"2024-09-12T19:12:23.295664+0000","last_undegraded":"2024-09-12T19:12:23.295664+0000","last_fullsized":"2024-09-12T19:12:23.295664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:44.259605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910233+0000","last_change":"2024-09-12T18:26:47.891685+0000","last_active":"2024-09-12T19:11:07.910233+0000","last_peered":"2024-09-12T19:11:07.910233+0000","last_clean":"2024-09-12T19:11:07.910233+0000","last_became_active":"2024-09-12T18:26:47.890879+0000","last_became_peered":"2024-09-12T18:26:47.890879+0000","last_unstale":"2024-09-12T19:11:07.910233+0000","last_undegraded":"2024-09-12T19:11:07.910233+0000","last_fullsized":"2024-09-12T19:11:07.910233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:38.226570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'240","reported_seq":768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.263121+0000","last_change":"2024-09-12T18:26:49.926668+0000","last_active":"2024-09-12T19:12:23.263121+0000","last_peered":"2024-09-12T19:12:23.263121+0000","last_clean":"2024-09-12T19:12:23.263121+0000","last_became_active":"2024-09-12T18:26:49.925984+0000","last_became_peered":"2024-09-12T18:26:49.925984+0000","last_unstale":"2024-09-12T19:12:23.263121+0000","last_undegraded":"2024-09-12T19:12:23.263121+0000","last_fullsized":"2024-09-12T19:12:23.263121+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:41.544032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":350,"num_read_kb":337,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'459","reported_seq":2018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.554179+0000","last_change":"2024-09-12T18:26:41.882252+0000","last_active":"2024-09-12T19:12:09.554179+0000","last_peered":"2024-09-12T19:12:09.554179+0000","last_clean":"2024-09-12T19:12:09.554179+0000","last_became_active":"2024-09-12T18:26:41.881971+0000","last_became_peered":"2024-09-12T18:26:41.881971+0000","last_unstale":"2024-09-12T19:12:09.554179+0000","last_undegraded":"2024-09-12T19:12:09.554179+0000","last_fullsized":"2024-09-12T19:12:09.554179+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:07.504109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2569,"num_read_kb":2413,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'279","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.960344+0000","last_change":"2024-09-12T18:26:39.874319+0000","last_active":"2024-09-12T19:12:08.960344+0000","last_peered":"2024-09-12T19:12:08.960344+0000","last_clean":"2024-09-12T19:12:08.960344+0000","last_became_active":"2024-09-12T18:26:39.873510+0000","last_became_peered":"2024-09-12T18:26:39.873510+0000","last_unstale":"2024-09-12T19:12:08.960344+0000","last_undegraded":"2024-09-12T19:12:08.960344+0000","last_fullsized":"2024-09-12T19:12:08.960344+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:47.297748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2207284,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":450,"num_read_kb":9365,"num_write":1066,"num_write_kb":22463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910172+0000","last_change":"2024-09-12T18:26:43.860596+0000","last_active":"2024-09-12T19:11:07.910172+0000","last_peered":"2024-09-12T19:11:07.910172+0000","last_clean":"2024-09-12T19:11:07.910172+0000","last_became_active":"2024-09-12T18:26:43.859847+0000","last_became_peered":"2024-09-12T18:26:43.859847+0000","last_unstale":"2024-09-12T19:11:07.910172+0000","last_undegraded":"2024-09-12T19:11:07.910172+0000","last_fullsized":"2024-09-12T19:11:07.910172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:16.685561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'313","reported_seq":896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:28.737941+0000","last_change":"2024-09-12T18:26:45.878384+0000","last_active":"2024-09-12T19:13:28.737941+0000","last_peered":"2024-09-12T19:13:28.737941+0000","last_clean":"2024-09-12T19:13:28.737941+0000","last_became_active":"2024-09-12T18:26:45.877790+0000","last_became_peered":"2024-09-12T18:26:45.877790+0000","last_unstale":"2024-09-12T19:13:28.737941+0000","last_undegraded":"2024-09-12T19:13:28.737941+0000","last_fullsized":"2024-09-12T19:13:28.737941+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:03.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":1028,"num_write":412,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.906698+0000","last_change":"2024-09-12T18:26:47.888972+0000","last_active":"2024-09-12T19:11:08.906698+0000","last_peered":"2024-09-12T19:11:08.906698+0000","last_clean":"2024-09-12T19:11:08.906698+0000","last_became_active":"2024-09-12T18:26:47.888252+0000","last_became_peered":"2024-09-12T18:26:47.888252+0000","last_unstale":"2024-09-12T19:11:08.906698+0000","last_undegraded":"2024-09-12T19:11:08.906698+0000","last_fullsized":"2024-09-12T19:11:08.906698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:23.691736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'144","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.914495+0000","last_change":"2024-09-12T18:26:49.923128+0000","last_active":"2024-09-12T19:11:19.914495+0000","last_peered":"2024-09-12T19:11:19.914495+0000","last_clean":"2024-09-12T19:11:19.914495+0000","last_became_active":"2024-09-12T18:26:49.922459+0000","last_became_peered":"2024-09-12T18:26:49.922459+0000","last_unstale":"2024-09-12T19:11:19.914495+0000","last_undegraded":"2024-09-12T19:11:19.914495+0000","last_fullsized":"2024-09-12T19:11:19.914495+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:13.475689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":460,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":153,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'471","reported_seq":1980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.622655+0000","last_change":"2024-09-12T18:26:41.851184+0000","last_active":"2024-09-12T19:12:18.622655+0000","last_peered":"2024-09-12T19:12:18.622655+0000","last_clean":"2024-09-12T19:12:18.622655+0000","last_became_active":"2024-09-12T18:26:41.850749+0000","last_became_peered":"2024-09-12T18:26:41.850749+0000","last_unstale":"2024-09-12T19:12:18.622655+0000","last_undegraded":"2024-09-12T19:12:18.622655+0000","last_fullsized":"2024-09-12T19:12:18.622655+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:25.945669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2503,"num_read_kb":2331,"num_write":575,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'323","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.197323+0000","last_change":"2024-09-12T18:26:39.854610+0000","last_active":"2024-09-12T19:12:08.197323+0000","last_peered":"2024-09-12T19:12:08.197323+0000","last_clean":"2024-09-12T19:12:08.197323+0000","last_became_active":"2024-09-12T18:26:39.854328+0000","last_became_peered":"2024-09-12T18:26:39.854328+0000","last_unstale":"2024-09-12T19:12:08.197323+0000","last_undegraded":"2024-09-12T19:12:08.197323+0000","last_fullsized":"2024-09-12T19:12:08.197323+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:21.829716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7968455,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":515,"num_read_kb":9662,"num_write":1178,"num_write_kb":35097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.905457+0000","last_change":"2024-09-12T18:26:43.866117+0000","last_active":"2024-09-12T19:11:03.905457+0000","last_peered":"2024-09-12T19:11:03.905457+0000","last_clean":"2024-09-12T19:11:03.905457+0000","last_became_active":"2024-09-12T18:26:43.865454+0000","last_became_peered":"2024-09-12T18:26:43.865454+0000","last_unstale":"2024-09-12T19:11:03.905457+0000","last_undegraded":"2024-09-12T19:11:03.905457+0000","last_fullsized":"2024-09-12T19:11:03.905457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:55.077443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'243","reported_seq":802,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.949398+0000","last_change":"2024-09-12T18:26:45.867830+0000","last_active":"2024-09-12T19:13:43.949398+0000","last_peered":"2024-09-12T19:13:43.949398+0000","last_clean":"2024-09-12T19:13:43.949398+0000","last_became_active":"2024-09-12T18:26:45.867096+0000","last_became_peered":"2024-09-12T18:26:45.867096+0000","last_unstale":"2024-09-12T19:13:43.949398+0000","last_undegraded":"2024-09-12T19:13:43.949398+0000","last_fullsized":"2024-09-12T19:13:43.949398+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.958792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53974,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":399,"num_read_kb":841,"num_write":324,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.932045+0000","last_change":"2024-09-12T18:26:47.895791+0000","last_active":"2024-09-12T19:11:08.932045+0000","last_peered":"2024-09-12T19:11:08.932045+0000","last_clean":"2024-09-12T19:11:08.932045+0000","last_became_active":"2024-09-12T18:26:47.895092+0000","last_became_peered":"2024-09-12T18:26:47.895092+0000","last_unstale":"2024-09-12T19:11:08.932045+0000","last_undegraded":"2024-09-12T19:11:08.932045+0000","last_fullsized":"2024-09-12T19:11:08.932045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:05.232441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'821","reported_seq":2419,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.207286+0000","last_change":"2024-09-12T18:26:41.872671+0000","last_active":"2024-09-12T19:11:58.207286+0000","last_peered":"2024-09-12T19:11:58.207286+0000","last_clean":"2024-09-12T19:11:58.207286+0000","last_became_active":"2024-09-12T18:26:41.871943+0000","last_became_peered":"2024-09-12T18:26:41.871943+0000","last_unstale":"2024-09-12T19:11:58.207286+0000","last_undegraded":"2024-09-12T19:11:58.207286+0000","last_fullsized":"2024-09-12T19:11:58.207286+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:15.536437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3898,"num_read_kb":3510,"num_write":1047,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'313","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.758972+0000","last_change":"2024-09-12T18:26:39.831302+0000","last_active":"2024-09-12T19:12:09.758972+0000","last_peered":"2024-09-12T19:12:09.758972+0000","last_clean":"2024-09-12T19:12:09.758972+0000","last_became_active":"2024-09-12T18:26:39.830963+0000","last_became_peered":"2024-09-12T18:26:39.830963+0000","last_unstale":"2024-09-12T19:12:09.758972+0000","last_undegraded":"2024-09-12T19:12:09.758972+0000","last_fullsized":"2024-09-12T19:12:09.758972+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:33.362610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11355684,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":552,"num_read_kb":35487,"num_write":1202,"num_write_kb":27084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:53.927546+0000","last_change":"2024-09-12T18:26:43.861948+0000","last_active":"2024-09-12T19:10:53.927546+0000","last_peered":"2024-09-12T19:10:53.927546+0000","last_clean":"2024-09-12T19:10:53.927546+0000","last_became_active":"2024-09-12T18:26:43.861521+0000","last_became_peered":"2024-09-12T18:26:43.861521+0000","last_unstale":"2024-09-12T19:10:53.927546+0000","last_undegraded":"2024-09-12T19:10:53.927546+0000","last_fullsized":"2024-09-12T19:10:53.927546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:00.161505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'443","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.736780+0000","last_change":"2024-09-12T18:26:45.873087+0000","last_active":"2024-09-12T19:13:57.736780+0000","last_peered":"2024-09-12T19:13:57.736780+0000","last_clean":"2024-09-12T19:13:57.736780+0000","last_became_active":"2024-09-12T18:26:45.872177+0000","last_became_peered":"2024-09-12T18:26:45.872177+0000","last_unstale":"2024-09-12T19:13:57.736780+0000","last_undegraded":"2024-09-12T19:13:57.736780+0000","last_fullsized":"2024-09-12T19:13:57.736780+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:14.142703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":798,"num_read_kb":1755,"num_write":687,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.879188+0000","last_change":"2024-09-12T18:26:47.903167+0000","last_active":"2024-09-12T19:09:18.879188+0000","last_peered":"2024-09-12T19:09:18.879188+0000","last_clean":"2024-09-12T19:09:18.879188+0000","last_became_active":"2024-09-12T18:26:47.902702+0000","last_became_peered":"2024-09-12T18:26:47.902702+0000","last_unstale":"2024-09-12T19:09:18.879188+0000","last_undegraded":"2024-09-12T19:09:18.879188+0000","last_fullsized":"2024-09-12T19:09:18.879188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:58.910571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'188","reported_seq":695,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.315741+0000","last_change":"2024-09-12T18:26:49.920882+0000","last_active":"2024-09-12T19:12:23.315741+0000","last_peered":"2024-09-12T19:12:23.315741+0000","last_clean":"2024-09-12T19:12:23.315741+0000","last_became_active":"2024-09-12T18:26:49.920066+0000","last_became_peered":"2024-09-12T18:26:49.920066+0000","last_unstale":"2024-09-12T19:12:23.315741+0000","last_undegraded":"2024-09-12T19:12:23.315741+0000","last_fullsized":"2024-09-12T19:12:23.315741+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:38.018526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":247,"num_read_kb":248,"num_write":459,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'764","reported_seq":2241,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:04.036663+0000","last_change":"2024-09-12T18:26:41.853638+0000","last_active":"2024-09-12T19:12:04.036663+0000","last_peered":"2024-09-12T19:12:04.036663+0000","last_clean":"2024-09-12T19:12:04.036663+0000","last_became_active":"2024-09-12T18:26:41.852157+0000","last_became_peered":"2024-09-12T18:26:41.852157+0000","last_unstale":"2024-09-12T19:12:04.036663+0000","last_undegraded":"2024-09-12T19:12:04.036663+0000","last_fullsized":"2024-09-12T19:12:04.036663+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:07.965311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3590,"num_read_kb":3230,"num_write":1002,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'318","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.707485+0000","last_change":"2024-09-12T18:27:11.827995+0000","last_active":"2024-09-12T19:13:57.707485+0000","last_peered":"2024-09-12T19:13:57.707485+0000","last_clean":"2024-09-12T19:13:57.707485+0000","last_became_active":"2024-09-12T18:27:11.827218+0000","last_became_peered":"2024-09-12T18:27:11.827218+0000","last_unstale":"2024-09-12T19:13:57.707485+0000","last_undegraded":"2024-09-12T19:13:57.707485+0000","last_fullsized":"2024-09-12T19:13:57.707485+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:06.201837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120630,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":457,"num_read_kb":7362,"num_write":1123,"num_write_kb":18791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.898175+0000","last_change":"2024-09-12T18:26:43.866082+0000","last_active":"2024-09-12T19:10:28.898175+0000","last_peered":"2024-09-12T19:10:28.898175+0000","last_clean":"2024-09-12T19:10:28.898175+0000","last_became_active":"2024-09-12T18:26:43.865319+0000","last_became_peered":"2024-09-12T18:26:43.865319+0000","last_unstale":"2024-09-12T19:10:28.898175+0000","last_undegraded":"2024-09-12T19:10:28.898175+0000","last_fullsized":"2024-09-12T19:10:28.898175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:34.611869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'293","reported_seq":865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.952948+0000","last_change":"2024-09-12T18:26:45.874050+0000","last_active":"2024-09-12T19:13:43.952948+0000","last_peered":"2024-09-12T19:13:43.952948+0000","last_clean":"2024-09-12T19:13:43.952948+0000","last_became_active":"2024-09-12T18:26:45.873197+0000","last_became_peered":"2024-09-12T18:26:45.873197+0000","last_unstale":"2024-09-12T19:13:43.952948+0000","last_undegraded":"2024-09-12T19:13:43.952948+0000","last_fullsized":"2024-09-12T19:13:43.952948+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:01.225799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61026,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":471,"num_read_kb":936,"num_write":396,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:17.891370+0000","last_change":"2024-09-12T18:26:47.884995+0000","last_active":"2024-09-12T19:09:17.891370+0000","last_peered":"2024-09-12T19:09:17.891370+0000","last_clean":"2024-09-12T19:09:17.891370+0000","last_became_active":"2024-09-12T18:26:47.883930+0000","last_became_peered":"2024-09-12T18:26:47.883930+0000","last_unstale":"2024-09-12T19:09:17.891370+0000","last_undegraded":"2024-09-12T19:09:17.891370+0000","last_fullsized":"2024-09-12T19:09:17.891370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:45.633573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'180","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.119927+0000","last_change":"2024-09-12T18:26:49.922518+0000","last_active":"2024-09-12T19:12:24.119927+0000","last_peered":"2024-09-12T19:12:24.119927+0000","last_clean":"2024-09-12T19:12:24.119927+0000","last_became_active":"2024-09-12T18:26:49.921797+0000","last_became_peered":"2024-09-12T18:26:49.921797+0000","last_unstale":"2024-09-12T19:12:24.119927+0000","last_undegraded":"2024-09-12T19:12:24.119927+0000","last_fullsized":"2024-09-12T19:12:24.119927+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:13.451147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1230,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":213,"num_write":519,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'508","reported_seq":1855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.603092+0000","last_change":"2024-09-12T18:26:41.851238+0000","last_active":"2024-09-12T19:12:06.603092+0000","last_peered":"2024-09-12T19:12:06.603092+0000","last_clean":"2024-09-12T19:12:06.603092+0000","last_became_active":"2024-09-12T18:26:41.850647+0000","last_became_peered":"2024-09-12T18:26:41.850647+0000","last_unstale":"2024-09-12T19:12:06.603092+0000","last_undegraded":"2024-09-12T19:12:06.603092+0000","last_fullsized":"2024-09-12T19:12:06.603092+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:45.957699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2444,"num_write":714,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'295","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.595014+0000","last_change":"2024-09-12T18:26:39.842569+0000","last_active":"2024-09-12T19:11:43.595014+0000","last_peered":"2024-09-12T19:11:43.595014+0000","last_clean":"2024-09-12T19:11:43.595014+0000","last_became_active":"2024-09-12T18:26:39.840458+0000","last_became_peered":"2024-09-12T18:26:39.840458+0000","last_unstale":"2024-09-12T19:11:43.595014+0000","last_undegraded":"2024-09-12T19:11:43.595014+0000","last_fullsized":"2024-09-12T19:11:43.595014+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:05.706995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2236055,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":421,"num_read_kb":36099,"num_write":1048,"num_write_kb":45658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:14.088096+0000","last_change":"2024-09-12T18:26:43.876974+0000","last_active":"2024-09-12T19:09:14.088096+0000","last_peered":"2024-09-12T19:09:14.088096+0000","last_clean":"2024-09-12T19:09:14.088096+0000","last_became_active":"2024-09-12T18:26:43.873669+0000","last_became_peered":"2024-09-12T18:26:43.873669+0000","last_unstale":"2024-09-12T19:09:14.088096+0000","last_undegraded":"2024-09-12T19:09:14.088096+0000","last_fullsized":"2024-09-12T19:09:14.088096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:55.720687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'279","reported_seq":848,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:38.729498+0000","last_change":"2024-09-12T18:26:46.023642+0000","last_active":"2024-09-12T19:12:38.729498+0000","last_peered":"2024-09-12T19:12:38.729498+0000","last_clean":"2024-09-12T19:12:38.729498+0000","last_became_active":"2024-09-12T18:26:46.023025+0000","last_became_peered":"2024-09-12T18:26:46.023025+0000","last_unstale":"2024-09-12T19:12:38.729498+0000","last_undegraded":"2024-09-12T19:12:38.729498+0000","last_fullsized":"2024-09-12T19:12:38.729498+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:34.349134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59881,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":993,"num_write":392,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:57.915384+0000","last_change":"2024-09-12T18:26:47.893458+0000","last_active":"2024-09-12T19:10:57.915384+0000","last_peered":"2024-09-12T19:10:57.915384+0000","last_clean":"2024-09-12T19:10:57.915384+0000","last_became_active":"2024-09-12T18:26:47.892678+0000","last_became_peered":"2024-09-12T18:26:47.892678+0000","last_unstale":"2024-09-12T19:10:57.915384+0000","last_undegraded":"2024-09-12T19:10:57.915384+0000","last_fullsized":"2024-09-12T19:10:57.915384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:22.345925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'113","reported_seq":596,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.000115+0000","last_change":"2024-09-12T18:26:49.919935+0000","last_active":"2024-09-12T19:13:44.000115+0000","last_peered":"2024-09-12T19:13:44.000115+0000","last_clean":"2024-09-12T19:13:44.000115+0000","last_became_active":"2024-09-12T18:26:49.919229+0000","last_became_peered":"2024-09-12T18:26:49.919229+0000","last_unstale":"2024-09-12T19:13:44.000115+0000","last_undegraded":"2024-09-12T19:13:44.000115+0000","last_fullsized":"2024-09-12T19:13:44.000115+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:52.637762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":95,"num_write":270,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'503","reported_seq":2204,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.539957+0000","last_change":"2024-09-12T18:26:41.844984+0000","last_active":"2024-09-12T19:12:09.539957+0000","last_peered":"2024-09-12T19:12:09.539957+0000","last_clean":"2024-09-12T19:12:09.539957+0000","last_became_active":"2024-09-12T18:26:41.844608+0000","last_became_peered":"2024-09-12T18:26:41.844608+0000","last_unstale":"2024-09-12T19:12:09.539957+0000","last_undegraded":"2024-09-12T19:12:09.539957+0000","last_fullsized":"2024-09-12T19:12:09.539957+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:01.162341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2752,"num_read_kb":2596,"num_write":594,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'276","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:19.633134+0000","last_change":"2024-09-12T18:27:11.807858+0000","last_active":"2024-09-12T19:12:19.633134+0000","last_peered":"2024-09-12T19:12:19.633134+0000","last_clean":"2024-09-12T19:12:19.633134+0000","last_became_active":"2024-09-12T18:27:11.807022+0000","last_became_peered":"2024-09-12T18:27:11.807022+0000","last_unstale":"2024-09-12T19:12:19.633134+0000","last_undegraded":"2024-09-12T19:12:19.633134+0000","last_fullsized":"2024-09-12T19:12:19.633134+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:42.477672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9976643,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":421,"num_read_kb":61134,"num_write":969,"num_write_kb":46178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:17.891331+0000","last_change":"2024-09-12T18:26:43.860395+0000","last_active":"2024-09-12T19:09:17.891331+0000","last_peered":"2024-09-12T19:09:17.891331+0000","last_clean":"2024-09-12T19:09:17.891331+0000","last_became_active":"2024-09-12T18:26:43.859997+0000","last_became_peered":"2024-09-12T18:26:43.859997+0000","last_unstale":"2024-09-12T19:09:17.891331+0000","last_undegraded":"2024-09-12T19:09:17.891331+0000","last_fullsized":"2024-09-12T19:09:17.891331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:23.870876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'90","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:21.975628+0000","last_change":"2024-09-12T18:26:46.022987+0000","last_active":"2024-09-12T19:11:21.975628+0000","last_peered":"2024-09-12T19:11:21.975628+0000","last_clean":"2024-09-12T19:11:21.975628+0000","last_became_active":"2024-09-12T18:26:46.022246+0000","last_became_peered":"2024-09-12T18:26:46.022246+0000","last_unstale":"2024-09-12T19:11:21.975628+0000","last_undegraded":"2024-09-12T19:11:21.975628+0000","last_fullsized":"2024-09-12T19:11:21.975628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:05.130410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":130,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'766","reported_seq":2305,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.018467+0000","last_change":"2024-09-12T18:26:47.894434+0000","last_active":"2024-09-12T19:13:44.018467+0000","last_peered":"2024-09-12T19:13:44.018467+0000","last_clean":"2024-09-12T19:13:44.018467+0000","last_became_active":"2024-09-12T18:26:47.891107+0000","last_became_peered":"2024-09-12T18:26:47.891107+0000","last_unstale":"2024-09-12T19:13:44.018467+0000","last_undegraded":"2024-09-12T19:13:44.018467+0000","last_fullsized":"2024-09-12T19:13:44.018467+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":701,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:30.324222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'114","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.746554+0000","last_change":"2024-09-12T18:26:49.916767+0000","last_active":"2024-09-12T19:12:21.746554+0000","last_peered":"2024-09-12T19:12:21.746554+0000","last_clean":"2024-09-12T19:12:21.746554+0000","last_became_active":"2024-09-12T18:26:49.915975+0000","last_became_peered":"2024-09-12T18:26:49.915975+0000","last_unstale":"2024-09-12T19:12:21.746554+0000","last_undegraded":"2024-09-12T19:12:21.746554+0000","last_fullsized":"2024-09-12T19:12:21.746554+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:39.304415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":276,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'457","reported_seq":2178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.110966+0000","last_change":"2024-09-12T18:26:41.853916+0000","last_active":"2024-09-12T19:12:24.110966+0000","last_peered":"2024-09-12T19:12:24.110966+0000","last_clean":"2024-09-12T19:12:24.110966+0000","last_became_active":"2024-09-12T18:26:41.853112+0000","last_became_peered":"2024-09-12T18:26:41.853112+0000","last_unstale":"2024-09-12T19:12:24.110966+0000","last_undegraded":"2024-09-12T19:12:24.110966+0000","last_fullsized":"2024-09-12T19:12:24.110966+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:47.031551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2539,"num_write":529,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'307","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:14.445032+0000","last_change":"2024-09-12T18:26:39.867749+0000","last_active":"2024-09-12T19:11:14.445032+0000","last_peered":"2024-09-12T19:11:14.445032+0000","last_clean":"2024-09-12T19:11:14.445032+0000","last_became_active":"2024-09-12T18:26:39.867136+0000","last_became_peered":"2024-09-12T18:26:39.867136+0000","last_unstale":"2024-09-12T19:11:14.445032+0000","last_undegraded":"2024-09-12T19:11:14.445032+0000","last_fullsized":"2024-09-12T19:11:14.445032+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:04.827164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15732260,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":460,"num_read_kb":14806,"num_write":1070,"num_write_kb":34226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:17.883321+0000","last_change":"2024-09-12T18:26:43.877662+0000","last_active":"2024-09-12T19:09:17.883321+0000","last_peered":"2024-09-12T19:09:17.883321+0000","last_clean":"2024-09-12T19:09:17.883321+0000","last_became_active":"2024-09-12T18:26:43.876801+0000","last_became_peered":"2024-09-12T18:26:43.876801+0000","last_unstale":"2024-09-12T19:09:17.883321+0000","last_undegraded":"2024-09-12T19:09:17.883321+0000","last_fullsized":"2024-09-12T19:09:17.883321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:49.772292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'289","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:53.927686+0000","last_change":"2024-09-12T18:26:45.873414+0000","last_active":"2024-09-12T19:12:53.927686+0000","last_peered":"2024-09-12T19:12:53.927686+0000","last_clean":"2024-09-12T19:12:53.927686+0000","last_became_active":"2024-09-12T18:26:45.872458+0000","last_became_peered":"2024-09-12T18:26:45.872458+0000","last_unstale":"2024-09-12T19:12:53.927686+0000","last_undegraded":"2024-09-12T19:12:53.927686+0000","last_fullsized":"2024-09-12T19:12:53.927686+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:15.684235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56998,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":975,"num_write":390,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.918253+0000","last_change":"2024-09-12T18:26:47.895896+0000","last_active":"2024-09-12T19:10:18.918253+0000","last_peered":"2024-09-12T19:10:18.918253+0000","last_clean":"2024-09-12T19:10:18.918253+0000","last_became_active":"2024-09-12T18:26:47.894689+0000","last_became_peered":"2024-09-12T18:26:47.894689+0000","last_unstale":"2024-09-12T19:10:18.918253+0000","last_undegraded":"2024-09-12T19:10:18.918253+0000","last_fullsized":"2024-09-12T19:10:18.918253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:12.028473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'122","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.472125+0000","last_change":"2024-09-12T18:26:49.931294+0000","last_active":"2024-09-12T19:12:21.472125+0000","last_peered":"2024-09-12T19:12:21.472125+0000","last_clean":"2024-09-12T19:12:21.472125+0000","last_became_active":"2024-09-12T18:26:49.930794+0000","last_became_peered":"2024-09-12T18:26:49.930794+0000","last_unstale":"2024-09-12T19:12:21.472125+0000","last_undegraded":"2024-09-12T19:12:21.472125+0000","last_fullsized":"2024-09-12T19:12:21.472125+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:20.540895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":295,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'613","reported_seq":2272,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.104950+0000","last_change":"2024-09-12T18:26:41.857340+0000","last_active":"2024-09-12T19:13:43.104950+0000","last_peered":"2024-09-12T19:13:43.104950+0000","last_clean":"2024-09-12T19:13:43.104950+0000","last_became_active":"2024-09-12T18:26:41.856621+0000","last_became_peered":"2024-09-12T18:26:41.856621+0000","last_unstale":"2024-09-12T19:13:43.104950+0000","last_undegraded":"2024-09-12T19:13:43.104950+0000","last_fullsized":"2024-09-12T19:13:43.104950+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:57.480188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3116,"num_read_kb":2841,"num_write":759,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'277","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:47.365388+0000","last_change":"2024-09-12T18:26:39.861785+0000","last_active":"2024-09-12T19:11:47.365388+0000","last_peered":"2024-09-12T19:11:47.365388+0000","last_clean":"2024-09-12T19:11:47.365388+0000","last_became_active":"2024-09-12T18:26:39.861108+0000","last_became_peered":"2024-09-12T18:26:39.861108+0000","last_unstale":"2024-09-12T19:11:47.365388+0000","last_undegraded":"2024-09-12T19:11:47.365388+0000","last_fullsized":"2024-09-12T19:11:47.365388+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:35.617812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20012033,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":431,"num_read_kb":32271,"num_write":928,"num_write_kb":22718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:13.878053+0000","last_change":"2024-09-12T18:26:43.861093+0000","last_active":"2024-09-12T19:09:13.878053+0000","last_peered":"2024-09-12T19:09:13.878053+0000","last_clean":"2024-09-12T19:09:13.878053+0000","last_became_active":"2024-09-12T18:26:43.860336+0000","last_became_peered":"2024-09-12T18:26:43.860336+0000","last_unstale":"2024-09-12T19:09:13.878053+0000","last_undegraded":"2024-09-12T19:09:13.878053+0000","last_fullsized":"2024-09-12T19:09:13.878053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:15.631369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'281","reported_seq":845,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.955648+0000","last_change":"2024-09-12T18:26:45.881839+0000","last_active":"2024-09-12T19:12:43.955648+0000","last_peered":"2024-09-12T19:12:43.955648+0000","last_clean":"2024-09-12T19:12:43.955648+0000","last_became_active":"2024-09-12T18:26:45.881364+0000","last_became_peered":"2024-09-12T18:26:45.881364+0000","last_unstale":"2024-09-12T19:12:43.955648+0000","last_undegraded":"2024-09-12T19:12:43.955648+0000","last_fullsized":"2024-09-12T19:12:43.955648+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:54.998693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56916,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":957,"num_write":378,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.898023+0000","last_change":"2024-09-12T18:26:47.888719+0000","last_active":"2024-09-12T19:10:28.898023+0000","last_peered":"2024-09-12T19:10:28.898023+0000","last_clean":"2024-09-12T19:10:28.898023+0000","last_became_active":"2024-09-12T18:26:47.888055+0000","last_became_peered":"2024-09-12T18:26:47.888055+0000","last_unstale":"2024-09-12T19:10:28.898023+0000","last_undegraded":"2024-09-12T19:10:28.898023+0000","last_fullsized":"2024-09-12T19:10:28.898023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:33.128326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.320073+0000","last_change":"2024-09-12T18:26:49.923335+0000","last_active":"2024-09-12T19:12:23.320073+0000","last_peered":"2024-09-12T19:12:23.320073+0000","last_clean":"2024-09-12T19:12:23.320073+0000","last_became_active":"2024-09-12T18:26:49.922543+0000","last_became_peered":"2024-09-12T18:26:49.922543+0000","last_unstale":"2024-09-12T19:12:23.320073+0000","last_undegraded":"2024-09-12T19:12:23.320073+0000","last_fullsized":"2024-09-12T19:12:23.320073+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:23.453107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":203,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'471","reported_seq":2057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.938937+0000","last_change":"2024-09-12T18:26:41.850838+0000","last_active":"2024-09-12T19:12:07.938937+0000","last_peered":"2024-09-12T19:12:07.938937+0000","last_clean":"2024-09-12T19:12:07.938937+0000","last_became_active":"2024-09-12T18:26:41.850499+0000","last_became_peered":"2024-09-12T18:26:41.850499+0000","last_unstale":"2024-09-12T19:12:07.938937+0000","last_undegraded":"2024-09-12T19:12:07.938937+0000","last_fullsized":"2024-09-12T19:12:07.938937+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:48.262784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2536,"num_read_kb":2375,"num_write":558,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'264","reported_seq":881,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.807160+0000","last_change":"2024-09-12T18:26:39.847761+0000","last_active":"2024-09-12T19:11:48.807160+0000","last_peered":"2024-09-12T19:11:48.807160+0000","last_clean":"2024-09-12T19:11:48.807160+0000","last_became_active":"2024-09-12T18:26:39.847422+0000","last_became_peered":"2024-09-12T18:26:39.847422+0000","last_unstale":"2024-09-12T19:11:48.807160+0000","last_undegraded":"2024-09-12T19:11:48.807160+0000","last_fullsized":"2024-09-12T19:11:48.807160+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:13.311491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4791729,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":375,"num_read_kb":20074,"num_write":1008,"num_write_kb":42638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:14.101283+0000","last_change":"2024-09-12T18:26:43.875901+0000","last_active":"2024-09-12T19:10:14.101283+0000","last_peered":"2024-09-12T19:10:14.101283+0000","last_clean":"2024-09-12T19:10:14.101283+0000","last_became_active":"2024-09-12T18:26:43.874881+0000","last_became_peered":"2024-09-12T18:26:43.874881+0000","last_unstale":"2024-09-12T19:10:14.101283+0000","last_undegraded":"2024-09-12T19:10:14.101283+0000","last_fullsized":"2024-09-12T19:10:14.101283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:20.082733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'269","reported_seq":819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.717325+0000","last_change":"2024-09-12T18:26:45.865460+0000","last_active":"2024-09-12T19:11:48.717325+0000","last_peered":"2024-09-12T19:11:48.717325+0000","last_clean":"2024-09-12T19:11:48.717325+0000","last_became_active":"2024-09-12T18:26:45.864264+0000","last_became_peered":"2024-09-12T18:26:45.864264+0000","last_unstale":"2024-09-12T19:11:48.717325+0000","last_undegraded":"2024-09-12T19:11:48.717325+0000","last_fullsized":"2024-09-12T19:11:48.717325+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:46.472729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65230,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":458,"num_read_kb":1028,"num_write":392,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:19.089126+0000","last_change":"2024-09-12T18:26:47.882838+0000","last_active":"2024-09-12T19:09:19.089126+0000","last_peered":"2024-09-12T19:09:19.089126+0000","last_clean":"2024-09-12T19:09:19.089126+0000","last_became_active":"2024-09-12T18:26:47.882094+0000","last_became_peered":"2024-09-12T18:26:47.882094+0000","last_unstale":"2024-09-12T19:09:19.089126+0000","last_undegraded":"2024-09-12T19:09:19.089126+0000","last_fullsized":"2024-09-12T19:09:19.089126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:28.769911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'194","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.741958+0000","last_change":"2024-09-12T18:26:49.921917+0000","last_active":"2024-09-12T19:12:21.741958+0000","last_peered":"2024-09-12T19:12:21.741958+0000","last_clean":"2024-09-12T19:12:21.741958+0000","last_became_active":"2024-09-12T18:26:49.920808+0000","last_became_peered":"2024-09-12T18:26:49.920808+0000","last_unstale":"2024-09-12T19:12:21.741958+0000","last_undegraded":"2024-09-12T19:12:21.741958+0000","last_fullsized":"2024-09-12T19:12:21.741958+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:38.677600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1188,"num_read_kb":1184,"num_write":433,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'790","reported_seq":2289,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.623824+0000","last_change":"2024-09-12T18:26:41.874632+0000","last_active":"2024-09-12T19:12:18.623824+0000","last_peered":"2024-09-12T19:12:18.623824+0000","last_clean":"2024-09-12T19:12:18.623824+0000","last_became_active":"2024-09-12T18:26:41.873690+0000","last_became_peered":"2024-09-12T18:26:41.873690+0000","last_unstale":"2024-09-12T19:12:18.623824+0000","last_undegraded":"2024-09-12T19:12:18.623824+0000","last_fullsized":"2024-09-12T19:12:18.623824+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:58.542257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3645,"num_read_kb":3278,"num_write":1029,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'291","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:54.375517+0000","last_change":"2024-09-12T18:27:11.830481+0000","last_active":"2024-09-12T19:11:54.375517+0000","last_peered":"2024-09-12T19:11:54.375517+0000","last_clean":"2024-09-12T19:11:54.375517+0000","last_became_active":"2024-09-12T18:27:11.829577+0000","last_became_peered":"2024-09-12T18:27:11.829577+0000","last_unstale":"2024-09-12T19:11:54.375517+0000","last_undegraded":"2024-09-12T19:11:54.375517+0000","last_fullsized":"2024-09-12T19:11:54.375517+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:39.120138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5779791,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":442,"num_read_kb":8019,"num_write":1145,"num_write_kb":33613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:27.907872+0000","last_change":"2024-09-12T18:26:43.865809+0000","last_active":"2024-09-12T19:10:27.907872+0000","last_peered":"2024-09-12T19:10:27.907872+0000","last_clean":"2024-09-12T19:10:27.907872+0000","last_became_active":"2024-09-12T18:26:43.864719+0000","last_became_peered":"2024-09-12T18:26:43.864719+0000","last_unstale":"2024-09-12T19:10:27.907872+0000","last_undegraded":"2024-09-12T19:10:27.907872+0000","last_fullsized":"2024-09-12T19:10:27.907872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:47.905822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'301","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:49.122478+0000","last_change":"2024-09-12T18:26:45.866467+0000","last_active":"2024-09-12T19:11:49.122478+0000","last_peered":"2024-09-12T19:11:49.122478+0000","last_clean":"2024-09-12T19:11:49.122478+0000","last_became_active":"2024-09-12T18:26:45.865711+0000","last_became_peered":"2024-09-12T18:26:45.865711+0000","last_unstale":"2024-09-12T19:11:49.122478+0000","last_undegraded":"2024-09-12T19:11:49.122478+0000","last_fullsized":"2024-09-12T19:11:49.122478+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:12.137382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":497,"num_read_kb":1005,"num_write":410,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.903282+0000","last_change":"2024-09-12T18:26:47.883801+0000","last_active":"2024-09-12T19:09:18.903282+0000","last_peered":"2024-09-12T19:09:18.903282+0000","last_clean":"2024-09-12T19:09:18.903282+0000","last_became_active":"2024-09-12T18:26:47.883014+0000","last_became_peered":"2024-09-12T18:26:47.883014+0000","last_unstale":"2024-09-12T19:09:18.903282+0000","last_undegraded":"2024-09-12T19:09:18.903282+0000","last_fullsized":"2024-09-12T19:09:18.903282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:35.546362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'106","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.102109+0000","last_change":"2024-09-12T18:26:49.922286+0000","last_active":"2024-09-12T19:13:43.102109+0000","last_peered":"2024-09-12T19:13:43.102109+0000","last_clean":"2024-09-12T19:13:43.102109+0000","last_became_active":"2024-09-12T18:26:49.921636+0000","last_became_peered":"2024-09-12T18:26:49.921636+0000","last_unstale":"2024-09-12T19:13:43.102109+0000","last_undegraded":"2024-09-12T19:13:43.102109+0000","last_fullsized":"2024-09-12T19:13:43.102109+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:07.594133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":621,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":107,"num_write":252,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'1273","reported_seq":3077,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.126851+0000","last_change":"2024-09-12T18:26:41.872801+0000","last_active":"2024-09-12T19:12:24.126851+0000","last_peered":"2024-09-12T19:12:24.126851+0000","last_clean":"2024-09-12T19:12:24.126851+0000","last_became_active":"2024-09-12T18:26:41.872455+0000","last_became_peered":"2024-09-12T18:26:41.872455+0000","last_unstale":"2024-09-12T19:12:24.126851+0000","last_undegraded":"2024-09-12T19:12:24.126851+0000","last_fullsized":"2024-09-12T19:12:24.126851+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:05.640554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6298,"num_read_kb":5578,"num_write":1816,"num_write_kb":809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'318","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.757297+0000","last_change":"2024-09-12T18:26:39.848638+0000","last_active":"2024-09-12T19:12:09.757297+0000","last_peered":"2024-09-12T19:12:09.757297+0000","last_clean":"2024-09-12T19:12:09.757297+0000","last_became_active":"2024-09-12T18:26:39.847954+0000","last_became_peered":"2024-09-12T18:26:39.847954+0000","last_unstale":"2024-09-12T19:12:09.757297+0000","last_undegraded":"2024-09-12T19:12:09.757297+0000","last_fullsized":"2024-09-12T19:12:09.757297+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:36.378454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23103420,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":503,"num_read_kb":77064,"num_write":1168,"num_write_kb":41008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'501","reported_seq":2145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.105839+0000","last_change":"2024-09-12T18:26:41.852684+0000","last_active":"2024-09-12T19:13:43.105839+0000","last_peered":"2024-09-12T19:13:43.105839+0000","last_clean":"2024-09-12T19:13:43.105839+0000","last_became_active":"2024-09-12T18:26:41.846040+0000","last_became_peered":"2024-09-12T18:26:41.846040+0000","last_unstale":"2024-09-12T19:13:43.105839+0000","last_undegraded":"2024-09-12T19:13:43.105839+0000","last_fullsized":"2024-09-12T19:13:43.105839+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:45.056792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2703,"num_read_kb":2531,"num_write":592,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'307","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:42.235030+0000","last_change":"2024-09-12T18:26:39.846352+0000","last_active":"2024-09-12T19:13:42.235030+0000","last_peered":"2024-09-12T19:13:42.235030+0000","last_clean":"2024-09-12T19:13:42.235030+0000","last_became_active":"2024-09-12T18:26:39.846028+0000","last_became_peered":"2024-09-12T18:26:39.846028+0000","last_unstale":"2024-09-12T19:13:42.235030+0000","last_undegraded":"2024-09-12T19:13:42.235030+0000","last_fullsized":"2024-09-12T19:13:42.235030+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:04.369252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1896747,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":707,"num_read_kb":5622,"num_write":1105,"num_write_kb":40701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'516","reported_seq":2039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.769450+0000","last_change":"2024-09-12T18:26:41.884917+0000","last_active":"2024-09-12T19:12:08.769450+0000","last_peered":"2024-09-12T19:12:08.769450+0000","last_clean":"2024-09-12T19:12:08.769450+0000","last_became_active":"2024-09-12T18:26:41.884394+0000","last_became_peered":"2024-09-12T18:26:41.884394+0000","last_unstale":"2024-09-12T19:12:08.769450+0000","last_undegraded":"2024-09-12T19:12:08.769450+0000","last_fullsized":"2024-09-12T19:12:08.769450+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:32.084024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2704,"num_read_kb":2505,"num_write":657,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'277","reported_seq":919,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:12.493346+0000","last_change":"2024-09-12T18:26:39.856913+0000","last_active":"2024-09-12T19:11:12.493346+0000","last_peered":"2024-09-12T19:11:12.493346+0000","last_clean":"2024-09-12T19:11:12.493346+0000","last_became_active":"2024-09-12T18:26:39.856026+0000","last_became_peered":"2024-09-12T18:26:39.856026+0000","last_unstale":"2024-09-12T19:11:12.493346+0000","last_undegraded":"2024-09-12T19:11:12.493346+0000","last_fullsized":"2024-09-12T19:11:12.493346+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:27.396302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7110994,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":464,"num_read_kb":16867,"num_write":1020,"num_write_kb":23838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'538","reported_seq":2153,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.106718+0000","last_change":"2024-09-12T18:26:41.850869+0000","last_active":"2024-09-12T19:13:43.106718+0000","last_peered":"2024-09-12T19:13:43.106718+0000","last_clean":"2024-09-12T19:13:43.106718+0000","last_became_active":"2024-09-12T18:26:41.850519+0000","last_became_peered":"2024-09-12T18:26:41.850519+0000","last_unstale":"2024-09-12T19:13:43.106718+0000","last_undegraded":"2024-09-12T19:13:43.106718+0000","last_fullsized":"2024-09-12T19:13:43.106718+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:01.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2864,"num_read_kb":2647,"num_write":672,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'289","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.700985+0000","last_change":"2024-09-12T18:26:39.843327+0000","last_active":"2024-09-12T19:11:59.700985+0000","last_peered":"2024-09-12T19:11:59.700985+0000","last_clean":"2024-09-12T19:11:59.700985+0000","last_became_active":"2024-09-12T18:26:39.842852+0000","last_became_peered":"2024-09-12T18:26:39.842852+0000","last_unstale":"2024-09-12T19:11:59.700985+0000","last_undegraded":"2024-09-12T19:11:59.700985+0000","last_fullsized":"2024-09-12T19:11:59.700985+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.968044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10012875,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":455,"num_read_kb":35620,"num_write":1102,"num_write_kb":31566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'814","reported_seq":2351,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.568561+0000","last_change":"2024-09-12T18:26:41.882724+0000","last_active":"2024-09-12T19:12:06.568561+0000","last_peered":"2024-09-12T19:12:06.568561+0000","last_clean":"2024-09-12T19:12:06.568561+0000","last_became_active":"2024-09-12T18:26:41.882458+0000","last_became_peered":"2024-09-12T18:26:41.882458+0000","last_unstale":"2024-09-12T19:12:06.568561+0000","last_undegraded":"2024-09-12T19:12:06.568561+0000","last_fullsized":"2024-09-12T19:12:06.568561+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:55.482811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3832,"num_read_kb":3447,"num_write":1071,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'269","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:02.481890+0000","last_change":"2024-09-12T18:26:39.855875+0000","last_active":"2024-09-12T19:12:02.481890+0000","last_peered":"2024-09-12T19:12:02.481890+0000","last_clean":"2024-09-12T19:12:02.481890+0000","last_became_active":"2024-09-12T18:26:39.855654+0000","last_became_peered":"2024-09-12T18:26:39.855654+0000","last_unstale":"2024-09-12T19:12:02.481890+0000","last_undegraded":"2024-09-12T19:12:02.481890+0000","last_fullsized":"2024-09-12T19:12:02.481890+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:14.438744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2146066,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":530,"num_read_kb":6402,"num_write":986,"num_write_kb":32224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'1222","reported_seq":2855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.127193+0000","last_change":"2024-09-12T18:26:41.877371+0000","last_active":"2024-09-12T19:12:24.127193+0000","last_peered":"2024-09-12T19:12:24.127193+0000","last_clean":"2024-09-12T19:12:24.127193+0000","last_became_active":"2024-09-12T18:26:41.876138+0000","last_became_peered":"2024-09-12T18:26:41.876138+0000","last_unstale":"2024-09-12T19:12:24.127193+0000","last_undegraded":"2024-09-12T19:12:24.127193+0000","last_fullsized":"2024-09-12T19:12:24.127193+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":1200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:46.850535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4890,"num_write":1674,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'277","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.703873+0000","last_change":"2024-09-12T18:26:39.844674+0000","last_active":"2024-09-12T19:13:57.703873+0000","last_peered":"2024-09-12T19:13:57.703873+0000","last_clean":"2024-09-12T19:13:57.703873+0000","last_became_active":"2024-09-12T18:26:39.844346+0000","last_became_peered":"2024-09-12T18:26:39.844346+0000","last_unstale":"2024-09-12T19:13:57.703873+0000","last_undegraded":"2024-09-12T19:13:57.703873+0000","last_fullsized":"2024-09-12T19:13:57.703873+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:51.398790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5747617,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":413,"num_read_kb":67178,"num_write":960,"num_write_kb":30033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'741","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.102708+0000","last_change":"2024-09-12T18:27:11.824740+0000","last_active":"2024-09-12T19:13:43.102708+0000","last_peered":"2024-09-12T19:13:43.102708+0000","last_clean":"2024-09-12T19:13:43.102708+0000","last_became_active":"2024-09-12T18:27:11.823747+0000","last_became_peered":"2024-09-12T18:27:11.823747+0000","last_unstale":"2024-09-12T19:13:43.102708+0000","last_undegraded":"2024-09-12T19:13:43.102708+0000","last_fullsized":"2024-09-12T19:13:43.102708+0000","mapping_epoch":37,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:51.790957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3535,"num_read_kb":3187,"num_write":978,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"265'280","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.310631+0000","last_change":"2024-09-12T18:26:39.871790+0000","last_active":"2024-09-12T19:12:07.310631+0000","last_peered":"2024-09-12T19:12:07.310631+0000","last_clean":"2024-09-12T19:12:07.310631+0000","last_became_active":"2024-09-12T18:26:39.871119+0000","last_became_peered":"2024-09-12T18:26:39.871119+0000","last_unstale":"2024-09-12T19:12:07.310631+0000","last_undegraded":"2024-09-12T19:12:07.310631+0000","last_fullsized":"2024-09-12T19:12:07.310631+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:01.325896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1105860,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":486,"num_read_kb":8461,"num_write":1059,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'1064","reported_seq":2771,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.604993+0000","last_change":"2024-09-12T18:26:41.869379+0000","last_active":"2024-09-12T19:12:09.604993+0000","last_peered":"2024-09-12T19:12:09.604993+0000","last_clean":"2024-09-12T19:12:09.604993+0000","last_became_active":"2024-09-12T18:26:41.863607+0000","last_became_peered":"2024-09-12T18:26:41.863607+0000","last_unstale":"2024-09-12T19:12:09.604993+0000","last_undegraded":"2024-09-12T19:12:09.604993+0000","last_fullsized":"2024-09-12T19:12:09.604993+0000","mapping_epoch":26,"log_start":"265'1000","ondisk_log_start":"265'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1000,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:52.994239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5203,"num_read_kb":4615,"num_write":1535,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'281","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:03.453454+0000","last_change":"2024-09-12T18:26:39.828227+0000","last_active":"2024-09-12T19:12:03.453454+0000","last_peered":"2024-09-12T19:12:03.453454+0000","last_clean":"2024-09-12T19:12:03.453454+0000","last_became_active":"2024-09-12T18:26:39.827475+0000","last_became_peered":"2024-09-12T18:26:39.827475+0000","last_unstale":"2024-09-12T19:12:03.453454+0000","last_undegraded":"2024-09-12T19:12:03.453454+0000","last_fullsized":"2024-09-12T19:12:03.453454+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:39.931458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10582884,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":436,"num_read_kb":48335,"num_write":1051,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'824","reported_seq":2436,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.126652+0000","last_change":"2024-09-12T18:26:41.851460+0000","last_active":"2024-09-12T19:12:24.126652+0000","last_peered":"2024-09-12T19:12:24.126652+0000","last_clean":"2024-09-12T19:12:24.126652+0000","last_became_active":"2024-09-12T18:26:41.851080+0000","last_became_peered":"2024-09-12T18:26:41.851080+0000","last_unstale":"2024-09-12T19:12:24.126652+0000","last_undegraded":"2024-09-12T19:12:24.126652+0000","last_fullsized":"2024-09-12T19:12:24.126652+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:00.421668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4015,"num_read_kb":3626,"num_write":1096,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'287","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:02.489033+0000","last_change":"2024-09-12T18:26:39.850533+0000","last_active":"2024-09-12T19:11:02.489033+0000","last_peered":"2024-09-12T19:11:02.489033+0000","last_clean":"2024-09-12T19:11:02.489033+0000","last_became_active":"2024-09-12T18:26:39.849722+0000","last_became_peered":"2024-09-12T18:26:39.849722+0000","last_unstale":"2024-09-12T19:11:02.489033+0000","last_undegraded":"2024-09-12T19:11:02.489033+0000","last_fullsized":"2024-09-12T19:11:02.489033+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:57.210670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15791650,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":438,"num_read_kb":40604,"num_write":1031,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'396","reported_seq":1927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.290269+0000","last_change":"2024-09-12T18:26:41.851925+0000","last_active":"2024-09-12T19:12:23.290269+0000","last_peered":"2024-09-12T19:12:23.290269+0000","last_clean":"2024-09-12T19:12:23.290269+0000","last_became_active":"2024-09-12T18:26:41.851159+0000","last_became_peered":"2024-09-12T18:26:41.851159+0000","last_unstale":"2024-09-12T19:12:23.290269+0000","last_undegraded":"2024-09-12T19:12:23.290269+0000","last_fullsized":"2024-09-12T19:12:23.290269+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:12.817942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2139,"num_read_kb":2047,"num_write":455,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'252","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.221348+0000","last_change":"2024-09-12T18:26:39.828823+0000","last_active":"2024-09-12T19:12:07.221348+0000","last_peered":"2024-09-12T19:12:07.221348+0000","last_clean":"2024-09-12T19:12:07.221348+0000","last_became_active":"2024-09-12T18:26:39.827933+0000","last_became_peered":"2024-09-12T18:26:39.827933+0000","last_unstale":"2024-09-12T19:12:07.221348+0000","last_undegraded":"2024-09-12T19:12:07.221348+0000","last_fullsized":"2024-09-12T19:12:07.221348+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:56.699019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293141,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":367,"num_read_kb":364,"num_write":880,"num_write_kb":38290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'1178","reported_seq":2805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.105889+0000","last_change":"2024-09-12T18:26:41.873225+0000","last_active":"2024-09-12T19:12:01.105889+0000","last_peered":"2024-09-12T19:12:01.105889+0000","last_clean":"2024-09-12T19:12:01.105889+0000","last_became_active":"2024-09-12T18:26:41.872816+0000","last_became_peered":"2024-09-12T18:26:41.872816+0000","last_unstale":"2024-09-12T19:12:01.105889+0000","last_undegraded":"2024-09-12T19:12:01.105889+0000","last_fullsized":"2024-09-12T19:12:01.105889+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:18.236340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5354,"num_read_kb":4741,"num_write":1604,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'253","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:13.914600+0000","last_change":"2024-09-12T18:27:12.006534+0000","last_active":"2024-09-12T19:11:13.914600+0000","last_peered":"2024-09-12T19:11:13.914600+0000","last_clean":"2024-09-12T19:11:13.914600+0000","last_became_active":"2024-09-12T18:27:12.005906+0000","last_became_peered":"2024-09-12T18:27:12.005906+0000","last_unstale":"2024-09-12T19:11:13.914600+0000","last_undegraded":"2024-09-12T19:11:13.914600+0000","last_fullsized":"2024-09-12T19:11:13.914600+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:10.452660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7395832,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":368,"num_read_kb":9281,"num_write":977,"num_write_kb":40338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"265'418","reported_seq":1866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.109146+0000","last_change":"2024-09-12T18:26:41.867368+0000","last_active":"2024-09-12T19:13:43.109146+0000","last_peered":"2024-09-12T19:13:43.109146+0000","last_clean":"2024-09-12T19:13:43.109146+0000","last_became_active":"2024-09-12T18:26:41.866602+0000","last_became_peered":"2024-09-12T18:26:41.866602+0000","last_unstale":"2024-09-12T19:13:43.109146+0000","last_undegraded":"2024-09-12T19:13:43.109146+0000","last_fullsized":"2024-09-12T19:13:43.109146+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:37.206508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2028,"num_write":492,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'297","reported_seq":918,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:57.633745+0000","last_change":"2024-09-12T18:26:39.872098+0000","last_active":"2024-09-12T19:11:57.633745+0000","last_peered":"2024-09-12T19:11:57.633745+0000","last_clean":"2024-09-12T19:11:57.633745+0000","last_became_active":"2024-09-12T18:26:39.871626+0000","last_became_peered":"2024-09-12T18:26:39.871626+0000","last_unstale":"2024-09-12T19:11:57.633745+0000","last_undegraded":"2024-09-12T19:11:57.633745+0000","last_fullsized":"2024-09-12T19:11:57.633745+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:14.820272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7166305,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":403,"num_read_kb":15528,"num_write":1047,"num_write_kb":35488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'1248","reported_seq":2886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.769985+0000","last_change":"2024-09-12T18:26:41.877593+0000","last_active":"2024-09-12T19:12:08.769985+0000","last_peered":"2024-09-12T19:12:08.769985+0000","last_clean":"2024-09-12T19:12:08.769985+0000","last_became_active":"2024-09-12T18:26:41.876708+0000","last_became_peered":"2024-09-12T18:26:41.876708+0000","last_unstale":"2024-09-12T19:12:08.769985+0000","last_undegraded":"2024-09-12T19:12:08.769985+0000","last_fullsized":"2024-09-12T19:12:08.769985+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:14.658782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5682,"num_read_kb":5005,"num_write":1690,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'263","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:05.909705+0000","last_change":"2024-09-12T18:26:39.858750+0000","last_active":"2024-09-12T19:12:05.909705+0000","last_peered":"2024-09-12T19:12:05.909705+0000","last_clean":"2024-09-12T19:12:05.909705+0000","last_became_active":"2024-09-12T18:26:39.857956+0000","last_became_peered":"2024-09-12T18:26:39.857956+0000","last_unstale":"2024-09-12T19:12:05.909705+0000","last_undegraded":"2024-09-12T19:12:05.909705+0000","last_fullsized":"2024-09-12T19:12:05.909705+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:36.402643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9048989,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":434,"num_read_kb":32197,"num_write":886,"num_write_kb":38029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'898","reported_seq":2593,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.554895+0000","last_change":"2024-09-12T18:26:41.854757+0000","last_active":"2024-09-12T19:12:06.554895+0000","last_peered":"2024-09-12T19:12:06.554895+0000","last_clean":"2024-09-12T19:12:06.554895+0000","last_became_active":"2024-09-12T18:26:41.854471+0000","last_became_peered":"2024-09-12T18:26:41.854471+0000","last_unstale":"2024-09-12T19:12:06.554895+0000","last_undegraded":"2024-09-12T19:12:06.554895+0000","last_fullsized":"2024-09-12T19:12:06.554895+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":800,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:00.860983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4435,"num_read_kb":4011,"num_write":1173,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'360","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.930373+0000","last_change":"2024-09-12T18:26:39.871177+0000","last_active":"2024-09-12T19:13:57.930373+0000","last_peered":"2024-09-12T19:13:57.930373+0000","last_clean":"2024-09-12T19:13:57.930373+0000","last_became_active":"2024-09-12T18:26:39.869924+0000","last_became_peered":"2024-09-12T18:26:39.869924+0000","last_unstale":"2024-09-12T19:13:57.930373+0000","last_undegraded":"2024-09-12T19:13:57.930373+0000","last_fullsized":"2024-09-12T19:13:57.930373+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:42.282746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429061,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":520,"num_read_kb":35584,"num_write":1204,"num_write_kb":36960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'684","reported_seq":2473,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.610409+0000","last_change":"2024-09-12T18:26:41.858693+0000","last_active":"2024-09-12T19:12:18.610409+0000","last_peered":"2024-09-12T19:12:18.610409+0000","last_clean":"2024-09-12T19:12:18.610409+0000","last_became_active":"2024-09-12T18:26:41.858362+0000","last_became_peered":"2024-09-12T18:26:41.858362+0000","last_unstale":"2024-09-12T19:12:18.610409+0000","last_undegraded":"2024-09-12T19:12:18.610409+0000","last_fullsized":"2024-09-12T19:12:18.610409+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:42.785349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3672,"num_read_kb":3341,"num_write":924,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'352","reported_seq":1135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:36.227159+0000","last_change":"2024-09-12T18:26:39.847818+0000","last_active":"2024-09-12T19:11:36.227159+0000","last_peered":"2024-09-12T19:11:36.227159+0000","last_clean":"2024-09-12T19:11:36.227159+0000","last_became_active":"2024-09-12T18:26:39.847373+0000","last_became_peered":"2024-09-12T18:26:39.847373+0000","last_unstale":"2024-09-12T19:11:36.227159+0000","last_undegraded":"2024-09-12T19:11:36.227159+0000","last_fullsized":"2024-09-12T19:11:36.227159+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:55.989925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13837277,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":744,"num_read_kb":75469,"num_write":1349,"num_write_kb":36911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'824","reported_seq":2390,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.104105+0000","last_change":"2024-09-12T18:26:41.873328+0000","last_active":"2024-09-12T19:13:43.104105+0000","last_peered":"2024-09-12T19:13:43.104105+0000","last_clean":"2024-09-12T19:13:43.104105+0000","last_became_active":"2024-09-12T18:26:41.871610+0000","last_became_peered":"2024-09-12T18:26:41.871610+0000","last_unstale":"2024-09-12T19:13:43.104105+0000","last_undegraded":"2024-09-12T19:13:43.104105+0000","last_fullsized":"2024-09-12T19:13:43.104105+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:57.336959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3622,"num_write":1076,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'230","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:55.322689+0000","last_change":"2024-09-12T18:26:39.875309+0000","last_active":"2024-09-12T19:11:55.322689+0000","last_peered":"2024-09-12T19:11:55.322689+0000","last_clean":"2024-09-12T19:11:55.322689+0000","last_became_active":"2024-09-12T18:26:39.874710+0000","last_became_peered":"2024-09-12T18:26:39.874710+0000","last_unstale":"2024-09-12T19:11:55.322689+0000","last_undegraded":"2024-09-12T19:11:55.322689+0000","last_fullsized":"2024-09-12T19:11:55.322689+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:32.381222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049289,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":391,"num_read_kb":12735,"num_write":888,"num_write_kb":23796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'279","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:45.625552+0000","last_change":"2024-09-12T18:26:39.847812+0000","last_active":"2024-09-12T19:11:45.625552+0000","last_peered":"2024-09-12T19:11:45.625552+0000","last_clean":"2024-09-12T19:11:45.625552+0000","last_became_active":"2024-09-12T18:26:39.846477+0000","last_became_peered":"2024-09-12T18:26:39.846477+0000","last_unstale":"2024-09-12T19:11:45.625552+0000","last_undegraded":"2024-09-12T19:11:45.625552+0000","last_fullsized":"2024-09-12T19:11:45.625552+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:04.316982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4908998,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":433,"num_read_kb":32398,"num_write":952,"num_write_kb":24916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'404","reported_seq":1869,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.107075+0000","last_change":"2024-09-12T18:26:41.851628+0000","last_active":"2024-09-12T19:13:43.107075+0000","last_peered":"2024-09-12T19:13:43.107075+0000","last_clean":"2024-09-12T19:13:43.107075+0000","last_became_active":"2024-09-12T18:26:41.851295+0000","last_became_peered":"2024-09-12T18:26:41.851295+0000","last_unstale":"2024-09-12T19:13:43.107075+0000","last_undegraded":"2024-09-12T19:13:43.107075+0000","last_fullsized":"2024-09-12T19:13:43.107075+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:27.756982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":455,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'283","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.701169+0000","last_change":"2024-09-12T18:26:39.857287+0000","last_active":"2024-09-12T19:13:57.701169+0000","last_peered":"2024-09-12T19:13:57.701169+0000","last_clean":"2024-09-12T19:13:57.701169+0000","last_became_active":"2024-09-12T18:26:39.857009+0000","last_became_peered":"2024-09-12T18:26:39.857009+0000","last_unstale":"2024-09-12T19:13:57.701169+0000","last_undegraded":"2024-09-12T19:13:57.701169+0000","last_fullsized":"2024-09-12T19:13:57.701169+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:48.340491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2358323,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":400,"num_read_kb":55511,"num_write":910,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'374","reported_seq":1762,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.894092+0000","last_change":"2024-09-12T18:26:41.878961+0000","last_active":"2024-09-12T19:12:07.894092+0000","last_peered":"2024-09-12T19:12:07.894092+0000","last_clean":"2024-09-12T19:12:07.894092+0000","last_became_active":"2024-09-12T18:26:41.872448+0000","last_became_peered":"2024-09-12T18:26:41.872448+0000","last_unstale":"2024-09-12T19:12:07.894092+0000","last_undegraded":"2024-09-12T19:12:07.894092+0000","last_fullsized":"2024-09-12T19:12:07.894092+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:18.608268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1946,"num_read_kb":1855,"num_write":441,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6147,"num_read_kb":4433,"num_write":1993,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":964,"ondisk_log_size":964,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":14976,"num_read_kb":14648,"num_write":16787,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1653,"ondisk_log_size":1653,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":541,"ondisk_log_size":541,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1892511,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17046,"num_read_kb":33290,"num_write":14424,"num_write_kb":11573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2924544,"data_stored":2434194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2075,"ondisk_log_size":2075,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2396,"num_read_kb":2855,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212286,"num_read_kb":193833,"num_write":55194,"num_write_kb":18759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3910,"ondisk_log_size":3910,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":480173717,"num_objects":3830,"num_object_clones":0,"num_object_copies":7660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3830,"num_whiteouts":0,"num_read":32811,"num_read_kb":1882752,"num_write":68724,"num_write_kb":2144860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1030660096,"data_stored":1002399160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4107,"ondisk_log_size":4107,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":65769289,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":157,"num_read_kb":214446,"num_write":168,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":125255680,"data_stored":125247122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":63672137,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":152,"num_read_kb":201134,"num_write":167,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126304256,"data_stored":126295698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510016,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":391676,"kb_used_data":143916,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93980164,"statfs":{"total":96636764160,"available":96235687936,"internally_reserved":0,"allocated":147369984,"data_stored":142588376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":253688262},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510016,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300584,"kb_used_data":183384,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94071256,"statfs":{"total":96636764160,"available":96328966144,"internally_reserved":0,"allocated":187785216,"data_stored":181571212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510017,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265348,"kb_used_data":189748,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94106492,"statfs":{"total":96636764160,"available":96365047808,"internally_reserved":0,"allocated":194301952,"data_stored":188252816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510014,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":466108,"kb_used_data":218348,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93905732,"statfs":{"total":96636764160,"available":96159469568,"internally_reserved":0,"allocated":223588352,"data_stored":217599643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510014,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249168,"kb_used_data":155584,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94122672,"statfs":{"total":96636764160,"available":96381616128,"internally_reserved":0,"allocated":159318016,"data_stored":155023243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510014,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":461744,"kb_used_data":214048,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":93910096,"statfs":{"total":96636764160,"available":96163938304,"internally_reserved":0,"allocated":219185152,"data_stored":212885377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":253622728},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542722,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":342548,"kb_used_data":68420,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94029292,"statfs":{"total":96636764160,"available":96285995008,"internally_reserved":0,"allocated":70062080,"data_stored":66408599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542720,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305460,"kb_used_data":170164,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94066380,"statfs":{"total":96636764160,"available":96323973120,"internally_reserved":0,"allocated":174247936,"data_stored":169431162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":168685568,"data_stored":163929834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90566656,"data_stored":88622662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93966336,"data_stored":91148738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":178442240,"data_stored":173999215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":154951680,"data_stored":150337560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":165584896,"data_stored":160969100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":115458048,"data_stored":112176297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":63004672,"data_stored":61215754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":345602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":253869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":130758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":493397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":91329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":675840,"data_stored":565619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":258614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":295006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26972160,"data_stored":26968770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18878464,"data_stored":18877575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":10525905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13303808,"data_stored":13300344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18878464,"data_stored":18877575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11202560,"data_stored":11199985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25923584,"data_stored":25920194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28352512,"data_stored":28351697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14684160,"data_stored":14683271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:13:59.628 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:13:59.976 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:13:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-09-12T19:13:59.993 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":1688,"stamp":"2024-09-12T19:13:58.439072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":612115279,"num_objects":4346,"num_object_clones":0,"num_object_copies":8692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4346,"num_whiteouts":0,"num_read":286049,"num_read_kb":2547458,"num_write":157600,"num_write_kb":2466739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13558,"ondisk_log_size":13558,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2782636,"kb_used_data":1343612,"kb_used_omap":12,"kb_used_meta":1438835,"kb_avail":752192084,"statfs":{"total":773094113280,"available":770244694016,"internally_reserved":0,"allocated":1375858688,"data_stored":1333760428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1473367603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-106503838,"num_objects":-655,"num_object_clones":0,"num_object_copies":-1310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-655,"num_whiteouts":0,"num_read":814,"num_read_kb":689,"num_write":700,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007761"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.893148+0000","last_change":"2024-09-12T18:55:19.125750+0000","last_active":"2024-09-12T19:10:18.893148+0000","last_peered":"2024-09-12T19:10:18.893148+0000","last_clean":"2024-09-12T19:10:18.893148+0000","last_became_active":"2024-09-12T18:55:19.125009+0000","last_became_peered":"2024-09-12T18:55:19.125009+0000","last_unstale":"2024-09-12T19:10:18.893148+0000","last_undegraded":"2024-09-12T19:10:18.893148+0000","last_fullsized":"2024-09-12T19:10:18.893148+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:07.599229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.902941+0000","last_change":"2024-09-12T18:43:32.909745+0000","last_active":"2024-09-12T19:11:03.902941+0000","last_peered":"2024-09-12T19:11:03.902941+0000","last_clean":"2024-09-12T19:11:03.902941+0000","last_became_active":"2024-09-12T18:43:32.908691+0000","last_became_peered":"2024-09-12T18:43:32.908691+0000","last_unstale":"2024-09-12T19:11:03.902941+0000","last_undegraded":"2024-09-12T19:11:03.902941+0000","last_fullsized":"2024-09-12T19:11:03.902941+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:19.818191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.926901+0000","last_change":"2024-09-12T18:43:29.867175+0000","last_active":"2024-09-12T19:10:58.926901+0000","last_peered":"2024-09-12T19:10:58.926901+0000","last_clean":"2024-09-12T19:10:58.926901+0000","last_became_active":"2024-09-12T18:43:29.866493+0000","last_became_peered":"2024-09-12T18:43:29.866493+0000","last_unstale":"2024-09-12T19:10:58.926901+0000","last_undegraded":"2024-09-12T19:10:58.926901+0000","last_fullsized":"2024-09-12T19:10:58.926901+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:56.771077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'18","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.928758+0000","last_change":"2024-09-12T18:41:45.362583+0000","last_active":"2024-09-12T19:10:58.928758+0000","last_peered":"2024-09-12T19:10:58.928758+0000","last_clean":"2024-09-12T19:10:58.928758+0000","last_became_active":"2024-09-12T18:41:45.361841+0000","last_became_peered":"2024-09-12T18:41:45.361841+0000","last_unstale":"2024-09-12T19:10:58.928758+0000","last_undegraded":"2024-09-12T19:10:58.928758+0000","last_fullsized":"2024-09-12T19:10:58.928758+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:31.032849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":66,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.881812+0000","last_change":"2024-09-12T18:55:19.153318+0000","last_active":"2024-09-12T19:10:18.881812+0000","last_peered":"2024-09-12T19:10:18.881812+0000","last_clean":"2024-09-12T19:10:18.881812+0000","last_became_active":"2024-09-12T18:55:19.150059+0000","last_became_peered":"2024-09-12T18:55:19.150059+0000","last_unstale":"2024-09-12T19:10:18.881812+0000","last_undegraded":"2024-09-12T19:10:18.881812+0000","last_fullsized":"2024-09-12T19:10:18.881812+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:04.495819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:04.112646+0000","last_change":"2024-09-12T18:43:32.905639+0000","last_active":"2024-09-12T19:11:04.112646+0000","last_peered":"2024-09-12T19:11:04.112646+0000","last_clean":"2024-09-12T19:11:04.112646+0000","last_became_active":"2024-09-12T18:43:32.904914+0000","last_became_peered":"2024-09-12T18:43:32.904914+0000","last_unstale":"2024-09-12T19:11:04.112646+0000","last_undegraded":"2024-09-12T19:11:04.112646+0000","last_fullsized":"2024-09-12T19:11:04.112646+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:47.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:32.741144+0000","last_change":"2024-09-12T18:43:29.895683+0000","last_active":"2024-09-12T19:13:32.741144+0000","last_peered":"2024-09-12T19:13:32.741144+0000","last_clean":"2024-09-12T19:13:32.741144+0000","last_became_active":"2024-09-12T18:43:29.891221+0000","last_became_peered":"2024-09-12T18:43:29.891221+0000","last_unstale":"2024-09-12T19:13:32.741144+0000","last_undegraded":"2024-09-12T19:13:32.741144+0000","last_fullsized":"2024-09-12T19:13:32.741144+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:28.583040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'32","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.876821+0000","last_change":"2024-09-12T18:41:45.362441+0000","last_active":"2024-09-12T19:09:53.876821+0000","last_peered":"2024-09-12T19:09:53.876821+0000","last_clean":"2024-09-12T19:09:53.876821+0000","last_became_active":"2024-09-12T18:41:45.361664+0000","last_became_peered":"2024-09-12T18:41:45.361664+0000","last_unstale":"2024-09-12T19:09:53.876821+0000","last_undegraded":"2024-09-12T19:09:53.876821+0000","last_fullsized":"2024-09-12T19:09:53.876821+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:16.353573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.888584+0000","last_change":"2024-09-12T18:55:19.120410+0000","last_active":"2024-09-12T19:09:48.888584+0000","last_peered":"2024-09-12T19:09:48.888584+0000","last_clean":"2024-09-12T19:09:48.888584+0000","last_became_active":"2024-09-12T18:55:19.119601+0000","last_became_peered":"2024-09-12T18:55:19.119601+0000","last_unstale":"2024-09-12T19:09:48.888584+0000","last_undegraded":"2024-09-12T19:09:48.888584+0000","last_fullsized":"2024-09-12T19:09:48.888584+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:00.200110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.923902+0000","last_change":"2024-09-12T18:43:32.917442+0000","last_active":"2024-09-12T19:10:38.923902+0000","last_peered":"2024-09-12T19:10:38.923902+0000","last_clean":"2024-09-12T19:10:38.923902+0000","last_became_active":"2024-09-12T18:43:32.916727+0000","last_became_peered":"2024-09-12T18:43:32.916727+0000","last_unstale":"2024-09-12T19:10:38.923902+0000","last_undegraded":"2024-09-12T19:10:38.923902+0000","last_fullsized":"2024-09-12T19:10:38.923902+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:51.785407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12290,"num_write":7,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"265'14","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.714674+0000","last_change":"2024-09-12T18:43:29.884424+0000","last_active":"2024-09-12T19:11:38.714674+0000","last_peered":"2024-09-12T19:11:38.714674+0000","last_clean":"2024-09-12T19:11:38.714674+0000","last_became_active":"2024-09-12T18:43:29.881401+0000","last_became_peered":"2024-09-12T18:43:29.881401+0000","last_unstale":"2024-09-12T19:11:38.714674+0000","last_undegraded":"2024-09-12T19:11:38.714674+0000","last_fullsized":"2024-09-12T19:11:38.714674+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:45.030211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":40962,"num_write":19,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'47","reported_seq":173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:04.762249+0000","last_change":"2024-09-12T18:41:45.360114+0000","last_active":"2024-09-12T19:10:04.762249+0000","last_peered":"2024-09-12T19:10:04.762249+0000","last_clean":"2024-09-12T19:10:04.762249+0000","last_became_active":"2024-09-12T18:41:45.350377+0000","last_became_peered":"2024-09-12T18:41:45.350377+0000","last_unstale":"2024-09-12T19:10:04.762249+0000","last_undegraded":"2024-09-12T19:10:04.762249+0000","last_fullsized":"2024-09-12T19:10:04.762249+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:15.485612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":164,"num_write":88,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.910960+0000","last_change":"2024-09-12T18:55:19.136469+0000","last_active":"2024-09-12T19:09:53.910960+0000","last_peered":"2024-09-12T19:09:53.910960+0000","last_clean":"2024-09-12T19:09:53.910960+0000","last_became_active":"2024-09-12T18:55:19.135875+0000","last_became_peered":"2024-09-12T18:55:19.135875+0000","last_unstale":"2024-09-12T19:09:53.910960+0000","last_undegraded":"2024-09-12T19:09:53.910960+0000","last_fullsized":"2024-09-12T19:09:53.910960+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:50.008510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'1","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.716115+0000","last_change":"2024-09-12T18:43:32.939294+0000","last_active":"2024-09-12T19:11:43.716115+0000","last_peered":"2024-09-12T19:11:43.716115+0000","last_clean":"2024-09-12T19:11:43.716115+0000","last_became_active":"2024-09-12T18:43:32.935176+0000","last_became_peered":"2024-09-12T18:43:32.935176+0000","last_unstale":"2024-09-12T19:11:43.716115+0000","last_undegraded":"2024-09-12T19:11:43.716115+0000","last_fullsized":"2024-09-12T19:11:43.716115+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:27.896775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:39.107194+0000","last_change":"2024-09-12T18:43:29.873805+0000","last_active":"2024-09-12T19:10:39.107194+0000","last_peered":"2024-09-12T19:10:39.107194+0000","last_clean":"2024-09-12T19:10:39.107194+0000","last_became_active":"2024-09-12T18:43:29.873115+0000","last_became_peered":"2024-09-12T18:43:29.873115+0000","last_unstale":"2024-09-12T19:10:39.107194+0000","last_undegraded":"2024-09-12T19:10:39.107194+0000","last_fullsized":"2024-09-12T19:10:39.107194+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:22.098039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'47","reported_seq":168,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.878251+0000","last_change":"2024-09-12T18:41:45.350781+0000","last_active":"2024-09-12T19:11:19.878251+0000","last_peered":"2024-09-12T19:11:19.878251+0000","last_clean":"2024-09-12T19:11:19.878251+0000","last_became_active":"2024-09-12T18:41:45.350035+0000","last_became_peered":"2024-09-12T18:41:45.350035+0000","last_unstale":"2024-09-12T19:11:19.878251+0000","last_undegraded":"2024-09-12T19:11:19.878251+0000","last_fullsized":"2024-09-12T19:11:19.878251+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:07.679045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":157,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:28.712218+0000","last_change":"2024-09-12T18:55:19.157689+0000","last_active":"2024-09-12T19:11:28.712218+0000","last_peered":"2024-09-12T19:11:28.712218+0000","last_clean":"2024-09-12T19:11:28.712218+0000","last_became_active":"2024-09-12T18:55:19.156936+0000","last_became_peered":"2024-09-12T18:55:19.156936+0000","last_unstale":"2024-09-12T19:11:28.712218+0000","last_undegraded":"2024-09-12T19:11:28.712218+0000","last_fullsized":"2024-09-12T19:11:28.712218+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:02.316107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.893085+0000","last_change":"2024-09-12T18:43:32.931532+0000","last_active":"2024-09-12T19:10:18.893085+0000","last_peered":"2024-09-12T19:10:18.893085+0000","last_clean":"2024-09-12T19:10:18.893085+0000","last_became_active":"2024-09-12T18:43:32.930772+0000","last_became_peered":"2024-09-12T18:43:32.930772+0000","last_unstale":"2024-09-12T19:10:18.893085+0000","last_undegraded":"2024-09-12T19:10:18.893085+0000","last_fullsized":"2024-09-12T19:10:18.893085+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:02.364155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'1","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.915522+0000","last_change":"2024-09-12T18:43:29.884425+0000","last_active":"2024-09-12T19:10:08.915522+0000","last_peered":"2024-09-12T19:10:08.915522+0000","last_clean":"2024-09-12T19:10:08.915522+0000","last_became_active":"2024-09-12T18:43:29.883399+0000","last_became_peered":"2024-09-12T18:43:29.883399+0000","last_unstale":"2024-09-12T19:10:08.915522+0000","last_undegraded":"2024-09-12T19:10:08.915522+0000","last_fullsized":"2024-09-12T19:10:08.915522+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:31.245225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'25","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:31.792096+0000","last_change":"2024-09-12T18:41:45.359067+0000","last_active":"2024-09-12T19:10:31.792096+0000","last_peered":"2024-09-12T19:10:31.792096+0000","last_clean":"2024-09-12T19:10:31.792096+0000","last_became_active":"2024-09-12T18:41:45.355180+0000","last_became_peered":"2024-09-12T18:41:45.355180+0000","last_unstale":"2024-09-12T19:10:31.792096+0000","last_undegraded":"2024-09-12T19:10:31.792096+0000","last_fullsized":"2024-09-12T19:10:31.792096+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:27.390592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:57.900836+0000","last_change":"2024-09-12T18:55:19.139208+0000","last_active":"2024-09-12T19:09:57.900836+0000","last_peered":"2024-09-12T19:09:57.900836+0000","last_clean":"2024-09-12T19:09:57.900836+0000","last_became_active":"2024-09-12T18:55:19.138472+0000","last_became_peered":"2024-09-12T18:55:19.138472+0000","last_unstale":"2024-09-12T19:09:57.900836+0000","last_undegraded":"2024-09-12T19:09:57.900836+0000","last_fullsized":"2024-09-12T19:09:57.900836+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:46.378454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.893333+0000","last_change":"2024-09-12T18:43:32.936388+0000","last_active":"2024-09-12T19:10:08.893333+0000","last_peered":"2024-09-12T19:10:08.893333+0000","last_clean":"2024-09-12T19:10:08.893333+0000","last_became_active":"2024-09-12T18:43:32.935898+0000","last_became_peered":"2024-09-12T18:43:32.935898+0000","last_unstale":"2024-09-12T19:10:08.893333+0000","last_undegraded":"2024-09-12T19:10:08.893333+0000","last_fullsized":"2024-09-12T19:10:08.893333+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:23.395289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'1","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:09.100142+0000","last_change":"2024-09-12T18:43:29.885221+0000","last_active":"2024-09-12T19:10:09.100142+0000","last_peered":"2024-09-12T19:10:09.100142+0000","last_clean":"2024-09-12T19:10:09.100142+0000","last_became_active":"2024-09-12T18:43:29.882621+0000","last_became_peered":"2024-09-12T18:43:29.882621+0000","last_unstale":"2024-09-12T19:10:09.100142+0000","last_undegraded":"2024-09-12T19:10:09.100142+0000","last_fullsized":"2024-09-12T19:10:09.100142+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:41.071383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'16","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.882329+0000","last_change":"2024-09-12T18:41:45.358702+0000","last_active":"2024-09-12T19:09:18.882329+0000","last_peered":"2024-09-12T19:09:18.882329+0000","last_clean":"2024-09-12T19:09:18.882329+0000","last_became_active":"2024-09-12T18:41:45.357957+0000","last_became_peered":"2024-09-12T18:41:45.357957+0000","last_unstale":"2024-09-12T19:09:18.882329+0000","last_undegraded":"2024-09-12T19:09:18.882329+0000","last_fullsized":"2024-09-12T19:09:18.882329+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:45.441066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":53,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899753+0000","last_change":"2024-09-12T18:55:19.148993+0000","last_active":"2024-09-12T19:10:22.899753+0000","last_peered":"2024-09-12T19:10:22.899753+0000","last_clean":"2024-09-12T19:10:22.899753+0000","last_became_active":"2024-09-12T18:55:19.147110+0000","last_became_peered":"2024-09-12T18:55:19.147110+0000","last_unstale":"2024-09-12T19:10:22.899753+0000","last_undegraded":"2024-09-12T19:10:22.899753+0000","last_fullsized":"2024-09-12T19:10:22.899753+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:46.858987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.905541+0000","last_change":"2024-09-12T18:43:32.923207+0000","last_active":"2024-09-12T19:11:03.905541+0000","last_peered":"2024-09-12T19:11:03.905541+0000","last_clean":"2024-09-12T19:11:03.905541+0000","last_became_active":"2024-09-12T18:43:32.922514+0000","last_became_peered":"2024-09-12T18:43:32.922514+0000","last_unstale":"2024-09-12T19:11:03.905541+0000","last_undegraded":"2024-09-12T19:11:03.905541+0000","last_fullsized":"2024-09-12T19:11:03.905541+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:30.175347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:04.112553+0000","last_change":"2024-09-12T18:43:29.905017+0000","last_active":"2024-09-12T19:11:04.112553+0000","last_peered":"2024-09-12T19:11:04.112553+0000","last_clean":"2024-09-12T19:11:04.112553+0000","last_became_active":"2024-09-12T18:43:29.904226+0000","last_became_peered":"2024-09-12T18:43:29.904226+0000","last_unstale":"2024-09-12T19:11:04.112553+0000","last_undegraded":"2024-09-12T19:11:04.112553+0000","last_fullsized":"2024-09-12T19:11:04.112553+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:47.238023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'21","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:53.927298+0000","last_change":"2024-09-12T18:41:45.359716+0000","last_active":"2024-09-12T19:10:53.927298+0000","last_peered":"2024-09-12T19:10:53.927298+0000","last_clean":"2024-09-12T19:10:53.927298+0000","last_became_active":"2024-09-12T18:41:45.351791+0000","last_became_peered":"2024-09-12T18:41:45.351791+0000","last_unstale":"2024-09-12T19:10:53.927298+0000","last_undegraded":"2024-09-12T19:10:53.927298+0000","last_fullsized":"2024-09-12T19:10:53.927298+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:10.883167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899885+0000","last_change":"2024-09-12T18:55:19.149601+0000","last_active":"2024-09-12T19:10:22.899885+0000","last_peered":"2024-09-12T19:10:22.899885+0000","last_clean":"2024-09-12T19:10:22.899885+0000","last_became_active":"2024-09-12T18:55:19.148859+0000","last_became_peered":"2024-09-12T18:55:19.148859+0000","last_unstale":"2024-09-12T19:10:22.899885+0000","last_undegraded":"2024-09-12T19:10:22.899885+0000","last_fullsized":"2024-09-12T19:10:22.899885+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:12.702998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.928529+0000","last_change":"2024-09-12T18:43:32.937883+0000","last_active":"2024-09-12T19:11:03.928529+0000","last_peered":"2024-09-12T19:11:03.928529+0000","last_clean":"2024-09-12T19:11:03.928529+0000","last_became_active":"2024-09-12T18:43:32.935669+0000","last_became_peered":"2024-09-12T18:43:32.935669+0000","last_unstale":"2024-09-12T19:11:03.928529+0000","last_undegraded":"2024-09-12T19:11:03.928529+0000","last_fullsized":"2024-09-12T19:11:03.928529+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:02.525737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.930224+0000","last_change":"2024-09-12T18:43:29.884274+0000","last_active":"2024-09-12T19:11:03.930224+0000","last_peered":"2024-09-12T19:11:03.930224+0000","last_clean":"2024-09-12T19:11:03.930224+0000","last_became_active":"2024-09-12T18:43:29.883324+0000","last_became_peered":"2024-09-12T18:43:29.883324+0000","last_unstale":"2024-09-12T19:11:03.930224+0000","last_undegraded":"2024-09-12T19:11:03.930224+0000","last_fullsized":"2024-09-12T19:11:03.930224+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.971344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'60","reported_seq":219,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:14.482064+0000","last_change":"2024-09-12T18:41:45.345965+0000","last_active":"2024-09-12T19:11:14.482064+0000","last_peered":"2024-09-12T19:11:14.482064+0000","last_clean":"2024-09-12T19:11:14.482064+0000","last_became_active":"2024-09-12T18:41:45.339369+0000","last_became_peered":"2024-09-12T18:41:45.339369+0000","last_unstale":"2024-09-12T19:11:14.482064+0000","last_undegraded":"2024-09-12T19:11:14.482064+0000","last_fullsized":"2024-09-12T19:11:14.482064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:10.411652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":229,"num_write":103,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:22.892454+0000","last_change":"2024-09-12T18:55:19.123103+0000","last_active":"2024-09-12T19:09:22.892454+0000","last_peered":"2024-09-12T19:09:22.892454+0000","last_clean":"2024-09-12T19:09:22.892454+0000","last_became_active":"2024-09-12T18:55:19.122414+0000","last_became_peered":"2024-09-12T18:55:19.122414+0000","last_unstale":"2024-09-12T19:09:22.892454+0000","last_undegraded":"2024-09-12T19:09:22.892454+0000","last_fullsized":"2024-09-12T19:09:22.892454+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:12.271436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.914646+0000","last_change":"2024-09-12T18:43:32.927238+0000","last_active":"2024-09-12T19:10:08.914646+0000","last_peered":"2024-09-12T19:10:08.914646+0000","last_clean":"2024-09-12T19:10:08.914646+0000","last_became_active":"2024-09-12T18:43:32.924570+0000","last_became_peered":"2024-09-12T18:43:32.924570+0000","last_unstale":"2024-09-12T19:10:08.914646+0000","last_undegraded":"2024-09-12T19:10:08.914646+0000","last_fullsized":"2024-09-12T19:10:08.914646+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:12.682450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'1","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.879155+0000","last_change":"2024-09-12T18:43:29.869397+0000","last_active":"2024-09-12T19:09:18.879155+0000","last_peered":"2024-09-12T19:09:18.879155+0000","last_clean":"2024-09-12T19:09:18.879155+0000","last_became_active":"2024-09-12T18:43:29.868738+0000","last_became_peered":"2024-09-12T18:43:29.868738+0000","last_unstale":"2024-09-12T19:09:18.879155+0000","last_undegraded":"2024-09-12T19:09:18.879155+0000","last_fullsized":"2024-09-12T19:09:18.879155+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:27.215594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'11","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.926325+0000","last_change":"2024-09-12T18:41:45.352288+0000","last_active":"2024-09-12T19:10:48.926325+0000","last_peered":"2024-09-12T19:10:48.926325+0000","last_clean":"2024-09-12T19:10:48.926325+0000","last_became_active":"2024-09-12T18:41:45.351553+0000","last_became_peered":"2024-09-12T18:41:45.351553+0000","last_unstale":"2024-09-12T19:10:48.926325+0000","last_undegraded":"2024-09-12T19:10:48.926325+0000","last_fullsized":"2024-09-12T19:10:48.926325+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:04.726575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":29,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.869417+0000","last_change":"2024-09-12T18:55:19.139323+0000","last_active":"2024-09-12T19:09:18.869417+0000","last_peered":"2024-09-12T19:09:18.869417+0000","last_clean":"2024-09-12T19:09:18.869417+0000","last_became_active":"2024-09-12T18:55:19.138649+0000","last_became_peered":"2024-09-12T18:55:19.138649+0000","last_unstale":"2024-09-12T19:09:18.869417+0000","last_undegraded":"2024-09-12T19:09:18.869417+0000","last_fullsized":"2024-09-12T19:09:18.869417+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:14.966478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.902275+0000","last_change":"2024-09-12T18:43:32.928110+0000","last_active":"2024-09-12T19:09:18.902275+0000","last_peered":"2024-09-12T19:09:18.902275+0000","last_clean":"2024-09-12T19:09:18.902275+0000","last_became_active":"2024-09-12T18:43:32.927181+0000","last_became_peered":"2024-09-12T18:43:32.927181+0000","last_unstale":"2024-09-12T19:09:18.902275+0000","last_undegraded":"2024-09-12T19:09:18.902275+0000","last_fullsized":"2024-09-12T19:09:18.902275+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:23.355481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'8","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.896153+0000","last_change":"2024-09-12T18:43:29.895323+0000","last_active":"2024-09-12T19:10:07.896153+0000","last_peered":"2024-09-12T19:10:07.896153+0000","last_clean":"2024-09-12T19:10:07.896153+0000","last_became_active":"2024-09-12T18:43:29.894650+0000","last_became_peered":"2024-09-12T18:43:29.894650+0000","last_unstale":"2024-09-12T19:10:07.896153+0000","last_undegraded":"2024-09-12T19:10:07.896153+0000","last_fullsized":"2024-09-12T19:10:07.896153+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:51.742629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8194,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'29","reported_seq":121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.891219+0000","last_change":"2024-09-12T18:41:45.361458+0000","last_active":"2024-09-12T19:11:19.891219+0000","last_peered":"2024-09-12T19:11:19.891219+0000","last_clean":"2024-09-12T19:11:19.891219+0000","last_became_active":"2024-09-12T18:41:45.360856+0000","last_became_peered":"2024-09-12T18:41:45.360856+0000","last_unstale":"2024-09-12T19:11:19.891219+0000","last_undegraded":"2024-09-12T19:11:19.891219+0000","last_fullsized":"2024-09-12T19:11:19.891219+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.915436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":92,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:22.884390+0000","last_change":"2024-09-12T18:55:19.126091+0000","last_active":"2024-09-12T19:09:22.884390+0000","last_peered":"2024-09-12T19:09:22.884390+0000","last_clean":"2024-09-12T19:09:22.884390+0000","last_became_active":"2024-09-12T18:55:19.123727+0000","last_became_peered":"2024-09-12T18:55:19.123727+0000","last_unstale":"2024-09-12T19:09:22.884390+0000","last_undegraded":"2024-09-12T19:09:22.884390+0000","last_fullsized":"2024-09-12T19:09:22.884390+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:20.999734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.914770+0000","last_change":"2024-09-12T18:43:32.935321+0000","last_active":"2024-09-12T19:10:08.914770+0000","last_peered":"2024-09-12T19:10:08.914770+0000","last_clean":"2024-09-12T19:10:08.914770+0000","last_became_active":"2024-09-12T18:43:32.934654+0000","last_became_peered":"2024-09-12T18:43:32.934654+0000","last_unstale":"2024-09-12T19:10:08.914770+0000","last_undegraded":"2024-09-12T19:10:08.914770+0000","last_fullsized":"2024-09-12T19:10:08.914770+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:18.460691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.878771+0000","last_change":"2024-09-12T18:43:29.865882+0000","last_active":"2024-09-12T19:10:03.878771+0000","last_peered":"2024-09-12T19:10:03.878771+0000","last_clean":"2024-09-12T19:10:03.878771+0000","last_became_active":"2024-09-12T18:43:29.863876+0000","last_became_peered":"2024-09-12T18:43:29.863876+0000","last_unstale":"2024-09-12T19:10:03.878771+0000","last_undegraded":"2024-09-12T19:10:03.878771+0000","last_fullsized":"2024-09-12T19:10:03.878771+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:17.118378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'15","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.888129+0000","last_change":"2024-09-12T18:41:45.347581+0000","last_active":"2024-09-12T19:10:48.888129+0000","last_peered":"2024-09-12T19:10:48.888129+0000","last_clean":"2024-09-12T19:10:48.888129+0000","last_became_active":"2024-09-12T18:41:45.346831+0000","last_became_peered":"2024-09-12T18:41:45.346831+0000","last_unstale":"2024-09-12T19:10:48.888129+0000","last_undegraded":"2024-09-12T19:10:48.888129+0000","last_fullsized":"2024-09-12T19:10:48.888129+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:46.368160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":48,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.879056+0000","last_change":"2024-09-12T18:55:19.129602+0000","last_active":"2024-09-12T19:09:18.879056+0000","last_peered":"2024-09-12T19:09:18.879056+0000","last_clean":"2024-09-12T19:09:18.879056+0000","last_became_active":"2024-09-12T18:55:19.125607+0000","last_became_peered":"2024-09-12T18:55:19.125607+0000","last_unstale":"2024-09-12T19:09:18.879056+0000","last_undegraded":"2024-09-12T19:09:18.879056+0000","last_fullsized":"2024-09-12T19:09:18.879056+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:37.974980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:09.100279+0000","last_change":"2024-09-12T18:43:32.909634+0000","last_active":"2024-09-12T19:10:09.100279+0000","last_peered":"2024-09-12T19:10:09.100279+0000","last_clean":"2024-09-12T19:10:09.100279+0000","last_became_active":"2024-09-12T18:43:32.908905+0000","last_became_peered":"2024-09-12T18:43:32.908905+0000","last_unstale":"2024-09-12T19:10:09.100279+0000","last_undegraded":"2024-09-12T19:10:09.100279+0000","last_fullsized":"2024-09-12T19:10:09.100279+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:55.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'6","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.915861+0000","last_change":"2024-09-12T18:43:29.883172+0000","last_active":"2024-09-12T19:10:08.915861+0000","last_peered":"2024-09-12T19:10:08.915861+0000","last_clean":"2024-09-12T19:10:08.915861+0000","last_became_active":"2024-09-12T18:43:29.880462+0000","last_became_peered":"2024-09-12T18:43:29.880462+0000","last_unstale":"2024-09-12T19:10:08.915861+0000","last_undegraded":"2024-09-12T19:10:08.915861+0000","last_fullsized":"2024-09-12T19:10:08.915861+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.795034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'6","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:57.892839+0000","last_change":"2024-09-12T18:41:45.360552+0000","last_active":"2024-09-12T19:09:57.892839+0000","last_peered":"2024-09-12T19:09:57.892839+0000","last_clean":"2024-09-12T19:09:57.892839+0000","last_became_active":"2024-09-12T18:41:45.359794+0000","last_became_peered":"2024-09-12T18:41:45.359794+0000","last_unstale":"2024-09-12T19:09:57.892839+0000","last_undegraded":"2024-09-12T19:09:57.892839+0000","last_fullsized":"2024-09-12T19:09:57.892839+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:00.750042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.910032+0000","last_change":"2024-09-12T18:55:19.154082+0000","last_active":"2024-09-12T19:09:48.910032+0000","last_peered":"2024-09-12T19:09:48.910032+0000","last_clean":"2024-09-12T19:09:48.910032+0000","last_became_active":"2024-09-12T18:55:19.152807+0000","last_became_peered":"2024-09-12T18:55:19.152807+0000","last_unstale":"2024-09-12T19:09:48.910032+0000","last_undegraded":"2024-09-12T19:09:48.910032+0000","last_fullsized":"2024-09-12T19:09:48.910032+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:33.926655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715438+0000","last_change":"2024-09-12T18:43:32.903978+0000","last_active":"2024-09-12T19:11:32.715438+0000","last_peered":"2024-09-12T19:11:32.715438+0000","last_clean":"2024-09-12T19:11:32.715438+0000","last_became_active":"2024-09-12T18:43:32.899988+0000","last_became_peered":"2024-09-12T18:43:32.899988+0000","last_unstale":"2024-09-12T19:11:32.715438+0000","last_undegraded":"2024-09-12T19:11:32.715438+0000","last_fullsized":"2024-09-12T19:11:32.715438+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:49.693725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'1","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:34.118959+0000","last_change":"2024-09-12T18:43:29.881020+0000","last_active":"2024-09-12T19:11:34.118959+0000","last_peered":"2024-09-12T19:11:34.118959+0000","last_clean":"2024-09-12T19:11:34.118959+0000","last_became_active":"2024-09-12T18:43:29.880294+0000","last_became_peered":"2024-09-12T18:43:29.880294+0000","last_unstale":"2024-09-12T19:11:34.118959+0000","last_undegraded":"2024-09-12T19:11:34.118959+0000","last_fullsized":"2024-09-12T19:11:34.118959+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:23.505932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'33","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:47.890460+0000","last_change":"2024-09-12T18:41:45.360139+0000","last_active":"2024-09-12T19:09:47.890460+0000","last_peered":"2024-09-12T19:09:47.890460+0000","last_clean":"2024-09-12T19:09:47.890460+0000","last_became_active":"2024-09-12T18:41:45.359405+0000","last_became_peered":"2024-09-12T18:41:45.359405+0000","last_unstale":"2024-09-12T19:09:47.890460+0000","last_undegraded":"2024-09-12T19:09:47.890460+0000","last_fullsized":"2024-09-12T19:09:47.890460+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:10.135901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":128,"num_write":57,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.911259+0000","last_change":"2024-09-12T18:55:19.139048+0000","last_active":"2024-09-12T19:09:48.911259+0000","last_peered":"2024-09-12T19:09:48.911259+0000","last_clean":"2024-09-12T19:09:48.911259+0000","last_became_active":"2024-09-12T18:55:19.136822+0000","last_became_peered":"2024-09-12T18:55:19.136822+0000","last_unstale":"2024-09-12T19:09:48.911259+0000","last_undegraded":"2024-09-12T19:09:48.911259+0000","last_fullsized":"2024-09-12T19:09:48.911259+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:07.426373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715353+0000","last_change":"2024-09-12T18:43:32.908035+0000","last_active":"2024-09-12T19:11:32.715353+0000","last_peered":"2024-09-12T19:11:32.715353+0000","last_clean":"2024-09-12T19:11:32.715353+0000","last_became_active":"2024-09-12T18:43:32.906911+0000","last_became_peered":"2024-09-12T18:43:32.906911+0000","last_unstale":"2024-09-12T19:11:32.715353+0000","last_undegraded":"2024-09-12T19:11:32.715353+0000","last_fullsized":"2024-09-12T19:11:32.715353+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:23.186205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"265'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:28.712068+0000","last_change":"2024-09-12T18:43:29.874437+0000","last_active":"2024-09-12T19:11:28.712068+0000","last_peered":"2024-09-12T19:11:28.712068+0000","last_clean":"2024-09-12T19:11:28.712068+0000","last_became_active":"2024-09-12T18:43:29.873561+0000","last_became_peered":"2024-09-12T18:43:29.873561+0000","last_unstale":"2024-09-12T19:11:28.712068+0000","last_undegraded":"2024-09-12T19:11:28.712068+0000","last_fullsized":"2024-09-12T19:11:28.712068+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:09.170136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'40","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.911052+0000","last_change":"2024-09-12T18:41:45.359990+0000","last_active":"2024-09-12T19:09:48.911052+0000","last_peered":"2024-09-12T19:09:48.911052+0000","last_clean":"2024-09-12T19:09:48.911052+0000","last_became_active":"2024-09-12T18:41:45.352482+0000","last_became_peered":"2024-09-12T18:41:45.352482+0000","last_unstale":"2024-09-12T19:09:48.911052+0000","last_undegraded":"2024-09-12T19:09:48.911052+0000","last_fullsized":"2024-09-12T19:09:48.911052+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:23.809564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:23.904477+0000","last_change":"2024-09-12T18:55:19.135873+0000","last_active":"2024-09-12T19:09:23.904477+0000","last_peered":"2024-09-12T19:09:23.904477+0000","last_clean":"2024-09-12T19:09:23.904477+0000","last_became_active":"2024-09-12T18:55:19.132991+0000","last_became_peered":"2024-09-12T18:55:19.132991+0000","last_unstale":"2024-09-12T19:09:23.904477+0000","last_undegraded":"2024-09-12T19:09:23.904477+0000","last_fullsized":"2024-09-12T19:09:23.904477+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:18.775245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:33.713286+0000","last_change":"2024-09-12T18:43:32.934314+0000","last_active":"2024-09-12T19:11:33.713286+0000","last_peered":"2024-09-12T19:11:33.713286+0000","last_clean":"2024-09-12T19:11:33.713286+0000","last_became_active":"2024-09-12T18:43:32.927109+0000","last_became_peered":"2024-09-12T18:43:32.927109+0000","last_unstale":"2024-09-12T19:11:33.713286+0000","last_undegraded":"2024-09-12T19:11:33.713286+0000","last_fullsized":"2024-09-12T19:11:33.713286+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:58.923503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":28674,"num_write":7,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'1","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:33.911847+0000","last_change":"2024-09-12T18:43:29.881351+0000","last_active":"2024-09-12T19:11:33.911847+0000","last_peered":"2024-09-12T19:11:33.911847+0000","last_clean":"2024-09-12T19:11:33.911847+0000","last_became_active":"2024-09-12T18:43:29.880517+0000","last_became_peered":"2024-09-12T18:43:29.880517+0000","last_unstale":"2024-09-12T19:11:33.911847+0000","last_undegraded":"2024-09-12T19:11:33.911847+0000","last_fullsized":"2024-09-12T19:11:33.911847+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:07.250936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:49.095887+0000","last_change":"2024-09-12T18:41:45.351776+0000","last_active":"2024-09-12T19:09:49.095887+0000","last_peered":"2024-09-12T19:09:49.095887+0000","last_clean":"2024-09-12T19:09:49.095887+0000","last_became_active":"2024-09-12T18:41:45.350632+0000","last_became_peered":"2024-09-12T18:41:45.350632+0000","last_unstale":"2024-09-12T19:09:49.095887+0000","last_undegraded":"2024-09-12T19:09:49.095887+0000","last_fullsized":"2024-09-12T19:09:49.095887+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:16.702236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.909979+0000","last_change":"2024-09-12T18:55:19.151498+0000","last_active":"2024-09-12T19:09:48.909979+0000","last_peered":"2024-09-12T19:09:48.909979+0000","last_clean":"2024-09-12T19:09:48.909979+0000","last_became_active":"2024-09-12T18:55:19.150880+0000","last_became_peered":"2024-09-12T18:55:19.150880+0000","last_unstale":"2024-09-12T19:09:48.909979+0000","last_undegraded":"2024-09-12T19:09:48.909979+0000","last_fullsized":"2024-09-12T19:09:48.909979+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:13.724232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'13","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:33.911802+0000","last_change":"2024-09-12T18:43:32.927843+0000","last_active":"2024-09-12T19:11:33.911802+0000","last_peered":"2024-09-12T19:11:33.911802+0000","last_clean":"2024-09-12T19:11:33.911802+0000","last_became_active":"2024-09-12T18:43:32.927270+0000","last_became_peered":"2024-09-12T18:43:32.927270+0000","last_unstale":"2024-09-12T19:11:33.911802+0000","last_undegraded":"2024-09-12T19:11:33.911802+0000","last_fullsized":"2024-09-12T19:11:33.911802+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:30.970671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":38914,"num_write":23,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'1","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:28.908122+0000","last_change":"2024-09-12T18:43:29.902339+0000","last_active":"2024-09-12T19:11:28.908122+0000","last_peered":"2024-09-12T19:11:28.908122+0000","last_clean":"2024-09-12T19:11:28.908122+0000","last_became_active":"2024-09-12T18:43:29.901627+0000","last_became_peered":"2024-09-12T18:43:29.901627+0000","last_unstale":"2024-09-12T19:11:28.908122+0000","last_undegraded":"2024-09-12T19:11:28.908122+0000","last_fullsized":"2024-09-12T19:11:28.908122+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:48.203220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'30","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.583951+0000","last_change":"2024-09-12T18:41:45.353240+0000","last_active":"2024-09-12T19:11:19.583951+0000","last_peered":"2024-09-12T19:11:19.583951+0000","last_clean":"2024-09-12T19:11:19.583951+0000","last_became_active":"2024-09-12T18:41:45.350670+0000","last_became_peered":"2024-09-12T18:41:45.350670+0000","last_unstale":"2024-09-12T19:11:19.583951+0000","last_undegraded":"2024-09-12T19:11:19.583951+0000","last_fullsized":"2024-09-12T19:11:19.583951+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:05.567815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.884911+0000","last_change":"2024-09-12T18:55:19.139183+0000","last_active":"2024-09-12T19:10:33.884911+0000","last_peered":"2024-09-12T19:10:33.884911+0000","last_clean":"2024-09-12T19:10:33.884911+0000","last_became_active":"2024-09-12T18:55:19.137332+0000","last_became_peered":"2024-09-12T18:55:19.137332+0000","last_unstale":"2024-09-12T19:10:33.884911+0000","last_undegraded":"2024-09-12T19:10:33.884911+0000","last_fullsized":"2024-09-12T19:10:33.884911+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:17.893526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'1","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:13.933310+0000","last_change":"2024-09-12T18:44:13.008362+0000","last_active":"2024-09-12T19:11:13.933310+0000","last_peered":"2024-09-12T19:11:13.933310+0000","last_clean":"2024-09-12T19:11:13.933310+0000","last_became_active":"2024-09-12T18:44:13.007582+0000","last_became_peered":"2024-09-12T18:44:13.007582+0000","last_unstale":"2024-09-12T19:11:13.933310+0000","last_undegraded":"2024-09-12T19:11:13.933310+0000","last_fullsized":"2024-09-12T19:11:13.933310+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:14.811461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.c","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.902160+0000","last_change":"2024-09-12T18:43:29.889784+0000","last_active":"2024-09-12T19:10:32.902160+0000","last_peered":"2024-09-12T19:10:32.902160+0000","last_clean":"2024-09-12T19:10:32.902160+0000","last_became_active":"2024-09-12T18:43:29.888041+0000","last_became_peered":"2024-09-12T18:43:29.888041+0000","last_unstale":"2024-09-12T19:10:32.902160+0000","last_undegraded":"2024-09-12T19:10:32.902160+0000","last_fullsized":"2024-09-12T19:10:32.902160+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:54.352777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'30","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.930272+0000","last_change":"2024-09-12T18:41:45.354909+0000","last_active":"2024-09-12T19:11:08.930272+0000","last_peered":"2024-09-12T19:11:08.930272+0000","last_clean":"2024-09-12T19:11:08.930272+0000","last_became_active":"2024-09-12T18:41:45.354063+0000","last_became_peered":"2024-09-12T18:41:45.354063+0000","last_unstale":"2024-09-12T19:11:08.930272+0000","last_undegraded":"2024-09-12T19:11:08.930272+0000","last_fullsized":"2024-09-12T19:11:08.930272+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:25.031450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910297+0000","last_change":"2024-09-12T18:55:19.140991+0000","last_active":"2024-09-12T19:11:07.910297+0000","last_peered":"2024-09-12T19:11:07.910297+0000","last_clean":"2024-09-12T19:11:07.910297+0000","last_became_active":"2024-09-12T18:55:19.140331+0000","last_became_peered":"2024-09-12T18:55:19.140331+0000","last_unstale":"2024-09-12T19:11:07.910297+0000","last_undegraded":"2024-09-12T19:11:07.910297+0000","last_fullsized":"2024-09-12T19:11:07.910297+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:37.267698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.920938+0000","last_change":"2024-09-12T18:43:32.935314+0000","last_active":"2024-09-12T19:10:33.920938+0000","last_peered":"2024-09-12T19:10:33.920938+0000","last_clean":"2024-09-12T19:10:33.920938+0000","last_became_active":"2024-09-12T18:43:32.934598+0000","last_became_peered":"2024-09-12T18:43:32.934598+0000","last_unstale":"2024-09-12T19:10:33.920938+0000","last_undegraded":"2024-09-12T19:10:33.920938+0000","last_fullsized":"2024-09-12T19:10:33.920938+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:01.163337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.883826+0000","last_change":"2024-09-12T18:43:29.888854+0000","last_active":"2024-09-12T19:10:28.883826+0000","last_peered":"2024-09-12T19:10:28.883826+0000","last_clean":"2024-09-12T19:10:28.883826+0000","last_became_active":"2024-09-12T18:43:29.887500+0000","last_became_peered":"2024-09-12T18:43:29.887500+0000","last_unstale":"2024-09-12T19:10:28.883826+0000","last_undegraded":"2024-09-12T19:10:28.883826+0000","last_fullsized":"2024-09-12T19:10:28.883826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:09.260023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'32","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.902996+0000","last_change":"2024-09-12T18:41:45.359668+0000","last_active":"2024-09-12T19:11:03.902996+0000","last_peered":"2024-09-12T19:11:03.902996+0000","last_clean":"2024-09-12T19:11:03.902996+0000","last_became_active":"2024-09-12T18:41:45.358914+0000","last_became_peered":"2024-09-12T18:41:45.358914+0000","last_unstale":"2024-09-12T19:11:03.902996+0000","last_undegraded":"2024-09-12T19:11:03.902996+0000","last_fullsized":"2024-09-12T19:11:03.902996+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:07.867252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":122,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.897994+0000","last_change":"2024-09-12T18:55:19.129609+0000","last_active":"2024-09-12T19:10:28.897994+0000","last_peered":"2024-09-12T19:10:28.897994+0000","last_clean":"2024-09-12T19:10:28.897994+0000","last_became_active":"2024-09-12T18:55:19.128236+0000","last_became_peered":"2024-09-12T18:55:19.128236+0000","last_unstale":"2024-09-12T19:10:28.897994+0000","last_undegraded":"2024-09-12T19:10:28.897994+0000","last_fullsized":"2024-09-12T19:10:28.897994+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:53.557810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"265'3","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:57.735434+0000","last_change":"2024-09-12T18:43:32.900792+0000","last_active":"2024-09-12T19:12:57.735434+0000","last_peered":"2024-09-12T19:12:57.735434+0000","last_clean":"2024-09-12T19:12:57.735434+0000","last_became_active":"2024-09-12T18:43:32.899943+0000","last_became_peered":"2024-09-12T18:43:32.899943+0000","last_unstale":"2024-09-12T19:12:57.735434+0000","last_undegraded":"2024-09-12T19:12:57.735434+0000","last_fullsized":"2024-09-12T19:12:57.735434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3444,"num_write":3,"num_write_kb":1722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.922613+0000","last_change":"2024-09-12T18:43:29.878465+0000","last_active":"2024-09-12T19:10:33.922613+0000","last_peered":"2024-09-12T19:10:33.922613+0000","last_clean":"2024-09-12T19:10:33.922613+0000","last_became_active":"2024-09-12T18:43:29.877755+0000","last_became_peered":"2024-09-12T18:43:29.877755+0000","last_unstale":"2024-09-12T19:10:33.922613+0000","last_undegraded":"2024-09-12T19:10:33.922613+0000","last_fullsized":"2024-09-12T19:10:33.922613+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:15.949360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4136,"num_write":3,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'17","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.905594+0000","last_change":"2024-09-12T18:41:45.358284+0000","last_active":"2024-09-12T19:11:03.905594+0000","last_peered":"2024-09-12T19:11:03.905594+0000","last_clean":"2024-09-12T19:11:03.905594+0000","last_became_active":"2024-09-12T18:41:45.357562+0000","last_became_peered":"2024-09-12T18:41:45.357562+0000","last_unstale":"2024-09-12T19:11:03.905594+0000","last_undegraded":"2024-09-12T19:11:03.905594+0000","last_fullsized":"2024-09-12T19:11:03.905594+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:45.746519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.902028+0000","last_change":"2024-09-12T18:55:19.137683+0000","last_active":"2024-09-12T19:10:32.902028+0000","last_peered":"2024-09-12T19:10:32.902028+0000","last_clean":"2024-09-12T19:10:32.902028+0000","last_became_active":"2024-09-12T18:55:19.136882+0000","last_became_peered":"2024-09-12T18:55:19.136882+0000","last_unstale":"2024-09-12T19:10:32.902028+0000","last_undegraded":"2024-09-12T19:10:32.902028+0000","last_fullsized":"2024-09-12T19:10:32.902028+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:09.805826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.921042+0000","last_change":"2024-09-12T18:43:32.930996+0000","last_active":"2024-09-12T19:10:33.921042+0000","last_peered":"2024-09-12T19:10:33.921042+0000","last_clean":"2024-09-12T19:10:33.921042+0000","last_became_active":"2024-09-12T18:43:32.927372+0000","last_became_peered":"2024-09-12T18:43:32.927372+0000","last_unstale":"2024-09-12T19:10:33.921042+0000","last_undegraded":"2024-09-12T19:10:33.921042+0000","last_fullsized":"2024-09-12T19:10:33.921042+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:56.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.910665+0000","last_change":"2024-09-12T18:43:29.900324+0000","last_active":"2024-09-12T19:10:37.910665+0000","last_peered":"2024-09-12T19:10:37.910665+0000","last_clean":"2024-09-12T19:10:37.910665+0000","last_became_active":"2024-09-12T18:43:29.888265+0000","last_became_peered":"2024-09-12T18:43:29.888265+0000","last_unstale":"2024-09-12T19:10:37.910665+0000","last_undegraded":"2024-09-12T19:10:37.910665+0000","last_fullsized":"2024-09-12T19:10:37.910665+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:31.453582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'32","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.891215+0000","last_change":"2024-09-12T18:41:45.336479+0000","last_active":"2024-09-12T19:11:03.891215+0000","last_peered":"2024-09-12T19:11:03.891215+0000","last_clean":"2024-09-12T19:11:03.891215+0000","last_became_active":"2024-09-12T18:41:45.335675+0000","last_became_peered":"2024-09-12T18:41:45.335675+0000","last_unstale":"2024-09-12T19:11:03.891215+0000","last_undegraded":"2024-09-12T19:11:03.891215+0000","last_fullsized":"2024-09-12T19:11:03.891215+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:40.967621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":63,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.928809+0000","last_change":"2024-09-12T18:55:19.150357+0000","last_active":"2024-09-12T19:11:03.928809+0000","last_peered":"2024-09-12T19:11:03.928809+0000","last_clean":"2024-09-12T19:11:03.928809+0000","last_became_active":"2024-09-12T18:55:19.149794+0000","last_became_peered":"2024-09-12T18:55:19.149794+0000","last_unstale":"2024-09-12T19:11:03.928809+0000","last_undegraded":"2024-09-12T19:11:03.928809+0000","last_fullsized":"2024-09-12T19:11:03.928809+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:29.807238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121142+0000","last_change":"2024-09-12T18:43:32.910786+0000","last_active":"2024-09-12T19:11:44.121142+0000","last_peered":"2024-09-12T19:11:44.121142+0000","last_clean":"2024-09-12T19:11:44.121142+0000","last_became_active":"2024-09-12T18:43:32.908692+0000","last_became_peered":"2024-09-12T18:43:32.908692+0000","last_unstale":"2024-09-12T19:11:44.121142+0000","last_undegraded":"2024-09-12T19:11:44.121142+0000","last_fullsized":"2024-09-12T19:11:44.121142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:46.037235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.940357+0000","last_change":"2024-09-12T18:43:29.883687+0000","last_active":"2024-09-12T19:11:43.940357+0000","last_peered":"2024-09-12T19:11:43.940357+0000","last_clean":"2024-09-12T19:11:43.940357+0000","last_became_active":"2024-09-12T18:43:29.882915+0000","last_became_peered":"2024-09-12T18:43:29.882915+0000","last_unstale":"2024-09-12T19:11:43.940357+0000","last_undegraded":"2024-09-12T19:11:43.940357+0000","last_fullsized":"2024-09-12T19:11:43.940357+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:04.141732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":15,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'74","reported_seq":245,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.930292+0000","last_change":"2024-09-12T18:41:45.352749+0000","last_active":"2024-09-12T19:11:03.930292+0000","last_peered":"2024-09-12T19:11:03.930292+0000","last_clean":"2024-09-12T19:11:03.930292+0000","last_became_active":"2024-09-12T18:41:45.351387+0000","last_became_peered":"2024-09-12T18:41:45.351387+0000","last_unstale":"2024-09-12T19:11:03.930292+0000","last_undegraded":"2024-09-12T19:11:03.930292+0000","last_fullsized":"2024-09-12T19:11:03.930292+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:09.964195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":261,"num_write":135,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:12.911671+0000","last_change":"2024-09-12T18:55:19.150286+0000","last_active":"2024-09-12T19:11:12.911671+0000","last_peered":"2024-09-12T19:11:12.911671+0000","last_clean":"2024-09-12T19:11:12.911671+0000","last_became_active":"2024-09-12T18:55:19.149666+0000","last_became_peered":"2024-09-12T18:55:19.149666+0000","last_unstale":"2024-09-12T19:11:12.911671+0000","last_undegraded":"2024-09-12T19:11:12.911671+0000","last_fullsized":"2024-09-12T19:11:12.911671+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:09.562684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'7","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.114111+0000","last_change":"2024-09-12T18:43:32.903834+0000","last_active":"2024-09-12T19:13:57.114111+0000","last_peered":"2024-09-12T19:13:57.114111+0000","last_clean":"2024-09-12T19:13:57.114111+0000","last_became_active":"2024-09-12T18:43:32.903112+0000","last_became_peered":"2024-09-12T18:43:32.903112+0000","last_unstale":"2024-09-12T19:13:57.114111+0000","last_undegraded":"2024-09-12T19:13:57.114111+0000","last_fullsized":"2024-09-12T19:13:57.114111+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:35.198794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.717849+0000","last_change":"2024-09-12T18:43:29.899798+0000","last_active":"2024-09-12T19:11:42.717849+0000","last_peered":"2024-09-12T19:11:42.717849+0000","last_clean":"2024-09-12T19:11:42.717849+0000","last_became_active":"2024-09-12T18:43:29.887725+0000","last_became_peered":"2024-09-12T18:43:29.887725+0000","last_unstale":"2024-09-12T19:11:42.717849+0000","last_undegraded":"2024-09-12T19:11:42.717849+0000","last_fullsized":"2024-09-12T19:11:42.717849+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:12.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.895985+0000","last_change":"2024-09-12T18:41:45.354403+0000","last_active":"2024-09-12T19:10:07.895985+0000","last_peered":"2024-09-12T19:10:07.895985+0000","last_clean":"2024-09-12T19:10:07.895985+0000","last_became_active":"2024-09-12T18:41:45.353582+0000","last_became_peered":"2024-09-12T18:41:45.353582+0000","last_unstale":"2024-09-12T19:10:07.895985+0000","last_undegraded":"2024-09-12T19:10:07.895985+0000","last_fullsized":"2024-09-12T19:10:07.895985+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:11.323313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910340+0000","last_change":"2024-09-12T18:55:19.147574+0000","last_active":"2024-09-12T19:11:07.910340+0000","last_peered":"2024-09-12T19:11:07.910340+0000","last_clean":"2024-09-12T19:11:07.910340+0000","last_became_active":"2024-09-12T18:55:19.146310+0000","last_became_peered":"2024-09-12T18:55:19.146310+0000","last_unstale":"2024-09-12T19:11:07.910340+0000","last_undegraded":"2024-09-12T19:11:07.910340+0000","last_fullsized":"2024-09-12T19:11:07.910340+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:20.681513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.909363+0000","last_change":"2024-09-12T18:43:32.922885+0000","last_active":"2024-09-12T19:10:32.909363+0000","last_peered":"2024-09-12T19:10:32.909363+0000","last_clean":"2024-09-12T19:10:32.909363+0000","last_became_active":"2024-09-12T18:43:32.922056+0000","last_became_peered":"2024-09-12T18:43:32.922056+0000","last_unstale":"2024-09-12T19:10:32.909363+0000","last_undegraded":"2024-09-12T19:10:32.909363+0000","last_fullsized":"2024-09-12T19:10:32.909363+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:30.503287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:38.908388+0000","last_change":"2024-09-12T18:43:29.886237+0000","last_active":"2024-09-12T19:09:38.908388+0000","last_peered":"2024-09-12T19:09:38.908388+0000","last_clean":"2024-09-12T19:09:38.908388+0000","last_became_active":"2024-09-12T18:43:29.885595+0000","last_became_peered":"2024-09-12T18:43:29.885595+0000","last_unstale":"2024-09-12T19:09:38.908388+0000","last_undegraded":"2024-09-12T19:09:38.908388+0000","last_fullsized":"2024-09-12T19:09:38.908388+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:41.139666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5492,"num_write":3,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'29","reported_seq":122,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.912167+0000","last_change":"2024-09-12T18:41:45.336015+0000","last_active":"2024-09-12T19:09:58.912167+0000","last_peered":"2024-09-12T19:09:58.912167+0000","last_clean":"2024-09-12T19:09:58.912167+0000","last_became_active":"2024-09-12T18:41:45.335258+0000","last_became_peered":"2024-09-12T18:41:45.335258+0000","last_unstale":"2024-09-12T19:09:58.912167+0000","last_undegraded":"2024-09-12T19:09:58.912167+0000","last_fullsized":"2024-09-12T19:09:58.912167+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:50.404611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":60,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.930417+0000","last_change":"2024-09-12T18:55:19.140934+0000","last_active":"2024-09-12T19:11:03.930417+0000","last_peered":"2024-09-12T19:11:03.930417+0000","last_clean":"2024-09-12T19:11:03.930417+0000","last_became_active":"2024-09-12T18:55:19.140247+0000","last_became_peered":"2024-09-12T18:55:19.140247+0000","last_unstale":"2024-09-12T19:11:03.930417+0000","last_undegraded":"2024-09-12T19:11:03.930417+0000","last_fullsized":"2024-09-12T19:11:03.930417+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:21.925405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'9","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:52.921169+0000","last_change":"2024-09-12T18:43:32.918976+0000","last_active":"2024-09-12T19:11:52.921169+0000","last_peered":"2024-09-12T19:11:52.921169+0000","last_clean":"2024-09-12T19:11:52.921169+0000","last_became_active":"2024-09-12T18:43:32.918077+0000","last_became_peered":"2024-09-12T18:43:32.918077+0000","last_unstale":"2024-09-12T19:11:52.921169+0000","last_undegraded":"2024-09-12T19:11:52.921169+0000","last_fullsized":"2024-09-12T19:11:52.921169+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.534577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:34.105965+0000","last_change":"2024-09-12T18:43:29.903733+0000","last_active":"2024-09-12T19:10:34.105965+0000","last_peered":"2024-09-12T19:10:34.105965+0000","last_clean":"2024-09-12T19:10:34.105965+0000","last_became_active":"2024-09-12T18:43:29.902444+0000","last_became_peered":"2024-09-12T18:43:29.902444+0000","last_unstale":"2024-09-12T19:10:34.105965+0000","last_undegraded":"2024-09-12T19:10:34.105965+0000","last_fullsized":"2024-09-12T19:10:34.105965+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:28.242386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'31","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.890560+0000","last_change":"2024-09-12T18:41:45.351143+0000","last_active":"2024-09-12T19:09:58.890560+0000","last_peered":"2024-09-12T19:09:58.890560+0000","last_clean":"2024-09-12T19:09:58.890560+0000","last_became_active":"2024-09-12T18:41:45.350344+0000","last_became_peered":"2024-09-12T18:41:45.350344+0000","last_unstale":"2024-09-12T19:09:58.890560+0000","last_undegraded":"2024-09-12T19:09:58.890560+0000","last_fullsized":"2024-09-12T19:09:58.890560+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:21.975925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":107,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:57.892779+0000","last_change":"2024-09-12T18:55:19.145504+0000","last_active":"2024-09-12T19:09:57.892779+0000","last_peered":"2024-09-12T19:09:57.892779+0000","last_clean":"2024-09-12T19:09:57.892779+0000","last_became_active":"2024-09-12T18:55:19.144778+0000","last_became_peered":"2024-09-12T18:55:19.144778+0000","last_unstale":"2024-09-12T19:09:57.892779+0000","last_undegraded":"2024-09-12T19:09:57.892779+0000","last_fullsized":"2024-09-12T19:09:57.892779+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:31.693075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:43.925140+0000","last_change":"2024-09-12T18:43:32.903502+0000","last_active":"2024-09-12T19:10:43.925140+0000","last_peered":"2024-09-12T19:10:43.925140+0000","last_clean":"2024-09-12T19:10:43.925140+0000","last_became_active":"2024-09-12T18:43:32.901790+0000","last_became_peered":"2024-09-12T18:43:32.901790+0000","last_unstale":"2024-09-12T19:10:43.925140+0000","last_undegraded":"2024-09-12T19:10:43.925140+0000","last_fullsized":"2024-09-12T19:10:43.925140+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:24.176553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903364+0000","last_change":"2024-09-12T18:43:29.890565+0000","last_active":"2024-09-12T19:10:37.903364+0000","last_peered":"2024-09-12T19:10:37.903364+0000","last_clean":"2024-09-12T19:10:37.903364+0000","last_became_active":"2024-09-12T18:43:29.889097+0000","last_became_peered":"2024-09-12T18:43:29.889097+0000","last_unstale":"2024-09-12T19:10:37.903364+0000","last_undegraded":"2024-09-12T19:10:37.903364+0000","last_fullsized":"2024-09-12T19:10:37.903364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:26.725295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.913527+0000","last_change":"2024-09-12T18:41:45.364829+0000","last_active":"2024-09-12T19:09:58.913527+0000","last_peered":"2024-09-12T19:09:58.913527+0000","last_clean":"2024-09-12T19:09:58.913527+0000","last_became_active":"2024-09-12T18:41:45.364055+0000","last_became_peered":"2024-09-12T18:41:45.364055+0000","last_unstale":"2024-09-12T19:09:58.913527+0000","last_undegraded":"2024-09-12T19:09:58.913527+0000","last_fullsized":"2024-09-12T19:09:58.913527+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:18.604878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.886937+0000","last_change":"2024-09-12T18:55:19.122707+0000","last_active":"2024-09-12T19:09:53.886937+0000","last_peered":"2024-09-12T19:09:53.886937+0000","last_clean":"2024-09-12T19:09:53.886937+0000","last_became_active":"2024-09-12T18:55:19.121805+0000","last_became_peered":"2024-09-12T18:55:19.121805+0000","last_unstale":"2024-09-12T19:09:53.886937+0000","last_undegraded":"2024-09-12T19:09:53.886937+0000","last_fullsized":"2024-09-12T19:09:53.886937+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:51.523106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'10","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.923737+0000","last_change":"2024-09-12T18:43:32.899098+0000","last_active":"2024-09-12T19:10:38.923737+0000","last_peered":"2024-09-12T19:10:38.923737+0000","last_clean":"2024-09-12T19:10:38.923737+0000","last_became_active":"2024-09-12T18:43:32.898379+0000","last_became_peered":"2024-09-12T18:43:32.898379+0000","last_unstale":"2024-09-12T19:10:38.923737+0000","last_undegraded":"2024-09-12T19:10:38.923737+0000","last_fullsized":"2024-09-12T19:10:38.923737+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:40.658854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":16388,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.886048+0000","last_change":"2024-09-12T18:43:29.897947+0000","last_active":"2024-09-12T19:10:38.886048+0000","last_peered":"2024-09-12T19:10:38.886048+0000","last_clean":"2024-09-12T19:10:38.886048+0000","last_became_active":"2024-09-12T18:43:29.897326+0000","last_became_peered":"2024-09-12T18:43:29.897326+0000","last_unstale":"2024-09-12T19:10:38.886048+0000","last_undegraded":"2024-09-12T19:10:38.886048+0000","last_fullsized":"2024-09-12T19:10:38.886048+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:49.647470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'31","reported_seq":129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.890721+0000","last_change":"2024-09-12T18:41:45.351648+0000","last_active":"2024-09-12T19:09:58.890721+0000","last_peered":"2024-09-12T19:09:58.890721+0000","last_clean":"2024-09-12T19:09:58.890721+0000","last_became_active":"2024-09-12T18:41:45.350900+0000","last_became_peered":"2024-09-12T18:41:45.350900+0000","last_unstale":"2024-09-12T19:09:58.890721+0000","last_undegraded":"2024-09-12T19:09:58.890721+0000","last_fullsized":"2024-09-12T19:09:58.890721+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:50.580663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":59,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715397+0000","last_change":"2024-09-12T18:55:19.123047+0000","last_active":"2024-09-12T19:11:32.715397+0000","last_peered":"2024-09-12T19:11:32.715397+0000","last_clean":"2024-09-12T19:11:32.715397+0000","last_became_active":"2024-09-12T18:55:19.122238+0000","last_became_peered":"2024-09-12T18:55:19.122238+0000","last_unstale":"2024-09-12T19:11:32.715397+0000","last_undegraded":"2024-09-12T19:11:32.715397+0000","last_fullsized":"2024-09-12T19:11:32.715397+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:01.481082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.918909+0000","last_change":"2024-09-12T18:43:32.914014+0000","last_active":"2024-09-12T19:11:42.918909+0000","last_peered":"2024-09-12T19:11:42.918909+0000","last_clean":"2024-09-12T19:11:42.918909+0000","last_became_active":"2024-09-12T18:43:32.913108+0000","last_became_peered":"2024-09-12T18:43:32.913108+0000","last_unstale":"2024-09-12T19:11:42.918909+0000","last_undegraded":"2024-09-12T19:11:42.918909+0000","last_fullsized":"2024-09-12T19:11:42.918909+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:00.617500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":15,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'8","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.910550+0000","last_change":"2024-09-12T18:43:29.878679+0000","last_active":"2024-09-12T19:11:38.910550+0000","last_peered":"2024-09-12T19:11:38.910550+0000","last_clean":"2024-09-12T19:11:38.910550+0000","last_became_active":"2024-09-12T18:43:29.877925+0000","last_became_peered":"2024-09-12T18:43:29.877925+0000","last_unstale":"2024-09-12T19:11:38.910550+0000","last_undegraded":"2024-09-12T19:11:38.910550+0000","last_fullsized":"2024-09-12T19:11:38.910550+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:25.553737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'135","reported_seq":472,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910405+0000","last_change":"2024-09-12T18:41:45.365909+0000","last_active":"2024-09-12T19:11:07.910405+0000","last_peered":"2024-09-12T19:11:07.910405+0000","last_clean":"2024-09-12T19:11:07.910405+0000","last_became_active":"2024-09-12T18:41:45.365175+0000","last_became_peered":"2024-09-12T18:41:45.365175+0000","last_unstale":"2024-09-12T19:11:07.910405+0000","last_undegraded":"2024-09-12T19:11:07.910405+0000","last_fullsized":"2024-09-12T19:11:07.910405+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:16.010188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":832,"num_read_kb":595,"num_write":177,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:54.096968+0000","last_change":"2024-09-12T18:55:19.130989+0000","last_active":"2024-09-12T19:09:54.096968+0000","last_peered":"2024-09-12T19:09:54.096968+0000","last_clean":"2024-09-12T19:09:54.096968+0000","last_became_active":"2024-09-12T18:55:19.130130+0000","last_became_peered":"2024-09-12T18:55:19.130130+0000","last_unstale":"2024-09-12T19:09:54.096968+0000","last_undegraded":"2024-09-12T19:09:54.096968+0000","last_fullsized":"2024-09-12T19:09:54.096968+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:36.507889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121479+0000","last_change":"2024-09-12T18:43:32.906004+0000","last_active":"2024-09-12T19:11:44.121479+0000","last_peered":"2024-09-12T19:11:44.121479+0000","last_clean":"2024-09-12T19:11:44.121479+0000","last_became_active":"2024-09-12T18:43:32.904789+0000","last_became_peered":"2024-09-12T18:43:32.904789+0000","last_unstale":"2024-09-12T19:11:44.121479+0000","last_undegraded":"2024-09-12T19:11:44.121479+0000","last_fullsized":"2024-09-12T19:11:44.121479+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:44.194875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.918932+0000","last_change":"2024-09-12T18:43:29.884688+0000","last_active":"2024-09-12T19:11:42.918932+0000","last_peered":"2024-09-12T19:11:42.918932+0000","last_clean":"2024-09-12T19:11:42.918932+0000","last_became_active":"2024-09-12T18:43:29.883790+0000","last_became_peered":"2024-09-12T18:43:29.883790+0000","last_unstale":"2024-09-12T19:11:42.918932+0000","last_undegraded":"2024-09-12T19:11:42.918932+0000","last_fullsized":"2024-09-12T19:11:42.918932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:58.821497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'6","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:57.915303+0000","last_change":"2024-09-12T18:41:45.358458+0000","last_active":"2024-09-12T19:10:57.915303+0000","last_peered":"2024-09-12T19:10:57.915303+0000","last_clean":"2024-09-12T19:10:57.915303+0000","last_became_active":"2024-09-12T18:41:45.357746+0000","last_became_peered":"2024-09-12T18:41:45.357746+0000","last_unstale":"2024-09-12T19:10:57.915303+0000","last_undegraded":"2024-09-12T19:10:57.915303+0000","last_fullsized":"2024-09-12T19:10:57.915303+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:16.491434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.883887+0000","last_change":"2024-09-12T18:55:19.140383+0000","last_active":"2024-09-12T19:10:28.883887+0000","last_peered":"2024-09-12T19:10:28.883887+0000","last_clean":"2024-09-12T19:10:28.883887+0000","last_became_active":"2024-09-12T18:55:19.139565+0000","last_became_peered":"2024-09-12T18:55:19.139565+0000","last_unstale":"2024-09-12T19:10:28.883887+0000","last_undegraded":"2024-09-12T19:10:28.883887+0000","last_fullsized":"2024-09-12T19:10:28.883887+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:46.784423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'1","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.910425+0000","last_change":"2024-09-12T18:43:32.906082+0000","last_active":"2024-09-12T19:10:37.910425+0000","last_peered":"2024-09-12T19:10:37.910425+0000","last_clean":"2024-09-12T19:10:37.910425+0000","last_became_active":"2024-09-12T18:43:32.904858+0000","last_became_peered":"2024-09-12T18:43:32.904858+0000","last_unstale":"2024-09-12T19:10:37.910425+0000","last_undegraded":"2024-09-12T19:10:37.910425+0000","last_fullsized":"2024-09-12T19:10:37.910425+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:58.276689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:42.947818+0000","last_change":"2024-09-12T18:43:29.890077+0000","last_active":"2024-09-12T19:13:42.947818+0000","last_peered":"2024-09-12T19:13:42.947818+0000","last_clean":"2024-09-12T19:13:42.947818+0000","last_became_active":"2024-09-12T18:43:29.889328+0000","last_became_peered":"2024-09-12T18:43:29.889328+0000","last_unstale":"2024-09-12T19:13:42.947818+0000","last_undegraded":"2024-09-12T19:13:42.947818+0000","last_fullsized":"2024-09-12T19:13:42.947818+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:20.098869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'8","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.901798+0000","last_change":"2024-09-12T18:41:45.354082+0000","last_active":"2024-09-12T19:10:58.901798+0000","last_peered":"2024-09-12T19:10:58.901798+0000","last_clean":"2024-09-12T19:10:58.901798+0000","last_became_active":"2024-09-12T18:41:45.353369+0000","last_became_peered":"2024-09-12T18:41:45.353369+0000","last_unstale":"2024-09-12T19:10:58.901798+0000","last_undegraded":"2024-09-12T19:10:58.901798+0000","last_fullsized":"2024-09-12T19:10:58.901798+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:49.982690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.921223+0000","last_change":"2024-09-12T18:55:19.116656+0000","last_active":"2024-09-12T19:10:28.921223+0000","last_peered":"2024-09-12T19:10:28.921223+0000","last_clean":"2024-09-12T19:10:28.921223+0000","last_became_active":"2024-09-12T18:55:19.115920+0000","last_became_peered":"2024-09-12T18:55:19.115920+0000","last_unstale":"2024-09-12T19:10:28.921223+0000","last_undegraded":"2024-09-12T19:10:28.921223+0000","last_fullsized":"2024-09-12T19:10:28.921223+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:54.225077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.911420+0000","last_change":"2024-09-12T18:43:32.914128+0000","last_active":"2024-09-12T19:11:43.911420+0000","last_peered":"2024-09-12T19:11:43.911420+0000","last_clean":"2024-09-12T19:11:43.911420+0000","last_became_active":"2024-09-12T18:43:32.913259+0000","last_became_peered":"2024-09-12T18:43:32.913259+0000","last_unstale":"2024-09-12T19:11:43.911420+0000","last_undegraded":"2024-09-12T19:11:43.911420+0000","last_fullsized":"2024-09-12T19:11:43.911420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:08.421749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903278+0000","last_change":"2024-09-12T18:43:29.883036+0000","last_active":"2024-09-12T19:10:37.903278+0000","last_peered":"2024-09-12T19:10:37.903278+0000","last_clean":"2024-09-12T19:10:37.903278+0000","last_became_active":"2024-09-12T18:43:29.882039+0000","last_became_peered":"2024-09-12T18:43:29.882039+0000","last_unstale":"2024-09-12T19:10:37.903278+0000","last_undegraded":"2024-09-12T19:10:37.903278+0000","last_fullsized":"2024-09-12T19:10:37.903278+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:20.442914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'181","reported_seq":586,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:59.111456+0000","last_change":"2024-09-12T18:41:45.354928+0000","last_active":"2024-09-12T19:10:59.111456+0000","last_peered":"2024-09-12T19:10:59.111456+0000","last_clean":"2024-09-12T19:10:59.111456+0000","last_became_active":"2024-09-12T18:41:45.354142+0000","last_became_peered":"2024-09-12T18:41:45.354142+0000","last_unstale":"2024-09-12T19:10:59.111456+0000","last_undegraded":"2024-09-12T19:10:59.111456+0000","last_fullsized":"2024-09-12T19:10:59.111456+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:57.126086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":838,"num_write":233,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.912268+0000","last_change":"2024-09-12T18:55:19.143090+0000","last_active":"2024-09-12T19:09:53.912268+0000","last_peered":"2024-09-12T19:09:53.912268+0000","last_clean":"2024-09-12T19:09:53.912268+0000","last_became_active":"2024-09-12T18:55:19.142412+0000","last_became_peered":"2024-09-12T18:55:19.142412+0000","last_unstale":"2024-09-12T19:09:53.912268+0000","last_undegraded":"2024-09-12T19:09:53.912268+0000","last_fullsized":"2024-09-12T19:09:53.912268+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.561947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'4","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.900143+0000","last_change":"2024-09-12T18:43:32.939711+0000","last_active":"2024-09-12T19:10:38.900143+0000","last_peered":"2024-09-12T19:10:38.900143+0000","last_clean":"2024-09-12T19:10:38.900143+0000","last_became_active":"2024-09-12T18:43:32.939024+0000","last_became_peered":"2024-09-12T18:43:32.939024+0000","last_unstale":"2024-09-12T19:10:38.900143+0000","last_undegraded":"2024-09-12T19:10:38.900143+0000","last_fullsized":"2024-09-12T19:10:38.900143+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:08.177317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:42.732247+0000","last_change":"2024-09-12T18:43:29.900783+0000","last_active":"2024-09-12T19:12:42.732247+0000","last_peered":"2024-09-12T19:12:42.732247+0000","last_clean":"2024-09-12T19:12:42.732247+0000","last_became_active":"2024-09-12T18:43:29.892060+0000","last_became_peered":"2024-09-12T18:43:29.892060+0000","last_unstale":"2024-09-12T19:12:42.732247+0000","last_undegraded":"2024-09-12T19:12:42.732247+0000","last_fullsized":"2024-09-12T19:12:42.732247+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:21.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'50","reported_seq":183,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:20.845700+0000","last_change":"2024-09-12T18:41:45.356560+0000","last_active":"2024-09-12T19:11:20.845700+0000","last_peered":"2024-09-12T19:11:20.845700+0000","last_clean":"2024-09-12T19:11:20.845700+0000","last_became_active":"2024-09-12T18:41:45.355840+0000","last_became_peered":"2024-09-12T18:41:45.355840+0000","last_unstale":"2024-09-12T19:11:20.845700+0000","last_undegraded":"2024-09-12T19:11:20.845700+0000","last_fullsized":"2024-09-12T19:11:20.845700+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:22.223128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":177,"num_write":88,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:02.894254+0000","last_change":"2024-09-12T18:55:19.156335+0000","last_active":"2024-09-12T19:10:02.894254+0000","last_peered":"2024-09-12T19:10:02.894254+0000","last_clean":"2024-09-12T19:10:02.894254+0000","last_became_active":"2024-09-12T18:55:19.155684+0000","last_became_peered":"2024-09-12T18:55:19.155684+0000","last_unstale":"2024-09-12T19:10:02.894254+0000","last_undegraded":"2024-09-12T19:10:02.894254+0000","last_fullsized":"2024-09-12T19:10:02.894254+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:14.458956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:39.107010+0000","last_change":"2024-09-12T18:43:32.905624+0000","last_active":"2024-09-12T19:10:39.107010+0000","last_peered":"2024-09-12T19:10:39.107010+0000","last_clean":"2024-09-12T19:10:39.107010+0000","last_became_active":"2024-09-12T18:43:32.903273+0000","last_became_peered":"2024-09-12T18:43:32.903273+0000","last_unstale":"2024-09-12T19:10:39.107010+0000","last_undegraded":"2024-09-12T19:10:39.107010+0000","last_fullsized":"2024-09-12T19:10:39.107010+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:48.885568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.900184+0000","last_change":"2024-09-12T18:43:29.868919+0000","last_active":"2024-09-12T19:10:38.900184+0000","last_peered":"2024-09-12T19:10:38.900184+0000","last_clean":"2024-09-12T19:10:38.900184+0000","last_became_active":"2024-09-12T18:43:29.865413+0000","last_became_peered":"2024-09-12T18:43:29.865413+0000","last_unstale":"2024-09-12T19:10:38.900184+0000","last_undegraded":"2024-09-12T19:10:38.900184+0000","last_fullsized":"2024-09-12T19:10:38.900184+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:35.628916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'25","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:57.922311+0000","last_change":"2024-09-12T18:41:45.363243+0000","last_active":"2024-09-12T19:11:57.922311+0000","last_peered":"2024-09-12T19:11:57.922311+0000","last_clean":"2024-09-12T19:11:57.922311+0000","last_became_active":"2024-09-12T18:41:45.362445+0000","last_became_peered":"2024-09-12T18:41:45.362445+0000","last_unstale":"2024-09-12T19:11:57.922311+0000","last_undegraded":"2024-09-12T19:11:57.922311+0000","last_fullsized":"2024-09-12T19:11:57.922311+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:57.818173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'288","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.929745+0000","last_change":"2024-09-12T18:26:39.874259+0000","last_active":"2024-09-12T19:13:57.929745+0000","last_peered":"2024-09-12T19:13:57.929745+0000","last_clean":"2024-09-12T19:13:57.929745+0000","last_became_active":"2024-09-12T18:26:39.872863+0000","last_became_peered":"2024-09-12T18:26:39.872863+0000","last_unstale":"2024-09-12T19:13:57.929745+0000","last_undegraded":"2024-09-12T19:13:57.929745+0000","last_fullsized":"2024-09-12T19:13:57.929745+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:12.641934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66222,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":381,"num_read_kb":8018,"num_write":922,"num_write_kb":33098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'548","reported_seq":2200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.104685+0000","last_change":"2024-09-12T18:26:41.881378+0000","last_active":"2024-09-12T19:12:24.104685+0000","last_peered":"2024-09-12T19:12:24.104685+0000","last_clean":"2024-09-12T19:12:24.104685+0000","last_became_active":"2024-09-12T18:26:41.879711+0000","last_became_peered":"2024-09-12T18:26:41.879711+0000","last_unstale":"2024-09-12T19:12:24.104685+0000","last_undegraded":"2024-09-12T19:12:24.104685+0000","last_fullsized":"2024-09-12T19:12:24.104685+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:43.105556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2944,"num_read_kb":2757,"num_write":660,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'326","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.689223+0000","last_change":"2024-09-12T18:26:39.837876+0000","last_active":"2024-09-12T19:13:57.689223+0000","last_peered":"2024-09-12T19:13:57.689223+0000","last_clean":"2024-09-12T19:13:57.689223+0000","last_became_active":"2024-09-12T18:26:39.837462+0000","last_became_peered":"2024-09-12T18:26:39.837462+0000","last_unstale":"2024-09-12T19:13:57.689223+0000","last_undegraded":"2024-09-12T19:13:57.689223+0000","last_fullsized":"2024-09-12T19:13:57.689223+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:16.597331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10511461,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":519,"num_read_kb":60596,"num_write":1071,"num_write_kb":26482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'832","reported_seq":2227,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.108683+0000","last_change":"2024-09-12T18:26:41.864753+0000","last_active":"2024-09-12T19:12:24.108683+0000","last_peered":"2024-09-12T19:12:24.108683+0000","last_clean":"2024-09-12T19:12:24.108683+0000","last_became_active":"2024-09-12T18:26:41.863835+0000","last_became_peered":"2024-09-12T18:26:41.863835+0000","last_unstale":"2024-09-12T19:12:24.108683+0000","last_undegraded":"2024-09-12T19:12:24.108683+0000","last_fullsized":"2024-09-12T19:12:24.108683+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:50.300481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3830,"num_read_kb":3409,"num_write":1134,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'304","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:33.953361+0000","last_change":"2024-09-12T18:26:39.831857+0000","last_active":"2024-09-12T19:12:33.953361+0000","last_peered":"2024-09-12T19:12:33.953361+0000","last_clean":"2024-09-12T19:12:33.953361+0000","last_became_active":"2024-09-12T18:26:39.831522+0000","last_became_peered":"2024-09-12T18:26:39.831522+0000","last_unstale":"2024-09-12T19:12:33.953361+0000","last_undegraded":"2024-09-12T19:12:33.953361+0000","last_fullsized":"2024-09-12T19:12:33.953361+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:44.938137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5739976,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":568,"num_read_kb":27262,"num_write":1100,"num_write_kb":30891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'361","reported_seq":1822,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.752145+0000","last_change":"2024-09-12T18:26:41.850866+0000","last_active":"2024-09-12T19:12:08.752145+0000","last_peered":"2024-09-12T19:12:08.752145+0000","last_clean":"2024-09-12T19:12:08.752145+0000","last_became_active":"2024-09-12T18:26:41.850001+0000","last_became_peered":"2024-09-12T18:26:41.850001+0000","last_unstale":"2024-09-12T19:12:08.752145+0000","last_undegraded":"2024-09-12T19:12:08.752145+0000","last_fullsized":"2024-09-12T19:12:08.752145+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:23.483403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2076,"num_read_kb":1992,"num_write":405,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'283","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:20.476261+0000","last_change":"2024-09-12T18:27:11.825105+0000","last_active":"2024-09-12T19:11:20.476261+0000","last_peered":"2024-09-12T19:11:20.476261+0000","last_clean":"2024-09-12T19:11:20.476261+0000","last_became_active":"2024-09-12T18:27:11.824331+0000","last_became_peered":"2024-09-12T18:27:11.824331+0000","last_unstale":"2024-09-12T19:11:20.476261+0000","last_undegraded":"2024-09-12T19:11:20.476261+0000","last_fullsized":"2024-09-12T19:11:20.476261+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:59.462165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5516773,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":421,"num_read_kb":38329,"num_write":1023,"num_write_kb":37388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'500","reported_seq":2054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.541136+0000","last_change":"2024-09-12T18:26:41.851231+0000","last_active":"2024-09-12T19:12:09.541136+0000","last_peered":"2024-09-12T19:12:09.541136+0000","last_clean":"2024-09-12T19:12:09.541136+0000","last_became_active":"2024-09-12T18:26:41.850866+0000","last_became_peered":"2024-09-12T18:26:41.850866+0000","last_unstale":"2024-09-12T19:12:09.541136+0000","last_undegraded":"2024-09-12T19:12:09.541136+0000","last_fullsized":"2024-09-12T19:12:09.541136+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:49.632192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2664,"num_read_kb":2487,"num_write":637,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'340","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.941984+0000","last_change":"2024-09-12T18:26:39.871051+0000","last_active":"2024-09-12T19:13:57.941984+0000","last_peered":"2024-09-12T19:13:57.941984+0000","last_clean":"2024-09-12T19:13:57.941984+0000","last_became_active":"2024-09-12T18:26:39.870272+0000","last_became_peered":"2024-09-12T18:26:39.870272+0000","last_unstale":"2024-09-12T19:13:57.941984+0000","last_undegraded":"2024-09-12T19:13:57.941984+0000","last_fullsized":"2024-09-12T19:13:57.941984+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:26.496206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4440945,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":742,"num_read_kb":17788,"num_write":1144,"num_write_kb":36512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'543","reported_seq":1968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.557048+0000","last_change":"2024-09-12T18:26:41.869564+0000","last_active":"2024-09-12T19:12:09.557048+0000","last_peered":"2024-09-12T19:12:09.557048+0000","last_clean":"2024-09-12T19:12:09.557048+0000","last_became_active":"2024-09-12T18:26:41.865288+0000","last_became_peered":"2024-09-12T18:26:41.865288+0000","last_unstale":"2024-09-12T19:12:09.557048+0000","last_undegraded":"2024-09-12T19:12:09.557048+0000","last_fullsized":"2024-09-12T19:12:09.557048+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:04.903221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2721,"num_read_kb":2571,"num_write":759,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'270","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:39.387927+0000","last_change":"2024-09-12T18:26:39.851993+0000","last_active":"2024-09-12T19:11:39.387927+0000","last_peered":"2024-09-12T19:11:39.387927+0000","last_clean":"2024-09-12T19:11:39.387927+0000","last_became_active":"2024-09-12T18:26:39.851253+0000","last_became_peered":"2024-09-12T18:26:39.851253+0000","last_unstale":"2024-09-12T19:11:39.387927+0000","last_undegraded":"2024-09-12T19:11:39.387927+0000","last_fullsized":"2024-09-12T19:11:39.387927+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:26.300087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1927120,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":405,"num_read_kb":31766,"num_write":1044,"num_write_kb":25425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'807","reported_seq":2339,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.105771+0000","last_change":"2024-09-12T18:26:41.852562+0000","last_active":"2024-09-12T19:13:43.105771+0000","last_peered":"2024-09-12T19:13:43.105771+0000","last_clean":"2024-09-12T19:13:43.105771+0000","last_became_active":"2024-09-12T18:26:41.851811+0000","last_became_peered":"2024-09-12T18:26:41.851811+0000","last_unstale":"2024-09-12T19:13:43.105771+0000","last_undegraded":"2024-09-12T19:13:43.105771+0000","last_fullsized":"2024-09-12T19:13:43.105771+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:07.152668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3792,"num_read_kb":3404,"num_write":1072,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'333","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.934666+0000","last_change":"2024-09-12T18:26:39.862363+0000","last_active":"2024-09-12T19:13:57.934666+0000","last_peered":"2024-09-12T19:13:57.934666+0000","last_clean":"2024-09-12T19:13:57.934666+0000","last_became_active":"2024-09-12T18:26:39.861529+0000","last_became_peered":"2024-09-12T18:26:39.861529+0000","last_unstale":"2024-09-12T19:13:57.934666+0000","last_undegraded":"2024-09-12T19:13:57.934666+0000","last_fullsized":"2024-09-12T19:13:57.934666+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:22.532453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454843,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":487,"num_read_kb":30234,"num_write":1136,"num_write_kb":47172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'698","reported_seq":2314,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.291262+0000","last_change":"2024-09-12T18:26:41.880160+0000","last_active":"2024-09-12T19:12:23.291262+0000","last_peered":"2024-09-12T19:12:23.291262+0000","last_clean":"2024-09-12T19:12:23.291262+0000","last_became_active":"2024-09-12T18:26:41.878820+0000","last_became_peered":"2024-09-12T18:26:41.878820+0000","last_unstale":"2024-09-12T19:12:23.291262+0000","last_undegraded":"2024-09-12T19:12:23.291262+0000","last_fullsized":"2024-09-12T19:12:23.291262+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:28.637107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3429,"num_read_kb":3073,"num_write":944,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'287","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.471552+0000","last_change":"2024-09-12T18:27:11.824834+0000","last_active":"2024-09-12T19:12:01.471552+0000","last_peered":"2024-09-12T19:12:01.471552+0000","last_clean":"2024-09-12T19:12:01.471552+0000","last_became_active":"2024-09-12T18:27:11.824008+0000","last_became_peered":"2024-09-12T18:27:11.824008+0000","last_unstale":"2024-09-12T19:12:01.471552+0000","last_undegraded":"2024-09-12T19:12:01.471552+0000","last_fullsized":"2024-09-12T19:12:01.471552+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:37.834927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11535097,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":579,"num_read_kb":10155,"num_write":1074,"num_write_kb":30763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'673","reported_seq":2284,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.623890+0000","last_change":"2024-09-12T18:26:41.854820+0000","last_active":"2024-09-12T19:12:18.623890+0000","last_peered":"2024-09-12T19:12:18.623890+0000","last_clean":"2024-09-12T19:12:18.623890+0000","last_became_active":"2024-09-12T18:26:41.854487+0000","last_became_peered":"2024-09-12T18:26:41.854487+0000","last_unstale":"2024-09-12T19:12:18.623890+0000","last_undegraded":"2024-09-12T19:12:18.623890+0000","last_fullsized":"2024-09-12T19:12:18.623890+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:55.693388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3483,"num_read_kb":3149,"num_write":934,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'460","reported_seq":2065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.554629+0000","last_change":"2024-09-12T18:26:41.845783+0000","last_active":"2024-09-12T19:12:09.554629+0000","last_peered":"2024-09-12T19:12:09.554629+0000","last_clean":"2024-09-12T19:12:09.554629+0000","last_became_active":"2024-09-12T18:26:41.845080+0000","last_became_peered":"2024-09-12T18:26:41.845080+0000","last_unstale":"2024-09-12T19:12:09.554629+0000","last_undegraded":"2024-09-12T19:12:09.554629+0000","last_fullsized":"2024-09-12T19:12:09.554629+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:41.747464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2421,"num_read_kb":2289,"num_write":534,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'343","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.919407+0000","last_change":"2024-09-12T18:26:39.874340+0000","last_active":"2024-09-12T19:13:57.919407+0000","last_peered":"2024-09-12T19:13:57.919407+0000","last_clean":"2024-09-12T19:13:57.919407+0000","last_became_active":"2024-09-12T18:26:39.872936+0000","last_became_peered":"2024-09-12T18:26:39.872936+0000","last_unstale":"2024-09-12T19:13:57.919407+0000","last_undegraded":"2024-09-12T19:13:57.919407+0000","last_fullsized":"2024-09-12T19:13:57.919407+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:52.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5293439,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":480,"num_read_kb":24957,"num_write":1219,"num_write_kb":33279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'559","reported_seq":2173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.208544+0000","last_change":"2024-09-12T18:26:41.874471+0000","last_active":"2024-09-12T19:11:58.208544+0000","last_peered":"2024-09-12T19:11:58.208544+0000","last_clean":"2024-09-12T19:11:58.208544+0000","last_became_active":"2024-09-12T18:26:41.865247+0000","last_became_peered":"2024-09-12T18:26:41.865247+0000","last_unstale":"2024-09-12T19:11:58.208544+0000","last_undegraded":"2024-09-12T19:11:58.208544+0000","last_fullsized":"2024-09-12T19:11:58.208544+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:35.308473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2931,"num_read_kb":2718,"num_write":721,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'342","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.894850+0000","last_change":"2024-09-12T18:26:39.859661+0000","last_active":"2024-09-12T19:10:13.894850+0000","last_peered":"2024-09-12T19:10:13.894850+0000","last_clean":"2024-09-12T19:10:13.894850+0000","last_became_active":"2024-09-12T18:26:39.858964+0000","last_became_peered":"2024-09-12T18:26:39.858964+0000","last_unstale":"2024-09-12T19:10:13.894850+0000","last_undegraded":"2024-09-12T19:10:13.894850+0000","last_fullsized":"2024-09-12T19:10:13.894850+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:12.307545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9762525,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":749,"num_read_kb":25615,"num_write":1258,"num_write_kb":27961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'826","reported_seq":2309,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.128247+0000","last_change":"2024-09-12T18:26:41.862769+0000","last_active":"2024-09-12T19:12:24.128247+0000","last_peered":"2024-09-12T19:12:24.128247+0000","last_clean":"2024-09-12T19:12:24.128247+0000","last_became_active":"2024-09-12T18:26:41.861762+0000","last_became_peered":"2024-09-12T18:26:41.861762+0000","last_unstale":"2024-09-12T19:12:24.128247+0000","last_undegraded":"2024-09-12T19:12:24.128247+0000","last_fullsized":"2024-09-12T19:12:24.128247+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:57.802438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3868,"num_read_kb":3443,"num_write":1111,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'322","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:19.878185+0000","last_change":"2024-09-12T18:26:39.857559+0000","last_active":"2024-09-12T19:12:19.878185+0000","last_peered":"2024-09-12T19:12:19.878185+0000","last_clean":"2024-09-12T19:12:19.878185+0000","last_became_active":"2024-09-12T18:26:39.856700+0000","last_became_peered":"2024-09-12T18:26:39.856700+0000","last_unstale":"2024-09-12T19:12:19.878185+0000","last_undegraded":"2024-09-12T19:12:19.878185+0000","last_fullsized":"2024-09-12T19:12:19.878185+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:32.134581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10390340,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":516,"num_read_kb":29092,"num_write":1175,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'408","reported_seq":1973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.624204+0000","last_change":"2024-09-12T18:26:41.855114+0000","last_active":"2024-09-12T19:12:18.624204+0000","last_peered":"2024-09-12T19:12:18.624204+0000","last_clean":"2024-09-12T19:12:18.624204+0000","last_became_active":"2024-09-12T18:26:41.854687+0000","last_became_peered":"2024-09-12T18:26:41.854687+0000","last_unstale":"2024-09-12T19:12:18.624204+0000","last_undegraded":"2024-09-12T19:12:18.624204+0000","last_fullsized":"2024-09-12T19:12:18.624204+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:38.397431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2203,"num_read_kb":2114,"num_write":459,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'246","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.538284+0000","last_change":"2024-09-12T18:26:39.846009+0000","last_active":"2024-09-12T19:12:01.538284+0000","last_peered":"2024-09-12T19:12:01.538284+0000","last_clean":"2024-09-12T19:12:01.538284+0000","last_became_active":"2024-09-12T18:26:39.845295+0000","last_became_peered":"2024-09-12T18:26:39.845295+0000","last_unstale":"2024-09-12T19:12:01.538284+0000","last_undegraded":"2024-09-12T19:12:01.538284+0000","last_fullsized":"2024-09-12T19:12:01.538284+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:17.674520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12175535,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":604,"num_read_kb":23311,"num_write":911,"num_write_kb":25673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'818","reported_seq":2465,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.289955+0000","last_change":"2024-09-12T18:26:41.856646+0000","last_active":"2024-09-12T19:12:23.289955+0000","last_peered":"2024-09-12T19:12:23.289955+0000","last_clean":"2024-09-12T19:12:23.289955+0000","last_became_active":"2024-09-12T18:26:41.856280+0000","last_became_peered":"2024-09-12T18:26:41.856280+0000","last_unstale":"2024-09-12T19:12:23.289955+0000","last_undegraded":"2024-09-12T19:12:23.289955+0000","last_fullsized":"2024-09-12T19:12:23.289955+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:36.396273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4038,"num_read_kb":3655,"num_write":1078,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'333","reported_seq":1026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.702513+0000","last_change":"2024-09-12T18:26:39.842574+0000","last_active":"2024-09-12T19:11:59.702513+0000","last_peered":"2024-09-12T19:11:59.702513+0000","last_clean":"2024-09-12T19:11:59.702513+0000","last_became_active":"2024-09-12T18:26:39.842159+0000","last_became_peered":"2024-09-12T18:26:39.842159+0000","last_unstale":"2024-09-12T19:11:59.702513+0000","last_undegraded":"2024-09-12T19:11:59.702513+0000","last_fullsized":"2024-09-12T19:11:59.702513+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:57.097188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19243142,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":545,"num_read_kb":58099,"num_write":1193,"num_write_kb":62462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'845","reported_seq":2432,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.108397+0000","last_change":"2024-09-12T18:26:41.854196+0000","last_active":"2024-09-12T19:13:43.108397+0000","last_peered":"2024-09-12T19:13:43.108397+0000","last_clean":"2024-09-12T19:13:43.108397+0000","last_became_active":"2024-09-12T18:26:41.853403+0000","last_became_peered":"2024-09-12T18:26:41.853403+0000","last_unstale":"2024-09-12T19:13:43.108397+0000","last_undegraded":"2024-09-12T19:13:43.108397+0000","last_fullsized":"2024-09-12T19:13:43.108397+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:23.475163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3981,"num_read_kb":3579,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'355","reported_seq":1064,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:13.933191+0000","last_change":"2024-09-12T18:26:39.834464+0000","last_active":"2024-09-12T19:11:13.933191+0000","last_peered":"2024-09-12T19:11:13.933191+0000","last_clean":"2024-09-12T19:11:13.933191+0000","last_became_active":"2024-09-12T18:26:39.834006+0000","last_became_peered":"2024-09-12T18:26:39.834006+0000","last_unstale":"2024-09-12T19:11:13.933191+0000","last_undegraded":"2024-09-12T19:11:13.933191+0000","last_fullsized":"2024-09-12T19:11:13.933191+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:58.733603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3329482,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":670,"num_read_kb":82742,"num_write":1276,"num_write_kb":55909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'115","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.220116+0000","last_change":"2024-09-12T18:26:49.907310+0000","last_active":"2024-09-12T19:12:24.220116+0000","last_peered":"2024-09-12T19:12:24.220116+0000","last_clean":"2024-09-12T19:12:24.220116+0000","last_became_active":"2024-09-12T18:26:49.906589+0000","last_became_peered":"2024-09-12T18:26:49.906589+0000","last_unstale":"2024-09-12T19:12:24.220116+0000","last_undegraded":"2024-09-12T19:12:24.220116+0000","last_fullsized":"2024-09-12T19:12:24.220116+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:14.519874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":280,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'752","reported_seq":2162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.190816+0000","last_change":"2024-09-12T18:26:41.853179+0000","last_active":"2024-09-12T19:11:59.190816+0000","last_peered":"2024-09-12T19:11:59.190816+0000","last_clean":"2024-09-12T19:11:59.190816+0000","last_became_active":"2024-09-12T18:26:41.852831+0000","last_became_peered":"2024-09-12T18:26:41.852831+0000","last_unstale":"2024-09-12T19:11:59.190816+0000","last_undegraded":"2024-09-12T19:11:59.190816+0000","last_fullsized":"2024-09-12T19:11:59.190816+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:22.488493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3501,"num_read_kb":3138,"num_write":986,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'361","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.871106+0000","last_change":"2024-09-12T18:27:11.824441+0000","last_active":"2024-09-12T19:13:57.871106+0000","last_peered":"2024-09-12T19:13:57.871106+0000","last_clean":"2024-09-12T19:13:57.871106+0000","last_became_active":"2024-09-12T18:27:11.823705+0000","last_became_peered":"2024-09-12T18:27:11.823705+0000","last_unstale":"2024-09-12T19:13:57.871106+0000","last_undegraded":"2024-09-12T19:13:57.871106+0000","last_fullsized":"2024-09-12T19:13:57.871106+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:16.557071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221836,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":562,"num_read_kb":55935,"num_write":1231,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.891991+0000","last_change":"2024-09-12T18:26:43.859139+0000","last_active":"2024-09-12T19:10:13.891991+0000","last_peered":"2024-09-12T19:10:13.891991+0000","last_clean":"2024-09-12T19:10:13.891991+0000","last_became_active":"2024-09-12T18:26:43.857754+0000","last_became_peered":"2024-09-12T18:26:43.857754+0000","last_unstale":"2024-09-12T19:10:13.891991+0000","last_undegraded":"2024-09-12T19:10:13.891991+0000","last_fullsized":"2024-09-12T19:10:13.891991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:44.851162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'312","reported_seq":910,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.955980+0000","last_change":"2024-09-12T18:26:45.876845+0000","last_active":"2024-09-12T19:12:43.955980+0000","last_peered":"2024-09-12T19:12:43.955980+0000","last_clean":"2024-09-12T19:12:43.955980+0000","last_became_active":"2024-09-12T18:26:45.876070+0000","last_became_peered":"2024-09-12T18:26:45.876070+0000","last_unstale":"2024-09-12T19:12:43.955980+0000","last_undegraded":"2024-09-12T19:12:43.955980+0000","last_fullsized":"2024-09-12T19:12:43.955980+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:22.272564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58716,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":955,"num_write":404,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:17.898757+0000","last_change":"2024-09-12T18:26:47.896202+0000","last_active":"2024-09-12T19:10:17.898757+0000","last_peered":"2024-09-12T19:10:17.898757+0000","last_clean":"2024-09-12T19:10:17.898757+0000","last_became_active":"2024-09-12T18:26:47.895471+0000","last_became_peered":"2024-09-12T18:26:47.895471+0000","last_unstale":"2024-09-12T19:10:17.898757+0000","last_undegraded":"2024-09-12T19:10:17.898757+0000","last_fullsized":"2024-09-12T19:10:17.898757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:33.203860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'2440","reported_seq":4321,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.300739+0000","last_change":"2024-09-12T18:26:49.913977+0000","last_active":"2024-09-12T19:12:21.300739+0000","last_peered":"2024-09-12T19:12:21.300739+0000","last_clean":"2024-09-12T19:12:21.300739+0000","last_became_active":"2024-09-12T18:26:49.913125+0000","last_became_peered":"2024-09-12T18:26:49.913125+0000","last_unstale":"2024-09-12T19:12:21.300739+0000","last_undegraded":"2024-09-12T19:12:21.300739+0000","last_fullsized":"2024-09-12T19:12:21.300739+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":2400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:14.099069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6085,"num_read_kb":6089,"num_write":4865,"num_write_kb":1791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'567","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:02.090617+0000","last_change":"2024-09-12T18:26:41.872673+0000","last_active":"2024-09-12T19:12:02.090617+0000","last_peered":"2024-09-12T19:12:02.090617+0000","last_clean":"2024-09-12T19:12:02.090617+0000","last_became_active":"2024-09-12T18:26:41.871531+0000","last_became_peered":"2024-09-12T18:26:41.871531+0000","last_unstale":"2024-09-12T19:12:02.090617+0000","last_undegraded":"2024-09-12T19:12:02.090617+0000","last_fullsized":"2024-09-12T19:12:02.090617+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:58.936555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2964,"num_read_kb":2726,"num_write":725,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'299","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:56.120289+0000","last_change":"2024-09-12T18:26:39.872043+0000","last_active":"2024-09-12T19:11:56.120289+0000","last_peered":"2024-09-12T19:11:56.120289+0000","last_clean":"2024-09-12T19:11:56.120289+0000","last_became_active":"2024-09-12T18:26:39.871605+0000","last_became_peered":"2024-09-12T18:26:39.871605+0000","last_unstale":"2024-09-12T19:11:56.120289+0000","last_undegraded":"2024-09-12T19:11:56.120289+0000","last_fullsized":"2024-09-12T19:11:56.120289+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:34.631521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5057800,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":511,"num_read_kb":33405,"num_write":1134,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.930194+0000","last_change":"2024-09-12T18:26:43.866305+0000","last_active":"2024-09-12T19:11:08.930194+0000","last_peered":"2024-09-12T19:11:08.930194+0000","last_clean":"2024-09-12T19:11:08.930194+0000","last_became_active":"2024-09-12T18:26:43.865817+0000","last_became_peered":"2024-09-12T18:26:43.865817+0000","last_unstale":"2024-09-12T19:11:08.930194+0000","last_undegraded":"2024-09-12T19:11:08.930194+0000","last_fullsized":"2024-09-12T19:11:08.930194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:44.351205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'75","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:11.668505+0000","last_change":"2024-09-12T18:26:45.854845+0000","last_active":"2024-09-12T19:11:11.668505+0000","last_peered":"2024-09-12T19:11:11.668505+0000","last_clean":"2024-09-12T19:11:11.668505+0000","last_became_active":"2024-09-12T18:26:45.854087+0000","last_became_peered":"2024-09-12T18:26:45.854087+0000","last_unstale":"2024-09-12T19:11:11.668505+0000","last_undegraded":"2024-09-12T19:11:11.668505+0000","last_fullsized":"2024-09-12T19:11:11.668505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:33.838948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:19.102590+0000","last_change":"2024-09-12T18:26:47.881155+0000","last_active":"2024-09-12T19:10:19.102590+0000","last_peered":"2024-09-12T19:10:19.102590+0000","last_clean":"2024-09-12T19:10:19.102590+0000","last_became_active":"2024-09-12T18:26:47.880374+0000","last_became_peered":"2024-09-12T18:26:47.880374+0000","last_unstale":"2024-09-12T19:10:19.102590+0000","last_undegraded":"2024-09-12T19:10:19.102590+0000","last_fullsized":"2024-09-12T19:10:19.102590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:15.543833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'120","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.174257+0000","last_change":"2024-09-12T18:26:49.927396+0000","last_active":"2024-09-12T19:11:59.174257+0000","last_peered":"2024-09-12T19:11:59.174257+0000","last_clean":"2024-09-12T19:11:59.174257+0000","last_became_active":"2024-09-12T18:26:49.926650+0000","last_became_peered":"2024-09-12T18:26:49.926650+0000","last_unstale":"2024-09-12T19:11:59.174257+0000","last_undegraded":"2024-09-12T19:11:59.174257+0000","last_fullsized":"2024-09-12T19:11:59.174257+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:12.549691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'508","reported_seq":2178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.106328+0000","last_change":"2024-09-12T18:26:41.852310+0000","last_active":"2024-09-12T19:12:01.106328+0000","last_peered":"2024-09-12T19:12:01.106328+0000","last_clean":"2024-09-12T19:12:01.106328+0000","last_became_active":"2024-09-12T18:26:41.851928+0000","last_became_peered":"2024-09-12T18:26:41.851928+0000","last_unstale":"2024-09-12T19:12:01.106328+0000","last_undegraded":"2024-09-12T19:12:01.106328+0000","last_fullsized":"2024-09-12T19:12:01.106328+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:23.223986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2649,"num_read_kb":2492,"num_write":594,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'350","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.905377+0000","last_change":"2024-09-12T18:26:39.864105+0000","last_active":"2024-09-12T19:13:57.905377+0000","last_peered":"2024-09-12T19:13:57.905377+0000","last_clean":"2024-09-12T19:13:57.905377+0000","last_became_active":"2024-09-12T18:26:39.863389+0000","last_became_peered":"2024-09-12T18:26:39.863389+0000","last_unstale":"2024-09-12T19:13:57.905377+0000","last_undegraded":"2024-09-12T19:13:57.905377+0000","last_fullsized":"2024-09-12T19:13:57.905377+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:59.089104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194678,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":506,"num_read_kb":22645,"num_write":1102,"num_write_kb":31309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.916104+0000","last_change":"2024-09-12T18:26:43.855208+0000","last_active":"2024-09-12T19:10:13.916104+0000","last_peered":"2024-09-12T19:10:13.916104+0000","last_clean":"2024-09-12T19:10:13.916104+0000","last_became_active":"2024-09-12T18:26:43.853736+0000","last_became_peered":"2024-09-12T18:26:43.853736+0000","last_unstale":"2024-09-12T19:10:13.916104+0000","last_undegraded":"2024-09-12T19:10:13.916104+0000","last_fullsized":"2024-09-12T19:10:13.916104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:26.483694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'112","reported_seq":644,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:16.619773+0000","last_change":"2024-09-12T18:26:45.853889+0000","last_active":"2024-09-12T19:11:16.619773+0000","last_peered":"2024-09-12T19:11:16.619773+0000","last_clean":"2024-09-12T19:11:16.619773+0000","last_became_active":"2024-09-12T18:26:45.853143+0000","last_became_peered":"2024-09-12T18:26:45.853143+0000","last_unstale":"2024-09-12T19:11:16.619773+0000","last_undegraded":"2024-09-12T19:11:16.619773+0000","last_fullsized":"2024-09-12T19:11:16.619773+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:21.398455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'760","reported_seq":4106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.834477+0000","last_change":"2024-09-12T18:26:47.895745+0000","last_active":"2024-09-12T19:13:56.834477+0000","last_peered":"2024-09-12T19:13:56.834477+0000","last_clean":"2024-09-12T19:13:56.834477+0000","last_became_active":"2024-09-12T18:26:47.895056+0000","last_became_peered":"2024-09-12T18:26:47.895056+0000","last_unstale":"2024-09-12T19:13:56.834477+0000","last_undegraded":"2024-09-12T19:13:56.834477+0000","last_fullsized":"2024-09-12T19:13:56.834477+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":702,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:33.762580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'174","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.267501+0000","last_change":"2024-09-12T18:26:49.890859+0000","last_active":"2024-09-12T19:12:24.267501+0000","last_peered":"2024-09-12T19:12:24.267501+0000","last_clean":"2024-09-12T19:12:24.267501+0000","last_became_active":"2024-09-12T18:26:49.890325+0000","last_became_peered":"2024-09-12T18:26:49.890325+0000","last_unstale":"2024-09-12T19:12:24.267501+0000","last_undegraded":"2024-09-12T19:12:24.267501+0000","last_fullsized":"2024-09-12T19:12:24.267501+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:48.483470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":638,"num_write":360,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'755","reported_seq":2307,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:05.288203+0000","last_change":"2024-09-12T18:26:41.862710+0000","last_active":"2024-09-12T19:12:05.288203+0000","last_peered":"2024-09-12T19:12:05.288203+0000","last_clean":"2024-09-12T19:12:05.288203+0000","last_became_active":"2024-09-12T18:26:41.862240+0000","last_became_peered":"2024-09-12T18:26:41.862240+0000","last_unstale":"2024-09-12T19:12:05.288203+0000","last_undegraded":"2024-09-12T19:12:05.288203+0000","last_fullsized":"2024-09-12T19:12:05.288203+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:33.961532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3627,"num_read_kb":3298,"num_write":982,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'262","reported_seq":877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:38.071574+0000","last_change":"2024-09-12T18:26:39.844306+0000","last_active":"2024-09-12T19:13:38.071574+0000","last_peered":"2024-09-12T19:13:38.071574+0000","last_clean":"2024-09-12T19:13:38.071574+0000","last_became_active":"2024-09-12T18:26:39.843351+0000","last_became_peered":"2024-09-12T18:26:39.843351+0000","last_unstale":"2024-09-12T19:13:38.071574+0000","last_undegraded":"2024-09-12T19:13:38.071574+0000","last_fullsized":"2024-09-12T19:13:38.071574+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:35.966180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417223,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":412,"num_read_kb":20705,"num_write":966,"num_write_kb":27627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.892087+0000","last_change":"2024-09-12T18:26:43.843098+0000","last_active":"2024-09-12T19:10:13.892087+0000","last_peered":"2024-09-12T19:10:13.892087+0000","last_clean":"2024-09-12T19:10:13.892087+0000","last_became_active":"2024-09-12T18:26:43.842479+0000","last_became_peered":"2024-09-12T18:26:43.842479+0000","last_unstale":"2024-09-12T19:10:13.892087+0000","last_undegraded":"2024-09-12T19:10:13.892087+0000","last_fullsized":"2024-09-12T19:10:13.892087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:07.573346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'281","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.959185+0000","last_change":"2024-09-12T18:26:46.025157+0000","last_active":"2024-09-12T19:13:43.959185+0000","last_peered":"2024-09-12T19:13:43.959185+0000","last_clean":"2024-09-12T19:13:43.959185+0000","last_became_active":"2024-09-12T18:26:46.024425+0000","last_became_peered":"2024-09-12T18:26:46.024425+0000","last_unstale":"2024-09-12T19:13:43.959185+0000","last_undegraded":"2024-09-12T19:13:43.959185+0000","last_fullsized":"2024-09-12T19:13:43.959185+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:13.803848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62379,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":998,"num_write":390,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'801","reported_seq":2364,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.028658+0000","last_change":"2024-09-12T18:26:47.899579+0000","last_active":"2024-09-12T19:13:44.028658+0000","last_peered":"2024-09-12T19:13:44.028658+0000","last_clean":"2024-09-12T19:13:44.028658+0000","last_became_active":"2024-09-12T18:26:47.898903+0000","last_became_peered":"2024-09-12T18:26:47.898903+0000","last_unstale":"2024-09-12T19:13:44.028658+0000","last_undegraded":"2024-09-12T19:13:44.028658+0000","last_fullsized":"2024-09-12T19:13:44.028658+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:43.604475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'762","reported_seq":2249,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:03.047582+0000","last_change":"2024-09-12T18:26:41.870576+0000","last_active":"2024-09-12T19:12:03.047582+0000","last_peered":"2024-09-12T19:12:03.047582+0000","last_clean":"2024-09-12T19:12:03.047582+0000","last_became_active":"2024-09-12T18:26:41.869852+0000","last_became_peered":"2024-09-12T18:26:41.869852+0000","last_unstale":"2024-09-12T19:12:03.047582+0000","last_undegraded":"2024-09-12T19:12:03.047582+0000","last_fullsized":"2024-09-12T19:12:03.047582+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:41.656803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3529,"num_read_kb":3192,"num_write":1004,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'453","reported_seq":1174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.942166+0000","last_change":"2024-09-12T18:26:39.875011+0000","last_active":"2024-09-12T19:13:57.942166+0000","last_peered":"2024-09-12T19:13:57.942166+0000","last_clean":"2024-09-12T19:13:57.942166+0000","last_became_active":"2024-09-12T18:26:39.873512+0000","last_became_peered":"2024-09-12T18:26:39.873512+0000","last_unstale":"2024-09-12T19:13:57.942166+0000","last_undegraded":"2024-09-12T19:13:57.942166+0000","last_fullsized":"2024-09-12T19:13:57.942166+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:45.863880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5044712,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":899,"num_read_kb":13008,"num_write":1518,"num_write_kb":39306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.895938+0000","last_change":"2024-09-12T18:26:43.871922+0000","last_active":"2024-09-12T19:10:07.895938+0000","last_peered":"2024-09-12T19:10:07.895938+0000","last_clean":"2024-09-12T19:10:07.895938+0000","last_became_active":"2024-09-12T18:26:43.871192+0000","last_became_peered":"2024-09-12T18:26:43.871192+0000","last_unstale":"2024-09-12T19:10:07.895938+0000","last_undegraded":"2024-09-12T19:10:07.895938+0000","last_fullsized":"2024-09-12T19:10:07.895938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:26.666887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'360","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:28.921731+0000","last_change":"2024-09-12T18:26:46.021987+0000","last_active":"2024-09-12T19:12:28.921731+0000","last_peered":"2024-09-12T19:12:28.921731+0000","last_clean":"2024-09-12T19:12:28.921731+0000","last_became_active":"2024-09-12T18:26:46.021239+0000","last_became_peered":"2024-09-12T18:26:46.021239+0000","last_unstale":"2024-09-12T19:12:28.921731+0000","last_undegraded":"2024-09-12T19:12:28.921731+0000","last_fullsized":"2024-09-12T19:12:28.921731+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:16.999506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55436,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":568,"num_read_kb":1061,"num_write":454,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:32.894704+0000","last_change":"2024-09-12T18:26:47.879784+0000","last_active":"2024-09-12T19:09:32.894704+0000","last_peered":"2024-09-12T19:09:32.894704+0000","last_clean":"2024-09-12T19:09:32.894704+0000","last_became_active":"2024-09-12T18:26:47.879079+0000","last_became_peered":"2024-09-12T18:26:47.879079+0000","last_unstale":"2024-09-12T19:09:32.894704+0000","last_undegraded":"2024-09-12T19:09:32.894704+0000","last_fullsized":"2024-09-12T19:09:32.894704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.067221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'551","reported_seq":1359,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.001450+0000","last_change":"2024-09-12T18:26:49.913788+0000","last_active":"2024-09-12T19:13:44.001450+0000","last_peered":"2024-09-12T19:13:44.001450+0000","last_clean":"2024-09-12T19:13:44.001450+0000","last_became_active":"2024-09-12T18:26:49.913115+0000","last_became_peered":"2024-09-12T18:26:49.913115+0000","last_unstale":"2024-09-12T19:13:44.001450+0000","last_undegraded":"2024-09-12T19:13:44.001450+0000","last_fullsized":"2024-09-12T19:13:44.001450+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:49.514569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1285,"num_write":1159,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'406","reported_seq":1988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.570164+0000","last_change":"2024-09-12T18:26:41.855029+0000","last_active":"2024-09-12T19:12:06.570164+0000","last_peered":"2024-09-12T19:12:06.570164+0000","last_clean":"2024-09-12T19:12:06.570164+0000","last_became_active":"2024-09-12T18:26:41.854391+0000","last_became_peered":"2024-09-12T18:26:41.854391+0000","last_unstale":"2024-09-12T19:12:06.570164+0000","last_undegraded":"2024-09-12T19:12:06.570164+0000","last_fullsized":"2024-09-12T19:12:06.570164+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:51.832674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2438,"num_read_kb":2340,"num_write":450,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'292","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.937366+0000","last_change":"2024-09-12T18:26:39.871356+0000","last_active":"2024-09-12T19:13:57.937366+0000","last_peered":"2024-09-12T19:13:57.937366+0000","last_clean":"2024-09-12T19:13:57.937366+0000","last_became_active":"2024-09-12T18:26:39.870641+0000","last_became_peered":"2024-09-12T18:26:39.870641+0000","last_unstale":"2024-09-12T19:13:57.937366+0000","last_undegraded":"2024-09-12T19:13:57.937366+0000","last_fullsized":"2024-09-12T19:13:57.937366+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:37.867643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048963,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":389,"num_read_kb":1418,"num_write":995,"num_write_kb":24682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.878656+0000","last_change":"2024-09-12T18:26:43.854009+0000","last_active":"2024-09-12T19:10:03.878656+0000","last_peered":"2024-09-12T19:10:03.878656+0000","last_clean":"2024-09-12T19:10:03.878656+0000","last_became_active":"2024-09-12T18:26:43.853212+0000","last_became_peered":"2024-09-12T18:26:43.853212+0000","last_unstale":"2024-09-12T19:10:03.878656+0000","last_undegraded":"2024-09-12T19:10:03.878656+0000","last_fullsized":"2024-09-12T19:10:03.878656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:12.634200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'259","reported_seq":821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.717284+0000","last_change":"2024-09-12T18:26:45.866790+0000","last_active":"2024-09-12T19:11:48.717284+0000","last_peered":"2024-09-12T19:11:48.717284+0000","last_clean":"2024-09-12T19:11:48.717284+0000","last_became_active":"2024-09-12T18:26:45.865933+0000","last_became_peered":"2024-09-12T18:26:45.865933+0000","last_unstale":"2024-09-12T19:11:48.717284+0000","last_undegraded":"2024-09-12T19:11:48.717284+0000","last_fullsized":"2024-09-12T19:11:48.717284+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:47.841285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69833,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":437,"num_read_kb":950,"num_write":362,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.915818+0000","last_change":"2024-09-12T18:26:47.898805+0000","last_active":"2024-09-12T19:10:13.915818+0000","last_peered":"2024-09-12T19:10:13.915818+0000","last_clean":"2024-09-12T19:10:13.915818+0000","last_became_active":"2024-09-12T18:26:47.898056+0000","last_became_peered":"2024-09-12T18:26:47.898056+0000","last_unstale":"2024-09-12T19:10:13.915818+0000","last_undegraded":"2024-09-12T19:10:13.915818+0000","last_fullsized":"2024-09-12T19:10:13.915818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:01.722126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'128","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:53.928598+0000","last_change":"2024-09-12T18:26:49.914410+0000","last_active":"2024-09-12T19:12:53.928598+0000","last_peered":"2024-09-12T19:12:53.928598+0000","last_clean":"2024-09-12T19:12:53.928598+0000","last_became_active":"2024-09-12T18:26:49.913180+0000","last_became_peered":"2024-09-12T18:26:49.913180+0000","last_unstale":"2024-09-12T19:12:53.928598+0000","last_undegraded":"2024-09-12T19:12:53.928598+0000","last_fullsized":"2024-09-12T19:12:53.928598+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:31.008311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'514","reported_seq":2058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.768357+0000","last_change":"2024-09-12T18:26:41.874172+0000","last_active":"2024-09-12T19:12:08.768357+0000","last_peered":"2024-09-12T19:12:08.768357+0000","last_clean":"2024-09-12T19:12:08.768357+0000","last_became_active":"2024-09-12T18:26:41.873229+0000","last_became_peered":"2024-09-12T18:26:41.873229+0000","last_unstale":"2024-09-12T19:12:08.768357+0000","last_undegraded":"2024-09-12T19:12:08.768357+0000","last_fullsized":"2024-09-12T19:12:08.768357+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:55.323047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2942,"num_read_kb":2741,"num_write":656,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'341","reported_seq":1120,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.949516+0000","last_change":"2024-09-12T18:26:39.865873+0000","last_active":"2024-09-12T19:13:57.949516+0000","last_peered":"2024-09-12T19:13:57.949516+0000","last_clean":"2024-09-12T19:13:57.949516+0000","last_became_active":"2024-09-12T18:26:39.865148+0000","last_became_peered":"2024-09-12T18:26:39.865148+0000","last_unstale":"2024-09-12T19:13:57.949516+0000","last_undegraded":"2024-09-12T19:13:57.949516+0000","last_fullsized":"2024-09-12T19:13:57.949516+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:00.744853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2271991,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":857,"num_read_kb":25450,"num_write":1052,"num_write_kb":40926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:28.871439+0000","last_change":"2024-09-12T18:26:43.854880+0000","last_active":"2024-09-12T19:09:28.871439+0000","last_peered":"2024-09-12T19:09:28.871439+0000","last_clean":"2024-09-12T19:09:28.871439+0000","last_became_active":"2024-09-12T18:26:43.853084+0000","last_became_peered":"2024-09-12T18:26:43.853084+0000","last_unstale":"2024-09-12T19:09:28.871439+0000","last_undegraded":"2024-09-12T19:09:28.871439+0000","last_fullsized":"2024-09-12T19:09:28.871439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:12.477078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'307","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.556756+0000","last_change":"2024-09-12T18:26:45.867127+0000","last_active":"2024-09-12T19:13:57.556756+0000","last_peered":"2024-09-12T19:13:57.556756+0000","last_clean":"2024-09-12T19:13:57.556756+0000","last_became_active":"2024-09-12T18:26:45.866325+0000","last_became_peered":"2024-09-12T18:26:45.866325+0000","last_unstale":"2024-09-12T19:13:57.556756+0000","last_undegraded":"2024-09-12T19:13:57.556756+0000","last_fullsized":"2024-09-12T19:13:57.556756+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:45.228994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64639,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":1214,"num_write":426,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'788","reported_seq":2646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.029707+0000","last_change":"2024-09-12T18:26:47.879674+0000","last_active":"2024-09-12T19:13:44.029707+0000","last_peered":"2024-09-12T19:13:44.029707+0000","last_clean":"2024-09-12T19:13:44.029707+0000","last_became_active":"2024-09-12T18:26:47.878956+0000","last_became_peered":"2024-09-12T18:26:47.878956+0000","last_unstale":"2024-09-12T19:13:44.029707+0000","last_undegraded":"2024-09-12T19:13:44.029707+0000","last_fullsized":"2024-09-12T19:13:44.029707+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:56.898695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'146","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.017181+0000","last_change":"2024-09-12T18:26:49.927113+0000","last_active":"2024-09-12T19:13:43.017181+0000","last_peered":"2024-09-12T19:13:43.017181+0000","last_clean":"2024-09-12T19:13:43.017181+0000","last_became_active":"2024-09-12T18:26:49.926384+0000","last_became_peered":"2024-09-12T18:26:49.926384+0000","last_unstale":"2024-09-12T19:13:43.017181+0000","last_undegraded":"2024-09-12T19:13:43.017181+0000","last_fullsized":"2024-09-12T19:13:43.017181+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:14.787817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":361,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'694","reported_seq":2114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.881016+0000","last_change":"2024-09-12T18:26:41.846934+0000","last_active":"2024-09-12T19:12:07.881016+0000","last_peered":"2024-09-12T19:12:07.881016+0000","last_clean":"2024-09-12T19:12:07.881016+0000","last_became_active":"2024-09-12T18:26:41.846589+0000","last_became_peered":"2024-09-12T18:26:41.846589+0000","last_unstale":"2024-09-12T19:12:07.881016+0000","last_undegraded":"2024-09-12T19:12:07.881016+0000","last_fullsized":"2024-09-12T19:12:07.881016+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:35.741190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3315,"num_read_kb":3003,"num_write":914,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'263","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.663150+0000","last_change":"2024-09-12T18:26:39.851620+0000","last_active":"2024-09-12T19:11:58.663150+0000","last_peered":"2024-09-12T19:11:58.663150+0000","last_clean":"2024-09-12T19:11:58.663150+0000","last_became_active":"2024-09-12T18:26:39.849950+0000","last_became_peered":"2024-09-12T18:26:39.849950+0000","last_unstale":"2024-09-12T19:11:58.663150+0000","last_undegraded":"2024-09-12T19:11:58.663150+0000","last_fullsized":"2024-09-12T19:11:58.663150+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:33.362610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8457173,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":571,"num_read_kb":33808,"num_write":994,"num_write_kb":22667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.879742+0000","last_change":"2024-09-12T18:26:43.875193+0000","last_active":"2024-09-12T19:10:08.879742+0000","last_peered":"2024-09-12T19:10:08.879742+0000","last_clean":"2024-09-12T19:10:08.879742+0000","last_became_active":"2024-09-12T18:26:43.874837+0000","last_became_peered":"2024-09-12T18:26:43.874837+0000","last_unstale":"2024-09-12T19:10:08.879742+0000","last_undegraded":"2024-09-12T19:10:08.879742+0000","last_fullsized":"2024-09-12T19:10:08.879742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:28.076097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'450","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.943287+0000","last_change":"2024-09-12T18:26:45.876006+0000","last_active":"2024-09-12T19:13:43.943287+0000","last_peered":"2024-09-12T19:13:43.943287+0000","last_clean":"2024-09-12T19:13:43.943287+0000","last_became_active":"2024-09-12T18:26:45.875223+0000","last_became_peered":"2024-09-12T18:26:45.875223+0000","last_unstale":"2024-09-12T19:13:43.943287+0000","last_undegraded":"2024-09-12T19:13:43.943287+0000","last_fullsized":"2024-09-12T19:13:43.943287+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:33.224194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107054,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":782,"num_read_kb":1698,"num_write":650,"num_write_kb":561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.879675+0000","last_change":"2024-09-12T18:26:47.892554+0000","last_active":"2024-09-12T19:10:08.879675+0000","last_peered":"2024-09-12T19:10:08.879675+0000","last_clean":"2024-09-12T19:10:08.879675+0000","last_became_active":"2024-09-12T18:26:47.891736+0000","last_became_peered":"2024-09-12T18:26:47.891736+0000","last_unstale":"2024-09-12T19:10:08.879675+0000","last_undegraded":"2024-09-12T19:10:08.879675+0000","last_fullsized":"2024-09-12T19:10:08.879675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:15.740755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'131","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:19.312995+0000","last_change":"2024-09-12T18:26:49.905418+0000","last_active":"2024-09-12T19:10:19.312995+0000","last_peered":"2024-09-12T19:10:19.312995+0000","last_clean":"2024-09-12T19:10:19.312995+0000","last_became_active":"2024-09-12T18:26:49.904633+0000","last_became_peered":"2024-09-12T18:26:49.904633+0000","last_unstale":"2024-09-12T19:10:19.312995+0000","last_undegraded":"2024-09-12T19:10:19.312995+0000","last_fullsized":"2024-09-12T19:10:19.312995+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:49.072537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":176,"num_write":324,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'684","reported_seq":2216,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.579998+0000","last_change":"2024-09-12T18:26:41.853736+0000","last_active":"2024-09-12T19:11:42.579998+0000","last_peered":"2024-09-12T19:11:42.579998+0000","last_clean":"2024-09-12T19:11:42.579998+0000","last_became_active":"2024-09-12T18:26:41.852958+0000","last_became_peered":"2024-09-12T18:26:41.852958+0000","last_unstale":"2024-09-12T19:11:42.579998+0000","last_undegraded":"2024-09-12T19:11:42.579998+0000","last_fullsized":"2024-09-12T19:11:42.579998+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:03.970571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3047,"num_write":870,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'281","reported_seq":950,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:05.911940+0000","last_change":"2024-09-12T18:26:39.844241+0000","last_active":"2024-09-12T19:12:05.911940+0000","last_peered":"2024-09-12T19:12:05.911940+0000","last_clean":"2024-09-12T19:12:05.911940+0000","last_became_active":"2024-09-12T18:26:39.842671+0000","last_became_peered":"2024-09-12T18:26:39.842671+0000","last_unstale":"2024-09-12T19:12:05.911940+0000","last_undegraded":"2024-09-12T19:12:05.911940+0000","last_fullsized":"2024-09-12T19:12:05.911940+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:01.142718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7857956,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":478,"num_read_kb":38368,"num_write":1075,"num_write_kb":24127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:28.871539+0000","last_change":"2024-09-12T18:26:43.864463+0000","last_active":"2024-09-12T19:09:28.871539+0000","last_peered":"2024-09-12T19:09:28.871539+0000","last_clean":"2024-09-12T19:09:28.871539+0000","last_became_active":"2024-09-12T18:26:43.863615+0000","last_became_peered":"2024-09-12T18:26:43.863615+0000","last_unstale":"2024-09-12T19:09:28.871539+0000","last_undegraded":"2024-09-12T19:09:28.871539+0000","last_fullsized":"2024-09-12T19:09:28.871539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:49.236494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'288","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:49.122609+0000","last_change":"2024-09-12T18:26:45.865043+0000","last_active":"2024-09-12T19:11:49.122609+0000","last_peered":"2024-09-12T19:11:49.122609+0000","last_clean":"2024-09-12T19:11:49.122609+0000","last_became_active":"2024-09-12T18:26:45.864308+0000","last_became_peered":"2024-09-12T18:26:45.864308+0000","last_unstale":"2024-09-12T19:11:49.122609+0000","last_undegraded":"2024-09-12T19:11:49.122609+0000","last_fullsized":"2024-09-12T19:11:49.122609+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:23.603111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56977,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":996,"num_write":454,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:43.910003+0000","last_change":"2024-09-12T18:26:47.904622+0000","last_active":"2024-09-12T19:09:43.910003+0000","last_peered":"2024-09-12T19:09:43.910003+0000","last_clean":"2024-09-12T19:09:43.910003+0000","last_became_active":"2024-09-12T18:26:47.903984+0000","last_became_peered":"2024-09-12T18:26:47.903984+0000","last_unstale":"2024-09-12T19:09:43.910003+0000","last_undegraded":"2024-09-12T19:09:43.910003+0000","last_fullsized":"2024-09-12T19:09:43.910003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:01.445193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'130","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:03.733674+0000","last_change":"2024-09-12T18:26:49.917735+0000","last_active":"2024-09-12T19:13:03.733674+0000","last_peered":"2024-09-12T19:13:03.733674+0000","last_clean":"2024-09-12T19:13:03.733674+0000","last_became_active":"2024-09-12T18:26:49.916255+0000","last_became_peered":"2024-09-12T18:26:49.916255+0000","last_unstale":"2024-09-12T19:13:03.733674+0000","last_undegraded":"2024-09-12T19:13:03.733674+0000","last_fullsized":"2024-09-12T19:13:03.733674+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:05.827351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":172,"num_read_kb":153,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'479","reported_seq":2155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.274718+0000","last_change":"2024-09-12T18:26:41.852549+0000","last_active":"2024-09-12T19:12:23.274718+0000","last_peered":"2024-09-12T19:12:23.274718+0000","last_clean":"2024-09-12T19:12:23.274718+0000","last_became_active":"2024-09-12T18:26:41.851789+0000","last_became_peered":"2024-09-12T18:26:41.851789+0000","last_unstale":"2024-09-12T19:12:23.274718+0000","last_undegraded":"2024-09-12T19:12:23.274718+0000","last_fullsized":"2024-09-12T19:12:23.274718+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:07.659593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2754,"num_read_kb":2601,"num_write":570,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'332","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.634592+0000","last_change":"2024-09-12T18:26:39.850151+0000","last_active":"2024-09-12T19:11:44.634592+0000","last_peered":"2024-09-12T19:11:44.634592+0000","last_clean":"2024-09-12T19:11:44.634592+0000","last_became_active":"2024-09-12T18:26:39.849392+0000","last_became_peered":"2024-09-12T18:26:39.849392+0000","last_unstale":"2024-09-12T19:11:44.634592+0000","last_undegraded":"2024-09-12T19:11:44.634592+0000","last_fullsized":"2024-09-12T19:11:44.634592+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:38.297523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569204,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":603,"num_read_kb":7425,"num_write":1111,"num_write_kb":13361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:32.894780+0000","last_change":"2024-09-12T18:26:43.877842+0000","last_active":"2024-09-12T19:09:32.894780+0000","last_peered":"2024-09-12T19:09:32.894780+0000","last_clean":"2024-09-12T19:09:32.894780+0000","last_became_active":"2024-09-12T18:26:43.877257+0000","last_became_peered":"2024-09-12T18:26:43.877257+0000","last_unstale":"2024-09-12T19:09:32.894780+0000","last_undegraded":"2024-09-12T19:09:32.894780+0000","last_fullsized":"2024-09-12T19:09:32.894780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:29.743058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'283","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.719215+0000","last_change":"2024-09-12T18:26:45.862903+0000","last_active":"2024-09-12T19:11:58.719215+0000","last_peered":"2024-09-12T19:11:58.719215+0000","last_clean":"2024-09-12T19:11:58.719215+0000","last_became_active":"2024-09-12T18:26:45.861947+0000","last_became_peered":"2024-09-12T18:26:45.861947+0000","last_unstale":"2024-09-12T19:11:58.719215+0000","last_undegraded":"2024-09-12T19:11:58.719215+0000","last_fullsized":"2024-09-12T19:11:58.719215+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:08.858976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56992,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":939,"num_write":374,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'752","reported_seq":2376,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.024733+0000","last_change":"2024-09-12T18:26:47.881128+0000","last_active":"2024-09-12T19:13:44.024733+0000","last_peered":"2024-09-12T19:13:44.024733+0000","last_clean":"2024-09-12T19:13:44.024733+0000","last_became_active":"2024-09-12T18:26:47.880400+0000","last_became_peered":"2024-09-12T18:26:47.880400+0000","last_unstale":"2024-09-12T19:13:44.024733+0000","last_undegraded":"2024-09-12T19:13:44.024733+0000","last_fullsized":"2024-09-12T19:13:44.024733+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:33.420018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'139","reported_seq":636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:06.307338+0000","last_change":"2024-09-12T18:26:49.914558+0000","last_active":"2024-09-12T19:11:06.307338+0000","last_peered":"2024-09-12T19:11:06.307338+0000","last_clean":"2024-09-12T19:11:06.307338+0000","last_became_active":"2024-09-12T18:26:49.913762+0000","last_became_peered":"2024-09-12T18:26:49.913762+0000","last_unstale":"2024-09-12T19:11:06.307338+0000","last_undegraded":"2024-09-12T19:11:06.307338+0000","last_fullsized":"2024-09-12T19:11:06.307338+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:09.188110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":330,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'794","reported_seq":2361,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.094946+0000","last_change":"2024-09-12T18:26:41.867333+0000","last_active":"2024-09-12T19:12:01.094946+0000","last_peered":"2024-09-12T19:12:01.094946+0000","last_clean":"2024-09-12T19:12:01.094946+0000","last_became_active":"2024-09-12T18:26:41.866528+0000","last_became_peered":"2024-09-12T18:26:41.866528+0000","last_unstale":"2024-09-12T19:12:01.094946+0000","last_undegraded":"2024-09-12T19:12:01.094946+0000","last_fullsized":"2024-09-12T19:12:01.094946+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:17.375009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3788,"num_read_kb":3420,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'274","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.596733+0000","last_change":"2024-09-12T18:26:39.844053+0000","last_active":"2024-09-12T19:11:43.596733+0000","last_peered":"2024-09-12T19:11:43.596733+0000","last_clean":"2024-09-12T19:11:43.596733+0000","last_became_active":"2024-09-12T18:26:39.839762+0000","last_became_peered":"2024-09-12T18:26:39.839762+0000","last_unstale":"2024-09-12T19:11:43.596733+0000","last_undegraded":"2024-09-12T19:11:43.596733+0000","last_fullsized":"2024-09-12T19:11:43.596733+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:10.306869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11428025,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":349,"num_read_kb":30494,"num_write":980,"num_write_kb":26286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1443,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.886976+0000","last_change":"2024-09-12T18:26:43.862723+0000","last_active":"2024-09-12T19:13:43.886976+0000","last_peered":"2024-09-12T19:13:43.886976+0000","last_clean":"2024-09-12T19:13:43.886976+0000","last_became_active":"2024-09-12T18:26:43.861969+0000","last_became_peered":"2024-09-12T18:26:43.861969+0000","last_unstale":"2024-09-12T19:13:43.886976+0000","last_undegraded":"2024-09-12T19:13:43.886976+0000","last_fullsized":"2024-09-12T19:13:43.886976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:53.579120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":949,"num_read_kb":949,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'77","reported_seq":593,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.717443+0000","last_change":"2024-09-12T18:26:46.020701+0000","last_active":"2024-09-12T19:11:48.717443+0000","last_peered":"2024-09-12T19:11:48.717443+0000","last_clean":"2024-09-12T19:11:48.717443+0000","last_became_active":"2024-09-12T18:26:46.019895+0000","last_became_peered":"2024-09-12T18:26:46.019895+0000","last_unstale":"2024-09-12T19:11:48.717443+0000","last_undegraded":"2024-09-12T19:11:48.717443+0000","last_fullsized":"2024-09-12T19:11:48.717443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:43.067058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'765","reported_seq":4368,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.027134+0000","last_change":"2024-09-12T18:26:47.888210+0000","last_active":"2024-09-12T19:13:44.027134+0000","last_peered":"2024-09-12T19:13:44.027134+0000","last_clean":"2024-09-12T19:13:44.027134+0000","last_became_active":"2024-09-12T18:26:47.882417+0000","last_became_peered":"2024-09-12T18:26:47.882417+0000","last_unstale":"2024-09-12T19:13:44.027134+0000","last_undegraded":"2024-09-12T19:13:44.027134+0000","last_fullsized":"2024-09-12T19:13:44.027134+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:18.819184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'146","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:04.041466+0000","last_change":"2024-09-12T18:26:49.927258+0000","last_active":"2024-09-12T19:12:04.041466+0000","last_peered":"2024-09-12T19:12:04.041466+0000","last_clean":"2024-09-12T19:12:04.041466+0000","last_became_active":"2024-09-12T18:26:49.926637+0000","last_became_peered":"2024-09-12T18:26:49.926637+0000","last_unstale":"2024-09-12T19:12:04.041466+0000","last_undegraded":"2024-09-12T19:12:04.041466+0000","last_fullsized":"2024-09-12T19:12:04.041466+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:49.800769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":120,"num_write":360,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'756","reported_seq":2269,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.171030+0000","last_change":"2024-09-12T18:26:41.839495+0000","last_active":"2024-09-12T19:11:59.171030+0000","last_peered":"2024-09-12T19:11:59.171030+0000","last_clean":"2024-09-12T19:11:59.171030+0000","last_became_active":"2024-09-12T18:26:41.839152+0000","last_became_peered":"2024-09-12T18:26:41.839152+0000","last_unstale":"2024-09-12T19:11:59.171030+0000","last_undegraded":"2024-09-12T19:11:59.171030+0000","last_fullsized":"2024-09-12T19:11:59.171030+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:53.021667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3609,"num_read_kb":3261,"num_write":1016,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'299","reported_seq":1162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.198702+0000","last_change":"2024-09-12T18:26:39.842163+0000","last_active":"2024-09-12T19:12:08.198702+0000","last_peered":"2024-09-12T19:12:08.198702+0000","last_clean":"2024-09-12T19:12:08.198702+0000","last_became_active":"2024-09-12T18:26:39.839018+0000","last_became_peered":"2024-09-12T18:26:39.839018+0000","last_unstale":"2024-09-12T19:12:08.198702+0000","last_undegraded":"2024-09-12T19:12:08.198702+0000","last_fullsized":"2024-09-12T19:12:08.198702+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:01.980870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12779029,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":917,"num_read_kb":16661,"num_write":1175,"num_write_kb":29221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:29.091642+0000","last_change":"2024-09-12T18:26:43.875133+0000","last_active":"2024-09-12T19:09:29.091642+0000","last_peered":"2024-09-12T19:09:29.091642+0000","last_clean":"2024-09-12T19:09:29.091642+0000","last_became_active":"2024-09-12T18:26:43.872882+0000","last_became_peered":"2024-09-12T18:26:43.872882+0000","last_unstale":"2024-09-12T19:09:29.091642+0000","last_undegraded":"2024-09-12T19:09:29.091642+0000","last_fullsized":"2024-09-12T19:09:29.091642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:27.685683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'390","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.370347+0000","last_change":"2024-09-12T18:26:45.871763+0000","last_active":"2024-09-12T19:12:24.370347+0000","last_peered":"2024-09-12T19:12:24.370347+0000","last_clean":"2024-09-12T19:12:24.370347+0000","last_became_active":"2024-09-12T18:26:45.871011+0000","last_became_peered":"2024-09-12T18:26:45.871011+0000","last_unstale":"2024-09-12T19:12:24.370347+0000","last_undegraded":"2024-09-12T19:12:24.370347+0000","last_fullsized":"2024-09-12T19:12:24.370347+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:25.203156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55304,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1182,"num_read_kb":1667,"num_write":1694,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:33.885454+0000","last_change":"2024-09-12T18:26:47.894796+0000","last_active":"2024-09-12T19:09:33.885454+0000","last_peered":"2024-09-12T19:09:33.885454+0000","last_clean":"2024-09-12T19:09:33.885454+0000","last_became_active":"2024-09-12T18:26:47.893881+0000","last_became_peered":"2024-09-12T18:26:47.893881+0000","last_unstale":"2024-09-12T19:09:33.885454+0000","last_undegraded":"2024-09-12T19:09:33.885454+0000","last_fullsized":"2024-09-12T19:09:33.885454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:58.081365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'157","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:37.541375+0000","last_change":"2024-09-12T18:26:49.912169+0000","last_active":"2024-09-12T19:11:37.541375+0000","last_peered":"2024-09-12T19:11:37.541375+0000","last_clean":"2024-09-12T19:11:37.541375+0000","last_became_active":"2024-09-12T18:26:49.911403+0000","last_became_peered":"2024-09-12T18:26:49.911403+0000","last_unstale":"2024-09-12T19:11:37.541375+0000","last_undegraded":"2024-09-12T19:11:37.541375+0000","last_fullsized":"2024-09-12T19:11:37.541375+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:01.150938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":152,"num_write":383,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'825","reported_seq":2330,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.126584+0000","last_change":"2024-09-12T18:26:41.874124+0000","last_active":"2024-09-12T19:12:24.126584+0000","last_peered":"2024-09-12T19:12:24.126584+0000","last_clean":"2024-09-12T19:12:24.126584+0000","last_became_active":"2024-09-12T18:26:41.873329+0000","last_became_peered":"2024-09-12T18:26:41.873329+0000","last_unstale":"2024-09-12T19:12:24.126584+0000","last_undegraded":"2024-09-12T19:12:24.126584+0000","last_fullsized":"2024-09-12T19:12:24.126584+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:49.832562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3864,"num_read_kb":3455,"num_write":1112,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.901972+0000","last_change":"2024-09-12T18:26:20.490476+0000","last_active":"2024-09-12T19:10:32.901972+0000","last_peered":"2024-09-12T19:10:32.901972+0000","last_clean":"2024-09-12T19:10:32.901972+0000","last_became_active":"2024-09-12T18:26:20.488464+0000","last_became_peered":"2024-09-12T18:26:20.488464+0000","last_unstale":"2024-09-12T19:10:32.901972+0000","last_undegraded":"2024-09-12T19:10:32.901972+0000","last_fullsized":"2024-09-12T19:10:32.901972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:19.397195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:19.397195+0000","last_clean_scrub_stamp":"2024-09-12T18:26:19.397195+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:55.130875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.891893+0000","last_change":"2024-09-12T18:26:27.490424+0000","last_active":"2024-09-12T19:10:13.891893+0000","last_peered":"2024-09-12T19:10:13.891893+0000","last_clean":"2024-09-12T19:10:13.891893+0000","last_became_active":"2024-09-12T18:26:25.483072+0000","last_became_peered":"2024-09-12T18:26:25.483072+0000","last_unstale":"2024-09-12T19:10:13.891893+0000","last_undegraded":"2024-09-12T19:10:13.891893+0000","last_fullsized":"2024-09-12T19:10:13.891893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:05.867109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010071489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'306","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:04.359804+0000","last_change":"2024-09-12T18:26:39.855572+0000","last_active":"2024-09-12T19:12:04.359804+0000","last_peered":"2024-09-12T19:12:04.359804+0000","last_clean":"2024-09-12T19:12:04.359804+0000","last_became_active":"2024-09-12T18:26:39.855274+0000","last_became_peered":"2024-09-12T18:26:39.855274+0000","last_unstale":"2024-09-12T19:12:04.359804+0000","last_undegraded":"2024-09-12T19:12:04.359804+0000","last_fullsized":"2024-09-12T19:12:04.359804+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:41.652285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4633640,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":526,"num_read_kb":43410,"num_write":1089,"num_write_kb":32341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"36'3","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.574535+0000","last_change":"2024-09-12T18:26:43.863289+0000","last_active":"2024-09-12T19:13:56.574535+0000","last_peered":"2024-09-12T19:13:56.574535+0000","last_clean":"2024-09-12T19:13:56.574535+0000","last_became_active":"2024-09-12T18:26:43.862599+0000","last_became_peered":"2024-09-12T18:26:43.862599+0000","last_unstale":"2024-09-12T19:13:56.574535+0000","last_undegraded":"2024-09-12T19:13:56.574535+0000","last_fullsized":"2024-09-12T19:13:56.574535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:40.040108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'703","reported_seq":1386,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.976548+0000","last_change":"2024-09-12T18:26:45.871462+0000","last_active":"2024-09-12T19:13:43.976548+0000","last_peered":"2024-09-12T19:13:43.976548+0000","last_clean":"2024-09-12T19:13:43.976548+0000","last_became_active":"2024-09-12T18:26:45.870711+0000","last_became_peered":"2024-09-12T18:26:45.870711+0000","last_unstale":"2024-09-12T19:13:43.976548+0000","last_undegraded":"2024-09-12T19:13:43.976548+0000","last_fullsized":"2024-09-12T19:13:43.976548+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:33.052933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185163,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1361,"num_read_kb":2859,"num_write":1270,"num_write_kb":1141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.915809+0000","last_change":"2024-09-12T18:26:47.888177+0000","last_active":"2024-09-12T19:10:08.915809+0000","last_peered":"2024-09-12T19:10:08.915809+0000","last_clean":"2024-09-12T19:10:08.915809+0000","last_became_active":"2024-09-12T18:26:47.886696+0000","last_became_peered":"2024-09-12T18:26:47.886696+0000","last_unstale":"2024-09-12T19:10:08.915809+0000","last_undegraded":"2024-09-12T19:10:08.915809+0000","last_fullsized":"2024-09-12T19:10:08.915809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:07.144929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'175","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.921796+0000","last_change":"2024-09-12T18:26:49.910601+0000","last_active":"2024-09-12T19:12:23.921796+0000","last_peered":"2024-09-12T19:12:23.921796+0000","last_clean":"2024-09-12T19:12:23.921796+0000","last_became_active":"2024-09-12T18:26:49.909591+0000","last_became_peered":"2024-09-12T18:26:49.909591+0000","last_unstale":"2024-09-12T19:12:23.921796+0000","last_undegraded":"2024-09-12T19:12:23.921796+0000","last_fullsized":"2024-09-12T19:12:23.921796+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.427369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":451,"num_write":354,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'445","reported_seq":1921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.106331+0000","last_change":"2024-09-12T18:27:11.827439+0000","last_active":"2024-09-12T19:13:43.106331+0000","last_peered":"2024-09-12T19:13:43.106331+0000","last_clean":"2024-09-12T19:13:43.106331+0000","last_became_active":"2024-09-12T18:27:11.825677+0000","last_became_peered":"2024-09-12T18:27:11.825677+0000","last_unstale":"2024-09-12T19:13:43.106331+0000","last_undegraded":"2024-09-12T19:13:43.106331+0000","last_fullsized":"2024-09-12T19:13:43.106331+0000","mapping_epoch":37,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:25.109981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2226,"num_read_kb":2089,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903232+0000","last_change":"2024-09-12T18:26:28.282837+0000","last_active":"2024-09-12T19:10:37.903232+0000","last_peered":"2024-09-12T19:10:37.903232+0000","last_clean":"2024-09-12T19:10:37.903232+0000","last_became_active":"2024-09-12T18:26:25.486681+0000","last_became_peered":"2024-09-12T18:26:25.486681+0000","last_unstale":"2024-09-12T19:10:37.903232+0000","last_undegraded":"2024-09-12T19:10:37.903232+0000","last_fullsized":"2024-09-12T19:10:37.903232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:48.632695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001127308,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'354","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:35.534251+0000","last_change":"2024-09-12T18:26:39.853101+0000","last_active":"2024-09-12T19:13:35.534251+0000","last_peered":"2024-09-12T19:13:35.534251+0000","last_clean":"2024-09-12T19:13:35.534251+0000","last_became_active":"2024-09-12T18:26:39.852604+0000","last_became_peered":"2024-09-12T18:26:39.852604+0000","last_unstale":"2024-09-12T19:13:35.534251+0000","last_undegraded":"2024-09-12T19:13:35.534251+0000","last_fullsized":"2024-09-12T19:13:35.534251+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:00.197344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3657272,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":527,"num_read_kb":8880,"num_write":1199,"num_write_kb":32875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.889750+0000","last_change":"2024-09-12T18:26:43.858389+0000","last_active":"2024-09-12T19:10:03.889750+0000","last_peered":"2024-09-12T19:10:03.889750+0000","last_clean":"2024-09-12T19:10:03.889750+0000","last_became_active":"2024-09-12T18:26:43.857619+0000","last_became_peered":"2024-09-12T18:26:43.857619+0000","last_unstale":"2024-09-12T19:10:03.889750+0000","last_undegraded":"2024-09-12T19:10:03.889750+0000","last_fullsized":"2024-09-12T19:10:03.889750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:43.526191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1270","reported_seq":2772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.340316+0000","last_change":"2024-09-12T18:26:45.866866+0000","last_active":"2024-09-12T19:13:57.340316+0000","last_peered":"2024-09-12T19:13:57.340316+0000","last_clean":"2024-09-12T19:13:57.340316+0000","last_became_active":"2024-09-12T18:26:45.865530+0000","last_became_peered":"2024-09-12T18:26:45.865530+0000","last_unstale":"2024-09-12T19:13:57.340316+0000","last_undegraded":"2024-09-12T19:13:57.340316+0000","last_fullsized":"2024-09-12T19:13:57.340316+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:38.754345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155377,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1993,"num_read_kb":3658,"num_write":1108,"num_write_kb":952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:42.904610+0000","last_change":"2024-09-12T18:26:47.887431+0000","last_active":"2024-09-12T19:10:42.904610+0000","last_peered":"2024-09-12T19:10:42.904610+0000","last_clean":"2024-09-12T19:10:42.904610+0000","last_became_active":"2024-09-12T18:26:47.886707+0000","last_became_peered":"2024-09-12T18:26:47.886707+0000","last_unstale":"2024-09-12T19:10:42.904610+0000","last_undegraded":"2024-09-12T19:10:42.904610+0000","last_fullsized":"2024-09-12T19:10:42.904610+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:24.695168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'194","reported_seq":727,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:22.676957+0000","last_change":"2024-09-12T18:26:49.910993+0000","last_active":"2024-09-12T19:12:22.676957+0000","last_peered":"2024-09-12T19:12:22.676957+0000","last_clean":"2024-09-12T19:12:22.676957+0000","last_became_active":"2024-09-12T18:26:49.909802+0000","last_became_peered":"2024-09-12T18:26:49.909802+0000","last_unstale":"2024-09-12T19:12:22.676957+0000","last_undegraded":"2024-09-12T19:12:22.676957+0000","last_fullsized":"2024-09-12T19:12:22.676957+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:14.966749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":337,"num_read_kb":322,"num_write":434,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'391","reported_seq":1912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.102094+0000","last_change":"2024-09-12T18:26:41.869197+0000","last_active":"2024-09-12T19:13:43.102094+0000","last_peered":"2024-09-12T19:13:43.102094+0000","last_clean":"2024-09-12T19:13:43.102094+0000","last_became_active":"2024-09-12T18:26:41.868958+0000","last_became_peered":"2024-09-12T18:26:41.868958+0000","last_unstale":"2024-09-12T19:13:43.102094+0000","last_undegraded":"2024-09-12T19:13:43.102094+0000","last_fullsized":"2024-09-12T19:13:43.102094+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:46.271646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2137,"num_read_kb":2050,"num_write":435,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.880725+0000","last_change":"2024-09-12T18:26:27.893863+0000","last_active":"2024-09-12T19:10:13.880725+0000","last_peered":"2024-09-12T19:10:13.880725+0000","last_clean":"2024-09-12T19:10:13.880725+0000","last_became_active":"2024-09-12T18:26:25.559069+0000","last_became_peered":"2024-09-12T18:26:25.559069+0000","last_unstale":"2024-09-12T19:10:13.880725+0000","last_undegraded":"2024-09-12T19:10:13.880725+0000","last_fullsized":"2024-09-12T19:10:13.880725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:18.983449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065344600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'265","reported_seq":874,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.741585+0000","last_change":"2024-09-12T18:26:39.833083+0000","last_active":"2024-09-12T19:13:57.741585+0000","last_peered":"2024-09-12T19:13:57.741585+0000","last_clean":"2024-09-12T19:13:57.741585+0000","last_became_active":"2024-09-12T18:26:39.832766+0000","last_became_peered":"2024-09-12T18:26:39.832766+0000","last_unstale":"2024-09-12T19:13:57.741585+0000","last_undegraded":"2024-09-12T19:13:57.741585+0000","last_fullsized":"2024-09-12T19:13:57.741585+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:39.006582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9548513,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":351,"num_read_kb":10646,"num_write":844,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.878799+0000","last_change":"2024-09-12T18:26:43.844267+0000","last_active":"2024-09-12T19:10:03.878799+0000","last_peered":"2024-09-12T19:10:03.878799+0000","last_clean":"2024-09-12T19:10:03.878799+0000","last_became_active":"2024-09-12T18:26:43.843884+0000","last_became_peered":"2024-09-12T18:26:43.843884+0000","last_unstale":"2024-09-12T19:10:03.878799+0000","last_undegraded":"2024-09-12T19:10:03.878799+0000","last_fullsized":"2024-09-12T19:10:03.878799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:30.199439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'237","reported_seq":1345,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:40.758792+0000","last_change":"2024-09-12T18:26:46.025252+0000","last_active":"2024-09-12T19:13:40.758792+0000","last_peered":"2024-09-12T19:13:40.758792+0000","last_clean":"2024-09-12T19:13:40.758792+0000","last_became_active":"2024-09-12T18:26:46.024474+0000","last_became_peered":"2024-09-12T18:26:46.024474+0000","last_unstale":"2024-09-12T19:13:40.758792+0000","last_undegraded":"2024-09-12T19:13:40.758792+0000","last_fullsized":"2024-09-12T19:13:40.758792+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:08.550075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.922523+0000","last_change":"2024-09-12T18:26:47.890416+0000","last_active":"2024-09-12T19:10:33.922523+0000","last_peered":"2024-09-12T19:10:33.922523+0000","last_clean":"2024-09-12T19:10:33.922523+0000","last_became_active":"2024-09-12T18:26:47.889718+0000","last_became_peered":"2024-09-12T18:26:47.889718+0000","last_unstale":"2024-09-12T19:10:33.922523+0000","last_undegraded":"2024-09-12T19:10:33.922523+0000","last_fullsized":"2024-09-12T19:10:33.922523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:51.602872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'249","reported_seq":844,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.430831+0000","last_change":"2024-09-12T18:26:49.913279+0000","last_active":"2024-09-12T19:12:23.430831+0000","last_peered":"2024-09-12T19:12:23.430831+0000","last_clean":"2024-09-12T19:12:23.430831+0000","last_became_active":"2024-09-12T18:26:49.912488+0000","last_became_peered":"2024-09-12T18:26:49.912488+0000","last_unstale":"2024-09-12T19:12:23.430831+0000","last_undegraded":"2024-09-12T19:12:23.430831+0000","last_fullsized":"2024-09-12T19:12:23.430831+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:27.428030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":492,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'918","reported_seq":2678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:00.244376+0000","last_change":"2024-09-12T18:26:41.849621+0000","last_active":"2024-09-12T19:12:00.244376+0000","last_peered":"2024-09-12T19:12:00.244376+0000","last_clean":"2024-09-12T19:12:00.244376+0000","last_became_active":"2024-09-12T18:26:41.847403+0000","last_became_peered":"2024-09-12T18:26:41.847403+0000","last_unstale":"2024-09-12T19:12:00.244376+0000","last_undegraded":"2024-09-12T19:12:00.244376+0000","last_fullsized":"2024-09-12T19:12:00.244376+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:03.076819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4497,"num_read_kb":4050,"num_write":1227,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.891846+0000","last_change":"2024-09-12T18:26:27.491626+0000","last_active":"2024-09-12T19:10:13.891846+0000","last_peered":"2024-09-12T19:10:13.891846+0000","last_clean":"2024-09-12T19:10:13.891846+0000","last_became_active":"2024-09-12T18:26:25.483909+0000","last_became_peered":"2024-09-12T18:26:25.483909+0000","last_unstale":"2024-09-12T19:10:13.891846+0000","last_undegraded":"2024-09-12T19:10:13.891846+0000","last_fullsized":"2024-09-12T19:10:13.891846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:34.647003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002260153,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'246","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:29.074334+0000","last_change":"2024-09-12T18:26:39.847712+0000","last_active":"2024-09-12T19:11:29.074334+0000","last_peered":"2024-09-12T19:11:29.074334+0000","last_clean":"2024-09-12T19:11:29.074334+0000","last_became_active":"2024-09-12T18:26:39.847002+0000","last_became_peered":"2024-09-12T18:26:39.847002+0000","last_unstale":"2024-09-12T19:11:29.074334+0000","last_undegraded":"2024-09-12T19:11:29.074334+0000","last_fullsized":"2024-09-12T19:11:29.074334+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:18.232097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11547385,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":554,"num_read_kb":6223,"num_write":894,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.923800+0000","last_change":"2024-09-12T18:26:43.862162+0000","last_active":"2024-09-12T19:10:38.923800+0000","last_peered":"2024-09-12T19:10:38.923800+0000","last_clean":"2024-09-12T19:10:38.923800+0000","last_became_active":"2024-09-12T18:26:43.861753+0000","last_became_peered":"2024-09-12T18:26:43.861753+0000","last_unstale":"2024-09-12T19:10:38.923800+0000","last_undegraded":"2024-09-12T19:10:38.923800+0000","last_fullsized":"2024-09-12T19:10:38.923800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:33.728113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'111","reported_seq":649,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.724941+0000","last_change":"2024-09-12T18:26:45.857442+0000","last_active":"2024-09-12T19:12:18.724941+0000","last_peered":"2024-09-12T19:12:18.724941+0000","last_clean":"2024-09-12T19:12:18.724941+0000","last_became_active":"2024-09-12T18:26:45.856615+0000","last_became_peered":"2024-09-12T18:26:45.856615+0000","last_unstale":"2024-09-12T19:12:18.724941+0000","last_undegraded":"2024-09-12T19:12:18.724941+0000","last_fullsized":"2024-09-12T19:12:18.724941+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:39.665638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.893516+0000","last_change":"2024-09-12T18:26:47.885794+0000","last_active":"2024-09-12T19:10:08.893516+0000","last_peered":"2024-09-12T19:10:08.893516+0000","last_clean":"2024-09-12T19:10:08.893516+0000","last_became_active":"2024-09-12T18:26:47.884981+0000","last_became_peered":"2024-09-12T18:26:47.884981+0000","last_unstale":"2024-09-12T19:10:08.893516+0000","last_undegraded":"2024-09-12T19:10:08.893516+0000","last_fullsized":"2024-09-12T19:10:08.893516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:07.204617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'140","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.019034+0000","last_change":"2024-09-12T18:26:49.918948+0000","last_active":"2024-09-12T19:13:43.019034+0000","last_peered":"2024-09-12T19:13:43.019034+0000","last_clean":"2024-09-12T19:13:43.019034+0000","last_became_active":"2024-09-12T18:26:49.918043+0000","last_became_peered":"2024-09-12T18:26:49.918043+0000","last_unstale":"2024-09-12T19:13:43.019034+0000","last_undegraded":"2024-09-12T19:13:43.019034+0000","last_fullsized":"2024-09-12T19:13:43.019034+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:07.565002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":258,"num_write":354,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'546","reported_seq":2235,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.289400+0000","last_change":"2024-09-12T18:26:41.878502+0000","last_active":"2024-09-12T19:12:23.289400+0000","last_peered":"2024-09-12T19:12:23.289400+0000","last_clean":"2024-09-12T19:12:23.289400+0000","last_became_active":"2024-09-12T18:26:41.878269+0000","last_became_peered":"2024-09-12T18:26:41.878269+0000","last_unstale":"2024-09-12T19:12:23.289400+0000","last_undegraded":"2024-09-12T19:12:23.289400+0000","last_fullsized":"2024-09-12T19:12:23.289400+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:02.850426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2954,"num_read_kb":2745,"num_write":669,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'402","reported_seq":1095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.897624+0000","last_change":"2024-09-12T18:26:39.853539+0000","last_active":"2024-09-12T19:10:38.897624+0000","last_peered":"2024-09-12T19:10:38.897624+0000","last_clean":"2024-09-12T19:10:38.897624+0000","last_became_active":"2024-09-12T18:26:39.851739+0000","last_became_peered":"2024-09-12T18:26:39.851739+0000","last_unstale":"2024-09-12T19:10:38.897624+0000","last_undegraded":"2024-09-12T19:10:38.897624+0000","last_fullsized":"2024-09-12T19:10:38.897624+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:22.623593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8737309,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":796,"num_read_kb":21229,"num_write":1305,"num_write_kb":18457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:12.904532+0000","last_change":"2024-09-12T18:26:27.492857+0000","last_active":"2024-09-12T19:10:12.904532+0000","last_peered":"2024-09-12T19:10:12.904532+0000","last_clean":"2024-09-12T19:10:12.904532+0000","last_became_active":"2024-09-12T18:26:25.474997+0000","last_became_peered":"2024-09-12T18:26:25.474997+0000","last_unstale":"2024-09-12T19:10:12.904532+0000","last_undegraded":"2024-09-12T19:10:12.904532+0000","last_fullsized":"2024-09-12T19:10:12.904532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:39.276451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099306900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.921024+0000","last_change":"2024-09-12T18:26:43.866505+0000","last_active":"2024-09-12T19:10:28.921024+0000","last_peered":"2024-09-12T19:10:28.921024+0000","last_clean":"2024-09-12T19:10:28.921024+0000","last_became_active":"2024-09-12T18:26:43.865697+0000","last_became_peered":"2024-09-12T18:26:43.865697+0000","last_unstale":"2024-09-12T19:10:28.921024+0000","last_undegraded":"2024-09-12T19:10:28.921024+0000","last_fullsized":"2024-09-12T19:10:28.921024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:41.285586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'542","reported_seq":1197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.959962+0000","last_change":"2024-09-12T18:26:45.880984+0000","last_active":"2024-09-12T19:13:43.959962+0000","last_peered":"2024-09-12T19:13:43.959962+0000","last_clean":"2024-09-12T19:13:43.959962+0000","last_became_active":"2024-09-12T18:26:45.877100+0000","last_became_peered":"2024-09-12T18:26:45.877100+0000","last_unstale":"2024-09-12T19:13:43.959962+0000","last_undegraded":"2024-09-12T19:13:43.959962+0000","last_fullsized":"2024-09-12T19:13:43.959962+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:31.277291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117225,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":926,"num_read_kb":1878,"num_write":804,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:34.105870+0000","last_change":"2024-09-12T18:26:47.900861+0000","last_active":"2024-09-12T19:10:34.105870+0000","last_peered":"2024-09-12T19:10:34.105870+0000","last_clean":"2024-09-12T19:10:34.105870+0000","last_became_active":"2024-09-12T18:26:47.900217+0000","last_became_peered":"2024-09-12T18:26:47.900217+0000","last_unstale":"2024-09-12T19:10:34.105870+0000","last_undegraded":"2024-09-12T19:10:34.105870+0000","last_fullsized":"2024-09-12T19:10:34.105870+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:22.630784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'141","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.613946+0000","last_change":"2024-09-12T18:26:49.921916+0000","last_active":"2024-09-12T19:12:18.613946+0000","last_peered":"2024-09-12T19:12:18.613946+0000","last_clean":"2024-09-12T19:12:18.613946+0000","last_became_active":"2024-09-12T18:26:49.921123+0000","last_became_peered":"2024-09-12T18:26:49.921123+0000","last_unstale":"2024-09-12T19:12:18.613946+0000","last_undegraded":"2024-09-12T19:12:18.613946+0000","last_fullsized":"2024-09-12T19:12:18.613946+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:45.398942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":212,"num_read_kb":188,"num_write":350,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'425","reported_seq":1878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.623418+0000","last_change":"2024-09-12T18:26:41.869757+0000","last_active":"2024-09-12T19:12:18.623418+0000","last_peered":"2024-09-12T19:12:18.623418+0000","last_clean":"2024-09-12T19:12:18.623418+0000","last_became_active":"2024-09-12T18:26:41.869426+0000","last_became_peered":"2024-09-12T18:26:41.869426+0000","last_unstale":"2024-09-12T19:12:18.623418+0000","last_undegraded":"2024-09-12T19:12:18.623418+0000","last_fullsized":"2024-09-12T19:12:18.623418+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:16.916527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2246,"num_read_kb":2097,"num_write":505,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'332","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.701512+0000","last_change":"2024-09-12T18:26:39.833175+0000","last_active":"2024-09-12T19:13:57.701512+0000","last_peered":"2024-09-12T19:13:57.701512+0000","last_clean":"2024-09-12T19:13:57.701512+0000","last_became_active":"2024-09-12T18:26:39.832593+0000","last_became_peered":"2024-09-12T18:26:39.832593+0000","last_unstale":"2024-09-12T19:13:57.701512+0000","last_undegraded":"2024-09-12T19:13:57.701512+0000","last_fullsized":"2024-09-12T19:13:57.701512+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:39.366882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6812624,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":611,"num_read_kb":23528,"num_write":1181,"num_write_kb":24783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899815+0000","last_change":"2024-09-12T18:26:28.282666+0000","last_active":"2024-09-12T19:10:22.899815+0000","last_peered":"2024-09-12T19:10:22.899815+0000","last_clean":"2024-09-12T19:10:22.899815+0000","last_became_active":"2024-09-12T18:26:25.484938+0000","last_became_peered":"2024-09-12T18:26:25.484938+0000","last_unstale":"2024-09-12T19:10:22.899815+0000","last_undegraded":"2024-09-12T19:10:22.899815+0000","last_fullsized":"2024-09-12T19:10:22.899815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:50.645807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001083194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.898070+0000","last_change":"2024-09-12T18:26:43.864066+0000","last_active":"2024-09-12T19:10:28.898070+0000","last_peered":"2024-09-12T19:10:28.898070+0000","last_clean":"2024-09-12T19:10:28.898070+0000","last_became_active":"2024-09-12T18:26:43.863388+0000","last_became_peered":"2024-09-12T18:26:43.863388+0000","last_unstale":"2024-09-12T19:10:28.898070+0000","last_undegraded":"2024-09-12T19:10:28.898070+0000","last_fullsized":"2024-09-12T19:10:28.898070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:19.436463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'160","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:15.347431+0000","last_change":"2024-09-12T18:26:46.020793+0000","last_active":"2024-09-12T19:11:15.347431+0000","last_peered":"2024-09-12T19:11:15.347431+0000","last_clean":"2024-09-12T19:11:15.347431+0000","last_became_active":"2024-09-12T18:26:46.020043+0000","last_became_peered":"2024-09-12T18:26:46.020043+0000","last_unstale":"2024-09-12T19:11:15.347431+0000","last_undegraded":"2024-09-12T19:11:15.347431+0000","last_fullsized":"2024-09-12T19:11:15.347431+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:28.384889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":189,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'811","reported_seq":2654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.020813+0000","last_change":"2024-09-12T18:26:47.880379+0000","last_active":"2024-09-12T19:13:44.020813+0000","last_peered":"2024-09-12T19:13:44.020813+0000","last_clean":"2024-09-12T19:13:44.020813+0000","last_became_active":"2024-09-12T18:26:47.879630+0000","last_became_peered":"2024-09-12T18:26:47.879630+0000","last_unstale":"2024-09-12T19:13:44.020813+0000","last_undegraded":"2024-09-12T19:13:44.020813+0000","last_fullsized":"2024-09-12T19:13:44.020813+0000","mapping_epoch":32,"log_start":"265'800","ondisk_log_start":"265'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:34.644082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'140","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.115335+0000","last_change":"2024-09-12T18:26:49.920666+0000","last_active":"2024-09-12T19:12:24.115335+0000","last_peered":"2024-09-12T19:12:24.115335+0000","last_clean":"2024-09-12T19:12:24.115335+0000","last_became_active":"2024-09-12T18:26:49.919846+0000","last_became_peered":"2024-09-12T18:26:49.919846+0000","last_unstale":"2024-09-12T19:12:24.115335+0000","last_undegraded":"2024-09-12T19:12:24.115335+0000","last_fullsized":"2024-09-12T19:12:24.115335+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:00.339860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":263,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'481","reported_seq":2008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.125760+0000","last_change":"2024-09-12T18:26:41.862442+0000","last_active":"2024-09-12T19:12:24.125760+0000","last_peered":"2024-09-12T19:12:24.125760+0000","last_clean":"2024-09-12T19:12:24.125760+0000","last_became_active":"2024-09-12T18:26:41.862008+0000","last_became_peered":"2024-09-12T18:26:41.862008+0000","last_unstale":"2024-09-12T19:12:24.125760+0000","last_undegraded":"2024-09-12T19:12:24.125760+0000","last_fullsized":"2024-09-12T19:12:24.125760+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:52.293333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":2263,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'276","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:21.671305+0000","last_change":"2024-09-12T18:26:39.865325+0000","last_active":"2024-09-12T19:11:21.671305+0000","last_peered":"2024-09-12T19:11:21.671305+0000","last_clean":"2024-09-12T19:11:21.671305+0000","last_became_active":"2024-09-12T18:26:39.865123+0000","last_became_peered":"2024-09-12T18:26:39.865123+0000","last_unstale":"2024-09-12T19:11:21.671305+0000","last_undegraded":"2024-09-12T19:11:21.671305+0000","last_fullsized":"2024-09-12T19:11:21.671305+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:13.963084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9783150,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":415,"num_read_kb":68443,"num_write":1020,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:47.898557+0000","last_change":"2024-09-12T18:26:27.493293+0000","last_active":"2024-09-12T19:09:47.898557+0000","last_peered":"2024-09-12T19:09:47.898557+0000","last_clean":"2024-09-12T19:09:47.898557+0000","last_became_active":"2024-09-12T18:26:25.485137+0000","last_became_peered":"2024-09-12T18:26:25.485137+0000","last_unstale":"2024-09-12T19:09:47.898557+0000","last_undegraded":"2024-09-12T19:09:47.898557+0000","last_fullsized":"2024-09-12T19:09:47.898557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:37.081707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013350759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:29.104750+0000","last_change":"2024-09-12T18:26:43.876064+0000","last_active":"2024-09-12T19:10:29.104750+0000","last_peered":"2024-09-12T19:10:29.104750+0000","last_clean":"2024-09-12T19:10:29.104750+0000","last_became_active":"2024-09-12T18:26:43.874845+0000","last_became_peered":"2024-09-12T18:26:43.874845+0000","last_unstale":"2024-09-12T19:10:29.104750+0000","last_undegraded":"2024-09-12T19:10:29.104750+0000","last_fullsized":"2024-09-12T19:10:29.104750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:36.440895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'106","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.584442+0000","last_change":"2024-09-12T18:26:45.864296+0000","last_active":"2024-09-12T19:11:07.584442+0000","last_peered":"2024-09-12T19:11:07.584442+0000","last_clean":"2024-09-12T19:11:07.584442+0000","last_became_active":"2024-09-12T18:26:45.863254+0000","last_became_peered":"2024-09-12T18:26:45.863254+0000","last_unstale":"2024-09-12T19:11:07.584442+0000","last_undegraded":"2024-09-12T19:11:07.584442+0000","last_fullsized":"2024-09-12T19:11:07.584442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:25.709734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'802","reported_seq":2516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.027653+0000","last_change":"2024-09-12T18:26:47.900388+0000","last_active":"2024-09-12T19:13:44.027653+0000","last_peered":"2024-09-12T19:13:44.027653+0000","last_clean":"2024-09-12T19:13:44.027653+0000","last_became_active":"2024-09-12T18:26:47.899682+0000","last_became_peered":"2024-09-12T18:26:47.899682+0000","last_unstale":"2024-09-12T19:13:44.027653+0000","last_undegraded":"2024-09-12T19:13:44.027653+0000","last_fullsized":"2024-09-12T19:13:44.027653+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:26.128123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'166","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.560824+0000","last_change":"2024-09-12T18:26:49.918711+0000","last_active":"2024-09-12T19:12:06.560824+0000","last_peered":"2024-09-12T19:12:06.560824+0000","last_clean":"2024-09-12T19:12:06.560824+0000","last_became_active":"2024-09-12T18:26:49.917537+0000","last_became_peered":"2024-09-12T18:26:49.917537+0000","last_unstale":"2024-09-12T19:12:06.560824+0000","last_undegraded":"2024-09-12T19:12:06.560824+0000","last_fullsized":"2024-09-12T19:12:06.560824+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:42.696961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":124,"num_write":364,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'443","reported_seq":1936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.769155+0000","last_change":"2024-09-12T18:26:41.872406+0000","last_active":"2024-09-12T19:12:08.769155+0000","last_peered":"2024-09-12T19:12:08.769155+0000","last_clean":"2024-09-12T19:12:08.769155+0000","last_became_active":"2024-09-12T18:26:41.871518+0000","last_became_peered":"2024-09-12T18:26:41.871518+0000","last_unstale":"2024-09-12T19:12:08.769155+0000","last_undegraded":"2024-09-12T19:12:08.769155+0000","last_fullsized":"2024-09-12T19:12:08.769155+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:26.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2145,"num_write":516,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'246","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:36.603533+0000","last_change":"2024-09-12T18:26:39.834460+0000","last_active":"2024-09-12T19:13:36.603533+0000","last_peered":"2024-09-12T19:13:36.603533+0000","last_clean":"2024-09-12T19:13:36.603533+0000","last_became_active":"2024-09-12T18:26:39.833924+0000","last_became_peered":"2024-09-12T18:26:39.833924+0000","last_unstale":"2024-09-12T19:13:36.603533+0000","last_undegraded":"2024-09-12T19:13:36.603533+0000","last_fullsized":"2024-09-12T19:13:36.603533+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:19.120900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21176942,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":411,"num_read_kb":59967,"num_write":947,"num_write_kb":34278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.888730+0000","last_change":"2024-09-12T18:26:27.699071+0000","last_active":"2024-09-12T19:09:48.888730+0000","last_peered":"2024-09-12T19:09:48.888730+0000","last_clean":"2024-09-12T19:09:48.888730+0000","last_became_active":"2024-09-12T18:26:25.487465+0000","last_became_peered":"2024-09-12T18:26:25.487465+0000","last_unstale":"2024-09-12T19:09:48.888730+0000","last_undegraded":"2024-09-12T19:09:48.888730+0000","last_fullsized":"2024-09-12T19:09:48.888730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:22.342394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010368949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.924444+0000","last_change":"2024-09-12T18:26:43.851056+0000","last_active":"2024-09-12T19:10:48.924444+0000","last_peered":"2024-09-12T19:10:48.924444+0000","last_clean":"2024-09-12T19:10:48.924444+0000","last_became_active":"2024-09-12T18:26:43.850274+0000","last_became_peered":"2024-09-12T18:26:43.850274+0000","last_unstale":"2024-09-12T19:10:48.924444+0000","last_undegraded":"2024-09-12T19:10:48.924444+0000","last_fullsized":"2024-09-12T19:10:48.924444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:39.140912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'713","reported_seq":1417,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.172805+0000","last_change":"2024-09-12T18:26:46.021959+0000","last_active":"2024-09-12T19:13:57.172805+0000","last_peered":"2024-09-12T19:13:57.172805+0000","last_clean":"2024-09-12T19:13:57.172805+0000","last_became_active":"2024-09-12T18:26:46.021217+0000","last_became_peered":"2024-09-12T18:26:46.021217+0000","last_unstale":"2024-09-12T19:13:57.172805+0000","last_undegraded":"2024-09-12T19:13:57.172805+0000","last_fullsized":"2024-09-12T19:13:57.172805+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:41.193709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200250,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1278,"num_read_kb":2908,"num_write":1052,"num_write_kb":915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.920778+0000","last_change":"2024-09-12T18:26:47.903443+0000","last_active":"2024-09-12T19:10:33.920778+0000","last_peered":"2024-09-12T19:10:33.920778+0000","last_clean":"2024-09-12T19:10:33.920778+0000","last_became_active":"2024-09-12T18:26:47.902750+0000","last_became_peered":"2024-09-12T18:26:47.902750+0000","last_unstale":"2024-09-12T19:10:33.920778+0000","last_undegraded":"2024-09-12T19:10:33.920778+0000","last_fullsized":"2024-09-12T19:10:33.920778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:44.433901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'107","reported_seq":606,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:06.951330+0000","last_change":"2024-09-12T18:26:49.920307+0000","last_active":"2024-09-12T19:11:06.951330+0000","last_peered":"2024-09-12T19:11:06.951330+0000","last_clean":"2024-09-12T19:11:06.951330+0000","last_became_active":"2024-09-12T18:26:49.919630+0000","last_became_peered":"2024-09-12T18:26:49.919630+0000","last_unstale":"2024-09-12T19:11:06.951330+0000","last_undegraded":"2024-09-12T19:11:06.951330+0000","last_fullsized":"2024-09-12T19:11:06.951330+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:18.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":269,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'143","reported_seq":705,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.274239+0000","last_change":"2024-09-12T18:26:49.913310+0000","last_active":"2024-09-12T19:12:24.274239+0000","last_peered":"2024-09-12T19:12:24.274239+0000","last_clean":"2024-09-12T19:12:24.274239+0000","last_became_active":"2024-09-12T18:26:49.912589+0000","last_became_peered":"2024-09-12T18:26:49.912589+0000","last_unstale":"2024-09-12T19:12:24.274239+0000","last_undegraded":"2024-09-12T19:12:24.274239+0000","last_fullsized":"2024-09-12T19:12:24.274239+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:07.282432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":221,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'913","reported_seq":2534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.894035+0000","last_change":"2024-09-12T18:26:41.876618+0000","last_active":"2024-09-12T19:12:07.894035+0000","last_peered":"2024-09-12T19:12:07.894035+0000","last_clean":"2024-09-12T19:12:07.894035+0000","last_became_active":"2024-09-12T18:26:41.875870+0000","last_became_peered":"2024-09-12T18:26:41.875870+0000","last_unstale":"2024-09-12T19:12:07.894035+0000","last_undegraded":"2024-09-12T19:12:07.894035+0000","last_fullsized":"2024-09-12T19:12:07.894035+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:06.713897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4445,"num_read_kb":3959,"num_write":1252,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'247","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:19.876577+0000","last_change":"2024-09-12T18:26:39.871102+0000","last_active":"2024-09-12T19:12:19.876577+0000","last_peered":"2024-09-12T19:12:19.876577+0000","last_clean":"2024-09-12T19:12:19.876577+0000","last_became_active":"2024-09-12T18:26:39.870576+0000","last_became_peered":"2024-09-12T18:26:39.870576+0000","last_unstale":"2024-09-12T19:12:19.876577+0000","last_undegraded":"2024-09-12T19:12:19.876577+0000","last_fullsized":"2024-09-12T19:12:19.876577+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:00.119644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14281508,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":389,"num_read_kb":31608,"num_write":858,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.917883+0000","last_change":"2024-09-12T18:26:43.865954+0000","last_active":"2024-09-12T19:11:07.917883+0000","last_peered":"2024-09-12T19:11:07.917883+0000","last_clean":"2024-09-12T19:11:07.917883+0000","last_became_active":"2024-09-12T18:26:43.864969+0000","last_became_peered":"2024-09-12T18:26:43.864969+0000","last_unstale":"2024-09-12T19:11:07.917883+0000","last_undegraded":"2024-09-12T19:11:07.917883+0000","last_fullsized":"2024-09-12T19:11:07.917883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:54.874241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'271","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:28.737857+0000","last_change":"2024-09-12T18:26:45.866194+0000","last_active":"2024-09-12T19:13:28.737857+0000","last_peered":"2024-09-12T19:13:28.737857+0000","last_clean":"2024-09-12T19:13:28.737857+0000","last_became_active":"2024-09-12T18:26:45.865329+0000","last_became_peered":"2024-09-12T18:26:45.865329+0000","last_unstale":"2024-09-12T19:13:28.737857+0000","last_undegraded":"2024-09-12T19:13:28.737857+0000","last_fullsized":"2024-09-12T19:13:28.737857+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:49.534078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59089,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":960,"num_write":376,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.929904+0000","last_change":"2024-09-12T18:26:47.891460+0000","last_active":"2024-09-12T19:11:08.929904+0000","last_peered":"2024-09-12T19:11:08.929904+0000","last_clean":"2024-09-12T19:11:08.929904+0000","last_became_active":"2024-09-12T18:26:47.890741+0000","last_became_peered":"2024-09-12T18:26:47.890741+0000","last_unstale":"2024-09-12T19:11:08.929904+0000","last_undegraded":"2024-09-12T19:11:08.929904+0000","last_fullsized":"2024-09-12T19:11:08.929904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:13.839409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'196","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.440206+0000","last_change":"2024-09-12T18:26:49.915054+0000","last_active":"2024-09-12T19:11:38.440206+0000","last_peered":"2024-09-12T19:11:38.440206+0000","last_clean":"2024-09-12T19:11:38.440206+0000","last_became_active":"2024-09-12T18:26:49.914506+0000","last_became_peered":"2024-09-12T18:26:49.914506+0000","last_unstale":"2024-09-12T19:11:38.440206+0000","last_undegraded":"2024-09-12T19:11:38.440206+0000","last_fullsized":"2024-09-12T19:11:38.440206+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:39.521599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":157,"num_write":456,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'900","reported_seq":2436,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.125291+0000","last_change":"2024-09-12T18:26:41.868353+0000","last_active":"2024-09-12T19:12:24.125291+0000","last_peered":"2024-09-12T19:12:24.125291+0000","last_clean":"2024-09-12T19:12:24.125291+0000","last_became_active":"2024-09-12T18:26:41.868082+0000","last_became_peered":"2024-09-12T18:26:41.868082+0000","last_unstale":"2024-09-12T19:12:24.125291+0000","last_undegraded":"2024-09-12T19:12:24.125291+0000","last_fullsized":"2024-09-12T19:12:24.125291+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:35.031358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4276,"num_read_kb":3807,"num_write":1253,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'357","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.935546+0000","last_change":"2024-09-12T18:26:39.870444+0000","last_active":"2024-09-12T19:13:57.935546+0000","last_peered":"2024-09-12T19:13:57.935546+0000","last_clean":"2024-09-12T19:13:57.935546+0000","last_became_active":"2024-09-12T18:26:39.869754+0000","last_became_peered":"2024-09-12T18:26:39.869754+0000","last_unstale":"2024-09-12T19:13:57.935546+0000","last_undegraded":"2024-09-12T19:13:57.935546+0000","last_fullsized":"2024-09-12T19:13:57.935546+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:26.428249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7093992,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":495,"num_read_kb":32033,"num_write":1196,"num_write_kb":47606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"36'5","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.871279+0000","last_change":"2024-09-12T18:26:43.854895+0000","last_active":"2024-09-12T19:13:43.871279+0000","last_peered":"2024-09-12T19:13:43.871279+0000","last_clean":"2024-09-12T19:13:43.871279+0000","last_became_active":"2024-09-12T18:26:43.854155+0000","last_became_peered":"2024-09-12T18:26:43.854155+0000","last_unstale":"2024-09-12T19:13:43.871279+0000","last_undegraded":"2024-09-12T19:13:43.871279+0000","last_fullsized":"2024-09-12T19:13:43.871279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:39.758296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'67","reported_seq":571,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.295664+0000","last_change":"2024-09-12T18:26:45.880353+0000","last_active":"2024-09-12T19:12:23.295664+0000","last_peered":"2024-09-12T19:12:23.295664+0000","last_clean":"2024-09-12T19:12:23.295664+0000","last_became_active":"2024-09-12T18:26:45.876785+0000","last_became_peered":"2024-09-12T18:26:45.876785+0000","last_unstale":"2024-09-12T19:12:23.295664+0000","last_undegraded":"2024-09-12T19:12:23.295664+0000","last_fullsized":"2024-09-12T19:12:23.295664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:44.259605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910233+0000","last_change":"2024-09-12T18:26:47.891685+0000","last_active":"2024-09-12T19:11:07.910233+0000","last_peered":"2024-09-12T19:11:07.910233+0000","last_clean":"2024-09-12T19:11:07.910233+0000","last_became_active":"2024-09-12T18:26:47.890879+0000","last_became_peered":"2024-09-12T18:26:47.890879+0000","last_unstale":"2024-09-12T19:11:07.910233+0000","last_undegraded":"2024-09-12T19:11:07.910233+0000","last_fullsized":"2024-09-12T19:11:07.910233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:38.226570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'240","reported_seq":768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.263121+0000","last_change":"2024-09-12T18:26:49.926668+0000","last_active":"2024-09-12T19:12:23.263121+0000","last_peered":"2024-09-12T19:12:23.263121+0000","last_clean":"2024-09-12T19:12:23.263121+0000","last_became_active":"2024-09-12T18:26:49.925984+0000","last_became_peered":"2024-09-12T18:26:49.925984+0000","last_unstale":"2024-09-12T19:12:23.263121+0000","last_undegraded":"2024-09-12T19:12:23.263121+0000","last_fullsized":"2024-09-12T19:12:23.263121+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:41.544032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":350,"num_read_kb":337,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'459","reported_seq":2018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.554179+0000","last_change":"2024-09-12T18:26:41.882252+0000","last_active":"2024-09-12T19:12:09.554179+0000","last_peered":"2024-09-12T19:12:09.554179+0000","last_clean":"2024-09-12T19:12:09.554179+0000","last_became_active":"2024-09-12T18:26:41.881971+0000","last_became_peered":"2024-09-12T18:26:41.881971+0000","last_unstale":"2024-09-12T19:12:09.554179+0000","last_undegraded":"2024-09-12T19:12:09.554179+0000","last_fullsized":"2024-09-12T19:12:09.554179+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:07.504109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2569,"num_read_kb":2413,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'279","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.960344+0000","last_change":"2024-09-12T18:26:39.874319+0000","last_active":"2024-09-12T19:12:08.960344+0000","last_peered":"2024-09-12T19:12:08.960344+0000","last_clean":"2024-09-12T19:12:08.960344+0000","last_became_active":"2024-09-12T18:26:39.873510+0000","last_became_peered":"2024-09-12T18:26:39.873510+0000","last_unstale":"2024-09-12T19:12:08.960344+0000","last_undegraded":"2024-09-12T19:12:08.960344+0000","last_fullsized":"2024-09-12T19:12:08.960344+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:47.297748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2207284,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":450,"num_read_kb":9365,"num_write":1066,"num_write_kb":22463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910172+0000","last_change":"2024-09-12T18:26:43.860596+0000","last_active":"2024-09-12T19:11:07.910172+0000","last_peered":"2024-09-12T19:11:07.910172+0000","last_clean":"2024-09-12T19:11:07.910172+0000","last_became_active":"2024-09-12T18:26:43.859847+0000","last_became_peered":"2024-09-12T18:26:43.859847+0000","last_unstale":"2024-09-12T19:11:07.910172+0000","last_undegraded":"2024-09-12T19:11:07.910172+0000","last_fullsized":"2024-09-12T19:11:07.910172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:16.685561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'313","reported_seq":896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:28.737941+0000","last_change":"2024-09-12T18:26:45.878384+0000","last_active":"2024-09-12T19:13:28.737941+0000","last_peered":"2024-09-12T19:13:28.737941+0000","last_clean":"2024-09-12T19:13:28.737941+0000","last_became_active":"2024-09-12T18:26:45.877790+0000","last_became_peered":"2024-09-12T18:26:45.877790+0000","last_unstale":"2024-09-12T19:13:28.737941+0000","last_undegraded":"2024-09-12T19:13:28.737941+0000","last_fullsized":"2024-09-12T19:13:28.737941+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:03.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":1028,"num_write":412,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.906698+0000","last_change":"2024-09-12T18:26:47.888972+0000","last_active":"2024-09-12T19:11:08.906698+0000","last_peered":"2024-09-12T19:11:08.906698+0000","last_clean":"2024-09-12T19:11:08.906698+0000","last_became_active":"2024-09-12T18:26:47.888252+0000","last_became_peered":"2024-09-12T18:26:47.888252+0000","last_unstale":"2024-09-12T19:11:08.906698+0000","last_undegraded":"2024-09-12T19:11:08.906698+0000","last_fullsized":"2024-09-12T19:11:08.906698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:23.691736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'144","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.914495+0000","last_change":"2024-09-12T18:26:49.923128+0000","last_active":"2024-09-12T19:11:19.914495+0000","last_peered":"2024-09-12T19:11:19.914495+0000","last_clean":"2024-09-12T19:11:19.914495+0000","last_became_active":"2024-09-12T18:26:49.922459+0000","last_became_peered":"2024-09-12T18:26:49.922459+0000","last_unstale":"2024-09-12T19:11:19.914495+0000","last_undegraded":"2024-09-12T19:11:19.914495+0000","last_fullsized":"2024-09-12T19:11:19.914495+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:13.475689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":460,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":153,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'471","reported_seq":1980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.622655+0000","last_change":"2024-09-12T18:26:41.851184+0000","last_active":"2024-09-12T19:12:18.622655+0000","last_peered":"2024-09-12T19:12:18.622655+0000","last_clean":"2024-09-12T19:12:18.622655+0000","last_became_active":"2024-09-12T18:26:41.850749+0000","last_became_peered":"2024-09-12T18:26:41.850749+0000","last_unstale":"2024-09-12T19:12:18.622655+0000","last_undegraded":"2024-09-12T19:12:18.622655+0000","last_fullsized":"2024-09-12T19:12:18.622655+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:25.945669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2503,"num_read_kb":2331,"num_write":575,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'323","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.197323+0000","last_change":"2024-09-12T18:26:39.854610+0000","last_active":"2024-09-12T19:12:08.197323+0000","last_peered":"2024-09-12T19:12:08.197323+0000","last_clean":"2024-09-12T19:12:08.197323+0000","last_became_active":"2024-09-12T18:26:39.854328+0000","last_became_peered":"2024-09-12T18:26:39.854328+0000","last_unstale":"2024-09-12T19:12:08.197323+0000","last_undegraded":"2024-09-12T19:12:08.197323+0000","last_fullsized":"2024-09-12T19:12:08.197323+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:21.829716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7968455,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":515,"num_read_kb":9662,"num_write":1178,"num_write_kb":35097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.905457+0000","last_change":"2024-09-12T18:26:43.866117+0000","last_active":"2024-09-12T19:11:03.905457+0000","last_peered":"2024-09-12T19:11:03.905457+0000","last_clean":"2024-09-12T19:11:03.905457+0000","last_became_active":"2024-09-12T18:26:43.865454+0000","last_became_peered":"2024-09-12T18:26:43.865454+0000","last_unstale":"2024-09-12T19:11:03.905457+0000","last_undegraded":"2024-09-12T19:11:03.905457+0000","last_fullsized":"2024-09-12T19:11:03.905457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:55.077443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'243","reported_seq":802,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.949398+0000","last_change":"2024-09-12T18:26:45.867830+0000","last_active":"2024-09-12T19:13:43.949398+0000","last_peered":"2024-09-12T19:13:43.949398+0000","last_clean":"2024-09-12T19:13:43.949398+0000","last_became_active":"2024-09-12T18:26:45.867096+0000","last_became_peered":"2024-09-12T18:26:45.867096+0000","last_unstale":"2024-09-12T19:13:43.949398+0000","last_undegraded":"2024-09-12T19:13:43.949398+0000","last_fullsized":"2024-09-12T19:13:43.949398+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.958792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53974,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":399,"num_read_kb":841,"num_write":324,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.932045+0000","last_change":"2024-09-12T18:26:47.895791+0000","last_active":"2024-09-12T19:11:08.932045+0000","last_peered":"2024-09-12T19:11:08.932045+0000","last_clean":"2024-09-12T19:11:08.932045+0000","last_became_active":"2024-09-12T18:26:47.895092+0000","last_became_peered":"2024-09-12T18:26:47.895092+0000","last_unstale":"2024-09-12T19:11:08.932045+0000","last_undegraded":"2024-09-12T19:11:08.932045+0000","last_fullsized":"2024-09-12T19:11:08.932045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:05.232441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'821","reported_seq":2419,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.207286+0000","last_change":"2024-09-12T18:26:41.872671+0000","last_active":"2024-09-12T19:11:58.207286+0000","last_peered":"2024-09-12T19:11:58.207286+0000","last_clean":"2024-09-12T19:11:58.207286+0000","last_became_active":"2024-09-12T18:26:41.871943+0000","last_became_peered":"2024-09-12T18:26:41.871943+0000","last_unstale":"2024-09-12T19:11:58.207286+0000","last_undegraded":"2024-09-12T19:11:58.207286+0000","last_fullsized":"2024-09-12T19:11:58.207286+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:15.536437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3898,"num_read_kb":3510,"num_write":1047,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'313","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.758972+0000","last_change":"2024-09-12T18:26:39.831302+0000","last_active":"2024-09-12T19:12:09.758972+0000","last_peered":"2024-09-12T19:12:09.758972+0000","last_clean":"2024-09-12T19:12:09.758972+0000","last_became_active":"2024-09-12T18:26:39.830963+0000","last_became_peered":"2024-09-12T18:26:39.830963+0000","last_unstale":"2024-09-12T19:12:09.758972+0000","last_undegraded":"2024-09-12T19:12:09.758972+0000","last_fullsized":"2024-09-12T19:12:09.758972+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:33.362610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11355684,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":552,"num_read_kb":35487,"num_write":1202,"num_write_kb":27084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:53.927546+0000","last_change":"2024-09-12T18:26:43.861948+0000","last_active":"2024-09-12T19:10:53.927546+0000","last_peered":"2024-09-12T19:10:53.927546+0000","last_clean":"2024-09-12T19:10:53.927546+0000","last_became_active":"2024-09-12T18:26:43.861521+0000","last_became_peered":"2024-09-12T18:26:43.861521+0000","last_unstale":"2024-09-12T19:10:53.927546+0000","last_undegraded":"2024-09-12T19:10:53.927546+0000","last_fullsized":"2024-09-12T19:10:53.927546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:00.161505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'443","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.736780+0000","last_change":"2024-09-12T18:26:45.873087+0000","last_active":"2024-09-12T19:13:57.736780+0000","last_peered":"2024-09-12T19:13:57.736780+0000","last_clean":"2024-09-12T19:13:57.736780+0000","last_became_active":"2024-09-12T18:26:45.872177+0000","last_became_peered":"2024-09-12T18:26:45.872177+0000","last_unstale":"2024-09-12T19:13:57.736780+0000","last_undegraded":"2024-09-12T19:13:57.736780+0000","last_fullsized":"2024-09-12T19:13:57.736780+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:14.142703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":798,"num_read_kb":1755,"num_write":687,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.879188+0000","last_change":"2024-09-12T18:26:47.903167+0000","last_active":"2024-09-12T19:09:18.879188+0000","last_peered":"2024-09-12T19:09:18.879188+0000","last_clean":"2024-09-12T19:09:18.879188+0000","last_became_active":"2024-09-12T18:26:47.902702+0000","last_became_peered":"2024-09-12T18:26:47.902702+0000","last_unstale":"2024-09-12T19:09:18.879188+0000","last_undegraded":"2024-09-12T19:09:18.879188+0000","last_fullsized":"2024-09-12T19:09:18.879188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:58.910571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'188","reported_seq":695,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.315741+0000","last_change":"2024-09-12T18:26:49.920882+0000","last_active":"2024-09-12T19:12:23.315741+0000","last_peered":"2024-09-12T19:12:23.315741+0000","last_clean":"2024-09-12T19:12:23.315741+0000","last_became_active":"2024-09-12T18:26:49.920066+0000","last_became_peered":"2024-09-12T18:26:49.920066+0000","last_unstale":"2024-09-12T19:12:23.315741+0000","last_undegraded":"2024-09-12T19:12:23.315741+0000","last_fullsized":"2024-09-12T19:12:23.315741+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:38.018526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":247,"num_read_kb":248,"num_write":459,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'764","reported_seq":2241,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:04.036663+0000","last_change":"2024-09-12T18:26:41.853638+0000","last_active":"2024-09-12T19:12:04.036663+0000","last_peered":"2024-09-12T19:12:04.036663+0000","last_clean":"2024-09-12T19:12:04.036663+0000","last_became_active":"2024-09-12T18:26:41.852157+0000","last_became_peered":"2024-09-12T18:26:41.852157+0000","last_unstale":"2024-09-12T19:12:04.036663+0000","last_undegraded":"2024-09-12T19:12:04.036663+0000","last_fullsized":"2024-09-12T19:12:04.036663+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:07.965311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3590,"num_read_kb":3230,"num_write":1002,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'318","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.707485+0000","last_change":"2024-09-12T18:27:11.827995+0000","last_active":"2024-09-12T19:13:57.707485+0000","last_peered":"2024-09-12T19:13:57.707485+0000","last_clean":"2024-09-12T19:13:57.707485+0000","last_became_active":"2024-09-12T18:27:11.827218+0000","last_became_peered":"2024-09-12T18:27:11.827218+0000","last_unstale":"2024-09-12T19:13:57.707485+0000","last_undegraded":"2024-09-12T19:13:57.707485+0000","last_fullsized":"2024-09-12T19:13:57.707485+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:06.201837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120630,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":457,"num_read_kb":7362,"num_write":1123,"num_write_kb":18791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.898175+0000","last_change":"2024-09-12T18:26:43.866082+0000","last_active":"2024-09-12T19:10:28.898175+0000","last_peered":"2024-09-12T19:10:28.898175+0000","last_clean":"2024-09-12T19:10:28.898175+0000","last_became_active":"2024-09-12T18:26:43.865319+0000","last_became_peered":"2024-09-12T18:26:43.865319+0000","last_unstale":"2024-09-12T19:10:28.898175+0000","last_undegraded":"2024-09-12T19:10:28.898175+0000","last_fullsized":"2024-09-12T19:10:28.898175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:34.611869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'293","reported_seq":865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.952948+0000","last_change":"2024-09-12T18:26:45.874050+0000","last_active":"2024-09-12T19:13:43.952948+0000","last_peered":"2024-09-12T19:13:43.952948+0000","last_clean":"2024-09-12T19:13:43.952948+0000","last_became_active":"2024-09-12T18:26:45.873197+0000","last_became_peered":"2024-09-12T18:26:45.873197+0000","last_unstale":"2024-09-12T19:13:43.952948+0000","last_undegraded":"2024-09-12T19:13:43.952948+0000","last_fullsized":"2024-09-12T19:13:43.952948+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:01.225799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61026,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":471,"num_read_kb":936,"num_write":396,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:17.891370+0000","last_change":"2024-09-12T18:26:47.884995+0000","last_active":"2024-09-12T19:09:17.891370+0000","last_peered":"2024-09-12T19:09:17.891370+0000","last_clean":"2024-09-12T19:09:17.891370+0000","last_became_active":"2024-09-12T18:26:47.883930+0000","last_became_peered":"2024-09-12T18:26:47.883930+0000","last_unstale":"2024-09-12T19:09:17.891370+0000","last_undegraded":"2024-09-12T19:09:17.891370+0000","last_fullsized":"2024-09-12T19:09:17.891370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:45.633573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'180","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.119927+0000","last_change":"2024-09-12T18:26:49.922518+0000","last_active":"2024-09-12T19:12:24.119927+0000","last_peered":"2024-09-12T19:12:24.119927+0000","last_clean":"2024-09-12T19:12:24.119927+0000","last_became_active":"2024-09-12T18:26:49.921797+0000","last_became_peered":"2024-09-12T18:26:49.921797+0000","last_unstale":"2024-09-12T19:12:24.119927+0000","last_undegraded":"2024-09-12T19:12:24.119927+0000","last_fullsized":"2024-09-12T19:12:24.119927+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:13.451147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1230,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":213,"num_write":519,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'508","reported_seq":1855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.603092+0000","last_change":"2024-09-12T18:26:41.851238+0000","last_active":"2024-09-12T19:12:06.603092+0000","last_peered":"2024-09-12T19:12:06.603092+0000","last_clean":"2024-09-12T19:12:06.603092+0000","last_became_active":"2024-09-12T18:26:41.850647+0000","last_became_peered":"2024-09-12T18:26:41.850647+0000","last_unstale":"2024-09-12T19:12:06.603092+0000","last_undegraded":"2024-09-12T19:12:06.603092+0000","last_fullsized":"2024-09-12T19:12:06.603092+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:45.957699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2444,"num_write":714,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'295","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.595014+0000","last_change":"2024-09-12T18:26:39.842569+0000","last_active":"2024-09-12T19:11:43.595014+0000","last_peered":"2024-09-12T19:11:43.595014+0000","last_clean":"2024-09-12T19:11:43.595014+0000","last_became_active":"2024-09-12T18:26:39.840458+0000","last_became_peered":"2024-09-12T18:26:39.840458+0000","last_unstale":"2024-09-12T19:11:43.595014+0000","last_undegraded":"2024-09-12T19:11:43.595014+0000","last_fullsized":"2024-09-12T19:11:43.595014+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:05.706995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2236055,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":421,"num_read_kb":36099,"num_write":1048,"num_write_kb":45658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:14.088096+0000","last_change":"2024-09-12T18:26:43.876974+0000","last_active":"2024-09-12T19:09:14.088096+0000","last_peered":"2024-09-12T19:09:14.088096+0000","last_clean":"2024-09-12T19:09:14.088096+0000","last_became_active":"2024-09-12T18:26:43.873669+0000","last_became_peered":"2024-09-12T18:26:43.873669+0000","last_unstale":"2024-09-12T19:09:14.088096+0000","last_undegraded":"2024-09-12T19:09:14.088096+0000","last_fullsized":"2024-09-12T19:09:14.088096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:55.720687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'279","reported_seq":848,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:38.729498+0000","last_change":"2024-09-12T18:26:46.023642+0000","last_active":"2024-09-12T19:12:38.729498+0000","last_peered":"2024-09-12T19:12:38.729498+0000","last_clean":"2024-09-12T19:12:38.729498+0000","last_became_active":"2024-09-12T18:26:46.023025+0000","last_became_peered":"2024-09-12T18:26:46.023025+0000","last_unstale":"2024-09-12T19:12:38.729498+0000","last_undegraded":"2024-09-12T19:12:38.729498+0000","last_fullsized":"2024-09-12T19:12:38.729498+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:34.349134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59881,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":993,"num_write":392,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:57.915384+0000","last_change":"2024-09-12T18:26:47.893458+0000","last_active":"2024-09-12T19:10:57.915384+0000","last_peered":"2024-09-12T19:10:57.915384+0000","last_clean":"2024-09-12T19:10:57.915384+0000","last_became_active":"2024-09-12T18:26:47.892678+0000","last_became_peered":"2024-09-12T18:26:47.892678+0000","last_unstale":"2024-09-12T19:10:57.915384+0000","last_undegraded":"2024-09-12T19:10:57.915384+0000","last_fullsized":"2024-09-12T19:10:57.915384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:22.345925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'113","reported_seq":596,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.000115+0000","last_change":"2024-09-12T18:26:49.919935+0000","last_active":"2024-09-12T19:13:44.000115+0000","last_peered":"2024-09-12T19:13:44.000115+0000","last_clean":"2024-09-12T19:13:44.000115+0000","last_became_active":"2024-09-12T18:26:49.919229+0000","last_became_peered":"2024-09-12T18:26:49.919229+0000","last_unstale":"2024-09-12T19:13:44.000115+0000","last_undegraded":"2024-09-12T19:13:44.000115+0000","last_fullsized":"2024-09-12T19:13:44.000115+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:52.637762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":95,"num_write":270,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'503","reported_seq":2204,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.539957+0000","last_change":"2024-09-12T18:26:41.844984+0000","last_active":"2024-09-12T19:12:09.539957+0000","last_peered":"2024-09-12T19:12:09.539957+0000","last_clean":"2024-09-12T19:12:09.539957+0000","last_became_active":"2024-09-12T18:26:41.844608+0000","last_became_peered":"2024-09-12T18:26:41.844608+0000","last_unstale":"2024-09-12T19:12:09.539957+0000","last_undegraded":"2024-09-12T19:12:09.539957+0000","last_fullsized":"2024-09-12T19:12:09.539957+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:01.162341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2752,"num_read_kb":2596,"num_write":594,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'276","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:19.633134+0000","last_change":"2024-09-12T18:27:11.807858+0000","last_active":"2024-09-12T19:12:19.633134+0000","last_peered":"2024-09-12T19:12:19.633134+0000","last_clean":"2024-09-12T19:12:19.633134+0000","last_became_active":"2024-09-12T18:27:11.807022+0000","last_became_peered":"2024-09-12T18:27:11.807022+0000","last_unstale":"2024-09-12T19:12:19.633134+0000","last_undegraded":"2024-09-12T19:12:19.633134+0000","last_fullsized":"2024-09-12T19:12:19.633134+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:42.477672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9976643,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":421,"num_read_kb":61134,"num_write":969,"num_write_kb":46178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:17.891331+0000","last_change":"2024-09-12T18:26:43.860395+0000","last_active":"2024-09-12T19:09:17.891331+0000","last_peered":"2024-09-12T19:09:17.891331+0000","last_clean":"2024-09-12T19:09:17.891331+0000","last_became_active":"2024-09-12T18:26:43.859997+0000","last_became_peered":"2024-09-12T18:26:43.859997+0000","last_unstale":"2024-09-12T19:09:17.891331+0000","last_undegraded":"2024-09-12T19:09:17.891331+0000","last_fullsized":"2024-09-12T19:09:17.891331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:23.870876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'90","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:21.975628+0000","last_change":"2024-09-12T18:26:46.022987+0000","last_active":"2024-09-12T19:11:21.975628+0000","last_peered":"2024-09-12T19:11:21.975628+0000","last_clean":"2024-09-12T19:11:21.975628+0000","last_became_active":"2024-09-12T18:26:46.022246+0000","last_became_peered":"2024-09-12T18:26:46.022246+0000","last_unstale":"2024-09-12T19:11:21.975628+0000","last_undegraded":"2024-09-12T19:11:21.975628+0000","last_fullsized":"2024-09-12T19:11:21.975628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:05.130410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":130,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'766","reported_seq":2305,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.018467+0000","last_change":"2024-09-12T18:26:47.894434+0000","last_active":"2024-09-12T19:13:44.018467+0000","last_peered":"2024-09-12T19:13:44.018467+0000","last_clean":"2024-09-12T19:13:44.018467+0000","last_became_active":"2024-09-12T18:26:47.891107+0000","last_became_peered":"2024-09-12T18:26:47.891107+0000","last_unstale":"2024-09-12T19:13:44.018467+0000","last_undegraded":"2024-09-12T19:13:44.018467+0000","last_fullsized":"2024-09-12T19:13:44.018467+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":701,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:30.324222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'114","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.746554+0000","last_change":"2024-09-12T18:26:49.916767+0000","last_active":"2024-09-12T19:12:21.746554+0000","last_peered":"2024-09-12T19:12:21.746554+0000","last_clean":"2024-09-12T19:12:21.746554+0000","last_became_active":"2024-09-12T18:26:49.915975+0000","last_became_peered":"2024-09-12T18:26:49.915975+0000","last_unstale":"2024-09-12T19:12:21.746554+0000","last_undegraded":"2024-09-12T19:12:21.746554+0000","last_fullsized":"2024-09-12T19:12:21.746554+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:39.304415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":276,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'457","reported_seq":2178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.110966+0000","last_change":"2024-09-12T18:26:41.853916+0000","last_active":"2024-09-12T19:12:24.110966+0000","last_peered":"2024-09-12T19:12:24.110966+0000","last_clean":"2024-09-12T19:12:24.110966+0000","last_became_active":"2024-09-12T18:26:41.853112+0000","last_became_peered":"2024-09-12T18:26:41.853112+0000","last_unstale":"2024-09-12T19:12:24.110966+0000","last_undegraded":"2024-09-12T19:12:24.110966+0000","last_fullsized":"2024-09-12T19:12:24.110966+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:47.031551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2539,"num_write":529,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'307","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:14.445032+0000","last_change":"2024-09-12T18:26:39.867749+0000","last_active":"2024-09-12T19:11:14.445032+0000","last_peered":"2024-09-12T19:11:14.445032+0000","last_clean":"2024-09-12T19:11:14.445032+0000","last_became_active":"2024-09-12T18:26:39.867136+0000","last_became_peered":"2024-09-12T18:26:39.867136+0000","last_unstale":"2024-09-12T19:11:14.445032+0000","last_undegraded":"2024-09-12T19:11:14.445032+0000","last_fullsized":"2024-09-12T19:11:14.445032+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:04.827164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15732260,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":460,"num_read_kb":14806,"num_write":1070,"num_write_kb":34226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:17.883321+0000","last_change":"2024-09-12T18:26:43.877662+0000","last_active":"2024-09-12T19:09:17.883321+0000","last_peered":"2024-09-12T19:09:17.883321+0000","last_clean":"2024-09-12T19:09:17.883321+0000","last_became_active":"2024-09-12T18:26:43.876801+0000","last_became_peered":"2024-09-12T18:26:43.876801+0000","last_unstale":"2024-09-12T19:09:17.883321+0000","last_undegraded":"2024-09-12T19:09:17.883321+0000","last_fullsized":"2024-09-12T19:09:17.883321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:49.772292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'289","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:53.927686+0000","last_change":"2024-09-12T18:26:45.873414+0000","last_active":"2024-09-12T19:12:53.927686+0000","last_peered":"2024-09-12T19:12:53.927686+0000","last_clean":"2024-09-12T19:12:53.927686+0000","last_became_active":"2024-09-12T18:26:45.872458+0000","last_became_peered":"2024-09-12T18:26:45.872458+0000","last_unstale":"2024-09-12T19:12:53.927686+0000","last_undegraded":"2024-09-12T19:12:53.927686+0000","last_fullsized":"2024-09-12T19:12:53.927686+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:15.684235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56998,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":975,"num_write":390,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.918253+0000","last_change":"2024-09-12T18:26:47.895896+0000","last_active":"2024-09-12T19:10:18.918253+0000","last_peered":"2024-09-12T19:10:18.918253+0000","last_clean":"2024-09-12T19:10:18.918253+0000","last_became_active":"2024-09-12T18:26:47.894689+0000","last_became_peered":"2024-09-12T18:26:47.894689+0000","last_unstale":"2024-09-12T19:10:18.918253+0000","last_undegraded":"2024-09-12T19:10:18.918253+0000","last_fullsized":"2024-09-12T19:10:18.918253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:12.028473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'122","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.472125+0000","last_change":"2024-09-12T18:26:49.931294+0000","last_active":"2024-09-12T19:12:21.472125+0000","last_peered":"2024-09-12T19:12:21.472125+0000","last_clean":"2024-09-12T19:12:21.472125+0000","last_became_active":"2024-09-12T18:26:49.930794+0000","last_became_peered":"2024-09-12T18:26:49.930794+0000","last_unstale":"2024-09-12T19:12:21.472125+0000","last_undegraded":"2024-09-12T19:12:21.472125+0000","last_fullsized":"2024-09-12T19:12:21.472125+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:20.540895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":295,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'613","reported_seq":2272,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.104950+0000","last_change":"2024-09-12T18:26:41.857340+0000","last_active":"2024-09-12T19:13:43.104950+0000","last_peered":"2024-09-12T19:13:43.104950+0000","last_clean":"2024-09-12T19:13:43.104950+0000","last_became_active":"2024-09-12T18:26:41.856621+0000","last_became_peered":"2024-09-12T18:26:41.856621+0000","last_unstale":"2024-09-12T19:13:43.104950+0000","last_undegraded":"2024-09-12T19:13:43.104950+0000","last_fullsized":"2024-09-12T19:13:43.104950+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:57.480188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3116,"num_read_kb":2841,"num_write":759,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'277","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:47.365388+0000","last_change":"2024-09-12T18:26:39.861785+0000","last_active":"2024-09-12T19:11:47.365388+0000","last_peered":"2024-09-12T19:11:47.365388+0000","last_clean":"2024-09-12T19:11:47.365388+0000","last_became_active":"2024-09-12T18:26:39.861108+0000","last_became_peered":"2024-09-12T18:26:39.861108+0000","last_unstale":"2024-09-12T19:11:47.365388+0000","last_undegraded":"2024-09-12T19:11:47.365388+0000","last_fullsized":"2024-09-12T19:11:47.365388+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:35.617812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20012033,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":431,"num_read_kb":32271,"num_write":928,"num_write_kb":22718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:13.878053+0000","last_change":"2024-09-12T18:26:43.861093+0000","last_active":"2024-09-12T19:09:13.878053+0000","last_peered":"2024-09-12T19:09:13.878053+0000","last_clean":"2024-09-12T19:09:13.878053+0000","last_became_active":"2024-09-12T18:26:43.860336+0000","last_became_peered":"2024-09-12T18:26:43.860336+0000","last_unstale":"2024-09-12T19:09:13.878053+0000","last_undegraded":"2024-09-12T19:09:13.878053+0000","last_fullsized":"2024-09-12T19:09:13.878053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:15.631369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'281","reported_seq":845,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.955648+0000","last_change":"2024-09-12T18:26:45.881839+0000","last_active":"2024-09-12T19:12:43.955648+0000","last_peered":"2024-09-12T19:12:43.955648+0000","last_clean":"2024-09-12T19:12:43.955648+0000","last_became_active":"2024-09-12T18:26:45.881364+0000","last_became_peered":"2024-09-12T18:26:45.881364+0000","last_unstale":"2024-09-12T19:12:43.955648+0000","last_undegraded":"2024-09-12T19:12:43.955648+0000","last_fullsized":"2024-09-12T19:12:43.955648+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:54.998693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56916,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":957,"num_write":378,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.898023+0000","last_change":"2024-09-12T18:26:47.888719+0000","last_active":"2024-09-12T19:10:28.898023+0000","last_peered":"2024-09-12T19:10:28.898023+0000","last_clean":"2024-09-12T19:10:28.898023+0000","last_became_active":"2024-09-12T18:26:47.888055+0000","last_became_peered":"2024-09-12T18:26:47.888055+0000","last_unstale":"2024-09-12T19:10:28.898023+0000","last_undegraded":"2024-09-12T19:10:28.898023+0000","last_fullsized":"2024-09-12T19:10:28.898023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:33.128326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.320073+0000","last_change":"2024-09-12T18:26:49.923335+0000","last_active":"2024-09-12T19:12:23.320073+0000","last_peered":"2024-09-12T19:12:23.320073+0000","last_clean":"2024-09-12T19:12:23.320073+0000","last_became_active":"2024-09-12T18:26:49.922543+0000","last_became_peered":"2024-09-12T18:26:49.922543+0000","last_unstale":"2024-09-12T19:12:23.320073+0000","last_undegraded":"2024-09-12T19:12:23.320073+0000","last_fullsized":"2024-09-12T19:12:23.320073+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:23.453107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":203,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'471","reported_seq":2057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.938937+0000","last_change":"2024-09-12T18:26:41.850838+0000","last_active":"2024-09-12T19:12:07.938937+0000","last_peered":"2024-09-12T19:12:07.938937+0000","last_clean":"2024-09-12T19:12:07.938937+0000","last_became_active":"2024-09-12T18:26:41.850499+0000","last_became_peered":"2024-09-12T18:26:41.850499+0000","last_unstale":"2024-09-12T19:12:07.938937+0000","last_undegraded":"2024-09-12T19:12:07.938937+0000","last_fullsized":"2024-09-12T19:12:07.938937+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:48.262784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2536,"num_read_kb":2375,"num_write":558,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'264","reported_seq":881,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.807160+0000","last_change":"2024-09-12T18:26:39.847761+0000","last_active":"2024-09-12T19:11:48.807160+0000","last_peered":"2024-09-12T19:11:48.807160+0000","last_clean":"2024-09-12T19:11:48.807160+0000","last_became_active":"2024-09-12T18:26:39.847422+0000","last_became_peered":"2024-09-12T18:26:39.847422+0000","last_unstale":"2024-09-12T19:11:48.807160+0000","last_undegraded":"2024-09-12T19:11:48.807160+0000","last_fullsized":"2024-09-12T19:11:48.807160+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:13.311491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4791729,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":375,"num_read_kb":20074,"num_write":1008,"num_write_kb":42638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:14.101283+0000","last_change":"2024-09-12T18:26:43.875901+0000","last_active":"2024-09-12T19:10:14.101283+0000","last_peered":"2024-09-12T19:10:14.101283+0000","last_clean":"2024-09-12T19:10:14.101283+0000","last_became_active":"2024-09-12T18:26:43.874881+0000","last_became_peered":"2024-09-12T18:26:43.874881+0000","last_unstale":"2024-09-12T19:10:14.101283+0000","last_undegraded":"2024-09-12T19:10:14.101283+0000","last_fullsized":"2024-09-12T19:10:14.101283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:20.082733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'269","reported_seq":819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.717325+0000","last_change":"2024-09-12T18:26:45.865460+0000","last_active":"2024-09-12T19:11:48.717325+0000","last_peered":"2024-09-12T19:11:48.717325+0000","last_clean":"2024-09-12T19:11:48.717325+0000","last_became_active":"2024-09-12T18:26:45.864264+0000","last_became_peered":"2024-09-12T18:26:45.864264+0000","last_unstale":"2024-09-12T19:11:48.717325+0000","last_undegraded":"2024-09-12T19:11:48.717325+0000","last_fullsized":"2024-09-12T19:11:48.717325+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:46.472729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65230,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":458,"num_read_kb":1028,"num_write":392,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:19.089126+0000","last_change":"2024-09-12T18:26:47.882838+0000","last_active":"2024-09-12T19:09:19.089126+0000","last_peered":"2024-09-12T19:09:19.089126+0000","last_clean":"2024-09-12T19:09:19.089126+0000","last_became_active":"2024-09-12T18:26:47.882094+0000","last_became_peered":"2024-09-12T18:26:47.882094+0000","last_unstale":"2024-09-12T19:09:19.089126+0000","last_undegraded":"2024-09-12T19:09:19.089126+0000","last_fullsized":"2024-09-12T19:09:19.089126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:28.769911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'194","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.741958+0000","last_change":"2024-09-12T18:26:49.921917+0000","last_active":"2024-09-12T19:12:21.741958+0000","last_peered":"2024-09-12T19:12:21.741958+0000","last_clean":"2024-09-12T19:12:21.741958+0000","last_became_active":"2024-09-12T18:26:49.920808+0000","last_became_peered":"2024-09-12T18:26:49.920808+0000","last_unstale":"2024-09-12T19:12:21.741958+0000","last_undegraded":"2024-09-12T19:12:21.741958+0000","last_fullsized":"2024-09-12T19:12:21.741958+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:38.677600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1188,"num_read_kb":1184,"num_write":433,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'790","reported_seq":2289,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.623824+0000","last_change":"2024-09-12T18:26:41.874632+0000","last_active":"2024-09-12T19:12:18.623824+0000","last_peered":"2024-09-12T19:12:18.623824+0000","last_clean":"2024-09-12T19:12:18.623824+0000","last_became_active":"2024-09-12T18:26:41.873690+0000","last_became_peered":"2024-09-12T18:26:41.873690+0000","last_unstale":"2024-09-12T19:12:18.623824+0000","last_undegraded":"2024-09-12T19:12:18.623824+0000","last_fullsized":"2024-09-12T19:12:18.623824+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:58.542257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3645,"num_read_kb":3278,"num_write":1029,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'291","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:54.375517+0000","last_change":"2024-09-12T18:27:11.830481+0000","last_active":"2024-09-12T19:11:54.375517+0000","last_peered":"2024-09-12T19:11:54.375517+0000","last_clean":"2024-09-12T19:11:54.375517+0000","last_became_active":"2024-09-12T18:27:11.829577+0000","last_became_peered":"2024-09-12T18:27:11.829577+0000","last_unstale":"2024-09-12T19:11:54.375517+0000","last_undegraded":"2024-09-12T19:11:54.375517+0000","last_fullsized":"2024-09-12T19:11:54.375517+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:39.120138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5779791,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":442,"num_read_kb":8019,"num_write":1145,"num_write_kb":33613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:27.907872+0000","last_change":"2024-09-12T18:26:43.865809+0000","last_active":"2024-09-12T19:10:27.907872+0000","last_peered":"2024-09-12T19:10:27.907872+0000","last_clean":"2024-09-12T19:10:27.907872+0000","last_became_active":"2024-09-12T18:26:43.864719+0000","last_became_peered":"2024-09-12T18:26:43.864719+0000","last_unstale":"2024-09-12T19:10:27.907872+0000","last_undegraded":"2024-09-12T19:10:27.907872+0000","last_fullsized":"2024-09-12T19:10:27.907872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:47.905822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'301","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:49.122478+0000","last_change":"2024-09-12T18:26:45.866467+0000","last_active":"2024-09-12T19:11:49.122478+0000","last_peered":"2024-09-12T19:11:49.122478+0000","last_clean":"2024-09-12T19:11:49.122478+0000","last_became_active":"2024-09-12T18:26:45.865711+0000","last_became_peered":"2024-09-12T18:26:45.865711+0000","last_unstale":"2024-09-12T19:11:49.122478+0000","last_undegraded":"2024-09-12T19:11:49.122478+0000","last_fullsized":"2024-09-12T19:11:49.122478+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:12.137382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":497,"num_read_kb":1005,"num_write":410,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.903282+0000","last_change":"2024-09-12T18:26:47.883801+0000","last_active":"2024-09-12T19:09:18.903282+0000","last_peered":"2024-09-12T19:09:18.903282+0000","last_clean":"2024-09-12T19:09:18.903282+0000","last_became_active":"2024-09-12T18:26:47.883014+0000","last_became_peered":"2024-09-12T18:26:47.883014+0000","last_unstale":"2024-09-12T19:09:18.903282+0000","last_undegraded":"2024-09-12T19:09:18.903282+0000","last_fullsized":"2024-09-12T19:09:18.903282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:35.546362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'106","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.102109+0000","last_change":"2024-09-12T18:26:49.922286+0000","last_active":"2024-09-12T19:13:43.102109+0000","last_peered":"2024-09-12T19:13:43.102109+0000","last_clean":"2024-09-12T19:13:43.102109+0000","last_became_active":"2024-09-12T18:26:49.921636+0000","last_became_peered":"2024-09-12T18:26:49.921636+0000","last_unstale":"2024-09-12T19:13:43.102109+0000","last_undegraded":"2024-09-12T19:13:43.102109+0000","last_fullsized":"2024-09-12T19:13:43.102109+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:07.594133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":621,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":107,"num_write":252,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'1273","reported_seq":3077,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.126851+0000","last_change":"2024-09-12T18:26:41.872801+0000","last_active":"2024-09-12T19:12:24.126851+0000","last_peered":"2024-09-12T19:12:24.126851+0000","last_clean":"2024-09-12T19:12:24.126851+0000","last_became_active":"2024-09-12T18:26:41.872455+0000","last_became_peered":"2024-09-12T18:26:41.872455+0000","last_unstale":"2024-09-12T19:12:24.126851+0000","last_undegraded":"2024-09-12T19:12:24.126851+0000","last_fullsized":"2024-09-12T19:12:24.126851+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:05.640554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6298,"num_read_kb":5578,"num_write":1816,"num_write_kb":809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'318","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.757297+0000","last_change":"2024-09-12T18:26:39.848638+0000","last_active":"2024-09-12T19:12:09.757297+0000","last_peered":"2024-09-12T19:12:09.757297+0000","last_clean":"2024-09-12T19:12:09.757297+0000","last_became_active":"2024-09-12T18:26:39.847954+0000","last_became_peered":"2024-09-12T18:26:39.847954+0000","last_unstale":"2024-09-12T19:12:09.757297+0000","last_undegraded":"2024-09-12T19:12:09.757297+0000","last_fullsized":"2024-09-12T19:12:09.757297+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:36.378454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23103420,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":503,"num_read_kb":77064,"num_write":1168,"num_write_kb":41008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'501","reported_seq":2145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.105839+0000","last_change":"2024-09-12T18:26:41.852684+0000","last_active":"2024-09-12T19:13:43.105839+0000","last_peered":"2024-09-12T19:13:43.105839+0000","last_clean":"2024-09-12T19:13:43.105839+0000","last_became_active":"2024-09-12T18:26:41.846040+0000","last_became_peered":"2024-09-12T18:26:41.846040+0000","last_unstale":"2024-09-12T19:13:43.105839+0000","last_undegraded":"2024-09-12T19:13:43.105839+0000","last_fullsized":"2024-09-12T19:13:43.105839+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:45.056792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2703,"num_read_kb":2531,"num_write":592,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'307","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:42.235030+0000","last_change":"2024-09-12T18:26:39.846352+0000","last_active":"2024-09-12T19:13:42.235030+0000","last_peered":"2024-09-12T19:13:42.235030+0000","last_clean":"2024-09-12T19:13:42.235030+0000","last_became_active":"2024-09-12T18:26:39.846028+0000","last_became_peered":"2024-09-12T18:26:39.846028+0000","last_unstale":"2024-09-12T19:13:42.235030+0000","last_undegraded":"2024-09-12T19:13:42.235030+0000","last_fullsized":"2024-09-12T19:13:42.235030+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:04.369252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1896747,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":707,"num_read_kb":5622,"num_write":1105,"num_write_kb":40701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'516","reported_seq":2039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.769450+0000","last_change":"2024-09-12T18:26:41.884917+0000","last_active":"2024-09-12T19:12:08.769450+0000","last_peered":"2024-09-12T19:12:08.769450+0000","last_clean":"2024-09-12T19:12:08.769450+0000","last_became_active":"2024-09-12T18:26:41.884394+0000","last_became_peered":"2024-09-12T18:26:41.884394+0000","last_unstale":"2024-09-12T19:12:08.769450+0000","last_undegraded":"2024-09-12T19:12:08.769450+0000","last_fullsized":"2024-09-12T19:12:08.769450+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:32.084024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2704,"num_read_kb":2505,"num_write":657,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'277","reported_seq":919,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:12.493346+0000","last_change":"2024-09-12T18:26:39.856913+0000","last_active":"2024-09-12T19:11:12.493346+0000","last_peered":"2024-09-12T19:11:12.493346+0000","last_clean":"2024-09-12T19:11:12.493346+0000","last_became_active":"2024-09-12T18:26:39.856026+0000","last_became_peered":"2024-09-12T18:26:39.856026+0000","last_unstale":"2024-09-12T19:11:12.493346+0000","last_undegraded":"2024-09-12T19:11:12.493346+0000","last_fullsized":"2024-09-12T19:11:12.493346+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:27.396302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7110994,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":464,"num_read_kb":16867,"num_write":1020,"num_write_kb":23838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'538","reported_seq":2153,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.106718+0000","last_change":"2024-09-12T18:26:41.850869+0000","last_active":"2024-09-12T19:13:43.106718+0000","last_peered":"2024-09-12T19:13:43.106718+0000","last_clean":"2024-09-12T19:13:43.106718+0000","last_became_active":"2024-09-12T18:26:41.850519+0000","last_became_peered":"2024-09-12T18:26:41.850519+0000","last_unstale":"2024-09-12T19:13:43.106718+0000","last_undegraded":"2024-09-12T19:13:43.106718+0000","last_fullsized":"2024-09-12T19:13:43.106718+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:01.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2864,"num_read_kb":2647,"num_write":672,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'289","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.700985+0000","last_change":"2024-09-12T18:26:39.843327+0000","last_active":"2024-09-12T19:11:59.700985+0000","last_peered":"2024-09-12T19:11:59.700985+0000","last_clean":"2024-09-12T19:11:59.700985+0000","last_became_active":"2024-09-12T18:26:39.842852+0000","last_became_peered":"2024-09-12T18:26:39.842852+0000","last_unstale":"2024-09-12T19:11:59.700985+0000","last_undegraded":"2024-09-12T19:11:59.700985+0000","last_fullsized":"2024-09-12T19:11:59.700985+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.968044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10012875,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":455,"num_read_kb":35620,"num_write":1102,"num_write_kb":31566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'814","reported_seq":2351,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.568561+0000","last_change":"2024-09-12T18:26:41.882724+0000","last_active":"2024-09-12T19:12:06.568561+0000","last_peered":"2024-09-12T19:12:06.568561+0000","last_clean":"2024-09-12T19:12:06.568561+0000","last_became_active":"2024-09-12T18:26:41.882458+0000","last_became_peered":"2024-09-12T18:26:41.882458+0000","last_unstale":"2024-09-12T19:12:06.568561+0000","last_undegraded":"2024-09-12T19:12:06.568561+0000","last_fullsized":"2024-09-12T19:12:06.568561+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:55.482811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3832,"num_read_kb":3447,"num_write":1071,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'269","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:02.481890+0000","last_change":"2024-09-12T18:26:39.855875+0000","last_active":"2024-09-12T19:12:02.481890+0000","last_peered":"2024-09-12T19:12:02.481890+0000","last_clean":"2024-09-12T19:12:02.481890+0000","last_became_active":"2024-09-12T18:26:39.855654+0000","last_became_peered":"2024-09-12T18:26:39.855654+0000","last_unstale":"2024-09-12T19:12:02.481890+0000","last_undegraded":"2024-09-12T19:12:02.481890+0000","last_fullsized":"2024-09-12T19:12:02.481890+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:14.438744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2146066,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":530,"num_read_kb":6402,"num_write":986,"num_write_kb":32224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'1222","reported_seq":2855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.127193+0000","last_change":"2024-09-12T18:26:41.877371+0000","last_active":"2024-09-12T19:12:24.127193+0000","last_peered":"2024-09-12T19:12:24.127193+0000","last_clean":"2024-09-12T19:12:24.127193+0000","last_became_active":"2024-09-12T18:26:41.876138+0000","last_became_peered":"2024-09-12T18:26:41.876138+0000","last_unstale":"2024-09-12T19:12:24.127193+0000","last_undegraded":"2024-09-12T19:12:24.127193+0000","last_fullsized":"2024-09-12T19:12:24.127193+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":1200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:46.850535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4890,"num_write":1674,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'277","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.703873+0000","last_change":"2024-09-12T18:26:39.844674+0000","last_active":"2024-09-12T19:13:57.703873+0000","last_peered":"2024-09-12T19:13:57.703873+0000","last_clean":"2024-09-12T19:13:57.703873+0000","last_became_active":"2024-09-12T18:26:39.844346+0000","last_became_peered":"2024-09-12T18:26:39.844346+0000","last_unstale":"2024-09-12T19:13:57.703873+0000","last_undegraded":"2024-09-12T19:13:57.703873+0000","last_fullsized":"2024-09-12T19:13:57.703873+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:51.398790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5747617,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":413,"num_read_kb":67178,"num_write":960,"num_write_kb":30033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'741","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.102708+0000","last_change":"2024-09-12T18:27:11.824740+0000","last_active":"2024-09-12T19:13:43.102708+0000","last_peered":"2024-09-12T19:13:43.102708+0000","last_clean":"2024-09-12T19:13:43.102708+0000","last_became_active":"2024-09-12T18:27:11.823747+0000","last_became_peered":"2024-09-12T18:27:11.823747+0000","last_unstale":"2024-09-12T19:13:43.102708+0000","last_undegraded":"2024-09-12T19:13:43.102708+0000","last_fullsized":"2024-09-12T19:13:43.102708+0000","mapping_epoch":37,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:51.790957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3535,"num_read_kb":3187,"num_write":978,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"265'280","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.310631+0000","last_change":"2024-09-12T18:26:39.871790+0000","last_active":"2024-09-12T19:12:07.310631+0000","last_peered":"2024-09-12T19:12:07.310631+0000","last_clean":"2024-09-12T19:12:07.310631+0000","last_became_active":"2024-09-12T18:26:39.871119+0000","last_became_peered":"2024-09-12T18:26:39.871119+0000","last_unstale":"2024-09-12T19:12:07.310631+0000","last_undegraded":"2024-09-12T19:12:07.310631+0000","last_fullsized":"2024-09-12T19:12:07.310631+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:01.325896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1105860,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":486,"num_read_kb":8461,"num_write":1059,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'1064","reported_seq":2771,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.604993+0000","last_change":"2024-09-12T18:26:41.869379+0000","last_active":"2024-09-12T19:12:09.604993+0000","last_peered":"2024-09-12T19:12:09.604993+0000","last_clean":"2024-09-12T19:12:09.604993+0000","last_became_active":"2024-09-12T18:26:41.863607+0000","last_became_peered":"2024-09-12T18:26:41.863607+0000","last_unstale":"2024-09-12T19:12:09.604993+0000","last_undegraded":"2024-09-12T19:12:09.604993+0000","last_fullsized":"2024-09-12T19:12:09.604993+0000","mapping_epoch":26,"log_start":"265'1000","ondisk_log_start":"265'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1000,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:52.994239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5203,"num_read_kb":4615,"num_write":1535,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'281","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:03.453454+0000","last_change":"2024-09-12T18:26:39.828227+0000","last_active":"2024-09-12T19:12:03.453454+0000","last_peered":"2024-09-12T19:12:03.453454+0000","last_clean":"2024-09-12T19:12:03.453454+0000","last_became_active":"2024-09-12T18:26:39.827475+0000","last_became_peered":"2024-09-12T18:26:39.827475+0000","last_unstale":"2024-09-12T19:12:03.453454+0000","last_undegraded":"2024-09-12T19:12:03.453454+0000","last_fullsized":"2024-09-12T19:12:03.453454+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:39.931458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10582884,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":436,"num_read_kb":48335,"num_write":1051,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'824","reported_seq":2436,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.126652+0000","last_change":"2024-09-12T18:26:41.851460+0000","last_active":"2024-09-12T19:12:24.126652+0000","last_peered":"2024-09-12T19:12:24.126652+0000","last_clean":"2024-09-12T19:12:24.126652+0000","last_became_active":"2024-09-12T18:26:41.851080+0000","last_became_peered":"2024-09-12T18:26:41.851080+0000","last_unstale":"2024-09-12T19:12:24.126652+0000","last_undegraded":"2024-09-12T19:12:24.126652+0000","last_fullsized":"2024-09-12T19:12:24.126652+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:00.421668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4015,"num_read_kb":3626,"num_write":1096,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'287","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:02.489033+0000","last_change":"2024-09-12T18:26:39.850533+0000","last_active":"2024-09-12T19:11:02.489033+0000","last_peered":"2024-09-12T19:11:02.489033+0000","last_clean":"2024-09-12T19:11:02.489033+0000","last_became_active":"2024-09-12T18:26:39.849722+0000","last_became_peered":"2024-09-12T18:26:39.849722+0000","last_unstale":"2024-09-12T19:11:02.489033+0000","last_undegraded":"2024-09-12T19:11:02.489033+0000","last_fullsized":"2024-09-12T19:11:02.489033+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:57.210670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15791650,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":438,"num_read_kb":40604,"num_write":1031,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'396","reported_seq":1927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.290269+0000","last_change":"2024-09-12T18:26:41.851925+0000","last_active":"2024-09-12T19:12:23.290269+0000","last_peered":"2024-09-12T19:12:23.290269+0000","last_clean":"2024-09-12T19:12:23.290269+0000","last_became_active":"2024-09-12T18:26:41.851159+0000","last_became_peered":"2024-09-12T18:26:41.851159+0000","last_unstale":"2024-09-12T19:12:23.290269+0000","last_undegraded":"2024-09-12T19:12:23.290269+0000","last_fullsized":"2024-09-12T19:12:23.290269+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:12.817942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2139,"num_read_kb":2047,"num_write":455,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'252","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.221348+0000","last_change":"2024-09-12T18:26:39.828823+0000","last_active":"2024-09-12T19:12:07.221348+0000","last_peered":"2024-09-12T19:12:07.221348+0000","last_clean":"2024-09-12T19:12:07.221348+0000","last_became_active":"2024-09-12T18:26:39.827933+0000","last_became_peered":"2024-09-12T18:26:39.827933+0000","last_unstale":"2024-09-12T19:12:07.221348+0000","last_undegraded":"2024-09-12T19:12:07.221348+0000","last_fullsized":"2024-09-12T19:12:07.221348+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:56.699019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293141,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":367,"num_read_kb":364,"num_write":880,"num_write_kb":38290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'1178","reported_seq":2805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.105889+0000","last_change":"2024-09-12T18:26:41.873225+0000","last_active":"2024-09-12T19:12:01.105889+0000","last_peered":"2024-09-12T19:12:01.105889+0000","last_clean":"2024-09-12T19:12:01.105889+0000","last_became_active":"2024-09-12T18:26:41.872816+0000","last_became_peered":"2024-09-12T18:26:41.872816+0000","last_unstale":"2024-09-12T19:12:01.105889+0000","last_undegraded":"2024-09-12T19:12:01.105889+0000","last_fullsized":"2024-09-12T19:12:01.105889+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:18.236340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5354,"num_read_kb":4741,"num_write":1604,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'253","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:13.914600+0000","last_change":"2024-09-12T18:27:12.006534+0000","last_active":"2024-09-12T19:11:13.914600+0000","last_peered":"2024-09-12T19:11:13.914600+0000","last_clean":"2024-09-12T19:11:13.914600+0000","last_became_active":"2024-09-12T18:27:12.005906+0000","last_became_peered":"2024-09-12T18:27:12.005906+0000","last_unstale":"2024-09-12T19:11:13.914600+0000","last_undegraded":"2024-09-12T19:11:13.914600+0000","last_fullsized":"2024-09-12T19:11:13.914600+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:10.452660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7395832,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":368,"num_read_kb":9281,"num_write":977,"num_write_kb":40338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"265'418","reported_seq":1866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.109146+0000","last_change":"2024-09-12T18:26:41.867368+0000","last_active":"2024-09-12T19:13:43.109146+0000","last_peered":"2024-09-12T19:13:43.109146+0000","last_clean":"2024-09-12T19:13:43.109146+0000","last_became_active":"2024-09-12T18:26:41.866602+0000","last_became_peered":"2024-09-12T18:26:41.866602+0000","last_unstale":"2024-09-12T19:13:43.109146+0000","last_undegraded":"2024-09-12T19:13:43.109146+0000","last_fullsized":"2024-09-12T19:13:43.109146+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:37.206508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2028,"num_write":492,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'297","reported_seq":918,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:57.633745+0000","last_change":"2024-09-12T18:26:39.872098+0000","last_active":"2024-09-12T19:11:57.633745+0000","last_peered":"2024-09-12T19:11:57.633745+0000","last_clean":"2024-09-12T19:11:57.633745+0000","last_became_active":"2024-09-12T18:26:39.871626+0000","last_became_peered":"2024-09-12T18:26:39.871626+0000","last_unstale":"2024-09-12T19:11:57.633745+0000","last_undegraded":"2024-09-12T19:11:57.633745+0000","last_fullsized":"2024-09-12T19:11:57.633745+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:14.820272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7166305,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":403,"num_read_kb":15528,"num_write":1047,"num_write_kb":35488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'1248","reported_seq":2886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.769985+0000","last_change":"2024-09-12T18:26:41.877593+0000","last_active":"2024-09-12T19:12:08.769985+0000","last_peered":"2024-09-12T19:12:08.769985+0000","last_clean":"2024-09-12T19:12:08.769985+0000","last_became_active":"2024-09-12T18:26:41.876708+0000","last_became_peered":"2024-09-12T18:26:41.876708+0000","last_unstale":"2024-09-12T19:12:08.769985+0000","last_undegraded":"2024-09-12T19:12:08.769985+0000","last_fullsized":"2024-09-12T19:12:08.769985+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:14.658782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5682,"num_read_kb":5005,"num_write":1690,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'263","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:05.909705+0000","last_change":"2024-09-12T18:26:39.858750+0000","last_active":"2024-09-12T19:12:05.909705+0000","last_peered":"2024-09-12T19:12:05.909705+0000","last_clean":"2024-09-12T19:12:05.909705+0000","last_became_active":"2024-09-12T18:26:39.857956+0000","last_became_peered":"2024-09-12T18:26:39.857956+0000","last_unstale":"2024-09-12T19:12:05.909705+0000","last_undegraded":"2024-09-12T19:12:05.909705+0000","last_fullsized":"2024-09-12T19:12:05.909705+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:36.402643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9048989,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":434,"num_read_kb":32197,"num_write":886,"num_write_kb":38029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'898","reported_seq":2593,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.554895+0000","last_change":"2024-09-12T18:26:41.854757+0000","last_active":"2024-09-12T19:12:06.554895+0000","last_peered":"2024-09-12T19:12:06.554895+0000","last_clean":"2024-09-12T19:12:06.554895+0000","last_became_active":"2024-09-12T18:26:41.854471+0000","last_became_peered":"2024-09-12T18:26:41.854471+0000","last_unstale":"2024-09-12T19:12:06.554895+0000","last_undegraded":"2024-09-12T19:12:06.554895+0000","last_fullsized":"2024-09-12T19:12:06.554895+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":800,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:00.860983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4435,"num_read_kb":4011,"num_write":1173,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'360","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.930373+0000","last_change":"2024-09-12T18:26:39.871177+0000","last_active":"2024-09-12T19:13:57.930373+0000","last_peered":"2024-09-12T19:13:57.930373+0000","last_clean":"2024-09-12T19:13:57.930373+0000","last_became_active":"2024-09-12T18:26:39.869924+0000","last_became_peered":"2024-09-12T18:26:39.869924+0000","last_unstale":"2024-09-12T19:13:57.930373+0000","last_undegraded":"2024-09-12T19:13:57.930373+0000","last_fullsized":"2024-09-12T19:13:57.930373+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:42.282746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429061,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":520,"num_read_kb":35584,"num_write":1204,"num_write_kb":36960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'684","reported_seq":2473,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.610409+0000","last_change":"2024-09-12T18:26:41.858693+0000","last_active":"2024-09-12T19:12:18.610409+0000","last_peered":"2024-09-12T19:12:18.610409+0000","last_clean":"2024-09-12T19:12:18.610409+0000","last_became_active":"2024-09-12T18:26:41.858362+0000","last_became_peered":"2024-09-12T18:26:41.858362+0000","last_unstale":"2024-09-12T19:12:18.610409+0000","last_undegraded":"2024-09-12T19:12:18.610409+0000","last_fullsized":"2024-09-12T19:12:18.610409+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:42.785349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3672,"num_read_kb":3341,"num_write":924,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'352","reported_seq":1135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:36.227159+0000","last_change":"2024-09-12T18:26:39.847818+0000","last_active":"2024-09-12T19:11:36.227159+0000","last_peered":"2024-09-12T19:11:36.227159+0000","last_clean":"2024-09-12T19:11:36.227159+0000","last_became_active":"2024-09-12T18:26:39.847373+0000","last_became_peered":"2024-09-12T18:26:39.847373+0000","last_unstale":"2024-09-12T19:11:36.227159+0000","last_undegraded":"2024-09-12T19:11:36.227159+0000","last_fullsized":"2024-09-12T19:11:36.227159+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:55.989925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13837277,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":744,"num_read_kb":75469,"num_write":1349,"num_write_kb":36911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'824","reported_seq":2390,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.104105+0000","last_change":"2024-09-12T18:26:41.873328+0000","last_active":"2024-09-12T19:13:43.104105+0000","last_peered":"2024-09-12T19:13:43.104105+0000","last_clean":"2024-09-12T19:13:43.104105+0000","last_became_active":"2024-09-12T18:26:41.871610+0000","last_became_peered":"2024-09-12T18:26:41.871610+0000","last_unstale":"2024-09-12T19:13:43.104105+0000","last_undegraded":"2024-09-12T19:13:43.104105+0000","last_fullsized":"2024-09-12T19:13:43.104105+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:57.336959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3622,"num_write":1076,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'230","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:55.322689+0000","last_change":"2024-09-12T18:26:39.875309+0000","last_active":"2024-09-12T19:11:55.322689+0000","last_peered":"2024-09-12T19:11:55.322689+0000","last_clean":"2024-09-12T19:11:55.322689+0000","last_became_active":"2024-09-12T18:26:39.874710+0000","last_became_peered":"2024-09-12T18:26:39.874710+0000","last_unstale":"2024-09-12T19:11:55.322689+0000","last_undegraded":"2024-09-12T19:11:55.322689+0000","last_fullsized":"2024-09-12T19:11:55.322689+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:32.381222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049289,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":391,"num_read_kb":12735,"num_write":888,"num_write_kb":23796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'279","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:45.625552+0000","last_change":"2024-09-12T18:26:39.847812+0000","last_active":"2024-09-12T19:11:45.625552+0000","last_peered":"2024-09-12T19:11:45.625552+0000","last_clean":"2024-09-12T19:11:45.625552+0000","last_became_active":"2024-09-12T18:26:39.846477+0000","last_became_peered":"2024-09-12T18:26:39.846477+0000","last_unstale":"2024-09-12T19:11:45.625552+0000","last_undegraded":"2024-09-12T19:11:45.625552+0000","last_fullsized":"2024-09-12T19:11:45.625552+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:04.316982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4908998,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":433,"num_read_kb":32398,"num_write":952,"num_write_kb":24916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'404","reported_seq":1869,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.107075+0000","last_change":"2024-09-12T18:26:41.851628+0000","last_active":"2024-09-12T19:13:43.107075+0000","last_peered":"2024-09-12T19:13:43.107075+0000","last_clean":"2024-09-12T19:13:43.107075+0000","last_became_active":"2024-09-12T18:26:41.851295+0000","last_became_peered":"2024-09-12T18:26:41.851295+0000","last_unstale":"2024-09-12T19:13:43.107075+0000","last_undegraded":"2024-09-12T19:13:43.107075+0000","last_fullsized":"2024-09-12T19:13:43.107075+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:27.756982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":455,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'283","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.701169+0000","last_change":"2024-09-12T18:26:39.857287+0000","last_active":"2024-09-12T19:13:57.701169+0000","last_peered":"2024-09-12T19:13:57.701169+0000","last_clean":"2024-09-12T19:13:57.701169+0000","last_became_active":"2024-09-12T18:26:39.857009+0000","last_became_peered":"2024-09-12T18:26:39.857009+0000","last_unstale":"2024-09-12T19:13:57.701169+0000","last_undegraded":"2024-09-12T19:13:57.701169+0000","last_fullsized":"2024-09-12T19:13:57.701169+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:48.340491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2358323,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":400,"num_read_kb":55511,"num_write":910,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'374","reported_seq":1762,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.894092+0000","last_change":"2024-09-12T18:26:41.878961+0000","last_active":"2024-09-12T19:12:07.894092+0000","last_peered":"2024-09-12T19:12:07.894092+0000","last_clean":"2024-09-12T19:12:07.894092+0000","last_became_active":"2024-09-12T18:26:41.872448+0000","last_became_peered":"2024-09-12T18:26:41.872448+0000","last_unstale":"2024-09-12T19:12:07.894092+0000","last_undegraded":"2024-09-12T19:12:07.894092+0000","last_fullsized":"2024-09-12T19:12:07.894092+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:18.608268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1946,"num_read_kb":1855,"num_write":441,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6147,"num_read_kb":4433,"num_write":1993,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":964,"ondisk_log_size":964,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":14976,"num_read_kb":14648,"num_write":16787,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1653,"ondisk_log_size":1653,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":541,"ondisk_log_size":541,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1892511,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17046,"num_read_kb":33290,"num_write":14424,"num_write_kb":11573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2924544,"data_stored":2434194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2075,"ondisk_log_size":2075,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2396,"num_read_kb":2855,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212286,"num_read_kb":193833,"num_write":55194,"num_write_kb":18759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3910,"ondisk_log_size":3910,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":480173717,"num_objects":3830,"num_object_clones":0,"num_object_copies":7660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3830,"num_whiteouts":0,"num_read":32811,"num_read_kb":1882752,"num_write":68724,"num_write_kb":2144860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1030660096,"data_stored":1002399160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4107,"ondisk_log_size":4107,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":65769289,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":157,"num_read_kb":214446,"num_write":168,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":125255680,"data_stored":125247122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":63672137,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":152,"num_read_kb":201134,"num_write":167,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126304256,"data_stored":126295698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510016,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":391676,"kb_used_data":143916,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93980164,"statfs":{"total":96636764160,"available":96235687936,"internally_reserved":0,"allocated":147369984,"data_stored":142588376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":253688262},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510016,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300584,"kb_used_data":183384,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94071256,"statfs":{"total":96636764160,"available":96328966144,"internally_reserved":0,"allocated":187785216,"data_stored":181571212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510017,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265348,"kb_used_data":189748,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94106492,"statfs":{"total":96636764160,"available":96365047808,"internally_reserved":0,"allocated":194301952,"data_stored":188252816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510014,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":466108,"kb_used_data":218348,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93905732,"statfs":{"total":96636764160,"available":96159469568,"internally_reserved":0,"allocated":223588352,"data_stored":217599643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510014,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249168,"kb_used_data":155584,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94122672,"statfs":{"total":96636764160,"available":96381616128,"internally_reserved":0,"allocated":159318016,"data_stored":155023243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510014,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":461744,"kb_used_data":214048,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":93910096,"statfs":{"total":96636764160,"available":96163938304,"internally_reserved":0,"allocated":219185152,"data_stored":212885377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":253622728},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542722,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":342548,"kb_used_data":68420,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94029292,"statfs":{"total":96636764160,"available":96285995008,"internally_reserved":0,"allocated":70062080,"data_stored":66408599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542720,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305460,"kb_used_data":170164,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94066380,"statfs":{"total":96636764160,"available":96323973120,"internally_reserved":0,"allocated":174247936,"data_stored":169431162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":168685568,"data_stored":163929834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90566656,"data_stored":88622662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93966336,"data_stored":91148738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":178442240,"data_stored":173999215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":154951680,"data_stored":150337560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":165584896,"data_stored":160969100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":115458048,"data_stored":112176297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":63004672,"data_stored":61215754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":345602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":253869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":130758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":493397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":91329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":675840,"data_stored":565619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":258614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":295006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26972160,"data_stored":26968770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18878464,"data_stored":18877575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":10525905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13303808,"data_stored":13300344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18878464,"data_stored":18877575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11202560,"data_stored":11199985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25923584,"data_stored":25920194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28352512,"data_stored":28351697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14684160,"data_stored":14683271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:14:00.008 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T19:14:00.008 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:14:00.347 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:14:00.361 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-09-12T19:14:00.368 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":1688,"stamp":"2024-09-12T19:13:58.439072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":612115279,"num_objects":4346,"num_object_clones":0,"num_object_copies":8692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4346,"num_whiteouts":0,"num_read":286049,"num_read_kb":2547458,"num_write":157600,"num_write_kb":2466739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13558,"ondisk_log_size":13558,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2782636,"kb_used_data":1343612,"kb_used_omap":12,"kb_used_meta":1438835,"kb_avail":752192084,"statfs":{"total":773094113280,"available":770244694016,"internally_reserved":0,"allocated":1375858688,"data_stored":1333760428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1473367603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-106503838,"num_objects":-655,"num_object_clones":0,"num_object_copies":-1310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-655,"num_whiteouts":0,"num_read":814,"num_read_kb":689,"num_write":700,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007761"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.893148+0000","last_change":"2024-09-12T18:55:19.125750+0000","last_active":"2024-09-12T19:10:18.893148+0000","last_peered":"2024-09-12T19:10:18.893148+0000","last_clean":"2024-09-12T19:10:18.893148+0000","last_became_active":"2024-09-12T18:55:19.125009+0000","last_became_peered":"2024-09-12T18:55:19.125009+0000","last_unstale":"2024-09-12T19:10:18.893148+0000","last_undegraded":"2024-09-12T19:10:18.893148+0000","last_fullsized":"2024-09-12T19:10:18.893148+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:07.599229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.902941+0000","last_change":"2024-09-12T18:43:32.909745+0000","last_active":"2024-09-12T19:11:03.902941+0000","last_peered":"2024-09-12T19:11:03.902941+0000","last_clean":"2024-09-12T19:11:03.902941+0000","last_became_active":"2024-09-12T18:43:32.908691+0000","last_became_peered":"2024-09-12T18:43:32.908691+0000","last_unstale":"2024-09-12T19:11:03.902941+0000","last_undegraded":"2024-09-12T19:11:03.902941+0000","last_fullsized":"2024-09-12T19:11:03.902941+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:19.818191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.926901+0000","last_change":"2024-09-12T18:43:29.867175+0000","last_active":"2024-09-12T19:10:58.926901+0000","last_peered":"2024-09-12T19:10:58.926901+0000","last_clean":"2024-09-12T19:10:58.926901+0000","last_became_active":"2024-09-12T18:43:29.866493+0000","last_became_peered":"2024-09-12T18:43:29.866493+0000","last_unstale":"2024-09-12T19:10:58.926901+0000","last_undegraded":"2024-09-12T19:10:58.926901+0000","last_fullsized":"2024-09-12T19:10:58.926901+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:56.771077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'18","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.928758+0000","last_change":"2024-09-12T18:41:45.362583+0000","last_active":"2024-09-12T19:10:58.928758+0000","last_peered":"2024-09-12T19:10:58.928758+0000","last_clean":"2024-09-12T19:10:58.928758+0000","last_became_active":"2024-09-12T18:41:45.361841+0000","last_became_peered":"2024-09-12T18:41:45.361841+0000","last_unstale":"2024-09-12T19:10:58.928758+0000","last_undegraded":"2024-09-12T19:10:58.928758+0000","last_fullsized":"2024-09-12T19:10:58.928758+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:31.032849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":66,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.881812+0000","last_change":"2024-09-12T18:55:19.153318+0000","last_active":"2024-09-12T19:10:18.881812+0000","last_peered":"2024-09-12T19:10:18.881812+0000","last_clean":"2024-09-12T19:10:18.881812+0000","last_became_active":"2024-09-12T18:55:19.150059+0000","last_became_peered":"2024-09-12T18:55:19.150059+0000","last_unstale":"2024-09-12T19:10:18.881812+0000","last_undegraded":"2024-09-12T19:10:18.881812+0000","last_fullsized":"2024-09-12T19:10:18.881812+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:04.495819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:04.112646+0000","last_change":"2024-09-12T18:43:32.905639+0000","last_active":"2024-09-12T19:11:04.112646+0000","last_peered":"2024-09-12T19:11:04.112646+0000","last_clean":"2024-09-12T19:11:04.112646+0000","last_became_active":"2024-09-12T18:43:32.904914+0000","last_became_peered":"2024-09-12T18:43:32.904914+0000","last_unstale":"2024-09-12T19:11:04.112646+0000","last_undegraded":"2024-09-12T19:11:04.112646+0000","last_fullsized":"2024-09-12T19:11:04.112646+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:47.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:32.741144+0000","last_change":"2024-09-12T18:43:29.895683+0000","last_active":"2024-09-12T19:13:32.741144+0000","last_peered":"2024-09-12T19:13:32.741144+0000","last_clean":"2024-09-12T19:13:32.741144+0000","last_became_active":"2024-09-12T18:43:29.891221+0000","last_became_peered":"2024-09-12T18:43:29.891221+0000","last_unstale":"2024-09-12T19:13:32.741144+0000","last_undegraded":"2024-09-12T19:13:32.741144+0000","last_fullsized":"2024-09-12T19:13:32.741144+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:28.583040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'32","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.876821+0000","last_change":"2024-09-12T18:41:45.362441+0000","last_active":"2024-09-12T19:09:53.876821+0000","last_peered":"2024-09-12T19:09:53.876821+0000","last_clean":"2024-09-12T19:09:53.876821+0000","last_became_active":"2024-09-12T18:41:45.361664+0000","last_became_peered":"2024-09-12T18:41:45.361664+0000","last_unstale":"2024-09-12T19:09:53.876821+0000","last_undegraded":"2024-09-12T19:09:53.876821+0000","last_fullsized":"2024-09-12T19:09:53.876821+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:16.353573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.888584+0000","last_change":"2024-09-12T18:55:19.120410+0000","last_active":"2024-09-12T19:09:48.888584+0000","last_peered":"2024-09-12T19:09:48.888584+0000","last_clean":"2024-09-12T19:09:48.888584+0000","last_became_active":"2024-09-12T18:55:19.119601+0000","last_became_peered":"2024-09-12T18:55:19.119601+0000","last_unstale":"2024-09-12T19:09:48.888584+0000","last_undegraded":"2024-09-12T19:09:48.888584+0000","last_fullsized":"2024-09-12T19:09:48.888584+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:00.200110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.923902+0000","last_change":"2024-09-12T18:43:32.917442+0000","last_active":"2024-09-12T19:10:38.923902+0000","last_peered":"2024-09-12T19:10:38.923902+0000","last_clean":"2024-09-12T19:10:38.923902+0000","last_became_active":"2024-09-12T18:43:32.916727+0000","last_became_peered":"2024-09-12T18:43:32.916727+0000","last_unstale":"2024-09-12T19:10:38.923902+0000","last_undegraded":"2024-09-12T19:10:38.923902+0000","last_fullsized":"2024-09-12T19:10:38.923902+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:51.785407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12290,"num_write":7,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"265'14","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.714674+0000","last_change":"2024-09-12T18:43:29.884424+0000","last_active":"2024-09-12T19:11:38.714674+0000","last_peered":"2024-09-12T19:11:38.714674+0000","last_clean":"2024-09-12T19:11:38.714674+0000","last_became_active":"2024-09-12T18:43:29.881401+0000","last_became_peered":"2024-09-12T18:43:29.881401+0000","last_unstale":"2024-09-12T19:11:38.714674+0000","last_undegraded":"2024-09-12T19:11:38.714674+0000","last_fullsized":"2024-09-12T19:11:38.714674+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:45.030211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":40962,"num_write":19,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'47","reported_seq":173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:04.762249+0000","last_change":"2024-09-12T18:41:45.360114+0000","last_active":"2024-09-12T19:10:04.762249+0000","last_peered":"2024-09-12T19:10:04.762249+0000","last_clean":"2024-09-12T19:10:04.762249+0000","last_became_active":"2024-09-12T18:41:45.350377+0000","last_became_peered":"2024-09-12T18:41:45.350377+0000","last_unstale":"2024-09-12T19:10:04.762249+0000","last_undegraded":"2024-09-12T19:10:04.762249+0000","last_fullsized":"2024-09-12T19:10:04.762249+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:15.485612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":164,"num_write":88,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.910960+0000","last_change":"2024-09-12T18:55:19.136469+0000","last_active":"2024-09-12T19:09:53.910960+0000","last_peered":"2024-09-12T19:09:53.910960+0000","last_clean":"2024-09-12T19:09:53.910960+0000","last_became_active":"2024-09-12T18:55:19.135875+0000","last_became_peered":"2024-09-12T18:55:19.135875+0000","last_unstale":"2024-09-12T19:09:53.910960+0000","last_undegraded":"2024-09-12T19:09:53.910960+0000","last_fullsized":"2024-09-12T19:09:53.910960+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:50.008510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'1","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.716115+0000","last_change":"2024-09-12T18:43:32.939294+0000","last_active":"2024-09-12T19:11:43.716115+0000","last_peered":"2024-09-12T19:11:43.716115+0000","last_clean":"2024-09-12T19:11:43.716115+0000","last_became_active":"2024-09-12T18:43:32.935176+0000","last_became_peered":"2024-09-12T18:43:32.935176+0000","last_unstale":"2024-09-12T19:11:43.716115+0000","last_undegraded":"2024-09-12T19:11:43.716115+0000","last_fullsized":"2024-09-12T19:11:43.716115+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:27.896775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:39.107194+0000","last_change":"2024-09-12T18:43:29.873805+0000","last_active":"2024-09-12T19:10:39.107194+0000","last_peered":"2024-09-12T19:10:39.107194+0000","last_clean":"2024-09-12T19:10:39.107194+0000","last_became_active":"2024-09-12T18:43:29.873115+0000","last_became_peered":"2024-09-12T18:43:29.873115+0000","last_unstale":"2024-09-12T19:10:39.107194+0000","last_undegraded":"2024-09-12T19:10:39.107194+0000","last_fullsized":"2024-09-12T19:10:39.107194+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:22.098039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'47","reported_seq":168,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.878251+0000","last_change":"2024-09-12T18:41:45.350781+0000","last_active":"2024-09-12T19:11:19.878251+0000","last_peered":"2024-09-12T19:11:19.878251+0000","last_clean":"2024-09-12T19:11:19.878251+0000","last_became_active":"2024-09-12T18:41:45.350035+0000","last_became_peered":"2024-09-12T18:41:45.350035+0000","last_unstale":"2024-09-12T19:11:19.878251+0000","last_undegraded":"2024-09-12T19:11:19.878251+0000","last_fullsized":"2024-09-12T19:11:19.878251+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:07.679045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":157,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:28.712218+0000","last_change":"2024-09-12T18:55:19.157689+0000","last_active":"2024-09-12T19:11:28.712218+0000","last_peered":"2024-09-12T19:11:28.712218+0000","last_clean":"2024-09-12T19:11:28.712218+0000","last_became_active":"2024-09-12T18:55:19.156936+0000","last_became_peered":"2024-09-12T18:55:19.156936+0000","last_unstale":"2024-09-12T19:11:28.712218+0000","last_undegraded":"2024-09-12T19:11:28.712218+0000","last_fullsized":"2024-09-12T19:11:28.712218+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:02.316107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.893085+0000","last_change":"2024-09-12T18:43:32.931532+0000","last_active":"2024-09-12T19:10:18.893085+0000","last_peered":"2024-09-12T19:10:18.893085+0000","last_clean":"2024-09-12T19:10:18.893085+0000","last_became_active":"2024-09-12T18:43:32.930772+0000","last_became_peered":"2024-09-12T18:43:32.930772+0000","last_unstale":"2024-09-12T19:10:18.893085+0000","last_undegraded":"2024-09-12T19:10:18.893085+0000","last_fullsized":"2024-09-12T19:10:18.893085+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:02.364155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'1","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.915522+0000","last_change":"2024-09-12T18:43:29.884425+0000","last_active":"2024-09-12T19:10:08.915522+0000","last_peered":"2024-09-12T19:10:08.915522+0000","last_clean":"2024-09-12T19:10:08.915522+0000","last_became_active":"2024-09-12T18:43:29.883399+0000","last_became_peered":"2024-09-12T18:43:29.883399+0000","last_unstale":"2024-09-12T19:10:08.915522+0000","last_undegraded":"2024-09-12T19:10:08.915522+0000","last_fullsized":"2024-09-12T19:10:08.915522+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:31.245225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'25","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:31.792096+0000","last_change":"2024-09-12T18:41:45.359067+0000","last_active":"2024-09-12T19:10:31.792096+0000","last_peered":"2024-09-12T19:10:31.792096+0000","last_clean":"2024-09-12T19:10:31.792096+0000","last_became_active":"2024-09-12T18:41:45.355180+0000","last_became_peered":"2024-09-12T18:41:45.355180+0000","last_unstale":"2024-09-12T19:10:31.792096+0000","last_undegraded":"2024-09-12T19:10:31.792096+0000","last_fullsized":"2024-09-12T19:10:31.792096+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:27.390592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:57.900836+0000","last_change":"2024-09-12T18:55:19.139208+0000","last_active":"2024-09-12T19:09:57.900836+0000","last_peered":"2024-09-12T19:09:57.900836+0000","last_clean":"2024-09-12T19:09:57.900836+0000","last_became_active":"2024-09-12T18:55:19.138472+0000","last_became_peered":"2024-09-12T18:55:19.138472+0000","last_unstale":"2024-09-12T19:09:57.900836+0000","last_undegraded":"2024-09-12T19:09:57.900836+0000","last_fullsized":"2024-09-12T19:09:57.900836+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:46.378454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.893333+0000","last_change":"2024-09-12T18:43:32.936388+0000","last_active":"2024-09-12T19:10:08.893333+0000","last_peered":"2024-09-12T19:10:08.893333+0000","last_clean":"2024-09-12T19:10:08.893333+0000","last_became_active":"2024-09-12T18:43:32.935898+0000","last_became_peered":"2024-09-12T18:43:32.935898+0000","last_unstale":"2024-09-12T19:10:08.893333+0000","last_undegraded":"2024-09-12T19:10:08.893333+0000","last_fullsized":"2024-09-12T19:10:08.893333+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:23.395289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'1","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:09.100142+0000","last_change":"2024-09-12T18:43:29.885221+0000","last_active":"2024-09-12T19:10:09.100142+0000","last_peered":"2024-09-12T19:10:09.100142+0000","last_clean":"2024-09-12T19:10:09.100142+0000","last_became_active":"2024-09-12T18:43:29.882621+0000","last_became_peered":"2024-09-12T18:43:29.882621+0000","last_unstale":"2024-09-12T19:10:09.100142+0000","last_undegraded":"2024-09-12T19:10:09.100142+0000","last_fullsized":"2024-09-12T19:10:09.100142+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:41.071383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'16","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.882329+0000","last_change":"2024-09-12T18:41:45.358702+0000","last_active":"2024-09-12T19:09:18.882329+0000","last_peered":"2024-09-12T19:09:18.882329+0000","last_clean":"2024-09-12T19:09:18.882329+0000","last_became_active":"2024-09-12T18:41:45.357957+0000","last_became_peered":"2024-09-12T18:41:45.357957+0000","last_unstale":"2024-09-12T19:09:18.882329+0000","last_undegraded":"2024-09-12T19:09:18.882329+0000","last_fullsized":"2024-09-12T19:09:18.882329+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:45.441066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":53,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899753+0000","last_change":"2024-09-12T18:55:19.148993+0000","last_active":"2024-09-12T19:10:22.899753+0000","last_peered":"2024-09-12T19:10:22.899753+0000","last_clean":"2024-09-12T19:10:22.899753+0000","last_became_active":"2024-09-12T18:55:19.147110+0000","last_became_peered":"2024-09-12T18:55:19.147110+0000","last_unstale":"2024-09-12T19:10:22.899753+0000","last_undegraded":"2024-09-12T19:10:22.899753+0000","last_fullsized":"2024-09-12T19:10:22.899753+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:46.858987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.905541+0000","last_change":"2024-09-12T18:43:32.923207+0000","last_active":"2024-09-12T19:11:03.905541+0000","last_peered":"2024-09-12T19:11:03.905541+0000","last_clean":"2024-09-12T19:11:03.905541+0000","last_became_active":"2024-09-12T18:43:32.922514+0000","last_became_peered":"2024-09-12T18:43:32.922514+0000","last_unstale":"2024-09-12T19:11:03.905541+0000","last_undegraded":"2024-09-12T19:11:03.905541+0000","last_fullsized":"2024-09-12T19:11:03.905541+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:30.175347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:04.112553+0000","last_change":"2024-09-12T18:43:29.905017+0000","last_active":"2024-09-12T19:11:04.112553+0000","last_peered":"2024-09-12T19:11:04.112553+0000","last_clean":"2024-09-12T19:11:04.112553+0000","last_became_active":"2024-09-12T18:43:29.904226+0000","last_became_peered":"2024-09-12T18:43:29.904226+0000","last_unstale":"2024-09-12T19:11:04.112553+0000","last_undegraded":"2024-09-12T19:11:04.112553+0000","last_fullsized":"2024-09-12T19:11:04.112553+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:47.238023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'21","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:53.927298+0000","last_change":"2024-09-12T18:41:45.359716+0000","last_active":"2024-09-12T19:10:53.927298+0000","last_peered":"2024-09-12T19:10:53.927298+0000","last_clean":"2024-09-12T19:10:53.927298+0000","last_became_active":"2024-09-12T18:41:45.351791+0000","last_became_peered":"2024-09-12T18:41:45.351791+0000","last_unstale":"2024-09-12T19:10:53.927298+0000","last_undegraded":"2024-09-12T19:10:53.927298+0000","last_fullsized":"2024-09-12T19:10:53.927298+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:10.883167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899885+0000","last_change":"2024-09-12T18:55:19.149601+0000","last_active":"2024-09-12T19:10:22.899885+0000","last_peered":"2024-09-12T19:10:22.899885+0000","last_clean":"2024-09-12T19:10:22.899885+0000","last_became_active":"2024-09-12T18:55:19.148859+0000","last_became_peered":"2024-09-12T18:55:19.148859+0000","last_unstale":"2024-09-12T19:10:22.899885+0000","last_undegraded":"2024-09-12T19:10:22.899885+0000","last_fullsized":"2024-09-12T19:10:22.899885+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:12.702998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'1","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.928529+0000","last_change":"2024-09-12T18:43:32.937883+0000","last_active":"2024-09-12T19:11:03.928529+0000","last_peered":"2024-09-12T19:11:03.928529+0000","last_clean":"2024-09-12T19:11:03.928529+0000","last_became_active":"2024-09-12T18:43:32.935669+0000","last_became_peered":"2024-09-12T18:43:32.935669+0000","last_unstale":"2024-09-12T19:11:03.928529+0000","last_undegraded":"2024-09-12T19:11:03.928529+0000","last_fullsized":"2024-09-12T19:11:03.928529+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:02.525737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.930224+0000","last_change":"2024-09-12T18:43:29.884274+0000","last_active":"2024-09-12T19:11:03.930224+0000","last_peered":"2024-09-12T19:11:03.930224+0000","last_clean":"2024-09-12T19:11:03.930224+0000","last_became_active":"2024-09-12T18:43:29.883324+0000","last_became_peered":"2024-09-12T18:43:29.883324+0000","last_unstale":"2024-09-12T19:11:03.930224+0000","last_undegraded":"2024-09-12T19:11:03.930224+0000","last_fullsized":"2024-09-12T19:11:03.930224+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.971344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'60","reported_seq":219,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:14.482064+0000","last_change":"2024-09-12T18:41:45.345965+0000","last_active":"2024-09-12T19:11:14.482064+0000","last_peered":"2024-09-12T19:11:14.482064+0000","last_clean":"2024-09-12T19:11:14.482064+0000","last_became_active":"2024-09-12T18:41:45.339369+0000","last_became_peered":"2024-09-12T18:41:45.339369+0000","last_unstale":"2024-09-12T19:11:14.482064+0000","last_undegraded":"2024-09-12T19:11:14.482064+0000","last_fullsized":"2024-09-12T19:11:14.482064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:10.411652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":229,"num_write":103,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:22.892454+0000","last_change":"2024-09-12T18:55:19.123103+0000","last_active":"2024-09-12T19:09:22.892454+0000","last_peered":"2024-09-12T19:09:22.892454+0000","last_clean":"2024-09-12T19:09:22.892454+0000","last_became_active":"2024-09-12T18:55:19.122414+0000","last_became_peered":"2024-09-12T18:55:19.122414+0000","last_unstale":"2024-09-12T19:09:22.892454+0000","last_undegraded":"2024-09-12T19:09:22.892454+0000","last_fullsized":"2024-09-12T19:09:22.892454+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:12.271436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.914646+0000","last_change":"2024-09-12T18:43:32.927238+0000","last_active":"2024-09-12T19:10:08.914646+0000","last_peered":"2024-09-12T19:10:08.914646+0000","last_clean":"2024-09-12T19:10:08.914646+0000","last_became_active":"2024-09-12T18:43:32.924570+0000","last_became_peered":"2024-09-12T18:43:32.924570+0000","last_unstale":"2024-09-12T19:10:08.914646+0000","last_undegraded":"2024-09-12T19:10:08.914646+0000","last_fullsized":"2024-09-12T19:10:08.914646+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:12.682450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'1","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.879155+0000","last_change":"2024-09-12T18:43:29.869397+0000","last_active":"2024-09-12T19:09:18.879155+0000","last_peered":"2024-09-12T19:09:18.879155+0000","last_clean":"2024-09-12T19:09:18.879155+0000","last_became_active":"2024-09-12T18:43:29.868738+0000","last_became_peered":"2024-09-12T18:43:29.868738+0000","last_unstale":"2024-09-12T19:09:18.879155+0000","last_undegraded":"2024-09-12T19:09:18.879155+0000","last_fullsized":"2024-09-12T19:09:18.879155+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:27.215594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'11","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.926325+0000","last_change":"2024-09-12T18:41:45.352288+0000","last_active":"2024-09-12T19:10:48.926325+0000","last_peered":"2024-09-12T19:10:48.926325+0000","last_clean":"2024-09-12T19:10:48.926325+0000","last_became_active":"2024-09-12T18:41:45.351553+0000","last_became_peered":"2024-09-12T18:41:45.351553+0000","last_unstale":"2024-09-12T19:10:48.926325+0000","last_undegraded":"2024-09-12T19:10:48.926325+0000","last_fullsized":"2024-09-12T19:10:48.926325+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:04.726575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":29,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.869417+0000","last_change":"2024-09-12T18:55:19.139323+0000","last_active":"2024-09-12T19:09:18.869417+0000","last_peered":"2024-09-12T19:09:18.869417+0000","last_clean":"2024-09-12T19:09:18.869417+0000","last_became_active":"2024-09-12T18:55:19.138649+0000","last_became_peered":"2024-09-12T18:55:19.138649+0000","last_unstale":"2024-09-12T19:09:18.869417+0000","last_undegraded":"2024-09-12T19:09:18.869417+0000","last_fullsized":"2024-09-12T19:09:18.869417+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:14.966478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.902275+0000","last_change":"2024-09-12T18:43:32.928110+0000","last_active":"2024-09-12T19:09:18.902275+0000","last_peered":"2024-09-12T19:09:18.902275+0000","last_clean":"2024-09-12T19:09:18.902275+0000","last_became_active":"2024-09-12T18:43:32.927181+0000","last_became_peered":"2024-09-12T18:43:32.927181+0000","last_unstale":"2024-09-12T19:09:18.902275+0000","last_undegraded":"2024-09-12T19:09:18.902275+0000","last_fullsized":"2024-09-12T19:09:18.902275+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:23.355481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'8","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.896153+0000","last_change":"2024-09-12T18:43:29.895323+0000","last_active":"2024-09-12T19:10:07.896153+0000","last_peered":"2024-09-12T19:10:07.896153+0000","last_clean":"2024-09-12T19:10:07.896153+0000","last_became_active":"2024-09-12T18:43:29.894650+0000","last_became_peered":"2024-09-12T18:43:29.894650+0000","last_unstale":"2024-09-12T19:10:07.896153+0000","last_undegraded":"2024-09-12T19:10:07.896153+0000","last_fullsized":"2024-09-12T19:10:07.896153+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:51.742629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8194,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'29","reported_seq":121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.891219+0000","last_change":"2024-09-12T18:41:45.361458+0000","last_active":"2024-09-12T19:11:19.891219+0000","last_peered":"2024-09-12T19:11:19.891219+0000","last_clean":"2024-09-12T19:11:19.891219+0000","last_became_active":"2024-09-12T18:41:45.360856+0000","last_became_peered":"2024-09-12T18:41:45.360856+0000","last_unstale":"2024-09-12T19:11:19.891219+0000","last_undegraded":"2024-09-12T19:11:19.891219+0000","last_fullsized":"2024-09-12T19:11:19.891219+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.915436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":92,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:22.884390+0000","last_change":"2024-09-12T18:55:19.126091+0000","last_active":"2024-09-12T19:09:22.884390+0000","last_peered":"2024-09-12T19:09:22.884390+0000","last_clean":"2024-09-12T19:09:22.884390+0000","last_became_active":"2024-09-12T18:55:19.123727+0000","last_became_peered":"2024-09-12T18:55:19.123727+0000","last_unstale":"2024-09-12T19:09:22.884390+0000","last_undegraded":"2024-09-12T19:09:22.884390+0000","last_fullsized":"2024-09-12T19:09:22.884390+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:20.999734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.914770+0000","last_change":"2024-09-12T18:43:32.935321+0000","last_active":"2024-09-12T19:10:08.914770+0000","last_peered":"2024-09-12T19:10:08.914770+0000","last_clean":"2024-09-12T19:10:08.914770+0000","last_became_active":"2024-09-12T18:43:32.934654+0000","last_became_peered":"2024-09-12T18:43:32.934654+0000","last_unstale":"2024-09-12T19:10:08.914770+0000","last_undegraded":"2024-09-12T19:10:08.914770+0000","last_fullsized":"2024-09-12T19:10:08.914770+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:18.460691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.878771+0000","last_change":"2024-09-12T18:43:29.865882+0000","last_active":"2024-09-12T19:10:03.878771+0000","last_peered":"2024-09-12T19:10:03.878771+0000","last_clean":"2024-09-12T19:10:03.878771+0000","last_became_active":"2024-09-12T18:43:29.863876+0000","last_became_peered":"2024-09-12T18:43:29.863876+0000","last_unstale":"2024-09-12T19:10:03.878771+0000","last_undegraded":"2024-09-12T19:10:03.878771+0000","last_fullsized":"2024-09-12T19:10:03.878771+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:17.118378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'15","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.888129+0000","last_change":"2024-09-12T18:41:45.347581+0000","last_active":"2024-09-12T19:10:48.888129+0000","last_peered":"2024-09-12T19:10:48.888129+0000","last_clean":"2024-09-12T19:10:48.888129+0000","last_became_active":"2024-09-12T18:41:45.346831+0000","last_became_peered":"2024-09-12T18:41:45.346831+0000","last_unstale":"2024-09-12T19:10:48.888129+0000","last_undegraded":"2024-09-12T19:10:48.888129+0000","last_fullsized":"2024-09-12T19:10:48.888129+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:46.368160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":48,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.879056+0000","last_change":"2024-09-12T18:55:19.129602+0000","last_active":"2024-09-12T19:09:18.879056+0000","last_peered":"2024-09-12T19:09:18.879056+0000","last_clean":"2024-09-12T19:09:18.879056+0000","last_became_active":"2024-09-12T18:55:19.125607+0000","last_became_peered":"2024-09-12T18:55:19.125607+0000","last_unstale":"2024-09-12T19:09:18.879056+0000","last_undegraded":"2024-09-12T19:09:18.879056+0000","last_fullsized":"2024-09-12T19:09:18.879056+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:37.974980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:09.100279+0000","last_change":"2024-09-12T18:43:32.909634+0000","last_active":"2024-09-12T19:10:09.100279+0000","last_peered":"2024-09-12T19:10:09.100279+0000","last_clean":"2024-09-12T19:10:09.100279+0000","last_became_active":"2024-09-12T18:43:32.908905+0000","last_became_peered":"2024-09-12T18:43:32.908905+0000","last_unstale":"2024-09-12T19:10:09.100279+0000","last_undegraded":"2024-09-12T19:10:09.100279+0000","last_fullsized":"2024-09-12T19:10:09.100279+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:55.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'6","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.915861+0000","last_change":"2024-09-12T18:43:29.883172+0000","last_active":"2024-09-12T19:10:08.915861+0000","last_peered":"2024-09-12T19:10:08.915861+0000","last_clean":"2024-09-12T19:10:08.915861+0000","last_became_active":"2024-09-12T18:43:29.880462+0000","last_became_peered":"2024-09-12T18:43:29.880462+0000","last_unstale":"2024-09-12T19:10:08.915861+0000","last_undegraded":"2024-09-12T19:10:08.915861+0000","last_fullsized":"2024-09-12T19:10:08.915861+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.795034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'6","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:57.892839+0000","last_change":"2024-09-12T18:41:45.360552+0000","last_active":"2024-09-12T19:09:57.892839+0000","last_peered":"2024-09-12T19:09:57.892839+0000","last_clean":"2024-09-12T19:09:57.892839+0000","last_became_active":"2024-09-12T18:41:45.359794+0000","last_became_peered":"2024-09-12T18:41:45.359794+0000","last_unstale":"2024-09-12T19:09:57.892839+0000","last_undegraded":"2024-09-12T19:09:57.892839+0000","last_fullsized":"2024-09-12T19:09:57.892839+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:00.750042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.910032+0000","last_change":"2024-09-12T18:55:19.154082+0000","last_active":"2024-09-12T19:09:48.910032+0000","last_peered":"2024-09-12T19:09:48.910032+0000","last_clean":"2024-09-12T19:09:48.910032+0000","last_became_active":"2024-09-12T18:55:19.152807+0000","last_became_peered":"2024-09-12T18:55:19.152807+0000","last_unstale":"2024-09-12T19:09:48.910032+0000","last_undegraded":"2024-09-12T19:09:48.910032+0000","last_fullsized":"2024-09-12T19:09:48.910032+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:33.926655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715438+0000","last_change":"2024-09-12T18:43:32.903978+0000","last_active":"2024-09-12T19:11:32.715438+0000","last_peered":"2024-09-12T19:11:32.715438+0000","last_clean":"2024-09-12T19:11:32.715438+0000","last_became_active":"2024-09-12T18:43:32.899988+0000","last_became_peered":"2024-09-12T18:43:32.899988+0000","last_unstale":"2024-09-12T19:11:32.715438+0000","last_undegraded":"2024-09-12T19:11:32.715438+0000","last_fullsized":"2024-09-12T19:11:32.715438+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:49.693725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'1","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:34.118959+0000","last_change":"2024-09-12T18:43:29.881020+0000","last_active":"2024-09-12T19:11:34.118959+0000","last_peered":"2024-09-12T19:11:34.118959+0000","last_clean":"2024-09-12T19:11:34.118959+0000","last_became_active":"2024-09-12T18:43:29.880294+0000","last_became_peered":"2024-09-12T18:43:29.880294+0000","last_unstale":"2024-09-12T19:11:34.118959+0000","last_undegraded":"2024-09-12T19:11:34.118959+0000","last_fullsized":"2024-09-12T19:11:34.118959+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:23.505932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'33","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:47.890460+0000","last_change":"2024-09-12T18:41:45.360139+0000","last_active":"2024-09-12T19:09:47.890460+0000","last_peered":"2024-09-12T19:09:47.890460+0000","last_clean":"2024-09-12T19:09:47.890460+0000","last_became_active":"2024-09-12T18:41:45.359405+0000","last_became_peered":"2024-09-12T18:41:45.359405+0000","last_unstale":"2024-09-12T19:09:47.890460+0000","last_undegraded":"2024-09-12T19:09:47.890460+0000","last_fullsized":"2024-09-12T19:09:47.890460+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:10.135901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":128,"num_write":57,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.911259+0000","last_change":"2024-09-12T18:55:19.139048+0000","last_active":"2024-09-12T19:09:48.911259+0000","last_peered":"2024-09-12T19:09:48.911259+0000","last_clean":"2024-09-12T19:09:48.911259+0000","last_became_active":"2024-09-12T18:55:19.136822+0000","last_became_peered":"2024-09-12T18:55:19.136822+0000","last_unstale":"2024-09-12T19:09:48.911259+0000","last_undegraded":"2024-09-12T19:09:48.911259+0000","last_fullsized":"2024-09-12T19:09:48.911259+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:07.426373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715353+0000","last_change":"2024-09-12T18:43:32.908035+0000","last_active":"2024-09-12T19:11:32.715353+0000","last_peered":"2024-09-12T19:11:32.715353+0000","last_clean":"2024-09-12T19:11:32.715353+0000","last_became_active":"2024-09-12T18:43:32.906911+0000","last_became_peered":"2024-09-12T18:43:32.906911+0000","last_unstale":"2024-09-12T19:11:32.715353+0000","last_undegraded":"2024-09-12T19:11:32.715353+0000","last_fullsized":"2024-09-12T19:11:32.715353+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:23.186205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"265'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:28.712068+0000","last_change":"2024-09-12T18:43:29.874437+0000","last_active":"2024-09-12T19:11:28.712068+0000","last_peered":"2024-09-12T19:11:28.712068+0000","last_clean":"2024-09-12T19:11:28.712068+0000","last_became_active":"2024-09-12T18:43:29.873561+0000","last_became_peered":"2024-09-12T18:43:29.873561+0000","last_unstale":"2024-09-12T19:11:28.712068+0000","last_undegraded":"2024-09-12T19:11:28.712068+0000","last_fullsized":"2024-09-12T19:11:28.712068+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:09.170136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8194,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'40","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.911052+0000","last_change":"2024-09-12T18:41:45.359990+0000","last_active":"2024-09-12T19:09:48.911052+0000","last_peered":"2024-09-12T19:09:48.911052+0000","last_clean":"2024-09-12T19:09:48.911052+0000","last_became_active":"2024-09-12T18:41:45.352482+0000","last_became_peered":"2024-09-12T18:41:45.352482+0000","last_unstale":"2024-09-12T19:09:48.911052+0000","last_undegraded":"2024-09-12T19:09:48.911052+0000","last_fullsized":"2024-09-12T19:09:48.911052+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:23.809564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:23.904477+0000","last_change":"2024-09-12T18:55:19.135873+0000","last_active":"2024-09-12T19:09:23.904477+0000","last_peered":"2024-09-12T19:09:23.904477+0000","last_clean":"2024-09-12T19:09:23.904477+0000","last_became_active":"2024-09-12T18:55:19.132991+0000","last_became_peered":"2024-09-12T18:55:19.132991+0000","last_unstale":"2024-09-12T19:09:23.904477+0000","last_undegraded":"2024-09-12T19:09:23.904477+0000","last_fullsized":"2024-09-12T19:09:23.904477+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:18.775245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:33.713286+0000","last_change":"2024-09-12T18:43:32.934314+0000","last_active":"2024-09-12T19:11:33.713286+0000","last_peered":"2024-09-12T19:11:33.713286+0000","last_clean":"2024-09-12T19:11:33.713286+0000","last_became_active":"2024-09-12T18:43:32.927109+0000","last_became_peered":"2024-09-12T18:43:32.927109+0000","last_unstale":"2024-09-12T19:11:33.713286+0000","last_undegraded":"2024-09-12T19:11:33.713286+0000","last_fullsized":"2024-09-12T19:11:33.713286+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:58.923503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":28674,"num_write":7,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'1","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:33.911847+0000","last_change":"2024-09-12T18:43:29.881351+0000","last_active":"2024-09-12T19:11:33.911847+0000","last_peered":"2024-09-12T19:11:33.911847+0000","last_clean":"2024-09-12T19:11:33.911847+0000","last_became_active":"2024-09-12T18:43:29.880517+0000","last_became_peered":"2024-09-12T18:43:29.880517+0000","last_unstale":"2024-09-12T19:11:33.911847+0000","last_undegraded":"2024-09-12T19:11:33.911847+0000","last_fullsized":"2024-09-12T19:11:33.911847+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:07.250936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:49.095887+0000","last_change":"2024-09-12T18:41:45.351776+0000","last_active":"2024-09-12T19:09:49.095887+0000","last_peered":"2024-09-12T19:09:49.095887+0000","last_clean":"2024-09-12T19:09:49.095887+0000","last_became_active":"2024-09-12T18:41:45.350632+0000","last_became_peered":"2024-09-12T18:41:45.350632+0000","last_unstale":"2024-09-12T19:09:49.095887+0000","last_undegraded":"2024-09-12T19:09:49.095887+0000","last_fullsized":"2024-09-12T19:09:49.095887+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:16.702236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.909979+0000","last_change":"2024-09-12T18:55:19.151498+0000","last_active":"2024-09-12T19:09:48.909979+0000","last_peered":"2024-09-12T19:09:48.909979+0000","last_clean":"2024-09-12T19:09:48.909979+0000","last_became_active":"2024-09-12T18:55:19.150880+0000","last_became_peered":"2024-09-12T18:55:19.150880+0000","last_unstale":"2024-09-12T19:09:48.909979+0000","last_undegraded":"2024-09-12T19:09:48.909979+0000","last_fullsized":"2024-09-12T19:09:48.909979+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:13.724232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'13","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:33.911802+0000","last_change":"2024-09-12T18:43:32.927843+0000","last_active":"2024-09-12T19:11:33.911802+0000","last_peered":"2024-09-12T19:11:33.911802+0000","last_clean":"2024-09-12T19:11:33.911802+0000","last_became_active":"2024-09-12T18:43:32.927270+0000","last_became_peered":"2024-09-12T18:43:32.927270+0000","last_unstale":"2024-09-12T19:11:33.911802+0000","last_undegraded":"2024-09-12T19:11:33.911802+0000","last_fullsized":"2024-09-12T19:11:33.911802+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:30.970671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":38914,"num_write":23,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'1","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:28.908122+0000","last_change":"2024-09-12T18:43:29.902339+0000","last_active":"2024-09-12T19:11:28.908122+0000","last_peered":"2024-09-12T19:11:28.908122+0000","last_clean":"2024-09-12T19:11:28.908122+0000","last_became_active":"2024-09-12T18:43:29.901627+0000","last_became_peered":"2024-09-12T18:43:29.901627+0000","last_unstale":"2024-09-12T19:11:28.908122+0000","last_undegraded":"2024-09-12T19:11:28.908122+0000","last_fullsized":"2024-09-12T19:11:28.908122+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:48.203220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'30","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.583951+0000","last_change":"2024-09-12T18:41:45.353240+0000","last_active":"2024-09-12T19:11:19.583951+0000","last_peered":"2024-09-12T19:11:19.583951+0000","last_clean":"2024-09-12T19:11:19.583951+0000","last_became_active":"2024-09-12T18:41:45.350670+0000","last_became_peered":"2024-09-12T18:41:45.350670+0000","last_unstale":"2024-09-12T19:11:19.583951+0000","last_undegraded":"2024-09-12T19:11:19.583951+0000","last_fullsized":"2024-09-12T19:11:19.583951+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:05.567815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.884911+0000","last_change":"2024-09-12T18:55:19.139183+0000","last_active":"2024-09-12T19:10:33.884911+0000","last_peered":"2024-09-12T19:10:33.884911+0000","last_clean":"2024-09-12T19:10:33.884911+0000","last_became_active":"2024-09-12T18:55:19.137332+0000","last_became_peered":"2024-09-12T18:55:19.137332+0000","last_unstale":"2024-09-12T19:10:33.884911+0000","last_undegraded":"2024-09-12T19:10:33.884911+0000","last_fullsized":"2024-09-12T19:10:33.884911+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:17.893526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'1","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:13.933310+0000","last_change":"2024-09-12T18:44:13.008362+0000","last_active":"2024-09-12T19:11:13.933310+0000","last_peered":"2024-09-12T19:11:13.933310+0000","last_clean":"2024-09-12T19:11:13.933310+0000","last_became_active":"2024-09-12T18:44:13.007582+0000","last_became_peered":"2024-09-12T18:44:13.007582+0000","last_unstale":"2024-09-12T19:11:13.933310+0000","last_undegraded":"2024-09-12T19:11:13.933310+0000","last_fullsized":"2024-09-12T19:11:13.933310+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:14.811461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.c","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.902160+0000","last_change":"2024-09-12T18:43:29.889784+0000","last_active":"2024-09-12T19:10:32.902160+0000","last_peered":"2024-09-12T19:10:32.902160+0000","last_clean":"2024-09-12T19:10:32.902160+0000","last_became_active":"2024-09-12T18:43:29.888041+0000","last_became_peered":"2024-09-12T18:43:29.888041+0000","last_unstale":"2024-09-12T19:10:32.902160+0000","last_undegraded":"2024-09-12T19:10:32.902160+0000","last_fullsized":"2024-09-12T19:10:32.902160+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:54.352777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'30","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.930272+0000","last_change":"2024-09-12T18:41:45.354909+0000","last_active":"2024-09-12T19:11:08.930272+0000","last_peered":"2024-09-12T19:11:08.930272+0000","last_clean":"2024-09-12T19:11:08.930272+0000","last_became_active":"2024-09-12T18:41:45.354063+0000","last_became_peered":"2024-09-12T18:41:45.354063+0000","last_unstale":"2024-09-12T19:11:08.930272+0000","last_undegraded":"2024-09-12T19:11:08.930272+0000","last_fullsized":"2024-09-12T19:11:08.930272+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:25.031450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910297+0000","last_change":"2024-09-12T18:55:19.140991+0000","last_active":"2024-09-12T19:11:07.910297+0000","last_peered":"2024-09-12T19:11:07.910297+0000","last_clean":"2024-09-12T19:11:07.910297+0000","last_became_active":"2024-09-12T18:55:19.140331+0000","last_became_peered":"2024-09-12T18:55:19.140331+0000","last_unstale":"2024-09-12T19:11:07.910297+0000","last_undegraded":"2024-09-12T19:11:07.910297+0000","last_fullsized":"2024-09-12T19:11:07.910297+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:37.267698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.920938+0000","last_change":"2024-09-12T18:43:32.935314+0000","last_active":"2024-09-12T19:10:33.920938+0000","last_peered":"2024-09-12T19:10:33.920938+0000","last_clean":"2024-09-12T19:10:33.920938+0000","last_became_active":"2024-09-12T18:43:32.934598+0000","last_became_peered":"2024-09-12T18:43:32.934598+0000","last_unstale":"2024-09-12T19:10:33.920938+0000","last_undegraded":"2024-09-12T19:10:33.920938+0000","last_fullsized":"2024-09-12T19:10:33.920938+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:01.163337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.883826+0000","last_change":"2024-09-12T18:43:29.888854+0000","last_active":"2024-09-12T19:10:28.883826+0000","last_peered":"2024-09-12T19:10:28.883826+0000","last_clean":"2024-09-12T19:10:28.883826+0000","last_became_active":"2024-09-12T18:43:29.887500+0000","last_became_peered":"2024-09-12T18:43:29.887500+0000","last_unstale":"2024-09-12T19:10:28.883826+0000","last_undegraded":"2024-09-12T19:10:28.883826+0000","last_fullsized":"2024-09-12T19:10:28.883826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:09.260023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'32","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.902996+0000","last_change":"2024-09-12T18:41:45.359668+0000","last_active":"2024-09-12T19:11:03.902996+0000","last_peered":"2024-09-12T19:11:03.902996+0000","last_clean":"2024-09-12T19:11:03.902996+0000","last_became_active":"2024-09-12T18:41:45.358914+0000","last_became_peered":"2024-09-12T18:41:45.358914+0000","last_unstale":"2024-09-12T19:11:03.902996+0000","last_undegraded":"2024-09-12T19:11:03.902996+0000","last_fullsized":"2024-09-12T19:11:03.902996+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:07.867252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":122,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.897994+0000","last_change":"2024-09-12T18:55:19.129609+0000","last_active":"2024-09-12T19:10:28.897994+0000","last_peered":"2024-09-12T19:10:28.897994+0000","last_clean":"2024-09-12T19:10:28.897994+0000","last_became_active":"2024-09-12T18:55:19.128236+0000","last_became_peered":"2024-09-12T18:55:19.128236+0000","last_unstale":"2024-09-12T19:10:28.897994+0000","last_undegraded":"2024-09-12T19:10:28.897994+0000","last_fullsized":"2024-09-12T19:10:28.897994+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:53.557810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"265'3","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:57.735434+0000","last_change":"2024-09-12T18:43:32.900792+0000","last_active":"2024-09-12T19:12:57.735434+0000","last_peered":"2024-09-12T19:12:57.735434+0000","last_clean":"2024-09-12T19:12:57.735434+0000","last_became_active":"2024-09-12T18:43:32.899943+0000","last_became_peered":"2024-09-12T18:43:32.899943+0000","last_unstale":"2024-09-12T19:12:57.735434+0000","last_undegraded":"2024-09-12T19:12:57.735434+0000","last_fullsized":"2024-09-12T19:12:57.735434+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3444,"num_write":3,"num_write_kb":1722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.922613+0000","last_change":"2024-09-12T18:43:29.878465+0000","last_active":"2024-09-12T19:10:33.922613+0000","last_peered":"2024-09-12T19:10:33.922613+0000","last_clean":"2024-09-12T19:10:33.922613+0000","last_became_active":"2024-09-12T18:43:29.877755+0000","last_became_peered":"2024-09-12T18:43:29.877755+0000","last_unstale":"2024-09-12T19:10:33.922613+0000","last_undegraded":"2024-09-12T19:10:33.922613+0000","last_fullsized":"2024-09-12T19:10:33.922613+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:15.949360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4136,"num_write":3,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'17","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.905594+0000","last_change":"2024-09-12T18:41:45.358284+0000","last_active":"2024-09-12T19:11:03.905594+0000","last_peered":"2024-09-12T19:11:03.905594+0000","last_clean":"2024-09-12T19:11:03.905594+0000","last_became_active":"2024-09-12T18:41:45.357562+0000","last_became_peered":"2024-09-12T18:41:45.357562+0000","last_unstale":"2024-09-12T19:11:03.905594+0000","last_undegraded":"2024-09-12T19:11:03.905594+0000","last_fullsized":"2024-09-12T19:11:03.905594+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:45.746519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.902028+0000","last_change":"2024-09-12T18:55:19.137683+0000","last_active":"2024-09-12T19:10:32.902028+0000","last_peered":"2024-09-12T19:10:32.902028+0000","last_clean":"2024-09-12T19:10:32.902028+0000","last_became_active":"2024-09-12T18:55:19.136882+0000","last_became_peered":"2024-09-12T18:55:19.136882+0000","last_unstale":"2024-09-12T19:10:32.902028+0000","last_undegraded":"2024-09-12T19:10:32.902028+0000","last_fullsized":"2024-09-12T19:10:32.902028+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:09.805826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.921042+0000","last_change":"2024-09-12T18:43:32.930996+0000","last_active":"2024-09-12T19:10:33.921042+0000","last_peered":"2024-09-12T19:10:33.921042+0000","last_clean":"2024-09-12T19:10:33.921042+0000","last_became_active":"2024-09-12T18:43:32.927372+0000","last_became_peered":"2024-09-12T18:43:32.927372+0000","last_unstale":"2024-09-12T19:10:33.921042+0000","last_undegraded":"2024-09-12T19:10:33.921042+0000","last_fullsized":"2024-09-12T19:10:33.921042+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:56.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.910665+0000","last_change":"2024-09-12T18:43:29.900324+0000","last_active":"2024-09-12T19:10:37.910665+0000","last_peered":"2024-09-12T19:10:37.910665+0000","last_clean":"2024-09-12T19:10:37.910665+0000","last_became_active":"2024-09-12T18:43:29.888265+0000","last_became_peered":"2024-09-12T18:43:29.888265+0000","last_unstale":"2024-09-12T19:10:37.910665+0000","last_undegraded":"2024-09-12T19:10:37.910665+0000","last_fullsized":"2024-09-12T19:10:37.910665+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:31.453582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'32","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.891215+0000","last_change":"2024-09-12T18:41:45.336479+0000","last_active":"2024-09-12T19:11:03.891215+0000","last_peered":"2024-09-12T19:11:03.891215+0000","last_clean":"2024-09-12T19:11:03.891215+0000","last_became_active":"2024-09-12T18:41:45.335675+0000","last_became_peered":"2024-09-12T18:41:45.335675+0000","last_unstale":"2024-09-12T19:11:03.891215+0000","last_undegraded":"2024-09-12T19:11:03.891215+0000","last_fullsized":"2024-09-12T19:11:03.891215+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:40.967621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":63,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.928809+0000","last_change":"2024-09-12T18:55:19.150357+0000","last_active":"2024-09-12T19:11:03.928809+0000","last_peered":"2024-09-12T19:11:03.928809+0000","last_clean":"2024-09-12T19:11:03.928809+0000","last_became_active":"2024-09-12T18:55:19.149794+0000","last_became_peered":"2024-09-12T18:55:19.149794+0000","last_unstale":"2024-09-12T19:11:03.928809+0000","last_undegraded":"2024-09-12T19:11:03.928809+0000","last_fullsized":"2024-09-12T19:11:03.928809+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:29.807238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121142+0000","last_change":"2024-09-12T18:43:32.910786+0000","last_active":"2024-09-12T19:11:44.121142+0000","last_peered":"2024-09-12T19:11:44.121142+0000","last_clean":"2024-09-12T19:11:44.121142+0000","last_became_active":"2024-09-12T18:43:32.908692+0000","last_became_peered":"2024-09-12T18:43:32.908692+0000","last_unstale":"2024-09-12T19:11:44.121142+0000","last_undegraded":"2024-09-12T19:11:44.121142+0000","last_fullsized":"2024-09-12T19:11:44.121142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:46.037235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.940357+0000","last_change":"2024-09-12T18:43:29.883687+0000","last_active":"2024-09-12T19:11:43.940357+0000","last_peered":"2024-09-12T19:11:43.940357+0000","last_clean":"2024-09-12T19:11:43.940357+0000","last_became_active":"2024-09-12T18:43:29.882915+0000","last_became_peered":"2024-09-12T18:43:29.882915+0000","last_unstale":"2024-09-12T19:11:43.940357+0000","last_undegraded":"2024-09-12T19:11:43.940357+0000","last_fullsized":"2024-09-12T19:11:43.940357+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:04.141732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":15,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'74","reported_seq":245,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.930292+0000","last_change":"2024-09-12T18:41:45.352749+0000","last_active":"2024-09-12T19:11:03.930292+0000","last_peered":"2024-09-12T19:11:03.930292+0000","last_clean":"2024-09-12T19:11:03.930292+0000","last_became_active":"2024-09-12T18:41:45.351387+0000","last_became_peered":"2024-09-12T18:41:45.351387+0000","last_unstale":"2024-09-12T19:11:03.930292+0000","last_undegraded":"2024-09-12T19:11:03.930292+0000","last_fullsized":"2024-09-12T19:11:03.930292+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:09.964195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":261,"num_write":135,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:12.911671+0000","last_change":"2024-09-12T18:55:19.150286+0000","last_active":"2024-09-12T19:11:12.911671+0000","last_peered":"2024-09-12T19:11:12.911671+0000","last_clean":"2024-09-12T19:11:12.911671+0000","last_became_active":"2024-09-12T18:55:19.149666+0000","last_became_peered":"2024-09-12T18:55:19.149666+0000","last_unstale":"2024-09-12T19:11:12.911671+0000","last_undegraded":"2024-09-12T19:11:12.911671+0000","last_fullsized":"2024-09-12T19:11:12.911671+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:09.562684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'7","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.114111+0000","last_change":"2024-09-12T18:43:32.903834+0000","last_active":"2024-09-12T19:13:57.114111+0000","last_peered":"2024-09-12T19:13:57.114111+0000","last_clean":"2024-09-12T19:13:57.114111+0000","last_became_active":"2024-09-12T18:43:32.903112+0000","last_became_peered":"2024-09-12T18:43:32.903112+0000","last_unstale":"2024-09-12T19:13:57.114111+0000","last_undegraded":"2024-09-12T19:13:57.114111+0000","last_fullsized":"2024-09-12T19:13:57.114111+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:35.198794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.717849+0000","last_change":"2024-09-12T18:43:29.899798+0000","last_active":"2024-09-12T19:11:42.717849+0000","last_peered":"2024-09-12T19:11:42.717849+0000","last_clean":"2024-09-12T19:11:42.717849+0000","last_became_active":"2024-09-12T18:43:29.887725+0000","last_became_peered":"2024-09-12T18:43:29.887725+0000","last_unstale":"2024-09-12T19:11:42.717849+0000","last_undegraded":"2024-09-12T19:11:42.717849+0000","last_fullsized":"2024-09-12T19:11:42.717849+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:12.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.895985+0000","last_change":"2024-09-12T18:41:45.354403+0000","last_active":"2024-09-12T19:10:07.895985+0000","last_peered":"2024-09-12T19:10:07.895985+0000","last_clean":"2024-09-12T19:10:07.895985+0000","last_became_active":"2024-09-12T18:41:45.353582+0000","last_became_peered":"2024-09-12T18:41:45.353582+0000","last_unstale":"2024-09-12T19:10:07.895985+0000","last_undegraded":"2024-09-12T19:10:07.895985+0000","last_fullsized":"2024-09-12T19:10:07.895985+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:11.323313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910340+0000","last_change":"2024-09-12T18:55:19.147574+0000","last_active":"2024-09-12T19:11:07.910340+0000","last_peered":"2024-09-12T19:11:07.910340+0000","last_clean":"2024-09-12T19:11:07.910340+0000","last_became_active":"2024-09-12T18:55:19.146310+0000","last_became_peered":"2024-09-12T18:55:19.146310+0000","last_unstale":"2024-09-12T19:11:07.910340+0000","last_undegraded":"2024-09-12T19:11:07.910340+0000","last_fullsized":"2024-09-12T19:11:07.910340+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:20.681513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.909363+0000","last_change":"2024-09-12T18:43:32.922885+0000","last_active":"2024-09-12T19:10:32.909363+0000","last_peered":"2024-09-12T19:10:32.909363+0000","last_clean":"2024-09-12T19:10:32.909363+0000","last_became_active":"2024-09-12T18:43:32.922056+0000","last_became_peered":"2024-09-12T18:43:32.922056+0000","last_unstale":"2024-09-12T19:10:32.909363+0000","last_undegraded":"2024-09-12T19:10:32.909363+0000","last_fullsized":"2024-09-12T19:10:32.909363+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:30.503287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:38.908388+0000","last_change":"2024-09-12T18:43:29.886237+0000","last_active":"2024-09-12T19:09:38.908388+0000","last_peered":"2024-09-12T19:09:38.908388+0000","last_clean":"2024-09-12T19:09:38.908388+0000","last_became_active":"2024-09-12T18:43:29.885595+0000","last_became_peered":"2024-09-12T18:43:29.885595+0000","last_unstale":"2024-09-12T19:09:38.908388+0000","last_undegraded":"2024-09-12T19:09:38.908388+0000","last_fullsized":"2024-09-12T19:09:38.908388+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:01:41.139666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5492,"num_write":3,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'29","reported_seq":122,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.912167+0000","last_change":"2024-09-12T18:41:45.336015+0000","last_active":"2024-09-12T19:09:58.912167+0000","last_peered":"2024-09-12T19:09:58.912167+0000","last_clean":"2024-09-12T19:09:58.912167+0000","last_became_active":"2024-09-12T18:41:45.335258+0000","last_became_peered":"2024-09-12T18:41:45.335258+0000","last_unstale":"2024-09-12T19:09:58.912167+0000","last_undegraded":"2024-09-12T19:09:58.912167+0000","last_fullsized":"2024-09-12T19:09:58.912167+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:50.404611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":60,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.930417+0000","last_change":"2024-09-12T18:55:19.140934+0000","last_active":"2024-09-12T19:11:03.930417+0000","last_peered":"2024-09-12T19:11:03.930417+0000","last_clean":"2024-09-12T19:11:03.930417+0000","last_became_active":"2024-09-12T18:55:19.140247+0000","last_became_peered":"2024-09-12T18:55:19.140247+0000","last_unstale":"2024-09-12T19:11:03.930417+0000","last_undegraded":"2024-09-12T19:11:03.930417+0000","last_fullsized":"2024-09-12T19:11:03.930417+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:21.925405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'9","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:52.921169+0000","last_change":"2024-09-12T18:43:32.918976+0000","last_active":"2024-09-12T19:11:52.921169+0000","last_peered":"2024-09-12T19:11:52.921169+0000","last_clean":"2024-09-12T19:11:52.921169+0000","last_became_active":"2024-09-12T18:43:32.918077+0000","last_became_peered":"2024-09-12T18:43:32.918077+0000","last_unstale":"2024-09-12T19:11:52.921169+0000","last_undegraded":"2024-09-12T19:11:52.921169+0000","last_fullsized":"2024-09-12T19:11:52.921169+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.534577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:34.105965+0000","last_change":"2024-09-12T18:43:29.903733+0000","last_active":"2024-09-12T19:10:34.105965+0000","last_peered":"2024-09-12T19:10:34.105965+0000","last_clean":"2024-09-12T19:10:34.105965+0000","last_became_active":"2024-09-12T18:43:29.902444+0000","last_became_peered":"2024-09-12T18:43:29.902444+0000","last_unstale":"2024-09-12T19:10:34.105965+0000","last_undegraded":"2024-09-12T19:10:34.105965+0000","last_fullsized":"2024-09-12T19:10:34.105965+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:28.242386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'31","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.890560+0000","last_change":"2024-09-12T18:41:45.351143+0000","last_active":"2024-09-12T19:09:58.890560+0000","last_peered":"2024-09-12T19:09:58.890560+0000","last_clean":"2024-09-12T19:09:58.890560+0000","last_became_active":"2024-09-12T18:41:45.350344+0000","last_became_peered":"2024-09-12T18:41:45.350344+0000","last_unstale":"2024-09-12T19:09:58.890560+0000","last_undegraded":"2024-09-12T19:09:58.890560+0000","last_fullsized":"2024-09-12T19:09:58.890560+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:21.975925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":107,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:57.892779+0000","last_change":"2024-09-12T18:55:19.145504+0000","last_active":"2024-09-12T19:09:57.892779+0000","last_peered":"2024-09-12T19:09:57.892779+0000","last_clean":"2024-09-12T19:09:57.892779+0000","last_became_active":"2024-09-12T18:55:19.144778+0000","last_became_peered":"2024-09-12T18:55:19.144778+0000","last_unstale":"2024-09-12T19:09:57.892779+0000","last_undegraded":"2024-09-12T19:09:57.892779+0000","last_fullsized":"2024-09-12T19:09:57.892779+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:31.693075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:43.925140+0000","last_change":"2024-09-12T18:43:32.903502+0000","last_active":"2024-09-12T19:10:43.925140+0000","last_peered":"2024-09-12T19:10:43.925140+0000","last_clean":"2024-09-12T19:10:43.925140+0000","last_became_active":"2024-09-12T18:43:32.901790+0000","last_became_peered":"2024-09-12T18:43:32.901790+0000","last_unstale":"2024-09-12T19:10:43.925140+0000","last_undegraded":"2024-09-12T19:10:43.925140+0000","last_fullsized":"2024-09-12T19:10:43.925140+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:24.176553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903364+0000","last_change":"2024-09-12T18:43:29.890565+0000","last_active":"2024-09-12T19:10:37.903364+0000","last_peered":"2024-09-12T19:10:37.903364+0000","last_clean":"2024-09-12T19:10:37.903364+0000","last_became_active":"2024-09-12T18:43:29.889097+0000","last_became_peered":"2024-09-12T18:43:29.889097+0000","last_unstale":"2024-09-12T19:10:37.903364+0000","last_undegraded":"2024-09-12T19:10:37.903364+0000","last_fullsized":"2024-09-12T19:10:37.903364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:26.725295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.913527+0000","last_change":"2024-09-12T18:41:45.364829+0000","last_active":"2024-09-12T19:09:58.913527+0000","last_peered":"2024-09-12T19:09:58.913527+0000","last_clean":"2024-09-12T19:09:58.913527+0000","last_became_active":"2024-09-12T18:41:45.364055+0000","last_became_peered":"2024-09-12T18:41:45.364055+0000","last_unstale":"2024-09-12T19:09:58.913527+0000","last_undegraded":"2024-09-12T19:09:58.913527+0000","last_fullsized":"2024-09-12T19:09:58.913527+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:18.604878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.886937+0000","last_change":"2024-09-12T18:55:19.122707+0000","last_active":"2024-09-12T19:09:53.886937+0000","last_peered":"2024-09-12T19:09:53.886937+0000","last_clean":"2024-09-12T19:09:53.886937+0000","last_became_active":"2024-09-12T18:55:19.121805+0000","last_became_peered":"2024-09-12T18:55:19.121805+0000","last_unstale":"2024-09-12T19:09:53.886937+0000","last_undegraded":"2024-09-12T19:09:53.886937+0000","last_fullsized":"2024-09-12T19:09:53.886937+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:51.523106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'10","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.923737+0000","last_change":"2024-09-12T18:43:32.899098+0000","last_active":"2024-09-12T19:10:38.923737+0000","last_peered":"2024-09-12T19:10:38.923737+0000","last_clean":"2024-09-12T19:10:38.923737+0000","last_became_active":"2024-09-12T18:43:32.898379+0000","last_became_peered":"2024-09-12T18:43:32.898379+0000","last_unstale":"2024-09-12T19:10:38.923737+0000","last_undegraded":"2024-09-12T19:10:38.923737+0000","last_fullsized":"2024-09-12T19:10:38.923737+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:40.658854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":16388,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.886048+0000","last_change":"2024-09-12T18:43:29.897947+0000","last_active":"2024-09-12T19:10:38.886048+0000","last_peered":"2024-09-12T19:10:38.886048+0000","last_clean":"2024-09-12T19:10:38.886048+0000","last_became_active":"2024-09-12T18:43:29.897326+0000","last_became_peered":"2024-09-12T18:43:29.897326+0000","last_unstale":"2024-09-12T19:10:38.886048+0000","last_undegraded":"2024-09-12T19:10:38.886048+0000","last_fullsized":"2024-09-12T19:10:38.886048+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:49.647470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'31","reported_seq":129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.890721+0000","last_change":"2024-09-12T18:41:45.351648+0000","last_active":"2024-09-12T19:09:58.890721+0000","last_peered":"2024-09-12T19:09:58.890721+0000","last_clean":"2024-09-12T19:09:58.890721+0000","last_became_active":"2024-09-12T18:41:45.350900+0000","last_became_peered":"2024-09-12T18:41:45.350900+0000","last_unstale":"2024-09-12T19:09:58.890721+0000","last_undegraded":"2024-09-12T19:09:58.890721+0000","last_fullsized":"2024-09-12T19:09:58.890721+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:50.580663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":59,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715397+0000","last_change":"2024-09-12T18:55:19.123047+0000","last_active":"2024-09-12T19:11:32.715397+0000","last_peered":"2024-09-12T19:11:32.715397+0000","last_clean":"2024-09-12T19:11:32.715397+0000","last_became_active":"2024-09-12T18:55:19.122238+0000","last_became_peered":"2024-09-12T18:55:19.122238+0000","last_unstale":"2024-09-12T19:11:32.715397+0000","last_undegraded":"2024-09-12T19:11:32.715397+0000","last_fullsized":"2024-09-12T19:11:32.715397+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:01.481082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.918909+0000","last_change":"2024-09-12T18:43:32.914014+0000","last_active":"2024-09-12T19:11:42.918909+0000","last_peered":"2024-09-12T19:11:42.918909+0000","last_clean":"2024-09-12T19:11:42.918909+0000","last_became_active":"2024-09-12T18:43:32.913108+0000","last_became_peered":"2024-09-12T18:43:32.913108+0000","last_unstale":"2024-09-12T19:11:42.918909+0000","last_undegraded":"2024-09-12T19:11:42.918909+0000","last_fullsized":"2024-09-12T19:11:42.918909+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:00.617500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":15,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'8","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.910550+0000","last_change":"2024-09-12T18:43:29.878679+0000","last_active":"2024-09-12T19:11:38.910550+0000","last_peered":"2024-09-12T19:11:38.910550+0000","last_clean":"2024-09-12T19:11:38.910550+0000","last_became_active":"2024-09-12T18:43:29.877925+0000","last_became_peered":"2024-09-12T18:43:29.877925+0000","last_unstale":"2024-09-12T19:11:38.910550+0000","last_undegraded":"2024-09-12T19:11:38.910550+0000","last_fullsized":"2024-09-12T19:11:38.910550+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:25.553737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'135","reported_seq":472,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910405+0000","last_change":"2024-09-12T18:41:45.365909+0000","last_active":"2024-09-12T19:11:07.910405+0000","last_peered":"2024-09-12T19:11:07.910405+0000","last_clean":"2024-09-12T19:11:07.910405+0000","last_became_active":"2024-09-12T18:41:45.365175+0000","last_became_peered":"2024-09-12T18:41:45.365175+0000","last_unstale":"2024-09-12T19:11:07.910405+0000","last_undegraded":"2024-09-12T19:11:07.910405+0000","last_fullsized":"2024-09-12T19:11:07.910405+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:16.010188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":832,"num_read_kb":595,"num_write":177,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:54.096968+0000","last_change":"2024-09-12T18:55:19.130989+0000","last_active":"2024-09-12T19:09:54.096968+0000","last_peered":"2024-09-12T19:09:54.096968+0000","last_clean":"2024-09-12T19:09:54.096968+0000","last_became_active":"2024-09-12T18:55:19.130130+0000","last_became_peered":"2024-09-12T18:55:19.130130+0000","last_unstale":"2024-09-12T19:09:54.096968+0000","last_undegraded":"2024-09-12T19:09:54.096968+0000","last_fullsized":"2024-09-12T19:09:54.096968+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:36.507889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121479+0000","last_change":"2024-09-12T18:43:32.906004+0000","last_active":"2024-09-12T19:11:44.121479+0000","last_peered":"2024-09-12T19:11:44.121479+0000","last_clean":"2024-09-12T19:11:44.121479+0000","last_became_active":"2024-09-12T18:43:32.904789+0000","last_became_peered":"2024-09-12T18:43:32.904789+0000","last_unstale":"2024-09-12T19:11:44.121479+0000","last_undegraded":"2024-09-12T19:11:44.121479+0000","last_fullsized":"2024-09-12T19:11:44.121479+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:44.194875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.918932+0000","last_change":"2024-09-12T18:43:29.884688+0000","last_active":"2024-09-12T19:11:42.918932+0000","last_peered":"2024-09-12T19:11:42.918932+0000","last_clean":"2024-09-12T19:11:42.918932+0000","last_became_active":"2024-09-12T18:43:29.883790+0000","last_became_peered":"2024-09-12T18:43:29.883790+0000","last_unstale":"2024-09-12T19:11:42.918932+0000","last_undegraded":"2024-09-12T19:11:42.918932+0000","last_fullsized":"2024-09-12T19:11:42.918932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:58.821497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'6","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:57.915303+0000","last_change":"2024-09-12T18:41:45.358458+0000","last_active":"2024-09-12T19:10:57.915303+0000","last_peered":"2024-09-12T19:10:57.915303+0000","last_clean":"2024-09-12T19:10:57.915303+0000","last_became_active":"2024-09-12T18:41:45.357746+0000","last_became_peered":"2024-09-12T18:41:45.357746+0000","last_unstale":"2024-09-12T19:10:57.915303+0000","last_undegraded":"2024-09-12T19:10:57.915303+0000","last_fullsized":"2024-09-12T19:10:57.915303+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:16.491434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.883887+0000","last_change":"2024-09-12T18:55:19.140383+0000","last_active":"2024-09-12T19:10:28.883887+0000","last_peered":"2024-09-12T19:10:28.883887+0000","last_clean":"2024-09-12T19:10:28.883887+0000","last_became_active":"2024-09-12T18:55:19.139565+0000","last_became_peered":"2024-09-12T18:55:19.139565+0000","last_unstale":"2024-09-12T19:10:28.883887+0000","last_undegraded":"2024-09-12T19:10:28.883887+0000","last_fullsized":"2024-09-12T19:10:28.883887+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:46.784423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'1","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.910425+0000","last_change":"2024-09-12T18:43:32.906082+0000","last_active":"2024-09-12T19:10:37.910425+0000","last_peered":"2024-09-12T19:10:37.910425+0000","last_clean":"2024-09-12T19:10:37.910425+0000","last_became_active":"2024-09-12T18:43:32.904858+0000","last_became_peered":"2024-09-12T18:43:32.904858+0000","last_unstale":"2024-09-12T19:10:37.910425+0000","last_undegraded":"2024-09-12T19:10:37.910425+0000","last_fullsized":"2024-09-12T19:10:37.910425+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:58.276689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:42.947818+0000","last_change":"2024-09-12T18:43:29.890077+0000","last_active":"2024-09-12T19:13:42.947818+0000","last_peered":"2024-09-12T19:13:42.947818+0000","last_clean":"2024-09-12T19:13:42.947818+0000","last_became_active":"2024-09-12T18:43:29.889328+0000","last_became_peered":"2024-09-12T18:43:29.889328+0000","last_unstale":"2024-09-12T19:13:42.947818+0000","last_undegraded":"2024-09-12T19:13:42.947818+0000","last_fullsized":"2024-09-12T19:13:42.947818+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:20.098869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'8","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.901798+0000","last_change":"2024-09-12T18:41:45.354082+0000","last_active":"2024-09-12T19:10:58.901798+0000","last_peered":"2024-09-12T19:10:58.901798+0000","last_clean":"2024-09-12T19:10:58.901798+0000","last_became_active":"2024-09-12T18:41:45.353369+0000","last_became_peered":"2024-09-12T18:41:45.353369+0000","last_unstale":"2024-09-12T19:10:58.901798+0000","last_undegraded":"2024-09-12T19:10:58.901798+0000","last_fullsized":"2024-09-12T19:10:58.901798+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:49.982690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.921223+0000","last_change":"2024-09-12T18:55:19.116656+0000","last_active":"2024-09-12T19:10:28.921223+0000","last_peered":"2024-09-12T19:10:28.921223+0000","last_clean":"2024-09-12T19:10:28.921223+0000","last_became_active":"2024-09-12T18:55:19.115920+0000","last_became_peered":"2024-09-12T18:55:19.115920+0000","last_unstale":"2024-09-12T19:10:28.921223+0000","last_undegraded":"2024-09-12T19:10:28.921223+0000","last_fullsized":"2024-09-12T19:10:28.921223+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:54.225077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.911420+0000","last_change":"2024-09-12T18:43:32.914128+0000","last_active":"2024-09-12T19:11:43.911420+0000","last_peered":"2024-09-12T19:11:43.911420+0000","last_clean":"2024-09-12T19:11:43.911420+0000","last_became_active":"2024-09-12T18:43:32.913259+0000","last_became_peered":"2024-09-12T18:43:32.913259+0000","last_unstale":"2024-09-12T19:11:43.911420+0000","last_undegraded":"2024-09-12T19:11:43.911420+0000","last_fullsized":"2024-09-12T19:11:43.911420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:08.421749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903278+0000","last_change":"2024-09-12T18:43:29.883036+0000","last_active":"2024-09-12T19:10:37.903278+0000","last_peered":"2024-09-12T19:10:37.903278+0000","last_clean":"2024-09-12T19:10:37.903278+0000","last_became_active":"2024-09-12T18:43:29.882039+0000","last_became_peered":"2024-09-12T18:43:29.882039+0000","last_unstale":"2024-09-12T19:10:37.903278+0000","last_undegraded":"2024-09-12T19:10:37.903278+0000","last_fullsized":"2024-09-12T19:10:37.903278+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:20.442914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'181","reported_seq":586,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:59.111456+0000","last_change":"2024-09-12T18:41:45.354928+0000","last_active":"2024-09-12T19:10:59.111456+0000","last_peered":"2024-09-12T19:10:59.111456+0000","last_clean":"2024-09-12T19:10:59.111456+0000","last_became_active":"2024-09-12T18:41:45.354142+0000","last_became_peered":"2024-09-12T18:41:45.354142+0000","last_unstale":"2024-09-12T19:10:59.111456+0000","last_undegraded":"2024-09-12T19:10:59.111456+0000","last_fullsized":"2024-09-12T19:10:59.111456+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:57.126086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":838,"num_write":233,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.912268+0000","last_change":"2024-09-12T18:55:19.143090+0000","last_active":"2024-09-12T19:09:53.912268+0000","last_peered":"2024-09-12T19:09:53.912268+0000","last_clean":"2024-09-12T19:09:53.912268+0000","last_became_active":"2024-09-12T18:55:19.142412+0000","last_became_peered":"2024-09-12T18:55:19.142412+0000","last_unstale":"2024-09-12T19:09:53.912268+0000","last_undegraded":"2024-09-12T19:09:53.912268+0000","last_fullsized":"2024-09-12T19:09:53.912268+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:21.561947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'4","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.900143+0000","last_change":"2024-09-12T18:43:32.939711+0000","last_active":"2024-09-12T19:10:38.900143+0000","last_peered":"2024-09-12T19:10:38.900143+0000","last_clean":"2024-09-12T19:10:38.900143+0000","last_became_active":"2024-09-12T18:43:32.939024+0000","last_became_peered":"2024-09-12T18:43:32.939024+0000","last_unstale":"2024-09-12T19:10:38.900143+0000","last_undegraded":"2024-09-12T19:10:38.900143+0000","last_fullsized":"2024-09-12T19:10:38.900143+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:08.177317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:42.732247+0000","last_change":"2024-09-12T18:43:29.900783+0000","last_active":"2024-09-12T19:12:42.732247+0000","last_peered":"2024-09-12T19:12:42.732247+0000","last_clean":"2024-09-12T19:12:42.732247+0000","last_became_active":"2024-09-12T18:43:29.892060+0000","last_became_peered":"2024-09-12T18:43:29.892060+0000","last_unstale":"2024-09-12T19:12:42.732247+0000","last_undegraded":"2024-09-12T19:12:42.732247+0000","last_fullsized":"2024-09-12T19:12:42.732247+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:21.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'50","reported_seq":183,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:20.845700+0000","last_change":"2024-09-12T18:41:45.356560+0000","last_active":"2024-09-12T19:11:20.845700+0000","last_peered":"2024-09-12T19:11:20.845700+0000","last_clean":"2024-09-12T19:11:20.845700+0000","last_became_active":"2024-09-12T18:41:45.355840+0000","last_became_peered":"2024-09-12T18:41:45.355840+0000","last_unstale":"2024-09-12T19:11:20.845700+0000","last_undegraded":"2024-09-12T19:11:20.845700+0000","last_fullsized":"2024-09-12T19:11:20.845700+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:22.223128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":177,"num_write":88,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:02.894254+0000","last_change":"2024-09-12T18:55:19.156335+0000","last_active":"2024-09-12T19:10:02.894254+0000","last_peered":"2024-09-12T19:10:02.894254+0000","last_clean":"2024-09-12T19:10:02.894254+0000","last_became_active":"2024-09-12T18:55:19.155684+0000","last_became_peered":"2024-09-12T18:55:19.155684+0000","last_unstale":"2024-09-12T19:10:02.894254+0000","last_undegraded":"2024-09-12T19:10:02.894254+0000","last_fullsized":"2024-09-12T19:10:02.894254+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:14.458956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:39.107010+0000","last_change":"2024-09-12T18:43:32.905624+0000","last_active":"2024-09-12T19:10:39.107010+0000","last_peered":"2024-09-12T19:10:39.107010+0000","last_clean":"2024-09-12T19:10:39.107010+0000","last_became_active":"2024-09-12T18:43:32.903273+0000","last_became_peered":"2024-09-12T18:43:32.903273+0000","last_unstale":"2024-09-12T19:10:39.107010+0000","last_undegraded":"2024-09-12T19:10:39.107010+0000","last_fullsized":"2024-09-12T19:10:39.107010+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:48.885568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.900184+0000","last_change":"2024-09-12T18:43:29.868919+0000","last_active":"2024-09-12T19:10:38.900184+0000","last_peered":"2024-09-12T19:10:38.900184+0000","last_clean":"2024-09-12T19:10:38.900184+0000","last_became_active":"2024-09-12T18:43:29.865413+0000","last_became_peered":"2024-09-12T18:43:29.865413+0000","last_unstale":"2024-09-12T19:10:38.900184+0000","last_undegraded":"2024-09-12T19:10:38.900184+0000","last_fullsized":"2024-09-12T19:10:38.900184+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:35.628916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'25","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:57.922311+0000","last_change":"2024-09-12T18:41:45.363243+0000","last_active":"2024-09-12T19:11:57.922311+0000","last_peered":"2024-09-12T19:11:57.922311+0000","last_clean":"2024-09-12T19:11:57.922311+0000","last_became_active":"2024-09-12T18:41:45.362445+0000","last_became_peered":"2024-09-12T18:41:45.362445+0000","last_unstale":"2024-09-12T19:11:57.922311+0000","last_undegraded":"2024-09-12T19:11:57.922311+0000","last_fullsized":"2024-09-12T19:11:57.922311+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:57.818173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'288","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.929745+0000","last_change":"2024-09-12T18:26:39.874259+0000","last_active":"2024-09-12T19:13:57.929745+0000","last_peered":"2024-09-12T19:13:57.929745+0000","last_clean":"2024-09-12T19:13:57.929745+0000","last_became_active":"2024-09-12T18:26:39.872863+0000","last_became_peered":"2024-09-12T18:26:39.872863+0000","last_unstale":"2024-09-12T19:13:57.929745+0000","last_undegraded":"2024-09-12T19:13:57.929745+0000","last_fullsized":"2024-09-12T19:13:57.929745+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:12.641934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66222,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":381,"num_read_kb":8018,"num_write":922,"num_write_kb":33098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'548","reported_seq":2200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.104685+0000","last_change":"2024-09-12T18:26:41.881378+0000","last_active":"2024-09-12T19:12:24.104685+0000","last_peered":"2024-09-12T19:12:24.104685+0000","last_clean":"2024-09-12T19:12:24.104685+0000","last_became_active":"2024-09-12T18:26:41.879711+0000","last_became_peered":"2024-09-12T18:26:41.879711+0000","last_unstale":"2024-09-12T19:12:24.104685+0000","last_undegraded":"2024-09-12T19:12:24.104685+0000","last_fullsized":"2024-09-12T19:12:24.104685+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:43.105556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2944,"num_read_kb":2757,"num_write":660,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'326","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.689223+0000","last_change":"2024-09-12T18:26:39.837876+0000","last_active":"2024-09-12T19:13:57.689223+0000","last_peered":"2024-09-12T19:13:57.689223+0000","last_clean":"2024-09-12T19:13:57.689223+0000","last_became_active":"2024-09-12T18:26:39.837462+0000","last_became_peered":"2024-09-12T18:26:39.837462+0000","last_unstale":"2024-09-12T19:13:57.689223+0000","last_undegraded":"2024-09-12T19:13:57.689223+0000","last_fullsized":"2024-09-12T19:13:57.689223+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:16.597331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10511461,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":519,"num_read_kb":60596,"num_write":1071,"num_write_kb":26482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'832","reported_seq":2227,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.108683+0000","last_change":"2024-09-12T18:26:41.864753+0000","last_active":"2024-09-12T19:12:24.108683+0000","last_peered":"2024-09-12T19:12:24.108683+0000","last_clean":"2024-09-12T19:12:24.108683+0000","last_became_active":"2024-09-12T18:26:41.863835+0000","last_became_peered":"2024-09-12T18:26:41.863835+0000","last_unstale":"2024-09-12T19:12:24.108683+0000","last_undegraded":"2024-09-12T19:12:24.108683+0000","last_fullsized":"2024-09-12T19:12:24.108683+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:50.300481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3830,"num_read_kb":3409,"num_write":1134,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'304","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:33.953361+0000","last_change":"2024-09-12T18:26:39.831857+0000","last_active":"2024-09-12T19:12:33.953361+0000","last_peered":"2024-09-12T19:12:33.953361+0000","last_clean":"2024-09-12T19:12:33.953361+0000","last_became_active":"2024-09-12T18:26:39.831522+0000","last_became_peered":"2024-09-12T18:26:39.831522+0000","last_unstale":"2024-09-12T19:12:33.953361+0000","last_undegraded":"2024-09-12T19:12:33.953361+0000","last_fullsized":"2024-09-12T19:12:33.953361+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:44.938137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5739976,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":568,"num_read_kb":27262,"num_write":1100,"num_write_kb":30891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'361","reported_seq":1822,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.752145+0000","last_change":"2024-09-12T18:26:41.850866+0000","last_active":"2024-09-12T19:12:08.752145+0000","last_peered":"2024-09-12T19:12:08.752145+0000","last_clean":"2024-09-12T19:12:08.752145+0000","last_became_active":"2024-09-12T18:26:41.850001+0000","last_became_peered":"2024-09-12T18:26:41.850001+0000","last_unstale":"2024-09-12T19:12:08.752145+0000","last_undegraded":"2024-09-12T19:12:08.752145+0000","last_fullsized":"2024-09-12T19:12:08.752145+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:23.483403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2076,"num_read_kb":1992,"num_write":405,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'283","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:20.476261+0000","last_change":"2024-09-12T18:27:11.825105+0000","last_active":"2024-09-12T19:11:20.476261+0000","last_peered":"2024-09-12T19:11:20.476261+0000","last_clean":"2024-09-12T19:11:20.476261+0000","last_became_active":"2024-09-12T18:27:11.824331+0000","last_became_peered":"2024-09-12T18:27:11.824331+0000","last_unstale":"2024-09-12T19:11:20.476261+0000","last_undegraded":"2024-09-12T19:11:20.476261+0000","last_fullsized":"2024-09-12T19:11:20.476261+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:59.462165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5516773,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":421,"num_read_kb":38329,"num_write":1023,"num_write_kb":37388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'500","reported_seq":2054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.541136+0000","last_change":"2024-09-12T18:26:41.851231+0000","last_active":"2024-09-12T19:12:09.541136+0000","last_peered":"2024-09-12T19:12:09.541136+0000","last_clean":"2024-09-12T19:12:09.541136+0000","last_became_active":"2024-09-12T18:26:41.850866+0000","last_became_peered":"2024-09-12T18:26:41.850866+0000","last_unstale":"2024-09-12T19:12:09.541136+0000","last_undegraded":"2024-09-12T19:12:09.541136+0000","last_fullsized":"2024-09-12T19:12:09.541136+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:49.632192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2664,"num_read_kb":2487,"num_write":637,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'340","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.941984+0000","last_change":"2024-09-12T18:26:39.871051+0000","last_active":"2024-09-12T19:13:57.941984+0000","last_peered":"2024-09-12T19:13:57.941984+0000","last_clean":"2024-09-12T19:13:57.941984+0000","last_became_active":"2024-09-12T18:26:39.870272+0000","last_became_peered":"2024-09-12T18:26:39.870272+0000","last_unstale":"2024-09-12T19:13:57.941984+0000","last_undegraded":"2024-09-12T19:13:57.941984+0000","last_fullsized":"2024-09-12T19:13:57.941984+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:26.496206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4440945,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":742,"num_read_kb":17788,"num_write":1144,"num_write_kb":36512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'543","reported_seq":1968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.557048+0000","last_change":"2024-09-12T18:26:41.869564+0000","last_active":"2024-09-12T19:12:09.557048+0000","last_peered":"2024-09-12T19:12:09.557048+0000","last_clean":"2024-09-12T19:12:09.557048+0000","last_became_active":"2024-09-12T18:26:41.865288+0000","last_became_peered":"2024-09-12T18:26:41.865288+0000","last_unstale":"2024-09-12T19:12:09.557048+0000","last_undegraded":"2024-09-12T19:12:09.557048+0000","last_fullsized":"2024-09-12T19:12:09.557048+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:04.903221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2721,"num_read_kb":2571,"num_write":759,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'270","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:39.387927+0000","last_change":"2024-09-12T18:26:39.851993+0000","last_active":"2024-09-12T19:11:39.387927+0000","last_peered":"2024-09-12T19:11:39.387927+0000","last_clean":"2024-09-12T19:11:39.387927+0000","last_became_active":"2024-09-12T18:26:39.851253+0000","last_became_peered":"2024-09-12T18:26:39.851253+0000","last_unstale":"2024-09-12T19:11:39.387927+0000","last_undegraded":"2024-09-12T19:11:39.387927+0000","last_fullsized":"2024-09-12T19:11:39.387927+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:26.300087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1927120,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":405,"num_read_kb":31766,"num_write":1044,"num_write_kb":25425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'807","reported_seq":2339,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.105771+0000","last_change":"2024-09-12T18:26:41.852562+0000","last_active":"2024-09-12T19:13:43.105771+0000","last_peered":"2024-09-12T19:13:43.105771+0000","last_clean":"2024-09-12T19:13:43.105771+0000","last_became_active":"2024-09-12T18:26:41.851811+0000","last_became_peered":"2024-09-12T18:26:41.851811+0000","last_unstale":"2024-09-12T19:13:43.105771+0000","last_undegraded":"2024-09-12T19:13:43.105771+0000","last_fullsized":"2024-09-12T19:13:43.105771+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:07.152668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3792,"num_read_kb":3404,"num_write":1072,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'333","reported_seq":970,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.934666+0000","last_change":"2024-09-12T18:26:39.862363+0000","last_active":"2024-09-12T19:13:57.934666+0000","last_peered":"2024-09-12T19:13:57.934666+0000","last_clean":"2024-09-12T19:13:57.934666+0000","last_became_active":"2024-09-12T18:26:39.861529+0000","last_became_peered":"2024-09-12T18:26:39.861529+0000","last_unstale":"2024-09-12T19:13:57.934666+0000","last_undegraded":"2024-09-12T19:13:57.934666+0000","last_fullsized":"2024-09-12T19:13:57.934666+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:22.532453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454843,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":487,"num_read_kb":30234,"num_write":1136,"num_write_kb":47172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'698","reported_seq":2314,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.291262+0000","last_change":"2024-09-12T18:26:41.880160+0000","last_active":"2024-09-12T19:12:23.291262+0000","last_peered":"2024-09-12T19:12:23.291262+0000","last_clean":"2024-09-12T19:12:23.291262+0000","last_became_active":"2024-09-12T18:26:41.878820+0000","last_became_peered":"2024-09-12T18:26:41.878820+0000","last_unstale":"2024-09-12T19:12:23.291262+0000","last_undegraded":"2024-09-12T19:12:23.291262+0000","last_fullsized":"2024-09-12T19:12:23.291262+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:28.637107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3429,"num_read_kb":3073,"num_write":944,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'287","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.471552+0000","last_change":"2024-09-12T18:27:11.824834+0000","last_active":"2024-09-12T19:12:01.471552+0000","last_peered":"2024-09-12T19:12:01.471552+0000","last_clean":"2024-09-12T19:12:01.471552+0000","last_became_active":"2024-09-12T18:27:11.824008+0000","last_became_peered":"2024-09-12T18:27:11.824008+0000","last_unstale":"2024-09-12T19:12:01.471552+0000","last_undegraded":"2024-09-12T19:12:01.471552+0000","last_fullsized":"2024-09-12T19:12:01.471552+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:37.834927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11535097,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":579,"num_read_kb":10155,"num_write":1074,"num_write_kb":30763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'673","reported_seq":2284,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.623890+0000","last_change":"2024-09-12T18:26:41.854820+0000","last_active":"2024-09-12T19:12:18.623890+0000","last_peered":"2024-09-12T19:12:18.623890+0000","last_clean":"2024-09-12T19:12:18.623890+0000","last_became_active":"2024-09-12T18:26:41.854487+0000","last_became_peered":"2024-09-12T18:26:41.854487+0000","last_unstale":"2024-09-12T19:12:18.623890+0000","last_undegraded":"2024-09-12T19:12:18.623890+0000","last_fullsized":"2024-09-12T19:12:18.623890+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:55.693388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3483,"num_read_kb":3149,"num_write":934,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'460","reported_seq":2065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.554629+0000","last_change":"2024-09-12T18:26:41.845783+0000","last_active":"2024-09-12T19:12:09.554629+0000","last_peered":"2024-09-12T19:12:09.554629+0000","last_clean":"2024-09-12T19:12:09.554629+0000","last_became_active":"2024-09-12T18:26:41.845080+0000","last_became_peered":"2024-09-12T18:26:41.845080+0000","last_unstale":"2024-09-12T19:12:09.554629+0000","last_undegraded":"2024-09-12T19:12:09.554629+0000","last_fullsized":"2024-09-12T19:12:09.554629+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:41.747464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2421,"num_read_kb":2289,"num_write":534,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'343","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.919407+0000","last_change":"2024-09-12T18:26:39.874340+0000","last_active":"2024-09-12T19:13:57.919407+0000","last_peered":"2024-09-12T19:13:57.919407+0000","last_clean":"2024-09-12T19:13:57.919407+0000","last_became_active":"2024-09-12T18:26:39.872936+0000","last_became_peered":"2024-09-12T18:26:39.872936+0000","last_unstale":"2024-09-12T19:13:57.919407+0000","last_undegraded":"2024-09-12T19:13:57.919407+0000","last_fullsized":"2024-09-12T19:13:57.919407+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:52.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5293439,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":480,"num_read_kb":24957,"num_write":1219,"num_write_kb":33279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'559","reported_seq":2173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.208544+0000","last_change":"2024-09-12T18:26:41.874471+0000","last_active":"2024-09-12T19:11:58.208544+0000","last_peered":"2024-09-12T19:11:58.208544+0000","last_clean":"2024-09-12T19:11:58.208544+0000","last_became_active":"2024-09-12T18:26:41.865247+0000","last_became_peered":"2024-09-12T18:26:41.865247+0000","last_unstale":"2024-09-12T19:11:58.208544+0000","last_undegraded":"2024-09-12T19:11:58.208544+0000","last_fullsized":"2024-09-12T19:11:58.208544+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:35.308473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2931,"num_read_kb":2718,"num_write":721,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'342","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.894850+0000","last_change":"2024-09-12T18:26:39.859661+0000","last_active":"2024-09-12T19:10:13.894850+0000","last_peered":"2024-09-12T19:10:13.894850+0000","last_clean":"2024-09-12T19:10:13.894850+0000","last_became_active":"2024-09-12T18:26:39.858964+0000","last_became_peered":"2024-09-12T18:26:39.858964+0000","last_unstale":"2024-09-12T19:10:13.894850+0000","last_undegraded":"2024-09-12T19:10:13.894850+0000","last_fullsized":"2024-09-12T19:10:13.894850+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:12.307545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9762525,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":749,"num_read_kb":25615,"num_write":1258,"num_write_kb":27961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'826","reported_seq":2309,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.128247+0000","last_change":"2024-09-12T18:26:41.862769+0000","last_active":"2024-09-12T19:12:24.128247+0000","last_peered":"2024-09-12T19:12:24.128247+0000","last_clean":"2024-09-12T19:12:24.128247+0000","last_became_active":"2024-09-12T18:26:41.861762+0000","last_became_peered":"2024-09-12T18:26:41.861762+0000","last_unstale":"2024-09-12T19:12:24.128247+0000","last_undegraded":"2024-09-12T19:12:24.128247+0000","last_fullsized":"2024-09-12T19:12:24.128247+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:57.802438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3868,"num_read_kb":3443,"num_write":1111,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'322","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:19.878185+0000","last_change":"2024-09-12T18:26:39.857559+0000","last_active":"2024-09-12T19:12:19.878185+0000","last_peered":"2024-09-12T19:12:19.878185+0000","last_clean":"2024-09-12T19:12:19.878185+0000","last_became_active":"2024-09-12T18:26:39.856700+0000","last_became_peered":"2024-09-12T18:26:39.856700+0000","last_unstale":"2024-09-12T19:12:19.878185+0000","last_undegraded":"2024-09-12T19:12:19.878185+0000","last_fullsized":"2024-09-12T19:12:19.878185+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:32.134581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10390340,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":516,"num_read_kb":29092,"num_write":1175,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'408","reported_seq":1973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.624204+0000","last_change":"2024-09-12T18:26:41.855114+0000","last_active":"2024-09-12T19:12:18.624204+0000","last_peered":"2024-09-12T19:12:18.624204+0000","last_clean":"2024-09-12T19:12:18.624204+0000","last_became_active":"2024-09-12T18:26:41.854687+0000","last_became_peered":"2024-09-12T18:26:41.854687+0000","last_unstale":"2024-09-12T19:12:18.624204+0000","last_undegraded":"2024-09-12T19:12:18.624204+0000","last_fullsized":"2024-09-12T19:12:18.624204+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:38.397431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2203,"num_read_kb":2114,"num_write":459,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'246","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.538284+0000","last_change":"2024-09-12T18:26:39.846009+0000","last_active":"2024-09-12T19:12:01.538284+0000","last_peered":"2024-09-12T19:12:01.538284+0000","last_clean":"2024-09-12T19:12:01.538284+0000","last_became_active":"2024-09-12T18:26:39.845295+0000","last_became_peered":"2024-09-12T18:26:39.845295+0000","last_unstale":"2024-09-12T19:12:01.538284+0000","last_undegraded":"2024-09-12T19:12:01.538284+0000","last_fullsized":"2024-09-12T19:12:01.538284+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:17.674520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12175535,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":604,"num_read_kb":23311,"num_write":911,"num_write_kb":25673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'818","reported_seq":2465,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.289955+0000","last_change":"2024-09-12T18:26:41.856646+0000","last_active":"2024-09-12T19:12:23.289955+0000","last_peered":"2024-09-12T19:12:23.289955+0000","last_clean":"2024-09-12T19:12:23.289955+0000","last_became_active":"2024-09-12T18:26:41.856280+0000","last_became_peered":"2024-09-12T18:26:41.856280+0000","last_unstale":"2024-09-12T19:12:23.289955+0000","last_undegraded":"2024-09-12T19:12:23.289955+0000","last_fullsized":"2024-09-12T19:12:23.289955+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:36.396273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4038,"num_read_kb":3655,"num_write":1078,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'333","reported_seq":1026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.702513+0000","last_change":"2024-09-12T18:26:39.842574+0000","last_active":"2024-09-12T19:11:59.702513+0000","last_peered":"2024-09-12T19:11:59.702513+0000","last_clean":"2024-09-12T19:11:59.702513+0000","last_became_active":"2024-09-12T18:26:39.842159+0000","last_became_peered":"2024-09-12T18:26:39.842159+0000","last_unstale":"2024-09-12T19:11:59.702513+0000","last_undegraded":"2024-09-12T19:11:59.702513+0000","last_fullsized":"2024-09-12T19:11:59.702513+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:57.097188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19243142,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":545,"num_read_kb":58099,"num_write":1193,"num_write_kb":62462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'845","reported_seq":2432,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.108397+0000","last_change":"2024-09-12T18:26:41.854196+0000","last_active":"2024-09-12T19:13:43.108397+0000","last_peered":"2024-09-12T19:13:43.108397+0000","last_clean":"2024-09-12T19:13:43.108397+0000","last_became_active":"2024-09-12T18:26:41.853403+0000","last_became_peered":"2024-09-12T18:26:41.853403+0000","last_unstale":"2024-09-12T19:13:43.108397+0000","last_undegraded":"2024-09-12T19:13:43.108397+0000","last_fullsized":"2024-09-12T19:13:43.108397+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:23.475163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3981,"num_read_kb":3579,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'355","reported_seq":1064,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:13.933191+0000","last_change":"2024-09-12T18:26:39.834464+0000","last_active":"2024-09-12T19:11:13.933191+0000","last_peered":"2024-09-12T19:11:13.933191+0000","last_clean":"2024-09-12T19:11:13.933191+0000","last_became_active":"2024-09-12T18:26:39.834006+0000","last_became_peered":"2024-09-12T18:26:39.834006+0000","last_unstale":"2024-09-12T19:11:13.933191+0000","last_undegraded":"2024-09-12T19:11:13.933191+0000","last_fullsized":"2024-09-12T19:11:13.933191+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:58.733603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3329482,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":670,"num_read_kb":82742,"num_write":1276,"num_write_kb":55909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'115","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.220116+0000","last_change":"2024-09-12T18:26:49.907310+0000","last_active":"2024-09-12T19:12:24.220116+0000","last_peered":"2024-09-12T19:12:24.220116+0000","last_clean":"2024-09-12T19:12:24.220116+0000","last_became_active":"2024-09-12T18:26:49.906589+0000","last_became_peered":"2024-09-12T18:26:49.906589+0000","last_unstale":"2024-09-12T19:12:24.220116+0000","last_undegraded":"2024-09-12T19:12:24.220116+0000","last_fullsized":"2024-09-12T19:12:24.220116+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:14.519874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":280,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'752","reported_seq":2162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.190816+0000","last_change":"2024-09-12T18:26:41.853179+0000","last_active":"2024-09-12T19:11:59.190816+0000","last_peered":"2024-09-12T19:11:59.190816+0000","last_clean":"2024-09-12T19:11:59.190816+0000","last_became_active":"2024-09-12T18:26:41.852831+0000","last_became_peered":"2024-09-12T18:26:41.852831+0000","last_unstale":"2024-09-12T19:11:59.190816+0000","last_undegraded":"2024-09-12T19:11:59.190816+0000","last_fullsized":"2024-09-12T19:11:59.190816+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:22.488493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3501,"num_read_kb":3138,"num_write":986,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'361","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.871106+0000","last_change":"2024-09-12T18:27:11.824441+0000","last_active":"2024-09-12T19:13:57.871106+0000","last_peered":"2024-09-12T19:13:57.871106+0000","last_clean":"2024-09-12T19:13:57.871106+0000","last_became_active":"2024-09-12T18:27:11.823705+0000","last_became_peered":"2024-09-12T18:27:11.823705+0000","last_unstale":"2024-09-12T19:13:57.871106+0000","last_undegraded":"2024-09-12T19:13:57.871106+0000","last_fullsized":"2024-09-12T19:13:57.871106+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:16.557071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221836,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":562,"num_read_kb":55935,"num_write":1231,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.891991+0000","last_change":"2024-09-12T18:26:43.859139+0000","last_active":"2024-09-12T19:10:13.891991+0000","last_peered":"2024-09-12T19:10:13.891991+0000","last_clean":"2024-09-12T19:10:13.891991+0000","last_became_active":"2024-09-12T18:26:43.857754+0000","last_became_peered":"2024-09-12T18:26:43.857754+0000","last_unstale":"2024-09-12T19:10:13.891991+0000","last_undegraded":"2024-09-12T19:10:13.891991+0000","last_fullsized":"2024-09-12T19:10:13.891991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:44.851162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'312","reported_seq":910,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.955980+0000","last_change":"2024-09-12T18:26:45.876845+0000","last_active":"2024-09-12T19:12:43.955980+0000","last_peered":"2024-09-12T19:12:43.955980+0000","last_clean":"2024-09-12T19:12:43.955980+0000","last_became_active":"2024-09-12T18:26:45.876070+0000","last_became_peered":"2024-09-12T18:26:45.876070+0000","last_unstale":"2024-09-12T19:12:43.955980+0000","last_undegraded":"2024-09-12T19:12:43.955980+0000","last_fullsized":"2024-09-12T19:12:43.955980+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:22.272564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58716,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":506,"num_read_kb":955,"num_write":404,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:17.898757+0000","last_change":"2024-09-12T18:26:47.896202+0000","last_active":"2024-09-12T19:10:17.898757+0000","last_peered":"2024-09-12T19:10:17.898757+0000","last_clean":"2024-09-12T19:10:17.898757+0000","last_became_active":"2024-09-12T18:26:47.895471+0000","last_became_peered":"2024-09-12T18:26:47.895471+0000","last_unstale":"2024-09-12T19:10:17.898757+0000","last_undegraded":"2024-09-12T19:10:17.898757+0000","last_fullsized":"2024-09-12T19:10:17.898757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:33.203860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'2440","reported_seq":4321,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.300739+0000","last_change":"2024-09-12T18:26:49.913977+0000","last_active":"2024-09-12T19:12:21.300739+0000","last_peered":"2024-09-12T19:12:21.300739+0000","last_clean":"2024-09-12T19:12:21.300739+0000","last_became_active":"2024-09-12T18:26:49.913125+0000","last_became_peered":"2024-09-12T18:26:49.913125+0000","last_unstale":"2024-09-12T19:12:21.300739+0000","last_undegraded":"2024-09-12T19:12:21.300739+0000","last_fullsized":"2024-09-12T19:12:21.300739+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":2400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:14.099069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6085,"num_read_kb":6089,"num_write":4865,"num_write_kb":1791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'567","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:02.090617+0000","last_change":"2024-09-12T18:26:41.872673+0000","last_active":"2024-09-12T19:12:02.090617+0000","last_peered":"2024-09-12T19:12:02.090617+0000","last_clean":"2024-09-12T19:12:02.090617+0000","last_became_active":"2024-09-12T18:26:41.871531+0000","last_became_peered":"2024-09-12T18:26:41.871531+0000","last_unstale":"2024-09-12T19:12:02.090617+0000","last_undegraded":"2024-09-12T19:12:02.090617+0000","last_fullsized":"2024-09-12T19:12:02.090617+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:58.936555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2964,"num_read_kb":2726,"num_write":725,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'299","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:56.120289+0000","last_change":"2024-09-12T18:26:39.872043+0000","last_active":"2024-09-12T19:11:56.120289+0000","last_peered":"2024-09-12T19:11:56.120289+0000","last_clean":"2024-09-12T19:11:56.120289+0000","last_became_active":"2024-09-12T18:26:39.871605+0000","last_became_peered":"2024-09-12T18:26:39.871605+0000","last_unstale":"2024-09-12T19:11:56.120289+0000","last_undegraded":"2024-09-12T19:11:56.120289+0000","last_fullsized":"2024-09-12T19:11:56.120289+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:34.631521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5057800,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":511,"num_read_kb":33405,"num_write":1134,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.930194+0000","last_change":"2024-09-12T18:26:43.866305+0000","last_active":"2024-09-12T19:11:08.930194+0000","last_peered":"2024-09-12T19:11:08.930194+0000","last_clean":"2024-09-12T19:11:08.930194+0000","last_became_active":"2024-09-12T18:26:43.865817+0000","last_became_peered":"2024-09-12T18:26:43.865817+0000","last_unstale":"2024-09-12T19:11:08.930194+0000","last_undegraded":"2024-09-12T19:11:08.930194+0000","last_fullsized":"2024-09-12T19:11:08.930194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:44.351205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'75","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:11.668505+0000","last_change":"2024-09-12T18:26:45.854845+0000","last_active":"2024-09-12T19:11:11.668505+0000","last_peered":"2024-09-12T19:11:11.668505+0000","last_clean":"2024-09-12T19:11:11.668505+0000","last_became_active":"2024-09-12T18:26:45.854087+0000","last_became_peered":"2024-09-12T18:26:45.854087+0000","last_unstale":"2024-09-12T19:11:11.668505+0000","last_undegraded":"2024-09-12T19:11:11.668505+0000","last_fullsized":"2024-09-12T19:11:11.668505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:33.838948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:19.102590+0000","last_change":"2024-09-12T18:26:47.881155+0000","last_active":"2024-09-12T19:10:19.102590+0000","last_peered":"2024-09-12T19:10:19.102590+0000","last_clean":"2024-09-12T19:10:19.102590+0000","last_became_active":"2024-09-12T18:26:47.880374+0000","last_became_peered":"2024-09-12T18:26:47.880374+0000","last_unstale":"2024-09-12T19:10:19.102590+0000","last_undegraded":"2024-09-12T19:10:19.102590+0000","last_fullsized":"2024-09-12T19:10:19.102590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:15.543833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'120","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.174257+0000","last_change":"2024-09-12T18:26:49.927396+0000","last_active":"2024-09-12T19:11:59.174257+0000","last_peered":"2024-09-12T19:11:59.174257+0000","last_clean":"2024-09-12T19:11:59.174257+0000","last_became_active":"2024-09-12T18:26:49.926650+0000","last_became_peered":"2024-09-12T18:26:49.926650+0000","last_unstale":"2024-09-12T19:11:59.174257+0000","last_undegraded":"2024-09-12T19:11:59.174257+0000","last_fullsized":"2024-09-12T19:11:59.174257+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:12.549691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'508","reported_seq":2178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.106328+0000","last_change":"2024-09-12T18:26:41.852310+0000","last_active":"2024-09-12T19:12:01.106328+0000","last_peered":"2024-09-12T19:12:01.106328+0000","last_clean":"2024-09-12T19:12:01.106328+0000","last_became_active":"2024-09-12T18:26:41.851928+0000","last_became_peered":"2024-09-12T18:26:41.851928+0000","last_unstale":"2024-09-12T19:12:01.106328+0000","last_undegraded":"2024-09-12T19:12:01.106328+0000","last_fullsized":"2024-09-12T19:12:01.106328+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:23.223986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2649,"num_read_kb":2492,"num_write":594,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'350","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.905377+0000","last_change":"2024-09-12T18:26:39.864105+0000","last_active":"2024-09-12T19:13:57.905377+0000","last_peered":"2024-09-12T19:13:57.905377+0000","last_clean":"2024-09-12T19:13:57.905377+0000","last_became_active":"2024-09-12T18:26:39.863389+0000","last_became_peered":"2024-09-12T18:26:39.863389+0000","last_unstale":"2024-09-12T19:13:57.905377+0000","last_undegraded":"2024-09-12T19:13:57.905377+0000","last_fullsized":"2024-09-12T19:13:57.905377+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:59.089104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194678,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":506,"num_read_kb":22645,"num_write":1102,"num_write_kb":31309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.916104+0000","last_change":"2024-09-12T18:26:43.855208+0000","last_active":"2024-09-12T19:10:13.916104+0000","last_peered":"2024-09-12T19:10:13.916104+0000","last_clean":"2024-09-12T19:10:13.916104+0000","last_became_active":"2024-09-12T18:26:43.853736+0000","last_became_peered":"2024-09-12T18:26:43.853736+0000","last_unstale":"2024-09-12T19:10:13.916104+0000","last_undegraded":"2024-09-12T19:10:13.916104+0000","last_fullsized":"2024-09-12T19:10:13.916104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:26.483694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'112","reported_seq":644,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:16.619773+0000","last_change":"2024-09-12T18:26:45.853889+0000","last_active":"2024-09-12T19:11:16.619773+0000","last_peered":"2024-09-12T19:11:16.619773+0000","last_clean":"2024-09-12T19:11:16.619773+0000","last_became_active":"2024-09-12T18:26:45.853143+0000","last_became_peered":"2024-09-12T18:26:45.853143+0000","last_unstale":"2024-09-12T19:11:16.619773+0000","last_undegraded":"2024-09-12T19:11:16.619773+0000","last_fullsized":"2024-09-12T19:11:16.619773+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:21.398455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'760","reported_seq":4106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.834477+0000","last_change":"2024-09-12T18:26:47.895745+0000","last_active":"2024-09-12T19:13:56.834477+0000","last_peered":"2024-09-12T19:13:56.834477+0000","last_clean":"2024-09-12T19:13:56.834477+0000","last_became_active":"2024-09-12T18:26:47.895056+0000","last_became_peered":"2024-09-12T18:26:47.895056+0000","last_unstale":"2024-09-12T19:13:56.834477+0000","last_undegraded":"2024-09-12T19:13:56.834477+0000","last_fullsized":"2024-09-12T19:13:56.834477+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":702,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:33.762580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'174","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.267501+0000","last_change":"2024-09-12T18:26:49.890859+0000","last_active":"2024-09-12T19:12:24.267501+0000","last_peered":"2024-09-12T19:12:24.267501+0000","last_clean":"2024-09-12T19:12:24.267501+0000","last_became_active":"2024-09-12T18:26:49.890325+0000","last_became_peered":"2024-09-12T18:26:49.890325+0000","last_unstale":"2024-09-12T19:12:24.267501+0000","last_undegraded":"2024-09-12T19:12:24.267501+0000","last_fullsized":"2024-09-12T19:12:24.267501+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:48.483470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":638,"num_write":360,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'755","reported_seq":2307,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:05.288203+0000","last_change":"2024-09-12T18:26:41.862710+0000","last_active":"2024-09-12T19:12:05.288203+0000","last_peered":"2024-09-12T19:12:05.288203+0000","last_clean":"2024-09-12T19:12:05.288203+0000","last_became_active":"2024-09-12T18:26:41.862240+0000","last_became_peered":"2024-09-12T18:26:41.862240+0000","last_unstale":"2024-09-12T19:12:05.288203+0000","last_undegraded":"2024-09-12T19:12:05.288203+0000","last_fullsized":"2024-09-12T19:12:05.288203+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:33.961532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3627,"num_read_kb":3298,"num_write":982,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'262","reported_seq":877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:38.071574+0000","last_change":"2024-09-12T18:26:39.844306+0000","last_active":"2024-09-12T19:13:38.071574+0000","last_peered":"2024-09-12T19:13:38.071574+0000","last_clean":"2024-09-12T19:13:38.071574+0000","last_became_active":"2024-09-12T18:26:39.843351+0000","last_became_peered":"2024-09-12T18:26:39.843351+0000","last_unstale":"2024-09-12T19:13:38.071574+0000","last_undegraded":"2024-09-12T19:13:38.071574+0000","last_fullsized":"2024-09-12T19:13:38.071574+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:35.966180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417223,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":412,"num_read_kb":20705,"num_write":966,"num_write_kb":27627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.892087+0000","last_change":"2024-09-12T18:26:43.843098+0000","last_active":"2024-09-12T19:10:13.892087+0000","last_peered":"2024-09-12T19:10:13.892087+0000","last_clean":"2024-09-12T19:10:13.892087+0000","last_became_active":"2024-09-12T18:26:43.842479+0000","last_became_peered":"2024-09-12T18:26:43.842479+0000","last_unstale":"2024-09-12T19:10:13.892087+0000","last_undegraded":"2024-09-12T19:10:13.892087+0000","last_fullsized":"2024-09-12T19:10:13.892087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:07.573346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'281","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.959185+0000","last_change":"2024-09-12T18:26:46.025157+0000","last_active":"2024-09-12T19:13:43.959185+0000","last_peered":"2024-09-12T19:13:43.959185+0000","last_clean":"2024-09-12T19:13:43.959185+0000","last_became_active":"2024-09-12T18:26:46.024425+0000","last_became_peered":"2024-09-12T18:26:46.024425+0000","last_unstale":"2024-09-12T19:13:43.959185+0000","last_undegraded":"2024-09-12T19:13:43.959185+0000","last_fullsized":"2024-09-12T19:13:43.959185+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:13.803848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62379,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":998,"num_write":390,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'801","reported_seq":2364,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.028658+0000","last_change":"2024-09-12T18:26:47.899579+0000","last_active":"2024-09-12T19:13:44.028658+0000","last_peered":"2024-09-12T19:13:44.028658+0000","last_clean":"2024-09-12T19:13:44.028658+0000","last_became_active":"2024-09-12T18:26:47.898903+0000","last_became_peered":"2024-09-12T18:26:47.898903+0000","last_unstale":"2024-09-12T19:13:44.028658+0000","last_undegraded":"2024-09-12T19:13:44.028658+0000","last_fullsized":"2024-09-12T19:13:44.028658+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:43.604475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'762","reported_seq":2249,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:03.047582+0000","last_change":"2024-09-12T18:26:41.870576+0000","last_active":"2024-09-12T19:12:03.047582+0000","last_peered":"2024-09-12T19:12:03.047582+0000","last_clean":"2024-09-12T19:12:03.047582+0000","last_became_active":"2024-09-12T18:26:41.869852+0000","last_became_peered":"2024-09-12T18:26:41.869852+0000","last_unstale":"2024-09-12T19:12:03.047582+0000","last_undegraded":"2024-09-12T19:12:03.047582+0000","last_fullsized":"2024-09-12T19:12:03.047582+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:41.656803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3529,"num_read_kb":3192,"num_write":1004,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'453","reported_seq":1174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.942166+0000","last_change":"2024-09-12T18:26:39.875011+0000","last_active":"2024-09-12T19:13:57.942166+0000","last_peered":"2024-09-12T19:13:57.942166+0000","last_clean":"2024-09-12T19:13:57.942166+0000","last_became_active":"2024-09-12T18:26:39.873512+0000","last_became_peered":"2024-09-12T18:26:39.873512+0000","last_unstale":"2024-09-12T19:13:57.942166+0000","last_undegraded":"2024-09-12T19:13:57.942166+0000","last_fullsized":"2024-09-12T19:13:57.942166+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:45.863880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5044712,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":899,"num_read_kb":13008,"num_write":1518,"num_write_kb":39306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.895938+0000","last_change":"2024-09-12T18:26:43.871922+0000","last_active":"2024-09-12T19:10:07.895938+0000","last_peered":"2024-09-12T19:10:07.895938+0000","last_clean":"2024-09-12T19:10:07.895938+0000","last_became_active":"2024-09-12T18:26:43.871192+0000","last_became_peered":"2024-09-12T18:26:43.871192+0000","last_unstale":"2024-09-12T19:10:07.895938+0000","last_undegraded":"2024-09-12T19:10:07.895938+0000","last_fullsized":"2024-09-12T19:10:07.895938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:26.666887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'360","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:28.921731+0000","last_change":"2024-09-12T18:26:46.021987+0000","last_active":"2024-09-12T19:12:28.921731+0000","last_peered":"2024-09-12T19:12:28.921731+0000","last_clean":"2024-09-12T19:12:28.921731+0000","last_became_active":"2024-09-12T18:26:46.021239+0000","last_became_peered":"2024-09-12T18:26:46.021239+0000","last_unstale":"2024-09-12T19:12:28.921731+0000","last_undegraded":"2024-09-12T19:12:28.921731+0000","last_fullsized":"2024-09-12T19:12:28.921731+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:16.999506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55436,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":568,"num_read_kb":1061,"num_write":454,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:32.894704+0000","last_change":"2024-09-12T18:26:47.879784+0000","last_active":"2024-09-12T19:09:32.894704+0000","last_peered":"2024-09-12T19:09:32.894704+0000","last_clean":"2024-09-12T19:09:32.894704+0000","last_became_active":"2024-09-12T18:26:47.879079+0000","last_became_peered":"2024-09-12T18:26:47.879079+0000","last_unstale":"2024-09-12T19:09:32.894704+0000","last_undegraded":"2024-09-12T19:09:32.894704+0000","last_fullsized":"2024-09-12T19:09:32.894704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:25.067221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'551","reported_seq":1359,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.001450+0000","last_change":"2024-09-12T18:26:49.913788+0000","last_active":"2024-09-12T19:13:44.001450+0000","last_peered":"2024-09-12T19:13:44.001450+0000","last_clean":"2024-09-12T19:13:44.001450+0000","last_became_active":"2024-09-12T18:26:49.913115+0000","last_became_peered":"2024-09-12T18:26:49.913115+0000","last_unstale":"2024-09-12T19:13:44.001450+0000","last_undegraded":"2024-09-12T19:13:44.001450+0000","last_fullsized":"2024-09-12T19:13:44.001450+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:49.514569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1285,"num_write":1159,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'406","reported_seq":1988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.570164+0000","last_change":"2024-09-12T18:26:41.855029+0000","last_active":"2024-09-12T19:12:06.570164+0000","last_peered":"2024-09-12T19:12:06.570164+0000","last_clean":"2024-09-12T19:12:06.570164+0000","last_became_active":"2024-09-12T18:26:41.854391+0000","last_became_peered":"2024-09-12T18:26:41.854391+0000","last_unstale":"2024-09-12T19:12:06.570164+0000","last_undegraded":"2024-09-12T19:12:06.570164+0000","last_fullsized":"2024-09-12T19:12:06.570164+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:51.832674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2438,"num_read_kb":2340,"num_write":450,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'292","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.937366+0000","last_change":"2024-09-12T18:26:39.871356+0000","last_active":"2024-09-12T19:13:57.937366+0000","last_peered":"2024-09-12T19:13:57.937366+0000","last_clean":"2024-09-12T19:13:57.937366+0000","last_became_active":"2024-09-12T18:26:39.870641+0000","last_became_peered":"2024-09-12T18:26:39.870641+0000","last_unstale":"2024-09-12T19:13:57.937366+0000","last_undegraded":"2024-09-12T19:13:57.937366+0000","last_fullsized":"2024-09-12T19:13:57.937366+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:37.867643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048963,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":389,"num_read_kb":1418,"num_write":995,"num_write_kb":24682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.878656+0000","last_change":"2024-09-12T18:26:43.854009+0000","last_active":"2024-09-12T19:10:03.878656+0000","last_peered":"2024-09-12T19:10:03.878656+0000","last_clean":"2024-09-12T19:10:03.878656+0000","last_became_active":"2024-09-12T18:26:43.853212+0000","last_became_peered":"2024-09-12T18:26:43.853212+0000","last_unstale":"2024-09-12T19:10:03.878656+0000","last_undegraded":"2024-09-12T19:10:03.878656+0000","last_fullsized":"2024-09-12T19:10:03.878656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:12.634200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'259","reported_seq":821,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.717284+0000","last_change":"2024-09-12T18:26:45.866790+0000","last_active":"2024-09-12T19:11:48.717284+0000","last_peered":"2024-09-12T19:11:48.717284+0000","last_clean":"2024-09-12T19:11:48.717284+0000","last_became_active":"2024-09-12T18:26:45.865933+0000","last_became_peered":"2024-09-12T18:26:45.865933+0000","last_unstale":"2024-09-12T19:11:48.717284+0000","last_undegraded":"2024-09-12T19:11:48.717284+0000","last_fullsized":"2024-09-12T19:11:48.717284+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:47.841285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69833,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":437,"num_read_kb":950,"num_write":362,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.915818+0000","last_change":"2024-09-12T18:26:47.898805+0000","last_active":"2024-09-12T19:10:13.915818+0000","last_peered":"2024-09-12T19:10:13.915818+0000","last_clean":"2024-09-12T19:10:13.915818+0000","last_became_active":"2024-09-12T18:26:47.898056+0000","last_became_peered":"2024-09-12T18:26:47.898056+0000","last_unstale":"2024-09-12T19:10:13.915818+0000","last_undegraded":"2024-09-12T19:10:13.915818+0000","last_fullsized":"2024-09-12T19:10:13.915818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:01.722126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'128","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:53.928598+0000","last_change":"2024-09-12T18:26:49.914410+0000","last_active":"2024-09-12T19:12:53.928598+0000","last_peered":"2024-09-12T19:12:53.928598+0000","last_clean":"2024-09-12T19:12:53.928598+0000","last_became_active":"2024-09-12T18:26:49.913180+0000","last_became_peered":"2024-09-12T18:26:49.913180+0000","last_unstale":"2024-09-12T19:12:53.928598+0000","last_undegraded":"2024-09-12T19:12:53.928598+0000","last_fullsized":"2024-09-12T19:12:53.928598+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:31.008311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'514","reported_seq":2058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.768357+0000","last_change":"2024-09-12T18:26:41.874172+0000","last_active":"2024-09-12T19:12:08.768357+0000","last_peered":"2024-09-12T19:12:08.768357+0000","last_clean":"2024-09-12T19:12:08.768357+0000","last_became_active":"2024-09-12T18:26:41.873229+0000","last_became_peered":"2024-09-12T18:26:41.873229+0000","last_unstale":"2024-09-12T19:12:08.768357+0000","last_undegraded":"2024-09-12T19:12:08.768357+0000","last_fullsized":"2024-09-12T19:12:08.768357+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:55.323047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2942,"num_read_kb":2741,"num_write":656,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'341","reported_seq":1120,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.949516+0000","last_change":"2024-09-12T18:26:39.865873+0000","last_active":"2024-09-12T19:13:57.949516+0000","last_peered":"2024-09-12T19:13:57.949516+0000","last_clean":"2024-09-12T19:13:57.949516+0000","last_became_active":"2024-09-12T18:26:39.865148+0000","last_became_peered":"2024-09-12T18:26:39.865148+0000","last_unstale":"2024-09-12T19:13:57.949516+0000","last_undegraded":"2024-09-12T19:13:57.949516+0000","last_fullsized":"2024-09-12T19:13:57.949516+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:00.744853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2271991,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":857,"num_read_kb":25450,"num_write":1052,"num_write_kb":40926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:28.871439+0000","last_change":"2024-09-12T18:26:43.854880+0000","last_active":"2024-09-12T19:09:28.871439+0000","last_peered":"2024-09-12T19:09:28.871439+0000","last_clean":"2024-09-12T19:09:28.871439+0000","last_became_active":"2024-09-12T18:26:43.853084+0000","last_became_peered":"2024-09-12T18:26:43.853084+0000","last_unstale":"2024-09-12T19:09:28.871439+0000","last_undegraded":"2024-09-12T19:09:28.871439+0000","last_fullsized":"2024-09-12T19:09:28.871439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:12.477078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'307","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.556756+0000","last_change":"2024-09-12T18:26:45.867127+0000","last_active":"2024-09-12T19:13:57.556756+0000","last_peered":"2024-09-12T19:13:57.556756+0000","last_clean":"2024-09-12T19:13:57.556756+0000","last_became_active":"2024-09-12T18:26:45.866325+0000","last_became_peered":"2024-09-12T18:26:45.866325+0000","last_unstale":"2024-09-12T19:13:57.556756+0000","last_undegraded":"2024-09-12T19:13:57.556756+0000","last_fullsized":"2024-09-12T19:13:57.556756+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:45.228994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64639,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":1214,"num_write":426,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'788","reported_seq":2646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.029707+0000","last_change":"2024-09-12T18:26:47.879674+0000","last_active":"2024-09-12T19:13:44.029707+0000","last_peered":"2024-09-12T19:13:44.029707+0000","last_clean":"2024-09-12T19:13:44.029707+0000","last_became_active":"2024-09-12T18:26:47.878956+0000","last_became_peered":"2024-09-12T18:26:47.878956+0000","last_unstale":"2024-09-12T19:13:44.029707+0000","last_undegraded":"2024-09-12T19:13:44.029707+0000","last_fullsized":"2024-09-12T19:13:44.029707+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:56.898695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'146","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.017181+0000","last_change":"2024-09-12T18:26:49.927113+0000","last_active":"2024-09-12T19:13:43.017181+0000","last_peered":"2024-09-12T19:13:43.017181+0000","last_clean":"2024-09-12T19:13:43.017181+0000","last_became_active":"2024-09-12T18:26:49.926384+0000","last_became_peered":"2024-09-12T18:26:49.926384+0000","last_unstale":"2024-09-12T19:13:43.017181+0000","last_undegraded":"2024-09-12T19:13:43.017181+0000","last_fullsized":"2024-09-12T19:13:43.017181+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:14.787817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":361,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'694","reported_seq":2114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.881016+0000","last_change":"2024-09-12T18:26:41.846934+0000","last_active":"2024-09-12T19:12:07.881016+0000","last_peered":"2024-09-12T19:12:07.881016+0000","last_clean":"2024-09-12T19:12:07.881016+0000","last_became_active":"2024-09-12T18:26:41.846589+0000","last_became_peered":"2024-09-12T18:26:41.846589+0000","last_unstale":"2024-09-12T19:12:07.881016+0000","last_undegraded":"2024-09-12T19:12:07.881016+0000","last_fullsized":"2024-09-12T19:12:07.881016+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:35.741190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3315,"num_read_kb":3003,"num_write":914,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'263","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.663150+0000","last_change":"2024-09-12T18:26:39.851620+0000","last_active":"2024-09-12T19:11:58.663150+0000","last_peered":"2024-09-12T19:11:58.663150+0000","last_clean":"2024-09-12T19:11:58.663150+0000","last_became_active":"2024-09-12T18:26:39.849950+0000","last_became_peered":"2024-09-12T18:26:39.849950+0000","last_unstale":"2024-09-12T19:11:58.663150+0000","last_undegraded":"2024-09-12T19:11:58.663150+0000","last_fullsized":"2024-09-12T19:11:58.663150+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:33.362610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8457173,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":571,"num_read_kb":33808,"num_write":994,"num_write_kb":22667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.879742+0000","last_change":"2024-09-12T18:26:43.875193+0000","last_active":"2024-09-12T19:10:08.879742+0000","last_peered":"2024-09-12T19:10:08.879742+0000","last_clean":"2024-09-12T19:10:08.879742+0000","last_became_active":"2024-09-12T18:26:43.874837+0000","last_became_peered":"2024-09-12T18:26:43.874837+0000","last_unstale":"2024-09-12T19:10:08.879742+0000","last_undegraded":"2024-09-12T19:10:08.879742+0000","last_fullsized":"2024-09-12T19:10:08.879742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:28.076097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'450","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.943287+0000","last_change":"2024-09-12T18:26:45.876006+0000","last_active":"2024-09-12T19:13:43.943287+0000","last_peered":"2024-09-12T19:13:43.943287+0000","last_clean":"2024-09-12T19:13:43.943287+0000","last_became_active":"2024-09-12T18:26:45.875223+0000","last_became_peered":"2024-09-12T18:26:45.875223+0000","last_unstale":"2024-09-12T19:13:43.943287+0000","last_undegraded":"2024-09-12T19:13:43.943287+0000","last_fullsized":"2024-09-12T19:13:43.943287+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:33.224194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107054,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":782,"num_read_kb":1698,"num_write":650,"num_write_kb":561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.879675+0000","last_change":"2024-09-12T18:26:47.892554+0000","last_active":"2024-09-12T19:10:08.879675+0000","last_peered":"2024-09-12T19:10:08.879675+0000","last_clean":"2024-09-12T19:10:08.879675+0000","last_became_active":"2024-09-12T18:26:47.891736+0000","last_became_peered":"2024-09-12T18:26:47.891736+0000","last_unstale":"2024-09-12T19:10:08.879675+0000","last_undegraded":"2024-09-12T19:10:08.879675+0000","last_fullsized":"2024-09-12T19:10:08.879675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:15.740755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'131","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:19.312995+0000","last_change":"2024-09-12T18:26:49.905418+0000","last_active":"2024-09-12T19:10:19.312995+0000","last_peered":"2024-09-12T19:10:19.312995+0000","last_clean":"2024-09-12T19:10:19.312995+0000","last_became_active":"2024-09-12T18:26:49.904633+0000","last_became_peered":"2024-09-12T18:26:49.904633+0000","last_unstale":"2024-09-12T19:10:19.312995+0000","last_undegraded":"2024-09-12T19:10:19.312995+0000","last_fullsized":"2024-09-12T19:10:19.312995+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:49.072537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":176,"num_write":324,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'684","reported_seq":2216,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.579998+0000","last_change":"2024-09-12T18:26:41.853736+0000","last_active":"2024-09-12T19:11:42.579998+0000","last_peered":"2024-09-12T19:11:42.579998+0000","last_clean":"2024-09-12T19:11:42.579998+0000","last_became_active":"2024-09-12T18:26:41.852958+0000","last_became_peered":"2024-09-12T18:26:41.852958+0000","last_unstale":"2024-09-12T19:11:42.579998+0000","last_undegraded":"2024-09-12T19:11:42.579998+0000","last_fullsized":"2024-09-12T19:11:42.579998+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:03.970571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3047,"num_write":870,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'281","reported_seq":950,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:05.911940+0000","last_change":"2024-09-12T18:26:39.844241+0000","last_active":"2024-09-12T19:12:05.911940+0000","last_peered":"2024-09-12T19:12:05.911940+0000","last_clean":"2024-09-12T19:12:05.911940+0000","last_became_active":"2024-09-12T18:26:39.842671+0000","last_became_peered":"2024-09-12T18:26:39.842671+0000","last_unstale":"2024-09-12T19:12:05.911940+0000","last_undegraded":"2024-09-12T19:12:05.911940+0000","last_fullsized":"2024-09-12T19:12:05.911940+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:01.142718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7857956,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":478,"num_read_kb":38368,"num_write":1075,"num_write_kb":24127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:28.871539+0000","last_change":"2024-09-12T18:26:43.864463+0000","last_active":"2024-09-12T19:09:28.871539+0000","last_peered":"2024-09-12T19:09:28.871539+0000","last_clean":"2024-09-12T19:09:28.871539+0000","last_became_active":"2024-09-12T18:26:43.863615+0000","last_became_peered":"2024-09-12T18:26:43.863615+0000","last_unstale":"2024-09-12T19:09:28.871539+0000","last_undegraded":"2024-09-12T19:09:28.871539+0000","last_fullsized":"2024-09-12T19:09:28.871539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:49.236494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'288","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:49.122609+0000","last_change":"2024-09-12T18:26:45.865043+0000","last_active":"2024-09-12T19:11:49.122609+0000","last_peered":"2024-09-12T19:11:49.122609+0000","last_clean":"2024-09-12T19:11:49.122609+0000","last_became_active":"2024-09-12T18:26:45.864308+0000","last_became_peered":"2024-09-12T18:26:45.864308+0000","last_unstale":"2024-09-12T19:11:49.122609+0000","last_undegraded":"2024-09-12T19:11:49.122609+0000","last_fullsized":"2024-09-12T19:11:49.122609+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:23.603111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56977,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":495,"num_read_kb":996,"num_write":454,"num_write_kb":379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:43.910003+0000","last_change":"2024-09-12T18:26:47.904622+0000","last_active":"2024-09-12T19:09:43.910003+0000","last_peered":"2024-09-12T19:09:43.910003+0000","last_clean":"2024-09-12T19:09:43.910003+0000","last_became_active":"2024-09-12T18:26:47.903984+0000","last_became_peered":"2024-09-12T18:26:47.903984+0000","last_unstale":"2024-09-12T19:09:43.910003+0000","last_undegraded":"2024-09-12T19:09:43.910003+0000","last_fullsized":"2024-09-12T19:09:43.910003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:01.445193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'130","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:03.733674+0000","last_change":"2024-09-12T18:26:49.917735+0000","last_active":"2024-09-12T19:13:03.733674+0000","last_peered":"2024-09-12T19:13:03.733674+0000","last_clean":"2024-09-12T19:13:03.733674+0000","last_became_active":"2024-09-12T18:26:49.916255+0000","last_became_peered":"2024-09-12T18:26:49.916255+0000","last_unstale":"2024-09-12T19:13:03.733674+0000","last_undegraded":"2024-09-12T19:13:03.733674+0000","last_fullsized":"2024-09-12T19:13:03.733674+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:05.827351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":172,"num_read_kb":153,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'479","reported_seq":2155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.274718+0000","last_change":"2024-09-12T18:26:41.852549+0000","last_active":"2024-09-12T19:12:23.274718+0000","last_peered":"2024-09-12T19:12:23.274718+0000","last_clean":"2024-09-12T19:12:23.274718+0000","last_became_active":"2024-09-12T18:26:41.851789+0000","last_became_peered":"2024-09-12T18:26:41.851789+0000","last_unstale":"2024-09-12T19:12:23.274718+0000","last_undegraded":"2024-09-12T19:12:23.274718+0000","last_fullsized":"2024-09-12T19:12:23.274718+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:07.659593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2754,"num_read_kb":2601,"num_write":570,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'332","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.634592+0000","last_change":"2024-09-12T18:26:39.850151+0000","last_active":"2024-09-12T19:11:44.634592+0000","last_peered":"2024-09-12T19:11:44.634592+0000","last_clean":"2024-09-12T19:11:44.634592+0000","last_became_active":"2024-09-12T18:26:39.849392+0000","last_became_peered":"2024-09-12T18:26:39.849392+0000","last_unstale":"2024-09-12T19:11:44.634592+0000","last_undegraded":"2024-09-12T19:11:44.634592+0000","last_fullsized":"2024-09-12T19:11:44.634592+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:38.297523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569204,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":603,"num_read_kb":7425,"num_write":1111,"num_write_kb":13361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:32.894780+0000","last_change":"2024-09-12T18:26:43.877842+0000","last_active":"2024-09-12T19:09:32.894780+0000","last_peered":"2024-09-12T19:09:32.894780+0000","last_clean":"2024-09-12T19:09:32.894780+0000","last_became_active":"2024-09-12T18:26:43.877257+0000","last_became_peered":"2024-09-12T18:26:43.877257+0000","last_unstale":"2024-09-12T19:09:32.894780+0000","last_undegraded":"2024-09-12T19:09:32.894780+0000","last_fullsized":"2024-09-12T19:09:32.894780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:29.743058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'283","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.719215+0000","last_change":"2024-09-12T18:26:45.862903+0000","last_active":"2024-09-12T19:11:58.719215+0000","last_peered":"2024-09-12T19:11:58.719215+0000","last_clean":"2024-09-12T19:11:58.719215+0000","last_became_active":"2024-09-12T18:26:45.861947+0000","last_became_peered":"2024-09-12T18:26:45.861947+0000","last_unstale":"2024-09-12T19:11:58.719215+0000","last_undegraded":"2024-09-12T19:11:58.719215+0000","last_fullsized":"2024-09-12T19:11:58.719215+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:08.858976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56992,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":939,"num_write":374,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'752","reported_seq":2376,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.024733+0000","last_change":"2024-09-12T18:26:47.881128+0000","last_active":"2024-09-12T19:13:44.024733+0000","last_peered":"2024-09-12T19:13:44.024733+0000","last_clean":"2024-09-12T19:13:44.024733+0000","last_became_active":"2024-09-12T18:26:47.880400+0000","last_became_peered":"2024-09-12T18:26:47.880400+0000","last_unstale":"2024-09-12T19:13:44.024733+0000","last_undegraded":"2024-09-12T19:13:44.024733+0000","last_fullsized":"2024-09-12T19:13:44.024733+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:33.420018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'139","reported_seq":636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:06.307338+0000","last_change":"2024-09-12T18:26:49.914558+0000","last_active":"2024-09-12T19:11:06.307338+0000","last_peered":"2024-09-12T19:11:06.307338+0000","last_clean":"2024-09-12T19:11:06.307338+0000","last_became_active":"2024-09-12T18:26:49.913762+0000","last_became_peered":"2024-09-12T18:26:49.913762+0000","last_unstale":"2024-09-12T19:11:06.307338+0000","last_undegraded":"2024-09-12T19:11:06.307338+0000","last_fullsized":"2024-09-12T19:11:06.307338+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:09.188110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":330,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'794","reported_seq":2361,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.094946+0000","last_change":"2024-09-12T18:26:41.867333+0000","last_active":"2024-09-12T19:12:01.094946+0000","last_peered":"2024-09-12T19:12:01.094946+0000","last_clean":"2024-09-12T19:12:01.094946+0000","last_became_active":"2024-09-12T18:26:41.866528+0000","last_became_peered":"2024-09-12T18:26:41.866528+0000","last_unstale":"2024-09-12T19:12:01.094946+0000","last_undegraded":"2024-09-12T19:12:01.094946+0000","last_fullsized":"2024-09-12T19:12:01.094946+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:17.375009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3788,"num_read_kb":3420,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'274","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.596733+0000","last_change":"2024-09-12T18:26:39.844053+0000","last_active":"2024-09-12T19:11:43.596733+0000","last_peered":"2024-09-12T19:11:43.596733+0000","last_clean":"2024-09-12T19:11:43.596733+0000","last_became_active":"2024-09-12T18:26:39.839762+0000","last_became_peered":"2024-09-12T18:26:39.839762+0000","last_unstale":"2024-09-12T19:11:43.596733+0000","last_undegraded":"2024-09-12T19:11:43.596733+0000","last_fullsized":"2024-09-12T19:11:43.596733+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:10.306869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11428025,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":349,"num_read_kb":30494,"num_write":980,"num_write_kb":26286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1443,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.886976+0000","last_change":"2024-09-12T18:26:43.862723+0000","last_active":"2024-09-12T19:13:43.886976+0000","last_peered":"2024-09-12T19:13:43.886976+0000","last_clean":"2024-09-12T19:13:43.886976+0000","last_became_active":"2024-09-12T18:26:43.861969+0000","last_became_peered":"2024-09-12T18:26:43.861969+0000","last_unstale":"2024-09-12T19:13:43.886976+0000","last_undegraded":"2024-09-12T19:13:43.886976+0000","last_fullsized":"2024-09-12T19:13:43.886976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:53.579120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":949,"num_read_kb":949,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'77","reported_seq":593,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.717443+0000","last_change":"2024-09-12T18:26:46.020701+0000","last_active":"2024-09-12T19:11:48.717443+0000","last_peered":"2024-09-12T19:11:48.717443+0000","last_clean":"2024-09-12T19:11:48.717443+0000","last_became_active":"2024-09-12T18:26:46.019895+0000","last_became_peered":"2024-09-12T18:26:46.019895+0000","last_unstale":"2024-09-12T19:11:48.717443+0000","last_undegraded":"2024-09-12T19:11:48.717443+0000","last_fullsized":"2024-09-12T19:11:48.717443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:59:43.067058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'765","reported_seq":4368,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.027134+0000","last_change":"2024-09-12T18:26:47.888210+0000","last_active":"2024-09-12T19:13:44.027134+0000","last_peered":"2024-09-12T19:13:44.027134+0000","last_clean":"2024-09-12T19:13:44.027134+0000","last_became_active":"2024-09-12T18:26:47.882417+0000","last_became_peered":"2024-09-12T18:26:47.882417+0000","last_unstale":"2024-09-12T19:13:44.027134+0000","last_undegraded":"2024-09-12T19:13:44.027134+0000","last_fullsized":"2024-09-12T19:13:44.027134+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:18.819184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'146","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:04.041466+0000","last_change":"2024-09-12T18:26:49.927258+0000","last_active":"2024-09-12T19:12:04.041466+0000","last_peered":"2024-09-12T19:12:04.041466+0000","last_clean":"2024-09-12T19:12:04.041466+0000","last_became_active":"2024-09-12T18:26:49.926637+0000","last_became_peered":"2024-09-12T18:26:49.926637+0000","last_unstale":"2024-09-12T19:12:04.041466+0000","last_undegraded":"2024-09-12T19:12:04.041466+0000","last_fullsized":"2024-09-12T19:12:04.041466+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:49.800769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":120,"num_write":360,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'756","reported_seq":2269,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.171030+0000","last_change":"2024-09-12T18:26:41.839495+0000","last_active":"2024-09-12T19:11:59.171030+0000","last_peered":"2024-09-12T19:11:59.171030+0000","last_clean":"2024-09-12T19:11:59.171030+0000","last_became_active":"2024-09-12T18:26:41.839152+0000","last_became_peered":"2024-09-12T18:26:41.839152+0000","last_unstale":"2024-09-12T19:11:59.171030+0000","last_undegraded":"2024-09-12T19:11:59.171030+0000","last_fullsized":"2024-09-12T19:11:59.171030+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:53.021667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3609,"num_read_kb":3261,"num_write":1016,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'299","reported_seq":1162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.198702+0000","last_change":"2024-09-12T18:26:39.842163+0000","last_active":"2024-09-12T19:12:08.198702+0000","last_peered":"2024-09-12T19:12:08.198702+0000","last_clean":"2024-09-12T19:12:08.198702+0000","last_became_active":"2024-09-12T18:26:39.839018+0000","last_became_peered":"2024-09-12T18:26:39.839018+0000","last_unstale":"2024-09-12T19:12:08.198702+0000","last_undegraded":"2024-09-12T19:12:08.198702+0000","last_fullsized":"2024-09-12T19:12:08.198702+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:01.980870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12779029,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":917,"num_read_kb":16661,"num_write":1175,"num_write_kb":29221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:29.091642+0000","last_change":"2024-09-12T18:26:43.875133+0000","last_active":"2024-09-12T19:09:29.091642+0000","last_peered":"2024-09-12T19:09:29.091642+0000","last_clean":"2024-09-12T19:09:29.091642+0000","last_became_active":"2024-09-12T18:26:43.872882+0000","last_became_peered":"2024-09-12T18:26:43.872882+0000","last_unstale":"2024-09-12T19:09:29.091642+0000","last_undegraded":"2024-09-12T19:09:29.091642+0000","last_fullsized":"2024-09-12T19:09:29.091642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:27.685683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'390","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.370347+0000","last_change":"2024-09-12T18:26:45.871763+0000","last_active":"2024-09-12T19:12:24.370347+0000","last_peered":"2024-09-12T19:12:24.370347+0000","last_clean":"2024-09-12T19:12:24.370347+0000","last_became_active":"2024-09-12T18:26:45.871011+0000","last_became_peered":"2024-09-12T18:26:45.871011+0000","last_unstale":"2024-09-12T19:12:24.370347+0000","last_undegraded":"2024-09-12T19:12:24.370347+0000","last_fullsized":"2024-09-12T19:12:24.370347+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:25.203156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55304,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1182,"num_read_kb":1667,"num_write":1694,"num_write_kb":1536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:33.885454+0000","last_change":"2024-09-12T18:26:47.894796+0000","last_active":"2024-09-12T19:09:33.885454+0000","last_peered":"2024-09-12T19:09:33.885454+0000","last_clean":"2024-09-12T19:09:33.885454+0000","last_became_active":"2024-09-12T18:26:47.893881+0000","last_became_peered":"2024-09-12T18:26:47.893881+0000","last_unstale":"2024-09-12T19:09:33.885454+0000","last_undegraded":"2024-09-12T19:09:33.885454+0000","last_fullsized":"2024-09-12T19:09:33.885454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:58.081365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'157","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:37.541375+0000","last_change":"2024-09-12T18:26:49.912169+0000","last_active":"2024-09-12T19:11:37.541375+0000","last_peered":"2024-09-12T19:11:37.541375+0000","last_clean":"2024-09-12T19:11:37.541375+0000","last_became_active":"2024-09-12T18:26:49.911403+0000","last_became_peered":"2024-09-12T18:26:49.911403+0000","last_unstale":"2024-09-12T19:11:37.541375+0000","last_undegraded":"2024-09-12T19:11:37.541375+0000","last_fullsized":"2024-09-12T19:11:37.541375+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:01.150938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":152,"num_write":383,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'825","reported_seq":2330,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.126584+0000","last_change":"2024-09-12T18:26:41.874124+0000","last_active":"2024-09-12T19:12:24.126584+0000","last_peered":"2024-09-12T19:12:24.126584+0000","last_clean":"2024-09-12T19:12:24.126584+0000","last_became_active":"2024-09-12T18:26:41.873329+0000","last_became_peered":"2024-09-12T18:26:41.873329+0000","last_unstale":"2024-09-12T19:12:24.126584+0000","last_undegraded":"2024-09-12T19:12:24.126584+0000","last_fullsized":"2024-09-12T19:12:24.126584+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:49.832562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3864,"num_read_kb":3455,"num_write":1112,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.901972+0000","last_change":"2024-09-12T18:26:20.490476+0000","last_active":"2024-09-12T19:10:32.901972+0000","last_peered":"2024-09-12T19:10:32.901972+0000","last_clean":"2024-09-12T19:10:32.901972+0000","last_became_active":"2024-09-12T18:26:20.488464+0000","last_became_peered":"2024-09-12T18:26:20.488464+0000","last_unstale":"2024-09-12T19:10:32.901972+0000","last_undegraded":"2024-09-12T19:10:32.901972+0000","last_fullsized":"2024-09-12T19:10:32.901972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:19.397195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:19.397195+0000","last_clean_scrub_stamp":"2024-09-12T18:26:19.397195+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:55.130875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.891893+0000","last_change":"2024-09-12T18:26:27.490424+0000","last_active":"2024-09-12T19:10:13.891893+0000","last_peered":"2024-09-12T19:10:13.891893+0000","last_clean":"2024-09-12T19:10:13.891893+0000","last_became_active":"2024-09-12T18:26:25.483072+0000","last_became_peered":"2024-09-12T18:26:25.483072+0000","last_unstale":"2024-09-12T19:10:13.891893+0000","last_undegraded":"2024-09-12T19:10:13.891893+0000","last_fullsized":"2024-09-12T19:10:13.891893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:05.867109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010071489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'306","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:04.359804+0000","last_change":"2024-09-12T18:26:39.855572+0000","last_active":"2024-09-12T19:12:04.359804+0000","last_peered":"2024-09-12T19:12:04.359804+0000","last_clean":"2024-09-12T19:12:04.359804+0000","last_became_active":"2024-09-12T18:26:39.855274+0000","last_became_peered":"2024-09-12T18:26:39.855274+0000","last_unstale":"2024-09-12T19:12:04.359804+0000","last_undegraded":"2024-09-12T19:12:04.359804+0000","last_fullsized":"2024-09-12T19:12:04.359804+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:41.652285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4633640,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":526,"num_read_kb":43410,"num_write":1089,"num_write_kb":32341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"36'3","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.574535+0000","last_change":"2024-09-12T18:26:43.863289+0000","last_active":"2024-09-12T19:13:56.574535+0000","last_peered":"2024-09-12T19:13:56.574535+0000","last_clean":"2024-09-12T19:13:56.574535+0000","last_became_active":"2024-09-12T18:26:43.862599+0000","last_became_peered":"2024-09-12T18:26:43.862599+0000","last_unstale":"2024-09-12T19:13:56.574535+0000","last_undegraded":"2024-09-12T19:13:56.574535+0000","last_fullsized":"2024-09-12T19:13:56.574535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:40.040108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'703","reported_seq":1386,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.976548+0000","last_change":"2024-09-12T18:26:45.871462+0000","last_active":"2024-09-12T19:13:43.976548+0000","last_peered":"2024-09-12T19:13:43.976548+0000","last_clean":"2024-09-12T19:13:43.976548+0000","last_became_active":"2024-09-12T18:26:45.870711+0000","last_became_peered":"2024-09-12T18:26:45.870711+0000","last_unstale":"2024-09-12T19:13:43.976548+0000","last_undegraded":"2024-09-12T19:13:43.976548+0000","last_fullsized":"2024-09-12T19:13:43.976548+0000","mapping_epoch":30,"log_start":"265'600","ondisk_log_start":"265'600","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:33.052933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185163,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1361,"num_read_kb":2859,"num_write":1270,"num_write_kb":1141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.915809+0000","last_change":"2024-09-12T18:26:47.888177+0000","last_active":"2024-09-12T19:10:08.915809+0000","last_peered":"2024-09-12T19:10:08.915809+0000","last_clean":"2024-09-12T19:10:08.915809+0000","last_became_active":"2024-09-12T18:26:47.886696+0000","last_became_peered":"2024-09-12T18:26:47.886696+0000","last_unstale":"2024-09-12T19:10:08.915809+0000","last_undegraded":"2024-09-12T19:10:08.915809+0000","last_fullsized":"2024-09-12T19:10:08.915809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:07.144929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'175","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.921796+0000","last_change":"2024-09-12T18:26:49.910601+0000","last_active":"2024-09-12T19:12:23.921796+0000","last_peered":"2024-09-12T19:12:23.921796+0000","last_clean":"2024-09-12T19:12:23.921796+0000","last_became_active":"2024-09-12T18:26:49.909591+0000","last_became_peered":"2024-09-12T18:26:49.909591+0000","last_unstale":"2024-09-12T19:12:23.921796+0000","last_undegraded":"2024-09-12T19:12:23.921796+0000","last_fullsized":"2024-09-12T19:12:23.921796+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.427369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":451,"num_write":354,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'445","reported_seq":1921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.106331+0000","last_change":"2024-09-12T18:27:11.827439+0000","last_active":"2024-09-12T19:13:43.106331+0000","last_peered":"2024-09-12T19:13:43.106331+0000","last_clean":"2024-09-12T19:13:43.106331+0000","last_became_active":"2024-09-12T18:27:11.825677+0000","last_became_peered":"2024-09-12T18:27:11.825677+0000","last_unstale":"2024-09-12T19:13:43.106331+0000","last_undegraded":"2024-09-12T19:13:43.106331+0000","last_fullsized":"2024-09-12T19:13:43.106331+0000","mapping_epoch":37,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:25.109981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2226,"num_read_kb":2089,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903232+0000","last_change":"2024-09-12T18:26:28.282837+0000","last_active":"2024-09-12T19:10:37.903232+0000","last_peered":"2024-09-12T19:10:37.903232+0000","last_clean":"2024-09-12T19:10:37.903232+0000","last_became_active":"2024-09-12T18:26:25.486681+0000","last_became_peered":"2024-09-12T18:26:25.486681+0000","last_unstale":"2024-09-12T19:10:37.903232+0000","last_undegraded":"2024-09-12T19:10:37.903232+0000","last_fullsized":"2024-09-12T19:10:37.903232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:48.632695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001127308,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'354","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:35.534251+0000","last_change":"2024-09-12T18:26:39.853101+0000","last_active":"2024-09-12T19:13:35.534251+0000","last_peered":"2024-09-12T19:13:35.534251+0000","last_clean":"2024-09-12T19:13:35.534251+0000","last_became_active":"2024-09-12T18:26:39.852604+0000","last_became_peered":"2024-09-12T18:26:39.852604+0000","last_unstale":"2024-09-12T19:13:35.534251+0000","last_undegraded":"2024-09-12T19:13:35.534251+0000","last_fullsized":"2024-09-12T19:13:35.534251+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:00.197344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3657272,"num_objects":91,"num_object_clones":0,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":527,"num_read_kb":8880,"num_write":1199,"num_write_kb":32875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.889750+0000","last_change":"2024-09-12T18:26:43.858389+0000","last_active":"2024-09-12T19:10:03.889750+0000","last_peered":"2024-09-12T19:10:03.889750+0000","last_clean":"2024-09-12T19:10:03.889750+0000","last_became_active":"2024-09-12T18:26:43.857619+0000","last_became_peered":"2024-09-12T18:26:43.857619+0000","last_unstale":"2024-09-12T19:10:03.889750+0000","last_undegraded":"2024-09-12T19:10:03.889750+0000","last_fullsized":"2024-09-12T19:10:03.889750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:43.526191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1270","reported_seq":2772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.340316+0000","last_change":"2024-09-12T18:26:45.866866+0000","last_active":"2024-09-12T19:13:57.340316+0000","last_peered":"2024-09-12T19:13:57.340316+0000","last_clean":"2024-09-12T19:13:57.340316+0000","last_became_active":"2024-09-12T18:26:45.865530+0000","last_became_peered":"2024-09-12T18:26:45.865530+0000","last_unstale":"2024-09-12T19:13:57.340316+0000","last_undegraded":"2024-09-12T19:13:57.340316+0000","last_fullsized":"2024-09-12T19:13:57.340316+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:38.754345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155377,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1993,"num_read_kb":3658,"num_write":1108,"num_write_kb":952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:42.904610+0000","last_change":"2024-09-12T18:26:47.887431+0000","last_active":"2024-09-12T19:10:42.904610+0000","last_peered":"2024-09-12T19:10:42.904610+0000","last_clean":"2024-09-12T19:10:42.904610+0000","last_became_active":"2024-09-12T18:26:47.886707+0000","last_became_peered":"2024-09-12T18:26:47.886707+0000","last_unstale":"2024-09-12T19:10:42.904610+0000","last_undegraded":"2024-09-12T19:10:42.904610+0000","last_fullsized":"2024-09-12T19:10:42.904610+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:24.695168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'194","reported_seq":727,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:22.676957+0000","last_change":"2024-09-12T18:26:49.910993+0000","last_active":"2024-09-12T19:12:22.676957+0000","last_peered":"2024-09-12T19:12:22.676957+0000","last_clean":"2024-09-12T19:12:22.676957+0000","last_became_active":"2024-09-12T18:26:49.909802+0000","last_became_peered":"2024-09-12T18:26:49.909802+0000","last_unstale":"2024-09-12T19:12:22.676957+0000","last_undegraded":"2024-09-12T19:12:22.676957+0000","last_fullsized":"2024-09-12T19:12:22.676957+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:14.966749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":337,"num_read_kb":322,"num_write":434,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'391","reported_seq":1912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.102094+0000","last_change":"2024-09-12T18:26:41.869197+0000","last_active":"2024-09-12T19:13:43.102094+0000","last_peered":"2024-09-12T19:13:43.102094+0000","last_clean":"2024-09-12T19:13:43.102094+0000","last_became_active":"2024-09-12T18:26:41.868958+0000","last_became_peered":"2024-09-12T18:26:41.868958+0000","last_unstale":"2024-09-12T19:13:43.102094+0000","last_undegraded":"2024-09-12T19:13:43.102094+0000","last_fullsized":"2024-09-12T19:13:43.102094+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:46.271646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2137,"num_read_kb":2050,"num_write":435,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.880725+0000","last_change":"2024-09-12T18:26:27.893863+0000","last_active":"2024-09-12T19:10:13.880725+0000","last_peered":"2024-09-12T19:10:13.880725+0000","last_clean":"2024-09-12T19:10:13.880725+0000","last_became_active":"2024-09-12T18:26:25.559069+0000","last_became_peered":"2024-09-12T18:26:25.559069+0000","last_unstale":"2024-09-12T19:10:13.880725+0000","last_undegraded":"2024-09-12T19:10:13.880725+0000","last_fullsized":"2024-09-12T19:10:13.880725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:18.983449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065344600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'265","reported_seq":874,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.741585+0000","last_change":"2024-09-12T18:26:39.833083+0000","last_active":"2024-09-12T19:13:57.741585+0000","last_peered":"2024-09-12T19:13:57.741585+0000","last_clean":"2024-09-12T19:13:57.741585+0000","last_became_active":"2024-09-12T18:26:39.832766+0000","last_became_peered":"2024-09-12T18:26:39.832766+0000","last_unstale":"2024-09-12T19:13:57.741585+0000","last_undegraded":"2024-09-12T19:13:57.741585+0000","last_fullsized":"2024-09-12T19:13:57.741585+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:39.006582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9548513,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":351,"num_read_kb":10646,"num_write":844,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.878799+0000","last_change":"2024-09-12T18:26:43.844267+0000","last_active":"2024-09-12T19:10:03.878799+0000","last_peered":"2024-09-12T19:10:03.878799+0000","last_clean":"2024-09-12T19:10:03.878799+0000","last_became_active":"2024-09-12T18:26:43.843884+0000","last_became_peered":"2024-09-12T18:26:43.843884+0000","last_unstale":"2024-09-12T19:10:03.878799+0000","last_undegraded":"2024-09-12T19:10:03.878799+0000","last_fullsized":"2024-09-12T19:10:03.878799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:30.199439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'237","reported_seq":1345,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:40.758792+0000","last_change":"2024-09-12T18:26:46.025252+0000","last_active":"2024-09-12T19:13:40.758792+0000","last_peered":"2024-09-12T19:13:40.758792+0000","last_clean":"2024-09-12T19:13:40.758792+0000","last_became_active":"2024-09-12T18:26:46.024474+0000","last_became_peered":"2024-09-12T18:26:46.024474+0000","last_unstale":"2024-09-12T19:13:40.758792+0000","last_undegraded":"2024-09-12T19:13:40.758792+0000","last_fullsized":"2024-09-12T19:13:40.758792+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:08.550075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.922523+0000","last_change":"2024-09-12T18:26:47.890416+0000","last_active":"2024-09-12T19:10:33.922523+0000","last_peered":"2024-09-12T19:10:33.922523+0000","last_clean":"2024-09-12T19:10:33.922523+0000","last_became_active":"2024-09-12T18:26:47.889718+0000","last_became_peered":"2024-09-12T18:26:47.889718+0000","last_unstale":"2024-09-12T19:10:33.922523+0000","last_undegraded":"2024-09-12T19:10:33.922523+0000","last_fullsized":"2024-09-12T19:10:33.922523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:51.602872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'249","reported_seq":844,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.430831+0000","last_change":"2024-09-12T18:26:49.913279+0000","last_active":"2024-09-12T19:12:23.430831+0000","last_peered":"2024-09-12T19:12:23.430831+0000","last_clean":"2024-09-12T19:12:23.430831+0000","last_became_active":"2024-09-12T18:26:49.912488+0000","last_became_peered":"2024-09-12T18:26:49.912488+0000","last_unstale":"2024-09-12T19:12:23.430831+0000","last_undegraded":"2024-09-12T19:12:23.430831+0000","last_fullsized":"2024-09-12T19:12:23.430831+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:27.428030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":492,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'918","reported_seq":2678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:00.244376+0000","last_change":"2024-09-12T18:26:41.849621+0000","last_active":"2024-09-12T19:12:00.244376+0000","last_peered":"2024-09-12T19:12:00.244376+0000","last_clean":"2024-09-12T19:12:00.244376+0000","last_became_active":"2024-09-12T18:26:41.847403+0000","last_became_peered":"2024-09-12T18:26:41.847403+0000","last_unstale":"2024-09-12T19:12:00.244376+0000","last_undegraded":"2024-09-12T19:12:00.244376+0000","last_fullsized":"2024-09-12T19:12:00.244376+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:03.076819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4497,"num_read_kb":4050,"num_write":1227,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.891846+0000","last_change":"2024-09-12T18:26:27.491626+0000","last_active":"2024-09-12T19:10:13.891846+0000","last_peered":"2024-09-12T19:10:13.891846+0000","last_clean":"2024-09-12T19:10:13.891846+0000","last_became_active":"2024-09-12T18:26:25.483909+0000","last_became_peered":"2024-09-12T18:26:25.483909+0000","last_unstale":"2024-09-12T19:10:13.891846+0000","last_undegraded":"2024-09-12T19:10:13.891846+0000","last_fullsized":"2024-09-12T19:10:13.891846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:34.647003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002260153,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'246","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:29.074334+0000","last_change":"2024-09-12T18:26:39.847712+0000","last_active":"2024-09-12T19:11:29.074334+0000","last_peered":"2024-09-12T19:11:29.074334+0000","last_clean":"2024-09-12T19:11:29.074334+0000","last_became_active":"2024-09-12T18:26:39.847002+0000","last_became_peered":"2024-09-12T18:26:39.847002+0000","last_unstale":"2024-09-12T19:11:29.074334+0000","last_undegraded":"2024-09-12T19:11:29.074334+0000","last_fullsized":"2024-09-12T19:11:29.074334+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:18.232097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11547385,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":554,"num_read_kb":6223,"num_write":894,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.923800+0000","last_change":"2024-09-12T18:26:43.862162+0000","last_active":"2024-09-12T19:10:38.923800+0000","last_peered":"2024-09-12T19:10:38.923800+0000","last_clean":"2024-09-12T19:10:38.923800+0000","last_became_active":"2024-09-12T18:26:43.861753+0000","last_became_peered":"2024-09-12T18:26:43.861753+0000","last_unstale":"2024-09-12T19:10:38.923800+0000","last_undegraded":"2024-09-12T19:10:38.923800+0000","last_fullsized":"2024-09-12T19:10:38.923800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:33.728113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'111","reported_seq":649,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.724941+0000","last_change":"2024-09-12T18:26:45.857442+0000","last_active":"2024-09-12T19:12:18.724941+0000","last_peered":"2024-09-12T19:12:18.724941+0000","last_clean":"2024-09-12T19:12:18.724941+0000","last_became_active":"2024-09-12T18:26:45.856615+0000","last_became_peered":"2024-09-12T18:26:45.856615+0000","last_unstale":"2024-09-12T19:12:18.724941+0000","last_undegraded":"2024-09-12T19:12:18.724941+0000","last_fullsized":"2024-09-12T19:12:18.724941+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:39.665638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.893516+0000","last_change":"2024-09-12T18:26:47.885794+0000","last_active":"2024-09-12T19:10:08.893516+0000","last_peered":"2024-09-12T19:10:08.893516+0000","last_clean":"2024-09-12T19:10:08.893516+0000","last_became_active":"2024-09-12T18:26:47.884981+0000","last_became_peered":"2024-09-12T18:26:47.884981+0000","last_unstale":"2024-09-12T19:10:08.893516+0000","last_undegraded":"2024-09-12T19:10:08.893516+0000","last_fullsized":"2024-09-12T19:10:08.893516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:07.204617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'140","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.019034+0000","last_change":"2024-09-12T18:26:49.918948+0000","last_active":"2024-09-12T19:13:43.019034+0000","last_peered":"2024-09-12T19:13:43.019034+0000","last_clean":"2024-09-12T19:13:43.019034+0000","last_became_active":"2024-09-12T18:26:49.918043+0000","last_became_peered":"2024-09-12T18:26:49.918043+0000","last_unstale":"2024-09-12T19:13:43.019034+0000","last_undegraded":"2024-09-12T19:13:43.019034+0000","last_fullsized":"2024-09-12T19:13:43.019034+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:07.565002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":258,"num_write":354,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'546","reported_seq":2235,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.289400+0000","last_change":"2024-09-12T18:26:41.878502+0000","last_active":"2024-09-12T19:12:23.289400+0000","last_peered":"2024-09-12T19:12:23.289400+0000","last_clean":"2024-09-12T19:12:23.289400+0000","last_became_active":"2024-09-12T18:26:41.878269+0000","last_became_peered":"2024-09-12T18:26:41.878269+0000","last_unstale":"2024-09-12T19:12:23.289400+0000","last_undegraded":"2024-09-12T19:12:23.289400+0000","last_fullsized":"2024-09-12T19:12:23.289400+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:02.850426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2954,"num_read_kb":2745,"num_write":669,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'402","reported_seq":1095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.897624+0000","last_change":"2024-09-12T18:26:39.853539+0000","last_active":"2024-09-12T19:10:38.897624+0000","last_peered":"2024-09-12T19:10:38.897624+0000","last_clean":"2024-09-12T19:10:38.897624+0000","last_became_active":"2024-09-12T18:26:39.851739+0000","last_became_peered":"2024-09-12T18:26:39.851739+0000","last_unstale":"2024-09-12T19:10:38.897624+0000","last_undegraded":"2024-09-12T19:10:38.897624+0000","last_fullsized":"2024-09-12T19:10:38.897624+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:22.623593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8737309,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":796,"num_read_kb":21229,"num_write":1305,"num_write_kb":18457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:12.904532+0000","last_change":"2024-09-12T18:26:27.492857+0000","last_active":"2024-09-12T19:10:12.904532+0000","last_peered":"2024-09-12T19:10:12.904532+0000","last_clean":"2024-09-12T19:10:12.904532+0000","last_became_active":"2024-09-12T18:26:25.474997+0000","last_became_peered":"2024-09-12T18:26:25.474997+0000","last_unstale":"2024-09-12T19:10:12.904532+0000","last_undegraded":"2024-09-12T19:10:12.904532+0000","last_fullsized":"2024-09-12T19:10:12.904532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:39.276451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099306900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.921024+0000","last_change":"2024-09-12T18:26:43.866505+0000","last_active":"2024-09-12T19:10:28.921024+0000","last_peered":"2024-09-12T19:10:28.921024+0000","last_clean":"2024-09-12T19:10:28.921024+0000","last_became_active":"2024-09-12T18:26:43.865697+0000","last_became_peered":"2024-09-12T18:26:43.865697+0000","last_unstale":"2024-09-12T19:10:28.921024+0000","last_undegraded":"2024-09-12T19:10:28.921024+0000","last_fullsized":"2024-09-12T19:10:28.921024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:41.285586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'542","reported_seq":1197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.959962+0000","last_change":"2024-09-12T18:26:45.880984+0000","last_active":"2024-09-12T19:13:43.959962+0000","last_peered":"2024-09-12T19:13:43.959962+0000","last_clean":"2024-09-12T19:13:43.959962+0000","last_became_active":"2024-09-12T18:26:45.877100+0000","last_became_peered":"2024-09-12T18:26:45.877100+0000","last_unstale":"2024-09-12T19:13:43.959962+0000","last_undegraded":"2024-09-12T19:13:43.959962+0000","last_fullsized":"2024-09-12T19:13:43.959962+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:31.277291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117225,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":926,"num_read_kb":1878,"num_write":804,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:34.105870+0000","last_change":"2024-09-12T18:26:47.900861+0000","last_active":"2024-09-12T19:10:34.105870+0000","last_peered":"2024-09-12T19:10:34.105870+0000","last_clean":"2024-09-12T19:10:34.105870+0000","last_became_active":"2024-09-12T18:26:47.900217+0000","last_became_peered":"2024-09-12T18:26:47.900217+0000","last_unstale":"2024-09-12T19:10:34.105870+0000","last_undegraded":"2024-09-12T19:10:34.105870+0000","last_fullsized":"2024-09-12T19:10:34.105870+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:22.630784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'141","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.613946+0000","last_change":"2024-09-12T18:26:49.921916+0000","last_active":"2024-09-12T19:12:18.613946+0000","last_peered":"2024-09-12T19:12:18.613946+0000","last_clean":"2024-09-12T19:12:18.613946+0000","last_became_active":"2024-09-12T18:26:49.921123+0000","last_became_peered":"2024-09-12T18:26:49.921123+0000","last_unstale":"2024-09-12T19:12:18.613946+0000","last_undegraded":"2024-09-12T19:12:18.613946+0000","last_fullsized":"2024-09-12T19:12:18.613946+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:45.398942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":212,"num_read_kb":188,"num_write":350,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'425","reported_seq":1878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.623418+0000","last_change":"2024-09-12T18:26:41.869757+0000","last_active":"2024-09-12T19:12:18.623418+0000","last_peered":"2024-09-12T19:12:18.623418+0000","last_clean":"2024-09-12T19:12:18.623418+0000","last_became_active":"2024-09-12T18:26:41.869426+0000","last_became_peered":"2024-09-12T18:26:41.869426+0000","last_unstale":"2024-09-12T19:12:18.623418+0000","last_undegraded":"2024-09-12T19:12:18.623418+0000","last_fullsized":"2024-09-12T19:12:18.623418+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:16.916527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2246,"num_read_kb":2097,"num_write":505,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'332","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.701512+0000","last_change":"2024-09-12T18:26:39.833175+0000","last_active":"2024-09-12T19:13:57.701512+0000","last_peered":"2024-09-12T19:13:57.701512+0000","last_clean":"2024-09-12T19:13:57.701512+0000","last_became_active":"2024-09-12T18:26:39.832593+0000","last_became_peered":"2024-09-12T18:26:39.832593+0000","last_unstale":"2024-09-12T19:13:57.701512+0000","last_undegraded":"2024-09-12T19:13:57.701512+0000","last_fullsized":"2024-09-12T19:13:57.701512+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:39.366882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6812624,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":611,"num_read_kb":23528,"num_write":1181,"num_write_kb":24783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899815+0000","last_change":"2024-09-12T18:26:28.282666+0000","last_active":"2024-09-12T19:10:22.899815+0000","last_peered":"2024-09-12T19:10:22.899815+0000","last_clean":"2024-09-12T19:10:22.899815+0000","last_became_active":"2024-09-12T18:26:25.484938+0000","last_became_peered":"2024-09-12T18:26:25.484938+0000","last_unstale":"2024-09-12T19:10:22.899815+0000","last_undegraded":"2024-09-12T19:10:22.899815+0000","last_fullsized":"2024-09-12T19:10:22.899815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:50.645807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001083194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.898070+0000","last_change":"2024-09-12T18:26:43.864066+0000","last_active":"2024-09-12T19:10:28.898070+0000","last_peered":"2024-09-12T19:10:28.898070+0000","last_clean":"2024-09-12T19:10:28.898070+0000","last_became_active":"2024-09-12T18:26:43.863388+0000","last_became_peered":"2024-09-12T18:26:43.863388+0000","last_unstale":"2024-09-12T19:10:28.898070+0000","last_undegraded":"2024-09-12T19:10:28.898070+0000","last_fullsized":"2024-09-12T19:10:28.898070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:19.436463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'160","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:15.347431+0000","last_change":"2024-09-12T18:26:46.020793+0000","last_active":"2024-09-12T19:11:15.347431+0000","last_peered":"2024-09-12T19:11:15.347431+0000","last_clean":"2024-09-12T19:11:15.347431+0000","last_became_active":"2024-09-12T18:26:46.020043+0000","last_became_peered":"2024-09-12T18:26:46.020043+0000","last_unstale":"2024-09-12T19:11:15.347431+0000","last_undegraded":"2024-09-12T19:11:15.347431+0000","last_fullsized":"2024-09-12T19:11:15.347431+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:28.384889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":189,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'811","reported_seq":2654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.020813+0000","last_change":"2024-09-12T18:26:47.880379+0000","last_active":"2024-09-12T19:13:44.020813+0000","last_peered":"2024-09-12T19:13:44.020813+0000","last_clean":"2024-09-12T19:13:44.020813+0000","last_became_active":"2024-09-12T18:26:47.879630+0000","last_became_peered":"2024-09-12T18:26:47.879630+0000","last_unstale":"2024-09-12T19:13:44.020813+0000","last_undegraded":"2024-09-12T19:13:44.020813+0000","last_fullsized":"2024-09-12T19:13:44.020813+0000","mapping_epoch":32,"log_start":"265'800","ondisk_log_start":"265'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:34.644082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'140","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.115335+0000","last_change":"2024-09-12T18:26:49.920666+0000","last_active":"2024-09-12T19:12:24.115335+0000","last_peered":"2024-09-12T19:12:24.115335+0000","last_clean":"2024-09-12T19:12:24.115335+0000","last_became_active":"2024-09-12T18:26:49.919846+0000","last_became_peered":"2024-09-12T18:26:49.919846+0000","last_unstale":"2024-09-12T19:12:24.115335+0000","last_undegraded":"2024-09-12T19:12:24.115335+0000","last_fullsized":"2024-09-12T19:12:24.115335+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:00.339860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":263,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'481","reported_seq":2008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.125760+0000","last_change":"2024-09-12T18:26:41.862442+0000","last_active":"2024-09-12T19:12:24.125760+0000","last_peered":"2024-09-12T19:12:24.125760+0000","last_clean":"2024-09-12T19:12:24.125760+0000","last_became_active":"2024-09-12T18:26:41.862008+0000","last_became_peered":"2024-09-12T18:26:41.862008+0000","last_unstale":"2024-09-12T19:12:24.125760+0000","last_undegraded":"2024-09-12T19:12:24.125760+0000","last_fullsized":"2024-09-12T19:12:24.125760+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:52.293333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":2263,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'276","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:21.671305+0000","last_change":"2024-09-12T18:26:39.865325+0000","last_active":"2024-09-12T19:11:21.671305+0000","last_peered":"2024-09-12T19:11:21.671305+0000","last_clean":"2024-09-12T19:11:21.671305+0000","last_became_active":"2024-09-12T18:26:39.865123+0000","last_became_peered":"2024-09-12T18:26:39.865123+0000","last_unstale":"2024-09-12T19:11:21.671305+0000","last_undegraded":"2024-09-12T19:11:21.671305+0000","last_fullsized":"2024-09-12T19:11:21.671305+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:13.963084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9783150,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":415,"num_read_kb":68443,"num_write":1020,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:47.898557+0000","last_change":"2024-09-12T18:26:27.493293+0000","last_active":"2024-09-12T19:09:47.898557+0000","last_peered":"2024-09-12T19:09:47.898557+0000","last_clean":"2024-09-12T19:09:47.898557+0000","last_became_active":"2024-09-12T18:26:25.485137+0000","last_became_peered":"2024-09-12T18:26:25.485137+0000","last_unstale":"2024-09-12T19:09:47.898557+0000","last_undegraded":"2024-09-12T19:09:47.898557+0000","last_fullsized":"2024-09-12T19:09:47.898557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:37.081707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013350759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:29.104750+0000","last_change":"2024-09-12T18:26:43.876064+0000","last_active":"2024-09-12T19:10:29.104750+0000","last_peered":"2024-09-12T19:10:29.104750+0000","last_clean":"2024-09-12T19:10:29.104750+0000","last_became_active":"2024-09-12T18:26:43.874845+0000","last_became_peered":"2024-09-12T18:26:43.874845+0000","last_unstale":"2024-09-12T19:10:29.104750+0000","last_undegraded":"2024-09-12T19:10:29.104750+0000","last_fullsized":"2024-09-12T19:10:29.104750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:36.440895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'106","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.584442+0000","last_change":"2024-09-12T18:26:45.864296+0000","last_active":"2024-09-12T19:11:07.584442+0000","last_peered":"2024-09-12T19:11:07.584442+0000","last_clean":"2024-09-12T19:11:07.584442+0000","last_became_active":"2024-09-12T18:26:45.863254+0000","last_became_peered":"2024-09-12T18:26:45.863254+0000","last_unstale":"2024-09-12T19:11:07.584442+0000","last_undegraded":"2024-09-12T19:11:07.584442+0000","last_fullsized":"2024-09-12T19:11:07.584442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:25.709734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'802","reported_seq":2516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.027653+0000","last_change":"2024-09-12T18:26:47.900388+0000","last_active":"2024-09-12T19:13:44.027653+0000","last_peered":"2024-09-12T19:13:44.027653+0000","last_clean":"2024-09-12T19:13:44.027653+0000","last_became_active":"2024-09-12T18:26:47.899682+0000","last_became_peered":"2024-09-12T18:26:47.899682+0000","last_unstale":"2024-09-12T19:13:44.027653+0000","last_undegraded":"2024-09-12T19:13:44.027653+0000","last_fullsized":"2024-09-12T19:13:44.027653+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:26.128123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'166","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.560824+0000","last_change":"2024-09-12T18:26:49.918711+0000","last_active":"2024-09-12T19:12:06.560824+0000","last_peered":"2024-09-12T19:12:06.560824+0000","last_clean":"2024-09-12T19:12:06.560824+0000","last_became_active":"2024-09-12T18:26:49.917537+0000","last_became_peered":"2024-09-12T18:26:49.917537+0000","last_unstale":"2024-09-12T19:12:06.560824+0000","last_undegraded":"2024-09-12T19:12:06.560824+0000","last_fullsized":"2024-09-12T19:12:06.560824+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:42.696961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":124,"num_write":364,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'443","reported_seq":1936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.769155+0000","last_change":"2024-09-12T18:26:41.872406+0000","last_active":"2024-09-12T19:12:08.769155+0000","last_peered":"2024-09-12T19:12:08.769155+0000","last_clean":"2024-09-12T19:12:08.769155+0000","last_became_active":"2024-09-12T18:26:41.871518+0000","last_became_peered":"2024-09-12T18:26:41.871518+0000","last_unstale":"2024-09-12T19:12:08.769155+0000","last_undegraded":"2024-09-12T19:12:08.769155+0000","last_fullsized":"2024-09-12T19:12:08.769155+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:26.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2145,"num_write":516,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'246","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:36.603533+0000","last_change":"2024-09-12T18:26:39.834460+0000","last_active":"2024-09-12T19:13:36.603533+0000","last_peered":"2024-09-12T19:13:36.603533+0000","last_clean":"2024-09-12T19:13:36.603533+0000","last_became_active":"2024-09-12T18:26:39.833924+0000","last_became_peered":"2024-09-12T18:26:39.833924+0000","last_unstale":"2024-09-12T19:13:36.603533+0000","last_undegraded":"2024-09-12T19:13:36.603533+0000","last_fullsized":"2024-09-12T19:13:36.603533+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:19.120900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21176942,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":411,"num_read_kb":59967,"num_write":947,"num_write_kb":34278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.888730+0000","last_change":"2024-09-12T18:26:27.699071+0000","last_active":"2024-09-12T19:09:48.888730+0000","last_peered":"2024-09-12T19:09:48.888730+0000","last_clean":"2024-09-12T19:09:48.888730+0000","last_became_active":"2024-09-12T18:26:25.487465+0000","last_became_peered":"2024-09-12T18:26:25.487465+0000","last_unstale":"2024-09-12T19:09:48.888730+0000","last_undegraded":"2024-09-12T19:09:48.888730+0000","last_fullsized":"2024-09-12T19:09:48.888730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:22.342394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010368949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.924444+0000","last_change":"2024-09-12T18:26:43.851056+0000","last_active":"2024-09-12T19:10:48.924444+0000","last_peered":"2024-09-12T19:10:48.924444+0000","last_clean":"2024-09-12T19:10:48.924444+0000","last_became_active":"2024-09-12T18:26:43.850274+0000","last_became_peered":"2024-09-12T18:26:43.850274+0000","last_unstale":"2024-09-12T19:10:48.924444+0000","last_undegraded":"2024-09-12T19:10:48.924444+0000","last_fullsized":"2024-09-12T19:10:48.924444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:39.140912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'713","reported_seq":1417,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.172805+0000","last_change":"2024-09-12T18:26:46.021959+0000","last_active":"2024-09-12T19:13:57.172805+0000","last_peered":"2024-09-12T19:13:57.172805+0000","last_clean":"2024-09-12T19:13:57.172805+0000","last_became_active":"2024-09-12T18:26:46.021217+0000","last_became_peered":"2024-09-12T18:26:46.021217+0000","last_unstale":"2024-09-12T19:13:57.172805+0000","last_undegraded":"2024-09-12T19:13:57.172805+0000","last_fullsized":"2024-09-12T19:13:57.172805+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:41.193709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200250,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1278,"num_read_kb":2908,"num_write":1052,"num_write_kb":915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.920778+0000","last_change":"2024-09-12T18:26:47.903443+0000","last_active":"2024-09-12T19:10:33.920778+0000","last_peered":"2024-09-12T19:10:33.920778+0000","last_clean":"2024-09-12T19:10:33.920778+0000","last_became_active":"2024-09-12T18:26:47.902750+0000","last_became_peered":"2024-09-12T18:26:47.902750+0000","last_unstale":"2024-09-12T19:10:33.920778+0000","last_undegraded":"2024-09-12T19:10:33.920778+0000","last_fullsized":"2024-09-12T19:10:33.920778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:44.433901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'107","reported_seq":606,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:06.951330+0000","last_change":"2024-09-12T18:26:49.920307+0000","last_active":"2024-09-12T19:11:06.951330+0000","last_peered":"2024-09-12T19:11:06.951330+0000","last_clean":"2024-09-12T19:11:06.951330+0000","last_became_active":"2024-09-12T18:26:49.919630+0000","last_became_peered":"2024-09-12T18:26:49.919630+0000","last_unstale":"2024-09-12T19:11:06.951330+0000","last_undegraded":"2024-09-12T19:11:06.951330+0000","last_fullsized":"2024-09-12T19:11:06.951330+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:18.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":269,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'143","reported_seq":705,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.274239+0000","last_change":"2024-09-12T18:26:49.913310+0000","last_active":"2024-09-12T19:12:24.274239+0000","last_peered":"2024-09-12T19:12:24.274239+0000","last_clean":"2024-09-12T19:12:24.274239+0000","last_became_active":"2024-09-12T18:26:49.912589+0000","last_became_peered":"2024-09-12T18:26:49.912589+0000","last_unstale":"2024-09-12T19:12:24.274239+0000","last_undegraded":"2024-09-12T19:12:24.274239+0000","last_fullsized":"2024-09-12T19:12:24.274239+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:07.282432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":221,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'913","reported_seq":2534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.894035+0000","last_change":"2024-09-12T18:26:41.876618+0000","last_active":"2024-09-12T19:12:07.894035+0000","last_peered":"2024-09-12T19:12:07.894035+0000","last_clean":"2024-09-12T19:12:07.894035+0000","last_became_active":"2024-09-12T18:26:41.875870+0000","last_became_peered":"2024-09-12T18:26:41.875870+0000","last_unstale":"2024-09-12T19:12:07.894035+0000","last_undegraded":"2024-09-12T19:12:07.894035+0000","last_fullsized":"2024-09-12T19:12:07.894035+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:06.713897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4445,"num_read_kb":3959,"num_write":1252,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'247","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:19.876577+0000","last_change":"2024-09-12T18:26:39.871102+0000","last_active":"2024-09-12T19:12:19.876577+0000","last_peered":"2024-09-12T19:12:19.876577+0000","last_clean":"2024-09-12T19:12:19.876577+0000","last_became_active":"2024-09-12T18:26:39.870576+0000","last_became_peered":"2024-09-12T18:26:39.870576+0000","last_unstale":"2024-09-12T19:12:19.876577+0000","last_undegraded":"2024-09-12T19:12:19.876577+0000","last_fullsized":"2024-09-12T19:12:19.876577+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:00.119644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14281508,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":389,"num_read_kb":31608,"num_write":858,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.917883+0000","last_change":"2024-09-12T18:26:43.865954+0000","last_active":"2024-09-12T19:11:07.917883+0000","last_peered":"2024-09-12T19:11:07.917883+0000","last_clean":"2024-09-12T19:11:07.917883+0000","last_became_active":"2024-09-12T18:26:43.864969+0000","last_became_peered":"2024-09-12T18:26:43.864969+0000","last_unstale":"2024-09-12T19:11:07.917883+0000","last_undegraded":"2024-09-12T19:11:07.917883+0000","last_fullsized":"2024-09-12T19:11:07.917883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:54.874241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'271","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:28.737857+0000","last_change":"2024-09-12T18:26:45.866194+0000","last_active":"2024-09-12T19:13:28.737857+0000","last_peered":"2024-09-12T19:13:28.737857+0000","last_clean":"2024-09-12T19:13:28.737857+0000","last_became_active":"2024-09-12T18:26:45.865329+0000","last_became_peered":"2024-09-12T18:26:45.865329+0000","last_unstale":"2024-09-12T19:13:28.737857+0000","last_undegraded":"2024-09-12T19:13:28.737857+0000","last_fullsized":"2024-09-12T19:13:28.737857+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:49.534078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59089,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":960,"num_write":376,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.929904+0000","last_change":"2024-09-12T18:26:47.891460+0000","last_active":"2024-09-12T19:11:08.929904+0000","last_peered":"2024-09-12T19:11:08.929904+0000","last_clean":"2024-09-12T19:11:08.929904+0000","last_became_active":"2024-09-12T18:26:47.890741+0000","last_became_peered":"2024-09-12T18:26:47.890741+0000","last_unstale":"2024-09-12T19:11:08.929904+0000","last_undegraded":"2024-09-12T19:11:08.929904+0000","last_fullsized":"2024-09-12T19:11:08.929904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:13.839409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'196","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.440206+0000","last_change":"2024-09-12T18:26:49.915054+0000","last_active":"2024-09-12T19:11:38.440206+0000","last_peered":"2024-09-12T19:11:38.440206+0000","last_clean":"2024-09-12T19:11:38.440206+0000","last_became_active":"2024-09-12T18:26:49.914506+0000","last_became_peered":"2024-09-12T18:26:49.914506+0000","last_unstale":"2024-09-12T19:11:38.440206+0000","last_undegraded":"2024-09-12T19:11:38.440206+0000","last_fullsized":"2024-09-12T19:11:38.440206+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:39.521599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":157,"num_write":456,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'900","reported_seq":2436,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.125291+0000","last_change":"2024-09-12T18:26:41.868353+0000","last_active":"2024-09-12T19:12:24.125291+0000","last_peered":"2024-09-12T19:12:24.125291+0000","last_clean":"2024-09-12T19:12:24.125291+0000","last_became_active":"2024-09-12T18:26:41.868082+0000","last_became_peered":"2024-09-12T18:26:41.868082+0000","last_unstale":"2024-09-12T19:12:24.125291+0000","last_undegraded":"2024-09-12T19:12:24.125291+0000","last_fullsized":"2024-09-12T19:12:24.125291+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:35.031358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4276,"num_read_kb":3807,"num_write":1253,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'357","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.935546+0000","last_change":"2024-09-12T18:26:39.870444+0000","last_active":"2024-09-12T19:13:57.935546+0000","last_peered":"2024-09-12T19:13:57.935546+0000","last_clean":"2024-09-12T19:13:57.935546+0000","last_became_active":"2024-09-12T18:26:39.869754+0000","last_became_peered":"2024-09-12T18:26:39.869754+0000","last_unstale":"2024-09-12T19:13:57.935546+0000","last_undegraded":"2024-09-12T19:13:57.935546+0000","last_fullsized":"2024-09-12T19:13:57.935546+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:26.428249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7093992,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":495,"num_read_kb":32033,"num_write":1196,"num_write_kb":47606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"36'5","reported_seq":973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.871279+0000","last_change":"2024-09-12T18:26:43.854895+0000","last_active":"2024-09-12T19:13:43.871279+0000","last_peered":"2024-09-12T19:13:43.871279+0000","last_clean":"2024-09-12T19:13:43.871279+0000","last_became_active":"2024-09-12T18:26:43.854155+0000","last_became_peered":"2024-09-12T18:26:43.854155+0000","last_unstale":"2024-09-12T19:13:43.871279+0000","last_undegraded":"2024-09-12T19:13:43.871279+0000","last_fullsized":"2024-09-12T19:13:43.871279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:39.758296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'67","reported_seq":571,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.295664+0000","last_change":"2024-09-12T18:26:45.880353+0000","last_active":"2024-09-12T19:12:23.295664+0000","last_peered":"2024-09-12T19:12:23.295664+0000","last_clean":"2024-09-12T19:12:23.295664+0000","last_became_active":"2024-09-12T18:26:45.876785+0000","last_became_peered":"2024-09-12T18:26:45.876785+0000","last_unstale":"2024-09-12T19:12:23.295664+0000","last_undegraded":"2024-09-12T19:12:23.295664+0000","last_fullsized":"2024-09-12T19:12:23.295664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:44.259605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910233+0000","last_change":"2024-09-12T18:26:47.891685+0000","last_active":"2024-09-12T19:11:07.910233+0000","last_peered":"2024-09-12T19:11:07.910233+0000","last_clean":"2024-09-12T19:11:07.910233+0000","last_became_active":"2024-09-12T18:26:47.890879+0000","last_became_peered":"2024-09-12T18:26:47.890879+0000","last_unstale":"2024-09-12T19:11:07.910233+0000","last_undegraded":"2024-09-12T19:11:07.910233+0000","last_fullsized":"2024-09-12T19:11:07.910233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:38.226570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'240","reported_seq":768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.263121+0000","last_change":"2024-09-12T18:26:49.926668+0000","last_active":"2024-09-12T19:12:23.263121+0000","last_peered":"2024-09-12T19:12:23.263121+0000","last_clean":"2024-09-12T19:12:23.263121+0000","last_became_active":"2024-09-12T18:26:49.925984+0000","last_became_peered":"2024-09-12T18:26:49.925984+0000","last_unstale":"2024-09-12T19:12:23.263121+0000","last_undegraded":"2024-09-12T19:12:23.263121+0000","last_fullsized":"2024-09-12T19:12:23.263121+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:41.544032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":350,"num_read_kb":337,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'459","reported_seq":2018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.554179+0000","last_change":"2024-09-12T18:26:41.882252+0000","last_active":"2024-09-12T19:12:09.554179+0000","last_peered":"2024-09-12T19:12:09.554179+0000","last_clean":"2024-09-12T19:12:09.554179+0000","last_became_active":"2024-09-12T18:26:41.881971+0000","last_became_peered":"2024-09-12T18:26:41.881971+0000","last_unstale":"2024-09-12T19:12:09.554179+0000","last_undegraded":"2024-09-12T19:12:09.554179+0000","last_fullsized":"2024-09-12T19:12:09.554179+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:07.504109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2569,"num_read_kb":2413,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'279","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.960344+0000","last_change":"2024-09-12T18:26:39.874319+0000","last_active":"2024-09-12T19:12:08.960344+0000","last_peered":"2024-09-12T19:12:08.960344+0000","last_clean":"2024-09-12T19:12:08.960344+0000","last_became_active":"2024-09-12T18:26:39.873510+0000","last_became_peered":"2024-09-12T18:26:39.873510+0000","last_unstale":"2024-09-12T19:12:08.960344+0000","last_undegraded":"2024-09-12T19:12:08.960344+0000","last_fullsized":"2024-09-12T19:12:08.960344+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:47.297748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2207284,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":450,"num_read_kb":9365,"num_write":1066,"num_write_kb":22463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910172+0000","last_change":"2024-09-12T18:26:43.860596+0000","last_active":"2024-09-12T19:11:07.910172+0000","last_peered":"2024-09-12T19:11:07.910172+0000","last_clean":"2024-09-12T19:11:07.910172+0000","last_became_active":"2024-09-12T18:26:43.859847+0000","last_became_peered":"2024-09-12T18:26:43.859847+0000","last_unstale":"2024-09-12T19:11:07.910172+0000","last_undegraded":"2024-09-12T19:11:07.910172+0000","last_fullsized":"2024-09-12T19:11:07.910172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:16.685561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'313","reported_seq":896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:28.737941+0000","last_change":"2024-09-12T18:26:45.878384+0000","last_active":"2024-09-12T19:13:28.737941+0000","last_peered":"2024-09-12T19:13:28.737941+0000","last_clean":"2024-09-12T19:13:28.737941+0000","last_became_active":"2024-09-12T18:26:45.877790+0000","last_became_peered":"2024-09-12T18:26:45.877790+0000","last_unstale":"2024-09-12T19:13:28.737941+0000","last_undegraded":"2024-09-12T19:13:28.737941+0000","last_fullsized":"2024-09-12T19:13:28.737941+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:03.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62852,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":507,"num_read_kb":1028,"num_write":412,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.906698+0000","last_change":"2024-09-12T18:26:47.888972+0000","last_active":"2024-09-12T19:11:08.906698+0000","last_peered":"2024-09-12T19:11:08.906698+0000","last_clean":"2024-09-12T19:11:08.906698+0000","last_became_active":"2024-09-12T18:26:47.888252+0000","last_became_peered":"2024-09-12T18:26:47.888252+0000","last_unstale":"2024-09-12T19:11:08.906698+0000","last_undegraded":"2024-09-12T19:11:08.906698+0000","last_fullsized":"2024-09-12T19:11:08.906698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:23.691736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'144","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.914495+0000","last_change":"2024-09-12T18:26:49.923128+0000","last_active":"2024-09-12T19:11:19.914495+0000","last_peered":"2024-09-12T19:11:19.914495+0000","last_clean":"2024-09-12T19:11:19.914495+0000","last_became_active":"2024-09-12T18:26:49.922459+0000","last_became_peered":"2024-09-12T18:26:49.922459+0000","last_unstale":"2024-09-12T19:11:19.914495+0000","last_undegraded":"2024-09-12T19:11:19.914495+0000","last_fullsized":"2024-09-12T19:11:19.914495+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:13.475689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":460,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":153,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'471","reported_seq":1980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.622655+0000","last_change":"2024-09-12T18:26:41.851184+0000","last_active":"2024-09-12T19:12:18.622655+0000","last_peered":"2024-09-12T19:12:18.622655+0000","last_clean":"2024-09-12T19:12:18.622655+0000","last_became_active":"2024-09-12T18:26:41.850749+0000","last_became_peered":"2024-09-12T18:26:41.850749+0000","last_unstale":"2024-09-12T19:12:18.622655+0000","last_undegraded":"2024-09-12T19:12:18.622655+0000","last_fullsized":"2024-09-12T19:12:18.622655+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:25.945669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2503,"num_read_kb":2331,"num_write":575,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'323","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.197323+0000","last_change":"2024-09-12T18:26:39.854610+0000","last_active":"2024-09-12T19:12:08.197323+0000","last_peered":"2024-09-12T19:12:08.197323+0000","last_clean":"2024-09-12T19:12:08.197323+0000","last_became_active":"2024-09-12T18:26:39.854328+0000","last_became_peered":"2024-09-12T18:26:39.854328+0000","last_unstale":"2024-09-12T19:12:08.197323+0000","last_undegraded":"2024-09-12T19:12:08.197323+0000","last_fullsized":"2024-09-12T19:12:08.197323+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:21.829716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7968455,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":515,"num_read_kb":9662,"num_write":1178,"num_write_kb":35097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.905457+0000","last_change":"2024-09-12T18:26:43.866117+0000","last_active":"2024-09-12T19:11:03.905457+0000","last_peered":"2024-09-12T19:11:03.905457+0000","last_clean":"2024-09-12T19:11:03.905457+0000","last_became_active":"2024-09-12T18:26:43.865454+0000","last_became_peered":"2024-09-12T18:26:43.865454+0000","last_unstale":"2024-09-12T19:11:03.905457+0000","last_undegraded":"2024-09-12T19:11:03.905457+0000","last_fullsized":"2024-09-12T19:11:03.905457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:55.077443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'243","reported_seq":802,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.949398+0000","last_change":"2024-09-12T18:26:45.867830+0000","last_active":"2024-09-12T19:13:43.949398+0000","last_peered":"2024-09-12T19:13:43.949398+0000","last_clean":"2024-09-12T19:13:43.949398+0000","last_became_active":"2024-09-12T18:26:45.867096+0000","last_became_peered":"2024-09-12T18:26:45.867096+0000","last_unstale":"2024-09-12T19:13:43.949398+0000","last_undegraded":"2024-09-12T19:13:43.949398+0000","last_fullsized":"2024-09-12T19:13:43.949398+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.958792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53974,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":399,"num_read_kb":841,"num_write":324,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.932045+0000","last_change":"2024-09-12T18:26:47.895791+0000","last_active":"2024-09-12T19:11:08.932045+0000","last_peered":"2024-09-12T19:11:08.932045+0000","last_clean":"2024-09-12T19:11:08.932045+0000","last_became_active":"2024-09-12T18:26:47.895092+0000","last_became_peered":"2024-09-12T18:26:47.895092+0000","last_unstale":"2024-09-12T19:11:08.932045+0000","last_undegraded":"2024-09-12T19:11:08.932045+0000","last_fullsized":"2024-09-12T19:11:08.932045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:05.232441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'821","reported_seq":2419,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.207286+0000","last_change":"2024-09-12T18:26:41.872671+0000","last_active":"2024-09-12T19:11:58.207286+0000","last_peered":"2024-09-12T19:11:58.207286+0000","last_clean":"2024-09-12T19:11:58.207286+0000","last_became_active":"2024-09-12T18:26:41.871943+0000","last_became_peered":"2024-09-12T18:26:41.871943+0000","last_unstale":"2024-09-12T19:11:58.207286+0000","last_undegraded":"2024-09-12T19:11:58.207286+0000","last_fullsized":"2024-09-12T19:11:58.207286+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:15.536437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3898,"num_read_kb":3510,"num_write":1047,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'313","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.758972+0000","last_change":"2024-09-12T18:26:39.831302+0000","last_active":"2024-09-12T19:12:09.758972+0000","last_peered":"2024-09-12T19:12:09.758972+0000","last_clean":"2024-09-12T19:12:09.758972+0000","last_became_active":"2024-09-12T18:26:39.830963+0000","last_became_peered":"2024-09-12T18:26:39.830963+0000","last_unstale":"2024-09-12T19:12:09.758972+0000","last_undegraded":"2024-09-12T19:12:09.758972+0000","last_fullsized":"2024-09-12T19:12:09.758972+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:33.362610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11355684,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":552,"num_read_kb":35487,"num_write":1202,"num_write_kb":27084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:53.927546+0000","last_change":"2024-09-12T18:26:43.861948+0000","last_active":"2024-09-12T19:10:53.927546+0000","last_peered":"2024-09-12T19:10:53.927546+0000","last_clean":"2024-09-12T19:10:53.927546+0000","last_became_active":"2024-09-12T18:26:43.861521+0000","last_became_peered":"2024-09-12T18:26:43.861521+0000","last_unstale":"2024-09-12T19:10:53.927546+0000","last_undegraded":"2024-09-12T19:10:53.927546+0000","last_fullsized":"2024-09-12T19:10:53.927546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:00.161505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'443","reported_seq":1067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.736780+0000","last_change":"2024-09-12T18:26:45.873087+0000","last_active":"2024-09-12T19:13:57.736780+0000","last_peered":"2024-09-12T19:13:57.736780+0000","last_clean":"2024-09-12T19:13:57.736780+0000","last_became_active":"2024-09-12T18:26:45.872177+0000","last_became_peered":"2024-09-12T18:26:45.872177+0000","last_unstale":"2024-09-12T19:13:57.736780+0000","last_undegraded":"2024-09-12T19:13:57.736780+0000","last_fullsized":"2024-09-12T19:13:57.736780+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:14.142703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110720,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":798,"num_read_kb":1755,"num_write":687,"num_write_kb":615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.879188+0000","last_change":"2024-09-12T18:26:47.903167+0000","last_active":"2024-09-12T19:09:18.879188+0000","last_peered":"2024-09-12T19:09:18.879188+0000","last_clean":"2024-09-12T19:09:18.879188+0000","last_became_active":"2024-09-12T18:26:47.902702+0000","last_became_peered":"2024-09-12T18:26:47.902702+0000","last_unstale":"2024-09-12T19:09:18.879188+0000","last_undegraded":"2024-09-12T19:09:18.879188+0000","last_fullsized":"2024-09-12T19:09:18.879188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:58.910571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'188","reported_seq":695,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.315741+0000","last_change":"2024-09-12T18:26:49.920882+0000","last_active":"2024-09-12T19:12:23.315741+0000","last_peered":"2024-09-12T19:12:23.315741+0000","last_clean":"2024-09-12T19:12:23.315741+0000","last_became_active":"2024-09-12T18:26:49.920066+0000","last_became_peered":"2024-09-12T18:26:49.920066+0000","last_unstale":"2024-09-12T19:12:23.315741+0000","last_undegraded":"2024-09-12T19:12:23.315741+0000","last_fullsized":"2024-09-12T19:12:23.315741+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:38.018526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":247,"num_read_kb":248,"num_write":459,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'764","reported_seq":2241,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:04.036663+0000","last_change":"2024-09-12T18:26:41.853638+0000","last_active":"2024-09-12T19:12:04.036663+0000","last_peered":"2024-09-12T19:12:04.036663+0000","last_clean":"2024-09-12T19:12:04.036663+0000","last_became_active":"2024-09-12T18:26:41.852157+0000","last_became_peered":"2024-09-12T18:26:41.852157+0000","last_unstale":"2024-09-12T19:12:04.036663+0000","last_undegraded":"2024-09-12T19:12:04.036663+0000","last_fullsized":"2024-09-12T19:12:04.036663+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:07.965311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3590,"num_read_kb":3230,"num_write":1002,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'318","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.707485+0000","last_change":"2024-09-12T18:27:11.827995+0000","last_active":"2024-09-12T19:13:57.707485+0000","last_peered":"2024-09-12T19:13:57.707485+0000","last_clean":"2024-09-12T19:13:57.707485+0000","last_became_active":"2024-09-12T18:27:11.827218+0000","last_became_peered":"2024-09-12T18:27:11.827218+0000","last_unstale":"2024-09-12T19:13:57.707485+0000","last_undegraded":"2024-09-12T19:13:57.707485+0000","last_fullsized":"2024-09-12T19:13:57.707485+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:06.201837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120630,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":457,"num_read_kb":7362,"num_write":1123,"num_write_kb":18791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.898175+0000","last_change":"2024-09-12T18:26:43.866082+0000","last_active":"2024-09-12T19:10:28.898175+0000","last_peered":"2024-09-12T19:10:28.898175+0000","last_clean":"2024-09-12T19:10:28.898175+0000","last_became_active":"2024-09-12T18:26:43.865319+0000","last_became_peered":"2024-09-12T18:26:43.865319+0000","last_unstale":"2024-09-12T19:10:28.898175+0000","last_undegraded":"2024-09-12T19:10:28.898175+0000","last_fullsized":"2024-09-12T19:10:28.898175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:34.611869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'293","reported_seq":865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.952948+0000","last_change":"2024-09-12T18:26:45.874050+0000","last_active":"2024-09-12T19:13:43.952948+0000","last_peered":"2024-09-12T19:13:43.952948+0000","last_clean":"2024-09-12T19:13:43.952948+0000","last_became_active":"2024-09-12T18:26:45.873197+0000","last_became_peered":"2024-09-12T18:26:45.873197+0000","last_unstale":"2024-09-12T19:13:43.952948+0000","last_undegraded":"2024-09-12T19:13:43.952948+0000","last_fullsized":"2024-09-12T19:13:43.952948+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:01.225799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61026,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":471,"num_read_kb":936,"num_write":396,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:17.891370+0000","last_change":"2024-09-12T18:26:47.884995+0000","last_active":"2024-09-12T19:09:17.891370+0000","last_peered":"2024-09-12T19:09:17.891370+0000","last_clean":"2024-09-12T19:09:17.891370+0000","last_became_active":"2024-09-12T18:26:47.883930+0000","last_became_peered":"2024-09-12T18:26:47.883930+0000","last_unstale":"2024-09-12T19:09:17.891370+0000","last_undegraded":"2024-09-12T19:09:17.891370+0000","last_fullsized":"2024-09-12T19:09:17.891370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:45.633573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'180","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.119927+0000","last_change":"2024-09-12T18:26:49.922518+0000","last_active":"2024-09-12T19:12:24.119927+0000","last_peered":"2024-09-12T19:12:24.119927+0000","last_clean":"2024-09-12T19:12:24.119927+0000","last_became_active":"2024-09-12T18:26:49.921797+0000","last_became_peered":"2024-09-12T18:26:49.921797+0000","last_unstale":"2024-09-12T19:12:24.119927+0000","last_undegraded":"2024-09-12T19:12:24.119927+0000","last_fullsized":"2024-09-12T19:12:24.119927+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:13.451147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1230,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":213,"num_write":519,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'508","reported_seq":1855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.603092+0000","last_change":"2024-09-12T18:26:41.851238+0000","last_active":"2024-09-12T19:12:06.603092+0000","last_peered":"2024-09-12T19:12:06.603092+0000","last_clean":"2024-09-12T19:12:06.603092+0000","last_became_active":"2024-09-12T18:26:41.850647+0000","last_became_peered":"2024-09-12T18:26:41.850647+0000","last_unstale":"2024-09-12T19:12:06.603092+0000","last_undegraded":"2024-09-12T19:12:06.603092+0000","last_fullsized":"2024-09-12T19:12:06.603092+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:45.957699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2444,"num_write":714,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'295","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.595014+0000","last_change":"2024-09-12T18:26:39.842569+0000","last_active":"2024-09-12T19:11:43.595014+0000","last_peered":"2024-09-12T19:11:43.595014+0000","last_clean":"2024-09-12T19:11:43.595014+0000","last_became_active":"2024-09-12T18:26:39.840458+0000","last_became_peered":"2024-09-12T18:26:39.840458+0000","last_unstale":"2024-09-12T19:11:43.595014+0000","last_undegraded":"2024-09-12T19:11:43.595014+0000","last_fullsized":"2024-09-12T19:11:43.595014+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:05.706995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2236055,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":421,"num_read_kb":36099,"num_write":1048,"num_write_kb":45658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:14.088096+0000","last_change":"2024-09-12T18:26:43.876974+0000","last_active":"2024-09-12T19:09:14.088096+0000","last_peered":"2024-09-12T19:09:14.088096+0000","last_clean":"2024-09-12T19:09:14.088096+0000","last_became_active":"2024-09-12T18:26:43.873669+0000","last_became_peered":"2024-09-12T18:26:43.873669+0000","last_unstale":"2024-09-12T19:09:14.088096+0000","last_undegraded":"2024-09-12T19:09:14.088096+0000","last_fullsized":"2024-09-12T19:09:14.088096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:55.720687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'279","reported_seq":848,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:38.729498+0000","last_change":"2024-09-12T18:26:46.023642+0000","last_active":"2024-09-12T19:12:38.729498+0000","last_peered":"2024-09-12T19:12:38.729498+0000","last_clean":"2024-09-12T19:12:38.729498+0000","last_became_active":"2024-09-12T18:26:46.023025+0000","last_became_peered":"2024-09-12T18:26:46.023025+0000","last_unstale":"2024-09-12T19:12:38.729498+0000","last_undegraded":"2024-09-12T19:12:38.729498+0000","last_fullsized":"2024-09-12T19:12:38.729498+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:34.349134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59881,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":471,"num_read_kb":993,"num_write":392,"num_write_kb":323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:57.915384+0000","last_change":"2024-09-12T18:26:47.893458+0000","last_active":"2024-09-12T19:10:57.915384+0000","last_peered":"2024-09-12T19:10:57.915384+0000","last_clean":"2024-09-12T19:10:57.915384+0000","last_became_active":"2024-09-12T18:26:47.892678+0000","last_became_peered":"2024-09-12T18:26:47.892678+0000","last_unstale":"2024-09-12T19:10:57.915384+0000","last_undegraded":"2024-09-12T19:10:57.915384+0000","last_fullsized":"2024-09-12T19:10:57.915384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:22.345925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'113","reported_seq":596,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.000115+0000","last_change":"2024-09-12T18:26:49.919935+0000","last_active":"2024-09-12T19:13:44.000115+0000","last_peered":"2024-09-12T19:13:44.000115+0000","last_clean":"2024-09-12T19:13:44.000115+0000","last_became_active":"2024-09-12T18:26:49.919229+0000","last_became_peered":"2024-09-12T18:26:49.919229+0000","last_unstale":"2024-09-12T19:13:44.000115+0000","last_undegraded":"2024-09-12T19:13:44.000115+0000","last_fullsized":"2024-09-12T19:13:44.000115+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:52.637762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":95,"num_write":270,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'503","reported_seq":2204,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.539957+0000","last_change":"2024-09-12T18:26:41.844984+0000","last_active":"2024-09-12T19:12:09.539957+0000","last_peered":"2024-09-12T19:12:09.539957+0000","last_clean":"2024-09-12T19:12:09.539957+0000","last_became_active":"2024-09-12T18:26:41.844608+0000","last_became_peered":"2024-09-12T18:26:41.844608+0000","last_unstale":"2024-09-12T19:12:09.539957+0000","last_undegraded":"2024-09-12T19:12:09.539957+0000","last_fullsized":"2024-09-12T19:12:09.539957+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:01.162341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2752,"num_read_kb":2596,"num_write":594,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'276","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:19.633134+0000","last_change":"2024-09-12T18:27:11.807858+0000","last_active":"2024-09-12T19:12:19.633134+0000","last_peered":"2024-09-12T19:12:19.633134+0000","last_clean":"2024-09-12T19:12:19.633134+0000","last_became_active":"2024-09-12T18:27:11.807022+0000","last_became_peered":"2024-09-12T18:27:11.807022+0000","last_unstale":"2024-09-12T19:12:19.633134+0000","last_undegraded":"2024-09-12T19:12:19.633134+0000","last_fullsized":"2024-09-12T19:12:19.633134+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:42.477672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9976643,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":421,"num_read_kb":61134,"num_write":969,"num_write_kb":46178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:17.891331+0000","last_change":"2024-09-12T18:26:43.860395+0000","last_active":"2024-09-12T19:09:17.891331+0000","last_peered":"2024-09-12T19:09:17.891331+0000","last_clean":"2024-09-12T19:09:17.891331+0000","last_became_active":"2024-09-12T18:26:43.859997+0000","last_became_peered":"2024-09-12T18:26:43.859997+0000","last_unstale":"2024-09-12T19:09:17.891331+0000","last_undegraded":"2024-09-12T19:09:17.891331+0000","last_fullsized":"2024-09-12T19:09:17.891331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:23.870876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'90","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:21.975628+0000","last_change":"2024-09-12T18:26:46.022987+0000","last_active":"2024-09-12T19:11:21.975628+0000","last_peered":"2024-09-12T19:11:21.975628+0000","last_clean":"2024-09-12T19:11:21.975628+0000","last_became_active":"2024-09-12T18:26:46.022246+0000","last_became_peered":"2024-09-12T18:26:46.022246+0000","last_unstale":"2024-09-12T19:11:21.975628+0000","last_undegraded":"2024-09-12T19:11:21.975628+0000","last_fullsized":"2024-09-12T19:11:21.975628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:05.130410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":130,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'766","reported_seq":2305,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.018467+0000","last_change":"2024-09-12T18:26:47.894434+0000","last_active":"2024-09-12T19:13:44.018467+0000","last_peered":"2024-09-12T19:13:44.018467+0000","last_clean":"2024-09-12T19:13:44.018467+0000","last_became_active":"2024-09-12T18:26:47.891107+0000","last_became_peered":"2024-09-12T18:26:47.891107+0000","last_unstale":"2024-09-12T19:13:44.018467+0000","last_undegraded":"2024-09-12T19:13:44.018467+0000","last_fullsized":"2024-09-12T19:13:44.018467+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":701,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:30.324222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'114","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.746554+0000","last_change":"2024-09-12T18:26:49.916767+0000","last_active":"2024-09-12T19:12:21.746554+0000","last_peered":"2024-09-12T19:12:21.746554+0000","last_clean":"2024-09-12T19:12:21.746554+0000","last_became_active":"2024-09-12T18:26:49.915975+0000","last_became_peered":"2024-09-12T18:26:49.915975+0000","last_unstale":"2024-09-12T19:12:21.746554+0000","last_undegraded":"2024-09-12T19:12:21.746554+0000","last_fullsized":"2024-09-12T19:12:21.746554+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:39.304415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":276,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'457","reported_seq":2178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.110966+0000","last_change":"2024-09-12T18:26:41.853916+0000","last_active":"2024-09-12T19:12:24.110966+0000","last_peered":"2024-09-12T19:12:24.110966+0000","last_clean":"2024-09-12T19:12:24.110966+0000","last_became_active":"2024-09-12T18:26:41.853112+0000","last_became_peered":"2024-09-12T18:26:41.853112+0000","last_unstale":"2024-09-12T19:12:24.110966+0000","last_undegraded":"2024-09-12T19:12:24.110966+0000","last_fullsized":"2024-09-12T19:12:24.110966+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:47.031551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2539,"num_write":529,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'307","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:14.445032+0000","last_change":"2024-09-12T18:26:39.867749+0000","last_active":"2024-09-12T19:11:14.445032+0000","last_peered":"2024-09-12T19:11:14.445032+0000","last_clean":"2024-09-12T19:11:14.445032+0000","last_became_active":"2024-09-12T18:26:39.867136+0000","last_became_peered":"2024-09-12T18:26:39.867136+0000","last_unstale":"2024-09-12T19:11:14.445032+0000","last_undegraded":"2024-09-12T19:11:14.445032+0000","last_fullsized":"2024-09-12T19:11:14.445032+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:04.827164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15732260,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":460,"num_read_kb":14806,"num_write":1070,"num_write_kb":34226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:17.883321+0000","last_change":"2024-09-12T18:26:43.877662+0000","last_active":"2024-09-12T19:09:17.883321+0000","last_peered":"2024-09-12T19:09:17.883321+0000","last_clean":"2024-09-12T19:09:17.883321+0000","last_became_active":"2024-09-12T18:26:43.876801+0000","last_became_peered":"2024-09-12T18:26:43.876801+0000","last_unstale":"2024-09-12T19:09:17.883321+0000","last_undegraded":"2024-09-12T19:09:17.883321+0000","last_fullsized":"2024-09-12T19:09:17.883321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:49.772292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'289","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:53.927686+0000","last_change":"2024-09-12T18:26:45.873414+0000","last_active":"2024-09-12T19:12:53.927686+0000","last_peered":"2024-09-12T19:12:53.927686+0000","last_clean":"2024-09-12T19:12:53.927686+0000","last_became_active":"2024-09-12T18:26:45.872458+0000","last_became_peered":"2024-09-12T18:26:45.872458+0000","last_unstale":"2024-09-12T19:12:53.927686+0000","last_undegraded":"2024-09-12T19:12:53.927686+0000","last_fullsized":"2024-09-12T19:12:53.927686+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:15.684235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56998,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":480,"num_read_kb":975,"num_write":390,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.918253+0000","last_change":"2024-09-12T18:26:47.895896+0000","last_active":"2024-09-12T19:10:18.918253+0000","last_peered":"2024-09-12T19:10:18.918253+0000","last_clean":"2024-09-12T19:10:18.918253+0000","last_became_active":"2024-09-12T18:26:47.894689+0000","last_became_peered":"2024-09-12T18:26:47.894689+0000","last_unstale":"2024-09-12T19:10:18.918253+0000","last_undegraded":"2024-09-12T19:10:18.918253+0000","last_fullsized":"2024-09-12T19:10:18.918253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:12.028473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'122","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.472125+0000","last_change":"2024-09-12T18:26:49.931294+0000","last_active":"2024-09-12T19:12:21.472125+0000","last_peered":"2024-09-12T19:12:21.472125+0000","last_clean":"2024-09-12T19:12:21.472125+0000","last_became_active":"2024-09-12T18:26:49.930794+0000","last_became_peered":"2024-09-12T18:26:49.930794+0000","last_unstale":"2024-09-12T19:12:21.472125+0000","last_undegraded":"2024-09-12T19:12:21.472125+0000","last_fullsized":"2024-09-12T19:12:21.472125+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:20.540895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":295,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'613","reported_seq":2272,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.104950+0000","last_change":"2024-09-12T18:26:41.857340+0000","last_active":"2024-09-12T19:13:43.104950+0000","last_peered":"2024-09-12T19:13:43.104950+0000","last_clean":"2024-09-12T19:13:43.104950+0000","last_became_active":"2024-09-12T18:26:41.856621+0000","last_became_peered":"2024-09-12T18:26:41.856621+0000","last_unstale":"2024-09-12T19:13:43.104950+0000","last_undegraded":"2024-09-12T19:13:43.104950+0000","last_fullsized":"2024-09-12T19:13:43.104950+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:57.480188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3116,"num_read_kb":2841,"num_write":759,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'277","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:47.365388+0000","last_change":"2024-09-12T18:26:39.861785+0000","last_active":"2024-09-12T19:11:47.365388+0000","last_peered":"2024-09-12T19:11:47.365388+0000","last_clean":"2024-09-12T19:11:47.365388+0000","last_became_active":"2024-09-12T18:26:39.861108+0000","last_became_peered":"2024-09-12T18:26:39.861108+0000","last_unstale":"2024-09-12T19:11:47.365388+0000","last_undegraded":"2024-09-12T19:11:47.365388+0000","last_fullsized":"2024-09-12T19:11:47.365388+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:35.617812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20012033,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":431,"num_read_kb":32271,"num_write":928,"num_write_kb":22718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:13.878053+0000","last_change":"2024-09-12T18:26:43.861093+0000","last_active":"2024-09-12T19:09:13.878053+0000","last_peered":"2024-09-12T19:09:13.878053+0000","last_clean":"2024-09-12T19:09:13.878053+0000","last_became_active":"2024-09-12T18:26:43.860336+0000","last_became_peered":"2024-09-12T18:26:43.860336+0000","last_unstale":"2024-09-12T19:09:13.878053+0000","last_undegraded":"2024-09-12T19:09:13.878053+0000","last_fullsized":"2024-09-12T19:09:13.878053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:15.631369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'281","reported_seq":845,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.955648+0000","last_change":"2024-09-12T18:26:45.881839+0000","last_active":"2024-09-12T19:12:43.955648+0000","last_peered":"2024-09-12T19:12:43.955648+0000","last_clean":"2024-09-12T19:12:43.955648+0000","last_became_active":"2024-09-12T18:26:45.881364+0000","last_became_peered":"2024-09-12T18:26:45.881364+0000","last_unstale":"2024-09-12T19:12:43.955648+0000","last_undegraded":"2024-09-12T19:12:43.955648+0000","last_fullsized":"2024-09-12T19:12:43.955648+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:54.998693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56916,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":957,"num_write":378,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.898023+0000","last_change":"2024-09-12T18:26:47.888719+0000","last_active":"2024-09-12T19:10:28.898023+0000","last_peered":"2024-09-12T19:10:28.898023+0000","last_clean":"2024-09-12T19:10:28.898023+0000","last_became_active":"2024-09-12T18:26:47.888055+0000","last_became_peered":"2024-09-12T18:26:47.888055+0000","last_unstale":"2024-09-12T19:10:28.898023+0000","last_undegraded":"2024-09-12T19:10:28.898023+0000","last_fullsized":"2024-09-12T19:10:28.898023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:33.128326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.320073+0000","last_change":"2024-09-12T18:26:49.923335+0000","last_active":"2024-09-12T19:12:23.320073+0000","last_peered":"2024-09-12T19:12:23.320073+0000","last_clean":"2024-09-12T19:12:23.320073+0000","last_became_active":"2024-09-12T18:26:49.922543+0000","last_became_peered":"2024-09-12T18:26:49.922543+0000","last_unstale":"2024-09-12T19:12:23.320073+0000","last_undegraded":"2024-09-12T19:12:23.320073+0000","last_fullsized":"2024-09-12T19:12:23.320073+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:23.453107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":203,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'471","reported_seq":2057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.938937+0000","last_change":"2024-09-12T18:26:41.850838+0000","last_active":"2024-09-12T19:12:07.938937+0000","last_peered":"2024-09-12T19:12:07.938937+0000","last_clean":"2024-09-12T19:12:07.938937+0000","last_became_active":"2024-09-12T18:26:41.850499+0000","last_became_peered":"2024-09-12T18:26:41.850499+0000","last_unstale":"2024-09-12T19:12:07.938937+0000","last_undegraded":"2024-09-12T19:12:07.938937+0000","last_fullsized":"2024-09-12T19:12:07.938937+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:48.262784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2536,"num_read_kb":2375,"num_write":558,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'264","reported_seq":881,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.807160+0000","last_change":"2024-09-12T18:26:39.847761+0000","last_active":"2024-09-12T19:11:48.807160+0000","last_peered":"2024-09-12T19:11:48.807160+0000","last_clean":"2024-09-12T19:11:48.807160+0000","last_became_active":"2024-09-12T18:26:39.847422+0000","last_became_peered":"2024-09-12T18:26:39.847422+0000","last_unstale":"2024-09-12T19:11:48.807160+0000","last_undegraded":"2024-09-12T19:11:48.807160+0000","last_fullsized":"2024-09-12T19:11:48.807160+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:13.311491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4791729,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":375,"num_read_kb":20074,"num_write":1008,"num_write_kb":42638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:14.101283+0000","last_change":"2024-09-12T18:26:43.875901+0000","last_active":"2024-09-12T19:10:14.101283+0000","last_peered":"2024-09-12T19:10:14.101283+0000","last_clean":"2024-09-12T19:10:14.101283+0000","last_became_active":"2024-09-12T18:26:43.874881+0000","last_became_peered":"2024-09-12T18:26:43.874881+0000","last_unstale":"2024-09-12T19:10:14.101283+0000","last_undegraded":"2024-09-12T19:10:14.101283+0000","last_fullsized":"2024-09-12T19:10:14.101283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:20.082733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'269","reported_seq":819,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.717325+0000","last_change":"2024-09-12T18:26:45.865460+0000","last_active":"2024-09-12T19:11:48.717325+0000","last_peered":"2024-09-12T19:11:48.717325+0000","last_clean":"2024-09-12T19:11:48.717325+0000","last_became_active":"2024-09-12T18:26:45.864264+0000","last_became_peered":"2024-09-12T18:26:45.864264+0000","last_unstale":"2024-09-12T19:11:48.717325+0000","last_undegraded":"2024-09-12T19:11:48.717325+0000","last_fullsized":"2024-09-12T19:11:48.717325+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:46.472729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65230,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":458,"num_read_kb":1028,"num_write":392,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:19.089126+0000","last_change":"2024-09-12T18:26:47.882838+0000","last_active":"2024-09-12T19:09:19.089126+0000","last_peered":"2024-09-12T19:09:19.089126+0000","last_clean":"2024-09-12T19:09:19.089126+0000","last_became_active":"2024-09-12T18:26:47.882094+0000","last_became_peered":"2024-09-12T18:26:47.882094+0000","last_unstale":"2024-09-12T19:09:19.089126+0000","last_undegraded":"2024-09-12T19:09:19.089126+0000","last_fullsized":"2024-09-12T19:09:19.089126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:28.769911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'194","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.741958+0000","last_change":"2024-09-12T18:26:49.921917+0000","last_active":"2024-09-12T19:12:21.741958+0000","last_peered":"2024-09-12T19:12:21.741958+0000","last_clean":"2024-09-12T19:12:21.741958+0000","last_became_active":"2024-09-12T18:26:49.920808+0000","last_became_peered":"2024-09-12T18:26:49.920808+0000","last_unstale":"2024-09-12T19:12:21.741958+0000","last_undegraded":"2024-09-12T19:12:21.741958+0000","last_fullsized":"2024-09-12T19:12:21.741958+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:38.677600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1188,"num_read_kb":1184,"num_write":433,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'790","reported_seq":2289,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.623824+0000","last_change":"2024-09-12T18:26:41.874632+0000","last_active":"2024-09-12T19:12:18.623824+0000","last_peered":"2024-09-12T19:12:18.623824+0000","last_clean":"2024-09-12T19:12:18.623824+0000","last_became_active":"2024-09-12T18:26:41.873690+0000","last_became_peered":"2024-09-12T18:26:41.873690+0000","last_unstale":"2024-09-12T19:12:18.623824+0000","last_undegraded":"2024-09-12T19:12:18.623824+0000","last_fullsized":"2024-09-12T19:12:18.623824+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:58.542257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3645,"num_read_kb":3278,"num_write":1029,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'291","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:54.375517+0000","last_change":"2024-09-12T18:27:11.830481+0000","last_active":"2024-09-12T19:11:54.375517+0000","last_peered":"2024-09-12T19:11:54.375517+0000","last_clean":"2024-09-12T19:11:54.375517+0000","last_became_active":"2024-09-12T18:27:11.829577+0000","last_became_peered":"2024-09-12T18:27:11.829577+0000","last_unstale":"2024-09-12T19:11:54.375517+0000","last_undegraded":"2024-09-12T19:11:54.375517+0000","last_fullsized":"2024-09-12T19:11:54.375517+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:39.120138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5779791,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":442,"num_read_kb":8019,"num_write":1145,"num_write_kb":33613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:27.907872+0000","last_change":"2024-09-12T18:26:43.865809+0000","last_active":"2024-09-12T19:10:27.907872+0000","last_peered":"2024-09-12T19:10:27.907872+0000","last_clean":"2024-09-12T19:10:27.907872+0000","last_became_active":"2024-09-12T18:26:43.864719+0000","last_became_peered":"2024-09-12T18:26:43.864719+0000","last_unstale":"2024-09-12T19:10:27.907872+0000","last_undegraded":"2024-09-12T19:10:27.907872+0000","last_fullsized":"2024-09-12T19:10:27.907872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:47.905822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'301","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:49.122478+0000","last_change":"2024-09-12T18:26:45.866467+0000","last_active":"2024-09-12T19:11:49.122478+0000","last_peered":"2024-09-12T19:11:49.122478+0000","last_clean":"2024-09-12T19:11:49.122478+0000","last_became_active":"2024-09-12T18:26:45.865711+0000","last_became_peered":"2024-09-12T18:26:45.865711+0000","last_unstale":"2024-09-12T19:11:49.122478+0000","last_undegraded":"2024-09-12T19:11:49.122478+0000","last_fullsized":"2024-09-12T19:11:49.122478+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:12.137382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":497,"num_read_kb":1005,"num_write":410,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.903282+0000","last_change":"2024-09-12T18:26:47.883801+0000","last_active":"2024-09-12T19:09:18.903282+0000","last_peered":"2024-09-12T19:09:18.903282+0000","last_clean":"2024-09-12T19:09:18.903282+0000","last_became_active":"2024-09-12T18:26:47.883014+0000","last_became_peered":"2024-09-12T18:26:47.883014+0000","last_unstale":"2024-09-12T19:09:18.903282+0000","last_undegraded":"2024-09-12T19:09:18.903282+0000","last_fullsized":"2024-09-12T19:09:18.903282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:35.546362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'106","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.102109+0000","last_change":"2024-09-12T18:26:49.922286+0000","last_active":"2024-09-12T19:13:43.102109+0000","last_peered":"2024-09-12T19:13:43.102109+0000","last_clean":"2024-09-12T19:13:43.102109+0000","last_became_active":"2024-09-12T18:26:49.921636+0000","last_became_peered":"2024-09-12T18:26:49.921636+0000","last_unstale":"2024-09-12T19:13:43.102109+0000","last_undegraded":"2024-09-12T19:13:43.102109+0000","last_fullsized":"2024-09-12T19:13:43.102109+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:07.594133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":621,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":107,"num_write":252,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'1273","reported_seq":3077,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.126851+0000","last_change":"2024-09-12T18:26:41.872801+0000","last_active":"2024-09-12T19:12:24.126851+0000","last_peered":"2024-09-12T19:12:24.126851+0000","last_clean":"2024-09-12T19:12:24.126851+0000","last_became_active":"2024-09-12T18:26:41.872455+0000","last_became_peered":"2024-09-12T18:26:41.872455+0000","last_unstale":"2024-09-12T19:12:24.126851+0000","last_undegraded":"2024-09-12T19:12:24.126851+0000","last_fullsized":"2024-09-12T19:12:24.126851+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:05.640554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6298,"num_read_kb":5578,"num_write":1816,"num_write_kb":809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'318","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.757297+0000","last_change":"2024-09-12T18:26:39.848638+0000","last_active":"2024-09-12T19:12:09.757297+0000","last_peered":"2024-09-12T19:12:09.757297+0000","last_clean":"2024-09-12T19:12:09.757297+0000","last_became_active":"2024-09-12T18:26:39.847954+0000","last_became_peered":"2024-09-12T18:26:39.847954+0000","last_unstale":"2024-09-12T19:12:09.757297+0000","last_undegraded":"2024-09-12T19:12:09.757297+0000","last_fullsized":"2024-09-12T19:12:09.757297+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:36.378454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23103420,"num_objects":96,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":0,"num_read":503,"num_read_kb":77064,"num_write":1168,"num_write_kb":41008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'501","reported_seq":2145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.105839+0000","last_change":"2024-09-12T18:26:41.852684+0000","last_active":"2024-09-12T19:13:43.105839+0000","last_peered":"2024-09-12T19:13:43.105839+0000","last_clean":"2024-09-12T19:13:43.105839+0000","last_became_active":"2024-09-12T18:26:41.846040+0000","last_became_peered":"2024-09-12T18:26:41.846040+0000","last_unstale":"2024-09-12T19:13:43.105839+0000","last_undegraded":"2024-09-12T19:13:43.105839+0000","last_fullsized":"2024-09-12T19:13:43.105839+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:45.056792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2703,"num_read_kb":2531,"num_write":592,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'307","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:42.235030+0000","last_change":"2024-09-12T18:26:39.846352+0000","last_active":"2024-09-12T19:13:42.235030+0000","last_peered":"2024-09-12T19:13:42.235030+0000","last_clean":"2024-09-12T19:13:42.235030+0000","last_became_active":"2024-09-12T18:26:39.846028+0000","last_became_peered":"2024-09-12T18:26:39.846028+0000","last_unstale":"2024-09-12T19:13:42.235030+0000","last_undegraded":"2024-09-12T19:13:42.235030+0000","last_fullsized":"2024-09-12T19:13:42.235030+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:04.369252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1896747,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":707,"num_read_kb":5622,"num_write":1105,"num_write_kb":40701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'516","reported_seq":2039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.769450+0000","last_change":"2024-09-12T18:26:41.884917+0000","last_active":"2024-09-12T19:12:08.769450+0000","last_peered":"2024-09-12T19:12:08.769450+0000","last_clean":"2024-09-12T19:12:08.769450+0000","last_became_active":"2024-09-12T18:26:41.884394+0000","last_became_peered":"2024-09-12T18:26:41.884394+0000","last_unstale":"2024-09-12T19:12:08.769450+0000","last_undegraded":"2024-09-12T19:12:08.769450+0000","last_fullsized":"2024-09-12T19:12:08.769450+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:32.084024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2704,"num_read_kb":2505,"num_write":657,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'277","reported_seq":919,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:12.493346+0000","last_change":"2024-09-12T18:26:39.856913+0000","last_active":"2024-09-12T19:11:12.493346+0000","last_peered":"2024-09-12T19:11:12.493346+0000","last_clean":"2024-09-12T19:11:12.493346+0000","last_became_active":"2024-09-12T18:26:39.856026+0000","last_became_peered":"2024-09-12T18:26:39.856026+0000","last_unstale":"2024-09-12T19:11:12.493346+0000","last_undegraded":"2024-09-12T19:11:12.493346+0000","last_fullsized":"2024-09-12T19:11:12.493346+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:27.396302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7110994,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":464,"num_read_kb":16867,"num_write":1020,"num_write_kb":23838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'538","reported_seq":2153,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.106718+0000","last_change":"2024-09-12T18:26:41.850869+0000","last_active":"2024-09-12T19:13:43.106718+0000","last_peered":"2024-09-12T19:13:43.106718+0000","last_clean":"2024-09-12T19:13:43.106718+0000","last_became_active":"2024-09-12T18:26:41.850519+0000","last_became_peered":"2024-09-12T18:26:41.850519+0000","last_unstale":"2024-09-12T19:13:43.106718+0000","last_undegraded":"2024-09-12T19:13:43.106718+0000","last_fullsized":"2024-09-12T19:13:43.106718+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:01.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2864,"num_read_kb":2647,"num_write":672,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'289","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.700985+0000","last_change":"2024-09-12T18:26:39.843327+0000","last_active":"2024-09-12T19:11:59.700985+0000","last_peered":"2024-09-12T19:11:59.700985+0000","last_clean":"2024-09-12T19:11:59.700985+0000","last_became_active":"2024-09-12T18:26:39.842852+0000","last_became_peered":"2024-09-12T18:26:39.842852+0000","last_unstale":"2024-09-12T19:11:59.700985+0000","last_undegraded":"2024-09-12T19:11:59.700985+0000","last_fullsized":"2024-09-12T19:11:59.700985+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.968044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10012875,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":455,"num_read_kb":35620,"num_write":1102,"num_write_kb":31566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'814","reported_seq":2351,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.568561+0000","last_change":"2024-09-12T18:26:41.882724+0000","last_active":"2024-09-12T19:12:06.568561+0000","last_peered":"2024-09-12T19:12:06.568561+0000","last_clean":"2024-09-12T19:12:06.568561+0000","last_became_active":"2024-09-12T18:26:41.882458+0000","last_became_peered":"2024-09-12T18:26:41.882458+0000","last_unstale":"2024-09-12T19:12:06.568561+0000","last_undegraded":"2024-09-12T19:12:06.568561+0000","last_fullsized":"2024-09-12T19:12:06.568561+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:55.482811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3832,"num_read_kb":3447,"num_write":1071,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'269","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:02.481890+0000","last_change":"2024-09-12T18:26:39.855875+0000","last_active":"2024-09-12T19:12:02.481890+0000","last_peered":"2024-09-12T19:12:02.481890+0000","last_clean":"2024-09-12T19:12:02.481890+0000","last_became_active":"2024-09-12T18:26:39.855654+0000","last_became_peered":"2024-09-12T18:26:39.855654+0000","last_unstale":"2024-09-12T19:12:02.481890+0000","last_undegraded":"2024-09-12T19:12:02.481890+0000","last_fullsized":"2024-09-12T19:12:02.481890+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:14.438744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2146066,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":530,"num_read_kb":6402,"num_write":986,"num_write_kb":32224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'1222","reported_seq":2855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.127193+0000","last_change":"2024-09-12T18:26:41.877371+0000","last_active":"2024-09-12T19:12:24.127193+0000","last_peered":"2024-09-12T19:12:24.127193+0000","last_clean":"2024-09-12T19:12:24.127193+0000","last_became_active":"2024-09-12T18:26:41.876138+0000","last_became_peered":"2024-09-12T18:26:41.876138+0000","last_unstale":"2024-09-12T19:12:24.127193+0000","last_undegraded":"2024-09-12T19:12:24.127193+0000","last_fullsized":"2024-09-12T19:12:24.127193+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":1200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:46.850535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4890,"num_write":1674,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'277","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.703873+0000","last_change":"2024-09-12T18:26:39.844674+0000","last_active":"2024-09-12T19:13:57.703873+0000","last_peered":"2024-09-12T19:13:57.703873+0000","last_clean":"2024-09-12T19:13:57.703873+0000","last_became_active":"2024-09-12T18:26:39.844346+0000","last_became_peered":"2024-09-12T18:26:39.844346+0000","last_unstale":"2024-09-12T19:13:57.703873+0000","last_undegraded":"2024-09-12T19:13:57.703873+0000","last_fullsized":"2024-09-12T19:13:57.703873+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:51.398790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5747617,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":413,"num_read_kb":67178,"num_write":960,"num_write_kb":30033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'741","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.102708+0000","last_change":"2024-09-12T18:27:11.824740+0000","last_active":"2024-09-12T19:13:43.102708+0000","last_peered":"2024-09-12T19:13:43.102708+0000","last_clean":"2024-09-12T19:13:43.102708+0000","last_became_active":"2024-09-12T18:27:11.823747+0000","last_became_peered":"2024-09-12T18:27:11.823747+0000","last_unstale":"2024-09-12T19:13:43.102708+0000","last_undegraded":"2024-09-12T19:13:43.102708+0000","last_fullsized":"2024-09-12T19:13:43.102708+0000","mapping_epoch":37,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:51.790957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3535,"num_read_kb":3187,"num_write":978,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"265'280","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.310631+0000","last_change":"2024-09-12T18:26:39.871790+0000","last_active":"2024-09-12T19:12:07.310631+0000","last_peered":"2024-09-12T19:12:07.310631+0000","last_clean":"2024-09-12T19:12:07.310631+0000","last_became_active":"2024-09-12T18:26:39.871119+0000","last_became_peered":"2024-09-12T18:26:39.871119+0000","last_unstale":"2024-09-12T19:12:07.310631+0000","last_undegraded":"2024-09-12T19:12:07.310631+0000","last_fullsized":"2024-09-12T19:12:07.310631+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:01.325896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1105860,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":486,"num_read_kb":8461,"num_write":1059,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'1064","reported_seq":2771,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.604993+0000","last_change":"2024-09-12T18:26:41.869379+0000","last_active":"2024-09-12T19:12:09.604993+0000","last_peered":"2024-09-12T19:12:09.604993+0000","last_clean":"2024-09-12T19:12:09.604993+0000","last_became_active":"2024-09-12T18:26:41.863607+0000","last_became_peered":"2024-09-12T18:26:41.863607+0000","last_unstale":"2024-09-12T19:12:09.604993+0000","last_undegraded":"2024-09-12T19:12:09.604993+0000","last_fullsized":"2024-09-12T19:12:09.604993+0000","mapping_epoch":26,"log_start":"265'1000","ondisk_log_start":"265'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1000,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:52.994239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5203,"num_read_kb":4615,"num_write":1535,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'281","reported_seq":926,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:03.453454+0000","last_change":"2024-09-12T18:26:39.828227+0000","last_active":"2024-09-12T19:12:03.453454+0000","last_peered":"2024-09-12T19:12:03.453454+0000","last_clean":"2024-09-12T19:12:03.453454+0000","last_became_active":"2024-09-12T18:26:39.827475+0000","last_became_peered":"2024-09-12T18:26:39.827475+0000","last_unstale":"2024-09-12T19:12:03.453454+0000","last_undegraded":"2024-09-12T19:12:03.453454+0000","last_fullsized":"2024-09-12T19:12:03.453454+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:39.931458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10582884,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":436,"num_read_kb":48335,"num_write":1051,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'824","reported_seq":2436,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.126652+0000","last_change":"2024-09-12T18:26:41.851460+0000","last_active":"2024-09-12T19:12:24.126652+0000","last_peered":"2024-09-12T19:12:24.126652+0000","last_clean":"2024-09-12T19:12:24.126652+0000","last_became_active":"2024-09-12T18:26:41.851080+0000","last_became_peered":"2024-09-12T18:26:41.851080+0000","last_unstale":"2024-09-12T19:12:24.126652+0000","last_undegraded":"2024-09-12T19:12:24.126652+0000","last_fullsized":"2024-09-12T19:12:24.126652+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:00.421668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4015,"num_read_kb":3626,"num_write":1096,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'287","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:02.489033+0000","last_change":"2024-09-12T18:26:39.850533+0000","last_active":"2024-09-12T19:11:02.489033+0000","last_peered":"2024-09-12T19:11:02.489033+0000","last_clean":"2024-09-12T19:11:02.489033+0000","last_became_active":"2024-09-12T18:26:39.849722+0000","last_became_peered":"2024-09-12T18:26:39.849722+0000","last_unstale":"2024-09-12T19:11:02.489033+0000","last_undegraded":"2024-09-12T19:11:02.489033+0000","last_fullsized":"2024-09-12T19:11:02.489033+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:57.210670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15791650,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":438,"num_read_kb":40604,"num_write":1031,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'396","reported_seq":1927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.290269+0000","last_change":"2024-09-12T18:26:41.851925+0000","last_active":"2024-09-12T19:12:23.290269+0000","last_peered":"2024-09-12T19:12:23.290269+0000","last_clean":"2024-09-12T19:12:23.290269+0000","last_became_active":"2024-09-12T18:26:41.851159+0000","last_became_peered":"2024-09-12T18:26:41.851159+0000","last_unstale":"2024-09-12T19:12:23.290269+0000","last_undegraded":"2024-09-12T19:12:23.290269+0000","last_fullsized":"2024-09-12T19:12:23.290269+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:12.817942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2139,"num_read_kb":2047,"num_write":455,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'252","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.221348+0000","last_change":"2024-09-12T18:26:39.828823+0000","last_active":"2024-09-12T19:12:07.221348+0000","last_peered":"2024-09-12T19:12:07.221348+0000","last_clean":"2024-09-12T19:12:07.221348+0000","last_became_active":"2024-09-12T18:26:39.827933+0000","last_became_peered":"2024-09-12T18:26:39.827933+0000","last_unstale":"2024-09-12T19:12:07.221348+0000","last_undegraded":"2024-09-12T19:12:07.221348+0000","last_fullsized":"2024-09-12T19:12:07.221348+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:56.699019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6293141,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":367,"num_read_kb":364,"num_write":880,"num_write_kb":38290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'1178","reported_seq":2805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.105889+0000","last_change":"2024-09-12T18:26:41.873225+0000","last_active":"2024-09-12T19:12:01.105889+0000","last_peered":"2024-09-12T19:12:01.105889+0000","last_clean":"2024-09-12T19:12:01.105889+0000","last_became_active":"2024-09-12T18:26:41.872816+0000","last_became_peered":"2024-09-12T18:26:41.872816+0000","last_unstale":"2024-09-12T19:12:01.105889+0000","last_undegraded":"2024-09-12T19:12:01.105889+0000","last_fullsized":"2024-09-12T19:12:01.105889+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:18.236340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5354,"num_read_kb":4741,"num_write":1604,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'253","reported_seq":838,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:13.914600+0000","last_change":"2024-09-12T18:27:12.006534+0000","last_active":"2024-09-12T19:11:13.914600+0000","last_peered":"2024-09-12T19:11:13.914600+0000","last_clean":"2024-09-12T19:11:13.914600+0000","last_became_active":"2024-09-12T18:27:12.005906+0000","last_became_peered":"2024-09-12T18:27:12.005906+0000","last_unstale":"2024-09-12T19:11:13.914600+0000","last_undegraded":"2024-09-12T19:11:13.914600+0000","last_fullsized":"2024-09-12T19:11:13.914600+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:10.452660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7395832,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":368,"num_read_kb":9281,"num_write":977,"num_write_kb":40338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"265'418","reported_seq":1866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.109146+0000","last_change":"2024-09-12T18:26:41.867368+0000","last_active":"2024-09-12T19:13:43.109146+0000","last_peered":"2024-09-12T19:13:43.109146+0000","last_clean":"2024-09-12T19:13:43.109146+0000","last_became_active":"2024-09-12T18:26:41.866602+0000","last_became_peered":"2024-09-12T18:26:41.866602+0000","last_unstale":"2024-09-12T19:13:43.109146+0000","last_undegraded":"2024-09-12T19:13:43.109146+0000","last_fullsized":"2024-09-12T19:13:43.109146+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:37.206508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2028,"num_write":492,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'297","reported_seq":918,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:57.633745+0000","last_change":"2024-09-12T18:26:39.872098+0000","last_active":"2024-09-12T19:11:57.633745+0000","last_peered":"2024-09-12T19:11:57.633745+0000","last_clean":"2024-09-12T19:11:57.633745+0000","last_became_active":"2024-09-12T18:26:39.871626+0000","last_became_peered":"2024-09-12T18:26:39.871626+0000","last_unstale":"2024-09-12T19:11:57.633745+0000","last_undegraded":"2024-09-12T19:11:57.633745+0000","last_fullsized":"2024-09-12T19:11:57.633745+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:14.820272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7166305,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":403,"num_read_kb":15528,"num_write":1047,"num_write_kb":35488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'1248","reported_seq":2886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.769985+0000","last_change":"2024-09-12T18:26:41.877593+0000","last_active":"2024-09-12T19:12:08.769985+0000","last_peered":"2024-09-12T19:12:08.769985+0000","last_clean":"2024-09-12T19:12:08.769985+0000","last_became_active":"2024-09-12T18:26:41.876708+0000","last_became_peered":"2024-09-12T18:26:41.876708+0000","last_unstale":"2024-09-12T19:12:08.769985+0000","last_undegraded":"2024-09-12T19:12:08.769985+0000","last_fullsized":"2024-09-12T19:12:08.769985+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:14.658782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5682,"num_read_kb":5005,"num_write":1690,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'263","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:05.909705+0000","last_change":"2024-09-12T18:26:39.858750+0000","last_active":"2024-09-12T19:12:05.909705+0000","last_peered":"2024-09-12T19:12:05.909705+0000","last_clean":"2024-09-12T19:12:05.909705+0000","last_became_active":"2024-09-12T18:26:39.857956+0000","last_became_peered":"2024-09-12T18:26:39.857956+0000","last_unstale":"2024-09-12T19:12:05.909705+0000","last_undegraded":"2024-09-12T19:12:05.909705+0000","last_fullsized":"2024-09-12T19:12:05.909705+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:36.402643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9048989,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":434,"num_read_kb":32197,"num_write":886,"num_write_kb":38029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'898","reported_seq":2593,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.554895+0000","last_change":"2024-09-12T18:26:41.854757+0000","last_active":"2024-09-12T19:12:06.554895+0000","last_peered":"2024-09-12T19:12:06.554895+0000","last_clean":"2024-09-12T19:12:06.554895+0000","last_became_active":"2024-09-12T18:26:41.854471+0000","last_became_peered":"2024-09-12T18:26:41.854471+0000","last_unstale":"2024-09-12T19:12:06.554895+0000","last_undegraded":"2024-09-12T19:12:06.554895+0000","last_fullsized":"2024-09-12T19:12:06.554895+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":800,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:00.860983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4435,"num_read_kb":4011,"num_write":1173,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'360","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.930373+0000","last_change":"2024-09-12T18:26:39.871177+0000","last_active":"2024-09-12T19:13:57.930373+0000","last_peered":"2024-09-12T19:13:57.930373+0000","last_clean":"2024-09-12T19:13:57.930373+0000","last_became_active":"2024-09-12T18:26:39.869924+0000","last_became_peered":"2024-09-12T18:26:39.869924+0000","last_unstale":"2024-09-12T19:13:57.930373+0000","last_undegraded":"2024-09-12T19:13:57.930373+0000","last_fullsized":"2024-09-12T19:13:57.930373+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:42.282746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1429061,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":520,"num_read_kb":35584,"num_write":1204,"num_write_kb":36960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'684","reported_seq":2473,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.610409+0000","last_change":"2024-09-12T18:26:41.858693+0000","last_active":"2024-09-12T19:12:18.610409+0000","last_peered":"2024-09-12T19:12:18.610409+0000","last_clean":"2024-09-12T19:12:18.610409+0000","last_became_active":"2024-09-12T18:26:41.858362+0000","last_became_peered":"2024-09-12T18:26:41.858362+0000","last_unstale":"2024-09-12T19:12:18.610409+0000","last_undegraded":"2024-09-12T19:12:18.610409+0000","last_fullsized":"2024-09-12T19:12:18.610409+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:42.785349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3672,"num_read_kb":3341,"num_write":924,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'352","reported_seq":1135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:36.227159+0000","last_change":"2024-09-12T18:26:39.847818+0000","last_active":"2024-09-12T19:11:36.227159+0000","last_peered":"2024-09-12T19:11:36.227159+0000","last_clean":"2024-09-12T19:11:36.227159+0000","last_became_active":"2024-09-12T18:26:39.847373+0000","last_became_peered":"2024-09-12T18:26:39.847373+0000","last_unstale":"2024-09-12T19:11:36.227159+0000","last_undegraded":"2024-09-12T19:11:36.227159+0000","last_fullsized":"2024-09-12T19:11:36.227159+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:55.989925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13837277,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":744,"num_read_kb":75469,"num_write":1349,"num_write_kb":36911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'824","reported_seq":2390,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.104105+0000","last_change":"2024-09-12T18:26:41.873328+0000","last_active":"2024-09-12T19:13:43.104105+0000","last_peered":"2024-09-12T19:13:43.104105+0000","last_clean":"2024-09-12T19:13:43.104105+0000","last_became_active":"2024-09-12T18:26:41.871610+0000","last_became_peered":"2024-09-12T18:26:41.871610+0000","last_unstale":"2024-09-12T19:13:43.104105+0000","last_undegraded":"2024-09-12T19:13:43.104105+0000","last_fullsized":"2024-09-12T19:13:43.104105+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:57.336959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3622,"num_write":1076,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'230","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:55.322689+0000","last_change":"2024-09-12T18:26:39.875309+0000","last_active":"2024-09-12T19:11:55.322689+0000","last_peered":"2024-09-12T19:11:55.322689+0000","last_clean":"2024-09-12T19:11:55.322689+0000","last_became_active":"2024-09-12T18:26:39.874710+0000","last_became_peered":"2024-09-12T18:26:39.874710+0000","last_unstale":"2024-09-12T19:11:55.322689+0000","last_undegraded":"2024-09-12T19:11:55.322689+0000","last_fullsized":"2024-09-12T19:11:55.322689+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:32.381222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049289,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":391,"num_read_kb":12735,"num_write":888,"num_write_kb":23796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'279","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:45.625552+0000","last_change":"2024-09-12T18:26:39.847812+0000","last_active":"2024-09-12T19:11:45.625552+0000","last_peered":"2024-09-12T19:11:45.625552+0000","last_clean":"2024-09-12T19:11:45.625552+0000","last_became_active":"2024-09-12T18:26:39.846477+0000","last_became_peered":"2024-09-12T18:26:39.846477+0000","last_unstale":"2024-09-12T19:11:45.625552+0000","last_undegraded":"2024-09-12T19:11:45.625552+0000","last_fullsized":"2024-09-12T19:11:45.625552+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:04.316982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4908998,"num_objects":80,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":433,"num_read_kb":32398,"num_write":952,"num_write_kb":24916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'404","reported_seq":1869,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.107075+0000","last_change":"2024-09-12T18:26:41.851628+0000","last_active":"2024-09-12T19:13:43.107075+0000","last_peered":"2024-09-12T19:13:43.107075+0000","last_clean":"2024-09-12T19:13:43.107075+0000","last_became_active":"2024-09-12T18:26:41.851295+0000","last_became_peered":"2024-09-12T18:26:41.851295+0000","last_unstale":"2024-09-12T19:13:43.107075+0000","last_undegraded":"2024-09-12T19:13:43.107075+0000","last_fullsized":"2024-09-12T19:13:43.107075+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:27.756982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":455,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'283","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.701169+0000","last_change":"2024-09-12T18:26:39.857287+0000","last_active":"2024-09-12T19:13:57.701169+0000","last_peered":"2024-09-12T19:13:57.701169+0000","last_clean":"2024-09-12T19:13:57.701169+0000","last_became_active":"2024-09-12T18:26:39.857009+0000","last_became_peered":"2024-09-12T18:26:39.857009+0000","last_unstale":"2024-09-12T19:13:57.701169+0000","last_undegraded":"2024-09-12T19:13:57.701169+0000","last_fullsized":"2024-09-12T19:13:57.701169+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:48.340491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2358323,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":400,"num_read_kb":55511,"num_write":910,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'374","reported_seq":1762,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.894092+0000","last_change":"2024-09-12T18:26:41.878961+0000","last_active":"2024-09-12T19:12:07.894092+0000","last_peered":"2024-09-12T19:12:07.894092+0000","last_clean":"2024-09-12T19:12:07.894092+0000","last_became_active":"2024-09-12T18:26:41.872448+0000","last_became_peered":"2024-09-12T18:26:41.872448+0000","last_unstale":"2024-09-12T19:12:07.894092+0000","last_undegraded":"2024-09-12T19:12:07.894092+0000","last_fullsized":"2024-09-12T19:12:07.894092+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:18.608268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1946,"num_read_kb":1855,"num_write":441,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6147,"num_read_kb":4433,"num_write":1993,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":964,"ondisk_log_size":964,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":14976,"num_read_kb":14648,"num_write":16787,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1653,"ondisk_log_size":1653,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":541,"ondisk_log_size":541,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1892511,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17046,"num_read_kb":33290,"num_write":14424,"num_write_kb":11573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2924544,"data_stored":2434194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2075,"ondisk_log_size":2075,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2396,"num_read_kb":2855,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212286,"num_read_kb":193833,"num_write":55194,"num_write_kb":18759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3910,"ondisk_log_size":3910,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":480173717,"num_objects":3830,"num_object_clones":0,"num_object_copies":7660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3830,"num_whiteouts":0,"num_read":32811,"num_read_kb":1882752,"num_write":68724,"num_write_kb":2144860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1030660096,"data_stored":1002399160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4107,"ondisk_log_size":4107,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":65769289,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":157,"num_read_kb":214446,"num_write":168,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":125255680,"data_stored":125247122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":63672137,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":152,"num_read_kb":201134,"num_write":167,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126304256,"data_stored":126295698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510016,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":391676,"kb_used_data":143916,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93980164,"statfs":{"total":96636764160,"available":96235687936,"internally_reserved":0,"allocated":147369984,"data_stored":142588376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":253688262},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510016,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300584,"kb_used_data":183384,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94071256,"statfs":{"total":96636764160,"available":96328966144,"internally_reserved":0,"allocated":187785216,"data_stored":181571212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":119994821},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510017,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265348,"kb_used_data":189748,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94106492,"statfs":{"total":96636764160,"available":96365047808,"internally_reserved":0,"allocated":194301952,"data_stored":188252816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510014,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":466108,"kb_used_data":218348,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93905732,"statfs":{"total":96636764160,"available":96159469568,"internally_reserved":0,"allocated":223588352,"data_stored":217599643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510014,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249168,"kb_used_data":155584,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94122672,"statfs":{"total":96636764160,"available":96381616128,"internally_reserved":0,"allocated":159318016,"data_stored":155023243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510014,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":461744,"kb_used_data":214048,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":93910096,"statfs":{"total":96636764160,"available":96163938304,"internally_reserved":0,"allocated":219185152,"data_stored":212885377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":253622728},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542722,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":342548,"kb_used_data":68420,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94029292,"statfs":{"total":96636764160,"available":96285995008,"internally_reserved":0,"allocated":70062080,"data_stored":66408599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542720,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305460,"kb_used_data":170164,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94066380,"statfs":{"total":96636764160,"available":96323973120,"internally_reserved":0,"allocated":174247936,"data_stored":169431162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":168685568,"data_stored":163929834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90566656,"data_stored":88622662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":93966336,"data_stored":91148738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":178442240,"data_stored":173999215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":154951680,"data_stored":150337560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":165584896,"data_stored":160969100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":115458048,"data_stored":112176297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":63004672,"data_stored":61215754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":345602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":253869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":130758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":493397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":91329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":675840,"data_stored":565619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":258614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":380928,"data_stored":295006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26972160,"data_stored":26968770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35651584,"data_stored":35651584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18878464,"data_stored":18877575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":10525905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13303808,"data_stored":13300344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":18878464,"data_stored":18877575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11202560,"data_stored":11199985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":25923584,"data_stored":25920194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28352512,"data_stored":28351697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":7340032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14684160,"data_stored":14683271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:14:00.381 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T19:14:00.706 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:14:00.706 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":265,"fsid":"2cc18cb2-6afc-4366-93a9-b1f579cd792f","created":"2024-09-12T18:26:05.742099+0000","modified":"2024-09-12T18:55:20.106579+0000","last_up_change":"2024-09-12T18:26:18.393867+0000","last_in_change":"2024-09-12T18:26:08.014473+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T18:26:18.722812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T18:26:23.958665+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T18:26:38.638313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T18:26:40.257775+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T18:26:41.947156+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T18:26:44.184735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T18:26:45.882177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T18:26:48.017182+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T18:41:43.837520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"254","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T18:43:28.699949+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T18:43:31.043792+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T18:55:17.261862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"265","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f6d201c3-d36f-4b75-8bcf-d55c910dcf0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6817","nonce":1581955167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6819","nonce":1581955167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6823","nonce":1581955167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":1581955167},{"type":"v1","addr":"172.21.15.111:6821","nonce":1581955167}]},"public_addr":"172.21.15.111:6817/1581955167","cluster_addr":"172.21.15.111:6819/1581955167","heartbeat_back_addr":"172.21.15.111:6823/1581955167","heartbeat_front_addr":"172.21.15.111:6821/1581955167","state":["exists","up"]},{"osd":1,"uuid":"49140545-86a4-4210-be95-412be10e99c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6801","nonce":2832238944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6803","nonce":2832238944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6807","nonce":2832238944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2832238944},{"type":"v1","addr":"172.21.15.111:6805","nonce":2832238944}]},"public_addr":"172.21.15.111:6801/2832238944","cluster_addr":"172.21.15.111:6803/2832238944","heartbeat_back_addr":"172.21.15.111:6807/2832238944","heartbeat_front_addr":"172.21.15.111:6805/2832238944","state":["exists","up"]},{"osd":2,"uuid":"d712690b-6779-4066-8278-fca60e2d67a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6825","nonce":1702084661}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6827","nonce":1702084661}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6830","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6831","nonce":1702084661}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":1702084661},{"type":"v1","addr":"172.21.15.111:6829","nonce":1702084661}]},"public_addr":"172.21.15.111:6825/1702084661","cluster_addr":"172.21.15.111:6827/1702084661","heartbeat_back_addr":"172.21.15.111:6831/1702084661","heartbeat_front_addr":"172.21.15.111:6829/1702084661","state":["exists","up"]},{"osd":3,"uuid":"b9a4ce89-2dd9-4b33-a188-2314de9ffd77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6809","nonce":2609694328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6811","nonce":2609694328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6815","nonce":2609694328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":2609694328},{"type":"v1","addr":"172.21.15.111:6813","nonce":2609694328}]},"public_addr":"172.21.15.111:6809/2609694328","cluster_addr":"172.21.15.111:6811/2609694328","heartbeat_back_addr":"172.21.15.111:6815/2609694328","heartbeat_front_addr":"172.21.15.111:6813/2609694328","state":["exists","up"]},{"osd":4,"uuid":"2ffc2db9-c5bd-432a-a596-fc46893774c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6817","nonce":2228313878}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6819","nonce":2228313878}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6823","nonce":2228313878}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":2228313878},{"type":"v1","addr":"172.21.15.153:6821","nonce":2228313878}]},"public_addr":"172.21.15.153:6817/2228313878","cluster_addr":"172.21.15.153:6819/2228313878","heartbeat_back_addr":"172.21.15.153:6823/2228313878","heartbeat_front_addr":"172.21.15.153:6821/2228313878","state":["exists","up"]},{"osd":5,"uuid":"6bf980d2-3561-4a7a-8f67-5ae37e945ff9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6825","nonce":2813139034}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6827","nonce":2813139034}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6831","nonce":2813139034}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2813139034},{"type":"v1","addr":"172.21.15.153:6829","nonce":2813139034}]},"public_addr":"172.21.15.153:6825/2813139034","cluster_addr":"172.21.15.153:6827/2813139034","heartbeat_back_addr":"172.21.15.153:6831/2813139034","heartbeat_front_addr":"172.21.15.153:6829/2813139034","state":["exists","up"]},{"osd":6,"uuid":"63d95b89-bcdc-4091-bc1a-572a1541f3f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6809","nonce":1571723771}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6811","nonce":1571723771}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6815","nonce":1571723771}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":1571723771},{"type":"v1","addr":"172.21.15.153:6813","nonce":1571723771}]},"public_addr":"172.21.15.153:6809/1571723771","cluster_addr":"172.21.15.153:6811/1571723771","heartbeat_back_addr":"172.21.15.153:6815/1571723771","heartbeat_front_addr":"172.21.15.153:6813/1571723771","state":["exists","up"]},{"osd":7,"uuid":"a617f7db-d938-42ab-bf23-1c84983fe4b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6801","nonce":1880471407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6803","nonce":1880471407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6807","nonce":1880471407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":1880471407},{"type":"v1","addr":"172.21.15.153:6805","nonce":1880471407}]},"public_addr":"172.21.15.153:6801/1880471407","cluster_addr":"172.21.15.153:6803/1880471407","heartbeat_back_addr":"172.21.15.153:6807/1880471407","heartbeat_front_addr":"172.21.15.153:6805/1880471407","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.876198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.611738+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.865948+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.812023+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:15.098612+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:15.038933+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.690178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T18:26:14.470574+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":4,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.1b","mappings":[{"from":0,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2},{"from":7,"to":6}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"67.d","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T19:14:01.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-12T19:14:01.726 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T19:14:01.726 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:14:01.888 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T19:14:01.888 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:14:01.888 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T19:14:01.905 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T19:14:02.197 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T19:14:02.216 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T19:14:02.216 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:14:02.351 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T19:14:02.351 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:14:02.351 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T19:14:02.366 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T19:14:02.652 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T19:14:02.670 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T19:14:02.670 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:14:02.820 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T19:14:02.820 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:14:02.820 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T19:14:02.836 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T19:14:03.135 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T19:14:03.155 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T19:14:03.155 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:14:03.308 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T19:14:03.308 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:14:03.308 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T19:14:03.325 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T19:14:03.616 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T19:14:03.634 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T19:14:03.634 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:14:03.774 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T19:14:03.774 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:14:03.775 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T19:14:03.790 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T19:14:04.083 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T19:14:04.102 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T19:14:04.103 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:14:04.253 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T19:14:04.253 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:14:04.253 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T19:14:04.269 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T19:14:04.567 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T19:14:04.586 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T19:14:04.587 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:14:04.734 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T19:14:04.735 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:14:04.735 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T19:14:04.749 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T19:14:05.050 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T19:14:05.071 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T19:14:05.071 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T19:14:05.216 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-12T19:14:05.216 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T19:14:05.216 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-12T19:14:05.231 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T19:14:05.519 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T19:14:05.539 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:14:05.869 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:14:05.903 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-09-12T19:14:05.919 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":1691,"stamp":"2024-09-12T19:14:04.441119+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":66372370,"num_objects":839,"num_object_clones":0,"num_object_copies":1678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":839,"num_whiteouts":0,"num_read":289963,"num_read_kb":2550992,"num_write":161318,"num_write_kb":2466794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13683,"ondisk_log_size":13683,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1608840,"kb_used_data":156232,"kb_used_omap":12,"kb_used_meta":1451315,"kb_avail":753365880,"statfs":{"total":773094113280,"available":771446661120,"internally_reserved":0,"allocated":159981568,"data_stored":146892046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1486147123},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-652246246,"num_objects":-4155,"num_object_clones":0,"num_object_copies":-8310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4155,"num_whiteouts":0,"num_read":4639,"num_read_kb":4132,"num_write":4404,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005846"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.893148+0000","last_change":"2024-09-12T18:55:19.125750+0000","last_active":"2024-09-12T19:10:18.893148+0000","last_peered":"2024-09-12T19:10:18.893148+0000","last_clean":"2024-09-12T19:10:18.893148+0000","last_became_active":"2024-09-12T18:55:19.125009+0000","last_became_peered":"2024-09-12T18:55:19.125009+0000","last_unstale":"2024-09-12T19:10:18.893148+0000","last_undegraded":"2024-09-12T19:10:18.893148+0000","last_fullsized":"2024-09-12T19:10:18.893148+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:07.599229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.902941+0000","last_change":"2024-09-12T18:43:32.909745+0000","last_active":"2024-09-12T19:11:03.902941+0000","last_peered":"2024-09-12T19:11:03.902941+0000","last_clean":"2024-09-12T19:11:03.902941+0000","last_became_active":"2024-09-12T18:43:32.908691+0000","last_became_peered":"2024-09-12T18:43:32.908691+0000","last_unstale":"2024-09-12T19:11:03.902941+0000","last_undegraded":"2024-09-12T19:11:03.902941+0000","last_fullsized":"2024-09-12T19:11:03.902941+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:19.818191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.926901+0000","last_change":"2024-09-12T18:43:29.867175+0000","last_active":"2024-09-12T19:10:58.926901+0000","last_peered":"2024-09-12T19:10:58.926901+0000","last_clean":"2024-09-12T19:10:58.926901+0000","last_became_active":"2024-09-12T18:43:29.866493+0000","last_became_peered":"2024-09-12T18:43:29.866493+0000","last_unstale":"2024-09-12T19:10:58.926901+0000","last_undegraded":"2024-09-12T19:10:58.926901+0000","last_fullsized":"2024-09-12T19:10:58.926901+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:56.771077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'18","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.928758+0000","last_change":"2024-09-12T18:41:45.362583+0000","last_active":"2024-09-12T19:10:58.928758+0000","last_peered":"2024-09-12T19:10:58.928758+0000","last_clean":"2024-09-12T19:10:58.928758+0000","last_became_active":"2024-09-12T18:41:45.361841+0000","last_became_peered":"2024-09-12T18:41:45.361841+0000","last_unstale":"2024-09-12T19:10:58.928758+0000","last_undegraded":"2024-09-12T19:10:58.928758+0000","last_fullsized":"2024-09-12T19:10:58.928758+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:31.032849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":66,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.881812+0000","last_change":"2024-09-12T18:55:19.153318+0000","last_active":"2024-09-12T19:10:18.881812+0000","last_peered":"2024-09-12T19:10:18.881812+0000","last_clean":"2024-09-12T19:10:18.881812+0000","last_became_active":"2024-09-12T18:55:19.150059+0000","last_became_peered":"2024-09-12T18:55:19.150059+0000","last_unstale":"2024-09-12T19:10:18.881812+0000","last_undegraded":"2024-09-12T19:10:18.881812+0000","last_fullsized":"2024-09-12T19:10:18.881812+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:04.495819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'4","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:34.145528+0000","last_change":"2024-09-12T18:43:32.905639+0000","last_active":"2024-09-12T19:13:34.145528+0000","last_peered":"2024-09-12T19:13:34.145528+0000","last_clean":"2024-09-12T19:13:34.145528+0000","last_became_active":"2024-09-12T18:43:32.904914+0000","last_became_peered":"2024-09-12T18:43:32.904914+0000","last_unstale":"2024-09-12T19:13:34.145528+0000","last_undegraded":"2024-09-12T19:13:34.145528+0000","last_fullsized":"2024-09-12T19:13:34.145528+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:47.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:32.741144+0000","last_change":"2024-09-12T18:43:29.895683+0000","last_active":"2024-09-12T19:13:32.741144+0000","last_peered":"2024-09-12T19:13:32.741144+0000","last_clean":"2024-09-12T19:13:32.741144+0000","last_became_active":"2024-09-12T18:43:29.891221+0000","last_became_peered":"2024-09-12T18:43:29.891221+0000","last_unstale":"2024-09-12T19:13:32.741144+0000","last_undegraded":"2024-09-12T19:13:32.741144+0000","last_fullsized":"2024-09-12T19:13:32.741144+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:28.583040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'32","reported_seq":138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.719152+0000","last_change":"2024-09-12T18:41:45.362441+0000","last_active":"2024-09-12T19:11:58.719152+0000","last_peered":"2024-09-12T19:11:58.719152+0000","last_clean":"2024-09-12T19:11:58.719152+0000","last_became_active":"2024-09-12T18:41:45.361664+0000","last_became_peered":"2024-09-12T18:41:45.361664+0000","last_unstale":"2024-09-12T19:11:58.719152+0000","last_undegraded":"2024-09-12T19:11:58.719152+0000","last_fullsized":"2024-09-12T19:11:58.719152+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:16.353573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.888584+0000","last_change":"2024-09-12T18:55:19.120410+0000","last_active":"2024-09-12T19:09:48.888584+0000","last_peered":"2024-09-12T19:09:48.888584+0000","last_clean":"2024-09-12T19:09:48.888584+0000","last_became_active":"2024-09-12T18:55:19.119601+0000","last_became_peered":"2024-09-12T18:55:19.119601+0000","last_unstale":"2024-09-12T19:09:48.888584+0000","last_undegraded":"2024-09-12T19:09:48.888584+0000","last_fullsized":"2024-09-12T19:09:48.888584+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:00.200110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'8","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.956039+0000","last_change":"2024-09-12T18:43:32.917442+0000","last_active":"2024-09-12T19:12:43.956039+0000","last_peered":"2024-09-12T19:12:43.956039+0000","last_clean":"2024-09-12T19:12:43.956039+0000","last_became_active":"2024-09-12T18:43:32.916727+0000","last_became_peered":"2024-09-12T18:43:32.916727+0000","last_unstale":"2024-09-12T19:12:43.956039+0000","last_undegraded":"2024-09-12T19:12:43.956039+0000","last_fullsized":"2024-09-12T19:12:43.956039+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:51.785407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"265'17","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.700779+0000","last_change":"2024-09-12T18:43:29.884424+0000","last_active":"2024-09-12T19:13:57.700779+0000","last_peered":"2024-09-12T19:13:57.700779+0000","last_clean":"2024-09-12T19:13:57.700779+0000","last_became_active":"2024-09-12T18:43:29.881401+0000","last_became_peered":"2024-09-12T18:43:29.881401+0000","last_unstale":"2024-09-12T19:13:57.700779+0000","last_undegraded":"2024-09-12T19:13:57.700779+0000","last_fullsized":"2024-09-12T19:13:57.700779+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:45.030211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":40962,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'47","reported_seq":173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:04.762249+0000","last_change":"2024-09-12T18:41:45.360114+0000","last_active":"2024-09-12T19:10:04.762249+0000","last_peered":"2024-09-12T19:10:04.762249+0000","last_clean":"2024-09-12T19:10:04.762249+0000","last_became_active":"2024-09-12T18:41:45.350377+0000","last_became_peered":"2024-09-12T18:41:45.350377+0000","last_unstale":"2024-09-12T19:10:04.762249+0000","last_undegraded":"2024-09-12T19:10:04.762249+0000","last_fullsized":"2024-09-12T19:10:04.762249+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:15.485612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":164,"num_write":88,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.910960+0000","last_change":"2024-09-12T18:55:19.136469+0000","last_active":"2024-09-12T19:09:53.910960+0000","last_peered":"2024-09-12T19:09:53.910960+0000","last_clean":"2024-09-12T19:09:53.910960+0000","last_became_active":"2024-09-12T18:55:19.135875+0000","last_became_peered":"2024-09-12T18:55:19.135875+0000","last_unstale":"2024-09-12T19:09:53.910960+0000","last_undegraded":"2024-09-12T19:09:53.910960+0000","last_fullsized":"2024-09-12T19:09:53.910960+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:50.008510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.741846+0000","last_change":"2024-09-12T18:43:32.939294+0000","last_active":"2024-09-12T19:13:43.741846+0000","last_peered":"2024-09-12T19:13:43.741846+0000","last_clean":"2024-09-12T19:13:43.741846+0000","last_became_active":"2024-09-12T18:43:32.935176+0000","last_became_peered":"2024-09-12T18:43:32.935176+0000","last_unstale":"2024-09-12T19:13:43.741846+0000","last_undegraded":"2024-09-12T19:13:43.741846+0000","last_fullsized":"2024-09-12T19:13:43.741846+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:27.896775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.348285+0000","last_change":"2024-09-12T18:43:29.873805+0000","last_active":"2024-09-12T19:13:57.348285+0000","last_peered":"2024-09-12T19:13:57.348285+0000","last_clean":"2024-09-12T19:13:57.348285+0000","last_became_active":"2024-09-12T18:43:29.873115+0000","last_became_peered":"2024-09-12T18:43:29.873115+0000","last_unstale":"2024-09-12T19:13:57.348285+0000","last_undegraded":"2024-09-12T19:13:57.348285+0000","last_fullsized":"2024-09-12T19:13:57.348285+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:22.098039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'47","reported_seq":168,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.878251+0000","last_change":"2024-09-12T18:41:45.350781+0000","last_active":"2024-09-12T19:11:19.878251+0000","last_peered":"2024-09-12T19:11:19.878251+0000","last_clean":"2024-09-12T19:11:19.878251+0000","last_became_active":"2024-09-12T18:41:45.350035+0000","last_became_peered":"2024-09-12T18:41:45.350035+0000","last_unstale":"2024-09-12T19:11:19.878251+0000","last_undegraded":"2024-09-12T19:11:19.878251+0000","last_fullsized":"2024-09-12T19:11:19.878251+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:17:07.679045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":157,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:28.712218+0000","last_change":"2024-09-12T18:55:19.157689+0000","last_active":"2024-09-12T19:11:28.712218+0000","last_peered":"2024-09-12T19:11:28.712218+0000","last_clean":"2024-09-12T19:11:28.712218+0000","last_became_active":"2024-09-12T18:55:19.156936+0000","last_became_peered":"2024-09-12T18:55:19.156936+0000","last_unstale":"2024-09-12T19:11:28.712218+0000","last_undegraded":"2024-09-12T19:11:28.712218+0000","last_fullsized":"2024-09-12T19:11:28.712218+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:02.316107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.893085+0000","last_change":"2024-09-12T18:43:32.931532+0000","last_active":"2024-09-12T19:10:18.893085+0000","last_peered":"2024-09-12T19:10:18.893085+0000","last_clean":"2024-09-12T19:10:18.893085+0000","last_became_active":"2024-09-12T18:43:32.930772+0000","last_became_peered":"2024-09-12T18:43:32.930772+0000","last_unstale":"2024-09-12T19:10:18.893085+0000","last_undegraded":"2024-09-12T19:10:18.893085+0000","last_fullsized":"2024-09-12T19:10:18.893085+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:02.364155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:33.952929+0000","last_change":"2024-09-12T18:43:29.884425+0000","last_active":"2024-09-12T19:12:33.952929+0000","last_peered":"2024-09-12T19:12:33.952929+0000","last_clean":"2024-09-12T19:12:33.952929+0000","last_became_active":"2024-09-12T18:43:29.883399+0000","last_became_peered":"2024-09-12T18:43:29.883399+0000","last_unstale":"2024-09-12T19:12:33.952929+0000","last_undegraded":"2024-09-12T19:12:33.952929+0000","last_fullsized":"2024-09-12T19:12:33.952929+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:31.245225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'25","reported_seq":116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:31.792096+0000","last_change":"2024-09-12T18:41:45.359067+0000","last_active":"2024-09-12T19:10:31.792096+0000","last_peered":"2024-09-12T19:10:31.792096+0000","last_clean":"2024-09-12T19:10:31.792096+0000","last_became_active":"2024-09-12T18:41:45.355180+0000","last_became_peered":"2024-09-12T18:41:45.355180+0000","last_unstale":"2024-09-12T19:10:31.792096+0000","last_undegraded":"2024-09-12T19:10:31.792096+0000","last_fullsized":"2024-09-12T19:10:31.792096+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:28:27.390592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:57.900836+0000","last_change":"2024-09-12T18:55:19.139208+0000","last_active":"2024-09-12T19:09:57.900836+0000","last_peered":"2024-09-12T19:09:57.900836+0000","last_clean":"2024-09-12T19:09:57.900836+0000","last_became_active":"2024-09-12T18:55:19.138472+0000","last_became_peered":"2024-09-12T18:55:19.138472+0000","last_unstale":"2024-09-12T19:09:57.900836+0000","last_undegraded":"2024-09-12T19:09:57.900836+0000","last_fullsized":"2024-09-12T19:09:57.900836+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:46.378454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.893333+0000","last_change":"2024-09-12T18:43:32.936388+0000","last_active":"2024-09-12T19:10:08.893333+0000","last_peered":"2024-09-12T19:10:08.893333+0000","last_clean":"2024-09-12T19:10:08.893333+0000","last_became_active":"2024-09-12T18:43:32.935898+0000","last_became_peered":"2024-09-12T18:43:32.935898+0000","last_unstale":"2024-09-12T19:10:08.893333+0000","last_undegraded":"2024-09-12T19:10:08.893333+0000","last_fullsized":"2024-09-12T19:10:08.893333+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:23.395289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'2","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:34.132279+0000","last_change":"2024-09-12T18:43:29.885221+0000","last_active":"2024-09-12T19:12:34.132279+0000","last_peered":"2024-09-12T19:12:34.132279+0000","last_clean":"2024-09-12T19:12:34.132279+0000","last_became_active":"2024-09-12T18:43:29.882621+0000","last_became_peered":"2024-09-12T18:43:29.882621+0000","last_unstale":"2024-09-12T19:12:34.132279+0000","last_undegraded":"2024-09-12T19:12:34.132279+0000","last_fullsized":"2024-09-12T19:12:34.132279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:41.071383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'16","reported_seq":90,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.882329+0000","last_change":"2024-09-12T18:41:45.358702+0000","last_active":"2024-09-12T19:09:18.882329+0000","last_peered":"2024-09-12T19:09:18.882329+0000","last_clean":"2024-09-12T19:09:18.882329+0000","last_became_active":"2024-09-12T18:41:45.357957+0000","last_became_peered":"2024-09-12T18:41:45.357957+0000","last_unstale":"2024-09-12T19:09:18.882329+0000","last_undegraded":"2024-09-12T19:09:18.882329+0000","last_fullsized":"2024-09-12T19:09:18.882329+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:45.441066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":53,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899753+0000","last_change":"2024-09-12T18:55:19.148993+0000","last_active":"2024-09-12T19:10:22.899753+0000","last_peered":"2024-09-12T19:10:22.899753+0000","last_clean":"2024-09-12T19:10:22.899753+0000","last_became_active":"2024-09-12T18:55:19.147110+0000","last_became_peered":"2024-09-12T18:55:19.147110+0000","last_unstale":"2024-09-12T19:10:22.899753+0000","last_undegraded":"2024-09-12T19:10:22.899753+0000","last_fullsized":"2024-09-12T19:10:22.899753+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:46.858987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.905541+0000","last_change":"2024-09-12T18:43:32.923207+0000","last_active":"2024-09-12T19:11:03.905541+0000","last_peered":"2024-09-12T19:11:03.905541+0000","last_clean":"2024-09-12T19:11:03.905541+0000","last_became_active":"2024-09-12T18:43:32.922514+0000","last_became_peered":"2024-09-12T18:43:32.922514+0000","last_unstale":"2024-09-12T19:11:03.905541+0000","last_undegraded":"2024-09-12T19:11:03.905541+0000","last_fullsized":"2024-09-12T19:11:03.905541+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:30.175347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'6","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:34.145443+0000","last_change":"2024-09-12T18:43:29.905017+0000","last_active":"2024-09-12T19:13:34.145443+0000","last_peered":"2024-09-12T19:13:34.145443+0000","last_clean":"2024-09-12T19:13:34.145443+0000","last_became_active":"2024-09-12T18:43:29.904226+0000","last_became_peered":"2024-09-12T18:43:29.904226+0000","last_unstale":"2024-09-12T19:13:34.145443+0000","last_undegraded":"2024-09-12T19:13:34.145443+0000","last_fullsized":"2024-09-12T19:13:34.145443+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:47.238023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'21","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:53.927298+0000","last_change":"2024-09-12T18:41:45.359716+0000","last_active":"2024-09-12T19:10:53.927298+0000","last_peered":"2024-09-12T19:10:53.927298+0000","last_clean":"2024-09-12T19:10:53.927298+0000","last_became_active":"2024-09-12T18:41:45.351791+0000","last_became_peered":"2024-09-12T18:41:45.351791+0000","last_unstale":"2024-09-12T19:10:53.927298+0000","last_undegraded":"2024-09-12T19:10:53.927298+0000","last_fullsized":"2024-09-12T19:10:53.927298+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:10.883167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899885+0000","last_change":"2024-09-12T18:55:19.149601+0000","last_active":"2024-09-12T19:10:22.899885+0000","last_peered":"2024-09-12T19:10:22.899885+0000","last_clean":"2024-09-12T19:10:22.899885+0000","last_became_active":"2024-09-12T18:55:19.148859+0000","last_became_peered":"2024-09-12T18:55:19.148859+0000","last_unstale":"2024-09-12T19:10:22.899885+0000","last_undegraded":"2024-09-12T19:10:22.899885+0000","last_fullsized":"2024-09-12T19:10:22.899885+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:12.702998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:33.738891+0000","last_change":"2024-09-12T18:43:32.937883+0000","last_active":"2024-09-12T19:13:33.738891+0000","last_peered":"2024-09-12T19:13:33.738891+0000","last_clean":"2024-09-12T19:13:33.738891+0000","last_became_active":"2024-09-12T18:43:32.935669+0000","last_became_peered":"2024-09-12T18:43:32.935669+0000","last_unstale":"2024-09-12T19:13:33.738891+0000","last_undegraded":"2024-09-12T19:13:33.738891+0000","last_fullsized":"2024-09-12T19:13:33.738891+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:02.525737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'5","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.347912+0000","last_change":"2024-09-12T18:43:29.884274+0000","last_active":"2024-09-12T19:13:57.347912+0000","last_peered":"2024-09-12T19:13:57.347912+0000","last_clean":"2024-09-12T19:13:57.347912+0000","last_became_active":"2024-09-12T18:43:29.883324+0000","last_became_peered":"2024-09-12T18:43:29.883324+0000","last_unstale":"2024-09-12T19:13:57.347912+0000","last_undegraded":"2024-09-12T19:13:57.347912+0000","last_fullsized":"2024-09-12T19:13:57.347912+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.971344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'60","reported_seq":219,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:14.482064+0000","last_change":"2024-09-12T18:41:45.345965+0000","last_active":"2024-09-12T19:11:14.482064+0000","last_peered":"2024-09-12T19:11:14.482064+0000","last_clean":"2024-09-12T19:11:14.482064+0000","last_became_active":"2024-09-12T18:41:45.339369+0000","last_became_peered":"2024-09-12T18:41:45.339369+0000","last_unstale":"2024-09-12T19:11:14.482064+0000","last_undegraded":"2024-09-12T19:11:14.482064+0000","last_fullsized":"2024-09-12T19:11:14.482064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:10.411652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":229,"num_write":103,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.717962+0000","last_change":"2024-09-12T18:55:19.123103+0000","last_active":"2024-09-12T19:11:42.717962+0000","last_peered":"2024-09-12T19:11:42.717962+0000","last_clean":"2024-09-12T19:11:42.717962+0000","last_became_active":"2024-09-12T18:55:19.122414+0000","last_became_peered":"2024-09-12T18:55:19.122414+0000","last_unstale":"2024-09-12T19:11:42.717962+0000","last_undegraded":"2024-09-12T19:11:42.717962+0000","last_fullsized":"2024-09-12T19:11:42.717962+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.491501+0000","last_change":"2024-09-12T18:43:32.927238+0000","last_active":"2024-09-12T19:13:57.491501+0000","last_peered":"2024-09-12T19:13:57.491501+0000","last_clean":"2024-09-12T19:13:57.491501+0000","last_became_active":"2024-09-12T18:43:32.924570+0000","last_became_peered":"2024-09-12T18:43:32.924570+0000","last_unstale":"2024-09-12T19:13:57.491501+0000","last_undegraded":"2024-09-12T19:13:57.491501+0000","last_fullsized":"2024-09-12T19:13:57.491501+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:12.682450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.564434+0000","last_change":"2024-09-12T18:43:29.869397+0000","last_active":"2024-09-12T19:13:57.564434+0000","last_peered":"2024-09-12T19:13:57.564434+0000","last_clean":"2024-09-12T19:13:57.564434+0000","last_became_active":"2024-09-12T18:43:29.868738+0000","last_became_peered":"2024-09-12T18:43:29.868738+0000","last_unstale":"2024-09-12T19:13:57.564434+0000","last_undegraded":"2024-09-12T19:13:57.564434+0000","last_fullsized":"2024-09-12T19:13:57.564434+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:27.215594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'11","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.926325+0000","last_change":"2024-09-12T18:41:45.352288+0000","last_active":"2024-09-12T19:10:48.926325+0000","last_peered":"2024-09-12T19:10:48.926325+0000","last_clean":"2024-09-12T19:10:48.926325+0000","last_became_active":"2024-09-12T18:41:45.351553+0000","last_became_peered":"2024-09-12T18:41:45.351553+0000","last_unstale":"2024-09-12T19:10:48.926325+0000","last_undegraded":"2024-09-12T19:10:48.926325+0000","last_fullsized":"2024-09-12T19:10:48.926325+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:04.726575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":29,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.714544+0000","last_change":"2024-09-12T18:55:19.139323+0000","last_active":"2024-09-12T19:11:38.714544+0000","last_peered":"2024-09-12T19:11:38.714544+0000","last_clean":"2024-09-12T19:11:38.714544+0000","last_became_active":"2024-09-12T18:55:19.138649+0000","last_became_peered":"2024-09-12T18:55:19.138649+0000","last_unstale":"2024-09-12T19:11:38.714544+0000","last_undegraded":"2024-09-12T19:11:38.714544+0000","last_fullsized":"2024-09-12T19:11:38.714544+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:14.966478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.777391+0000","last_change":"2024-09-12T18:43:32.928110+0000","last_active":"2024-09-12T19:13:57.777391+0000","last_peered":"2024-09-12T19:13:57.777391+0000","last_clean":"2024-09-12T19:13:57.777391+0000","last_became_active":"2024-09-12T18:43:32.927181+0000","last_became_peered":"2024-09-12T18:43:32.927181+0000","last_unstale":"2024-09-12T19:13:57.777391+0000","last_undegraded":"2024-09-12T19:13:57.777391+0000","last_fullsized":"2024-09-12T19:13:57.777391+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'8","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.896153+0000","last_change":"2024-09-12T18:43:29.895323+0000","last_active":"2024-09-12T19:10:07.896153+0000","last_peered":"2024-09-12T19:10:07.896153+0000","last_clean":"2024-09-12T19:10:07.896153+0000","last_became_active":"2024-09-12T18:43:29.894650+0000","last_became_peered":"2024-09-12T18:43:29.894650+0000","last_unstale":"2024-09-12T19:10:07.896153+0000","last_undegraded":"2024-09-12T19:10:07.896153+0000","last_fullsized":"2024-09-12T19:10:07.896153+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:51.742629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8194,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'29","reported_seq":121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.891219+0000","last_change":"2024-09-12T18:41:45.361458+0000","last_active":"2024-09-12T19:11:19.891219+0000","last_peered":"2024-09-12T19:11:19.891219+0000","last_clean":"2024-09-12T19:11:19.891219+0000","last_became_active":"2024-09-12T18:41:45.360856+0000","last_became_peered":"2024-09-12T18:41:45.360856+0000","last_unstale":"2024-09-12T19:11:19.891219+0000","last_undegraded":"2024-09-12T19:11:19.891219+0000","last_fullsized":"2024-09-12T19:11:19.891219+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.915436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":92,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.918501+0000","last_change":"2024-09-12T18:55:19.126091+0000","last_active":"2024-09-12T19:11:42.918501+0000","last_peered":"2024-09-12T19:11:42.918501+0000","last_clean":"2024-09-12T19:11:42.918501+0000","last_became_active":"2024-09-12T18:55:19.123727+0000","last_became_peered":"2024-09-12T18:55:19.123727+0000","last_unstale":"2024-09-12T19:11:42.918501+0000","last_undegraded":"2024-09-12T19:11:42.918501+0000","last_fullsized":"2024-09-12T19:11:42.918501+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:20.999734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.914770+0000","last_change":"2024-09-12T18:43:32.935321+0000","last_active":"2024-09-12T19:10:08.914770+0000","last_peered":"2024-09-12T19:10:08.914770+0000","last_clean":"2024-09-12T19:10:08.914770+0000","last_became_active":"2024-09-12T18:43:32.934654+0000","last_became_peered":"2024-09-12T18:43:32.934654+0000","last_unstale":"2024-09-12T19:10:08.914770+0000","last_undegraded":"2024-09-12T19:10:08.914770+0000","last_fullsized":"2024-09-12T19:10:08.914770+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:18.460691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'4","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.821326+0000","last_change":"2024-09-12T18:43:29.865882+0000","last_active":"2024-09-12T19:13:57.821326+0000","last_peered":"2024-09-12T19:13:57.821326+0000","last_clean":"2024-09-12T19:13:57.821326+0000","last_became_active":"2024-09-12T18:43:29.863876+0000","last_became_peered":"2024-09-12T18:43:29.863876+0000","last_unstale":"2024-09-12T19:13:57.821326+0000","last_undegraded":"2024-09-12T19:13:57.821326+0000","last_fullsized":"2024-09-12T19:13:57.821326+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:17.118378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'15","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.888129+0000","last_change":"2024-09-12T18:41:45.347581+0000","last_active":"2024-09-12T19:10:48.888129+0000","last_peered":"2024-09-12T19:10:48.888129+0000","last_clean":"2024-09-12T19:10:48.888129+0000","last_became_active":"2024-09-12T18:41:45.346831+0000","last_became_peered":"2024-09-12T18:41:45.346831+0000","last_unstale":"2024-09-12T19:10:48.888129+0000","last_undegraded":"2024-09-12T19:10:48.888129+0000","last_fullsized":"2024-09-12T19:10:48.888129+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:46.368160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":48,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.910328+0000","last_change":"2024-09-12T18:55:19.129602+0000","last_active":"2024-09-12T19:11:38.910328+0000","last_peered":"2024-09-12T19:11:38.910328+0000","last_clean":"2024-09-12T19:11:38.910328+0000","last_became_active":"2024-09-12T18:55:19.125607+0000","last_became_peered":"2024-09-12T18:55:19.125607+0000","last_unstale":"2024-09-12T19:11:38.910328+0000","last_undegraded":"2024-09-12T19:11:38.910328+0000","last_fullsized":"2024-09-12T19:11:38.910328+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:37.974980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'4","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.442728+0000","last_change":"2024-09-12T18:43:32.909634+0000","last_active":"2024-09-12T19:13:57.442728+0000","last_peered":"2024-09-12T19:13:57.442728+0000","last_clean":"2024-09-12T19:13:57.442728+0000","last_became_active":"2024-09-12T18:43:32.908905+0000","last_became_peered":"2024-09-12T18:43:32.908905+0000","last_unstale":"2024-09-12T19:13:57.442728+0000","last_undegraded":"2024-09-12T19:13:57.442728+0000","last_fullsized":"2024-09-12T19:13:57.442728+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:55.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'7","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:33.953479+0000","last_change":"2024-09-12T18:43:29.883172+0000","last_active":"2024-09-12T19:12:33.953479+0000","last_peered":"2024-09-12T19:12:33.953479+0000","last_clean":"2024-09-12T19:12:33.953479+0000","last_became_active":"2024-09-12T18:43:29.880462+0000","last_became_peered":"2024-09-12T18:43:29.880462+0000","last_unstale":"2024-09-12T19:12:33.953479+0000","last_undegraded":"2024-09-12T19:12:33.953479+0000","last_fullsized":"2024-09-12T19:12:33.953479+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.795034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'6","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:57.892839+0000","last_change":"2024-09-12T18:41:45.360552+0000","last_active":"2024-09-12T19:09:57.892839+0000","last_peered":"2024-09-12T19:09:57.892839+0000","last_clean":"2024-09-12T19:09:57.892839+0000","last_became_active":"2024-09-12T18:41:45.359794+0000","last_became_peered":"2024-09-12T18:41:45.359794+0000","last_unstale":"2024-09-12T19:09:57.892839+0000","last_undegraded":"2024-09-12T19:09:57.892839+0000","last_fullsized":"2024-09-12T19:09:57.892839+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:00.750042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.910032+0000","last_change":"2024-09-12T18:55:19.154082+0000","last_active":"2024-09-12T19:09:48.910032+0000","last_peered":"2024-09-12T19:09:48.910032+0000","last_clean":"2024-09-12T19:09:48.910032+0000","last_became_active":"2024-09-12T18:55:19.152807+0000","last_became_peered":"2024-09-12T18:55:19.152807+0000","last_unstale":"2024-09-12T19:09:48.910032+0000","last_undegraded":"2024-09-12T19:09:48.910032+0000","last_fullsized":"2024-09-12T19:09:48.910032+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:33.926655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715438+0000","last_change":"2024-09-12T18:43:32.903978+0000","last_active":"2024-09-12T19:11:32.715438+0000","last_peered":"2024-09-12T19:11:32.715438+0000","last_clean":"2024-09-12T19:11:32.715438+0000","last_became_active":"2024-09-12T18:43:32.899988+0000","last_became_peered":"2024-09-12T18:43:32.899988+0000","last_unstale":"2024-09-12T19:11:32.715438+0000","last_undegraded":"2024-09-12T19:11:32.715438+0000","last_fullsized":"2024-09-12T19:11:32.715438+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:49.693725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:54.149724+0000","last_change":"2024-09-12T18:43:29.881020+0000","last_active":"2024-09-12T19:13:54.149724+0000","last_peered":"2024-09-12T19:13:54.149724+0000","last_clean":"2024-09-12T19:13:54.149724+0000","last_became_active":"2024-09-12T18:43:29.880294+0000","last_became_peered":"2024-09-12T18:43:29.880294+0000","last_unstale":"2024-09-12T19:13:54.149724+0000","last_undegraded":"2024-09-12T19:13:54.149724+0000","last_fullsized":"2024-09-12T19:13:54.149724+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:23.505932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'33","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:47.890460+0000","last_change":"2024-09-12T18:41:45.360139+0000","last_active":"2024-09-12T19:09:47.890460+0000","last_peered":"2024-09-12T19:09:47.890460+0000","last_clean":"2024-09-12T19:09:47.890460+0000","last_became_active":"2024-09-12T18:41:45.359405+0000","last_became_peered":"2024-09-12T18:41:45.359405+0000","last_unstale":"2024-09-12T19:09:47.890460+0000","last_undegraded":"2024-09-12T19:09:47.890460+0000","last_fullsized":"2024-09-12T19:09:47.890460+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:10.135901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":128,"num_write":57,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.911259+0000","last_change":"2024-09-12T18:55:19.139048+0000","last_active":"2024-09-12T19:09:48.911259+0000","last_peered":"2024-09-12T19:09:48.911259+0000","last_clean":"2024-09-12T19:09:48.911259+0000","last_became_active":"2024-09-12T18:55:19.136822+0000","last_became_peered":"2024-09-12T18:55:19.136822+0000","last_unstale":"2024-09-12T19:09:48.911259+0000","last_undegraded":"2024-09-12T19:09:48.911259+0000","last_fullsized":"2024-09-12T19:09:48.911259+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:07.426373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715353+0000","last_change":"2024-09-12T18:43:32.908035+0000","last_active":"2024-09-12T19:11:32.715353+0000","last_peered":"2024-09-12T19:11:32.715353+0000","last_clean":"2024-09-12T19:11:32.715353+0000","last_became_active":"2024-09-12T18:43:32.906911+0000","last_became_peered":"2024-09-12T18:43:32.906911+0000","last_unstale":"2024-09-12T19:11:32.715353+0000","last_undegraded":"2024-09-12T19:11:32.715353+0000","last_fullsized":"2024-09-12T19:11:32.715353+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:23.186205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"265'6","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:48.743023+0000","last_change":"2024-09-12T18:43:29.874437+0000","last_active":"2024-09-12T19:13:48.743023+0000","last_peered":"2024-09-12T19:13:48.743023+0000","last_clean":"2024-09-12T19:13:48.743023+0000","last_became_active":"2024-09-12T18:43:29.873561+0000","last_became_peered":"2024-09-12T18:43:29.873561+0000","last_unstale":"2024-09-12T19:13:48.743023+0000","last_undegraded":"2024-09-12T19:13:48.743023+0000","last_fullsized":"2024-09-12T19:13:48.743023+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:09.170136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'40","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.911052+0000","last_change":"2024-09-12T18:41:45.359990+0000","last_active":"2024-09-12T19:09:48.911052+0000","last_peered":"2024-09-12T19:09:48.911052+0000","last_clean":"2024-09-12T19:09:48.911052+0000","last_became_active":"2024-09-12T18:41:45.352482+0000","last_became_peered":"2024-09-12T18:41:45.352482+0000","last_unstale":"2024-09-12T19:09:48.911052+0000","last_undegraded":"2024-09-12T19:09:48.911052+0000","last_fullsized":"2024-09-12T19:09:48.911052+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:23.809564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:23.904477+0000","last_change":"2024-09-12T18:55:19.135873+0000","last_active":"2024-09-12T19:09:23.904477+0000","last_peered":"2024-09-12T19:09:23.904477+0000","last_clean":"2024-09-12T19:09:23.904477+0000","last_became_active":"2024-09-12T18:55:19.132991+0000","last_became_peered":"2024-09-12T18:55:19.132991+0000","last_unstale":"2024-09-12T19:09:23.904477+0000","last_undegraded":"2024-09-12T19:09:23.904477+0000","last_fullsized":"2024-09-12T19:09:23.904477+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:18.775245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'8","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:53.744198+0000","last_change":"2024-09-12T18:43:32.934314+0000","last_active":"2024-09-12T19:13:53.744198+0000","last_peered":"2024-09-12T19:13:53.744198+0000","last_clean":"2024-09-12T19:13:53.744198+0000","last_became_active":"2024-09-12T18:43:32.927109+0000","last_became_peered":"2024-09-12T18:43:32.927109+0000","last_unstale":"2024-09-12T19:13:53.744198+0000","last_undegraded":"2024-09-12T19:13:53.744198+0000","last_fullsized":"2024-09-12T19:13:53.744198+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:58.923503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":28674,"num_write":8,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:53.944654+0000","last_change":"2024-09-12T18:43:29.881351+0000","last_active":"2024-09-12T19:13:53.944654+0000","last_peered":"2024-09-12T19:13:53.944654+0000","last_clean":"2024-09-12T19:13:53.944654+0000","last_became_active":"2024-09-12T18:43:29.880517+0000","last_became_peered":"2024-09-12T18:43:29.880517+0000","last_unstale":"2024-09-12T19:13:53.944654+0000","last_undegraded":"2024-09-12T19:13:53.944654+0000","last_fullsized":"2024-09-12T19:13:53.944654+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:07.250936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:49.095887+0000","last_change":"2024-09-12T18:41:45.351776+0000","last_active":"2024-09-12T19:09:49.095887+0000","last_peered":"2024-09-12T19:09:49.095887+0000","last_clean":"2024-09-12T19:09:49.095887+0000","last_became_active":"2024-09-12T18:41:45.350632+0000","last_became_peered":"2024-09-12T18:41:45.350632+0000","last_unstale":"2024-09-12T19:09:49.095887+0000","last_undegraded":"2024-09-12T19:09:49.095887+0000","last_fullsized":"2024-09-12T19:09:49.095887+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:16.702236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.909979+0000","last_change":"2024-09-12T18:55:19.151498+0000","last_active":"2024-09-12T19:09:48.909979+0000","last_peered":"2024-09-12T19:09:48.909979+0000","last_clean":"2024-09-12T19:09:48.909979+0000","last_became_active":"2024-09-12T18:55:19.150880+0000","last_became_peered":"2024-09-12T18:55:19.150880+0000","last_unstale":"2024-09-12T19:09:48.909979+0000","last_undegraded":"2024-09-12T19:09:48.909979+0000","last_fullsized":"2024-09-12T19:09:48.909979+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:13.724232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'16","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.822058+0000","last_change":"2024-09-12T18:43:32.927843+0000","last_active":"2024-09-12T19:13:57.822058+0000","last_peered":"2024-09-12T19:13:57.822058+0000","last_clean":"2024-09-12T19:13:57.822058+0000","last_became_active":"2024-09-12T18:43:32.927270+0000","last_became_peered":"2024-09-12T18:43:32.927270+0000","last_unstale":"2024-09-12T19:13:57.822058+0000","last_undegraded":"2024-09-12T19:13:57.822058+0000","last_fullsized":"2024-09-12T19:13:57.822058+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:30.970671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":38914,"num_write":26,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:48.942548+0000","last_change":"2024-09-12T18:43:29.902339+0000","last_active":"2024-09-12T19:13:48.942548+0000","last_peered":"2024-09-12T19:13:48.942548+0000","last_clean":"2024-09-12T19:13:48.942548+0000","last_became_active":"2024-09-12T18:43:29.901627+0000","last_became_peered":"2024-09-12T18:43:29.901627+0000","last_unstale":"2024-09-12T19:13:48.942548+0000","last_undegraded":"2024-09-12T19:13:48.942548+0000","last_fullsized":"2024-09-12T19:13:48.942548+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:48.203220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'30","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.583951+0000","last_change":"2024-09-12T18:41:45.353240+0000","last_active":"2024-09-12T19:11:19.583951+0000","last_peered":"2024-09-12T19:11:19.583951+0000","last_clean":"2024-09-12T19:11:19.583951+0000","last_became_active":"2024-09-12T18:41:45.350670+0000","last_became_peered":"2024-09-12T18:41:45.350670+0000","last_unstale":"2024-09-12T19:11:19.583951+0000","last_undegraded":"2024-09-12T19:11:19.583951+0000","last_fullsized":"2024-09-12T19:11:19.583951+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:05.567815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.884911+0000","last_change":"2024-09-12T18:55:19.139183+0000","last_active":"2024-09-12T19:10:33.884911+0000","last_peered":"2024-09-12T19:10:33.884911+0000","last_clean":"2024-09-12T19:10:33.884911+0000","last_became_active":"2024-09-12T18:55:19.137332+0000","last_became_peered":"2024-09-12T18:55:19.137332+0000","last_unstale":"2024-09-12T19:10:33.884911+0000","last_undegraded":"2024-09-12T19:10:33.884911+0000","last_fullsized":"2024-09-12T19:10:33.884911+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:17.893526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:28.743525+0000","last_change":"2024-09-12T18:44:13.008362+0000","last_active":"2024-09-12T19:13:28.743525+0000","last_peered":"2024-09-12T19:13:28.743525+0000","last_clean":"2024-09-12T19:13:28.743525+0000","last_became_active":"2024-09-12T18:44:13.007582+0000","last_became_peered":"2024-09-12T18:44:13.007582+0000","last_unstale":"2024-09-12T19:13:28.743525+0000","last_undegraded":"2024-09-12T19:13:28.743525+0000","last_fullsized":"2024-09-12T19:13:28.743525+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:14.811461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.c","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.902160+0000","last_change":"2024-09-12T18:43:29.889784+0000","last_active":"2024-09-12T19:10:32.902160+0000","last_peered":"2024-09-12T19:10:32.902160+0000","last_clean":"2024-09-12T19:10:32.902160+0000","last_became_active":"2024-09-12T18:43:29.888041+0000","last_became_peered":"2024-09-12T18:43:29.888041+0000","last_unstale":"2024-09-12T19:10:32.902160+0000","last_undegraded":"2024-09-12T19:10:32.902160+0000","last_fullsized":"2024-09-12T19:10:32.902160+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:54.352777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'30","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.930272+0000","last_change":"2024-09-12T18:41:45.354909+0000","last_active":"2024-09-12T19:11:08.930272+0000","last_peered":"2024-09-12T19:11:08.930272+0000","last_clean":"2024-09-12T19:11:08.930272+0000","last_became_active":"2024-09-12T18:41:45.354063+0000","last_became_peered":"2024-09-12T18:41:45.354063+0000","last_unstale":"2024-09-12T19:11:08.930272+0000","last_undegraded":"2024-09-12T19:11:08.930272+0000","last_fullsized":"2024-09-12T19:11:08.930272+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:25.031450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910297+0000","last_change":"2024-09-12T18:55:19.140991+0000","last_active":"2024-09-12T19:11:07.910297+0000","last_peered":"2024-09-12T19:11:07.910297+0000","last_clean":"2024-09-12T19:11:07.910297+0000","last_became_active":"2024-09-12T18:55:19.140331+0000","last_became_peered":"2024-09-12T18:55:19.140331+0000","last_unstale":"2024-09-12T19:11:07.910297+0000","last_undegraded":"2024-09-12T19:11:07.910297+0000","last_fullsized":"2024-09-12T19:11:07.910297+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:37.267698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.444004+0000","last_change":"2024-09-12T18:43:32.935314+0000","last_active":"2024-09-12T19:13:57.444004+0000","last_peered":"2024-09-12T19:13:57.444004+0000","last_clean":"2024-09-12T19:13:57.444004+0000","last_became_active":"2024-09-12T18:43:32.934598+0000","last_became_peered":"2024-09-12T18:43:32.934598+0000","last_unstale":"2024-09-12T19:13:57.444004+0000","last_undegraded":"2024-09-12T19:13:57.444004+0000","last_fullsized":"2024-09-12T19:13:57.444004+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:01.163337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.728342+0000","last_change":"2024-09-12T18:43:29.888854+0000","last_active":"2024-09-12T19:12:43.728342+0000","last_peered":"2024-09-12T19:12:43.728342+0000","last_clean":"2024-09-12T19:12:43.728342+0000","last_became_active":"2024-09-12T18:43:29.887500+0000","last_became_peered":"2024-09-12T18:43:29.887500+0000","last_unstale":"2024-09-12T19:12:43.728342+0000","last_undegraded":"2024-09-12T19:12:43.728342+0000","last_fullsized":"2024-09-12T19:12:43.728342+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:09.260023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'32","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.902996+0000","last_change":"2024-09-12T18:41:45.359668+0000","last_active":"2024-09-12T19:11:03.902996+0000","last_peered":"2024-09-12T19:11:03.902996+0000","last_clean":"2024-09-12T19:11:03.902996+0000","last_became_active":"2024-09-12T18:41:45.358914+0000","last_became_peered":"2024-09-12T18:41:45.358914+0000","last_unstale":"2024-09-12T19:11:03.902996+0000","last_undegraded":"2024-09-12T19:11:03.902996+0000","last_fullsized":"2024-09-12T19:11:03.902996+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:07.867252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":122,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.897994+0000","last_change":"2024-09-12T18:55:19.129609+0000","last_active":"2024-09-12T19:10:28.897994+0000","last_peered":"2024-09-12T19:10:28.897994+0000","last_clean":"2024-09-12T19:10:28.897994+0000","last_became_active":"2024-09-12T18:55:19.128236+0000","last_became_peered":"2024-09-12T18:55:19.128236+0000","last_unstale":"2024-09-12T19:10:28.897994+0000","last_undegraded":"2024-09-12T19:10:28.897994+0000","last_fullsized":"2024-09-12T19:10:28.897994+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:53.557810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"265'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.491078+0000","last_change":"2024-09-12T18:43:32.900792+0000","last_active":"2024-09-12T19:13:57.491078+0000","last_peered":"2024-09-12T19:13:57.491078+0000","last_clean":"2024-09-12T19:13:57.491078+0000","last_became_active":"2024-09-12T18:43:32.899943+0000","last_became_peered":"2024-09-12T18:43:32.899943+0000","last_unstale":"2024-09-12T19:13:57.491078+0000","last_undegraded":"2024-09-12T19:13:57.491078+0000","last_fullsized":"2024-09-12T19:13:57.491078+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3444,"num_write":4,"num_write_kb":1722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:48.957143+0000","last_change":"2024-09-12T18:43:29.878465+0000","last_active":"2024-09-12T19:12:48.957143+0000","last_peered":"2024-09-12T19:12:48.957143+0000","last_clean":"2024-09-12T19:12:48.957143+0000","last_became_active":"2024-09-12T18:43:29.877755+0000","last_became_peered":"2024-09-12T18:43:29.877755+0000","last_unstale":"2024-09-12T19:12:48.957143+0000","last_undegraded":"2024-09-12T19:12:48.957143+0000","last_fullsized":"2024-09-12T19:12:48.957143+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:15.949360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4136,"num_write":4,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'17","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.905594+0000","last_change":"2024-09-12T18:41:45.358284+0000","last_active":"2024-09-12T19:11:03.905594+0000","last_peered":"2024-09-12T19:11:03.905594+0000","last_clean":"2024-09-12T19:11:03.905594+0000","last_became_active":"2024-09-12T18:41:45.357562+0000","last_became_peered":"2024-09-12T18:41:45.357562+0000","last_unstale":"2024-09-12T19:11:03.905594+0000","last_undegraded":"2024-09-12T19:11:03.905594+0000","last_fullsized":"2024-09-12T19:11:03.905594+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:45.746519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.902028+0000","last_change":"2024-09-12T18:55:19.137683+0000","last_active":"2024-09-12T19:10:32.902028+0000","last_peered":"2024-09-12T19:10:32.902028+0000","last_clean":"2024-09-12T19:10:32.902028+0000","last_became_active":"2024-09-12T18:55:19.136882+0000","last_became_peered":"2024-09-12T18:55:19.136882+0000","last_unstale":"2024-09-12T19:10:32.902028+0000","last_undegraded":"2024-09-12T19:10:32.902028+0000","last_fullsized":"2024-09-12T19:10:32.902028+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:09.805826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.921042+0000","last_change":"2024-09-12T18:43:32.930996+0000","last_active":"2024-09-12T19:10:33.921042+0000","last_peered":"2024-09-12T19:10:33.921042+0000","last_clean":"2024-09-12T19:10:33.921042+0000","last_became_active":"2024-09-12T18:43:32.927372+0000","last_became_peered":"2024-09-12T18:43:32.927372+0000","last_unstale":"2024-09-12T19:10:33.921042+0000","last_undegraded":"2024-09-12T19:10:33.921042+0000","last_fullsized":"2024-09-12T19:10:33.921042+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:56.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.910665+0000","last_change":"2024-09-12T18:43:29.900324+0000","last_active":"2024-09-12T19:10:37.910665+0000","last_peered":"2024-09-12T19:10:37.910665+0000","last_clean":"2024-09-12T19:10:37.910665+0000","last_became_active":"2024-09-12T18:43:29.888265+0000","last_became_peered":"2024-09-12T18:43:29.888265+0000","last_unstale":"2024-09-12T19:10:37.910665+0000","last_undegraded":"2024-09-12T19:10:37.910665+0000","last_fullsized":"2024-09-12T19:10:37.910665+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:31.453582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'32","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.891215+0000","last_change":"2024-09-12T18:41:45.336479+0000","last_active":"2024-09-12T19:11:03.891215+0000","last_peered":"2024-09-12T19:11:03.891215+0000","last_clean":"2024-09-12T19:11:03.891215+0000","last_became_active":"2024-09-12T18:41:45.335675+0000","last_became_peered":"2024-09-12T18:41:45.335675+0000","last_unstale":"2024-09-12T19:11:03.891215+0000","last_undegraded":"2024-09-12T19:11:03.891215+0000","last_fullsized":"2024-09-12T19:11:03.891215+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:40.967621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":63,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.928809+0000","last_change":"2024-09-12T18:55:19.150357+0000","last_active":"2024-09-12T19:11:03.928809+0000","last_peered":"2024-09-12T19:11:03.928809+0000","last_clean":"2024-09-12T19:11:03.928809+0000","last_became_active":"2024-09-12T18:55:19.149794+0000","last_became_peered":"2024-09-12T18:55:19.149794+0000","last_unstale":"2024-09-12T19:11:03.928809+0000","last_undegraded":"2024-09-12T19:11:03.928809+0000","last_fullsized":"2024-09-12T19:11:03.928809+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:29.807238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121142+0000","last_change":"2024-09-12T18:43:32.910786+0000","last_active":"2024-09-12T19:11:44.121142+0000","last_peered":"2024-09-12T19:11:44.121142+0000","last_clean":"2024-09-12T19:11:44.121142+0000","last_became_active":"2024-09-12T18:43:32.908692+0000","last_became_peered":"2024-09-12T18:43:32.908692+0000","last_unstale":"2024-09-12T19:11:44.121142+0000","last_undegraded":"2024-09-12T19:11:44.121142+0000","last_fullsized":"2024-09-12T19:11:44.121142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:46.037235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:53.749219+0000","last_change":"2024-09-12T18:43:29.883687+0000","last_active":"2024-09-12T19:13:53.749219+0000","last_peered":"2024-09-12T19:13:53.749219+0000","last_clean":"2024-09-12T19:13:53.749219+0000","last_became_active":"2024-09-12T18:43:29.882915+0000","last_became_peered":"2024-09-12T18:43:29.882915+0000","last_unstale":"2024-09-12T19:13:53.749219+0000","last_undegraded":"2024-09-12T19:13:53.749219+0000","last_fullsized":"2024-09-12T19:13:53.749219+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:04.141732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'74","reported_seq":245,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.930292+0000","last_change":"2024-09-12T18:41:45.352749+0000","last_active":"2024-09-12T19:11:03.930292+0000","last_peered":"2024-09-12T19:11:03.930292+0000","last_clean":"2024-09-12T19:11:03.930292+0000","last_became_active":"2024-09-12T18:41:45.351387+0000","last_became_peered":"2024-09-12T18:41:45.351387+0000","last_unstale":"2024-09-12T19:11:03.930292+0000","last_undegraded":"2024-09-12T19:11:03.930292+0000","last_fullsized":"2024-09-12T19:11:03.930292+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:09.964195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":261,"num_write":135,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:12.911671+0000","last_change":"2024-09-12T18:55:19.150286+0000","last_active":"2024-09-12T19:11:12.911671+0000","last_peered":"2024-09-12T19:11:12.911671+0000","last_clean":"2024-09-12T19:11:12.911671+0000","last_became_active":"2024-09-12T18:55:19.149666+0000","last_became_peered":"2024-09-12T18:55:19.149666+0000","last_unstale":"2024-09-12T19:11:12.911671+0000","last_undegraded":"2024-09-12T19:11:12.911671+0000","last_fullsized":"2024-09-12T19:11:12.911671+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:09.562684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'7","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.114111+0000","last_change":"2024-09-12T18:43:32.903834+0000","last_active":"2024-09-12T19:13:57.114111+0000","last_peered":"2024-09-12T19:13:57.114111+0000","last_clean":"2024-09-12T19:13:57.114111+0000","last_became_active":"2024-09-12T18:43:32.903112+0000","last_became_peered":"2024-09-12T18:43:32.903112+0000","last_unstale":"2024-09-12T19:13:57.114111+0000","last_undegraded":"2024-09-12T19:13:57.114111+0000","last_fullsized":"2024-09-12T19:13:57.114111+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:35.198794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.717849+0000","last_change":"2024-09-12T18:43:29.899798+0000","last_active":"2024-09-12T19:11:42.717849+0000","last_peered":"2024-09-12T19:11:42.717849+0000","last_clean":"2024-09-12T19:11:42.717849+0000","last_became_active":"2024-09-12T18:43:29.887725+0000","last_became_peered":"2024-09-12T18:43:29.887725+0000","last_unstale":"2024-09-12T19:11:42.717849+0000","last_undegraded":"2024-09-12T19:11:42.717849+0000","last_fullsized":"2024-09-12T19:11:42.717849+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:12.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.895985+0000","last_change":"2024-09-12T18:41:45.354403+0000","last_active":"2024-09-12T19:10:07.895985+0000","last_peered":"2024-09-12T19:10:07.895985+0000","last_clean":"2024-09-12T19:10:07.895985+0000","last_became_active":"2024-09-12T18:41:45.353582+0000","last_became_peered":"2024-09-12T18:41:45.353582+0000","last_unstale":"2024-09-12T19:10:07.895985+0000","last_undegraded":"2024-09-12T19:10:07.895985+0000","last_fullsized":"2024-09-12T19:10:07.895985+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:11.323313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910340+0000","last_change":"2024-09-12T18:55:19.147574+0000","last_active":"2024-09-12T19:11:07.910340+0000","last_peered":"2024-09-12T19:11:07.910340+0000","last_clean":"2024-09-12T19:11:07.910340+0000","last_became_active":"2024-09-12T18:55:19.146310+0000","last_became_peered":"2024-09-12T18:55:19.146310+0000","last_unstale":"2024-09-12T19:11:07.910340+0000","last_undegraded":"2024-09-12T19:11:07.910340+0000","last_fullsized":"2024-09-12T19:11:07.910340+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:20.681513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.909363+0000","last_change":"2024-09-12T18:43:32.922885+0000","last_active":"2024-09-12T19:10:32.909363+0000","last_peered":"2024-09-12T19:10:32.909363+0000","last_clean":"2024-09-12T19:10:32.909363+0000","last_became_active":"2024-09-12T18:43:32.922056+0000","last_became_peered":"2024-09-12T18:43:32.922056+0000","last_unstale":"2024-09-12T19:10:32.909363+0000","last_undegraded":"2024-09-12T19:10:32.909363+0000","last_fullsized":"2024-09-12T19:10:32.909363+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:30.503287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.821484+0000","last_change":"2024-09-12T18:43:29.886237+0000","last_active":"2024-09-12T19:13:57.821484+0000","last_peered":"2024-09-12T19:13:57.821484+0000","last_clean":"2024-09-12T19:13:57.821484+0000","last_became_active":"2024-09-12T18:43:29.885595+0000","last_became_peered":"2024-09-12T18:43:29.885595+0000","last_unstale":"2024-09-12T19:13:57.821484+0000","last_undegraded":"2024-09-12T19:13:57.821484+0000","last_fullsized":"2024-09-12T19:13:57.821484+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5492,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'29","reported_seq":122,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.912167+0000","last_change":"2024-09-12T18:41:45.336015+0000","last_active":"2024-09-12T19:09:58.912167+0000","last_peered":"2024-09-12T19:09:58.912167+0000","last_clean":"2024-09-12T19:09:58.912167+0000","last_became_active":"2024-09-12T18:41:45.335258+0000","last_became_peered":"2024-09-12T18:41:45.335258+0000","last_unstale":"2024-09-12T19:09:58.912167+0000","last_undegraded":"2024-09-12T19:09:58.912167+0000","last_fullsized":"2024-09-12T19:09:58.912167+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:39:50.404611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":60,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.930417+0000","last_change":"2024-09-12T18:55:19.140934+0000","last_active":"2024-09-12T19:11:03.930417+0000","last_peered":"2024-09-12T19:11:03.930417+0000","last_clean":"2024-09-12T19:11:03.930417+0000","last_became_active":"2024-09-12T18:55:19.140247+0000","last_became_peered":"2024-09-12T18:55:19.140247+0000","last_unstale":"2024-09-12T19:11:03.930417+0000","last_undegraded":"2024-09-12T19:11:03.930417+0000","last_fullsized":"2024-09-12T19:11:03.930417+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:21.925405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'9","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.822690+0000","last_change":"2024-09-12T18:43:32.918976+0000","last_active":"2024-09-12T19:13:57.822690+0000","last_peered":"2024-09-12T19:13:57.822690+0000","last_clean":"2024-09-12T19:13:57.822690+0000","last_became_active":"2024-09-12T18:43:32.918077+0000","last_became_peered":"2024-09-12T18:43:32.918077+0000","last_unstale":"2024-09-12T19:13:57.822690+0000","last_undegraded":"2024-09-12T19:13:57.822690+0000","last_fullsized":"2024-09-12T19:13:57.822690+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.534577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:34.105965+0000","last_change":"2024-09-12T18:43:29.903733+0000","last_active":"2024-09-12T19:10:34.105965+0000","last_peered":"2024-09-12T19:10:34.105965+0000","last_clean":"2024-09-12T19:10:34.105965+0000","last_became_active":"2024-09-12T18:43:29.902444+0000","last_became_peered":"2024-09-12T18:43:29.902444+0000","last_unstale":"2024-09-12T19:10:34.105965+0000","last_undegraded":"2024-09-12T19:10:34.105965+0000","last_fullsized":"2024-09-12T19:10:34.105965+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:28.242386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'31","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.890560+0000","last_change":"2024-09-12T18:41:45.351143+0000","last_active":"2024-09-12T19:09:58.890560+0000","last_peered":"2024-09-12T19:09:58.890560+0000","last_clean":"2024-09-12T19:09:58.890560+0000","last_became_active":"2024-09-12T18:41:45.350344+0000","last_became_peered":"2024-09-12T18:41:45.350344+0000","last_unstale":"2024-09-12T19:09:58.890560+0000","last_undegraded":"2024-09-12T19:09:58.890560+0000","last_fullsized":"2024-09-12T19:09:58.890560+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:21.975925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":107,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:57.892779+0000","last_change":"2024-09-12T18:55:19.145504+0000","last_active":"2024-09-12T19:09:57.892779+0000","last_peered":"2024-09-12T19:09:57.892779+0000","last_clean":"2024-09-12T19:09:57.892779+0000","last_became_active":"2024-09-12T18:55:19.144778+0000","last_became_peered":"2024-09-12T18:55:19.144778+0000","last_unstale":"2024-09-12T19:09:57.892779+0000","last_undegraded":"2024-09-12T19:09:57.892779+0000","last_fullsized":"2024-09-12T19:09:57.892779+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:31.693075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:48.957071+0000","last_change":"2024-09-12T18:43:32.903502+0000","last_active":"2024-09-12T19:12:48.957071+0000","last_peered":"2024-09-12T19:12:48.957071+0000","last_clean":"2024-09-12T19:12:48.957071+0000","last_became_active":"2024-09-12T18:43:32.901790+0000","last_became_peered":"2024-09-12T18:43:32.901790+0000","last_unstale":"2024-09-12T19:12:48.957071+0000","last_undegraded":"2024-09-12T19:12:48.957071+0000","last_fullsized":"2024-09-12T19:12:48.957071+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:24.176553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903364+0000","last_change":"2024-09-12T18:43:29.890565+0000","last_active":"2024-09-12T19:10:37.903364+0000","last_peered":"2024-09-12T19:10:37.903364+0000","last_clean":"2024-09-12T19:10:37.903364+0000","last_became_active":"2024-09-12T18:43:29.889097+0000","last_became_peered":"2024-09-12T18:43:29.889097+0000","last_unstale":"2024-09-12T19:10:37.903364+0000","last_undegraded":"2024-09-12T19:10:37.903364+0000","last_fullsized":"2024-09-12T19:10:37.903364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:26.725295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.913527+0000","last_change":"2024-09-12T18:41:45.364829+0000","last_active":"2024-09-12T19:09:58.913527+0000","last_peered":"2024-09-12T19:09:58.913527+0000","last_clean":"2024-09-12T19:09:58.913527+0000","last_became_active":"2024-09-12T18:41:45.364055+0000","last_became_peered":"2024-09-12T18:41:45.364055+0000","last_unstale":"2024-09-12T19:09:58.913527+0000","last_undegraded":"2024-09-12T19:09:58.913527+0000","last_fullsized":"2024-09-12T19:09:58.913527+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:16:18.604878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.915239+0000","last_change":"2024-09-12T18:55:19.122707+0000","last_active":"2024-09-12T19:11:58.915239+0000","last_peered":"2024-09-12T19:11:58.915239+0000","last_clean":"2024-09-12T19:11:58.915239+0000","last_became_active":"2024-09-12T18:55:19.121805+0000","last_became_peered":"2024-09-12T18:55:19.121805+0000","last_unstale":"2024-09-12T19:11:58.915239+0000","last_undegraded":"2024-09-12T19:11:58.915239+0000","last_fullsized":"2024-09-12T19:11:58.915239+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:51.523106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'11","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.955856+0000","last_change":"2024-09-12T18:43:32.899098+0000","last_active":"2024-09-12T19:12:43.955856+0000","last_peered":"2024-09-12T19:12:43.955856+0000","last_clean":"2024-09-12T19:12:43.955856+0000","last_became_active":"2024-09-12T18:43:32.898379+0000","last_became_peered":"2024-09-12T18:43:32.898379+0000","last_unstale":"2024-09-12T19:12:43.955856+0000","last_undegraded":"2024-09-12T19:12:43.955856+0000","last_fullsized":"2024-09-12T19:12:43.955856+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:40.658854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":16388,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.348079+0000","last_change":"2024-09-12T18:43:29.897947+0000","last_active":"2024-09-12T19:13:57.348079+0000","last_peered":"2024-09-12T19:13:57.348079+0000","last_clean":"2024-09-12T19:13:57.348079+0000","last_became_active":"2024-09-12T18:43:29.897326+0000","last_became_peered":"2024-09-12T18:43:29.897326+0000","last_unstale":"2024-09-12T19:13:57.348079+0000","last_undegraded":"2024-09-12T19:13:57.348079+0000","last_fullsized":"2024-09-12T19:13:57.348079+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:49.647470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'31","reported_seq":129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:58.890721+0000","last_change":"2024-09-12T18:41:45.351648+0000","last_active":"2024-09-12T19:09:58.890721+0000","last_peered":"2024-09-12T19:09:58.890721+0000","last_clean":"2024-09-12T19:09:58.890721+0000","last_became_active":"2024-09-12T18:41:45.350900+0000","last_became_peered":"2024-09-12T18:41:45.350900+0000","last_unstale":"2024-09-12T19:09:58.890721+0000","last_undegraded":"2024-09-12T19:09:58.890721+0000","last_fullsized":"2024-09-12T19:09:58.890721+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:50.580663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":59,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715397+0000","last_change":"2024-09-12T18:55:19.123047+0000","last_active":"2024-09-12T19:11:32.715397+0000","last_peered":"2024-09-12T19:11:32.715397+0000","last_clean":"2024-09-12T19:11:32.715397+0000","last_became_active":"2024-09-12T18:55:19.122238+0000","last_became_peered":"2024-09-12T18:55:19.122238+0000","last_unstale":"2024-09-12T19:11:32.715397+0000","last_undegraded":"2024-09-12T19:11:32.715397+0000","last_fullsized":"2024-09-12T19:11:32.715397+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:01.481082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:52.950322+0000","last_change":"2024-09-12T18:43:32.914014+0000","last_active":"2024-09-12T19:13:52.950322+0000","last_peered":"2024-09-12T19:13:52.950322+0000","last_clean":"2024-09-12T19:13:52.950322+0000","last_became_active":"2024-09-12T18:43:32.913108+0000","last_became_peered":"2024-09-12T18:43:32.913108+0000","last_unstale":"2024-09-12T19:13:52.950322+0000","last_undegraded":"2024-09-12T19:13:52.950322+0000","last_fullsized":"2024-09-12T19:13:52.950322+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:00.617500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'8","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.910550+0000","last_change":"2024-09-12T18:43:29.878679+0000","last_active":"2024-09-12T19:11:38.910550+0000","last_peered":"2024-09-12T19:11:38.910550+0000","last_clean":"2024-09-12T19:11:38.910550+0000","last_became_active":"2024-09-12T18:43:29.877925+0000","last_became_peered":"2024-09-12T18:43:29.877925+0000","last_unstale":"2024-09-12T19:11:38.910550+0000","last_undegraded":"2024-09-12T19:11:38.910550+0000","last_fullsized":"2024-09-12T19:11:38.910550+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:25.553737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'135","reported_seq":472,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910405+0000","last_change":"2024-09-12T18:41:45.365909+0000","last_active":"2024-09-12T19:11:07.910405+0000","last_peered":"2024-09-12T19:11:07.910405+0000","last_clean":"2024-09-12T19:11:07.910405+0000","last_became_active":"2024-09-12T18:41:45.365175+0000","last_became_peered":"2024-09-12T18:41:45.365175+0000","last_unstale":"2024-09-12T19:11:07.910405+0000","last_undegraded":"2024-09-12T19:11:07.910405+0000","last_fullsized":"2024-09-12T19:11:07.910405+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:16.010188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":832,"num_read_kb":595,"num_write":177,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.124516+0000","last_change":"2024-09-12T18:55:19.130989+0000","last_active":"2024-09-12T19:11:59.124516+0000","last_peered":"2024-09-12T19:11:59.124516+0000","last_clean":"2024-09-12T19:11:59.124516+0000","last_became_active":"2024-09-12T18:55:19.130130+0000","last_became_peered":"2024-09-12T18:55:19.130130+0000","last_unstale":"2024-09-12T19:11:59.124516+0000","last_undegraded":"2024-09-12T19:11:59.124516+0000","last_fullsized":"2024-09-12T19:11:59.124516+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121479+0000","last_change":"2024-09-12T18:43:32.906004+0000","last_active":"2024-09-12T19:11:44.121479+0000","last_peered":"2024-09-12T19:11:44.121479+0000","last_clean":"2024-09-12T19:11:44.121479+0000","last_became_active":"2024-09-12T18:43:32.904789+0000","last_became_peered":"2024-09-12T18:43:32.904789+0000","last_unstale":"2024-09-12T19:11:44.121479+0000","last_undegraded":"2024-09-12T19:11:44.121479+0000","last_fullsized":"2024-09-12T19:11:44.121479+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:44.194875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.918932+0000","last_change":"2024-09-12T18:43:29.884688+0000","last_active":"2024-09-12T19:11:42.918932+0000","last_peered":"2024-09-12T19:11:42.918932+0000","last_clean":"2024-09-12T19:11:42.918932+0000","last_became_active":"2024-09-12T18:43:29.883790+0000","last_became_peered":"2024-09-12T18:43:29.883790+0000","last_unstale":"2024-09-12T19:11:42.918932+0000","last_undegraded":"2024-09-12T19:11:42.918932+0000","last_fullsized":"2024-09-12T19:11:42.918932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:58.821497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'6","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:57.915303+0000","last_change":"2024-09-12T18:41:45.358458+0000","last_active":"2024-09-12T19:10:57.915303+0000","last_peered":"2024-09-12T19:10:57.915303+0000","last_clean":"2024-09-12T19:10:57.915303+0000","last_became_active":"2024-09-12T18:41:45.357746+0000","last_became_peered":"2024-09-12T18:41:45.357746+0000","last_unstale":"2024-09-12T19:10:57.915303+0000","last_undegraded":"2024-09-12T19:10:57.915303+0000","last_fullsized":"2024-09-12T19:10:57.915303+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:16.491434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.883887+0000","last_change":"2024-09-12T18:55:19.140383+0000","last_active":"2024-09-12T19:10:28.883887+0000","last_peered":"2024-09-12T19:10:28.883887+0000","last_clean":"2024-09-12T19:10:28.883887+0000","last_became_active":"2024-09-12T18:55:19.139565+0000","last_became_peered":"2024-09-12T18:55:19.139565+0000","last_unstale":"2024-09-12T19:10:28.883887+0000","last_undegraded":"2024-09-12T19:10:28.883887+0000","last_fullsized":"2024-09-12T19:10:28.883887+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:46.784423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:42.732160+0000","last_change":"2024-09-12T18:43:32.906082+0000","last_active":"2024-09-12T19:12:42.732160+0000","last_peered":"2024-09-12T19:12:42.732160+0000","last_clean":"2024-09-12T19:12:42.732160+0000","last_became_active":"2024-09-12T18:43:32.904858+0000","last_became_peered":"2024-09-12T18:43:32.904858+0000","last_unstale":"2024-09-12T19:12:42.732160+0000","last_undegraded":"2024-09-12T19:12:42.732160+0000","last_fullsized":"2024-09-12T19:12:42.732160+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:58.276689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:42.947818+0000","last_change":"2024-09-12T18:43:29.890077+0000","last_active":"2024-09-12T19:13:42.947818+0000","last_peered":"2024-09-12T19:13:42.947818+0000","last_clean":"2024-09-12T19:13:42.947818+0000","last_became_active":"2024-09-12T18:43:29.889328+0000","last_became_peered":"2024-09-12T18:43:29.889328+0000","last_unstale":"2024-09-12T19:13:42.947818+0000","last_undegraded":"2024-09-12T19:13:42.947818+0000","last_fullsized":"2024-09-12T19:13:42.947818+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:20.098869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'8","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.901798+0000","last_change":"2024-09-12T18:41:45.354082+0000","last_active":"2024-09-12T19:10:58.901798+0000","last_peered":"2024-09-12T19:10:58.901798+0000","last_clean":"2024-09-12T19:10:58.901798+0000","last_became_active":"2024-09-12T18:41:45.353369+0000","last_became_peered":"2024-09-12T18:41:45.353369+0000","last_unstale":"2024-09-12T19:10:58.901798+0000","last_undegraded":"2024-09-12T19:10:58.901798+0000","last_fullsized":"2024-09-12T19:10:58.901798+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:49.982690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.921223+0000","last_change":"2024-09-12T18:55:19.116656+0000","last_active":"2024-09-12T19:10:28.921223+0000","last_peered":"2024-09-12T19:10:28.921223+0000","last_clean":"2024-09-12T19:10:28.921223+0000","last_became_active":"2024-09-12T18:55:19.115920+0000","last_became_peered":"2024-09-12T18:55:19.115920+0000","last_unstale":"2024-09-12T19:10:28.921223+0000","last_undegraded":"2024-09-12T19:10:28.921223+0000","last_fullsized":"2024-09-12T19:10:28.921223+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:54.225077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.911420+0000","last_change":"2024-09-12T18:43:32.914128+0000","last_active":"2024-09-12T19:11:43.911420+0000","last_peered":"2024-09-12T19:11:43.911420+0000","last_clean":"2024-09-12T19:11:43.911420+0000","last_became_active":"2024-09-12T18:43:32.913259+0000","last_became_peered":"2024-09-12T18:43:32.913259+0000","last_unstale":"2024-09-12T19:11:43.911420+0000","last_undegraded":"2024-09-12T19:11:43.911420+0000","last_fullsized":"2024-09-12T19:11:43.911420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:08.421749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903278+0000","last_change":"2024-09-12T18:43:29.883036+0000","last_active":"2024-09-12T19:10:37.903278+0000","last_peered":"2024-09-12T19:10:37.903278+0000","last_clean":"2024-09-12T19:10:37.903278+0000","last_became_active":"2024-09-12T18:43:29.882039+0000","last_became_peered":"2024-09-12T18:43:29.882039+0000","last_unstale":"2024-09-12T19:10:37.903278+0000","last_undegraded":"2024-09-12T19:10:37.903278+0000","last_fullsized":"2024-09-12T19:10:37.903278+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:20.442914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'181","reported_seq":586,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:59.111456+0000","last_change":"2024-09-12T18:41:45.354928+0000","last_active":"2024-09-12T19:10:59.111456+0000","last_peered":"2024-09-12T19:10:59.111456+0000","last_clean":"2024-09-12T19:10:59.111456+0000","last_became_active":"2024-09-12T18:41:45.354142+0000","last_became_peered":"2024-09-12T18:41:45.354142+0000","last_unstale":"2024-09-12T19:10:59.111456+0000","last_undegraded":"2024-09-12T19:10:59.111456+0000","last_fullsized":"2024-09-12T19:10:59.111456+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:57.126086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":838,"num_write":233,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.944495+0000","last_change":"2024-09-12T18:55:19.143090+0000","last_active":"2024-09-12T19:11:58.944495+0000","last_peered":"2024-09-12T19:11:58.944495+0000","last_clean":"2024-09-12T19:11:58.944495+0000","last_became_active":"2024-09-12T18:55:19.142412+0000","last_became_peered":"2024-09-12T18:55:19.142412+0000","last_unstale":"2024-09-12T19:11:58.944495+0000","last_undegraded":"2024-09-12T19:11:58.944495+0000","last_fullsized":"2024-09-12T19:11:58.944495+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.926151+0000","last_change":"2024-09-12T18:43:32.939711+0000","last_active":"2024-09-12T19:12:43.926151+0000","last_peered":"2024-09-12T19:12:43.926151+0000","last_clean":"2024-09-12T19:12:43.926151+0000","last_became_active":"2024-09-12T18:43:32.939024+0000","last_became_peered":"2024-09-12T18:43:32.939024+0000","last_unstale":"2024-09-12T19:12:43.926151+0000","last_undegraded":"2024-09-12T19:12:43.926151+0000","last_fullsized":"2024-09-12T19:12:43.926151+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:08.177317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:42.732247+0000","last_change":"2024-09-12T18:43:29.900783+0000","last_active":"2024-09-12T19:12:42.732247+0000","last_peered":"2024-09-12T19:12:42.732247+0000","last_clean":"2024-09-12T19:12:42.732247+0000","last_became_active":"2024-09-12T18:43:29.892060+0000","last_became_peered":"2024-09-12T18:43:29.892060+0000","last_unstale":"2024-09-12T19:12:42.732247+0000","last_undegraded":"2024-09-12T19:12:42.732247+0000","last_fullsized":"2024-09-12T19:12:42.732247+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:21.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'50","reported_seq":183,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:20.845700+0000","last_change":"2024-09-12T18:41:45.356560+0000","last_active":"2024-09-12T19:11:20.845700+0000","last_peered":"2024-09-12T19:11:20.845700+0000","last_clean":"2024-09-12T19:11:20.845700+0000","last_became_active":"2024-09-12T18:41:45.355840+0000","last_became_peered":"2024-09-12T18:41:45.355840+0000","last_unstale":"2024-09-12T19:11:20.845700+0000","last_undegraded":"2024-09-12T19:11:20.845700+0000","last_fullsized":"2024-09-12T19:11:20.845700+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:22.223128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":177,"num_write":88,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:02.894254+0000","last_change":"2024-09-12T18:55:19.156335+0000","last_active":"2024-09-12T19:10:02.894254+0000","last_peered":"2024-09-12T19:10:02.894254+0000","last_clean":"2024-09-12T19:10:02.894254+0000","last_became_active":"2024-09-12T18:55:19.155684+0000","last_became_peered":"2024-09-12T18:55:19.155684+0000","last_unstale":"2024-09-12T19:10:02.894254+0000","last_undegraded":"2024-09-12T19:10:02.894254+0000","last_fullsized":"2024-09-12T19:10:02.894254+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:14.458956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.779035+0000","last_change":"2024-09-12T18:43:32.905624+0000","last_active":"2024-09-12T19:13:57.779035+0000","last_peered":"2024-09-12T19:13:57.779035+0000","last_clean":"2024-09-12T19:13:57.779035+0000","last_became_active":"2024-09-12T18:43:32.903273+0000","last_became_peered":"2024-09-12T18:43:32.903273+0000","last_unstale":"2024-09-12T19:13:57.779035+0000","last_undegraded":"2024-09-12T19:13:57.779035+0000","last_fullsized":"2024-09-12T19:13:57.779035+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:48.885568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.926200+0000","last_change":"2024-09-12T18:43:29.868919+0000","last_active":"2024-09-12T19:12:43.926200+0000","last_peered":"2024-09-12T19:12:43.926200+0000","last_clean":"2024-09-12T19:12:43.926200+0000","last_became_active":"2024-09-12T18:43:29.865413+0000","last_became_peered":"2024-09-12T18:43:29.865413+0000","last_unstale":"2024-09-12T19:12:43.926200+0000","last_undegraded":"2024-09-12T19:12:43.926200+0000","last_fullsized":"2024-09-12T19:12:43.926200+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:35.628916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'25","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:57.922311+0000","last_change":"2024-09-12T18:41:45.363243+0000","last_active":"2024-09-12T19:11:57.922311+0000","last_peered":"2024-09-12T19:11:57.922311+0000","last_clean":"2024-09-12T19:11:57.922311+0000","last_became_active":"2024-09-12T18:41:45.362445+0000","last_became_peered":"2024-09-12T18:41:45.362445+0000","last_unstale":"2024-09-12T19:11:57.922311+0000","last_undegraded":"2024-09-12T19:11:57.922311+0000","last_fullsized":"2024-09-12T19:11:57.922311+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:57.818173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'314","reported_seq":912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.338154+0000","last_change":"2024-09-12T18:26:39.874259+0000","last_active":"2024-09-12T19:13:58.338154+0000","last_peered":"2024-09-12T19:13:58.338154+0000","last_clean":"2024-09-12T19:13:58.338154+0000","last_became_active":"2024-09-12T18:26:39.872863+0000","last_became_peered":"2024-09-12T18:26:39.872863+0000","last_unstale":"2024-09-12T19:13:58.338154+0000","last_undegraded":"2024-09-12T19:13:58.338154+0000","last_fullsized":"2024-09-12T19:13:58.338154+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:12.641934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65109,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":407,"num_read_kb":8020,"num_write":948,"num_write_kb":33098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'548","reported_seq":2200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.104685+0000","last_change":"2024-09-12T18:26:41.881378+0000","last_active":"2024-09-12T19:12:24.104685+0000","last_peered":"2024-09-12T19:12:24.104685+0000","last_clean":"2024-09-12T19:12:24.104685+0000","last_became_active":"2024-09-12T18:26:41.879711+0000","last_became_peered":"2024-09-12T18:26:41.879711+0000","last_unstale":"2024-09-12T19:12:24.104685+0000","last_undegraded":"2024-09-12T19:12:24.104685+0000","last_fullsized":"2024-09-12T19:12:24.104685+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:43.105556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2944,"num_read_kb":2757,"num_write":660,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'372","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.371680+0000","last_change":"2024-09-12T18:26:39.837876+0000","last_active":"2024-09-12T19:13:58.371680+0000","last_peered":"2024-09-12T19:13:58.371680+0000","last_clean":"2024-09-12T19:13:58.371680+0000","last_became_active":"2024-09-12T18:26:39.837462+0000","last_became_peered":"2024-09-12T18:26:39.837462+0000","last_unstale":"2024-09-12T19:13:58.371680+0000","last_undegraded":"2024-09-12T19:13:58.371680+0000","last_fullsized":"2024-09-12T19:13:58.371680+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:16.597331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10456094,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":60601,"num_write":1117,"num_write_kb":26482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'832","reported_seq":2227,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.108683+0000","last_change":"2024-09-12T18:26:41.864753+0000","last_active":"2024-09-12T19:12:24.108683+0000","last_peered":"2024-09-12T19:12:24.108683+0000","last_clean":"2024-09-12T19:12:24.108683+0000","last_became_active":"2024-09-12T18:26:41.863835+0000","last_became_peered":"2024-09-12T18:26:41.863835+0000","last_unstale":"2024-09-12T19:12:24.108683+0000","last_undegraded":"2024-09-12T19:12:24.108683+0000","last_fullsized":"2024-09-12T19:12:24.108683+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:50.300481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3830,"num_read_kb":3409,"num_write":1134,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'370","reported_seq":1046,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.335385+0000","last_change":"2024-09-12T18:26:39.831857+0000","last_active":"2024-09-12T19:13:58.335385+0000","last_peered":"2024-09-12T19:13:58.335385+0000","last_clean":"2024-09-12T19:13:58.335385+0000","last_became_active":"2024-09-12T18:26:39.831522+0000","last_became_peered":"2024-09-12T18:26:39.831522+0000","last_unstale":"2024-09-12T19:13:58.335385+0000","last_undegraded":"2024-09-12T19:13:58.335385+0000","last_fullsized":"2024-09-12T19:13:58.335385+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:44.938137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":634,"num_read_kb":27264,"num_write":1166,"num_write_kb":30891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'361","reported_seq":1822,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.752145+0000","last_change":"2024-09-12T18:26:41.850866+0000","last_active":"2024-09-12T19:12:08.752145+0000","last_peered":"2024-09-12T19:12:08.752145+0000","last_clean":"2024-09-12T19:12:08.752145+0000","last_became_active":"2024-09-12T18:26:41.850001+0000","last_became_peered":"2024-09-12T18:26:41.850001+0000","last_unstale":"2024-09-12T19:12:08.752145+0000","last_undegraded":"2024-09-12T19:12:08.752145+0000","last_fullsized":"2024-09-12T19:12:08.752145+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:23.483403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2076,"num_read_kb":1992,"num_write":405,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'349","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.354968+0000","last_change":"2024-09-12T18:27:11.825105+0000","last_active":"2024-09-12T19:13:58.354968+0000","last_peered":"2024-09-12T19:13:58.354968+0000","last_clean":"2024-09-12T19:13:58.354968+0000","last_became_active":"2024-09-12T18:27:11.824331+0000","last_became_peered":"2024-09-12T18:27:11.824331+0000","last_unstale":"2024-09-12T19:13:58.354968+0000","last_undegraded":"2024-09-12T19:13:58.354968+0000","last_fullsized":"2024-09-12T19:13:58.354968+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:59.462165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":38329,"num_write":1089,"num_write_kb":37388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'500","reported_seq":2054,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.541136+0000","last_change":"2024-09-12T18:26:41.851231+0000","last_active":"2024-09-12T19:12:09.541136+0000","last_peered":"2024-09-12T19:12:09.541136+0000","last_clean":"2024-09-12T19:12:09.541136+0000","last_became_active":"2024-09-12T18:26:41.850866+0000","last_became_peered":"2024-09-12T18:26:41.850866+0000","last_unstale":"2024-09-12T19:12:09.541136+0000","last_undegraded":"2024-09-12T19:12:09.541136+0000","last_fullsized":"2024-09-12T19:12:09.541136+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:49.632192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2664,"num_read_kb":2487,"num_write":637,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'369","reported_seq":1102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.377140+0000","last_change":"2024-09-12T18:26:39.871051+0000","last_active":"2024-09-12T19:13:58.377140+0000","last_peered":"2024-09-12T19:13:58.377140+0000","last_clean":"2024-09-12T19:13:58.377140+0000","last_became_active":"2024-09-12T18:26:39.870272+0000","last_became_peered":"2024-09-12T18:26:39.870272+0000","last_unstale":"2024-09-12T19:13:58.377140+0000","last_undegraded":"2024-09-12T19:13:58.377140+0000","last_fullsized":"2024-09-12T19:13:58.377140+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:16:26.496206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":771,"num_read_kb":17788,"num_write":1173,"num_write_kb":36512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'543","reported_seq":1968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.557048+0000","last_change":"2024-09-12T18:26:41.869564+0000","last_active":"2024-09-12T19:12:09.557048+0000","last_peered":"2024-09-12T19:12:09.557048+0000","last_clean":"2024-09-12T19:12:09.557048+0000","last_became_active":"2024-09-12T18:26:41.865288+0000","last_became_peered":"2024-09-12T18:26:41.865288+0000","last_unstale":"2024-09-12T19:12:09.557048+0000","last_undegraded":"2024-09-12T19:12:09.557048+0000","last_fullsized":"2024-09-12T19:12:09.557048+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":500,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:04.903221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2721,"num_read_kb":2571,"num_write":759,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'329","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.373612+0000","last_change":"2024-09-12T18:26:39.851993+0000","last_active":"2024-09-12T19:13:58.373612+0000","last_peered":"2024-09-12T19:13:58.373612+0000","last_clean":"2024-09-12T19:13:58.373612+0000","last_became_active":"2024-09-12T18:26:39.851253+0000","last_became_peered":"2024-09-12T18:26:39.851253+0000","last_unstale":"2024-09-12T19:13:58.373612+0000","last_undegraded":"2024-09-12T19:13:58.373612+0000","last_fullsized":"2024-09-12T19:13:58.373612+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:26.300087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493192,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":31766,"num_write":1103,"num_write_kb":25425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'807","reported_seq":2339,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.105771+0000","last_change":"2024-09-12T18:26:41.852562+0000","last_active":"2024-09-12T19:13:43.105771+0000","last_peered":"2024-09-12T19:13:43.105771+0000","last_clean":"2024-09-12T19:13:43.105771+0000","last_became_active":"2024-09-12T18:26:41.851811+0000","last_became_peered":"2024-09-12T18:26:41.851811+0000","last_unstale":"2024-09-12T19:13:43.105771+0000","last_undegraded":"2024-09-12T19:13:43.105771+0000","last_fullsized":"2024-09-12T19:13:43.105771+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:07.152668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3792,"num_read_kb":3404,"num_write":1072,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'357","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.348272+0000","last_change":"2024-09-12T18:26:39.862363+0000","last_active":"2024-09-12T19:13:58.348272+0000","last_peered":"2024-09-12T19:13:58.348272+0000","last_clean":"2024-09-12T19:13:58.348272+0000","last_became_active":"2024-09-12T18:26:39.861529+0000","last_became_peered":"2024-09-12T18:26:39.861529+0000","last_unstale":"2024-09-12T19:13:58.348272+0000","last_undegraded":"2024-09-12T19:13:58.348272+0000","last_fullsized":"2024-09-12T19:13:58.348272+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:22.532453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":30235,"num_write":1160,"num_write_kb":47172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'698","reported_seq":2314,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.291262+0000","last_change":"2024-09-12T18:26:41.880160+0000","last_active":"2024-09-12T19:12:23.291262+0000","last_peered":"2024-09-12T19:12:23.291262+0000","last_clean":"2024-09-12T19:12:23.291262+0000","last_became_active":"2024-09-12T18:26:41.878820+0000","last_became_peered":"2024-09-12T18:26:41.878820+0000","last_unstale":"2024-09-12T19:12:23.291262+0000","last_undegraded":"2024-09-12T19:12:23.291262+0000","last_fullsized":"2024-09-12T19:12:23.291262+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:28.637107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3429,"num_read_kb":3073,"num_write":944,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'342","reported_seq":1033,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.250230+0000","last_change":"2024-09-12T18:27:11.824834+0000","last_active":"2024-09-12T19:13:58.250230+0000","last_peered":"2024-09-12T19:13:58.250230+0000","last_clean":"2024-09-12T19:13:58.250230+0000","last_became_active":"2024-09-12T18:27:11.824008+0000","last_became_peered":"2024-09-12T18:27:11.824008+0000","last_unstale":"2024-09-12T19:13:58.250230+0000","last_undegraded":"2024-09-12T19:13:58.250230+0000","last_fullsized":"2024-09-12T19:13:58.250230+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:48:37.834927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":634,"num_read_kb":10155,"num_write":1129,"num_write_kb":30763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'673","reported_seq":2284,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.623890+0000","last_change":"2024-09-12T18:26:41.854820+0000","last_active":"2024-09-12T19:12:18.623890+0000","last_peered":"2024-09-12T19:12:18.623890+0000","last_clean":"2024-09-12T19:12:18.623890+0000","last_became_active":"2024-09-12T18:26:41.854487+0000","last_became_peered":"2024-09-12T18:26:41.854487+0000","last_unstale":"2024-09-12T19:12:18.623890+0000","last_undegraded":"2024-09-12T19:12:18.623890+0000","last_fullsized":"2024-09-12T19:12:18.623890+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":600,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:55.693388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3483,"num_read_kb":3149,"num_write":934,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'460","reported_seq":2065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.554629+0000","last_change":"2024-09-12T18:26:41.845783+0000","last_active":"2024-09-12T19:12:09.554629+0000","last_peered":"2024-09-12T19:12:09.554629+0000","last_clean":"2024-09-12T19:12:09.554629+0000","last_became_active":"2024-09-12T18:26:41.845080+0000","last_became_peered":"2024-09-12T18:26:41.845080+0000","last_unstale":"2024-09-12T19:12:09.554629+0000","last_undegraded":"2024-09-12T19:12:09.554629+0000","last_fullsized":"2024-09-12T19:12:09.554629+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:41:41.747464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2421,"num_read_kb":2289,"num_write":534,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'369","reported_seq":1003,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.321472+0000","last_change":"2024-09-12T18:26:39.874340+0000","last_active":"2024-09-12T19:13:58.321472+0000","last_peered":"2024-09-12T19:13:58.321472+0000","last_clean":"2024-09-12T19:13:58.321472+0000","last_became_active":"2024-09-12T18:26:39.872936+0000","last_became_peered":"2024-09-12T18:26:39.872936+0000","last_unstale":"2024-09-12T19:13:58.321472+0000","last_undegraded":"2024-09-12T19:13:58.321472+0000","last_fullsized":"2024-09-12T19:13:58.321472+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:52.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":506,"num_read_kb":24957,"num_write":1245,"num_write_kb":33279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'559","reported_seq":2173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.208544+0000","last_change":"2024-09-12T18:26:41.874471+0000","last_active":"2024-09-12T19:11:58.208544+0000","last_peered":"2024-09-12T19:11:58.208544+0000","last_clean":"2024-09-12T19:11:58.208544+0000","last_became_active":"2024-09-12T18:26:41.865247+0000","last_became_peered":"2024-09-12T18:26:41.865247+0000","last_unstale":"2024-09-12T19:11:58.208544+0000","last_undegraded":"2024-09-12T19:11:58.208544+0000","last_fullsized":"2024-09-12T19:11:58.208544+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:35.308473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2931,"num_read_kb":2718,"num_write":721,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'403","reported_seq":1112,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.265536+0000","last_change":"2024-09-12T18:26:39.859661+0000","last_active":"2024-09-12T19:13:58.265536+0000","last_peered":"2024-09-12T19:13:58.265536+0000","last_clean":"2024-09-12T19:13:58.265536+0000","last_became_active":"2024-09-12T18:26:39.858964+0000","last_became_peered":"2024-09-12T18:26:39.858964+0000","last_unstale":"2024-09-12T19:13:58.265536+0000","last_undegraded":"2024-09-12T19:13:58.265536+0000","last_fullsized":"2024-09-12T19:13:58.265536+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:12.307545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":810,"num_read_kb":25615,"num_write":1319,"num_write_kb":27961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'826","reported_seq":2309,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.128247+0000","last_change":"2024-09-12T18:26:41.862769+0000","last_active":"2024-09-12T19:12:24.128247+0000","last_peered":"2024-09-12T19:12:24.128247+0000","last_clean":"2024-09-12T19:12:24.128247+0000","last_became_active":"2024-09-12T18:26:41.861762+0000","last_became_peered":"2024-09-12T18:26:41.861762+0000","last_unstale":"2024-09-12T19:12:24.128247+0000","last_undegraded":"2024-09-12T19:12:24.128247+0000","last_fullsized":"2024-09-12T19:12:24.128247+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:57.802438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3868,"num_read_kb":3443,"num_write":1111,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'389","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.367462+0000","last_change":"2024-09-12T18:26:39.857559+0000","last_active":"2024-09-12T19:13:58.367462+0000","last_peered":"2024-09-12T19:13:58.367462+0000","last_clean":"2024-09-12T19:13:58.367462+0000","last_became_active":"2024-09-12T18:26:39.856700+0000","last_became_peered":"2024-09-12T18:26:39.856700+0000","last_unstale":"2024-09-12T19:13:58.367462+0000","last_undegraded":"2024-09-12T19:13:58.367462+0000","last_fullsized":"2024-09-12T19:13:58.367462+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:32.134581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632225,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":583,"num_read_kb":29092,"num_write":1242,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'408","reported_seq":1973,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.624204+0000","last_change":"2024-09-12T18:26:41.855114+0000","last_active":"2024-09-12T19:12:18.624204+0000","last_peered":"2024-09-12T19:12:18.624204+0000","last_clean":"2024-09-12T19:12:18.624204+0000","last_became_active":"2024-09-12T18:26:41.854687+0000","last_became_peered":"2024-09-12T18:26:41.854687+0000","last_unstale":"2024-09-12T19:12:18.624204+0000","last_undegraded":"2024-09-12T19:12:18.624204+0000","last_fullsized":"2024-09-12T19:12:18.624204+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:38.397431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2203,"num_read_kb":2114,"num_write":459,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'299","reported_seq":1017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.345131+0000","last_change":"2024-09-12T18:26:39.846009+0000","last_active":"2024-09-12T19:13:58.345131+0000","last_peered":"2024-09-12T19:13:58.345131+0000","last_clean":"2024-09-12T19:13:58.345131+0000","last_became_active":"2024-09-12T18:26:39.845295+0000","last_became_peered":"2024-09-12T18:26:39.845295+0000","last_unstale":"2024-09-12T19:13:58.345131+0000","last_undegraded":"2024-09-12T19:13:58.345131+0000","last_fullsized":"2024-09-12T19:13:58.345131+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:17.674520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306760,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":23315,"num_write":964,"num_write_kb":25673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'818","reported_seq":2465,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.289955+0000","last_change":"2024-09-12T18:26:41.856646+0000","last_active":"2024-09-12T19:12:23.289955+0000","last_peered":"2024-09-12T19:12:23.289955+0000","last_clean":"2024-09-12T19:12:23.289955+0000","last_became_active":"2024-09-12T18:26:41.856280+0000","last_became_peered":"2024-09-12T18:26:41.856280+0000","last_unstale":"2024-09-12T19:12:23.289955+0000","last_undegraded":"2024-09-12T19:12:23.289955+0000","last_fullsized":"2024-09-12T19:12:23.289955+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":800,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:53:36.396273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4038,"num_read_kb":3655,"num_write":1078,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'410","reported_seq":1103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.342720+0000","last_change":"2024-09-12T18:26:39.842574+0000","last_active":"2024-09-12T19:13:58.342720+0000","last_peered":"2024-09-12T19:13:58.342720+0000","last_clean":"2024-09-12T19:13:58.342720+0000","last_became_active":"2024-09-12T18:26:39.842159+0000","last_became_peered":"2024-09-12T18:26:39.842159+0000","last_unstale":"2024-09-12T19:13:58.342720+0000","last_undegraded":"2024-09-12T19:13:58.342720+0000","last_fullsized":"2024-09-12T19:13:58.342720+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:57.097188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":622,"num_read_kb":58105,"num_write":1270,"num_write_kb":62462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'845","reported_seq":2432,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.108397+0000","last_change":"2024-09-12T18:26:41.854196+0000","last_active":"2024-09-12T19:13:43.108397+0000","last_peered":"2024-09-12T19:13:43.108397+0000","last_clean":"2024-09-12T19:13:43.108397+0000","last_became_active":"2024-09-12T18:26:41.853403+0000","last_became_peered":"2024-09-12T18:26:41.853403+0000","last_unstale":"2024-09-12T19:13:43.108397+0000","last_undegraded":"2024-09-12T19:13:43.108397+0000","last_fullsized":"2024-09-12T19:13:43.108397+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:23.475163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3981,"num_read_kb":3579,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'405","reported_seq":1114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.318943+0000","last_change":"2024-09-12T18:26:39.834464+0000","last_active":"2024-09-12T19:13:58.318943+0000","last_peered":"2024-09-12T19:13:58.318943+0000","last_clean":"2024-09-12T19:13:58.318943+0000","last_became_active":"2024-09-12T18:26:39.834006+0000","last_became_peered":"2024-09-12T18:26:39.834006+0000","last_unstale":"2024-09-12T19:13:58.318943+0000","last_undegraded":"2024-09-12T19:13:58.318943+0000","last_fullsized":"2024-09-12T19:13:58.318943+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:17:58.733603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":720,"num_read_kb":82742,"num_write":1326,"num_write_kb":55909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'115","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.220116+0000","last_change":"2024-09-12T18:26:49.907310+0000","last_active":"2024-09-12T19:12:24.220116+0000","last_peered":"2024-09-12T19:12:24.220116+0000","last_clean":"2024-09-12T19:12:24.220116+0000","last_became_active":"2024-09-12T18:26:49.906589+0000","last_became_peered":"2024-09-12T18:26:49.906589+0000","last_unstale":"2024-09-12T19:12:24.220116+0000","last_undegraded":"2024-09-12T19:12:24.220116+0000","last_fullsized":"2024-09-12T19:12:24.220116+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:14.519874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":280,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'752","reported_seq":2162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.190816+0000","last_change":"2024-09-12T18:26:41.853179+0000","last_active":"2024-09-12T19:11:59.190816+0000","last_peered":"2024-09-12T19:11:59.190816+0000","last_clean":"2024-09-12T19:11:59.190816+0000","last_became_active":"2024-09-12T18:26:41.852831+0000","last_became_peered":"2024-09-12T18:26:41.852831+0000","last_unstale":"2024-09-12T19:11:59.190816+0000","last_undegraded":"2024-09-12T19:11:59.190816+0000","last_fullsized":"2024-09-12T19:11:59.190816+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:22.488493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3501,"num_read_kb":3138,"num_write":986,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'386","reported_seq":1057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.379863+0000","last_change":"2024-09-12T18:27:11.824441+0000","last_active":"2024-09-12T19:13:58.379863+0000","last_peered":"2024-09-12T19:13:58.379863+0000","last_clean":"2024-09-12T19:13:58.379863+0000","last_became_active":"2024-09-12T18:27:11.823705+0000","last_became_peered":"2024-09-12T18:27:11.823705+0000","last_unstale":"2024-09-12T19:13:58.379863+0000","last_undegraded":"2024-09-12T19:13:58.379863+0000","last_fullsized":"2024-09-12T19:13:58.379863+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:16.557071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":587,"num_read_kb":55935,"num_write":1256,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.891991+0000","last_change":"2024-09-12T18:26:43.859139+0000","last_active":"2024-09-12T19:10:13.891991+0000","last_peered":"2024-09-12T19:10:13.891991+0000","last_clean":"2024-09-12T19:10:13.891991+0000","last_became_active":"2024-09-12T18:26:43.857754+0000","last_became_peered":"2024-09-12T18:26:43.857754+0000","last_unstale":"2024-09-12T19:10:13.891991+0000","last_undegraded":"2024-09-12T19:10:13.891991+0000","last_fullsized":"2024-09-12T19:10:13.891991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:44.851162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'317","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.243406+0000","last_change":"2024-09-12T18:26:45.876845+0000","last_active":"2024-09-12T19:13:57.243406+0000","last_peered":"2024-09-12T19:13:57.243406+0000","last_clean":"2024-09-12T19:13:57.243406+0000","last_became_active":"2024-09-12T18:26:45.876070+0000","last_became_peered":"2024-09-12T18:26:45.876070+0000","last_unstale":"2024-09-12T19:13:57.243406+0000","last_undegraded":"2024-09-12T19:13:57.243406+0000","last_fullsized":"2024-09-12T19:13:57.243406+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:22.272564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48204,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1086,"num_write":410,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:17.898757+0000","last_change":"2024-09-12T18:26:47.896202+0000","last_active":"2024-09-12T19:10:17.898757+0000","last_peered":"2024-09-12T19:10:17.898757+0000","last_clean":"2024-09-12T19:10:17.898757+0000","last_became_active":"2024-09-12T18:26:47.895471+0000","last_became_peered":"2024-09-12T18:26:47.895471+0000","last_unstale":"2024-09-12T19:10:17.898757+0000","last_undegraded":"2024-09-12T19:10:17.898757+0000","last_fullsized":"2024-09-12T19:10:17.898757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:33.203860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'2440","reported_seq":4321,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.300739+0000","last_change":"2024-09-12T18:26:49.913977+0000","last_active":"2024-09-12T19:12:21.300739+0000","last_peered":"2024-09-12T19:12:21.300739+0000","last_clean":"2024-09-12T19:12:21.300739+0000","last_became_active":"2024-09-12T18:26:49.913125+0000","last_became_peered":"2024-09-12T18:26:49.913125+0000","last_unstale":"2024-09-12T19:12:21.300739+0000","last_undegraded":"2024-09-12T19:12:21.300739+0000","last_fullsized":"2024-09-12T19:12:21.300739+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":2400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:14.099069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6085,"num_read_kb":6089,"num_write":4865,"num_write_kb":1791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'567","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:02.090617+0000","last_change":"2024-09-12T18:26:41.872673+0000","last_active":"2024-09-12T19:12:02.090617+0000","last_peered":"2024-09-12T19:12:02.090617+0000","last_clean":"2024-09-12T19:12:02.090617+0000","last_became_active":"2024-09-12T18:26:41.871531+0000","last_became_peered":"2024-09-12T18:26:41.871531+0000","last_unstale":"2024-09-12T19:12:02.090617+0000","last_undegraded":"2024-09-12T19:12:02.090617+0000","last_fullsized":"2024-09-12T19:12:02.090617+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:58.936555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2964,"num_read_kb":2726,"num_write":725,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'363","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.277976+0000","last_change":"2024-09-12T18:26:39.872043+0000","last_active":"2024-09-12T19:13:58.277976+0000","last_peered":"2024-09-12T19:13:58.277976+0000","last_clean":"2024-09-12T19:13:58.277976+0000","last_became_active":"2024-09-12T18:26:39.871605+0000","last_became_peered":"2024-09-12T18:26:39.871605+0000","last_unstale":"2024-09-12T19:13:58.277976+0000","last_undegraded":"2024-09-12T19:13:58.277976+0000","last_fullsized":"2024-09-12T19:13:58.277976+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:34:34.631521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721310,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":33411,"num_write":1198,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.930194+0000","last_change":"2024-09-12T18:26:43.866305+0000","last_active":"2024-09-12T19:11:08.930194+0000","last_peered":"2024-09-12T19:11:08.930194+0000","last_clean":"2024-09-12T19:11:08.930194+0000","last_became_active":"2024-09-12T18:26:43.865817+0000","last_became_peered":"2024-09-12T18:26:43.865817+0000","last_unstale":"2024-09-12T19:11:08.930194+0000","last_undegraded":"2024-09-12T19:11:08.930194+0000","last_fullsized":"2024-09-12T19:11:08.930194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:43:44.351205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'75","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:11.668505+0000","last_change":"2024-09-12T18:26:45.854845+0000","last_active":"2024-09-12T19:11:11.668505+0000","last_peered":"2024-09-12T19:11:11.668505+0000","last_clean":"2024-09-12T19:11:11.668505+0000","last_became_active":"2024-09-12T18:26:45.854087+0000","last_became_peered":"2024-09-12T18:26:45.854087+0000","last_unstale":"2024-09-12T19:11:11.668505+0000","last_undegraded":"2024-09-12T19:11:11.668505+0000","last_fullsized":"2024-09-12T19:11:11.668505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:33.838948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:19.102590+0000","last_change":"2024-09-12T18:26:47.881155+0000","last_active":"2024-09-12T19:10:19.102590+0000","last_peered":"2024-09-12T19:10:19.102590+0000","last_clean":"2024-09-12T19:10:19.102590+0000","last_became_active":"2024-09-12T18:26:47.880374+0000","last_became_peered":"2024-09-12T18:26:47.880374+0000","last_unstale":"2024-09-12T19:10:19.102590+0000","last_undegraded":"2024-09-12T19:10:19.102590+0000","last_fullsized":"2024-09-12T19:10:19.102590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:15.543833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'120","reported_seq":622,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.174257+0000","last_change":"2024-09-12T18:26:49.927396+0000","last_active":"2024-09-12T19:11:59.174257+0000","last_peered":"2024-09-12T19:11:59.174257+0000","last_clean":"2024-09-12T19:11:59.174257+0000","last_became_active":"2024-09-12T18:26:49.926650+0000","last_became_peered":"2024-09-12T18:26:49.926650+0000","last_unstale":"2024-09-12T19:11:59.174257+0000","last_undegraded":"2024-09-12T19:11:59.174257+0000","last_fullsized":"2024-09-12T19:11:59.174257+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:12.549691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'508","reported_seq":2178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.106328+0000","last_change":"2024-09-12T18:26:41.852310+0000","last_active":"2024-09-12T19:12:01.106328+0000","last_peered":"2024-09-12T19:12:01.106328+0000","last_clean":"2024-09-12T19:12:01.106328+0000","last_became_active":"2024-09-12T18:26:41.851928+0000","last_became_peered":"2024-09-12T18:26:41.851928+0000","last_unstale":"2024-09-12T19:12:01.106328+0000","last_undegraded":"2024-09-12T19:12:01.106328+0000","last_fullsized":"2024-09-12T19:12:01.106328+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:23.223986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2649,"num_read_kb":2492,"num_write":594,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'373","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.382227+0000","last_change":"2024-09-12T18:26:39.864105+0000","last_active":"2024-09-12T19:13:58.382227+0000","last_peered":"2024-09-12T19:13:58.382227+0000","last_clean":"2024-09-12T19:13:58.382227+0000","last_became_active":"2024-09-12T18:26:39.863389+0000","last_became_peered":"2024-09-12T18:26:39.863389+0000","last_unstale":"2024-09-12T19:13:58.382227+0000","last_undegraded":"2024-09-12T19:13:58.382227+0000","last_fullsized":"2024-09-12T19:13:58.382227+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:59.089104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":529,"num_read_kb":22645,"num_write":1125,"num_write_kb":31309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.916104+0000","last_change":"2024-09-12T18:26:43.855208+0000","last_active":"2024-09-12T19:10:13.916104+0000","last_peered":"2024-09-12T19:10:13.916104+0000","last_clean":"2024-09-12T19:10:13.916104+0000","last_became_active":"2024-09-12T18:26:43.853736+0000","last_became_peered":"2024-09-12T18:26:43.853736+0000","last_unstale":"2024-09-12T19:10:13.916104+0000","last_undegraded":"2024-09-12T19:10:13.916104+0000","last_fullsized":"2024-09-12T19:10:13.916104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:26.483694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'112","reported_seq":644,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:16.619773+0000","last_change":"2024-09-12T18:26:45.853889+0000","last_active":"2024-09-12T19:11:16.619773+0000","last_peered":"2024-09-12T19:11:16.619773+0000","last_clean":"2024-09-12T19:11:16.619773+0000","last_became_active":"2024-09-12T18:26:45.853143+0000","last_became_peered":"2024-09-12T18:26:45.853143+0000","last_unstale":"2024-09-12T19:11:16.619773+0000","last_undegraded":"2024-09-12T19:11:16.619773+0000","last_fullsized":"2024-09-12T19:11:16.619773+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:21.398455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'764","reported_seq":4110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.252054+0000","last_change":"2024-09-12T18:26:47.895745+0000","last_active":"2024-09-12T19:13:58.252054+0000","last_peered":"2024-09-12T19:13:58.252054+0000","last_clean":"2024-09-12T19:13:58.252054+0000","last_became_active":"2024-09-12T18:26:47.895056+0000","last_became_peered":"2024-09-12T18:26:47.895056+0000","last_unstale":"2024-09-12T19:13:58.252054+0000","last_undegraded":"2024-09-12T19:13:58.252054+0000","last_fullsized":"2024-09-12T19:13:58.252054+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":702,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:33.762580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'174","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.267501+0000","last_change":"2024-09-12T18:26:49.890859+0000","last_active":"2024-09-12T19:12:24.267501+0000","last_peered":"2024-09-12T19:12:24.267501+0000","last_clean":"2024-09-12T19:12:24.267501+0000","last_became_active":"2024-09-12T18:26:49.890325+0000","last_became_peered":"2024-09-12T18:26:49.890325+0000","last_unstale":"2024-09-12T19:12:24.267501+0000","last_undegraded":"2024-09-12T19:12:24.267501+0000","last_fullsized":"2024-09-12T19:12:24.267501+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:48.483470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":638,"num_write":360,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'755","reported_seq":2307,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:05.288203+0000","last_change":"2024-09-12T18:26:41.862710+0000","last_active":"2024-09-12T19:12:05.288203+0000","last_peered":"2024-09-12T19:12:05.288203+0000","last_clean":"2024-09-12T19:12:05.288203+0000","last_became_active":"2024-09-12T18:26:41.862240+0000","last_became_peered":"2024-09-12T18:26:41.862240+0000","last_unstale":"2024-09-12T19:12:05.288203+0000","last_undegraded":"2024-09-12T19:12:05.288203+0000","last_fullsized":"2024-09-12T19:12:05.288203+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:33.961532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3627,"num_read_kb":3298,"num_write":982,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'329","reported_seq":944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.373996+0000","last_change":"2024-09-12T18:26:39.844306+0000","last_active":"2024-09-12T19:13:58.373996+0000","last_peered":"2024-09-12T19:13:58.373996+0000","last_clean":"2024-09-12T19:13:58.373996+0000","last_became_active":"2024-09-12T18:26:39.843351+0000","last_became_peered":"2024-09-12T18:26:39.843351+0000","last_unstale":"2024-09-12T19:13:58.373996+0000","last_undegraded":"2024-09-12T19:13:58.373996+0000","last_fullsized":"2024-09-12T19:13:58.373996+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:35.966180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170084,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":20705,"num_write":1033,"num_write_kb":27627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.892087+0000","last_change":"2024-09-12T18:26:43.843098+0000","last_active":"2024-09-12T19:10:13.892087+0000","last_peered":"2024-09-12T19:10:13.892087+0000","last_clean":"2024-09-12T19:10:13.892087+0000","last_became_active":"2024-09-12T18:26:43.842479+0000","last_became_peered":"2024-09-12T18:26:43.842479+0000","last_unstale":"2024-09-12T19:10:13.892087+0000","last_undegraded":"2024-09-12T19:10:13.892087+0000","last_fullsized":"2024-09-12T19:10:13.892087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:07.573346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'285","reported_seq":848,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.359667+0000","last_change":"2024-09-12T18:26:46.025157+0000","last_active":"2024-09-12T19:13:58.359667+0000","last_peered":"2024-09-12T19:13:58.359667+0000","last_clean":"2024-09-12T19:13:58.359667+0000","last_became_active":"2024-09-12T18:26:46.024425+0000","last_became_peered":"2024-09-12T18:26:46.024425+0000","last_unstale":"2024-09-12T19:13:58.359667+0000","last_undegraded":"2024-09-12T19:13:58.359667+0000","last_fullsized":"2024-09-12T19:13:58.359667+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:13.803848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53269,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1121,"num_write":396,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'804","reported_seq":2367,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.847619+0000","last_change":"2024-09-12T18:26:47.899579+0000","last_active":"2024-09-12T19:13:56.847619+0000","last_peered":"2024-09-12T19:13:56.847619+0000","last_clean":"2024-09-12T19:13:56.847619+0000","last_became_active":"2024-09-12T18:26:47.898903+0000","last_became_peered":"2024-09-12T18:26:47.898903+0000","last_unstale":"2024-09-12T19:13:56.847619+0000","last_undegraded":"2024-09-12T19:13:56.847619+0000","last_fullsized":"2024-09-12T19:13:56.847619+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:43.604475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'762","reported_seq":2249,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:03.047582+0000","last_change":"2024-09-12T18:26:41.870576+0000","last_active":"2024-09-12T19:12:03.047582+0000","last_peered":"2024-09-12T19:12:03.047582+0000","last_clean":"2024-09-12T19:12:03.047582+0000","last_became_active":"2024-09-12T18:26:41.869852+0000","last_became_peered":"2024-09-12T18:26:41.869852+0000","last_unstale":"2024-09-12T19:12:03.047582+0000","last_undegraded":"2024-09-12T19:12:03.047582+0000","last_fullsized":"2024-09-12T19:12:03.047582+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:41.656803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3529,"num_read_kb":3192,"num_write":1004,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'479","reported_seq":1200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.376479+0000","last_change":"2024-09-12T18:26:39.875011+0000","last_active":"2024-09-12T19:13:58.376479+0000","last_peered":"2024-09-12T19:13:58.376479+0000","last_clean":"2024-09-12T19:13:58.376479+0000","last_became_active":"2024-09-12T18:26:39.873512+0000","last_became_peered":"2024-09-12T18:26:39.873512+0000","last_unstale":"2024-09-12T19:13:58.376479+0000","last_undegraded":"2024-09-12T19:13:58.376479+0000","last_fullsized":"2024-09-12T19:13:58.376479+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:45.863880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4719716,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":925,"num_read_kb":13008,"num_write":1544,"num_write_kb":39306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.895938+0000","last_change":"2024-09-12T18:26:43.871922+0000","last_active":"2024-09-12T19:10:07.895938+0000","last_peered":"2024-09-12T19:10:07.895938+0000","last_clean":"2024-09-12T19:10:07.895938+0000","last_became_active":"2024-09-12T18:26:43.871192+0000","last_became_peered":"2024-09-12T18:26:43.871192+0000","last_unstale":"2024-09-12T19:10:07.895938+0000","last_undegraded":"2024-09-12T19:10:07.895938+0000","last_fullsized":"2024-09-12T19:10:07.895938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:26.666887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'365","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.435863+0000","last_change":"2024-09-12T18:26:46.021987+0000","last_active":"2024-09-12T19:13:57.435863+0000","last_peered":"2024-09-12T19:13:57.435863+0000","last_clean":"2024-09-12T19:13:57.435863+0000","last_became_active":"2024-09-12T18:26:46.021239+0000","last_became_peered":"2024-09-12T18:26:46.021239+0000","last_unstale":"2024-09-12T19:13:57.435863+0000","last_undegraded":"2024-09-12T19:13:57.435863+0000","last_fullsized":"2024-09-12T19:13:57.435863+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:16.999506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43291,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":581,"num_read_kb":1196,"num_write":460,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:47.719815+0000","last_change":"2024-09-12T18:26:47.879784+0000","last_active":"2024-09-12T19:11:47.719815+0000","last_peered":"2024-09-12T19:11:47.719815+0000","last_clean":"2024-09-12T19:11:47.719815+0000","last_became_active":"2024-09-12T18:26:47.879079+0000","last_became_peered":"2024-09-12T18:26:47.879079+0000","last_unstale":"2024-09-12T19:11:47.719815+0000","last_undegraded":"2024-09-12T19:11:47.719815+0000","last_fullsized":"2024-09-12T19:11:47.719815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'551","reported_seq":1359,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.001450+0000","last_change":"2024-09-12T18:26:49.913788+0000","last_active":"2024-09-12T19:13:44.001450+0000","last_peered":"2024-09-12T19:13:44.001450+0000","last_clean":"2024-09-12T19:13:44.001450+0000","last_became_active":"2024-09-12T18:26:49.913115+0000","last_became_peered":"2024-09-12T18:26:49.913115+0000","last_unstale":"2024-09-12T19:13:44.001450+0000","last_undegraded":"2024-09-12T19:13:44.001450+0000","last_fullsized":"2024-09-12T19:13:44.001450+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:49.514569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1285,"num_write":1159,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'406","reported_seq":1988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.570164+0000","last_change":"2024-09-12T18:26:41.855029+0000","last_active":"2024-09-12T19:12:06.570164+0000","last_peered":"2024-09-12T19:12:06.570164+0000","last_clean":"2024-09-12T19:12:06.570164+0000","last_became_active":"2024-09-12T18:26:41.854391+0000","last_became_peered":"2024-09-12T18:26:41.854391+0000","last_unstale":"2024-09-12T19:12:06.570164+0000","last_undegraded":"2024-09-12T19:12:06.570164+0000","last_fullsized":"2024-09-12T19:12:06.570164+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:51.832674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2438,"num_read_kb":2340,"num_write":450,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'317","reported_seq":919,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.377039+0000","last_change":"2024-09-12T18:26:39.871356+0000","last_active":"2024-09-12T19:13:58.377039+0000","last_peered":"2024-09-12T19:13:58.377039+0000","last_clean":"2024-09-12T19:13:58.377039+0000","last_became_active":"2024-09-12T18:26:39.870641+0000","last_became_peered":"2024-09-12T18:26:39.870641+0000","last_unstale":"2024-09-12T19:13:58.377039+0000","last_undegraded":"2024-09-12T19:13:58.377039+0000","last_fullsized":"2024-09-12T19:13:58.377039+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:37.867643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":414,"num_read_kb":1418,"num_write":1020,"num_write_kb":24682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.878656+0000","last_change":"2024-09-12T18:26:43.854009+0000","last_active":"2024-09-12T19:10:03.878656+0000","last_peered":"2024-09-12T19:10:03.878656+0000","last_clean":"2024-09-12T19:10:03.878656+0000","last_became_active":"2024-09-12T18:26:43.853212+0000","last_became_peered":"2024-09-12T18:26:43.853212+0000","last_unstale":"2024-09-12T19:10:03.878656+0000","last_undegraded":"2024-09-12T19:10:03.878656+0000","last_fullsized":"2024-09-12T19:10:03.878656+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:12.634200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'264","reported_seq":832,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.006631+0000","last_change":"2024-09-12T18:26:45.866790+0000","last_active":"2024-09-12T19:13:58.006631+0000","last_peered":"2024-09-12T19:13:58.006631+0000","last_clean":"2024-09-12T19:13:58.006631+0000","last_became_active":"2024-09-12T18:26:45.865933+0000","last_became_peered":"2024-09-12T18:26:45.865933+0000","last_unstale":"2024-09-12T19:13:58.006631+0000","last_undegraded":"2024-09-12T19:13:58.006631+0000","last_fullsized":"2024-09-12T19:13:58.006631+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":1093,"num_write":368,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.915818+0000","last_change":"2024-09-12T18:26:47.898805+0000","last_active":"2024-09-12T19:10:13.915818+0000","last_peered":"2024-09-12T19:10:13.915818+0000","last_clean":"2024-09-12T19:10:13.915818+0000","last_became_active":"2024-09-12T18:26:47.898056+0000","last_became_peered":"2024-09-12T18:26:47.898056+0000","last_unstale":"2024-09-12T19:10:13.915818+0000","last_undegraded":"2024-09-12T19:10:13.915818+0000","last_fullsized":"2024-09-12T19:10:13.915818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:01.722126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'128","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:53.928598+0000","last_change":"2024-09-12T18:26:49.914410+0000","last_active":"2024-09-12T19:12:53.928598+0000","last_peered":"2024-09-12T19:12:53.928598+0000","last_clean":"2024-09-12T19:12:53.928598+0000","last_became_active":"2024-09-12T18:26:49.913180+0000","last_became_peered":"2024-09-12T18:26:49.913180+0000","last_unstale":"2024-09-12T19:12:53.928598+0000","last_undegraded":"2024-09-12T19:12:53.928598+0000","last_fullsized":"2024-09-12T19:12:53.928598+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:31.008311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'514","reported_seq":2058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.768357+0000","last_change":"2024-09-12T18:26:41.874172+0000","last_active":"2024-09-12T19:12:08.768357+0000","last_peered":"2024-09-12T19:12:08.768357+0000","last_clean":"2024-09-12T19:12:08.768357+0000","last_became_active":"2024-09-12T18:26:41.873229+0000","last_became_peered":"2024-09-12T18:26:41.873229+0000","last_unstale":"2024-09-12T19:12:08.768357+0000","last_undegraded":"2024-09-12T19:12:08.768357+0000","last_fullsized":"2024-09-12T19:12:08.768357+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:55.323047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2942,"num_read_kb":2741,"num_write":656,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'367","reported_seq":1146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.367686+0000","last_change":"2024-09-12T18:26:39.865873+0000","last_active":"2024-09-12T19:13:58.367686+0000","last_peered":"2024-09-12T19:13:58.367686+0000","last_clean":"2024-09-12T19:13:58.367686+0000","last_became_active":"2024-09-12T18:26:39.865148+0000","last_became_peered":"2024-09-12T18:26:39.865148+0000","last_unstale":"2024-09-12T19:13:58.367686+0000","last_undegraded":"2024-09-12T19:13:58.367686+0000","last_fullsized":"2024-09-12T19:13:58.367686+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:00.744853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":883,"num_read_kb":25450,"num_write":1078,"num_write_kb":40926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.715755+0000","last_change":"2024-09-12T18:26:43.854880+0000","last_active":"2024-09-12T19:11:43.715755+0000","last_peered":"2024-09-12T19:11:43.715755+0000","last_clean":"2024-09-12T19:11:43.715755+0000","last_became_active":"2024-09-12T18:26:43.853084+0000","last_became_peered":"2024-09-12T18:26:43.853084+0000","last_unstale":"2024-09-12T19:11:43.715755+0000","last_undegraded":"2024-09-12T19:11:43.715755+0000","last_fullsized":"2024-09-12T19:11:43.715755+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:42:12.477078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'307","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.556756+0000","last_change":"2024-09-12T18:26:45.867127+0000","last_active":"2024-09-12T19:13:57.556756+0000","last_peered":"2024-09-12T19:13:57.556756+0000","last_clean":"2024-09-12T19:13:57.556756+0000","last_became_active":"2024-09-12T18:26:45.866325+0000","last_became_peered":"2024-09-12T18:26:45.866325+0000","last_unstale":"2024-09-12T19:13:57.556756+0000","last_undegraded":"2024-09-12T19:13:57.556756+0000","last_fullsized":"2024-09-12T19:13:57.556756+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:45.228994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64639,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":1214,"num_write":426,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'792","reported_seq":2650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.027906+0000","last_change":"2024-09-12T18:26:47.879674+0000","last_active":"2024-09-12T19:13:58.027906+0000","last_peered":"2024-09-12T19:13:58.027906+0000","last_clean":"2024-09-12T19:13:58.027906+0000","last_became_active":"2024-09-12T18:26:47.878956+0000","last_became_peered":"2024-09-12T18:26:47.878956+0000","last_unstale":"2024-09-12T19:13:58.027906+0000","last_undegraded":"2024-09-12T19:13:58.027906+0000","last_fullsized":"2024-09-12T19:13:58.027906+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:56.898695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'146","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.017181+0000","last_change":"2024-09-12T18:26:49.927113+0000","last_active":"2024-09-12T19:13:43.017181+0000","last_peered":"2024-09-12T19:13:43.017181+0000","last_clean":"2024-09-12T19:13:43.017181+0000","last_became_active":"2024-09-12T18:26:49.926384+0000","last_became_peered":"2024-09-12T18:26:49.926384+0000","last_unstale":"2024-09-12T19:13:43.017181+0000","last_undegraded":"2024-09-12T19:13:43.017181+0000","last_fullsized":"2024-09-12T19:13:43.017181+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:14.787817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":361,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'694","reported_seq":2115,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.893516+0000","last_change":"2024-09-12T18:26:41.846934+0000","last_active":"2024-09-12T19:12:07.893516+0000","last_peered":"2024-09-12T19:12:07.893516+0000","last_clean":"2024-09-12T19:12:07.893516+0000","last_became_active":"2024-09-12T18:26:41.846589+0000","last_became_peered":"2024-09-12T18:26:41.846589+0000","last_unstale":"2024-09-12T19:12:07.893516+0000","last_undegraded":"2024-09-12T19:12:07.893516+0000","last_fullsized":"2024-09-12T19:12:07.893516+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:35.741190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3315,"num_read_kb":3003,"num_write":914,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'316","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.356305+0000","last_change":"2024-09-12T18:26:39.851620+0000","last_active":"2024-09-12T19:13:58.356305+0000","last_peered":"2024-09-12T19:13:58.356305+0000","last_clean":"2024-09-12T19:13:58.356305+0000","last_became_active":"2024-09-12T18:26:39.849950+0000","last_became_peered":"2024-09-12T18:26:39.849950+0000","last_unstale":"2024-09-12T19:13:58.356305+0000","last_undegraded":"2024-09-12T19:13:58.356305+0000","last_fullsized":"2024-09-12T19:13:58.356305+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:33.362610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67871,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":33808,"num_write":1047,"num_write_kb":22667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.879742+0000","last_change":"2024-09-12T18:26:43.875193+0000","last_active":"2024-09-12T19:10:08.879742+0000","last_peered":"2024-09-12T19:10:08.879742+0000","last_clean":"2024-09-12T19:10:08.879742+0000","last_became_active":"2024-09-12T18:26:43.874837+0000","last_became_peered":"2024-09-12T18:26:43.874837+0000","last_unstale":"2024-09-12T19:10:08.879742+0000","last_undegraded":"2024-09-12T19:10:08.879742+0000","last_fullsized":"2024-09-12T19:10:08.879742+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:28.076097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'460","reported_seq":1092,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.116026+0000","last_change":"2024-09-12T18:26:45.876006+0000","last_active":"2024-09-12T19:13:58.116026+0000","last_peered":"2024-09-12T19:13:58.116026+0000","last_clean":"2024-09-12T19:13:58.116026+0000","last_became_active":"2024-09-12T18:26:45.875223+0000","last_became_peered":"2024-09-12T18:26:45.875223+0000","last_unstale":"2024-09-12T19:13:58.116026+0000","last_undegraded":"2024-09-12T19:13:58.116026+0000","last_fullsized":"2024-09-12T19:13:58.116026+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:33.224194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89882,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":808,"num_read_kb":1944,"num_write":662,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.879675+0000","last_change":"2024-09-12T18:26:47.892554+0000","last_active":"2024-09-12T19:10:08.879675+0000","last_peered":"2024-09-12T19:10:08.879675+0000","last_clean":"2024-09-12T19:10:08.879675+0000","last_became_active":"2024-09-12T18:26:47.891736+0000","last_became_peered":"2024-09-12T18:26:47.891736+0000","last_unstale":"2024-09-12T19:10:08.879675+0000","last_undegraded":"2024-09-12T19:10:08.879675+0000","last_fullsized":"2024-09-12T19:10:08.879675+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:21:15.740755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'131","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:19.312995+0000","last_change":"2024-09-12T18:26:49.905418+0000","last_active":"2024-09-12T19:10:19.312995+0000","last_peered":"2024-09-12T19:10:19.312995+0000","last_clean":"2024-09-12T19:10:19.312995+0000","last_became_active":"2024-09-12T18:26:49.904633+0000","last_became_peered":"2024-09-12T18:26:49.904633+0000","last_unstale":"2024-09-12T19:10:19.312995+0000","last_undegraded":"2024-09-12T19:10:19.312995+0000","last_fullsized":"2024-09-12T19:10:19.312995+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:49.072537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":176,"num_write":324,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'684","reported_seq":2217,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121355+0000","last_change":"2024-09-12T18:26:41.853736+0000","last_active":"2024-09-12T19:11:44.121355+0000","last_peered":"2024-09-12T19:11:44.121355+0000","last_clean":"2024-09-12T19:11:44.121355+0000","last_became_active":"2024-09-12T18:26:41.852958+0000","last_became_peered":"2024-09-12T18:26:41.852958+0000","last_unstale":"2024-09-12T19:11:44.121355+0000","last_undegraded":"2024-09-12T19:11:44.121355+0000","last_fullsized":"2024-09-12T19:11:44.121355+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:46:03.970571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3047,"num_write":870,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'341","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.387493+0000","last_change":"2024-09-12T18:26:39.844241+0000","last_active":"2024-09-12T19:13:58.387493+0000","last_peered":"2024-09-12T19:13:58.387493+0000","last_clean":"2024-09-12T19:13:58.387493+0000","last_became_active":"2024-09-12T18:26:39.842671+0000","last_became_peered":"2024-09-12T18:26:39.842671+0000","last_unstale":"2024-09-12T19:13:58.387493+0000","last_undegraded":"2024-09-12T19:13:58.387493+0000","last_fullsized":"2024-09-12T19:13:58.387493+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:01.142718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1239003,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":38368,"num_write":1135,"num_write_kb":24127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.715908+0000","last_change":"2024-09-12T18:26:43.864463+0000","last_active":"2024-09-12T19:11:43.715908+0000","last_peered":"2024-09-12T19:11:43.715908+0000","last_clean":"2024-09-12T19:11:43.715908+0000","last_became_active":"2024-09-12T18:26:43.863615+0000","last_became_peered":"2024-09-12T18:26:43.863615+0000","last_unstale":"2024-09-12T19:11:43.715908+0000","last_undegraded":"2024-09-12T19:11:43.715908+0000","last_fullsized":"2024-09-12T19:11:43.715908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:49.236494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'293","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.158035+0000","last_change":"2024-09-12T18:26:45.865043+0000","last_active":"2024-09-12T19:13:58.158035+0000","last_peered":"2024-09-12T19:13:58.158035+0000","last_clean":"2024-09-12T19:13:58.158035+0000","last_became_active":"2024-09-12T18:26:45.864308+0000","last_became_peered":"2024-09-12T18:26:45.864308+0000","last_unstale":"2024-09-12T19:13:58.158035+0000","last_undegraded":"2024-09-12T19:13:58.158035+0000","last_fullsized":"2024-09-12T19:13:58.158035+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1125,"num_write":460,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:43.910003+0000","last_change":"2024-09-12T18:26:47.904622+0000","last_active":"2024-09-12T19:09:43.910003+0000","last_peered":"2024-09-12T19:09:43.910003+0000","last_clean":"2024-09-12T19:09:43.910003+0000","last_became_active":"2024-09-12T18:26:47.903984+0000","last_became_peered":"2024-09-12T18:26:47.903984+0000","last_unstale":"2024-09-12T19:09:43.910003+0000","last_undegraded":"2024-09-12T19:09:43.910003+0000","last_fullsized":"2024-09-12T19:09:43.910003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:01.445193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'130","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:03.733674+0000","last_change":"2024-09-12T18:26:49.917735+0000","last_active":"2024-09-12T19:13:03.733674+0000","last_peered":"2024-09-12T19:13:03.733674+0000","last_clean":"2024-09-12T19:13:03.733674+0000","last_became_active":"2024-09-12T18:26:49.916255+0000","last_became_peered":"2024-09-12T18:26:49.916255+0000","last_unstale":"2024-09-12T19:13:03.733674+0000","last_undegraded":"2024-09-12T19:13:03.733674+0000","last_fullsized":"2024-09-12T19:13:03.733674+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:05.827351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":172,"num_read_kb":153,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'479","reported_seq":2156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.290589+0000","last_change":"2024-09-12T18:26:41.852549+0000","last_active":"2024-09-12T19:12:23.290589+0000","last_peered":"2024-09-12T19:12:23.290589+0000","last_clean":"2024-09-12T19:12:23.290589+0000","last_became_active":"2024-09-12T18:26:41.851789+0000","last_became_peered":"2024-09-12T18:26:41.851789+0000","last_unstale":"2024-09-12T19:12:23.290589+0000","last_undegraded":"2024-09-12T19:12:23.290589+0000","last_fullsized":"2024-09-12T19:12:23.290589+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:07.659593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2754,"num_read_kb":2601,"num_write":570,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'392","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.332347+0000","last_change":"2024-09-12T18:26:39.850151+0000","last_active":"2024-09-12T19:13:58.332347+0000","last_peered":"2024-09-12T19:13:58.332347+0000","last_clean":"2024-09-12T19:13:58.332347+0000","last_became_active":"2024-09-12T18:26:39.849392+0000","last_became_peered":"2024-09-12T18:26:39.849392+0000","last_unstale":"2024-09-12T19:13:58.332347+0000","last_undegraded":"2024-09-12T19:13:58.332347+0000","last_fullsized":"2024-09-12T19:13:58.332347+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:38.297523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568421,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":663,"num_read_kb":7425,"num_write":1171,"num_write_kb":13361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:47.719873+0000","last_change":"2024-09-12T18:26:43.877842+0000","last_active":"2024-09-12T19:11:47.719873+0000","last_peered":"2024-09-12T19:11:47.719873+0000","last_clean":"2024-09-12T19:11:47.719873+0000","last_became_active":"2024-09-12T18:26:43.877257+0000","last_became_peered":"2024-09-12T18:26:43.877257+0000","last_unstale":"2024-09-12T19:11:47.719873+0000","last_undegraded":"2024-09-12T19:11:47.719873+0000","last_fullsized":"2024-09-12T19:11:47.719873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'288","reported_seq":870,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.887747+0000","last_change":"2024-09-12T18:26:45.862903+0000","last_active":"2024-09-12T19:13:57.887747+0000","last_peered":"2024-09-12T19:13:57.887747+0000","last_clean":"2024-09-12T19:13:57.887747+0000","last_became_active":"2024-09-12T18:26:45.861947+0000","last_became_peered":"2024-09-12T18:26:45.861947+0000","last_unstale":"2024-09-12T19:13:57.887747+0000","last_undegraded":"2024-09-12T19:13:57.887747+0000","last_fullsized":"2024-09-12T19:13:57.887747+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:30:08.858976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50433,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":477,"num_read_kb":1052,"num_write":380,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'756","reported_seq":2381,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.397078+0000","last_change":"2024-09-12T18:26:47.881128+0000","last_active":"2024-09-12T19:13:58.397078+0000","last_peered":"2024-09-12T19:13:58.397078+0000","last_clean":"2024-09-12T19:13:58.397078+0000","last_became_active":"2024-09-12T18:26:47.880400+0000","last_became_peered":"2024-09-12T18:26:47.880400+0000","last_unstale":"2024-09-12T19:13:58.397078+0000","last_undegraded":"2024-09-12T19:13:58.397078+0000","last_fullsized":"2024-09-12T19:13:58.397078+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'139","reported_seq":636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:06.307338+0000","last_change":"2024-09-12T18:26:49.914558+0000","last_active":"2024-09-12T19:11:06.307338+0000","last_peered":"2024-09-12T19:11:06.307338+0000","last_clean":"2024-09-12T19:11:06.307338+0000","last_became_active":"2024-09-12T18:26:49.913762+0000","last_became_peered":"2024-09-12T18:26:49.913762+0000","last_unstale":"2024-09-12T19:11:06.307338+0000","last_undegraded":"2024-09-12T19:11:06.307338+0000","last_fullsized":"2024-09-12T19:11:06.307338+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:09.188110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":330,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'794","reported_seq":2362,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.108199+0000","last_change":"2024-09-12T18:26:41.867333+0000","last_active":"2024-09-12T19:12:01.108199+0000","last_peered":"2024-09-12T19:12:01.108199+0000","last_clean":"2024-09-12T19:12:01.108199+0000","last_became_active":"2024-09-12T18:26:41.866528+0000","last_became_peered":"2024-09-12T18:26:41.866528+0000","last_unstale":"2024-09-12T19:12:01.108199+0000","last_undegraded":"2024-09-12T19:12:01.108199+0000","last_fullsized":"2024-09-12T19:12:01.108199+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:17.375009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3788,"num_read_kb":3420,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'339","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.376629+0000","last_change":"2024-09-12T18:26:39.844053+0000","last_active":"2024-09-12T19:13:58.376629+0000","last_peered":"2024-09-12T19:13:58.376629+0000","last_clean":"2024-09-12T19:13:58.376629+0000","last_became_active":"2024-09-12T18:26:39.839762+0000","last_became_peered":"2024-09-12T18:26:39.839762+0000","last_unstale":"2024-09-12T19:13:58.376629+0000","last_undegraded":"2024-09-12T19:13:58.376629+0000","last_fullsized":"2024-09-12T19:13:58.376629+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:10.306869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1967405,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":414,"num_read_kb":30496,"num_write":1045,"num_write_kb":26286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1447,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.586961+0000","last_change":"2024-09-12T18:26:43.862723+0000","last_active":"2024-09-12T19:13:56.586961+0000","last_peered":"2024-09-12T19:13:56.586961+0000","last_clean":"2024-09-12T19:13:56.586961+0000","last_became_active":"2024-09-12T18:26:43.861969+0000","last_became_peered":"2024-09-12T18:26:43.861969+0000","last_unstale":"2024-09-12T19:13:56.586961+0000","last_undegraded":"2024-09-12T19:13:56.586961+0000","last_fullsized":"2024-09-12T19:13:56.586961+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:53.579120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'77","reported_seq":594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.125814+0000","last_change":"2024-09-12T18:26:46.020701+0000","last_active":"2024-09-12T19:13:43.125814+0000","last_peered":"2024-09-12T19:13:43.125814+0000","last_clean":"2024-09-12T19:13:43.125814+0000","last_became_active":"2024-09-12T18:26:46.019895+0000","last_became_peered":"2024-09-12T18:26:46.019895+0000","last_unstale":"2024-09-12T19:13:43.125814+0000","last_undegraded":"2024-09-12T19:13:43.125814+0000","last_fullsized":"2024-09-12T19:13:43.125814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'770","reported_seq":4374,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.398677+0000","last_change":"2024-09-12T18:26:47.888210+0000","last_active":"2024-09-12T19:13:58.398677+0000","last_peered":"2024-09-12T19:13:58.398677+0000","last_clean":"2024-09-12T19:13:58.398677+0000","last_became_active":"2024-09-12T18:26:47.882417+0000","last_became_peered":"2024-09-12T18:26:47.882417+0000","last_unstale":"2024-09-12T19:13:58.398677+0000","last_undegraded":"2024-09-12T19:13:58.398677+0000","last_fullsized":"2024-09-12T19:13:58.398677+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":701,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:18.819184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'146","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:04.041466+0000","last_change":"2024-09-12T18:26:49.927258+0000","last_active":"2024-09-12T19:12:04.041466+0000","last_peered":"2024-09-12T19:12:04.041466+0000","last_clean":"2024-09-12T19:12:04.041466+0000","last_became_active":"2024-09-12T18:26:49.926637+0000","last_became_peered":"2024-09-12T18:26:49.926637+0000","last_unstale":"2024-09-12T19:12:04.041466+0000","last_undegraded":"2024-09-12T19:12:04.041466+0000","last_fullsized":"2024-09-12T19:12:04.041466+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:49.800769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":120,"num_write":360,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'756","reported_seq":2269,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.171030+0000","last_change":"2024-09-12T18:26:41.839495+0000","last_active":"2024-09-12T19:11:59.171030+0000","last_peered":"2024-09-12T19:11:59.171030+0000","last_clean":"2024-09-12T19:11:59.171030+0000","last_became_active":"2024-09-12T18:26:41.839152+0000","last_became_peered":"2024-09-12T18:26:41.839152+0000","last_unstale":"2024-09-12T19:11:59.171030+0000","last_undegraded":"2024-09-12T19:11:59.171030+0000","last_fullsized":"2024-09-12T19:11:59.171030+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:53.021667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3609,"num_read_kb":3261,"num_write":1016,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'370","reported_seq":1233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.378849+0000","last_change":"2024-09-12T18:26:39.842163+0000","last_active":"2024-09-12T19:13:58.378849+0000","last_peered":"2024-09-12T19:13:58.378849+0000","last_clean":"2024-09-12T19:13:58.378849+0000","last_became_active":"2024-09-12T18:26:39.839018+0000","last_became_peered":"2024-09-12T18:26:39.839018+0000","last_unstale":"2024-09-12T19:13:58.378849+0000","last_undegraded":"2024-09-12T19:13:58.378849+0000","last_fullsized":"2024-09-12T19:13:58.378849+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:13:01.980870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88291,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":988,"num_read_kb":16661,"num_write":1246,"num_write_kb":29221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121502+0000","last_change":"2024-09-12T18:26:43.875133+0000","last_active":"2024-09-12T19:11:44.121502+0000","last_peered":"2024-09-12T19:11:44.121502+0000","last_clean":"2024-09-12T19:11:44.121502+0000","last_became_active":"2024-09-12T18:26:43.872882+0000","last_became_peered":"2024-09-12T18:26:43.872882+0000","last_unstale":"2024-09-12T19:11:44.121502+0000","last_undegraded":"2024-09-12T19:11:44.121502+0000","last_fullsized":"2024-09-12T19:11:44.121502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:27.685683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'395","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.292197+0000","last_change":"2024-09-12T18:26:45.871763+0000","last_active":"2024-09-12T19:13:57.292197+0000","last_peered":"2024-09-12T19:13:57.292197+0000","last_clean":"2024-09-12T19:13:57.292197+0000","last_became_active":"2024-09-12T18:26:45.871011+0000","last_became_peered":"2024-09-12T18:26:45.871011+0000","last_unstale":"2024-09-12T19:13:57.292197+0000","last_undegraded":"2024-09-12T19:13:57.292197+0000","last_fullsized":"2024-09-12T19:13:57.292197+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:25.203156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47428,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1195,"num_read_kb":1786,"num_write":1700,"num_write_kb":1538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.914986+0000","last_change":"2024-09-12T18:26:47.894796+0000","last_active":"2024-09-12T19:11:48.914986+0000","last_peered":"2024-09-12T19:11:48.914986+0000","last_clean":"2024-09-12T19:11:48.914986+0000","last_became_active":"2024-09-12T18:26:47.893881+0000","last_became_peered":"2024-09-12T18:26:47.893881+0000","last_unstale":"2024-09-12T19:11:48.914986+0000","last_undegraded":"2024-09-12T19:11:48.914986+0000","last_fullsized":"2024-09-12T19:11:48.914986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:58.081365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'157","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:37.541375+0000","last_change":"2024-09-12T18:26:49.912169+0000","last_active":"2024-09-12T19:11:37.541375+0000","last_peered":"2024-09-12T19:11:37.541375+0000","last_clean":"2024-09-12T19:11:37.541375+0000","last_became_active":"2024-09-12T18:26:49.911403+0000","last_became_peered":"2024-09-12T18:26:49.911403+0000","last_unstale":"2024-09-12T19:11:37.541375+0000","last_undegraded":"2024-09-12T19:11:37.541375+0000","last_fullsized":"2024-09-12T19:11:37.541375+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:01.150938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":152,"num_write":383,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'825","reported_seq":2330,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.126584+0000","last_change":"2024-09-12T18:26:41.874124+0000","last_active":"2024-09-12T19:12:24.126584+0000","last_peered":"2024-09-12T19:12:24.126584+0000","last_clean":"2024-09-12T19:12:24.126584+0000","last_became_active":"2024-09-12T18:26:41.873329+0000","last_became_peered":"2024-09-12T18:26:41.873329+0000","last_unstale":"2024-09-12T19:12:24.126584+0000","last_undegraded":"2024-09-12T19:12:24.126584+0000","last_fullsized":"2024-09-12T19:12:24.126584+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:16:49.832562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3864,"num_read_kb":3455,"num_write":1112,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.901972+0000","last_change":"2024-09-12T18:26:20.490476+0000","last_active":"2024-09-12T19:10:32.901972+0000","last_peered":"2024-09-12T19:10:32.901972+0000","last_clean":"2024-09-12T19:10:32.901972+0000","last_became_active":"2024-09-12T18:26:20.488464+0000","last_became_peered":"2024-09-12T18:26:20.488464+0000","last_unstale":"2024-09-12T19:10:32.901972+0000","last_undegraded":"2024-09-12T19:10:32.901972+0000","last_fullsized":"2024-09-12T19:10:32.901972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:19.397195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:19.397195+0000","last_clean_scrub_stamp":"2024-09-12T18:26:19.397195+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:55.130875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.891893+0000","last_change":"2024-09-12T18:26:27.490424+0000","last_active":"2024-09-12T19:10:13.891893+0000","last_peered":"2024-09-12T19:10:13.891893+0000","last_clean":"2024-09-12T19:10:13.891893+0000","last_became_active":"2024-09-12T18:26:25.483072+0000","last_became_peered":"2024-09-12T18:26:25.483072+0000","last_unstale":"2024-09-12T19:10:13.891893+0000","last_undegraded":"2024-09-12T19:10:13.891893+0000","last_fullsized":"2024-09-12T19:10:13.891893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:35:05.867109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010071489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'365","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.315031+0000","last_change":"2024-09-12T18:26:39.855572+0000","last_active":"2024-09-12T19:13:58.315031+0000","last_peered":"2024-09-12T19:13:58.315031+0000","last_clean":"2024-09-12T19:13:58.315031+0000","last_became_active":"2024-09-12T18:26:39.855274+0000","last_became_peered":"2024-09-12T18:26:39.855274+0000","last_unstale":"2024-09-12T19:13:58.315031+0000","last_undegraded":"2024-09-12T19:13:58.315031+0000","last_fullsized":"2024-09-12T19:13:58.315031+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:41.652285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399238,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":585,"num_read_kb":43416,"num_write":1148,"num_write_kb":32341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"36'3","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.574535+0000","last_change":"2024-09-12T18:26:43.863289+0000","last_active":"2024-09-12T19:13:56.574535+0000","last_peered":"2024-09-12T19:13:56.574535+0000","last_clean":"2024-09-12T19:13:56.574535+0000","last_became_active":"2024-09-12T18:26:43.862599+0000","last_became_peered":"2024-09-12T18:26:43.862599+0000","last_unstale":"2024-09-12T19:13:56.574535+0000","last_undegraded":"2024-09-12T19:13:56.574535+0000","last_fullsized":"2024-09-12T19:13:56.574535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:40.040108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'718","reported_seq":1416,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.814967+0000","last_change":"2024-09-12T18:26:45.871462+0000","last_active":"2024-09-12T19:13:57.814967+0000","last_peered":"2024-09-12T19:13:57.814967+0000","last_clean":"2024-09-12T19:13:57.814967+0000","last_became_active":"2024-09-12T18:26:45.870711+0000","last_became_peered":"2024-09-12T18:26:45.870711+0000","last_unstale":"2024-09-12T19:13:57.814967+0000","last_undegraded":"2024-09-12T19:13:57.814967+0000","last_fullsized":"2024-09-12T19:13:57.814967+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:33.052933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152164,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1400,"num_read_kb":3258,"num_write":1288,"num_write_kb":1147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.915809+0000","last_change":"2024-09-12T18:26:47.888177+0000","last_active":"2024-09-12T19:10:08.915809+0000","last_peered":"2024-09-12T19:10:08.915809+0000","last_clean":"2024-09-12T19:10:08.915809+0000","last_became_active":"2024-09-12T18:26:47.886696+0000","last_became_peered":"2024-09-12T18:26:47.886696+0000","last_unstale":"2024-09-12T19:10:08.915809+0000","last_undegraded":"2024-09-12T19:10:08.915809+0000","last_fullsized":"2024-09-12T19:10:08.915809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:07.144929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'175","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.921796+0000","last_change":"2024-09-12T18:26:49.910601+0000","last_active":"2024-09-12T19:12:23.921796+0000","last_peered":"2024-09-12T19:12:23.921796+0000","last_clean":"2024-09-12T19:12:23.921796+0000","last_became_active":"2024-09-12T18:26:49.909591+0000","last_became_peered":"2024-09-12T18:26:49.909591+0000","last_unstale":"2024-09-12T19:12:23.921796+0000","last_undegraded":"2024-09-12T19:12:23.921796+0000","last_fullsized":"2024-09-12T19:12:23.921796+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.427369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":451,"num_write":354,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'445","reported_seq":1921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.106331+0000","last_change":"2024-09-12T18:27:11.827439+0000","last_active":"2024-09-12T19:13:43.106331+0000","last_peered":"2024-09-12T19:13:43.106331+0000","last_clean":"2024-09-12T19:13:43.106331+0000","last_became_active":"2024-09-12T18:27:11.825677+0000","last_became_peered":"2024-09-12T18:27:11.825677+0000","last_unstale":"2024-09-12T19:13:43.106331+0000","last_undegraded":"2024-09-12T19:13:43.106331+0000","last_fullsized":"2024-09-12T19:13:43.106331+0000","mapping_epoch":37,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:25.109981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2226,"num_read_kb":2089,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903232+0000","last_change":"2024-09-12T18:26:28.282837+0000","last_active":"2024-09-12T19:10:37.903232+0000","last_peered":"2024-09-12T19:10:37.903232+0000","last_clean":"2024-09-12T19:10:37.903232+0000","last_became_active":"2024-09-12T18:26:25.486681+0000","last_became_peered":"2024-09-12T18:26:25.486681+0000","last_unstale":"2024-09-12T19:10:37.903232+0000","last_undegraded":"2024-09-12T19:10:37.903232+0000","last_fullsized":"2024-09-12T19:10:37.903232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:48.632695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001127308,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'447","reported_seq":1101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:02.915481+0000","last_change":"2024-09-12T19:14:02.915481+0000","last_active":"2024-09-12T19:14:02.915481+0000","last_peered":"2024-09-12T19:14:02.915481+0000","last_clean":"2024-09-12T19:14:02.915481+0000","last_became_active":"2024-09-12T18:26:39.852604+0000","last_became_peered":"2024-09-12T18:26:39.852604+0000","last_unstale":"2024-09-12T19:14:02.915481+0000","last_undegraded":"2024-09-12T19:14:02.915481+0000","last_fullsized":"2024-09-12T19:14:02.915481+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'447","last_scrub_stamp":"2024-09-12T19:14:02.915389+0000","last_deep_scrub":"265'447","last_deep_scrub_stamp":"2024-09-12T19:14:02.915389+0000","last_clean_scrub_stamp":"2024-09-12T19:14:02.915389+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:58.385296+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1797992,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":612,"num_read_kb":8884,"num_write":1284,"num_write_kb":32875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.889750+0000","last_change":"2024-09-12T18:26:43.858389+0000","last_active":"2024-09-12T19:10:03.889750+0000","last_peered":"2024-09-12T19:10:03.889750+0000","last_clean":"2024-09-12T19:10:03.889750+0000","last_became_active":"2024-09-12T18:26:43.857619+0000","last_became_peered":"2024-09-12T18:26:43.857619+0000","last_unstale":"2024-09-12T19:10:03.889750+0000","last_undegraded":"2024-09-12T19:10:03.889750+0000","last_fullsized":"2024-09-12T19:10:03.889750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:43:43.526191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1276","reported_seq":2783,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.165535+0000","last_change":"2024-09-12T18:26:45.866866+0000","last_active":"2024-09-12T19:13:58.165535+0000","last_peered":"2024-09-12T19:13:58.165535+0000","last_clean":"2024-09-12T19:13:58.165535+0000","last_became_active":"2024-09-12T18:26:45.865530+0000","last_became_peered":"2024-09-12T18:26:45.865530+0000","last_unstale":"2024-09-12T19:13:58.165535+0000","last_undegraded":"2024-09-12T19:13:58.165535+0000","last_fullsized":"2024-09-12T19:13:58.165535+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:38.754345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145649,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2006,"num_read_kb":3785,"num_write":1114,"num_write_kb":954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:42.904610+0000","last_change":"2024-09-12T18:26:47.887431+0000","last_active":"2024-09-12T19:10:42.904610+0000","last_peered":"2024-09-12T19:10:42.904610+0000","last_clean":"2024-09-12T19:10:42.904610+0000","last_became_active":"2024-09-12T18:26:47.886707+0000","last_became_peered":"2024-09-12T18:26:47.886707+0000","last_unstale":"2024-09-12T19:10:42.904610+0000","last_undegraded":"2024-09-12T19:10:42.904610+0000","last_fullsized":"2024-09-12T19:10:42.904610+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:24.695168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'194","reported_seq":727,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:22.676957+0000","last_change":"2024-09-12T18:26:49.910993+0000","last_active":"2024-09-12T19:12:22.676957+0000","last_peered":"2024-09-12T19:12:22.676957+0000","last_clean":"2024-09-12T19:12:22.676957+0000","last_became_active":"2024-09-12T18:26:49.909802+0000","last_became_peered":"2024-09-12T18:26:49.909802+0000","last_unstale":"2024-09-12T19:12:22.676957+0000","last_undegraded":"2024-09-12T19:12:22.676957+0000","last_fullsized":"2024-09-12T19:12:22.676957+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:14.966749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":337,"num_read_kb":322,"num_write":434,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'391","reported_seq":1912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.102094+0000","last_change":"2024-09-12T18:26:41.869197+0000","last_active":"2024-09-12T19:13:43.102094+0000","last_peered":"2024-09-12T19:13:43.102094+0000","last_clean":"2024-09-12T19:13:43.102094+0000","last_became_active":"2024-09-12T18:26:41.868958+0000","last_became_peered":"2024-09-12T18:26:41.868958+0000","last_unstale":"2024-09-12T19:13:43.102094+0000","last_undegraded":"2024-09-12T19:13:43.102094+0000","last_fullsized":"2024-09-12T19:13:43.102094+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:46.271646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2137,"num_read_kb":2050,"num_write":435,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":520,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.880725+0000","last_change":"2024-09-12T18:26:27.893863+0000","last_active":"2024-09-12T19:10:13.880725+0000","last_peered":"2024-09-12T19:10:13.880725+0000","last_clean":"2024-09-12T19:10:13.880725+0000","last_became_active":"2024-09-12T18:26:25.559069+0000","last_became_peered":"2024-09-12T18:26:25.559069+0000","last_unstale":"2024-09-12T19:10:13.880725+0000","last_undegraded":"2024-09-12T19:10:13.880725+0000","last_fullsized":"2024-09-12T19:10:13.880725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:18.983449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00065344600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'300","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.368682+0000","last_change":"2024-09-12T18:26:39.833083+0000","last_active":"2024-09-12T19:13:58.368682+0000","last_peered":"2024-09-12T19:13:58.368682+0000","last_clean":"2024-09-12T19:13:58.368682+0000","last_became_active":"2024-09-12T18:26:39.832766+0000","last_became_peered":"2024-09-12T18:26:39.832766+0000","last_unstale":"2024-09-12T19:13:58.368682+0000","last_undegraded":"2024-09-12T19:13:58.368682+0000","last_fullsized":"2024-09-12T19:13:58.368682+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:53:39.006582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":386,"num_read_kb":10646,"num_write":879,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:03.878799+0000","last_change":"2024-09-12T18:26:43.844267+0000","last_active":"2024-09-12T19:10:03.878799+0000","last_peered":"2024-09-12T19:10:03.878799+0000","last_clean":"2024-09-12T19:10:03.878799+0000","last_became_active":"2024-09-12T18:26:43.843884+0000","last_became_peered":"2024-09-12T18:26:43.843884+0000","last_unstale":"2024-09-12T19:10:03.878799+0000","last_undegraded":"2024-09-12T19:10:03.878799+0000","last_fullsized":"2024-09-12T19:10:03.878799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:30.199439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'237","reported_seq":1345,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:40.758792+0000","last_change":"2024-09-12T18:26:46.025252+0000","last_active":"2024-09-12T19:13:40.758792+0000","last_peered":"2024-09-12T19:13:40.758792+0000","last_clean":"2024-09-12T19:13:40.758792+0000","last_became_active":"2024-09-12T18:26:46.024474+0000","last_became_peered":"2024-09-12T18:26:46.024474+0000","last_unstale":"2024-09-12T19:13:40.758792+0000","last_undegraded":"2024-09-12T19:13:40.758792+0000","last_fullsized":"2024-09-12T19:13:40.758792+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:08.550075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.922523+0000","last_change":"2024-09-12T18:26:47.890416+0000","last_active":"2024-09-12T19:10:33.922523+0000","last_peered":"2024-09-12T19:10:33.922523+0000","last_clean":"2024-09-12T19:10:33.922523+0000","last_became_active":"2024-09-12T18:26:47.889718+0000","last_became_peered":"2024-09-12T18:26:47.889718+0000","last_unstale":"2024-09-12T19:10:33.922523+0000","last_undegraded":"2024-09-12T19:10:33.922523+0000","last_fullsized":"2024-09-12T19:10:33.922523+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:51.602872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'249","reported_seq":844,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.430831+0000","last_change":"2024-09-12T18:26:49.913279+0000","last_active":"2024-09-12T19:12:23.430831+0000","last_peered":"2024-09-12T19:12:23.430831+0000","last_clean":"2024-09-12T19:12:23.430831+0000","last_became_active":"2024-09-12T18:26:49.912488+0000","last_became_peered":"2024-09-12T18:26:49.912488+0000","last_unstale":"2024-09-12T19:12:23.430831+0000","last_undegraded":"2024-09-12T19:12:23.430831+0000","last_fullsized":"2024-09-12T19:12:23.430831+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:27.428030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":492,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'918","reported_seq":2678,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:00.244376+0000","last_change":"2024-09-12T18:26:41.849621+0000","last_active":"2024-09-12T19:12:00.244376+0000","last_peered":"2024-09-12T19:12:00.244376+0000","last_clean":"2024-09-12T19:12:00.244376+0000","last_became_active":"2024-09-12T18:26:41.847403+0000","last_became_peered":"2024-09-12T18:26:41.847403+0000","last_unstale":"2024-09-12T19:12:00.244376+0000","last_undegraded":"2024-09-12T19:12:00.244376+0000","last_fullsized":"2024-09-12T19:12:00.244376+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:03.076819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4497,"num_read_kb":4050,"num_write":1227,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.891846+0000","last_change":"2024-09-12T18:26:27.491626+0000","last_active":"2024-09-12T19:10:13.891846+0000","last_peered":"2024-09-12T19:10:13.891846+0000","last_clean":"2024-09-12T19:10:13.891846+0000","last_became_active":"2024-09-12T18:26:25.483909+0000","last_became_peered":"2024-09-12T18:26:25.483909+0000","last_unstale":"2024-09-12T19:10:13.891846+0000","last_undegraded":"2024-09-12T19:10:13.891846+0000","last_fullsized":"2024-09-12T19:10:13.891846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:34.647003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002260153,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'305","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.365715+0000","last_change":"2024-09-12T18:26:39.847712+0000","last_active":"2024-09-12T19:13:58.365715+0000","last_peered":"2024-09-12T19:13:58.365715+0000","last_clean":"2024-09-12T19:13:58.365715+0000","last_became_active":"2024-09-12T18:26:39.847002+0000","last_became_peered":"2024-09-12T18:26:39.847002+0000","last_unstale":"2024-09-12T19:13:58.365715+0000","last_undegraded":"2024-09-12T19:13:58.365715+0000","last_fullsized":"2024-09-12T19:13:58.365715+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:18.232097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":613,"num_read_kb":6223,"num_write":953,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:38.923800+0000","last_change":"2024-09-12T18:26:43.862162+0000","last_active":"2024-09-12T19:10:38.923800+0000","last_peered":"2024-09-12T19:10:38.923800+0000","last_clean":"2024-09-12T19:10:38.923800+0000","last_became_active":"2024-09-12T18:26:43.861753+0000","last_became_peered":"2024-09-12T18:26:43.861753+0000","last_unstale":"2024-09-12T19:10:38.923800+0000","last_undegraded":"2024-09-12T19:10:38.923800+0000","last_fullsized":"2024-09-12T19:10:38.923800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:33.728113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'111","reported_seq":649,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.724941+0000","last_change":"2024-09-12T18:26:45.857442+0000","last_active":"2024-09-12T19:12:18.724941+0000","last_peered":"2024-09-12T19:12:18.724941+0000","last_clean":"2024-09-12T19:12:18.724941+0000","last_became_active":"2024-09-12T18:26:45.856615+0000","last_became_peered":"2024-09-12T18:26:45.856615+0000","last_unstale":"2024-09-12T19:12:18.724941+0000","last_undegraded":"2024-09-12T19:12:18.724941+0000","last_fullsized":"2024-09-12T19:12:18.724941+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:39.665638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.893516+0000","last_change":"2024-09-12T18:26:47.885794+0000","last_active":"2024-09-12T19:10:08.893516+0000","last_peered":"2024-09-12T19:10:08.893516+0000","last_clean":"2024-09-12T19:10:08.893516+0000","last_became_active":"2024-09-12T18:26:47.884981+0000","last_became_peered":"2024-09-12T18:26:47.884981+0000","last_unstale":"2024-09-12T19:10:08.893516+0000","last_undegraded":"2024-09-12T19:10:08.893516+0000","last_fullsized":"2024-09-12T19:10:08.893516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:07.204617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'140","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.019034+0000","last_change":"2024-09-12T18:26:49.918948+0000","last_active":"2024-09-12T19:13:43.019034+0000","last_peered":"2024-09-12T19:13:43.019034+0000","last_clean":"2024-09-12T19:13:43.019034+0000","last_became_active":"2024-09-12T18:26:49.918043+0000","last_became_peered":"2024-09-12T18:26:49.918043+0000","last_unstale":"2024-09-12T19:13:43.019034+0000","last_undegraded":"2024-09-12T19:13:43.019034+0000","last_fullsized":"2024-09-12T19:13:43.019034+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:07.565002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":258,"num_write":354,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'546","reported_seq":2235,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.289400+0000","last_change":"2024-09-12T18:26:41.878502+0000","last_active":"2024-09-12T19:12:23.289400+0000","last_peered":"2024-09-12T19:12:23.289400+0000","last_clean":"2024-09-12T19:12:23.289400+0000","last_became_active":"2024-09-12T18:26:41.878269+0000","last_became_peered":"2024-09-12T18:26:41.878269+0000","last_unstale":"2024-09-12T19:12:23.289400+0000","last_undegraded":"2024-09-12T19:12:23.289400+0000","last_fullsized":"2024-09-12T19:12:23.289400+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:02.850426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2954,"num_read_kb":2745,"num_write":669,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'454","reported_seq":1147,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.358382+0000","last_change":"2024-09-12T18:26:39.853539+0000","last_active":"2024-09-12T19:13:58.358382+0000","last_peered":"2024-09-12T19:13:58.358382+0000","last_clean":"2024-09-12T19:13:58.358382+0000","last_became_active":"2024-09-12T18:26:39.851739+0000","last_became_peered":"2024-09-12T18:26:39.851739+0000","last_unstale":"2024-09-12T19:13:58.358382+0000","last_undegraded":"2024-09-12T19:13:58.358382+0000","last_fullsized":"2024-09-12T19:13:58.358382+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:22.623593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":848,"num_read_kb":21232,"num_write":1357,"num_write_kb":18457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:12.904532+0000","last_change":"2024-09-12T18:26:27.492857+0000","last_active":"2024-09-12T19:10:12.904532+0000","last_peered":"2024-09-12T19:10:12.904532+0000","last_clean":"2024-09-12T19:10:12.904532+0000","last_became_active":"2024-09-12T18:26:25.474997+0000","last_became_peered":"2024-09-12T18:26:25.474997+0000","last_unstale":"2024-09-12T19:10:12.904532+0000","last_undegraded":"2024-09-12T19:10:12.904532+0000","last_fullsized":"2024-09-12T19:10:12.904532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:39.276451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099306900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.921024+0000","last_change":"2024-09-12T18:26:43.866505+0000","last_active":"2024-09-12T19:10:28.921024+0000","last_peered":"2024-09-12T19:10:28.921024+0000","last_clean":"2024-09-12T19:10:28.921024+0000","last_became_active":"2024-09-12T18:26:43.865697+0000","last_became_peered":"2024-09-12T18:26:43.865697+0000","last_unstale":"2024-09-12T19:10:28.921024+0000","last_undegraded":"2024-09-12T19:10:28.921024+0000","last_fullsized":"2024-09-12T19:10:28.921024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:41.285586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'552","reported_seq":1217,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.390324+0000","last_change":"2024-09-12T18:26:45.880984+0000","last_active":"2024-09-12T19:13:58.390324+0000","last_peered":"2024-09-12T19:13:58.390324+0000","last_clean":"2024-09-12T19:13:58.390324+0000","last_became_active":"2024-09-12T18:26:45.877100+0000","last_became_peered":"2024-09-12T18:26:45.877100+0000","last_unstale":"2024-09-12T19:13:58.390324+0000","last_undegraded":"2024-09-12T19:13:58.390324+0000","last_fullsized":"2024-09-12T19:13:58.390324+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:31.277291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103009,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":952,"num_read_kb":2114,"num_write":816,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:34.105870+0000","last_change":"2024-09-12T18:26:47.900861+0000","last_active":"2024-09-12T19:10:34.105870+0000","last_peered":"2024-09-12T19:10:34.105870+0000","last_clean":"2024-09-12T19:10:34.105870+0000","last_became_active":"2024-09-12T18:26:47.900217+0000","last_became_peered":"2024-09-12T18:26:47.900217+0000","last_unstale":"2024-09-12T19:10:34.105870+0000","last_undegraded":"2024-09-12T19:10:34.105870+0000","last_fullsized":"2024-09-12T19:10:34.105870+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:22.630784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'141","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.613946+0000","last_change":"2024-09-12T18:26:49.921916+0000","last_active":"2024-09-12T19:12:18.613946+0000","last_peered":"2024-09-12T19:12:18.613946+0000","last_clean":"2024-09-12T19:12:18.613946+0000","last_became_active":"2024-09-12T18:26:49.921123+0000","last_became_peered":"2024-09-12T18:26:49.921123+0000","last_unstale":"2024-09-12T19:12:18.613946+0000","last_undegraded":"2024-09-12T19:12:18.613946+0000","last_fullsized":"2024-09-12T19:12:18.613946+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:45.398942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":212,"num_read_kb":188,"num_write":350,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'425","reported_seq":1878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.623418+0000","last_change":"2024-09-12T18:26:41.869757+0000","last_active":"2024-09-12T19:12:18.623418+0000","last_peered":"2024-09-12T19:12:18.623418+0000","last_clean":"2024-09-12T19:12:18.623418+0000","last_became_active":"2024-09-12T18:26:41.869426+0000","last_became_peered":"2024-09-12T18:26:41.869426+0000","last_unstale":"2024-09-12T19:12:18.623418+0000","last_undegraded":"2024-09-12T19:12:18.623418+0000","last_fullsized":"2024-09-12T19:12:18.623418+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:16.916527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2246,"num_read_kb":2097,"num_write":505,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'365","reported_seq":1048,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.382818+0000","last_change":"2024-09-12T18:26:39.833175+0000","last_active":"2024-09-12T19:13:58.382818+0000","last_peered":"2024-09-12T19:13:58.382818+0000","last_clean":"2024-09-12T19:13:58.382818+0000","last_became_active":"2024-09-12T18:26:39.832593+0000","last_became_peered":"2024-09-12T18:26:39.832593+0000","last_unstale":"2024-09-12T19:13:58.382818+0000","last_undegraded":"2024-09-12T19:13:58.382818+0000","last_fullsized":"2024-09-12T19:13:58.382818+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:27:39.366882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1569358,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":23528,"num_write":1214,"num_write_kb":24783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899815+0000","last_change":"2024-09-12T18:26:28.282666+0000","last_active":"2024-09-12T19:10:22.899815+0000","last_peered":"2024-09-12T19:10:22.899815+0000","last_clean":"2024-09-12T19:10:22.899815+0000","last_became_active":"2024-09-12T18:26:25.484938+0000","last_became_peered":"2024-09-12T18:26:25.484938+0000","last_unstale":"2024-09-12T19:10:22.899815+0000","last_undegraded":"2024-09-12T19:10:22.899815+0000","last_fullsized":"2024-09-12T19:10:22.899815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:50.645807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001083194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.898070+0000","last_change":"2024-09-12T18:26:43.864066+0000","last_active":"2024-09-12T19:10:28.898070+0000","last_peered":"2024-09-12T19:10:28.898070+0000","last_clean":"2024-09-12T19:10:28.898070+0000","last_became_active":"2024-09-12T18:26:43.863388+0000","last_became_peered":"2024-09-12T18:26:43.863388+0000","last_unstale":"2024-09-12T19:10:28.898070+0000","last_undegraded":"2024-09-12T19:10:28.898070+0000","last_fullsized":"2024-09-12T19:10:28.898070+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:27:19.436463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'160","reported_seq":724,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:15.347431+0000","last_change":"2024-09-12T18:26:46.020793+0000","last_active":"2024-09-12T19:11:15.347431+0000","last_peered":"2024-09-12T19:11:15.347431+0000","last_clean":"2024-09-12T19:11:15.347431+0000","last_became_active":"2024-09-12T18:26:46.020043+0000","last_became_peered":"2024-09-12T18:26:46.020043+0000","last_unstale":"2024-09-12T19:11:15.347431+0000","last_undegraded":"2024-09-12T19:11:15.347431+0000","last_fullsized":"2024-09-12T19:11:15.347431+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:43:28.384889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":189,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'814","reported_seq":2657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.831278+0000","last_change":"2024-09-12T18:26:47.880379+0000","last_active":"2024-09-12T19:13:56.831278+0000","last_peered":"2024-09-12T19:13:56.831278+0000","last_clean":"2024-09-12T19:13:56.831278+0000","last_became_active":"2024-09-12T18:26:47.879630+0000","last_became_peered":"2024-09-12T18:26:47.879630+0000","last_unstale":"2024-09-12T19:13:56.831278+0000","last_undegraded":"2024-09-12T19:13:56.831278+0000","last_fullsized":"2024-09-12T19:13:56.831278+0000","mapping_epoch":32,"log_start":"265'800","ondisk_log_start":"265'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:34.644082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'140","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.115335+0000","last_change":"2024-09-12T18:26:49.920666+0000","last_active":"2024-09-12T19:12:24.115335+0000","last_peered":"2024-09-12T19:12:24.115335+0000","last_clean":"2024-09-12T19:12:24.115335+0000","last_became_active":"2024-09-12T18:26:49.919846+0000","last_became_peered":"2024-09-12T18:26:49.919846+0000","last_unstale":"2024-09-12T19:12:24.115335+0000","last_undegraded":"2024-09-12T19:12:24.115335+0000","last_fullsized":"2024-09-12T19:12:24.115335+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:05:00.339860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":263,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'481","reported_seq":2008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.125760+0000","last_change":"2024-09-12T18:26:41.862442+0000","last_active":"2024-09-12T19:12:24.125760+0000","last_peered":"2024-09-12T19:12:24.125760+0000","last_clean":"2024-09-12T19:12:24.125760+0000","last_became_active":"2024-09-12T18:26:41.862008+0000","last_became_peered":"2024-09-12T18:26:41.862008+0000","last_unstale":"2024-09-12T19:12:24.125760+0000","last_undegraded":"2024-09-12T19:12:24.125760+0000","last_fullsized":"2024-09-12T19:12:24.125760+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:52.293333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":2263,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'341","reported_seq":982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.370999+0000","last_change":"2024-09-12T18:26:39.865325+0000","last_active":"2024-09-12T19:13:58.370999+0000","last_peered":"2024-09-12T19:13:58.370999+0000","last_clean":"2024-09-12T19:13:58.370999+0000","last_became_active":"2024-09-12T18:26:39.865123+0000","last_became_peered":"2024-09-12T18:26:39.865123+0000","last_unstale":"2024-09-12T19:13:58.370999+0000","last_undegraded":"2024-09-12T19:13:58.370999+0000","last_fullsized":"2024-09-12T19:13:58.370999+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:13.963084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":68443,"num_write":1085,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:47.898557+0000","last_change":"2024-09-12T18:26:27.493293+0000","last_active":"2024-09-12T19:09:47.898557+0000","last_peered":"2024-09-12T19:09:47.898557+0000","last_clean":"2024-09-12T19:09:47.898557+0000","last_became_active":"2024-09-12T18:26:25.485137+0000","last_became_peered":"2024-09-12T18:26:25.485137+0000","last_unstale":"2024-09-12T19:09:47.898557+0000","last_undegraded":"2024-09-12T19:09:47.898557+0000","last_fullsized":"2024-09-12T19:09:47.898557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:37.081707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013350759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:29.104750+0000","last_change":"2024-09-12T18:26:43.876064+0000","last_active":"2024-09-12T19:10:29.104750+0000","last_peered":"2024-09-12T19:10:29.104750+0000","last_clean":"2024-09-12T19:10:29.104750+0000","last_became_active":"2024-09-12T18:26:43.874845+0000","last_became_peered":"2024-09-12T18:26:43.874845+0000","last_unstale":"2024-09-12T19:10:29.104750+0000","last_undegraded":"2024-09-12T19:10:29.104750+0000","last_fullsized":"2024-09-12T19:10:29.104750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:36.440895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'106","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.584442+0000","last_change":"2024-09-12T18:26:45.864296+0000","last_active":"2024-09-12T19:11:07.584442+0000","last_peered":"2024-09-12T19:11:07.584442+0000","last_clean":"2024-09-12T19:11:07.584442+0000","last_became_active":"2024-09-12T18:26:45.863254+0000","last_became_peered":"2024-09-12T18:26:45.863254+0000","last_unstale":"2024-09-12T19:11:07.584442+0000","last_undegraded":"2024-09-12T19:11:07.584442+0000","last_fullsized":"2024-09-12T19:11:07.584442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:25.709734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'805","reported_seq":2519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.842088+0000","last_change":"2024-09-12T18:26:47.900388+0000","last_active":"2024-09-12T19:13:56.842088+0000","last_peered":"2024-09-12T19:13:56.842088+0000","last_clean":"2024-09-12T19:13:56.842088+0000","last_became_active":"2024-09-12T18:26:47.899682+0000","last_became_peered":"2024-09-12T18:26:47.899682+0000","last_unstale":"2024-09-12T19:13:56.842088+0000","last_undegraded":"2024-09-12T19:13:56.842088+0000","last_fullsized":"2024-09-12T19:13:56.842088+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:26.128123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'166","reported_seq":671,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.560824+0000","last_change":"2024-09-12T18:26:49.918711+0000","last_active":"2024-09-12T19:12:06.560824+0000","last_peered":"2024-09-12T19:12:06.560824+0000","last_clean":"2024-09-12T19:12:06.560824+0000","last_became_active":"2024-09-12T18:26:49.917537+0000","last_became_peered":"2024-09-12T18:26:49.917537+0000","last_unstale":"2024-09-12T19:12:06.560824+0000","last_undegraded":"2024-09-12T19:12:06.560824+0000","last_fullsized":"2024-09-12T19:12:06.560824+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:42.696961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":124,"num_write":364,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'443","reported_seq":1936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.769155+0000","last_change":"2024-09-12T18:26:41.872406+0000","last_active":"2024-09-12T19:12:08.769155+0000","last_peered":"2024-09-12T19:12:08.769155+0000","last_clean":"2024-09-12T19:12:08.769155+0000","last_became_active":"2024-09-12T18:26:41.871518+0000","last_became_peered":"2024-09-12T18:26:41.871518+0000","last_unstale":"2024-09-12T19:12:08.769155+0000","last_undegraded":"2024-09-12T19:12:08.769155+0000","last_fullsized":"2024-09-12T19:12:08.769155+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:26.103139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2145,"num_write":516,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'309","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.347713+0000","last_change":"2024-09-12T18:26:39.834460+0000","last_active":"2024-09-12T19:13:58.347713+0000","last_peered":"2024-09-12T19:13:58.347713+0000","last_clean":"2024-09-12T19:13:58.347713+0000","last_became_active":"2024-09-12T18:26:39.833924+0000","last_became_peered":"2024-09-12T18:26:39.833924+0000","last_unstale":"2024-09-12T19:13:58.347713+0000","last_undegraded":"2024-09-12T19:13:58.347713+0000","last_fullsized":"2024-09-12T19:13:58.347713+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:19.120900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6467978,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":59970,"num_write":1010,"num_write_kb":34278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.888730+0000","last_change":"2024-09-12T18:26:27.699071+0000","last_active":"2024-09-12T19:09:48.888730+0000","last_peered":"2024-09-12T19:09:48.888730+0000","last_clean":"2024-09-12T19:09:48.888730+0000","last_became_active":"2024-09-12T18:26:25.487465+0000","last_became_peered":"2024-09-12T18:26:25.487465+0000","last_unstale":"2024-09-12T19:09:48.888730+0000","last_undegraded":"2024-09-12T19:09:48.888730+0000","last_fullsized":"2024-09-12T19:09:48.888730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:24.443130+0000","last_clean_scrub_stamp":"2024-09-12T18:26:24.443130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:22.342394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010368949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.924444+0000","last_change":"2024-09-12T18:26:43.851056+0000","last_active":"2024-09-12T19:10:48.924444+0000","last_peered":"2024-09-12T19:10:48.924444+0000","last_clean":"2024-09-12T19:10:48.924444+0000","last_became_active":"2024-09-12T18:26:43.850274+0000","last_became_peered":"2024-09-12T18:26:43.850274+0000","last_unstale":"2024-09-12T19:10:48.924444+0000","last_undegraded":"2024-09-12T19:10:48.924444+0000","last_fullsized":"2024-09-12T19:10:48.924444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:39.140912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'720","reported_seq":1433,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.289812+0000","last_change":"2024-09-12T18:26:46.021959+0000","last_active":"2024-09-12T19:13:58.289812+0000","last_peered":"2024-09-12T19:13:58.289812+0000","last_clean":"2024-09-12T19:13:58.289812+0000","last_became_active":"2024-09-12T18:26:46.021217+0000","last_became_peered":"2024-09-12T18:26:46.021217+0000","last_unstale":"2024-09-12T19:13:58.289812+0000","last_undegraded":"2024-09-12T19:13:58.289812+0000","last_fullsized":"2024-09-12T19:13:58.289812+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:41.193709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1300,"num_read_kb":3120,"num_write":1062,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.920778+0000","last_change":"2024-09-12T18:26:47.903443+0000","last_active":"2024-09-12T19:10:33.920778+0000","last_peered":"2024-09-12T19:10:33.920778+0000","last_clean":"2024-09-12T19:10:33.920778+0000","last_became_active":"2024-09-12T18:26:47.902750+0000","last_became_peered":"2024-09-12T18:26:47.902750+0000","last_unstale":"2024-09-12T19:10:33.920778+0000","last_undegraded":"2024-09-12T19:10:33.920778+0000","last_fullsized":"2024-09-12T19:10:33.920778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:44.433901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'107","reported_seq":606,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:06.951330+0000","last_change":"2024-09-12T18:26:49.920307+0000","last_active":"2024-09-12T19:11:06.951330+0000","last_peered":"2024-09-12T19:11:06.951330+0000","last_clean":"2024-09-12T19:11:06.951330+0000","last_became_active":"2024-09-12T18:26:49.919630+0000","last_became_peered":"2024-09-12T18:26:49.919630+0000","last_unstale":"2024-09-12T19:11:06.951330+0000","last_undegraded":"2024-09-12T19:11:06.951330+0000","last_fullsized":"2024-09-12T19:11:06.951330+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:39:18.038651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":269,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'143","reported_seq":705,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.274239+0000","last_change":"2024-09-12T18:26:49.913310+0000","last_active":"2024-09-12T19:12:24.274239+0000","last_peered":"2024-09-12T19:12:24.274239+0000","last_clean":"2024-09-12T19:12:24.274239+0000","last_became_active":"2024-09-12T18:26:49.912589+0000","last_became_peered":"2024-09-12T18:26:49.912589+0000","last_unstale":"2024-09-12T19:12:24.274239+0000","last_undegraded":"2024-09-12T19:12:24.274239+0000","last_fullsized":"2024-09-12T19:12:24.274239+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:07.282432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":221,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'913","reported_seq":2534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.894035+0000","last_change":"2024-09-12T18:26:41.876618+0000","last_active":"2024-09-12T19:12:07.894035+0000","last_peered":"2024-09-12T19:12:07.894035+0000","last_clean":"2024-09-12T19:12:07.894035+0000","last_became_active":"2024-09-12T18:26:41.875870+0000","last_became_peered":"2024-09-12T18:26:41.875870+0000","last_unstale":"2024-09-12T19:12:07.894035+0000","last_undegraded":"2024-09-12T19:12:07.894035+0000","last_fullsized":"2024-09-12T19:12:07.894035+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:06.713897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4445,"num_read_kb":3959,"num_write":1252,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'306","reported_seq":945,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.380328+0000","last_change":"2024-09-12T18:26:39.871102+0000","last_active":"2024-09-12T19:13:58.380328+0000","last_peered":"2024-09-12T19:13:58.380328+0000","last_clean":"2024-09-12T19:13:58.380328+0000","last_became_active":"2024-09-12T18:26:39.870576+0000","last_became_peered":"2024-09-12T18:26:39.870576+0000","last_unstale":"2024-09-12T19:13:58.380328+0000","last_undegraded":"2024-09-12T19:13:58.380328+0000","last_fullsized":"2024-09-12T19:13:58.380328+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:00.119644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":31608,"num_write":917,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.917883+0000","last_change":"2024-09-12T18:26:43.865954+0000","last_active":"2024-09-12T19:11:07.917883+0000","last_peered":"2024-09-12T19:11:07.917883+0000","last_clean":"2024-09-12T19:11:07.917883+0000","last_became_active":"2024-09-12T18:26:43.864969+0000","last_became_peered":"2024-09-12T18:26:43.864969+0000","last_unstale":"2024-09-12T19:11:07.917883+0000","last_undegraded":"2024-09-12T19:11:07.917883+0000","last_fullsized":"2024-09-12T19:11:07.917883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:54.874241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'276","reported_seq":848,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.485175+0000","last_change":"2024-09-12T18:26:45.866194+0000","last_active":"2024-09-12T19:13:57.485175+0000","last_peered":"2024-09-12T19:13:57.485175+0000","last_clean":"2024-09-12T19:13:57.485175+0000","last_became_active":"2024-09-12T18:26:45.865329+0000","last_became_peered":"2024-09-12T18:26:45.865329+0000","last_unstale":"2024-09-12T19:13:57.485175+0000","last_undegraded":"2024-09-12T19:13:57.485175+0000","last_fullsized":"2024-09-12T19:13:57.485175+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:49.534078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":1095,"num_write":382,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.929904+0000","last_change":"2024-09-12T18:26:47.891460+0000","last_active":"2024-09-12T19:11:08.929904+0000","last_peered":"2024-09-12T19:11:08.929904+0000","last_clean":"2024-09-12T19:11:08.929904+0000","last_became_active":"2024-09-12T18:26:47.890741+0000","last_became_peered":"2024-09-12T18:26:47.890741+0000","last_unstale":"2024-09-12T19:11:08.929904+0000","last_undegraded":"2024-09-12T19:11:08.929904+0000","last_fullsized":"2024-09-12T19:11:08.929904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:13.839409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'196","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.440206+0000","last_change":"2024-09-12T18:26:49.915054+0000","last_active":"2024-09-12T19:11:38.440206+0000","last_peered":"2024-09-12T19:11:38.440206+0000","last_clean":"2024-09-12T19:11:38.440206+0000","last_became_active":"2024-09-12T18:26:49.914506+0000","last_became_peered":"2024-09-12T18:26:49.914506+0000","last_unstale":"2024-09-12T19:11:38.440206+0000","last_undegraded":"2024-09-12T19:11:38.440206+0000","last_fullsized":"2024-09-12T19:11:38.440206+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:39.521599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":157,"num_write":456,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'900","reported_seq":2436,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.125291+0000","last_change":"2024-09-12T18:26:41.868353+0000","last_active":"2024-09-12T19:12:24.125291+0000","last_peered":"2024-09-12T19:12:24.125291+0000","last_clean":"2024-09-12T19:12:24.125291+0000","last_became_active":"2024-09-12T18:26:41.868082+0000","last_became_peered":"2024-09-12T18:26:41.868082+0000","last_unstale":"2024-09-12T19:12:24.125291+0000","last_undegraded":"2024-09-12T19:12:24.125291+0000","last_fullsized":"2024-09-12T19:12:24.125291+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:35.031358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4276,"num_read_kb":3807,"num_write":1253,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'382","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.377913+0000","last_change":"2024-09-12T18:26:39.870444+0000","last_active":"2024-09-12T19:13:58.377913+0000","last_peered":"2024-09-12T19:13:58.377913+0000","last_clean":"2024-09-12T19:13:58.377913+0000","last_became_active":"2024-09-12T18:26:39.869754+0000","last_became_peered":"2024-09-12T18:26:39.869754+0000","last_unstale":"2024-09-12T19:13:58.377913+0000","last_undegraded":"2024-09-12T19:13:58.377913+0000","last_fullsized":"2024-09-12T19:13:58.377913+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:45:26.428249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525344,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":32033,"num_write":1221,"num_write_kb":47606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"36'5","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.571569+0000","last_change":"2024-09-12T18:26:43.854895+0000","last_active":"2024-09-12T19:13:56.571569+0000","last_peered":"2024-09-12T19:13:56.571569+0000","last_clean":"2024-09-12T19:13:56.571569+0000","last_became_active":"2024-09-12T18:26:43.854155+0000","last_became_peered":"2024-09-12T18:26:43.854155+0000","last_unstale":"2024-09-12T19:13:56.571569+0000","last_undegraded":"2024-09-12T19:13:56.571569+0000","last_fullsized":"2024-09-12T19:13:56.571569+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:39.758296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'67","reported_seq":571,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.295664+0000","last_change":"2024-09-12T18:26:45.880353+0000","last_active":"2024-09-12T19:12:23.295664+0000","last_peered":"2024-09-12T19:12:23.295664+0000","last_clean":"2024-09-12T19:12:23.295664+0000","last_became_active":"2024-09-12T18:26:45.876785+0000","last_became_peered":"2024-09-12T18:26:45.876785+0000","last_unstale":"2024-09-12T19:12:23.295664+0000","last_undegraded":"2024-09-12T19:12:23.295664+0000","last_fullsized":"2024-09-12T19:12:23.295664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:44.259605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910233+0000","last_change":"2024-09-12T18:26:47.891685+0000","last_active":"2024-09-12T19:11:07.910233+0000","last_peered":"2024-09-12T19:11:07.910233+0000","last_clean":"2024-09-12T19:11:07.910233+0000","last_became_active":"2024-09-12T18:26:47.890879+0000","last_became_peered":"2024-09-12T18:26:47.890879+0000","last_unstale":"2024-09-12T19:11:07.910233+0000","last_undegraded":"2024-09-12T19:11:07.910233+0000","last_fullsized":"2024-09-12T19:11:07.910233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:38.226570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'240","reported_seq":768,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.263121+0000","last_change":"2024-09-12T18:26:49.926668+0000","last_active":"2024-09-12T19:12:23.263121+0000","last_peered":"2024-09-12T19:12:23.263121+0000","last_clean":"2024-09-12T19:12:23.263121+0000","last_became_active":"2024-09-12T18:26:49.925984+0000","last_became_peered":"2024-09-12T18:26:49.925984+0000","last_unstale":"2024-09-12T19:12:23.263121+0000","last_undegraded":"2024-09-12T19:12:23.263121+0000","last_fullsized":"2024-09-12T19:12:23.263121+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:22:41.544032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":350,"num_read_kb":337,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'459","reported_seq":2018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.554179+0000","last_change":"2024-09-12T18:26:41.882252+0000","last_active":"2024-09-12T19:12:09.554179+0000","last_peered":"2024-09-12T19:12:09.554179+0000","last_clean":"2024-09-12T19:12:09.554179+0000","last_became_active":"2024-09-12T18:26:41.881971+0000","last_became_peered":"2024-09-12T18:26:41.881971+0000","last_unstale":"2024-09-12T19:12:09.554179+0000","last_undegraded":"2024-09-12T19:12:09.554179+0000","last_fullsized":"2024-09-12T19:12:09.554179+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:07.504109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2569,"num_read_kb":2413,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'354","reported_seq":1005,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.335768+0000","last_change":"2024-09-12T18:26:39.874319+0000","last_active":"2024-09-12T19:13:58.335768+0000","last_peered":"2024-09-12T19:13:58.335768+0000","last_clean":"2024-09-12T19:13:58.335768+0000","last_became_active":"2024-09-12T18:26:39.873510+0000","last_became_peered":"2024-09-12T18:26:39.873510+0000","last_unstale":"2024-09-12T19:13:58.335768+0000","last_undegraded":"2024-09-12T19:13:58.335768+0000","last_fullsized":"2024-09-12T19:13:58.335768+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:47.297748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":9367,"num_write":1141,"num_write_kb":22463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910172+0000","last_change":"2024-09-12T18:26:43.860596+0000","last_active":"2024-09-12T19:11:07.910172+0000","last_peered":"2024-09-12T19:11:07.910172+0000","last_clean":"2024-09-12T19:11:07.910172+0000","last_became_active":"2024-09-12T18:26:43.859847+0000","last_became_peered":"2024-09-12T18:26:43.859847+0000","last_unstale":"2024-09-12T19:11:07.910172+0000","last_undegraded":"2024-09-12T19:11:07.910172+0000","last_fullsized":"2024-09-12T19:11:07.910172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:16.685561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'318","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.325144+0000","last_change":"2024-09-12T18:26:45.878384+0000","last_active":"2024-09-12T19:13:58.325144+0000","last_peered":"2024-09-12T19:13:58.325144+0000","last_clean":"2024-09-12T19:13:58.325144+0000","last_became_active":"2024-09-12T18:26:45.877790+0000","last_became_peered":"2024-09-12T18:26:45.877790+0000","last_unstale":"2024-09-12T19:13:58.325144+0000","last_undegraded":"2024-09-12T19:13:58.325144+0000","last_fullsized":"2024-09-12T19:13:58.325144+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:03.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53461,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1153,"num_write":418,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.906698+0000","last_change":"2024-09-12T18:26:47.888972+0000","last_active":"2024-09-12T19:11:08.906698+0000","last_peered":"2024-09-12T19:11:08.906698+0000","last_clean":"2024-09-12T19:11:08.906698+0000","last_became_active":"2024-09-12T18:26:47.888252+0000","last_became_peered":"2024-09-12T18:26:47.888252+0000","last_unstale":"2024-09-12T19:11:08.906698+0000","last_undegraded":"2024-09-12T19:11:08.906698+0000","last_fullsized":"2024-09-12T19:11:08.906698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:23.691736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'144","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.914495+0000","last_change":"2024-09-12T18:26:49.923128+0000","last_active":"2024-09-12T19:11:19.914495+0000","last_peered":"2024-09-12T19:11:19.914495+0000","last_clean":"2024-09-12T19:11:19.914495+0000","last_became_active":"2024-09-12T18:26:49.922459+0000","last_became_peered":"2024-09-12T18:26:49.922459+0000","last_unstale":"2024-09-12T19:11:19.914495+0000","last_undegraded":"2024-09-12T19:11:19.914495+0000","last_fullsized":"2024-09-12T19:11:19.914495+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:13.475689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":460,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":153,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'471","reported_seq":1980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.622655+0000","last_change":"2024-09-12T18:26:41.851184+0000","last_active":"2024-09-12T19:12:18.622655+0000","last_peered":"2024-09-12T19:12:18.622655+0000","last_clean":"2024-09-12T19:12:18.622655+0000","last_became_active":"2024-09-12T18:26:41.850749+0000","last_became_peered":"2024-09-12T18:26:41.850749+0000","last_unstale":"2024-09-12T19:12:18.622655+0000","last_undegraded":"2024-09-12T19:12:18.622655+0000","last_fullsized":"2024-09-12T19:12:18.622655+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:25.945669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2503,"num_read_kb":2331,"num_write":575,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'386","reported_seq":1045,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.354020+0000","last_change":"2024-09-12T18:26:39.854610+0000","last_active":"2024-09-12T19:13:58.354020+0000","last_peered":"2024-09-12T19:13:58.354020+0000","last_clean":"2024-09-12T19:13:58.354020+0000","last_became_active":"2024-09-12T18:26:39.854328+0000","last_became_peered":"2024-09-12T18:26:39.854328+0000","last_unstale":"2024-09-12T19:13:58.354020+0000","last_undegraded":"2024-09-12T19:13:58.354020+0000","last_fullsized":"2024-09-12T19:13:58.354020+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:21.829716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653632,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":578,"num_read_kb":9662,"num_write":1241,"num_write_kb":35097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.905457+0000","last_change":"2024-09-12T18:26:43.866117+0000","last_active":"2024-09-12T19:11:03.905457+0000","last_peered":"2024-09-12T19:11:03.905457+0000","last_clean":"2024-09-12T19:11:03.905457+0000","last_became_active":"2024-09-12T18:26:43.865454+0000","last_became_peered":"2024-09-12T18:26:43.865454+0000","last_unstale":"2024-09-12T19:11:03.905457+0000","last_undegraded":"2024-09-12T19:11:03.905457+0000","last_fullsized":"2024-09-12T19:11:03.905457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:55.077443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'247","reported_seq":811,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.220497+0000","last_change":"2024-09-12T18:26:45.867830+0000","last_active":"2024-09-12T19:13:58.220497+0000","last_peered":"2024-09-12T19:13:58.220497+0000","last_clean":"2024-09-12T19:13:58.220497+0000","last_became_active":"2024-09-12T18:26:45.867096+0000","last_became_peered":"2024-09-12T18:26:45.867096+0000","last_unstale":"2024-09-12T19:13:58.220497+0000","last_undegraded":"2024-09-12T19:13:58.220497+0000","last_fullsized":"2024-09-12T19:13:58.220497+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.958792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50031,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":412,"num_read_kb":948,"num_write":330,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.932045+0000","last_change":"2024-09-12T18:26:47.895791+0000","last_active":"2024-09-12T19:11:08.932045+0000","last_peered":"2024-09-12T19:11:08.932045+0000","last_clean":"2024-09-12T19:11:08.932045+0000","last_became_active":"2024-09-12T18:26:47.895092+0000","last_became_peered":"2024-09-12T18:26:47.895092+0000","last_unstale":"2024-09-12T19:11:08.932045+0000","last_undegraded":"2024-09-12T19:11:08.932045+0000","last_fullsized":"2024-09-12T19:11:08.932045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:05.232441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'821","reported_seq":2419,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.207286+0000","last_change":"2024-09-12T18:26:41.872671+0000","last_active":"2024-09-12T19:11:58.207286+0000","last_peered":"2024-09-12T19:11:58.207286+0000","last_clean":"2024-09-12T19:11:58.207286+0000","last_became_active":"2024-09-12T18:26:41.871943+0000","last_became_peered":"2024-09-12T18:26:41.871943+0000","last_unstale":"2024-09-12T19:11:58.207286+0000","last_undegraded":"2024-09-12T19:11:58.207286+0000","last_fullsized":"2024-09-12T19:11:58.207286+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":800,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:15.536437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3898,"num_read_kb":3510,"num_write":1047,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'390","reported_seq":1086,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.314287+0000","last_change":"2024-09-12T18:26:39.831302+0000","last_active":"2024-09-12T19:13:58.314287+0000","last_peered":"2024-09-12T19:13:58.314287+0000","last_clean":"2024-09-12T19:13:58.314287+0000","last_became_active":"2024-09-12T18:26:39.830963+0000","last_became_peered":"2024-09-12T18:26:39.830963+0000","last_unstale":"2024-09-12T19:13:58.314287+0000","last_undegraded":"2024-09-12T19:13:58.314287+0000","last_fullsized":"2024-09-12T19:13:58.314287+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:38:33.362610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1535921,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":35487,"num_write":1279,"num_write_kb":27084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:53.927546+0000","last_change":"2024-09-12T18:26:43.861948+0000","last_active":"2024-09-12T19:10:53.927546+0000","last_peered":"2024-09-12T19:10:53.927546+0000","last_clean":"2024-09-12T19:10:53.927546+0000","last_became_active":"2024-09-12T18:26:43.861521+0000","last_became_peered":"2024-09-12T18:26:43.861521+0000","last_unstale":"2024-09-12T19:10:53.927546+0000","last_undegraded":"2024-09-12T19:10:53.927546+0000","last_fullsized":"2024-09-12T19:10:53.927546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:00.161505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'450","reported_seq":1080,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.187172+0000","last_change":"2024-09-12T18:26:45.873087+0000","last_active":"2024-09-12T19:13:58.187172+0000","last_peered":"2024-09-12T19:13:58.187172+0000","last_clean":"2024-09-12T19:13:58.187172+0000","last_became_active":"2024-09-12T18:26:45.872177+0000","last_became_peered":"2024-09-12T18:26:45.872177+0000","last_unstale":"2024-09-12T19:13:58.187172+0000","last_undegraded":"2024-09-12T19:13:58.187172+0000","last_fullsized":"2024-09-12T19:13:58.187172+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:05:14.142703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101880,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":818,"num_read_kb":1923,"num_write":698,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.879188+0000","last_change":"2024-09-12T18:26:47.903167+0000","last_active":"2024-09-12T19:09:18.879188+0000","last_peered":"2024-09-12T19:09:18.879188+0000","last_clean":"2024-09-12T19:09:18.879188+0000","last_became_active":"2024-09-12T18:26:47.902702+0000","last_became_peered":"2024-09-12T18:26:47.902702+0000","last_unstale":"2024-09-12T19:09:18.879188+0000","last_undegraded":"2024-09-12T19:09:18.879188+0000","last_fullsized":"2024-09-12T19:09:18.879188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:58.910571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'188","reported_seq":695,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.315741+0000","last_change":"2024-09-12T18:26:49.920882+0000","last_active":"2024-09-12T19:12:23.315741+0000","last_peered":"2024-09-12T19:12:23.315741+0000","last_clean":"2024-09-12T19:12:23.315741+0000","last_became_active":"2024-09-12T18:26:49.920066+0000","last_became_peered":"2024-09-12T18:26:49.920066+0000","last_unstale":"2024-09-12T19:12:23.315741+0000","last_undegraded":"2024-09-12T19:12:23.315741+0000","last_fullsized":"2024-09-12T19:12:23.315741+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:38.018526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":247,"num_read_kb":248,"num_write":459,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'764","reported_seq":2241,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:04.036663+0000","last_change":"2024-09-12T18:26:41.853638+0000","last_active":"2024-09-12T19:12:04.036663+0000","last_peered":"2024-09-12T19:12:04.036663+0000","last_clean":"2024-09-12T19:12:04.036663+0000","last_became_active":"2024-09-12T18:26:41.852157+0000","last_became_peered":"2024-09-12T18:26:41.852157+0000","last_unstale":"2024-09-12T19:12:04.036663+0000","last_undegraded":"2024-09-12T19:12:04.036663+0000","last_fullsized":"2024-09-12T19:12:04.036663+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:44:07.965311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3590,"num_read_kb":3230,"num_write":1002,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'352","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.357203+0000","last_change":"2024-09-12T18:27:11.827995+0000","last_active":"2024-09-12T19:13:58.357203+0000","last_peered":"2024-09-12T19:13:58.357203+0000","last_clean":"2024-09-12T19:13:58.357203+0000","last_became_active":"2024-09-12T18:27:11.827218+0000","last_became_peered":"2024-09-12T18:27:11.827218+0000","last_unstale":"2024-09-12T19:13:58.357203+0000","last_undegraded":"2024-09-12T19:13:58.357203+0000","last_fullsized":"2024-09-12T19:13:58.357203+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:32:06.201837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35618,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":7368,"num_write":1157,"num_write_kb":18791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.898175+0000","last_change":"2024-09-12T18:26:43.866082+0000","last_active":"2024-09-12T19:10:28.898175+0000","last_peered":"2024-09-12T19:10:28.898175+0000","last_clean":"2024-09-12T19:10:28.898175+0000","last_became_active":"2024-09-12T18:26:43.865319+0000","last_became_peered":"2024-09-12T18:26:43.865319+0000","last_unstale":"2024-09-12T19:10:28.898175+0000","last_undegraded":"2024-09-12T19:10:28.898175+0000","last_fullsized":"2024-09-12T19:10:28.898175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:34.611869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'297","reported_seq":874,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.253460+0000","last_change":"2024-09-12T18:26:45.874050+0000","last_active":"2024-09-12T19:13:58.253460+0000","last_peered":"2024-09-12T19:13:58.253460+0000","last_clean":"2024-09-12T19:13:58.253460+0000","last_became_active":"2024-09-12T18:26:45.873197+0000","last_became_peered":"2024-09-12T18:26:45.873197+0000","last_unstale":"2024-09-12T19:13:58.253460+0000","last_undegraded":"2024-09-12T19:13:58.253460+0000","last_fullsized":"2024-09-12T19:13:58.253460+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:01.225799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55940,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":484,"num_read_kb":1049,"num_write":402,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:17.891370+0000","last_change":"2024-09-12T18:26:47.884995+0000","last_active":"2024-09-12T19:09:17.891370+0000","last_peered":"2024-09-12T19:09:17.891370+0000","last_clean":"2024-09-12T19:09:17.891370+0000","last_became_active":"2024-09-12T18:26:47.883930+0000","last_became_peered":"2024-09-12T18:26:47.883930+0000","last_unstale":"2024-09-12T19:09:17.891370+0000","last_undegraded":"2024-09-12T19:09:17.891370+0000","last_fullsized":"2024-09-12T19:09:17.891370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:45.633573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'180","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.119927+0000","last_change":"2024-09-12T18:26:49.922518+0000","last_active":"2024-09-12T19:12:24.119927+0000","last_peered":"2024-09-12T19:12:24.119927+0000","last_clean":"2024-09-12T19:12:24.119927+0000","last_became_active":"2024-09-12T18:26:49.921797+0000","last_became_peered":"2024-09-12T18:26:49.921797+0000","last_unstale":"2024-09-12T19:12:24.119927+0000","last_undegraded":"2024-09-12T19:12:24.119927+0000","last_fullsized":"2024-09-12T19:12:24.119927+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:13.451147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1230,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":213,"num_write":519,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'508","reported_seq":1855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.603092+0000","last_change":"2024-09-12T18:26:41.851238+0000","last_active":"2024-09-12T19:12:06.603092+0000","last_peered":"2024-09-12T19:12:06.603092+0000","last_clean":"2024-09-12T19:12:06.603092+0000","last_became_active":"2024-09-12T18:26:41.850647+0000","last_became_peered":"2024-09-12T18:26:41.850647+0000","last_unstale":"2024-09-12T19:12:06.603092+0000","last_undegraded":"2024-09-12T19:12:06.603092+0000","last_fullsized":"2024-09-12T19:12:06.603092+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:41:45.957699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2444,"num_write":714,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'365","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.381119+0000","last_change":"2024-09-12T18:26:39.842569+0000","last_active":"2024-09-12T19:13:58.381119+0000","last_peered":"2024-09-12T19:13:58.381119+0000","last_clean":"2024-09-12T19:13:58.381119+0000","last_became_active":"2024-09-12T18:26:39.840458+0000","last_became_peered":"2024-09-12T18:26:39.840458+0000","last_unstale":"2024-09-12T19:13:58.381119+0000","last_undegraded":"2024-09-12T19:13:58.381119+0000","last_fullsized":"2024-09-12T19:13:58.381119+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:32:05.706995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":36107,"num_write":1118,"num_write_kb":45658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:14.088096+0000","last_change":"2024-09-12T18:26:43.876974+0000","last_active":"2024-09-12T19:09:14.088096+0000","last_peered":"2024-09-12T19:09:14.088096+0000","last_clean":"2024-09-12T19:09:14.088096+0000","last_became_active":"2024-09-12T18:26:43.873669+0000","last_became_peered":"2024-09-12T18:26:43.873669+0000","last_unstale":"2024-09-12T19:09:14.088096+0000","last_undegraded":"2024-09-12T19:09:14.088096+0000","last_fullsized":"2024-09-12T19:09:14.088096+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:55.720687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'284","reported_seq":858,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.694187+0000","last_change":"2024-09-12T18:26:46.023642+0000","last_active":"2024-09-12T19:13:57.694187+0000","last_peered":"2024-09-12T19:13:57.694187+0000","last_clean":"2024-09-12T19:13:57.694187+0000","last_became_active":"2024-09-12T18:26:46.023025+0000","last_became_peered":"2024-09-12T18:26:46.023025+0000","last_unstale":"2024-09-12T19:13:57.694187+0000","last_undegraded":"2024-09-12T19:13:57.694187+0000","last_fullsized":"2024-09-12T19:13:57.694187+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:34.349134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44021,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":1142,"num_write":398,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:57.915384+0000","last_change":"2024-09-12T18:26:47.893458+0000","last_active":"2024-09-12T19:10:57.915384+0000","last_peered":"2024-09-12T19:10:57.915384+0000","last_clean":"2024-09-12T19:10:57.915384+0000","last_became_active":"2024-09-12T18:26:47.892678+0000","last_became_peered":"2024-09-12T18:26:47.892678+0000","last_unstale":"2024-09-12T19:10:57.915384+0000","last_undegraded":"2024-09-12T19:10:57.915384+0000","last_fullsized":"2024-09-12T19:10:57.915384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:22.345925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'113","reported_seq":596,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.000115+0000","last_change":"2024-09-12T18:26:49.919935+0000","last_active":"2024-09-12T19:13:44.000115+0000","last_peered":"2024-09-12T19:13:44.000115+0000","last_clean":"2024-09-12T19:13:44.000115+0000","last_became_active":"2024-09-12T18:26:49.919229+0000","last_became_peered":"2024-09-12T18:26:49.919229+0000","last_unstale":"2024-09-12T19:13:44.000115+0000","last_undegraded":"2024-09-12T19:13:44.000115+0000","last_fullsized":"2024-09-12T19:13:44.000115+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:52.637762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":95,"num_write":270,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'503","reported_seq":2204,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.539957+0000","last_change":"2024-09-12T18:26:41.844984+0000","last_active":"2024-09-12T19:12:09.539957+0000","last_peered":"2024-09-12T19:12:09.539957+0000","last_clean":"2024-09-12T19:12:09.539957+0000","last_became_active":"2024-09-12T18:26:41.844608+0000","last_became_peered":"2024-09-12T18:26:41.844608+0000","last_unstale":"2024-09-12T19:12:09.539957+0000","last_undegraded":"2024-09-12T19:12:09.539957+0000","last_fullsized":"2024-09-12T19:12:09.539957+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:01.162341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2752,"num_read_kb":2596,"num_write":594,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'346","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.382002+0000","last_change":"2024-09-12T18:27:11.807858+0000","last_active":"2024-09-12T19:13:58.382002+0000","last_peered":"2024-09-12T19:13:58.382002+0000","last_clean":"2024-09-12T19:13:58.382002+0000","last_became_active":"2024-09-12T18:27:11.807022+0000","last_became_peered":"2024-09-12T18:27:11.807022+0000","last_unstale":"2024-09-12T19:13:58.382002+0000","last_undegraded":"2024-09-12T19:13:58.382002+0000","last_fullsized":"2024-09-12T19:13:58.382002+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:42.477672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4711351,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":491,"num_read_kb":61134,"num_write":1039,"num_write_kb":46178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:17.891331+0000","last_change":"2024-09-12T18:26:43.860395+0000","last_active":"2024-09-12T19:09:17.891331+0000","last_peered":"2024-09-12T19:09:17.891331+0000","last_clean":"2024-09-12T19:09:17.891331+0000","last_became_active":"2024-09-12T18:26:43.859997+0000","last_became_peered":"2024-09-12T18:26:43.859997+0000","last_unstale":"2024-09-12T19:09:17.891331+0000","last_undegraded":"2024-09-12T19:09:17.891331+0000","last_fullsized":"2024-09-12T19:09:17.891331+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:23.870876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'90","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:21.975628+0000","last_change":"2024-09-12T18:26:46.022987+0000","last_active":"2024-09-12T19:11:21.975628+0000","last_peered":"2024-09-12T19:11:21.975628+0000","last_clean":"2024-09-12T19:11:21.975628+0000","last_became_active":"2024-09-12T18:26:46.022246+0000","last_became_peered":"2024-09-12T18:26:46.022246+0000","last_unstale":"2024-09-12T19:11:21.975628+0000","last_undegraded":"2024-09-12T19:11:21.975628+0000","last_fullsized":"2024-09-12T19:11:21.975628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:05.130410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":130,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'771","reported_seq":2310,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.035276+0000","last_change":"2024-09-12T18:26:47.894434+0000","last_active":"2024-09-12T19:13:58.035276+0000","last_peered":"2024-09-12T19:13:58.035276+0000","last_clean":"2024-09-12T19:13:58.035276+0000","last_became_active":"2024-09-12T18:26:47.891107+0000","last_became_peered":"2024-09-12T18:26:47.891107+0000","last_unstale":"2024-09-12T19:13:58.035276+0000","last_undegraded":"2024-09-12T19:13:58.035276+0000","last_fullsized":"2024-09-12T19:13:58.035276+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":701,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:30.324222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'114","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.746554+0000","last_change":"2024-09-12T18:26:49.916767+0000","last_active":"2024-09-12T19:12:21.746554+0000","last_peered":"2024-09-12T19:12:21.746554+0000","last_clean":"2024-09-12T19:12:21.746554+0000","last_became_active":"2024-09-12T18:26:49.915975+0000","last_became_peered":"2024-09-12T18:26:49.915975+0000","last_unstale":"2024-09-12T19:12:21.746554+0000","last_undegraded":"2024-09-12T19:12:21.746554+0000","last_fullsized":"2024-09-12T19:12:21.746554+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:39.304415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":276,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'457","reported_seq":2178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.110966+0000","last_change":"2024-09-12T18:26:41.853916+0000","last_active":"2024-09-12T19:12:24.110966+0000","last_peered":"2024-09-12T19:12:24.110966+0000","last_clean":"2024-09-12T19:12:24.110966+0000","last_became_active":"2024-09-12T18:26:41.853112+0000","last_became_peered":"2024-09-12T18:26:41.853112+0000","last_unstale":"2024-09-12T19:12:24.110966+0000","last_undegraded":"2024-09-12T19:12:24.110966+0000","last_fullsized":"2024-09-12T19:12:24.110966+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:47.031551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2539,"num_write":529,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'378","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.371672+0000","last_change":"2024-09-12T18:26:39.867749+0000","last_active":"2024-09-12T19:13:58.371672+0000","last_peered":"2024-09-12T19:13:58.371672+0000","last_clean":"2024-09-12T19:13:58.371672+0000","last_became_active":"2024-09-12T18:26:39.867136+0000","last_became_peered":"2024-09-12T18:26:39.867136+0000","last_unstale":"2024-09-12T19:13:58.371672+0000","last_undegraded":"2024-09-12T19:13:58.371672+0000","last_fullsized":"2024-09-12T19:13:58.371672+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:04.827164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":531,"num_read_kb":14806,"num_write":1141,"num_write_kb":34226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:17.883321+0000","last_change":"2024-09-12T18:26:43.877662+0000","last_active":"2024-09-12T19:09:17.883321+0000","last_peered":"2024-09-12T19:09:17.883321+0000","last_clean":"2024-09-12T19:09:17.883321+0000","last_became_active":"2024-09-12T18:26:43.876801+0000","last_became_peered":"2024-09-12T18:26:43.876801+0000","last_unstale":"2024-09-12T19:09:17.883321+0000","last_undegraded":"2024-09-12T19:09:17.883321+0000","last_fullsized":"2024-09-12T19:09:17.883321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:49.772292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'294","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.924374+0000","last_change":"2024-09-12T18:26:45.873414+0000","last_active":"2024-09-12T19:13:57.924374+0000","last_peered":"2024-09-12T19:13:57.924374+0000","last_clean":"2024-09-12T19:13:57.924374+0000","last_became_active":"2024-09-12T18:26:45.872458+0000","last_became_peered":"2024-09-12T18:26:45.872458+0000","last_unstale":"2024-09-12T19:13:57.924374+0000","last_undegraded":"2024-09-12T19:13:57.924374+0000","last_fullsized":"2024-09-12T19:13:57.924374+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:15.684235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48239,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":1098,"num_write":396,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.918253+0000","last_change":"2024-09-12T18:26:47.895896+0000","last_active":"2024-09-12T19:10:18.918253+0000","last_peered":"2024-09-12T19:10:18.918253+0000","last_clean":"2024-09-12T19:10:18.918253+0000","last_became_active":"2024-09-12T18:26:47.894689+0000","last_became_peered":"2024-09-12T18:26:47.894689+0000","last_unstale":"2024-09-12T19:10:18.918253+0000","last_undegraded":"2024-09-12T19:10:18.918253+0000","last_fullsized":"2024-09-12T19:10:18.918253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:12.028473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'122","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.472125+0000","last_change":"2024-09-12T18:26:49.931294+0000","last_active":"2024-09-12T19:12:21.472125+0000","last_peered":"2024-09-12T19:12:21.472125+0000","last_clean":"2024-09-12T19:12:21.472125+0000","last_became_active":"2024-09-12T18:26:49.930794+0000","last_became_peered":"2024-09-12T18:26:49.930794+0000","last_unstale":"2024-09-12T19:12:21.472125+0000","last_undegraded":"2024-09-12T19:12:21.472125+0000","last_fullsized":"2024-09-12T19:12:21.472125+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:20.540895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":295,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'613","reported_seq":2272,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.104950+0000","last_change":"2024-09-12T18:26:41.857340+0000","last_active":"2024-09-12T19:13:43.104950+0000","last_peered":"2024-09-12T19:13:43.104950+0000","last_clean":"2024-09-12T19:13:43.104950+0000","last_became_active":"2024-09-12T18:26:41.856621+0000","last_became_peered":"2024-09-12T18:26:41.856621+0000","last_unstale":"2024-09-12T19:13:43.104950+0000","last_undegraded":"2024-09-12T19:13:43.104950+0000","last_fullsized":"2024-09-12T19:13:43.104950+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:55:57.480188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3116,"num_read_kb":2841,"num_write":759,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'346","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.374066+0000","last_change":"2024-09-12T18:26:39.861785+0000","last_active":"2024-09-12T19:13:58.374066+0000","last_peered":"2024-09-12T19:13:58.374066+0000","last_clean":"2024-09-12T19:13:58.374066+0000","last_became_active":"2024-09-12T18:26:39.861108+0000","last_became_peered":"2024-09-12T18:26:39.861108+0000","last_unstale":"2024-09-12T19:13:58.374066+0000","last_undegraded":"2024-09-12T19:13:58.374066+0000","last_fullsized":"2024-09-12T19:13:58.374066+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:35.617812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":32271,"num_write":997,"num_write_kb":22718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:13.878053+0000","last_change":"2024-09-12T18:26:43.861093+0000","last_active":"2024-09-12T19:09:13.878053+0000","last_peered":"2024-09-12T19:09:13.878053+0000","last_clean":"2024-09-12T19:09:13.878053+0000","last_became_active":"2024-09-12T18:26:43.860336+0000","last_became_peered":"2024-09-12T18:26:43.860336+0000","last_unstale":"2024-09-12T19:09:13.878053+0000","last_undegraded":"2024-09-12T19:09:13.878053+0000","last_fullsized":"2024-09-12T19:09:13.878053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:15.631369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'286","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.963187+0000","last_change":"2024-09-12T18:26:45.881839+0000","last_active":"2024-09-12T19:13:57.963187+0000","last_peered":"2024-09-12T19:13:57.963187+0000","last_clean":"2024-09-12T19:13:57.963187+0000","last_became_active":"2024-09-12T18:26:45.881364+0000","last_became_peered":"2024-09-12T18:26:45.881364+0000","last_unstale":"2024-09-12T19:13:57.963187+0000","last_undegraded":"2024-09-12T19:13:57.963187+0000","last_fullsized":"2024-09-12T19:13:57.963187+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:54.998693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1088,"num_write":384,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.898023+0000","last_change":"2024-09-12T18:26:47.888719+0000","last_active":"2024-09-12T19:10:28.898023+0000","last_peered":"2024-09-12T19:10:28.898023+0000","last_clean":"2024-09-12T19:10:28.898023+0000","last_became_active":"2024-09-12T18:26:47.888055+0000","last_became_peered":"2024-09-12T18:26:47.888055+0000","last_unstale":"2024-09-12T19:10:28.898023+0000","last_undegraded":"2024-09-12T19:10:28.898023+0000","last_fullsized":"2024-09-12T19:10:28.898023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:33.128326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.320073+0000","last_change":"2024-09-12T18:26:49.923335+0000","last_active":"2024-09-12T19:12:23.320073+0000","last_peered":"2024-09-12T19:12:23.320073+0000","last_clean":"2024-09-12T19:12:23.320073+0000","last_became_active":"2024-09-12T18:26:49.922543+0000","last_became_peered":"2024-09-12T18:26:49.922543+0000","last_unstale":"2024-09-12T19:12:23.320073+0000","last_undegraded":"2024-09-12T19:12:23.320073+0000","last_fullsized":"2024-09-12T19:12:23.320073+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:23.453107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":203,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'471","reported_seq":2057,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.938937+0000","last_change":"2024-09-12T18:26:41.850838+0000","last_active":"2024-09-12T19:12:07.938937+0000","last_peered":"2024-09-12T19:12:07.938937+0000","last_clean":"2024-09-12T19:12:07.938937+0000","last_became_active":"2024-09-12T18:26:41.850499+0000","last_became_peered":"2024-09-12T18:26:41.850499+0000","last_unstale":"2024-09-12T19:12:07.938937+0000","last_undegraded":"2024-09-12T19:12:07.938937+0000","last_fullsized":"2024-09-12T19:12:07.938937+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:51:48.262784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2536,"num_read_kb":2375,"num_write":558,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'324","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.333692+0000","last_change":"2024-09-12T18:26:39.847761+0000","last_active":"2024-09-12T19:13:58.333692+0000","last_peered":"2024-09-12T19:13:58.333692+0000","last_clean":"2024-09-12T19:13:58.333692+0000","last_became_active":"2024-09-12T18:26:39.847422+0000","last_became_peered":"2024-09-12T18:26:39.847422+0000","last_unstale":"2024-09-12T19:13:58.333692+0000","last_undegraded":"2024-09-12T19:13:58.333692+0000","last_fullsized":"2024-09-12T19:13:58.333692+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:13.311491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568138,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":20074,"num_write":1068,"num_write_kb":42638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:14.101283+0000","last_change":"2024-09-12T18:26:43.875901+0000","last_active":"2024-09-12T19:10:14.101283+0000","last_peered":"2024-09-12T19:10:14.101283+0000","last_clean":"2024-09-12T19:10:14.101283+0000","last_became_active":"2024-09-12T18:26:43.874881+0000","last_became_peered":"2024-09-12T18:26:43.874881+0000","last_unstale":"2024-09-12T19:10:14.101283+0000","last_undegraded":"2024-09-12T19:10:14.101283+0000","last_fullsized":"2024-09-12T19:10:14.101283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:20.082733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'274","reported_seq":829,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.612273+0000","last_change":"2024-09-12T18:26:45.865460+0000","last_active":"2024-09-12T19:13:57.612273+0000","last_peered":"2024-09-12T19:13:57.612273+0000","last_clean":"2024-09-12T19:13:57.612273+0000","last_became_active":"2024-09-12T18:26:45.864264+0000","last_became_peered":"2024-09-12T18:26:45.864264+0000","last_unstale":"2024-09-12T19:13:57.612273+0000","last_undegraded":"2024-09-12T19:13:57.612273+0000","last_fullsized":"2024-09-12T19:13:57.612273+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:46.472729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49732,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":471,"num_read_kb":1179,"num_write":398,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:19.089126+0000","last_change":"2024-09-12T18:26:47.882838+0000","last_active":"2024-09-12T19:09:19.089126+0000","last_peered":"2024-09-12T19:09:19.089126+0000","last_clean":"2024-09-12T19:09:19.089126+0000","last_became_active":"2024-09-12T18:26:47.882094+0000","last_became_peered":"2024-09-12T18:26:47.882094+0000","last_unstale":"2024-09-12T19:09:19.089126+0000","last_undegraded":"2024-09-12T19:09:19.089126+0000","last_fullsized":"2024-09-12T19:09:19.089126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:28.769911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'194","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.741958+0000","last_change":"2024-09-12T18:26:49.921917+0000","last_active":"2024-09-12T19:12:21.741958+0000","last_peered":"2024-09-12T19:12:21.741958+0000","last_clean":"2024-09-12T19:12:21.741958+0000","last_became_active":"2024-09-12T18:26:49.920808+0000","last_became_peered":"2024-09-12T18:26:49.920808+0000","last_unstale":"2024-09-12T19:12:21.741958+0000","last_undegraded":"2024-09-12T19:12:21.741958+0000","last_fullsized":"2024-09-12T19:12:21.741958+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:38.677600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1188,"num_read_kb":1184,"num_write":433,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'790","reported_seq":2289,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.623824+0000","last_change":"2024-09-12T18:26:41.874632+0000","last_active":"2024-09-12T19:12:18.623824+0000","last_peered":"2024-09-12T19:12:18.623824+0000","last_clean":"2024-09-12T19:12:18.623824+0000","last_became_active":"2024-09-12T18:26:41.873690+0000","last_became_peered":"2024-09-12T18:26:41.873690+0000","last_unstale":"2024-09-12T19:12:18.623824+0000","last_undegraded":"2024-09-12T19:12:18.623824+0000","last_fullsized":"2024-09-12T19:12:18.623824+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:58.542257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3645,"num_read_kb":3278,"num_write":1029,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'358","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.373232+0000","last_change":"2024-09-12T18:27:11.830481+0000","last_active":"2024-09-12T19:13:58.373232+0000","last_peered":"2024-09-12T19:13:58.373232+0000","last_clean":"2024-09-12T19:13:58.373232+0000","last_became_active":"2024-09-12T18:27:11.829577+0000","last_became_peered":"2024-09-12T18:27:11.829577+0000","last_unstale":"2024-09-12T19:13:58.373232+0000","last_undegraded":"2024-09-12T19:13:58.373232+0000","last_fullsized":"2024-09-12T19:13:58.373232+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:39.120138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513384,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":509,"num_read_kb":8019,"num_write":1212,"num_write_kb":33613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:27.907872+0000","last_change":"2024-09-12T18:26:43.865809+0000","last_active":"2024-09-12T19:10:27.907872+0000","last_peered":"2024-09-12T19:10:27.907872+0000","last_clean":"2024-09-12T19:10:27.907872+0000","last_became_active":"2024-09-12T18:26:43.864719+0000","last_became_peered":"2024-09-12T18:26:43.864719+0000","last_unstale":"2024-09-12T19:10:27.907872+0000","last_undegraded":"2024-09-12T19:10:27.907872+0000","last_fullsized":"2024-09-12T19:10:27.907872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:47.905822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'306","reported_seq":893,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.734323+0000","last_change":"2024-09-12T18:26:45.866467+0000","last_active":"2024-09-12T19:13:57.734323+0000","last_peered":"2024-09-12T19:13:57.734323+0000","last_clean":"2024-09-12T19:13:57.734323+0000","last_became_active":"2024-09-12T18:26:45.865711+0000","last_became_peered":"2024-09-12T18:26:45.865711+0000","last_unstale":"2024-09-12T19:13:57.734323+0000","last_undegraded":"2024-09-12T19:13:57.734323+0000","last_fullsized":"2024-09-12T19:13:57.734323+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:12.137382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47780,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1144,"num_write":416,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:18.903282+0000","last_change":"2024-09-12T18:26:47.883801+0000","last_active":"2024-09-12T19:09:18.903282+0000","last_peered":"2024-09-12T19:09:18.903282+0000","last_clean":"2024-09-12T19:09:18.903282+0000","last_became_active":"2024-09-12T18:26:47.883014+0000","last_became_peered":"2024-09-12T18:26:47.883014+0000","last_unstale":"2024-09-12T19:09:18.903282+0000","last_undegraded":"2024-09-12T19:09:18.903282+0000","last_fullsized":"2024-09-12T19:09:18.903282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:35.546362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'106","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.102109+0000","last_change":"2024-09-12T18:26:49.922286+0000","last_active":"2024-09-12T19:13:43.102109+0000","last_peered":"2024-09-12T19:13:43.102109+0000","last_clean":"2024-09-12T19:13:43.102109+0000","last_became_active":"2024-09-12T18:26:49.921636+0000","last_became_peered":"2024-09-12T18:26:49.921636+0000","last_unstale":"2024-09-12T19:13:43.102109+0000","last_undegraded":"2024-09-12T19:13:43.102109+0000","last_fullsized":"2024-09-12T19:13:43.102109+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:07.594133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":621,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":107,"num_write":252,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'1273","reported_seq":3077,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.126851+0000","last_change":"2024-09-12T18:26:41.872801+0000","last_active":"2024-09-12T19:12:24.126851+0000","last_peered":"2024-09-12T19:12:24.126851+0000","last_clean":"2024-09-12T19:12:24.126851+0000","last_became_active":"2024-09-12T18:26:41.872455+0000","last_became_peered":"2024-09-12T18:26:41.872455+0000","last_unstale":"2024-09-12T19:12:24.126851+0000","last_undegraded":"2024-09-12T19:12:24.126851+0000","last_fullsized":"2024-09-12T19:12:24.126851+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":1200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:05.640554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6298,"num_read_kb":5578,"num_write":1816,"num_write_kb":809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'404","reported_seq":1096,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.380664+0000","last_change":"2024-09-12T18:26:39.848638+0000","last_active":"2024-09-12T19:13:58.380664+0000","last_peered":"2024-09-12T19:13:58.380664+0000","last_clean":"2024-09-12T19:13:58.380664+0000","last_became_active":"2024-09-12T18:26:39.847954+0000","last_became_peered":"2024-09-12T18:26:39.847954+0000","last_unstale":"2024-09-12T19:13:58.380664+0000","last_undegraded":"2024-09-12T19:13:58.380664+0000","last_fullsized":"2024-09-12T19:13:58.380664+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:36.378454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263330,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":589,"num_read_kb":77066,"num_write":1254,"num_write_kb":41008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'501","reported_seq":2145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.105839+0000","last_change":"2024-09-12T18:26:41.852684+0000","last_active":"2024-09-12T19:13:43.105839+0000","last_peered":"2024-09-12T19:13:43.105839+0000","last_clean":"2024-09-12T19:13:43.105839+0000","last_became_active":"2024-09-12T18:26:41.846040+0000","last_became_peered":"2024-09-12T18:26:41.846040+0000","last_unstale":"2024-09-12T19:13:43.105839+0000","last_undegraded":"2024-09-12T19:13:43.105839+0000","last_fullsized":"2024-09-12T19:13:43.105839+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:45.056792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2703,"num_read_kb":2531,"num_write":592,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'378","reported_seq":1092,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.374788+0000","last_change":"2024-09-12T18:26:39.846352+0000","last_active":"2024-09-12T19:13:58.374788+0000","last_peered":"2024-09-12T19:13:58.374788+0000","last_clean":"2024-09-12T19:13:58.374788+0000","last_became_active":"2024-09-12T18:26:39.846028+0000","last_became_peered":"2024-09-12T18:26:39.846028+0000","last_unstale":"2024-09-12T19:13:58.374788+0000","last_undegraded":"2024-09-12T19:13:58.374788+0000","last_fullsized":"2024-09-12T19:13:58.374788+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:04.369252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":778,"num_read_kb":5622,"num_write":1176,"num_write_kb":40701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'516","reported_seq":2039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.769450+0000","last_change":"2024-09-12T18:26:41.884917+0000","last_active":"2024-09-12T19:12:08.769450+0000","last_peered":"2024-09-12T19:12:08.769450+0000","last_clean":"2024-09-12T19:12:08.769450+0000","last_became_active":"2024-09-12T18:26:41.884394+0000","last_became_peered":"2024-09-12T18:26:41.884394+0000","last_unstale":"2024-09-12T19:12:08.769450+0000","last_undegraded":"2024-09-12T19:12:08.769450+0000","last_fullsized":"2024-09-12T19:12:08.769450+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:36:32.084024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2704,"num_read_kb":2505,"num_write":657,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'344","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.371510+0000","last_change":"2024-09-12T18:26:39.856913+0000","last_active":"2024-09-12T19:13:58.371510+0000","last_peered":"2024-09-12T19:13:58.371510+0000","last_clean":"2024-09-12T19:13:58.371510+0000","last_became_active":"2024-09-12T18:26:39.856026+0000","last_became_peered":"2024-09-12T18:26:39.856026+0000","last_unstale":"2024-09-12T19:13:58.371510+0000","last_undegraded":"2024-09-12T19:13:58.371510+0000","last_fullsized":"2024-09-12T19:13:58.371510+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:27.396302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136883,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":16869,"num_write":1087,"num_write_kb":23838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'538","reported_seq":2153,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.106718+0000","last_change":"2024-09-12T18:26:41.850869+0000","last_active":"2024-09-12T19:13:43.106718+0000","last_peered":"2024-09-12T19:13:43.106718+0000","last_clean":"2024-09-12T19:13:43.106718+0000","last_became_active":"2024-09-12T18:26:41.850519+0000","last_became_peered":"2024-09-12T18:26:41.850519+0000","last_unstale":"2024-09-12T19:13:43.106718+0000","last_undegraded":"2024-09-12T19:13:43.106718+0000","last_fullsized":"2024-09-12T19:13:43.106718+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:01.952369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2864,"num_read_kb":2647,"num_write":672,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'349","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.368700+0000","last_change":"2024-09-12T18:26:39.843327+0000","last_active":"2024-09-12T19:13:58.368700+0000","last_peered":"2024-09-12T19:13:58.368700+0000","last_clean":"2024-09-12T19:13:58.368700+0000","last_became_active":"2024-09-12T18:26:39.842852+0000","last_became_peered":"2024-09-12T18:26:39.842852+0000","last_unstale":"2024-09-12T19:13:58.368700+0000","last_undegraded":"2024-09-12T19:13:58.368700+0000","last_fullsized":"2024-09-12T19:13:58.368700+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:46.968044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524303,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":35620,"num_write":1162,"num_write_kb":31566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'814","reported_seq":2351,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.568561+0000","last_change":"2024-09-12T18:26:41.882724+0000","last_active":"2024-09-12T19:12:06.568561+0000","last_peered":"2024-09-12T19:12:06.568561+0000","last_clean":"2024-09-12T19:12:06.568561+0000","last_became_active":"2024-09-12T18:26:41.882458+0000","last_became_peered":"2024-09-12T18:26:41.882458+0000","last_unstale":"2024-09-12T19:12:06.568561+0000","last_undegraded":"2024-09-12T19:12:06.568561+0000","last_fullsized":"2024-09-12T19:12:06.568561+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:55.482811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3832,"num_read_kb":3447,"num_write":1071,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'331","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.346176+0000","last_change":"2024-09-12T18:26:39.855875+0000","last_active":"2024-09-12T19:13:58.346176+0000","last_peered":"2024-09-12T19:13:58.346176+0000","last_clean":"2024-09-12T19:13:58.346176+0000","last_became_active":"2024-09-12T18:26:39.855654+0000","last_became_peered":"2024-09-12T18:26:39.855654+0000","last_unstale":"2024-09-12T19:13:58.346176+0000","last_undegraded":"2024-09-12T19:13:58.346176+0000","last_fullsized":"2024-09-12T19:13:58.346176+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:14.438744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":592,"num_read_kb":6402,"num_write":1048,"num_write_kb":32224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'1222","reported_seq":2855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.127193+0000","last_change":"2024-09-12T18:26:41.877371+0000","last_active":"2024-09-12T19:12:24.127193+0000","last_peered":"2024-09-12T19:12:24.127193+0000","last_clean":"2024-09-12T19:12:24.127193+0000","last_became_active":"2024-09-12T18:26:41.876138+0000","last_became_peered":"2024-09-12T18:26:41.876138+0000","last_unstale":"2024-09-12T19:12:24.127193+0000","last_undegraded":"2024-09-12T19:12:24.127193+0000","last_fullsized":"2024-09-12T19:12:24.127193+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":1200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:46.850535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4890,"num_write":1674,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'310","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.381776+0000","last_change":"2024-09-12T18:26:39.844674+0000","last_active":"2024-09-12T19:13:58.381776+0000","last_peered":"2024-09-12T19:13:58.381776+0000","last_clean":"2024-09-12T19:13:58.381776+0000","last_became_active":"2024-09-12T18:26:39.844346+0000","last_became_peered":"2024-09-12T18:26:39.844346+0000","last_unstale":"2024-09-12T19:13:58.381776+0000","last_undegraded":"2024-09-12T19:13:58.381776+0000","last_fullsized":"2024-09-12T19:13:58.381776+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:04:51.398790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":67178,"num_write":993,"num_write_kb":30033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'741","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.102708+0000","last_change":"2024-09-12T18:27:11.824740+0000","last_active":"2024-09-12T19:13:43.102708+0000","last_peered":"2024-09-12T19:13:43.102708+0000","last_clean":"2024-09-12T19:13:43.102708+0000","last_became_active":"2024-09-12T18:27:11.823747+0000","last_became_peered":"2024-09-12T18:27:11.823747+0000","last_unstale":"2024-09-12T19:13:43.102708+0000","last_undegraded":"2024-09-12T19:13:43.102708+0000","last_fullsized":"2024-09-12T19:13:43.102708+0000","mapping_epoch":37,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:51.790957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3535,"num_read_kb":3187,"num_write":978,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"265'332","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.357102+0000","last_change":"2024-09-12T18:26:39.871790+0000","last_active":"2024-09-12T19:13:58.357102+0000","last_peered":"2024-09-12T19:13:58.357102+0000","last_clean":"2024-09-12T19:13:58.357102+0000","last_became_active":"2024-09-12T18:26:39.871119+0000","last_became_peered":"2024-09-12T18:26:39.871119+0000","last_unstale":"2024-09-12T19:13:58.357102+0000","last_undegraded":"2024-09-12T19:13:58.357102+0000","last_fullsized":"2024-09-12T19:13:58.357102+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:01.325896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695310,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":8461,"num_write":1111,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'1064","reported_seq":2771,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.604993+0000","last_change":"2024-09-12T18:26:41.869379+0000","last_active":"2024-09-12T19:12:09.604993+0000","last_peered":"2024-09-12T19:12:09.604993+0000","last_clean":"2024-09-12T19:12:09.604993+0000","last_became_active":"2024-09-12T18:26:41.863607+0000","last_became_peered":"2024-09-12T18:26:41.863607+0000","last_unstale":"2024-09-12T19:12:09.604993+0000","last_undegraded":"2024-09-12T19:12:09.604993+0000","last_fullsized":"2024-09-12T19:12:09.604993+0000","mapping_epoch":26,"log_start":"265'1000","ondisk_log_start":"265'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1000,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:00:52.994239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5203,"num_read_kb":4615,"num_write":1535,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'338","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.387800+0000","last_change":"2024-09-12T18:26:39.828227+0000","last_active":"2024-09-12T19:13:58.387800+0000","last_peered":"2024-09-12T19:13:58.387800+0000","last_clean":"2024-09-12T19:13:58.387800+0000","last_became_active":"2024-09-12T18:26:39.827475+0000","last_became_peered":"2024-09-12T18:26:39.827475+0000","last_unstale":"2024-09-12T19:13:58.387800+0000","last_undegraded":"2024-09-12T19:13:58.387800+0000","last_fullsized":"2024-09-12T19:13:58.387800+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:39.931458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136911,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":492,"num_read_kb":48337,"num_write":1107,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'824","reported_seq":2436,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.126652+0000","last_change":"2024-09-12T18:26:41.851460+0000","last_active":"2024-09-12T19:12:24.126652+0000","last_peered":"2024-09-12T19:12:24.126652+0000","last_clean":"2024-09-12T19:12:24.126652+0000","last_became_active":"2024-09-12T18:26:41.851080+0000","last_became_peered":"2024-09-12T18:26:41.851080+0000","last_unstale":"2024-09-12T19:12:24.126652+0000","last_undegraded":"2024-09-12T19:12:24.126652+0000","last_fullsized":"2024-09-12T19:12:24.126652+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:45:00.421668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4015,"num_read_kb":3626,"num_write":1096,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'358","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.324114+0000","last_change":"2024-09-12T18:26:39.850533+0000","last_active":"2024-09-12T19:13:58.324114+0000","last_peered":"2024-09-12T19:13:58.324114+0000","last_clean":"2024-09-12T19:13:58.324114+0000","last_became_active":"2024-09-12T18:26:39.849722+0000","last_became_peered":"2024-09-12T18:26:39.849722+0000","last_unstale":"2024-09-12T19:13:58.324114+0000","last_undegraded":"2024-09-12T19:13:58.324114+0000","last_fullsized":"2024-09-12T19:13:58.324114+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:57.210670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":40604,"num_write":1102,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'396","reported_seq":1927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.290269+0000","last_change":"2024-09-12T18:26:41.851925+0000","last_active":"2024-09-12T19:12:23.290269+0000","last_peered":"2024-09-12T19:12:23.290269+0000","last_clean":"2024-09-12T19:12:23.290269+0000","last_became_active":"2024-09-12T18:26:41.851159+0000","last_became_peered":"2024-09-12T18:26:41.851159+0000","last_unstale":"2024-09-12T19:12:23.290269+0000","last_undegraded":"2024-09-12T19:12:23.290269+0000","last_fullsized":"2024-09-12T19:12:23.290269+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:24:12.817942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2139,"num_read_kb":2047,"num_write":455,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'308","reported_seq":912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.337377+0000","last_change":"2024-09-12T18:26:39.828823+0000","last_active":"2024-09-12T19:13:58.337377+0000","last_peered":"2024-09-12T19:13:58.337377+0000","last_clean":"2024-09-12T19:13:58.337377+0000","last_became_active":"2024-09-12T18:26:39.827933+0000","last_became_peered":"2024-09-12T18:26:39.827933+0000","last_unstale":"2024-09-12T19:13:58.337377+0000","last_undegraded":"2024-09-12T19:13:58.337377+0000","last_fullsized":"2024-09-12T19:13:58.337377+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:56.699019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":423,"num_read_kb":364,"num_write":936,"num_write_kb":38290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'1178","reported_seq":2805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:01.105889+0000","last_change":"2024-09-12T18:26:41.873225+0000","last_active":"2024-09-12T19:12:01.105889+0000","last_peered":"2024-09-12T19:12:01.105889+0000","last_clean":"2024-09-12T19:12:01.105889+0000","last_became_active":"2024-09-12T18:26:41.872816+0000","last_became_peered":"2024-09-12T18:26:41.872816+0000","last_unstale":"2024-09-12T19:12:01.105889+0000","last_undegraded":"2024-09-12T19:12:01.105889+0000","last_fullsized":"2024-09-12T19:12:01.105889+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:18.236340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5354,"num_read_kb":4741,"num_write":1604,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'305","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.373040+0000","last_change":"2024-09-12T18:27:12.006534+0000","last_active":"2024-09-12T19:13:58.373040+0000","last_peered":"2024-09-12T19:13:58.373040+0000","last_clean":"2024-09-12T19:13:58.373040+0000","last_became_active":"2024-09-12T18:27:12.005906+0000","last_became_peered":"2024-09-12T18:27:12.005906+0000","last_unstale":"2024-09-12T19:13:58.373040+0000","last_undegraded":"2024-09-12T19:13:58.373040+0000","last_fullsized":"2024-09-12T19:13:58.373040+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:10.452660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":9281,"num_write":1029,"num_write_kb":40338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"265'418","reported_seq":1867,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.120100+0000","last_change":"2024-09-12T18:26:41.867368+0000","last_active":"2024-09-12T19:13:43.120100+0000","last_peered":"2024-09-12T19:13:43.120100+0000","last_clean":"2024-09-12T19:13:43.120100+0000","last_became_active":"2024-09-12T18:26:41.866602+0000","last_became_peered":"2024-09-12T18:26:41.866602+0000","last_unstale":"2024-09-12T19:13:43.120100+0000","last_undegraded":"2024-09-12T19:13:43.120100+0000","last_fullsized":"2024-09-12T19:13:43.120100+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:37.206508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2028,"num_write":492,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'362","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.348064+0000","last_change":"2024-09-12T18:26:39.872098+0000","last_active":"2024-09-12T19:13:58.348064+0000","last_peered":"2024-09-12T19:13:58.348064+0000","last_clean":"2024-09-12T19:13:58.348064+0000","last_became_active":"2024-09-12T18:26:39.871626+0000","last_became_peered":"2024-09-12T18:26:39.871626+0000","last_unstale":"2024-09-12T19:13:58.348064+0000","last_undegraded":"2024-09-12T19:13:58.348064+0000","last_fullsized":"2024-09-12T19:13:58.348064+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:14.820272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2185594,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":15528,"num_write":1112,"num_write_kb":35488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'1248","reported_seq":2886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.769985+0000","last_change":"2024-09-12T18:26:41.877593+0000","last_active":"2024-09-12T19:12:08.769985+0000","last_peered":"2024-09-12T19:12:08.769985+0000","last_clean":"2024-09-12T19:12:08.769985+0000","last_became_active":"2024-09-12T18:26:41.876708+0000","last_became_peered":"2024-09-12T18:26:41.876708+0000","last_unstale":"2024-09-12T19:12:08.769985+0000","last_undegraded":"2024-09-12T19:12:08.769985+0000","last_fullsized":"2024-09-12T19:12:08.769985+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":1200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:14.658782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5682,"num_read_kb":5005,"num_write":1690,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'321","reported_seq":967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.367069+0000","last_change":"2024-09-12T18:26:39.858750+0000","last_active":"2024-09-12T19:13:58.367069+0000","last_peered":"2024-09-12T19:13:58.367069+0000","last_clean":"2024-09-12T19:13:58.367069+0000","last_became_active":"2024-09-12T18:26:39.857956+0000","last_became_peered":"2024-09-12T18:26:39.857956+0000","last_unstale":"2024-09-12T19:13:58.367069+0000","last_undegraded":"2024-09-12T19:13:58.367069+0000","last_fullsized":"2024-09-12T19:13:58.367069+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:36.402643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2580367,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":492,"num_read_kb":32197,"num_write":944,"num_write_kb":38029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'898","reported_seq":2594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.568136+0000","last_change":"2024-09-12T18:26:41.854757+0000","last_active":"2024-09-12T19:12:06.568136+0000","last_peered":"2024-09-12T19:12:06.568136+0000","last_clean":"2024-09-12T19:12:06.568136+0000","last_became_active":"2024-09-12T18:26:41.854471+0000","last_became_peered":"2024-09-12T18:26:41.854471+0000","last_unstale":"2024-09-12T19:12:06.568136+0000","last_undegraded":"2024-09-12T19:12:06.568136+0000","last_fullsized":"2024-09-12T19:12:06.568136+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":800,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:00.860983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4435,"num_read_kb":4011,"num_write":1173,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'382","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.356775+0000","last_change":"2024-09-12T18:26:39.871177+0000","last_active":"2024-09-12T19:13:58.356775+0000","last_peered":"2024-09-12T19:13:58.356775+0000","last_clean":"2024-09-12T19:13:58.356775+0000","last_became_active":"2024-09-12T18:26:39.869924+0000","last_became_peered":"2024-09-12T18:26:39.869924+0000","last_unstale":"2024-09-12T19:13:58.356775+0000","last_undegraded":"2024-09-12T19:13:58.356775+0000","last_fullsized":"2024-09-12T19:13:58.356775+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:42.282746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399013,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":35584,"num_write":1226,"num_write_kb":36960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'684","reported_seq":2474,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.623661+0000","last_change":"2024-09-12T18:26:41.858693+0000","last_active":"2024-09-12T19:12:18.623661+0000","last_peered":"2024-09-12T19:12:18.623661+0000","last_clean":"2024-09-12T19:12:18.623661+0000","last_became_active":"2024-09-12T18:26:41.858362+0000","last_became_peered":"2024-09-12T18:26:41.858362+0000","last_unstale":"2024-09-12T19:12:18.623661+0000","last_undegraded":"2024-09-12T19:12:18.623661+0000","last_fullsized":"2024-09-12T19:12:18.623661+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:42.785349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3672,"num_read_kb":3341,"num_write":924,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'420","reported_seq":1203,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.313889+0000","last_change":"2024-09-12T18:26:39.847818+0000","last_active":"2024-09-12T19:13:58.313889+0000","last_peered":"2024-09-12T19:13:58.313889+0000","last_clean":"2024-09-12T19:13:58.313889+0000","last_became_active":"2024-09-12T18:26:39.847373+0000","last_became_peered":"2024-09-12T18:26:39.847373+0000","last_unstale":"2024-09-12T19:13:58.313889+0000","last_undegraded":"2024-09-12T19:13:58.313889+0000","last_fullsized":"2024-09-12T19:13:58.313889+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:55.989925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":812,"num_read_kb":75472,"num_write":1417,"num_write_kb":36911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'824","reported_seq":2390,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.104105+0000","last_change":"2024-09-12T18:26:41.873328+0000","last_active":"2024-09-12T19:13:43.104105+0000","last_peered":"2024-09-12T19:13:43.104105+0000","last_clean":"2024-09-12T19:13:43.104105+0000","last_became_active":"2024-09-12T18:26:41.871610+0000","last_became_peered":"2024-09-12T18:26:41.871610+0000","last_unstale":"2024-09-12T19:13:43.104105+0000","last_undegraded":"2024-09-12T19:13:43.104105+0000","last_fullsized":"2024-09-12T19:13:43.104105+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:39:57.336959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3622,"num_write":1076,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'284","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.343013+0000","last_change":"2024-09-12T18:26:39.875309+0000","last_active":"2024-09-12T19:13:58.343013+0000","last_peered":"2024-09-12T19:13:58.343013+0000","last_clean":"2024-09-12T19:13:58.343013+0000","last_became_active":"2024-09-12T18:26:39.874710+0000","last_became_peered":"2024-09-12T18:26:39.874710+0000","last_unstale":"2024-09-12T19:13:58.343013+0000","last_undegraded":"2024-09-12T19:13:58.343013+0000","last_fullsized":"2024-09-12T19:13:58.343013+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:32.381222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":12735,"num_write":942,"num_write_kb":23796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'354","reported_seq":1005,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.343307+0000","last_change":"2024-09-12T18:26:39.847812+0000","last_active":"2024-09-12T19:13:58.343307+0000","last_peered":"2024-09-12T19:13:58.343307+0000","last_clean":"2024-09-12T19:13:58.343307+0000","last_became_active":"2024-09-12T18:26:39.846477+0000","last_became_peered":"2024-09-12T18:26:39.846477+0000","last_unstale":"2024-09-12T19:13:58.343307+0000","last_undegraded":"2024-09-12T19:13:58.343307+0000","last_fullsized":"2024-09-12T19:13:58.343307+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:04.316982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":32398,"num_write":1027,"num_write_kb":24916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'404","reported_seq":1869,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.107075+0000","last_change":"2024-09-12T18:26:41.851628+0000","last_active":"2024-09-12T19:13:43.107075+0000","last_peered":"2024-09-12T19:13:43.107075+0000","last_clean":"2024-09-12T19:13:43.107075+0000","last_became_active":"2024-09-12T18:26:41.851295+0000","last_became_peered":"2024-09-12T18:26:41.851295+0000","last_unstale":"2024-09-12T19:13:43.107075+0000","last_undegraded":"2024-09-12T19:13:43.107075+0000","last_fullsized":"2024-09-12T19:13:43.107075+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:38:27.756982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":455,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'318","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.349787+0000","last_change":"2024-09-12T18:26:39.857287+0000","last_active":"2024-09-12T19:13:58.349787+0000","last_peered":"2024-09-12T19:13:58.349787+0000","last_clean":"2024-09-12T19:13:58.349787+0000","last_became_active":"2024-09-12T18:26:39.857009+0000","last_became_peered":"2024-09-12T18:26:39.857009+0000","last_unstale":"2024-09-12T19:13:58.349787+0000","last_undegraded":"2024-09-12T19:13:58.349787+0000","last_fullsized":"2024-09-12T19:13:58.349787+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:38.790557+0000","last_clean_scrub_stamp":"2024-09-12T18:26:38.790557+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:48.340491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2355888,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":55513,"num_write":945,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'374","reported_seq":1762,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.894092+0000","last_change":"2024-09-12T18:26:41.878961+0000","last_active":"2024-09-12T19:12:07.894092+0000","last_peered":"2024-09-12T19:12:07.894092+0000","last_clean":"2024-09-12T19:12:07.894092+0000","last_became_active":"2024-09-12T18:26:41.872448+0000","last_became_peered":"2024-09-12T18:26:41.872448+0000","last_unstale":"2024-09-12T19:12:07.894092+0000","last_undegraded":"2024-09-12T19:12:07.894092+0000","last_fullsized":"2024-09-12T19:12:07.894092+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:23:18.608268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1946,"num_read_kb":1855,"num_write":441,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6147,"num_read_kb":4433,"num_write":1993,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":964,"ondisk_log_size":964,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":14976,"num_read_kb":14648,"num_write":16787,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1653,"ondisk_log_size":1653,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":572,"ondisk_log_size":572,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1597681,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17400,"num_read_kb":36744,"num_write":14589,"num_write_kb":11628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2107,"ondisk_log_size":2107,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212286,"num_read_kb":193833,"num_write":55194,"num_write_kb":18759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3910,"ondisk_log_size":3910,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":64167064,"num_objects":372,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":372,"num_whiteouts":0,"num_read":36315,"num_read_kb":1882823,"num_write":72228,"num_write_kb":2144860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":129474560,"data_stored":128334128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4120,"ondisk_log_size":4120,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":214446,"num_write":192,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":201134,"num_write":192,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510018,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262852,"kb_used_data":10652,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94108988,"statfs":{"total":96636764160,"available":96367603712,"internally_reserved":0,"allocated":10907648,"data_stored":9282789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257948102},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510018,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132072,"kb_used_data":10480,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94239768,"statfs":{"total":96636764160,"available":96501522432,"internally_reserved":0,"allocated":10731520,"data_stored":9041400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510019,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92808,"kb_used_data":29688,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94279032,"statfs":{"total":96636764160,"available":96541728768,"internally_reserved":0,"allocated":30400512,"data_stored":28782462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510016,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262852,"kb_used_data":10792,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94108988,"statfs":{"total":96636764160,"available":96367603712,"internally_reserved":0,"allocated":11051008,"data_stored":9395858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510016,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112760,"kb_used_data":14880,"kb_used_omap":1,"kb_used_meta":97726,"kb_avail":94259080,"statfs":{"total":96636764160,"available":96521297920,"internally_reserved":0,"allocated":15237120,"data_stored":13690985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100071877},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510016,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284940,"kb_used_data":33084,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94086900,"statfs":{"total":96636764160,"available":96344985600,"internally_reserved":0,"allocated":33878016,"data_stored":32185380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":257882568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542723,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":293136,"kb_used_data":18688,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94078704,"statfs":{"total":96636764160,"available":96336592896,"internally_reserved":0,"allocated":19136512,"data_stored":17444491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542721,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":167420,"kb_used_data":27968,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94204420,"statfs":{"total":96636764160,"available":96465326080,"internally_reserved":0,"allocated":28639232,"data_stored":27068681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29601792,"data_stored":29420904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24977408,"data_stored":24897183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11599872,"data_stored":11518686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7376896,"data_stored":7222226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26800128,"data_stored":26613106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7016448,"data_stored":6869386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7270400,"data_stored":7112125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14831616,"data_stored":14680512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:14:05.940 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.940 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.940 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.941 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.941 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.941 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.941 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.941 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.942 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.942 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.942 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.942 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.942 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.943 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.943 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.943 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.943 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.943 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.944 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.944 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.944 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.944 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.944 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.945 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.945 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.945 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.945 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.945 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.946 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.946 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.946 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.946 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.946 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.947 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.947 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.947 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.947 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.947 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.948 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.948 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.948 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.948 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.948 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.949 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.949 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.949 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.949 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.949 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.950 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.950 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.950 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.950 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.950 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.950 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.951 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.951 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.951 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.951 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.951 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.951 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.951 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.951 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.951 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.952 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.952 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.952 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.952 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.952 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.952 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.952 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.952 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.953 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.953 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.953 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.953 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.953 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.953 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.953 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.953 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.953 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.954 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.954 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.954 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.954 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.954 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.954 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.954 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.954 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.954 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.955 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.955 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.955 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.955 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.955 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.955 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.956 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.956 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.956 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.956 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.956 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.956 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.956 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.957 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.957 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.957 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.957 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.957 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.957 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.957 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.958 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.958 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.958 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.958 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.958 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.958 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.958 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.958 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.959 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.959 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.959 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.959 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.959 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.959 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.960 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.960 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.960 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.960 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.960 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.961 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.961 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.961 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.961 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.961 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.962 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.962 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.962 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.962 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.962 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.963 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.963 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.963 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.963 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.964 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.964 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.964 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.964 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.964 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.965 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.965 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.965 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.965 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.965 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.966 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.966 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.966 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.966 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.966 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.967 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.967 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.967 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.967 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.967 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.968 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.968 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.968 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.968 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.968 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.968 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.968 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.968 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.969 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.969 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.969 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.969 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.969 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.969 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.969 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.969 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.969 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.970 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.970 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.970 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.970 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.970 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.970 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.970 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.970 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.970 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.970 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.971 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.971 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.971 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.971 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.971 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.971 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.971 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.971 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.971 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.972 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.972 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.972 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.972 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.972 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.972 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.972 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.972 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.972 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.972 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.973 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.973 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.973 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.973 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.973 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.973 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.973 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.973 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.973 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.974 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.974 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.974 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.974 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.974 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.974 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.974 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.974 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.974 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.975 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.975 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.975 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.975 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T18:26:19.397195+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=19, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.975 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T18:26:24.443130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.975 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.975 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.975 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.975 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.976 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.976 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.976 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T18:26:24.443130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.976 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.976 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.976 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.976 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.976 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.976 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T18:26:24.443130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.977 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.977 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.977 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.977 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.977 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.977 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.977 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T18:26:24.443130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.977 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.977 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.977 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.978 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.978 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.978 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.978 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.978 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T18:26:24.443130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.978 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.978 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.978 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.978 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.979 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.979 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.979 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T18:26:24.443130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.979 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.979 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.979 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.979 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.979 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.979 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.979 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T18:26:24.443130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.980 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.980 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.980 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.980 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.980 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.980 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.980 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T18:26:24.443130+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=24, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.980 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.980 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.981 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.981 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.981 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.981 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.981 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.981 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.981 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.981 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.981 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.981 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.982 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.982 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.982 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.982 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.982 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.982 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.982 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.982 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.982 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.983 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.983 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.983 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.983 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.983 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.983 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.983 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.983 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.983 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.983 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.984 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.984 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.984 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.984 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.984 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.984 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.984 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.984 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.984 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.985 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.985 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.985 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.985 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.985 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.985 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.985 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.985 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.985 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.986 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.986 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.986 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.986 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.986 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.986 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.986 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.986 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.986 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.986 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.987 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.987 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.987 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.987 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.987 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.987 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.987 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.987 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.987 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.988 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.988 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.988 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.988 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.988 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.988 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.988 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.988 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.988 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.988 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.989 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.989 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.989 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.989 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.989 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.989 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.989 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.989 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.989 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.990 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.990 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.990 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.990 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.990 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.990 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.990 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.990 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.990 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.990 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.991 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.991 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.991 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.991 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.991 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.991 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.991 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.991 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.991 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.992 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.992 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.992 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.992 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.992 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T18:26:38.790557+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=38, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.992 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:05.992 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:14:25.993 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:14:26.335 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:14:26.351 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-09-12T19:14:26.365 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":1701,"stamp":"2024-09-12T19:14:24.455253+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":66372370,"num_objects":839,"num_object_clones":0,"num_object_copies":1678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":839,"num_whiteouts":0,"num_read":289963,"num_read_kb":2550992,"num_write":161318,"num_write_kb":2466794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":47925,"num_omap_keys":178,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13622,"ondisk_log_size":13622,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1595208,"kb_used_data":156232,"kb_used_omap":12,"kb_used_meta":1438835,"kb_avail":753379512,"statfs":{"total":773094113280,"available":771460620288,"internally_reserved":0,"allocated":159981568,"data_stored":146892046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1473367603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":47672,"num_omap_keys":177,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007779"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.893148+0000","last_change":"2024-09-12T18:55:19.125750+0000","last_active":"2024-09-12T19:10:18.893148+0000","last_peered":"2024-09-12T19:10:18.893148+0000","last_clean":"2024-09-12T19:10:18.893148+0000","last_became_active":"2024-09-12T18:55:19.125009+0000","last_became_peered":"2024-09-12T18:55:19.125009+0000","last_unstale":"2024-09-12T19:10:18.893148+0000","last_undegraded":"2024-09-12T19:10:18.893148+0000","last_fullsized":"2024-09-12T19:10:18.893148+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:07.599229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.902941+0000","last_change":"2024-09-12T18:43:32.909745+0000","last_active":"2024-09-12T19:11:03.902941+0000","last_peered":"2024-09-12T19:11:03.902941+0000","last_clean":"2024-09-12T19:11:03.902941+0000","last_became_active":"2024-09-12T18:43:32.908691+0000","last_became_peered":"2024-09-12T18:43:32.908691+0000","last_unstale":"2024-09-12T19:11:03.902941+0000","last_undegraded":"2024-09-12T19:11:03.902941+0000","last_fullsized":"2024-09-12T19:11:03.902941+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:19.818191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.926901+0000","last_change":"2024-09-12T18:43:29.867175+0000","last_active":"2024-09-12T19:10:58.926901+0000","last_peered":"2024-09-12T19:10:58.926901+0000","last_clean":"2024-09-12T19:10:58.926901+0000","last_became_active":"2024-09-12T18:43:29.866493+0000","last_became_peered":"2024-09-12T18:43:29.866493+0000","last_unstale":"2024-09-12T19:10:58.926901+0000","last_undegraded":"2024-09-12T19:10:58.926901+0000","last_fullsized":"2024-09-12T19:10:58.926901+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:56.771077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'18","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.928758+0000","last_change":"2024-09-12T18:41:45.362583+0000","last_active":"2024-09-12T19:10:58.928758+0000","last_peered":"2024-09-12T19:10:58.928758+0000","last_clean":"2024-09-12T19:10:58.928758+0000","last_became_active":"2024-09-12T18:41:45.361841+0000","last_became_peered":"2024-09-12T18:41:45.361841+0000","last_unstale":"2024-09-12T19:10:58.928758+0000","last_undegraded":"2024-09-12T19:10:58.928758+0000","last_fullsized":"2024-09-12T19:10:58.928758+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:31.032849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":66,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.881812+0000","last_change":"2024-09-12T18:55:19.153318+0000","last_active":"2024-09-12T19:10:18.881812+0000","last_peered":"2024-09-12T19:10:18.881812+0000","last_clean":"2024-09-12T19:10:18.881812+0000","last_became_active":"2024-09-12T18:55:19.150059+0000","last_became_peered":"2024-09-12T18:55:19.150059+0000","last_unstale":"2024-09-12T19:10:18.881812+0000","last_undegraded":"2024-09-12T19:10:18.881812+0000","last_fullsized":"2024-09-12T19:10:18.881812+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:04.495819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'4","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:34.145528+0000","last_change":"2024-09-12T18:43:32.905639+0000","last_active":"2024-09-12T19:13:34.145528+0000","last_peered":"2024-09-12T19:13:34.145528+0000","last_clean":"2024-09-12T19:13:34.145528+0000","last_became_active":"2024-09-12T18:43:32.904914+0000","last_became_peered":"2024-09-12T18:43:32.904914+0000","last_unstale":"2024-09-12T19:13:34.145528+0000","last_undegraded":"2024-09-12T19:13:34.145528+0000","last_fullsized":"2024-09-12T19:13:34.145528+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:47.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:32.741144+0000","last_change":"2024-09-12T18:43:29.895683+0000","last_active":"2024-09-12T19:13:32.741144+0000","last_peered":"2024-09-12T19:13:32.741144+0000","last_clean":"2024-09-12T19:13:32.741144+0000","last_became_active":"2024-09-12T18:43:29.891221+0000","last_became_peered":"2024-09-12T18:43:29.891221+0000","last_unstale":"2024-09-12T19:13:32.741144+0000","last_undegraded":"2024-09-12T19:13:32.741144+0000","last_fullsized":"2024-09-12T19:13:32.741144+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:55:28.583040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'32","reported_seq":138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.719152+0000","last_change":"2024-09-12T18:41:45.362441+0000","last_active":"2024-09-12T19:11:58.719152+0000","last_peered":"2024-09-12T19:11:58.719152+0000","last_clean":"2024-09-12T19:11:58.719152+0000","last_became_active":"2024-09-12T18:41:45.361664+0000","last_became_peered":"2024-09-12T18:41:45.361664+0000","last_unstale":"2024-09-12T19:11:58.719152+0000","last_undegraded":"2024-09-12T19:11:58.719152+0000","last_fullsized":"2024-09-12T19:11:58.719152+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:16.353573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.888584+0000","last_change":"2024-09-12T18:55:19.120410+0000","last_active":"2024-09-12T19:09:48.888584+0000","last_peered":"2024-09-12T19:09:48.888584+0000","last_clean":"2024-09-12T19:09:48.888584+0000","last_became_active":"2024-09-12T18:55:19.119601+0000","last_became_peered":"2024-09-12T18:55:19.119601+0000","last_unstale":"2024-09-12T19:09:48.888584+0000","last_undegraded":"2024-09-12T19:09:48.888584+0000","last_fullsized":"2024-09-12T19:09:48.888584+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:00.200110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'8","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.956039+0000","last_change":"2024-09-12T18:43:32.917442+0000","last_active":"2024-09-12T19:12:43.956039+0000","last_peered":"2024-09-12T19:12:43.956039+0000","last_clean":"2024-09-12T19:12:43.956039+0000","last_became_active":"2024-09-12T18:43:32.916727+0000","last_became_peered":"2024-09-12T18:43:32.916727+0000","last_unstale":"2024-09-12T19:12:43.956039+0000","last_undegraded":"2024-09-12T19:12:43.956039+0000","last_fullsized":"2024-09-12T19:12:43.956039+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:51.785407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"265'17","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.700779+0000","last_change":"2024-09-12T18:43:29.884424+0000","last_active":"2024-09-12T19:13:57.700779+0000","last_peered":"2024-09-12T19:13:57.700779+0000","last_clean":"2024-09-12T19:13:57.700779+0000","last_became_active":"2024-09-12T18:43:29.881401+0000","last_became_peered":"2024-09-12T18:43:29.881401+0000","last_unstale":"2024-09-12T19:13:57.700779+0000","last_undegraded":"2024-09-12T19:13:57.700779+0000","last_fullsized":"2024-09-12T19:13:57.700779+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:45.030211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":40962,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'47","reported_seq":174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.942050+0000","last_change":"2024-09-12T18:41:45.360114+0000","last_active":"2024-09-12T19:11:48.942050+0000","last_peered":"2024-09-12T19:11:48.942050+0000","last_clean":"2024-09-12T19:11:48.942050+0000","last_became_active":"2024-09-12T18:41:45.350377+0000","last_became_peered":"2024-09-12T18:41:45.350377+0000","last_unstale":"2024-09-12T19:11:48.942050+0000","last_undegraded":"2024-09-12T19:11:48.942050+0000","last_fullsized":"2024-09-12T19:11:48.942050+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":164,"num_write":88,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.910960+0000","last_change":"2024-09-12T18:55:19.136469+0000","last_active":"2024-09-12T19:09:53.910960+0000","last_peered":"2024-09-12T19:09:53.910960+0000","last_clean":"2024-09-12T19:09:53.910960+0000","last_became_active":"2024-09-12T18:55:19.135875+0000","last_became_peered":"2024-09-12T18:55:19.135875+0000","last_unstale":"2024-09-12T19:09:53.910960+0000","last_undegraded":"2024-09-12T19:09:53.910960+0000","last_fullsized":"2024-09-12T19:09:53.910960+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:50.008510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.741846+0000","last_change":"2024-09-12T18:43:32.939294+0000","last_active":"2024-09-12T19:13:43.741846+0000","last_peered":"2024-09-12T19:13:43.741846+0000","last_clean":"2024-09-12T19:13:43.741846+0000","last_became_active":"2024-09-12T18:43:32.935176+0000","last_became_peered":"2024-09-12T18:43:32.935176+0000","last_unstale":"2024-09-12T19:13:43.741846+0000","last_undegraded":"2024-09-12T19:13:43.741846+0000","last_fullsized":"2024-09-12T19:13:43.741846+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:27.896775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.348285+0000","last_change":"2024-09-12T18:43:29.873805+0000","last_active":"2024-09-12T19:13:57.348285+0000","last_peered":"2024-09-12T19:13:57.348285+0000","last_clean":"2024-09-12T19:13:57.348285+0000","last_became_active":"2024-09-12T18:43:29.873115+0000","last_became_peered":"2024-09-12T18:43:29.873115+0000","last_unstale":"2024-09-12T19:13:57.348285+0000","last_undegraded":"2024-09-12T19:13:57.348285+0000","last_fullsized":"2024-09-12T19:13:57.348285+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:22.098039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'47","reported_seq":169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.717386+0000","last_change":"2024-09-12T18:41:45.350781+0000","last_active":"2024-09-12T19:11:48.717386+0000","last_peered":"2024-09-12T19:11:48.717386+0000","last_clean":"2024-09-12T19:11:48.717386+0000","last_became_active":"2024-09-12T18:41:45.350035+0000","last_became_peered":"2024-09-12T18:41:45.350035+0000","last_unstale":"2024-09-12T19:11:48.717386+0000","last_undegraded":"2024-09-12T19:11:48.717386+0000","last_fullsized":"2024-09-12T19:11:48.717386+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":157,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:28.712218+0000","last_change":"2024-09-12T18:55:19.157689+0000","last_active":"2024-09-12T19:11:28.712218+0000","last_peered":"2024-09-12T19:11:28.712218+0000","last_clean":"2024-09-12T19:11:28.712218+0000","last_became_active":"2024-09-12T18:55:19.156936+0000","last_became_peered":"2024-09-12T18:55:19.156936+0000","last_unstale":"2024-09-12T19:11:28.712218+0000","last_undegraded":"2024-09-12T19:11:28.712218+0000","last_fullsized":"2024-09-12T19:11:28.712218+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:02.316107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.893085+0000","last_change":"2024-09-12T18:43:32.931532+0000","last_active":"2024-09-12T19:10:18.893085+0000","last_peered":"2024-09-12T19:10:18.893085+0000","last_clean":"2024-09-12T19:10:18.893085+0000","last_became_active":"2024-09-12T18:43:32.930772+0000","last_became_peered":"2024-09-12T18:43:32.930772+0000","last_unstale":"2024-09-12T19:10:18.893085+0000","last_undegraded":"2024-09-12T19:10:18.893085+0000","last_fullsized":"2024-09-12T19:10:18.893085+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:02.364155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:33.952929+0000","last_change":"2024-09-12T18:43:29.884425+0000","last_active":"2024-09-12T19:12:33.952929+0000","last_peered":"2024-09-12T19:12:33.952929+0000","last_clean":"2024-09-12T19:12:33.952929+0000","last_became_active":"2024-09-12T18:43:29.883399+0000","last_became_peered":"2024-09-12T18:43:29.883399+0000","last_unstale":"2024-09-12T19:12:33.952929+0000","last_undegraded":"2024-09-12T19:12:33.952929+0000","last_fullsized":"2024-09-12T19:12:33.952929+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:31.245225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'25","reported_seq":117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.717215+0000","last_change":"2024-09-12T18:41:45.359067+0000","last_active":"2024-09-12T19:11:48.717215+0000","last_peered":"2024-09-12T19:11:48.717215+0000","last_clean":"2024-09-12T19:11:48.717215+0000","last_became_active":"2024-09-12T18:41:45.355180+0000","last_became_peered":"2024-09-12T18:41:45.355180+0000","last_unstale":"2024-09-12T19:11:48.717215+0000","last_undegraded":"2024-09-12T19:11:48.717215+0000","last_fullsized":"2024-09-12T19:11:48.717215+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:02.723412+0000","last_change":"2024-09-12T18:55:19.139208+0000","last_active":"2024-09-12T19:12:02.723412+0000","last_peered":"2024-09-12T19:12:02.723412+0000","last_clean":"2024-09-12T19:12:02.723412+0000","last_became_active":"2024-09-12T18:55:19.138472+0000","last_became_peered":"2024-09-12T18:55:19.138472+0000","last_unstale":"2024-09-12T19:12:02.723412+0000","last_undegraded":"2024-09-12T19:12:02.723412+0000","last_fullsized":"2024-09-12T19:12:02.723412+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.893333+0000","last_change":"2024-09-12T18:43:32.936388+0000","last_active":"2024-09-12T19:10:08.893333+0000","last_peered":"2024-09-12T19:10:08.893333+0000","last_clean":"2024-09-12T19:10:08.893333+0000","last_became_active":"2024-09-12T18:43:32.935898+0000","last_became_peered":"2024-09-12T18:43:32.935898+0000","last_unstale":"2024-09-12T19:10:08.893333+0000","last_undegraded":"2024-09-12T19:10:08.893333+0000","last_fullsized":"2024-09-12T19:10:08.893333+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:23.395289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'2","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:34.132279+0000","last_change":"2024-09-12T18:43:29.885221+0000","last_active":"2024-09-12T19:12:34.132279+0000","last_peered":"2024-09-12T19:12:34.132279+0000","last_clean":"2024-09-12T19:12:34.132279+0000","last_became_active":"2024-09-12T18:43:29.882621+0000","last_became_peered":"2024-09-12T18:43:29.882621+0000","last_unstale":"2024-09-12T19:12:34.132279+0000","last_undegraded":"2024-09-12T19:12:34.132279+0000","last_fullsized":"2024-09-12T19:12:34.132279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:41.071383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'16","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.914913+0000","last_change":"2024-09-12T18:41:45.358702+0000","last_active":"2024-09-12T19:11:48.914913+0000","last_peered":"2024-09-12T19:11:48.914913+0000","last_clean":"2024-09-12T19:11:48.914913+0000","last_became_active":"2024-09-12T18:41:45.357957+0000","last_became_peered":"2024-09-12T18:41:45.357957+0000","last_unstale":"2024-09-12T19:11:48.914913+0000","last_undegraded":"2024-09-12T19:11:48.914913+0000","last_fullsized":"2024-09-12T19:11:48.914913+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":53,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899753+0000","last_change":"2024-09-12T18:55:19.148993+0000","last_active":"2024-09-12T19:10:22.899753+0000","last_peered":"2024-09-12T19:10:22.899753+0000","last_clean":"2024-09-12T19:10:22.899753+0000","last_became_active":"2024-09-12T18:55:19.147110+0000","last_became_peered":"2024-09-12T18:55:19.147110+0000","last_unstale":"2024-09-12T19:10:22.899753+0000","last_undegraded":"2024-09-12T19:10:22.899753+0000","last_fullsized":"2024-09-12T19:10:22.899753+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:46.858987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.905541+0000","last_change":"2024-09-12T18:43:32.923207+0000","last_active":"2024-09-12T19:11:03.905541+0000","last_peered":"2024-09-12T19:11:03.905541+0000","last_clean":"2024-09-12T19:11:03.905541+0000","last_became_active":"2024-09-12T18:43:32.922514+0000","last_became_peered":"2024-09-12T18:43:32.922514+0000","last_unstale":"2024-09-12T19:11:03.905541+0000","last_undegraded":"2024-09-12T19:11:03.905541+0000","last_fullsized":"2024-09-12T19:11:03.905541+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:30.175347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'6","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:34.145443+0000","last_change":"2024-09-12T18:43:29.905017+0000","last_active":"2024-09-12T19:13:34.145443+0000","last_peered":"2024-09-12T19:13:34.145443+0000","last_clean":"2024-09-12T19:13:34.145443+0000","last_became_active":"2024-09-12T18:43:29.904226+0000","last_became_peered":"2024-09-12T18:43:29.904226+0000","last_unstale":"2024-09-12T19:13:34.145443+0000","last_undegraded":"2024-09-12T19:13:34.145443+0000","last_fullsized":"2024-09-12T19:13:34.145443+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:47.238023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'21","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:53.927298+0000","last_change":"2024-09-12T18:41:45.359716+0000","last_active":"2024-09-12T19:10:53.927298+0000","last_peered":"2024-09-12T19:10:53.927298+0000","last_clean":"2024-09-12T19:10:53.927298+0000","last_became_active":"2024-09-12T18:41:45.351791+0000","last_became_peered":"2024-09-12T18:41:45.351791+0000","last_unstale":"2024-09-12T19:10:53.927298+0000","last_undegraded":"2024-09-12T19:10:53.927298+0000","last_fullsized":"2024-09-12T19:10:53.927298+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:10.883167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899885+0000","last_change":"2024-09-12T18:55:19.149601+0000","last_active":"2024-09-12T19:10:22.899885+0000","last_peered":"2024-09-12T19:10:22.899885+0000","last_clean":"2024-09-12T19:10:22.899885+0000","last_became_active":"2024-09-12T18:55:19.148859+0000","last_became_peered":"2024-09-12T18:55:19.148859+0000","last_unstale":"2024-09-12T19:10:22.899885+0000","last_undegraded":"2024-09-12T19:10:22.899885+0000","last_fullsized":"2024-09-12T19:10:22.899885+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:12.702998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:33.738891+0000","last_change":"2024-09-12T18:43:32.937883+0000","last_active":"2024-09-12T19:13:33.738891+0000","last_peered":"2024-09-12T19:13:33.738891+0000","last_clean":"2024-09-12T19:13:33.738891+0000","last_became_active":"2024-09-12T18:43:32.935669+0000","last_became_peered":"2024-09-12T18:43:32.935669+0000","last_unstale":"2024-09-12T19:13:33.738891+0000","last_undegraded":"2024-09-12T19:13:33.738891+0000","last_fullsized":"2024-09-12T19:13:33.738891+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:02.525737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'5","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.347912+0000","last_change":"2024-09-12T18:43:29.884274+0000","last_active":"2024-09-12T19:13:57.347912+0000","last_peered":"2024-09-12T19:13:57.347912+0000","last_clean":"2024-09-12T19:13:57.347912+0000","last_became_active":"2024-09-12T18:43:29.883324+0000","last_became_peered":"2024-09-12T18:43:29.883324+0000","last_unstale":"2024-09-12T19:13:57.347912+0000","last_undegraded":"2024-09-12T19:13:57.347912+0000","last_fullsized":"2024-09-12T19:13:57.347912+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.971344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'60","reported_seq":219,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:14.482064+0000","last_change":"2024-09-12T18:41:45.345965+0000","last_active":"2024-09-12T19:11:14.482064+0000","last_peered":"2024-09-12T19:11:14.482064+0000","last_clean":"2024-09-12T19:11:14.482064+0000","last_became_active":"2024-09-12T18:41:45.339369+0000","last_became_peered":"2024-09-12T18:41:45.339369+0000","last_unstale":"2024-09-12T19:11:14.482064+0000","last_undegraded":"2024-09-12T19:11:14.482064+0000","last_fullsized":"2024-09-12T19:11:14.482064+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:10.411652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":229,"num_write":103,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.717962+0000","last_change":"2024-09-12T18:55:19.123103+0000","last_active":"2024-09-12T19:11:42.717962+0000","last_peered":"2024-09-12T19:11:42.717962+0000","last_clean":"2024-09-12T19:11:42.717962+0000","last_became_active":"2024-09-12T18:55:19.122414+0000","last_became_peered":"2024-09-12T18:55:19.122414+0000","last_unstale":"2024-09-12T19:11:42.717962+0000","last_undegraded":"2024-09-12T19:11:42.717962+0000","last_fullsized":"2024-09-12T19:11:42.717962+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.491501+0000","last_change":"2024-09-12T18:43:32.927238+0000","last_active":"2024-09-12T19:13:57.491501+0000","last_peered":"2024-09-12T19:13:57.491501+0000","last_clean":"2024-09-12T19:13:57.491501+0000","last_became_active":"2024-09-12T18:43:32.924570+0000","last_became_peered":"2024-09-12T18:43:32.924570+0000","last_unstale":"2024-09-12T19:13:57.491501+0000","last_undegraded":"2024-09-12T19:13:57.491501+0000","last_fullsized":"2024-09-12T19:13:57.491501+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:12.682450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.564434+0000","last_change":"2024-09-12T18:43:29.869397+0000","last_active":"2024-09-12T19:13:57.564434+0000","last_peered":"2024-09-12T19:13:57.564434+0000","last_clean":"2024-09-12T19:13:57.564434+0000","last_became_active":"2024-09-12T18:43:29.868738+0000","last_became_peered":"2024-09-12T18:43:29.868738+0000","last_unstale":"2024-09-12T19:13:57.564434+0000","last_undegraded":"2024-09-12T19:13:57.564434+0000","last_fullsized":"2024-09-12T19:13:57.564434+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:27.215594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'11","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.926325+0000","last_change":"2024-09-12T18:41:45.352288+0000","last_active":"2024-09-12T19:10:48.926325+0000","last_peered":"2024-09-12T19:10:48.926325+0000","last_clean":"2024-09-12T19:10:48.926325+0000","last_became_active":"2024-09-12T18:41:45.351553+0000","last_became_peered":"2024-09-12T18:41:45.351553+0000","last_unstale":"2024-09-12T19:10:48.926325+0000","last_undegraded":"2024-09-12T19:10:48.926325+0000","last_fullsized":"2024-09-12T19:10:48.926325+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:04.726575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":29,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.714544+0000","last_change":"2024-09-12T18:55:19.139323+0000","last_active":"2024-09-12T19:11:38.714544+0000","last_peered":"2024-09-12T19:11:38.714544+0000","last_clean":"2024-09-12T19:11:38.714544+0000","last_became_active":"2024-09-12T18:55:19.138649+0000","last_became_peered":"2024-09-12T18:55:19.138649+0000","last_unstale":"2024-09-12T19:11:38.714544+0000","last_undegraded":"2024-09-12T19:11:38.714544+0000","last_fullsized":"2024-09-12T19:11:38.714544+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:14.966478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.777391+0000","last_change":"2024-09-12T18:43:32.928110+0000","last_active":"2024-09-12T19:13:57.777391+0000","last_peered":"2024-09-12T19:13:57.777391+0000","last_clean":"2024-09-12T19:13:57.777391+0000","last_became_active":"2024-09-12T18:43:32.927181+0000","last_became_peered":"2024-09-12T18:43:32.927181+0000","last_unstale":"2024-09-12T19:13:57.777391+0000","last_undegraded":"2024-09-12T19:13:57.777391+0000","last_fullsized":"2024-09-12T19:13:57.777391+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'8","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.896153+0000","last_change":"2024-09-12T18:43:29.895323+0000","last_active":"2024-09-12T19:10:07.896153+0000","last_peered":"2024-09-12T19:10:07.896153+0000","last_clean":"2024-09-12T19:10:07.896153+0000","last_became_active":"2024-09-12T18:43:29.894650+0000","last_became_peered":"2024-09-12T18:43:29.894650+0000","last_unstale":"2024-09-12T19:10:07.896153+0000","last_undegraded":"2024-09-12T19:10:07.896153+0000","last_fullsized":"2024-09-12T19:10:07.896153+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:51.742629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8194,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'29","reported_seq":121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.891219+0000","last_change":"2024-09-12T18:41:45.361458+0000","last_active":"2024-09-12T19:11:19.891219+0000","last_peered":"2024-09-12T19:11:19.891219+0000","last_clean":"2024-09-12T19:11:19.891219+0000","last_became_active":"2024-09-12T18:41:45.360856+0000","last_became_peered":"2024-09-12T18:41:45.360856+0000","last_unstale":"2024-09-12T19:11:19.891219+0000","last_undegraded":"2024-09-12T19:11:19.891219+0000","last_fullsized":"2024-09-12T19:11:19.891219+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.915436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":92,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.918501+0000","last_change":"2024-09-12T18:55:19.126091+0000","last_active":"2024-09-12T19:11:42.918501+0000","last_peered":"2024-09-12T19:11:42.918501+0000","last_clean":"2024-09-12T19:11:42.918501+0000","last_became_active":"2024-09-12T18:55:19.123727+0000","last_became_peered":"2024-09-12T18:55:19.123727+0000","last_unstale":"2024-09-12T19:11:42.918501+0000","last_undegraded":"2024-09-12T19:11:42.918501+0000","last_fullsized":"2024-09-12T19:11:42.918501+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:20.999734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.914770+0000","last_change":"2024-09-12T18:43:32.935321+0000","last_active":"2024-09-12T19:10:08.914770+0000","last_peered":"2024-09-12T19:10:08.914770+0000","last_clean":"2024-09-12T19:10:08.914770+0000","last_became_active":"2024-09-12T18:43:32.934654+0000","last_became_peered":"2024-09-12T18:43:32.934654+0000","last_unstale":"2024-09-12T19:10:08.914770+0000","last_undegraded":"2024-09-12T19:10:08.914770+0000","last_fullsized":"2024-09-12T19:10:08.914770+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:18.460691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'4","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.821326+0000","last_change":"2024-09-12T18:43:29.865882+0000","last_active":"2024-09-12T19:13:57.821326+0000","last_peered":"2024-09-12T19:13:57.821326+0000","last_clean":"2024-09-12T19:13:57.821326+0000","last_became_active":"2024-09-12T18:43:29.863876+0000","last_became_peered":"2024-09-12T18:43:29.863876+0000","last_unstale":"2024-09-12T19:13:57.821326+0000","last_undegraded":"2024-09-12T19:13:57.821326+0000","last_fullsized":"2024-09-12T19:13:57.821326+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:17.118378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'15","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.888129+0000","last_change":"2024-09-12T18:41:45.347581+0000","last_active":"2024-09-12T19:10:48.888129+0000","last_peered":"2024-09-12T19:10:48.888129+0000","last_clean":"2024-09-12T19:10:48.888129+0000","last_became_active":"2024-09-12T18:41:45.346831+0000","last_became_peered":"2024-09-12T18:41:45.346831+0000","last_unstale":"2024-09-12T19:10:48.888129+0000","last_undegraded":"2024-09-12T19:10:48.888129+0000","last_fullsized":"2024-09-12T19:10:48.888129+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:46.368160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":48,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.910328+0000","last_change":"2024-09-12T18:55:19.129602+0000","last_active":"2024-09-12T19:11:38.910328+0000","last_peered":"2024-09-12T19:11:38.910328+0000","last_clean":"2024-09-12T19:11:38.910328+0000","last_became_active":"2024-09-12T18:55:19.125607+0000","last_became_peered":"2024-09-12T18:55:19.125607+0000","last_unstale":"2024-09-12T19:11:38.910328+0000","last_undegraded":"2024-09-12T19:11:38.910328+0000","last_fullsized":"2024-09-12T19:11:38.910328+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:37.974980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'4","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.442728+0000","last_change":"2024-09-12T18:43:32.909634+0000","last_active":"2024-09-12T19:13:57.442728+0000","last_peered":"2024-09-12T19:13:57.442728+0000","last_clean":"2024-09-12T19:13:57.442728+0000","last_became_active":"2024-09-12T18:43:32.908905+0000","last_became_peered":"2024-09-12T18:43:32.908905+0000","last_unstale":"2024-09-12T19:13:57.442728+0000","last_undegraded":"2024-09-12T19:13:57.442728+0000","last_fullsized":"2024-09-12T19:13:57.442728+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:55.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'7","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:33.953479+0000","last_change":"2024-09-12T18:43:29.883172+0000","last_active":"2024-09-12T19:12:33.953479+0000","last_peered":"2024-09-12T19:12:33.953479+0000","last_clean":"2024-09-12T19:12:33.953479+0000","last_became_active":"2024-09-12T18:43:29.880462+0000","last_became_peered":"2024-09-12T18:43:29.880462+0000","last_unstale":"2024-09-12T19:12:33.953479+0000","last_undegraded":"2024-09-12T19:12:33.953479+0000","last_fullsized":"2024-09-12T19:12:33.953479+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.795034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'6","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:57.892839+0000","last_change":"2024-09-12T18:41:45.360552+0000","last_active":"2024-09-12T19:09:57.892839+0000","last_peered":"2024-09-12T19:09:57.892839+0000","last_clean":"2024-09-12T19:09:57.892839+0000","last_became_active":"2024-09-12T18:41:45.359794+0000","last_became_peered":"2024-09-12T18:41:45.359794+0000","last_unstale":"2024-09-12T19:09:57.892839+0000","last_undegraded":"2024-09-12T19:09:57.892839+0000","last_fullsized":"2024-09-12T19:09:57.892839+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:46:00.750042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.910032+0000","last_change":"2024-09-12T18:55:19.154082+0000","last_active":"2024-09-12T19:09:48.910032+0000","last_peered":"2024-09-12T19:09:48.910032+0000","last_clean":"2024-09-12T19:09:48.910032+0000","last_became_active":"2024-09-12T18:55:19.152807+0000","last_became_peered":"2024-09-12T18:55:19.152807+0000","last_unstale":"2024-09-12T19:09:48.910032+0000","last_undegraded":"2024-09-12T19:09:48.910032+0000","last_fullsized":"2024-09-12T19:09:48.910032+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:50:33.926655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715438+0000","last_change":"2024-09-12T18:43:32.903978+0000","last_active":"2024-09-12T19:11:32.715438+0000","last_peered":"2024-09-12T19:11:32.715438+0000","last_clean":"2024-09-12T19:11:32.715438+0000","last_became_active":"2024-09-12T18:43:32.899988+0000","last_became_peered":"2024-09-12T18:43:32.899988+0000","last_unstale":"2024-09-12T19:11:32.715438+0000","last_undegraded":"2024-09-12T19:11:32.715438+0000","last_fullsized":"2024-09-12T19:11:32.715438+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:49.693725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:54.149724+0000","last_change":"2024-09-12T18:43:29.881020+0000","last_active":"2024-09-12T19:13:54.149724+0000","last_peered":"2024-09-12T19:13:54.149724+0000","last_clean":"2024-09-12T19:13:54.149724+0000","last_became_active":"2024-09-12T18:43:29.880294+0000","last_became_peered":"2024-09-12T18:43:29.880294+0000","last_unstale":"2024-09-12T19:13:54.149724+0000","last_undegraded":"2024-09-12T19:13:54.149724+0000","last_fullsized":"2024-09-12T19:13:54.149724+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:23.505932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'33","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:47.890460+0000","last_change":"2024-09-12T18:41:45.360139+0000","last_active":"2024-09-12T19:09:47.890460+0000","last_peered":"2024-09-12T19:09:47.890460+0000","last_clean":"2024-09-12T19:09:47.890460+0000","last_became_active":"2024-09-12T18:41:45.359405+0000","last_became_peered":"2024-09-12T18:41:45.359405+0000","last_unstale":"2024-09-12T19:09:47.890460+0000","last_undegraded":"2024-09-12T19:09:47.890460+0000","last_fullsized":"2024-09-12T19:09:47.890460+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:10.135901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":128,"num_write":57,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.911259+0000","last_change":"2024-09-12T18:55:19.139048+0000","last_active":"2024-09-12T19:09:48.911259+0000","last_peered":"2024-09-12T19:09:48.911259+0000","last_clean":"2024-09-12T19:09:48.911259+0000","last_became_active":"2024-09-12T18:55:19.136822+0000","last_became_peered":"2024-09-12T18:55:19.136822+0000","last_unstale":"2024-09-12T19:09:48.911259+0000","last_undegraded":"2024-09-12T19:09:48.911259+0000","last_fullsized":"2024-09-12T19:09:48.911259+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:33:07.426373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715353+0000","last_change":"2024-09-12T18:43:32.908035+0000","last_active":"2024-09-12T19:11:32.715353+0000","last_peered":"2024-09-12T19:11:32.715353+0000","last_clean":"2024-09-12T19:11:32.715353+0000","last_became_active":"2024-09-12T18:43:32.906911+0000","last_became_peered":"2024-09-12T18:43:32.906911+0000","last_unstale":"2024-09-12T19:11:32.715353+0000","last_undegraded":"2024-09-12T19:11:32.715353+0000","last_fullsized":"2024-09-12T19:11:32.715353+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:23.186205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"265'6","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:48.743023+0000","last_change":"2024-09-12T18:43:29.874437+0000","last_active":"2024-09-12T19:13:48.743023+0000","last_peered":"2024-09-12T19:13:48.743023+0000","last_clean":"2024-09-12T19:13:48.743023+0000","last_became_active":"2024-09-12T18:43:29.873561+0000","last_became_peered":"2024-09-12T18:43:29.873561+0000","last_unstale":"2024-09-12T19:13:48.743023+0000","last_undegraded":"2024-09-12T19:13:48.743023+0000","last_fullsized":"2024-09-12T19:13:48.743023+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:09.170136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'40","reported_seq":156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.911052+0000","last_change":"2024-09-12T18:41:45.359990+0000","last_active":"2024-09-12T19:09:48.911052+0000","last_peered":"2024-09-12T19:09:48.911052+0000","last_clean":"2024-09-12T19:09:48.911052+0000","last_became_active":"2024-09-12T18:41:45.352482+0000","last_became_peered":"2024-09-12T18:41:45.352482+0000","last_unstale":"2024-09-12T19:09:48.911052+0000","last_undegraded":"2024-09-12T19:09:48.911052+0000","last_fullsized":"2024-09-12T19:09:48.911052+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:52:23.809564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.940679+0000","last_change":"2024-09-12T18:55:19.135873+0000","last_active":"2024-09-12T19:11:43.940679+0000","last_peered":"2024-09-12T19:11:43.940679+0000","last_clean":"2024-09-12T19:11:43.940679+0000","last_became_active":"2024-09-12T18:55:19.132991+0000","last_became_peered":"2024-09-12T18:55:19.132991+0000","last_unstale":"2024-09-12T19:11:43.940679+0000","last_undegraded":"2024-09-12T19:11:43.940679+0000","last_fullsized":"2024-09-12T19:11:43.940679+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'8","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:53.744198+0000","last_change":"2024-09-12T18:43:32.934314+0000","last_active":"2024-09-12T19:13:53.744198+0000","last_peered":"2024-09-12T19:13:53.744198+0000","last_clean":"2024-09-12T19:13:53.744198+0000","last_became_active":"2024-09-12T18:43:32.927109+0000","last_became_peered":"2024-09-12T18:43:32.927109+0000","last_unstale":"2024-09-12T19:13:53.744198+0000","last_undegraded":"2024-09-12T19:13:53.744198+0000","last_fullsized":"2024-09-12T19:13:53.744198+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:58.923503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":28674,"num_write":8,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:53.944654+0000","last_change":"2024-09-12T18:43:29.881351+0000","last_active":"2024-09-12T19:13:53.944654+0000","last_peered":"2024-09-12T19:13:53.944654+0000","last_clean":"2024-09-12T19:13:53.944654+0000","last_became_active":"2024-09-12T18:43:29.880517+0000","last_became_peered":"2024-09-12T18:43:29.880517+0000","last_unstale":"2024-09-12T19:13:53.944654+0000","last_undegraded":"2024-09-12T19:13:53.944654+0000","last_fullsized":"2024-09-12T19:13:53.944654+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:07.250936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:49.095887+0000","last_change":"2024-09-12T18:41:45.351776+0000","last_active":"2024-09-12T19:09:49.095887+0000","last_peered":"2024-09-12T19:09:49.095887+0000","last_clean":"2024-09-12T19:09:49.095887+0000","last_became_active":"2024-09-12T18:41:45.350632+0000","last_became_peered":"2024-09-12T18:41:45.350632+0000","last_unstale":"2024-09-12T19:09:49.095887+0000","last_undegraded":"2024-09-12T19:09:49.095887+0000","last_fullsized":"2024-09-12T19:09:49.095887+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:16.702236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:48.909979+0000","last_change":"2024-09-12T18:55:19.151498+0000","last_active":"2024-09-12T19:09:48.909979+0000","last_peered":"2024-09-12T19:09:48.909979+0000","last_clean":"2024-09-12T19:09:48.909979+0000","last_became_active":"2024-09-12T18:55:19.150880+0000","last_became_peered":"2024-09-12T18:55:19.150880+0000","last_unstale":"2024-09-12T19:09:48.909979+0000","last_undegraded":"2024-09-12T19:09:48.909979+0000","last_fullsized":"2024-09-12T19:09:48.909979+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:13.724232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'16","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.822058+0000","last_change":"2024-09-12T18:43:32.927843+0000","last_active":"2024-09-12T19:13:57.822058+0000","last_peered":"2024-09-12T19:13:57.822058+0000","last_clean":"2024-09-12T19:13:57.822058+0000","last_became_active":"2024-09-12T18:43:32.927270+0000","last_became_peered":"2024-09-12T18:43:32.927270+0000","last_unstale":"2024-09-12T19:13:57.822058+0000","last_undegraded":"2024-09-12T19:13:57.822058+0000","last_fullsized":"2024-09-12T19:13:57.822058+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:30.970671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":38914,"num_write":26,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:48.942548+0000","last_change":"2024-09-12T18:43:29.902339+0000","last_active":"2024-09-12T19:13:48.942548+0000","last_peered":"2024-09-12T19:13:48.942548+0000","last_clean":"2024-09-12T19:13:48.942548+0000","last_became_active":"2024-09-12T18:43:29.901627+0000","last_became_peered":"2024-09-12T18:43:29.901627+0000","last_unstale":"2024-09-12T19:13:48.942548+0000","last_undegraded":"2024-09-12T19:13:48.942548+0000","last_fullsized":"2024-09-12T19:13:48.942548+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:48.203220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'30","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.583951+0000","last_change":"2024-09-12T18:41:45.353240+0000","last_active":"2024-09-12T19:11:19.583951+0000","last_peered":"2024-09-12T19:11:19.583951+0000","last_clean":"2024-09-12T19:11:19.583951+0000","last_became_active":"2024-09-12T18:41:45.350670+0000","last_became_peered":"2024-09-12T18:41:45.350670+0000","last_unstale":"2024-09-12T19:11:19.583951+0000","last_undegraded":"2024-09-12T19:11:19.583951+0000","last_fullsized":"2024-09-12T19:11:19.583951+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:05.567815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.884911+0000","last_change":"2024-09-12T18:55:19.139183+0000","last_active":"2024-09-12T19:10:33.884911+0000","last_peered":"2024-09-12T19:10:33.884911+0000","last_clean":"2024-09-12T19:10:33.884911+0000","last_became_active":"2024-09-12T18:55:19.137332+0000","last_became_peered":"2024-09-12T18:55:19.137332+0000","last_unstale":"2024-09-12T19:10:33.884911+0000","last_undegraded":"2024-09-12T19:10:33.884911+0000","last_fullsized":"2024-09-12T19:10:33.884911+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:17.893526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:28.743525+0000","last_change":"2024-09-12T18:44:13.008362+0000","last_active":"2024-09-12T19:13:28.743525+0000","last_peered":"2024-09-12T19:13:28.743525+0000","last_clean":"2024-09-12T19:13:28.743525+0000","last_became_active":"2024-09-12T18:44:13.007582+0000","last_became_peered":"2024-09-12T18:44:13.007582+0000","last_unstale":"2024-09-12T19:13:28.743525+0000","last_undegraded":"2024-09-12T19:13:28.743525+0000","last_fullsized":"2024-09-12T19:13:28.743525+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:14.811461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.c","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.902160+0000","last_change":"2024-09-12T18:43:29.889784+0000","last_active":"2024-09-12T19:10:32.902160+0000","last_peered":"2024-09-12T19:10:32.902160+0000","last_clean":"2024-09-12T19:10:32.902160+0000","last_became_active":"2024-09-12T18:43:29.888041+0000","last_became_peered":"2024-09-12T18:43:29.888041+0000","last_unstale":"2024-09-12T19:10:32.902160+0000","last_undegraded":"2024-09-12T19:10:32.902160+0000","last_fullsized":"2024-09-12T19:10:32.902160+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:54.352777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'30","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.930272+0000","last_change":"2024-09-12T18:41:45.354909+0000","last_active":"2024-09-12T19:11:08.930272+0000","last_peered":"2024-09-12T19:11:08.930272+0000","last_clean":"2024-09-12T19:11:08.930272+0000","last_became_active":"2024-09-12T18:41:45.354063+0000","last_became_peered":"2024-09-12T18:41:45.354063+0000","last_unstale":"2024-09-12T19:11:08.930272+0000","last_undegraded":"2024-09-12T19:11:08.930272+0000","last_fullsized":"2024-09-12T19:11:08.930272+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:25.031450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910297+0000","last_change":"2024-09-12T18:55:19.140991+0000","last_active":"2024-09-12T19:11:07.910297+0000","last_peered":"2024-09-12T19:11:07.910297+0000","last_clean":"2024-09-12T19:11:07.910297+0000","last_became_active":"2024-09-12T18:55:19.140331+0000","last_became_peered":"2024-09-12T18:55:19.140331+0000","last_unstale":"2024-09-12T19:11:07.910297+0000","last_undegraded":"2024-09-12T19:11:07.910297+0000","last_fullsized":"2024-09-12T19:11:07.910297+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:37.267698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.444004+0000","last_change":"2024-09-12T18:43:32.935314+0000","last_active":"2024-09-12T19:13:57.444004+0000","last_peered":"2024-09-12T19:13:57.444004+0000","last_clean":"2024-09-12T19:13:57.444004+0000","last_became_active":"2024-09-12T18:43:32.934598+0000","last_became_peered":"2024-09-12T18:43:32.934598+0000","last_unstale":"2024-09-12T19:13:57.444004+0000","last_undegraded":"2024-09-12T19:13:57.444004+0000","last_fullsized":"2024-09-12T19:13:57.444004+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:01.163337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.728342+0000","last_change":"2024-09-12T18:43:29.888854+0000","last_active":"2024-09-12T19:12:43.728342+0000","last_peered":"2024-09-12T19:12:43.728342+0000","last_clean":"2024-09-12T19:12:43.728342+0000","last_became_active":"2024-09-12T18:43:29.887500+0000","last_became_peered":"2024-09-12T18:43:29.887500+0000","last_unstale":"2024-09-12T19:12:43.728342+0000","last_undegraded":"2024-09-12T19:12:43.728342+0000","last_fullsized":"2024-09-12T19:12:43.728342+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:09.260023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'32","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.902996+0000","last_change":"2024-09-12T18:41:45.359668+0000","last_active":"2024-09-12T19:11:03.902996+0000","last_peered":"2024-09-12T19:11:03.902996+0000","last_clean":"2024-09-12T19:11:03.902996+0000","last_became_active":"2024-09-12T18:41:45.358914+0000","last_became_peered":"2024-09-12T18:41:45.358914+0000","last_unstale":"2024-09-12T19:11:03.902996+0000","last_undegraded":"2024-09-12T19:11:03.902996+0000","last_fullsized":"2024-09-12T19:11:03.902996+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:07.867252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":122,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.897994+0000","last_change":"2024-09-12T18:55:19.129609+0000","last_active":"2024-09-12T19:10:28.897994+0000","last_peered":"2024-09-12T19:10:28.897994+0000","last_clean":"2024-09-12T19:10:28.897994+0000","last_became_active":"2024-09-12T18:55:19.128236+0000","last_became_peered":"2024-09-12T18:55:19.128236+0000","last_unstale":"2024-09-12T19:10:28.897994+0000","last_undegraded":"2024-09-12T19:10:28.897994+0000","last_fullsized":"2024-09-12T19:10:28.897994+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:53.557810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"265'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.491078+0000","last_change":"2024-09-12T18:43:32.900792+0000","last_active":"2024-09-12T19:13:57.491078+0000","last_peered":"2024-09-12T19:13:57.491078+0000","last_clean":"2024-09-12T19:13:57.491078+0000","last_became_active":"2024-09-12T18:43:32.899943+0000","last_became_peered":"2024-09-12T18:43:32.899943+0000","last_unstale":"2024-09-12T19:13:57.491078+0000","last_undegraded":"2024-09-12T19:13:57.491078+0000","last_fullsized":"2024-09-12T19:13:57.491078+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3444,"num_write":4,"num_write_kb":1722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:48.957143+0000","last_change":"2024-09-12T18:43:29.878465+0000","last_active":"2024-09-12T19:12:48.957143+0000","last_peered":"2024-09-12T19:12:48.957143+0000","last_clean":"2024-09-12T19:12:48.957143+0000","last_became_active":"2024-09-12T18:43:29.877755+0000","last_became_peered":"2024-09-12T18:43:29.877755+0000","last_unstale":"2024-09-12T19:12:48.957143+0000","last_undegraded":"2024-09-12T19:12:48.957143+0000","last_fullsized":"2024-09-12T19:12:48.957143+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:15.949360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4136,"num_write":4,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'17","reported_seq":94,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.905594+0000","last_change":"2024-09-12T18:41:45.358284+0000","last_active":"2024-09-12T19:11:03.905594+0000","last_peered":"2024-09-12T19:11:03.905594+0000","last_clean":"2024-09-12T19:11:03.905594+0000","last_became_active":"2024-09-12T18:41:45.357562+0000","last_became_peered":"2024-09-12T18:41:45.357562+0000","last_unstale":"2024-09-12T19:11:03.905594+0000","last_undegraded":"2024-09-12T19:11:03.905594+0000","last_fullsized":"2024-09-12T19:11:03.905594+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:45.746519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.902028+0000","last_change":"2024-09-12T18:55:19.137683+0000","last_active":"2024-09-12T19:10:32.902028+0000","last_peered":"2024-09-12T19:10:32.902028+0000","last_clean":"2024-09-12T19:10:32.902028+0000","last_became_active":"2024-09-12T18:55:19.136882+0000","last_became_peered":"2024-09-12T18:55:19.136882+0000","last_unstale":"2024-09-12T19:10:32.902028+0000","last_undegraded":"2024-09-12T19:10:32.902028+0000","last_fullsized":"2024-09-12T19:10:32.902028+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:09.805826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.921042+0000","last_change":"2024-09-12T18:43:32.930996+0000","last_active":"2024-09-12T19:10:33.921042+0000","last_peered":"2024-09-12T19:10:33.921042+0000","last_clean":"2024-09-12T19:10:33.921042+0000","last_became_active":"2024-09-12T18:43:32.927372+0000","last_became_peered":"2024-09-12T18:43:32.927372+0000","last_unstale":"2024-09-12T19:10:33.921042+0000","last_undegraded":"2024-09-12T19:10:33.921042+0000","last_fullsized":"2024-09-12T19:10:33.921042+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:56.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.910665+0000","last_change":"2024-09-12T18:43:29.900324+0000","last_active":"2024-09-12T19:10:37.910665+0000","last_peered":"2024-09-12T19:10:37.910665+0000","last_clean":"2024-09-12T19:10:37.910665+0000","last_became_active":"2024-09-12T18:43:29.888265+0000","last_became_peered":"2024-09-12T18:43:29.888265+0000","last_unstale":"2024-09-12T19:10:37.910665+0000","last_undegraded":"2024-09-12T19:10:37.910665+0000","last_fullsized":"2024-09-12T19:10:37.910665+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:31.453582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'32","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.891215+0000","last_change":"2024-09-12T18:41:45.336479+0000","last_active":"2024-09-12T19:11:03.891215+0000","last_peered":"2024-09-12T19:11:03.891215+0000","last_clean":"2024-09-12T19:11:03.891215+0000","last_became_active":"2024-09-12T18:41:45.335675+0000","last_became_peered":"2024-09-12T18:41:45.335675+0000","last_unstale":"2024-09-12T19:11:03.891215+0000","last_undegraded":"2024-09-12T19:11:03.891215+0000","last_fullsized":"2024-09-12T19:11:03.891215+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:40.967621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":63,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.928809+0000","last_change":"2024-09-12T18:55:19.150357+0000","last_active":"2024-09-12T19:11:03.928809+0000","last_peered":"2024-09-12T19:11:03.928809+0000","last_clean":"2024-09-12T19:11:03.928809+0000","last_became_active":"2024-09-12T18:55:19.149794+0000","last_became_peered":"2024-09-12T18:55:19.149794+0000","last_unstale":"2024-09-12T19:11:03.928809+0000","last_undegraded":"2024-09-12T19:11:03.928809+0000","last_fullsized":"2024-09-12T19:11:03.928809+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:29.807238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121142+0000","last_change":"2024-09-12T18:43:32.910786+0000","last_active":"2024-09-12T19:11:44.121142+0000","last_peered":"2024-09-12T19:11:44.121142+0000","last_clean":"2024-09-12T19:11:44.121142+0000","last_became_active":"2024-09-12T18:43:32.908692+0000","last_became_peered":"2024-09-12T18:43:32.908692+0000","last_unstale":"2024-09-12T19:11:44.121142+0000","last_undegraded":"2024-09-12T19:11:44.121142+0000","last_fullsized":"2024-09-12T19:11:44.121142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:46.037235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:53.749219+0000","last_change":"2024-09-12T18:43:29.883687+0000","last_active":"2024-09-12T19:13:53.749219+0000","last_peered":"2024-09-12T19:13:53.749219+0000","last_clean":"2024-09-12T19:13:53.749219+0000","last_became_active":"2024-09-12T18:43:29.882915+0000","last_became_peered":"2024-09-12T18:43:29.882915+0000","last_unstale":"2024-09-12T19:13:53.749219+0000","last_undegraded":"2024-09-12T19:13:53.749219+0000","last_fullsized":"2024-09-12T19:13:53.749219+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:04.141732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'74","reported_seq":245,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.930292+0000","last_change":"2024-09-12T18:41:45.352749+0000","last_active":"2024-09-12T19:11:03.930292+0000","last_peered":"2024-09-12T19:11:03.930292+0000","last_clean":"2024-09-12T19:11:03.930292+0000","last_became_active":"2024-09-12T18:41:45.351387+0000","last_became_peered":"2024-09-12T18:41:45.351387+0000","last_unstale":"2024-09-12T19:11:03.930292+0000","last_undegraded":"2024-09-12T19:11:03.930292+0000","last_fullsized":"2024-09-12T19:11:03.930292+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:11:09.964195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":261,"num_write":135,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:12.911671+0000","last_change":"2024-09-12T18:55:19.150286+0000","last_active":"2024-09-12T19:11:12.911671+0000","last_peered":"2024-09-12T19:11:12.911671+0000","last_clean":"2024-09-12T19:11:12.911671+0000","last_became_active":"2024-09-12T18:55:19.149666+0000","last_became_peered":"2024-09-12T18:55:19.149666+0000","last_unstale":"2024-09-12T19:11:12.911671+0000","last_undegraded":"2024-09-12T19:11:12.911671+0000","last_fullsized":"2024-09-12T19:11:12.911671+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:09.562684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'7","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.114111+0000","last_change":"2024-09-12T18:43:32.903834+0000","last_active":"2024-09-12T19:13:57.114111+0000","last_peered":"2024-09-12T19:13:57.114111+0000","last_clean":"2024-09-12T19:13:57.114111+0000","last_became_active":"2024-09-12T18:43:32.903112+0000","last_became_peered":"2024-09-12T18:43:32.903112+0000","last_unstale":"2024-09-12T19:13:57.114111+0000","last_undegraded":"2024-09-12T19:13:57.114111+0000","last_fullsized":"2024-09-12T19:13:57.114111+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:35.198794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.717849+0000","last_change":"2024-09-12T18:43:29.899798+0000","last_active":"2024-09-12T19:11:42.717849+0000","last_peered":"2024-09-12T19:11:42.717849+0000","last_clean":"2024-09-12T19:11:42.717849+0000","last_became_active":"2024-09-12T18:43:29.887725+0000","last_became_peered":"2024-09-12T18:43:29.887725+0000","last_unstale":"2024-09-12T19:11:42.717849+0000","last_undegraded":"2024-09-12T19:11:42.717849+0000","last_fullsized":"2024-09-12T19:11:42.717849+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:12.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.895985+0000","last_change":"2024-09-12T18:41:45.354403+0000","last_active":"2024-09-12T19:10:07.895985+0000","last_peered":"2024-09-12T19:10:07.895985+0000","last_clean":"2024-09-12T19:10:07.895985+0000","last_became_active":"2024-09-12T18:41:45.353582+0000","last_became_peered":"2024-09-12T18:41:45.353582+0000","last_unstale":"2024-09-12T19:10:07.895985+0000","last_undegraded":"2024-09-12T19:10:07.895985+0000","last_fullsized":"2024-09-12T19:10:07.895985+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:29:11.323313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910340+0000","last_change":"2024-09-12T18:55:19.147574+0000","last_active":"2024-09-12T19:11:07.910340+0000","last_peered":"2024-09-12T19:11:07.910340+0000","last_clean":"2024-09-12T19:11:07.910340+0000","last_became_active":"2024-09-12T18:55:19.146310+0000","last_became_peered":"2024-09-12T18:55:19.146310+0000","last_unstale":"2024-09-12T19:11:07.910340+0000","last_undegraded":"2024-09-12T19:11:07.910340+0000","last_fullsized":"2024-09-12T19:11:07.910340+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:20.681513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.909363+0000","last_change":"2024-09-12T18:43:32.922885+0000","last_active":"2024-09-12T19:10:32.909363+0000","last_peered":"2024-09-12T19:10:32.909363+0000","last_clean":"2024-09-12T19:10:32.909363+0000","last_became_active":"2024-09-12T18:43:32.922056+0000","last_became_peered":"2024-09-12T18:43:32.922056+0000","last_unstale":"2024-09-12T19:10:32.909363+0000","last_undegraded":"2024-09-12T19:10:32.909363+0000","last_fullsized":"2024-09-12T19:10:32.909363+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:30.503287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.821484+0000","last_change":"2024-09-12T18:43:29.886237+0000","last_active":"2024-09-12T19:13:57.821484+0000","last_peered":"2024-09-12T19:13:57.821484+0000","last_clean":"2024-09-12T19:13:57.821484+0000","last_became_active":"2024-09-12T18:43:29.885595+0000","last_became_peered":"2024-09-12T18:43:29.885595+0000","last_unstale":"2024-09-12T19:13:57.821484+0000","last_undegraded":"2024-09-12T19:13:57.821484+0000","last_fullsized":"2024-09-12T19:13:57.821484+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5492,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'29","reported_seq":123,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.722539+0000","last_change":"2024-09-12T18:41:45.336015+0000","last_active":"2024-09-12T19:12:08.722539+0000","last_peered":"2024-09-12T19:12:08.722539+0000","last_clean":"2024-09-12T19:12:08.722539+0000","last_became_active":"2024-09-12T18:41:45.335258+0000","last_became_peered":"2024-09-12T18:41:45.335258+0000","last_unstale":"2024-09-12T19:12:08.722539+0000","last_undegraded":"2024-09-12T19:12:08.722539+0000","last_fullsized":"2024-09-12T19:12:08.722539+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":60,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.930417+0000","last_change":"2024-09-12T18:55:19.140934+0000","last_active":"2024-09-12T19:11:03.930417+0000","last_peered":"2024-09-12T19:11:03.930417+0000","last_clean":"2024-09-12T19:11:03.930417+0000","last_became_active":"2024-09-12T18:55:19.140247+0000","last_became_peered":"2024-09-12T18:55:19.140247+0000","last_unstale":"2024-09-12T19:11:03.930417+0000","last_undegraded":"2024-09-12T19:11:03.930417+0000","last_fullsized":"2024-09-12T19:11:03.930417+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:21.925405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'9","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.822690+0000","last_change":"2024-09-12T18:43:32.918976+0000","last_active":"2024-09-12T19:13:57.822690+0000","last_peered":"2024-09-12T19:13:57.822690+0000","last_clean":"2024-09-12T19:13:57.822690+0000","last_became_active":"2024-09-12T18:43:32.918077+0000","last_became_peered":"2024-09-12T18:43:32.918077+0000","last_unstale":"2024-09-12T19:13:57.822690+0000","last_undegraded":"2024-09-12T19:13:57.822690+0000","last_fullsized":"2024-09-12T19:13:57.822690+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.534577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:34.105965+0000","last_change":"2024-09-12T18:43:29.903733+0000","last_active":"2024-09-12T19:10:34.105965+0000","last_peered":"2024-09-12T19:10:34.105965+0000","last_clean":"2024-09-12T19:10:34.105965+0000","last_became_active":"2024-09-12T18:43:29.902444+0000","last_became_peered":"2024-09-12T18:43:29.902444+0000","last_unstale":"2024-09-12T19:10:34.105965+0000","last_undegraded":"2024-09-12T19:10:34.105965+0000","last_fullsized":"2024-09-12T19:10:34.105965+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:31:28.242386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'31","reported_seq":133,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.918798+0000","last_change":"2024-09-12T18:41:45.351143+0000","last_active":"2024-09-12T19:12:08.918798+0000","last_peered":"2024-09-12T19:12:08.918798+0000","last_clean":"2024-09-12T19:12:08.918798+0000","last_became_active":"2024-09-12T18:41:45.350344+0000","last_became_peered":"2024-09-12T18:41:45.350344+0000","last_unstale":"2024-09-12T19:12:08.918798+0000","last_undegraded":"2024-09-12T19:12:08.918798+0000","last_fullsized":"2024-09-12T19:12:08.918798+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":107,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:02.923486+0000","last_change":"2024-09-12T18:55:19.145504+0000","last_active":"2024-09-12T19:12:02.923486+0000","last_peered":"2024-09-12T19:12:02.923486+0000","last_clean":"2024-09-12T19:12:02.923486+0000","last_became_active":"2024-09-12T18:55:19.144778+0000","last_became_peered":"2024-09-12T18:55:19.144778+0000","last_unstale":"2024-09-12T19:12:02.923486+0000","last_undegraded":"2024-09-12T19:12:02.923486+0000","last_fullsized":"2024-09-12T19:12:02.923486+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:48.957071+0000","last_change":"2024-09-12T18:43:32.903502+0000","last_active":"2024-09-12T19:12:48.957071+0000","last_peered":"2024-09-12T19:12:48.957071+0000","last_clean":"2024-09-12T19:12:48.957071+0000","last_became_active":"2024-09-12T18:43:32.901790+0000","last_became_peered":"2024-09-12T18:43:32.901790+0000","last_unstale":"2024-09-12T19:12:48.957071+0000","last_undegraded":"2024-09-12T19:12:48.957071+0000","last_fullsized":"2024-09-12T19:12:48.957071+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:24.176553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903364+0000","last_change":"2024-09-12T18:43:29.890565+0000","last_active":"2024-09-12T19:10:37.903364+0000","last_peered":"2024-09-12T19:10:37.903364+0000","last_clean":"2024-09-12T19:10:37.903364+0000","last_became_active":"2024-09-12T18:43:29.889097+0000","last_became_peered":"2024-09-12T18:43:29.889097+0000","last_unstale":"2024-09-12T19:10:37.903364+0000","last_undegraded":"2024-09-12T19:10:37.903364+0000","last_fullsized":"2024-09-12T19:10:37.903364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:26.725295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.947159+0000","last_change":"2024-09-12T18:41:45.364829+0000","last_active":"2024-09-12T19:12:08.947159+0000","last_peered":"2024-09-12T19:12:08.947159+0000","last_clean":"2024-09-12T19:12:08.947159+0000","last_became_active":"2024-09-12T18:41:45.364055+0000","last_became_peered":"2024-09-12T18:41:45.364055+0000","last_unstale":"2024-09-12T19:12:08.947159+0000","last_undegraded":"2024-09-12T19:12:08.947159+0000","last_fullsized":"2024-09-12T19:12:08.947159+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.915239+0000","last_change":"2024-09-12T18:55:19.122707+0000","last_active":"2024-09-12T19:11:58.915239+0000","last_peered":"2024-09-12T19:11:58.915239+0000","last_clean":"2024-09-12T19:11:58.915239+0000","last_became_active":"2024-09-12T18:55:19.121805+0000","last_became_peered":"2024-09-12T18:55:19.121805+0000","last_unstale":"2024-09-12T19:11:58.915239+0000","last_undegraded":"2024-09-12T19:11:58.915239+0000","last_fullsized":"2024-09-12T19:11:58.915239+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:51.523106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'11","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.955856+0000","last_change":"2024-09-12T18:43:32.899098+0000","last_active":"2024-09-12T19:12:43.955856+0000","last_peered":"2024-09-12T19:12:43.955856+0000","last_clean":"2024-09-12T19:12:43.955856+0000","last_became_active":"2024-09-12T18:43:32.898379+0000","last_became_peered":"2024-09-12T18:43:32.898379+0000","last_unstale":"2024-09-12T19:12:43.955856+0000","last_undegraded":"2024-09-12T19:12:43.955856+0000","last_fullsized":"2024-09-12T19:12:43.955856+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:40.658854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":16388,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.348079+0000","last_change":"2024-09-12T18:43:29.897947+0000","last_active":"2024-09-12T19:13:57.348079+0000","last_peered":"2024-09-12T19:13:57.348079+0000","last_clean":"2024-09-12T19:13:57.348079+0000","last_became_active":"2024-09-12T18:43:29.897326+0000","last_became_peered":"2024-09-12T18:43:29.897326+0000","last_unstale":"2024-09-12T19:13:57.348079+0000","last_undegraded":"2024-09-12T19:13:57.348079+0000","last_fullsized":"2024-09-12T19:13:57.348079+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:49.647470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'31","reported_seq":130,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.918944+0000","last_change":"2024-09-12T18:41:45.351648+0000","last_active":"2024-09-12T19:12:08.918944+0000","last_peered":"2024-09-12T19:12:08.918944+0000","last_clean":"2024-09-12T19:12:08.918944+0000","last_became_active":"2024-09-12T18:41:45.350900+0000","last_became_peered":"2024-09-12T18:41:45.350900+0000","last_unstale":"2024-09-12T19:12:08.918944+0000","last_undegraded":"2024-09-12T19:12:08.918944+0000","last_fullsized":"2024-09-12T19:12:08.918944+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":59,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715397+0000","last_change":"2024-09-12T18:55:19.123047+0000","last_active":"2024-09-12T19:11:32.715397+0000","last_peered":"2024-09-12T19:11:32.715397+0000","last_clean":"2024-09-12T19:11:32.715397+0000","last_became_active":"2024-09-12T18:55:19.122238+0000","last_became_peered":"2024-09-12T18:55:19.122238+0000","last_unstale":"2024-09-12T19:11:32.715397+0000","last_undegraded":"2024-09-12T19:11:32.715397+0000","last_fullsized":"2024-09-12T19:11:32.715397+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:01.481082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:52.950322+0000","last_change":"2024-09-12T18:43:32.914014+0000","last_active":"2024-09-12T19:13:52.950322+0000","last_peered":"2024-09-12T19:13:52.950322+0000","last_clean":"2024-09-12T19:13:52.950322+0000","last_became_active":"2024-09-12T18:43:32.913108+0000","last_became_peered":"2024-09-12T18:43:32.913108+0000","last_unstale":"2024-09-12T19:13:52.950322+0000","last_undegraded":"2024-09-12T19:13:52.950322+0000","last_fullsized":"2024-09-12T19:13:52.950322+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:00.617500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'8","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.910550+0000","last_change":"2024-09-12T18:43:29.878679+0000","last_active":"2024-09-12T19:11:38.910550+0000","last_peered":"2024-09-12T19:11:38.910550+0000","last_clean":"2024-09-12T19:11:38.910550+0000","last_became_active":"2024-09-12T18:43:29.877925+0000","last_became_peered":"2024-09-12T18:43:29.877925+0000","last_unstale":"2024-09-12T19:11:38.910550+0000","last_undegraded":"2024-09-12T19:11:38.910550+0000","last_fullsized":"2024-09-12T19:11:38.910550+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:25.553737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'135","reported_seq":472,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910405+0000","last_change":"2024-09-12T18:41:45.365909+0000","last_active":"2024-09-12T19:11:07.910405+0000","last_peered":"2024-09-12T19:11:07.910405+0000","last_clean":"2024-09-12T19:11:07.910405+0000","last_became_active":"2024-09-12T18:41:45.365175+0000","last_became_peered":"2024-09-12T18:41:45.365175+0000","last_unstale":"2024-09-12T19:11:07.910405+0000","last_undegraded":"2024-09-12T19:11:07.910405+0000","last_fullsized":"2024-09-12T19:11:07.910405+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:16.010188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":832,"num_read_kb":595,"num_write":177,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.124516+0000","last_change":"2024-09-12T18:55:19.130989+0000","last_active":"2024-09-12T19:11:59.124516+0000","last_peered":"2024-09-12T19:11:59.124516+0000","last_clean":"2024-09-12T19:11:59.124516+0000","last_became_active":"2024-09-12T18:55:19.130130+0000","last_became_peered":"2024-09-12T18:55:19.130130+0000","last_unstale":"2024-09-12T19:11:59.124516+0000","last_undegraded":"2024-09-12T19:11:59.124516+0000","last_fullsized":"2024-09-12T19:11:59.124516+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121479+0000","last_change":"2024-09-12T18:43:32.906004+0000","last_active":"2024-09-12T19:11:44.121479+0000","last_peered":"2024-09-12T19:11:44.121479+0000","last_clean":"2024-09-12T19:11:44.121479+0000","last_became_active":"2024-09-12T18:43:32.904789+0000","last_became_peered":"2024-09-12T18:43:32.904789+0000","last_unstale":"2024-09-12T19:11:44.121479+0000","last_undegraded":"2024-09-12T19:11:44.121479+0000","last_fullsized":"2024-09-12T19:11:44.121479+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:44.194875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.918932+0000","last_change":"2024-09-12T18:43:29.884688+0000","last_active":"2024-09-12T19:11:42.918932+0000","last_peered":"2024-09-12T19:11:42.918932+0000","last_clean":"2024-09-12T19:11:42.918932+0000","last_became_active":"2024-09-12T18:43:29.883790+0000","last_became_peered":"2024-09-12T18:43:29.883790+0000","last_unstale":"2024-09-12T19:11:42.918932+0000","last_undegraded":"2024-09-12T19:11:42.918932+0000","last_fullsized":"2024-09-12T19:11:42.918932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:58.821497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'6","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:57.915303+0000","last_change":"2024-09-12T18:41:45.358458+0000","last_active":"2024-09-12T19:10:57.915303+0000","last_peered":"2024-09-12T19:10:57.915303+0000","last_clean":"2024-09-12T19:10:57.915303+0000","last_became_active":"2024-09-12T18:41:45.357746+0000","last_became_peered":"2024-09-12T18:41:45.357746+0000","last_unstale":"2024-09-12T19:10:57.915303+0000","last_undegraded":"2024-09-12T19:10:57.915303+0000","last_fullsized":"2024-09-12T19:10:57.915303+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:16.491434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.883887+0000","last_change":"2024-09-12T18:55:19.140383+0000","last_active":"2024-09-12T19:10:28.883887+0000","last_peered":"2024-09-12T19:10:28.883887+0000","last_clean":"2024-09-12T19:10:28.883887+0000","last_became_active":"2024-09-12T18:55:19.139565+0000","last_became_peered":"2024-09-12T18:55:19.139565+0000","last_unstale":"2024-09-12T19:10:28.883887+0000","last_undegraded":"2024-09-12T19:10:28.883887+0000","last_fullsized":"2024-09-12T19:10:28.883887+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:41:46.784423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:42.732160+0000","last_change":"2024-09-12T18:43:32.906082+0000","last_active":"2024-09-12T19:12:42.732160+0000","last_peered":"2024-09-12T19:12:42.732160+0000","last_clean":"2024-09-12T19:12:42.732160+0000","last_became_active":"2024-09-12T18:43:32.904858+0000","last_became_peered":"2024-09-12T18:43:32.904858+0000","last_unstale":"2024-09-12T19:12:42.732160+0000","last_undegraded":"2024-09-12T19:12:42.732160+0000","last_fullsized":"2024-09-12T19:12:42.732160+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:58.276689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:42.947818+0000","last_change":"2024-09-12T18:43:29.890077+0000","last_active":"2024-09-12T19:13:42.947818+0000","last_peered":"2024-09-12T19:13:42.947818+0000","last_clean":"2024-09-12T19:13:42.947818+0000","last_became_active":"2024-09-12T18:43:29.889328+0000","last_became_peered":"2024-09-12T18:43:29.889328+0000","last_unstale":"2024-09-12T19:13:42.947818+0000","last_undegraded":"2024-09-12T19:13:42.947818+0000","last_fullsized":"2024-09-12T19:13:42.947818+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:20.098869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'8","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.901798+0000","last_change":"2024-09-12T18:41:45.354082+0000","last_active":"2024-09-12T19:10:58.901798+0000","last_peered":"2024-09-12T19:10:58.901798+0000","last_clean":"2024-09-12T19:10:58.901798+0000","last_became_active":"2024-09-12T18:41:45.353369+0000","last_became_peered":"2024-09-12T18:41:45.353369+0000","last_unstale":"2024-09-12T19:10:58.901798+0000","last_undegraded":"2024-09-12T19:10:58.901798+0000","last_fullsized":"2024-09-12T19:10:58.901798+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:09:49.982690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.921223+0000","last_change":"2024-09-12T18:55:19.116656+0000","last_active":"2024-09-12T19:10:28.921223+0000","last_peered":"2024-09-12T19:10:28.921223+0000","last_clean":"2024-09-12T19:10:28.921223+0000","last_became_active":"2024-09-12T18:55:19.115920+0000","last_became_peered":"2024-09-12T18:55:19.115920+0000","last_unstale":"2024-09-12T19:10:28.921223+0000","last_undegraded":"2024-09-12T19:10:28.921223+0000","last_fullsized":"2024-09-12T19:10:28.921223+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:54.225077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.911420+0000","last_change":"2024-09-12T18:43:32.914128+0000","last_active":"2024-09-12T19:11:43.911420+0000","last_peered":"2024-09-12T19:11:43.911420+0000","last_clean":"2024-09-12T19:11:43.911420+0000","last_became_active":"2024-09-12T18:43:32.913259+0000","last_became_peered":"2024-09-12T18:43:32.913259+0000","last_unstale":"2024-09-12T19:11:43.911420+0000","last_undegraded":"2024-09-12T19:11:43.911420+0000","last_fullsized":"2024-09-12T19:11:43.911420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:08.421749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903278+0000","last_change":"2024-09-12T18:43:29.883036+0000","last_active":"2024-09-12T19:10:37.903278+0000","last_peered":"2024-09-12T19:10:37.903278+0000","last_clean":"2024-09-12T19:10:37.903278+0000","last_became_active":"2024-09-12T18:43:29.882039+0000","last_became_peered":"2024-09-12T18:43:29.882039+0000","last_unstale":"2024-09-12T19:10:37.903278+0000","last_undegraded":"2024-09-12T19:10:37.903278+0000","last_fullsized":"2024-09-12T19:10:37.903278+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:20.442914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'181","reported_seq":586,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:59.111456+0000","last_change":"2024-09-12T18:41:45.354928+0000","last_active":"2024-09-12T19:10:59.111456+0000","last_peered":"2024-09-12T19:10:59.111456+0000","last_clean":"2024-09-12T19:10:59.111456+0000","last_became_active":"2024-09-12T18:41:45.354142+0000","last_became_peered":"2024-09-12T18:41:45.354142+0000","last_unstale":"2024-09-12T19:10:59.111456+0000","last_undegraded":"2024-09-12T19:10:59.111456+0000","last_fullsized":"2024-09-12T19:10:59.111456+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:57.126086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":838,"num_write":233,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.944495+0000","last_change":"2024-09-12T18:55:19.143090+0000","last_active":"2024-09-12T19:11:58.944495+0000","last_peered":"2024-09-12T19:11:58.944495+0000","last_clean":"2024-09-12T19:11:58.944495+0000","last_became_active":"2024-09-12T18:55:19.142412+0000","last_became_peered":"2024-09-12T18:55:19.142412+0000","last_unstale":"2024-09-12T19:11:58.944495+0000","last_undegraded":"2024-09-12T19:11:58.944495+0000","last_fullsized":"2024-09-12T19:11:58.944495+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'5","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.926151+0000","last_change":"2024-09-12T18:43:32.939711+0000","last_active":"2024-09-12T19:12:43.926151+0000","last_peered":"2024-09-12T19:12:43.926151+0000","last_clean":"2024-09-12T19:12:43.926151+0000","last_became_active":"2024-09-12T18:43:32.939024+0000","last_became_peered":"2024-09-12T18:43:32.939024+0000","last_unstale":"2024-09-12T19:12:43.926151+0000","last_undegraded":"2024-09-12T19:12:43.926151+0000","last_fullsized":"2024-09-12T19:12:43.926151+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:08.177317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:42.732247+0000","last_change":"2024-09-12T18:43:29.900783+0000","last_active":"2024-09-12T19:12:42.732247+0000","last_peered":"2024-09-12T19:12:42.732247+0000","last_clean":"2024-09-12T19:12:42.732247+0000","last_became_active":"2024-09-12T18:43:29.892060+0000","last_became_peered":"2024-09-12T18:43:29.892060+0000","last_unstale":"2024-09-12T19:12:42.732247+0000","last_undegraded":"2024-09-12T19:12:42.732247+0000","last_fullsized":"2024-09-12T19:12:42.732247+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:21.621735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'50","reported_seq":183,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:20.845700+0000","last_change":"2024-09-12T18:41:45.356560+0000","last_active":"2024-09-12T19:11:20.845700+0000","last_peered":"2024-09-12T19:11:20.845700+0000","last_clean":"2024-09-12T19:11:20.845700+0000","last_became_active":"2024-09-12T18:41:45.355840+0000","last_became_peered":"2024-09-12T18:41:45.355840+0000","last_unstale":"2024-09-12T19:11:20.845700+0000","last_undegraded":"2024-09-12T19:11:20.845700+0000","last_fullsized":"2024-09-12T19:11:20.845700+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:22.223128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":177,"num_write":88,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.924734+0000","last_change":"2024-09-12T18:55:19.156335+0000","last_active":"2024-09-12T19:12:07.924734+0000","last_peered":"2024-09-12T19:12:07.924734+0000","last_clean":"2024-09-12T19:12:07.924734+0000","last_became_active":"2024-09-12T18:55:19.155684+0000","last_became_peered":"2024-09-12T18:55:19.155684+0000","last_unstale":"2024-09-12T19:12:07.924734+0000","last_undegraded":"2024-09-12T19:12:07.924734+0000","last_fullsized":"2024-09-12T19:12:07.924734+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.779035+0000","last_change":"2024-09-12T18:43:32.905624+0000","last_active":"2024-09-12T19:13:57.779035+0000","last_peered":"2024-09-12T19:13:57.779035+0000","last_clean":"2024-09-12T19:13:57.779035+0000","last_became_active":"2024-09-12T18:43:32.903273+0000","last_became_peered":"2024-09-12T18:43:32.903273+0000","last_unstale":"2024-09-12T19:13:57.779035+0000","last_undegraded":"2024-09-12T19:13:57.779035+0000","last_fullsized":"2024-09-12T19:13:57.779035+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:48.885568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.926200+0000","last_change":"2024-09-12T18:43:29.868919+0000","last_active":"2024-09-12T19:12:43.926200+0000","last_peered":"2024-09-12T19:12:43.926200+0000","last_clean":"2024-09-12T19:12:43.926200+0000","last_became_active":"2024-09-12T18:43:29.865413+0000","last_became_peered":"2024-09-12T18:43:29.865413+0000","last_unstale":"2024-09-12T19:12:43.926200+0000","last_undegraded":"2024-09-12T19:12:43.926200+0000","last_fullsized":"2024-09-12T19:12:43.926200+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:35.628916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'25","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:57.922311+0000","last_change":"2024-09-12T18:41:45.363243+0000","last_active":"2024-09-12T19:11:57.922311+0000","last_peered":"2024-09-12T19:11:57.922311+0000","last_clean":"2024-09-12T19:11:57.922311+0000","last_became_active":"2024-09-12T18:41:45.362445+0000","last_became_peered":"2024-09-12T18:41:45.362445+0000","last_unstale":"2024-09-12T19:11:57.922311+0000","last_undegraded":"2024-09-12T19:11:57.922311+0000","last_fullsized":"2024-09-12T19:11:57.922311+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:28:57.818173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'318","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.831615+0000","last_change":"2024-09-12T19:14:18.831615+0000","last_active":"2024-09-12T19:14:18.831615+0000","last_peered":"2024-09-12T19:14:18.831615+0000","last_clean":"2024-09-12T19:14:18.831615+0000","last_became_active":"2024-09-12T18:26:39.872863+0000","last_became_peered":"2024-09-12T18:26:39.872863+0000","last_unstale":"2024-09-12T19:14:18.831615+0000","last_undegraded":"2024-09-12T19:14:18.831615+0000","last_fullsized":"2024-09-12T19:14:18.831615+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T19:14:18.831273+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T19:14:18.831273+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.831273+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:35.503180+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65109,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":407,"num_read_kb":8020,"num_write":948,"num_write_kb":33098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'549","reported_seq":2210,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.381001+0000","last_change":"2024-09-12T19:14:23.381001+0000","last_active":"2024-09-12T19:14:23.381001+0000","last_peered":"2024-09-12T19:14:23.381001+0000","last_clean":"2024-09-12T19:14:23.381001+0000","last_became_active":"2024-09-12T18:26:41.879711+0000","last_became_peered":"2024-09-12T18:26:41.879711+0000","last_unstale":"2024-09-12T19:14:23.381001+0000","last_undegraded":"2024-09-12T19:14:23.381001+0000","last_fullsized":"2024-09-12T19:14:23.381001+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'549","last_scrub_stamp":"2024-09-12T19:14:23.380715+0000","last_deep_scrub":"265'549","last_deep_scrub_stamp":"2024-09-12T19:14:23.380715+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.380715+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:49.716008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2944,"num_read_kb":2757,"num_write":660,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'376","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.135299+0000","last_change":"2024-09-12T19:14:12.135299+0000","last_active":"2024-09-12T19:14:12.135299+0000","last_peered":"2024-09-12T19:14:12.135299+0000","last_clean":"2024-09-12T19:14:12.135299+0000","last_became_active":"2024-09-12T18:26:39.837462+0000","last_became_peered":"2024-09-12T18:26:39.837462+0000","last_unstale":"2024-09-12T19:14:12.135299+0000","last_undegraded":"2024-09-12T19:14:12.135299+0000","last_fullsized":"2024-09-12T19:14:12.135299+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T19:14:12.135058+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T19:14:12.135058+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.135058+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:27.693768+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10456094,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":60601,"num_write":1117,"num_write_kb":26482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'832","reported_seq":2228,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.126636+0000","last_change":"2024-09-12T18:26:41.864753+0000","last_active":"2024-09-12T19:12:24.126636+0000","last_peered":"2024-09-12T19:12:24.126636+0000","last_clean":"2024-09-12T19:12:24.126636+0000","last_became_active":"2024-09-12T18:26:41.863835+0000","last_became_peered":"2024-09-12T18:26:41.863835+0000","last_unstale":"2024-09-12T19:12:24.126636+0000","last_undegraded":"2024-09-12T19:12:24.126636+0000","last_fullsized":"2024-09-12T19:12:24.126636+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3830,"num_read_kb":3409,"num_write":1134,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'378","reported_seq":1062,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.849112+0000","last_change":"2024-09-12T19:14:08.849112+0000","last_active":"2024-09-12T19:14:08.849112+0000","last_peered":"2024-09-12T19:14:08.849112+0000","last_clean":"2024-09-12T19:14:08.849112+0000","last_became_active":"2024-09-12T18:26:39.831522+0000","last_became_peered":"2024-09-12T18:26:39.831522+0000","last_unstale":"2024-09-12T19:14:08.849112+0000","last_undegraded":"2024-09-12T19:14:08.849112+0000","last_fullsized":"2024-09-12T19:14:08.849112+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T19:14:08.848850+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T19:14:08.848850+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.848850+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:42.012065+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":634,"num_read_kb":27264,"num_write":1166,"num_write_kb":30891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'366","reported_seq":1836,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.391877+0000","last_change":"2024-09-12T19:14:23.391877+0000","last_active":"2024-09-12T19:14:23.391877+0000","last_peered":"2024-09-12T19:14:23.391877+0000","last_clean":"2024-09-12T19:14:23.391877+0000","last_became_active":"2024-09-12T18:26:41.850001+0000","last_became_peered":"2024-09-12T18:26:41.850001+0000","last_unstale":"2024-09-12T19:14:23.391877+0000","last_undegraded":"2024-09-12T19:14:23.391877+0000","last_fullsized":"2024-09-12T19:14:23.391877+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T19:14:23.391604+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T19:14:23.391604+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.391604+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:22.771625+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2076,"num_read_kb":1992,"num_write":405,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":948,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'352","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.551022+0000","last_change":"2024-09-12T19:14:16.551022+0000","last_active":"2024-09-12T19:14:16.551022+0000","last_peered":"2024-09-12T19:14:16.551022+0000","last_clean":"2024-09-12T19:14:16.551022+0000","last_became_active":"2024-09-12T18:27:11.824331+0000","last_became_peered":"2024-09-12T18:27:11.824331+0000","last_unstale":"2024-09-12T19:14:16.551022+0000","last_undegraded":"2024-09-12T19:14:16.551022+0000","last_fullsized":"2024-09-12T19:14:16.551022+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T19:14:16.550844+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T19:14:16.550844+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.550844+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:58.419343+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":38329,"num_write":1089,"num_write_kb":37388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'500","reported_seq":2055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:09.554528+0000","last_change":"2024-09-12T18:26:41.851231+0000","last_active":"2024-09-12T19:12:09.554528+0000","last_peered":"2024-09-12T19:12:09.554528+0000","last_clean":"2024-09-12T19:12:09.554528+0000","last_became_active":"2024-09-12T18:26:41.850866+0000","last_became_peered":"2024-09-12T18:26:41.850866+0000","last_unstale":"2024-09-12T19:12:09.554528+0000","last_undegraded":"2024-09-12T19:12:09.554528+0000","last_fullsized":"2024-09-12T19:12:09.554528+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2664,"num_read_kb":2487,"num_write":637,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'375","reported_seq":1117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.824067+0000","last_change":"2024-09-12T19:14:17.824067+0000","last_active":"2024-09-12T19:14:17.824067+0000","last_peered":"2024-09-12T19:14:17.824067+0000","last_clean":"2024-09-12T19:14:17.824067+0000","last_became_active":"2024-09-12T18:26:39.870272+0000","last_became_peered":"2024-09-12T18:26:39.870272+0000","last_unstale":"2024-09-12T19:14:17.824067+0000","last_undegraded":"2024-09-12T19:14:17.824067+0000","last_fullsized":"2024-09-12T19:14:17.824067+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T19:14:17.823882+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T19:14:17.823882+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.823882+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:12.604920+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":771,"num_read_kb":17788,"num_write":1173,"num_write_kb":36512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'544","reported_seq":1977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.599400+0000","last_change":"2024-09-12T19:14:16.599400+0000","last_active":"2024-09-12T19:14:16.599400+0000","last_peered":"2024-09-12T19:14:16.599400+0000","last_clean":"2024-09-12T19:14:16.599400+0000","last_became_active":"2024-09-12T18:26:41.865288+0000","last_became_peered":"2024-09-12T18:26:41.865288+0000","last_unstale":"2024-09-12T19:14:16.599400+0000","last_undegraded":"2024-09-12T19:14:16.599400+0000","last_fullsized":"2024-09-12T19:14:16.599400+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'544","last_scrub_stamp":"2024-09-12T19:14:16.599227+0000","last_deep_scrub":"265'544","last_deep_scrub_stamp":"2024-09-12T19:14:16.599227+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.599227+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:43.374177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2721,"num_read_kb":2571,"num_write":759,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'336","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.604868+0000","last_change":"2024-09-12T19:14:15.604868+0000","last_active":"2024-09-12T19:14:15.604868+0000","last_peered":"2024-09-12T19:14:15.604868+0000","last_clean":"2024-09-12T19:14:15.604868+0000","last_became_active":"2024-09-12T18:26:39.851253+0000","last_became_peered":"2024-09-12T18:26:39.851253+0000","last_unstale":"2024-09-12T19:14:15.604868+0000","last_undegraded":"2024-09-12T19:14:15.604868+0000","last_fullsized":"2024-09-12T19:14:15.604868+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T19:14:15.604676+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T19:14:15.604676+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.604676+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:42.167079+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493192,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":31766,"num_write":1103,"num_write_kb":25425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'807","reported_seq":2339,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.105771+0000","last_change":"2024-09-12T18:26:41.852562+0000","last_active":"2024-09-12T19:13:43.105771+0000","last_peered":"2024-09-12T19:13:43.105771+0000","last_clean":"2024-09-12T19:13:43.105771+0000","last_became_active":"2024-09-12T18:26:41.851811+0000","last_became_peered":"2024-09-12T18:26:41.851811+0000","last_unstale":"2024-09-12T19:13:43.105771+0000","last_undegraded":"2024-09-12T19:13:43.105771+0000","last_fullsized":"2024-09-12T19:13:43.105771+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:35:07.152668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3792,"num_read_kb":3404,"num_write":1072,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'361","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.808471+0000","last_change":"2024-09-12T19:14:16.808471+0000","last_active":"2024-09-12T19:14:16.808471+0000","last_peered":"2024-09-12T19:14:16.808471+0000","last_clean":"2024-09-12T19:14:16.808471+0000","last_became_active":"2024-09-12T18:26:39.861529+0000","last_became_peered":"2024-09-12T18:26:39.861529+0000","last_unstale":"2024-09-12T19:14:16.808471+0000","last_undegraded":"2024-09-12T19:14:16.808471+0000","last_fullsized":"2024-09-12T19:14:16.808471+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'361","last_scrub_stamp":"2024-09-12T19:14:16.808282+0000","last_deep_scrub":"265'361","last_deep_scrub_stamp":"2024-09-12T19:14:16.808282+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.808282+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:23.887451+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":30235,"num_write":1160,"num_write_kb":47172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'702","reported_seq":2326,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.343997+0000","last_change":"2024-09-12T19:14:22.343997+0000","last_active":"2024-09-12T19:14:22.343997+0000","last_peered":"2024-09-12T19:14:22.343997+0000","last_clean":"2024-09-12T19:14:22.343997+0000","last_became_active":"2024-09-12T18:26:41.878820+0000","last_became_peered":"2024-09-12T18:26:41.878820+0000","last_unstale":"2024-09-12T19:14:22.343997+0000","last_undegraded":"2024-09-12T19:14:22.343997+0000","last_fullsized":"2024-09-12T19:14:22.343997+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'702","last_scrub_stamp":"2024-09-12T19:14:22.343819+0000","last_deep_scrub":"265'702","last_deep_scrub_stamp":"2024-09-12T19:14:22.343819+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.343819+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:29.298164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3429,"num_read_kb":3073,"num_write":944,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'345","reported_seq":1045,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.978941+0000","last_change":"2024-09-12T19:14:18.978941+0000","last_active":"2024-09-12T19:14:18.978941+0000","last_peered":"2024-09-12T19:14:18.978941+0000","last_clean":"2024-09-12T19:14:18.978941+0000","last_became_active":"2024-09-12T18:27:11.824008+0000","last_became_peered":"2024-09-12T18:27:11.824008+0000","last_unstale":"2024-09-12T19:14:18.978941+0000","last_undegraded":"2024-09-12T19:14:18.978941+0000","last_fullsized":"2024-09-12T19:14:18.978941+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-12T19:14:18.978754+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-12T19:14:18.978754+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.978754+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:11.553698+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":634,"num_read_kb":10155,"num_write":1129,"num_write_kb":30763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'678","reported_seq":2297,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.021352+0000","last_change":"2024-09-12T19:14:13.021352+0000","last_active":"2024-09-12T19:14:13.021352+0000","last_peered":"2024-09-12T19:14:13.021352+0000","last_clean":"2024-09-12T19:14:13.021352+0000","last_became_active":"2024-09-12T18:26:41.854487+0000","last_became_peered":"2024-09-12T18:26:41.854487+0000","last_unstale":"2024-09-12T19:14:13.021352+0000","last_undegraded":"2024-09-12T19:14:13.021352+0000","last_fullsized":"2024-09-12T19:14:13.021352+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'678","last_scrub_stamp":"2024-09-12T19:14:13.021126+0000","last_deep_scrub":"265'678","last_deep_scrub_stamp":"2024-09-12T19:14:13.021126+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.021126+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:16.262713+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3483,"num_read_kb":3149,"num_write":934,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3253,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'464","reported_seq":2077,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.379502+0000","last_change":"2024-09-12T19:14:21.379502+0000","last_active":"2024-09-12T19:14:21.379502+0000","last_peered":"2024-09-12T19:14:21.379502+0000","last_clean":"2024-09-12T19:14:21.379502+0000","last_became_active":"2024-09-12T18:26:41.845080+0000","last_became_peered":"2024-09-12T18:26:41.845080+0000","last_unstale":"2024-09-12T19:14:21.379502+0000","last_undegraded":"2024-09-12T19:14:21.379502+0000","last_fullsized":"2024-09-12T19:14:21.379502+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'464","last_scrub_stamp":"2024-09-12T19:14:21.379327+0000","last_deep_scrub":"265'464","last_deep_scrub_stamp":"2024-09-12T19:14:21.379327+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.379327+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:35.754623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2421,"num_read_kb":2289,"num_write":534,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'377","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.854483+0000","last_change":"2024-09-12T19:14:12.854483+0000","last_active":"2024-09-12T19:14:12.854483+0000","last_peered":"2024-09-12T19:14:12.854483+0000","last_clean":"2024-09-12T19:14:12.854483+0000","last_became_active":"2024-09-12T18:26:39.872936+0000","last_became_peered":"2024-09-12T18:26:39.872936+0000","last_unstale":"2024-09-12T19:14:12.854483+0000","last_undegraded":"2024-09-12T19:14:12.854483+0000","last_fullsized":"2024-09-12T19:14:12.854483+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:14:12.854221+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:14:12.854221+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.854221+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.012669+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":506,"num_read_kb":24957,"num_write":1245,"num_write_kb":33279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'560","reported_seq":2182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.878540+0000","last_change":"2024-09-12T19:14:20.878540+0000","last_active":"2024-09-12T19:14:20.878540+0000","last_peered":"2024-09-12T19:14:20.878540+0000","last_clean":"2024-09-12T19:14:20.878540+0000","last_became_active":"2024-09-12T18:26:41.865247+0000","last_became_peered":"2024-09-12T18:26:41.865247+0000","last_unstale":"2024-09-12T19:14:20.878540+0000","last_undegraded":"2024-09-12T19:14:20.878540+0000","last_fullsized":"2024-09-12T19:14:20.878540+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'560","last_scrub_stamp":"2024-09-12T19:14:20.878338+0000","last_deep_scrub":"265'560","last_deep_scrub_stamp":"2024-09-12T19:14:20.878338+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.878338+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:05.827599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2931,"num_read_kb":2718,"num_write":721,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'407","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.608658+0000","last_change":"2024-09-12T19:14:12.608658+0000","last_active":"2024-09-12T19:14:12.608658+0000","last_peered":"2024-09-12T19:14:12.608658+0000","last_clean":"2024-09-12T19:14:12.608658+0000","last_became_active":"2024-09-12T18:26:39.858964+0000","last_became_peered":"2024-09-12T18:26:39.858964+0000","last_unstale":"2024-09-12T19:14:12.608658+0000","last_undegraded":"2024-09-12T19:14:12.608658+0000","last_fullsized":"2024-09-12T19:14:12.608658+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'407","last_scrub_stamp":"2024-09-12T19:14:12.608446+0000","last_deep_scrub":"265'407","last_deep_scrub_stamp":"2024-09-12T19:14:12.608446+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.608446+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:32.397218+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":810,"num_read_kb":25615,"num_write":1319,"num_write_kb":27961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'829","reported_seq":2320,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.413316+0000","last_change":"2024-09-12T19:14:20.413316+0000","last_active":"2024-09-12T19:14:20.413316+0000","last_peered":"2024-09-12T19:14:20.413316+0000","last_clean":"2024-09-12T19:14:20.413316+0000","last_became_active":"2024-09-12T18:26:41.861762+0000","last_became_peered":"2024-09-12T18:26:41.861762+0000","last_unstale":"2024-09-12T19:14:20.413316+0000","last_undegraded":"2024-09-12T19:14:20.413316+0000","last_fullsized":"2024-09-12T19:14:20.413316+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'829","last_scrub_stamp":"2024-09-12T19:14:20.413148+0000","last_deep_scrub":"265'829","last_deep_scrub_stamp":"2024-09-12T19:14:20.413148+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.413148+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:56.664208+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3868,"num_read_kb":3443,"num_write":1111,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'398","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.589461+0000","last_change":"2024-09-12T19:14:10.589461+0000","last_active":"2024-09-12T19:14:10.589461+0000","last_peered":"2024-09-12T19:14:10.589461+0000","last_clean":"2024-09-12T19:14:10.589461+0000","last_became_active":"2024-09-12T18:26:39.856700+0000","last_became_peered":"2024-09-12T18:26:39.856700+0000","last_unstale":"2024-09-12T19:14:10.589461+0000","last_undegraded":"2024-09-12T19:14:10.589461+0000","last_fullsized":"2024-09-12T19:14:10.589461+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'398","last_scrub_stamp":"2024-09-12T19:14:10.589144+0000","last_deep_scrub":"265'398","last_deep_scrub_stamp":"2024-09-12T19:14:10.589144+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.589144+0000","objects_scrubbed":9,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:43.957851+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632225,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":583,"num_read_kb":29092,"num_write":1242,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'409","reported_seq":1982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.020591+0000","last_change":"2024-09-12T19:14:14.020591+0000","last_active":"2024-09-12T19:14:14.020591+0000","last_peered":"2024-09-12T19:14:14.020591+0000","last_clean":"2024-09-12T19:14:14.020591+0000","last_became_active":"2024-09-12T18:26:41.854687+0000","last_became_peered":"2024-09-12T18:26:41.854687+0000","last_unstale":"2024-09-12T19:14:14.020591+0000","last_undegraded":"2024-09-12T19:14:14.020591+0000","last_fullsized":"2024-09-12T19:14:14.020591+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T19:14:14.020301+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T19:14:14.020301+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.020301+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:02.096125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2203,"num_read_kb":2114,"num_write":459,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'308","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.295484+0000","last_change":"2024-09-12T19:14:09.295484+0000","last_active":"2024-09-12T19:14:09.295484+0000","last_peered":"2024-09-12T19:14:09.295484+0000","last_clean":"2024-09-12T19:14:09.295484+0000","last_became_active":"2024-09-12T18:26:39.845295+0000","last_became_peered":"2024-09-12T18:26:39.845295+0000","last_unstale":"2024-09-12T19:14:09.295484+0000","last_undegraded":"2024-09-12T19:14:09.295484+0000","last_fullsized":"2024-09-12T19:14:09.295484+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'308","last_scrub_stamp":"2024-09-12T19:14:09.295239+0000","last_deep_scrub":"265'308","last_deep_scrub_stamp":"2024-09-12T19:14:09.295239+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.295239+0000","objects_scrubbed":9,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:26.941892+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306760,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":23315,"num_write":964,"num_write_kb":25673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'820","reported_seq":2475,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.067808+0000","last_change":"2024-09-12T19:14:11.067808+0000","last_active":"2024-09-12T19:14:11.067808+0000","last_peered":"2024-09-12T19:14:11.067808+0000","last_clean":"2024-09-12T19:14:11.067808+0000","last_became_active":"2024-09-12T18:26:41.856280+0000","last_became_peered":"2024-09-12T18:26:41.856280+0000","last_unstale":"2024-09-12T19:14:11.067808+0000","last_undegraded":"2024-09-12T19:14:11.067808+0000","last_fullsized":"2024-09-12T19:14:11.067808+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'820","last_scrub_stamp":"2024-09-12T19:14:11.067602+0000","last_deep_scrub":"265'820","last_deep_scrub_stamp":"2024-09-12T19:14:11.067602+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.067602+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:07.191479+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4038,"num_read_kb":3655,"num_write":1078,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1764,"num_omap_keys":7,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'416","reported_seq":1117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.822636+0000","last_change":"2024-09-12T19:14:09.822636+0000","last_active":"2024-09-12T19:14:09.822636+0000","last_peered":"2024-09-12T19:14:09.822636+0000","last_clean":"2024-09-12T19:14:09.822636+0000","last_became_active":"2024-09-12T18:26:39.842159+0000","last_became_peered":"2024-09-12T18:26:39.842159+0000","last_unstale":"2024-09-12T19:14:09.822636+0000","last_undegraded":"2024-09-12T19:14:09.822636+0000","last_fullsized":"2024-09-12T19:14:09.822636+0000","mapping_epoch":24,"log_start":"265'401","ondisk_log_start":"265'401","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'416","last_scrub_stamp":"2024-09-12T19:14:09.822414+0000","last_deep_scrub":"265'416","last_deep_scrub_stamp":"2024-09-12T19:14:09.822414+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.822414+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":401,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:12.755786+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":622,"num_read_kb":58105,"num_write":1270,"num_write_kb":62462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'846","reported_seq":2441,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.379392+0000","last_change":"2024-09-12T19:14:22.379392+0000","last_active":"2024-09-12T19:14:22.379392+0000","last_peered":"2024-09-12T19:14:22.379392+0000","last_clean":"2024-09-12T19:14:22.379392+0000","last_became_active":"2024-09-12T18:26:41.853403+0000","last_became_peered":"2024-09-12T18:26:41.853403+0000","last_unstale":"2024-09-12T19:14:22.379392+0000","last_undegraded":"2024-09-12T19:14:22.379392+0000","last_fullsized":"2024-09-12T19:14:22.379392+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'846","last_scrub_stamp":"2024-09-12T19:14:22.379204+0000","last_deep_scrub":"265'846","last_deep_scrub_stamp":"2024-09-12T19:14:22.379204+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.379204+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:29.289985+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3981,"num_read_kb":3579,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'408","reported_seq":1125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.829466+0000","last_change":"2024-09-12T19:14:07.829466+0000","last_active":"2024-09-12T19:14:07.829466+0000","last_peered":"2024-09-12T19:14:07.829466+0000","last_clean":"2024-09-12T19:14:07.829466+0000","last_became_active":"2024-09-12T18:26:39.834006+0000","last_became_peered":"2024-09-12T18:26:39.834006+0000","last_unstale":"2024-09-12T19:14:07.829466+0000","last_undegraded":"2024-09-12T19:14:07.829466+0000","last_fullsized":"2024-09-12T19:14:07.829466+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'408","last_scrub_stamp":"2024-09-12T19:14:07.829075+0000","last_deep_scrub":"265'408","last_deep_scrub_stamp":"2024-09-12T19:14:07.829075+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.829075+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:01.756044+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":720,"num_read_kb":82742,"num_write":1326,"num_write_kb":55909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'115","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.220116+0000","last_change":"2024-09-12T18:26:49.907310+0000","last_active":"2024-09-12T19:12:24.220116+0000","last_peered":"2024-09-12T19:12:24.220116+0000","last_clean":"2024-09-12T19:12:24.220116+0000","last_became_active":"2024-09-12T18:26:49.906589+0000","last_became_peered":"2024-09-12T18:26:49.906589+0000","last_unstale":"2024-09-12T19:12:24.220116+0000","last_undegraded":"2024-09-12T19:12:24.220116+0000","last_fullsized":"2024-09-12T19:12:24.220116+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:14.519874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":280,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'755","reported_seq":2173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.828743+0000","last_change":"2024-09-12T19:14:11.828743+0000","last_active":"2024-09-12T19:14:11.828743+0000","last_peered":"2024-09-12T19:14:11.828743+0000","last_clean":"2024-09-12T19:14:11.828743+0000","last_became_active":"2024-09-12T18:26:41.852831+0000","last_became_peered":"2024-09-12T18:26:41.852831+0000","last_unstale":"2024-09-12T19:14:11.828743+0000","last_undegraded":"2024-09-12T19:14:11.828743+0000","last_fullsized":"2024-09-12T19:14:11.828743+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'755","last_scrub_stamp":"2024-09-12T19:14:11.828569+0000","last_deep_scrub":"265'755","last_deep_scrub_stamp":"2024-09-12T19:14:11.828569+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.828569+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:38.861938+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3501,"num_read_kb":3138,"num_write":986,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'391","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.849709+0000","last_change":"2024-09-12T19:14:10.849709+0000","last_active":"2024-09-12T19:14:10.849709+0000","last_peered":"2024-09-12T19:14:10.849709+0000","last_clean":"2024-09-12T19:14:10.849709+0000","last_became_active":"2024-09-12T18:27:11.823705+0000","last_became_peered":"2024-09-12T18:27:11.823705+0000","last_unstale":"2024-09-12T19:14:10.849709+0000","last_undegraded":"2024-09-12T19:14:10.849709+0000","last_fullsized":"2024-09-12T19:14:10.849709+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T19:14:10.849514+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T19:14:10.849514+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.849514+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:57.941792+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":587,"num_read_kb":55935,"num_write":1256,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.891991+0000","last_change":"2024-09-12T18:26:43.859139+0000","last_active":"2024-09-12T19:10:13.891991+0000","last_peered":"2024-09-12T19:10:13.891991+0000","last_clean":"2024-09-12T19:10:13.891991+0000","last_became_active":"2024-09-12T18:26:43.857754+0000","last_became_peered":"2024-09-12T18:26:43.857754+0000","last_unstale":"2024-09-12T19:10:13.891991+0000","last_undegraded":"2024-09-12T19:10:13.891991+0000","last_fullsized":"2024-09-12T19:10:13.891991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:47:44.851162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'321","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.680630+0000","last_change":"2024-09-12T19:14:21.680630+0000","last_active":"2024-09-12T19:14:21.680630+0000","last_peered":"2024-09-12T19:14:21.680630+0000","last_clean":"2024-09-12T19:14:21.680630+0000","last_became_active":"2024-09-12T18:26:45.876070+0000","last_became_peered":"2024-09-12T18:26:45.876070+0000","last_unstale":"2024-09-12T19:14:21.680630+0000","last_undegraded":"2024-09-12T19:14:21.680630+0000","last_fullsized":"2024-09-12T19:14:21.680630+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T19:14:21.680429+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T19:14:21.680429+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.680429+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:11.520559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48204,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1086,"num_write":410,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:17.898757+0000","last_change":"2024-09-12T18:26:47.896202+0000","last_active":"2024-09-12T19:10:17.898757+0000","last_peered":"2024-09-12T19:10:17.898757+0000","last_clean":"2024-09-12T19:10:17.898757+0000","last_became_active":"2024-09-12T18:26:47.895471+0000","last_became_peered":"2024-09-12T18:26:47.895471+0000","last_unstale":"2024-09-12T19:10:17.898757+0000","last_undegraded":"2024-09-12T19:10:17.898757+0000","last_fullsized":"2024-09-12T19:10:17.898757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:33.203860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'2440","reported_seq":4321,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.300739+0000","last_change":"2024-09-12T18:26:49.913977+0000","last_active":"2024-09-12T19:12:21.300739+0000","last_peered":"2024-09-12T19:12:21.300739+0000","last_clean":"2024-09-12T19:12:21.300739+0000","last_became_active":"2024-09-12T18:26:49.913125+0000","last_became_peered":"2024-09-12T18:26:49.913125+0000","last_unstale":"2024-09-12T19:12:21.300739+0000","last_undegraded":"2024-09-12T19:12:21.300739+0000","last_fullsized":"2024-09-12T19:12:21.300739+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":2400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:14.099069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6085,"num_read_kb":6089,"num_write":4865,"num_write_kb":1791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'570","reported_seq":2198,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.473163+0000","last_change":"2024-09-12T19:14:18.473163+0000","last_active":"2024-09-12T19:14:18.473163+0000","last_peered":"2024-09-12T19:14:18.473163+0000","last_clean":"2024-09-12T19:14:18.473163+0000","last_became_active":"2024-09-12T18:26:41.871531+0000","last_became_peered":"2024-09-12T18:26:41.871531+0000","last_unstale":"2024-09-12T19:14:18.473163+0000","last_undegraded":"2024-09-12T19:14:18.473163+0000","last_fullsized":"2024-09-12T19:14:18.473163+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'570","last_scrub_stamp":"2024-09-12T19:14:18.472978+0000","last_deep_scrub":"265'570","last_deep_scrub_stamp":"2024-09-12T19:14:18.472978+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.472978+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:22.258961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2964,"num_read_kb":2726,"num_write":725,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3006,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'370","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.853877+0000","last_change":"2024-09-12T19:14:06.853877+0000","last_active":"2024-09-12T19:14:06.853877+0000","last_peered":"2024-09-12T19:14:06.853877+0000","last_clean":"2024-09-12T19:14:06.853877+0000","last_became_active":"2024-09-12T18:26:39.871605+0000","last_became_peered":"2024-09-12T18:26:39.871605+0000","last_unstale":"2024-09-12T19:14:06.853877+0000","last_undegraded":"2024-09-12T19:14:06.853877+0000","last_fullsized":"2024-09-12T19:14:06.853877+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T19:14:06.853744+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T19:14:06.853744+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.853744+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:17.533292+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721310,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":33411,"num_write":1198,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.044317+0000","last_change":"2024-09-12T19:14:22.044317+0000","last_active":"2024-09-12T19:14:22.044317+0000","last_peered":"2024-09-12T19:14:22.044317+0000","last_clean":"2024-09-12T19:14:22.044317+0000","last_became_active":"2024-09-12T18:26:43.865817+0000","last_became_peered":"2024-09-12T18:26:43.865817+0000","last_unstale":"2024-09-12T19:14:22.044317+0000","last_undegraded":"2024-09-12T19:14:22.044317+0000","last_fullsized":"2024-09-12T19:14:22.044317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:22.044143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:22.044143+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.044143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:11.814993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'75","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:11.668505+0000","last_change":"2024-09-12T18:26:45.854845+0000","last_active":"2024-09-12T19:11:11.668505+0000","last_peered":"2024-09-12T19:11:11.668505+0000","last_clean":"2024-09-12T19:11:11.668505+0000","last_became_active":"2024-09-12T18:26:45.854087+0000","last_became_peered":"2024-09-12T18:26:45.854087+0000","last_unstale":"2024-09-12T19:11:11.668505+0000","last_undegraded":"2024-09-12T19:11:11.668505+0000","last_fullsized":"2024-09-12T19:11:11.668505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:33.838948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:19.102590+0000","last_change":"2024-09-12T18:26:47.881155+0000","last_active":"2024-09-12T19:10:19.102590+0000","last_peered":"2024-09-12T19:10:19.102590+0000","last_clean":"2024-09-12T19:10:19.102590+0000","last_became_active":"2024-09-12T18:26:47.880374+0000","last_became_peered":"2024-09-12T18:26:47.880374+0000","last_unstale":"2024-09-12T19:10:19.102590+0000","last_undegraded":"2024-09-12T19:10:19.102590+0000","last_fullsized":"2024-09-12T19:10:19.102590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:40:15.543833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'120","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.194096+0000","last_change":"2024-09-12T18:26:49.927396+0000","last_active":"2024-09-12T19:11:59.194096+0000","last_peered":"2024-09-12T19:11:59.194096+0000","last_clean":"2024-09-12T19:11:59.194096+0000","last_became_active":"2024-09-12T18:26:49.926650+0000","last_became_peered":"2024-09-12T18:26:49.926650+0000","last_unstale":"2024-09-12T19:11:59.194096+0000","last_undegraded":"2024-09-12T19:11:59.194096+0000","last_fullsized":"2024-09-12T19:11:59.194096+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'509","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.773187+0000","last_change":"2024-09-12T19:14:11.773187+0000","last_active":"2024-09-12T19:14:11.773187+0000","last_peered":"2024-09-12T19:14:11.773187+0000","last_clean":"2024-09-12T19:14:11.773187+0000","last_became_active":"2024-09-12T18:26:41.851928+0000","last_became_peered":"2024-09-12T18:26:41.851928+0000","last_unstale":"2024-09-12T19:14:11.773187+0000","last_undegraded":"2024-09-12T19:14:11.773187+0000","last_fullsized":"2024-09-12T19:14:11.773187+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'509","last_scrub_stamp":"2024-09-12T19:14:11.773008+0000","last_deep_scrub":"265'509","last_deep_scrub_stamp":"2024-09-12T19:14:11.773008+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.773008+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:15.496861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2649,"num_read_kb":2492,"num_write":594,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'375","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.825389+0000","last_change":"2024-09-12T19:14:15.825389+0000","last_active":"2024-09-12T19:14:15.825389+0000","last_peered":"2024-09-12T19:14:15.825389+0000","last_clean":"2024-09-12T19:14:15.825389+0000","last_became_active":"2024-09-12T18:26:39.863389+0000","last_became_peered":"2024-09-12T18:26:39.863389+0000","last_unstale":"2024-09-12T19:14:15.825389+0000","last_undegraded":"2024-09-12T19:14:15.825389+0000","last_fullsized":"2024-09-12T19:14:15.825389+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T19:14:15.825196+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T19:14:15.825196+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.825196+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:32.797512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":529,"num_read_kb":22645,"num_write":1125,"num_write_kb":31309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.916104+0000","last_change":"2024-09-12T18:26:43.855208+0000","last_active":"2024-09-12T19:10:13.916104+0000","last_peered":"2024-09-12T19:10:13.916104+0000","last_clean":"2024-09-12T19:10:13.916104+0000","last_became_active":"2024-09-12T18:26:43.853736+0000","last_became_peered":"2024-09-12T18:26:43.853736+0000","last_unstale":"2024-09-12T19:10:13.916104+0000","last_undegraded":"2024-09-12T19:10:13.916104+0000","last_fullsized":"2024-09-12T19:10:13.916104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:26.483694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'118","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.965708+0000","last_change":"2024-09-12T19:14:21.965708+0000","last_active":"2024-09-12T19:14:21.965708+0000","last_peered":"2024-09-12T19:14:21.965708+0000","last_clean":"2024-09-12T19:14:21.965708+0000","last_became_active":"2024-09-12T18:26:45.853143+0000","last_became_peered":"2024-09-12T18:26:45.853143+0000","last_unstale":"2024-09-12T19:14:21.965708+0000","last_undegraded":"2024-09-12T19:14:21.965708+0000","last_fullsized":"2024-09-12T19:14:21.965708+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T19:14:21.965574+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T19:14:21.965574+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.965574+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:04.870883+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'764","reported_seq":4110,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.252054+0000","last_change":"2024-09-12T18:26:47.895745+0000","last_active":"2024-09-12T19:13:58.252054+0000","last_peered":"2024-09-12T19:13:58.252054+0000","last_clean":"2024-09-12T19:13:58.252054+0000","last_became_active":"2024-09-12T18:26:47.895056+0000","last_became_peered":"2024-09-12T18:26:47.895056+0000","last_unstale":"2024-09-12T19:13:58.252054+0000","last_undegraded":"2024-09-12T19:13:58.252054+0000","last_fullsized":"2024-09-12T19:13:58.252054+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":702,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:09:33.762580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'174","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.003639+0000","last_change":"2024-09-12T18:26:49.890859+0000","last_active":"2024-09-12T19:13:44.003639+0000","last_peered":"2024-09-12T19:13:44.003639+0000","last_clean":"2024-09-12T19:13:44.003639+0000","last_became_active":"2024-09-12T18:26:49.890325+0000","last_became_peered":"2024-09-12T18:26:49.890325+0000","last_unstale":"2024-09-12T19:13:44.003639+0000","last_undegraded":"2024-09-12T19:13:44.003639+0000","last_fullsized":"2024-09-12T19:13:44.003639+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":638,"num_write":360,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'756","reported_seq":2316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.795472+0000","last_change":"2024-09-12T19:14:10.795472+0000","last_active":"2024-09-12T19:14:10.795472+0000","last_peered":"2024-09-12T19:14:10.795472+0000","last_clean":"2024-09-12T19:14:10.795472+0000","last_became_active":"2024-09-12T18:26:41.862240+0000","last_became_peered":"2024-09-12T18:26:41.862240+0000","last_unstale":"2024-09-12T19:14:10.795472+0000","last_undegraded":"2024-09-12T19:14:10.795472+0000","last_fullsized":"2024-09-12T19:14:10.795472+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'756","last_scrub_stamp":"2024-09-12T19:14:10.795293+0000","last_deep_scrub":"265'756","last_deep_scrub_stamp":"2024-09-12T19:14:10.795293+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.795293+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:49.343521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3627,"num_read_kb":3298,"num_write":982,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'333","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.459163+0000","last_change":"2024-09-12T19:14:05.459163+0000","last_active":"2024-09-12T19:14:05.459163+0000","last_peered":"2024-09-12T19:14:05.459163+0000","last_clean":"2024-09-12T19:14:05.459163+0000","last_became_active":"2024-09-12T18:26:39.843351+0000","last_became_peered":"2024-09-12T18:26:39.843351+0000","last_unstale":"2024-09-12T19:14:05.459163+0000","last_undegraded":"2024-09-12T19:14:05.459163+0000","last_fullsized":"2024-09-12T19:14:05.459163+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T19:14:05.458982+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T19:14:05.458982+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.458982+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:06.506600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170084,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":20705,"num_write":1033,"num_write_kb":27627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.892087+0000","last_change":"2024-09-12T18:26:43.843098+0000","last_active":"2024-09-12T19:10:13.892087+0000","last_peered":"2024-09-12T19:10:13.892087+0000","last_clean":"2024-09-12T19:10:13.892087+0000","last_became_active":"2024-09-12T18:26:43.842479+0000","last_became_peered":"2024-09-12T18:26:43.842479+0000","last_unstale":"2024-09-12T19:10:13.892087+0000","last_undegraded":"2024-09-12T19:10:13.892087+0000","last_fullsized":"2024-09-12T19:10:13.892087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:07.573346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'285","reported_seq":848,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.359667+0000","last_change":"2024-09-12T18:26:46.025157+0000","last_active":"2024-09-12T19:13:58.359667+0000","last_peered":"2024-09-12T19:13:58.359667+0000","last_clean":"2024-09-12T19:13:58.359667+0000","last_became_active":"2024-09-12T18:26:46.024425+0000","last_became_peered":"2024-09-12T18:26:46.024425+0000","last_unstale":"2024-09-12T19:13:58.359667+0000","last_undegraded":"2024-09-12T19:13:58.359667+0000","last_fullsized":"2024-09-12T19:13:58.359667+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:13.803848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53269,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1121,"num_write":396,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'804","reported_seq":2367,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.847619+0000","last_change":"2024-09-12T18:26:47.899579+0000","last_active":"2024-09-12T19:13:56.847619+0000","last_peered":"2024-09-12T19:13:56.847619+0000","last_clean":"2024-09-12T19:13:56.847619+0000","last_became_active":"2024-09-12T18:26:47.898903+0000","last_became_peered":"2024-09-12T18:26:47.898903+0000","last_unstale":"2024-09-12T19:13:56.847619+0000","last_undegraded":"2024-09-12T19:13:56.847619+0000","last_fullsized":"2024-09-12T19:13:56.847619+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":700,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:43.604475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'763","reported_seq":2259,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.517406+0000","last_change":"2024-09-12T19:14:17.517243+0000","last_active":"2024-09-12T19:14:17.517406+0000","last_peered":"2024-09-12T19:14:17.517406+0000","last_clean":"2024-09-12T19:14:17.517406+0000","last_became_active":"2024-09-12T18:26:41.869852+0000","last_became_peered":"2024-09-12T18:26:41.869852+0000","last_unstale":"2024-09-12T19:14:17.517406+0000","last_undegraded":"2024-09-12T19:14:17.517406+0000","last_fullsized":"2024-09-12T19:14:17.517406+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'763","last_scrub_stamp":"2024-09-12T19:14:17.517055+0000","last_deep_scrub":"265'763","last_deep_scrub_stamp":"2024-09-12T19:14:17.517055+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.517055+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:12.395779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3529,"num_read_kb":3192,"num_write":1004,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'488","reported_seq":1218,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.860766+0000","last_change":"2024-09-12T19:14:07.860628+0000","last_active":"2024-09-12T19:14:07.860766+0000","last_peered":"2024-09-12T19:14:07.860766+0000","last_clean":"2024-09-12T19:14:07.860766+0000","last_became_active":"2024-09-12T18:26:39.873512+0000","last_became_peered":"2024-09-12T18:26:39.873512+0000","last_unstale":"2024-09-12T19:14:07.860766+0000","last_undegraded":"2024-09-12T19:14:07.860766+0000","last_fullsized":"2024-09-12T19:14:07.860766+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'488","last_scrub_stamp":"2024-09-12T19:14:07.860425+0000","last_deep_scrub":"265'488","last_deep_scrub_stamp":"2024-09-12T19:14:07.860425+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.860425+0000","objects_scrubbed":9,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:17.144835+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4719716,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":925,"num_read_kb":13008,"num_write":1544,"num_write_kb":39306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.895938+0000","last_change":"2024-09-12T18:26:43.871922+0000","last_active":"2024-09-12T19:10:07.895938+0000","last_peered":"2024-09-12T19:10:07.895938+0000","last_clean":"2024-09-12T19:10:07.895938+0000","last_became_active":"2024-09-12T18:26:43.871192+0000","last_became_peered":"2024-09-12T18:26:43.871192+0000","last_unstale":"2024-09-12T19:10:07.895938+0000","last_undegraded":"2024-09-12T19:10:07.895938+0000","last_fullsized":"2024-09-12T19:10:07.895938+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:26.666887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'365","reported_seq":971,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.435863+0000","last_change":"2024-09-12T18:26:46.021987+0000","last_active":"2024-09-12T19:13:57.435863+0000","last_peered":"2024-09-12T19:13:57.435863+0000","last_clean":"2024-09-12T19:13:57.435863+0000","last_became_active":"2024-09-12T18:26:46.021239+0000","last_became_peered":"2024-09-12T18:26:46.021239+0000","last_unstale":"2024-09-12T19:13:57.435863+0000","last_undegraded":"2024-09-12T19:13:57.435863+0000","last_fullsized":"2024-09-12T19:13:57.435863+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:47:16.999506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43291,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":581,"num_read_kb":1196,"num_write":460,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:47.719815+0000","last_change":"2024-09-12T18:26:47.879784+0000","last_active":"2024-09-12T19:11:47.719815+0000","last_peered":"2024-09-12T19:11:47.719815+0000","last_clean":"2024-09-12T19:11:47.719815+0000","last_became_active":"2024-09-12T18:26:47.879079+0000","last_became_peered":"2024-09-12T18:26:47.879079+0000","last_unstale":"2024-09-12T19:11:47.719815+0000","last_undegraded":"2024-09-12T19:11:47.719815+0000","last_fullsized":"2024-09-12T19:11:47.719815+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'551","reported_seq":1359,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.001450+0000","last_change":"2024-09-12T18:26:49.913788+0000","last_active":"2024-09-12T19:13:44.001450+0000","last_peered":"2024-09-12T19:13:44.001450+0000","last_clean":"2024-09-12T19:13:44.001450+0000","last_became_active":"2024-09-12T18:26:49.913115+0000","last_became_peered":"2024-09-12T18:26:49.913115+0000","last_unstale":"2024-09-12T19:13:44.001450+0000","last_undegraded":"2024-09-12T19:13:44.001450+0000","last_fullsized":"2024-09-12T19:13:44.001450+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:49.514569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1285,"num_write":1159,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'406","reported_seq":1997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.255176+0000","last_change":"2024-09-12T19:14:11.255011+0000","last_active":"2024-09-12T19:14:11.255176+0000","last_peered":"2024-09-12T19:14:11.255176+0000","last_clean":"2024-09-12T19:14:11.255176+0000","last_became_active":"2024-09-12T18:26:41.854391+0000","last_became_peered":"2024-09-12T18:26:41.854391+0000","last_unstale":"2024-09-12T19:14:11.255176+0000","last_undegraded":"2024-09-12T19:14:11.255176+0000","last_fullsized":"2024-09-12T19:14:11.255176+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'406","last_scrub_stamp":"2024-09-12T19:14:11.254823+0000","last_deep_scrub":"265'406","last_deep_scrub_stamp":"2024-09-12T19:14:11.254823+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.254823+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:18.934488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2438,"num_read_kb":2340,"num_write":450,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'324","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.838638+0000","last_change":"2024-09-12T19:14:14.838638+0000","last_active":"2024-09-12T19:14:14.838638+0000","last_peered":"2024-09-12T19:14:14.838638+0000","last_clean":"2024-09-12T19:14:14.838638+0000","last_became_active":"2024-09-12T18:26:39.870641+0000","last_became_peered":"2024-09-12T18:26:39.870641+0000","last_unstale":"2024-09-12T19:14:14.838638+0000","last_undegraded":"2024-09-12T19:14:14.838638+0000","last_fullsized":"2024-09-12T19:14:14.838638+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T19:14:14.838413+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T19:14:14.838413+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.838413+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:05.370907+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":414,"num_read_kb":1418,"num_write":1020,"num_write_kb":24682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.038768+0000","last_change":"2024-09-12T19:14:16.038622+0000","last_active":"2024-09-12T19:14:16.038768+0000","last_peered":"2024-09-12T19:14:16.038768+0000","last_clean":"2024-09-12T19:14:16.038768+0000","last_became_active":"2024-09-12T18:26:43.853212+0000","last_became_peered":"2024-09-12T18:26:43.853212+0000","last_unstale":"2024-09-12T19:14:16.038768+0000","last_undegraded":"2024-09-12T19:14:16.038768+0000","last_fullsized":"2024-09-12T19:14:16.038768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:16.038447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:16.038447+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.038447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:19.209452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'264","reported_seq":832,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.006631+0000","last_change":"2024-09-12T18:26:45.866790+0000","last_active":"2024-09-12T19:13:58.006631+0000","last_peered":"2024-09-12T19:13:58.006631+0000","last_clean":"2024-09-12T19:13:58.006631+0000","last_became_active":"2024-09-12T18:26:45.865933+0000","last_became_peered":"2024-09-12T18:26:45.865933+0000","last_unstale":"2024-09-12T19:13:58.006631+0000","last_undegraded":"2024-09-12T19:13:58.006631+0000","last_fullsized":"2024-09-12T19:13:58.006631+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":1093,"num_write":368,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:13.915818+0000","last_change":"2024-09-12T18:26:47.898805+0000","last_active":"2024-09-12T19:10:13.915818+0000","last_peered":"2024-09-12T19:10:13.915818+0000","last_clean":"2024-09-12T19:10:13.915818+0000","last_became_active":"2024-09-12T18:26:47.898056+0000","last_became_peered":"2024-09-12T18:26:47.898056+0000","last_unstale":"2024-09-12T19:10:13.915818+0000","last_undegraded":"2024-09-12T19:10:13.915818+0000","last_fullsized":"2024-09-12T19:10:13.915818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:11:01.722126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'128","reported_seq":621,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:53.928598+0000","last_change":"2024-09-12T18:26:49.914410+0000","last_active":"2024-09-12T19:12:53.928598+0000","last_peered":"2024-09-12T19:12:53.928598+0000","last_clean":"2024-09-12T19:12:53.928598+0000","last_became_active":"2024-09-12T18:26:49.913180+0000","last_became_peered":"2024-09-12T18:26:49.913180+0000","last_unstale":"2024-09-12T19:12:53.928598+0000","last_undegraded":"2024-09-12T19:12:53.928598+0000","last_fullsized":"2024-09-12T19:12:53.928598+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:31.008311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'516","reported_seq":2068,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.593883+0000","last_change":"2024-09-12T19:14:17.593883+0000","last_active":"2024-09-12T19:14:17.593883+0000","last_peered":"2024-09-12T19:14:17.593883+0000","last_clean":"2024-09-12T19:14:17.593883+0000","last_became_active":"2024-09-12T18:26:41.873229+0000","last_became_peered":"2024-09-12T18:26:41.873229+0000","last_unstale":"2024-09-12T19:14:17.593883+0000","last_undegraded":"2024-09-12T19:14:17.593883+0000","last_fullsized":"2024-09-12T19:14:17.593883+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'516","last_scrub_stamp":"2024-09-12T19:14:17.593701+0000","last_deep_scrub":"265'516","last_deep_scrub_stamp":"2024-09-12T19:14:17.593701+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.593701+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:37.476864+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2942,"num_read_kb":2741,"num_write":656,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'373","reported_seq":1160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.839637+0000","last_change":"2024-09-12T19:14:06.839637+0000","last_active":"2024-09-12T19:14:06.839637+0000","last_peered":"2024-09-12T19:14:06.839637+0000","last_clean":"2024-09-12T19:14:06.839637+0000","last_became_active":"2024-09-12T18:26:39.865148+0000","last_became_peered":"2024-09-12T18:26:39.865148+0000","last_unstale":"2024-09-12T19:14:06.839637+0000","last_undegraded":"2024-09-12T19:14:06.839637+0000","last_fullsized":"2024-09-12T19:14:06.839637+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T19:14:06.839379+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T19:14:06.839379+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.839379+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:03.080191+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":883,"num_read_kb":25450,"num_write":1078,"num_write_kb":40926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.978124+0000","last_change":"2024-09-12T19:14:17.978124+0000","last_active":"2024-09-12T19:14:17.978124+0000","last_peered":"2024-09-12T19:14:17.978124+0000","last_clean":"2024-09-12T19:14:17.978124+0000","last_became_active":"2024-09-12T18:26:43.853084+0000","last_became_peered":"2024-09-12T18:26:43.853084+0000","last_unstale":"2024-09-12T19:14:17.978124+0000","last_undegraded":"2024-09-12T19:14:17.978124+0000","last_fullsized":"2024-09-12T19:14:17.978124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:17.977941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:17.977941+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.977941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:53.773804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'307","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.556756+0000","last_change":"2024-09-12T18:26:45.867127+0000","last_active":"2024-09-12T19:13:57.556756+0000","last_peered":"2024-09-12T19:13:57.556756+0000","last_clean":"2024-09-12T19:13:57.556756+0000","last_became_active":"2024-09-12T18:26:45.866325+0000","last_became_peered":"2024-09-12T18:26:45.866325+0000","last_unstale":"2024-09-12T19:13:57.556756+0000","last_undegraded":"2024-09-12T19:13:57.556756+0000","last_fullsized":"2024-09-12T19:13:57.556756+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:36:45.228994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64639,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":1214,"num_write":426,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'792","reported_seq":2650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.027906+0000","last_change":"2024-09-12T18:26:47.879674+0000","last_active":"2024-09-12T19:13:58.027906+0000","last_peered":"2024-09-12T19:13:58.027906+0000","last_clean":"2024-09-12T19:13:58.027906+0000","last_became_active":"2024-09-12T18:26:47.878956+0000","last_became_peered":"2024-09-12T18:26:47.878956+0000","last_unstale":"2024-09-12T19:13:58.027906+0000","last_undegraded":"2024-09-12T19:13:58.027906+0000","last_fullsized":"2024-09-12T19:13:58.027906+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":700,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:56.898695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'146","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.017181+0000","last_change":"2024-09-12T18:26:49.927113+0000","last_active":"2024-09-12T19:13:43.017181+0000","last_peered":"2024-09-12T19:13:43.017181+0000","last_clean":"2024-09-12T19:13:43.017181+0000","last_became_active":"2024-09-12T18:26:49.926384+0000","last_became_peered":"2024-09-12T18:26:49.926384+0000","last_unstale":"2024-09-12T19:13:43.017181+0000","last_undegraded":"2024-09-12T19:13:43.017181+0000","last_fullsized":"2024-09-12T19:13:43.017181+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:14.787817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":361,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'694","reported_seq":2115,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.893516+0000","last_change":"2024-09-12T18:26:41.846934+0000","last_active":"2024-09-12T19:12:07.893516+0000","last_peered":"2024-09-12T19:12:07.893516+0000","last_clean":"2024-09-12T19:12:07.893516+0000","last_became_active":"2024-09-12T18:26:41.846589+0000","last_became_peered":"2024-09-12T18:26:41.846589+0000","last_unstale":"2024-09-12T19:12:07.893516+0000","last_undegraded":"2024-09-12T19:12:07.893516+0000","last_fullsized":"2024-09-12T19:12:07.893516+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":600,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:35.741190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3315,"num_read_kb":3003,"num_write":914,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'320","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.671103+0000","last_change":"2024-09-12T19:14:13.671103+0000","last_active":"2024-09-12T19:14:13.671103+0000","last_peered":"2024-09-12T19:14:13.671103+0000","last_clean":"2024-09-12T19:14:13.671103+0000","last_became_active":"2024-09-12T18:26:39.849950+0000","last_became_peered":"2024-09-12T18:26:39.849950+0000","last_unstale":"2024-09-12T19:14:13.671103+0000","last_undegraded":"2024-09-12T19:14:13.671103+0000","last_fullsized":"2024-09-12T19:14:13.671103+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-12T19:14:13.670923+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-12T19:14:13.670923+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.670923+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:21.214840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67871,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":33808,"num_write":1047,"num_write_kb":22667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.020705+0000","last_change":"2024-09-12T19:14:17.020705+0000","last_active":"2024-09-12T19:14:17.020705+0000","last_peered":"2024-09-12T19:14:17.020705+0000","last_clean":"2024-09-12T19:14:17.020705+0000","last_became_active":"2024-09-12T18:26:43.874837+0000","last_became_peered":"2024-09-12T18:26:43.874837+0000","last_unstale":"2024-09-12T19:14:17.020705+0000","last_undegraded":"2024-09-12T19:14:17.020705+0000","last_fullsized":"2024-09-12T19:14:17.020705+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:17.020520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:17.020520+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.020520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:48.881506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'463","reported_seq":1103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.750004+0000","last_change":"2024-09-12T19:14:18.750004+0000","last_active":"2024-09-12T19:14:18.750004+0000","last_peered":"2024-09-12T19:14:18.750004+0000","last_clean":"2024-09-12T19:14:18.750004+0000","last_became_active":"2024-09-12T18:26:45.875223+0000","last_became_peered":"2024-09-12T18:26:45.875223+0000","last_unstale":"2024-09-12T19:14:18.750004+0000","last_undegraded":"2024-09-12T19:14:18.750004+0000","last_fullsized":"2024-09-12T19:14:18.750004+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'463","last_scrub_stamp":"2024-09-12T19:14:18.749757+0000","last_deep_scrub":"265'463","last_deep_scrub_stamp":"2024-09-12T19:14:18.749757+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.749757+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:18.294446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89882,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":808,"num_read_kb":1944,"num_write":662,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.919044+0000","last_change":"2024-09-12T19:14:22.919044+0000","last_active":"2024-09-12T19:14:22.919044+0000","last_peered":"2024-09-12T19:14:22.919044+0000","last_clean":"2024-09-12T19:14:22.919044+0000","last_became_active":"2024-09-12T18:26:47.891736+0000","last_became_peered":"2024-09-12T18:26:47.891736+0000","last_unstale":"2024-09-12T19:14:22.919044+0000","last_undegraded":"2024-09-12T19:14:22.919044+0000","last_fullsized":"2024-09-12T19:14:22.919044+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:22.918866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:22.918866+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.918866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:26.902442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'131","reported_seq":654,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:19.312995+0000","last_change":"2024-09-12T18:26:49.905418+0000","last_active":"2024-09-12T19:10:19.312995+0000","last_peered":"2024-09-12T19:10:19.312995+0000","last_clean":"2024-09-12T19:10:19.312995+0000","last_became_active":"2024-09-12T18:26:49.904633+0000","last_became_peered":"2024-09-12T18:26:49.904633+0000","last_unstale":"2024-09-12T19:10:19.312995+0000","last_undegraded":"2024-09-12T19:10:19.312995+0000","last_fullsized":"2024-09-12T19:10:19.312995+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:49.072537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":176,"num_write":324,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'686","reported_seq":2227,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.254200+0000","last_change":"2024-09-12T19:14:10.254200+0000","last_active":"2024-09-12T19:14:10.254200+0000","last_peered":"2024-09-12T19:14:10.254200+0000","last_clean":"2024-09-12T19:14:10.254200+0000","last_became_active":"2024-09-12T18:26:41.852958+0000","last_became_peered":"2024-09-12T18:26:41.852958+0000","last_unstale":"2024-09-12T19:14:10.254200+0000","last_undegraded":"2024-09-12T19:14:10.254200+0000","last_fullsized":"2024-09-12T19:14:10.254200+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'686","last_scrub_stamp":"2024-09-12T19:14:10.253985+0000","last_deep_scrub":"265'686","last_deep_scrub_stamp":"2024-09-12T19:14:10.253985+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.253985+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:57.088986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3047,"num_write":870,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'348","reported_seq":1026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.823078+0000","last_change":"2024-09-12T19:14:07.823078+0000","last_active":"2024-09-12T19:14:07.823078+0000","last_peered":"2024-09-12T19:14:07.823078+0000","last_clean":"2024-09-12T19:14:07.823078+0000","last_became_active":"2024-09-12T18:26:39.842671+0000","last_became_peered":"2024-09-12T18:26:39.842671+0000","last_unstale":"2024-09-12T19:14:07.823078+0000","last_undegraded":"2024-09-12T19:14:07.823078+0000","last_fullsized":"2024-09-12T19:14:07.823078+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T19:14:07.822813+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T19:14:07.822813+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.822813+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:55.357796+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1239003,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":38368,"num_write":1135,"num_write_kb":24127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.990290+0000","last_change":"2024-09-12T19:14:18.990290+0000","last_active":"2024-09-12T19:14:18.990290+0000","last_peered":"2024-09-12T19:14:18.990290+0000","last_clean":"2024-09-12T19:14:18.990290+0000","last_became_active":"2024-09-12T18:26:43.863615+0000","last_became_peered":"2024-09-12T18:26:43.863615+0000","last_unstale":"2024-09-12T19:14:18.990290+0000","last_undegraded":"2024-09-12T19:14:18.990290+0000","last_fullsized":"2024-09-12T19:14:18.990290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:18.990106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:18.990106+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.990106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:09.209296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'293","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.158035+0000","last_change":"2024-09-12T18:26:45.865043+0000","last_active":"2024-09-12T19:13:58.158035+0000","last_peered":"2024-09-12T19:13:58.158035+0000","last_clean":"2024-09-12T19:13:58.158035+0000","last_became_active":"2024-09-12T18:26:45.864308+0000","last_became_peered":"2024-09-12T18:26:45.864308+0000","last_unstale":"2024-09-12T19:13:58.158035+0000","last_undegraded":"2024-09-12T19:13:58.158035+0000","last_fullsized":"2024-09-12T19:13:58.158035+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1125,"num_write":460,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.944645+0000","last_change":"2024-09-12T18:26:47.904622+0000","last_active":"2024-09-12T19:11:58.944645+0000","last_peered":"2024-09-12T19:11:58.944645+0000","last_clean":"2024-09-12T19:11:58.944645+0000","last_became_active":"2024-09-12T18:26:47.903984+0000","last_became_peered":"2024-09-12T18:26:47.903984+0000","last_unstale":"2024-09-12T19:11:58.944645+0000","last_undegraded":"2024-09-12T19:11:58.944645+0000","last_fullsized":"2024-09-12T19:11:58.944645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'130","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:03.733674+0000","last_change":"2024-09-12T18:26:49.917735+0000","last_active":"2024-09-12T19:13:03.733674+0000","last_peered":"2024-09-12T19:13:03.733674+0000","last_clean":"2024-09-12T19:13:03.733674+0000","last_became_active":"2024-09-12T18:26:49.916255+0000","last_became_peered":"2024-09-12T18:26:49.916255+0000","last_unstale":"2024-09-12T19:13:03.733674+0000","last_undegraded":"2024-09-12T19:13:03.733674+0000","last_fullsized":"2024-09-12T19:13:03.733674+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:05.827351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":172,"num_read_kb":153,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'482","reported_seq":2167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.282073+0000","last_change":"2024-09-12T19:14:14.282073+0000","last_active":"2024-09-12T19:14:14.282073+0000","last_peered":"2024-09-12T19:14:14.282073+0000","last_clean":"2024-09-12T19:14:14.282073+0000","last_became_active":"2024-09-12T18:26:41.851789+0000","last_became_peered":"2024-09-12T18:26:41.851789+0000","last_unstale":"2024-09-12T19:14:14.282073+0000","last_undegraded":"2024-09-12T19:14:14.282073+0000","last_fullsized":"2024-09-12T19:14:14.282073+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'482","last_scrub_stamp":"2024-09-12T19:14:14.281887+0000","last_deep_scrub":"265'482","last_deep_scrub_stamp":"2024-09-12T19:14:14.281887+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.281887+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:45.318532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2754,"num_read_kb":2601,"num_write":570,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'400","reported_seq":1058,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.540889+0000","last_change":"2024-09-12T19:14:08.540889+0000","last_active":"2024-09-12T19:14:08.540889+0000","last_peered":"2024-09-12T19:14:08.540889+0000","last_clean":"2024-09-12T19:14:08.540889+0000","last_became_active":"2024-09-12T18:26:39.849392+0000","last_became_peered":"2024-09-12T18:26:39.849392+0000","last_unstale":"2024-09-12T19:14:08.540889+0000","last_undegraded":"2024-09-12T19:14:08.540889+0000","last_fullsized":"2024-09-12T19:14:08.540889+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'400","last_scrub_stamp":"2024-09-12T19:14:08.540659+0000","last_deep_scrub":"265'400","last_deep_scrub_stamp":"2024-09-12T19:14:08.540659+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.540659+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:17.495615+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568421,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":663,"num_read_kb":7425,"num_write":1171,"num_write_kb":13361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:47.719873+0000","last_change":"2024-09-12T18:26:43.877842+0000","last_active":"2024-09-12T19:11:47.719873+0000","last_peered":"2024-09-12T19:11:47.719873+0000","last_clean":"2024-09-12T19:11:47.719873+0000","last_became_active":"2024-09-12T18:26:43.877257+0000","last_became_peered":"2024-09-12T18:26:43.877257+0000","last_unstale":"2024-09-12T19:11:47.719873+0000","last_undegraded":"2024-09-12T19:11:47.719873+0000","last_fullsized":"2024-09-12T19:11:47.719873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'294","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.969182+0000","last_change":"2024-09-12T19:14:19.969182+0000","last_active":"2024-09-12T19:14:19.969182+0000","last_peered":"2024-09-12T19:14:19.969182+0000","last_clean":"2024-09-12T19:14:19.969182+0000","last_became_active":"2024-09-12T18:26:45.861947+0000","last_became_peered":"2024-09-12T18:26:45.861947+0000","last_unstale":"2024-09-12T19:14:19.969182+0000","last_undegraded":"2024-09-12T19:14:19.969182+0000","last_fullsized":"2024-09-12T19:14:19.969182+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T19:14:19.968867+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T19:14:19.968867+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.968867+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:54.486748+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50433,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":477,"num_read_kb":1052,"num_write":380,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'756","reported_seq":2389,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.932810+0000","last_change":"2024-09-12T19:14:20.932810+0000","last_active":"2024-09-12T19:14:20.932810+0000","last_peered":"2024-09-12T19:14:20.932810+0000","last_clean":"2024-09-12T19:14:20.932810+0000","last_became_active":"2024-09-12T18:26:47.880400+0000","last_became_peered":"2024-09-12T18:26:47.880400+0000","last_unstale":"2024-09-12T19:14:20.932810+0000","last_undegraded":"2024-09-12T19:14:20.932810+0000","last_fullsized":"2024-09-12T19:14:20.932810+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'756","last_scrub_stamp":"2024-09-12T19:14:20.932627+0000","last_deep_scrub":"265'756","last_deep_scrub_stamp":"2024-09-12T19:14:20.932627+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.932627+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:26.073326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'139","reported_seq":636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:06.307338+0000","last_change":"2024-09-12T18:26:49.914558+0000","last_active":"2024-09-12T19:11:06.307338+0000","last_peered":"2024-09-12T19:11:06.307338+0000","last_clean":"2024-09-12T19:11:06.307338+0000","last_became_active":"2024-09-12T18:26:49.913762+0000","last_became_peered":"2024-09-12T18:26:49.913762+0000","last_unstale":"2024-09-12T19:11:06.307338+0000","last_undegraded":"2024-09-12T19:11:06.307338+0000","last_fullsized":"2024-09-12T19:11:06.307338+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:09.188110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":330,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'795","reported_seq":2371,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.242878+0000","last_change":"2024-09-12T19:14:12.242878+0000","last_active":"2024-09-12T19:14:12.242878+0000","last_peered":"2024-09-12T19:14:12.242878+0000","last_clean":"2024-09-12T19:14:12.242878+0000","last_became_active":"2024-09-12T18:26:41.866528+0000","last_became_peered":"2024-09-12T18:26:41.866528+0000","last_unstale":"2024-09-12T19:14:12.242878+0000","last_undegraded":"2024-09-12T19:14:12.242878+0000","last_fullsized":"2024-09-12T19:14:12.242878+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'795","last_scrub_stamp":"2024-09-12T19:14:12.242691+0000","last_deep_scrub":"265'795","last_deep_scrub_stamp":"2024-09-12T19:14:12.242691+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.242691+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:57.776142+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3788,"num_read_kb":3420,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'343","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.298428+0000","last_change":"2024-09-12T19:14:07.298219+0000","last_active":"2024-09-12T19:14:07.298428+0000","last_peered":"2024-09-12T19:14:07.298428+0000","last_clean":"2024-09-12T19:14:07.298428+0000","last_became_active":"2024-09-12T18:26:39.839762+0000","last_became_peered":"2024-09-12T18:26:39.839762+0000","last_unstale":"2024-09-12T19:14:07.298428+0000","last_undegraded":"2024-09-12T19:14:07.298428+0000","last_fullsized":"2024-09-12T19:14:07.298428+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:14:07.298004+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:14:07.298004+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.298004+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:50.827849+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1967405,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":414,"num_read_kb":30496,"num_write":1045,"num_write_kb":26286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1448,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.818671+0000","last_change":"2024-09-12T18:26:43.862723+0000","last_active":"2024-09-12T19:13:56.818671+0000","last_peered":"2024-09-12T19:13:56.818671+0000","last_clean":"2024-09-12T19:13:56.818671+0000","last_became_active":"2024-09-12T18:26:43.861969+0000","last_became_peered":"2024-09-12T18:26:43.861969+0000","last_unstale":"2024-09-12T19:13:56.818671+0000","last_undegraded":"2024-09-12T19:13:56.818671+0000","last_fullsized":"2024-09-12T19:13:56.818671+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'77","reported_seq":594,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.125814+0000","last_change":"2024-09-12T18:26:46.020701+0000","last_active":"2024-09-12T19:13:43.125814+0000","last_peered":"2024-09-12T19:13:43.125814+0000","last_clean":"2024-09-12T19:13:43.125814+0000","last_became_active":"2024-09-12T18:26:46.019895+0000","last_became_peered":"2024-09-12T18:26:46.019895+0000","last_unstale":"2024-09-12T19:13:43.125814+0000","last_undegraded":"2024-09-12T19:13:43.125814+0000","last_fullsized":"2024-09-12T19:13:43.125814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'770","reported_seq":4382,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.673781+0000","last_change":"2024-09-12T19:14:23.673781+0000","last_active":"2024-09-12T19:14:23.673781+0000","last_peered":"2024-09-12T19:14:23.673781+0000","last_clean":"2024-09-12T19:14:23.673781+0000","last_became_active":"2024-09-12T18:26:47.882417+0000","last_became_peered":"2024-09-12T18:26:47.882417+0000","last_unstale":"2024-09-12T19:14:23.673781+0000","last_undegraded":"2024-09-12T19:14:23.673781+0000","last_fullsized":"2024-09-12T19:14:23.673781+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'770","last_scrub_stamp":"2024-09-12T19:14:23.673552+0000","last_deep_scrub":"265'770","last_deep_scrub_stamp":"2024-09-12T19:14:23.673552+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.673552+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":701,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:41.286038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'146","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:04.041466+0000","last_change":"2024-09-12T18:26:49.927258+0000","last_active":"2024-09-12T19:12:04.041466+0000","last_peered":"2024-09-12T19:12:04.041466+0000","last_clean":"2024-09-12T19:12:04.041466+0000","last_became_active":"2024-09-12T18:26:49.926637+0000","last_became_peered":"2024-09-12T18:26:49.926637+0000","last_unstale":"2024-09-12T19:12:04.041466+0000","last_undegraded":"2024-09-12T19:12:04.041466+0000","last_fullsized":"2024-09-12T19:12:04.041466+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:49.800769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":120,"num_write":360,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'756","reported_seq":2278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.078131+0000","last_change":"2024-09-12T19:14:13.078131+0000","last_active":"2024-09-12T19:14:13.078131+0000","last_peered":"2024-09-12T19:14:13.078131+0000","last_clean":"2024-09-12T19:14:13.078131+0000","last_became_active":"2024-09-12T18:26:41.839152+0000","last_became_peered":"2024-09-12T18:26:41.839152+0000","last_unstale":"2024-09-12T19:14:13.078131+0000","last_undegraded":"2024-09-12T19:14:13.078131+0000","last_fullsized":"2024-09-12T19:14:13.078131+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'756","last_scrub_stamp":"2024-09-12T19:14:13.077954+0000","last_deep_scrub":"265'756","last_deep_scrub_stamp":"2024-09-12T19:14:13.077954+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.077954+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:32.408093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3609,"num_read_kb":3261,"num_write":1016,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'377","reported_seq":1249,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.786508+0000","last_change":"2024-09-12T19:14:08.786353+0000","last_active":"2024-09-12T19:14:08.786508+0000","last_peered":"2024-09-12T19:14:08.786508+0000","last_clean":"2024-09-12T19:14:08.786508+0000","last_became_active":"2024-09-12T18:26:39.839018+0000","last_became_peered":"2024-09-12T18:26:39.839018+0000","last_unstale":"2024-09-12T19:14:08.786508+0000","last_undegraded":"2024-09-12T19:14:08.786508+0000","last_fullsized":"2024-09-12T19:14:08.786508+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:14:08.786149+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:14:08.786149+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.786149+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:20.356579+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88291,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":988,"num_read_kb":16661,"num_write":1246,"num_write_kb":29221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121502+0000","last_change":"2024-09-12T18:26:43.875133+0000","last_active":"2024-09-12T19:11:44.121502+0000","last_peered":"2024-09-12T19:11:44.121502+0000","last_clean":"2024-09-12T19:11:44.121502+0000","last_became_active":"2024-09-12T18:26:43.872882+0000","last_became_peered":"2024-09-12T18:26:43.872882+0000","last_unstale":"2024-09-12T19:11:44.121502+0000","last_undegraded":"2024-09-12T19:11:44.121502+0000","last_fullsized":"2024-09-12T19:11:44.121502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:14:27.685683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'395","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.292197+0000","last_change":"2024-09-12T18:26:45.871763+0000","last_active":"2024-09-12T19:13:57.292197+0000","last_peered":"2024-09-12T19:13:57.292197+0000","last_clean":"2024-09-12T19:13:57.292197+0000","last_became_active":"2024-09-12T18:26:45.871011+0000","last_became_peered":"2024-09-12T18:26:45.871011+0000","last_unstale":"2024-09-12T19:13:57.292197+0000","last_undegraded":"2024-09-12T19:13:57.292197+0000","last_fullsized":"2024-09-12T19:13:57.292197+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:15:25.203156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47428,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1195,"num_read_kb":1786,"num_write":1700,"num_write_kb":1538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.641621+0000","last_change":"2024-09-12T19:14:22.641621+0000","last_active":"2024-09-12T19:14:22.641621+0000","last_peered":"2024-09-12T19:14:22.641621+0000","last_clean":"2024-09-12T19:14:22.641621+0000","last_became_active":"2024-09-12T18:26:47.893881+0000","last_became_peered":"2024-09-12T18:26:47.893881+0000","last_unstale":"2024-09-12T19:14:22.641621+0000","last_undegraded":"2024-09-12T19:14:22.641621+0000","last_fullsized":"2024-09-12T19:14:22.641621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:22.641442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:22.641442+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.641442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:34.196498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'157","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:37.541375+0000","last_change":"2024-09-12T18:26:49.912169+0000","last_active":"2024-09-12T19:11:37.541375+0000","last_peered":"2024-09-12T19:11:37.541375+0000","last_clean":"2024-09-12T19:11:37.541375+0000","last_became_active":"2024-09-12T18:26:49.911403+0000","last_became_peered":"2024-09-12T18:26:49.911403+0000","last_unstale":"2024-09-12T19:11:37.541375+0000","last_undegraded":"2024-09-12T19:11:37.541375+0000","last_fullsized":"2024-09-12T19:11:37.541375+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:01.150938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":152,"num_write":383,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'826","reported_seq":2339,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.591537+0000","last_change":"2024-09-12T19:14:15.591537+0000","last_active":"2024-09-12T19:14:15.591537+0000","last_peered":"2024-09-12T19:14:15.591537+0000","last_clean":"2024-09-12T19:14:15.591537+0000","last_became_active":"2024-09-12T18:26:41.873329+0000","last_became_peered":"2024-09-12T18:26:41.873329+0000","last_unstale":"2024-09-12T19:14:15.591537+0000","last_undegraded":"2024-09-12T19:14:15.591537+0000","last_fullsized":"2024-09-12T19:14:15.591537+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'826","last_scrub_stamp":"2024-09-12T19:14:15.591318+0000","last_deep_scrub":"265'826","last_deep_scrub_stamp":"2024-09-12T19:14:15.591318+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.591318+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:40.100277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3864,"num_read_kb":3455,"num_write":1112,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.823046+0000","last_change":"2024-09-12T19:14:05.823046+0000","last_active":"2024-09-12T19:14:05.823046+0000","last_peered":"2024-09-12T19:14:05.823046+0000","last_clean":"2024-09-12T19:14:05.823046+0000","last_became_active":"2024-09-12T18:26:20.488464+0000","last_became_peered":"2024-09-12T18:26:20.488464+0000","last_unstale":"2024-09-12T19:14:05.823046+0000","last_undegraded":"2024-09-12T19:14:05.823046+0000","last_fullsized":"2024-09-12T19:14:05.823046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T19:14:05.822803+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T19:14:05.822803+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.822803+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:50.624649+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.565231+0000","last_change":"2024-09-12T19:14:06.564974+0000","last_active":"2024-09-12T19:14:06.565231+0000","last_peered":"2024-09-12T19:14:06.565231+0000","last_clean":"2024-09-12T19:14:06.565231+0000","last_became_active":"2024-09-12T18:26:25.483072+0000","last_became_peered":"2024-09-12T18:26:25.483072+0000","last_unstale":"2024-09-12T19:14:06.565231+0000","last_undegraded":"2024-09-12T19:14:06.565231+0000","last_fullsized":"2024-09-12T19:14:06.565231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:06.564760+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:06.564760+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.564760+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:34.986549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010071489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'369","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:03.767482+0000","last_change":"2024-09-12T19:14:03.767482+0000","last_active":"2024-09-12T19:14:03.767482+0000","last_peered":"2024-09-12T19:14:03.767482+0000","last_clean":"2024-09-12T19:14:03.767482+0000","last_became_active":"2024-09-12T18:26:39.855274+0000","last_became_peered":"2024-09-12T18:26:39.855274+0000","last_unstale":"2024-09-12T19:14:03.767482+0000","last_undegraded":"2024-09-12T19:14:03.767482+0000","last_fullsized":"2024-09-12T19:14:03.767482+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'369","last_scrub_stamp":"2024-09-12T19:14:03.767414+0000","last_deep_scrub":"265'369","last_deep_scrub_stamp":"2024-09-12T19:14:03.767414+0000","last_clean_scrub_stamp":"2024-09-12T19:14:03.767414+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:11.994783+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399238,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":585,"num_read_kb":43416,"num_write":1148,"num_write_kb":32341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"265'4","reported_seq":983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.885214+0000","last_change":"2024-09-12T19:14:22.885214+0000","last_active":"2024-09-12T19:14:22.885214+0000","last_peered":"2024-09-12T19:14:22.885214+0000","last_clean":"2024-09-12T19:14:22.885214+0000","last_became_active":"2024-09-12T18:26:43.862599+0000","last_became_peered":"2024-09-12T18:26:43.862599+0000","last_unstale":"2024-09-12T19:14:22.885214+0000","last_undegraded":"2024-09-12T19:14:22.885214+0000","last_fullsized":"2024-09-12T19:14:22.885214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:22.885024+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:22.885024+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.885024+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:30.442155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'718","reported_seq":1416,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.814967+0000","last_change":"2024-09-12T18:26:45.871462+0000","last_active":"2024-09-12T19:13:57.814967+0000","last_peered":"2024-09-12T19:13:57.814967+0000","last_clean":"2024-09-12T19:13:57.814967+0000","last_became_active":"2024-09-12T18:26:45.870711+0000","last_became_peered":"2024-09-12T18:26:45.870711+0000","last_unstale":"2024-09-12T19:13:57.814967+0000","last_undegraded":"2024-09-12T19:13:57.814967+0000","last_fullsized":"2024-09-12T19:13:57.814967+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":700,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:33.052933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152164,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1400,"num_read_kb":3258,"num_write":1288,"num_write_kb":1147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.915809+0000","last_change":"2024-09-12T18:26:47.888177+0000","last_active":"2024-09-12T19:10:08.915809+0000","last_peered":"2024-09-12T19:10:08.915809+0000","last_clean":"2024-09-12T19:10:08.915809+0000","last_became_active":"2024-09-12T18:26:47.886696+0000","last_became_peered":"2024-09-12T18:26:47.886696+0000","last_unstale":"2024-09-12T19:10:08.915809+0000","last_undegraded":"2024-09-12T19:10:08.915809+0000","last_fullsized":"2024-09-12T19:10:08.915809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:07.144929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'175","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.921796+0000","last_change":"2024-09-12T18:26:49.910601+0000","last_active":"2024-09-12T19:12:23.921796+0000","last_peered":"2024-09-12T19:12:23.921796+0000","last_clean":"2024-09-12T19:12:23.921796+0000","last_became_active":"2024-09-12T18:26:49.909591+0000","last_became_peered":"2024-09-12T18:26:49.909591+0000","last_unstale":"2024-09-12T19:12:23.921796+0000","last_undegraded":"2024-09-12T19:12:23.921796+0000","last_fullsized":"2024-09-12T19:12:23.921796+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:57.427369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":451,"num_write":354,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'449","reported_seq":1934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.828712+0000","last_change":"2024-09-12T19:14:09.828560+0000","last_active":"2024-09-12T19:14:09.828712+0000","last_peered":"2024-09-12T19:14:09.828712+0000","last_clean":"2024-09-12T19:14:09.828712+0000","last_became_active":"2024-09-12T18:27:11.825677+0000","last_became_peered":"2024-09-12T18:27:11.825677+0000","last_unstale":"2024-09-12T19:14:09.828712+0000","last_undegraded":"2024-09-12T19:14:09.828712+0000","last_fullsized":"2024-09-12T19:14:09.828712+0000","mapping_epoch":37,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'449","last_scrub_stamp":"2024-09-12T19:14:09.828367+0000","last_deep_scrub":"265'449","last_deep_scrub_stamp":"2024-09-12T19:14:09.828367+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.828367+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:10.327973+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2226,"num_read_kb":2089,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.817097+0000","last_change":"2024-09-12T19:14:09.817097+0000","last_active":"2024-09-12T19:14:09.817097+0000","last_peered":"2024-09-12T19:14:09.817097+0000","last_clean":"2024-09-12T19:14:09.817097+0000","last_became_active":"2024-09-12T18:26:25.486681+0000","last_became_peered":"2024-09-12T18:26:25.486681+0000","last_unstale":"2024-09-12T19:14:09.817097+0000","last_undegraded":"2024-09-12T19:14:09.817097+0000","last_fullsized":"2024-09-12T19:14:09.817097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:09.816815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:09.816815+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.816815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:48.920838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001127308,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'447","reported_seq":1101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:02.915481+0000","last_change":"2024-09-12T19:14:02.915481+0000","last_active":"2024-09-12T19:14:02.915481+0000","last_peered":"2024-09-12T19:14:02.915481+0000","last_clean":"2024-09-12T19:14:02.915481+0000","last_became_active":"2024-09-12T18:26:39.852604+0000","last_became_peered":"2024-09-12T18:26:39.852604+0000","last_unstale":"2024-09-12T19:14:02.915481+0000","last_undegraded":"2024-09-12T19:14:02.915481+0000","last_fullsized":"2024-09-12T19:14:02.915481+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'447","last_scrub_stamp":"2024-09-12T19:14:02.915389+0000","last_deep_scrub":"265'447","last_deep_scrub_stamp":"2024-09-12T19:14:02.915389+0000","last_clean_scrub_stamp":"2024-09-12T19:14:02.915389+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:58.385296+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1797992,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":612,"num_read_kb":8884,"num_write":1284,"num_write_kb":32875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:13.918605+0000","last_change":"2024-09-12T18:26:43.858389+0000","last_active":"2024-09-12T19:12:13.918605+0000","last_peered":"2024-09-12T19:12:13.918605+0000","last_clean":"2024-09-12T19:12:13.918605+0000","last_became_active":"2024-09-12T18:26:43.857619+0000","last_became_peered":"2024-09-12T18:26:43.857619+0000","last_unstale":"2024-09-12T19:12:13.918605+0000","last_undegraded":"2024-09-12T19:12:13.918605+0000","last_fullsized":"2024-09-12T19:12:13.918605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1276","reported_seq":2783,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.165535+0000","last_change":"2024-09-12T18:26:45.866866+0000","last_active":"2024-09-12T19:13:58.165535+0000","last_peered":"2024-09-12T19:13:58.165535+0000","last_clean":"2024-09-12T19:13:58.165535+0000","last_became_active":"2024-09-12T18:26:45.865530+0000","last_became_peered":"2024-09-12T18:26:45.865530+0000","last_unstale":"2024-09-12T19:13:58.165535+0000","last_undegraded":"2024-09-12T19:13:58.165535+0000","last_fullsized":"2024-09-12T19:13:58.165535+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:38.754345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145649,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2006,"num_read_kb":3785,"num_write":1114,"num_write_kb":954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:42.904610+0000","last_change":"2024-09-12T18:26:47.887431+0000","last_active":"2024-09-12T19:10:42.904610+0000","last_peered":"2024-09-12T19:10:42.904610+0000","last_clean":"2024-09-12T19:10:42.904610+0000","last_became_active":"2024-09-12T18:26:47.886707+0000","last_became_peered":"2024-09-12T18:26:47.886707+0000","last_unstale":"2024-09-12T19:10:42.904610+0000","last_undegraded":"2024-09-12T19:10:42.904610+0000","last_fullsized":"2024-09-12T19:10:42.904610+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:24.695168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'194","reported_seq":727,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:22.676957+0000","last_change":"2024-09-12T18:26:49.910993+0000","last_active":"2024-09-12T19:12:22.676957+0000","last_peered":"2024-09-12T19:12:22.676957+0000","last_clean":"2024-09-12T19:12:22.676957+0000","last_became_active":"2024-09-12T18:26:49.909802+0000","last_became_peered":"2024-09-12T18:26:49.909802+0000","last_unstale":"2024-09-12T19:12:22.676957+0000","last_undegraded":"2024-09-12T19:12:22.676957+0000","last_fullsized":"2024-09-12T19:12:22.676957+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:14.966749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":337,"num_read_kb":322,"num_write":434,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'395","reported_seq":1925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.062834+0000","last_change":"2024-09-12T19:14:10.062699+0000","last_active":"2024-09-12T19:14:10.062834+0000","last_peered":"2024-09-12T19:14:10.062834+0000","last_clean":"2024-09-12T19:14:10.062834+0000","last_became_active":"2024-09-12T18:26:41.868958+0000","last_became_peered":"2024-09-12T18:26:41.868958+0000","last_unstale":"2024-09-12T19:14:10.062834+0000","last_undegraded":"2024-09-12T19:14:10.062834+0000","last_fullsized":"2024-09-12T19:14:10.062834+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'395","last_scrub_stamp":"2024-09-12T19:14:10.062517+0000","last_deep_scrub":"265'395","last_deep_scrub_stamp":"2024-09-12T19:14:10.062517+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.062517+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:11.560866+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2137,"num_read_kb":2050,"num_write":435,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1191,"num_omap_keys":5,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.034479+0000","last_change":"2024-09-12T19:14:04.034267+0000","last_active":"2024-09-12T19:14:04.034479+0000","last_peered":"2024-09-12T19:14:04.034479+0000","last_clean":"2024-09-12T19:14:04.034479+0000","last_became_active":"2024-09-12T18:26:25.559069+0000","last_became_peered":"2024-09-12T18:26:25.559069+0000","last_unstale":"2024-09-12T19:14:04.034479+0000","last_undegraded":"2024-09-12T19:14:04.034479+0000","last_fullsized":"2024-09-12T19:14:04.034479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:04.034076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:04.034076+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.034076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:45.407307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00065344600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'305","reported_seq":922,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.182326+0000","last_change":"2024-09-12T19:14:20.182326+0000","last_active":"2024-09-12T19:14:20.182326+0000","last_peered":"2024-09-12T19:14:20.182326+0000","last_clean":"2024-09-12T19:14:20.182326+0000","last_became_active":"2024-09-12T18:26:39.832766+0000","last_became_peered":"2024-09-12T18:26:39.832766+0000","last_unstale":"2024-09-12T19:14:20.182326+0000","last_undegraded":"2024-09-12T19:14:20.182326+0000","last_fullsized":"2024-09-12T19:14:20.182326+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T19:14:20.182116+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T19:14:20.182116+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.182116+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:08.243108+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":386,"num_read_kb":10646,"num_write":879,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.043264+0000","last_change":"2024-09-12T19:14:15.043116+0000","last_active":"2024-09-12T19:14:15.043264+0000","last_peered":"2024-09-12T19:14:15.043264+0000","last_clean":"2024-09-12T19:14:15.043264+0000","last_became_active":"2024-09-12T18:26:43.843884+0000","last_became_peered":"2024-09-12T18:26:43.843884+0000","last_unstale":"2024-09-12T19:14:15.043264+0000","last_undegraded":"2024-09-12T19:14:15.043264+0000","last_fullsized":"2024-09-12T19:14:15.043264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:15.042938+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:15.042938+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.042938+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:57.556164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'237","reported_seq":1345,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:40.758792+0000","last_change":"2024-09-12T18:26:46.025252+0000","last_active":"2024-09-12T19:13:40.758792+0000","last_peered":"2024-09-12T19:13:40.758792+0000","last_clean":"2024-09-12T19:13:40.758792+0000","last_became_active":"2024-09-12T18:26:46.024474+0000","last_became_peered":"2024-09-12T18:26:46.024474+0000","last_unstale":"2024-09-12T19:13:40.758792+0000","last_undegraded":"2024-09-12T19:13:40.758792+0000","last_fullsized":"2024-09-12T19:13:40.758792+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:44:08.550075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.623352+0000","last_change":"2024-09-12T19:14:23.623352+0000","last_active":"2024-09-12T19:14:23.623352+0000","last_peered":"2024-09-12T19:14:23.623352+0000","last_clean":"2024-09-12T19:14:23.623352+0000","last_became_active":"2024-09-12T18:26:47.889718+0000","last_became_peered":"2024-09-12T18:26:47.889718+0000","last_unstale":"2024-09-12T19:14:23.623352+0000","last_undegraded":"2024-09-12T19:14:23.623352+0000","last_fullsized":"2024-09-12T19:14:23.623352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:23.623180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:23.623180+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.623180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:13.007796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'249","reported_seq":845,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.323546+0000","last_change":"2024-09-12T18:26:49.913279+0000","last_active":"2024-09-12T19:12:24.323546+0000","last_peered":"2024-09-12T19:12:24.323546+0000","last_clean":"2024-09-12T19:12:24.323546+0000","last_became_active":"2024-09-12T18:26:49.912488+0000","last_became_peered":"2024-09-12T18:26:49.912488+0000","last_unstale":"2024-09-12T19:12:24.323546+0000","last_undegraded":"2024-09-12T19:12:24.323546+0000","last_fullsized":"2024-09-12T19:12:24.323546+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":492,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'923","reported_seq":2691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.118118+0000","last_change":"2024-09-12T19:14:14.118118+0000","last_active":"2024-09-12T19:14:14.118118+0000","last_peered":"2024-09-12T19:14:14.118118+0000","last_clean":"2024-09-12T19:14:14.118118+0000","last_became_active":"2024-09-12T18:26:41.847403+0000","last_became_peered":"2024-09-12T18:26:41.847403+0000","last_unstale":"2024-09-12T19:14:14.118118+0000","last_undegraded":"2024-09-12T19:14:14.118118+0000","last_fullsized":"2024-09-12T19:14:14.118118+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'923","last_scrub_stamp":"2024-09-12T19:14:14.117836+0000","last_deep_scrub":"265'923","last_deep_scrub_stamp":"2024-09-12T19:14:14.117836+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.117836+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:45.790389+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4497,"num_read_kb":4050,"num_write":1227,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3569,"num_omap_keys":15,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.604240+0000","last_change":"2024-09-12T19:14:05.604094+0000","last_active":"2024-09-12T19:14:05.604240+0000","last_peered":"2024-09-12T19:14:05.604240+0000","last_clean":"2024-09-12T19:14:05.604240+0000","last_became_active":"2024-09-12T18:26:25.483909+0000","last_became_peered":"2024-09-12T18:26:25.483909+0000","last_unstale":"2024-09-12T19:14:05.604240+0000","last_undegraded":"2024-09-12T19:14:05.604240+0000","last_fullsized":"2024-09-12T19:14:05.604240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T19:14:05.603905+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T19:14:05.603905+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.603905+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:00.442699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002260153,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'308","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.355955+0000","last_change":"2024-09-12T19:14:04.355955+0000","last_active":"2024-09-12T19:14:04.355955+0000","last_peered":"2024-09-12T19:14:04.355955+0000","last_clean":"2024-09-12T19:14:04.355955+0000","last_became_active":"2024-09-12T18:26:39.847002+0000","last_became_peered":"2024-09-12T18:26:39.847002+0000","last_unstale":"2024-09-12T19:14:04.355955+0000","last_undegraded":"2024-09-12T19:14:04.355955+0000","last_fullsized":"2024-09-12T19:14:04.355955+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'308","last_scrub_stamp":"2024-09-12T19:14:04.355733+0000","last_deep_scrub":"265'308","last_deep_scrub_stamp":"2024-09-12T19:14:04.355733+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.355733+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:41.026404+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":613,"num_read_kb":6223,"num_write":953,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.809100+0000","last_change":"2024-09-12T19:14:14.809100+0000","last_active":"2024-09-12T19:14:14.809100+0000","last_peered":"2024-09-12T19:14:14.809100+0000","last_clean":"2024-09-12T19:14:14.809100+0000","last_became_active":"2024-09-12T18:26:43.861753+0000","last_became_peered":"2024-09-12T18:26:43.861753+0000","last_unstale":"2024-09-12T19:14:14.809100+0000","last_undegraded":"2024-09-12T19:14:14.809100+0000","last_fullsized":"2024-09-12T19:14:14.809100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:14.808880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:14.808880+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.808880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:18.789841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'111","reported_seq":649,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.724941+0000","last_change":"2024-09-12T18:26:45.857442+0000","last_active":"2024-09-12T19:12:18.724941+0000","last_peered":"2024-09-12T19:12:18.724941+0000","last_clean":"2024-09-12T19:12:18.724941+0000","last_became_active":"2024-09-12T18:26:45.856615+0000","last_became_peered":"2024-09-12T18:26:45.856615+0000","last_unstale":"2024-09-12T19:12:18.724941+0000","last_undegraded":"2024-09-12T19:12:18.724941+0000","last_fullsized":"2024-09-12T19:12:18.724941+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:39.665638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.655037+0000","last_change":"2024-09-12T19:14:21.655037+0000","last_active":"2024-09-12T19:14:21.655037+0000","last_peered":"2024-09-12T19:14:21.655037+0000","last_clean":"2024-09-12T19:14:21.655037+0000","last_became_active":"2024-09-12T18:26:47.884981+0000","last_became_peered":"2024-09-12T18:26:47.884981+0000","last_unstale":"2024-09-12T19:14:21.655037+0000","last_undegraded":"2024-09-12T19:14:21.655037+0000","last_fullsized":"2024-09-12T19:14:21.655037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:21.654865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:21.654865+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.654865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:15.223256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'140","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.019034+0000","last_change":"2024-09-12T18:26:49.918948+0000","last_active":"2024-09-12T19:13:43.019034+0000","last_peered":"2024-09-12T19:13:43.019034+0000","last_clean":"2024-09-12T19:13:43.019034+0000","last_became_active":"2024-09-12T18:26:49.918043+0000","last_became_peered":"2024-09-12T18:26:49.918043+0000","last_unstale":"2024-09-12T19:13:43.019034+0000","last_undegraded":"2024-09-12T19:13:43.019034+0000","last_fullsized":"2024-09-12T19:13:43.019034+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:07.565002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":258,"num_write":354,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'550","reported_seq":2247,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.028527+0000","last_change":"2024-09-12T19:14:08.028527+0000","last_active":"2024-09-12T19:14:08.028527+0000","last_peered":"2024-09-12T19:14:08.028527+0000","last_clean":"2024-09-12T19:14:08.028527+0000","last_became_active":"2024-09-12T18:26:41.878269+0000","last_became_peered":"2024-09-12T18:26:41.878269+0000","last_unstale":"2024-09-12T19:14:08.028527+0000","last_undegraded":"2024-09-12T19:14:08.028527+0000","last_fullsized":"2024-09-12T19:14:08.028527+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'550","last_scrub_stamp":"2024-09-12T19:14:08.028346+0000","last_deep_scrub":"265'550","last_deep_scrub_stamp":"2024-09-12T19:14:08.028346+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.028346+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:00.737745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2954,"num_read_kb":2745,"num_write":669,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'462","reported_seq":1163,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.591491+0000","last_change":"2024-09-12T19:14:04.591491+0000","last_active":"2024-09-12T19:14:04.591491+0000","last_peered":"2024-09-12T19:14:04.591491+0000","last_clean":"2024-09-12T19:14:04.591491+0000","last_became_active":"2024-09-12T18:26:39.851739+0000","last_became_peered":"2024-09-12T18:26:39.851739+0000","last_unstale":"2024-09-12T19:14:04.591491+0000","last_undegraded":"2024-09-12T19:14:04.591491+0000","last_fullsized":"2024-09-12T19:14:04.591491+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'462","last_scrub_stamp":"2024-09-12T19:14:04.591353+0000","last_deep_scrub":"265'462","last_deep_scrub_stamp":"2024-09-12T19:14:04.591353+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.591353+0000","objects_scrubbed":8,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:47:43.285385+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":848,"num_read_kb":21232,"num_write":1357,"num_write_kb":18457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:03.058708+0000","last_change":"2024-09-12T19:14:03.058458+0000","last_active":"2024-09-12T19:14:03.058708+0000","last_peered":"2024-09-12T19:14:03.058708+0000","last_clean":"2024-09-12T19:14:03.058708+0000","last_became_active":"2024-09-12T18:26:25.474997+0000","last_became_peered":"2024-09-12T18:26:25.474997+0000","last_unstale":"2024-09-12T19:14:03.058708+0000","last_undegraded":"2024-09-12T19:14:03.058708+0000","last_fullsized":"2024-09-12T19:14:03.058708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:03.058262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:03.058262+0000","last_clean_scrub_stamp":"2024-09-12T19:14:03.058262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:33.435710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099306900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.921024+0000","last_change":"2024-09-12T18:26:43.866505+0000","last_active":"2024-09-12T19:10:28.921024+0000","last_peered":"2024-09-12T19:10:28.921024+0000","last_clean":"2024-09-12T19:10:28.921024+0000","last_became_active":"2024-09-12T18:26:43.865697+0000","last_became_peered":"2024-09-12T18:26:43.865697+0000","last_unstale":"2024-09-12T19:10:28.921024+0000","last_undegraded":"2024-09-12T19:10:28.921024+0000","last_fullsized":"2024-09-12T19:10:28.921024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:59:41.285586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'560","reported_seq":1233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.683021+0000","last_change":"2024-09-12T19:14:22.683021+0000","last_active":"2024-09-12T19:14:22.683021+0000","last_peered":"2024-09-12T19:14:22.683021+0000","last_clean":"2024-09-12T19:14:22.683021+0000","last_became_active":"2024-09-12T18:26:45.877100+0000","last_became_peered":"2024-09-12T18:26:45.877100+0000","last_unstale":"2024-09-12T19:14:22.683021+0000","last_undegraded":"2024-09-12T19:14:22.683021+0000","last_fullsized":"2024-09-12T19:14:22.683021+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'560","last_scrub_stamp":"2024-09-12T19:14:22.682604+0000","last_deep_scrub":"265'560","last_deep_scrub_stamp":"2024-09-12T19:14:22.682604+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.682604+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:19.522572+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103009,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":952,"num_read_kb":2114,"num_write":816,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10824,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:34.105870+0000","last_change":"2024-09-12T18:26:47.900861+0000","last_active":"2024-09-12T19:10:34.105870+0000","last_peered":"2024-09-12T19:10:34.105870+0000","last_clean":"2024-09-12T19:10:34.105870+0000","last_became_active":"2024-09-12T18:26:47.900217+0000","last_became_peered":"2024-09-12T18:26:47.900217+0000","last_unstale":"2024-09-12T19:10:34.105870+0000","last_undegraded":"2024-09-12T19:10:34.105870+0000","last_fullsized":"2024-09-12T19:10:34.105870+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:22.630784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'141","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.626757+0000","last_change":"2024-09-12T18:26:49.921916+0000","last_active":"2024-09-12T19:12:18.626757+0000","last_peered":"2024-09-12T19:12:18.626757+0000","last_clean":"2024-09-12T19:12:18.626757+0000","last_became_active":"2024-09-12T18:26:49.921123+0000","last_became_peered":"2024-09-12T18:26:49.921123+0000","last_unstale":"2024-09-12T19:12:18.626757+0000","last_undegraded":"2024-09-12T19:12:18.626757+0000","last_fullsized":"2024-09-12T19:12:18.626757+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":212,"num_read_kb":188,"num_write":350,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'429","reported_seq":1890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.799636+0000","last_change":"2024-09-12T19:14:15.799636+0000","last_active":"2024-09-12T19:14:15.799636+0000","last_peered":"2024-09-12T19:14:15.799636+0000","last_clean":"2024-09-12T19:14:15.799636+0000","last_became_active":"2024-09-12T18:26:41.869426+0000","last_became_peered":"2024-09-12T18:26:41.869426+0000","last_unstale":"2024-09-12T19:14:15.799636+0000","last_undegraded":"2024-09-12T19:14:15.799636+0000","last_fullsized":"2024-09-12T19:14:15.799636+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'429","last_scrub_stamp":"2024-09-12T19:14:15.799455+0000","last_deep_scrub":"265'429","last_deep_scrub_stamp":"2024-09-12T19:14:15.799455+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.799455+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:25.588201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2246,"num_read_kb":2097,"num_write":505,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'373","reported_seq":1064,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.024849+0000","last_change":"2024-09-12T19:14:09.024849+0000","last_active":"2024-09-12T19:14:09.024849+0000","last_peered":"2024-09-12T19:14:09.024849+0000","last_clean":"2024-09-12T19:14:09.024849+0000","last_became_active":"2024-09-12T18:26:39.832593+0000","last_became_peered":"2024-09-12T18:26:39.832593+0000","last_unstale":"2024-09-12T19:14:09.024849+0000","last_undegraded":"2024-09-12T19:14:09.024849+0000","last_fullsized":"2024-09-12T19:14:09.024849+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T19:14:09.024591+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T19:14:09.024591+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.024591+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:04.058256+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1569358,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":23528,"num_write":1214,"num_write_kb":24783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.854566+0000","last_change":"2024-09-12T19:14:08.854566+0000","last_active":"2024-09-12T19:14:08.854566+0000","last_peered":"2024-09-12T19:14:08.854566+0000","last_clean":"2024-09-12T19:14:08.854566+0000","last_became_active":"2024-09-12T18:26:25.484938+0000","last_became_peered":"2024-09-12T18:26:25.484938+0000","last_unstale":"2024-09-12T19:14:08.854566+0000","last_undegraded":"2024-09-12T19:14:08.854566+0000","last_fullsized":"2024-09-12T19:14:08.854566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:08.854352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:08.854352+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.854352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:10.919124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001083194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.597867+0000","last_change":"2024-09-12T19:14:18.597867+0000","last_active":"2024-09-12T19:14:18.597867+0000","last_peered":"2024-09-12T19:14:18.597867+0000","last_clean":"2024-09-12T19:14:18.597867+0000","last_became_active":"2024-09-12T18:26:43.863388+0000","last_became_peered":"2024-09-12T18:26:43.863388+0000","last_unstale":"2024-09-12T19:14:18.597867+0000","last_undegraded":"2024-09-12T19:14:18.597867+0000","last_fullsized":"2024-09-12T19:14:18.597867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:18.597691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:18.597691+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.597691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:16.253901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'168","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.137680+0000","last_change":"2024-09-12T19:14:22.137680+0000","last_active":"2024-09-12T19:14:22.137680+0000","last_peered":"2024-09-12T19:14:22.137680+0000","last_clean":"2024-09-12T19:14:22.137680+0000","last_became_active":"2024-09-12T18:26:46.020043+0000","last_became_peered":"2024-09-12T18:26:46.020043+0000","last_unstale":"2024-09-12T19:14:22.137680+0000","last_undegraded":"2024-09-12T19:14:22.137680+0000","last_fullsized":"2024-09-12T19:14:22.137680+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T19:14:22.137464+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T19:14:22.137464+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.137464+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:31.392371+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":189,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'814","reported_seq":2657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.831278+0000","last_change":"2024-09-12T18:26:47.880379+0000","last_active":"2024-09-12T19:13:56.831278+0000","last_peered":"2024-09-12T19:13:56.831278+0000","last_clean":"2024-09-12T19:13:56.831278+0000","last_became_active":"2024-09-12T18:26:47.879630+0000","last_became_peered":"2024-09-12T18:26:47.879630+0000","last_unstale":"2024-09-12T19:13:56.831278+0000","last_undegraded":"2024-09-12T19:13:56.831278+0000","last_fullsized":"2024-09-12T19:13:56.831278+0000","mapping_epoch":32,"log_start":"265'800","ondisk_log_start":"265'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:34.644082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'140","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.005359+0000","last_change":"2024-09-12T18:26:49.920666+0000","last_active":"2024-09-12T19:13:44.005359+0000","last_peered":"2024-09-12T19:13:44.005359+0000","last_clean":"2024-09-12T19:13:44.005359+0000","last_became_active":"2024-09-12T18:26:49.919846+0000","last_became_peered":"2024-09-12T18:26:49.919846+0000","last_unstale":"2024-09-12T19:13:44.005359+0000","last_undegraded":"2024-09-12T19:13:44.005359+0000","last_fullsized":"2024-09-12T19:13:44.005359+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":263,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'481","reported_seq":2016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.951639+0000","last_change":"2024-09-12T19:14:19.951639+0000","last_active":"2024-09-12T19:14:19.951639+0000","last_peered":"2024-09-12T19:14:19.951639+0000","last_clean":"2024-09-12T19:14:19.951639+0000","last_became_active":"2024-09-12T18:26:41.862008+0000","last_became_peered":"2024-09-12T18:26:41.862008+0000","last_unstale":"2024-09-12T19:14:19.951639+0000","last_undegraded":"2024-09-12T19:14:19.951639+0000","last_fullsized":"2024-09-12T19:14:19.951639+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'481","last_scrub_stamp":"2024-09-12T19:14:19.951462+0000","last_deep_scrub":"265'481","last_deep_scrub_stamp":"2024-09-12T19:14:19.951462+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.951462+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:03.077093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":2263,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'343","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.734772+0000","last_change":"2024-09-12T19:14:04.734724+0000","last_active":"2024-09-12T19:14:04.734772+0000","last_peered":"2024-09-12T19:14:04.734772+0000","last_clean":"2024-09-12T19:14:04.734772+0000","last_became_active":"2024-09-12T18:26:39.865123+0000","last_became_peered":"2024-09-12T18:26:39.865123+0000","last_unstale":"2024-09-12T19:14:04.734772+0000","last_undegraded":"2024-09-12T19:14:04.734772+0000","last_fullsized":"2024-09-12T19:14:04.734772+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:14:04.734653+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:14:04.734653+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.734653+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:27.841010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":68443,"num_write":1085,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.072373+0000","last_change":"2024-09-12T19:14:06.072144+0000","last_active":"2024-09-12T19:14:06.072373+0000","last_peered":"2024-09-12T19:14:06.072373+0000","last_clean":"2024-09-12T19:14:06.072373+0000","last_became_active":"2024-09-12T18:26:25.485137+0000","last_became_peered":"2024-09-12T18:26:25.485137+0000","last_unstale":"2024-09-12T19:14:06.072373+0000","last_undegraded":"2024-09-12T19:14:06.072373+0000","last_fullsized":"2024-09-12T19:14:06.072373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:06.071853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:06.071853+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.071853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:58.794679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013350759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:29.104750+0000","last_change":"2024-09-12T18:26:43.876064+0000","last_active":"2024-09-12T19:10:29.104750+0000","last_peered":"2024-09-12T19:10:29.104750+0000","last_clean":"2024-09-12T19:10:29.104750+0000","last_became_active":"2024-09-12T18:26:43.874845+0000","last_became_peered":"2024-09-12T18:26:43.874845+0000","last_unstale":"2024-09-12T19:10:29.104750+0000","last_undegraded":"2024-09-12T19:10:29.104750+0000","last_fullsized":"2024-09-12T19:10:29.104750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:36.440895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'106","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.584442+0000","last_change":"2024-09-12T18:26:45.864296+0000","last_active":"2024-09-12T19:11:07.584442+0000","last_peered":"2024-09-12T19:11:07.584442+0000","last_clean":"2024-09-12T19:11:07.584442+0000","last_became_active":"2024-09-12T18:26:45.863254+0000","last_became_peered":"2024-09-12T18:26:45.863254+0000","last_unstale":"2024-09-12T19:11:07.584442+0000","last_undegraded":"2024-09-12T19:11:07.584442+0000","last_fullsized":"2024-09-12T19:11:07.584442+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:53:25.709734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'805","reported_seq":2519,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:56.842088+0000","last_change":"2024-09-12T18:26:47.900388+0000","last_active":"2024-09-12T19:13:56.842088+0000","last_peered":"2024-09-12T19:13:56.842088+0000","last_clean":"2024-09-12T19:13:56.842088+0000","last_became_active":"2024-09-12T18:26:47.899682+0000","last_became_peered":"2024-09-12T18:26:47.899682+0000","last_unstale":"2024-09-12T19:13:56.842088+0000","last_undegraded":"2024-09-12T19:13:56.842088+0000","last_fullsized":"2024-09-12T19:13:56.842088+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:26.128123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'166","reported_seq":672,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:06.573641+0000","last_change":"2024-09-12T18:26:49.918711+0000","last_active":"2024-09-12T19:12:06.573641+0000","last_peered":"2024-09-12T19:12:06.573641+0000","last_clean":"2024-09-12T19:12:06.573641+0000","last_became_active":"2024-09-12T18:26:49.917537+0000","last_became_peered":"2024-09-12T18:26:49.917537+0000","last_unstale":"2024-09-12T19:12:06.573641+0000","last_undegraded":"2024-09-12T19:12:06.573641+0000","last_fullsized":"2024-09-12T19:12:06.573641+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":124,"num_write":364,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'446","reported_seq":1947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.329287+0000","last_change":"2024-09-12T19:14:08.329287+0000","last_active":"2024-09-12T19:14:08.329287+0000","last_peered":"2024-09-12T19:14:08.329287+0000","last_clean":"2024-09-12T19:14:08.329287+0000","last_became_active":"2024-09-12T18:26:41.871518+0000","last_became_peered":"2024-09-12T18:26:41.871518+0000","last_unstale":"2024-09-12T19:14:08.329287+0000","last_undegraded":"2024-09-12T19:14:08.329287+0000","last_fullsized":"2024-09-12T19:14:08.329287+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'446","last_scrub_stamp":"2024-09-12T19:14:08.329092+0000","last_deep_scrub":"265'446","last_deep_scrub_stamp":"2024-09-12T19:14:08.329092+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.329092+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:06.915175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2145,"num_write":516,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'315","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:03.905567+0000","last_change":"2024-09-12T19:14:03.905429+0000","last_active":"2024-09-12T19:14:03.905567+0000","last_peered":"2024-09-12T19:14:03.905567+0000","last_clean":"2024-09-12T19:14:03.905567+0000","last_became_active":"2024-09-12T18:26:39.833924+0000","last_became_peered":"2024-09-12T18:26:39.833924+0000","last_unstale":"2024-09-12T19:14:03.905567+0000","last_undegraded":"2024-09-12T19:14:03.905567+0000","last_fullsized":"2024-09-12T19:14:03.905567+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T19:14:03.905233+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T19:14:03.905233+0000","last_clean_scrub_stamp":"2024-09-12T19:14:03.905233+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:50.763493+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6467978,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":59970,"num_write":1010,"num_write_kb":34278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.502466+0000","last_change":"2024-09-12T19:14:06.502292+0000","last_active":"2024-09-12T19:14:06.502466+0000","last_peered":"2024-09-12T19:14:06.502466+0000","last_clean":"2024-09-12T19:14:06.502466+0000","last_became_active":"2024-09-12T18:26:25.487465+0000","last_became_peered":"2024-09-12T18:26:25.487465+0000","last_unstale":"2024-09-12T19:14:06.502466+0000","last_undegraded":"2024-09-12T19:14:06.502466+0000","last_fullsized":"2024-09-12T19:14:06.502466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:06.502115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:06.502115+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.502115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:23.228019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010368949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.924444+0000","last_change":"2024-09-12T18:26:43.851056+0000","last_active":"2024-09-12T19:10:48.924444+0000","last_peered":"2024-09-12T19:10:48.924444+0000","last_clean":"2024-09-12T19:10:48.924444+0000","last_became_active":"2024-09-12T18:26:43.850274+0000","last_became_peered":"2024-09-12T18:26:43.850274+0000","last_unstale":"2024-09-12T19:10:48.924444+0000","last_undegraded":"2024-09-12T19:10:48.924444+0000","last_fullsized":"2024-09-12T19:10:48.924444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:48:39.140912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'720","reported_seq":1433,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.289812+0000","last_change":"2024-09-12T18:26:46.021959+0000","last_active":"2024-09-12T19:13:58.289812+0000","last_peered":"2024-09-12T19:13:58.289812+0000","last_clean":"2024-09-12T19:13:58.289812+0000","last_became_active":"2024-09-12T18:26:46.021217+0000","last_became_peered":"2024-09-12T18:26:46.021217+0000","last_unstale":"2024-09-12T19:13:58.289812+0000","last_undegraded":"2024-09-12T19:13:58.289812+0000","last_fullsized":"2024-09-12T19:13:58.289812+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:41.193709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1300,"num_read_kb":3120,"num_write":1062,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.920778+0000","last_change":"2024-09-12T18:26:47.903443+0000","last_active":"2024-09-12T19:10:33.920778+0000","last_peered":"2024-09-12T19:10:33.920778+0000","last_clean":"2024-09-12T19:10:33.920778+0000","last_became_active":"2024-09-12T18:26:47.902750+0000","last_became_peered":"2024-09-12T18:26:47.902750+0000","last_unstale":"2024-09-12T19:10:33.920778+0000","last_undegraded":"2024-09-12T19:10:33.920778+0000","last_fullsized":"2024-09-12T19:10:33.920778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:44.433901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'107","reported_seq":607,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:53.914218+0000","last_change":"2024-09-12T18:26:49.920307+0000","last_active":"2024-09-12T19:11:53.914218+0000","last_peered":"2024-09-12T19:11:53.914218+0000","last_clean":"2024-09-12T19:11:53.914218+0000","last_became_active":"2024-09-12T18:26:49.919630+0000","last_became_peered":"2024-09-12T18:26:49.919630+0000","last_unstale":"2024-09-12T19:11:53.914218+0000","last_undegraded":"2024-09-12T19:11:53.914218+0000","last_fullsized":"2024-09-12T19:11:53.914218+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":269,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'143","reported_seq":705,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.274239+0000","last_change":"2024-09-12T18:26:49.913310+0000","last_active":"2024-09-12T19:12:24.274239+0000","last_peered":"2024-09-12T19:12:24.274239+0000","last_clean":"2024-09-12T19:12:24.274239+0000","last_became_active":"2024-09-12T18:26:49.912589+0000","last_became_peered":"2024-09-12T18:26:49.912589+0000","last_unstale":"2024-09-12T19:12:24.274239+0000","last_undegraded":"2024-09-12T19:12:24.274239+0000","last_fullsized":"2024-09-12T19:12:24.274239+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:07.282432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":221,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'914","reported_seq":2543,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.269753+0000","last_change":"2024-09-12T19:14:15.269753+0000","last_active":"2024-09-12T19:14:15.269753+0000","last_peered":"2024-09-12T19:14:15.269753+0000","last_clean":"2024-09-12T19:14:15.269753+0000","last_became_active":"2024-09-12T18:26:41.875870+0000","last_became_peered":"2024-09-12T18:26:41.875870+0000","last_unstale":"2024-09-12T19:14:15.269753+0000","last_undegraded":"2024-09-12T19:14:15.269753+0000","last_fullsized":"2024-09-12T19:14:15.269753+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'914","last_scrub_stamp":"2024-09-12T19:14:15.269571+0000","last_deep_scrub":"265'914","last_deep_scrub_stamp":"2024-09-12T19:14:15.269571+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.269571+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":900,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:16.227806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4445,"num_read_kb":3959,"num_write":1252,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'311","reported_seq":958,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.359664+0000","last_change":"2024-09-12T19:14:05.359664+0000","last_active":"2024-09-12T19:14:05.359664+0000","last_peered":"2024-09-12T19:14:05.359664+0000","last_clean":"2024-09-12T19:14:05.359664+0000","last_became_active":"2024-09-12T18:26:39.870576+0000","last_became_peered":"2024-09-12T18:26:39.870576+0000","last_unstale":"2024-09-12T19:14:05.359664+0000","last_undegraded":"2024-09-12T19:14:05.359664+0000","last_fullsized":"2024-09-12T19:14:05.359664+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'311","last_scrub_stamp":"2024-09-12T19:14:05.359443+0000","last_deep_scrub":"265'311","last_deep_scrub_stamp":"2024-09-12T19:14:05.359443+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.359443+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:08.218478+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":31608,"num_write":917,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.194115+0000","last_change":"2024-09-12T19:14:16.194115+0000","last_active":"2024-09-12T19:14:16.194115+0000","last_peered":"2024-09-12T19:14:16.194115+0000","last_clean":"2024-09-12T19:14:16.194115+0000","last_became_active":"2024-09-12T18:26:43.864969+0000","last_became_peered":"2024-09-12T18:26:43.864969+0000","last_unstale":"2024-09-12T19:14:16.194115+0000","last_undegraded":"2024-09-12T19:14:16.194115+0000","last_fullsized":"2024-09-12T19:14:16.194115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:16.193928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:16.193928+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.193928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:14.944724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'276","reported_seq":848,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.485175+0000","last_change":"2024-09-12T18:26:45.866194+0000","last_active":"2024-09-12T19:13:57.485175+0000","last_peered":"2024-09-12T19:13:57.485175+0000","last_clean":"2024-09-12T19:13:57.485175+0000","last_became_active":"2024-09-12T18:26:45.865329+0000","last_became_peered":"2024-09-12T18:26:45.865329+0000","last_unstale":"2024-09-12T19:13:57.485175+0000","last_undegraded":"2024-09-12T19:13:57.485175+0000","last_fullsized":"2024-09-12T19:13:57.485175+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:49.534078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":1095,"num_write":382,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.929904+0000","last_change":"2024-09-12T18:26:47.891460+0000","last_active":"2024-09-12T19:11:08.929904+0000","last_peered":"2024-09-12T19:11:08.929904+0000","last_clean":"2024-09-12T19:11:08.929904+0000","last_became_active":"2024-09-12T18:26:47.890741+0000","last_became_peered":"2024-09-12T18:26:47.890741+0000","last_unstale":"2024-09-12T19:11:08.929904+0000","last_undegraded":"2024-09-12T19:11:08.929904+0000","last_fullsized":"2024-09-12T19:11:08.929904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:28:13.839409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'196","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.440206+0000","last_change":"2024-09-12T18:26:49.915054+0000","last_active":"2024-09-12T19:11:38.440206+0000","last_peered":"2024-09-12T19:11:38.440206+0000","last_clean":"2024-09-12T19:11:38.440206+0000","last_became_active":"2024-09-12T18:26:49.914506+0000","last_became_peered":"2024-09-12T18:26:49.914506+0000","last_unstale":"2024-09-12T19:11:38.440206+0000","last_undegraded":"2024-09-12T19:11:38.440206+0000","last_fullsized":"2024-09-12T19:11:38.440206+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:39.521599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":157,"num_write":456,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'903","reported_seq":2447,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.072876+0000","last_change":"2024-09-12T19:14:11.072876+0000","last_active":"2024-09-12T19:14:11.072876+0000","last_peered":"2024-09-12T19:14:11.072876+0000","last_clean":"2024-09-12T19:14:11.072876+0000","last_became_active":"2024-09-12T18:26:41.868082+0000","last_became_peered":"2024-09-12T18:26:41.868082+0000","last_unstale":"2024-09-12T19:14:11.072876+0000","last_undegraded":"2024-09-12T19:14:11.072876+0000","last_fullsized":"2024-09-12T19:14:11.072876+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'903","last_scrub_stamp":"2024-09-12T19:14:11.072670+0000","last_deep_scrub":"265'903","last_deep_scrub_stamp":"2024-09-12T19:14:11.072670+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.072670+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":800,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:29.244238+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4276,"num_read_kb":3807,"num_write":1253,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'386","reported_seq":1055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.818692+0000","last_change":"2024-09-12T19:14:11.818692+0000","last_active":"2024-09-12T19:14:11.818692+0000","last_peered":"2024-09-12T19:14:11.818692+0000","last_clean":"2024-09-12T19:14:11.818692+0000","last_became_active":"2024-09-12T18:26:39.869754+0000","last_became_peered":"2024-09-12T18:26:39.869754+0000","last_unstale":"2024-09-12T19:14:11.818692+0000","last_undegraded":"2024-09-12T19:14:11.818692+0000","last_fullsized":"2024-09-12T19:14:11.818692+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T19:14:11.818493+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T19:14:11.818493+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.818493+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:30.957800+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525344,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":32033,"num_write":1221,"num_write_kb":47606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"265'6","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.088539+0000","last_change":"2024-09-12T19:14:23.088539+0000","last_active":"2024-09-12T19:14:23.088539+0000","last_peered":"2024-09-12T19:14:23.088539+0000","last_clean":"2024-09-12T19:14:23.088539+0000","last_became_active":"2024-09-12T18:26:43.854155+0000","last_became_peered":"2024-09-12T18:26:43.854155+0000","last_unstale":"2024-09-12T19:14:23.088539+0000","last_undegraded":"2024-09-12T19:14:23.088539+0000","last_fullsized":"2024-09-12T19:14:23.088539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:23.088313+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:23.088313+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.088313+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:08.243249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'67","reported_seq":571,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.295664+0000","last_change":"2024-09-12T18:26:45.880353+0000","last_active":"2024-09-12T19:12:23.295664+0000","last_peered":"2024-09-12T19:12:23.295664+0000","last_clean":"2024-09-12T19:12:23.295664+0000","last_became_active":"2024-09-12T18:26:45.876785+0000","last_became_peered":"2024-09-12T18:26:45.876785+0000","last_unstale":"2024-09-12T19:12:23.295664+0000","last_undegraded":"2024-09-12T19:12:23.295664+0000","last_fullsized":"2024-09-12T19:12:23.295664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:09:44.259605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910233+0000","last_change":"2024-09-12T18:26:47.891685+0000","last_active":"2024-09-12T19:11:07.910233+0000","last_peered":"2024-09-12T19:11:07.910233+0000","last_clean":"2024-09-12T19:11:07.910233+0000","last_became_active":"2024-09-12T18:26:47.890879+0000","last_became_peered":"2024-09-12T18:26:47.890879+0000","last_unstale":"2024-09-12T19:11:07.910233+0000","last_undegraded":"2024-09-12T19:11:07.910233+0000","last_fullsized":"2024-09-12T19:11:07.910233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:38.226570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'240","reported_seq":769,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.298598+0000","last_change":"2024-09-12T18:26:49.926668+0000","last_active":"2024-09-12T19:12:23.298598+0000","last_peered":"2024-09-12T19:12:23.298598+0000","last_clean":"2024-09-12T19:12:23.298598+0000","last_became_active":"2024-09-12T18:26:49.925984+0000","last_became_peered":"2024-09-12T18:26:49.925984+0000","last_unstale":"2024-09-12T19:12:23.298598+0000","last_undegraded":"2024-09-12T19:12:23.298598+0000","last_fullsized":"2024-09-12T19:12:23.298598+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":350,"num_read_kb":337,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'464","reported_seq":2031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.936402+0000","last_change":"2024-09-12T19:14:17.936402+0000","last_active":"2024-09-12T19:14:17.936402+0000","last_peered":"2024-09-12T19:14:17.936402+0000","last_clean":"2024-09-12T19:14:17.936402+0000","last_became_active":"2024-09-12T18:26:41.881971+0000","last_became_peered":"2024-09-12T18:26:41.881971+0000","last_unstale":"2024-09-12T19:14:17.936402+0000","last_undegraded":"2024-09-12T19:14:17.936402+0000","last_fullsized":"2024-09-12T19:14:17.936402+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'464","last_scrub_stamp":"2024-09-12T19:14:17.936203+0000","last_deep_scrub":"265'464","last_deep_scrub_stamp":"2024-09-12T19:14:17.936203+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.936203+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:43.789540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2569,"num_read_kb":2413,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'356","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.537024+0000","last_change":"2024-09-12T19:14:08.537024+0000","last_active":"2024-09-12T19:14:08.537024+0000","last_peered":"2024-09-12T19:14:08.537024+0000","last_clean":"2024-09-12T19:14:08.537024+0000","last_became_active":"2024-09-12T18:26:39.873510+0000","last_became_peered":"2024-09-12T18:26:39.873510+0000","last_unstale":"2024-09-12T19:14:08.537024+0000","last_undegraded":"2024-09-12T19:14:08.537024+0000","last_fullsized":"2024-09-12T19:14:08.537024+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T19:14:08.536754+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T19:14:08.536754+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.536754+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:17.499997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":9367,"num_write":1141,"num_write_kb":22463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910172+0000","last_change":"2024-09-12T18:26:43.860596+0000","last_active":"2024-09-12T19:11:07.910172+0000","last_peered":"2024-09-12T19:11:07.910172+0000","last_clean":"2024-09-12T19:11:07.910172+0000","last_became_active":"2024-09-12T18:26:43.859847+0000","last_became_peered":"2024-09-12T18:26:43.859847+0000","last_unstale":"2024-09-12T19:11:07.910172+0000","last_undegraded":"2024-09-12T19:11:07.910172+0000","last_fullsized":"2024-09-12T19:11:07.910172+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:16.685561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'318","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.325144+0000","last_change":"2024-09-12T18:26:45.878384+0000","last_active":"2024-09-12T19:13:58.325144+0000","last_peered":"2024-09-12T19:13:58.325144+0000","last_clean":"2024-09-12T19:13:58.325144+0000","last_became_active":"2024-09-12T18:26:45.877790+0000","last_became_peered":"2024-09-12T18:26:45.877790+0000","last_unstale":"2024-09-12T19:13:58.325144+0000","last_undegraded":"2024-09-12T19:13:58.325144+0000","last_fullsized":"2024-09-12T19:13:58.325144+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:52:03.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53461,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1153,"num_write":418,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.906698+0000","last_change":"2024-09-12T18:26:47.888972+0000","last_active":"2024-09-12T19:11:08.906698+0000","last_peered":"2024-09-12T19:11:08.906698+0000","last_clean":"2024-09-12T19:11:08.906698+0000","last_became_active":"2024-09-12T18:26:47.888252+0000","last_became_peered":"2024-09-12T18:26:47.888252+0000","last_unstale":"2024-09-12T19:11:08.906698+0000","last_undegraded":"2024-09-12T19:11:08.906698+0000","last_fullsized":"2024-09-12T19:11:08.906698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:19:23.691736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'144","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:53.914139+0000","last_change":"2024-09-12T18:26:49.923128+0000","last_active":"2024-09-12T19:11:53.914139+0000","last_peered":"2024-09-12T19:11:53.914139+0000","last_clean":"2024-09-12T19:11:53.914139+0000","last_became_active":"2024-09-12T18:26:49.922459+0000","last_became_peered":"2024-09-12T18:26:49.922459+0000","last_unstale":"2024-09-12T19:11:53.914139+0000","last_undegraded":"2024-09-12T19:11:53.914139+0000","last_fullsized":"2024-09-12T19:11:53.914139+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":460,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":153,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'471","reported_seq":1980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.622655+0000","last_change":"2024-09-12T18:26:41.851184+0000","last_active":"2024-09-12T19:12:18.622655+0000","last_peered":"2024-09-12T19:12:18.622655+0000","last_clean":"2024-09-12T19:12:18.622655+0000","last_became_active":"2024-09-12T18:26:41.850749+0000","last_became_peered":"2024-09-12T18:26:41.850749+0000","last_unstale":"2024-09-12T19:12:18.622655+0000","last_undegraded":"2024-09-12T19:12:18.622655+0000","last_fullsized":"2024-09-12T19:12:18.622655+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:24:25.945669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2503,"num_read_kb":2331,"num_write":575,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'394","reported_seq":1061,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.877872+0000","last_change":"2024-09-12T19:14:04.877872+0000","last_active":"2024-09-12T19:14:04.877872+0000","last_peered":"2024-09-12T19:14:04.877872+0000","last_clean":"2024-09-12T19:14:04.877872+0000","last_became_active":"2024-09-12T18:26:39.854328+0000","last_became_peered":"2024-09-12T18:26:39.854328+0000","last_unstale":"2024-09-12T19:14:04.877872+0000","last_undegraded":"2024-09-12T19:14:04.877872+0000","last_fullsized":"2024-09-12T19:14:04.877872+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T19:14:04.877782+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T19:14:04.877782+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.877782+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:04.369955+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653632,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":578,"num_read_kb":9662,"num_write":1241,"num_write_kb":35097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.636565+0000","last_change":"2024-09-12T19:14:19.636565+0000","last_active":"2024-09-12T19:14:19.636565+0000","last_peered":"2024-09-12T19:14:19.636565+0000","last_clean":"2024-09-12T19:14:19.636565+0000","last_became_active":"2024-09-12T18:26:43.865454+0000","last_became_peered":"2024-09-12T18:26:43.865454+0000","last_unstale":"2024-09-12T19:14:19.636565+0000","last_undegraded":"2024-09-12T19:14:19.636565+0000","last_fullsized":"2024-09-12T19:14:19.636565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:19.636385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:19.636385+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.636385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:25.727508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'247","reported_seq":811,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.220497+0000","last_change":"2024-09-12T18:26:45.867830+0000","last_active":"2024-09-12T19:13:58.220497+0000","last_peered":"2024-09-12T19:13:58.220497+0000","last_clean":"2024-09-12T19:13:58.220497+0000","last_became_active":"2024-09-12T18:26:45.867096+0000","last_became_peered":"2024-09-12T18:26:45.867096+0000","last_unstale":"2024-09-12T19:13:58.220497+0000","last_undegraded":"2024-09-12T19:13:58.220497+0000","last_fullsized":"2024-09-12T19:13:58.220497+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:22.958792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50031,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":412,"num_read_kb":948,"num_write":330,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.932045+0000","last_change":"2024-09-12T18:26:47.895791+0000","last_active":"2024-09-12T19:11:08.932045+0000","last_peered":"2024-09-12T19:11:08.932045+0000","last_clean":"2024-09-12T19:11:08.932045+0000","last_became_active":"2024-09-12T18:26:47.895092+0000","last_became_peered":"2024-09-12T18:26:47.895092+0000","last_unstale":"2024-09-12T19:11:08.932045+0000","last_undegraded":"2024-09-12T19:11:08.932045+0000","last_fullsized":"2024-09-12T19:11:08.932045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:05.232441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'824","reported_seq":2430,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.626256+0000","last_change":"2024-09-12T19:14:13.626256+0000","last_active":"2024-09-12T19:14:13.626256+0000","last_peered":"2024-09-12T19:14:13.626256+0000","last_clean":"2024-09-12T19:14:13.626256+0000","last_became_active":"2024-09-12T18:26:41.871943+0000","last_became_peered":"2024-09-12T18:26:41.871943+0000","last_unstale":"2024-09-12T19:14:13.626256+0000","last_undegraded":"2024-09-12T19:14:13.626256+0000","last_fullsized":"2024-09-12T19:14:13.626256+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'824","last_scrub_stamp":"2024-09-12T19:14:13.626053+0000","last_deep_scrub":"265'824","last_deep_scrub_stamp":"2024-09-12T19:14:13.626053+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.626053+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.562273+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3898,"num_read_kb":3510,"num_write":1047,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'395","reported_seq":1099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.825137+0000","last_change":"2024-09-12T19:14:12.825137+0000","last_active":"2024-09-12T19:14:12.825137+0000","last_peered":"2024-09-12T19:14:12.825137+0000","last_clean":"2024-09-12T19:14:12.825137+0000","last_became_active":"2024-09-12T18:26:39.830963+0000","last_became_peered":"2024-09-12T18:26:39.830963+0000","last_unstale":"2024-09-12T19:14:12.825137+0000","last_undegraded":"2024-09-12T19:14:12.825137+0000","last_fullsized":"2024-09-12T19:14:12.825137+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'395","last_scrub_stamp":"2024-09-12T19:14:12.824911+0000","last_deep_scrub":"265'395","last_deep_scrub_stamp":"2024-09-12T19:14:12.824911+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.824911+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:52.488076+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1535921,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":35487,"num_write":1279,"num_write_kb":27084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.764872+0000","last_change":"2024-09-12T19:14:16.764872+0000","last_active":"2024-09-12T19:14:16.764872+0000","last_peered":"2024-09-12T19:14:16.764872+0000","last_clean":"2024-09-12T19:14:16.764872+0000","last_became_active":"2024-09-12T18:26:43.861521+0000","last_became_peered":"2024-09-12T18:26:43.861521+0000","last_unstale":"2024-09-12T19:14:16.764872+0000","last_undegraded":"2024-09-12T19:14:16.764872+0000","last_fullsized":"2024-09-12T19:14:16.764872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:16.764692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:16.764692+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.764692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:50.424087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'450","reported_seq":1081,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.188004+0000","last_change":"2024-09-12T18:26:45.873087+0000","last_active":"2024-09-12T19:13:58.188004+0000","last_peered":"2024-09-12T19:13:58.188004+0000","last_clean":"2024-09-12T19:13:58.188004+0000","last_became_active":"2024-09-12T18:26:45.872177+0000","last_became_peered":"2024-09-12T18:26:45.872177+0000","last_unstale":"2024-09-12T19:13:58.188004+0000","last_undegraded":"2024-09-12T19:13:58.188004+0000","last_fullsized":"2024-09-12T19:13:58.188004+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101880,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":818,"num_read_kb":1923,"num_write":698,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.912967+0000","last_change":"2024-09-12T18:26:47.903167+0000","last_active":"2024-09-12T19:11:48.912967+0000","last_peered":"2024-09-12T19:11:48.912967+0000","last_clean":"2024-09-12T19:11:48.912967+0000","last_became_active":"2024-09-12T18:26:47.902702+0000","last_became_peered":"2024-09-12T18:26:47.902702+0000","last_unstale":"2024-09-12T19:11:48.912967+0000","last_undegraded":"2024-09-12T19:11:48.912967+0000","last_fullsized":"2024-09-12T19:11:48.912967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'188","reported_seq":695,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.315741+0000","last_change":"2024-09-12T18:26:49.920882+0000","last_active":"2024-09-12T19:12:23.315741+0000","last_peered":"2024-09-12T19:12:23.315741+0000","last_clean":"2024-09-12T19:12:23.315741+0000","last_became_active":"2024-09-12T18:26:49.920066+0000","last_became_peered":"2024-09-12T18:26:49.920066+0000","last_unstale":"2024-09-12T19:12:23.315741+0000","last_undegraded":"2024-09-12T19:12:23.315741+0000","last_fullsized":"2024-09-12T19:12:23.315741+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:38.018526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":247,"num_read_kb":248,"num_write":459,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'766","reported_seq":2251,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.780033+0000","last_change":"2024-09-12T19:14:13.780033+0000","last_active":"2024-09-12T19:14:13.780033+0000","last_peered":"2024-09-12T19:14:13.780033+0000","last_clean":"2024-09-12T19:14:13.780033+0000","last_became_active":"2024-09-12T18:26:41.852157+0000","last_became_peered":"2024-09-12T18:26:41.852157+0000","last_unstale":"2024-09-12T19:14:13.780033+0000","last_undegraded":"2024-09-12T19:14:13.780033+0000","last_fullsized":"2024-09-12T19:14:13.780033+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'766","last_scrub_stamp":"2024-09-12T19:14:13.779803+0000","last_deep_scrub":"265'766","last_deep_scrub_stamp":"2024-09-12T19:14:13.779803+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.779803+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:23.013752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3590,"num_read_kb":3230,"num_write":1002,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'359","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.109273+0000","last_change":"2024-09-12T19:14:04.109273+0000","last_active":"2024-09-12T19:14:04.109273+0000","last_peered":"2024-09-12T19:14:04.109273+0000","last_clean":"2024-09-12T19:14:04.109273+0000","last_became_active":"2024-09-12T18:27:11.827218+0000","last_became_peered":"2024-09-12T18:27:11.827218+0000","last_unstale":"2024-09-12T19:14:04.109273+0000","last_undegraded":"2024-09-12T19:14:04.109273+0000","last_fullsized":"2024-09-12T19:14:04.109273+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-12T19:14:04.109120+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-12T19:14:04.109120+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.109120+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:11.700071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35618,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":7368,"num_write":1157,"num_write_kb":18791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.620223+0000","last_change":"2024-09-12T19:14:20.620223+0000","last_active":"2024-09-12T19:14:20.620223+0000","last_peered":"2024-09-12T19:14:20.620223+0000","last_clean":"2024-09-12T19:14:20.620223+0000","last_became_active":"2024-09-12T18:26:43.865319+0000","last_became_peered":"2024-09-12T18:26:43.865319+0000","last_unstale":"2024-09-12T19:14:20.620223+0000","last_undegraded":"2024-09-12T19:14:20.620223+0000","last_fullsized":"2024-09-12T19:14:20.620223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:20.620033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:20.620033+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.620033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:41.034438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'297","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.254404+0000","last_change":"2024-09-12T18:26:45.874050+0000","last_active":"2024-09-12T19:13:58.254404+0000","last_peered":"2024-09-12T19:13:58.254404+0000","last_clean":"2024-09-12T19:13:58.254404+0000","last_became_active":"2024-09-12T18:26:45.873197+0000","last_became_peered":"2024-09-12T18:26:45.873197+0000","last_unstale":"2024-09-12T19:13:58.254404+0000","last_undegraded":"2024-09-12T19:13:58.254404+0000","last_fullsized":"2024-09-12T19:13:58.254404+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55940,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":484,"num_read_kb":1049,"num_write":402,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:47.719924+0000","last_change":"2024-09-12T18:26:47.884995+0000","last_active":"2024-09-12T19:11:47.719924+0000","last_peered":"2024-09-12T19:11:47.719924+0000","last_clean":"2024-09-12T19:11:47.719924+0000","last_became_active":"2024-09-12T18:26:47.883930+0000","last_became_peered":"2024-09-12T18:26:47.883930+0000","last_unstale":"2024-09-12T19:11:47.719924+0000","last_undegraded":"2024-09-12T19:11:47.719924+0000","last_fullsized":"2024-09-12T19:11:47.719924+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'180","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:24.119927+0000","last_change":"2024-09-12T18:26:49.922518+0000","last_active":"2024-09-12T19:12:24.119927+0000","last_peered":"2024-09-12T19:12:24.119927+0000","last_clean":"2024-09-12T19:12:24.119927+0000","last_became_active":"2024-09-12T18:26:49.921797+0000","last_became_peered":"2024-09-12T18:26:49.921797+0000","last_unstale":"2024-09-12T19:12:24.119927+0000","last_undegraded":"2024-09-12T19:12:24.119927+0000","last_fullsized":"2024-09-12T19:12:24.119927+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:13.451147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1230,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":213,"num_write":519,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'510","reported_seq":1866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.874616+0000","last_change":"2024-09-12T19:14:14.874616+0000","last_active":"2024-09-12T19:14:14.874616+0000","last_peered":"2024-09-12T19:14:14.874616+0000","last_clean":"2024-09-12T19:14:14.874616+0000","last_became_active":"2024-09-12T18:26:41.850647+0000","last_became_peered":"2024-09-12T18:26:41.850647+0000","last_unstale":"2024-09-12T19:14:14.874616+0000","last_undegraded":"2024-09-12T19:14:14.874616+0000","last_fullsized":"2024-09-12T19:14:14.874616+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'510","last_scrub_stamp":"2024-09-12T19:14:14.874432+0000","last_deep_scrub":"265'510","last_deep_scrub_stamp":"2024-09-12T19:14:14.874432+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.874432+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:42.100953+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2444,"num_write":714,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'370","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.335302+0000","last_change":"2024-09-12T19:14:06.335158+0000","last_active":"2024-09-12T19:14:06.335302+0000","last_peered":"2024-09-12T19:14:06.335302+0000","last_clean":"2024-09-12T19:14:06.335302+0000","last_became_active":"2024-09-12T18:26:39.840458+0000","last_became_peered":"2024-09-12T18:26:39.840458+0000","last_unstale":"2024-09-12T19:14:06.335302+0000","last_undegraded":"2024-09-12T19:14:06.335302+0000","last_fullsized":"2024-09-12T19:14:06.335302+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T19:14:06.334888+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T19:14:06.334888+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.334888+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:55.530203+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":36107,"num_write":1118,"num_write_kb":45658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121396+0000","last_change":"2024-09-12T18:26:43.876974+0000","last_active":"2024-09-12T19:11:44.121396+0000","last_peered":"2024-09-12T19:11:44.121396+0000","last_clean":"2024-09-12T19:11:44.121396+0000","last_became_active":"2024-09-12T18:26:43.873669+0000","last_became_peered":"2024-09-12T18:26:43.873669+0000","last_unstale":"2024-09-12T19:11:44.121396+0000","last_undegraded":"2024-09-12T19:11:44.121396+0000","last_fullsized":"2024-09-12T19:11:44.121396+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'284","reported_seq":858,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.694187+0000","last_change":"2024-09-12T18:26:46.023642+0000","last_active":"2024-09-12T19:13:57.694187+0000","last_peered":"2024-09-12T19:13:57.694187+0000","last_clean":"2024-09-12T19:13:57.694187+0000","last_became_active":"2024-09-12T18:26:46.023025+0000","last_became_peered":"2024-09-12T18:26:46.023025+0000","last_unstale":"2024-09-12T19:13:57.694187+0000","last_undegraded":"2024-09-12T19:13:57.694187+0000","last_fullsized":"2024-09-12T19:13:57.694187+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:54:34.349134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44021,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":1142,"num_write":398,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:57.915384+0000","last_change":"2024-09-12T18:26:47.893458+0000","last_active":"2024-09-12T19:10:57.915384+0000","last_peered":"2024-09-12T19:10:57.915384+0000","last_clean":"2024-09-12T19:10:57.915384+0000","last_became_active":"2024-09-12T18:26:47.892678+0000","last_became_peered":"2024-09-12T18:26:47.892678+0000","last_unstale":"2024-09-12T19:10:57.915384+0000","last_undegraded":"2024-09-12T19:10:57.915384+0000","last_fullsized":"2024-09-12T19:10:57.915384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:22.345925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'113","reported_seq":596,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:44.000115+0000","last_change":"2024-09-12T18:26:49.919935+0000","last_active":"2024-09-12T19:13:44.000115+0000","last_peered":"2024-09-12T19:13:44.000115+0000","last_clean":"2024-09-12T19:13:44.000115+0000","last_became_active":"2024-09-12T18:26:49.919229+0000","last_became_peered":"2024-09-12T18:26:49.919229+0000","last_unstale":"2024-09-12T19:13:44.000115+0000","last_undegraded":"2024-09-12T19:13:44.000115+0000","last_fullsized":"2024-09-12T19:13:44.000115+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:52.637762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":95,"num_write":270,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'505","reported_seq":2215,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.051477+0000","last_change":"2024-09-12T19:14:09.051264+0000","last_active":"2024-09-12T19:14:09.051477+0000","last_peered":"2024-09-12T19:14:09.051477+0000","last_clean":"2024-09-12T19:14:09.051477+0000","last_became_active":"2024-09-12T18:26:41.844608+0000","last_became_peered":"2024-09-12T18:26:41.844608+0000","last_unstale":"2024-09-12T19:14:09.051477+0000","last_undegraded":"2024-09-12T19:14:09.051477+0000","last_fullsized":"2024-09-12T19:14:09.051477+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T19:14:09.051011+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T19:14:09.051011+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.051011+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:05.391256+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2752,"num_read_kb":2596,"num_write":594,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'356","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.038747+0000","last_change":"2024-09-12T19:14:05.038747+0000","last_active":"2024-09-12T19:14:05.038747+0000","last_peered":"2024-09-12T19:14:05.038747+0000","last_clean":"2024-09-12T19:14:05.038747+0000","last_became_active":"2024-09-12T18:27:11.807022+0000","last_became_peered":"2024-09-12T18:27:11.807022+0000","last_unstale":"2024-09-12T19:14:05.038747+0000","last_undegraded":"2024-09-12T19:14:05.038747+0000","last_fullsized":"2024-09-12T19:14:05.038747+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T19:14:05.038645+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T19:14:05.038645+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.038645+0000","objects_scrubbed":10,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:35.165624+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4711351,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":491,"num_read_kb":61134,"num_write":1039,"num_write_kb":46178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.189124+0000","last_change":"2024-09-12T19:14:18.189124+0000","last_active":"2024-09-12T19:14:18.189124+0000","last_peered":"2024-09-12T19:14:18.189124+0000","last_clean":"2024-09-12T19:14:18.189124+0000","last_became_active":"2024-09-12T18:26:43.859997+0000","last_became_peered":"2024-09-12T18:26:43.859997+0000","last_unstale":"2024-09-12T19:14:18.189124+0000","last_undegraded":"2024-09-12T19:14:18.189124+0000","last_fullsized":"2024-09-12T19:14:18.189124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:18.188935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:18.188935+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.188935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:37.056353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'90","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:21.975628+0000","last_change":"2024-09-12T18:26:46.022987+0000","last_active":"2024-09-12T19:11:21.975628+0000","last_peered":"2024-09-12T19:11:21.975628+0000","last_clean":"2024-09-12T19:11:21.975628+0000","last_became_active":"2024-09-12T18:26:46.022246+0000","last_became_peered":"2024-09-12T18:26:46.022246+0000","last_unstale":"2024-09-12T19:11:21.975628+0000","last_undegraded":"2024-09-12T19:11:21.975628+0000","last_fullsized":"2024-09-12T19:11:21.975628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:05.130410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":130,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'771","reported_seq":2310,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:58.035276+0000","last_change":"2024-09-12T18:26:47.894434+0000","last_active":"2024-09-12T19:13:58.035276+0000","last_peered":"2024-09-12T19:13:58.035276+0000","last_clean":"2024-09-12T19:13:58.035276+0000","last_became_active":"2024-09-12T18:26:47.891107+0000","last_became_peered":"2024-09-12T18:26:47.891107+0000","last_unstale":"2024-09-12T19:13:58.035276+0000","last_undegraded":"2024-09-12T19:13:58.035276+0000","last_fullsized":"2024-09-12T19:13:58.035276+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":701,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:30.324222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'114","reported_seq":603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.746554+0000","last_change":"2024-09-12T18:26:49.916767+0000","last_active":"2024-09-12T19:12:21.746554+0000","last_peered":"2024-09-12T19:12:21.746554+0000","last_clean":"2024-09-12T19:12:21.746554+0000","last_became_active":"2024-09-12T18:26:49.915975+0000","last_became_peered":"2024-09-12T18:26:49.915975+0000","last_unstale":"2024-09-12T19:12:21.746554+0000","last_undegraded":"2024-09-12T19:12:21.746554+0000","last_fullsized":"2024-09-12T19:12:21.746554+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:25:39.304415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":276,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'459","reported_seq":2189,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.267997+0000","last_change":"2024-09-12T19:14:17.267997+0000","last_active":"2024-09-12T19:14:17.267997+0000","last_peered":"2024-09-12T19:14:17.267997+0000","last_clean":"2024-09-12T19:14:17.267997+0000","last_became_active":"2024-09-12T18:26:41.853112+0000","last_became_peered":"2024-09-12T18:26:41.853112+0000","last_unstale":"2024-09-12T19:14:17.267997+0000","last_undegraded":"2024-09-12T19:14:17.267997+0000","last_fullsized":"2024-09-12T19:14:17.267997+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'459","last_scrub_stamp":"2024-09-12T19:14:17.267770+0000","last_deep_scrub":"265'459","last_deep_scrub_stamp":"2024-09-12T19:14:17.267770+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.267770+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:48.144249+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2539,"num_write":529,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'386","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.623237+0000","last_change":"2024-09-12T19:14:10.623072+0000","last_active":"2024-09-12T19:14:10.623237+0000","last_peered":"2024-09-12T19:14:10.623237+0000","last_clean":"2024-09-12T19:14:10.623237+0000","last_became_active":"2024-09-12T18:26:39.867136+0000","last_became_peered":"2024-09-12T18:26:39.867136+0000","last_unstale":"2024-09-12T19:14:10.623237+0000","last_undegraded":"2024-09-12T19:14:10.623237+0000","last_fullsized":"2024-09-12T19:14:10.623237+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T19:14:10.622850+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T19:14:10.622850+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.622850+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:12.986847+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":531,"num_read_kb":14806,"num_write":1141,"num_write_kb":34226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:47.919930+0000","last_change":"2024-09-12T18:26:43.877662+0000","last_active":"2024-09-12T19:11:47.919930+0000","last_peered":"2024-09-12T19:11:47.919930+0000","last_clean":"2024-09-12T19:11:47.919930+0000","last_became_active":"2024-09-12T18:26:43.876801+0000","last_became_peered":"2024-09-12T18:26:43.876801+0000","last_unstale":"2024-09-12T19:11:47.919930+0000","last_undegraded":"2024-09-12T19:11:47.919930+0000","last_fullsized":"2024-09-12T19:11:47.919930+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'294","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.924374+0000","last_change":"2024-09-12T18:26:45.873414+0000","last_active":"2024-09-12T19:13:57.924374+0000","last_peered":"2024-09-12T19:13:57.924374+0000","last_clean":"2024-09-12T19:13:57.924374+0000","last_became_active":"2024-09-12T18:26:45.872458+0000","last_became_peered":"2024-09-12T18:26:45.872458+0000","last_unstale":"2024-09-12T19:13:57.924374+0000","last_undegraded":"2024-09-12T19:13:57.924374+0000","last_fullsized":"2024-09-12T19:13:57.924374+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:15.684235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48239,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":1098,"num_write":396,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.918253+0000","last_change":"2024-09-12T18:26:47.895896+0000","last_active":"2024-09-12T19:10:18.918253+0000","last_peered":"2024-09-12T19:10:18.918253+0000","last_clean":"2024-09-12T19:10:18.918253+0000","last_became_active":"2024-09-12T18:26:47.894689+0000","last_became_peered":"2024-09-12T18:26:47.894689+0000","last_unstale":"2024-09-12T19:10:18.918253+0000","last_undegraded":"2024-09-12T19:10:18.918253+0000","last_fullsized":"2024-09-12T19:10:18.918253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:12.028473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'122","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.472125+0000","last_change":"2024-09-12T18:26:49.931294+0000","last_active":"2024-09-12T19:12:21.472125+0000","last_peered":"2024-09-12T19:12:21.472125+0000","last_clean":"2024-09-12T19:12:21.472125+0000","last_became_active":"2024-09-12T18:26:49.930794+0000","last_became_peered":"2024-09-12T18:26:49.930794+0000","last_unstale":"2024-09-12T19:12:21.472125+0000","last_undegraded":"2024-09-12T19:12:21.472125+0000","last_fullsized":"2024-09-12T19:12:21.472125+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:20.540895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":295,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'615","reported_seq":2283,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.306673+0000","last_change":"2024-09-12T19:14:16.306673+0000","last_active":"2024-09-12T19:14:16.306673+0000","last_peered":"2024-09-12T19:14:16.306673+0000","last_clean":"2024-09-12T19:14:16.306673+0000","last_became_active":"2024-09-12T18:26:41.856621+0000","last_became_peered":"2024-09-12T18:26:41.856621+0000","last_unstale":"2024-09-12T19:14:16.306673+0000","last_undegraded":"2024-09-12T19:14:16.306673+0000","last_fullsized":"2024-09-12T19:14:16.306673+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'615","last_scrub_stamp":"2024-09-12T19:14:16.306444+0000","last_deep_scrub":"265'615","last_deep_scrub_stamp":"2024-09-12T19:14:16.306444+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.306444+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:27.035273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3116,"num_read_kb":2841,"num_write":759,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'350","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.527370+0000","last_change":"2024-09-12T19:14:07.527194+0000","last_active":"2024-09-12T19:14:07.527370+0000","last_peered":"2024-09-12T19:14:07.527370+0000","last_clean":"2024-09-12T19:14:07.527370+0000","last_became_active":"2024-09-12T18:26:39.861108+0000","last_became_peered":"2024-09-12T18:26:39.861108+0000","last_unstale":"2024-09-12T19:14:07.527370+0000","last_undegraded":"2024-09-12T19:14:07.527370+0000","last_fullsized":"2024-09-12T19:14:07.527370+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-12T19:14:07.526998+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-12T19:14:07.526998+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.526998+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:41.778291+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":32271,"num_write":997,"num_write_kb":22718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.911680+0000","last_change":"2024-09-12T18:26:43.861093+0000","last_active":"2024-09-12T19:11:43.911680+0000","last_peered":"2024-09-12T19:11:43.911680+0000","last_clean":"2024-09-12T19:11:43.911680+0000","last_became_active":"2024-09-12T18:26:43.860336+0000","last_became_peered":"2024-09-12T18:26:43.860336+0000","last_unstale":"2024-09-12T19:11:43.911680+0000","last_undegraded":"2024-09-12T19:11:43.911680+0000","last_fullsized":"2024-09-12T19:11:43.911680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'286","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.963187+0000","last_change":"2024-09-12T18:26:45.881839+0000","last_active":"2024-09-12T19:13:57.963187+0000","last_peered":"2024-09-12T19:13:57.963187+0000","last_clean":"2024-09-12T19:13:57.963187+0000","last_became_active":"2024-09-12T18:26:45.881364+0000","last_became_peered":"2024-09-12T18:26:45.881364+0000","last_unstale":"2024-09-12T19:13:57.963187+0000","last_undegraded":"2024-09-12T19:13:57.963187+0000","last_fullsized":"2024-09-12T19:13:57.963187+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:54.998693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1088,"num_write":384,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":483,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.898023+0000","last_change":"2024-09-12T18:26:47.888719+0000","last_active":"2024-09-12T19:10:28.898023+0000","last_peered":"2024-09-12T19:10:28.898023+0000","last_clean":"2024-09-12T19:10:28.898023+0000","last_became_active":"2024-09-12T18:26:47.888055+0000","last_became_peered":"2024-09-12T18:26:47.888055+0000","last_unstale":"2024-09-12T19:10:28.898023+0000","last_undegraded":"2024-09-12T19:10:28.898023+0000","last_fullsized":"2024-09-12T19:10:28.898023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:33.128326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.320073+0000","last_change":"2024-09-12T18:26:49.923335+0000","last_active":"2024-09-12T19:12:23.320073+0000","last_peered":"2024-09-12T19:12:23.320073+0000","last_clean":"2024-09-12T19:12:23.320073+0000","last_became_active":"2024-09-12T18:26:49.922543+0000","last_became_peered":"2024-09-12T18:26:49.922543+0000","last_unstale":"2024-09-12T19:12:23.320073+0000","last_undegraded":"2024-09-12T19:12:23.320073+0000","last_fullsized":"2024-09-12T19:12:23.320073+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:22:23.453107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":203,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'473","reported_seq":2067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.004828+0000","last_change":"2024-09-12T19:14:21.004828+0000","last_active":"2024-09-12T19:14:21.004828+0000","last_peered":"2024-09-12T19:14:21.004828+0000","last_clean":"2024-09-12T19:14:21.004828+0000","last_became_active":"2024-09-12T18:26:41.850499+0000","last_became_peered":"2024-09-12T18:26:41.850499+0000","last_unstale":"2024-09-12T19:14:21.004828+0000","last_undegraded":"2024-09-12T19:14:21.004828+0000","last_fullsized":"2024-09-12T19:14:21.004828+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T19:14:21.004635+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T19:14:21.004635+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.004635+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:17.985937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2536,"num_read_kb":2375,"num_write":558,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2075,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'330","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.923865+0000","last_change":"2024-09-12T19:14:15.923865+0000","last_active":"2024-09-12T19:14:15.923865+0000","last_peered":"2024-09-12T19:14:15.923865+0000","last_clean":"2024-09-12T19:14:15.923865+0000","last_became_active":"2024-09-12T18:26:39.847422+0000","last_became_peered":"2024-09-12T18:26:39.847422+0000","last_unstale":"2024-09-12T19:14:15.923865+0000","last_undegraded":"2024-09-12T19:14:15.923865+0000","last_fullsized":"2024-09-12T19:14:15.923865+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T19:14:15.923637+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T19:14:15.923637+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.923637+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:08.399373+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568138,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":20074,"num_write":1068,"num_write_kb":42638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:14.101283+0000","last_change":"2024-09-12T18:26:43.875901+0000","last_active":"2024-09-12T19:10:14.101283+0000","last_peered":"2024-09-12T19:10:14.101283+0000","last_clean":"2024-09-12T19:10:14.101283+0000","last_became_active":"2024-09-12T18:26:43.874881+0000","last_became_peered":"2024-09-12T18:26:43.874881+0000","last_unstale":"2024-09-12T19:10:14.101283+0000","last_undegraded":"2024-09-12T19:10:14.101283+0000","last_fullsized":"2024-09-12T19:10:14.101283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:42.824712+0000","last_clean_scrub_stamp":"2024-09-12T18:26:42.824712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:20:20.082733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'274","reported_seq":830,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.613383+0000","last_change":"2024-09-12T18:26:45.865460+0000","last_active":"2024-09-12T19:13:57.613383+0000","last_peered":"2024-09-12T19:13:57.613383+0000","last_clean":"2024-09-12T19:13:57.613383+0000","last_became_active":"2024-09-12T18:26:45.864264+0000","last_became_peered":"2024-09-12T18:26:45.864264+0000","last_unstale":"2024-09-12T19:13:57.613383+0000","last_undegraded":"2024-09-12T19:13:57.613383+0000","last_fullsized":"2024-09-12T19:13:57.613383+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49732,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":471,"num_read_kb":1179,"num_write":398,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:49.122517+0000","last_change":"2024-09-12T18:26:47.882838+0000","last_active":"2024-09-12T19:11:49.122517+0000","last_peered":"2024-09-12T19:11:49.122517+0000","last_clean":"2024-09-12T19:11:49.122517+0000","last_became_active":"2024-09-12T18:26:47.882094+0000","last_became_peered":"2024-09-12T18:26:47.882094+0000","last_unstale":"2024-09-12T19:11:49.122517+0000","last_undegraded":"2024-09-12T19:11:49.122517+0000","last_fullsized":"2024-09-12T19:11:49.122517+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'194","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:21.741958+0000","last_change":"2024-09-12T18:26:49.921917+0000","last_active":"2024-09-12T19:12:21.741958+0000","last_peered":"2024-09-12T19:12:21.741958+0000","last_clean":"2024-09-12T19:12:21.741958+0000","last_became_active":"2024-09-12T18:26:49.920808+0000","last_became_peered":"2024-09-12T18:26:49.920808+0000","last_unstale":"2024-09-12T19:12:21.741958+0000","last_undegraded":"2024-09-12T19:12:21.741958+0000","last_fullsized":"2024-09-12T19:12:21.741958+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:30:38.677600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1188,"num_read_kb":1184,"num_write":433,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'794","reported_seq":2301,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.291683+0000","last_change":"2024-09-12T19:14:13.291683+0000","last_active":"2024-09-12T19:14:13.291683+0000","last_peered":"2024-09-12T19:14:13.291683+0000","last_clean":"2024-09-12T19:14:13.291683+0000","last_became_active":"2024-09-12T18:26:41.873690+0000","last_became_peered":"2024-09-12T18:26:41.873690+0000","last_unstale":"2024-09-12T19:14:13.291683+0000","last_undegraded":"2024-09-12T19:14:13.291683+0000","last_fullsized":"2024-09-12T19:14:13.291683+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'794","last_scrub_stamp":"2024-09-12T19:14:13.291444+0000","last_deep_scrub":"265'794","last_deep_scrub_stamp":"2024-09-12T19:14:13.291444+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.291444+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.167004+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3645,"num_read_kb":3278,"num_write":1029,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'366","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.869008+0000","last_change":"2024-09-12T19:14:05.869008+0000","last_active":"2024-09-12T19:14:05.869008+0000","last_peered":"2024-09-12T19:14:05.869008+0000","last_clean":"2024-09-12T19:14:05.869008+0000","last_became_active":"2024-09-12T18:27:11.829577+0000","last_became_peered":"2024-09-12T18:27:11.829577+0000","last_unstale":"2024-09-12T19:14:05.869008+0000","last_undegraded":"2024-09-12T19:14:05.869008+0000","last_fullsized":"2024-09-12T19:14:05.869008+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T19:14:05.868750+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T19:14:05.868750+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.868750+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:24.728613+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513384,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":509,"num_read_kb":8019,"num_write":1212,"num_write_kb":33613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.215657+0000","last_change":"2024-09-12T19:14:19.215657+0000","last_active":"2024-09-12T19:14:19.215657+0000","last_peered":"2024-09-12T19:14:19.215657+0000","last_clean":"2024-09-12T19:14:19.215657+0000","last_became_active":"2024-09-12T18:26:43.864719+0000","last_became_peered":"2024-09-12T18:26:43.864719+0000","last_unstale":"2024-09-12T19:14:19.215657+0000","last_undegraded":"2024-09-12T19:14:19.215657+0000","last_fullsized":"2024-09-12T19:14:19.215657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:19.215472+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:19.215472+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.215472+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:05.760013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'306","reported_seq":894,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.735340+0000","last_change":"2024-09-12T18:26:45.866467+0000","last_active":"2024-09-12T19:13:57.735340+0000","last_peered":"2024-09-12T19:13:57.735340+0000","last_clean":"2024-09-12T19:13:57.735340+0000","last_became_active":"2024-09-12T18:26:45.865711+0000","last_became_peered":"2024-09-12T18:26:45.865711+0000","last_unstale":"2024-09-12T19:13:57.735340+0000","last_undegraded":"2024-09-12T19:13:57.735340+0000","last_fullsized":"2024-09-12T19:13:57.735340+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:44.830681+0000","last_clean_scrub_stamp":"2024-09-12T18:26:44.830681+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47780,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1144,"num_write":416,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.941985+0000","last_change":"2024-09-12T18:26:47.883801+0000","last_active":"2024-09-12T19:11:48.941985+0000","last_peered":"2024-09-12T19:11:48.941985+0000","last_clean":"2024-09-12T19:11:48.941985+0000","last_became_active":"2024-09-12T18:26:47.883014+0000","last_became_peered":"2024-09-12T18:26:47.883014+0000","last_unstale":"2024-09-12T19:11:48.941985+0000","last_undegraded":"2024-09-12T19:11:48.941985+0000","last_fullsized":"2024-09-12T19:11:48.941985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:46.839187+0000","last_clean_scrub_stamp":"2024-09-12T18:26:46.839187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'106","reported_seq":609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.102109+0000","last_change":"2024-09-12T18:26:49.922286+0000","last_active":"2024-09-12T19:13:43.102109+0000","last_peered":"2024-09-12T19:13:43.102109+0000","last_clean":"2024-09-12T19:13:43.102109+0000","last_became_active":"2024-09-12T18:26:49.921636+0000","last_became_peered":"2024-09-12T18:26:49.921636+0000","last_unstale":"2024-09-12T19:13:43.102109+0000","last_undegraded":"2024-09-12T19:13:43.102109+0000","last_fullsized":"2024-09-12T19:13:43.102109+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:32:07.594133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":621,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":107,"num_write":252,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'1276","reported_seq":3089,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.158163+0000","last_change":"2024-09-12T19:14:15.157980+0000","last_active":"2024-09-12T19:14:15.158163+0000","last_peered":"2024-09-12T19:14:15.158163+0000","last_clean":"2024-09-12T19:14:15.158163+0000","last_became_active":"2024-09-12T18:26:41.872455+0000","last_became_peered":"2024-09-12T18:26:41.872455+0000","last_unstale":"2024-09-12T19:14:15.158163+0000","last_undegraded":"2024-09-12T19:14:15.158163+0000","last_fullsized":"2024-09-12T19:14:15.158163+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1276","last_scrub_stamp":"2024-09-12T19:14:15.157805+0000","last_deep_scrub":"265'1276","last_deep_scrub_stamp":"2024-09-12T19:14:15.157805+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.157805+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":1200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:47.614559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6298,"num_read_kb":5578,"num_write":1816,"num_write_kb":809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'415","reported_seq":1115,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.516055+0000","last_change":"2024-09-12T19:14:07.516055+0000","last_active":"2024-09-12T19:14:07.516055+0000","last_peered":"2024-09-12T19:14:07.516055+0000","last_clean":"2024-09-12T19:14:07.516055+0000","last_became_active":"2024-09-12T18:26:39.847954+0000","last_became_peered":"2024-09-12T18:26:39.847954+0000","last_unstale":"2024-09-12T19:14:07.516055+0000","last_undegraded":"2024-09-12T19:14:07.516055+0000","last_fullsized":"2024-09-12T19:14:07.516055+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'415","last_scrub_stamp":"2024-09-12T19:14:07.515758+0000","last_deep_scrub":"265'415","last_deep_scrub_stamp":"2024-09-12T19:14:07.515758+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.515758+0000","objects_scrubbed":11,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:44.678357+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263330,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":589,"num_read_kb":77066,"num_write":1254,"num_write_kb":41008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'506","reported_seq":2159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.163931+0000","last_change":"2024-09-12T19:14:17.163693+0000","last_active":"2024-09-12T19:14:17.163931+0000","last_peered":"2024-09-12T19:14:17.163931+0000","last_clean":"2024-09-12T19:14:17.163931+0000","last_became_active":"2024-09-12T18:26:41.846040+0000","last_became_peered":"2024-09-12T18:26:41.846040+0000","last_unstale":"2024-09-12T19:14:17.163931+0000","last_undegraded":"2024-09-12T19:14:17.163931+0000","last_fullsized":"2024-09-12T19:14:17.163931+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'506","last_scrub_stamp":"2024-09-12T19:14:17.163451+0000","last_deep_scrub":"265'506","last_deep_scrub_stamp":"2024-09-12T19:14:17.163451+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.163451+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:17.436750+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2703,"num_read_kb":2531,"num_write":592,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'383","reported_seq":1105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.072667+0000","last_change":"2024-09-12T19:14:06.072667+0000","last_active":"2024-09-12T19:14:06.072667+0000","last_peered":"2024-09-12T19:14:06.072667+0000","last_clean":"2024-09-12T19:14:06.072667+0000","last_became_active":"2024-09-12T18:26:39.846028+0000","last_became_peered":"2024-09-12T18:26:39.846028+0000","last_unstale":"2024-09-12T19:14:06.072667+0000","last_undegraded":"2024-09-12T19:14:06.072667+0000","last_fullsized":"2024-09-12T19:14:06.072667+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T19:14:06.072441+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T19:14:06.072441+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.072441+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:27.496097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":778,"num_read_kb":5622,"num_write":1176,"num_write_kb":40701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'518","reported_seq":2050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.449208+0000","last_change":"2024-09-12T19:14:19.449064+0000","last_active":"2024-09-12T19:14:19.449208+0000","last_peered":"2024-09-12T19:14:19.449208+0000","last_clean":"2024-09-12T19:14:19.449208+0000","last_became_active":"2024-09-12T18:26:41.884394+0000","last_became_peered":"2024-09-12T18:26:41.884394+0000","last_unstale":"2024-09-12T19:14:19.449208+0000","last_undegraded":"2024-09-12T19:14:19.449208+0000","last_fullsized":"2024-09-12T19:14:19.449208+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'518","last_scrub_stamp":"2024-09-12T19:14:19.448882+0000","last_deep_scrub":"265'518","last_deep_scrub_stamp":"2024-09-12T19:14:19.448882+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.448882+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:45.429300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2704,"num_read_kb":2505,"num_write":657,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'348","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.576657+0000","last_change":"2024-09-12T19:14:09.576657+0000","last_active":"2024-09-12T19:14:09.576657+0000","last_peered":"2024-09-12T19:14:09.576657+0000","last_clean":"2024-09-12T19:14:09.576657+0000","last_became_active":"2024-09-12T18:26:39.856026+0000","last_became_peered":"2024-09-12T18:26:39.856026+0000","last_unstale":"2024-09-12T19:14:09.576657+0000","last_undegraded":"2024-09-12T19:14:09.576657+0000","last_fullsized":"2024-09-12T19:14:09.576657+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T19:14:09.576403+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T19:14:09.576403+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.576403+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:49.231864+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136883,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":16869,"num_write":1087,"num_write_kb":23838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'540","reported_seq":2164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.152123+0000","last_change":"2024-09-12T19:14:21.151938+0000","last_active":"2024-09-12T19:14:21.152123+0000","last_peered":"2024-09-12T19:14:21.152123+0000","last_clean":"2024-09-12T19:14:21.152123+0000","last_became_active":"2024-09-12T18:26:41.850519+0000","last_became_peered":"2024-09-12T18:26:41.850519+0000","last_unstale":"2024-09-12T19:14:21.152123+0000","last_undegraded":"2024-09-12T19:14:21.152123+0000","last_fullsized":"2024-09-12T19:14:21.152123+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'540","last_scrub_stamp":"2024-09-12T19:14:21.151755+0000","last_deep_scrub":"265'540","last_deep_scrub_stamp":"2024-09-12T19:14:21.151755+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.151755+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:23.137225+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2864,"num_read_kb":2647,"num_write":672,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'356","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.828101+0000","last_change":"2024-09-12T19:14:10.828101+0000","last_active":"2024-09-12T19:14:10.828101+0000","last_peered":"2024-09-12T19:14:10.828101+0000","last_clean":"2024-09-12T19:14:10.828101+0000","last_became_active":"2024-09-12T18:26:39.842852+0000","last_became_peered":"2024-09-12T18:26:39.842852+0000","last_unstale":"2024-09-12T19:14:10.828101+0000","last_undegraded":"2024-09-12T19:14:10.828101+0000","last_fullsized":"2024-09-12T19:14:10.828101+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T19:14:10.827863+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T19:14:10.827863+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.827863+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:51.034300+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524303,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":35620,"num_write":1162,"num_write_kb":31566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'816","reported_seq":2361,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.953680+0000","last_change":"2024-09-12T19:14:16.953680+0000","last_active":"2024-09-12T19:14:16.953680+0000","last_peered":"2024-09-12T19:14:16.953680+0000","last_clean":"2024-09-12T19:14:16.953680+0000","last_became_active":"2024-09-12T18:26:41.882458+0000","last_became_peered":"2024-09-12T18:26:41.882458+0000","last_unstale":"2024-09-12T19:14:16.953680+0000","last_undegraded":"2024-09-12T19:14:16.953680+0000","last_fullsized":"2024-09-12T19:14:16.953680+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'816","last_scrub_stamp":"2024-09-12T19:14:16.953485+0000","last_deep_scrub":"265'816","last_deep_scrub_stamp":"2024-09-12T19:14:16.953485+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.953485+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:39.442346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3832,"num_read_kb":3447,"num_write":1071,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'338","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.763905+0000","last_change":"2024-09-12T19:14:05.763769+0000","last_active":"2024-09-12T19:14:05.763905+0000","last_peered":"2024-09-12T19:14:05.763905+0000","last_clean":"2024-09-12T19:14:05.763905+0000","last_became_active":"2024-09-12T18:26:39.855654+0000","last_became_peered":"2024-09-12T18:26:39.855654+0000","last_unstale":"2024-09-12T19:14:05.763905+0000","last_undegraded":"2024-09-12T19:14:05.763905+0000","last_fullsized":"2024-09-12T19:14:05.763905+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'338","last_scrub_stamp":"2024-09-12T19:14:05.763566+0000","last_deep_scrub":"265'338","last_deep_scrub_stamp":"2024-09-12T19:14:05.763566+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.763566+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:37.605894+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":592,"num_read_kb":6402,"num_write":1048,"num_write_kb":32224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'1224","reported_seq":2865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.258534+0000","last_change":"2024-09-12T19:14:18.258534+0000","last_active":"2024-09-12T19:14:18.258534+0000","last_peered":"2024-09-12T19:14:18.258534+0000","last_clean":"2024-09-12T19:14:18.258534+0000","last_became_active":"2024-09-12T18:26:41.876138+0000","last_became_peered":"2024-09-12T18:26:41.876138+0000","last_unstale":"2024-09-12T19:14:18.258534+0000","last_undegraded":"2024-09-12T19:14:18.258534+0000","last_fullsized":"2024-09-12T19:14:18.258534+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1224","last_scrub_stamp":"2024-09-12T19:14:18.258312+0000","last_deep_scrub":"265'1224","last_deep_scrub_stamp":"2024-09-12T19:14:18.258312+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.258312+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":1200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:16.154638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4890,"num_write":1674,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'314","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.063931+0000","last_change":"2024-09-12T19:14:05.063835+0000","last_active":"2024-09-12T19:14:05.063931+0000","last_peered":"2024-09-12T19:14:05.063931+0000","last_clean":"2024-09-12T19:14:05.063931+0000","last_became_active":"2024-09-12T18:26:39.844346+0000","last_became_peered":"2024-09-12T18:26:39.844346+0000","last_unstale":"2024-09-12T19:14:05.063931+0000","last_undegraded":"2024-09-12T19:14:05.063931+0000","last_fullsized":"2024-09-12T19:14:05.063931+0000","mapping_epoch":24,"log_start":"265'301","ondisk_log_start":"265'301","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-12T19:14:05.063699+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-12T19:14:05.063699+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.063699+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":301,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:23.183938+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":67178,"num_write":993,"num_write_kb":30033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'745","reported_seq":2199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.035158+0000","last_change":"2024-09-12T19:14:08.035158+0000","last_active":"2024-09-12T19:14:08.035158+0000","last_peered":"2024-09-12T19:14:08.035158+0000","last_clean":"2024-09-12T19:14:08.035158+0000","last_became_active":"2024-09-12T18:27:11.823747+0000","last_became_peered":"2024-09-12T18:27:11.823747+0000","last_unstale":"2024-09-12T19:14:08.035158+0000","last_undegraded":"2024-09-12T19:14:08.035158+0000","last_fullsized":"2024-09-12T19:14:08.035158+0000","mapping_epoch":37,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'745","last_scrub_stamp":"2024-09-12T19:14:08.034931+0000","last_deep_scrub":"265'745","last_deep_scrub_stamp":"2024-09-12T19:14:08.034931+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.034931+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:31.331294+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3535,"num_read_kb":3187,"num_write":978,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"265'340","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.585320+0000","last_change":"2024-09-12T19:14:11.585184+0000","last_active":"2024-09-12T19:14:11.585320+0000","last_peered":"2024-09-12T19:14:11.585320+0000","last_clean":"2024-09-12T19:14:11.585320+0000","last_became_active":"2024-09-12T18:26:39.871119+0000","last_became_peered":"2024-09-12T18:26:39.871119+0000","last_unstale":"2024-09-12T19:14:11.585320+0000","last_undegraded":"2024-09-12T19:14:11.585320+0000","last_fullsized":"2024-09-12T19:14:11.585320+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T19:14:11.584993+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T19:14:11.584993+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.584993+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:59.549191+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695310,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":8461,"num_write":1111,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'1067","reported_seq":2782,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.623962+0000","last_change":"2024-09-12T19:14:14.623962+0000","last_active":"2024-09-12T19:14:14.623962+0000","last_peered":"2024-09-12T19:14:14.623962+0000","last_clean":"2024-09-12T19:14:14.623962+0000","last_became_active":"2024-09-12T18:26:41.863607+0000","last_became_peered":"2024-09-12T18:26:41.863607+0000","last_unstale":"2024-09-12T19:14:14.623962+0000","last_undegraded":"2024-09-12T19:14:14.623962+0000","last_fullsized":"2024-09-12T19:14:14.623962+0000","mapping_epoch":26,"log_start":"265'1000","ondisk_log_start":"265'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1067","last_scrub_stamp":"2024-09-12T19:14:14.623754+0000","last_deep_scrub":"265'1067","last_deep_scrub_stamp":"2024-09-12T19:14:14.623754+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.623754+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":1000,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:14.209154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5203,"num_read_kb":4615,"num_write":1535,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1418,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'347","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.809761+0000","last_change":"2024-09-12T19:14:06.809689+0000","last_active":"2024-09-12T19:14:06.809761+0000","last_peered":"2024-09-12T19:14:06.809761+0000","last_clean":"2024-09-12T19:14:06.809761+0000","last_became_active":"2024-09-12T18:26:39.827475+0000","last_became_peered":"2024-09-12T18:26:39.827475+0000","last_unstale":"2024-09-12T19:14:06.809761+0000","last_undegraded":"2024-09-12T19:14:06.809761+0000","last_fullsized":"2024-09-12T19:14:06.809761+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T19:14:06.809544+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T19:14:06.809544+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.809544+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:35.789447+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136911,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":492,"num_read_kb":48337,"num_write":1107,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'826","reported_seq":2446,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.731033+0000","last_change":"2024-09-12T19:14:19.731033+0000","last_active":"2024-09-12T19:14:19.731033+0000","last_peered":"2024-09-12T19:14:19.731033+0000","last_clean":"2024-09-12T19:14:19.731033+0000","last_became_active":"2024-09-12T18:26:41.851080+0000","last_became_peered":"2024-09-12T18:26:41.851080+0000","last_unstale":"2024-09-12T19:14:19.731033+0000","last_undegraded":"2024-09-12T19:14:19.731033+0000","last_fullsized":"2024-09-12T19:14:19.731033+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'826","last_scrub_stamp":"2024-09-12T19:14:19.730759+0000","last_deep_scrub":"265'826","last_deep_scrub_stamp":"2024-09-12T19:14:19.730759+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.730759+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:22.313239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4015,"num_read_kb":3626,"num_write":1096,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'362","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.617777+0000","last_change":"2024-09-12T19:14:11.617777+0000","last_active":"2024-09-12T19:14:11.617777+0000","last_peered":"2024-09-12T19:14:11.617777+0000","last_clean":"2024-09-12T19:14:11.617777+0000","last_became_active":"2024-09-12T18:26:39.849722+0000","last_became_peered":"2024-09-12T18:26:39.849722+0000","last_unstale":"2024-09-12T19:14:11.617777+0000","last_undegraded":"2024-09-12T19:14:11.617777+0000","last_fullsized":"2024-09-12T19:14:11.617777+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T19:14:11.617565+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T19:14:11.617565+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.617565+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:32.390820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":40604,"num_write":1102,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'396","reported_seq":1935,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.331338+0000","last_change":"2024-09-12T19:14:20.331338+0000","last_active":"2024-09-12T19:14:20.331338+0000","last_peered":"2024-09-12T19:14:20.331338+0000","last_clean":"2024-09-12T19:14:20.331338+0000","last_became_active":"2024-09-12T18:26:41.851159+0000","last_became_peered":"2024-09-12T18:26:41.851159+0000","last_unstale":"2024-09-12T19:14:20.331338+0000","last_undegraded":"2024-09-12T19:14:20.331338+0000","last_fullsized":"2024-09-12T19:14:20.331338+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'396","last_scrub_stamp":"2024-09-12T19:14:20.331149+0000","last_deep_scrub":"265'396","last_deep_scrub_stamp":"2024-09-12T19:14:20.331149+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.331149+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:03.216872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2139,"num_read_kb":2047,"num_write":455,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'312","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.866891+0000","last_change":"2024-09-12T19:14:13.866891+0000","last_active":"2024-09-12T19:14:13.866891+0000","last_peered":"2024-09-12T19:14:13.866891+0000","last_clean":"2024-09-12T19:14:13.866891+0000","last_became_active":"2024-09-12T18:26:39.827933+0000","last_became_peered":"2024-09-12T18:26:39.827933+0000","last_unstale":"2024-09-12T19:14:13.866891+0000","last_undegraded":"2024-09-12T19:14:13.866891+0000","last_fullsized":"2024-09-12T19:14:13.866891+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T19:14:13.866679+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T19:14:13.866679+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.866679+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:05.360145+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":423,"num_read_kb":364,"num_write":936,"num_write_kb":38290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'1178","reported_seq":2814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.081400+0000","last_change":"2024-09-12T19:14:10.081400+0000","last_active":"2024-09-12T19:14:10.081400+0000","last_peered":"2024-09-12T19:14:10.081400+0000","last_clean":"2024-09-12T19:14:10.081400+0000","last_became_active":"2024-09-12T18:26:41.872816+0000","last_became_peered":"2024-09-12T18:26:41.872816+0000","last_unstale":"2024-09-12T19:14:10.081400+0000","last_undegraded":"2024-09-12T19:14:10.081400+0000","last_fullsized":"2024-09-12T19:14:10.081400+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1178","last_scrub_stamp":"2024-09-12T19:14:10.081223+0000","last_deep_scrub":"265'1178","last_deep_scrub_stamp":"2024-09-12T19:14:10.081223+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.081223+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:17.777350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5354,"num_read_kb":4741,"num_write":1604,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'309","reported_seq":902,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.028067+0000","last_change":"2024-09-12T19:14:07.028067+0000","last_active":"2024-09-12T19:14:07.028067+0000","last_peered":"2024-09-12T19:14:07.028067+0000","last_clean":"2024-09-12T19:14:07.028067+0000","last_became_active":"2024-09-12T18:27:12.005906+0000","last_became_peered":"2024-09-12T18:27:12.005906+0000","last_unstale":"2024-09-12T19:14:07.028067+0000","last_undegraded":"2024-09-12T19:14:07.028067+0000","last_fullsized":"2024-09-12T19:14:07.028067+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-12T19:14:07.027874+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-12T19:14:07.027874+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.027874+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:58.637085+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":9281,"num_write":1029,"num_write_kb":40338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"265'421","reported_seq":1878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.299205+0000","last_change":"2024-09-12T19:14:19.299205+0000","last_active":"2024-09-12T19:14:19.299205+0000","last_peered":"2024-09-12T19:14:19.299205+0000","last_clean":"2024-09-12T19:14:19.299205+0000","last_became_active":"2024-09-12T18:26:41.866602+0000","last_became_peered":"2024-09-12T18:26:41.866602+0000","last_unstale":"2024-09-12T19:14:19.299205+0000","last_undegraded":"2024-09-12T19:14:19.299205+0000","last_fullsized":"2024-09-12T19:14:19.299205+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T19:14:19.298966+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T19:14:19.298966+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.298966+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:05.474113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2028,"num_write":492,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'368","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.808721+0000","last_change":"2024-09-12T19:14:12.808721+0000","last_active":"2024-09-12T19:14:12.808721+0000","last_peered":"2024-09-12T19:14:12.808721+0000","last_clean":"2024-09-12T19:14:12.808721+0000","last_became_active":"2024-09-12T18:26:39.871626+0000","last_became_peered":"2024-09-12T18:26:39.871626+0000","last_unstale":"2024-09-12T19:14:12.808721+0000","last_undegraded":"2024-09-12T19:14:12.808721+0000","last_fullsized":"2024-09-12T19:14:12.808721+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T19:14:12.808485+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T19:14:12.808485+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.808485+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:25.920885+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2185594,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":15528,"num_write":1112,"num_write_kb":35488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'1249","reported_seq":2895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.880698+0000","last_change":"2024-09-12T19:14:21.880698+0000","last_active":"2024-09-12T19:14:21.880698+0000","last_peered":"2024-09-12T19:14:21.880698+0000","last_clean":"2024-09-12T19:14:21.880698+0000","last_became_active":"2024-09-12T18:26:41.876708+0000","last_became_peered":"2024-09-12T18:26:41.876708+0000","last_unstale":"2024-09-12T19:14:21.880698+0000","last_undegraded":"2024-09-12T19:14:21.880698+0000","last_fullsized":"2024-09-12T19:14:21.880698+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1249","last_scrub_stamp":"2024-09-12T19:14:21.880516+0000","last_deep_scrub":"265'1249","last_deep_scrub_stamp":"2024-09-12T19:14:21.880516+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.880516+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":1200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:42.174249+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5682,"num_read_kb":5005,"num_write":1690,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'330","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.568489+0000","last_change":"2024-09-12T19:14:09.568489+0000","last_active":"2024-09-12T19:14:09.568489+0000","last_peered":"2024-09-12T19:14:09.568489+0000","last_clean":"2024-09-12T19:14:09.568489+0000","last_became_active":"2024-09-12T18:26:39.857956+0000","last_became_peered":"2024-09-12T18:26:39.857956+0000","last_unstale":"2024-09-12T19:14:09.568489+0000","last_undegraded":"2024-09-12T19:14:09.568489+0000","last_fullsized":"2024-09-12T19:14:09.568489+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T19:14:09.568184+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T19:14:09.568184+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.568184+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:20.538784+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2580367,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":492,"num_read_kb":32197,"num_write":944,"num_write_kb":38029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'899","reported_seq":2603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.791367+0000","last_change":"2024-09-12T19:14:17.791367+0000","last_active":"2024-09-12T19:14:17.791367+0000","last_peered":"2024-09-12T19:14:17.791367+0000","last_clean":"2024-09-12T19:14:17.791367+0000","last_became_active":"2024-09-12T18:26:41.854471+0000","last_became_peered":"2024-09-12T18:26:41.854471+0000","last_unstale":"2024-09-12T19:14:17.791367+0000","last_undegraded":"2024-09-12T19:14:17.791367+0000","last_fullsized":"2024-09-12T19:14:17.791367+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'899","last_scrub_stamp":"2024-09-12T19:14:17.791192+0000","last_deep_scrub":"265'899","last_deep_scrub_stamp":"2024-09-12T19:14:17.791192+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.791192+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:01.381428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4435,"num_read_kb":4011,"num_write":1173,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'389","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.836040+0000","last_change":"2024-09-12T19:14:13.836040+0000","last_active":"2024-09-12T19:14:13.836040+0000","last_peered":"2024-09-12T19:14:13.836040+0000","last_clean":"2024-09-12T19:14:13.836040+0000","last_became_active":"2024-09-12T18:26:39.869924+0000","last_became_peered":"2024-09-12T18:26:39.869924+0000","last_unstale":"2024-09-12T19:14:13.836040+0000","last_undegraded":"2024-09-12T19:14:13.836040+0000","last_fullsized":"2024-09-12T19:14:13.836040+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'389","last_scrub_stamp":"2024-09-12T19:14:13.835820+0000","last_deep_scrub":"265'389","last_deep_scrub_stamp":"2024-09-12T19:14:13.835820+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.835820+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:38.231301+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399013,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":35584,"num_write":1226,"num_write_kb":36960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'684","reported_seq":2474,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:18.623661+0000","last_change":"2024-09-12T18:26:41.858693+0000","last_active":"2024-09-12T19:12:18.623661+0000","last_peered":"2024-09-12T19:12:18.623661+0000","last_clean":"2024-09-12T19:12:18.623661+0000","last_became_active":"2024-09-12T18:26:41.858362+0000","last_became_peered":"2024-09-12T18:26:41.858362+0000","last_unstale":"2024-09-12T19:12:18.623661+0000","last_undegraded":"2024-09-12T19:12:18.623661+0000","last_fullsized":"2024-09-12T19:12:18.623661+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:40.812345+0000","last_clean_scrub_stamp":"2024-09-12T18:26:40.812345+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":600,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:42.785349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3672,"num_read_kb":3341,"num_write":924,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'426","reported_seq":1217,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.038483+0000","last_change":"2024-09-12T19:14:12.038483+0000","last_active":"2024-09-12T19:14:12.038483+0000","last_peered":"2024-09-12T19:14:12.038483+0000","last_clean":"2024-09-12T19:14:12.038483+0000","last_became_active":"2024-09-12T18:26:39.847373+0000","last_became_peered":"2024-09-12T18:26:39.847373+0000","last_unstale":"2024-09-12T19:14:12.038483+0000","last_undegraded":"2024-09-12T19:14:12.038483+0000","last_fullsized":"2024-09-12T19:14:12.038483+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'426","last_scrub_stamp":"2024-09-12T19:14:12.038294+0000","last_deep_scrub":"265'426","last_deep_scrub_stamp":"2024-09-12T19:14:12.038294+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.038294+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:28.497991+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":812,"num_read_kb":75472,"num_write":1417,"num_write_kb":36911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'826","reported_seq":2400,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.850884+0000","last_change":"2024-09-12T19:14:19.850884+0000","last_active":"2024-09-12T19:14:19.850884+0000","last_peered":"2024-09-12T19:14:19.850884+0000","last_clean":"2024-09-12T19:14:19.850884+0000","last_became_active":"2024-09-12T18:26:41.871610+0000","last_became_peered":"2024-09-12T18:26:41.871610+0000","last_unstale":"2024-09-12T19:14:19.850884+0000","last_undegraded":"2024-09-12T19:14:19.850884+0000","last_fullsized":"2024-09-12T19:14:19.850884+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'826","last_scrub_stamp":"2024-09-12T19:14:19.850704+0000","last_deep_scrub":"265'826","last_deep_scrub_stamp":"2024-09-12T19:14:19.850704+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.850704+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:40.802958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3622,"num_write":1076,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'288","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.625440+0000","last_change":"2024-09-12T19:14:12.625440+0000","last_active":"2024-09-12T19:14:12.625440+0000","last_peered":"2024-09-12T19:14:12.625440+0000","last_clean":"2024-09-12T19:14:12.625440+0000","last_became_active":"2024-09-12T18:26:39.874710+0000","last_became_peered":"2024-09-12T18:26:39.874710+0000","last_unstale":"2024-09-12T19:14:12.625440+0000","last_undegraded":"2024-09-12T19:14:12.625440+0000","last_fullsized":"2024-09-12T19:14:12.625440+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'288","last_scrub_stamp":"2024-09-12T19:14:12.625246+0000","last_deep_scrub":"265'288","last_deep_scrub_stamp":"2024-09-12T19:14:12.625246+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.625246+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:05.154814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":12735,"num_write":942,"num_write_kb":23796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'359","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.643734+0000","last_change":"2024-09-12T19:14:14.643734+0000","last_active":"2024-09-12T19:14:14.643734+0000","last_peered":"2024-09-12T19:14:14.643734+0000","last_clean":"2024-09-12T19:14:14.643734+0000","last_became_active":"2024-09-12T18:26:39.846477+0000","last_became_peered":"2024-09-12T18:26:39.846477+0000","last_unstale":"2024-09-12T19:14:14.643734+0000","last_undegraded":"2024-09-12T19:14:14.643734+0000","last_fullsized":"2024-09-12T19:14:14.643734+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-12T19:14:14.643507+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-12T19:14:14.643507+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.643507+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:48.800351+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":32398,"num_write":1027,"num_write_kb":24916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'405","reported_seq":1878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.711466+0000","last_change":"2024-09-12T19:14:20.711466+0000","last_active":"2024-09-12T19:14:20.711466+0000","last_peered":"2024-09-12T19:14:20.711466+0000","last_clean":"2024-09-12T19:14:20.711466+0000","last_became_active":"2024-09-12T18:26:41.851295+0000","last_became_peered":"2024-09-12T18:26:41.851295+0000","last_unstale":"2024-09-12T19:14:20.711466+0000","last_undegraded":"2024-09-12T19:14:20.711466+0000","last_fullsized":"2024-09-12T19:14:20.711466+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-12T19:14:20.711236+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-12T19:14:20.711236+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.711236+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:44.617496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":455,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'322","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.037157+0000","last_change":"2024-09-12T19:14:07.037157+0000","last_active":"2024-09-12T19:14:07.037157+0000","last_peered":"2024-09-12T19:14:07.037157+0000","last_clean":"2024-09-12T19:14:07.037157+0000","last_became_active":"2024-09-12T18:26:39.857009+0000","last_became_peered":"2024-09-12T18:26:39.857009+0000","last_unstale":"2024-09-12T19:14:07.037157+0000","last_undegraded":"2024-09-12T19:14:07.037157+0000","last_fullsized":"2024-09-12T19:14:07.037157+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T19:14:07.036972+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T19:14:07.036972+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.036972+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:28.775839+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2355888,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":55513,"num_write":945,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'377","reported_seq":1773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.366487+0000","last_change":"2024-09-12T19:14:21.366487+0000","last_active":"2024-09-12T19:14:21.366487+0000","last_peered":"2024-09-12T19:14:21.366487+0000","last_clean":"2024-09-12T19:14:21.366487+0000","last_became_active":"2024-09-12T18:26:41.872448+0000","last_became_peered":"2024-09-12T18:26:41.872448+0000","last_unstale":"2024-09-12T19:14:21.366487+0000","last_undegraded":"2024-09-12T19:14:21.366487+0000","last_fullsized":"2024-09-12T19:14:21.366487+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:14:21.366307+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:14:21.366307+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.366307+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:53.119707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1946,"num_read_kb":1855,"num_write":441,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6147,"num_read_kb":4433,"num_write":1993,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":964,"ondisk_log_size":964,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":14976,"num_read_kb":14648,"num_write":16787,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1653,"ondisk_log_size":1653,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":572,"ondisk_log_size":572,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1597681,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17400,"num_read_kb":36744,"num_write":14589,"num_write_kb":11628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10824,"num_omap_keys":26,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2142,"ondisk_log_size":2142,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212286,"num_read_kb":193833,"num_write":55194,"num_write_kb":18759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":37101,"num_omap_keys":152,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4044,"ondisk_log_size":4044,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":64167064,"num_objects":372,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":372,"num_whiteouts":0,"num_read":36315,"num_read_kb":1882823,"num_write":72228,"num_write_kb":2144860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":129474560,"data_stored":128334128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3882,"ondisk_log_size":3882,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":214446,"num_write":192,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":201134,"num_write":192,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510022,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262572,"kb_used_data":10652,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94109268,"statfs":{"total":96636764160,"available":96367890432,"internally_reserved":0,"allocated":10907648,"data_stored":9282789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257948102},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510022,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131840,"kb_used_data":10480,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94240000,"statfs":{"total":96636764160,"available":96501760000,"internally_reserved":0,"allocated":10731520,"data_stored":9041400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510023,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92808,"kb_used_data":29688,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94279032,"statfs":{"total":96636764160,"available":96541728768,"internally_reserved":0,"allocated":30400512,"data_stored":28782462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510020,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266872,"kb_used_data":10792,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94104968,"statfs":{"total":96636764160,"available":96363487232,"internally_reserved":0,"allocated":11051008,"data_stored":9395858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510020,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95984,"kb_used_data":14880,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94275856,"statfs":{"total":96636764160,"available":96538476544,"internally_reserved":0,"allocated":15237120,"data_stored":13690985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510020,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284940,"kb_used_data":33084,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94086900,"statfs":{"total":96636764160,"available":96344985600,"internally_reserved":0,"allocated":33878016,"data_stored":32185380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":257882568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542727,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292816,"kb_used_data":18688,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94079024,"statfs":{"total":96636764160,"available":96336920576,"internally_reserved":0,"allocated":19136512,"data_stored":17444491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542725,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":167376,"kb_used_data":27968,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94204464,"statfs":{"total":96636764160,"available":96465371136,"internally_reserved":0,"allocated":28639232,"data_stored":27068681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29601792,"data_stored":29420904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24977408,"data_stored":24897183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11599872,"data_stored":11518686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7376896,"data_stored":7222226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26800128,"data_stored":26613106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7016448,"data_stored":6869386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7270400,"data_stored":7112125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14831616,"data_stored":14680512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:14:26.434 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.434 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.434 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.435 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.435 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.435 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.435 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.435 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.435 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.435 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.435 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.436 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.436 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.436 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.436 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.436 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.436 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.436 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.437 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.437 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.437 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.437 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.437 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.437 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.437 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.437 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.438 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.438 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.438 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.438 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.438 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.438 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.438 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.438 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.438 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.439 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.439 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.439 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.439 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.439 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.439 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.439 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.439 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.439 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.440 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.440 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.440 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.440 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.440 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.440 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.440 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.440 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.441 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.441 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.441 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.441 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.441 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.441 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.441 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.441 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.441 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.442 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.442 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.442 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.442 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.442 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.442 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.443 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.443 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.443 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.443 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.443 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.443 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.443 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.443 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.443 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.444 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.444 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.444 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.444 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.444 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.444 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.444 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.444 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.445 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.445 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.445 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.445 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.445 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.445 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.445 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.445 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.445 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.446 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.446 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.446 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.446 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.446 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.446 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.447 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.447 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.447 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.447 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.447 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.447 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.447 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.447 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.447 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.448 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.448 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.448 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.448 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.448 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.448 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.448 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.448 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.448 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.449 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.449 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.449 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.449 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.449 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.449 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.449 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.449 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.450 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.450 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.450 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.450 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.450 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.450 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.450 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.451 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.451 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.451 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.451 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.451 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.451 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.451 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.452 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.452 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.452 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.452 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.452 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.452 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.452 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.452 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.452 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.453 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.453 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.453 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.453 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.453 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.453 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.453 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.454 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.454 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.454 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.454 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.454 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.454 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.454 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.455 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.455 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.455 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.455 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.455 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.455 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.455 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.455 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.456 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.456 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.456 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.456 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.456 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.456 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.457 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.457 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.457 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.457 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.457 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.457 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.457 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.458 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.458 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.458 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.458 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.458 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.458 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.458 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.458 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.459 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.459 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.459 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.459 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.459 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.459 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.459 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.459 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.460 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.460 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.460 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.460 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.460 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.460 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.460 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.461 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.461 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.461 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.461 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.461 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.461 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.461 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.461 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.462 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.462 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.462 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.462 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.462 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.462 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.463 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.463 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.463 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.463 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.463 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.463 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.463 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T18:26:42.824712+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.464 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.464 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.464 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.464 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T18:26:44.830681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.464 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T18:26:46.839187+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.464 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.465 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T18:26:40.812345+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=40, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:26.465 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:14:46.466 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:14:46.829 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:14:46.847 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-09-12T19:14:46.858 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":1712,"stamp":"2024-09-12T19:14:46.471752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":66372370,"num_objects":839,"num_object_clones":0,"num_object_copies":1678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":839,"num_whiteouts":0,"num_read":289963,"num_read_kb":2550992,"num_write":161318,"num_write_kb":2466794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":726776,"num_omap_keys":1779,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13585,"ondisk_log_size":13585,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1595208,"kb_used_data":156232,"kb_used_omap":12,"kb_used_meta":1438835,"kb_avail":753379512,"statfs":{"total":773094113280,"available":771460620288,"internally_reserved":0,"allocated":159981568,"data_stored":146892046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1473367603},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18298,"num_omap_keys":49,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009485"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.893148+0000","last_change":"2024-09-12T18:55:19.125750+0000","last_active":"2024-09-12T19:10:18.893148+0000","last_peered":"2024-09-12T19:10:18.893148+0000","last_clean":"2024-09-12T19:10:18.893148+0000","last_became_active":"2024-09-12T18:55:19.125009+0000","last_became_peered":"2024-09-12T18:55:19.125009+0000","last_unstale":"2024-09-12T19:10:18.893148+0000","last_undegraded":"2024-09-12T19:10:18.893148+0000","last_fullsized":"2024-09-12T19:10:18.893148+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:07.599229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'7","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.902941+0000","last_change":"2024-09-12T18:43:32.909745+0000","last_active":"2024-09-12T19:11:03.902941+0000","last_peered":"2024-09-12T19:11:03.902941+0000","last_clean":"2024-09-12T19:11:03.902941+0000","last_became_active":"2024-09-12T18:43:32.908691+0000","last_became_peered":"2024-09-12T18:43:32.908691+0000","last_unstale":"2024-09-12T19:11:03.902941+0000","last_undegraded":"2024-09-12T19:11:03.902941+0000","last_fullsized":"2024-09-12T19:11:03.902941+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:19.818191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.926901+0000","last_change":"2024-09-12T18:43:29.867175+0000","last_active":"2024-09-12T19:10:58.926901+0000","last_peered":"2024-09-12T19:10:58.926901+0000","last_clean":"2024-09-12T19:10:58.926901+0000","last_became_active":"2024-09-12T18:43:29.866493+0000","last_became_peered":"2024-09-12T18:43:29.866493+0000","last_unstale":"2024-09-12T19:10:58.926901+0000","last_undegraded":"2024-09-12T19:10:58.926901+0000","last_fullsized":"2024-09-12T19:10:58.926901+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:56.771077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'18","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:58.928758+0000","last_change":"2024-09-12T18:41:45.362583+0000","last_active":"2024-09-12T19:10:58.928758+0000","last_peered":"2024-09-12T19:10:58.928758+0000","last_clean":"2024-09-12T19:10:58.928758+0000","last_became_active":"2024-09-12T18:41:45.361841+0000","last_became_peered":"2024-09-12T18:41:45.361841+0000","last_unstale":"2024-09-12T19:10:58.928758+0000","last_undegraded":"2024-09-12T19:10:58.928758+0000","last_fullsized":"2024-09-12T19:10:58.928758+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:49:31.032849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":66,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.893323+0000","last_change":"2024-09-12T19:14:33.893323+0000","last_active":"2024-09-12T19:14:33.893323+0000","last_peered":"2024-09-12T19:14:33.893323+0000","last_clean":"2024-09-12T19:14:33.893323+0000","last_became_active":"2024-09-12T18:55:19.150059+0000","last_became_peered":"2024-09-12T18:55:19.150059+0000","last_unstale":"2024-09-12T19:14:33.893323+0000","last_undegraded":"2024-09-12T19:14:33.893323+0000","last_fullsized":"2024-09-12T19:14:33.893323+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:33.893119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:33.893119+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.893119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:17.600330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'4","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:34.145528+0000","last_change":"2024-09-12T18:43:32.905639+0000","last_active":"2024-09-12T19:13:34.145528+0000","last_peered":"2024-09-12T19:13:34.145528+0000","last_clean":"2024-09-12T19:13:34.145528+0000","last_became_active":"2024-09-12T18:43:32.904914+0000","last_became_peered":"2024-09-12T18:43:32.904914+0000","last_unstale":"2024-09-12T19:13:34.145528+0000","last_undegraded":"2024-09-12T19:13:34.145528+0000","last_fullsized":"2024-09-12T19:13:34.145528+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:47.857125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'3","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.240294+0000","last_change":"2024-09-12T19:14:36.240294+0000","last_active":"2024-09-12T19:14:36.240294+0000","last_peered":"2024-09-12T19:14:36.240294+0000","last_clean":"2024-09-12T19:14:36.240294+0000","last_became_active":"2024-09-12T18:43:29.891221+0000","last_became_peered":"2024-09-12T18:43:29.891221+0000","last_unstale":"2024-09-12T19:14:36.240294+0000","last_undegraded":"2024-09-12T19:14:36.240294+0000","last_fullsized":"2024-09-12T19:14:36.240294+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T19:14:36.240122+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T19:14:36.240122+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.240122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:05.077317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'32","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.892397+0000","last_change":"2024-09-12T19:14:25.892397+0000","last_active":"2024-09-12T19:14:25.892397+0000","last_peered":"2024-09-12T19:14:25.892397+0000","last_clean":"2024-09-12T19:14:25.892397+0000","last_became_active":"2024-09-12T18:41:45.361664+0000","last_became_peered":"2024-09-12T18:41:45.361664+0000","last_unstale":"2024-09-12T19:14:25.892397+0000","last_undegraded":"2024-09-12T19:14:25.892397+0000","last_fullsized":"2024-09-12T19:14:25.892397+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T19:14:25.892204+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T19:14:25.892204+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.892204+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:20.883904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.603743+0000","last_change":"2024-09-12T19:14:42.603743+0000","last_active":"2024-09-12T19:14:42.603743+0000","last_peered":"2024-09-12T19:14:42.603743+0000","last_clean":"2024-09-12T19:14:42.603743+0000","last_became_active":"2024-09-12T18:55:19.119601+0000","last_became_peered":"2024-09-12T18:55:19.119601+0000","last_unstale":"2024-09-12T19:14:42.603743+0000","last_undegraded":"2024-09-12T19:14:42.603743+0000","last_fullsized":"2024-09-12T19:14:42.603743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:42.603555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:42.603555+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.603555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:44.001319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'8","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.956039+0000","last_change":"2024-09-12T18:43:32.917442+0000","last_active":"2024-09-12T19:12:43.956039+0000","last_peered":"2024-09-12T19:12:43.956039+0000","last_clean":"2024-09-12T19:12:43.956039+0000","last_became_active":"2024-09-12T18:43:32.916727+0000","last_became_peered":"2024-09-12T18:43:32.916727+0000","last_unstale":"2024-09-12T19:12:43.956039+0000","last_undegraded":"2024-09-12T19:12:43.956039+0000","last_fullsized":"2024-09-12T19:12:43.956039+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:51.785407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"265'17","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.867868+0000","last_change":"2024-09-12T19:14:30.867868+0000","last_active":"2024-09-12T19:14:30.867868+0000","last_peered":"2024-09-12T19:14:30.867868+0000","last_clean":"2024-09-12T19:14:30.867868+0000","last_became_active":"2024-09-12T18:43:29.881401+0000","last_became_peered":"2024-09-12T18:43:29.881401+0000","last_unstale":"2024-09-12T19:14:30.867868+0000","last_undegraded":"2024-09-12T19:14:30.867868+0000","last_fullsized":"2024-09-12T19:14:30.867868+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-12T19:14:30.867685+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-12T19:14:30.867685+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.867685+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:04.890149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":40962,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'47","reported_seq":174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.942050+0000","last_change":"2024-09-12T18:41:45.360114+0000","last_active":"2024-09-12T19:11:48.942050+0000","last_peered":"2024-09-12T19:11:48.942050+0000","last_clean":"2024-09-12T19:11:48.942050+0000","last_became_active":"2024-09-12T18:41:45.350377+0000","last_became_peered":"2024-09-12T18:41:45.350377+0000","last_unstale":"2024-09-12T19:11:48.942050+0000","last_undegraded":"2024-09-12T19:11:48.942050+0000","last_fullsized":"2024-09-12T19:11:48.942050+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":164,"num_write":88,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:09:53.910960+0000","last_change":"2024-09-12T18:55:19.136469+0000","last_active":"2024-09-12T19:09:53.910960+0000","last_peered":"2024-09-12T19:09:53.910960+0000","last_clean":"2024-09-12T19:09:53.910960+0000","last_became_active":"2024-09-12T18:55:19.135875+0000","last_became_peered":"2024-09-12T18:55:19.135875+0000","last_unstale":"2024-09-12T19:09:53.910960+0000","last_undegraded":"2024-09-12T19:09:53.910960+0000","last_fullsized":"2024-09-12T19:09:53.910960+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:42:50.008510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:43.741846+0000","last_change":"2024-09-12T18:43:32.939294+0000","last_active":"2024-09-12T19:13:43.741846+0000","last_peered":"2024-09-12T19:13:43.741846+0000","last_clean":"2024-09-12T19:13:43.741846+0000","last_became_active":"2024-09-12T18:43:32.935176+0000","last_became_peered":"2024-09-12T18:43:32.935176+0000","last_unstale":"2024-09-12T19:13:43.741846+0000","last_undegraded":"2024-09-12T19:13:43.741846+0000","last_fullsized":"2024-09-12T19:13:43.741846+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:27.896775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'7","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.348285+0000","last_change":"2024-09-12T18:43:29.873805+0000","last_active":"2024-09-12T19:13:57.348285+0000","last_peered":"2024-09-12T19:13:57.348285+0000","last_clean":"2024-09-12T19:13:57.348285+0000","last_became_active":"2024-09-12T18:43:29.873115+0000","last_became_peered":"2024-09-12T18:43:29.873115+0000","last_unstale":"2024-09-12T19:13:57.348285+0000","last_undegraded":"2024-09-12T19:13:57.348285+0000","last_fullsized":"2024-09-12T19:13:57.348285+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:22.098039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'47","reported_seq":169,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.717386+0000","last_change":"2024-09-12T18:41:45.350781+0000","last_active":"2024-09-12T19:11:48.717386+0000","last_peered":"2024-09-12T19:11:48.717386+0000","last_clean":"2024-09-12T19:11:48.717386+0000","last_became_active":"2024-09-12T18:41:45.350035+0000","last_became_peered":"2024-09-12T18:41:45.350035+0000","last_unstale":"2024-09-12T19:11:48.717386+0000","last_undegraded":"2024-09-12T19:11:48.717386+0000","last_fullsized":"2024-09-12T19:11:48.717386+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":157,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:28.712218+0000","last_change":"2024-09-12T18:55:19.157689+0000","last_active":"2024-09-12T19:11:28.712218+0000","last_peered":"2024-09-12T19:11:28.712218+0000","last_clean":"2024-09-12T19:11:28.712218+0000","last_became_active":"2024-09-12T18:55:19.156936+0000","last_became_peered":"2024-09-12T18:55:19.156936+0000","last_unstale":"2024-09-12T19:11:28.712218+0000","last_undegraded":"2024-09-12T19:11:28.712218+0000","last_fullsized":"2024-09-12T19:11:28.712218+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:02.316107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:18.893085+0000","last_change":"2024-09-12T18:43:32.931532+0000","last_active":"2024-09-12T19:10:18.893085+0000","last_peered":"2024-09-12T19:10:18.893085+0000","last_clean":"2024-09-12T19:10:18.893085+0000","last_became_active":"2024-09-12T18:43:32.930772+0000","last_became_peered":"2024-09-12T18:43:32.930772+0000","last_unstale":"2024-09-12T19:10:18.893085+0000","last_undegraded":"2024-09-12T19:10:18.893085+0000","last_fullsized":"2024-09-12T19:10:18.893085+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:02.364155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:33.952929+0000","last_change":"2024-09-12T18:43:29.884425+0000","last_active":"2024-09-12T19:12:33.952929+0000","last_peered":"2024-09-12T19:12:33.952929+0000","last_clean":"2024-09-12T19:12:33.952929+0000","last_became_active":"2024-09-12T18:43:29.883399+0000","last_became_peered":"2024-09-12T18:43:29.883399+0000","last_unstale":"2024-09-12T19:12:33.952929+0000","last_undegraded":"2024-09-12T19:12:33.952929+0000","last_fullsized":"2024-09-12T19:12:33.952929+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:29:31.245225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'25","reported_seq":117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:48.717215+0000","last_change":"2024-09-12T18:41:45.359067+0000","last_active":"2024-09-12T19:11:48.717215+0000","last_peered":"2024-09-12T19:11:48.717215+0000","last_clean":"2024-09-12T19:11:48.717215+0000","last_became_active":"2024-09-12T18:41:45.355180+0000","last_became_peered":"2024-09-12T18:41:45.355180+0000","last_unstale":"2024-09-12T19:11:48.717215+0000","last_undegraded":"2024-09-12T19:11:48.717215+0000","last_fullsized":"2024-09-12T19:11:48.717215+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:02.723412+0000","last_change":"2024-09-12T18:55:19.139208+0000","last_active":"2024-09-12T19:12:02.723412+0000","last_peered":"2024-09-12T19:12:02.723412+0000","last_clean":"2024-09-12T19:12:02.723412+0000","last_became_active":"2024-09-12T18:55:19.138472+0000","last_became_peered":"2024-09-12T18:55:19.138472+0000","last_unstale":"2024-09-12T19:12:02.723412+0000","last_undegraded":"2024-09-12T19:12:02.723412+0000","last_fullsized":"2024-09-12T19:12:02.723412+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.593109+0000","last_change":"2024-09-12T19:14:39.593109+0000","last_active":"2024-09-12T19:14:39.593109+0000","last_peered":"2024-09-12T19:14:39.593109+0000","last_clean":"2024-09-12T19:14:39.593109+0000","last_became_active":"2024-09-12T18:43:32.935898+0000","last_became_peered":"2024-09-12T18:43:32.935898+0000","last_unstale":"2024-09-12T19:14:39.593109+0000","last_undegraded":"2024-09-12T19:14:39.593109+0000","last_fullsized":"2024-09-12T19:14:39.593109+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:39.592923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:39.592923+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.592923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:09.296334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'2","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:34.132279+0000","last_change":"2024-09-12T18:43:29.885221+0000","last_active":"2024-09-12T19:12:34.132279+0000","last_peered":"2024-09-12T19:12:34.132279+0000","last_clean":"2024-09-12T19:12:34.132279+0000","last_became_active":"2024-09-12T18:43:29.882621+0000","last_became_peered":"2024-09-12T18:43:29.882621+0000","last_unstale":"2024-09-12T19:12:34.132279+0000","last_undegraded":"2024-09-12T19:12:34.132279+0000","last_fullsized":"2024-09-12T19:12:34.132279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:41.071383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'16","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.591269+0000","last_change":"2024-09-12T19:14:34.591269+0000","last_active":"2024-09-12T19:14:34.591269+0000","last_peered":"2024-09-12T19:14:34.591269+0000","last_clean":"2024-09-12T19:14:34.591269+0000","last_became_active":"2024-09-12T18:41:45.357957+0000","last_became_peered":"2024-09-12T18:41:45.357957+0000","last_unstale":"2024-09-12T19:14:34.591269+0000","last_undegraded":"2024-09-12T19:14:34.591269+0000","last_fullsized":"2024-09-12T19:14:34.591269+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'16","last_scrub_stamp":"2024-09-12T19:14:34.591083+0000","last_deep_scrub":"265'16","last_deep_scrub_stamp":"2024-09-12T19:14:34.591083+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.591083+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:57.301977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":53,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899753+0000","last_change":"2024-09-12T18:55:19.148993+0000","last_active":"2024-09-12T19:10:22.899753+0000","last_peered":"2024-09-12T19:10:22.899753+0000","last_clean":"2024-09-12T19:10:22.899753+0000","last_became_active":"2024-09-12T18:55:19.147110+0000","last_became_peered":"2024-09-12T18:55:19.147110+0000","last_unstale":"2024-09-12T19:10:22.899753+0000","last_undegraded":"2024-09-12T19:10:22.899753+0000","last_fullsized":"2024-09-12T19:10:22.899753+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:46.858987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.634793+0000","last_change":"2024-09-12T19:14:40.634793+0000","last_active":"2024-09-12T19:14:40.634793+0000","last_peered":"2024-09-12T19:14:40.634793+0000","last_clean":"2024-09-12T19:14:40.634793+0000","last_became_active":"2024-09-12T18:43:32.922514+0000","last_became_peered":"2024-09-12T18:43:32.922514+0000","last_unstale":"2024-09-12T19:14:40.634793+0000","last_undegraded":"2024-09-12T19:14:40.634793+0000","last_fullsized":"2024-09-12T19:14:40.634793+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:40.634623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:40.634623+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.634623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:12.146446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'6","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:34.145443+0000","last_change":"2024-09-12T18:43:29.905017+0000","last_active":"2024-09-12T19:13:34.145443+0000","last_peered":"2024-09-12T19:13:34.145443+0000","last_clean":"2024-09-12T19:13:34.145443+0000","last_became_active":"2024-09-12T18:43:29.904226+0000","last_became_peered":"2024-09-12T18:43:29.904226+0000","last_unstale":"2024-09-12T19:13:34.145443+0000","last_undegraded":"2024-09-12T19:13:34.145443+0000","last_fullsized":"2024-09-12T19:13:34.145443+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:46:47.238023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'21","reported_seq":103,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:53.927298+0000","last_change":"2024-09-12T18:41:45.359716+0000","last_active":"2024-09-12T19:10:53.927298+0000","last_peered":"2024-09-12T19:10:53.927298+0000","last_clean":"2024-09-12T19:10:53.927298+0000","last_became_active":"2024-09-12T18:41:45.351791+0000","last_became_peered":"2024-09-12T18:41:45.351791+0000","last_unstale":"2024-09-12T19:10:53.927298+0000","last_undegraded":"2024-09-12T19:10:53.927298+0000","last_fullsized":"2024-09-12T19:10:53.927298+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:10.883167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899885+0000","last_change":"2024-09-12T18:55:19.149601+0000","last_active":"2024-09-12T19:10:22.899885+0000","last_peered":"2024-09-12T19:10:22.899885+0000","last_clean":"2024-09-12T19:10:22.899885+0000","last_became_active":"2024-09-12T18:55:19.148859+0000","last_became_peered":"2024-09-12T18:55:19.148859+0000","last_unstale":"2024-09-12T19:10:22.899885+0000","last_undegraded":"2024-09-12T19:10:22.899885+0000","last_fullsized":"2024-09-12T19:10:22.899885+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:37:12.702998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:33.738891+0000","last_change":"2024-09-12T18:43:32.937883+0000","last_active":"2024-09-12T19:13:33.738891+0000","last_peered":"2024-09-12T19:13:33.738891+0000","last_clean":"2024-09-12T19:13:33.738891+0000","last_became_active":"2024-09-12T18:43:32.935669+0000","last_became_peered":"2024-09-12T18:43:32.935669+0000","last_unstale":"2024-09-12T19:13:33.738891+0000","last_undegraded":"2024-09-12T19:13:33.738891+0000","last_fullsized":"2024-09-12T19:13:33.738891+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:36:02.525737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'5","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.347912+0000","last_change":"2024-09-12T18:43:29.884274+0000","last_active":"2024-09-12T19:13:57.347912+0000","last_peered":"2024-09-12T19:13:57.347912+0000","last_clean":"2024-09-12T19:13:57.347912+0000","last_became_active":"2024-09-12T18:43:29.883324+0000","last_became_peered":"2024-09-12T18:43:29.883324+0000","last_unstale":"2024-09-12T19:13:57.347912+0000","last_undegraded":"2024-09-12T19:13:57.347912+0000","last_fullsized":"2024-09-12T19:13:57.347912+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.971344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'60","reported_seq":227,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.204859+0000","last_change":"2024-09-12T19:14:33.204859+0000","last_active":"2024-09-12T19:14:33.204859+0000","last_peered":"2024-09-12T19:14:33.204859+0000","last_clean":"2024-09-12T19:14:33.204859+0000","last_became_active":"2024-09-12T18:41:45.339369+0000","last_became_peered":"2024-09-12T18:41:45.339369+0000","last_unstale":"2024-09-12T19:14:33.204859+0000","last_undegraded":"2024-09-12T19:14:33.204859+0000","last_fullsized":"2024-09-12T19:14:33.204859+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'60","last_scrub_stamp":"2024-09-12T19:14:33.204676+0000","last_deep_scrub":"265'60","last_deep_scrub_stamp":"2024-09-12T19:14:33.204676+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.204676+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:59.124298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":229,"num_write":103,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.254009+0000","last_change":"2024-09-12T19:14:42.254009+0000","last_active":"2024-09-12T19:14:42.254009+0000","last_peered":"2024-09-12T19:14:42.254009+0000","last_clean":"2024-09-12T19:14:42.254009+0000","last_became_active":"2024-09-12T18:55:19.122414+0000","last_became_peered":"2024-09-12T18:55:19.122414+0000","last_unstale":"2024-09-12T19:14:42.254009+0000","last_undegraded":"2024-09-12T19:14:42.254009+0000","last_fullsized":"2024-09-12T19:14:42.254009+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:42.253838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:42.253838+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.253838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:22.298367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.491501+0000","last_change":"2024-09-12T18:43:32.927238+0000","last_active":"2024-09-12T19:13:57.491501+0000","last_peered":"2024-09-12T19:13:57.491501+0000","last_clean":"2024-09-12T19:13:57.491501+0000","last_became_active":"2024-09-12T18:43:32.924570+0000","last_became_peered":"2024-09-12T18:43:32.924570+0000","last_unstale":"2024-09-12T19:13:57.491501+0000","last_undegraded":"2024-09-12T19:13:57.491501+0000","last_fullsized":"2024-09-12T19:13:57.491501+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:12.682450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'2","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.564434+0000","last_change":"2024-09-12T18:43:29.869397+0000","last_active":"2024-09-12T19:13:57.564434+0000","last_peered":"2024-09-12T19:13:57.564434+0000","last_clean":"2024-09-12T19:13:57.564434+0000","last_became_active":"2024-09-12T18:43:29.868738+0000","last_became_peered":"2024-09-12T18:43:29.868738+0000","last_unstale":"2024-09-12T19:13:57.564434+0000","last_undegraded":"2024-09-12T19:13:57.564434+0000","last_fullsized":"2024-09-12T19:13:57.564434+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:46:27.215594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'11","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:48.926325+0000","last_change":"2024-09-12T18:41:45.352288+0000","last_active":"2024-09-12T19:10:48.926325+0000","last_peered":"2024-09-12T19:10:48.926325+0000","last_clean":"2024-09-12T19:10:48.926325+0000","last_became_active":"2024-09-12T18:41:45.351553+0000","last_became_peered":"2024-09-12T18:41:45.351553+0000","last_unstale":"2024-09-12T19:10:48.926325+0000","last_undegraded":"2024-09-12T19:10:48.926325+0000","last_fullsized":"2024-09-12T19:10:48.926325+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:04.726575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":29,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.872990+0000","last_change":"2024-09-12T19:14:32.872990+0000","last_active":"2024-09-12T19:14:32.872990+0000","last_peered":"2024-09-12T19:14:32.872990+0000","last_clean":"2024-09-12T19:14:32.872990+0000","last_became_active":"2024-09-12T18:55:19.138649+0000","last_became_peered":"2024-09-12T18:55:19.138649+0000","last_unstale":"2024-09-12T19:14:32.872990+0000","last_undegraded":"2024-09-12T19:14:32.872990+0000","last_fullsized":"2024-09-12T19:14:32.872990+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:32.872783+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:32.872783+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.872783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:29.362590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.777391+0000","last_change":"2024-09-12T18:43:32.928110+0000","last_active":"2024-09-12T19:13:57.777391+0000","last_peered":"2024-09-12T19:13:57.777391+0000","last_clean":"2024-09-12T19:13:57.777391+0000","last_became_active":"2024-09-12T18:43:32.927181+0000","last_became_peered":"2024-09-12T18:43:32.927181+0000","last_unstale":"2024-09-12T19:13:57.777391+0000","last_undegraded":"2024-09-12T19:13:57.777391+0000","last_fullsized":"2024-09-12T19:13:57.777391+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'8","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:07.896153+0000","last_change":"2024-09-12T18:43:29.895323+0000","last_active":"2024-09-12T19:10:07.896153+0000","last_peered":"2024-09-12T19:10:07.896153+0000","last_clean":"2024-09-12T19:10:07.896153+0000","last_became_active":"2024-09-12T18:43:29.894650+0000","last_became_peered":"2024-09-12T18:43:29.894650+0000","last_unstale":"2024-09-12T19:10:07.896153+0000","last_undegraded":"2024-09-12T19:10:07.896153+0000","last_fullsized":"2024-09-12T19:10:07.896153+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:51.742629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8194,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'29","reported_seq":121,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:19.891219+0000","last_change":"2024-09-12T18:41:45.361458+0000","last_active":"2024-09-12T19:11:19.891219+0000","last_peered":"2024-09-12T19:11:19.891219+0000","last_clean":"2024-09-12T19:11:19.891219+0000","last_became_active":"2024-09-12T18:41:45.360856+0000","last_became_peered":"2024-09-12T18:41:45.360856+0000","last_unstale":"2024-09-12T19:11:19.891219+0000","last_undegraded":"2024-09-12T19:11:19.891219+0000","last_fullsized":"2024-09-12T19:11:19.891219+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.915436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":92,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.918501+0000","last_change":"2024-09-12T18:55:19.126091+0000","last_active":"2024-09-12T19:11:42.918501+0000","last_peered":"2024-09-12T19:11:42.918501+0000","last_clean":"2024-09-12T19:11:42.918501+0000","last_became_active":"2024-09-12T18:55:19.123727+0000","last_became_peered":"2024-09-12T18:55:19.123727+0000","last_unstale":"2024-09-12T19:11:42.918501+0000","last_undegraded":"2024-09-12T19:11:42.918501+0000","last_fullsized":"2024-09-12T19:11:42.918501+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:20.999734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:08.914770+0000","last_change":"2024-09-12T18:43:32.935321+0000","last_active":"2024-09-12T19:10:08.914770+0000","last_peered":"2024-09-12T19:10:08.914770+0000","last_clean":"2024-09-12T19:10:08.914770+0000","last_became_active":"2024-09-12T18:43:32.934654+0000","last_became_peered":"2024-09-12T18:43:32.934654+0000","last_unstale":"2024-09-12T19:10:08.914770+0000","last_undegraded":"2024-09-12T19:10:08.914770+0000","last_fullsized":"2024-09-12T19:10:08.914770+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:18.460691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'4","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.906345+0000","last_change":"2024-09-12T19:14:27.906345+0000","last_active":"2024-09-12T19:14:27.906345+0000","last_peered":"2024-09-12T19:14:27.906345+0000","last_clean":"2024-09-12T19:14:27.906345+0000","last_became_active":"2024-09-12T18:43:29.863876+0000","last_became_peered":"2024-09-12T18:43:29.863876+0000","last_unstale":"2024-09-12T19:14:27.906345+0000","last_undegraded":"2024-09-12T19:14:27.906345+0000","last_fullsized":"2024-09-12T19:14:27.906345+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:27.906147+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:27.906147+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.906147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:02.539821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'15","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.896889+0000","last_change":"2024-09-12T19:14:24.896889+0000","last_active":"2024-09-12T19:14:24.896889+0000","last_peered":"2024-09-12T19:14:24.896889+0000","last_clean":"2024-09-12T19:14:24.896889+0000","last_became_active":"2024-09-12T18:41:45.346831+0000","last_became_peered":"2024-09-12T18:41:45.346831+0000","last_unstale":"2024-09-12T19:14:24.896889+0000","last_undegraded":"2024-09-12T19:14:24.896889+0000","last_fullsized":"2024-09-12T19:14:24.896889+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'15","last_scrub_stamp":"2024-09-12T19:14:24.896715+0000","last_deep_scrub":"265'15","last_deep_scrub_stamp":"2024-09-12T19:14:24.896715+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.896715+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:43.841424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":48,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.910328+0000","last_change":"2024-09-12T18:55:19.129602+0000","last_active":"2024-09-12T19:11:38.910328+0000","last_peered":"2024-09-12T19:11:38.910328+0000","last_clean":"2024-09-12T19:11:38.910328+0000","last_became_active":"2024-09-12T18:55:19.125607+0000","last_became_peered":"2024-09-12T18:55:19.125607+0000","last_unstale":"2024-09-12T19:11:38.910328+0000","last_undegraded":"2024-09-12T19:11:38.910328+0000","last_fullsized":"2024-09-12T19:11:38.910328+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:37.974980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'4","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.442728+0000","last_change":"2024-09-12T18:43:32.909634+0000","last_active":"2024-09-12T19:13:57.442728+0000","last_peered":"2024-09-12T19:13:57.442728+0000","last_clean":"2024-09-12T19:13:57.442728+0000","last_became_active":"2024-09-12T18:43:32.908905+0000","last_became_peered":"2024-09-12T18:43:32.908905+0000","last_unstale":"2024-09-12T19:13:57.442728+0000","last_undegraded":"2024-09-12T19:13:57.442728+0000","last_fullsized":"2024-09-12T19:13:57.442728+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:55.460584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'7","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:33.953479+0000","last_change":"2024-09-12T18:43:29.883172+0000","last_active":"2024-09-12T19:12:33.953479+0000","last_peered":"2024-09-12T19:12:33.953479+0000","last_clean":"2024-09-12T19:12:33.953479+0000","last_became_active":"2024-09-12T18:43:29.880462+0000","last_became_peered":"2024-09-12T18:43:29.880462+0000","last_unstale":"2024-09-12T19:12:33.953479+0000","last_undegraded":"2024-09-12T19:12:33.953479+0000","last_fullsized":"2024-09-12T19:12:33.953479+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:21:22.795034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:17.927079+0000","last_change":"2024-09-12T18:41:45.360552+0000","last_active":"2024-09-12T19:12:17.927079+0000","last_peered":"2024-09-12T19:12:17.927079+0000","last_clean":"2024-09-12T19:12:17.927079+0000","last_became_active":"2024-09-12T18:41:45.359794+0000","last_became_peered":"2024-09-12T18:41:45.359794+0000","last_unstale":"2024-09-12T19:12:17.927079+0000","last_undegraded":"2024-09-12T19:12:17.927079+0000","last_fullsized":"2024-09-12T19:12:17.927079+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:13.723865+0000","last_change":"2024-09-12T18:55:19.154082+0000","last_active":"2024-09-12T19:12:13.723865+0000","last_peered":"2024-09-12T19:12:13.723865+0000","last_clean":"2024-09-12T19:12:13.723865+0000","last_became_active":"2024-09-12T18:55:19.152807+0000","last_became_peered":"2024-09-12T18:55:19.152807+0000","last_unstale":"2024-09-12T19:12:13.723865+0000","last_undegraded":"2024-09-12T19:12:13.723865+0000","last_fullsized":"2024-09-12T19:12:13.723865+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.295407+0000","last_change":"2024-09-12T19:14:41.295407+0000","last_active":"2024-09-12T19:14:41.295407+0000","last_peered":"2024-09-12T19:14:41.295407+0000","last_clean":"2024-09-12T19:14:41.295407+0000","last_became_active":"2024-09-12T18:43:32.899988+0000","last_became_peered":"2024-09-12T18:43:32.899988+0000","last_unstale":"2024-09-12T19:14:41.295407+0000","last_undegraded":"2024-09-12T19:14:41.295407+0000","last_fullsized":"2024-09-12T19:14:41.295407+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:41.295235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:41.295235+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.295235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:08.234217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.454508+0000","last_change":"2024-09-12T19:14:43.454508+0000","last_active":"2024-09-12T19:14:43.454508+0000","last_peered":"2024-09-12T19:14:43.454508+0000","last_clean":"2024-09-12T19:14:43.454508+0000","last_became_active":"2024-09-12T18:43:29.880294+0000","last_became_peered":"2024-09-12T18:43:29.880294+0000","last_unstale":"2024-09-12T19:14:43.454508+0000","last_undegraded":"2024-09-12T19:14:43.454508+0000","last_fullsized":"2024-09-12T19:14:43.454508+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:43.454286+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:43.454286+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.454286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:48.347559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'33","reported_seq":142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.924618+0000","last_change":"2024-09-12T18:41:45.360139+0000","last_active":"2024-09-12T19:12:07.924618+0000","last_peered":"2024-09-12T19:12:07.924618+0000","last_clean":"2024-09-12T19:12:07.924618+0000","last_became_active":"2024-09-12T18:41:45.359405+0000","last_became_peered":"2024-09-12T18:41:45.359405+0000","last_unstale":"2024-09-12T19:12:07.924618+0000","last_undegraded":"2024-09-12T19:12:07.924618+0000","last_fullsized":"2024-09-12T19:12:07.924618+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":128,"num_write":57,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:13.948212+0000","last_change":"2024-09-12T18:55:19.139048+0000","last_active":"2024-09-12T19:12:13.948212+0000","last_peered":"2024-09-12T19:12:13.948212+0000","last_clean":"2024-09-12T19:12:13.948212+0000","last_became_active":"2024-09-12T18:55:19.136822+0000","last_became_peered":"2024-09-12T18:55:19.136822+0000","last_unstale":"2024-09-12T19:12:13.948212+0000","last_undegraded":"2024-09-12T19:12:13.948212+0000","last_fullsized":"2024-09-12T19:12:13.948212+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715353+0000","last_change":"2024-09-12T18:43:32.908035+0000","last_active":"2024-09-12T19:11:32.715353+0000","last_peered":"2024-09-12T19:11:32.715353+0000","last_clean":"2024-09-12T19:11:32.715353+0000","last_became_active":"2024-09-12T18:43:32.906911+0000","last_became_peered":"2024-09-12T18:43:32.906911+0000","last_unstale":"2024-09-12T19:11:32.715353+0000","last_undegraded":"2024-09-12T19:11:32.715353+0000","last_fullsized":"2024-09-12T19:11:32.715353+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:23.186205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"265'6","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:48.743023+0000","last_change":"2024-09-12T18:43:29.874437+0000","last_active":"2024-09-12T19:13:48.743023+0000","last_peered":"2024-09-12T19:13:48.743023+0000","last_clean":"2024-09-12T19:13:48.743023+0000","last_became_active":"2024-09-12T18:43:29.873561+0000","last_became_peered":"2024-09-12T18:43:29.873561+0000","last_unstale":"2024-09-12T19:13:48.743023+0000","last_undegraded":"2024-09-12T19:13:48.743023+0000","last_fullsized":"2024-09-12T19:13:48.743023+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:09.170136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'40","reported_seq":165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.515779+0000","last_change":"2024-09-12T19:14:42.515779+0000","last_active":"2024-09-12T19:14:42.515779+0000","last_peered":"2024-09-12T19:14:42.515779+0000","last_clean":"2024-09-12T19:14:42.515779+0000","last_became_active":"2024-09-12T18:41:45.352482+0000","last_became_peered":"2024-09-12T18:41:45.352482+0000","last_unstale":"2024-09-12T19:14:42.515779+0000","last_undegraded":"2024-09-12T19:14:42.515779+0000","last_fullsized":"2024-09-12T19:14:42.515779+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'40","last_scrub_stamp":"2024-09-12T19:14:42.515590+0000","last_deep_scrub":"265'40","last_deep_scrub_stamp":"2024-09-12T19:14:42.515590+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.515590+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:20.756086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.940679+0000","last_change":"2024-09-12T18:55:19.135873+0000","last_active":"2024-09-12T19:11:43.940679+0000","last_peered":"2024-09-12T19:11:43.940679+0000","last_clean":"2024-09-12T19:11:43.940679+0000","last_became_active":"2024-09-12T18:55:19.132991+0000","last_became_peered":"2024-09-12T18:55:19.132991+0000","last_unstale":"2024-09-12T19:11:43.940679+0000","last_undegraded":"2024-09-12T19:11:43.940679+0000","last_fullsized":"2024-09-12T19:11:43.940679+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'8","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:53.744198+0000","last_change":"2024-09-12T18:43:32.934314+0000","last_active":"2024-09-12T19:13:53.744198+0000","last_peered":"2024-09-12T19:13:53.744198+0000","last_clean":"2024-09-12T19:13:53.744198+0000","last_became_active":"2024-09-12T18:43:32.927109+0000","last_became_peered":"2024-09-12T18:43:32.927109+0000","last_unstale":"2024-09-12T19:13:53.744198+0000","last_undegraded":"2024-09-12T19:13:53.744198+0000","last_fullsized":"2024-09-12T19:13:53.744198+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:58.923503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":28674,"num_write":8,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.565997+0000","last_change":"2024-09-12T19:14:36.565997+0000","last_active":"2024-09-12T19:14:36.565997+0000","last_peered":"2024-09-12T19:14:36.565997+0000","last_clean":"2024-09-12T19:14:36.565997+0000","last_became_active":"2024-09-12T18:43:29.880517+0000","last_became_peered":"2024-09-12T18:43:29.880517+0000","last_unstale":"2024-09-12T19:14:36.565997+0000","last_undegraded":"2024-09-12T19:14:36.565997+0000","last_fullsized":"2024-09-12T19:14:36.565997+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:36.565822+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:36.565822+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.565822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:02.635626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.421270+0000","last_change":"2024-09-12T19:14:41.421270+0000","last_active":"2024-09-12T19:14:41.421270+0000","last_peered":"2024-09-12T19:14:41.421270+0000","last_clean":"2024-09-12T19:14:41.421270+0000","last_became_active":"2024-09-12T18:41:45.350632+0000","last_became_peered":"2024-09-12T18:41:45.350632+0000","last_unstale":"2024-09-12T19:14:41.421270+0000","last_undegraded":"2024-09-12T19:14:41.421270+0000","last_fullsized":"2024-09-12T19:14:41.421270+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-12T19:14:41.421072+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-12T19:14:41.421072+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.421072+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:50.795483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:13.723828+0000","last_change":"2024-09-12T18:55:19.151498+0000","last_active":"2024-09-12T19:12:13.723828+0000","last_peered":"2024-09-12T19:12:13.723828+0000","last_clean":"2024-09-12T19:12:13.723828+0000","last_became_active":"2024-09-12T18:55:19.150880+0000","last_became_peered":"2024-09-12T18:55:19.150880+0000","last_unstale":"2024-09-12T19:12:13.723828+0000","last_undegraded":"2024-09-12T19:12:13.723828+0000","last_fullsized":"2024-09-12T19:12:13.723828+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'16","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.602068+0000","last_change":"2024-09-12T19:14:37.602068+0000","last_active":"2024-09-12T19:14:37.602068+0000","last_peered":"2024-09-12T19:14:37.602068+0000","last_clean":"2024-09-12T19:14:37.602068+0000","last_became_active":"2024-09-12T18:43:32.927270+0000","last_became_peered":"2024-09-12T18:43:32.927270+0000","last_unstale":"2024-09-12T19:14:37.602068+0000","last_undegraded":"2024-09-12T19:14:37.602068+0000","last_fullsized":"2024-09-12T19:14:37.602068+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'16","last_scrub_stamp":"2024-09-12T19:14:37.601821+0000","last_deep_scrub":"265'16","last_deep_scrub_stamp":"2024-09-12T19:14:37.601821+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.601821+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:43.617916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":38914,"num_write":26,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:48.942548+0000","last_change":"2024-09-12T18:43:29.902339+0000","last_active":"2024-09-12T19:13:48.942548+0000","last_peered":"2024-09-12T19:13:48.942548+0000","last_clean":"2024-09-12T19:13:48.942548+0000","last_became_active":"2024-09-12T18:43:29.901627+0000","last_became_peered":"2024-09-12T18:43:29.901627+0000","last_unstale":"2024-09-12T19:13:48.942548+0000","last_undegraded":"2024-09-12T19:13:48.942548+0000","last_fullsized":"2024-09-12T19:13:48.942548+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:48.203220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'30","reported_seq":131,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:08.722471+0000","last_change":"2024-09-12T18:41:45.353240+0000","last_active":"2024-09-12T19:12:08.722471+0000","last_peered":"2024-09-12T19:12:08.722471+0000","last_clean":"2024-09-12T19:12:08.722471+0000","last_became_active":"2024-09-12T18:41:45.350670+0000","last_became_peered":"2024-09-12T18:41:45.350670+0000","last_unstale":"2024-09-12T19:12:08.722471+0000","last_undegraded":"2024-09-12T19:12:08.722471+0000","last_fullsized":"2024-09-12T19:12:08.722471+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.831089+0000","last_change":"2024-09-12T19:14:31.831089+0000","last_active":"2024-09-12T19:14:31.831089+0000","last_peered":"2024-09-12T19:14:31.831089+0000","last_clean":"2024-09-12T19:14:31.831089+0000","last_became_active":"2024-09-12T18:55:19.137332+0000","last_became_peered":"2024-09-12T18:55:19.137332+0000","last_unstale":"2024-09-12T19:14:31.831089+0000","last_undegraded":"2024-09-12T19:14:31.831089+0000","last_fullsized":"2024-09-12T19:14:31.831089+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:31.830906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:31.830906+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.830906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:09.304238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:28.743525+0000","last_change":"2024-09-12T18:44:13.008362+0000","last_active":"2024-09-12T19:13:28.743525+0000","last_peered":"2024-09-12T19:13:28.743525+0000","last_clean":"2024-09-12T19:13:28.743525+0000","last_became_active":"2024-09-12T18:44:13.007582+0000","last_became_peered":"2024-09-12T18:44:13.007582+0000","last_unstale":"2024-09-12T19:13:28.743525+0000","last_undegraded":"2024-09-12T19:13:28.743525+0000","last_fullsized":"2024-09-12T19:13:28.743525+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:14.811461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.c","version":"262'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.902160+0000","last_change":"2024-09-12T18:43:29.889784+0000","last_active":"2024-09-12T19:10:32.902160+0000","last_peered":"2024-09-12T19:10:32.902160+0000","last_clean":"2024-09-12T19:10:32.902160+0000","last_became_active":"2024-09-12T18:43:29.888041+0000","last_became_peered":"2024-09-12T18:43:29.888041+0000","last_unstale":"2024-09-12T19:10:32.902160+0000","last_undegraded":"2024-09-12T19:10:32.902160+0000","last_fullsized":"2024-09-12T19:10:32.902160+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:10:54.352777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'30","reported_seq":127,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:08.930272+0000","last_change":"2024-09-12T18:41:45.354909+0000","last_active":"2024-09-12T19:11:08.930272+0000","last_peered":"2024-09-12T19:11:08.930272+0000","last_clean":"2024-09-12T19:11:08.930272+0000","last_became_active":"2024-09-12T18:41:45.354063+0000","last_became_peered":"2024-09-12T18:41:45.354063+0000","last_unstale":"2024-09-12T19:11:08.930272+0000","last_undegraded":"2024-09-12T19:11:08.930272+0000","last_fullsized":"2024-09-12T19:11:08.930272+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:25.031450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910297+0000","last_change":"2024-09-12T18:55:19.140991+0000","last_active":"2024-09-12T19:11:07.910297+0000","last_peered":"2024-09-12T19:11:07.910297+0000","last_clean":"2024-09-12T19:11:07.910297+0000","last_became_active":"2024-09-12T18:55:19.140331+0000","last_became_peered":"2024-09-12T18:55:19.140331+0000","last_unstale":"2024-09-12T19:11:07.910297+0000","last_undegraded":"2024-09-12T19:11:07.910297+0000","last_fullsized":"2024-09-12T19:11:07.910297+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:21:37.267698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.444004+0000","last_change":"2024-09-12T18:43:32.935314+0000","last_active":"2024-09-12T19:13:57.444004+0000","last_peered":"2024-09-12T19:13:57.444004+0000","last_clean":"2024-09-12T19:13:57.444004+0000","last_became_active":"2024-09-12T18:43:32.934598+0000","last_became_peered":"2024-09-12T18:43:32.934598+0000","last_unstale":"2024-09-12T19:13:57.444004+0000","last_undegraded":"2024-09-12T19:13:57.444004+0000","last_fullsized":"2024-09-12T19:13:57.444004+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:52:01.163337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.869286+0000","last_change":"2024-09-12T19:14:28.869286+0000","last_active":"2024-09-12T19:14:28.869286+0000","last_peered":"2024-09-12T19:14:28.869286+0000","last_clean":"2024-09-12T19:14:28.869286+0000","last_became_active":"2024-09-12T18:43:29.887500+0000","last_became_peered":"2024-09-12T18:43:29.887500+0000","last_unstale":"2024-09-12T19:14:28.869286+0000","last_undegraded":"2024-09-12T19:14:28.869286+0000","last_fullsized":"2024-09-12T19:14:28.869286+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:28.869104+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:28.869104+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.869104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:56.378736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'32","reported_seq":147,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.418810+0000","last_change":"2024-09-12T19:14:42.418810+0000","last_active":"2024-09-12T19:14:42.418810+0000","last_peered":"2024-09-12T19:14:42.418810+0000","last_clean":"2024-09-12T19:14:42.418810+0000","last_became_active":"2024-09-12T18:41:45.358914+0000","last_became_peered":"2024-09-12T18:41:45.358914+0000","last_unstale":"2024-09-12T19:14:42.418810+0000","last_undegraded":"2024-09-12T19:14:42.418810+0000","last_fullsized":"2024-09-12T19:14:42.418810+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T19:14:42.418633+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T19:14:42.418633+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.418633+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:42:43.329544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":122,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.621631+0000","last_change":"2024-09-12T19:14:41.621631+0000","last_active":"2024-09-12T19:14:41.621631+0000","last_peered":"2024-09-12T19:14:41.621631+0000","last_clean":"2024-09-12T19:14:41.621631+0000","last_became_active":"2024-09-12T18:55:19.128236+0000","last_became_peered":"2024-09-12T18:55:19.128236+0000","last_unstale":"2024-09-12T19:14:41.621631+0000","last_undegraded":"2024-09-12T19:14:41.621631+0000","last_fullsized":"2024-09-12T19:14:41.621631+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:41.621448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:41.621448+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.621448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:46.166631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"265'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.491078+0000","last_change":"2024-09-12T18:43:32.900792+0000","last_active":"2024-09-12T19:13:57.491078+0000","last_peered":"2024-09-12T19:13:57.491078+0000","last_clean":"2024-09-12T19:13:57.491078+0000","last_became_active":"2024-09-12T18:43:32.899943+0000","last_became_peered":"2024-09-12T18:43:32.899943+0000","last_unstale":"2024-09-12T19:13:57.491078+0000","last_undegraded":"2024-09-12T19:13:57.491078+0000","last_fullsized":"2024-09-12T19:13:57.491078+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:06.601060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3444,"num_write":4,"num_write_kb":1722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'4","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:48.957143+0000","last_change":"2024-09-12T18:43:29.878465+0000","last_active":"2024-09-12T19:12:48.957143+0000","last_peered":"2024-09-12T19:12:48.957143+0000","last_clean":"2024-09-12T19:12:48.957143+0000","last_became_active":"2024-09-12T18:43:29.877755+0000","last_became_peered":"2024-09-12T18:43:29.877755+0000","last_unstale":"2024-09-12T19:12:48.957143+0000","last_undegraded":"2024-09-12T19:12:48.957143+0000","last_fullsized":"2024-09-12T19:12:48.957143+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:15.949360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4136,"num_write":4,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'17","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.551734+0000","last_change":"2024-09-12T19:14:33.551734+0000","last_active":"2024-09-12T19:14:33.551734+0000","last_peered":"2024-09-12T19:14:33.551734+0000","last_clean":"2024-09-12T19:14:33.551734+0000","last_became_active":"2024-09-12T18:41:45.357562+0000","last_became_peered":"2024-09-12T18:41:45.357562+0000","last_unstale":"2024-09-12T19:14:33.551734+0000","last_undegraded":"2024-09-12T19:14:33.551734+0000","last_fullsized":"2024-09-12T19:14:33.551734+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'17","last_scrub_stamp":"2024-09-12T19:14:33.551517+0000","last_deep_scrub":"262'17","last_deep_scrub_stamp":"2024-09-12T19:14:33.551517+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.551517+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:16.826743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:32.902028+0000","last_change":"2024-09-12T18:55:19.137683+0000","last_active":"2024-09-12T19:10:32.902028+0000","last_peered":"2024-09-12T19:10:32.902028+0000","last_clean":"2024-09-12T19:10:32.902028+0000","last_became_active":"2024-09-12T18:55:19.136882+0000","last_became_peered":"2024-09-12T18:55:19.136882+0000","last_unstale":"2024-09-12T19:10:32.902028+0000","last_undegraded":"2024-09-12T19:10:32.902028+0000","last_fullsized":"2024-09-12T19:10:32.902028+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:09.805826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:33.921042+0000","last_change":"2024-09-12T18:43:32.930996+0000","last_active":"2024-09-12T19:10:33.921042+0000","last_peered":"2024-09-12T19:10:33.921042+0000","last_clean":"2024-09-12T19:10:33.921042+0000","last_became_active":"2024-09-12T18:43:32.927372+0000","last_became_peered":"2024-09-12T18:43:32.927372+0000","last_unstale":"2024-09-12T19:10:33.921042+0000","last_undegraded":"2024-09-12T19:10:33.921042+0000","last_fullsized":"2024-09-12T19:10:33.921042+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:56.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.279454+0000","last_change":"2024-09-12T19:14:39.279454+0000","last_active":"2024-09-12T19:14:39.279454+0000","last_peered":"2024-09-12T19:14:39.279454+0000","last_clean":"2024-09-12T19:14:39.279454+0000","last_became_active":"2024-09-12T18:43:29.888265+0000","last_became_peered":"2024-09-12T18:43:29.888265+0000","last_unstale":"2024-09-12T19:14:39.279454+0000","last_undegraded":"2024-09-12T19:14:39.279454+0000","last_fullsized":"2024-09-12T19:14:39.279454+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T19:14:39.279259+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T19:14:39.279259+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.279259+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:16.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'32","reported_seq":145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.875670+0000","last_change":"2024-09-12T19:14:23.875670+0000","last_active":"2024-09-12T19:14:23.875670+0000","last_peered":"2024-09-12T19:14:23.875670+0000","last_clean":"2024-09-12T19:14:23.875670+0000","last_became_active":"2024-09-12T18:41:45.335675+0000","last_became_peered":"2024-09-12T18:41:45.335675+0000","last_unstale":"2024-09-12T19:14:23.875670+0000","last_undegraded":"2024-09-12T19:14:23.875670+0000","last_fullsized":"2024-09-12T19:14:23.875670+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T19:14:23.875487+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T19:14:23.875487+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.875487+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:42.681180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":63,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.928809+0000","last_change":"2024-09-12T18:55:19.150357+0000","last_active":"2024-09-12T19:11:03.928809+0000","last_peered":"2024-09-12T19:11:03.928809+0000","last_clean":"2024-09-12T19:11:03.928809+0000","last_became_active":"2024-09-12T18:55:19.149794+0000","last_became_peered":"2024-09-12T18:55:19.149794+0000","last_unstale":"2024-09-12T19:11:03.928809+0000","last_undegraded":"2024-09-12T19:11:03.928809+0000","last_fullsized":"2024-09-12T19:11:03.928809+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:29.807238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121142+0000","last_change":"2024-09-12T18:43:32.910786+0000","last_active":"2024-09-12T19:11:44.121142+0000","last_peered":"2024-09-12T19:11:44.121142+0000","last_clean":"2024-09-12T19:11:44.121142+0000","last_became_active":"2024-09-12T18:43:32.908692+0000","last_became_peered":"2024-09-12T18:43:32.908692+0000","last_unstale":"2024-09-12T19:11:44.121142+0000","last_undegraded":"2024-09-12T19:11:44.121142+0000","last_fullsized":"2024-09-12T19:11:44.121142+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:46.037235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'6","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:53.749219+0000","last_change":"2024-09-12T18:43:29.883687+0000","last_active":"2024-09-12T19:13:53.749219+0000","last_peered":"2024-09-12T19:13:53.749219+0000","last_clean":"2024-09-12T19:13:53.749219+0000","last_became_active":"2024-09-12T18:43:29.882915+0000","last_became_peered":"2024-09-12T18:43:29.882915+0000","last_unstale":"2024-09-12T19:13:53.749219+0000","last_undegraded":"2024-09-12T19:13:53.749219+0000","last_fullsized":"2024-09-12T19:13:53.749219+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:57:04.141732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'74","reported_seq":253,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.481566+0000","last_change":"2024-09-12T19:14:43.481566+0000","last_active":"2024-09-12T19:14:43.481566+0000","last_peered":"2024-09-12T19:14:43.481566+0000","last_clean":"2024-09-12T19:14:43.481566+0000","last_became_active":"2024-09-12T18:41:45.351387+0000","last_became_peered":"2024-09-12T18:41:45.351387+0000","last_unstale":"2024-09-12T19:14:43.481566+0000","last_undegraded":"2024-09-12T19:14:43.481566+0000","last_fullsized":"2024-09-12T19:14:43.481566+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T19:14:43.481388+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T19:14:43.481388+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.481388+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:58.275602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":261,"num_write":135,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:12.911671+0000","last_change":"2024-09-12T18:55:19.150286+0000","last_active":"2024-09-12T19:11:12.911671+0000","last_peered":"2024-09-12T19:11:12.911671+0000","last_clean":"2024-09-12T19:11:12.911671+0000","last_became_active":"2024-09-12T18:55:19.149666+0000","last_became_peered":"2024-09-12T18:55:19.149666+0000","last_unstale":"2024-09-12T19:11:12.911671+0000","last_undegraded":"2024-09-12T19:11:12.911671+0000","last_fullsized":"2024-09-12T19:11:12.911671+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:59:09.562684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'7","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.114111+0000","last_change":"2024-09-12T18:43:32.903834+0000","last_active":"2024-09-12T19:13:57.114111+0000","last_peered":"2024-09-12T19:13:57.114111+0000","last_clean":"2024-09-12T19:13:57.114111+0000","last_became_active":"2024-09-12T18:43:32.903112+0000","last_became_peered":"2024-09-12T18:43:32.903112+0000","last_unstale":"2024-09-12T19:13:57.114111+0000","last_undegraded":"2024-09-12T19:13:57.114111+0000","last_fullsized":"2024-09-12T19:13:57.114111+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:35.198794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.316037+0000","last_change":"2024-09-12T19:14:40.316037+0000","last_active":"2024-09-12T19:14:40.316037+0000","last_peered":"2024-09-12T19:14:40.316037+0000","last_clean":"2024-09-12T19:14:40.316037+0000","last_became_active":"2024-09-12T18:43:29.887725+0000","last_became_peered":"2024-09-12T18:43:29.887725+0000","last_unstale":"2024-09-12T19:14:40.316037+0000","last_undegraded":"2024-09-12T19:14:40.316037+0000","last_fullsized":"2024-09-12T19:14:40.316037+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:14:40.315848+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:14:40.315848+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.315848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:20.157102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'2","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.940200+0000","last_change":"2024-09-12T19:14:42.940200+0000","last_active":"2024-09-12T19:14:42.940200+0000","last_peered":"2024-09-12T19:14:42.940200+0000","last_clean":"2024-09-12T19:14:42.940200+0000","last_became_active":"2024-09-12T18:41:45.353582+0000","last_became_peered":"2024-09-12T18:41:45.353582+0000","last_unstale":"2024-09-12T19:14:42.940200+0000","last_undegraded":"2024-09-12T19:14:42.940200+0000","last_fullsized":"2024-09-12T19:14:42.940200+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:42.940004+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:42.940004+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.940004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:22.109399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:07.910340+0000","last_change":"2024-09-12T18:55:19.147574+0000","last_active":"2024-09-12T19:11:07.910340+0000","last_peered":"2024-09-12T19:11:07.910340+0000","last_clean":"2024-09-12T19:11:07.910340+0000","last_became_active":"2024-09-12T18:55:19.146310+0000","last_became_peered":"2024-09-12T18:55:19.146310+0000","last_unstale":"2024-09-12T19:11:07.910340+0000","last_undegraded":"2024-09-12T19:11:07.910340+0000","last_fullsized":"2024-09-12T19:11:07.910340+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:19:20.681513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.279523+0000","last_change":"2024-09-12T19:14:38.279523+0000","last_active":"2024-09-12T19:14:38.279523+0000","last_peered":"2024-09-12T19:14:38.279523+0000","last_clean":"2024-09-12T19:14:38.279523+0000","last_became_active":"2024-09-12T18:43:32.922056+0000","last_became_peered":"2024-09-12T18:43:32.922056+0000","last_unstale":"2024-09-12T19:14:38.279523+0000","last_undegraded":"2024-09-12T19:14:38.279523+0000","last_fullsized":"2024-09-12T19:14:38.279523+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:38.279343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:38.279343+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.279343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:07.605920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.821484+0000","last_change":"2024-09-12T18:43:29.886237+0000","last_active":"2024-09-12T19:13:57.821484+0000","last_peered":"2024-09-12T19:13:57.821484+0000","last_clean":"2024-09-12T19:13:57.821484+0000","last_became_active":"2024-09-12T18:43:29.885595+0000","last_became_peered":"2024-09-12T18:43:29.885595+0000","last_unstale":"2024-09-12T19:13:57.821484+0000","last_undegraded":"2024-09-12T19:13:57.821484+0000","last_fullsized":"2024-09-12T19:13:57.821484+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5492,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'29","reported_seq":131,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.093979+0000","last_change":"2024-09-12T19:14:38.093979+0000","last_active":"2024-09-12T19:14:38.093979+0000","last_peered":"2024-09-12T19:14:38.093979+0000","last_clean":"2024-09-12T19:14:38.093979+0000","last_became_active":"2024-09-12T18:41:45.335258+0000","last_became_peered":"2024-09-12T18:41:45.335258+0000","last_unstale":"2024-09-12T19:14:38.093979+0000","last_undegraded":"2024-09-12T19:14:38.093979+0000","last_fullsized":"2024-09-12T19:14:38.093979+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T19:14:38.093802+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T19:14:38.093802+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.093802+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:43.894454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":60,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:03.930417+0000","last_change":"2024-09-12T18:55:19.140934+0000","last_active":"2024-09-12T19:11:03.930417+0000","last_peered":"2024-09-12T19:11:03.930417+0000","last_clean":"2024-09-12T19:11:03.930417+0000","last_became_active":"2024-09-12T18:55:19.140247+0000","last_became_peered":"2024-09-12T18:55:19.140247+0000","last_unstale":"2024-09-12T19:11:03.930417+0000","last_undegraded":"2024-09-12T19:11:03.930417+0000","last_fullsized":"2024-09-12T19:11:03.930417+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:21.925405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'9","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.822690+0000","last_change":"2024-09-12T18:43:32.918976+0000","last_active":"2024-09-12T19:13:57.822690+0000","last_peered":"2024-09-12T19:13:57.822690+0000","last_clean":"2024-09-12T19:13:57.822690+0000","last_became_active":"2024-09-12T18:43:32.918077+0000","last_became_peered":"2024-09-12T18:43:32.918077+0000","last_unstale":"2024-09-12T19:13:57.822690+0000","last_undegraded":"2024-09-12T19:13:57.822690+0000","last_fullsized":"2024-09-12T19:13:57.822690+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:54.534577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.470472+0000","last_change":"2024-09-12T19:14:42.470472+0000","last_active":"2024-09-12T19:14:42.470472+0000","last_peered":"2024-09-12T19:14:42.470472+0000","last_clean":"2024-09-12T19:14:42.470472+0000","last_became_active":"2024-09-12T18:43:29.902444+0000","last_became_peered":"2024-09-12T18:43:29.902444+0000","last_unstale":"2024-09-12T19:14:42.470472+0000","last_undegraded":"2024-09-12T19:14:42.470472+0000","last_fullsized":"2024-09-12T19:14:42.470472+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:42.470264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:42.470264+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.470264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:34.096293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'31","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.555760+0000","last_change":"2024-09-12T19:14:32.555760+0000","last_active":"2024-09-12T19:14:32.555760+0000","last_peered":"2024-09-12T19:14:32.555760+0000","last_clean":"2024-09-12T19:14:32.555760+0000","last_became_active":"2024-09-12T18:41:45.350344+0000","last_became_peered":"2024-09-12T18:41:45.350344+0000","last_unstale":"2024-09-12T19:14:32.555760+0000","last_undegraded":"2024-09-12T19:14:32.555760+0000","last_fullsized":"2024-09-12T19:14:32.555760+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:14:32.555579+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:14:32.555579+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.555579+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:51.762007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":107,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:02.923486+0000","last_change":"2024-09-12T18:55:19.145504+0000","last_active":"2024-09-12T19:12:02.923486+0000","last_peered":"2024-09-12T19:12:02.923486+0000","last_clean":"2024-09-12T19:12:02.923486+0000","last_became_active":"2024-09-12T18:55:19.144778+0000","last_became_peered":"2024-09-12T18:55:19.144778+0000","last_unstale":"2024-09-12T19:12:02.923486+0000","last_undegraded":"2024-09-12T19:12:02.923486+0000","last_fullsized":"2024-09-12T19:12:02.923486+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:48.957071+0000","last_change":"2024-09-12T18:43:32.903502+0000","last_active":"2024-09-12T19:12:48.957071+0000","last_peered":"2024-09-12T19:12:48.957071+0000","last_clean":"2024-09-12T19:12:48.957071+0000","last_became_active":"2024-09-12T18:43:32.901790+0000","last_became_peered":"2024-09-12T18:43:32.901790+0000","last_unstale":"2024-09-12T19:12:48.957071+0000","last_undegraded":"2024-09-12T19:12:48.957071+0000","last_fullsized":"2024-09-12T19:12:48.957071+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:24.176553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903364+0000","last_change":"2024-09-12T18:43:29.890565+0000","last_active":"2024-09-12T19:10:37.903364+0000","last_peered":"2024-09-12T19:10:37.903364+0000","last_clean":"2024-09-12T19:10:37.903364+0000","last_became_active":"2024-09-12T18:43:29.889097+0000","last_became_peered":"2024-09-12T18:43:29.889097+0000","last_unstale":"2024-09-12T19:10:37.903364+0000","last_undegraded":"2024-09-12T19:10:37.903364+0000","last_fullsized":"2024-09-12T19:10:37.903364+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:26.725295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.555852+0000","last_change":"2024-09-12T19:14:41.555852+0000","last_active":"2024-09-12T19:14:41.555852+0000","last_peered":"2024-09-12T19:14:41.555852+0000","last_clean":"2024-09-12T19:14:41.555852+0000","last_became_active":"2024-09-12T18:41:45.364055+0000","last_became_peered":"2024-09-12T18:41:45.364055+0000","last_unstale":"2024-09-12T19:14:41.555852+0000","last_undegraded":"2024-09-12T19:14:41.555852+0000","last_fullsized":"2024-09-12T19:14:41.555852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:14:41.555635+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:14:41.555635+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.555635+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:37.201797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.915239+0000","last_change":"2024-09-12T18:55:19.122707+0000","last_active":"2024-09-12T19:11:58.915239+0000","last_peered":"2024-09-12T19:11:58.915239+0000","last_clean":"2024-09-12T19:11:58.915239+0000","last_became_active":"2024-09-12T18:55:19.121805+0000","last_became_peered":"2024-09-12T18:55:19.121805+0000","last_unstale":"2024-09-12T19:11:58.915239+0000","last_undegraded":"2024-09-12T19:11:58.915239+0000","last_fullsized":"2024-09-12T19:11:58.915239+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:51.523106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'11","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:43.955856+0000","last_change":"2024-09-12T18:43:32.899098+0000","last_active":"2024-09-12T19:12:43.955856+0000","last_peered":"2024-09-12T19:12:43.955856+0000","last_clean":"2024-09-12T19:12:43.955856+0000","last_became_active":"2024-09-12T18:43:32.898379+0000","last_became_peered":"2024-09-12T18:43:32.898379+0000","last_unstale":"2024-09-12T19:12:43.955856+0000","last_undegraded":"2024-09-12T19:12:43.955856+0000","last_fullsized":"2024-09-12T19:12:43.955856+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:40.658854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":16388,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.863334+0000","last_change":"2024-09-12T19:14:26.863334+0000","last_active":"2024-09-12T19:14:26.863334+0000","last_peered":"2024-09-12T19:14:26.863334+0000","last_clean":"2024-09-12T19:14:26.863334+0000","last_became_active":"2024-09-12T18:43:29.897326+0000","last_became_peered":"2024-09-12T18:43:29.897326+0000","last_unstale":"2024-09-12T19:14:26.863334+0000","last_undegraded":"2024-09-12T19:14:26.863334+0000","last_fullsized":"2024-09-12T19:14:26.863334+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:26.863141+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:26.863141+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.863141+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:17.681641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'31","reported_seq":138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.563792+0000","last_change":"2024-09-12T19:14:31.563792+0000","last_active":"2024-09-12T19:14:31.563792+0000","last_peered":"2024-09-12T19:14:31.563792+0000","last_clean":"2024-09-12T19:14:31.563792+0000","last_became_active":"2024-09-12T18:41:45.350900+0000","last_became_peered":"2024-09-12T18:41:45.350900+0000","last_unstale":"2024-09-12T19:14:31.563792+0000","last_undegraded":"2024-09-12T19:14:31.563792+0000","last_fullsized":"2024-09-12T19:14:31.563792+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:14:31.563626+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:14:31.563626+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.563626+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:23.203129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":59,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:32.715397+0000","last_change":"2024-09-12T18:55:19.123047+0000","last_active":"2024-09-12T19:11:32.715397+0000","last_peered":"2024-09-12T19:11:32.715397+0000","last_clean":"2024-09-12T19:11:32.715397+0000","last_became_active":"2024-09-12T18:55:19.122238+0000","last_became_peered":"2024-09-12T18:55:19.122238+0000","last_unstale":"2024-09-12T19:11:32.715397+0000","last_undegraded":"2024-09-12T19:11:32.715397+0000","last_fullsized":"2024-09-12T19:11:32.715397+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:01.481082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'6","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:52.950322+0000","last_change":"2024-09-12T18:43:32.914014+0000","last_active":"2024-09-12T19:13:52.950322+0000","last_peered":"2024-09-12T19:13:52.950322+0000","last_clean":"2024-09-12T19:13:52.950322+0000","last_became_active":"2024-09-12T18:43:32.913108+0000","last_became_peered":"2024-09-12T18:43:32.913108+0000","last_unstale":"2024-09-12T19:13:52.950322+0000","last_undegraded":"2024-09-12T19:13:52.950322+0000","last_fullsized":"2024-09-12T19:13:52.950322+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:00.617500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'8","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.411897+0000","last_change":"2024-09-12T19:14:43.411897+0000","last_active":"2024-09-12T19:14:43.411897+0000","last_peered":"2024-09-12T19:14:43.411897+0000","last_clean":"2024-09-12T19:14:43.411897+0000","last_became_active":"2024-09-12T18:43:29.877925+0000","last_became_peered":"2024-09-12T18:43:29.877925+0000","last_unstale":"2024-09-12T19:14:43.411897+0000","last_undegraded":"2024-09-12T19:14:43.411897+0000","last_fullsized":"2024-09-12T19:14:43.411897+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T19:14:43.411708+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T19:14:43.411708+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.411708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:45.701934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'136","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.987916+0000","last_change":"2024-09-12T19:14:41.987916+0000","last_active":"2024-09-12T19:14:41.987916+0000","last_peered":"2024-09-12T19:14:41.987916+0000","last_clean":"2024-09-12T19:14:41.987916+0000","last_became_active":"2024-09-12T18:41:45.365175+0000","last_became_peered":"2024-09-12T18:41:45.365175+0000","last_unstale":"2024-09-12T19:14:41.987916+0000","last_undegraded":"2024-09-12T19:14:41.987916+0000","last_fullsized":"2024-09-12T19:14:41.987916+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T19:14:41.987735+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T19:14:41.987735+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.987735+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:27.035898+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":832,"num_read_kb":595,"num_write":177,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4212,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:59.124516+0000","last_change":"2024-09-12T18:55:19.130989+0000","last_active":"2024-09-12T19:11:59.124516+0000","last_peered":"2024-09-12T19:11:59.124516+0000","last_clean":"2024-09-12T19:11:59.124516+0000","last_became_active":"2024-09-12T18:55:19.130130+0000","last_became_peered":"2024-09-12T18:55:19.130130+0000","last_unstale":"2024-09-12T19:11:59.124516+0000","last_undegraded":"2024-09-12T19:11:59.124516+0000","last_fullsized":"2024-09-12T19:11:59.124516+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:44.121479+0000","last_change":"2024-09-12T18:43:32.906004+0000","last_active":"2024-09-12T19:11:44.121479+0000","last_peered":"2024-09-12T19:11:44.121479+0000","last_clean":"2024-09-12T19:11:44.121479+0000","last_became_active":"2024-09-12T18:43:32.904789+0000","last_became_peered":"2024-09-12T18:43:32.904789+0000","last_unstale":"2024-09-12T19:11:44.121479+0000","last_undegraded":"2024-09-12T19:11:44.121479+0000","last_fullsized":"2024-09-12T19:11:44.121479+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:44.194875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:42.918932+0000","last_change":"2024-09-12T18:43:29.884688+0000","last_active":"2024-09-12T19:11:42.918932+0000","last_peered":"2024-09-12T19:11:42.918932+0000","last_clean":"2024-09-12T19:11:42.918932+0000","last_became_active":"2024-09-12T18:43:29.883790+0000","last_became_peered":"2024-09-12T18:43:29.883790+0000","last_unstale":"2024-09-12T19:11:42.918932+0000","last_undegraded":"2024-09-12T19:11:42.918932+0000","last_fullsized":"2024-09-12T19:11:42.918932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:07:58.821497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'6","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.251147+0000","last_change":"2024-09-12T19:14:35.251147+0000","last_active":"2024-09-12T19:14:35.251147+0000","last_peered":"2024-09-12T19:14:35.251147+0000","last_clean":"2024-09-12T19:14:35.251147+0000","last_became_active":"2024-09-12T18:41:45.357746+0000","last_became_peered":"2024-09-12T18:41:45.357746+0000","last_unstale":"2024-09-12T19:14:35.251147+0000","last_undegraded":"2024-09-12T19:14:35.251147+0000","last_fullsized":"2024-09-12T19:14:35.251147+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:35.250936+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:35.250936+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.250936+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:30.843137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.854932+0000","last_change":"2024-09-12T19:14:29.854932+0000","last_active":"2024-09-12T19:14:29.854932+0000","last_peered":"2024-09-12T19:14:29.854932+0000","last_clean":"2024-09-12T19:14:29.854932+0000","last_became_active":"2024-09-12T18:55:19.139565+0000","last_became_peered":"2024-09-12T18:55:19.139565+0000","last_unstale":"2024-09-12T19:14:29.854932+0000","last_undegraded":"2024-09-12T19:14:29.854932+0000","last_fullsized":"2024-09-12T19:14:29.854932+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:29.854724+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:29.854724+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.854724+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:30.370455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.286462+0000","last_change":"2024-09-12T19:14:37.286462+0000","last_active":"2024-09-12T19:14:37.286462+0000","last_peered":"2024-09-12T19:14:37.286462+0000","last_clean":"2024-09-12T19:14:37.286462+0000","last_became_active":"2024-09-12T18:43:32.904858+0000","last_became_peered":"2024-09-12T18:43:32.904858+0000","last_unstale":"2024-09-12T19:14:37.286462+0000","last_undegraded":"2024-09-12T19:14:37.286462+0000","last_fullsized":"2024-09-12T19:14:37.286462+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:37.286273+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:37.286273+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.286273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:27.729597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:42.947818+0000","last_change":"2024-09-12T18:43:29.890077+0000","last_active":"2024-09-12T19:13:42.947818+0000","last_peered":"2024-09-12T19:13:42.947818+0000","last_clean":"2024-09-12T19:13:42.947818+0000","last_became_active":"2024-09-12T18:43:29.889328+0000","last_became_peered":"2024-09-12T18:43:29.889328+0000","last_unstale":"2024-09-12T19:13:42.947818+0000","last_undegraded":"2024-09-12T19:13:42.947818+0000","last_fullsized":"2024-09-12T19:13:42.947818+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:20.098869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'8","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.434439+0000","last_change":"2024-09-12T19:14:41.434439+0000","last_active":"2024-09-12T19:14:41.434439+0000","last_peered":"2024-09-12T19:14:41.434439+0000","last_clean":"2024-09-12T19:14:41.434439+0000","last_became_active":"2024-09-12T18:41:45.353369+0000","last_became_peered":"2024-09-12T18:41:45.353369+0000","last_unstale":"2024-09-12T19:14:41.434439+0000","last_undegraded":"2024-09-12T19:14:41.434439+0000","last_fullsized":"2024-09-12T19:14:41.434439+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T19:14:41.434222+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T19:14:41.434222+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.434222+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:43.913683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:28.921223+0000","last_change":"2024-09-12T18:55:19.116656+0000","last_active":"2024-09-12T19:10:28.921223+0000","last_peered":"2024-09-12T19:10:28.921223+0000","last_clean":"2024-09-12T19:10:28.921223+0000","last_became_active":"2024-09-12T18:55:19.115920+0000","last_became_peered":"2024-09-12T18:55:19.115920+0000","last_unstale":"2024-09-12T19:10:28.921223+0000","last_undegraded":"2024-09-12T19:10:28.921223+0000","last_fullsized":"2024-09-12T19:10:28.921223+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:54.225077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:43.911420+0000","last_change":"2024-09-12T18:43:32.914128+0000","last_active":"2024-09-12T19:11:43.911420+0000","last_peered":"2024-09-12T19:11:43.911420+0000","last_clean":"2024-09-12T19:11:43.911420+0000","last_became_active":"2024-09-12T18:43:32.913259+0000","last_became_peered":"2024-09-12T18:43:32.913259+0000","last_unstale":"2024-09-12T19:11:43.911420+0000","last_undegraded":"2024-09-12T19:11:43.911420+0000","last_fullsized":"2024-09-12T19:11:43.911420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:08.421749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:37.903278+0000","last_change":"2024-09-12T18:43:29.883036+0000","last_active":"2024-09-12T19:10:37.903278+0000","last_peered":"2024-09-12T19:10:37.903278+0000","last_clean":"2024-09-12T19:10:37.903278+0000","last_became_active":"2024-09-12T18:43:29.882039+0000","last_became_peered":"2024-09-12T18:43:29.882039+0000","last_unstale":"2024-09-12T19:10:37.903278+0000","last_undegraded":"2024-09-12T19:10:37.903278+0000","last_fullsized":"2024-09-12T19:10:37.903278+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:28.819869+0000","last_clean_scrub_stamp":"2024-09-12T18:43:28.819869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:47:20.442914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'181","reported_seq":586,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:59.111456+0000","last_change":"2024-09-12T18:41:45.354928+0000","last_active":"2024-09-12T19:10:59.111456+0000","last_peered":"2024-09-12T19:10:59.111456+0000","last_clean":"2024-09-12T19:10:59.111456+0000","last_became_active":"2024-09-12T18:41:45.354142+0000","last_became_peered":"2024-09-12T18:41:45.354142+0000","last_unstale":"2024-09-12T19:10:59.111456+0000","last_undegraded":"2024-09-12T19:10:59.111456+0000","last_fullsized":"2024-09-12T19:10:59.111456+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:41:44.307274+0000","last_clean_scrub_stamp":"2024-09-12T18:41:44.307274+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:57.126086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":838,"num_write":233,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:58.944495+0000","last_change":"2024-09-12T18:55:19.143090+0000","last_active":"2024-09-12T19:11:58.944495+0000","last_peered":"2024-09-12T19:11:58.944495+0000","last_clean":"2024-09-12T19:11:58.944495+0000","last_became_active":"2024-09-12T18:55:19.142412+0000","last_became_peered":"2024-09-12T18:55:19.142412+0000","last_unstale":"2024-09-12T19:11:58.944495+0000","last_undegraded":"2024-09-12T19:11:58.944495+0000","last_fullsized":"2024-09-12T19:11:58.944495+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.583634+0000","last_change":"2024-09-12T19:14:38.583634+0000","last_active":"2024-09-12T19:14:38.583634+0000","last_peered":"2024-09-12T19:14:38.583634+0000","last_clean":"2024-09-12T19:14:38.583634+0000","last_became_active":"2024-09-12T18:43:32.939024+0000","last_became_peered":"2024-09-12T18:43:32.939024+0000","last_unstale":"2024-09-12T19:14:38.583634+0000","last_undegraded":"2024-09-12T19:14:38.583634+0000","last_fullsized":"2024-09-12T19:14:38.583634+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:14:38.583441+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:14:38.583441+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.583441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:41.132873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.242928+0000","last_change":"2024-09-12T19:14:34.242928+0000","last_active":"2024-09-12T19:14:34.242928+0000","last_peered":"2024-09-12T19:14:34.242928+0000","last_clean":"2024-09-12T19:14:34.242928+0000","last_became_active":"2024-09-12T18:43:29.892060+0000","last_became_peered":"2024-09-12T18:43:29.892060+0000","last_unstale":"2024-09-12T19:14:34.242928+0000","last_undegraded":"2024-09-12T19:14:34.242928+0000","last_fullsized":"2024-09-12T19:14:34.242928+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:34.242755+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:34.242755+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.242755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:28.135417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'50","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.569521+0000","last_change":"2024-09-12T19:14:30.569521+0000","last_active":"2024-09-12T19:14:30.569521+0000","last_peered":"2024-09-12T19:14:30.569521+0000","last_clean":"2024-09-12T19:14:30.569521+0000","last_became_active":"2024-09-12T18:41:45.355840+0000","last_became_peered":"2024-09-12T18:41:45.355840+0000","last_unstale":"2024-09-12T19:14:30.569521+0000","last_undegraded":"2024-09-12T19:14:30.569521+0000","last_fullsized":"2024-09-12T19:14:30.569521+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T19:14:30.569342+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T19:14:30.569342+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.569342+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:57.208477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":177,"num_write":88,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:07.924734+0000","last_change":"2024-09-12T18:55:19.156335+0000","last_active":"2024-09-12T19:12:07.924734+0000","last_peered":"2024-09-12T19:12:07.924734+0000","last_clean":"2024-09-12T19:12:07.924734+0000","last_became_active":"2024-09-12T18:55:19.155684+0000","last_became_peered":"2024-09-12T18:55:19.155684+0000","last_unstale":"2024-09-12T19:12:07.924734+0000","last_undegraded":"2024-09-12T19:12:07.924734+0000","last_fullsized":"2024-09-12T19:12:07.924734+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'4","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:57.779035+0000","last_change":"2024-09-12T18:43:32.905624+0000","last_active":"2024-09-12T19:13:57.779035+0000","last_peered":"2024-09-12T19:13:57.779035+0000","last_clean":"2024-09-12T19:13:57.779035+0000","last_became_active":"2024-09-12T18:43:32.903273+0000","last_became_peered":"2024-09-12T18:43:32.903273+0000","last_unstale":"2024-09-12T19:13:57.779035+0000","last_undegraded":"2024-09-12T19:13:57.779035+0000","last_fullsized":"2024-09-12T19:13:57.779035+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:58:48.885568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.559742+0000","last_change":"2024-09-12T19:14:35.559742+0000","last_active":"2024-09-12T19:14:35.559742+0000","last_peered":"2024-09-12T19:14:35.559742+0000","last_clean":"2024-09-12T19:14:35.559742+0000","last_became_active":"2024-09-12T18:43:29.865413+0000","last_became_peered":"2024-09-12T18:43:29.865413+0000","last_unstale":"2024-09-12T19:14:35.559742+0000","last_undegraded":"2024-09-12T19:14:35.559742+0000","last_fullsized":"2024-09-12T19:14:35.559742+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:14:35.559570+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:14:35.559570+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.559570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:25.856774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'25","reported_seq":126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.938892+0000","last_change":"2024-09-12T19:14:40.938892+0000","last_active":"2024-09-12T19:14:40.938892+0000","last_peered":"2024-09-12T19:14:40.938892+0000","last_clean":"2024-09-12T19:14:40.938892+0000","last_became_active":"2024-09-12T18:41:45.362445+0000","last_became_peered":"2024-09-12T18:41:45.362445+0000","last_unstale":"2024-09-12T19:14:40.938892+0000","last_undegraded":"2024-09-12T19:14:40.938892+0000","last_fullsized":"2024-09-12T19:14:40.938892+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-12T19:14:40.938699+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-12T19:14:40.938699+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.938699+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:00.250732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'318","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.831899+0000","last_change":"2024-09-12T19:14:18.831615+0000","last_active":"2024-09-12T19:14:18.831899+0000","last_peered":"2024-09-12T19:14:18.831899+0000","last_clean":"2024-09-12T19:14:18.831899+0000","last_became_active":"2024-09-12T18:26:39.872863+0000","last_became_peered":"2024-09-12T18:26:39.872863+0000","last_unstale":"2024-09-12T19:14:18.831899+0000","last_undegraded":"2024-09-12T19:14:18.831899+0000","last_fullsized":"2024-09-12T19:14:18.831899+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T19:14:18.831273+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T19:14:18.831273+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.831273+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:35.503180+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65109,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":407,"num_read_kb":8020,"num_write":948,"num_write_kb":33098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'549","reported_seq":2210,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.381001+0000","last_change":"2024-09-12T19:14:23.381001+0000","last_active":"2024-09-12T19:14:23.381001+0000","last_peered":"2024-09-12T19:14:23.381001+0000","last_clean":"2024-09-12T19:14:23.381001+0000","last_became_active":"2024-09-12T18:26:41.879711+0000","last_became_peered":"2024-09-12T18:26:41.879711+0000","last_unstale":"2024-09-12T19:14:23.381001+0000","last_undegraded":"2024-09-12T19:14:23.381001+0000","last_fullsized":"2024-09-12T19:14:23.381001+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'549","last_scrub_stamp":"2024-09-12T19:14:23.380715+0000","last_deep_scrub":"265'549","last_deep_scrub_stamp":"2024-09-12T19:14:23.380715+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.380715+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:49.716008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2944,"num_read_kb":2757,"num_write":660,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'376","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.135455+0000","last_change":"2024-09-12T19:14:12.135299+0000","last_active":"2024-09-12T19:14:12.135455+0000","last_peered":"2024-09-12T19:14:12.135455+0000","last_clean":"2024-09-12T19:14:12.135455+0000","last_became_active":"2024-09-12T18:26:39.837462+0000","last_became_peered":"2024-09-12T18:26:39.837462+0000","last_unstale":"2024-09-12T19:14:12.135455+0000","last_undegraded":"2024-09-12T19:14:12.135455+0000","last_fullsized":"2024-09-12T19:14:12.135455+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T19:14:12.135058+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T19:14:12.135058+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.135058+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:27.693768+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10456094,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":60601,"num_write":1117,"num_write_kb":26482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'837","reported_seq":2241,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.904657+0000","last_change":"2024-09-12T19:14:23.904657+0000","last_active":"2024-09-12T19:14:23.904657+0000","last_peered":"2024-09-12T19:14:23.904657+0000","last_clean":"2024-09-12T19:14:23.904657+0000","last_became_active":"2024-09-12T18:26:41.863835+0000","last_became_peered":"2024-09-12T18:26:41.863835+0000","last_unstale":"2024-09-12T19:14:23.904657+0000","last_undegraded":"2024-09-12T19:14:23.904657+0000","last_fullsized":"2024-09-12T19:14:23.904657+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'837","last_scrub_stamp":"2024-09-12T19:14:23.904418+0000","last_deep_scrub":"265'837","last_deep_scrub_stamp":"2024-09-12T19:14:23.904418+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.904418+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:53.971623+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3830,"num_read_kb":3409,"num_write":1134,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'378","reported_seq":1063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.849257+0000","last_change":"2024-09-12T19:14:08.849112+0000","last_active":"2024-09-12T19:14:08.849257+0000","last_peered":"2024-09-12T19:14:08.849257+0000","last_clean":"2024-09-12T19:14:08.849257+0000","last_became_active":"2024-09-12T18:26:39.831522+0000","last_became_peered":"2024-09-12T18:26:39.831522+0000","last_unstale":"2024-09-12T19:14:08.849257+0000","last_undegraded":"2024-09-12T19:14:08.849257+0000","last_fullsized":"2024-09-12T19:14:08.849257+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T19:14:08.848850+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T19:14:08.848850+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.848850+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:42.012065+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":634,"num_read_kb":27264,"num_write":1166,"num_write_kb":30891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'366","reported_seq":1836,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.391877+0000","last_change":"2024-09-12T19:14:23.391877+0000","last_active":"2024-09-12T19:14:23.391877+0000","last_peered":"2024-09-12T19:14:23.391877+0000","last_clean":"2024-09-12T19:14:23.391877+0000","last_became_active":"2024-09-12T18:26:41.850001+0000","last_became_peered":"2024-09-12T18:26:41.850001+0000","last_unstale":"2024-09-12T19:14:23.391877+0000","last_undegraded":"2024-09-12T19:14:23.391877+0000","last_fullsized":"2024-09-12T19:14:23.391877+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T19:14:23.391604+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T19:14:23.391604+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.391604+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:22.771625+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2076,"num_read_kb":1992,"num_write":405,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":948,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'352","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.551022+0000","last_change":"2024-09-12T19:14:16.551022+0000","last_active":"2024-09-12T19:14:16.551022+0000","last_peered":"2024-09-12T19:14:16.551022+0000","last_clean":"2024-09-12T19:14:16.551022+0000","last_became_active":"2024-09-12T18:27:11.824331+0000","last_became_peered":"2024-09-12T18:27:11.824331+0000","last_unstale":"2024-09-12T19:14:16.551022+0000","last_undegraded":"2024-09-12T19:14:16.551022+0000","last_fullsized":"2024-09-12T19:14:16.551022+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T19:14:16.550844+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T19:14:16.550844+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.550844+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:58.419343+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":38329,"num_write":1089,"num_write_kb":37388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'504","reported_seq":2067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.607377+0000","last_change":"2024-09-12T19:14:28.607377+0000","last_active":"2024-09-12T19:14:28.607377+0000","last_peered":"2024-09-12T19:14:28.607377+0000","last_clean":"2024-09-12T19:14:28.607377+0000","last_became_active":"2024-09-12T18:26:41.850866+0000","last_became_peered":"2024-09-12T18:26:41.850866+0000","last_unstale":"2024-09-12T19:14:28.607377+0000","last_undegraded":"2024-09-12T19:14:28.607377+0000","last_fullsized":"2024-09-12T19:14:28.607377+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'504","last_scrub_stamp":"2024-09-12T19:14:28.607197+0000","last_deep_scrub":"265'504","last_deep_scrub_stamp":"2024-09-12T19:14:28.607197+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.607197+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:40.118453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2664,"num_read_kb":2487,"num_write":637,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'375","reported_seq":1117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.824067+0000","last_change":"2024-09-12T19:14:17.824067+0000","last_active":"2024-09-12T19:14:17.824067+0000","last_peered":"2024-09-12T19:14:17.824067+0000","last_clean":"2024-09-12T19:14:17.824067+0000","last_became_active":"2024-09-12T18:26:39.870272+0000","last_became_peered":"2024-09-12T18:26:39.870272+0000","last_unstale":"2024-09-12T19:14:17.824067+0000","last_undegraded":"2024-09-12T19:14:17.824067+0000","last_fullsized":"2024-09-12T19:14:17.824067+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T19:14:17.823882+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T19:14:17.823882+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.823882+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:12.604920+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":771,"num_read_kb":17788,"num_write":1173,"num_write_kb":36512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'544","reported_seq":1977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.599400+0000","last_change":"2024-09-12T19:14:16.599400+0000","last_active":"2024-09-12T19:14:16.599400+0000","last_peered":"2024-09-12T19:14:16.599400+0000","last_clean":"2024-09-12T19:14:16.599400+0000","last_became_active":"2024-09-12T18:26:41.865288+0000","last_became_peered":"2024-09-12T18:26:41.865288+0000","last_unstale":"2024-09-12T19:14:16.599400+0000","last_undegraded":"2024-09-12T19:14:16.599400+0000","last_fullsized":"2024-09-12T19:14:16.599400+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'544","last_scrub_stamp":"2024-09-12T19:14:16.599227+0000","last_deep_scrub":"265'544","last_deep_scrub_stamp":"2024-09-12T19:14:16.599227+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.599227+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:43.374177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2721,"num_read_kb":2571,"num_write":759,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'336","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.604868+0000","last_change":"2024-09-12T19:14:15.604868+0000","last_active":"2024-09-12T19:14:15.604868+0000","last_peered":"2024-09-12T19:14:15.604868+0000","last_clean":"2024-09-12T19:14:15.604868+0000","last_became_active":"2024-09-12T18:26:39.851253+0000","last_became_peered":"2024-09-12T18:26:39.851253+0000","last_unstale":"2024-09-12T19:14:15.604868+0000","last_undegraded":"2024-09-12T19:14:15.604868+0000","last_fullsized":"2024-09-12T19:14:15.604868+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T19:14:15.604676+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T19:14:15.604676+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.604676+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:42.167079+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493192,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":31766,"num_write":1103,"num_write_kb":25425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'809","reported_seq":2350,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.411683+0000","last_change":"2024-09-12T19:14:24.411445+0000","last_active":"2024-09-12T19:14:24.411683+0000","last_peered":"2024-09-12T19:14:24.411683+0000","last_clean":"2024-09-12T19:14:24.411683+0000","last_became_active":"2024-09-12T18:26:41.851811+0000","last_became_peered":"2024-09-12T18:26:41.851811+0000","last_unstale":"2024-09-12T19:14:24.411683+0000","last_undegraded":"2024-09-12T19:14:24.411683+0000","last_fullsized":"2024-09-12T19:14:24.411683+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'809","last_scrub_stamp":"2024-09-12T19:14:24.411193+0000","last_deep_scrub":"265'809","last_deep_scrub_stamp":"2024-09-12T19:14:24.411193+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.411193+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:30.044424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3792,"num_read_kb":3404,"num_write":1072,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'361","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.808471+0000","last_change":"2024-09-12T19:14:16.808471+0000","last_active":"2024-09-12T19:14:16.808471+0000","last_peered":"2024-09-12T19:14:16.808471+0000","last_clean":"2024-09-12T19:14:16.808471+0000","last_became_active":"2024-09-12T18:26:39.861529+0000","last_became_peered":"2024-09-12T18:26:39.861529+0000","last_unstale":"2024-09-12T19:14:16.808471+0000","last_undegraded":"2024-09-12T19:14:16.808471+0000","last_fullsized":"2024-09-12T19:14:16.808471+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'361","last_scrub_stamp":"2024-09-12T19:14:16.808282+0000","last_deep_scrub":"265'361","last_deep_scrub_stamp":"2024-09-12T19:14:16.808282+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.808282+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:23.887451+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":30235,"num_write":1160,"num_write_kb":47172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'702","reported_seq":2327,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.344153+0000","last_change":"2024-09-12T19:14:22.343997+0000","last_active":"2024-09-12T19:14:22.344153+0000","last_peered":"2024-09-12T19:14:22.344153+0000","last_clean":"2024-09-12T19:14:22.344153+0000","last_became_active":"2024-09-12T18:26:41.878820+0000","last_became_peered":"2024-09-12T18:26:41.878820+0000","last_unstale":"2024-09-12T19:14:22.344153+0000","last_undegraded":"2024-09-12T19:14:22.344153+0000","last_fullsized":"2024-09-12T19:14:22.344153+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'702","last_scrub_stamp":"2024-09-12T19:14:22.343819+0000","last_deep_scrub":"265'702","last_deep_scrub_stamp":"2024-09-12T19:14:22.343819+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.343819+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:29.298164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3429,"num_read_kb":3073,"num_write":944,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'345","reported_seq":1045,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.978941+0000","last_change":"2024-09-12T19:14:18.978941+0000","last_active":"2024-09-12T19:14:18.978941+0000","last_peered":"2024-09-12T19:14:18.978941+0000","last_clean":"2024-09-12T19:14:18.978941+0000","last_became_active":"2024-09-12T18:27:11.824008+0000","last_became_peered":"2024-09-12T18:27:11.824008+0000","last_unstale":"2024-09-12T19:14:18.978941+0000","last_undegraded":"2024-09-12T19:14:18.978941+0000","last_fullsized":"2024-09-12T19:14:18.978941+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-12T19:14:18.978754+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-12T19:14:18.978754+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.978754+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:11.553698+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":634,"num_read_kb":10155,"num_write":1129,"num_write_kb":30763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'678","reported_seq":2298,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.021610+0000","last_change":"2024-09-12T19:14:13.021352+0000","last_active":"2024-09-12T19:14:13.021610+0000","last_peered":"2024-09-12T19:14:13.021610+0000","last_clean":"2024-09-12T19:14:13.021610+0000","last_became_active":"2024-09-12T18:26:41.854487+0000","last_became_peered":"2024-09-12T18:26:41.854487+0000","last_unstale":"2024-09-12T19:14:13.021610+0000","last_undegraded":"2024-09-12T19:14:13.021610+0000","last_fullsized":"2024-09-12T19:14:13.021610+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'678","last_scrub_stamp":"2024-09-12T19:14:13.021126+0000","last_deep_scrub":"265'678","last_deep_scrub_stamp":"2024-09-12T19:14:13.021126+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.021126+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:16.262713+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3483,"num_read_kb":3149,"num_write":934,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3253,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'464","reported_seq":2077,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.379502+0000","last_change":"2024-09-12T19:14:21.379502+0000","last_active":"2024-09-12T19:14:21.379502+0000","last_peered":"2024-09-12T19:14:21.379502+0000","last_clean":"2024-09-12T19:14:21.379502+0000","last_became_active":"2024-09-12T18:26:41.845080+0000","last_became_peered":"2024-09-12T18:26:41.845080+0000","last_unstale":"2024-09-12T19:14:21.379502+0000","last_undegraded":"2024-09-12T19:14:21.379502+0000","last_fullsized":"2024-09-12T19:14:21.379502+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'464","last_scrub_stamp":"2024-09-12T19:14:21.379327+0000","last_deep_scrub":"265'464","last_deep_scrub_stamp":"2024-09-12T19:14:21.379327+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.379327+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:35.754623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2421,"num_read_kb":2289,"num_write":534,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'377","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.854483+0000","last_change":"2024-09-12T19:14:12.854483+0000","last_active":"2024-09-12T19:14:12.854483+0000","last_peered":"2024-09-12T19:14:12.854483+0000","last_clean":"2024-09-12T19:14:12.854483+0000","last_became_active":"2024-09-12T18:26:39.872936+0000","last_became_peered":"2024-09-12T18:26:39.872936+0000","last_unstale":"2024-09-12T19:14:12.854483+0000","last_undegraded":"2024-09-12T19:14:12.854483+0000","last_fullsized":"2024-09-12T19:14:12.854483+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:14:12.854221+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:14:12.854221+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.854221+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.012669+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":506,"num_read_kb":24957,"num_write":1245,"num_write_kb":33279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'560","reported_seq":2182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.878540+0000","last_change":"2024-09-12T19:14:20.878540+0000","last_active":"2024-09-12T19:14:20.878540+0000","last_peered":"2024-09-12T19:14:20.878540+0000","last_clean":"2024-09-12T19:14:20.878540+0000","last_became_active":"2024-09-12T18:26:41.865247+0000","last_became_peered":"2024-09-12T18:26:41.865247+0000","last_unstale":"2024-09-12T19:14:20.878540+0000","last_undegraded":"2024-09-12T19:14:20.878540+0000","last_fullsized":"2024-09-12T19:14:20.878540+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'560","last_scrub_stamp":"2024-09-12T19:14:20.878338+0000","last_deep_scrub":"265'560","last_deep_scrub_stamp":"2024-09-12T19:14:20.878338+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.878338+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:05.827599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2931,"num_read_kb":2718,"num_write":721,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'407","reported_seq":1124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.608658+0000","last_change":"2024-09-12T19:14:12.608658+0000","last_active":"2024-09-12T19:14:12.608658+0000","last_peered":"2024-09-12T19:14:12.608658+0000","last_clean":"2024-09-12T19:14:12.608658+0000","last_became_active":"2024-09-12T18:26:39.858964+0000","last_became_peered":"2024-09-12T18:26:39.858964+0000","last_unstale":"2024-09-12T19:14:12.608658+0000","last_undegraded":"2024-09-12T19:14:12.608658+0000","last_fullsized":"2024-09-12T19:14:12.608658+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'407","last_scrub_stamp":"2024-09-12T19:14:12.608446+0000","last_deep_scrub":"265'407","last_deep_scrub_stamp":"2024-09-12T19:14:12.608446+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.608446+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:32.397218+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":810,"num_read_kb":25615,"num_write":1319,"num_write_kb":27961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'829","reported_seq":2320,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.413316+0000","last_change":"2024-09-12T19:14:20.413316+0000","last_active":"2024-09-12T19:14:20.413316+0000","last_peered":"2024-09-12T19:14:20.413316+0000","last_clean":"2024-09-12T19:14:20.413316+0000","last_became_active":"2024-09-12T18:26:41.861762+0000","last_became_peered":"2024-09-12T18:26:41.861762+0000","last_unstale":"2024-09-12T19:14:20.413316+0000","last_undegraded":"2024-09-12T19:14:20.413316+0000","last_fullsized":"2024-09-12T19:14:20.413316+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'829","last_scrub_stamp":"2024-09-12T19:14:20.413148+0000","last_deep_scrub":"265'829","last_deep_scrub_stamp":"2024-09-12T19:14:20.413148+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.413148+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:56.664208+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3868,"num_read_kb":3443,"num_write":1111,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'398","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.589461+0000","last_change":"2024-09-12T19:14:10.589461+0000","last_active":"2024-09-12T19:14:10.589461+0000","last_peered":"2024-09-12T19:14:10.589461+0000","last_clean":"2024-09-12T19:14:10.589461+0000","last_became_active":"2024-09-12T18:26:39.856700+0000","last_became_peered":"2024-09-12T18:26:39.856700+0000","last_unstale":"2024-09-12T19:14:10.589461+0000","last_undegraded":"2024-09-12T19:14:10.589461+0000","last_fullsized":"2024-09-12T19:14:10.589461+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'398","last_scrub_stamp":"2024-09-12T19:14:10.589144+0000","last_deep_scrub":"265'398","last_deep_scrub_stamp":"2024-09-12T19:14:10.589144+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.589144+0000","objects_scrubbed":9,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:43.957851+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632225,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":583,"num_read_kb":29092,"num_write":1242,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'409","reported_seq":1982,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.020591+0000","last_change":"2024-09-12T19:14:14.020591+0000","last_active":"2024-09-12T19:14:14.020591+0000","last_peered":"2024-09-12T19:14:14.020591+0000","last_clean":"2024-09-12T19:14:14.020591+0000","last_became_active":"2024-09-12T18:26:41.854687+0000","last_became_peered":"2024-09-12T18:26:41.854687+0000","last_unstale":"2024-09-12T19:14:14.020591+0000","last_undegraded":"2024-09-12T19:14:14.020591+0000","last_fullsized":"2024-09-12T19:14:14.020591+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T19:14:14.020301+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T19:14:14.020301+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.020301+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:02.096125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2203,"num_read_kb":2114,"num_write":459,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'308","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.295484+0000","last_change":"2024-09-12T19:14:09.295484+0000","last_active":"2024-09-12T19:14:09.295484+0000","last_peered":"2024-09-12T19:14:09.295484+0000","last_clean":"2024-09-12T19:14:09.295484+0000","last_became_active":"2024-09-12T18:26:39.845295+0000","last_became_peered":"2024-09-12T18:26:39.845295+0000","last_unstale":"2024-09-12T19:14:09.295484+0000","last_undegraded":"2024-09-12T19:14:09.295484+0000","last_fullsized":"2024-09-12T19:14:09.295484+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'308","last_scrub_stamp":"2024-09-12T19:14:09.295239+0000","last_deep_scrub":"265'308","last_deep_scrub_stamp":"2024-09-12T19:14:09.295239+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.295239+0000","objects_scrubbed":9,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:26.941892+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306760,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":23315,"num_write":964,"num_write_kb":25673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'820","reported_seq":2475,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.067808+0000","last_change":"2024-09-12T19:14:11.067808+0000","last_active":"2024-09-12T19:14:11.067808+0000","last_peered":"2024-09-12T19:14:11.067808+0000","last_clean":"2024-09-12T19:14:11.067808+0000","last_became_active":"2024-09-12T18:26:41.856280+0000","last_became_peered":"2024-09-12T18:26:41.856280+0000","last_unstale":"2024-09-12T19:14:11.067808+0000","last_undegraded":"2024-09-12T19:14:11.067808+0000","last_fullsized":"2024-09-12T19:14:11.067808+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'820","last_scrub_stamp":"2024-09-12T19:14:11.067602+0000","last_deep_scrub":"265'820","last_deep_scrub_stamp":"2024-09-12T19:14:11.067602+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.067602+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:07.191479+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4038,"num_read_kb":3655,"num_write":1078,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1764,"num_omap_keys":7,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'416","reported_seq":1117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.822636+0000","last_change":"2024-09-12T19:14:09.822636+0000","last_active":"2024-09-12T19:14:09.822636+0000","last_peered":"2024-09-12T19:14:09.822636+0000","last_clean":"2024-09-12T19:14:09.822636+0000","last_became_active":"2024-09-12T18:26:39.842159+0000","last_became_peered":"2024-09-12T18:26:39.842159+0000","last_unstale":"2024-09-12T19:14:09.822636+0000","last_undegraded":"2024-09-12T19:14:09.822636+0000","last_fullsized":"2024-09-12T19:14:09.822636+0000","mapping_epoch":24,"log_start":"265'401","ondisk_log_start":"265'401","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'416","last_scrub_stamp":"2024-09-12T19:14:09.822414+0000","last_deep_scrub":"265'416","last_deep_scrub_stamp":"2024-09-12T19:14:09.822414+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.822414+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":401,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:12.755786+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":622,"num_read_kb":58105,"num_write":1270,"num_write_kb":62462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'846","reported_seq":2441,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.379392+0000","last_change":"2024-09-12T19:14:22.379392+0000","last_active":"2024-09-12T19:14:22.379392+0000","last_peered":"2024-09-12T19:14:22.379392+0000","last_clean":"2024-09-12T19:14:22.379392+0000","last_became_active":"2024-09-12T18:26:41.853403+0000","last_became_peered":"2024-09-12T18:26:41.853403+0000","last_unstale":"2024-09-12T19:14:22.379392+0000","last_undegraded":"2024-09-12T19:14:22.379392+0000","last_fullsized":"2024-09-12T19:14:22.379392+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'846","last_scrub_stamp":"2024-09-12T19:14:22.379204+0000","last_deep_scrub":"265'846","last_deep_scrub_stamp":"2024-09-12T19:14:22.379204+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.379204+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:29.289985+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3981,"num_read_kb":3579,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'408","reported_seq":1125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.829466+0000","last_change":"2024-09-12T19:14:07.829466+0000","last_active":"2024-09-12T19:14:07.829466+0000","last_peered":"2024-09-12T19:14:07.829466+0000","last_clean":"2024-09-12T19:14:07.829466+0000","last_became_active":"2024-09-12T18:26:39.834006+0000","last_became_peered":"2024-09-12T18:26:39.834006+0000","last_unstale":"2024-09-12T19:14:07.829466+0000","last_undegraded":"2024-09-12T19:14:07.829466+0000","last_fullsized":"2024-09-12T19:14:07.829466+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'408","last_scrub_stamp":"2024-09-12T19:14:07.829075+0000","last_deep_scrub":"265'408","last_deep_scrub_stamp":"2024-09-12T19:14:07.829075+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.829075+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:01.756044+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":720,"num_read_kb":82742,"num_write":1326,"num_write_kb":55909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'116","reported_seq":636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.401927+0000","last_change":"2024-09-12T19:14:38.401927+0000","last_active":"2024-09-12T19:14:38.401927+0000","last_peered":"2024-09-12T19:14:38.401927+0000","last_clean":"2024-09-12T19:14:38.401927+0000","last_became_active":"2024-09-12T18:26:49.906589+0000","last_became_peered":"2024-09-12T18:26:49.906589+0000","last_unstale":"2024-09-12T19:14:38.401927+0000","last_undegraded":"2024-09-12T19:14:38.401927+0000","last_fullsized":"2024-09-12T19:14:38.401927+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T19:14:38.401733+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T19:14:38.401733+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.401733+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:42.295621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":280,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'755","reported_seq":2173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.828743+0000","last_change":"2024-09-12T19:14:11.828743+0000","last_active":"2024-09-12T19:14:11.828743+0000","last_peered":"2024-09-12T19:14:11.828743+0000","last_clean":"2024-09-12T19:14:11.828743+0000","last_became_active":"2024-09-12T18:26:41.852831+0000","last_became_peered":"2024-09-12T18:26:41.852831+0000","last_unstale":"2024-09-12T19:14:11.828743+0000","last_undegraded":"2024-09-12T19:14:11.828743+0000","last_fullsized":"2024-09-12T19:14:11.828743+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'755","last_scrub_stamp":"2024-09-12T19:14:11.828569+0000","last_deep_scrub":"265'755","last_deep_scrub_stamp":"2024-09-12T19:14:11.828569+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.828569+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:38.861938+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3501,"num_read_kb":3138,"num_write":986,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'391","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.849709+0000","last_change":"2024-09-12T19:14:10.849709+0000","last_active":"2024-09-12T19:14:10.849709+0000","last_peered":"2024-09-12T19:14:10.849709+0000","last_clean":"2024-09-12T19:14:10.849709+0000","last_became_active":"2024-09-12T18:27:11.823705+0000","last_became_peered":"2024-09-12T18:27:11.823705+0000","last_unstale":"2024-09-12T19:14:10.849709+0000","last_undegraded":"2024-09-12T19:14:10.849709+0000","last_fullsized":"2024-09-12T19:14:10.849709+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T19:14:10.849514+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T19:14:10.849514+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.849514+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:57.941792+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":587,"num_read_kb":55935,"num_write":1256,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.290526+0000","last_change":"2024-09-12T19:14:26.290526+0000","last_active":"2024-09-12T19:14:26.290526+0000","last_peered":"2024-09-12T19:14:26.290526+0000","last_clean":"2024-09-12T19:14:26.290526+0000","last_became_active":"2024-09-12T18:26:43.857754+0000","last_became_peered":"2024-09-12T18:26:43.857754+0000","last_unstale":"2024-09-12T19:14:26.290526+0000","last_undegraded":"2024-09-12T19:14:26.290526+0000","last_fullsized":"2024-09-12T19:14:26.290526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.290273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.290273+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.290273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:50.223630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'321","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.680630+0000","last_change":"2024-09-12T19:14:21.680630+0000","last_active":"2024-09-12T19:14:21.680630+0000","last_peered":"2024-09-12T19:14:21.680630+0000","last_clean":"2024-09-12T19:14:21.680630+0000","last_became_active":"2024-09-12T18:26:45.876070+0000","last_became_peered":"2024-09-12T18:26:45.876070+0000","last_unstale":"2024-09-12T19:14:21.680630+0000","last_undegraded":"2024-09-12T19:14:21.680630+0000","last_fullsized":"2024-09-12T19:14:21.680630+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T19:14:21.680429+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T19:14:21.680429+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.680429+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:11.520559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48204,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1086,"num_write":410,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.987495+0000","last_change":"2024-09-12T19:14:36.987495+0000","last_active":"2024-09-12T19:14:36.987495+0000","last_peered":"2024-09-12T19:14:36.987495+0000","last_clean":"2024-09-12T19:14:36.987495+0000","last_became_active":"2024-09-12T18:26:47.895471+0000","last_became_peered":"2024-09-12T18:26:47.895471+0000","last_unstale":"2024-09-12T19:14:36.987495+0000","last_undegraded":"2024-09-12T19:14:36.987495+0000","last_fullsized":"2024-09-12T19:14:36.987495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:36.987320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:36.987320+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.987320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:48.128304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'2444","reported_seq":4333,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.421658+0000","last_change":"2024-09-12T19:14:39.421658+0000","last_active":"2024-09-12T19:14:39.421658+0000","last_peered":"2024-09-12T19:14:39.421658+0000","last_clean":"2024-09-12T19:14:39.421658+0000","last_became_active":"2024-09-12T18:26:49.913125+0000","last_became_peered":"2024-09-12T18:26:49.913125+0000","last_unstale":"2024-09-12T19:14:39.421658+0000","last_undegraded":"2024-09-12T19:14:39.421658+0000","last_fullsized":"2024-09-12T19:14:39.421658+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2444","last_scrub_stamp":"2024-09-12T19:14:39.421480+0000","last_deep_scrub":"265'2444","last_deep_scrub_stamp":"2024-09-12T19:14:39.421480+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.421480+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":2400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:47.047328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6085,"num_read_kb":6089,"num_write":4865,"num_write_kb":1791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'570","reported_seq":2198,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.473163+0000","last_change":"2024-09-12T19:14:18.473163+0000","last_active":"2024-09-12T19:14:18.473163+0000","last_peered":"2024-09-12T19:14:18.473163+0000","last_clean":"2024-09-12T19:14:18.473163+0000","last_became_active":"2024-09-12T18:26:41.871531+0000","last_became_peered":"2024-09-12T18:26:41.871531+0000","last_unstale":"2024-09-12T19:14:18.473163+0000","last_undegraded":"2024-09-12T19:14:18.473163+0000","last_fullsized":"2024-09-12T19:14:18.473163+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'570","last_scrub_stamp":"2024-09-12T19:14:18.472978+0000","last_deep_scrub":"265'570","last_deep_scrub_stamp":"2024-09-12T19:14:18.472978+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.472978+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:22.258961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2964,"num_read_kb":2726,"num_write":725,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3006,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'370","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.853877+0000","last_change":"2024-09-12T19:14:06.853877+0000","last_active":"2024-09-12T19:14:06.853877+0000","last_peered":"2024-09-12T19:14:06.853877+0000","last_clean":"2024-09-12T19:14:06.853877+0000","last_became_active":"2024-09-12T18:26:39.871605+0000","last_became_peered":"2024-09-12T18:26:39.871605+0000","last_unstale":"2024-09-12T19:14:06.853877+0000","last_undegraded":"2024-09-12T19:14:06.853877+0000","last_fullsized":"2024-09-12T19:14:06.853877+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T19:14:06.853744+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T19:14:06.853744+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.853744+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:17.533292+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721310,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":33411,"num_write":1198,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.044317+0000","last_change":"2024-09-12T19:14:22.044317+0000","last_active":"2024-09-12T19:14:22.044317+0000","last_peered":"2024-09-12T19:14:22.044317+0000","last_clean":"2024-09-12T19:14:22.044317+0000","last_became_active":"2024-09-12T18:26:43.865817+0000","last_became_peered":"2024-09-12T18:26:43.865817+0000","last_unstale":"2024-09-12T19:14:22.044317+0000","last_undegraded":"2024-09-12T19:14:22.044317+0000","last_fullsized":"2024-09-12T19:14:22.044317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:22.044143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:22.044143+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.044143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:11.814993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'78","reported_seq":613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.411663+0000","last_change":"2024-09-12T19:14:31.411663+0000","last_active":"2024-09-12T19:14:31.411663+0000","last_peered":"2024-09-12T19:14:31.411663+0000","last_clean":"2024-09-12T19:14:31.411663+0000","last_became_active":"2024-09-12T18:26:45.854087+0000","last_became_peered":"2024-09-12T18:26:45.854087+0000","last_unstale":"2024-09-12T19:14:31.411663+0000","last_undegraded":"2024-09-12T19:14:31.411663+0000","last_fullsized":"2024-09-12T19:14:31.411663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'78","last_scrub_stamp":"2024-09-12T19:14:31.411447+0000","last_deep_scrub":"265'78","last_deep_scrub_stamp":"2024-09-12T19:14:31.411447+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.411447+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:41.644882+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.411477+0000","last_change":"2024-09-12T19:14:35.411477+0000","last_active":"2024-09-12T19:14:35.411477+0000","last_peered":"2024-09-12T19:14:35.411477+0000","last_clean":"2024-09-12T19:14:35.411477+0000","last_became_active":"2024-09-12T18:26:47.880374+0000","last_became_peered":"2024-09-12T18:26:47.880374+0000","last_unstale":"2024-09-12T19:14:35.411477+0000","last_undegraded":"2024-09-12T19:14:35.411477+0000","last_fullsized":"2024-09-12T19:14:35.411477+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:35.411256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:35.411256+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.411256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:16.321639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'124","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.600230+0000","last_change":"2024-09-12T19:14:40.600230+0000","last_active":"2024-09-12T19:14:40.600230+0000","last_peered":"2024-09-12T19:14:40.600230+0000","last_clean":"2024-09-12T19:14:40.600230+0000","last_became_active":"2024-09-12T18:26:49.926650+0000","last_became_peered":"2024-09-12T18:26:49.926650+0000","last_unstale":"2024-09-12T19:14:40.600230+0000","last_undegraded":"2024-09-12T19:14:40.600230+0000","last_fullsized":"2024-09-12T19:14:40.600230+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-12T19:14:40.600061+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-12T19:14:40.600061+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.600061+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:02.379306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'509","reported_seq":2187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.773187+0000","last_change":"2024-09-12T19:14:11.773187+0000","last_active":"2024-09-12T19:14:11.773187+0000","last_peered":"2024-09-12T19:14:11.773187+0000","last_clean":"2024-09-12T19:14:11.773187+0000","last_became_active":"2024-09-12T18:26:41.851928+0000","last_became_peered":"2024-09-12T18:26:41.851928+0000","last_unstale":"2024-09-12T19:14:11.773187+0000","last_undegraded":"2024-09-12T19:14:11.773187+0000","last_fullsized":"2024-09-12T19:14:11.773187+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'509","last_scrub_stamp":"2024-09-12T19:14:11.773008+0000","last_deep_scrub":"265'509","last_deep_scrub_stamp":"2024-09-12T19:14:11.773008+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.773008+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:15.496861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2649,"num_read_kb":2492,"num_write":594,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'375","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.825389+0000","last_change":"2024-09-12T19:14:15.825389+0000","last_active":"2024-09-12T19:14:15.825389+0000","last_peered":"2024-09-12T19:14:15.825389+0000","last_clean":"2024-09-12T19:14:15.825389+0000","last_became_active":"2024-09-12T18:26:39.863389+0000","last_became_peered":"2024-09-12T18:26:39.863389+0000","last_unstale":"2024-09-12T19:14:15.825389+0000","last_undegraded":"2024-09-12T19:14:15.825389+0000","last_fullsized":"2024-09-12T19:14:15.825389+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T19:14:15.825196+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T19:14:15.825196+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.825196+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:32.797512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":529,"num_read_kb":22645,"num_write":1125,"num_write_kb":31309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.120777+0000","last_change":"2024-09-12T19:14:25.120777+0000","last_active":"2024-09-12T19:14:25.120777+0000","last_peered":"2024-09-12T19:14:25.120777+0000","last_clean":"2024-09-12T19:14:25.120777+0000","last_became_active":"2024-09-12T18:26:43.853736+0000","last_became_peered":"2024-09-12T18:26:43.853736+0000","last_unstale":"2024-09-12T19:14:25.120777+0000","last_undegraded":"2024-09-12T19:14:25.120777+0000","last_fullsized":"2024-09-12T19:14:25.120777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:25.120602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:25.120602+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.120602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:00.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'118","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.965708+0000","last_change":"2024-09-12T19:14:21.965708+0000","last_active":"2024-09-12T19:14:21.965708+0000","last_peered":"2024-09-12T19:14:21.965708+0000","last_clean":"2024-09-12T19:14:21.965708+0000","last_became_active":"2024-09-12T18:26:45.853143+0000","last_became_peered":"2024-09-12T18:26:45.853143+0000","last_unstale":"2024-09-12T19:14:21.965708+0000","last_undegraded":"2024-09-12T19:14:21.965708+0000","last_fullsized":"2024-09-12T19:14:21.965708+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T19:14:21.965574+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T19:14:21.965574+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.965574+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:04.870883+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'765","reported_seq":4119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.961804+0000","last_change":"2024-09-12T19:14:35.961804+0000","last_active":"2024-09-12T19:14:35.961804+0000","last_peered":"2024-09-12T19:14:35.961804+0000","last_clean":"2024-09-12T19:14:35.961804+0000","last_became_active":"2024-09-12T18:26:47.895056+0000","last_became_peered":"2024-09-12T18:26:47.895056+0000","last_unstale":"2024-09-12T19:14:35.961804+0000","last_undegraded":"2024-09-12T19:14:35.961804+0000","last_fullsized":"2024-09-12T19:14:35.961804+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'765","last_scrub_stamp":"2024-09-12T19:14:35.961585+0000","last_deep_scrub":"265'765","last_deep_scrub_stamp":"2024-09-12T19:14:35.961585+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.961585+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":702,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:37.718968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'176","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.370688+0000","last_change":"2024-09-12T19:14:39.370688+0000","last_active":"2024-09-12T19:14:39.370688+0000","last_peered":"2024-09-12T19:14:39.370688+0000","last_clean":"2024-09-12T19:14:39.370688+0000","last_became_active":"2024-09-12T18:26:49.890325+0000","last_became_peered":"2024-09-12T18:26:49.890325+0000","last_unstale":"2024-09-12T19:14:39.370688+0000","last_undegraded":"2024-09-12T19:14:39.370688+0000","last_fullsized":"2024-09-12T19:14:39.370688+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'176","last_scrub_stamp":"2024-09-12T19:14:39.370494+0000","last_deep_scrub":"265'176","last_deep_scrub_stamp":"2024-09-12T19:14:39.370494+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.370494+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:05.708623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":638,"num_write":360,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'756","reported_seq":2316,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.795472+0000","last_change":"2024-09-12T19:14:10.795472+0000","last_active":"2024-09-12T19:14:10.795472+0000","last_peered":"2024-09-12T19:14:10.795472+0000","last_clean":"2024-09-12T19:14:10.795472+0000","last_became_active":"2024-09-12T18:26:41.862240+0000","last_became_peered":"2024-09-12T18:26:41.862240+0000","last_unstale":"2024-09-12T19:14:10.795472+0000","last_undegraded":"2024-09-12T19:14:10.795472+0000","last_fullsized":"2024-09-12T19:14:10.795472+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'756","last_scrub_stamp":"2024-09-12T19:14:10.795293+0000","last_deep_scrub":"265'756","last_deep_scrub_stamp":"2024-09-12T19:14:10.795293+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.795293+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:49.343521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3627,"num_read_kb":3298,"num_write":982,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'333","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.459163+0000","last_change":"2024-09-12T19:14:05.459163+0000","last_active":"2024-09-12T19:14:05.459163+0000","last_peered":"2024-09-12T19:14:05.459163+0000","last_clean":"2024-09-12T19:14:05.459163+0000","last_became_active":"2024-09-12T18:26:39.843351+0000","last_became_peered":"2024-09-12T18:26:39.843351+0000","last_unstale":"2024-09-12T19:14:05.459163+0000","last_undegraded":"2024-09-12T19:14:05.459163+0000","last_fullsized":"2024-09-12T19:14:05.459163+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T19:14:05.458982+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T19:14:05.458982+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.458982+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:06.506600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170084,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":20705,"num_write":1033,"num_write_kb":27627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.337030+0000","last_change":"2024-09-12T19:14:27.337030+0000","last_active":"2024-09-12T19:14:27.337030+0000","last_peered":"2024-09-12T19:14:27.337030+0000","last_clean":"2024-09-12T19:14:27.337030+0000","last_became_active":"2024-09-12T18:26:43.842479+0000","last_became_peered":"2024-09-12T18:26:43.842479+0000","last_unstale":"2024-09-12T19:14:27.337030+0000","last_undegraded":"2024-09-12T19:14:27.337030+0000","last_fullsized":"2024-09-12T19:14:27.337030+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:27.336832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:27.336832+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.336832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:05.189762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'290","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.925082+0000","last_change":"2024-09-12T19:14:31.925082+0000","last_active":"2024-09-12T19:14:31.925082+0000","last_peered":"2024-09-12T19:14:31.925082+0000","last_clean":"2024-09-12T19:14:31.925082+0000","last_became_active":"2024-09-12T18:26:46.024425+0000","last_became_peered":"2024-09-12T18:26:46.024425+0000","last_unstale":"2024-09-12T19:14:31.925082+0000","last_undegraded":"2024-09-12T19:14:31.925082+0000","last_fullsized":"2024-09-12T19:14:31.925082+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'290","last_scrub_stamp":"2024-09-12T19:14:31.924894+0000","last_deep_scrub":"265'290","last_deep_scrub_stamp":"2024-09-12T19:14:31.924894+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.924894+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:37.319952+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53269,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1121,"num_write":396,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'805","reported_seq":2376,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.127838+0000","last_change":"2024-09-12T19:14:35.127838+0000","last_active":"2024-09-12T19:14:35.127838+0000","last_peered":"2024-09-12T19:14:35.127838+0000","last_clean":"2024-09-12T19:14:35.127838+0000","last_became_active":"2024-09-12T18:26:47.898903+0000","last_became_peered":"2024-09-12T18:26:47.898903+0000","last_unstale":"2024-09-12T19:14:35.127838+0000","last_undegraded":"2024-09-12T19:14:35.127838+0000","last_fullsized":"2024-09-12T19:14:35.127838+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'805","last_scrub_stamp":"2024-09-12T19:14:35.127664+0000","last_deep_scrub":"265'805","last_deep_scrub_stamp":"2024-09-12T19:14:35.127664+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.127664+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:40.173903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'763","reported_seq":2259,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.517406+0000","last_change":"2024-09-12T19:14:17.517243+0000","last_active":"2024-09-12T19:14:17.517406+0000","last_peered":"2024-09-12T19:14:17.517406+0000","last_clean":"2024-09-12T19:14:17.517406+0000","last_became_active":"2024-09-12T18:26:41.869852+0000","last_became_peered":"2024-09-12T18:26:41.869852+0000","last_unstale":"2024-09-12T19:14:17.517406+0000","last_undegraded":"2024-09-12T19:14:17.517406+0000","last_fullsized":"2024-09-12T19:14:17.517406+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'763","last_scrub_stamp":"2024-09-12T19:14:17.517055+0000","last_deep_scrub":"265'763","last_deep_scrub_stamp":"2024-09-12T19:14:17.517055+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.517055+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:12.395779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3529,"num_read_kb":3192,"num_write":1004,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'488","reported_seq":1218,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.860766+0000","last_change":"2024-09-12T19:14:07.860628+0000","last_active":"2024-09-12T19:14:07.860766+0000","last_peered":"2024-09-12T19:14:07.860766+0000","last_clean":"2024-09-12T19:14:07.860766+0000","last_became_active":"2024-09-12T18:26:39.873512+0000","last_became_peered":"2024-09-12T18:26:39.873512+0000","last_unstale":"2024-09-12T19:14:07.860766+0000","last_undegraded":"2024-09-12T19:14:07.860766+0000","last_fullsized":"2024-09-12T19:14:07.860766+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'488","last_scrub_stamp":"2024-09-12T19:14:07.860425+0000","last_deep_scrub":"265'488","last_deep_scrub_stamp":"2024-09-12T19:14:07.860425+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.860425+0000","objects_scrubbed":9,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:17.144835+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4719716,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":925,"num_read_kb":13008,"num_write":1544,"num_write_kb":39306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.943955+0000","last_change":"2024-09-12T19:14:25.943735+0000","last_active":"2024-09-12T19:14:25.943955+0000","last_peered":"2024-09-12T19:14:25.943955+0000","last_clean":"2024-09-12T19:14:25.943955+0000","last_became_active":"2024-09-12T18:26:43.871192+0000","last_became_peered":"2024-09-12T18:26:43.871192+0000","last_unstale":"2024-09-12T19:14:25.943955+0000","last_undegraded":"2024-09-12T19:14:25.943955+0000","last_fullsized":"2024-09-12T19:14:25.943955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:25.943520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:25.943520+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.943520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:09.489365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'374","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.423698+0000","last_change":"2024-09-12T19:14:31.423562+0000","last_active":"2024-09-12T19:14:31.423698+0000","last_peered":"2024-09-12T19:14:31.423698+0000","last_clean":"2024-09-12T19:14:31.423698+0000","last_became_active":"2024-09-12T18:26:46.021239+0000","last_became_peered":"2024-09-12T18:26:46.021239+0000","last_unstale":"2024-09-12T19:14:31.423698+0000","last_undegraded":"2024-09-12T19:14:31.423698+0000","last_fullsized":"2024-09-12T19:14:31.423698+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T19:14:31.423337+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T19:14:31.423337+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.423337+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:09.733674+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43291,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":581,"num_read_kb":1196,"num_write":460,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.087460+0000","last_change":"2024-09-12T19:14:23.087460+0000","last_active":"2024-09-12T19:14:23.087460+0000","last_peered":"2024-09-12T19:14:23.087460+0000","last_clean":"2024-09-12T19:14:23.087460+0000","last_became_active":"2024-09-12T18:26:47.879079+0000","last_became_peered":"2024-09-12T18:26:47.879079+0000","last_unstale":"2024-09-12T19:14:23.087460+0000","last_undegraded":"2024-09-12T19:14:23.087460+0000","last_fullsized":"2024-09-12T19:14:23.087460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:23.087260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:23.087260+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.087260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:13.127777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'554","reported_seq":1370,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.468996+0000","last_change":"2024-09-12T19:14:35.468996+0000","last_active":"2024-09-12T19:14:35.468996+0000","last_peered":"2024-09-12T19:14:35.468996+0000","last_clean":"2024-09-12T19:14:35.468996+0000","last_became_active":"2024-09-12T18:26:49.913115+0000","last_became_peered":"2024-09-12T18:26:49.913115+0000","last_unstale":"2024-09-12T19:14:35.468996+0000","last_undegraded":"2024-09-12T19:14:35.468996+0000","last_fullsized":"2024-09-12T19:14:35.468996+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'554","last_scrub_stamp":"2024-09-12T19:14:35.468768+0000","last_deep_scrub":"265'554","last_deep_scrub_stamp":"2024-09-12T19:14:35.468768+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.468768+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:18.817640+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1285,"num_write":1159,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'406","reported_seq":1997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.255176+0000","last_change":"2024-09-12T19:14:11.255011+0000","last_active":"2024-09-12T19:14:11.255176+0000","last_peered":"2024-09-12T19:14:11.255176+0000","last_clean":"2024-09-12T19:14:11.255176+0000","last_became_active":"2024-09-12T18:26:41.854391+0000","last_became_peered":"2024-09-12T18:26:41.854391+0000","last_unstale":"2024-09-12T19:14:11.255176+0000","last_undegraded":"2024-09-12T19:14:11.255176+0000","last_fullsized":"2024-09-12T19:14:11.255176+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'406","last_scrub_stamp":"2024-09-12T19:14:11.254823+0000","last_deep_scrub":"265'406","last_deep_scrub_stamp":"2024-09-12T19:14:11.254823+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.254823+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:18.934488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2438,"num_read_kb":2340,"num_write":450,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'324","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.838638+0000","last_change":"2024-09-12T19:14:14.838638+0000","last_active":"2024-09-12T19:14:14.838638+0000","last_peered":"2024-09-12T19:14:14.838638+0000","last_clean":"2024-09-12T19:14:14.838638+0000","last_became_active":"2024-09-12T18:26:39.870641+0000","last_became_peered":"2024-09-12T18:26:39.870641+0000","last_unstale":"2024-09-12T19:14:14.838638+0000","last_undegraded":"2024-09-12T19:14:14.838638+0000","last_fullsized":"2024-09-12T19:14:14.838638+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T19:14:14.838413+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T19:14:14.838413+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.838413+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:05.370907+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":414,"num_read_kb":1418,"num_write":1020,"num_write_kb":24682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.038768+0000","last_change":"2024-09-12T19:14:16.038622+0000","last_active":"2024-09-12T19:14:16.038768+0000","last_peered":"2024-09-12T19:14:16.038768+0000","last_clean":"2024-09-12T19:14:16.038768+0000","last_became_active":"2024-09-12T18:26:43.853212+0000","last_became_peered":"2024-09-12T18:26:43.853212+0000","last_unstale":"2024-09-12T19:14:16.038768+0000","last_undegraded":"2024-09-12T19:14:16.038768+0000","last_fullsized":"2024-09-12T19:14:16.038768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:16.038447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:16.038447+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.038447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:19.209452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'268","reported_seq":844,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.140596+0000","last_change":"2024-09-12T19:14:29.140596+0000","last_active":"2024-09-12T19:14:29.140596+0000","last_peered":"2024-09-12T19:14:29.140596+0000","last_clean":"2024-09-12T19:14:29.140596+0000","last_became_active":"2024-09-12T18:26:45.865933+0000","last_became_peered":"2024-09-12T18:26:45.865933+0000","last_unstale":"2024-09-12T19:14:29.140596+0000","last_undegraded":"2024-09-12T19:14:29.140596+0000","last_fullsized":"2024-09-12T19:14:29.140596+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'268","last_scrub_stamp":"2024-09-12T19:14:29.140514+0000","last_deep_scrub":"265'268","last_deep_scrub_stamp":"2024-09-12T19:14:29.140514+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.140514+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:19.695815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":1093,"num_write":368,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.127307+0000","last_change":"2024-09-12T19:14:37.127144+0000","last_active":"2024-09-12T19:14:37.127307+0000","last_peered":"2024-09-12T19:14:37.127307+0000","last_clean":"2024-09-12T19:14:37.127307+0000","last_became_active":"2024-09-12T18:26:47.898056+0000","last_became_peered":"2024-09-12T18:26:47.898056+0000","last_unstale":"2024-09-12T19:14:37.127307+0000","last_undegraded":"2024-09-12T19:14:37.127307+0000","last_fullsized":"2024-09-12T19:14:37.127307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:37.126949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:37.126949+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.126949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:10.568305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'129","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.628586+0000","last_change":"2024-09-12T19:14:27.628586+0000","last_active":"2024-09-12T19:14:27.628586+0000","last_peered":"2024-09-12T19:14:27.628586+0000","last_clean":"2024-09-12T19:14:27.628586+0000","last_became_active":"2024-09-12T18:26:49.913180+0000","last_became_peered":"2024-09-12T18:26:49.913180+0000","last_unstale":"2024-09-12T19:14:27.628586+0000","last_undegraded":"2024-09-12T19:14:27.628586+0000","last_fullsized":"2024-09-12T19:14:27.628586+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T19:14:27.628402+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T19:14:27.628402+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.628402+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:51.688502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'516","reported_seq":2069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.594030+0000","last_change":"2024-09-12T19:14:17.593883+0000","last_active":"2024-09-12T19:14:17.594030+0000","last_peered":"2024-09-12T19:14:17.594030+0000","last_clean":"2024-09-12T19:14:17.594030+0000","last_became_active":"2024-09-12T18:26:41.873229+0000","last_became_peered":"2024-09-12T18:26:41.873229+0000","last_unstale":"2024-09-12T19:14:17.594030+0000","last_undegraded":"2024-09-12T19:14:17.594030+0000","last_fullsized":"2024-09-12T19:14:17.594030+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'516","last_scrub_stamp":"2024-09-12T19:14:17.593701+0000","last_deep_scrub":"265'516","last_deep_scrub_stamp":"2024-09-12T19:14:17.593701+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.593701+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:37.476864+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2942,"num_read_kb":2741,"num_write":656,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'373","reported_seq":1160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.839637+0000","last_change":"2024-09-12T19:14:06.839637+0000","last_active":"2024-09-12T19:14:06.839637+0000","last_peered":"2024-09-12T19:14:06.839637+0000","last_clean":"2024-09-12T19:14:06.839637+0000","last_became_active":"2024-09-12T18:26:39.865148+0000","last_became_peered":"2024-09-12T18:26:39.865148+0000","last_unstale":"2024-09-12T19:14:06.839637+0000","last_undegraded":"2024-09-12T19:14:06.839637+0000","last_fullsized":"2024-09-12T19:14:06.839637+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T19:14:06.839379+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T19:14:06.839379+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.839379+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:03.080191+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":883,"num_read_kb":25450,"num_write":1078,"num_write_kb":40926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.978124+0000","last_change":"2024-09-12T19:14:17.978124+0000","last_active":"2024-09-12T19:14:17.978124+0000","last_peered":"2024-09-12T19:14:17.978124+0000","last_clean":"2024-09-12T19:14:17.978124+0000","last_became_active":"2024-09-12T18:26:43.853084+0000","last_became_peered":"2024-09-12T18:26:43.853084+0000","last_unstale":"2024-09-12T19:14:17.978124+0000","last_undegraded":"2024-09-12T19:14:17.978124+0000","last_fullsized":"2024-09-12T19:14:17.978124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:17.977941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:17.977941+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.977941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:53.773804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'315","reported_seq":904,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.992045+0000","last_change":"2024-09-12T19:14:29.992045+0000","last_active":"2024-09-12T19:14:29.992045+0000","last_peered":"2024-09-12T19:14:29.992045+0000","last_clean":"2024-09-12T19:14:29.992045+0000","last_became_active":"2024-09-12T18:26:45.866325+0000","last_became_peered":"2024-09-12T18:26:45.866325+0000","last_unstale":"2024-09-12T19:14:29.992045+0000","last_undegraded":"2024-09-12T19:14:29.992045+0000","last_fullsized":"2024-09-12T19:14:29.992045+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T19:14:29.991846+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T19:14:29.991846+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.991846+0000","objects_scrubbed":8,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:32.915033+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64639,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":1214,"num_write":426,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'793","reported_seq":2660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.570416+0000","last_change":"2024-09-12T19:14:29.570416+0000","last_active":"2024-09-12T19:14:29.570416+0000","last_peered":"2024-09-12T19:14:29.570416+0000","last_clean":"2024-09-12T19:14:29.570416+0000","last_became_active":"2024-09-12T18:26:47.878956+0000","last_became_peered":"2024-09-12T18:26:47.878956+0000","last_unstale":"2024-09-12T19:14:29.570416+0000","last_undegraded":"2024-09-12T19:14:29.570416+0000","last_fullsized":"2024-09-12T19:14:29.570416+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'793","last_scrub_stamp":"2024-09-12T19:14:29.570202+0000","last_deep_scrub":"265'793","last_deep_scrub_stamp":"2024-09-12T19:14:29.570202+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.570202+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:44.401820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'149","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.666439+0000","last_change":"2024-09-12T19:14:33.666295+0000","last_active":"2024-09-12T19:14:33.666439+0000","last_peered":"2024-09-12T19:14:33.666439+0000","last_clean":"2024-09-12T19:14:33.666439+0000","last_became_active":"2024-09-12T18:26:49.926384+0000","last_became_peered":"2024-09-12T18:26:49.926384+0000","last_unstale":"2024-09-12T19:14:33.666439+0000","last_undegraded":"2024-09-12T19:14:33.666439+0000","last_fullsized":"2024-09-12T19:14:33.666439+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'149","last_scrub_stamp":"2024-09-12T19:14:33.666118+0000","last_deep_scrub":"265'149","last_deep_scrub_stamp":"2024-09-12T19:14:33.666118+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.666118+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:55.329801+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":361,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'695","reported_seq":2124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.634374+0000","last_change":"2024-09-12T19:14:24.634374+0000","last_active":"2024-09-12T19:14:24.634374+0000","last_peered":"2024-09-12T19:14:24.634374+0000","last_clean":"2024-09-12T19:14:24.634374+0000","last_became_active":"2024-09-12T18:26:41.846589+0000","last_became_peered":"2024-09-12T18:26:41.846589+0000","last_unstale":"2024-09-12T19:14:24.634374+0000","last_undegraded":"2024-09-12T19:14:24.634374+0000","last_fullsized":"2024-09-12T19:14:24.634374+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'695","last_scrub_stamp":"2024-09-12T19:14:24.634180+0000","last_deep_scrub":"265'695","last_deep_scrub_stamp":"2024-09-12T19:14:24.634180+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.634180+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":600,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:28.875628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3315,"num_read_kb":3003,"num_write":914,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'320","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.671103+0000","last_change":"2024-09-12T19:14:13.671103+0000","last_active":"2024-09-12T19:14:13.671103+0000","last_peered":"2024-09-12T19:14:13.671103+0000","last_clean":"2024-09-12T19:14:13.671103+0000","last_became_active":"2024-09-12T18:26:39.849950+0000","last_became_peered":"2024-09-12T18:26:39.849950+0000","last_unstale":"2024-09-12T19:14:13.671103+0000","last_undegraded":"2024-09-12T19:14:13.671103+0000","last_fullsized":"2024-09-12T19:14:13.671103+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-12T19:14:13.670923+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-12T19:14:13.670923+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.670923+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:21.214840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67871,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":33808,"num_write":1047,"num_write_kb":22667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.020856+0000","last_change":"2024-09-12T19:14:17.020705+0000","last_active":"2024-09-12T19:14:17.020856+0000","last_peered":"2024-09-12T19:14:17.020856+0000","last_clean":"2024-09-12T19:14:17.020856+0000","last_became_active":"2024-09-12T18:26:43.874837+0000","last_became_peered":"2024-09-12T18:26:43.874837+0000","last_unstale":"2024-09-12T19:14:17.020856+0000","last_undegraded":"2024-09-12T19:14:17.020856+0000","last_fullsized":"2024-09-12T19:14:17.020856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:17.020520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:17.020520+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.020520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:48.881506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'463","reported_seq":1104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.750171+0000","last_change":"2024-09-12T19:14:18.750004+0000","last_active":"2024-09-12T19:14:18.750171+0000","last_peered":"2024-09-12T19:14:18.750171+0000","last_clean":"2024-09-12T19:14:18.750171+0000","last_became_active":"2024-09-12T18:26:45.875223+0000","last_became_peered":"2024-09-12T18:26:45.875223+0000","last_unstale":"2024-09-12T19:14:18.750171+0000","last_undegraded":"2024-09-12T19:14:18.750171+0000","last_fullsized":"2024-09-12T19:14:18.750171+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'463","last_scrub_stamp":"2024-09-12T19:14:18.749757+0000","last_deep_scrub":"265'463","last_deep_scrub_stamp":"2024-09-12T19:14:18.749757+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.749757+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:18.294446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89882,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":808,"num_read_kb":1944,"num_write":662,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.919177+0000","last_change":"2024-09-12T19:14:22.919044+0000","last_active":"2024-09-12T19:14:22.919177+0000","last_peered":"2024-09-12T19:14:22.919177+0000","last_clean":"2024-09-12T19:14:22.919177+0000","last_became_active":"2024-09-12T18:26:47.891736+0000","last_became_peered":"2024-09-12T18:26:47.891736+0000","last_unstale":"2024-09-12T19:14:22.919177+0000","last_undegraded":"2024-09-12T19:14:22.919177+0000","last_fullsized":"2024-09-12T19:14:22.919177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:22.918866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:22.918866+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.918866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:26.902442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'132","reported_seq":664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.138544+0000","last_change":"2024-09-12T19:14:31.138382+0000","last_active":"2024-09-12T19:14:31.138544+0000","last_peered":"2024-09-12T19:14:31.138544+0000","last_clean":"2024-09-12T19:14:31.138544+0000","last_became_active":"2024-09-12T18:26:49.904633+0000","last_became_peered":"2024-09-12T18:26:49.904633+0000","last_unstale":"2024-09-12T19:14:31.138544+0000","last_undegraded":"2024-09-12T19:14:31.138544+0000","last_fullsized":"2024-09-12T19:14:31.138544+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-12T19:14:31.138190+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-12T19:14:31.138190+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.138190+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:17.704300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":176,"num_write":324,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'686","reported_seq":2227,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.254200+0000","last_change":"2024-09-12T19:14:10.254200+0000","last_active":"2024-09-12T19:14:10.254200+0000","last_peered":"2024-09-12T19:14:10.254200+0000","last_clean":"2024-09-12T19:14:10.254200+0000","last_became_active":"2024-09-12T18:26:41.852958+0000","last_became_peered":"2024-09-12T18:26:41.852958+0000","last_unstale":"2024-09-12T19:14:10.254200+0000","last_undegraded":"2024-09-12T19:14:10.254200+0000","last_fullsized":"2024-09-12T19:14:10.254200+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'686","last_scrub_stamp":"2024-09-12T19:14:10.253985+0000","last_deep_scrub":"265'686","last_deep_scrub_stamp":"2024-09-12T19:14:10.253985+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.253985+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:57.088986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3047,"num_write":870,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'348","reported_seq":1026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.823078+0000","last_change":"2024-09-12T19:14:07.823078+0000","last_active":"2024-09-12T19:14:07.823078+0000","last_peered":"2024-09-12T19:14:07.823078+0000","last_clean":"2024-09-12T19:14:07.823078+0000","last_became_active":"2024-09-12T18:26:39.842671+0000","last_became_peered":"2024-09-12T18:26:39.842671+0000","last_unstale":"2024-09-12T19:14:07.823078+0000","last_undegraded":"2024-09-12T19:14:07.823078+0000","last_fullsized":"2024-09-12T19:14:07.823078+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T19:14:07.822813+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T19:14:07.822813+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.822813+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:55.357796+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1239003,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":38368,"num_write":1135,"num_write_kb":24127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.990290+0000","last_change":"2024-09-12T19:14:18.990290+0000","last_active":"2024-09-12T19:14:18.990290+0000","last_peered":"2024-09-12T19:14:18.990290+0000","last_clean":"2024-09-12T19:14:18.990290+0000","last_became_active":"2024-09-12T18:26:43.863615+0000","last_became_peered":"2024-09-12T18:26:43.863615+0000","last_unstale":"2024-09-12T19:14:18.990290+0000","last_undegraded":"2024-09-12T19:14:18.990290+0000","last_fullsized":"2024-09-12T19:14:18.990290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:18.990106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:18.990106+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.990106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:09.209296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'300","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.394027+0000","last_change":"2024-09-12T19:14:30.394027+0000","last_active":"2024-09-12T19:14:30.394027+0000","last_peered":"2024-09-12T19:14:30.394027+0000","last_clean":"2024-09-12T19:14:30.394027+0000","last_became_active":"2024-09-12T18:26:45.864308+0000","last_became_peered":"2024-09-12T18:26:45.864308+0000","last_unstale":"2024-09-12T19:14:30.394027+0000","last_undegraded":"2024-09-12T19:14:30.394027+0000","last_fullsized":"2024-09-12T19:14:30.394027+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'300","last_scrub_stamp":"2024-09-12T19:14:30.393706+0000","last_deep_scrub":"265'300","last_deep_scrub_stamp":"2024-09-12T19:14:30.393706+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.393706+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:59.921731+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1125,"num_write":460,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.610186+0000","last_change":"2024-09-12T19:14:30.610186+0000","last_active":"2024-09-12T19:14:30.610186+0000","last_peered":"2024-09-12T19:14:30.610186+0000","last_clean":"2024-09-12T19:14:30.610186+0000","last_became_active":"2024-09-12T18:26:47.903984+0000","last_became_peered":"2024-09-12T18:26:47.903984+0000","last_unstale":"2024-09-12T19:14:30.610186+0000","last_undegraded":"2024-09-12T19:14:30.610186+0000","last_fullsized":"2024-09-12T19:14:30.610186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:30.610001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:30.610001+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.610001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:49.149778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'130","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:03.733674+0000","last_change":"2024-09-12T18:26:49.917735+0000","last_active":"2024-09-12T19:13:03.733674+0000","last_peered":"2024-09-12T19:13:03.733674+0000","last_clean":"2024-09-12T19:13:03.733674+0000","last_became_active":"2024-09-12T18:26:49.916255+0000","last_became_peered":"2024-09-12T18:26:49.916255+0000","last_unstale":"2024-09-12T19:13:03.733674+0000","last_undegraded":"2024-09-12T19:13:03.733674+0000","last_fullsized":"2024-09-12T19:13:03.733674+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:06:05.827351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":172,"num_read_kb":153,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'482","reported_seq":2167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.282073+0000","last_change":"2024-09-12T19:14:14.282073+0000","last_active":"2024-09-12T19:14:14.282073+0000","last_peered":"2024-09-12T19:14:14.282073+0000","last_clean":"2024-09-12T19:14:14.282073+0000","last_became_active":"2024-09-12T18:26:41.851789+0000","last_became_peered":"2024-09-12T18:26:41.851789+0000","last_unstale":"2024-09-12T19:14:14.282073+0000","last_undegraded":"2024-09-12T19:14:14.282073+0000","last_fullsized":"2024-09-12T19:14:14.282073+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'482","last_scrub_stamp":"2024-09-12T19:14:14.281887+0000","last_deep_scrub":"265'482","last_deep_scrub_stamp":"2024-09-12T19:14:14.281887+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.281887+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:45.318532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2754,"num_read_kb":2601,"num_write":570,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'400","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.541035+0000","last_change":"2024-09-12T19:14:08.540889+0000","last_active":"2024-09-12T19:14:08.541035+0000","last_peered":"2024-09-12T19:14:08.541035+0000","last_clean":"2024-09-12T19:14:08.541035+0000","last_became_active":"2024-09-12T18:26:39.849392+0000","last_became_peered":"2024-09-12T18:26:39.849392+0000","last_unstale":"2024-09-12T19:14:08.541035+0000","last_undegraded":"2024-09-12T19:14:08.541035+0000","last_fullsized":"2024-09-12T19:14:08.541035+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'400","last_scrub_stamp":"2024-09-12T19:14:08.540659+0000","last_deep_scrub":"265'400","last_deep_scrub_stamp":"2024-09-12T19:14:08.540659+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.540659+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:17.495615+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568421,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":663,"num_read_kb":7425,"num_write":1171,"num_write_kb":13361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.128970+0000","last_change":"2024-09-12T19:14:24.128970+0000","last_active":"2024-09-12T19:14:24.128970+0000","last_peered":"2024-09-12T19:14:24.128970+0000","last_clean":"2024-09-12T19:14:24.128970+0000","last_became_active":"2024-09-12T18:26:43.877257+0000","last_became_peered":"2024-09-12T18:26:43.877257+0000","last_unstale":"2024-09-12T19:14:24.128970+0000","last_undegraded":"2024-09-12T19:14:24.128970+0000","last_fullsized":"2024-09-12T19:14:24.128970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:24.128757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:24.128757+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.128757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:40.291222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'294","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.969182+0000","last_change":"2024-09-12T19:14:19.969182+0000","last_active":"2024-09-12T19:14:19.969182+0000","last_peered":"2024-09-12T19:14:19.969182+0000","last_clean":"2024-09-12T19:14:19.969182+0000","last_became_active":"2024-09-12T18:26:45.861947+0000","last_became_peered":"2024-09-12T18:26:45.861947+0000","last_unstale":"2024-09-12T19:14:19.969182+0000","last_undegraded":"2024-09-12T19:14:19.969182+0000","last_fullsized":"2024-09-12T19:14:19.969182+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T19:14:19.968867+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T19:14:19.968867+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.968867+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:54.486748+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50433,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":477,"num_read_kb":1052,"num_write":380,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'756","reported_seq":2389,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.932810+0000","last_change":"2024-09-12T19:14:20.932810+0000","last_active":"2024-09-12T19:14:20.932810+0000","last_peered":"2024-09-12T19:14:20.932810+0000","last_clean":"2024-09-12T19:14:20.932810+0000","last_became_active":"2024-09-12T18:26:47.880400+0000","last_became_peered":"2024-09-12T18:26:47.880400+0000","last_unstale":"2024-09-12T19:14:20.932810+0000","last_undegraded":"2024-09-12T19:14:20.932810+0000","last_fullsized":"2024-09-12T19:14:20.932810+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'756","last_scrub_stamp":"2024-09-12T19:14:20.932627+0000","last_deep_scrub":"265'756","last_deep_scrub_stamp":"2024-09-12T19:14:20.932627+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.932627+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:26.073326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'142","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.141820+0000","last_change":"2024-09-12T19:14:25.141820+0000","last_active":"2024-09-12T19:14:25.141820+0000","last_peered":"2024-09-12T19:14:25.141820+0000","last_clean":"2024-09-12T19:14:25.141820+0000","last_became_active":"2024-09-12T18:26:49.913762+0000","last_became_peered":"2024-09-12T18:26:49.913762+0000","last_unstale":"2024-09-12T19:14:25.141820+0000","last_undegraded":"2024-09-12T19:14:25.141820+0000","last_fullsized":"2024-09-12T19:14:25.141820+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T19:14:25.141622+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T19:14:25.141622+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.141622+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:49.383630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":330,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'795","reported_seq":2371,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.242878+0000","last_change":"2024-09-12T19:14:12.242878+0000","last_active":"2024-09-12T19:14:12.242878+0000","last_peered":"2024-09-12T19:14:12.242878+0000","last_clean":"2024-09-12T19:14:12.242878+0000","last_became_active":"2024-09-12T18:26:41.866528+0000","last_became_peered":"2024-09-12T18:26:41.866528+0000","last_unstale":"2024-09-12T19:14:12.242878+0000","last_undegraded":"2024-09-12T19:14:12.242878+0000","last_fullsized":"2024-09-12T19:14:12.242878+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'795","last_scrub_stamp":"2024-09-12T19:14:12.242691+0000","last_deep_scrub":"265'795","last_deep_scrub_stamp":"2024-09-12T19:14:12.242691+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.242691+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:57.776142+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3788,"num_read_kb":3420,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'343","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.298428+0000","last_change":"2024-09-12T19:14:07.298219+0000","last_active":"2024-09-12T19:14:07.298428+0000","last_peered":"2024-09-12T19:14:07.298428+0000","last_clean":"2024-09-12T19:14:07.298428+0000","last_became_active":"2024-09-12T18:26:39.839762+0000","last_became_peered":"2024-09-12T18:26:39.839762+0000","last_unstale":"2024-09-12T19:14:07.298428+0000","last_undegraded":"2024-09-12T19:14:07.298428+0000","last_fullsized":"2024-09-12T19:14:07.298428+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:14:07.298004+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:14:07.298004+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.298004+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:50.827849+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1967405,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":414,"num_read_kb":30496,"num_write":1045,"num_write_kb":26286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.296902+0000","last_change":"2024-09-12T19:14:25.296902+0000","last_active":"2024-09-12T19:14:25.296902+0000","last_peered":"2024-09-12T19:14:25.296902+0000","last_clean":"2024-09-12T19:14:25.296902+0000","last_became_active":"2024-09-12T18:26:43.861969+0000","last_became_peered":"2024-09-12T18:26:43.861969+0000","last_unstale":"2024-09-12T19:14:25.296902+0000","last_undegraded":"2024-09-12T19:14:25.296902+0000","last_fullsized":"2024-09-12T19:14:25.296902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:25.296671+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:25.296671+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.296671+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:25.230803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'82","reported_seq":607,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.147478+0000","last_change":"2024-09-12T19:14:30.147478+0000","last_active":"2024-09-12T19:14:30.147478+0000","last_peered":"2024-09-12T19:14:30.147478+0000","last_clean":"2024-09-12T19:14:30.147478+0000","last_became_active":"2024-09-12T18:26:46.019895+0000","last_became_peered":"2024-09-12T18:26:46.019895+0000","last_unstale":"2024-09-12T19:14:30.147478+0000","last_undegraded":"2024-09-12T19:14:30.147478+0000","last_fullsized":"2024-09-12T19:14:30.147478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'82","last_scrub_stamp":"2024-09-12T19:14:30.147252+0000","last_deep_scrub":"265'82","last_deep_scrub_stamp":"2024-09-12T19:14:30.147252+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.147252+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.755307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'770","reported_seq":4382,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.673781+0000","last_change":"2024-09-12T19:14:23.673781+0000","last_active":"2024-09-12T19:14:23.673781+0000","last_peered":"2024-09-12T19:14:23.673781+0000","last_clean":"2024-09-12T19:14:23.673781+0000","last_became_active":"2024-09-12T18:26:47.882417+0000","last_became_peered":"2024-09-12T18:26:47.882417+0000","last_unstale":"2024-09-12T19:14:23.673781+0000","last_undegraded":"2024-09-12T19:14:23.673781+0000","last_fullsized":"2024-09-12T19:14:23.673781+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'770","last_scrub_stamp":"2024-09-12T19:14:23.673552+0000","last_deep_scrub":"265'770","last_deep_scrub_stamp":"2024-09-12T19:14:23.673552+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.673552+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":701,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:41.286038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'147","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.409054+0000","last_change":"2024-09-12T19:14:40.409054+0000","last_active":"2024-09-12T19:14:40.409054+0000","last_peered":"2024-09-12T19:14:40.409054+0000","last_clean":"2024-09-12T19:14:40.409054+0000","last_became_active":"2024-09-12T18:26:49.926637+0000","last_became_peered":"2024-09-12T18:26:49.926637+0000","last_unstale":"2024-09-12T19:14:40.409054+0000","last_undegraded":"2024-09-12T19:14:40.409054+0000","last_fullsized":"2024-09-12T19:14:40.409054+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'147","last_scrub_stamp":"2024-09-12T19:14:40.408868+0000","last_deep_scrub":"265'147","last_deep_scrub_stamp":"2024-09-12T19:14:40.408868+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.408868+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:45.542033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":120,"num_write":360,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'756","reported_seq":2278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.078131+0000","last_change":"2024-09-12T19:14:13.078131+0000","last_active":"2024-09-12T19:14:13.078131+0000","last_peered":"2024-09-12T19:14:13.078131+0000","last_clean":"2024-09-12T19:14:13.078131+0000","last_became_active":"2024-09-12T18:26:41.839152+0000","last_became_peered":"2024-09-12T18:26:41.839152+0000","last_unstale":"2024-09-12T19:14:13.078131+0000","last_undegraded":"2024-09-12T19:14:13.078131+0000","last_fullsized":"2024-09-12T19:14:13.078131+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'756","last_scrub_stamp":"2024-09-12T19:14:13.077954+0000","last_deep_scrub":"265'756","last_deep_scrub_stamp":"2024-09-12T19:14:13.077954+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.077954+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:32.408093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3609,"num_read_kb":3261,"num_write":1016,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'377","reported_seq":1249,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.786508+0000","last_change":"2024-09-12T19:14:08.786353+0000","last_active":"2024-09-12T19:14:08.786508+0000","last_peered":"2024-09-12T19:14:08.786508+0000","last_clean":"2024-09-12T19:14:08.786508+0000","last_became_active":"2024-09-12T18:26:39.839018+0000","last_became_peered":"2024-09-12T18:26:39.839018+0000","last_unstale":"2024-09-12T19:14:08.786508+0000","last_undegraded":"2024-09-12T19:14:08.786508+0000","last_fullsized":"2024-09-12T19:14:08.786508+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:14:08.786149+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:14:08.786149+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.786149+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:20.356579+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88291,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":988,"num_read_kb":16661,"num_write":1246,"num_write_kb":29221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.384473+0000","last_change":"2024-09-12T19:14:26.384473+0000","last_active":"2024-09-12T19:14:26.384473+0000","last_peered":"2024-09-12T19:14:26.384473+0000","last_clean":"2024-09-12T19:14:26.384473+0000","last_became_active":"2024-09-12T18:26:43.872882+0000","last_became_peered":"2024-09-12T18:26:43.872882+0000","last_unstale":"2024-09-12T19:14:26.384473+0000","last_undegraded":"2024-09-12T19:14:26.384473+0000","last_fullsized":"2024-09-12T19:14:26.384473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.384291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.384291+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.384291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:56.838256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'404","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.395106+0000","last_change":"2024-09-12T19:14:30.395106+0000","last_active":"2024-09-12T19:14:30.395106+0000","last_peered":"2024-09-12T19:14:30.395106+0000","last_clean":"2024-09-12T19:14:30.395106+0000","last_became_active":"2024-09-12T18:26:45.871011+0000","last_became_peered":"2024-09-12T18:26:45.871011+0000","last_unstale":"2024-09-12T19:14:30.395106+0000","last_undegraded":"2024-09-12T19:14:30.395106+0000","last_fullsized":"2024-09-12T19:14:30.395106+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T19:14:30.394900+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T19:14:30.394900+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.394900+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:57.258839+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47428,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1195,"num_read_kb":1786,"num_write":1700,"num_write_kb":1538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488484,"num_omap_keys":1128,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.641621+0000","last_change":"2024-09-12T19:14:22.641621+0000","last_active":"2024-09-12T19:14:22.641621+0000","last_peered":"2024-09-12T19:14:22.641621+0000","last_clean":"2024-09-12T19:14:22.641621+0000","last_became_active":"2024-09-12T18:26:47.893881+0000","last_became_peered":"2024-09-12T18:26:47.893881+0000","last_unstale":"2024-09-12T19:14:22.641621+0000","last_undegraded":"2024-09-12T19:14:22.641621+0000","last_fullsized":"2024-09-12T19:14:22.641621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:22.641442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:22.641442+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.641442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:34.196498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'161","reported_seq":664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.120976+0000","last_change":"2024-09-12T19:14:30.120976+0000","last_active":"2024-09-12T19:14:30.120976+0000","last_peered":"2024-09-12T19:14:30.120976+0000","last_clean":"2024-09-12T19:14:30.120976+0000","last_became_active":"2024-09-12T18:26:49.911403+0000","last_became_peered":"2024-09-12T18:26:49.911403+0000","last_unstale":"2024-09-12T19:14:30.120976+0000","last_undegraded":"2024-09-12T19:14:30.120976+0000","last_fullsized":"2024-09-12T19:14:30.120976+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'161","last_scrub_stamp":"2024-09-12T19:14:30.120766+0000","last_deep_scrub":"265'161","last_deep_scrub_stamp":"2024-09-12T19:14:30.120766+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.120766+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:49.239056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":152,"num_write":383,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'826","reported_seq":2339,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.591537+0000","last_change":"2024-09-12T19:14:15.591537+0000","last_active":"2024-09-12T19:14:15.591537+0000","last_peered":"2024-09-12T19:14:15.591537+0000","last_clean":"2024-09-12T19:14:15.591537+0000","last_became_active":"2024-09-12T18:26:41.873329+0000","last_became_peered":"2024-09-12T18:26:41.873329+0000","last_unstale":"2024-09-12T19:14:15.591537+0000","last_undegraded":"2024-09-12T19:14:15.591537+0000","last_fullsized":"2024-09-12T19:14:15.591537+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'826","last_scrub_stamp":"2024-09-12T19:14:15.591318+0000","last_deep_scrub":"265'826","last_deep_scrub_stamp":"2024-09-12T19:14:15.591318+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.591318+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:40.100277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3864,"num_read_kb":3455,"num_write":1112,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.823308+0000","last_change":"2024-09-12T19:14:05.823046+0000","last_active":"2024-09-12T19:14:05.823308+0000","last_peered":"2024-09-12T19:14:05.823308+0000","last_clean":"2024-09-12T19:14:05.823308+0000","last_became_active":"2024-09-12T18:26:20.488464+0000","last_became_peered":"2024-09-12T18:26:20.488464+0000","last_unstale":"2024-09-12T19:14:05.823308+0000","last_undegraded":"2024-09-12T19:14:05.823308+0000","last_fullsized":"2024-09-12T19:14:05.823308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T19:14:05.822803+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T19:14:05.822803+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.822803+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:50.624649+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.565231+0000","last_change":"2024-09-12T19:14:06.564974+0000","last_active":"2024-09-12T19:14:06.565231+0000","last_peered":"2024-09-12T19:14:06.565231+0000","last_clean":"2024-09-12T19:14:06.565231+0000","last_became_active":"2024-09-12T18:26:25.483072+0000","last_became_peered":"2024-09-12T18:26:25.483072+0000","last_unstale":"2024-09-12T19:14:06.565231+0000","last_undegraded":"2024-09-12T19:14:06.565231+0000","last_fullsized":"2024-09-12T19:14:06.565231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:06.564760+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:06.564760+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.564760+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:34.986549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010071489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'369","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:03.767534+0000","last_change":"2024-09-12T19:14:03.767482+0000","last_active":"2024-09-12T19:14:03.767534+0000","last_peered":"2024-09-12T19:14:03.767534+0000","last_clean":"2024-09-12T19:14:03.767534+0000","last_became_active":"2024-09-12T18:26:39.855274+0000","last_became_peered":"2024-09-12T18:26:39.855274+0000","last_unstale":"2024-09-12T19:14:03.767534+0000","last_undegraded":"2024-09-12T19:14:03.767534+0000","last_fullsized":"2024-09-12T19:14:03.767534+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'369","last_scrub_stamp":"2024-09-12T19:14:03.767414+0000","last_deep_scrub":"265'369","last_deep_scrub_stamp":"2024-09-12T19:14:03.767414+0000","last_clean_scrub_stamp":"2024-09-12T19:14:03.767414+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:11.994783+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399238,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":585,"num_read_kb":43416,"num_write":1148,"num_write_kb":32341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"265'4","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.885397+0000","last_change":"2024-09-12T19:14:22.885214+0000","last_active":"2024-09-12T19:14:22.885397+0000","last_peered":"2024-09-12T19:14:22.885397+0000","last_clean":"2024-09-12T19:14:22.885397+0000","last_became_active":"2024-09-12T18:26:43.862599+0000","last_became_peered":"2024-09-12T18:26:43.862599+0000","last_unstale":"2024-09-12T19:14:22.885397+0000","last_undegraded":"2024-09-12T19:14:22.885397+0000","last_fullsized":"2024-09-12T19:14:22.885397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:22.885024+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:22.885024+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.885024+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:30.442155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'724","reported_seq":1431,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.410071+0000","last_change":"2024-09-12T19:14:29.410071+0000","last_active":"2024-09-12T19:14:29.410071+0000","last_peered":"2024-09-12T19:14:29.410071+0000","last_clean":"2024-09-12T19:14:29.410071+0000","last_became_active":"2024-09-12T18:26:45.870711+0000","last_became_peered":"2024-09-12T18:26:45.870711+0000","last_unstale":"2024-09-12T19:14:29.410071+0000","last_undegraded":"2024-09-12T19:14:29.410071+0000","last_fullsized":"2024-09-12T19:14:29.410071+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'724","last_scrub_stamp":"2024-09-12T19:14:29.409865+0000","last_deep_scrub":"265'724","last_deep_scrub_stamp":"2024-09-12T19:14:29.409865+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.409865+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:32.681147+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152164,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1400,"num_read_kb":3258,"num_write":1288,"num_write_kb":1147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89484,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.621767+0000","last_change":"2024-09-12T19:14:26.621630+0000","last_active":"2024-09-12T19:14:26.621767+0000","last_peered":"2024-09-12T19:14:26.621767+0000","last_clean":"2024-09-12T19:14:26.621767+0000","last_became_active":"2024-09-12T18:26:47.886696+0000","last_became_peered":"2024-09-12T18:26:47.886696+0000","last_unstale":"2024-09-12T19:14:26.621767+0000","last_undegraded":"2024-09-12T19:14:26.621767+0000","last_fullsized":"2024-09-12T19:14:26.621767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.621440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.621440+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.621440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:12.826430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'177","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.599030+0000","last_change":"2024-09-12T19:14:28.598889+0000","last_active":"2024-09-12T19:14:28.599030+0000","last_peered":"2024-09-12T19:14:28.599030+0000","last_clean":"2024-09-12T19:14:28.599030+0000","last_became_active":"2024-09-12T18:26:49.909591+0000","last_became_peered":"2024-09-12T18:26:49.909591+0000","last_unstale":"2024-09-12T19:14:28.599030+0000","last_undegraded":"2024-09-12T19:14:28.599030+0000","last_fullsized":"2024-09-12T19:14:28.599030+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'177","last_scrub_stamp":"2024-09-12T19:14:28.598710+0000","last_deep_scrub":"265'177","last_deep_scrub_stamp":"2024-09-12T19:14:28.598710+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.598710+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:25.270781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":451,"num_write":354,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'449","reported_seq":1934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.828712+0000","last_change":"2024-09-12T19:14:09.828560+0000","last_active":"2024-09-12T19:14:09.828712+0000","last_peered":"2024-09-12T19:14:09.828712+0000","last_clean":"2024-09-12T19:14:09.828712+0000","last_became_active":"2024-09-12T18:27:11.825677+0000","last_became_peered":"2024-09-12T18:27:11.825677+0000","last_unstale":"2024-09-12T19:14:09.828712+0000","last_undegraded":"2024-09-12T19:14:09.828712+0000","last_fullsized":"2024-09-12T19:14:09.828712+0000","mapping_epoch":37,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'449","last_scrub_stamp":"2024-09-12T19:14:09.828367+0000","last_deep_scrub":"265'449","last_deep_scrub_stamp":"2024-09-12T19:14:09.828367+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.828367+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:10.327973+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2226,"num_read_kb":2089,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.817334+0000","last_change":"2024-09-12T19:14:09.817097+0000","last_active":"2024-09-12T19:14:09.817334+0000","last_peered":"2024-09-12T19:14:09.817334+0000","last_clean":"2024-09-12T19:14:09.817334+0000","last_became_active":"2024-09-12T18:26:25.486681+0000","last_became_peered":"2024-09-12T18:26:25.486681+0000","last_unstale":"2024-09-12T19:14:09.817334+0000","last_undegraded":"2024-09-12T19:14:09.817334+0000","last_fullsized":"2024-09-12T19:14:09.817334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:09.816815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:09.816815+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.816815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:48.920838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001127308,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'447","reported_seq":1102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:02.915533+0000","last_change":"2024-09-12T19:14:02.915481+0000","last_active":"2024-09-12T19:14:02.915533+0000","last_peered":"2024-09-12T19:14:02.915533+0000","last_clean":"2024-09-12T19:14:02.915533+0000","last_became_active":"2024-09-12T18:26:39.852604+0000","last_became_peered":"2024-09-12T18:26:39.852604+0000","last_unstale":"2024-09-12T19:14:02.915533+0000","last_undegraded":"2024-09-12T19:14:02.915533+0000","last_fullsized":"2024-09-12T19:14:02.915533+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'447","last_scrub_stamp":"2024-09-12T19:14:02.915389+0000","last_deep_scrub":"265'447","last_deep_scrub_stamp":"2024-09-12T19:14:02.915389+0000","last_clean_scrub_stamp":"2024-09-12T19:14:02.915389+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:58.385296+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1797992,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":612,"num_read_kb":8884,"num_write":1284,"num_write_kb":32875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.332526+0000","last_change":"2024-09-12T19:14:24.332526+0000","last_active":"2024-09-12T19:14:24.332526+0000","last_peered":"2024-09-12T19:14:24.332526+0000","last_clean":"2024-09-12T19:14:24.332526+0000","last_became_active":"2024-09-12T18:26:43.857619+0000","last_became_peered":"2024-09-12T18:26:43.857619+0000","last_unstale":"2024-09-12T19:14:24.332526+0000","last_undegraded":"2024-09-12T19:14:24.332526+0000","last_fullsized":"2024-09-12T19:14:24.332526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:24.332345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:24.332345+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.332345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:34.488154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1288","reported_seq":2804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.136233+0000","last_change":"2024-09-12T19:14:29.136156+0000","last_active":"2024-09-12T19:14:29.136233+0000","last_peered":"2024-09-12T19:14:29.136233+0000","last_clean":"2024-09-12T19:14:29.136233+0000","last_became_active":"2024-09-12T18:26:45.865530+0000","last_became_peered":"2024-09-12T18:26:45.865530+0000","last_unstale":"2024-09-12T19:14:29.136233+0000","last_undegraded":"2024-09-12T19:14:29.136233+0000","last_fullsized":"2024-09-12T19:14:29.136233+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1288","last_scrub_stamp":"2024-09-12T19:14:29.136034+0000","last_deep_scrub":"265'1288","last_deep_scrub_stamp":"2024-09-12T19:14:29.136034+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.136034+0000","objects_scrubbed":12,"log_size":88,"log_dups_size":1200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:22.780326+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145649,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2006,"num_read_kb":3785,"num_write":1114,"num_write_kb":954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.948511+0000","last_change":"2024-09-12T19:14:32.948511+0000","last_active":"2024-09-12T19:14:32.948511+0000","last_peered":"2024-09-12T19:14:32.948511+0000","last_clean":"2024-09-12T19:14:32.948511+0000","last_became_active":"2024-09-12T18:26:47.886707+0000","last_became_peered":"2024-09-12T18:26:47.886707+0000","last_unstale":"2024-09-12T19:14:32.948511+0000","last_undegraded":"2024-09-12T19:14:32.948511+0000","last_fullsized":"2024-09-12T19:14:32.948511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:32.948325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:32.948325+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.948325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:02.738260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'198","reported_seq":739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.169299+0000","last_change":"2024-09-12T19:14:32.169299+0000","last_active":"2024-09-12T19:14:32.169299+0000","last_peered":"2024-09-12T19:14:32.169299+0000","last_clean":"2024-09-12T19:14:32.169299+0000","last_became_active":"2024-09-12T18:26:49.909802+0000","last_became_peered":"2024-09-12T18:26:49.909802+0000","last_unstale":"2024-09-12T19:14:32.169299+0000","last_undegraded":"2024-09-12T19:14:32.169299+0000","last_fullsized":"2024-09-12T19:14:32.169299+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'198","last_scrub_stamp":"2024-09-12T19:14:32.169120+0000","last_deep_scrub":"265'198","last_deep_scrub_stamp":"2024-09-12T19:14:32.169120+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.169120+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:37.739092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":337,"num_read_kb":322,"num_write":434,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'395","reported_seq":1925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.062834+0000","last_change":"2024-09-12T19:14:10.062699+0000","last_active":"2024-09-12T19:14:10.062834+0000","last_peered":"2024-09-12T19:14:10.062834+0000","last_clean":"2024-09-12T19:14:10.062834+0000","last_became_active":"2024-09-12T18:26:41.868958+0000","last_became_peered":"2024-09-12T18:26:41.868958+0000","last_unstale":"2024-09-12T19:14:10.062834+0000","last_undegraded":"2024-09-12T19:14:10.062834+0000","last_fullsized":"2024-09-12T19:14:10.062834+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'395","last_scrub_stamp":"2024-09-12T19:14:10.062517+0000","last_deep_scrub":"265'395","last_deep_scrub_stamp":"2024-09-12T19:14:10.062517+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.062517+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:11.560866+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2137,"num_read_kb":2050,"num_write":435,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1191,"num_omap_keys":5,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.034479+0000","last_change":"2024-09-12T19:14:04.034267+0000","last_active":"2024-09-12T19:14:04.034479+0000","last_peered":"2024-09-12T19:14:04.034479+0000","last_clean":"2024-09-12T19:14:04.034479+0000","last_became_active":"2024-09-12T18:26:25.559069+0000","last_became_peered":"2024-09-12T18:26:25.559069+0000","last_unstale":"2024-09-12T19:14:04.034479+0000","last_undegraded":"2024-09-12T19:14:04.034479+0000","last_fullsized":"2024-09-12T19:14:04.034479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:04.034076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:04.034076+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.034076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:45.407307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00065344600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'305","reported_seq":922,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.182326+0000","last_change":"2024-09-12T19:14:20.182326+0000","last_active":"2024-09-12T19:14:20.182326+0000","last_peered":"2024-09-12T19:14:20.182326+0000","last_clean":"2024-09-12T19:14:20.182326+0000","last_became_active":"2024-09-12T18:26:39.832766+0000","last_became_peered":"2024-09-12T18:26:39.832766+0000","last_unstale":"2024-09-12T19:14:20.182326+0000","last_undegraded":"2024-09-12T19:14:20.182326+0000","last_fullsized":"2024-09-12T19:14:20.182326+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T19:14:20.182116+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T19:14:20.182116+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.182116+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:08.243108+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":386,"num_read_kb":10646,"num_write":879,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.043264+0000","last_change":"2024-09-12T19:14:15.043116+0000","last_active":"2024-09-12T19:14:15.043264+0000","last_peered":"2024-09-12T19:14:15.043264+0000","last_clean":"2024-09-12T19:14:15.043264+0000","last_became_active":"2024-09-12T18:26:43.843884+0000","last_became_peered":"2024-09-12T18:26:43.843884+0000","last_unstale":"2024-09-12T19:14:15.043264+0000","last_undegraded":"2024-09-12T19:14:15.043264+0000","last_fullsized":"2024-09-12T19:14:15.043264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:15.042938+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:15.042938+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.042938+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:57.556164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'246","reported_seq":1362,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.033627+0000","last_change":"2024-09-12T19:14:29.033627+0000","last_active":"2024-09-12T19:14:29.033627+0000","last_peered":"2024-09-12T19:14:29.033627+0000","last_clean":"2024-09-12T19:14:29.033627+0000","last_became_active":"2024-09-12T18:26:46.024474+0000","last_became_peered":"2024-09-12T18:26:46.024474+0000","last_unstale":"2024-09-12T19:14:29.033627+0000","last_undegraded":"2024-09-12T19:14:29.033627+0000","last_fullsized":"2024-09-12T19:14:29.033627+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'246","last_scrub_stamp":"2024-09-12T19:14:29.033403+0000","last_deep_scrub":"265'246","last_deep_scrub_stamp":"2024-09-12T19:14:29.033403+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.033403+0000","objects_scrubbed":9,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:35.289473+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.623507+0000","last_change":"2024-09-12T19:14:23.623352+0000","last_active":"2024-09-12T19:14:23.623507+0000","last_peered":"2024-09-12T19:14:23.623507+0000","last_clean":"2024-09-12T19:14:23.623507+0000","last_became_active":"2024-09-12T18:26:47.889718+0000","last_became_peered":"2024-09-12T18:26:47.889718+0000","last_unstale":"2024-09-12T19:14:23.623507+0000","last_undegraded":"2024-09-12T19:14:23.623507+0000","last_fullsized":"2024-09-12T19:14:23.623507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:23.623180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:23.623180+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.623180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:13.007796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'251","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.143065+0000","last_change":"2024-09-12T19:14:43.143065+0000","last_active":"2024-09-12T19:14:43.143065+0000","last_peered":"2024-09-12T19:14:43.143065+0000","last_clean":"2024-09-12T19:14:43.143065+0000","last_became_active":"2024-09-12T18:26:49.912488+0000","last_became_peered":"2024-09-12T18:26:49.912488+0000","last_unstale":"2024-09-12T19:14:43.143065+0000","last_undegraded":"2024-09-12T19:14:43.143065+0000","last_fullsized":"2024-09-12T19:14:43.143065+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'251","last_scrub_stamp":"2024-09-12T19:14:43.142896+0000","last_deep_scrub":"265'251","last_deep_scrub_stamp":"2024-09-12T19:14:43.142896+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.142896+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:21.062229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":492,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'923","reported_seq":2692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.118359+0000","last_change":"2024-09-12T19:14:14.118118+0000","last_active":"2024-09-12T19:14:14.118359+0000","last_peered":"2024-09-12T19:14:14.118359+0000","last_clean":"2024-09-12T19:14:14.118359+0000","last_became_active":"2024-09-12T18:26:41.847403+0000","last_became_peered":"2024-09-12T18:26:41.847403+0000","last_unstale":"2024-09-12T19:14:14.118359+0000","last_undegraded":"2024-09-12T19:14:14.118359+0000","last_fullsized":"2024-09-12T19:14:14.118359+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'923","last_scrub_stamp":"2024-09-12T19:14:14.117836+0000","last_deep_scrub":"265'923","last_deep_scrub_stamp":"2024-09-12T19:14:14.117836+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.117836+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:45.790389+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4497,"num_read_kb":4050,"num_write":1227,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3569,"num_omap_keys":15,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.604240+0000","last_change":"2024-09-12T19:14:05.604094+0000","last_active":"2024-09-12T19:14:05.604240+0000","last_peered":"2024-09-12T19:14:05.604240+0000","last_clean":"2024-09-12T19:14:05.604240+0000","last_became_active":"2024-09-12T18:26:25.483909+0000","last_became_peered":"2024-09-12T18:26:25.483909+0000","last_unstale":"2024-09-12T19:14:05.604240+0000","last_undegraded":"2024-09-12T19:14:05.604240+0000","last_fullsized":"2024-09-12T19:14:05.604240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T19:14:05.603905+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T19:14:05.603905+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.603905+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:00.442699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002260153,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'308","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.356090+0000","last_change":"2024-09-12T19:14:04.355955+0000","last_active":"2024-09-12T19:14:04.356090+0000","last_peered":"2024-09-12T19:14:04.356090+0000","last_clean":"2024-09-12T19:14:04.356090+0000","last_became_active":"2024-09-12T18:26:39.847002+0000","last_became_peered":"2024-09-12T18:26:39.847002+0000","last_unstale":"2024-09-12T19:14:04.356090+0000","last_undegraded":"2024-09-12T19:14:04.356090+0000","last_fullsized":"2024-09-12T19:14:04.356090+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'308","last_scrub_stamp":"2024-09-12T19:14:04.355733+0000","last_deep_scrub":"265'308","last_deep_scrub_stamp":"2024-09-12T19:14:04.355733+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.355733+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:41.026404+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":613,"num_read_kb":6223,"num_write":953,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.809100+0000","last_change":"2024-09-12T19:14:14.809100+0000","last_active":"2024-09-12T19:14:14.809100+0000","last_peered":"2024-09-12T19:14:14.809100+0000","last_clean":"2024-09-12T19:14:14.809100+0000","last_became_active":"2024-09-12T18:26:43.861753+0000","last_became_peered":"2024-09-12T18:26:43.861753+0000","last_unstale":"2024-09-12T19:14:14.809100+0000","last_undegraded":"2024-09-12T19:14:14.809100+0000","last_fullsized":"2024-09-12T19:14:14.809100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:14.808880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:14.808880+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.808880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:18.789841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'118","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.181685+0000","last_change":"2024-09-12T19:14:28.181545+0000","last_active":"2024-09-12T19:14:28.181685+0000","last_peered":"2024-09-12T19:14:28.181685+0000","last_clean":"2024-09-12T19:14:28.181685+0000","last_became_active":"2024-09-12T18:26:45.856615+0000","last_became_peered":"2024-09-12T18:26:45.856615+0000","last_unstale":"2024-09-12T19:14:28.181685+0000","last_undegraded":"2024-09-12T19:14:28.181685+0000","last_fullsized":"2024-09-12T19:14:28.181685+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T19:14:28.181357+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T19:14:28.181357+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.181357+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:08.289459+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.655183+0000","last_change":"2024-09-12T19:14:21.655037+0000","last_active":"2024-09-12T19:14:21.655183+0000","last_peered":"2024-09-12T19:14:21.655183+0000","last_clean":"2024-09-12T19:14:21.655183+0000","last_became_active":"2024-09-12T18:26:47.884981+0000","last_became_peered":"2024-09-12T18:26:47.884981+0000","last_unstale":"2024-09-12T19:14:21.655183+0000","last_undegraded":"2024-09-12T19:14:21.655183+0000","last_fullsized":"2024-09-12T19:14:21.655183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:21.654865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:21.654865+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.654865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:15.223256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'140","reported_seq":700,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.502576+0000","last_change":"2024-09-12T19:14:36.502576+0000","last_active":"2024-09-12T19:14:36.502576+0000","last_peered":"2024-09-12T19:14:36.502576+0000","last_clean":"2024-09-12T19:14:36.502576+0000","last_became_active":"2024-09-12T18:26:49.918043+0000","last_became_peered":"2024-09-12T18:26:49.918043+0000","last_unstale":"2024-09-12T19:14:36.502576+0000","last_undegraded":"2024-09-12T19:14:36.502576+0000","last_fullsized":"2024-09-12T19:14:36.502576+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T19:14:36.502391+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T19:14:36.502391+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.502391+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:34.316362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":258,"num_write":354,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'550","reported_seq":2248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.028687+0000","last_change":"2024-09-12T19:14:08.028527+0000","last_active":"2024-09-12T19:14:08.028687+0000","last_peered":"2024-09-12T19:14:08.028687+0000","last_clean":"2024-09-12T19:14:08.028687+0000","last_became_active":"2024-09-12T18:26:41.878269+0000","last_became_peered":"2024-09-12T18:26:41.878269+0000","last_unstale":"2024-09-12T19:14:08.028687+0000","last_undegraded":"2024-09-12T19:14:08.028687+0000","last_fullsized":"2024-09-12T19:14:08.028687+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'550","last_scrub_stamp":"2024-09-12T19:14:08.028346+0000","last_deep_scrub":"265'550","last_deep_scrub_stamp":"2024-09-12T19:14:08.028346+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.028346+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:00.737745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2954,"num_read_kb":2745,"num_write":669,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'462","reported_seq":1163,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.591491+0000","last_change":"2024-09-12T19:14:04.591491+0000","last_active":"2024-09-12T19:14:04.591491+0000","last_peered":"2024-09-12T19:14:04.591491+0000","last_clean":"2024-09-12T19:14:04.591491+0000","last_became_active":"2024-09-12T18:26:39.851739+0000","last_became_peered":"2024-09-12T18:26:39.851739+0000","last_unstale":"2024-09-12T19:14:04.591491+0000","last_undegraded":"2024-09-12T19:14:04.591491+0000","last_fullsized":"2024-09-12T19:14:04.591491+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'462","last_scrub_stamp":"2024-09-12T19:14:04.591353+0000","last_deep_scrub":"265'462","last_deep_scrub_stamp":"2024-09-12T19:14:04.591353+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.591353+0000","objects_scrubbed":8,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:47:43.285385+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":848,"num_read_kb":21232,"num_write":1357,"num_write_kb":18457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:03.058708+0000","last_change":"2024-09-12T19:14:03.058458+0000","last_active":"2024-09-12T19:14:03.058708+0000","last_peered":"2024-09-12T19:14:03.058708+0000","last_clean":"2024-09-12T19:14:03.058708+0000","last_became_active":"2024-09-12T18:26:25.474997+0000","last_became_peered":"2024-09-12T18:26:25.474997+0000","last_unstale":"2024-09-12T19:14:03.058708+0000","last_undegraded":"2024-09-12T19:14:03.058708+0000","last_fullsized":"2024-09-12T19:14:03.058708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:03.058262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:03.058262+0000","last_clean_scrub_stamp":"2024-09-12T19:14:03.058262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:33.435710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099306900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.565116+0000","last_change":"2024-09-12T19:14:31.564869+0000","last_active":"2024-09-12T19:14:31.565116+0000","last_peered":"2024-09-12T19:14:31.565116+0000","last_clean":"2024-09-12T19:14:31.565116+0000","last_became_active":"2024-09-12T18:26:43.865697+0000","last_became_peered":"2024-09-12T18:26:43.865697+0000","last_unstale":"2024-09-12T19:14:31.565116+0000","last_undegraded":"2024-09-12T19:14:31.565116+0000","last_fullsized":"2024-09-12T19:14:31.565116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:31.564660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:31.564660+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.564660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:47.040558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'560","reported_seq":1233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.683021+0000","last_change":"2024-09-12T19:14:22.683021+0000","last_active":"2024-09-12T19:14:22.683021+0000","last_peered":"2024-09-12T19:14:22.683021+0000","last_clean":"2024-09-12T19:14:22.683021+0000","last_became_active":"2024-09-12T18:26:45.877100+0000","last_became_peered":"2024-09-12T18:26:45.877100+0000","last_unstale":"2024-09-12T19:14:22.683021+0000","last_undegraded":"2024-09-12T19:14:22.683021+0000","last_fullsized":"2024-09-12T19:14:22.683021+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'560","last_scrub_stamp":"2024-09-12T19:14:22.682604+0000","last_deep_scrub":"265'560","last_deep_scrub_stamp":"2024-09-12T19:14:22.682604+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.682604+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:19.522572+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103009,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":952,"num_read_kb":2114,"num_write":816,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10824,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.436574+0000","last_change":"2024-09-12T19:14:33.436395+0000","last_active":"2024-09-12T19:14:33.436574+0000","last_peered":"2024-09-12T19:14:33.436574+0000","last_clean":"2024-09-12T19:14:33.436574+0000","last_became_active":"2024-09-12T18:26:47.900217+0000","last_became_peered":"2024-09-12T18:26:47.900217+0000","last_unstale":"2024-09-12T19:14:33.436574+0000","last_undegraded":"2024-09-12T19:14:33.436574+0000","last_fullsized":"2024-09-12T19:14:33.436574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:33.436202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:33.436202+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.436202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:41.332666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'145","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.662133+0000","last_change":"2024-09-12T19:14:35.662133+0000","last_active":"2024-09-12T19:14:35.662133+0000","last_peered":"2024-09-12T19:14:35.662133+0000","last_clean":"2024-09-12T19:14:35.662133+0000","last_became_active":"2024-09-12T18:26:49.921123+0000","last_became_peered":"2024-09-12T18:26:49.921123+0000","last_unstale":"2024-09-12T19:14:35.662133+0000","last_undegraded":"2024-09-12T19:14:35.662133+0000","last_fullsized":"2024-09-12T19:14:35.662133+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'145","last_scrub_stamp":"2024-09-12T19:14:35.661928+0000","last_deep_scrub":"265'145","last_deep_scrub_stamp":"2024-09-12T19:14:35.661928+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.661928+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:42.989154+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":212,"num_read_kb":188,"num_write":350,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'429","reported_seq":1891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.799785+0000","last_change":"2024-09-12T19:14:15.799636+0000","last_active":"2024-09-12T19:14:15.799785+0000","last_peered":"2024-09-12T19:14:15.799785+0000","last_clean":"2024-09-12T19:14:15.799785+0000","last_became_active":"2024-09-12T18:26:41.869426+0000","last_became_peered":"2024-09-12T18:26:41.869426+0000","last_unstale":"2024-09-12T19:14:15.799785+0000","last_undegraded":"2024-09-12T19:14:15.799785+0000","last_fullsized":"2024-09-12T19:14:15.799785+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'429","last_scrub_stamp":"2024-09-12T19:14:15.799455+0000","last_deep_scrub":"265'429","last_deep_scrub_stamp":"2024-09-12T19:14:15.799455+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.799455+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:25.588201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2246,"num_read_kb":2097,"num_write":505,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'373","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.025106+0000","last_change":"2024-09-12T19:14:09.024849+0000","last_active":"2024-09-12T19:14:09.025106+0000","last_peered":"2024-09-12T19:14:09.025106+0000","last_clean":"2024-09-12T19:14:09.025106+0000","last_became_active":"2024-09-12T18:26:39.832593+0000","last_became_peered":"2024-09-12T18:26:39.832593+0000","last_unstale":"2024-09-12T19:14:09.025106+0000","last_undegraded":"2024-09-12T19:14:09.025106+0000","last_fullsized":"2024-09-12T19:14:09.025106+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T19:14:09.024591+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T19:14:09.024591+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.024591+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:04.058256+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1569358,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":23528,"num_write":1214,"num_write_kb":24783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.854721+0000","last_change":"2024-09-12T19:14:08.854566+0000","last_active":"2024-09-12T19:14:08.854721+0000","last_peered":"2024-09-12T19:14:08.854721+0000","last_clean":"2024-09-12T19:14:08.854721+0000","last_became_active":"2024-09-12T18:26:25.484938+0000","last_became_peered":"2024-09-12T18:26:25.484938+0000","last_unstale":"2024-09-12T19:14:08.854721+0000","last_undegraded":"2024-09-12T19:14:08.854721+0000","last_fullsized":"2024-09-12T19:14:08.854721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:08.854352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:08.854352+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.854352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:10.919124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001083194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.597993+0000","last_change":"2024-09-12T19:14:18.597867+0000","last_active":"2024-09-12T19:14:18.597993+0000","last_peered":"2024-09-12T19:14:18.597993+0000","last_clean":"2024-09-12T19:14:18.597993+0000","last_became_active":"2024-09-12T18:26:43.863388+0000","last_became_peered":"2024-09-12T18:26:43.863388+0000","last_unstale":"2024-09-12T19:14:18.597993+0000","last_undegraded":"2024-09-12T19:14:18.597993+0000","last_fullsized":"2024-09-12T19:14:18.597993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:18.597691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:18.597691+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.597691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:16.253901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'168","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.137853+0000","last_change":"2024-09-12T19:14:22.137680+0000","last_active":"2024-09-12T19:14:22.137853+0000","last_peered":"2024-09-12T19:14:22.137853+0000","last_clean":"2024-09-12T19:14:22.137853+0000","last_became_active":"2024-09-12T18:26:46.020043+0000","last_became_peered":"2024-09-12T18:26:46.020043+0000","last_unstale":"2024-09-12T19:14:22.137853+0000","last_undegraded":"2024-09-12T19:14:22.137853+0000","last_fullsized":"2024-09-12T19:14:22.137853+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T19:14:22.137464+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T19:14:22.137464+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.137464+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:31.392371+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":189,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'815","reported_seq":2666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.414248+0000","last_change":"2024-09-12T19:14:32.414248+0000","last_active":"2024-09-12T19:14:32.414248+0000","last_peered":"2024-09-12T19:14:32.414248+0000","last_clean":"2024-09-12T19:14:32.414248+0000","last_became_active":"2024-09-12T18:26:47.879630+0000","last_became_peered":"2024-09-12T18:26:47.879630+0000","last_unstale":"2024-09-12T19:14:32.414248+0000","last_undegraded":"2024-09-12T19:14:32.414248+0000","last_fullsized":"2024-09-12T19:14:32.414248+0000","mapping_epoch":32,"log_start":"265'800","ondisk_log_start":"265'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'815","last_scrub_stamp":"2024-09-12T19:14:32.413965+0000","last_deep_scrub":"265'815","last_deep_scrub_stamp":"2024-09-12T19:14:32.413965+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.413965+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:16.861896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'143","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.167533+0000","last_change":"2024-09-12T19:14:36.167533+0000","last_active":"2024-09-12T19:14:36.167533+0000","last_peered":"2024-09-12T19:14:36.167533+0000","last_clean":"2024-09-12T19:14:36.167533+0000","last_became_active":"2024-09-12T18:26:49.919846+0000","last_became_peered":"2024-09-12T18:26:49.919846+0000","last_unstale":"2024-09-12T19:14:36.167533+0000","last_undegraded":"2024-09-12T19:14:36.167533+0000","last_fullsized":"2024-09-12T19:14:36.167533+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'143","last_scrub_stamp":"2024-09-12T19:14:36.167304+0000","last_deep_scrub":"265'143","last_deep_scrub_stamp":"2024-09-12T19:14:36.167304+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.167304+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:56.870847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":263,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'481","reported_seq":2016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.951639+0000","last_change":"2024-09-12T19:14:19.951639+0000","last_active":"2024-09-12T19:14:19.951639+0000","last_peered":"2024-09-12T19:14:19.951639+0000","last_clean":"2024-09-12T19:14:19.951639+0000","last_became_active":"2024-09-12T18:26:41.862008+0000","last_became_peered":"2024-09-12T18:26:41.862008+0000","last_unstale":"2024-09-12T19:14:19.951639+0000","last_undegraded":"2024-09-12T19:14:19.951639+0000","last_fullsized":"2024-09-12T19:14:19.951639+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'481","last_scrub_stamp":"2024-09-12T19:14:19.951462+0000","last_deep_scrub":"265'481","last_deep_scrub_stamp":"2024-09-12T19:14:19.951462+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.951462+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:03.077093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":2263,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'343","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.734772+0000","last_change":"2024-09-12T19:14:04.734724+0000","last_active":"2024-09-12T19:14:04.734772+0000","last_peered":"2024-09-12T19:14:04.734772+0000","last_clean":"2024-09-12T19:14:04.734772+0000","last_became_active":"2024-09-12T18:26:39.865123+0000","last_became_peered":"2024-09-12T18:26:39.865123+0000","last_unstale":"2024-09-12T19:14:04.734772+0000","last_undegraded":"2024-09-12T19:14:04.734772+0000","last_fullsized":"2024-09-12T19:14:04.734772+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:14:04.734653+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:14:04.734653+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.734653+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:27.841010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":68443,"num_write":1085,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.072373+0000","last_change":"2024-09-12T19:14:06.072144+0000","last_active":"2024-09-12T19:14:06.072373+0000","last_peered":"2024-09-12T19:14:06.072373+0000","last_clean":"2024-09-12T19:14:06.072373+0000","last_became_active":"2024-09-12T18:26:25.485137+0000","last_became_peered":"2024-09-12T18:26:25.485137+0000","last_unstale":"2024-09-12T19:14:06.072373+0000","last_undegraded":"2024-09-12T19:14:06.072373+0000","last_fullsized":"2024-09-12T19:14:06.072373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:06.071853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:06.071853+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.071853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:58.794679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013350759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":512,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.431634+0000","last_change":"2024-09-12T19:14:25.431505+0000","last_active":"2024-09-12T19:14:25.431634+0000","last_peered":"2024-09-12T19:14:25.431634+0000","last_clean":"2024-09-12T19:14:25.431634+0000","last_became_active":"2024-09-12T18:26:43.874845+0000","last_became_peered":"2024-09-12T18:26:43.874845+0000","last_unstale":"2024-09-12T19:14:25.431634+0000","last_undegraded":"2024-09-12T19:14:25.431634+0000","last_fullsized":"2024-09-12T19:14:25.431634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:25.431335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:25.431335+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.431335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:03.653096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'111","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.375797+0000","last_change":"2024-09-12T19:14:29.375629+0000","last_active":"2024-09-12T19:14:29.375797+0000","last_peered":"2024-09-12T19:14:29.375797+0000","last_clean":"2024-09-12T19:14:29.375797+0000","last_became_active":"2024-09-12T18:26:45.863254+0000","last_became_peered":"2024-09-12T18:26:45.863254+0000","last_unstale":"2024-09-12T19:14:29.375797+0000","last_undegraded":"2024-09-12T19:14:29.375797+0000","last_fullsized":"2024-09-12T19:14:29.375797+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'111","last_scrub_stamp":"2024-09-12T19:14:29.375431+0000","last_deep_scrub":"265'111","last_deep_scrub_stamp":"2024-09-12T19:14:29.375431+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.375431+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:57.740072+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'806","reported_seq":2529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.139058+0000","last_change":"2024-09-12T19:14:40.138891+0000","last_active":"2024-09-12T19:14:40.139058+0000","last_peered":"2024-09-12T19:14:40.139058+0000","last_clean":"2024-09-12T19:14:40.139058+0000","last_became_active":"2024-09-12T18:26:47.899682+0000","last_became_peered":"2024-09-12T18:26:47.899682+0000","last_unstale":"2024-09-12T19:14:40.139058+0000","last_undegraded":"2024-09-12T19:14:40.139058+0000","last_fullsized":"2024-09-12T19:14:40.139058+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T19:14:40.138717+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T19:14:40.138717+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.138717+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:51.728312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'168","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.669516+0000","last_change":"2024-09-12T19:14:34.669516+0000","last_active":"2024-09-12T19:14:34.669516+0000","last_peered":"2024-09-12T19:14:34.669516+0000","last_clean":"2024-09-12T19:14:34.669516+0000","last_became_active":"2024-09-12T18:26:49.917537+0000","last_became_peered":"2024-09-12T18:26:49.917537+0000","last_unstale":"2024-09-12T19:14:34.669516+0000","last_undegraded":"2024-09-12T19:14:34.669516+0000","last_fullsized":"2024-09-12T19:14:34.669516+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T19:14:34.669306+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T19:14:34.669306+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.669306+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:24.898251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":124,"num_write":364,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'446","reported_seq":1948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.329435+0000","last_change":"2024-09-12T19:14:08.329287+0000","last_active":"2024-09-12T19:14:08.329435+0000","last_peered":"2024-09-12T19:14:08.329435+0000","last_clean":"2024-09-12T19:14:08.329435+0000","last_became_active":"2024-09-12T18:26:41.871518+0000","last_became_peered":"2024-09-12T18:26:41.871518+0000","last_unstale":"2024-09-12T19:14:08.329435+0000","last_undegraded":"2024-09-12T19:14:08.329435+0000","last_fullsized":"2024-09-12T19:14:08.329435+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'446","last_scrub_stamp":"2024-09-12T19:14:08.329092+0000","last_deep_scrub":"265'446","last_deep_scrub_stamp":"2024-09-12T19:14:08.329092+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.329092+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:06.915175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2145,"num_write":516,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'315","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:03.905567+0000","last_change":"2024-09-12T19:14:03.905429+0000","last_active":"2024-09-12T19:14:03.905567+0000","last_peered":"2024-09-12T19:14:03.905567+0000","last_clean":"2024-09-12T19:14:03.905567+0000","last_became_active":"2024-09-12T18:26:39.833924+0000","last_became_peered":"2024-09-12T18:26:39.833924+0000","last_unstale":"2024-09-12T19:14:03.905567+0000","last_undegraded":"2024-09-12T19:14:03.905567+0000","last_fullsized":"2024-09-12T19:14:03.905567+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T19:14:03.905233+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T19:14:03.905233+0000","last_clean_scrub_stamp":"2024-09-12T19:14:03.905233+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:50.763493+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6467978,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":59970,"num_write":1010,"num_write_kb":34278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.502466+0000","last_change":"2024-09-12T19:14:06.502292+0000","last_active":"2024-09-12T19:14:06.502466+0000","last_peered":"2024-09-12T19:14:06.502466+0000","last_clean":"2024-09-12T19:14:06.502466+0000","last_became_active":"2024-09-12T18:26:25.487465+0000","last_became_peered":"2024-09-12T18:26:25.487465+0000","last_unstale":"2024-09-12T19:14:06.502466+0000","last_undegraded":"2024-09-12T19:14:06.502466+0000","last_fullsized":"2024-09-12T19:14:06.502466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:06.502115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:06.502115+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.502115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:23.228019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010368949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.159963+0000","last_change":"2024-09-12T19:14:27.159963+0000","last_active":"2024-09-12T19:14:27.159963+0000","last_peered":"2024-09-12T19:14:27.159963+0000","last_clean":"2024-09-12T19:14:27.159963+0000","last_became_active":"2024-09-12T18:26:43.850274+0000","last_became_peered":"2024-09-12T18:26:43.850274+0000","last_unstale":"2024-09-12T19:14:27.159963+0000","last_undegraded":"2024-09-12T19:14:27.159963+0000","last_fullsized":"2024-09-12T19:14:27.159963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:27.159785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:27.159785+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.159785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:35.905171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'726","reported_seq":1448,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.985314+0000","last_change":"2024-09-12T19:14:27.985159+0000","last_active":"2024-09-12T19:14:27.985314+0000","last_peered":"2024-09-12T19:14:27.985314+0000","last_clean":"2024-09-12T19:14:27.985314+0000","last_became_active":"2024-09-12T18:26:46.021217+0000","last_became_peered":"2024-09-12T18:26:46.021217+0000","last_unstale":"2024-09-12T19:14:27.985314+0000","last_undegraded":"2024-09-12T19:14:27.985314+0000","last_fullsized":"2024-09-12T19:14:27.985314+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'726","last_scrub_stamp":"2024-09-12T19:14:27.984936+0000","last_deep_scrub":"265'726","last_deep_scrub_stamp":"2024-09-12T19:14:27.984936+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.984936+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:44.715111+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1300,"num_read_kb":3120,"num_write":1062,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.147229+0000","last_change":"2024-09-12T19:14:33.147105+0000","last_active":"2024-09-12T19:14:33.147229+0000","last_peered":"2024-09-12T19:14:33.147229+0000","last_clean":"2024-09-12T19:14:33.147229+0000","last_became_active":"2024-09-12T18:26:47.902750+0000","last_became_peered":"2024-09-12T18:26:47.902750+0000","last_unstale":"2024-09-12T19:14:33.147229+0000","last_undegraded":"2024-09-12T19:14:33.147229+0000","last_fullsized":"2024-09-12T19:14:33.147229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:33.146930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:33.146930+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.146930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:58.966836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'110","reported_seq":618,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.468204+0000","last_change":"2024-09-12T19:14:37.468204+0000","last_active":"2024-09-12T19:14:37.468204+0000","last_peered":"2024-09-12T19:14:37.468204+0000","last_clean":"2024-09-12T19:14:37.468204+0000","last_became_active":"2024-09-12T18:26:49.919630+0000","last_became_peered":"2024-09-12T18:26:49.919630+0000","last_unstale":"2024-09-12T19:14:37.468204+0000","last_undegraded":"2024-09-12T19:14:37.468204+0000","last_fullsized":"2024-09-12T19:14:37.468204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T19:14:37.468006+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T19:14:37.468006+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.468006+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:22.357730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":269,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'144","reported_seq":714,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.617914+0000","last_change":"2024-09-12T19:14:38.617914+0000","last_active":"2024-09-12T19:14:38.617914+0000","last_peered":"2024-09-12T19:14:38.617914+0000","last_clean":"2024-09-12T19:14:38.617914+0000","last_became_active":"2024-09-12T18:26:49.912589+0000","last_became_peered":"2024-09-12T18:26:49.912589+0000","last_unstale":"2024-09-12T19:14:38.617914+0000","last_undegraded":"2024-09-12T19:14:38.617914+0000","last_fullsized":"2024-09-12T19:14:38.617914+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T19:14:38.617701+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T19:14:38.617701+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.617701+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:12.497842+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":221,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'914","reported_seq":2543,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.269753+0000","last_change":"2024-09-12T19:14:15.269753+0000","last_active":"2024-09-12T19:14:15.269753+0000","last_peered":"2024-09-12T19:14:15.269753+0000","last_clean":"2024-09-12T19:14:15.269753+0000","last_became_active":"2024-09-12T18:26:41.875870+0000","last_became_peered":"2024-09-12T18:26:41.875870+0000","last_unstale":"2024-09-12T19:14:15.269753+0000","last_undegraded":"2024-09-12T19:14:15.269753+0000","last_fullsized":"2024-09-12T19:14:15.269753+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'914","last_scrub_stamp":"2024-09-12T19:14:15.269571+0000","last_deep_scrub":"265'914","last_deep_scrub_stamp":"2024-09-12T19:14:15.269571+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.269571+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":900,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:16.227806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4445,"num_read_kb":3959,"num_write":1252,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'311","reported_seq":958,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.359664+0000","last_change":"2024-09-12T19:14:05.359664+0000","last_active":"2024-09-12T19:14:05.359664+0000","last_peered":"2024-09-12T19:14:05.359664+0000","last_clean":"2024-09-12T19:14:05.359664+0000","last_became_active":"2024-09-12T18:26:39.870576+0000","last_became_peered":"2024-09-12T18:26:39.870576+0000","last_unstale":"2024-09-12T19:14:05.359664+0000","last_undegraded":"2024-09-12T19:14:05.359664+0000","last_fullsized":"2024-09-12T19:14:05.359664+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'311","last_scrub_stamp":"2024-09-12T19:14:05.359443+0000","last_deep_scrub":"265'311","last_deep_scrub_stamp":"2024-09-12T19:14:05.359443+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.359443+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:08.218478+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":31608,"num_write":917,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.194115+0000","last_change":"2024-09-12T19:14:16.194115+0000","last_active":"2024-09-12T19:14:16.194115+0000","last_peered":"2024-09-12T19:14:16.194115+0000","last_clean":"2024-09-12T19:14:16.194115+0000","last_became_active":"2024-09-12T18:26:43.864969+0000","last_became_peered":"2024-09-12T18:26:43.864969+0000","last_unstale":"2024-09-12T19:14:16.194115+0000","last_undegraded":"2024-09-12T19:14:16.194115+0000","last_fullsized":"2024-09-12T19:14:16.194115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:16.193928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:16.193928+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.193928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:14.944724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'281","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.112064+0000","last_change":"2024-09-12T19:14:31.112064+0000","last_active":"2024-09-12T19:14:31.112064+0000","last_peered":"2024-09-12T19:14:31.112064+0000","last_clean":"2024-09-12T19:14:31.112064+0000","last_became_active":"2024-09-12T18:26:45.865329+0000","last_became_peered":"2024-09-12T18:26:45.865329+0000","last_unstale":"2024-09-12T19:14:31.112064+0000","last_undegraded":"2024-09-12T19:14:31.112064+0000","last_fullsized":"2024-09-12T19:14:31.112064+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-12T19:14:31.111802+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-12T19:14:31.111802+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.111802+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:31.456814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":1095,"num_write":382,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.132452+0000","last_change":"2024-09-12T19:14:42.132452+0000","last_active":"2024-09-12T19:14:42.132452+0000","last_peered":"2024-09-12T19:14:42.132452+0000","last_clean":"2024-09-12T19:14:42.132452+0000","last_became_active":"2024-09-12T18:26:47.890741+0000","last_became_peered":"2024-09-12T18:26:47.890741+0000","last_unstale":"2024-09-12T19:14:42.132452+0000","last_undegraded":"2024-09-12T19:14:42.132452+0000","last_fullsized":"2024-09-12T19:14:42.132452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:42.132277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:42.132277+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.132277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:17.240518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'196","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:38.440206+0000","last_change":"2024-09-12T18:26:49.915054+0000","last_active":"2024-09-12T19:11:38.440206+0000","last_peered":"2024-09-12T19:11:38.440206+0000","last_clean":"2024-09-12T19:11:38.440206+0000","last_became_active":"2024-09-12T18:26:49.914506+0000","last_became_peered":"2024-09-12T18:26:49.914506+0000","last_unstale":"2024-09-12T19:11:38.440206+0000","last_undegraded":"2024-09-12T19:11:38.440206+0000","last_fullsized":"2024-09-12T19:11:38.440206+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:39.521599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":157,"num_write":456,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'903","reported_seq":2447,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.072876+0000","last_change":"2024-09-12T19:14:11.072876+0000","last_active":"2024-09-12T19:14:11.072876+0000","last_peered":"2024-09-12T19:14:11.072876+0000","last_clean":"2024-09-12T19:14:11.072876+0000","last_became_active":"2024-09-12T18:26:41.868082+0000","last_became_peered":"2024-09-12T18:26:41.868082+0000","last_unstale":"2024-09-12T19:14:11.072876+0000","last_undegraded":"2024-09-12T19:14:11.072876+0000","last_fullsized":"2024-09-12T19:14:11.072876+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'903","last_scrub_stamp":"2024-09-12T19:14:11.072670+0000","last_deep_scrub":"265'903","last_deep_scrub_stamp":"2024-09-12T19:14:11.072670+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.072670+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":800,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:29.244238+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4276,"num_read_kb":3807,"num_write":1253,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'386","reported_seq":1055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.818692+0000","last_change":"2024-09-12T19:14:11.818692+0000","last_active":"2024-09-12T19:14:11.818692+0000","last_peered":"2024-09-12T19:14:11.818692+0000","last_clean":"2024-09-12T19:14:11.818692+0000","last_became_active":"2024-09-12T18:26:39.869754+0000","last_became_peered":"2024-09-12T18:26:39.869754+0000","last_unstale":"2024-09-12T19:14:11.818692+0000","last_undegraded":"2024-09-12T19:14:11.818692+0000","last_fullsized":"2024-09-12T19:14:11.818692+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T19:14:11.818493+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T19:14:11.818493+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.818493+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:30.957800+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525344,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":32033,"num_write":1221,"num_write_kb":47606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"265'6","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.088539+0000","last_change":"2024-09-12T19:14:23.088539+0000","last_active":"2024-09-12T19:14:23.088539+0000","last_peered":"2024-09-12T19:14:23.088539+0000","last_clean":"2024-09-12T19:14:23.088539+0000","last_became_active":"2024-09-12T18:26:43.854155+0000","last_became_peered":"2024-09-12T18:26:43.854155+0000","last_unstale":"2024-09-12T19:14:23.088539+0000","last_undegraded":"2024-09-12T19:14:23.088539+0000","last_fullsized":"2024-09-12T19:14:23.088539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:23.088313+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:23.088313+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.088313+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:08.243249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'70","reported_seq":582,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.634014+0000","last_change":"2024-09-12T19:14:27.634014+0000","last_active":"2024-09-12T19:14:27.634014+0000","last_peered":"2024-09-12T19:14:27.634014+0000","last_clean":"2024-09-12T19:14:27.634014+0000","last_became_active":"2024-09-12T18:26:45.876785+0000","last_became_peered":"2024-09-12T18:26:45.876785+0000","last_unstale":"2024-09-12T19:14:27.634014+0000","last_undegraded":"2024-09-12T19:14:27.634014+0000","last_fullsized":"2024-09-12T19:14:27.634014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'70","last_scrub_stamp":"2024-09-12T19:14:27.633823+0000","last_deep_scrub":"265'70","last_deep_scrub_stamp":"2024-09-12T19:14:27.633823+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.633823+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:21.906210+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.946756+0000","last_change":"2024-09-12T19:14:34.946756+0000","last_active":"2024-09-12T19:14:34.946756+0000","last_peered":"2024-09-12T19:14:34.946756+0000","last_clean":"2024-09-12T19:14:34.946756+0000","last_became_active":"2024-09-12T18:26:47.890879+0000","last_became_peered":"2024-09-12T18:26:47.890879+0000","last_unstale":"2024-09-12T19:14:34.946756+0000","last_undegraded":"2024-09-12T19:14:34.946756+0000","last_fullsized":"2024-09-12T19:14:34.946756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:34.946573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:34.946573+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.946573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:29.143096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'242","reported_seq":779,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.586436+0000","last_change":"2024-09-12T19:14:39.586436+0000","last_active":"2024-09-12T19:14:39.586436+0000","last_peered":"2024-09-12T19:14:39.586436+0000","last_clean":"2024-09-12T19:14:39.586436+0000","last_became_active":"2024-09-12T18:26:49.925984+0000","last_became_peered":"2024-09-12T18:26:49.925984+0000","last_unstale":"2024-09-12T19:14:39.586436+0000","last_undegraded":"2024-09-12T19:14:39.586436+0000","last_fullsized":"2024-09-12T19:14:39.586436+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'242","last_scrub_stamp":"2024-09-12T19:14:39.586244+0000","last_deep_scrub":"265'242","last_deep_scrub_stamp":"2024-09-12T19:14:39.586244+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.586244+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:53.690239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":350,"num_read_kb":337,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'464","reported_seq":2031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.936402+0000","last_change":"2024-09-12T19:14:17.936402+0000","last_active":"2024-09-12T19:14:17.936402+0000","last_peered":"2024-09-12T19:14:17.936402+0000","last_clean":"2024-09-12T19:14:17.936402+0000","last_became_active":"2024-09-12T18:26:41.881971+0000","last_became_peered":"2024-09-12T18:26:41.881971+0000","last_unstale":"2024-09-12T19:14:17.936402+0000","last_undegraded":"2024-09-12T19:14:17.936402+0000","last_fullsized":"2024-09-12T19:14:17.936402+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'464","last_scrub_stamp":"2024-09-12T19:14:17.936203+0000","last_deep_scrub":"265'464","last_deep_scrub_stamp":"2024-09-12T19:14:17.936203+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.936203+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:43.789540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2569,"num_read_kb":2413,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'356","reported_seq":1015,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.537024+0000","last_change":"2024-09-12T19:14:08.537024+0000","last_active":"2024-09-12T19:14:08.537024+0000","last_peered":"2024-09-12T19:14:08.537024+0000","last_clean":"2024-09-12T19:14:08.537024+0000","last_became_active":"2024-09-12T18:26:39.873510+0000","last_became_peered":"2024-09-12T18:26:39.873510+0000","last_unstale":"2024-09-12T19:14:08.537024+0000","last_undegraded":"2024-09-12T19:14:08.537024+0000","last_fullsized":"2024-09-12T19:14:08.537024+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T19:14:08.536754+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T19:14:08.536754+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.536754+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:17.499997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":9367,"num_write":1141,"num_write_kb":22463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.899799+0000","last_change":"2024-09-12T19:14:24.899799+0000","last_active":"2024-09-12T19:14:24.899799+0000","last_peered":"2024-09-12T19:14:24.899799+0000","last_clean":"2024-09-12T19:14:24.899799+0000","last_became_active":"2024-09-12T18:26:43.859847+0000","last_became_peered":"2024-09-12T18:26:43.859847+0000","last_unstale":"2024-09-12T19:14:24.899799+0000","last_undegraded":"2024-09-12T19:14:24.899799+0000","last_fullsized":"2024-09-12T19:14:24.899799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:24.899615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:24.899615+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.899615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:15.801326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'323","reported_seq":919,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.159233+0000","last_change":"2024-09-12T19:14:34.159233+0000","last_active":"2024-09-12T19:14:34.159233+0000","last_peered":"2024-09-12T19:14:34.159233+0000","last_clean":"2024-09-12T19:14:34.159233+0000","last_became_active":"2024-09-12T18:26:45.877790+0000","last_became_peered":"2024-09-12T18:26:45.877790+0000","last_unstale":"2024-09-12T19:14:34.159233+0000","last_undegraded":"2024-09-12T19:14:34.159233+0000","last_fullsized":"2024-09-12T19:14:34.159233+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'323","last_scrub_stamp":"2024-09-12T19:14:34.159030+0000","last_deep_scrub":"265'323","last_deep_scrub_stamp":"2024-09-12T19:14:34.159030+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.159030+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:12.177367+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53461,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1153,"num_write":418,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.660232+0000","last_change":"2024-09-12T19:14:24.660232+0000","last_active":"2024-09-12T19:14:24.660232+0000","last_peered":"2024-09-12T19:14:24.660232+0000","last_clean":"2024-09-12T19:14:24.660232+0000","last_became_active":"2024-09-12T18:26:47.888252+0000","last_became_peered":"2024-09-12T18:26:47.888252+0000","last_unstale":"2024-09-12T19:14:24.660232+0000","last_undegraded":"2024-09-12T19:14:24.660232+0000","last_fullsized":"2024-09-12T19:14:24.660232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:24.660011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:24.660011+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.660011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:19.539418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'147","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.421474+0000","last_change":"2024-09-12T19:14:40.421474+0000","last_active":"2024-09-12T19:14:40.421474+0000","last_peered":"2024-09-12T19:14:40.421474+0000","last_clean":"2024-09-12T19:14:40.421474+0000","last_became_active":"2024-09-12T18:26:49.922459+0000","last_became_peered":"2024-09-12T18:26:49.922459+0000","last_unstale":"2024-09-12T19:14:40.421474+0000","last_undegraded":"2024-09-12T19:14:40.421474+0000","last_fullsized":"2024-09-12T19:14:40.421474+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'147","last_scrub_stamp":"2024-09-12T19:14:40.421300+0000","last_deep_scrub":"265'147","last_deep_scrub_stamp":"2024-09-12T19:14:40.421300+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.421300+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:35.325046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":460,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":153,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'473","reported_seq":1990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.139968+0000","last_change":"2024-09-12T19:14:26.139968+0000","last_active":"2024-09-12T19:14:26.139968+0000","last_peered":"2024-09-12T19:14:26.139968+0000","last_clean":"2024-09-12T19:14:26.139968+0000","last_became_active":"2024-09-12T18:26:41.850749+0000","last_became_peered":"2024-09-12T18:26:41.850749+0000","last_unstale":"2024-09-12T19:14:26.139968+0000","last_undegraded":"2024-09-12T19:14:26.139968+0000","last_fullsized":"2024-09-12T19:14:26.139968+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T19:14:26.139906+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T19:14:26.139906+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.139906+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:31.076243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2503,"num_read_kb":2331,"num_write":575,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'394","reported_seq":1061,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.877872+0000","last_change":"2024-09-12T19:14:04.877872+0000","last_active":"2024-09-12T19:14:04.877872+0000","last_peered":"2024-09-12T19:14:04.877872+0000","last_clean":"2024-09-12T19:14:04.877872+0000","last_became_active":"2024-09-12T18:26:39.854328+0000","last_became_peered":"2024-09-12T18:26:39.854328+0000","last_unstale":"2024-09-12T19:14:04.877872+0000","last_undegraded":"2024-09-12T19:14:04.877872+0000","last_fullsized":"2024-09-12T19:14:04.877872+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T19:14:04.877782+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T19:14:04.877782+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.877782+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:04.369955+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653632,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":578,"num_read_kb":9662,"num_write":1241,"num_write_kb":35097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.636565+0000","last_change":"2024-09-12T19:14:19.636565+0000","last_active":"2024-09-12T19:14:19.636565+0000","last_peered":"2024-09-12T19:14:19.636565+0000","last_clean":"2024-09-12T19:14:19.636565+0000","last_became_active":"2024-09-12T18:26:43.865454+0000","last_became_peered":"2024-09-12T18:26:43.865454+0000","last_unstale":"2024-09-12T19:14:19.636565+0000","last_undegraded":"2024-09-12T19:14:19.636565+0000","last_fullsized":"2024-09-12T19:14:19.636565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:19.636385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:19.636385+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.636385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:25.727508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'251","reported_seq":823,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.957699+0000","last_change":"2024-09-12T19:14:30.957699+0000","last_active":"2024-09-12T19:14:30.957699+0000","last_peered":"2024-09-12T19:14:30.957699+0000","last_clean":"2024-09-12T19:14:30.957699+0000","last_became_active":"2024-09-12T18:26:45.867096+0000","last_became_peered":"2024-09-12T18:26:45.867096+0000","last_unstale":"2024-09-12T19:14:30.957699+0000","last_undegraded":"2024-09-12T19:14:30.957699+0000","last_fullsized":"2024-09-12T19:14:30.957699+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'251","last_scrub_stamp":"2024-09-12T19:14:30.957445+0000","last_deep_scrub":"265'251","last_deep_scrub_stamp":"2024-09-12T19:14:30.957445+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.957445+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:47.556501+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50031,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":412,"num_read_kb":948,"num_write":330,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.645346+0000","last_change":"2024-09-12T19:14:37.645346+0000","last_active":"2024-09-12T19:14:37.645346+0000","last_peered":"2024-09-12T19:14:37.645346+0000","last_clean":"2024-09-12T19:14:37.645346+0000","last_became_active":"2024-09-12T18:26:47.895092+0000","last_became_peered":"2024-09-12T18:26:47.895092+0000","last_unstale":"2024-09-12T19:14:37.645346+0000","last_undegraded":"2024-09-12T19:14:37.645346+0000","last_fullsized":"2024-09-12T19:14:37.645346+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:37.645167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:37.645167+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.645167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:11.713611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'824","reported_seq":2431,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.626437+0000","last_change":"2024-09-12T19:14:13.626256+0000","last_active":"2024-09-12T19:14:13.626437+0000","last_peered":"2024-09-12T19:14:13.626437+0000","last_clean":"2024-09-12T19:14:13.626437+0000","last_became_active":"2024-09-12T18:26:41.871943+0000","last_became_peered":"2024-09-12T18:26:41.871943+0000","last_unstale":"2024-09-12T19:14:13.626437+0000","last_undegraded":"2024-09-12T19:14:13.626437+0000","last_fullsized":"2024-09-12T19:14:13.626437+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'824","last_scrub_stamp":"2024-09-12T19:14:13.626053+0000","last_deep_scrub":"265'824","last_deep_scrub_stamp":"2024-09-12T19:14:13.626053+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.626053+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.562273+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3898,"num_read_kb":3510,"num_write":1047,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'395","reported_seq":1099,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.825137+0000","last_change":"2024-09-12T19:14:12.825137+0000","last_active":"2024-09-12T19:14:12.825137+0000","last_peered":"2024-09-12T19:14:12.825137+0000","last_clean":"2024-09-12T19:14:12.825137+0000","last_became_active":"2024-09-12T18:26:39.830963+0000","last_became_peered":"2024-09-12T18:26:39.830963+0000","last_unstale":"2024-09-12T19:14:12.825137+0000","last_undegraded":"2024-09-12T19:14:12.825137+0000","last_fullsized":"2024-09-12T19:14:12.825137+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'395","last_scrub_stamp":"2024-09-12T19:14:12.824911+0000","last_deep_scrub":"265'395","last_deep_scrub_stamp":"2024-09-12T19:14:12.824911+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.824911+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:52.488076+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1535921,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":35487,"num_write":1279,"num_write_kb":27084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.764872+0000","last_change":"2024-09-12T19:14:16.764872+0000","last_active":"2024-09-12T19:14:16.764872+0000","last_peered":"2024-09-12T19:14:16.764872+0000","last_clean":"2024-09-12T19:14:16.764872+0000","last_became_active":"2024-09-12T18:26:43.861521+0000","last_became_peered":"2024-09-12T18:26:43.861521+0000","last_unstale":"2024-09-12T19:14:16.764872+0000","last_undegraded":"2024-09-12T19:14:16.764872+0000","last_fullsized":"2024-09-12T19:14:16.764872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:16.764692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:16.764692+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.764692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:50.424087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'455","reported_seq":1094,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.104481+0000","last_change":"2024-09-12T19:14:28.104481+0000","last_active":"2024-09-12T19:14:28.104481+0000","last_peered":"2024-09-12T19:14:28.104481+0000","last_clean":"2024-09-12T19:14:28.104481+0000","last_became_active":"2024-09-12T18:26:45.872177+0000","last_became_peered":"2024-09-12T18:26:45.872177+0000","last_unstale":"2024-09-12T19:14:28.104481+0000","last_undegraded":"2024-09-12T19:14:28.104481+0000","last_fullsized":"2024-09-12T19:14:28.104481+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'455","last_scrub_stamp":"2024-09-12T19:14:28.104260+0000","last_deep_scrub":"265'455","last_deep_scrub_stamp":"2024-09-12T19:14:28.104260+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.104260+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:34.205526+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101880,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":818,"num_read_kb":1923,"num_write":698,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.440404+0000","last_change":"2024-09-12T19:14:33.440404+0000","last_active":"2024-09-12T19:14:33.440404+0000","last_peered":"2024-09-12T19:14:33.440404+0000","last_clean":"2024-09-12T19:14:33.440404+0000","last_became_active":"2024-09-12T18:26:47.902702+0000","last_became_peered":"2024-09-12T18:26:47.902702+0000","last_unstale":"2024-09-12T19:14:33.440404+0000","last_undegraded":"2024-09-12T19:14:33.440404+0000","last_fullsized":"2024-09-12T19:14:33.440404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:33.440225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:33.440225+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.440225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:15.909780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'188","reported_seq":695,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:23.315741+0000","last_change":"2024-09-12T18:26:49.920882+0000","last_active":"2024-09-12T19:12:23.315741+0000","last_peered":"2024-09-12T19:12:23.315741+0000","last_clean":"2024-09-12T19:12:23.315741+0000","last_became_active":"2024-09-12T18:26:49.920066+0000","last_became_peered":"2024-09-12T18:26:49.920066+0000","last_unstale":"2024-09-12T19:12:23.315741+0000","last_undegraded":"2024-09-12T19:12:23.315741+0000","last_fullsized":"2024-09-12T19:12:23.315741+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:38.018526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":247,"num_read_kb":248,"num_write":459,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'766","reported_seq":2251,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.780033+0000","last_change":"2024-09-12T19:14:13.780033+0000","last_active":"2024-09-12T19:14:13.780033+0000","last_peered":"2024-09-12T19:14:13.780033+0000","last_clean":"2024-09-12T19:14:13.780033+0000","last_became_active":"2024-09-12T18:26:41.852157+0000","last_became_peered":"2024-09-12T18:26:41.852157+0000","last_unstale":"2024-09-12T19:14:13.780033+0000","last_undegraded":"2024-09-12T19:14:13.780033+0000","last_fullsized":"2024-09-12T19:14:13.780033+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'766","last_scrub_stamp":"2024-09-12T19:14:13.779803+0000","last_deep_scrub":"265'766","last_deep_scrub_stamp":"2024-09-12T19:14:13.779803+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.779803+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:23.013752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3590,"num_read_kb":3230,"num_write":1002,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'359","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.109273+0000","last_change":"2024-09-12T19:14:04.109273+0000","last_active":"2024-09-12T19:14:04.109273+0000","last_peered":"2024-09-12T19:14:04.109273+0000","last_clean":"2024-09-12T19:14:04.109273+0000","last_became_active":"2024-09-12T18:27:11.827218+0000","last_became_peered":"2024-09-12T18:27:11.827218+0000","last_unstale":"2024-09-12T19:14:04.109273+0000","last_undegraded":"2024-09-12T19:14:04.109273+0000","last_fullsized":"2024-09-12T19:14:04.109273+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-12T19:14:04.109120+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-12T19:14:04.109120+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.109120+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:11.700071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35618,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":7368,"num_write":1157,"num_write_kb":18791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.620363+0000","last_change":"2024-09-12T19:14:20.620223+0000","last_active":"2024-09-12T19:14:20.620363+0000","last_peered":"2024-09-12T19:14:20.620363+0000","last_clean":"2024-09-12T19:14:20.620363+0000","last_became_active":"2024-09-12T18:26:43.865319+0000","last_became_peered":"2024-09-12T18:26:43.865319+0000","last_unstale":"2024-09-12T19:14:20.620363+0000","last_undegraded":"2024-09-12T19:14:20.620363+0000","last_fullsized":"2024-09-12T19:14:20.620363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:20.620033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:20.620033+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.620033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:41.034438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'305","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.971413+0000","last_change":"2024-09-12T19:14:33.971413+0000","last_active":"2024-09-12T19:14:33.971413+0000","last_peered":"2024-09-12T19:14:33.971413+0000","last_clean":"2024-09-12T19:14:33.971413+0000","last_became_active":"2024-09-12T18:26:45.873197+0000","last_became_peered":"2024-09-12T18:26:45.873197+0000","last_unstale":"2024-09-12T19:14:33.971413+0000","last_undegraded":"2024-09-12T19:14:33.971413+0000","last_fullsized":"2024-09-12T19:14:33.971413+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T19:14:33.971112+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T19:14:33.971112+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.971112+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:32.411051+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55940,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":484,"num_read_kb":1049,"num_write":402,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.125907+0000","last_change":"2024-09-12T19:14:26.125907+0000","last_active":"2024-09-12T19:14:26.125907+0000","last_peered":"2024-09-12T19:14:26.125907+0000","last_clean":"2024-09-12T19:14:26.125907+0000","last_became_active":"2024-09-12T18:26:47.883930+0000","last_became_peered":"2024-09-12T18:26:47.883930+0000","last_unstale":"2024-09-12T19:14:26.125907+0000","last_undegraded":"2024-09-12T19:14:26.125907+0000","last_fullsized":"2024-09-12T19:14:26.125907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.125835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.125835+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.125835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:41.323040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'185","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.621808+0000","last_change":"2024-09-12T19:14:29.621808+0000","last_active":"2024-09-12T19:14:29.621808+0000","last_peered":"2024-09-12T19:14:29.621808+0000","last_clean":"2024-09-12T19:14:29.621808+0000","last_became_active":"2024-09-12T18:26:49.921797+0000","last_became_peered":"2024-09-12T18:26:49.921797+0000","last_unstale":"2024-09-12T19:14:29.621808+0000","last_undegraded":"2024-09-12T19:14:29.621808+0000","last_fullsized":"2024-09-12T19:14:29.621808+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'185","last_scrub_stamp":"2024-09-12T19:14:29.621585+0000","last_deep_scrub":"265'185","last_deep_scrub_stamp":"2024-09-12T19:14:29.621585+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.621585+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:37.942287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1230,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":213,"num_write":519,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'510","reported_seq":1866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.874616+0000","last_change":"2024-09-12T19:14:14.874616+0000","last_active":"2024-09-12T19:14:14.874616+0000","last_peered":"2024-09-12T19:14:14.874616+0000","last_clean":"2024-09-12T19:14:14.874616+0000","last_became_active":"2024-09-12T18:26:41.850647+0000","last_became_peered":"2024-09-12T18:26:41.850647+0000","last_unstale":"2024-09-12T19:14:14.874616+0000","last_undegraded":"2024-09-12T19:14:14.874616+0000","last_fullsized":"2024-09-12T19:14:14.874616+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'510","last_scrub_stamp":"2024-09-12T19:14:14.874432+0000","last_deep_scrub":"265'510","last_deep_scrub_stamp":"2024-09-12T19:14:14.874432+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.874432+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:42.100953+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2444,"num_write":714,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'370","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.335302+0000","last_change":"2024-09-12T19:14:06.335158+0000","last_active":"2024-09-12T19:14:06.335302+0000","last_peered":"2024-09-12T19:14:06.335302+0000","last_clean":"2024-09-12T19:14:06.335302+0000","last_became_active":"2024-09-12T18:26:39.840458+0000","last_became_peered":"2024-09-12T18:26:39.840458+0000","last_unstale":"2024-09-12T19:14:06.335302+0000","last_undegraded":"2024-09-12T19:14:06.335302+0000","last_fullsized":"2024-09-12T19:14:06.335302+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T19:14:06.334888+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T19:14:06.334888+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.334888+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:55.530203+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":36107,"num_write":1118,"num_write_kb":45658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.397690+0000","last_change":"2024-09-12T19:14:28.397690+0000","last_active":"2024-09-12T19:14:28.397690+0000","last_peered":"2024-09-12T19:14:28.397690+0000","last_clean":"2024-09-12T19:14:28.397690+0000","last_became_active":"2024-09-12T18:26:43.873669+0000","last_became_peered":"2024-09-12T18:26:43.873669+0000","last_unstale":"2024-09-12T19:14:28.397690+0000","last_undegraded":"2024-09-12T19:14:28.397690+0000","last_fullsized":"2024-09-12T19:14:28.397690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:28.397489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:28.397489+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.397489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:00.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'289","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.133092+0000","last_change":"2024-09-12T19:14:32.132819+0000","last_active":"2024-09-12T19:14:32.133092+0000","last_peered":"2024-09-12T19:14:32.133092+0000","last_clean":"2024-09-12T19:14:32.133092+0000","last_became_active":"2024-09-12T18:26:46.023025+0000","last_became_peered":"2024-09-12T18:26:46.023025+0000","last_unstale":"2024-09-12T19:14:32.133092+0000","last_undegraded":"2024-09-12T19:14:32.133092+0000","last_fullsized":"2024-09-12T19:14:32.133092+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'289","last_scrub_stamp":"2024-09-12T19:14:32.132594+0000","last_deep_scrub":"265'289","last_deep_scrub_stamp":"2024-09-12T19:14:32.132594+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.132594+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:06.506994+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44021,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":1142,"num_write":398,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.084809+0000","last_change":"2024-09-12T19:14:27.084809+0000","last_active":"2024-09-12T19:14:27.084809+0000","last_peered":"2024-09-12T19:14:27.084809+0000","last_clean":"2024-09-12T19:14:27.084809+0000","last_became_active":"2024-09-12T18:26:47.892678+0000","last_became_peered":"2024-09-12T18:26:47.892678+0000","last_unstale":"2024-09-12T19:14:27.084809+0000","last_undegraded":"2024-09-12T19:14:27.084809+0000","last_fullsized":"2024-09-12T19:14:27.084809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:27.084634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:27.084634+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.084634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:09.082275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'117","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.465745+0000","last_change":"2024-09-12T19:14:38.465745+0000","last_active":"2024-09-12T19:14:38.465745+0000","last_peered":"2024-09-12T19:14:38.465745+0000","last_clean":"2024-09-12T19:14:38.465745+0000","last_became_active":"2024-09-12T18:26:49.919229+0000","last_became_peered":"2024-09-12T18:26:49.919229+0000","last_unstale":"2024-09-12T19:14:38.465745+0000","last_undegraded":"2024-09-12T19:14:38.465745+0000","last_fullsized":"2024-09-12T19:14:38.465745+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'117","last_scrub_stamp":"2024-09-12T19:14:38.465553+0000","last_deep_scrub":"265'117","last_deep_scrub_stamp":"2024-09-12T19:14:38.465553+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.465553+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:11.984486+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":95,"num_write":270,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'505","reported_seq":2215,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.051477+0000","last_change":"2024-09-12T19:14:09.051264+0000","last_active":"2024-09-12T19:14:09.051477+0000","last_peered":"2024-09-12T19:14:09.051477+0000","last_clean":"2024-09-12T19:14:09.051477+0000","last_became_active":"2024-09-12T18:26:41.844608+0000","last_became_peered":"2024-09-12T18:26:41.844608+0000","last_unstale":"2024-09-12T19:14:09.051477+0000","last_undegraded":"2024-09-12T19:14:09.051477+0000","last_fullsized":"2024-09-12T19:14:09.051477+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T19:14:09.051011+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T19:14:09.051011+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.051011+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:05.391256+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2752,"num_read_kb":2596,"num_write":594,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'356","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.038812+0000","last_change":"2024-09-12T19:14:05.038747+0000","last_active":"2024-09-12T19:14:05.038812+0000","last_peered":"2024-09-12T19:14:05.038812+0000","last_clean":"2024-09-12T19:14:05.038812+0000","last_became_active":"2024-09-12T18:27:11.807022+0000","last_became_peered":"2024-09-12T18:27:11.807022+0000","last_unstale":"2024-09-12T19:14:05.038812+0000","last_undegraded":"2024-09-12T19:14:05.038812+0000","last_fullsized":"2024-09-12T19:14:05.038812+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T19:14:05.038645+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T19:14:05.038645+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.038645+0000","objects_scrubbed":10,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:35.165624+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4711351,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":491,"num_read_kb":61134,"num_write":1039,"num_write_kb":46178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.189124+0000","last_change":"2024-09-12T19:14:18.189124+0000","last_active":"2024-09-12T19:14:18.189124+0000","last_peered":"2024-09-12T19:14:18.189124+0000","last_clean":"2024-09-12T19:14:18.189124+0000","last_became_active":"2024-09-12T18:26:43.859997+0000","last_became_peered":"2024-09-12T18:26:43.859997+0000","last_unstale":"2024-09-12T19:14:18.189124+0000","last_undegraded":"2024-09-12T19:14:18.189124+0000","last_fullsized":"2024-09-12T19:14:18.189124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:18.188935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:18.188935+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.188935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:37.056353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'97","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.465536+0000","last_change":"2024-09-12T19:14:32.465536+0000","last_active":"2024-09-12T19:14:32.465536+0000","last_peered":"2024-09-12T19:14:32.465536+0000","last_clean":"2024-09-12T19:14:32.465536+0000","last_became_active":"2024-09-12T18:26:46.022246+0000","last_became_peered":"2024-09-12T18:26:46.022246+0000","last_unstale":"2024-09-12T19:14:32.465536+0000","last_undegraded":"2024-09-12T19:14:32.465536+0000","last_fullsized":"2024-09-12T19:14:32.465536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'97","last_scrub_stamp":"2024-09-12T19:14:32.465307+0000","last_deep_scrub":"265'97","last_deep_scrub_stamp":"2024-09-12T19:14:32.465307+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.465307+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:58.419382+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":130,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'771","reported_seq":2319,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.623054+0000","last_change":"2024-09-12T19:14:26.622931+0000","last_active":"2024-09-12T19:14:26.623054+0000","last_peered":"2024-09-12T19:14:26.623054+0000","last_clean":"2024-09-12T19:14:26.623054+0000","last_became_active":"2024-09-12T18:26:47.891107+0000","last_became_peered":"2024-09-12T18:26:47.891107+0000","last_unstale":"2024-09-12T19:14:26.623054+0000","last_undegraded":"2024-09-12T19:14:26.623054+0000","last_fullsized":"2024-09-12T19:14:26.623054+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-12T19:14:26.622749+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-12T19:14:26.622749+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.622749+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":701,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:47.744229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'115","reported_seq":612,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.951554+0000","last_change":"2024-09-12T19:14:37.951554+0000","last_active":"2024-09-12T19:14:37.951554+0000","last_peered":"2024-09-12T19:14:37.951554+0000","last_clean":"2024-09-12T19:14:37.951554+0000","last_became_active":"2024-09-12T18:26:49.915975+0000","last_became_peered":"2024-09-12T18:26:49.915975+0000","last_unstale":"2024-09-12T19:14:37.951554+0000","last_undegraded":"2024-09-12T19:14:37.951554+0000","last_fullsized":"2024-09-12T19:14:37.951554+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'115","last_scrub_stamp":"2024-09-12T19:14:37.951350+0000","last_deep_scrub":"265'115","last_deep_scrub_stamp":"2024-09-12T19:14:37.951350+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.951350+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:04.237891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":276,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'459","reported_seq":2189,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.267997+0000","last_change":"2024-09-12T19:14:17.267997+0000","last_active":"2024-09-12T19:14:17.267997+0000","last_peered":"2024-09-12T19:14:17.267997+0000","last_clean":"2024-09-12T19:14:17.267997+0000","last_became_active":"2024-09-12T18:26:41.853112+0000","last_became_peered":"2024-09-12T18:26:41.853112+0000","last_unstale":"2024-09-12T19:14:17.267997+0000","last_undegraded":"2024-09-12T19:14:17.267997+0000","last_fullsized":"2024-09-12T19:14:17.267997+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'459","last_scrub_stamp":"2024-09-12T19:14:17.267770+0000","last_deep_scrub":"265'459","last_deep_scrub_stamp":"2024-09-12T19:14:17.267770+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.267770+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:48.144249+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2539,"num_write":529,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'386","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.623237+0000","last_change":"2024-09-12T19:14:10.623072+0000","last_active":"2024-09-12T19:14:10.623237+0000","last_peered":"2024-09-12T19:14:10.623237+0000","last_clean":"2024-09-12T19:14:10.623237+0000","last_became_active":"2024-09-12T18:26:39.867136+0000","last_became_peered":"2024-09-12T18:26:39.867136+0000","last_unstale":"2024-09-12T19:14:10.623237+0000","last_undegraded":"2024-09-12T19:14:10.623237+0000","last_fullsized":"2024-09-12T19:14:10.623237+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T19:14:10.622850+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T19:14:10.622850+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.622850+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:12.986847+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":531,"num_read_kb":14806,"num_write":1141,"num_write_kb":34226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.948462+0000","last_change":"2024-09-12T19:14:26.948462+0000","last_active":"2024-09-12T19:14:26.948462+0000","last_peered":"2024-09-12T19:14:26.948462+0000","last_clean":"2024-09-12T19:14:26.948462+0000","last_became_active":"2024-09-12T18:26:43.876801+0000","last_became_peered":"2024-09-12T18:26:43.876801+0000","last_unstale":"2024-09-12T19:14:26.948462+0000","last_undegraded":"2024-09-12T19:14:26.948462+0000","last_fullsized":"2024-09-12T19:14:26.948462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.948178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.948178+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.948178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.096405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'301","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.448405+0000","last_change":"2024-09-12T19:14:34.448405+0000","last_active":"2024-09-12T19:14:34.448405+0000","last_peered":"2024-09-12T19:14:34.448405+0000","last_clean":"2024-09-12T19:14:34.448405+0000","last_became_active":"2024-09-12T18:26:45.872458+0000","last_became_peered":"2024-09-12T18:26:45.872458+0000","last_unstale":"2024-09-12T19:14:34.448405+0000","last_undegraded":"2024-09-12T19:14:34.448405+0000","last_fullsized":"2024-09-12T19:14:34.448405+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'301","last_scrub_stamp":"2024-09-12T19:14:34.448139+0000","last_deep_scrub":"265'301","last_deep_scrub_stamp":"2024-09-12T19:14:34.448139+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.448139+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:34.342174+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48239,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":1098,"num_write":396,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.612118+0000","last_change":"2024-09-12T19:14:32.612118+0000","last_active":"2024-09-12T19:14:32.612118+0000","last_peered":"2024-09-12T19:14:32.612118+0000","last_clean":"2024-09-12T19:14:32.612118+0000","last_became_active":"2024-09-12T18:26:47.894689+0000","last_became_peered":"2024-09-12T18:26:47.894689+0000","last_unstale":"2024-09-12T19:14:32.612118+0000","last_undegraded":"2024-09-12T19:14:32.612118+0000","last_fullsized":"2024-09-12T19:14:32.612118+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:32.611933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:32.611933+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.611933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:14.342442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'126","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.933153+0000","last_change":"2024-09-12T19:14:39.933153+0000","last_active":"2024-09-12T19:14:39.933153+0000","last_peered":"2024-09-12T19:14:39.933153+0000","last_clean":"2024-09-12T19:14:39.933153+0000","last_became_active":"2024-09-12T18:26:49.930794+0000","last_became_peered":"2024-09-12T18:26:49.930794+0000","last_unstale":"2024-09-12T19:14:39.933153+0000","last_undegraded":"2024-09-12T19:14:39.933153+0000","last_fullsized":"2024-09-12T19:14:39.933153+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T19:14:39.932971+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T19:14:39.932971+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.932971+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:37.505049+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":295,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'615","reported_seq":2283,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.306673+0000","last_change":"2024-09-12T19:14:16.306673+0000","last_active":"2024-09-12T19:14:16.306673+0000","last_peered":"2024-09-12T19:14:16.306673+0000","last_clean":"2024-09-12T19:14:16.306673+0000","last_became_active":"2024-09-12T18:26:41.856621+0000","last_became_peered":"2024-09-12T18:26:41.856621+0000","last_unstale":"2024-09-12T19:14:16.306673+0000","last_undegraded":"2024-09-12T19:14:16.306673+0000","last_fullsized":"2024-09-12T19:14:16.306673+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'615","last_scrub_stamp":"2024-09-12T19:14:16.306444+0000","last_deep_scrub":"265'615","last_deep_scrub_stamp":"2024-09-12T19:14:16.306444+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.306444+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:27.035273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3116,"num_read_kb":2841,"num_write":759,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'350","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.527370+0000","last_change":"2024-09-12T19:14:07.527194+0000","last_active":"2024-09-12T19:14:07.527370+0000","last_peered":"2024-09-12T19:14:07.527370+0000","last_clean":"2024-09-12T19:14:07.527370+0000","last_became_active":"2024-09-12T18:26:39.861108+0000","last_became_peered":"2024-09-12T18:26:39.861108+0000","last_unstale":"2024-09-12T19:14:07.527370+0000","last_undegraded":"2024-09-12T19:14:07.527370+0000","last_fullsized":"2024-09-12T19:14:07.527370+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-12T19:14:07.526998+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-12T19:14:07.526998+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.526998+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:41.778291+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":32271,"num_write":997,"num_write_kb":22718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.351092+0000","last_change":"2024-09-12T19:14:28.351092+0000","last_active":"2024-09-12T19:14:28.351092+0000","last_peered":"2024-09-12T19:14:28.351092+0000","last_clean":"2024-09-12T19:14:28.351092+0000","last_became_active":"2024-09-12T18:26:43.860336+0000","last_became_peered":"2024-09-12T18:26:43.860336+0000","last_unstale":"2024-09-12T19:14:28.351092+0000","last_undegraded":"2024-09-12T19:14:28.351092+0000","last_fullsized":"2024-09-12T19:14:28.351092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:28.350811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:28.350811+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.350811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:11.124551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'289","reported_seq":866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.608971+0000","last_change":"2024-09-12T19:14:25.608971+0000","last_active":"2024-09-12T19:14:25.608971+0000","last_peered":"2024-09-12T19:14:25.608971+0000","last_clean":"2024-09-12T19:14:25.608971+0000","last_became_active":"2024-09-12T18:26:45.881364+0000","last_became_peered":"2024-09-12T18:26:45.881364+0000","last_unstale":"2024-09-12T19:14:25.608971+0000","last_undegraded":"2024-09-12T19:14:25.608971+0000","last_fullsized":"2024-09-12T19:14:25.608971+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'289","last_scrub_stamp":"2024-09-12T19:14:25.608758+0000","last_deep_scrub":"265'289","last_deep_scrub_stamp":"2024-09-12T19:14:25.608758+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.608758+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:03.024276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1088,"num_write":384,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.618093+0000","last_change":"2024-09-12T19:14:25.618093+0000","last_active":"2024-09-12T19:14:25.618093+0000","last_peered":"2024-09-12T19:14:25.618093+0000","last_clean":"2024-09-12T19:14:25.618093+0000","last_became_active":"2024-09-12T18:26:47.888055+0000","last_became_peered":"2024-09-12T18:26:47.888055+0000","last_unstale":"2024-09-12T19:14:25.618093+0000","last_undegraded":"2024-09-12T19:14:25.618093+0000","last_fullsized":"2024-09-12T19:14:25.618093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:25.617917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:25.617917+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.617917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:04.933570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'127","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.153413+0000","last_change":"2024-09-12T19:14:41.153413+0000","last_active":"2024-09-12T19:14:41.153413+0000","last_peered":"2024-09-12T19:14:41.153413+0000","last_clean":"2024-09-12T19:14:41.153413+0000","last_became_active":"2024-09-12T18:26:49.922543+0000","last_became_peered":"2024-09-12T18:26:49.922543+0000","last_unstale":"2024-09-12T19:14:41.153413+0000","last_undegraded":"2024-09-12T19:14:41.153413+0000","last_fullsized":"2024-09-12T19:14:41.153413+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-12T19:14:41.153225+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-12T19:14:41.153225+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.153225+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:36.199893+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":203,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'473","reported_seq":2067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.004828+0000","last_change":"2024-09-12T19:14:21.004828+0000","last_active":"2024-09-12T19:14:21.004828+0000","last_peered":"2024-09-12T19:14:21.004828+0000","last_clean":"2024-09-12T19:14:21.004828+0000","last_became_active":"2024-09-12T18:26:41.850499+0000","last_became_peered":"2024-09-12T18:26:41.850499+0000","last_unstale":"2024-09-12T19:14:21.004828+0000","last_undegraded":"2024-09-12T19:14:21.004828+0000","last_fullsized":"2024-09-12T19:14:21.004828+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T19:14:21.004635+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T19:14:21.004635+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.004635+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:17.985937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2536,"num_read_kb":2375,"num_write":558,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2075,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'330","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.923865+0000","last_change":"2024-09-12T19:14:15.923865+0000","last_active":"2024-09-12T19:14:15.923865+0000","last_peered":"2024-09-12T19:14:15.923865+0000","last_clean":"2024-09-12T19:14:15.923865+0000","last_became_active":"2024-09-12T18:26:39.847422+0000","last_became_peered":"2024-09-12T18:26:39.847422+0000","last_unstale":"2024-09-12T19:14:15.923865+0000","last_undegraded":"2024-09-12T19:14:15.923865+0000","last_fullsized":"2024-09-12T19:14:15.923865+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T19:14:15.923637+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T19:14:15.923637+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.923637+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:08.399373+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568138,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":20074,"num_write":1068,"num_write_kb":42638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.378417+0000","last_change":"2024-09-12T19:14:27.378417+0000","last_active":"2024-09-12T19:14:27.378417+0000","last_peered":"2024-09-12T19:14:27.378417+0000","last_clean":"2024-09-12T19:14:27.378417+0000","last_became_active":"2024-09-12T18:26:43.874881+0000","last_became_peered":"2024-09-12T18:26:43.874881+0000","last_unstale":"2024-09-12T19:14:27.378417+0000","last_undegraded":"2024-09-12T19:14:27.378417+0000","last_fullsized":"2024-09-12T19:14:27.378417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:27.378198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:27.378198+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.378198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:47.322357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'276","reported_seq":840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.099273+0000","last_change":"2024-09-12T19:14:39.099273+0000","last_active":"2024-09-12T19:14:39.099273+0000","last_peered":"2024-09-12T19:14:39.099273+0000","last_clean":"2024-09-12T19:14:39.099273+0000","last_became_active":"2024-09-12T18:26:45.864264+0000","last_became_peered":"2024-09-12T18:26:45.864264+0000","last_unstale":"2024-09-12T19:14:39.099273+0000","last_undegraded":"2024-09-12T19:14:39.099273+0000","last_fullsized":"2024-09-12T19:14:39.099273+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'276","last_scrub_stamp":"2024-09-12T19:14:39.099101+0000","last_deep_scrub":"265'276","last_deep_scrub_stamp":"2024-09-12T19:14:39.099101+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.099101+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:20.021492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49732,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":471,"num_read_kb":1179,"num_write":398,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.379102+0000","last_change":"2024-09-12T19:14:37.379102+0000","last_active":"2024-09-12T19:14:37.379102+0000","last_peered":"2024-09-12T19:14:37.379102+0000","last_clean":"2024-09-12T19:14:37.379102+0000","last_became_active":"2024-09-12T18:26:47.882094+0000","last_became_peered":"2024-09-12T18:26:47.882094+0000","last_unstale":"2024-09-12T19:14:37.379102+0000","last_undegraded":"2024-09-12T19:14:37.379102+0000","last_fullsized":"2024-09-12T19:14:37.379102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:37.378923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:37.378923+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.378923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:57.166212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'200","reported_seq":1665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.981290+0000","last_change":"2024-09-12T19:14:38.981290+0000","last_active":"2024-09-12T19:14:38.981290+0000","last_peered":"2024-09-12T19:14:38.981290+0000","last_clean":"2024-09-12T19:14:38.981290+0000","last_became_active":"2024-09-12T18:26:49.920808+0000","last_became_peered":"2024-09-12T18:26:49.920808+0000","last_unstale":"2024-09-12T19:14:38.981290+0000","last_undegraded":"2024-09-12T19:14:38.981290+0000","last_fullsized":"2024-09-12T19:14:38.981290+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'200","last_scrub_stamp":"2024-09-12T19:14:38.981092+0000","last_deep_scrub":"265'200","last_deep_scrub_stamp":"2024-09-12T19:14:38.981092+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.981092+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:27.527614+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1188,"num_read_kb":1184,"num_write":433,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'794","reported_seq":2301,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.291683+0000","last_change":"2024-09-12T19:14:13.291683+0000","last_active":"2024-09-12T19:14:13.291683+0000","last_peered":"2024-09-12T19:14:13.291683+0000","last_clean":"2024-09-12T19:14:13.291683+0000","last_became_active":"2024-09-12T18:26:41.873690+0000","last_became_peered":"2024-09-12T18:26:41.873690+0000","last_unstale":"2024-09-12T19:14:13.291683+0000","last_undegraded":"2024-09-12T19:14:13.291683+0000","last_fullsized":"2024-09-12T19:14:13.291683+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'794","last_scrub_stamp":"2024-09-12T19:14:13.291444+0000","last_deep_scrub":"265'794","last_deep_scrub_stamp":"2024-09-12T19:14:13.291444+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.291444+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.167004+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3645,"num_read_kb":3278,"num_write":1029,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'366","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.869192+0000","last_change":"2024-09-12T19:14:05.869008+0000","last_active":"2024-09-12T19:14:05.869192+0000","last_peered":"2024-09-12T19:14:05.869192+0000","last_clean":"2024-09-12T19:14:05.869192+0000","last_became_active":"2024-09-12T18:27:11.829577+0000","last_became_peered":"2024-09-12T18:27:11.829577+0000","last_unstale":"2024-09-12T19:14:05.869192+0000","last_undegraded":"2024-09-12T19:14:05.869192+0000","last_fullsized":"2024-09-12T19:14:05.869192+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T19:14:05.868750+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T19:14:05.868750+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.868750+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:24.728613+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513384,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":509,"num_read_kb":8019,"num_write":1212,"num_write_kb":33613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.215657+0000","last_change":"2024-09-12T19:14:19.215657+0000","last_active":"2024-09-12T19:14:19.215657+0000","last_peered":"2024-09-12T19:14:19.215657+0000","last_clean":"2024-09-12T19:14:19.215657+0000","last_became_active":"2024-09-12T18:26:43.864719+0000","last_became_peered":"2024-09-12T18:26:43.864719+0000","last_unstale":"2024-09-12T19:14:19.215657+0000","last_undegraded":"2024-09-12T19:14:19.215657+0000","last_fullsized":"2024-09-12T19:14:19.215657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:19.215472+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:19.215472+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.215472+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:05.760013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'311","reported_seq":907,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.449025+0000","last_change":"2024-09-12T19:14:34.449025+0000","last_active":"2024-09-12T19:14:34.449025+0000","last_peered":"2024-09-12T19:14:34.449025+0000","last_clean":"2024-09-12T19:14:34.449025+0000","last_became_active":"2024-09-12T18:26:45.865711+0000","last_became_peered":"2024-09-12T18:26:45.865711+0000","last_unstale":"2024-09-12T19:14:34.449025+0000","last_undegraded":"2024-09-12T19:14:34.449025+0000","last_fullsized":"2024-09-12T19:14:34.449025+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'311","last_scrub_stamp":"2024-09-12T19:14:34.448810+0000","last_deep_scrub":"265'311","last_deep_scrub_stamp":"2024-09-12T19:14:34.448810+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.448810+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:58.928887+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47780,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1144,"num_write":416,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.622059+0000","last_change":"2024-09-12T19:14:36.622059+0000","last_active":"2024-09-12T19:14:36.622059+0000","last_peered":"2024-09-12T19:14:36.622059+0000","last_clean":"2024-09-12T19:14:36.622059+0000","last_became_active":"2024-09-12T18:26:47.883014+0000","last_became_peered":"2024-09-12T18:26:47.883014+0000","last_unstale":"2024-09-12T19:14:36.622059+0000","last_undegraded":"2024-09-12T19:14:36.622059+0000","last_fullsized":"2024-09-12T19:14:36.622059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:36.621864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:36.621864+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.621864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:58.258765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'109","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.431809+0000","last_change":"2024-09-12T19:14:36.431809+0000","last_active":"2024-09-12T19:14:36.431809+0000","last_peered":"2024-09-12T19:14:36.431809+0000","last_clean":"2024-09-12T19:14:36.431809+0000","last_became_active":"2024-09-12T18:26:49.921636+0000","last_became_peered":"2024-09-12T18:26:49.921636+0000","last_unstale":"2024-09-12T19:14:36.431809+0000","last_undegraded":"2024-09-12T19:14:36.431809+0000","last_fullsized":"2024-09-12T19:14:36.431809+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-12T19:14:36.431615+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-12T19:14:36.431615+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.431615+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:18.233287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":621,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":107,"num_write":252,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'1276","reported_seq":3089,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.158163+0000","last_change":"2024-09-12T19:14:15.157980+0000","last_active":"2024-09-12T19:14:15.158163+0000","last_peered":"2024-09-12T19:14:15.158163+0000","last_clean":"2024-09-12T19:14:15.158163+0000","last_became_active":"2024-09-12T18:26:41.872455+0000","last_became_peered":"2024-09-12T18:26:41.872455+0000","last_unstale":"2024-09-12T19:14:15.158163+0000","last_undegraded":"2024-09-12T19:14:15.158163+0000","last_fullsized":"2024-09-12T19:14:15.158163+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1276","last_scrub_stamp":"2024-09-12T19:14:15.157805+0000","last_deep_scrub":"265'1276","last_deep_scrub_stamp":"2024-09-12T19:14:15.157805+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.157805+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":1200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:47.614559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6298,"num_read_kb":5578,"num_write":1816,"num_write_kb":809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'415","reported_seq":1116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.516302+0000","last_change":"2024-09-12T19:14:07.516055+0000","last_active":"2024-09-12T19:14:07.516302+0000","last_peered":"2024-09-12T19:14:07.516302+0000","last_clean":"2024-09-12T19:14:07.516302+0000","last_became_active":"2024-09-12T18:26:39.847954+0000","last_became_peered":"2024-09-12T18:26:39.847954+0000","last_unstale":"2024-09-12T19:14:07.516302+0000","last_undegraded":"2024-09-12T19:14:07.516302+0000","last_fullsized":"2024-09-12T19:14:07.516302+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'415","last_scrub_stamp":"2024-09-12T19:14:07.515758+0000","last_deep_scrub":"265'415","last_deep_scrub_stamp":"2024-09-12T19:14:07.515758+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.515758+0000","objects_scrubbed":11,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:44.678357+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263330,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":589,"num_read_kb":77066,"num_write":1254,"num_write_kb":41008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'506","reported_seq":2159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.163931+0000","last_change":"2024-09-12T19:14:17.163693+0000","last_active":"2024-09-12T19:14:17.163931+0000","last_peered":"2024-09-12T19:14:17.163931+0000","last_clean":"2024-09-12T19:14:17.163931+0000","last_became_active":"2024-09-12T18:26:41.846040+0000","last_became_peered":"2024-09-12T18:26:41.846040+0000","last_unstale":"2024-09-12T19:14:17.163931+0000","last_undegraded":"2024-09-12T19:14:17.163931+0000","last_fullsized":"2024-09-12T19:14:17.163931+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'506","last_scrub_stamp":"2024-09-12T19:14:17.163451+0000","last_deep_scrub":"265'506","last_deep_scrub_stamp":"2024-09-12T19:14:17.163451+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.163451+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:17.436750+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2703,"num_read_kb":2531,"num_write":592,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'383","reported_seq":1106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.072813+0000","last_change":"2024-09-12T19:14:06.072667+0000","last_active":"2024-09-12T19:14:06.072813+0000","last_peered":"2024-09-12T19:14:06.072813+0000","last_clean":"2024-09-12T19:14:06.072813+0000","last_became_active":"2024-09-12T18:26:39.846028+0000","last_became_peered":"2024-09-12T18:26:39.846028+0000","last_unstale":"2024-09-12T19:14:06.072813+0000","last_undegraded":"2024-09-12T19:14:06.072813+0000","last_fullsized":"2024-09-12T19:14:06.072813+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T19:14:06.072441+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T19:14:06.072441+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.072441+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:27.496097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":778,"num_read_kb":5622,"num_write":1176,"num_write_kb":40701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'518","reported_seq":2050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.449208+0000","last_change":"2024-09-12T19:14:19.449064+0000","last_active":"2024-09-12T19:14:19.449208+0000","last_peered":"2024-09-12T19:14:19.449208+0000","last_clean":"2024-09-12T19:14:19.449208+0000","last_became_active":"2024-09-12T18:26:41.884394+0000","last_became_peered":"2024-09-12T18:26:41.884394+0000","last_unstale":"2024-09-12T19:14:19.449208+0000","last_undegraded":"2024-09-12T19:14:19.449208+0000","last_fullsized":"2024-09-12T19:14:19.449208+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'518","last_scrub_stamp":"2024-09-12T19:14:19.448882+0000","last_deep_scrub":"265'518","last_deep_scrub_stamp":"2024-09-12T19:14:19.448882+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.448882+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:45.429300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2704,"num_read_kb":2505,"num_write":657,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'348","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.576885+0000","last_change":"2024-09-12T19:14:09.576657+0000","last_active":"2024-09-12T19:14:09.576885+0000","last_peered":"2024-09-12T19:14:09.576885+0000","last_clean":"2024-09-12T19:14:09.576885+0000","last_became_active":"2024-09-12T18:26:39.856026+0000","last_became_peered":"2024-09-12T18:26:39.856026+0000","last_unstale":"2024-09-12T19:14:09.576885+0000","last_undegraded":"2024-09-12T19:14:09.576885+0000","last_fullsized":"2024-09-12T19:14:09.576885+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T19:14:09.576403+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T19:14:09.576403+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.576403+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:49.231864+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136883,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":16869,"num_write":1087,"num_write_kb":23838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'540","reported_seq":2164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.152123+0000","last_change":"2024-09-12T19:14:21.151938+0000","last_active":"2024-09-12T19:14:21.152123+0000","last_peered":"2024-09-12T19:14:21.152123+0000","last_clean":"2024-09-12T19:14:21.152123+0000","last_became_active":"2024-09-12T18:26:41.850519+0000","last_became_peered":"2024-09-12T18:26:41.850519+0000","last_unstale":"2024-09-12T19:14:21.152123+0000","last_undegraded":"2024-09-12T19:14:21.152123+0000","last_fullsized":"2024-09-12T19:14:21.152123+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'540","last_scrub_stamp":"2024-09-12T19:14:21.151755+0000","last_deep_scrub":"265'540","last_deep_scrub_stamp":"2024-09-12T19:14:21.151755+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.151755+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:23.137225+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2864,"num_read_kb":2647,"num_write":672,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'356","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.828101+0000","last_change":"2024-09-12T19:14:10.828101+0000","last_active":"2024-09-12T19:14:10.828101+0000","last_peered":"2024-09-12T19:14:10.828101+0000","last_clean":"2024-09-12T19:14:10.828101+0000","last_became_active":"2024-09-12T18:26:39.842852+0000","last_became_peered":"2024-09-12T18:26:39.842852+0000","last_unstale":"2024-09-12T19:14:10.828101+0000","last_undegraded":"2024-09-12T19:14:10.828101+0000","last_fullsized":"2024-09-12T19:14:10.828101+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T19:14:10.827863+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T19:14:10.827863+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.827863+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:51.034300+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524303,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":35620,"num_write":1162,"num_write_kb":31566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'816","reported_seq":2361,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.953680+0000","last_change":"2024-09-12T19:14:16.953680+0000","last_active":"2024-09-12T19:14:16.953680+0000","last_peered":"2024-09-12T19:14:16.953680+0000","last_clean":"2024-09-12T19:14:16.953680+0000","last_became_active":"2024-09-12T18:26:41.882458+0000","last_became_peered":"2024-09-12T18:26:41.882458+0000","last_unstale":"2024-09-12T19:14:16.953680+0000","last_undegraded":"2024-09-12T19:14:16.953680+0000","last_fullsized":"2024-09-12T19:14:16.953680+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'816","last_scrub_stamp":"2024-09-12T19:14:16.953485+0000","last_deep_scrub":"265'816","last_deep_scrub_stamp":"2024-09-12T19:14:16.953485+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.953485+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:39.442346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3832,"num_read_kb":3447,"num_write":1071,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'338","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.763905+0000","last_change":"2024-09-12T19:14:05.763769+0000","last_active":"2024-09-12T19:14:05.763905+0000","last_peered":"2024-09-12T19:14:05.763905+0000","last_clean":"2024-09-12T19:14:05.763905+0000","last_became_active":"2024-09-12T18:26:39.855654+0000","last_became_peered":"2024-09-12T18:26:39.855654+0000","last_unstale":"2024-09-12T19:14:05.763905+0000","last_undegraded":"2024-09-12T19:14:05.763905+0000","last_fullsized":"2024-09-12T19:14:05.763905+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'338","last_scrub_stamp":"2024-09-12T19:14:05.763566+0000","last_deep_scrub":"265'338","last_deep_scrub_stamp":"2024-09-12T19:14:05.763566+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.763566+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:37.605894+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":592,"num_read_kb":6402,"num_write":1048,"num_write_kb":32224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'1224","reported_seq":2866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.258685+0000","last_change":"2024-09-12T19:14:18.258534+0000","last_active":"2024-09-12T19:14:18.258685+0000","last_peered":"2024-09-12T19:14:18.258685+0000","last_clean":"2024-09-12T19:14:18.258685+0000","last_became_active":"2024-09-12T18:26:41.876138+0000","last_became_peered":"2024-09-12T18:26:41.876138+0000","last_unstale":"2024-09-12T19:14:18.258685+0000","last_undegraded":"2024-09-12T19:14:18.258685+0000","last_fullsized":"2024-09-12T19:14:18.258685+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1224","last_scrub_stamp":"2024-09-12T19:14:18.258312+0000","last_deep_scrub":"265'1224","last_deep_scrub_stamp":"2024-09-12T19:14:18.258312+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.258312+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":1200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:16.154638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4890,"num_write":1674,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'314","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.063931+0000","last_change":"2024-09-12T19:14:05.063835+0000","last_active":"2024-09-12T19:14:05.063931+0000","last_peered":"2024-09-12T19:14:05.063931+0000","last_clean":"2024-09-12T19:14:05.063931+0000","last_became_active":"2024-09-12T18:26:39.844346+0000","last_became_peered":"2024-09-12T18:26:39.844346+0000","last_unstale":"2024-09-12T19:14:05.063931+0000","last_undegraded":"2024-09-12T19:14:05.063931+0000","last_fullsized":"2024-09-12T19:14:05.063931+0000","mapping_epoch":24,"log_start":"265'301","ondisk_log_start":"265'301","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-12T19:14:05.063699+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-12T19:14:05.063699+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.063699+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":301,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:23.183938+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":67178,"num_write":993,"num_write_kb":30033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'745","reported_seq":2199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.035158+0000","last_change":"2024-09-12T19:14:08.035158+0000","last_active":"2024-09-12T19:14:08.035158+0000","last_peered":"2024-09-12T19:14:08.035158+0000","last_clean":"2024-09-12T19:14:08.035158+0000","last_became_active":"2024-09-12T18:27:11.823747+0000","last_became_peered":"2024-09-12T18:27:11.823747+0000","last_unstale":"2024-09-12T19:14:08.035158+0000","last_undegraded":"2024-09-12T19:14:08.035158+0000","last_fullsized":"2024-09-12T19:14:08.035158+0000","mapping_epoch":37,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'745","last_scrub_stamp":"2024-09-12T19:14:08.034931+0000","last_deep_scrub":"265'745","last_deep_scrub_stamp":"2024-09-12T19:14:08.034931+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.034931+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:31.331294+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3535,"num_read_kb":3187,"num_write":978,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"265'340","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.585320+0000","last_change":"2024-09-12T19:14:11.585184+0000","last_active":"2024-09-12T19:14:11.585320+0000","last_peered":"2024-09-12T19:14:11.585320+0000","last_clean":"2024-09-12T19:14:11.585320+0000","last_became_active":"2024-09-12T18:26:39.871119+0000","last_became_peered":"2024-09-12T18:26:39.871119+0000","last_unstale":"2024-09-12T19:14:11.585320+0000","last_undegraded":"2024-09-12T19:14:11.585320+0000","last_fullsized":"2024-09-12T19:14:11.585320+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T19:14:11.584993+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T19:14:11.584993+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.584993+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:59.549191+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695310,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":8461,"num_write":1111,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'1067","reported_seq":2783,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.624192+0000","last_change":"2024-09-12T19:14:14.623962+0000","last_active":"2024-09-12T19:14:14.624192+0000","last_peered":"2024-09-12T19:14:14.624192+0000","last_clean":"2024-09-12T19:14:14.624192+0000","last_became_active":"2024-09-12T18:26:41.863607+0000","last_became_peered":"2024-09-12T18:26:41.863607+0000","last_unstale":"2024-09-12T19:14:14.624192+0000","last_undegraded":"2024-09-12T19:14:14.624192+0000","last_fullsized":"2024-09-12T19:14:14.624192+0000","mapping_epoch":26,"log_start":"265'1000","ondisk_log_start":"265'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1067","last_scrub_stamp":"2024-09-12T19:14:14.623754+0000","last_deep_scrub":"265'1067","last_deep_scrub_stamp":"2024-09-12T19:14:14.623754+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.623754+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":1000,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:14.209154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5203,"num_read_kb":4615,"num_write":1535,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1418,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'347","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.809761+0000","last_change":"2024-09-12T19:14:06.809689+0000","last_active":"2024-09-12T19:14:06.809761+0000","last_peered":"2024-09-12T19:14:06.809761+0000","last_clean":"2024-09-12T19:14:06.809761+0000","last_became_active":"2024-09-12T18:26:39.827475+0000","last_became_peered":"2024-09-12T18:26:39.827475+0000","last_unstale":"2024-09-12T19:14:06.809761+0000","last_undegraded":"2024-09-12T19:14:06.809761+0000","last_fullsized":"2024-09-12T19:14:06.809761+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T19:14:06.809544+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T19:14:06.809544+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.809544+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:35.789447+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136911,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":492,"num_read_kb":48337,"num_write":1107,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'826","reported_seq":2446,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.731033+0000","last_change":"2024-09-12T19:14:19.731033+0000","last_active":"2024-09-12T19:14:19.731033+0000","last_peered":"2024-09-12T19:14:19.731033+0000","last_clean":"2024-09-12T19:14:19.731033+0000","last_became_active":"2024-09-12T18:26:41.851080+0000","last_became_peered":"2024-09-12T18:26:41.851080+0000","last_unstale":"2024-09-12T19:14:19.731033+0000","last_undegraded":"2024-09-12T19:14:19.731033+0000","last_fullsized":"2024-09-12T19:14:19.731033+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'826","last_scrub_stamp":"2024-09-12T19:14:19.730759+0000","last_deep_scrub":"265'826","last_deep_scrub_stamp":"2024-09-12T19:14:19.730759+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.730759+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:22.313239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4015,"num_read_kb":3626,"num_write":1096,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'362","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.617921+0000","last_change":"2024-09-12T19:14:11.617777+0000","last_active":"2024-09-12T19:14:11.617921+0000","last_peered":"2024-09-12T19:14:11.617921+0000","last_clean":"2024-09-12T19:14:11.617921+0000","last_became_active":"2024-09-12T18:26:39.849722+0000","last_became_peered":"2024-09-12T18:26:39.849722+0000","last_unstale":"2024-09-12T19:14:11.617921+0000","last_undegraded":"2024-09-12T19:14:11.617921+0000","last_fullsized":"2024-09-12T19:14:11.617921+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T19:14:11.617565+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T19:14:11.617565+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.617565+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:32.390820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":40604,"num_write":1102,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'396","reported_seq":1935,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.331338+0000","last_change":"2024-09-12T19:14:20.331338+0000","last_active":"2024-09-12T19:14:20.331338+0000","last_peered":"2024-09-12T19:14:20.331338+0000","last_clean":"2024-09-12T19:14:20.331338+0000","last_became_active":"2024-09-12T18:26:41.851159+0000","last_became_peered":"2024-09-12T18:26:41.851159+0000","last_unstale":"2024-09-12T19:14:20.331338+0000","last_undegraded":"2024-09-12T19:14:20.331338+0000","last_fullsized":"2024-09-12T19:14:20.331338+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'396","last_scrub_stamp":"2024-09-12T19:14:20.331149+0000","last_deep_scrub":"265'396","last_deep_scrub_stamp":"2024-09-12T19:14:20.331149+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.331149+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:03.216872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2139,"num_read_kb":2047,"num_write":455,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'312","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.866891+0000","last_change":"2024-09-12T19:14:13.866891+0000","last_active":"2024-09-12T19:14:13.866891+0000","last_peered":"2024-09-12T19:14:13.866891+0000","last_clean":"2024-09-12T19:14:13.866891+0000","last_became_active":"2024-09-12T18:26:39.827933+0000","last_became_peered":"2024-09-12T18:26:39.827933+0000","last_unstale":"2024-09-12T19:14:13.866891+0000","last_undegraded":"2024-09-12T19:14:13.866891+0000","last_fullsized":"2024-09-12T19:14:13.866891+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T19:14:13.866679+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T19:14:13.866679+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.866679+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:05.360145+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":423,"num_read_kb":364,"num_write":936,"num_write_kb":38290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'1178","reported_seq":2814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.081400+0000","last_change":"2024-09-12T19:14:10.081400+0000","last_active":"2024-09-12T19:14:10.081400+0000","last_peered":"2024-09-12T19:14:10.081400+0000","last_clean":"2024-09-12T19:14:10.081400+0000","last_became_active":"2024-09-12T18:26:41.872816+0000","last_became_peered":"2024-09-12T18:26:41.872816+0000","last_unstale":"2024-09-12T19:14:10.081400+0000","last_undegraded":"2024-09-12T19:14:10.081400+0000","last_fullsized":"2024-09-12T19:14:10.081400+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1178","last_scrub_stamp":"2024-09-12T19:14:10.081223+0000","last_deep_scrub":"265'1178","last_deep_scrub_stamp":"2024-09-12T19:14:10.081223+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.081223+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:17.777350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5354,"num_read_kb":4741,"num_write":1604,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'309","reported_seq":903,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.028209+0000","last_change":"2024-09-12T19:14:07.028067+0000","last_active":"2024-09-12T19:14:07.028209+0000","last_peered":"2024-09-12T19:14:07.028209+0000","last_clean":"2024-09-12T19:14:07.028209+0000","last_became_active":"2024-09-12T18:27:12.005906+0000","last_became_peered":"2024-09-12T18:27:12.005906+0000","last_unstale":"2024-09-12T19:14:07.028209+0000","last_undegraded":"2024-09-12T19:14:07.028209+0000","last_fullsized":"2024-09-12T19:14:07.028209+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-12T19:14:07.027874+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-12T19:14:07.027874+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.027874+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:58.637085+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":9281,"num_write":1029,"num_write_kb":40338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"265'421","reported_seq":1878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.299205+0000","last_change":"2024-09-12T19:14:19.299205+0000","last_active":"2024-09-12T19:14:19.299205+0000","last_peered":"2024-09-12T19:14:19.299205+0000","last_clean":"2024-09-12T19:14:19.299205+0000","last_became_active":"2024-09-12T18:26:41.866602+0000","last_became_peered":"2024-09-12T18:26:41.866602+0000","last_unstale":"2024-09-12T19:14:19.299205+0000","last_undegraded":"2024-09-12T19:14:19.299205+0000","last_fullsized":"2024-09-12T19:14:19.299205+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T19:14:19.298966+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T19:14:19.298966+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.298966+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:05.474113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2028,"num_write":492,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'368","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.808721+0000","last_change":"2024-09-12T19:14:12.808721+0000","last_active":"2024-09-12T19:14:12.808721+0000","last_peered":"2024-09-12T19:14:12.808721+0000","last_clean":"2024-09-12T19:14:12.808721+0000","last_became_active":"2024-09-12T18:26:39.871626+0000","last_became_peered":"2024-09-12T18:26:39.871626+0000","last_unstale":"2024-09-12T19:14:12.808721+0000","last_undegraded":"2024-09-12T19:14:12.808721+0000","last_fullsized":"2024-09-12T19:14:12.808721+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T19:14:12.808485+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T19:14:12.808485+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.808485+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:25.920885+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2185594,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":15528,"num_write":1112,"num_write_kb":35488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'1249","reported_seq":2895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.880698+0000","last_change":"2024-09-12T19:14:21.880698+0000","last_active":"2024-09-12T19:14:21.880698+0000","last_peered":"2024-09-12T19:14:21.880698+0000","last_clean":"2024-09-12T19:14:21.880698+0000","last_became_active":"2024-09-12T18:26:41.876708+0000","last_became_peered":"2024-09-12T18:26:41.876708+0000","last_unstale":"2024-09-12T19:14:21.880698+0000","last_undegraded":"2024-09-12T19:14:21.880698+0000","last_fullsized":"2024-09-12T19:14:21.880698+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1249","last_scrub_stamp":"2024-09-12T19:14:21.880516+0000","last_deep_scrub":"265'1249","last_deep_scrub_stamp":"2024-09-12T19:14:21.880516+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.880516+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":1200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:42.174249+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5682,"num_read_kb":5005,"num_write":1690,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'330","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.568489+0000","last_change":"2024-09-12T19:14:09.568489+0000","last_active":"2024-09-12T19:14:09.568489+0000","last_peered":"2024-09-12T19:14:09.568489+0000","last_clean":"2024-09-12T19:14:09.568489+0000","last_became_active":"2024-09-12T18:26:39.857956+0000","last_became_peered":"2024-09-12T18:26:39.857956+0000","last_unstale":"2024-09-12T19:14:09.568489+0000","last_undegraded":"2024-09-12T19:14:09.568489+0000","last_fullsized":"2024-09-12T19:14:09.568489+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T19:14:09.568184+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T19:14:09.568184+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.568184+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:20.538784+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2580367,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":492,"num_read_kb":32197,"num_write":944,"num_write_kb":38029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'899","reported_seq":2603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.791367+0000","last_change":"2024-09-12T19:14:17.791367+0000","last_active":"2024-09-12T19:14:17.791367+0000","last_peered":"2024-09-12T19:14:17.791367+0000","last_clean":"2024-09-12T19:14:17.791367+0000","last_became_active":"2024-09-12T18:26:41.854471+0000","last_became_peered":"2024-09-12T18:26:41.854471+0000","last_unstale":"2024-09-12T19:14:17.791367+0000","last_undegraded":"2024-09-12T19:14:17.791367+0000","last_fullsized":"2024-09-12T19:14:17.791367+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'899","last_scrub_stamp":"2024-09-12T19:14:17.791192+0000","last_deep_scrub":"265'899","last_deep_scrub_stamp":"2024-09-12T19:14:17.791192+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.791192+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:01.381428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4435,"num_read_kb":4011,"num_write":1173,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'389","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.836040+0000","last_change":"2024-09-12T19:14:13.836040+0000","last_active":"2024-09-12T19:14:13.836040+0000","last_peered":"2024-09-12T19:14:13.836040+0000","last_clean":"2024-09-12T19:14:13.836040+0000","last_became_active":"2024-09-12T18:26:39.869924+0000","last_became_peered":"2024-09-12T18:26:39.869924+0000","last_unstale":"2024-09-12T19:14:13.836040+0000","last_undegraded":"2024-09-12T19:14:13.836040+0000","last_fullsized":"2024-09-12T19:14:13.836040+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'389","last_scrub_stamp":"2024-09-12T19:14:13.835820+0000","last_deep_scrub":"265'389","last_deep_scrub_stamp":"2024-09-12T19:14:13.835820+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.835820+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:38.231301+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399013,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":35584,"num_write":1226,"num_write_kb":36960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'690","reported_seq":2488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.100626+0000","last_change":"2024-09-12T19:14:24.100626+0000","last_active":"2024-09-12T19:14:24.100626+0000","last_peered":"2024-09-12T19:14:24.100626+0000","last_clean":"2024-09-12T19:14:24.100626+0000","last_became_active":"2024-09-12T18:26:41.858362+0000","last_became_peered":"2024-09-12T18:26:41.858362+0000","last_unstale":"2024-09-12T19:14:24.100626+0000","last_undegraded":"2024-09-12T19:14:24.100626+0000","last_fullsized":"2024-09-12T19:14:24.100626+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'690","last_scrub_stamp":"2024-09-12T19:14:24.100446+0000","last_deep_scrub":"265'690","last_deep_scrub_stamp":"2024-09-12T19:14:24.100446+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.100446+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:25.838408+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3672,"num_read_kb":3341,"num_write":924,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3008,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'426","reported_seq":1217,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.038483+0000","last_change":"2024-09-12T19:14:12.038483+0000","last_active":"2024-09-12T19:14:12.038483+0000","last_peered":"2024-09-12T19:14:12.038483+0000","last_clean":"2024-09-12T19:14:12.038483+0000","last_became_active":"2024-09-12T18:26:39.847373+0000","last_became_peered":"2024-09-12T18:26:39.847373+0000","last_unstale":"2024-09-12T19:14:12.038483+0000","last_undegraded":"2024-09-12T19:14:12.038483+0000","last_fullsized":"2024-09-12T19:14:12.038483+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'426","last_scrub_stamp":"2024-09-12T19:14:12.038294+0000","last_deep_scrub":"265'426","last_deep_scrub_stamp":"2024-09-12T19:14:12.038294+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.038294+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:28.497991+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":812,"num_read_kb":75472,"num_write":1417,"num_write_kb":36911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'826","reported_seq":2401,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.851050+0000","last_change":"2024-09-12T19:14:19.850884+0000","last_active":"2024-09-12T19:14:19.851050+0000","last_peered":"2024-09-12T19:14:19.851050+0000","last_clean":"2024-09-12T19:14:19.851050+0000","last_became_active":"2024-09-12T18:26:41.871610+0000","last_became_peered":"2024-09-12T18:26:41.871610+0000","last_unstale":"2024-09-12T19:14:19.851050+0000","last_undegraded":"2024-09-12T19:14:19.851050+0000","last_fullsized":"2024-09-12T19:14:19.851050+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'826","last_scrub_stamp":"2024-09-12T19:14:19.850704+0000","last_deep_scrub":"265'826","last_deep_scrub_stamp":"2024-09-12T19:14:19.850704+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.850704+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:40.802958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3622,"num_write":1076,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'288","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.625440+0000","last_change":"2024-09-12T19:14:12.625440+0000","last_active":"2024-09-12T19:14:12.625440+0000","last_peered":"2024-09-12T19:14:12.625440+0000","last_clean":"2024-09-12T19:14:12.625440+0000","last_became_active":"2024-09-12T18:26:39.874710+0000","last_became_peered":"2024-09-12T18:26:39.874710+0000","last_unstale":"2024-09-12T19:14:12.625440+0000","last_undegraded":"2024-09-12T19:14:12.625440+0000","last_fullsized":"2024-09-12T19:14:12.625440+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'288","last_scrub_stamp":"2024-09-12T19:14:12.625246+0000","last_deep_scrub":"265'288","last_deep_scrub_stamp":"2024-09-12T19:14:12.625246+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.625246+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:05.154814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":12735,"num_write":942,"num_write_kb":23796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'359","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.643734+0000","last_change":"2024-09-12T19:14:14.643734+0000","last_active":"2024-09-12T19:14:14.643734+0000","last_peered":"2024-09-12T19:14:14.643734+0000","last_clean":"2024-09-12T19:14:14.643734+0000","last_became_active":"2024-09-12T18:26:39.846477+0000","last_became_peered":"2024-09-12T18:26:39.846477+0000","last_unstale":"2024-09-12T19:14:14.643734+0000","last_undegraded":"2024-09-12T19:14:14.643734+0000","last_fullsized":"2024-09-12T19:14:14.643734+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-12T19:14:14.643507+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-12T19:14:14.643507+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.643507+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:48.800351+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":32398,"num_write":1027,"num_write_kb":24916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'405","reported_seq":1878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.711466+0000","last_change":"2024-09-12T19:14:20.711466+0000","last_active":"2024-09-12T19:14:20.711466+0000","last_peered":"2024-09-12T19:14:20.711466+0000","last_clean":"2024-09-12T19:14:20.711466+0000","last_became_active":"2024-09-12T18:26:41.851295+0000","last_became_peered":"2024-09-12T18:26:41.851295+0000","last_unstale":"2024-09-12T19:14:20.711466+0000","last_undegraded":"2024-09-12T19:14:20.711466+0000","last_fullsized":"2024-09-12T19:14:20.711466+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-12T19:14:20.711236+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-12T19:14:20.711236+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.711236+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:44.617496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":455,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'322","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.037157+0000","last_change":"2024-09-12T19:14:07.037157+0000","last_active":"2024-09-12T19:14:07.037157+0000","last_peered":"2024-09-12T19:14:07.037157+0000","last_clean":"2024-09-12T19:14:07.037157+0000","last_became_active":"2024-09-12T18:26:39.857009+0000","last_became_peered":"2024-09-12T18:26:39.857009+0000","last_unstale":"2024-09-12T19:14:07.037157+0000","last_undegraded":"2024-09-12T19:14:07.037157+0000","last_fullsized":"2024-09-12T19:14:07.037157+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T19:14:07.036972+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T19:14:07.036972+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.036972+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:28.775839+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2355888,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":55513,"num_write":945,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'377","reported_seq":1773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.366487+0000","last_change":"2024-09-12T19:14:21.366487+0000","last_active":"2024-09-12T19:14:21.366487+0000","last_peered":"2024-09-12T19:14:21.366487+0000","last_clean":"2024-09-12T19:14:21.366487+0000","last_became_active":"2024-09-12T18:26:41.872448+0000","last_became_peered":"2024-09-12T18:26:41.872448+0000","last_unstale":"2024-09-12T19:14:21.366487+0000","last_undegraded":"2024-09-12T19:14:21.366487+0000","last_fullsized":"2024-09-12T19:14:21.366487+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:14:21.366307+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:14:21.366307+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.366307+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:53.119707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1946,"num_read_kb":1855,"num_write":441,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6147,"num_read_kb":4433,"num_write":1993,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4212,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":965,"ondisk_log_size":965,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":14976,"num_read_kb":14648,"num_write":16787,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1732,"ondisk_log_size":1732,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":577,"ondisk_log_size":577,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1597681,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17400,"num_read_kb":36744,"num_write":14589,"num_write_kb":11628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":675720,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1996,"ondisk_log_size":1996,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212286,"num_read_kb":193833,"num_write":55194,"num_write_kb":18759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43776,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4064,"ondisk_log_size":4064,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":64167064,"num_objects":372,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":372,"num_whiteouts":0,"num_read":36315,"num_read_kb":1882823,"num_write":72228,"num_write_kb":2144860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":129474560,"data_stored":128334128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3882,"ondisk_log_size":3882,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":214446,"num_write":192,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":201134,"num_write":192,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510026,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262572,"kb_used_data":10652,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94109268,"statfs":{"total":96636764160,"available":96367890432,"internally_reserved":0,"allocated":10907648,"data_stored":9282789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257948102},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510026,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131840,"kb_used_data":10480,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94240000,"statfs":{"total":96636764160,"available":96501760000,"internally_reserved":0,"allocated":10731520,"data_stored":9041400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510027,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92808,"kb_used_data":29688,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94279032,"statfs":{"total":96636764160,"available":96541728768,"internally_reserved":0,"allocated":30400512,"data_stored":28782462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510024,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266872,"kb_used_data":10792,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94104968,"statfs":{"total":96636764160,"available":96363487232,"internally_reserved":0,"allocated":11051008,"data_stored":9395858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510024,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95984,"kb_used_data":14880,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94275856,"statfs":{"total":96636764160,"available":96538476544,"internally_reserved":0,"allocated":15237120,"data_stored":13690985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510024,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284940,"kb_used_data":33084,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94086900,"statfs":{"total":96636764160,"available":96344985600,"internally_reserved":0,"allocated":33878016,"data_stored":32185380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":257882568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542731,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292816,"kb_used_data":18688,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94079024,"statfs":{"total":96636764160,"available":96336920576,"internally_reserved":0,"allocated":19136512,"data_stored":17444491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542729,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":167376,"kb_used_data":27968,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94204464,"statfs":{"total":96636764160,"available":96465371136,"internally_reserved":0,"allocated":28639232,"data_stored":27068681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29601792,"data_stored":29420904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24977408,"data_stored":24897183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11599872,"data_stored":11518686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7376896,"data_stored":7222226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26800128,"data_stored":26613106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7016448,"data_stored":6869386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7270400,"data_stored":7112125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14831616,"data_stored":14680512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:14:46.878 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.878 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.878 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.879 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.879 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.879 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.879 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.879 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.880 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.880 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.880 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.881 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.881 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.881 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.881 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.882 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.882 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.882 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.882 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.883 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.883 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.883 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.883 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.883 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.883 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.884 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.884 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.884 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.884 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.884 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.885 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.885 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.885 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.886 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.886 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.886 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.887 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.887 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.887 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.887 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.887 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.887 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.887 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.887 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.888 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.888 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.888 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.888 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.889 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.889 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.889 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.890 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.890 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.890 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.890 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.890 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.890 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.890 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.890 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.891 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.891 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.891 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.891 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.891 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.891 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.891 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.891 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.892 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.892 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.892 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.892 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.892 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.892 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.892 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.893 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.893 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.893 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T18:43:28.819869+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.893 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T18:41:44.307274+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=41, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.893 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.893 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.893 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.894 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.896 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.896 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:14:46.897 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:15:06.898 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:15:07.240 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:15:07.252 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-09-12T19:15:07.256 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":1722,"stamp":"2024-09-12T19:15:06.485790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":66372370,"num_objects":839,"num_object_clones":0,"num_object_copies":1678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":839,"num_whiteouts":0,"num_read":289963,"num_read_kb":2550992,"num_write":161318,"num_write_kb":2466794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":727835,"num_omap_keys":1786,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13595,"ondisk_log_size":13595,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1599368,"kb_used_data":156232,"kb_used_omap":12,"kb_used_meta":1442995,"kb_avail":753375352,"statfs":{"total":773094113280,"available":771456360448,"internally_reserved":0,"allocated":159981568,"data_stored":146892046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1477627443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009269"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:51.442575+0000","last_change":"2024-09-12T19:14:51.442575+0000","last_active":"2024-09-12T19:14:51.442575+0000","last_peered":"2024-09-12T19:14:51.442575+0000","last_clean":"2024-09-12T19:14:51.442575+0000","last_became_active":"2024-09-12T18:55:19.125009+0000","last_became_peered":"2024-09-12T18:55:19.125009+0000","last_unstale":"2024-09-12T19:14:51.442575+0000","last_undegraded":"2024-09-12T19:14:51.442575+0000","last_fullsized":"2024-09-12T19:14:51.442575+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:51.442356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:51.442356+0000","last_clean_scrub_stamp":"2024-09-12T19:14:51.442356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:43.740430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'7","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:47.466285+0000","last_change":"2024-09-12T19:14:47.466285+0000","last_active":"2024-09-12T19:14:47.466285+0000","last_peered":"2024-09-12T19:14:47.466285+0000","last_clean":"2024-09-12T19:14:47.466285+0000","last_became_active":"2024-09-12T18:43:32.908691+0000","last_became_peered":"2024-09-12T18:43:32.908691+0000","last_unstale":"2024-09-12T19:14:47.466285+0000","last_undegraded":"2024-09-12T19:14:47.466285+0000","last_fullsized":"2024-09-12T19:14:47.466285+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T19:14:47.466097+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T19:14:47.466097+0000","last_clean_scrub_stamp":"2024-09-12T19:14:47.466097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:13.193101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:57.229218+0000","last_change":"2024-09-12T19:14:57.229218+0000","last_active":"2024-09-12T19:14:57.229218+0000","last_peered":"2024-09-12T19:14:57.229218+0000","last_clean":"2024-09-12T19:14:57.229218+0000","last_became_active":"2024-09-12T18:43:29.866493+0000","last_became_peered":"2024-09-12T18:43:29.866493+0000","last_unstale":"2024-09-12T19:14:57.229218+0000","last_undegraded":"2024-09-12T19:14:57.229218+0000","last_fullsized":"2024-09-12T19:14:57.229218+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:57.229038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:57.229038+0000","last_clean_scrub_stamp":"2024-09-12T19:14:57.229038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:52.079398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'18","reported_seq":107,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:47.412005+0000","last_change":"2024-09-12T19:14:47.412005+0000","last_active":"2024-09-12T19:14:47.412005+0000","last_peered":"2024-09-12T19:14:47.412005+0000","last_clean":"2024-09-12T19:14:47.412005+0000","last_became_active":"2024-09-12T18:41:45.361841+0000","last_became_peered":"2024-09-12T18:41:45.361841+0000","last_unstale":"2024-09-12T19:14:47.412005+0000","last_undegraded":"2024-09-12T19:14:47.412005+0000","last_fullsized":"2024-09-12T19:14:47.412005+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'18","last_scrub_stamp":"2024-09-12T19:14:47.411835+0000","last_deep_scrub":"265'18","last_deep_scrub_stamp":"2024-09-12T19:14:47.411835+0000","last_clean_scrub_stamp":"2024-09-12T19:14:47.411835+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:18.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":66,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.893323+0000","last_change":"2024-09-12T19:14:33.893323+0000","last_active":"2024-09-12T19:14:33.893323+0000","last_peered":"2024-09-12T19:14:33.893323+0000","last_clean":"2024-09-12T19:14:33.893323+0000","last_became_active":"2024-09-12T18:55:19.150059+0000","last_became_peered":"2024-09-12T18:55:19.150059+0000","last_unstale":"2024-09-12T19:14:33.893323+0000","last_undegraded":"2024-09-12T19:14:33.893323+0000","last_fullsized":"2024-09-12T19:14:33.893323+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:33.893119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:33.893119+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.893119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:17.600330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'4","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:53.375403+0000","last_change":"2024-09-12T19:14:53.375403+0000","last_active":"2024-09-12T19:14:53.375403+0000","last_peered":"2024-09-12T19:14:53.375403+0000","last_clean":"2024-09-12T19:14:53.375403+0000","last_became_active":"2024-09-12T18:43:32.904914+0000","last_became_peered":"2024-09-12T18:43:32.904914+0000","last_unstale":"2024-09-12T19:14:53.375403+0000","last_undegraded":"2024-09-12T19:14:53.375403+0000","last_fullsized":"2024-09-12T19:14:53.375403+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:53.375212+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:53.375212+0000","last_clean_scrub_stamp":"2024-09-12T19:14:53.375212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:17.046208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'3","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.240294+0000","last_change":"2024-09-12T19:14:36.240294+0000","last_active":"2024-09-12T19:14:36.240294+0000","last_peered":"2024-09-12T19:14:36.240294+0000","last_clean":"2024-09-12T19:14:36.240294+0000","last_became_active":"2024-09-12T18:43:29.891221+0000","last_became_peered":"2024-09-12T18:43:29.891221+0000","last_unstale":"2024-09-12T19:14:36.240294+0000","last_undegraded":"2024-09-12T19:14:36.240294+0000","last_fullsized":"2024-09-12T19:14:36.240294+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T19:14:36.240122+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T19:14:36.240122+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.240122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:05.077317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'32","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.892397+0000","last_change":"2024-09-12T19:14:25.892397+0000","last_active":"2024-09-12T19:14:25.892397+0000","last_peered":"2024-09-12T19:14:25.892397+0000","last_clean":"2024-09-12T19:14:25.892397+0000","last_became_active":"2024-09-12T18:41:45.361664+0000","last_became_peered":"2024-09-12T18:41:45.361664+0000","last_unstale":"2024-09-12T19:14:25.892397+0000","last_undegraded":"2024-09-12T19:14:25.892397+0000","last_fullsized":"2024-09-12T19:14:25.892397+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T19:14:25.892204+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T19:14:25.892204+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.892204+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:20.883904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.603743+0000","last_change":"2024-09-12T19:14:42.603743+0000","last_active":"2024-09-12T19:14:42.603743+0000","last_peered":"2024-09-12T19:14:42.603743+0000","last_clean":"2024-09-12T19:14:42.603743+0000","last_became_active":"2024-09-12T18:55:19.119601+0000","last_became_peered":"2024-09-12T18:55:19.119601+0000","last_unstale":"2024-09-12T19:14:42.603743+0000","last_undegraded":"2024-09-12T19:14:42.603743+0000","last_fullsized":"2024-09-12T19:14:42.603743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:42.603555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:42.603555+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.603555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:44.001319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'8","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:00.361811+0000","last_change":"2024-09-12T19:15:00.361811+0000","last_active":"2024-09-12T19:15:00.361811+0000","last_peered":"2024-09-12T19:15:00.361811+0000","last_clean":"2024-09-12T19:15:00.361811+0000","last_became_active":"2024-09-12T18:43:32.916727+0000","last_became_peered":"2024-09-12T18:43:32.916727+0000","last_unstale":"2024-09-12T19:15:00.361811+0000","last_undegraded":"2024-09-12T19:15:00.361811+0000","last_fullsized":"2024-09-12T19:15:00.361811+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:15:00.361639+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:15:00.361639+0000","last_clean_scrub_stamp":"2024-09-12T19:15:00.361639+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:28.989648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"265'17","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.867868+0000","last_change":"2024-09-12T19:14:30.867868+0000","last_active":"2024-09-12T19:14:30.867868+0000","last_peered":"2024-09-12T19:14:30.867868+0000","last_clean":"2024-09-12T19:14:30.867868+0000","last_became_active":"2024-09-12T18:43:29.881401+0000","last_became_peered":"2024-09-12T18:43:29.881401+0000","last_unstale":"2024-09-12T19:14:30.867868+0000","last_undegraded":"2024-09-12T19:14:30.867868+0000","last_fullsized":"2024-09-12T19:14:30.867868+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-12T19:14:30.867685+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-12T19:14:30.867685+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.867685+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:04.890149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":40962,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'47","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:46.438523+0000","last_change":"2024-09-12T19:14:46.438523+0000","last_active":"2024-09-12T19:14:46.438523+0000","last_peered":"2024-09-12T19:14:46.438523+0000","last_clean":"2024-09-12T19:14:46.438523+0000","last_became_active":"2024-09-12T18:41:45.350377+0000","last_became_peered":"2024-09-12T18:41:45.350377+0000","last_unstale":"2024-09-12T19:14:46.438523+0000","last_undegraded":"2024-09-12T19:14:46.438523+0000","last_fullsized":"2024-09-12T19:14:46.438523+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'47","last_scrub_stamp":"2024-09-12T19:14:46.438312+0000","last_deep_scrub":"265'47","last_deep_scrub_stamp":"2024-09-12T19:14:46.438312+0000","last_clean_scrub_stamp":"2024-09-12T19:14:46.438312+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:25.071409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":164,"num_write":88,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:01.205454+0000","last_change":"2024-09-12T19:15:01.205454+0000","last_active":"2024-09-12T19:15:01.205454+0000","last_peered":"2024-09-12T19:15:01.205454+0000","last_clean":"2024-09-12T19:15:01.205454+0000","last_became_active":"2024-09-12T18:55:19.135875+0000","last_became_peered":"2024-09-12T18:55:19.135875+0000","last_unstale":"2024-09-12T19:15:01.205454+0000","last_undegraded":"2024-09-12T19:15:01.205454+0000","last_fullsized":"2024-09-12T19:15:01.205454+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:01.205270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:01.205270+0000","last_clean_scrub_stamp":"2024-09-12T19:15:01.205270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:00.445374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:51.238182+0000","last_change":"2024-09-12T19:14:51.238182+0000","last_active":"2024-09-12T19:14:51.238182+0000","last_peered":"2024-09-12T19:14:51.238182+0000","last_clean":"2024-09-12T19:14:51.238182+0000","last_became_active":"2024-09-12T18:43:32.935176+0000","last_became_peered":"2024-09-12T18:43:32.935176+0000","last_unstale":"2024-09-12T19:14:51.238182+0000","last_undegraded":"2024-09-12T19:14:51.238182+0000","last_fullsized":"2024-09-12T19:14:51.238182+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:51.237888+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:51.237888+0000","last_clean_scrub_stamp":"2024-09-12T19:14:51.237888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:32.541363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'7","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:44.417970+0000","last_change":"2024-09-12T19:14:44.417762+0000","last_active":"2024-09-12T19:14:44.417970+0000","last_peered":"2024-09-12T19:14:44.417970+0000","last_clean":"2024-09-12T19:14:44.417970+0000","last_became_active":"2024-09-12T18:43:29.873115+0000","last_became_peered":"2024-09-12T18:43:29.873115+0000","last_unstale":"2024-09-12T19:14:44.417970+0000","last_undegraded":"2024-09-12T19:14:44.417970+0000","last_fullsized":"2024-09-12T19:14:44.417970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:14:44.417568+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:14:44.417568+0000","last_clean_scrub_stamp":"2024-09-12T19:14:44.417568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:50.532550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'47","reported_seq":177,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:50.241511+0000","last_change":"2024-09-12T19:14:50.241511+0000","last_active":"2024-09-12T19:14:50.241511+0000","last_peered":"2024-09-12T19:14:50.241511+0000","last_clean":"2024-09-12T19:14:50.241511+0000","last_became_active":"2024-09-12T18:41:45.350035+0000","last_became_peered":"2024-09-12T18:41:45.350035+0000","last_unstale":"2024-09-12T19:14:50.241511+0000","last_undegraded":"2024-09-12T19:14:50.241511+0000","last_fullsized":"2024-09-12T19:14:50.241511+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'47","last_scrub_stamp":"2024-09-12T19:14:50.241318+0000","last_deep_scrub":"265'47","last_deep_scrub_stamp":"2024-09-12T19:14:50.241318+0000","last_clean_scrub_stamp":"2024-09-12T19:14:50.241318+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:58.198239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":157,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:11:28.712218+0000","last_change":"2024-09-12T18:55:19.157689+0000","last_active":"2024-09-12T19:11:28.712218+0000","last_peered":"2024-09-12T19:11:28.712218+0000","last_clean":"2024-09-12T19:11:28.712218+0000","last_became_active":"2024-09-12T18:55:19.156936+0000","last_became_peered":"2024-09-12T18:55:19.156936+0000","last_unstale":"2024-09-12T19:11:28.712218+0000","last_undegraded":"2024-09-12T19:11:28.712218+0000","last_fullsized":"2024-09-12T19:11:28.712218+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:02.316107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:48.438065+0000","last_change":"2024-09-12T19:14:48.438065+0000","last_active":"2024-09-12T19:14:48.438065+0000","last_peered":"2024-09-12T19:14:48.438065+0000","last_clean":"2024-09-12T19:14:48.438065+0000","last_became_active":"2024-09-12T18:43:32.930772+0000","last_became_peered":"2024-09-12T18:43:32.930772+0000","last_unstale":"2024-09-12T19:14:48.438065+0000","last_undegraded":"2024-09-12T19:14:48.438065+0000","last_fullsized":"2024-09-12T19:14:48.438065+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:14:48.437875+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:14:48.437875+0000","last_clean_scrub_stamp":"2024-09-12T19:14:48.437875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:37.119431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:56.320969+0000","last_change":"2024-09-12T19:14:56.320780+0000","last_active":"2024-09-12T19:14:56.320969+0000","last_peered":"2024-09-12T19:14:56.320969+0000","last_clean":"2024-09-12T19:14:56.320969+0000","last_became_active":"2024-09-12T18:43:29.883399+0000","last_became_peered":"2024-09-12T18:43:29.883399+0000","last_unstale":"2024-09-12T19:14:56.320969+0000","last_undegraded":"2024-09-12T19:14:56.320969+0000","last_fullsized":"2024-09-12T19:14:56.320969+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:56.320610+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:56.320610+0000","last_clean_scrub_stamp":"2024-09-12T19:14:56.320610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:52.233187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'25","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:47.245470+0000","last_change":"2024-09-12T19:14:47.245470+0000","last_active":"2024-09-12T19:14:47.245470+0000","last_peered":"2024-09-12T19:14:47.245470+0000","last_clean":"2024-09-12T19:14:47.245470+0000","last_became_active":"2024-09-12T18:41:45.355180+0000","last_became_peered":"2024-09-12T18:41:45.355180+0000","last_unstale":"2024-09-12T19:14:47.245470+0000","last_undegraded":"2024-09-12T19:14:47.245470+0000","last_fullsized":"2024-09-12T19:14:47.245470+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-12T19:14:47.245284+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-12T19:14:47.245284+0000","last_clean_scrub_stamp":"2024-09-12T19:14:47.245284+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:40.355254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:46.167790+0000","last_change":"2024-09-12T19:14:46.167790+0000","last_active":"2024-09-12T19:14:46.167790+0000","last_peered":"2024-09-12T19:14:46.167790+0000","last_clean":"2024-09-12T19:14:46.167790+0000","last_became_active":"2024-09-12T18:55:19.138472+0000","last_became_peered":"2024-09-12T18:55:19.138472+0000","last_unstale":"2024-09-12T19:14:46.167790+0000","last_undegraded":"2024-09-12T19:14:46.167790+0000","last_fullsized":"2024-09-12T19:14:46.167790+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:46.167613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:46.167613+0000","last_clean_scrub_stamp":"2024-09-12T19:14:46.167613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:29.174849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.593244+0000","last_change":"2024-09-12T19:14:39.593109+0000","last_active":"2024-09-12T19:14:39.593244+0000","last_peered":"2024-09-12T19:14:39.593244+0000","last_clean":"2024-09-12T19:14:39.593244+0000","last_became_active":"2024-09-12T18:43:32.935898+0000","last_became_peered":"2024-09-12T18:43:32.935898+0000","last_unstale":"2024-09-12T19:14:39.593244+0000","last_undegraded":"2024-09-12T19:14:39.593244+0000","last_fullsized":"2024-09-12T19:14:39.593244+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:39.592923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:39.592923+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.592923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:09.296334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:46.396445+0000","last_change":"2024-09-12T19:14:46.396267+0000","last_active":"2024-09-12T19:14:46.396445+0000","last_peered":"2024-09-12T19:14:46.396445+0000","last_clean":"2024-09-12T19:14:46.396445+0000","last_became_active":"2024-09-12T18:43:29.882621+0000","last_became_peered":"2024-09-12T18:43:29.882621+0000","last_unstale":"2024-09-12T19:14:46.396445+0000","last_undegraded":"2024-09-12T19:14:46.396445+0000","last_fullsized":"2024-09-12T19:14:46.396445+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:46.396080+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:46.396080+0000","last_clean_scrub_stamp":"2024-09-12T19:14:46.396080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:59.022865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'16","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.591269+0000","last_change":"2024-09-12T19:14:34.591269+0000","last_active":"2024-09-12T19:14:34.591269+0000","last_peered":"2024-09-12T19:14:34.591269+0000","last_clean":"2024-09-12T19:14:34.591269+0000","last_became_active":"2024-09-12T18:41:45.357957+0000","last_became_peered":"2024-09-12T18:41:45.357957+0000","last_unstale":"2024-09-12T19:14:34.591269+0000","last_undegraded":"2024-09-12T19:14:34.591269+0000","last_fullsized":"2024-09-12T19:14:34.591269+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'16","last_scrub_stamp":"2024-09-12T19:14:34.591083+0000","last_deep_scrub":"265'16","last_deep_scrub_stamp":"2024-09-12T19:14:34.591083+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.591083+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:57.301977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":53,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":21,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:10:22.899753+0000","last_change":"2024-09-12T18:55:19.148993+0000","last_active":"2024-09-12T19:10:22.899753+0000","last_peered":"2024-09-12T19:10:22.899753+0000","last_clean":"2024-09-12T19:10:22.899753+0000","last_became_active":"2024-09-12T18:55:19.147110+0000","last_became_peered":"2024-09-12T18:55:19.147110+0000","last_unstale":"2024-09-12T19:10:22.899753+0000","last_undegraded":"2024-09-12T19:10:22.899753+0000","last_fullsized":"2024-09-12T19:10:22.899753+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:55:18.080142+0000","last_clean_scrub_stamp":"2024-09-12T18:55:18.080142+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:46.858987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.634793+0000","last_change":"2024-09-12T19:14:40.634793+0000","last_active":"2024-09-12T19:14:40.634793+0000","last_peered":"2024-09-12T19:14:40.634793+0000","last_clean":"2024-09-12T19:14:40.634793+0000","last_became_active":"2024-09-12T18:43:32.922514+0000","last_became_peered":"2024-09-12T18:43:32.922514+0000","last_unstale":"2024-09-12T19:14:40.634793+0000","last_undegraded":"2024-09-12T19:14:40.634793+0000","last_fullsized":"2024-09-12T19:14:40.634793+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:40.634623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:40.634623+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.634623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:12.146446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'6","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:47.376445+0000","last_change":"2024-09-12T19:14:47.376445+0000","last_active":"2024-09-12T19:14:47.376445+0000","last_peered":"2024-09-12T19:14:47.376445+0000","last_clean":"2024-09-12T19:14:47.376445+0000","last_became_active":"2024-09-12T18:43:29.904226+0000","last_became_peered":"2024-09-12T18:43:29.904226+0000","last_unstale":"2024-09-12T19:14:47.376445+0000","last_undegraded":"2024-09-12T19:14:47.376445+0000","last_fullsized":"2024-09-12T19:14:47.376445+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:47.376264+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:47.376264+0000","last_clean_scrub_stamp":"2024-09-12T19:14:47.376264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:56.028120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'21","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:44.512829+0000","last_change":"2024-09-12T19:14:44.512829+0000","last_active":"2024-09-12T19:14:44.512829+0000","last_peered":"2024-09-12T19:14:44.512829+0000","last_clean":"2024-09-12T19:14:44.512829+0000","last_became_active":"2024-09-12T18:41:45.351791+0000","last_became_peered":"2024-09-12T18:41:45.351791+0000","last_unstale":"2024-09-12T19:14:44.512829+0000","last_undegraded":"2024-09-12T19:14:44.512829+0000","last_fullsized":"2024-09-12T19:14:44.512829+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'21","last_scrub_stamp":"2024-09-12T19:14:44.512633+0000","last_deep_scrub":"265'21","last_deep_scrub_stamp":"2024-09-12T19:14:44.512633+0000","last_clean_scrub_stamp":"2024-09-12T19:14:44.512633+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:07.728305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":28,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:02.062909+0000","last_change":"2024-09-12T19:15:02.062909+0000","last_active":"2024-09-12T19:15:02.062909+0000","last_peered":"2024-09-12T19:15:02.062909+0000","last_clean":"2024-09-12T19:15:02.062909+0000","last_became_active":"2024-09-12T18:55:19.148859+0000","last_became_peered":"2024-09-12T18:55:19.148859+0000","last_unstale":"2024-09-12T19:15:02.062909+0000","last_undegraded":"2024-09-12T19:15:02.062909+0000","last_fullsized":"2024-09-12T19:15:02.062909+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:02.062689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:02.062689+0000","last_clean_scrub_stamp":"2024-09-12T19:15:02.062689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:26.858709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:53.280948+0000","last_change":"2024-09-12T19:14:53.280948+0000","last_active":"2024-09-12T19:14:53.280948+0000","last_peered":"2024-09-12T19:14:53.280948+0000","last_clean":"2024-09-12T19:14:53.280948+0000","last_became_active":"2024-09-12T18:43:32.935669+0000","last_became_peered":"2024-09-12T18:43:32.935669+0000","last_unstale":"2024-09-12T19:14:53.280948+0000","last_undegraded":"2024-09-12T19:14:53.280948+0000","last_fullsized":"2024-09-12T19:14:53.280948+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:53.280744+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:53.280744+0000","last_clean_scrub_stamp":"2024-09-12T19:14:53.280744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:34.700136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'5","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:52.369578+0000","last_change":"2024-09-12T19:14:52.369578+0000","last_active":"2024-09-12T19:14:52.369578+0000","last_peered":"2024-09-12T19:14:52.369578+0000","last_clean":"2024-09-12T19:14:52.369578+0000","last_became_active":"2024-09-12T18:43:29.883324+0000","last_became_peered":"2024-09-12T18:43:29.883324+0000","last_unstale":"2024-09-12T19:14:52.369578+0000","last_undegraded":"2024-09-12T19:14:52.369578+0000","last_fullsized":"2024-09-12T19:14:52.369578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:14:52.369406+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:14:52.369406+0000","last_clean_scrub_stamp":"2024-09-12T19:14:52.369406+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:45.335346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'60","reported_seq":227,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.204859+0000","last_change":"2024-09-12T19:14:33.204859+0000","last_active":"2024-09-12T19:14:33.204859+0000","last_peered":"2024-09-12T19:14:33.204859+0000","last_clean":"2024-09-12T19:14:33.204859+0000","last_became_active":"2024-09-12T18:41:45.339369+0000","last_became_peered":"2024-09-12T18:41:45.339369+0000","last_unstale":"2024-09-12T19:14:33.204859+0000","last_undegraded":"2024-09-12T19:14:33.204859+0000","last_fullsized":"2024-09-12T19:14:33.204859+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'60","last_scrub_stamp":"2024-09-12T19:14:33.204676+0000","last_deep_scrub":"265'60","last_deep_scrub_stamp":"2024-09-12T19:14:33.204676+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.204676+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:59.124298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":229,"num_write":103,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.254009+0000","last_change":"2024-09-12T19:14:42.254009+0000","last_active":"2024-09-12T19:14:42.254009+0000","last_peered":"2024-09-12T19:14:42.254009+0000","last_clean":"2024-09-12T19:14:42.254009+0000","last_became_active":"2024-09-12T18:55:19.122414+0000","last_became_peered":"2024-09-12T18:55:19.122414+0000","last_unstale":"2024-09-12T19:14:42.254009+0000","last_undegraded":"2024-09-12T19:14:42.254009+0000","last_fullsized":"2024-09-12T19:14:42.254009+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:42.253838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:42.253838+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.253838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:22.298367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:58.197030+0000","last_change":"2024-09-12T19:14:58.196861+0000","last_active":"2024-09-12T19:14:58.197030+0000","last_peered":"2024-09-12T19:14:58.197030+0000","last_clean":"2024-09-12T19:14:58.197030+0000","last_became_active":"2024-09-12T18:43:32.924570+0000","last_became_peered":"2024-09-12T18:43:32.924570+0000","last_unstale":"2024-09-12T19:14:58.197030+0000","last_undegraded":"2024-09-12T19:14:58.197030+0000","last_fullsized":"2024-09-12T19:14:58.197030+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:14:58.196680+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:14:58.196680+0000","last_clean_scrub_stamp":"2024-09-12T19:14:58.196680+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:50.364623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:45.427851+0000","last_change":"2024-09-12T19:14:45.427851+0000","last_active":"2024-09-12T19:14:45.427851+0000","last_peered":"2024-09-12T19:14:45.427851+0000","last_clean":"2024-09-12T19:14:45.427851+0000","last_became_active":"2024-09-12T18:43:29.868738+0000","last_became_peered":"2024-09-12T18:43:29.868738+0000","last_unstale":"2024-09-12T19:14:45.427851+0000","last_undegraded":"2024-09-12T19:14:45.427851+0000","last_fullsized":"2024-09-12T19:14:45.427851+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:45.427658+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:45.427658+0000","last_clean_scrub_stamp":"2024-09-12T19:14:45.427658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:19.934295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'11","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:45.485125+0000","last_change":"2024-09-12T19:14:45.485125+0000","last_active":"2024-09-12T19:14:45.485125+0000","last_peered":"2024-09-12T19:14:45.485125+0000","last_clean":"2024-09-12T19:14:45.485125+0000","last_became_active":"2024-09-12T18:41:45.351553+0000","last_became_peered":"2024-09-12T18:41:45.351553+0000","last_unstale":"2024-09-12T19:14:45.485125+0000","last_undegraded":"2024-09-12T19:14:45.485125+0000","last_fullsized":"2024-09-12T19:14:45.485125+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T19:14:45.484873+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T19:14:45.484873+0000","last_clean_scrub_stamp":"2024-09-12T19:14:45.484873+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:13.929615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":29,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.872990+0000","last_change":"2024-09-12T19:14:32.872990+0000","last_active":"2024-09-12T19:14:32.872990+0000","last_peered":"2024-09-12T19:14:32.872990+0000","last_clean":"2024-09-12T19:14:32.872990+0000","last_became_active":"2024-09-12T18:55:19.138649+0000","last_became_peered":"2024-09-12T18:55:19.138649+0000","last_unstale":"2024-09-12T19:14:32.872990+0000","last_undegraded":"2024-09-12T19:14:32.872990+0000","last_fullsized":"2024-09-12T19:14:32.872990+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:32.872783+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:32.872783+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.872783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:29.362590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:03.170325+0000","last_change":"2024-09-12T19:15:03.170325+0000","last_active":"2024-09-12T19:15:03.170325+0000","last_peered":"2024-09-12T19:15:03.170325+0000","last_clean":"2024-09-12T19:15:03.170325+0000","last_became_active":"2024-09-12T18:43:32.927181+0000","last_became_peered":"2024-09-12T18:43:32.927181+0000","last_unstale":"2024-09-12T19:15:03.170325+0000","last_undegraded":"2024-09-12T19:15:03.170325+0000","last_fullsized":"2024-09-12T19:15:03.170325+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:15:03.170073+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:15:03.170073+0000","last_clean_scrub_stamp":"2024-09-12T19:15:03.170073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:02.221581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'8","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:50.894380+0000","last_change":"2024-09-12T19:14:50.894186+0000","last_active":"2024-09-12T19:14:50.894380+0000","last_peered":"2024-09-12T19:14:50.894380+0000","last_clean":"2024-09-12T19:14:50.894380+0000","last_became_active":"2024-09-12T18:43:29.894650+0000","last_became_peered":"2024-09-12T18:43:29.894650+0000","last_unstale":"2024-09-12T19:14:50.894380+0000","last_undegraded":"2024-09-12T19:14:50.894380+0000","last_fullsized":"2024-09-12T19:14:50.894380+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T19:14:50.893953+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T19:14:50.893953+0000","last_clean_scrub_stamp":"2024-09-12T19:14:50.893953+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:08.487097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8194,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'29","reported_seq":129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:46.197753+0000","last_change":"2024-09-12T19:14:46.197753+0000","last_active":"2024-09-12T19:14:46.197753+0000","last_peered":"2024-09-12T19:14:46.197753+0000","last_clean":"2024-09-12T19:14:46.197753+0000","last_became_active":"2024-09-12T18:41:45.360856+0000","last_became_peered":"2024-09-12T18:41:45.360856+0000","last_unstale":"2024-09-12T19:14:46.197753+0000","last_undegraded":"2024-09-12T19:14:46.197753+0000","last_fullsized":"2024-09-12T19:14:46.197753+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T19:14:46.197580+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T19:14:46.197580+0000","last_clean_scrub_stamp":"2024-09-12T19:14:46.197580+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:57.052501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":92,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:01.047287+0000","last_change":"2024-09-12T19:15:01.047287+0000","last_active":"2024-09-12T19:15:01.047287+0000","last_peered":"2024-09-12T19:15:01.047287+0000","last_clean":"2024-09-12T19:15:01.047287+0000","last_became_active":"2024-09-12T18:55:19.123727+0000","last_became_peered":"2024-09-12T18:55:19.123727+0000","last_unstale":"2024-09-12T19:15:01.047287+0000","last_undegraded":"2024-09-12T19:15:01.047287+0000","last_fullsized":"2024-09-12T19:15:01.047287+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:01.047097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:01.047097+0000","last_clean_scrub_stamp":"2024-09-12T19:15:01.047097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:37.016224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:12:33.728264+0000","last_change":"2024-09-12T18:43:32.935321+0000","last_active":"2024-09-12T19:12:33.728264+0000","last_peered":"2024-09-12T19:12:33.728264+0000","last_clean":"2024-09-12T19:12:33.728264+0000","last_became_active":"2024-09-12T18:43:32.934654+0000","last_became_peered":"2024-09-12T18:43:32.934654+0000","last_unstale":"2024-09-12T19:12:33.728264+0000","last_undegraded":"2024-09-12T19:12:33.728264+0000","last_fullsized":"2024-09-12T19:12:33.728264+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:43:31.858730+0000","last_clean_scrub_stamp":"2024-09-12T18:43:31.858730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'4","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.906547+0000","last_change":"2024-09-12T19:14:27.906345+0000","last_active":"2024-09-12T19:14:27.906547+0000","last_peered":"2024-09-12T19:14:27.906547+0000","last_clean":"2024-09-12T19:14:27.906547+0000","last_became_active":"2024-09-12T18:43:29.863876+0000","last_became_peered":"2024-09-12T18:43:29.863876+0000","last_unstale":"2024-09-12T19:14:27.906547+0000","last_undegraded":"2024-09-12T19:14:27.906547+0000","last_fullsized":"2024-09-12T19:14:27.906547+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:27.906147+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:27.906147+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.906147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:02.539821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'15","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.896889+0000","last_change":"2024-09-12T19:14:24.896889+0000","last_active":"2024-09-12T19:14:24.896889+0000","last_peered":"2024-09-12T19:14:24.896889+0000","last_clean":"2024-09-12T19:14:24.896889+0000","last_became_active":"2024-09-12T18:41:45.346831+0000","last_became_peered":"2024-09-12T18:41:45.346831+0000","last_unstale":"2024-09-12T19:14:24.896889+0000","last_undegraded":"2024-09-12T19:14:24.896889+0000","last_fullsized":"2024-09-12T19:14:24.896889+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'15","last_scrub_stamp":"2024-09-12T19:14:24.896715+0000","last_deep_scrub":"265'15","last_deep_scrub_stamp":"2024-09-12T19:14:24.896715+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.896715+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:43.841424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":48,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:50.442335+0000","last_change":"2024-09-12T19:14:50.442335+0000","last_active":"2024-09-12T19:14:50.442335+0000","last_peered":"2024-09-12T19:14:50.442335+0000","last_clean":"2024-09-12T19:14:50.442335+0000","last_became_active":"2024-09-12T18:55:19.125607+0000","last_became_peered":"2024-09-12T18:55:19.125607+0000","last_unstale":"2024-09-12T19:14:50.442335+0000","last_undegraded":"2024-09-12T19:14:50.442335+0000","last_fullsized":"2024-09-12T19:14:50.442335+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:50.442162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:50.442162+0000","last_clean_scrub_stamp":"2024-09-12T19:14:50.442162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:45.000699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'4","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:51.397040+0000","last_change":"2024-09-12T19:14:51.396901+0000","last_active":"2024-09-12T19:14:51.397040+0000","last_peered":"2024-09-12T19:14:51.397040+0000","last_clean":"2024-09-12T19:14:51.397040+0000","last_became_active":"2024-09-12T18:43:32.908905+0000","last_became_peered":"2024-09-12T18:43:32.908905+0000","last_unstale":"2024-09-12T19:14:51.397040+0000","last_undegraded":"2024-09-12T19:14:51.397040+0000","last_fullsized":"2024-09-12T19:14:51.397040+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:51.396713+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:51.396713+0000","last_clean_scrub_stamp":"2024-09-12T19:14:51.396713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:43.250876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'7","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:51.411138+0000","last_change":"2024-09-12T19:14:51.410961+0000","last_active":"2024-09-12T19:14:51.411138+0000","last_peered":"2024-09-12T19:14:51.411138+0000","last_clean":"2024-09-12T19:14:51.411138+0000","last_became_active":"2024-09-12T18:43:29.880462+0000","last_became_peered":"2024-09-12T18:43:29.880462+0000","last_unstale":"2024-09-12T19:14:51.411138+0000","last_undegraded":"2024-09-12T19:14:51.411138+0000","last_fullsized":"2024-09-12T19:14:51.411138+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:14:51.410782+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:14:51.410782+0000","last_clean_scrub_stamp":"2024-09-12T19:14:51.410782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:15.243999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'6","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.981218+0000","last_change":"2024-09-12T19:14:43.981218+0000","last_active":"2024-09-12T19:14:43.981218+0000","last_peered":"2024-09-12T19:14:43.981218+0000","last_clean":"2024-09-12T19:14:43.981218+0000","last_became_active":"2024-09-12T18:41:45.359794+0000","last_became_peered":"2024-09-12T18:41:45.359794+0000","last_unstale":"2024-09-12T19:14:43.981218+0000","last_undegraded":"2024-09-12T19:14:43.981218+0000","last_fullsized":"2024-09-12T19:14:43.981218+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T19:14:43.981001+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T19:14:43.981001+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.981001+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:04.583940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:00.173191+0000","last_change":"2024-09-12T19:15:00.173191+0000","last_active":"2024-09-12T19:15:00.173191+0000","last_peered":"2024-09-12T19:15:00.173191+0000","last_clean":"2024-09-12T19:15:00.173191+0000","last_became_active":"2024-09-12T18:55:19.152807+0000","last_became_peered":"2024-09-12T18:55:19.152807+0000","last_unstale":"2024-09-12T19:15:00.173191+0000","last_undegraded":"2024-09-12T19:15:00.173191+0000","last_fullsized":"2024-09-12T19:15:00.173191+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:00.173017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:00.173017+0000","last_clean_scrub_stamp":"2024-09-12T19:15:00.173017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:43.442731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.295407+0000","last_change":"2024-09-12T19:14:41.295407+0000","last_active":"2024-09-12T19:14:41.295407+0000","last_peered":"2024-09-12T19:14:41.295407+0000","last_clean":"2024-09-12T19:14:41.295407+0000","last_became_active":"2024-09-12T18:43:32.899988+0000","last_became_peered":"2024-09-12T18:43:32.899988+0000","last_unstale":"2024-09-12T19:14:41.295407+0000","last_undegraded":"2024-09-12T19:14:41.295407+0000","last_fullsized":"2024-09-12T19:14:41.295407+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:41.295235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:41.295235+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.295235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:08.234217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.454508+0000","last_change":"2024-09-12T19:14:43.454508+0000","last_active":"2024-09-12T19:14:43.454508+0000","last_peered":"2024-09-12T19:14:43.454508+0000","last_clean":"2024-09-12T19:14:43.454508+0000","last_became_active":"2024-09-12T18:43:29.880294+0000","last_became_peered":"2024-09-12T18:43:29.880294+0000","last_unstale":"2024-09-12T19:14:43.454508+0000","last_undegraded":"2024-09-12T19:14:43.454508+0000","last_fullsized":"2024-09-12T19:14:43.454508+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:43.454286+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:43.454286+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.454286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:48.347559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'33","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:44.977518+0000","last_change":"2024-09-12T19:14:44.977518+0000","last_active":"2024-09-12T19:14:44.977518+0000","last_peered":"2024-09-12T19:14:44.977518+0000","last_clean":"2024-09-12T19:14:44.977518+0000","last_became_active":"2024-09-12T18:41:45.359405+0000","last_became_peered":"2024-09-12T18:41:45.359405+0000","last_unstale":"2024-09-12T19:14:44.977518+0000","last_undegraded":"2024-09-12T19:14:44.977518+0000","last_fullsized":"2024-09-12T19:14:44.977518+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-12T19:14:44.977303+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-12T19:14:44.977303+0000","last_clean_scrub_stamp":"2024-09-12T19:14:44.977303+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:50.210796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":128,"num_write":57,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:02.357581+0000","last_change":"2024-09-12T19:15:02.357581+0000","last_active":"2024-09-12T19:15:02.357581+0000","last_peered":"2024-09-12T19:15:02.357581+0000","last_clean":"2024-09-12T19:15:02.357581+0000","last_became_active":"2024-09-12T18:55:19.136822+0000","last_became_peered":"2024-09-12T18:55:19.136822+0000","last_unstale":"2024-09-12T19:15:02.357581+0000","last_undegraded":"2024-09-12T19:15:02.357581+0000","last_fullsized":"2024-09-12T19:15:02.357581+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:02.357399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:02.357399+0000","last_clean_scrub_stamp":"2024-09-12T19:15:02.357399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:00.308319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:44.201542+0000","last_change":"2024-09-12T19:14:44.201542+0000","last_active":"2024-09-12T19:14:44.201542+0000","last_peered":"2024-09-12T19:14:44.201542+0000","last_clean":"2024-09-12T19:14:44.201542+0000","last_became_active":"2024-09-12T18:43:32.906911+0000","last_became_peered":"2024-09-12T18:43:32.906911+0000","last_unstale":"2024-09-12T19:14:44.201542+0000","last_undegraded":"2024-09-12T19:14:44.201542+0000","last_fullsized":"2024-09-12T19:14:44.201542+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T19:14:44.201360+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T19:14:44.201360+0000","last_clean_scrub_stamp":"2024-09-12T19:14:44.201360+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:03.633247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"265'6","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:55.226442+0000","last_change":"2024-09-12T19:14:55.226442+0000","last_active":"2024-09-12T19:14:55.226442+0000","last_peered":"2024-09-12T19:14:55.226442+0000","last_clean":"2024-09-12T19:14:55.226442+0000","last_became_active":"2024-09-12T18:43:29.873561+0000","last_became_peered":"2024-09-12T18:43:29.873561+0000","last_unstale":"2024-09-12T19:14:55.226442+0000","last_undegraded":"2024-09-12T19:14:55.226442+0000","last_fullsized":"2024-09-12T19:14:55.226442+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:55.226261+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:55.226261+0000","last_clean_scrub_stamp":"2024-09-12T19:14:55.226261+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:48.936403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'40","reported_seq":165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.515779+0000","last_change":"2024-09-12T19:14:42.515779+0000","last_active":"2024-09-12T19:14:42.515779+0000","last_peered":"2024-09-12T19:14:42.515779+0000","last_clean":"2024-09-12T19:14:42.515779+0000","last_became_active":"2024-09-12T18:41:45.352482+0000","last_became_peered":"2024-09-12T18:41:45.352482+0000","last_unstale":"2024-09-12T19:14:42.515779+0000","last_undegraded":"2024-09-12T19:14:42.515779+0000","last_fullsized":"2024-09-12T19:14:42.515779+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'40","last_scrub_stamp":"2024-09-12T19:14:42.515590+0000","last_deep_scrub":"265'40","last_deep_scrub_stamp":"2024-09-12T19:14:42.515590+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.515590+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:20.756086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:59.340917+0000","last_change":"2024-09-12T19:14:59.340917+0000","last_active":"2024-09-12T19:14:59.340917+0000","last_peered":"2024-09-12T19:14:59.340917+0000","last_clean":"2024-09-12T19:14:59.340917+0000","last_became_active":"2024-09-12T18:55:19.132991+0000","last_became_peered":"2024-09-12T18:55:19.132991+0000","last_unstale":"2024-09-12T19:14:59.340917+0000","last_undegraded":"2024-09-12T19:14:59.340917+0000","last_fullsized":"2024-09-12T19:14:59.340917+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:59.340713+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:59.340713+0000","last_clean_scrub_stamp":"2024-09-12T19:14:59.340713+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:26.953686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'8","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:49.252082+0000","last_change":"2024-09-12T19:14:49.252082+0000","last_active":"2024-09-12T19:14:49.252082+0000","last_peered":"2024-09-12T19:14:49.252082+0000","last_clean":"2024-09-12T19:14:49.252082+0000","last_became_active":"2024-09-12T18:43:32.927109+0000","last_became_peered":"2024-09-12T18:43:32.927109+0000","last_unstale":"2024-09-12T19:14:49.252082+0000","last_undegraded":"2024-09-12T19:14:49.252082+0000","last_fullsized":"2024-09-12T19:14:49.252082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:14:49.251906+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:14:49.251906+0000","last_clean_scrub_stamp":"2024-09-12T19:14:49.251906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:53.966223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":28674,"num_write":8,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.565997+0000","last_change":"2024-09-12T19:14:36.565997+0000","last_active":"2024-09-12T19:14:36.565997+0000","last_peered":"2024-09-12T19:14:36.565997+0000","last_clean":"2024-09-12T19:14:36.565997+0000","last_became_active":"2024-09-12T18:43:29.880517+0000","last_became_peered":"2024-09-12T18:43:29.880517+0000","last_unstale":"2024-09-12T19:14:36.565997+0000","last_undegraded":"2024-09-12T19:14:36.565997+0000","last_fullsized":"2024-09-12T19:14:36.565997+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:36.565822+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:36.565822+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.565822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:02.635626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.421270+0000","last_change":"2024-09-12T19:14:41.421270+0000","last_active":"2024-09-12T19:14:41.421270+0000","last_peered":"2024-09-12T19:14:41.421270+0000","last_clean":"2024-09-12T19:14:41.421270+0000","last_became_active":"2024-09-12T18:41:45.350632+0000","last_became_peered":"2024-09-12T18:41:45.350632+0000","last_unstale":"2024-09-12T19:14:41.421270+0000","last_undegraded":"2024-09-12T19:14:41.421270+0000","last_fullsized":"2024-09-12T19:14:41.421270+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-12T19:14:41.421072+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-12T19:14:41.421072+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.421072+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:50.795483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:52.259441+0000","last_change":"2024-09-12T19:14:52.259441+0000","last_active":"2024-09-12T19:14:52.259441+0000","last_peered":"2024-09-12T19:14:52.259441+0000","last_clean":"2024-09-12T19:14:52.259441+0000","last_became_active":"2024-09-12T18:55:19.150880+0000","last_became_peered":"2024-09-12T18:55:19.150880+0000","last_unstale":"2024-09-12T19:14:52.259441+0000","last_undegraded":"2024-09-12T19:14:52.259441+0000","last_fullsized":"2024-09-12T19:14:52.259441+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:52.259264+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:52.259264+0000","last_clean_scrub_stamp":"2024-09-12T19:14:52.259264+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.191374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'16","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.602068+0000","last_change":"2024-09-12T19:14:37.602068+0000","last_active":"2024-09-12T19:14:37.602068+0000","last_peered":"2024-09-12T19:14:37.602068+0000","last_clean":"2024-09-12T19:14:37.602068+0000","last_became_active":"2024-09-12T18:43:32.927270+0000","last_became_peered":"2024-09-12T18:43:32.927270+0000","last_unstale":"2024-09-12T19:14:37.602068+0000","last_undegraded":"2024-09-12T19:14:37.602068+0000","last_fullsized":"2024-09-12T19:14:37.602068+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'16","last_scrub_stamp":"2024-09-12T19:14:37.601821+0000","last_deep_scrub":"265'16","last_deep_scrub_stamp":"2024-09-12T19:14:37.601821+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.601821+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:43.617916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":38914,"num_write":26,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:44.385330+0000","last_change":"2024-09-12T19:14:44.385330+0000","last_active":"2024-09-12T19:14:44.385330+0000","last_peered":"2024-09-12T19:14:44.385330+0000","last_clean":"2024-09-12T19:14:44.385330+0000","last_became_active":"2024-09-12T18:43:29.901627+0000","last_became_peered":"2024-09-12T18:43:29.901627+0000","last_unstale":"2024-09-12T19:14:44.385330+0000","last_undegraded":"2024-09-12T19:14:44.385330+0000","last_fullsized":"2024-09-12T19:14:44.385330+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:44.385148+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:44.385148+0000","last_clean_scrub_stamp":"2024-09-12T19:14:44.385148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:45.484496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'30","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:56.205937+0000","last_change":"2024-09-12T19:14:56.205937+0000","last_active":"2024-09-12T19:14:56.205937+0000","last_peered":"2024-09-12T19:14:56.205937+0000","last_clean":"2024-09-12T19:14:56.205937+0000","last_became_active":"2024-09-12T18:41:45.350670+0000","last_became_peered":"2024-09-12T18:41:45.350670+0000","last_unstale":"2024-09-12T19:14:56.205937+0000","last_undegraded":"2024-09-12T19:14:56.205937+0000","last_fullsized":"2024-09-12T19:14:56.205937+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:14:56.205727+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:14:56.205727+0000","last_clean_scrub_stamp":"2024-09-12T19:14:56.205727+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:01.557266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.831222+0000","last_change":"2024-09-12T19:14:31.831089+0000","last_active":"2024-09-12T19:14:31.831222+0000","last_peered":"2024-09-12T19:14:31.831222+0000","last_clean":"2024-09-12T19:14:31.831222+0000","last_became_active":"2024-09-12T18:55:19.137332+0000","last_became_peered":"2024-09-12T18:55:19.137332+0000","last_unstale":"2024-09-12T19:14:31.831222+0000","last_undegraded":"2024-09-12T19:14:31.831222+0000","last_fullsized":"2024-09-12T19:14:31.831222+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:31.830906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:31.830906+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.830906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:09.304238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:54.414527+0000","last_change":"2024-09-12T19:14:54.414527+0000","last_active":"2024-09-12T19:14:54.414527+0000","last_peered":"2024-09-12T19:14:54.414527+0000","last_clean":"2024-09-12T19:14:54.414527+0000","last_became_active":"2024-09-12T18:44:13.007582+0000","last_became_peered":"2024-09-12T18:44:13.007582+0000","last_unstale":"2024-09-12T19:14:54.414527+0000","last_undegraded":"2024-09-12T19:14:54.414527+0000","last_fullsized":"2024-09-12T19:14:54.414527+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:54.414355+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:54.414355+0000","last_clean_scrub_stamp":"2024-09-12T19:14:54.414355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:11.656022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.c","version":"262'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:49.943237+0000","last_change":"2024-09-12T19:14:49.942961+0000","last_active":"2024-09-12T19:14:49.943237+0000","last_peered":"2024-09-12T19:14:49.943237+0000","last_clean":"2024-09-12T19:14:49.943237+0000","last_became_active":"2024-09-12T18:43:29.888041+0000","last_became_peered":"2024-09-12T18:43:29.888041+0000","last_unstale":"2024-09-12T19:14:49.943237+0000","last_undegraded":"2024-09-12T19:14:49.943237+0000","last_fullsized":"2024-09-12T19:14:49.943237+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:14:49.942706+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:14:49.942706+0000","last_clean_scrub_stamp":"2024-09-12T19:14:49.942706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:32.766473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'30","reported_seq":135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:59.169595+0000","last_change":"2024-09-12T19:14:59.169595+0000","last_active":"2024-09-12T19:14:59.169595+0000","last_peered":"2024-09-12T19:14:59.169595+0000","last_clean":"2024-09-12T19:14:59.169595+0000","last_became_active":"2024-09-12T18:41:45.354063+0000","last_became_peered":"2024-09-12T18:41:45.354063+0000","last_unstale":"2024-09-12T19:14:59.169595+0000","last_undegraded":"2024-09-12T19:14:59.169595+0000","last_fullsized":"2024-09-12T19:14:59.169595+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:14:59.169422+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:14:59.169422+0000","last_clean_scrub_stamp":"2024-09-12T19:14:59.169422+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:32.508734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:57.969238+0000","last_change":"2024-09-12T19:14:57.969238+0000","last_active":"2024-09-12T19:14:57.969238+0000","last_peered":"2024-09-12T19:14:57.969238+0000","last_clean":"2024-09-12T19:14:57.969238+0000","last_became_active":"2024-09-12T18:55:19.140331+0000","last_became_peered":"2024-09-12T18:55:19.140331+0000","last_unstale":"2024-09-12T19:14:57.969238+0000","last_undegraded":"2024-09-12T19:14:57.969238+0000","last_fullsized":"2024-09-12T19:14:57.969238+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:57.968950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:57.968950+0000","last_clean_scrub_stamp":"2024-09-12T19:14:57.968950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:49.663127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:02.195460+0000","last_change":"2024-09-12T19:15:02.195303+0000","last_active":"2024-09-12T19:15:02.195460+0000","last_peered":"2024-09-12T19:15:02.195460+0000","last_clean":"2024-09-12T19:15:02.195460+0000","last_became_active":"2024-09-12T18:43:32.934598+0000","last_became_peered":"2024-09-12T18:43:32.934598+0000","last_unstale":"2024-09-12T19:15:02.195460+0000","last_undegraded":"2024-09-12T19:15:02.195460+0000","last_fullsized":"2024-09-12T19:15:02.195460+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:15:02.195128+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:15:02.195128+0000","last_clean_scrub_stamp":"2024-09-12T19:15:02.195128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:10.834790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.869444+0000","last_change":"2024-09-12T19:14:28.869286+0000","last_active":"2024-09-12T19:14:28.869444+0000","last_peered":"2024-09-12T19:14:28.869444+0000","last_clean":"2024-09-12T19:14:28.869444+0000","last_became_active":"2024-09-12T18:43:29.887500+0000","last_became_peered":"2024-09-12T18:43:29.887500+0000","last_unstale":"2024-09-12T19:14:28.869444+0000","last_undegraded":"2024-09-12T19:14:28.869444+0000","last_fullsized":"2024-09-12T19:14:28.869444+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:28.869104+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:28.869104+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.869104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:56.378736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'32","reported_seq":147,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.418810+0000","last_change":"2024-09-12T19:14:42.418810+0000","last_active":"2024-09-12T19:14:42.418810+0000","last_peered":"2024-09-12T19:14:42.418810+0000","last_clean":"2024-09-12T19:14:42.418810+0000","last_became_active":"2024-09-12T18:41:45.358914+0000","last_became_peered":"2024-09-12T18:41:45.358914+0000","last_unstale":"2024-09-12T19:14:42.418810+0000","last_undegraded":"2024-09-12T19:14:42.418810+0000","last_fullsized":"2024-09-12T19:14:42.418810+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T19:14:42.418633+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T19:14:42.418633+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.418633+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:42:43.329544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":122,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.621787+0000","last_change":"2024-09-12T19:14:41.621631+0000","last_active":"2024-09-12T19:14:41.621787+0000","last_peered":"2024-09-12T19:14:41.621787+0000","last_clean":"2024-09-12T19:14:41.621787+0000","last_became_active":"2024-09-12T18:55:19.128236+0000","last_became_peered":"2024-09-12T18:55:19.128236+0000","last_unstale":"2024-09-12T19:14:41.621787+0000","last_undegraded":"2024-09-12T19:14:41.621787+0000","last_fullsized":"2024-09-12T19:14:41.621787+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:41.621448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:41.621448+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.621448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:46.166631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"265'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:45.160990+0000","last_change":"2024-09-12T19:14:45.160990+0000","last_active":"2024-09-12T19:14:45.160990+0000","last_peered":"2024-09-12T19:14:45.160990+0000","last_clean":"2024-09-12T19:14:45.160990+0000","last_became_active":"2024-09-12T18:43:32.899943+0000","last_became_peered":"2024-09-12T18:43:32.899943+0000","last_unstale":"2024-09-12T19:14:45.160990+0000","last_undegraded":"2024-09-12T19:14:45.160990+0000","last_fullsized":"2024-09-12T19:14:45.160990+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:45.160754+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:45.160754+0000","last_clean_scrub_stamp":"2024-09-12T19:14:45.160754+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:04.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3444,"num_write":4,"num_write_kb":1722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'4","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:50.389947+0000","last_change":"2024-09-12T19:14:50.389742+0000","last_active":"2024-09-12T19:14:50.389947+0000","last_peered":"2024-09-12T19:14:50.389947+0000","last_clean":"2024-09-12T19:14:50.389947+0000","last_became_active":"2024-09-12T18:43:29.877755+0000","last_became_peered":"2024-09-12T18:43:29.877755+0000","last_unstale":"2024-09-12T19:14:50.389947+0000","last_undegraded":"2024-09-12T19:14:50.389947+0000","last_fullsized":"2024-09-12T19:14:50.389947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:50.389565+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:50.389565+0000","last_clean_scrub_stamp":"2024-09-12T19:14:50.389565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:21.451717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4136,"num_write":4,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'17","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.551734+0000","last_change":"2024-09-12T19:14:33.551734+0000","last_active":"2024-09-12T19:14:33.551734+0000","last_peered":"2024-09-12T19:14:33.551734+0000","last_clean":"2024-09-12T19:14:33.551734+0000","last_became_active":"2024-09-12T18:41:45.357562+0000","last_became_peered":"2024-09-12T18:41:45.357562+0000","last_unstale":"2024-09-12T19:14:33.551734+0000","last_undegraded":"2024-09-12T19:14:33.551734+0000","last_fullsized":"2024-09-12T19:14:33.551734+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'17","last_scrub_stamp":"2024-09-12T19:14:33.551517+0000","last_deep_scrub":"262'17","last_deep_scrub_stamp":"2024-09-12T19:14:33.551517+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.551517+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:16.826743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:56.952221+0000","last_change":"2024-09-12T19:14:56.952221+0000","last_active":"2024-09-12T19:14:56.952221+0000","last_peered":"2024-09-12T19:14:56.952221+0000","last_clean":"2024-09-12T19:14:56.952221+0000","last_became_active":"2024-09-12T18:55:19.136882+0000","last_became_peered":"2024-09-12T18:55:19.136882+0000","last_unstale":"2024-09-12T19:14:56.952221+0000","last_undegraded":"2024-09-12T19:14:56.952221+0000","last_fullsized":"2024-09-12T19:14:56.952221+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:56.952033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:56.952033+0000","last_clean_scrub_stamp":"2024-09-12T19:14:56.952033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:46.289676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'4","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:48.258613+0000","last_change":"2024-09-12T19:14:48.258453+0000","last_active":"2024-09-12T19:14:48.258613+0000","last_peered":"2024-09-12T19:14:48.258613+0000","last_clean":"2024-09-12T19:14:48.258613+0000","last_became_active":"2024-09-12T18:43:32.927372+0000","last_became_peered":"2024-09-12T18:43:32.927372+0000","last_unstale":"2024-09-12T19:14:48.258613+0000","last_undegraded":"2024-09-12T19:14:48.258613+0000","last_fullsized":"2024-09-12T19:14:48.258613+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T19:14:48.258241+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T19:14:48.258241+0000","last_clean_scrub_stamp":"2024-09-12T19:14:48.258241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:18.284608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.279454+0000","last_change":"2024-09-12T19:14:39.279454+0000","last_active":"2024-09-12T19:14:39.279454+0000","last_peered":"2024-09-12T19:14:39.279454+0000","last_clean":"2024-09-12T19:14:39.279454+0000","last_became_active":"2024-09-12T18:43:29.888265+0000","last_became_peered":"2024-09-12T18:43:29.888265+0000","last_unstale":"2024-09-12T19:14:39.279454+0000","last_undegraded":"2024-09-12T19:14:39.279454+0000","last_fullsized":"2024-09-12T19:14:39.279454+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T19:14:39.279259+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T19:14:39.279259+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.279259+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:16.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'32","reported_seq":145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.875670+0000","last_change":"2024-09-12T19:14:23.875670+0000","last_active":"2024-09-12T19:14:23.875670+0000","last_peered":"2024-09-12T19:14:23.875670+0000","last_clean":"2024-09-12T19:14:23.875670+0000","last_became_active":"2024-09-12T18:41:45.335675+0000","last_became_peered":"2024-09-12T18:41:45.335675+0000","last_unstale":"2024-09-12T19:14:23.875670+0000","last_undegraded":"2024-09-12T19:14:23.875670+0000","last_fullsized":"2024-09-12T19:14:23.875670+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T19:14:23.875487+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T19:14:23.875487+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.875487+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:42.681180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":63,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:54.235651+0000","last_change":"2024-09-12T19:14:54.235651+0000","last_active":"2024-09-12T19:14:54.235651+0000","last_peered":"2024-09-12T19:14:54.235651+0000","last_clean":"2024-09-12T19:14:54.235651+0000","last_became_active":"2024-09-12T18:55:19.149794+0000","last_became_peered":"2024-09-12T18:55:19.149794+0000","last_unstale":"2024-09-12T19:14:54.235651+0000","last_undegraded":"2024-09-12T19:14:54.235651+0000","last_fullsized":"2024-09-12T19:14:54.235651+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:54.235440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:54.235440+0000","last_clean_scrub_stamp":"2024-09-12T19:14:54.235440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:42.719639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:49.405597+0000","last_change":"2024-09-12T19:14:49.405597+0000","last_active":"2024-09-12T19:14:49.405597+0000","last_peered":"2024-09-12T19:14:49.405597+0000","last_clean":"2024-09-12T19:14:49.405597+0000","last_became_active":"2024-09-12T18:43:32.908692+0000","last_became_peered":"2024-09-12T18:43:32.908692+0000","last_unstale":"2024-09-12T19:14:49.405597+0000","last_undegraded":"2024-09-12T19:14:49.405597+0000","last_fullsized":"2024-09-12T19:14:49.405597+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:14:49.405406+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:14:49.405406+0000","last_clean_scrub_stamp":"2024-09-12T19:14:49.405406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:44.477787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'6","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:49.429955+0000","last_change":"2024-09-12T19:14:49.429955+0000","last_active":"2024-09-12T19:14:49.429955+0000","last_peered":"2024-09-12T19:14:49.429955+0000","last_clean":"2024-09-12T19:14:49.429955+0000","last_became_active":"2024-09-12T18:43:29.882915+0000","last_became_peered":"2024-09-12T18:43:29.882915+0000","last_unstale":"2024-09-12T19:14:49.429955+0000","last_undegraded":"2024-09-12T19:14:49.429955+0000","last_fullsized":"2024-09-12T19:14:49.429955+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:49.429685+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:49.429685+0000","last_clean_scrub_stamp":"2024-09-12T19:14:49.429685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:34.757943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'74","reported_seq":253,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.481566+0000","last_change":"2024-09-12T19:14:43.481566+0000","last_active":"2024-09-12T19:14:43.481566+0000","last_peered":"2024-09-12T19:14:43.481566+0000","last_clean":"2024-09-12T19:14:43.481566+0000","last_became_active":"2024-09-12T18:41:45.351387+0000","last_became_peered":"2024-09-12T18:41:45.351387+0000","last_unstale":"2024-09-12T19:14:43.481566+0000","last_undegraded":"2024-09-12T19:14:43.481566+0000","last_fullsized":"2024-09-12T19:14:43.481566+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T19:14:43.481388+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T19:14:43.481388+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.481388+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:58.275602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":261,"num_write":135,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:00.028159+0000","last_change":"2024-09-12T19:15:00.028159+0000","last_active":"2024-09-12T19:15:00.028159+0000","last_peered":"2024-09-12T19:15:00.028159+0000","last_clean":"2024-09-12T19:15:00.028159+0000","last_became_active":"2024-09-12T18:55:19.149666+0000","last_became_peered":"2024-09-12T18:55:19.149666+0000","last_unstale":"2024-09-12T19:15:00.028159+0000","last_undegraded":"2024-09-12T19:15:00.028159+0000","last_fullsized":"2024-09-12T19:15:00.028159+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:00.027947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:00.027947+0000","last_clean_scrub_stamp":"2024-09-12T19:15:00.027947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:57.471575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'7","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:52.889488+0000","last_change":"2024-09-12T19:14:52.889488+0000","last_active":"2024-09-12T19:14:52.889488+0000","last_peered":"2024-09-12T19:14:52.889488+0000","last_clean":"2024-09-12T19:14:52.889488+0000","last_became_active":"2024-09-12T18:43:32.903112+0000","last_became_peered":"2024-09-12T18:43:32.903112+0000","last_unstale":"2024-09-12T19:14:52.889488+0000","last_undegraded":"2024-09-12T19:14:52.889488+0000","last_fullsized":"2024-09-12T19:14:52.889488+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:14:52.889210+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:14:52.889210+0000","last_clean_scrub_stamp":"2024-09-12T19:14:52.889210+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:50.413388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.316037+0000","last_change":"2024-09-12T19:14:40.316037+0000","last_active":"2024-09-12T19:14:40.316037+0000","last_peered":"2024-09-12T19:14:40.316037+0000","last_clean":"2024-09-12T19:14:40.316037+0000","last_became_active":"2024-09-12T18:43:29.887725+0000","last_became_peered":"2024-09-12T18:43:29.887725+0000","last_unstale":"2024-09-12T19:14:40.316037+0000","last_undegraded":"2024-09-12T19:14:40.316037+0000","last_fullsized":"2024-09-12T19:14:40.316037+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:14:40.315848+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:14:40.315848+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.315848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:20.157102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'2","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.940200+0000","last_change":"2024-09-12T19:14:42.940200+0000","last_active":"2024-09-12T19:14:42.940200+0000","last_peered":"2024-09-12T19:14:42.940200+0000","last_clean":"2024-09-12T19:14:42.940200+0000","last_became_active":"2024-09-12T18:41:45.353582+0000","last_became_peered":"2024-09-12T18:41:45.353582+0000","last_unstale":"2024-09-12T19:14:42.940200+0000","last_undegraded":"2024-09-12T19:14:42.940200+0000","last_fullsized":"2024-09-12T19:14:42.940200+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:42.940004+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:42.940004+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.940004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:22.109399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:59.014168+0000","last_change":"2024-09-12T19:14:59.014168+0000","last_active":"2024-09-12T19:14:59.014168+0000","last_peered":"2024-09-12T19:14:59.014168+0000","last_clean":"2024-09-12T19:14:59.014168+0000","last_became_active":"2024-09-12T18:55:19.146310+0000","last_became_peered":"2024-09-12T18:55:19.146310+0000","last_unstale":"2024-09-12T19:14:59.014168+0000","last_undegraded":"2024-09-12T19:14:59.014168+0000","last_fullsized":"2024-09-12T19:14:59.014168+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:59.013977+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:59.013977+0000","last_clean_scrub_stamp":"2024-09-12T19:14:59.013977+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:58.690382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.279653+0000","last_change":"2024-09-12T19:14:38.279523+0000","last_active":"2024-09-12T19:14:38.279653+0000","last_peered":"2024-09-12T19:14:38.279653+0000","last_clean":"2024-09-12T19:14:38.279653+0000","last_became_active":"2024-09-12T18:43:32.922056+0000","last_became_peered":"2024-09-12T18:43:32.922056+0000","last_unstale":"2024-09-12T19:14:38.279653+0000","last_undegraded":"2024-09-12T19:14:38.279653+0000","last_fullsized":"2024-09-12T19:14:38.279653+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:38.279343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:38.279343+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.279343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:07.605920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'4","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:48.399439+0000","last_change":"2024-09-12T19:14:48.399439+0000","last_active":"2024-09-12T19:14:48.399439+0000","last_peered":"2024-09-12T19:14:48.399439+0000","last_clean":"2024-09-12T19:14:48.399439+0000","last_became_active":"2024-09-12T18:43:29.885595+0000","last_became_peered":"2024-09-12T18:43:29.885595+0000","last_unstale":"2024-09-12T19:14:48.399439+0000","last_undegraded":"2024-09-12T19:14:48.399439+0000","last_fullsized":"2024-09-12T19:14:48.399439+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:48.399260+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:48.399260+0000","last_clean_scrub_stamp":"2024-09-12T19:14:48.399260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:35.537456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5492,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'29","reported_seq":131,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.093979+0000","last_change":"2024-09-12T19:14:38.093979+0000","last_active":"2024-09-12T19:14:38.093979+0000","last_peered":"2024-09-12T19:14:38.093979+0000","last_clean":"2024-09-12T19:14:38.093979+0000","last_became_active":"2024-09-12T18:41:45.335258+0000","last_became_peered":"2024-09-12T18:41:45.335258+0000","last_unstale":"2024-09-12T19:14:38.093979+0000","last_undegraded":"2024-09-12T19:14:38.093979+0000","last_fullsized":"2024-09-12T19:14:38.093979+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T19:14:38.093802+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T19:14:38.093802+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.093802+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:43.894454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":60,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:58.333276+0000","last_change":"2024-09-12T19:14:58.333276+0000","last_active":"2024-09-12T19:14:58.333276+0000","last_peered":"2024-09-12T19:14:58.333276+0000","last_clean":"2024-09-12T19:14:58.333276+0000","last_became_active":"2024-09-12T18:55:19.140247+0000","last_became_peered":"2024-09-12T18:55:19.140247+0000","last_unstale":"2024-09-12T19:14:58.333276+0000","last_undegraded":"2024-09-12T19:14:58.333276+0000","last_fullsized":"2024-09-12T19:14:58.333276+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:58.333011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:58.333011+0000","last_clean_scrub_stamp":"2024-09-12T19:14:58.333011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:02.170077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'9","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:53.936868+0000","last_change":"2024-09-12T19:14:53.936868+0000","last_active":"2024-09-12T19:14:53.936868+0000","last_peered":"2024-09-12T19:14:53.936868+0000","last_clean":"2024-09-12T19:14:53.936868+0000","last_became_active":"2024-09-12T18:43:32.918077+0000","last_became_peered":"2024-09-12T18:43:32.918077+0000","last_unstale":"2024-09-12T19:14:53.936868+0000","last_undegraded":"2024-09-12T19:14:53.936868+0000","last_fullsized":"2024-09-12T19:14:53.936868+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T19:14:53.936669+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T19:14:53.936669+0000","last_clean_scrub_stamp":"2024-09-12T19:14:53.936669+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:35.464475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.470598+0000","last_change":"2024-09-12T19:14:42.470472+0000","last_active":"2024-09-12T19:14:42.470598+0000","last_peered":"2024-09-12T19:14:42.470598+0000","last_clean":"2024-09-12T19:14:42.470598+0000","last_became_active":"2024-09-12T18:43:29.902444+0000","last_became_peered":"2024-09-12T18:43:29.902444+0000","last_unstale":"2024-09-12T19:14:42.470598+0000","last_undegraded":"2024-09-12T19:14:42.470598+0000","last_fullsized":"2024-09-12T19:14:42.470598+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:42.470264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:42.470264+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.470264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:34.096293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'31","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.555760+0000","last_change":"2024-09-12T19:14:32.555760+0000","last_active":"2024-09-12T19:14:32.555760+0000","last_peered":"2024-09-12T19:14:32.555760+0000","last_clean":"2024-09-12T19:14:32.555760+0000","last_became_active":"2024-09-12T18:41:45.350344+0000","last_became_peered":"2024-09-12T18:41:45.350344+0000","last_unstale":"2024-09-12T19:14:32.555760+0000","last_undegraded":"2024-09-12T19:14:32.555760+0000","last_fullsized":"2024-09-12T19:14:32.555760+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:14:32.555579+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:14:32.555579+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.555579+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:51.762007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":107,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:54.949796+0000","last_change":"2024-09-12T19:14:54.949796+0000","last_active":"2024-09-12T19:14:54.949796+0000","last_peered":"2024-09-12T19:14:54.949796+0000","last_clean":"2024-09-12T19:14:54.949796+0000","last_became_active":"2024-09-12T18:55:19.144778+0000","last_became_peered":"2024-09-12T18:55:19.144778+0000","last_unstale":"2024-09-12T19:14:54.949796+0000","last_undegraded":"2024-09-12T19:14:54.949796+0000","last_fullsized":"2024-09-12T19:14:54.949796+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:54.949609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:54.949609+0000","last_clean_scrub_stamp":"2024-09-12T19:14:54.949609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:35.053301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:55.366913+0000","last_change":"2024-09-12T19:14:55.366764+0000","last_active":"2024-09-12T19:14:55.366913+0000","last_peered":"2024-09-12T19:14:55.366913+0000","last_clean":"2024-09-12T19:14:55.366913+0000","last_became_active":"2024-09-12T18:43:32.901790+0000","last_became_peered":"2024-09-12T18:43:32.901790+0000","last_unstale":"2024-09-12T19:14:55.366913+0000","last_undegraded":"2024-09-12T19:14:55.366913+0000","last_fullsized":"2024-09-12T19:14:55.366913+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:14:55.366576+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:14:55.366576+0000","last_clean_scrub_stamp":"2024-09-12T19:14:55.366576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:45.292808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'3","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:47.958293+0000","last_change":"2024-09-12T19:14:47.958132+0000","last_active":"2024-09-12T19:14:47.958293+0000","last_peered":"2024-09-12T19:14:47.958293+0000","last_clean":"2024-09-12T19:14:47.958293+0000","last_became_active":"2024-09-12T18:43:29.889097+0000","last_became_peered":"2024-09-12T18:43:29.889097+0000","last_unstale":"2024-09-12T19:14:47.958293+0000","last_undegraded":"2024-09-12T19:14:47.958293+0000","last_fullsized":"2024-09-12T19:14:47.958293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T19:14:47.957946+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T19:14:47.957946+0000","last_clean_scrub_stamp":"2024-09-12T19:14:47.957946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:50.918309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.555852+0000","last_change":"2024-09-12T19:14:41.555852+0000","last_active":"2024-09-12T19:14:41.555852+0000","last_peered":"2024-09-12T19:14:41.555852+0000","last_clean":"2024-09-12T19:14:41.555852+0000","last_became_active":"2024-09-12T18:41:45.364055+0000","last_became_peered":"2024-09-12T18:41:45.364055+0000","last_unstale":"2024-09-12T19:14:41.555852+0000","last_undegraded":"2024-09-12T19:14:41.555852+0000","last_fullsized":"2024-09-12T19:14:41.555852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:14:41.555635+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:14:41.555635+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.555635+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:37.201797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:49.483369+0000","last_change":"2024-09-12T19:14:49.483369+0000","last_active":"2024-09-12T19:14:49.483369+0000","last_peered":"2024-09-12T19:14:49.483369+0000","last_clean":"2024-09-12T19:14:49.483369+0000","last_became_active":"2024-09-12T18:55:19.121805+0000","last_became_peered":"2024-09-12T18:55:19.121805+0000","last_unstale":"2024-09-12T19:14:49.483369+0000","last_undegraded":"2024-09-12T19:14:49.483369+0000","last_fullsized":"2024-09-12T19:14:49.483369+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:49.483182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:49.483182+0000","last_clean_scrub_stamp":"2024-09-12T19:14:49.483182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:53.086069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'11","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:53.410541+0000","last_change":"2024-09-12T19:14:53.410541+0000","last_active":"2024-09-12T19:14:53.410541+0000","last_peered":"2024-09-12T19:14:53.410541+0000","last_clean":"2024-09-12T19:14:53.410541+0000","last_became_active":"2024-09-12T18:43:32.898379+0000","last_became_peered":"2024-09-12T18:43:32.898379+0000","last_unstale":"2024-09-12T19:14:53.410541+0000","last_undegraded":"2024-09-12T19:14:53.410541+0000","last_fullsized":"2024-09-12T19:14:53.410541+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T19:14:53.410355+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T19:14:53.410355+0000","last_clean_scrub_stamp":"2024-09-12T19:14:53.410355+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:21.748107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":16388,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.863466+0000","last_change":"2024-09-12T19:14:26.863334+0000","last_active":"2024-09-12T19:14:26.863466+0000","last_peered":"2024-09-12T19:14:26.863466+0000","last_clean":"2024-09-12T19:14:26.863466+0000","last_became_active":"2024-09-12T18:43:29.897326+0000","last_became_peered":"2024-09-12T18:43:29.897326+0000","last_unstale":"2024-09-12T19:14:26.863466+0000","last_undegraded":"2024-09-12T19:14:26.863466+0000","last_fullsized":"2024-09-12T19:14:26.863466+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:26.863141+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:26.863141+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.863141+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:17.681641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'31","reported_seq":138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.563792+0000","last_change":"2024-09-12T19:14:31.563792+0000","last_active":"2024-09-12T19:14:31.563792+0000","last_peered":"2024-09-12T19:14:31.563792+0000","last_clean":"2024-09-12T19:14:31.563792+0000","last_became_active":"2024-09-12T18:41:45.350900+0000","last_became_peered":"2024-09-12T18:41:45.350900+0000","last_unstale":"2024-09-12T19:14:31.563792+0000","last_undegraded":"2024-09-12T19:14:31.563792+0000","last_fullsized":"2024-09-12T19:14:31.563792+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:14:31.563626+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:14:31.563626+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.563626+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:23.203129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":59,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.235967+0000","last_change":"2024-09-12T19:14:43.235967+0000","last_active":"2024-09-12T19:14:43.235967+0000","last_peered":"2024-09-12T19:14:43.235967+0000","last_clean":"2024-09-12T19:14:43.235967+0000","last_became_active":"2024-09-12T18:55:19.122238+0000","last_became_peered":"2024-09-12T18:55:19.122238+0000","last_unstale":"2024-09-12T19:14:43.235967+0000","last_undegraded":"2024-09-12T19:14:43.235967+0000","last_fullsized":"2024-09-12T19:14:43.235967+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:43.235760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:43.235760+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.235760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.891226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:51.877994+0000","last_change":"2024-09-12T19:14:51.877994+0000","last_active":"2024-09-12T19:14:51.877994+0000","last_peered":"2024-09-12T19:14:51.877994+0000","last_clean":"2024-09-12T19:14:51.877994+0000","last_became_active":"2024-09-12T18:43:32.913108+0000","last_became_peered":"2024-09-12T18:43:32.913108+0000","last_unstale":"2024-09-12T19:14:51.877994+0000","last_undegraded":"2024-09-12T19:14:51.877994+0000","last_fullsized":"2024-09-12T19:14:51.877994+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:51.877815+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:51.877815+0000","last_clean_scrub_stamp":"2024-09-12T19:14:51.877815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:00.128894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'8","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.411897+0000","last_change":"2024-09-12T19:14:43.411897+0000","last_active":"2024-09-12T19:14:43.411897+0000","last_peered":"2024-09-12T19:14:43.411897+0000","last_clean":"2024-09-12T19:14:43.411897+0000","last_became_active":"2024-09-12T18:43:29.877925+0000","last_became_peered":"2024-09-12T18:43:29.877925+0000","last_unstale":"2024-09-12T19:14:43.411897+0000","last_undegraded":"2024-09-12T19:14:43.411897+0000","last_fullsized":"2024-09-12T19:14:43.411897+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T19:14:43.411708+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T19:14:43.411708+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.411708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:45.701934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'136","reported_seq":481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.987916+0000","last_change":"2024-09-12T19:14:41.987916+0000","last_active":"2024-09-12T19:14:41.987916+0000","last_peered":"2024-09-12T19:14:41.987916+0000","last_clean":"2024-09-12T19:14:41.987916+0000","last_became_active":"2024-09-12T18:41:45.365175+0000","last_became_peered":"2024-09-12T18:41:45.365175+0000","last_unstale":"2024-09-12T19:14:41.987916+0000","last_undegraded":"2024-09-12T19:14:41.987916+0000","last_fullsized":"2024-09-12T19:14:41.987916+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T19:14:41.987735+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T19:14:41.987735+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.987735+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:27.035898+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":832,"num_read_kb":595,"num_write":177,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4212,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:52.385088+0000","last_change":"2024-09-12T19:14:52.385088+0000","last_active":"2024-09-12T19:14:52.385088+0000","last_peered":"2024-09-12T19:14:52.385088+0000","last_clean":"2024-09-12T19:14:52.385088+0000","last_became_active":"2024-09-12T18:55:19.130130+0000","last_became_peered":"2024-09-12T18:55:19.130130+0000","last_unstale":"2024-09-12T19:14:52.385088+0000","last_undegraded":"2024-09-12T19:14:52.385088+0000","last_fullsized":"2024-09-12T19:14:52.385088+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:52.384905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:52.384905+0000","last_clean_scrub_stamp":"2024-09-12T19:14:52.384905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:23.229832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:50.361024+0000","last_change":"2024-09-12T19:14:50.361024+0000","last_active":"2024-09-12T19:14:50.361024+0000","last_peered":"2024-09-12T19:14:50.361024+0000","last_clean":"2024-09-12T19:14:50.361024+0000","last_became_active":"2024-09-12T18:43:32.904789+0000","last_became_peered":"2024-09-12T18:43:32.904789+0000","last_unstale":"2024-09-12T19:14:50.361024+0000","last_undegraded":"2024-09-12T19:14:50.361024+0000","last_fullsized":"2024-09-12T19:14:50.361024+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:14:50.360832+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:14:50.360832+0000","last_clean_scrub_stamp":"2024-09-12T19:14:50.360832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:01.900688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:48.933812+0000","last_change":"2024-09-12T19:14:48.933812+0000","last_active":"2024-09-12T19:14:48.933812+0000","last_peered":"2024-09-12T19:14:48.933812+0000","last_clean":"2024-09-12T19:14:48.933812+0000","last_became_active":"2024-09-12T18:43:29.883790+0000","last_became_peered":"2024-09-12T18:43:29.883790+0000","last_unstale":"2024-09-12T19:14:48.933812+0000","last_undegraded":"2024-09-12T19:14:48.933812+0000","last_fullsized":"2024-09-12T19:14:48.933812+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:48.933628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:48.933628+0000","last_clean_scrub_stamp":"2024-09-12T19:14:48.933628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:36.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'6","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.251147+0000","last_change":"2024-09-12T19:14:35.251147+0000","last_active":"2024-09-12T19:14:35.251147+0000","last_peered":"2024-09-12T19:14:35.251147+0000","last_clean":"2024-09-12T19:14:35.251147+0000","last_became_active":"2024-09-12T18:41:45.357746+0000","last_became_peered":"2024-09-12T18:41:45.357746+0000","last_unstale":"2024-09-12T19:14:35.251147+0000","last_undegraded":"2024-09-12T19:14:35.251147+0000","last_fullsized":"2024-09-12T19:14:35.251147+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:35.250936+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:35.250936+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.250936+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:30.843137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.855209+0000","last_change":"2024-09-12T19:14:29.854932+0000","last_active":"2024-09-12T19:14:29.855209+0000","last_peered":"2024-09-12T19:14:29.855209+0000","last_clean":"2024-09-12T19:14:29.855209+0000","last_became_active":"2024-09-12T18:55:19.139565+0000","last_became_peered":"2024-09-12T18:55:19.139565+0000","last_unstale":"2024-09-12T19:14:29.855209+0000","last_undegraded":"2024-09-12T19:14:29.855209+0000","last_fullsized":"2024-09-12T19:14:29.855209+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:29.854724+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:29.854724+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.854724+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:30.370455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.286649+0000","last_change":"2024-09-12T19:14:37.286462+0000","last_active":"2024-09-12T19:14:37.286649+0000","last_peered":"2024-09-12T19:14:37.286649+0000","last_clean":"2024-09-12T19:14:37.286649+0000","last_became_active":"2024-09-12T18:43:32.904858+0000","last_became_peered":"2024-09-12T18:43:32.904858+0000","last_unstale":"2024-09-12T19:14:37.286649+0000","last_undegraded":"2024-09-12T19:14:37.286649+0000","last_fullsized":"2024-09-12T19:14:37.286649+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:37.286273+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:37.286273+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.286273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:27.729597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'4","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:46.002213+0000","last_change":"2024-09-12T19:14:46.002213+0000","last_active":"2024-09-12T19:14:46.002213+0000","last_peered":"2024-09-12T19:14:46.002213+0000","last_clean":"2024-09-12T19:14:46.002213+0000","last_became_active":"2024-09-12T18:43:29.889328+0000","last_became_peered":"2024-09-12T18:43:29.889328+0000","last_unstale":"2024-09-12T19:14:46.002213+0000","last_undegraded":"2024-09-12T19:14:46.002213+0000","last_fullsized":"2024-09-12T19:14:46.002213+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:46.002027+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:46.002027+0000","last_clean_scrub_stamp":"2024-09-12T19:14:46.002027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:39.507049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'8","reported_seq":83,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.434439+0000","last_change":"2024-09-12T19:14:41.434439+0000","last_active":"2024-09-12T19:14:41.434439+0000","last_peered":"2024-09-12T19:14:41.434439+0000","last_clean":"2024-09-12T19:14:41.434439+0000","last_became_active":"2024-09-12T18:41:45.353369+0000","last_became_peered":"2024-09-12T18:41:45.353369+0000","last_unstale":"2024-09-12T19:14:41.434439+0000","last_undegraded":"2024-09-12T19:14:41.434439+0000","last_fullsized":"2024-09-12T19:14:41.434439+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T19:14:41.434222+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T19:14:41.434222+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.434222+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:43.913683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:01.403442+0000","last_change":"2024-09-12T19:15:01.403442+0000","last_active":"2024-09-12T19:15:01.403442+0000","last_peered":"2024-09-12T19:15:01.403442+0000","last_clean":"2024-09-12T19:15:01.403442+0000","last_became_active":"2024-09-12T18:55:19.115920+0000","last_became_peered":"2024-09-12T18:55:19.115920+0000","last_unstale":"2024-09-12T19:15:01.403442+0000","last_undegraded":"2024-09-12T19:15:01.403442+0000","last_fullsized":"2024-09-12T19:15:01.403442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:01.403275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:01.403275+0000","last_clean_scrub_stamp":"2024-09-12T19:15:01.403275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:42.582415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:46.443166+0000","last_change":"2024-09-12T19:14:46.443166+0000","last_active":"2024-09-12T19:14:46.443166+0000","last_peered":"2024-09-12T19:14:46.443166+0000","last_clean":"2024-09-12T19:14:46.443166+0000","last_became_active":"2024-09-12T18:43:32.913259+0000","last_became_peered":"2024-09-12T18:43:32.913259+0000","last_unstale":"2024-09-12T19:14:46.443166+0000","last_undegraded":"2024-09-12T19:14:46.443166+0000","last_fullsized":"2024-09-12T19:14:46.443166+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:46.442950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:46.442950+0000","last_clean_scrub_stamp":"2024-09-12T19:14:46.442950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:06.341853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:46.958032+0000","last_change":"2024-09-12T19:14:46.957890+0000","last_active":"2024-09-12T19:14:46.958032+0000","last_peered":"2024-09-12T19:14:46.958032+0000","last_clean":"2024-09-12T19:14:46.958032+0000","last_became_active":"2024-09-12T18:43:29.882039+0000","last_became_peered":"2024-09-12T18:43:29.882039+0000","last_unstale":"2024-09-12T19:14:46.958032+0000","last_undegraded":"2024-09-12T19:14:46.958032+0000","last_fullsized":"2024-09-12T19:14:46.958032+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:46.957701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:46.957701+0000","last_clean_scrub_stamp":"2024-09-12T19:14:46.957701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:05.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'182","reported_seq":595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:45.435181+0000","last_change":"2024-09-12T19:14:45.435181+0000","last_active":"2024-09-12T19:14:45.435181+0000","last_peered":"2024-09-12T19:14:45.435181+0000","last_clean":"2024-09-12T19:14:45.435181+0000","last_became_active":"2024-09-12T18:41:45.354142+0000","last_became_peered":"2024-09-12T18:41:45.354142+0000","last_unstale":"2024-09-12T19:14:45.435181+0000","last_undegraded":"2024-09-12T19:14:45.435181+0000","last_fullsized":"2024-09-12T19:14:45.435181+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'182","last_scrub_stamp":"2024-09-12T19:14:45.434988+0000","last_deep_scrub":"265'182","last_deep_scrub_stamp":"2024-09-12T19:14:45.434988+0000","last_clean_scrub_stamp":"2024-09-12T19:14:45.434988+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:49.267458+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":838,"num_write":233,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":495,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:57.318891+0000","last_change":"2024-09-12T19:14:57.318891+0000","last_active":"2024-09-12T19:14:57.318891+0000","last_peered":"2024-09-12T19:14:57.318891+0000","last_clean":"2024-09-12T19:14:57.318891+0000","last_became_active":"2024-09-12T18:55:19.142412+0000","last_became_peered":"2024-09-12T18:55:19.142412+0000","last_unstale":"2024-09-12T19:14:57.318891+0000","last_undegraded":"2024-09-12T19:14:57.318891+0000","last_fullsized":"2024-09-12T19:14:57.318891+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:57.318714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:57.318714+0000","last_clean_scrub_stamp":"2024-09-12T19:14:57.318714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:22.828271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'5","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.583770+0000","last_change":"2024-09-12T19:14:38.583634+0000","last_active":"2024-09-12T19:14:38.583770+0000","last_peered":"2024-09-12T19:14:38.583770+0000","last_clean":"2024-09-12T19:14:38.583770+0000","last_became_active":"2024-09-12T18:43:32.939024+0000","last_became_peered":"2024-09-12T18:43:32.939024+0000","last_unstale":"2024-09-12T19:14:38.583770+0000","last_undegraded":"2024-09-12T19:14:38.583770+0000","last_fullsized":"2024-09-12T19:14:38.583770+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:14:38.583441+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:14:38.583441+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.583441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:41.132873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.243074+0000","last_change":"2024-09-12T19:14:34.242928+0000","last_active":"2024-09-12T19:14:34.243074+0000","last_peered":"2024-09-12T19:14:34.243074+0000","last_clean":"2024-09-12T19:14:34.243074+0000","last_became_active":"2024-09-12T18:43:29.892060+0000","last_became_peered":"2024-09-12T18:43:29.892060+0000","last_unstale":"2024-09-12T19:14:34.243074+0000","last_undegraded":"2024-09-12T19:14:34.243074+0000","last_fullsized":"2024-09-12T19:14:34.243074+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:34.242755+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:34.242755+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.242755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:28.135417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'50","reported_seq":191,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.569521+0000","last_change":"2024-09-12T19:14:30.569521+0000","last_active":"2024-09-12T19:14:30.569521+0000","last_peered":"2024-09-12T19:14:30.569521+0000","last_clean":"2024-09-12T19:14:30.569521+0000","last_became_active":"2024-09-12T18:41:45.355840+0000","last_became_peered":"2024-09-12T18:41:45.355840+0000","last_unstale":"2024-09-12T19:14:30.569521+0000","last_undegraded":"2024-09-12T19:14:30.569521+0000","last_fullsized":"2024-09-12T19:14:30.569521+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T19:14:30.569342+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T19:14:30.569342+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.569342+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:57.208477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":177,"num_write":88,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:55.935335+0000","last_change":"2024-09-12T19:14:55.935335+0000","last_active":"2024-09-12T19:14:55.935335+0000","last_peered":"2024-09-12T19:14:55.935335+0000","last_clean":"2024-09-12T19:14:55.935335+0000","last_became_active":"2024-09-12T18:55:19.155684+0000","last_became_peered":"2024-09-12T18:55:19.155684+0000","last_unstale":"2024-09-12T19:14:55.935335+0000","last_undegraded":"2024-09-12T19:14:55.935335+0000","last_fullsized":"2024-09-12T19:14:55.935335+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:55.935156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:55.935156+0000","last_clean_scrub_stamp":"2024-09-12T19:14:55.935156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:03.644530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'4","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:48.376640+0000","last_change":"2024-09-12T19:14:48.376477+0000","last_active":"2024-09-12T19:14:48.376640+0000","last_peered":"2024-09-12T19:14:48.376640+0000","last_clean":"2024-09-12T19:14:48.376640+0000","last_became_active":"2024-09-12T18:43:32.903273+0000","last_became_peered":"2024-09-12T18:43:32.903273+0000","last_unstale":"2024-09-12T19:14:48.376640+0000","last_undegraded":"2024-09-12T19:14:48.376640+0000","last_fullsized":"2024-09-12T19:14:48.376640+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:48.376299+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:48.376299+0000","last_clean_scrub_stamp":"2024-09-12T19:14:48.376299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:27.208401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.559913+0000","last_change":"2024-09-12T19:14:35.559742+0000","last_active":"2024-09-12T19:14:35.559913+0000","last_peered":"2024-09-12T19:14:35.559913+0000","last_clean":"2024-09-12T19:14:35.559913+0000","last_became_active":"2024-09-12T18:43:29.865413+0000","last_became_peered":"2024-09-12T18:43:29.865413+0000","last_unstale":"2024-09-12T19:14:35.559913+0000","last_undegraded":"2024-09-12T19:14:35.559913+0000","last_fullsized":"2024-09-12T19:14:35.559913+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:14:35.559570+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:14:35.559570+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.559570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:25.856774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'25","reported_seq":126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.938892+0000","last_change":"2024-09-12T19:14:40.938892+0000","last_active":"2024-09-12T19:14:40.938892+0000","last_peered":"2024-09-12T19:14:40.938892+0000","last_clean":"2024-09-12T19:14:40.938892+0000","last_became_active":"2024-09-12T18:41:45.362445+0000","last_became_peered":"2024-09-12T18:41:45.362445+0000","last_unstale":"2024-09-12T19:14:40.938892+0000","last_undegraded":"2024-09-12T19:14:40.938892+0000","last_fullsized":"2024-09-12T19:14:40.938892+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-12T19:14:40.938699+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-12T19:14:40.938699+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.938699+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:00.250732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'318","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.831899+0000","last_change":"2024-09-12T19:14:18.831615+0000","last_active":"2024-09-12T19:14:18.831899+0000","last_peered":"2024-09-12T19:14:18.831899+0000","last_clean":"2024-09-12T19:14:18.831899+0000","last_became_active":"2024-09-12T18:26:39.872863+0000","last_became_peered":"2024-09-12T18:26:39.872863+0000","last_unstale":"2024-09-12T19:14:18.831899+0000","last_undegraded":"2024-09-12T19:14:18.831899+0000","last_fullsized":"2024-09-12T19:14:18.831899+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T19:14:18.831273+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T19:14:18.831273+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.831273+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:35.503180+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65109,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":407,"num_read_kb":8020,"num_write":948,"num_write_kb":33098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'549","reported_seq":2210,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.381001+0000","last_change":"2024-09-12T19:14:23.381001+0000","last_active":"2024-09-12T19:14:23.381001+0000","last_peered":"2024-09-12T19:14:23.381001+0000","last_clean":"2024-09-12T19:14:23.381001+0000","last_became_active":"2024-09-12T18:26:41.879711+0000","last_became_peered":"2024-09-12T18:26:41.879711+0000","last_unstale":"2024-09-12T19:14:23.381001+0000","last_undegraded":"2024-09-12T19:14:23.381001+0000","last_fullsized":"2024-09-12T19:14:23.381001+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'549","last_scrub_stamp":"2024-09-12T19:14:23.380715+0000","last_deep_scrub":"265'549","last_deep_scrub_stamp":"2024-09-12T19:14:23.380715+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.380715+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:49.716008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2944,"num_read_kb":2757,"num_write":660,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'376","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.135455+0000","last_change":"2024-09-12T19:14:12.135299+0000","last_active":"2024-09-12T19:14:12.135455+0000","last_peered":"2024-09-12T19:14:12.135455+0000","last_clean":"2024-09-12T19:14:12.135455+0000","last_became_active":"2024-09-12T18:26:39.837462+0000","last_became_peered":"2024-09-12T18:26:39.837462+0000","last_unstale":"2024-09-12T19:14:12.135455+0000","last_undegraded":"2024-09-12T19:14:12.135455+0000","last_fullsized":"2024-09-12T19:14:12.135455+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T19:14:12.135058+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T19:14:12.135058+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.135058+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:27.693768+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10456094,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":60601,"num_write":1117,"num_write_kb":26482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'837","reported_seq":2241,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.904657+0000","last_change":"2024-09-12T19:14:23.904657+0000","last_active":"2024-09-12T19:14:23.904657+0000","last_peered":"2024-09-12T19:14:23.904657+0000","last_clean":"2024-09-12T19:14:23.904657+0000","last_became_active":"2024-09-12T18:26:41.863835+0000","last_became_peered":"2024-09-12T18:26:41.863835+0000","last_unstale":"2024-09-12T19:14:23.904657+0000","last_undegraded":"2024-09-12T19:14:23.904657+0000","last_fullsized":"2024-09-12T19:14:23.904657+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'837","last_scrub_stamp":"2024-09-12T19:14:23.904418+0000","last_deep_scrub":"265'837","last_deep_scrub_stamp":"2024-09-12T19:14:23.904418+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.904418+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:53.971623+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3830,"num_read_kb":3409,"num_write":1134,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'378","reported_seq":1063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.849257+0000","last_change":"2024-09-12T19:14:08.849112+0000","last_active":"2024-09-12T19:14:08.849257+0000","last_peered":"2024-09-12T19:14:08.849257+0000","last_clean":"2024-09-12T19:14:08.849257+0000","last_became_active":"2024-09-12T18:26:39.831522+0000","last_became_peered":"2024-09-12T18:26:39.831522+0000","last_unstale":"2024-09-12T19:14:08.849257+0000","last_undegraded":"2024-09-12T19:14:08.849257+0000","last_fullsized":"2024-09-12T19:14:08.849257+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T19:14:08.848850+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T19:14:08.848850+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.848850+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:42.012065+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":634,"num_read_kb":27264,"num_write":1166,"num_write_kb":30891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'366","reported_seq":1836,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.391877+0000","last_change":"2024-09-12T19:14:23.391877+0000","last_active":"2024-09-12T19:14:23.391877+0000","last_peered":"2024-09-12T19:14:23.391877+0000","last_clean":"2024-09-12T19:14:23.391877+0000","last_became_active":"2024-09-12T18:26:41.850001+0000","last_became_peered":"2024-09-12T18:26:41.850001+0000","last_unstale":"2024-09-12T19:14:23.391877+0000","last_undegraded":"2024-09-12T19:14:23.391877+0000","last_fullsized":"2024-09-12T19:14:23.391877+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T19:14:23.391604+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T19:14:23.391604+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.391604+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:22.771625+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2076,"num_read_kb":1992,"num_write":405,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":948,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'352","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.551177+0000","last_change":"2024-09-12T19:14:16.551022+0000","last_active":"2024-09-12T19:14:16.551177+0000","last_peered":"2024-09-12T19:14:16.551177+0000","last_clean":"2024-09-12T19:14:16.551177+0000","last_became_active":"2024-09-12T18:27:11.824331+0000","last_became_peered":"2024-09-12T18:27:11.824331+0000","last_unstale":"2024-09-12T19:14:16.551177+0000","last_undegraded":"2024-09-12T19:14:16.551177+0000","last_fullsized":"2024-09-12T19:14:16.551177+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T19:14:16.550844+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T19:14:16.550844+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.550844+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:58.419343+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":38329,"num_write":1089,"num_write_kb":37388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'504","reported_seq":2067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.607377+0000","last_change":"2024-09-12T19:14:28.607377+0000","last_active":"2024-09-12T19:14:28.607377+0000","last_peered":"2024-09-12T19:14:28.607377+0000","last_clean":"2024-09-12T19:14:28.607377+0000","last_became_active":"2024-09-12T18:26:41.850866+0000","last_became_peered":"2024-09-12T18:26:41.850866+0000","last_unstale":"2024-09-12T19:14:28.607377+0000","last_undegraded":"2024-09-12T19:14:28.607377+0000","last_fullsized":"2024-09-12T19:14:28.607377+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'504","last_scrub_stamp":"2024-09-12T19:14:28.607197+0000","last_deep_scrub":"265'504","last_deep_scrub_stamp":"2024-09-12T19:14:28.607197+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.607197+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:40.118453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2664,"num_read_kb":2487,"num_write":637,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'375","reported_seq":1117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.824067+0000","last_change":"2024-09-12T19:14:17.824067+0000","last_active":"2024-09-12T19:14:17.824067+0000","last_peered":"2024-09-12T19:14:17.824067+0000","last_clean":"2024-09-12T19:14:17.824067+0000","last_became_active":"2024-09-12T18:26:39.870272+0000","last_became_peered":"2024-09-12T18:26:39.870272+0000","last_unstale":"2024-09-12T19:14:17.824067+0000","last_undegraded":"2024-09-12T19:14:17.824067+0000","last_fullsized":"2024-09-12T19:14:17.824067+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T19:14:17.823882+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T19:14:17.823882+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.823882+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:12.604920+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":771,"num_read_kb":17788,"num_write":1173,"num_write_kb":36512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'544","reported_seq":1978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.599536+0000","last_change":"2024-09-12T19:14:16.599400+0000","last_active":"2024-09-12T19:14:16.599536+0000","last_peered":"2024-09-12T19:14:16.599536+0000","last_clean":"2024-09-12T19:14:16.599536+0000","last_became_active":"2024-09-12T18:26:41.865288+0000","last_became_peered":"2024-09-12T18:26:41.865288+0000","last_unstale":"2024-09-12T19:14:16.599536+0000","last_undegraded":"2024-09-12T19:14:16.599536+0000","last_fullsized":"2024-09-12T19:14:16.599536+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'544","last_scrub_stamp":"2024-09-12T19:14:16.599227+0000","last_deep_scrub":"265'544","last_deep_scrub_stamp":"2024-09-12T19:14:16.599227+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.599227+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:43.374177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2721,"num_read_kb":2571,"num_write":759,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'336","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.604868+0000","last_change":"2024-09-12T19:14:15.604868+0000","last_active":"2024-09-12T19:14:15.604868+0000","last_peered":"2024-09-12T19:14:15.604868+0000","last_clean":"2024-09-12T19:14:15.604868+0000","last_became_active":"2024-09-12T18:26:39.851253+0000","last_became_peered":"2024-09-12T18:26:39.851253+0000","last_unstale":"2024-09-12T19:14:15.604868+0000","last_undegraded":"2024-09-12T19:14:15.604868+0000","last_fullsized":"2024-09-12T19:14:15.604868+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T19:14:15.604676+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T19:14:15.604676+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.604676+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:42.167079+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493192,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":31766,"num_write":1103,"num_write_kb":25425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'809","reported_seq":2350,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.411683+0000","last_change":"2024-09-12T19:14:24.411445+0000","last_active":"2024-09-12T19:14:24.411683+0000","last_peered":"2024-09-12T19:14:24.411683+0000","last_clean":"2024-09-12T19:14:24.411683+0000","last_became_active":"2024-09-12T18:26:41.851811+0000","last_became_peered":"2024-09-12T18:26:41.851811+0000","last_unstale":"2024-09-12T19:14:24.411683+0000","last_undegraded":"2024-09-12T19:14:24.411683+0000","last_fullsized":"2024-09-12T19:14:24.411683+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'809","last_scrub_stamp":"2024-09-12T19:14:24.411193+0000","last_deep_scrub":"265'809","last_deep_scrub_stamp":"2024-09-12T19:14:24.411193+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.411193+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:30.044424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3792,"num_read_kb":3404,"num_write":1072,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'361","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.808471+0000","last_change":"2024-09-12T19:14:16.808471+0000","last_active":"2024-09-12T19:14:16.808471+0000","last_peered":"2024-09-12T19:14:16.808471+0000","last_clean":"2024-09-12T19:14:16.808471+0000","last_became_active":"2024-09-12T18:26:39.861529+0000","last_became_peered":"2024-09-12T18:26:39.861529+0000","last_unstale":"2024-09-12T19:14:16.808471+0000","last_undegraded":"2024-09-12T19:14:16.808471+0000","last_fullsized":"2024-09-12T19:14:16.808471+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'361","last_scrub_stamp":"2024-09-12T19:14:16.808282+0000","last_deep_scrub":"265'361","last_deep_scrub_stamp":"2024-09-12T19:14:16.808282+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.808282+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:23.887451+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":30235,"num_write":1160,"num_write_kb":47172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'702","reported_seq":2327,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.344153+0000","last_change":"2024-09-12T19:14:22.343997+0000","last_active":"2024-09-12T19:14:22.344153+0000","last_peered":"2024-09-12T19:14:22.344153+0000","last_clean":"2024-09-12T19:14:22.344153+0000","last_became_active":"2024-09-12T18:26:41.878820+0000","last_became_peered":"2024-09-12T18:26:41.878820+0000","last_unstale":"2024-09-12T19:14:22.344153+0000","last_undegraded":"2024-09-12T19:14:22.344153+0000","last_fullsized":"2024-09-12T19:14:22.344153+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'702","last_scrub_stamp":"2024-09-12T19:14:22.343819+0000","last_deep_scrub":"265'702","last_deep_scrub_stamp":"2024-09-12T19:14:22.343819+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.343819+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:29.298164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3429,"num_read_kb":3073,"num_write":944,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'345","reported_seq":1045,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.978941+0000","last_change":"2024-09-12T19:14:18.978941+0000","last_active":"2024-09-12T19:14:18.978941+0000","last_peered":"2024-09-12T19:14:18.978941+0000","last_clean":"2024-09-12T19:14:18.978941+0000","last_became_active":"2024-09-12T18:27:11.824008+0000","last_became_peered":"2024-09-12T18:27:11.824008+0000","last_unstale":"2024-09-12T19:14:18.978941+0000","last_undegraded":"2024-09-12T19:14:18.978941+0000","last_fullsized":"2024-09-12T19:14:18.978941+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-12T19:14:18.978754+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-12T19:14:18.978754+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.978754+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:11.553698+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":634,"num_read_kb":10155,"num_write":1129,"num_write_kb":30763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'678","reported_seq":2298,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.021610+0000","last_change":"2024-09-12T19:14:13.021352+0000","last_active":"2024-09-12T19:14:13.021610+0000","last_peered":"2024-09-12T19:14:13.021610+0000","last_clean":"2024-09-12T19:14:13.021610+0000","last_became_active":"2024-09-12T18:26:41.854487+0000","last_became_peered":"2024-09-12T18:26:41.854487+0000","last_unstale":"2024-09-12T19:14:13.021610+0000","last_undegraded":"2024-09-12T19:14:13.021610+0000","last_fullsized":"2024-09-12T19:14:13.021610+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'678","last_scrub_stamp":"2024-09-12T19:14:13.021126+0000","last_deep_scrub":"265'678","last_deep_scrub_stamp":"2024-09-12T19:14:13.021126+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.021126+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:16.262713+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3483,"num_read_kb":3149,"num_write":934,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3253,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'464","reported_seq":2077,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.379502+0000","last_change":"2024-09-12T19:14:21.379502+0000","last_active":"2024-09-12T19:14:21.379502+0000","last_peered":"2024-09-12T19:14:21.379502+0000","last_clean":"2024-09-12T19:14:21.379502+0000","last_became_active":"2024-09-12T18:26:41.845080+0000","last_became_peered":"2024-09-12T18:26:41.845080+0000","last_unstale":"2024-09-12T19:14:21.379502+0000","last_undegraded":"2024-09-12T19:14:21.379502+0000","last_fullsized":"2024-09-12T19:14:21.379502+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'464","last_scrub_stamp":"2024-09-12T19:14:21.379327+0000","last_deep_scrub":"265'464","last_deep_scrub_stamp":"2024-09-12T19:14:21.379327+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.379327+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:35.754623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2421,"num_read_kb":2289,"num_write":534,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'377","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.854483+0000","last_change":"2024-09-12T19:14:12.854483+0000","last_active":"2024-09-12T19:14:12.854483+0000","last_peered":"2024-09-12T19:14:12.854483+0000","last_clean":"2024-09-12T19:14:12.854483+0000","last_became_active":"2024-09-12T18:26:39.872936+0000","last_became_peered":"2024-09-12T18:26:39.872936+0000","last_unstale":"2024-09-12T19:14:12.854483+0000","last_undegraded":"2024-09-12T19:14:12.854483+0000","last_fullsized":"2024-09-12T19:14:12.854483+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:14:12.854221+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:14:12.854221+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.854221+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.012669+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":506,"num_read_kb":24957,"num_write":1245,"num_write_kb":33279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'560","reported_seq":2182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.878540+0000","last_change":"2024-09-12T19:14:20.878540+0000","last_active":"2024-09-12T19:14:20.878540+0000","last_peered":"2024-09-12T19:14:20.878540+0000","last_clean":"2024-09-12T19:14:20.878540+0000","last_became_active":"2024-09-12T18:26:41.865247+0000","last_became_peered":"2024-09-12T18:26:41.865247+0000","last_unstale":"2024-09-12T19:14:20.878540+0000","last_undegraded":"2024-09-12T19:14:20.878540+0000","last_fullsized":"2024-09-12T19:14:20.878540+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'560","last_scrub_stamp":"2024-09-12T19:14:20.878338+0000","last_deep_scrub":"265'560","last_deep_scrub_stamp":"2024-09-12T19:14:20.878338+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.878338+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:05.827599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2931,"num_read_kb":2718,"num_write":721,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'407","reported_seq":1125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.608821+0000","last_change":"2024-09-12T19:14:12.608658+0000","last_active":"2024-09-12T19:14:12.608821+0000","last_peered":"2024-09-12T19:14:12.608821+0000","last_clean":"2024-09-12T19:14:12.608821+0000","last_became_active":"2024-09-12T18:26:39.858964+0000","last_became_peered":"2024-09-12T18:26:39.858964+0000","last_unstale":"2024-09-12T19:14:12.608821+0000","last_undegraded":"2024-09-12T19:14:12.608821+0000","last_fullsized":"2024-09-12T19:14:12.608821+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'407","last_scrub_stamp":"2024-09-12T19:14:12.608446+0000","last_deep_scrub":"265'407","last_deep_scrub_stamp":"2024-09-12T19:14:12.608446+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.608446+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:32.397218+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":810,"num_read_kb":25615,"num_write":1319,"num_write_kb":27961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'829","reported_seq":2320,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.413316+0000","last_change":"2024-09-12T19:14:20.413316+0000","last_active":"2024-09-12T19:14:20.413316+0000","last_peered":"2024-09-12T19:14:20.413316+0000","last_clean":"2024-09-12T19:14:20.413316+0000","last_became_active":"2024-09-12T18:26:41.861762+0000","last_became_peered":"2024-09-12T18:26:41.861762+0000","last_unstale":"2024-09-12T19:14:20.413316+0000","last_undegraded":"2024-09-12T19:14:20.413316+0000","last_fullsized":"2024-09-12T19:14:20.413316+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'829","last_scrub_stamp":"2024-09-12T19:14:20.413148+0000","last_deep_scrub":"265'829","last_deep_scrub_stamp":"2024-09-12T19:14:20.413148+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.413148+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:56.664208+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3868,"num_read_kb":3443,"num_write":1111,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'398","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.589611+0000","last_change":"2024-09-12T19:14:10.589461+0000","last_active":"2024-09-12T19:14:10.589611+0000","last_peered":"2024-09-12T19:14:10.589611+0000","last_clean":"2024-09-12T19:14:10.589611+0000","last_became_active":"2024-09-12T18:26:39.856700+0000","last_became_peered":"2024-09-12T18:26:39.856700+0000","last_unstale":"2024-09-12T19:14:10.589611+0000","last_undegraded":"2024-09-12T19:14:10.589611+0000","last_fullsized":"2024-09-12T19:14:10.589611+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'398","last_scrub_stamp":"2024-09-12T19:14:10.589144+0000","last_deep_scrub":"265'398","last_deep_scrub_stamp":"2024-09-12T19:14:10.589144+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.589144+0000","objects_scrubbed":9,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:43.957851+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632225,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":583,"num_read_kb":29092,"num_write":1242,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'409","reported_seq":1983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.020835+0000","last_change":"2024-09-12T19:14:14.020591+0000","last_active":"2024-09-12T19:14:14.020835+0000","last_peered":"2024-09-12T19:14:14.020835+0000","last_clean":"2024-09-12T19:14:14.020835+0000","last_became_active":"2024-09-12T18:26:41.854687+0000","last_became_peered":"2024-09-12T18:26:41.854687+0000","last_unstale":"2024-09-12T19:14:14.020835+0000","last_undegraded":"2024-09-12T19:14:14.020835+0000","last_fullsized":"2024-09-12T19:14:14.020835+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T19:14:14.020301+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T19:14:14.020301+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.020301+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:02.096125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2203,"num_read_kb":2114,"num_write":459,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'308","reported_seq":1035,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.295640+0000","last_change":"2024-09-12T19:14:09.295484+0000","last_active":"2024-09-12T19:14:09.295640+0000","last_peered":"2024-09-12T19:14:09.295640+0000","last_clean":"2024-09-12T19:14:09.295640+0000","last_became_active":"2024-09-12T18:26:39.845295+0000","last_became_peered":"2024-09-12T18:26:39.845295+0000","last_unstale":"2024-09-12T19:14:09.295640+0000","last_undegraded":"2024-09-12T19:14:09.295640+0000","last_fullsized":"2024-09-12T19:14:09.295640+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'308","last_scrub_stamp":"2024-09-12T19:14:09.295239+0000","last_deep_scrub":"265'308","last_deep_scrub_stamp":"2024-09-12T19:14:09.295239+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.295239+0000","objects_scrubbed":9,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:26.941892+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306760,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":23315,"num_write":964,"num_write_kb":25673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'820","reported_seq":2476,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.067947+0000","last_change":"2024-09-12T19:14:11.067808+0000","last_active":"2024-09-12T19:14:11.067947+0000","last_peered":"2024-09-12T19:14:11.067947+0000","last_clean":"2024-09-12T19:14:11.067947+0000","last_became_active":"2024-09-12T18:26:41.856280+0000","last_became_peered":"2024-09-12T18:26:41.856280+0000","last_unstale":"2024-09-12T19:14:11.067947+0000","last_undegraded":"2024-09-12T19:14:11.067947+0000","last_fullsized":"2024-09-12T19:14:11.067947+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'820","last_scrub_stamp":"2024-09-12T19:14:11.067602+0000","last_deep_scrub":"265'820","last_deep_scrub_stamp":"2024-09-12T19:14:11.067602+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.067602+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:07.191479+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4038,"num_read_kb":3655,"num_write":1078,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1764,"num_omap_keys":7,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'416","reported_seq":1118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.822795+0000","last_change":"2024-09-12T19:14:09.822636+0000","last_active":"2024-09-12T19:14:09.822795+0000","last_peered":"2024-09-12T19:14:09.822795+0000","last_clean":"2024-09-12T19:14:09.822795+0000","last_became_active":"2024-09-12T18:26:39.842159+0000","last_became_peered":"2024-09-12T18:26:39.842159+0000","last_unstale":"2024-09-12T19:14:09.822795+0000","last_undegraded":"2024-09-12T19:14:09.822795+0000","last_fullsized":"2024-09-12T19:14:09.822795+0000","mapping_epoch":24,"log_start":"265'401","ondisk_log_start":"265'401","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'416","last_scrub_stamp":"2024-09-12T19:14:09.822414+0000","last_deep_scrub":"265'416","last_deep_scrub_stamp":"2024-09-12T19:14:09.822414+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.822414+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":401,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:12.755786+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":622,"num_read_kb":58105,"num_write":1270,"num_write_kb":62462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'846","reported_seq":2442,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.379526+0000","last_change":"2024-09-12T19:14:22.379392+0000","last_active":"2024-09-12T19:14:22.379526+0000","last_peered":"2024-09-12T19:14:22.379526+0000","last_clean":"2024-09-12T19:14:22.379526+0000","last_became_active":"2024-09-12T18:26:41.853403+0000","last_became_peered":"2024-09-12T18:26:41.853403+0000","last_unstale":"2024-09-12T19:14:22.379526+0000","last_undegraded":"2024-09-12T19:14:22.379526+0000","last_fullsized":"2024-09-12T19:14:22.379526+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'846","last_scrub_stamp":"2024-09-12T19:14:22.379204+0000","last_deep_scrub":"265'846","last_deep_scrub_stamp":"2024-09-12T19:14:22.379204+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.379204+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:29.289985+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3981,"num_read_kb":3579,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'408","reported_seq":1125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.829466+0000","last_change":"2024-09-12T19:14:07.829466+0000","last_active":"2024-09-12T19:14:07.829466+0000","last_peered":"2024-09-12T19:14:07.829466+0000","last_clean":"2024-09-12T19:14:07.829466+0000","last_became_active":"2024-09-12T18:26:39.834006+0000","last_became_peered":"2024-09-12T18:26:39.834006+0000","last_unstale":"2024-09-12T19:14:07.829466+0000","last_undegraded":"2024-09-12T19:14:07.829466+0000","last_fullsized":"2024-09-12T19:14:07.829466+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'408","last_scrub_stamp":"2024-09-12T19:14:07.829075+0000","last_deep_scrub":"265'408","last_deep_scrub_stamp":"2024-09-12T19:14:07.829075+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.829075+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:01.756044+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":720,"num_read_kb":82742,"num_write":1326,"num_write_kb":55909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'116","reported_seq":636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.401927+0000","last_change":"2024-09-12T19:14:38.401927+0000","last_active":"2024-09-12T19:14:38.401927+0000","last_peered":"2024-09-12T19:14:38.401927+0000","last_clean":"2024-09-12T19:14:38.401927+0000","last_became_active":"2024-09-12T18:26:49.906589+0000","last_became_peered":"2024-09-12T18:26:49.906589+0000","last_unstale":"2024-09-12T19:14:38.401927+0000","last_undegraded":"2024-09-12T19:14:38.401927+0000","last_fullsized":"2024-09-12T19:14:38.401927+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T19:14:38.401733+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T19:14:38.401733+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.401733+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:42.295621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":280,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'755","reported_seq":2173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.828743+0000","last_change":"2024-09-12T19:14:11.828743+0000","last_active":"2024-09-12T19:14:11.828743+0000","last_peered":"2024-09-12T19:14:11.828743+0000","last_clean":"2024-09-12T19:14:11.828743+0000","last_became_active":"2024-09-12T18:26:41.852831+0000","last_became_peered":"2024-09-12T18:26:41.852831+0000","last_unstale":"2024-09-12T19:14:11.828743+0000","last_undegraded":"2024-09-12T19:14:11.828743+0000","last_fullsized":"2024-09-12T19:14:11.828743+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'755","last_scrub_stamp":"2024-09-12T19:14:11.828569+0000","last_deep_scrub":"265'755","last_deep_scrub_stamp":"2024-09-12T19:14:11.828569+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.828569+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:38.861938+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3501,"num_read_kb":3138,"num_write":986,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'391","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.849709+0000","last_change":"2024-09-12T19:14:10.849709+0000","last_active":"2024-09-12T19:14:10.849709+0000","last_peered":"2024-09-12T19:14:10.849709+0000","last_clean":"2024-09-12T19:14:10.849709+0000","last_became_active":"2024-09-12T18:27:11.823705+0000","last_became_peered":"2024-09-12T18:27:11.823705+0000","last_unstale":"2024-09-12T19:14:10.849709+0000","last_undegraded":"2024-09-12T19:14:10.849709+0000","last_fullsized":"2024-09-12T19:14:10.849709+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T19:14:10.849514+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T19:14:10.849514+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.849514+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:57.941792+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":587,"num_read_kb":55935,"num_write":1256,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.290759+0000","last_change":"2024-09-12T19:14:26.290526+0000","last_active":"2024-09-12T19:14:26.290759+0000","last_peered":"2024-09-12T19:14:26.290759+0000","last_clean":"2024-09-12T19:14:26.290759+0000","last_became_active":"2024-09-12T18:26:43.857754+0000","last_became_peered":"2024-09-12T18:26:43.857754+0000","last_unstale":"2024-09-12T19:14:26.290759+0000","last_undegraded":"2024-09-12T19:14:26.290759+0000","last_fullsized":"2024-09-12T19:14:26.290759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.290273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.290273+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.290273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:50.223630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'321","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.680630+0000","last_change":"2024-09-12T19:14:21.680630+0000","last_active":"2024-09-12T19:14:21.680630+0000","last_peered":"2024-09-12T19:14:21.680630+0000","last_clean":"2024-09-12T19:14:21.680630+0000","last_became_active":"2024-09-12T18:26:45.876070+0000","last_became_peered":"2024-09-12T18:26:45.876070+0000","last_unstale":"2024-09-12T19:14:21.680630+0000","last_undegraded":"2024-09-12T19:14:21.680630+0000","last_fullsized":"2024-09-12T19:14:21.680630+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T19:14:21.680429+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T19:14:21.680429+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.680429+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:11.520559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48204,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1086,"num_write":410,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.987495+0000","last_change":"2024-09-12T19:14:36.987495+0000","last_active":"2024-09-12T19:14:36.987495+0000","last_peered":"2024-09-12T19:14:36.987495+0000","last_clean":"2024-09-12T19:14:36.987495+0000","last_became_active":"2024-09-12T18:26:47.895471+0000","last_became_peered":"2024-09-12T18:26:47.895471+0000","last_unstale":"2024-09-12T19:14:36.987495+0000","last_undegraded":"2024-09-12T19:14:36.987495+0000","last_fullsized":"2024-09-12T19:14:36.987495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:36.987320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:36.987320+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.987320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:48.128304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'2444","reported_seq":4333,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.421658+0000","last_change":"2024-09-12T19:14:39.421658+0000","last_active":"2024-09-12T19:14:39.421658+0000","last_peered":"2024-09-12T19:14:39.421658+0000","last_clean":"2024-09-12T19:14:39.421658+0000","last_became_active":"2024-09-12T18:26:49.913125+0000","last_became_peered":"2024-09-12T18:26:49.913125+0000","last_unstale":"2024-09-12T19:14:39.421658+0000","last_undegraded":"2024-09-12T19:14:39.421658+0000","last_fullsized":"2024-09-12T19:14:39.421658+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2444","last_scrub_stamp":"2024-09-12T19:14:39.421480+0000","last_deep_scrub":"265'2444","last_deep_scrub_stamp":"2024-09-12T19:14:39.421480+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.421480+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":2400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:47.047328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6085,"num_read_kb":6089,"num_write":4865,"num_write_kb":1791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'570","reported_seq":2199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.473314+0000","last_change":"2024-09-12T19:14:18.473163+0000","last_active":"2024-09-12T19:14:18.473314+0000","last_peered":"2024-09-12T19:14:18.473314+0000","last_clean":"2024-09-12T19:14:18.473314+0000","last_became_active":"2024-09-12T18:26:41.871531+0000","last_became_peered":"2024-09-12T18:26:41.871531+0000","last_unstale":"2024-09-12T19:14:18.473314+0000","last_undegraded":"2024-09-12T19:14:18.473314+0000","last_fullsized":"2024-09-12T19:14:18.473314+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'570","last_scrub_stamp":"2024-09-12T19:14:18.472978+0000","last_deep_scrub":"265'570","last_deep_scrub_stamp":"2024-09-12T19:14:18.472978+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.472978+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:22.258961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2964,"num_read_kb":2726,"num_write":725,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3006,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'370","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.853877+0000","last_change":"2024-09-12T19:14:06.853877+0000","last_active":"2024-09-12T19:14:06.853877+0000","last_peered":"2024-09-12T19:14:06.853877+0000","last_clean":"2024-09-12T19:14:06.853877+0000","last_became_active":"2024-09-12T18:26:39.871605+0000","last_became_peered":"2024-09-12T18:26:39.871605+0000","last_unstale":"2024-09-12T19:14:06.853877+0000","last_undegraded":"2024-09-12T19:14:06.853877+0000","last_fullsized":"2024-09-12T19:14:06.853877+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T19:14:06.853744+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T19:14:06.853744+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.853744+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:17.533292+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721310,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":33411,"num_write":1198,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.044317+0000","last_change":"2024-09-12T19:14:22.044317+0000","last_active":"2024-09-12T19:14:22.044317+0000","last_peered":"2024-09-12T19:14:22.044317+0000","last_clean":"2024-09-12T19:14:22.044317+0000","last_became_active":"2024-09-12T18:26:43.865817+0000","last_became_peered":"2024-09-12T18:26:43.865817+0000","last_unstale":"2024-09-12T19:14:22.044317+0000","last_undegraded":"2024-09-12T19:14:22.044317+0000","last_fullsized":"2024-09-12T19:14:22.044317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:22.044143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:22.044143+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.044143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:11.814993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'78","reported_seq":613,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.411663+0000","last_change":"2024-09-12T19:14:31.411663+0000","last_active":"2024-09-12T19:14:31.411663+0000","last_peered":"2024-09-12T19:14:31.411663+0000","last_clean":"2024-09-12T19:14:31.411663+0000","last_became_active":"2024-09-12T18:26:45.854087+0000","last_became_peered":"2024-09-12T18:26:45.854087+0000","last_unstale":"2024-09-12T19:14:31.411663+0000","last_undegraded":"2024-09-12T19:14:31.411663+0000","last_fullsized":"2024-09-12T19:14:31.411663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'78","last_scrub_stamp":"2024-09-12T19:14:31.411447+0000","last_deep_scrub":"265'78","last_deep_scrub_stamp":"2024-09-12T19:14:31.411447+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.411447+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:41.644882+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.411477+0000","last_change":"2024-09-12T19:14:35.411477+0000","last_active":"2024-09-12T19:14:35.411477+0000","last_peered":"2024-09-12T19:14:35.411477+0000","last_clean":"2024-09-12T19:14:35.411477+0000","last_became_active":"2024-09-12T18:26:47.880374+0000","last_became_peered":"2024-09-12T18:26:47.880374+0000","last_unstale":"2024-09-12T19:14:35.411477+0000","last_undegraded":"2024-09-12T19:14:35.411477+0000","last_fullsized":"2024-09-12T19:14:35.411477+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:35.411256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:35.411256+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.411256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:16.321639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'124","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.600230+0000","last_change":"2024-09-12T19:14:40.600230+0000","last_active":"2024-09-12T19:14:40.600230+0000","last_peered":"2024-09-12T19:14:40.600230+0000","last_clean":"2024-09-12T19:14:40.600230+0000","last_became_active":"2024-09-12T18:26:49.926650+0000","last_became_peered":"2024-09-12T18:26:49.926650+0000","last_unstale":"2024-09-12T19:14:40.600230+0000","last_undegraded":"2024-09-12T19:14:40.600230+0000","last_fullsized":"2024-09-12T19:14:40.600230+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-12T19:14:40.600061+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-12T19:14:40.600061+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.600061+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:02.379306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'509","reported_seq":2188,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.773342+0000","last_change":"2024-09-12T19:14:11.773187+0000","last_active":"2024-09-12T19:14:11.773342+0000","last_peered":"2024-09-12T19:14:11.773342+0000","last_clean":"2024-09-12T19:14:11.773342+0000","last_became_active":"2024-09-12T18:26:41.851928+0000","last_became_peered":"2024-09-12T18:26:41.851928+0000","last_unstale":"2024-09-12T19:14:11.773342+0000","last_undegraded":"2024-09-12T19:14:11.773342+0000","last_fullsized":"2024-09-12T19:14:11.773342+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'509","last_scrub_stamp":"2024-09-12T19:14:11.773008+0000","last_deep_scrub":"265'509","last_deep_scrub_stamp":"2024-09-12T19:14:11.773008+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.773008+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:15.496861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2649,"num_read_kb":2492,"num_write":594,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'375","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.825389+0000","last_change":"2024-09-12T19:14:15.825389+0000","last_active":"2024-09-12T19:14:15.825389+0000","last_peered":"2024-09-12T19:14:15.825389+0000","last_clean":"2024-09-12T19:14:15.825389+0000","last_became_active":"2024-09-12T18:26:39.863389+0000","last_became_peered":"2024-09-12T18:26:39.863389+0000","last_unstale":"2024-09-12T19:14:15.825389+0000","last_undegraded":"2024-09-12T19:14:15.825389+0000","last_fullsized":"2024-09-12T19:14:15.825389+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T19:14:15.825196+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T19:14:15.825196+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.825196+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:32.797512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":529,"num_read_kb":22645,"num_write":1125,"num_write_kb":31309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.120956+0000","last_change":"2024-09-12T19:14:25.120777+0000","last_active":"2024-09-12T19:14:25.120956+0000","last_peered":"2024-09-12T19:14:25.120956+0000","last_clean":"2024-09-12T19:14:25.120956+0000","last_became_active":"2024-09-12T18:26:43.853736+0000","last_became_peered":"2024-09-12T18:26:43.853736+0000","last_unstale":"2024-09-12T19:14:25.120956+0000","last_undegraded":"2024-09-12T19:14:25.120956+0000","last_fullsized":"2024-09-12T19:14:25.120956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:25.120602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:25.120602+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.120602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:00.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'118","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.965708+0000","last_change":"2024-09-12T19:14:21.965708+0000","last_active":"2024-09-12T19:14:21.965708+0000","last_peered":"2024-09-12T19:14:21.965708+0000","last_clean":"2024-09-12T19:14:21.965708+0000","last_became_active":"2024-09-12T18:26:45.853143+0000","last_became_peered":"2024-09-12T18:26:45.853143+0000","last_unstale":"2024-09-12T19:14:21.965708+0000","last_undegraded":"2024-09-12T19:14:21.965708+0000","last_fullsized":"2024-09-12T19:14:21.965708+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T19:14:21.965574+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T19:14:21.965574+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.965574+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:04.870883+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'765","reported_seq":4119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.961804+0000","last_change":"2024-09-12T19:14:35.961804+0000","last_active":"2024-09-12T19:14:35.961804+0000","last_peered":"2024-09-12T19:14:35.961804+0000","last_clean":"2024-09-12T19:14:35.961804+0000","last_became_active":"2024-09-12T18:26:47.895056+0000","last_became_peered":"2024-09-12T18:26:47.895056+0000","last_unstale":"2024-09-12T19:14:35.961804+0000","last_undegraded":"2024-09-12T19:14:35.961804+0000","last_fullsized":"2024-09-12T19:14:35.961804+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'765","last_scrub_stamp":"2024-09-12T19:14:35.961585+0000","last_deep_scrub":"265'765","last_deep_scrub_stamp":"2024-09-12T19:14:35.961585+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.961585+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":702,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:37.718968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'176","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.370688+0000","last_change":"2024-09-12T19:14:39.370688+0000","last_active":"2024-09-12T19:14:39.370688+0000","last_peered":"2024-09-12T19:14:39.370688+0000","last_clean":"2024-09-12T19:14:39.370688+0000","last_became_active":"2024-09-12T18:26:49.890325+0000","last_became_peered":"2024-09-12T18:26:49.890325+0000","last_unstale":"2024-09-12T19:14:39.370688+0000","last_undegraded":"2024-09-12T19:14:39.370688+0000","last_fullsized":"2024-09-12T19:14:39.370688+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'176","last_scrub_stamp":"2024-09-12T19:14:39.370494+0000","last_deep_scrub":"265'176","last_deep_scrub_stamp":"2024-09-12T19:14:39.370494+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.370494+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:05.708623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":638,"num_write":360,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'756","reported_seq":2317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.795602+0000","last_change":"2024-09-12T19:14:10.795472+0000","last_active":"2024-09-12T19:14:10.795602+0000","last_peered":"2024-09-12T19:14:10.795602+0000","last_clean":"2024-09-12T19:14:10.795602+0000","last_became_active":"2024-09-12T18:26:41.862240+0000","last_became_peered":"2024-09-12T18:26:41.862240+0000","last_unstale":"2024-09-12T19:14:10.795602+0000","last_undegraded":"2024-09-12T19:14:10.795602+0000","last_fullsized":"2024-09-12T19:14:10.795602+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'756","last_scrub_stamp":"2024-09-12T19:14:10.795293+0000","last_deep_scrub":"265'756","last_deep_scrub_stamp":"2024-09-12T19:14:10.795293+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.795293+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:49.343521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3627,"num_read_kb":3298,"num_write":982,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'333","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.459163+0000","last_change":"2024-09-12T19:14:05.459163+0000","last_active":"2024-09-12T19:14:05.459163+0000","last_peered":"2024-09-12T19:14:05.459163+0000","last_clean":"2024-09-12T19:14:05.459163+0000","last_became_active":"2024-09-12T18:26:39.843351+0000","last_became_peered":"2024-09-12T18:26:39.843351+0000","last_unstale":"2024-09-12T19:14:05.459163+0000","last_undegraded":"2024-09-12T19:14:05.459163+0000","last_fullsized":"2024-09-12T19:14:05.459163+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T19:14:05.458982+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T19:14:05.458982+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.458982+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:06.506600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170084,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":20705,"num_write":1033,"num_write_kb":27627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.337255+0000","last_change":"2024-09-12T19:14:27.337030+0000","last_active":"2024-09-12T19:14:27.337255+0000","last_peered":"2024-09-12T19:14:27.337255+0000","last_clean":"2024-09-12T19:14:27.337255+0000","last_became_active":"2024-09-12T18:26:43.842479+0000","last_became_peered":"2024-09-12T18:26:43.842479+0000","last_unstale":"2024-09-12T19:14:27.337255+0000","last_undegraded":"2024-09-12T19:14:27.337255+0000","last_fullsized":"2024-09-12T19:14:27.337255+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:27.336832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:27.336832+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.336832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:05.189762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'290","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.925082+0000","last_change":"2024-09-12T19:14:31.925082+0000","last_active":"2024-09-12T19:14:31.925082+0000","last_peered":"2024-09-12T19:14:31.925082+0000","last_clean":"2024-09-12T19:14:31.925082+0000","last_became_active":"2024-09-12T18:26:46.024425+0000","last_became_peered":"2024-09-12T18:26:46.024425+0000","last_unstale":"2024-09-12T19:14:31.925082+0000","last_undegraded":"2024-09-12T19:14:31.925082+0000","last_fullsized":"2024-09-12T19:14:31.925082+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'290","last_scrub_stamp":"2024-09-12T19:14:31.924894+0000","last_deep_scrub":"265'290","last_deep_scrub_stamp":"2024-09-12T19:14:31.924894+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.924894+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:37.319952+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53269,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1121,"num_write":396,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'805","reported_seq":2376,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.127838+0000","last_change":"2024-09-12T19:14:35.127838+0000","last_active":"2024-09-12T19:14:35.127838+0000","last_peered":"2024-09-12T19:14:35.127838+0000","last_clean":"2024-09-12T19:14:35.127838+0000","last_became_active":"2024-09-12T18:26:47.898903+0000","last_became_peered":"2024-09-12T18:26:47.898903+0000","last_unstale":"2024-09-12T19:14:35.127838+0000","last_undegraded":"2024-09-12T19:14:35.127838+0000","last_fullsized":"2024-09-12T19:14:35.127838+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'805","last_scrub_stamp":"2024-09-12T19:14:35.127664+0000","last_deep_scrub":"265'805","last_deep_scrub_stamp":"2024-09-12T19:14:35.127664+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.127664+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:40.173903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'763","reported_seq":2259,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.517406+0000","last_change":"2024-09-12T19:14:17.517243+0000","last_active":"2024-09-12T19:14:17.517406+0000","last_peered":"2024-09-12T19:14:17.517406+0000","last_clean":"2024-09-12T19:14:17.517406+0000","last_became_active":"2024-09-12T18:26:41.869852+0000","last_became_peered":"2024-09-12T18:26:41.869852+0000","last_unstale":"2024-09-12T19:14:17.517406+0000","last_undegraded":"2024-09-12T19:14:17.517406+0000","last_fullsized":"2024-09-12T19:14:17.517406+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'763","last_scrub_stamp":"2024-09-12T19:14:17.517055+0000","last_deep_scrub":"265'763","last_deep_scrub_stamp":"2024-09-12T19:14:17.517055+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.517055+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:12.395779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3529,"num_read_kb":3192,"num_write":1004,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'488","reported_seq":1218,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.860766+0000","last_change":"2024-09-12T19:14:07.860628+0000","last_active":"2024-09-12T19:14:07.860766+0000","last_peered":"2024-09-12T19:14:07.860766+0000","last_clean":"2024-09-12T19:14:07.860766+0000","last_became_active":"2024-09-12T18:26:39.873512+0000","last_became_peered":"2024-09-12T18:26:39.873512+0000","last_unstale":"2024-09-12T19:14:07.860766+0000","last_undegraded":"2024-09-12T19:14:07.860766+0000","last_fullsized":"2024-09-12T19:14:07.860766+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'488","last_scrub_stamp":"2024-09-12T19:14:07.860425+0000","last_deep_scrub":"265'488","last_deep_scrub_stamp":"2024-09-12T19:14:07.860425+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.860425+0000","objects_scrubbed":9,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:17.144835+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4719716,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":925,"num_read_kb":13008,"num_write":1544,"num_write_kb":39306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.943955+0000","last_change":"2024-09-12T19:14:25.943735+0000","last_active":"2024-09-12T19:14:25.943955+0000","last_peered":"2024-09-12T19:14:25.943955+0000","last_clean":"2024-09-12T19:14:25.943955+0000","last_became_active":"2024-09-12T18:26:43.871192+0000","last_became_peered":"2024-09-12T18:26:43.871192+0000","last_unstale":"2024-09-12T19:14:25.943955+0000","last_undegraded":"2024-09-12T19:14:25.943955+0000","last_fullsized":"2024-09-12T19:14:25.943955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:25.943520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:25.943520+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.943520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:09.489365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'374","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.423698+0000","last_change":"2024-09-12T19:14:31.423562+0000","last_active":"2024-09-12T19:14:31.423698+0000","last_peered":"2024-09-12T19:14:31.423698+0000","last_clean":"2024-09-12T19:14:31.423698+0000","last_became_active":"2024-09-12T18:26:46.021239+0000","last_became_peered":"2024-09-12T18:26:46.021239+0000","last_unstale":"2024-09-12T19:14:31.423698+0000","last_undegraded":"2024-09-12T19:14:31.423698+0000","last_fullsized":"2024-09-12T19:14:31.423698+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T19:14:31.423337+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T19:14:31.423337+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.423337+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:09.733674+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43291,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":581,"num_read_kb":1196,"num_write":460,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.087460+0000","last_change":"2024-09-12T19:14:23.087460+0000","last_active":"2024-09-12T19:14:23.087460+0000","last_peered":"2024-09-12T19:14:23.087460+0000","last_clean":"2024-09-12T19:14:23.087460+0000","last_became_active":"2024-09-12T18:26:47.879079+0000","last_became_peered":"2024-09-12T18:26:47.879079+0000","last_unstale":"2024-09-12T19:14:23.087460+0000","last_undegraded":"2024-09-12T19:14:23.087460+0000","last_fullsized":"2024-09-12T19:14:23.087460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:23.087260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:23.087260+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.087260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:13.127777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'554","reported_seq":1371,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.469150+0000","last_change":"2024-09-12T19:14:35.468996+0000","last_active":"2024-09-12T19:14:35.469150+0000","last_peered":"2024-09-12T19:14:35.469150+0000","last_clean":"2024-09-12T19:14:35.469150+0000","last_became_active":"2024-09-12T18:26:49.913115+0000","last_became_peered":"2024-09-12T18:26:49.913115+0000","last_unstale":"2024-09-12T19:14:35.469150+0000","last_undegraded":"2024-09-12T19:14:35.469150+0000","last_fullsized":"2024-09-12T19:14:35.469150+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'554","last_scrub_stamp":"2024-09-12T19:14:35.468768+0000","last_deep_scrub":"265'554","last_deep_scrub_stamp":"2024-09-12T19:14:35.468768+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.468768+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:18.817640+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1285,"num_write":1159,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'406","reported_seq":1997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.255176+0000","last_change":"2024-09-12T19:14:11.255011+0000","last_active":"2024-09-12T19:14:11.255176+0000","last_peered":"2024-09-12T19:14:11.255176+0000","last_clean":"2024-09-12T19:14:11.255176+0000","last_became_active":"2024-09-12T18:26:41.854391+0000","last_became_peered":"2024-09-12T18:26:41.854391+0000","last_unstale":"2024-09-12T19:14:11.255176+0000","last_undegraded":"2024-09-12T19:14:11.255176+0000","last_fullsized":"2024-09-12T19:14:11.255176+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'406","last_scrub_stamp":"2024-09-12T19:14:11.254823+0000","last_deep_scrub":"265'406","last_deep_scrub_stamp":"2024-09-12T19:14:11.254823+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.254823+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:18.934488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2438,"num_read_kb":2340,"num_write":450,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'324","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.838638+0000","last_change":"2024-09-12T19:14:14.838638+0000","last_active":"2024-09-12T19:14:14.838638+0000","last_peered":"2024-09-12T19:14:14.838638+0000","last_clean":"2024-09-12T19:14:14.838638+0000","last_became_active":"2024-09-12T18:26:39.870641+0000","last_became_peered":"2024-09-12T18:26:39.870641+0000","last_unstale":"2024-09-12T19:14:14.838638+0000","last_undegraded":"2024-09-12T19:14:14.838638+0000","last_fullsized":"2024-09-12T19:14:14.838638+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T19:14:14.838413+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T19:14:14.838413+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.838413+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:05.370907+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":414,"num_read_kb":1418,"num_write":1020,"num_write_kb":24682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.038768+0000","last_change":"2024-09-12T19:14:16.038622+0000","last_active":"2024-09-12T19:14:16.038768+0000","last_peered":"2024-09-12T19:14:16.038768+0000","last_clean":"2024-09-12T19:14:16.038768+0000","last_became_active":"2024-09-12T18:26:43.853212+0000","last_became_peered":"2024-09-12T18:26:43.853212+0000","last_unstale":"2024-09-12T19:14:16.038768+0000","last_undegraded":"2024-09-12T19:14:16.038768+0000","last_fullsized":"2024-09-12T19:14:16.038768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:16.038447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:16.038447+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.038447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:19.209452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'268","reported_seq":844,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.140596+0000","last_change":"2024-09-12T19:14:29.140596+0000","last_active":"2024-09-12T19:14:29.140596+0000","last_peered":"2024-09-12T19:14:29.140596+0000","last_clean":"2024-09-12T19:14:29.140596+0000","last_became_active":"2024-09-12T18:26:45.865933+0000","last_became_peered":"2024-09-12T18:26:45.865933+0000","last_unstale":"2024-09-12T19:14:29.140596+0000","last_undegraded":"2024-09-12T19:14:29.140596+0000","last_fullsized":"2024-09-12T19:14:29.140596+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'268","last_scrub_stamp":"2024-09-12T19:14:29.140514+0000","last_deep_scrub":"265'268","last_deep_scrub_stamp":"2024-09-12T19:14:29.140514+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.140514+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:19.695815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":1093,"num_write":368,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.127307+0000","last_change":"2024-09-12T19:14:37.127144+0000","last_active":"2024-09-12T19:14:37.127307+0000","last_peered":"2024-09-12T19:14:37.127307+0000","last_clean":"2024-09-12T19:14:37.127307+0000","last_became_active":"2024-09-12T18:26:47.898056+0000","last_became_peered":"2024-09-12T18:26:47.898056+0000","last_unstale":"2024-09-12T19:14:37.127307+0000","last_undegraded":"2024-09-12T19:14:37.127307+0000","last_fullsized":"2024-09-12T19:14:37.127307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:37.126949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:37.126949+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.126949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:10.568305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'129","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.628744+0000","last_change":"2024-09-12T19:14:27.628586+0000","last_active":"2024-09-12T19:14:27.628744+0000","last_peered":"2024-09-12T19:14:27.628744+0000","last_clean":"2024-09-12T19:14:27.628744+0000","last_became_active":"2024-09-12T18:26:49.913180+0000","last_became_peered":"2024-09-12T18:26:49.913180+0000","last_unstale":"2024-09-12T19:14:27.628744+0000","last_undegraded":"2024-09-12T19:14:27.628744+0000","last_fullsized":"2024-09-12T19:14:27.628744+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T19:14:27.628402+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T19:14:27.628402+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.628402+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:51.688502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'516","reported_seq":2069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.594030+0000","last_change":"2024-09-12T19:14:17.593883+0000","last_active":"2024-09-12T19:14:17.594030+0000","last_peered":"2024-09-12T19:14:17.594030+0000","last_clean":"2024-09-12T19:14:17.594030+0000","last_became_active":"2024-09-12T18:26:41.873229+0000","last_became_peered":"2024-09-12T18:26:41.873229+0000","last_unstale":"2024-09-12T19:14:17.594030+0000","last_undegraded":"2024-09-12T19:14:17.594030+0000","last_fullsized":"2024-09-12T19:14:17.594030+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'516","last_scrub_stamp":"2024-09-12T19:14:17.593701+0000","last_deep_scrub":"265'516","last_deep_scrub_stamp":"2024-09-12T19:14:17.593701+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.593701+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:37.476864+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2942,"num_read_kb":2741,"num_write":656,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'373","reported_seq":1160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.839637+0000","last_change":"2024-09-12T19:14:06.839637+0000","last_active":"2024-09-12T19:14:06.839637+0000","last_peered":"2024-09-12T19:14:06.839637+0000","last_clean":"2024-09-12T19:14:06.839637+0000","last_became_active":"2024-09-12T18:26:39.865148+0000","last_became_peered":"2024-09-12T18:26:39.865148+0000","last_unstale":"2024-09-12T19:14:06.839637+0000","last_undegraded":"2024-09-12T19:14:06.839637+0000","last_fullsized":"2024-09-12T19:14:06.839637+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T19:14:06.839379+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T19:14:06.839379+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.839379+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:03.080191+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":883,"num_read_kb":25450,"num_write":1078,"num_write_kb":40926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.978124+0000","last_change":"2024-09-12T19:14:17.978124+0000","last_active":"2024-09-12T19:14:17.978124+0000","last_peered":"2024-09-12T19:14:17.978124+0000","last_clean":"2024-09-12T19:14:17.978124+0000","last_became_active":"2024-09-12T18:26:43.853084+0000","last_became_peered":"2024-09-12T18:26:43.853084+0000","last_unstale":"2024-09-12T19:14:17.978124+0000","last_undegraded":"2024-09-12T19:14:17.978124+0000","last_fullsized":"2024-09-12T19:14:17.978124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:17.977941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:17.977941+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.977941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:53.773804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'315","reported_seq":904,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.992045+0000","last_change":"2024-09-12T19:14:29.992045+0000","last_active":"2024-09-12T19:14:29.992045+0000","last_peered":"2024-09-12T19:14:29.992045+0000","last_clean":"2024-09-12T19:14:29.992045+0000","last_became_active":"2024-09-12T18:26:45.866325+0000","last_became_peered":"2024-09-12T18:26:45.866325+0000","last_unstale":"2024-09-12T19:14:29.992045+0000","last_undegraded":"2024-09-12T19:14:29.992045+0000","last_fullsized":"2024-09-12T19:14:29.992045+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T19:14:29.991846+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T19:14:29.991846+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.991846+0000","objects_scrubbed":8,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:32.915033+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64639,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":1214,"num_write":426,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'793","reported_seq":2660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.570416+0000","last_change":"2024-09-12T19:14:29.570416+0000","last_active":"2024-09-12T19:14:29.570416+0000","last_peered":"2024-09-12T19:14:29.570416+0000","last_clean":"2024-09-12T19:14:29.570416+0000","last_became_active":"2024-09-12T18:26:47.878956+0000","last_became_peered":"2024-09-12T18:26:47.878956+0000","last_unstale":"2024-09-12T19:14:29.570416+0000","last_undegraded":"2024-09-12T19:14:29.570416+0000","last_fullsized":"2024-09-12T19:14:29.570416+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'793","last_scrub_stamp":"2024-09-12T19:14:29.570202+0000","last_deep_scrub":"265'793","last_deep_scrub_stamp":"2024-09-12T19:14:29.570202+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.570202+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:44.401820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'149","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.666439+0000","last_change":"2024-09-12T19:14:33.666295+0000","last_active":"2024-09-12T19:14:33.666439+0000","last_peered":"2024-09-12T19:14:33.666439+0000","last_clean":"2024-09-12T19:14:33.666439+0000","last_became_active":"2024-09-12T18:26:49.926384+0000","last_became_peered":"2024-09-12T18:26:49.926384+0000","last_unstale":"2024-09-12T19:14:33.666439+0000","last_undegraded":"2024-09-12T19:14:33.666439+0000","last_fullsized":"2024-09-12T19:14:33.666439+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'149","last_scrub_stamp":"2024-09-12T19:14:33.666118+0000","last_deep_scrub":"265'149","last_deep_scrub_stamp":"2024-09-12T19:14:33.666118+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.666118+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:55.329801+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":361,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'695","reported_seq":2124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.634374+0000","last_change":"2024-09-12T19:14:24.634374+0000","last_active":"2024-09-12T19:14:24.634374+0000","last_peered":"2024-09-12T19:14:24.634374+0000","last_clean":"2024-09-12T19:14:24.634374+0000","last_became_active":"2024-09-12T18:26:41.846589+0000","last_became_peered":"2024-09-12T18:26:41.846589+0000","last_unstale":"2024-09-12T19:14:24.634374+0000","last_undegraded":"2024-09-12T19:14:24.634374+0000","last_fullsized":"2024-09-12T19:14:24.634374+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'695","last_scrub_stamp":"2024-09-12T19:14:24.634180+0000","last_deep_scrub":"265'695","last_deep_scrub_stamp":"2024-09-12T19:14:24.634180+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.634180+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":600,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:28.875628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3315,"num_read_kb":3003,"num_write":914,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'320","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.671103+0000","last_change":"2024-09-12T19:14:13.671103+0000","last_active":"2024-09-12T19:14:13.671103+0000","last_peered":"2024-09-12T19:14:13.671103+0000","last_clean":"2024-09-12T19:14:13.671103+0000","last_became_active":"2024-09-12T18:26:39.849950+0000","last_became_peered":"2024-09-12T18:26:39.849950+0000","last_unstale":"2024-09-12T19:14:13.671103+0000","last_undegraded":"2024-09-12T19:14:13.671103+0000","last_fullsized":"2024-09-12T19:14:13.671103+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-12T19:14:13.670923+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-12T19:14:13.670923+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.670923+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:21.214840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67871,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":33808,"num_write":1047,"num_write_kb":22667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.020856+0000","last_change":"2024-09-12T19:14:17.020705+0000","last_active":"2024-09-12T19:14:17.020856+0000","last_peered":"2024-09-12T19:14:17.020856+0000","last_clean":"2024-09-12T19:14:17.020856+0000","last_became_active":"2024-09-12T18:26:43.874837+0000","last_became_peered":"2024-09-12T18:26:43.874837+0000","last_unstale":"2024-09-12T19:14:17.020856+0000","last_undegraded":"2024-09-12T19:14:17.020856+0000","last_fullsized":"2024-09-12T19:14:17.020856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:17.020520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:17.020520+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.020520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:48.881506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'463","reported_seq":1104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.750171+0000","last_change":"2024-09-12T19:14:18.750004+0000","last_active":"2024-09-12T19:14:18.750171+0000","last_peered":"2024-09-12T19:14:18.750171+0000","last_clean":"2024-09-12T19:14:18.750171+0000","last_became_active":"2024-09-12T18:26:45.875223+0000","last_became_peered":"2024-09-12T18:26:45.875223+0000","last_unstale":"2024-09-12T19:14:18.750171+0000","last_undegraded":"2024-09-12T19:14:18.750171+0000","last_fullsized":"2024-09-12T19:14:18.750171+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'463","last_scrub_stamp":"2024-09-12T19:14:18.749757+0000","last_deep_scrub":"265'463","last_deep_scrub_stamp":"2024-09-12T19:14:18.749757+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.749757+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:18.294446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89882,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":808,"num_read_kb":1944,"num_write":662,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.919177+0000","last_change":"2024-09-12T19:14:22.919044+0000","last_active":"2024-09-12T19:14:22.919177+0000","last_peered":"2024-09-12T19:14:22.919177+0000","last_clean":"2024-09-12T19:14:22.919177+0000","last_became_active":"2024-09-12T18:26:47.891736+0000","last_became_peered":"2024-09-12T18:26:47.891736+0000","last_unstale":"2024-09-12T19:14:22.919177+0000","last_undegraded":"2024-09-12T19:14:22.919177+0000","last_fullsized":"2024-09-12T19:14:22.919177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:22.918866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:22.918866+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.918866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:26.902442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'132","reported_seq":664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.138544+0000","last_change":"2024-09-12T19:14:31.138382+0000","last_active":"2024-09-12T19:14:31.138544+0000","last_peered":"2024-09-12T19:14:31.138544+0000","last_clean":"2024-09-12T19:14:31.138544+0000","last_became_active":"2024-09-12T18:26:49.904633+0000","last_became_peered":"2024-09-12T18:26:49.904633+0000","last_unstale":"2024-09-12T19:14:31.138544+0000","last_undegraded":"2024-09-12T19:14:31.138544+0000","last_fullsized":"2024-09-12T19:14:31.138544+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-12T19:14:31.138190+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-12T19:14:31.138190+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.138190+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:17.704300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":176,"num_write":324,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'686","reported_seq":2227,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.254200+0000","last_change":"2024-09-12T19:14:10.254200+0000","last_active":"2024-09-12T19:14:10.254200+0000","last_peered":"2024-09-12T19:14:10.254200+0000","last_clean":"2024-09-12T19:14:10.254200+0000","last_became_active":"2024-09-12T18:26:41.852958+0000","last_became_peered":"2024-09-12T18:26:41.852958+0000","last_unstale":"2024-09-12T19:14:10.254200+0000","last_undegraded":"2024-09-12T19:14:10.254200+0000","last_fullsized":"2024-09-12T19:14:10.254200+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'686","last_scrub_stamp":"2024-09-12T19:14:10.253985+0000","last_deep_scrub":"265'686","last_deep_scrub_stamp":"2024-09-12T19:14:10.253985+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.253985+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:57.088986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3047,"num_write":870,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'348","reported_seq":1026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.823078+0000","last_change":"2024-09-12T19:14:07.823078+0000","last_active":"2024-09-12T19:14:07.823078+0000","last_peered":"2024-09-12T19:14:07.823078+0000","last_clean":"2024-09-12T19:14:07.823078+0000","last_became_active":"2024-09-12T18:26:39.842671+0000","last_became_peered":"2024-09-12T18:26:39.842671+0000","last_unstale":"2024-09-12T19:14:07.823078+0000","last_undegraded":"2024-09-12T19:14:07.823078+0000","last_fullsized":"2024-09-12T19:14:07.823078+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T19:14:07.822813+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T19:14:07.822813+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.822813+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:55.357796+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1239003,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":38368,"num_write":1135,"num_write_kb":24127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.990290+0000","last_change":"2024-09-12T19:14:18.990290+0000","last_active":"2024-09-12T19:14:18.990290+0000","last_peered":"2024-09-12T19:14:18.990290+0000","last_clean":"2024-09-12T19:14:18.990290+0000","last_became_active":"2024-09-12T18:26:43.863615+0000","last_became_peered":"2024-09-12T18:26:43.863615+0000","last_unstale":"2024-09-12T19:14:18.990290+0000","last_undegraded":"2024-09-12T19:14:18.990290+0000","last_fullsized":"2024-09-12T19:14:18.990290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:18.990106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:18.990106+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.990106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:09.209296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'300","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.394027+0000","last_change":"2024-09-12T19:14:30.394027+0000","last_active":"2024-09-12T19:14:30.394027+0000","last_peered":"2024-09-12T19:14:30.394027+0000","last_clean":"2024-09-12T19:14:30.394027+0000","last_became_active":"2024-09-12T18:26:45.864308+0000","last_became_peered":"2024-09-12T18:26:45.864308+0000","last_unstale":"2024-09-12T19:14:30.394027+0000","last_undegraded":"2024-09-12T19:14:30.394027+0000","last_fullsized":"2024-09-12T19:14:30.394027+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'300","last_scrub_stamp":"2024-09-12T19:14:30.393706+0000","last_deep_scrub":"265'300","last_deep_scrub_stamp":"2024-09-12T19:14:30.393706+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.393706+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:59.921731+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1125,"num_write":460,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.610186+0000","last_change":"2024-09-12T19:14:30.610186+0000","last_active":"2024-09-12T19:14:30.610186+0000","last_peered":"2024-09-12T19:14:30.610186+0000","last_clean":"2024-09-12T19:14:30.610186+0000","last_became_active":"2024-09-12T18:26:47.903984+0000","last_became_peered":"2024-09-12T18:26:47.903984+0000","last_unstale":"2024-09-12T19:14:30.610186+0000","last_undegraded":"2024-09-12T19:14:30.610186+0000","last_fullsized":"2024-09-12T19:14:30.610186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:30.610001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:30.610001+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.610001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:49.149778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'130","reported_seq":636,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:13:33.389715+0000","last_change":"2024-09-12T18:26:49.917735+0000","last_active":"2024-09-12T19:13:33.389715+0000","last_peered":"2024-09-12T19:13:33.389715+0000","last_clean":"2024-09-12T19:13:33.389715+0000","last_became_active":"2024-09-12T18:26:49.916255+0000","last_became_peered":"2024-09-12T18:26:49.916255+0000","last_unstale":"2024-09-12T19:13:33.389715+0000","last_undegraded":"2024-09-12T19:13:33.389715+0000","last_fullsized":"2024-09-12T19:13:33.389715+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T18:26:48.866488+0000","last_clean_scrub_stamp":"2024-09-12T18:26:48.866488+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":172,"num_read_kb":153,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'482","reported_seq":2167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.282073+0000","last_change":"2024-09-12T19:14:14.282073+0000","last_active":"2024-09-12T19:14:14.282073+0000","last_peered":"2024-09-12T19:14:14.282073+0000","last_clean":"2024-09-12T19:14:14.282073+0000","last_became_active":"2024-09-12T18:26:41.851789+0000","last_became_peered":"2024-09-12T18:26:41.851789+0000","last_unstale":"2024-09-12T19:14:14.282073+0000","last_undegraded":"2024-09-12T19:14:14.282073+0000","last_fullsized":"2024-09-12T19:14:14.282073+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'482","last_scrub_stamp":"2024-09-12T19:14:14.281887+0000","last_deep_scrub":"265'482","last_deep_scrub_stamp":"2024-09-12T19:14:14.281887+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.281887+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:45.318532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2754,"num_read_kb":2601,"num_write":570,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'400","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.541035+0000","last_change":"2024-09-12T19:14:08.540889+0000","last_active":"2024-09-12T19:14:08.541035+0000","last_peered":"2024-09-12T19:14:08.541035+0000","last_clean":"2024-09-12T19:14:08.541035+0000","last_became_active":"2024-09-12T18:26:39.849392+0000","last_became_peered":"2024-09-12T18:26:39.849392+0000","last_unstale":"2024-09-12T19:14:08.541035+0000","last_undegraded":"2024-09-12T19:14:08.541035+0000","last_fullsized":"2024-09-12T19:14:08.541035+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'400","last_scrub_stamp":"2024-09-12T19:14:08.540659+0000","last_deep_scrub":"265'400","last_deep_scrub_stamp":"2024-09-12T19:14:08.540659+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.540659+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:17.495615+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568421,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":663,"num_read_kb":7425,"num_write":1171,"num_write_kb":13361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.128970+0000","last_change":"2024-09-12T19:14:24.128970+0000","last_active":"2024-09-12T19:14:24.128970+0000","last_peered":"2024-09-12T19:14:24.128970+0000","last_clean":"2024-09-12T19:14:24.128970+0000","last_became_active":"2024-09-12T18:26:43.877257+0000","last_became_peered":"2024-09-12T18:26:43.877257+0000","last_unstale":"2024-09-12T19:14:24.128970+0000","last_undegraded":"2024-09-12T19:14:24.128970+0000","last_fullsized":"2024-09-12T19:14:24.128970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:24.128757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:24.128757+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.128757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:40.291222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'294","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.969182+0000","last_change":"2024-09-12T19:14:19.969182+0000","last_active":"2024-09-12T19:14:19.969182+0000","last_peered":"2024-09-12T19:14:19.969182+0000","last_clean":"2024-09-12T19:14:19.969182+0000","last_became_active":"2024-09-12T18:26:45.861947+0000","last_became_peered":"2024-09-12T18:26:45.861947+0000","last_unstale":"2024-09-12T19:14:19.969182+0000","last_undegraded":"2024-09-12T19:14:19.969182+0000","last_fullsized":"2024-09-12T19:14:19.969182+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T19:14:19.968867+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T19:14:19.968867+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.968867+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:54.486748+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50433,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":477,"num_read_kb":1052,"num_write":380,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'756","reported_seq":2389,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.932810+0000","last_change":"2024-09-12T19:14:20.932810+0000","last_active":"2024-09-12T19:14:20.932810+0000","last_peered":"2024-09-12T19:14:20.932810+0000","last_clean":"2024-09-12T19:14:20.932810+0000","last_became_active":"2024-09-12T18:26:47.880400+0000","last_became_peered":"2024-09-12T18:26:47.880400+0000","last_unstale":"2024-09-12T19:14:20.932810+0000","last_undegraded":"2024-09-12T19:14:20.932810+0000","last_fullsized":"2024-09-12T19:14:20.932810+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'756","last_scrub_stamp":"2024-09-12T19:14:20.932627+0000","last_deep_scrub":"265'756","last_deep_scrub_stamp":"2024-09-12T19:14:20.932627+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.932627+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:26.073326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'142","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.141956+0000","last_change":"2024-09-12T19:14:25.141820+0000","last_active":"2024-09-12T19:14:25.141956+0000","last_peered":"2024-09-12T19:14:25.141956+0000","last_clean":"2024-09-12T19:14:25.141956+0000","last_became_active":"2024-09-12T18:26:49.913762+0000","last_became_peered":"2024-09-12T18:26:49.913762+0000","last_unstale":"2024-09-12T19:14:25.141956+0000","last_undegraded":"2024-09-12T19:14:25.141956+0000","last_fullsized":"2024-09-12T19:14:25.141956+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T19:14:25.141622+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T19:14:25.141622+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.141622+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:49.383630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":330,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'795","reported_seq":2371,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.242878+0000","last_change":"2024-09-12T19:14:12.242878+0000","last_active":"2024-09-12T19:14:12.242878+0000","last_peered":"2024-09-12T19:14:12.242878+0000","last_clean":"2024-09-12T19:14:12.242878+0000","last_became_active":"2024-09-12T18:26:41.866528+0000","last_became_peered":"2024-09-12T18:26:41.866528+0000","last_unstale":"2024-09-12T19:14:12.242878+0000","last_undegraded":"2024-09-12T19:14:12.242878+0000","last_fullsized":"2024-09-12T19:14:12.242878+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'795","last_scrub_stamp":"2024-09-12T19:14:12.242691+0000","last_deep_scrub":"265'795","last_deep_scrub_stamp":"2024-09-12T19:14:12.242691+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.242691+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:57.776142+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3788,"num_read_kb":3420,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'343","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.298428+0000","last_change":"2024-09-12T19:14:07.298219+0000","last_active":"2024-09-12T19:14:07.298428+0000","last_peered":"2024-09-12T19:14:07.298428+0000","last_clean":"2024-09-12T19:14:07.298428+0000","last_became_active":"2024-09-12T18:26:39.839762+0000","last_became_peered":"2024-09-12T18:26:39.839762+0000","last_unstale":"2024-09-12T19:14:07.298428+0000","last_undegraded":"2024-09-12T19:14:07.298428+0000","last_fullsized":"2024-09-12T19:14:07.298428+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:14:07.298004+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:14:07.298004+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.298004+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:50.827849+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1967405,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":414,"num_read_kb":30496,"num_write":1045,"num_write_kb":26286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.296902+0000","last_change":"2024-09-12T19:14:25.296902+0000","last_active":"2024-09-12T19:14:25.296902+0000","last_peered":"2024-09-12T19:14:25.296902+0000","last_clean":"2024-09-12T19:14:25.296902+0000","last_became_active":"2024-09-12T18:26:43.861969+0000","last_became_peered":"2024-09-12T18:26:43.861969+0000","last_unstale":"2024-09-12T19:14:25.296902+0000","last_undegraded":"2024-09-12T19:14:25.296902+0000","last_fullsized":"2024-09-12T19:14:25.296902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:25.296671+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:25.296671+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.296671+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:25.230803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'82","reported_seq":607,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.147478+0000","last_change":"2024-09-12T19:14:30.147478+0000","last_active":"2024-09-12T19:14:30.147478+0000","last_peered":"2024-09-12T19:14:30.147478+0000","last_clean":"2024-09-12T19:14:30.147478+0000","last_became_active":"2024-09-12T18:26:46.019895+0000","last_became_peered":"2024-09-12T18:26:46.019895+0000","last_unstale":"2024-09-12T19:14:30.147478+0000","last_undegraded":"2024-09-12T19:14:30.147478+0000","last_fullsized":"2024-09-12T19:14:30.147478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'82","last_scrub_stamp":"2024-09-12T19:14:30.147252+0000","last_deep_scrub":"265'82","last_deep_scrub_stamp":"2024-09-12T19:14:30.147252+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.147252+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.755307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'770","reported_seq":4382,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.673781+0000","last_change":"2024-09-12T19:14:23.673781+0000","last_active":"2024-09-12T19:14:23.673781+0000","last_peered":"2024-09-12T19:14:23.673781+0000","last_clean":"2024-09-12T19:14:23.673781+0000","last_became_active":"2024-09-12T18:26:47.882417+0000","last_became_peered":"2024-09-12T18:26:47.882417+0000","last_unstale":"2024-09-12T19:14:23.673781+0000","last_undegraded":"2024-09-12T19:14:23.673781+0000","last_fullsized":"2024-09-12T19:14:23.673781+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'770","last_scrub_stamp":"2024-09-12T19:14:23.673552+0000","last_deep_scrub":"265'770","last_deep_scrub_stamp":"2024-09-12T19:14:23.673552+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.673552+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":701,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:41.286038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'147","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.409211+0000","last_change":"2024-09-12T19:14:40.409054+0000","last_active":"2024-09-12T19:14:40.409211+0000","last_peered":"2024-09-12T19:14:40.409211+0000","last_clean":"2024-09-12T19:14:40.409211+0000","last_became_active":"2024-09-12T18:26:49.926637+0000","last_became_peered":"2024-09-12T18:26:49.926637+0000","last_unstale":"2024-09-12T19:14:40.409211+0000","last_undegraded":"2024-09-12T19:14:40.409211+0000","last_fullsized":"2024-09-12T19:14:40.409211+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'147","last_scrub_stamp":"2024-09-12T19:14:40.408868+0000","last_deep_scrub":"265'147","last_deep_scrub_stamp":"2024-09-12T19:14:40.408868+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.408868+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:45.542033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":120,"num_write":360,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'756","reported_seq":2278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.078131+0000","last_change":"2024-09-12T19:14:13.078131+0000","last_active":"2024-09-12T19:14:13.078131+0000","last_peered":"2024-09-12T19:14:13.078131+0000","last_clean":"2024-09-12T19:14:13.078131+0000","last_became_active":"2024-09-12T18:26:41.839152+0000","last_became_peered":"2024-09-12T18:26:41.839152+0000","last_unstale":"2024-09-12T19:14:13.078131+0000","last_undegraded":"2024-09-12T19:14:13.078131+0000","last_fullsized":"2024-09-12T19:14:13.078131+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'756","last_scrub_stamp":"2024-09-12T19:14:13.077954+0000","last_deep_scrub":"265'756","last_deep_scrub_stamp":"2024-09-12T19:14:13.077954+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.077954+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:32.408093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3609,"num_read_kb":3261,"num_write":1016,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'377","reported_seq":1249,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.786508+0000","last_change":"2024-09-12T19:14:08.786353+0000","last_active":"2024-09-12T19:14:08.786508+0000","last_peered":"2024-09-12T19:14:08.786508+0000","last_clean":"2024-09-12T19:14:08.786508+0000","last_became_active":"2024-09-12T18:26:39.839018+0000","last_became_peered":"2024-09-12T18:26:39.839018+0000","last_unstale":"2024-09-12T19:14:08.786508+0000","last_undegraded":"2024-09-12T19:14:08.786508+0000","last_fullsized":"2024-09-12T19:14:08.786508+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:14:08.786149+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:14:08.786149+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.786149+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:20.356579+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88291,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":988,"num_read_kb":16661,"num_write":1246,"num_write_kb":29221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.384473+0000","last_change":"2024-09-12T19:14:26.384473+0000","last_active":"2024-09-12T19:14:26.384473+0000","last_peered":"2024-09-12T19:14:26.384473+0000","last_clean":"2024-09-12T19:14:26.384473+0000","last_became_active":"2024-09-12T18:26:43.872882+0000","last_became_peered":"2024-09-12T18:26:43.872882+0000","last_unstale":"2024-09-12T19:14:26.384473+0000","last_undegraded":"2024-09-12T19:14:26.384473+0000","last_fullsized":"2024-09-12T19:14:26.384473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.384291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.384291+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.384291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:56.838256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'404","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.395106+0000","last_change":"2024-09-12T19:14:30.395106+0000","last_active":"2024-09-12T19:14:30.395106+0000","last_peered":"2024-09-12T19:14:30.395106+0000","last_clean":"2024-09-12T19:14:30.395106+0000","last_became_active":"2024-09-12T18:26:45.871011+0000","last_became_peered":"2024-09-12T18:26:45.871011+0000","last_unstale":"2024-09-12T19:14:30.395106+0000","last_undegraded":"2024-09-12T19:14:30.395106+0000","last_fullsized":"2024-09-12T19:14:30.395106+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T19:14:30.394900+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T19:14:30.394900+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.394900+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:57.258839+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47428,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1195,"num_read_kb":1786,"num_write":1700,"num_write_kb":1538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488484,"num_omap_keys":1128,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.641621+0000","last_change":"2024-09-12T19:14:22.641621+0000","last_active":"2024-09-12T19:14:22.641621+0000","last_peered":"2024-09-12T19:14:22.641621+0000","last_clean":"2024-09-12T19:14:22.641621+0000","last_became_active":"2024-09-12T18:26:47.893881+0000","last_became_peered":"2024-09-12T18:26:47.893881+0000","last_unstale":"2024-09-12T19:14:22.641621+0000","last_undegraded":"2024-09-12T19:14:22.641621+0000","last_fullsized":"2024-09-12T19:14:22.641621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:22.641442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:22.641442+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.641442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:34.196498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'161","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.121134+0000","last_change":"2024-09-12T19:14:30.120976+0000","last_active":"2024-09-12T19:14:30.121134+0000","last_peered":"2024-09-12T19:14:30.121134+0000","last_clean":"2024-09-12T19:14:30.121134+0000","last_became_active":"2024-09-12T18:26:49.911403+0000","last_became_peered":"2024-09-12T18:26:49.911403+0000","last_unstale":"2024-09-12T19:14:30.121134+0000","last_undegraded":"2024-09-12T19:14:30.121134+0000","last_fullsized":"2024-09-12T19:14:30.121134+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'161","last_scrub_stamp":"2024-09-12T19:14:30.120766+0000","last_deep_scrub":"265'161","last_deep_scrub_stamp":"2024-09-12T19:14:30.120766+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.120766+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:49.239056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":152,"num_write":383,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'826","reported_seq":2340,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.591722+0000","last_change":"2024-09-12T19:14:15.591537+0000","last_active":"2024-09-12T19:14:15.591722+0000","last_peered":"2024-09-12T19:14:15.591722+0000","last_clean":"2024-09-12T19:14:15.591722+0000","last_became_active":"2024-09-12T18:26:41.873329+0000","last_became_peered":"2024-09-12T18:26:41.873329+0000","last_unstale":"2024-09-12T19:14:15.591722+0000","last_undegraded":"2024-09-12T19:14:15.591722+0000","last_fullsized":"2024-09-12T19:14:15.591722+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'826","last_scrub_stamp":"2024-09-12T19:14:15.591318+0000","last_deep_scrub":"265'826","last_deep_scrub_stamp":"2024-09-12T19:14:15.591318+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.591318+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:40.100277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3864,"num_read_kb":3455,"num_write":1112,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.823308+0000","last_change":"2024-09-12T19:14:05.823046+0000","last_active":"2024-09-12T19:14:05.823308+0000","last_peered":"2024-09-12T19:14:05.823308+0000","last_clean":"2024-09-12T19:14:05.823308+0000","last_became_active":"2024-09-12T18:26:20.488464+0000","last_became_peered":"2024-09-12T18:26:20.488464+0000","last_unstale":"2024-09-12T19:14:05.823308+0000","last_undegraded":"2024-09-12T19:14:05.823308+0000","last_fullsized":"2024-09-12T19:14:05.823308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T19:14:05.822803+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T19:14:05.822803+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.822803+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:50.624649+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.565231+0000","last_change":"2024-09-12T19:14:06.564974+0000","last_active":"2024-09-12T19:14:06.565231+0000","last_peered":"2024-09-12T19:14:06.565231+0000","last_clean":"2024-09-12T19:14:06.565231+0000","last_became_active":"2024-09-12T18:26:25.483072+0000","last_became_peered":"2024-09-12T18:26:25.483072+0000","last_unstale":"2024-09-12T19:14:06.565231+0000","last_undegraded":"2024-09-12T19:14:06.565231+0000","last_fullsized":"2024-09-12T19:14:06.565231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:06.564760+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:06.564760+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.564760+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:34.986549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010071489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'369","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:03.767534+0000","last_change":"2024-09-12T19:14:03.767482+0000","last_active":"2024-09-12T19:14:03.767534+0000","last_peered":"2024-09-12T19:14:03.767534+0000","last_clean":"2024-09-12T19:14:03.767534+0000","last_became_active":"2024-09-12T18:26:39.855274+0000","last_became_peered":"2024-09-12T18:26:39.855274+0000","last_unstale":"2024-09-12T19:14:03.767534+0000","last_undegraded":"2024-09-12T19:14:03.767534+0000","last_fullsized":"2024-09-12T19:14:03.767534+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'369","last_scrub_stamp":"2024-09-12T19:14:03.767414+0000","last_deep_scrub":"265'369","last_deep_scrub_stamp":"2024-09-12T19:14:03.767414+0000","last_clean_scrub_stamp":"2024-09-12T19:14:03.767414+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:11.994783+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399238,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":585,"num_read_kb":43416,"num_write":1148,"num_write_kb":32341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"265'4","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.885397+0000","last_change":"2024-09-12T19:14:22.885214+0000","last_active":"2024-09-12T19:14:22.885397+0000","last_peered":"2024-09-12T19:14:22.885397+0000","last_clean":"2024-09-12T19:14:22.885397+0000","last_became_active":"2024-09-12T18:26:43.862599+0000","last_became_peered":"2024-09-12T18:26:43.862599+0000","last_unstale":"2024-09-12T19:14:22.885397+0000","last_undegraded":"2024-09-12T19:14:22.885397+0000","last_fullsized":"2024-09-12T19:14:22.885397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:22.885024+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:22.885024+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.885024+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:30.442155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'724","reported_seq":1431,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.410071+0000","last_change":"2024-09-12T19:14:29.410071+0000","last_active":"2024-09-12T19:14:29.410071+0000","last_peered":"2024-09-12T19:14:29.410071+0000","last_clean":"2024-09-12T19:14:29.410071+0000","last_became_active":"2024-09-12T18:26:45.870711+0000","last_became_peered":"2024-09-12T18:26:45.870711+0000","last_unstale":"2024-09-12T19:14:29.410071+0000","last_undegraded":"2024-09-12T19:14:29.410071+0000","last_fullsized":"2024-09-12T19:14:29.410071+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'724","last_scrub_stamp":"2024-09-12T19:14:29.409865+0000","last_deep_scrub":"265'724","last_deep_scrub_stamp":"2024-09-12T19:14:29.409865+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.409865+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:32.681147+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152164,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1400,"num_read_kb":3258,"num_write":1288,"num_write_kb":1147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89484,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.621767+0000","last_change":"2024-09-12T19:14:26.621630+0000","last_active":"2024-09-12T19:14:26.621767+0000","last_peered":"2024-09-12T19:14:26.621767+0000","last_clean":"2024-09-12T19:14:26.621767+0000","last_became_active":"2024-09-12T18:26:47.886696+0000","last_became_peered":"2024-09-12T18:26:47.886696+0000","last_unstale":"2024-09-12T19:14:26.621767+0000","last_undegraded":"2024-09-12T19:14:26.621767+0000","last_fullsized":"2024-09-12T19:14:26.621767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.621440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.621440+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.621440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:12.826430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'177","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.599030+0000","last_change":"2024-09-12T19:14:28.598889+0000","last_active":"2024-09-12T19:14:28.599030+0000","last_peered":"2024-09-12T19:14:28.599030+0000","last_clean":"2024-09-12T19:14:28.599030+0000","last_became_active":"2024-09-12T18:26:49.909591+0000","last_became_peered":"2024-09-12T18:26:49.909591+0000","last_unstale":"2024-09-12T19:14:28.599030+0000","last_undegraded":"2024-09-12T19:14:28.599030+0000","last_fullsized":"2024-09-12T19:14:28.599030+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'177","last_scrub_stamp":"2024-09-12T19:14:28.598710+0000","last_deep_scrub":"265'177","last_deep_scrub_stamp":"2024-09-12T19:14:28.598710+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.598710+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:25.270781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":451,"num_write":354,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'449","reported_seq":1934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.828712+0000","last_change":"2024-09-12T19:14:09.828560+0000","last_active":"2024-09-12T19:14:09.828712+0000","last_peered":"2024-09-12T19:14:09.828712+0000","last_clean":"2024-09-12T19:14:09.828712+0000","last_became_active":"2024-09-12T18:27:11.825677+0000","last_became_peered":"2024-09-12T18:27:11.825677+0000","last_unstale":"2024-09-12T19:14:09.828712+0000","last_undegraded":"2024-09-12T19:14:09.828712+0000","last_fullsized":"2024-09-12T19:14:09.828712+0000","mapping_epoch":37,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'449","last_scrub_stamp":"2024-09-12T19:14:09.828367+0000","last_deep_scrub":"265'449","last_deep_scrub_stamp":"2024-09-12T19:14:09.828367+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.828367+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:10.327973+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2226,"num_read_kb":2089,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.817334+0000","last_change":"2024-09-12T19:14:09.817097+0000","last_active":"2024-09-12T19:14:09.817334+0000","last_peered":"2024-09-12T19:14:09.817334+0000","last_clean":"2024-09-12T19:14:09.817334+0000","last_became_active":"2024-09-12T18:26:25.486681+0000","last_became_peered":"2024-09-12T18:26:25.486681+0000","last_unstale":"2024-09-12T19:14:09.817334+0000","last_undegraded":"2024-09-12T19:14:09.817334+0000","last_fullsized":"2024-09-12T19:14:09.817334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:09.816815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:09.816815+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.816815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:48.920838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001127308,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'447","reported_seq":1102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:02.915533+0000","last_change":"2024-09-12T19:14:02.915481+0000","last_active":"2024-09-12T19:14:02.915533+0000","last_peered":"2024-09-12T19:14:02.915533+0000","last_clean":"2024-09-12T19:14:02.915533+0000","last_became_active":"2024-09-12T18:26:39.852604+0000","last_became_peered":"2024-09-12T18:26:39.852604+0000","last_unstale":"2024-09-12T19:14:02.915533+0000","last_undegraded":"2024-09-12T19:14:02.915533+0000","last_fullsized":"2024-09-12T19:14:02.915533+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'447","last_scrub_stamp":"2024-09-12T19:14:02.915389+0000","last_deep_scrub":"265'447","last_deep_scrub_stamp":"2024-09-12T19:14:02.915389+0000","last_clean_scrub_stamp":"2024-09-12T19:14:02.915389+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:58.385296+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1797992,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":612,"num_read_kb":8884,"num_write":1284,"num_write_kb":32875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.332526+0000","last_change":"2024-09-12T19:14:24.332526+0000","last_active":"2024-09-12T19:14:24.332526+0000","last_peered":"2024-09-12T19:14:24.332526+0000","last_clean":"2024-09-12T19:14:24.332526+0000","last_became_active":"2024-09-12T18:26:43.857619+0000","last_became_peered":"2024-09-12T18:26:43.857619+0000","last_unstale":"2024-09-12T19:14:24.332526+0000","last_undegraded":"2024-09-12T19:14:24.332526+0000","last_fullsized":"2024-09-12T19:14:24.332526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:24.332345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:24.332345+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.332345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:34.488154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1288","reported_seq":2804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.136233+0000","last_change":"2024-09-12T19:14:29.136156+0000","last_active":"2024-09-12T19:14:29.136233+0000","last_peered":"2024-09-12T19:14:29.136233+0000","last_clean":"2024-09-12T19:14:29.136233+0000","last_became_active":"2024-09-12T18:26:45.865530+0000","last_became_peered":"2024-09-12T18:26:45.865530+0000","last_unstale":"2024-09-12T19:14:29.136233+0000","last_undegraded":"2024-09-12T19:14:29.136233+0000","last_fullsized":"2024-09-12T19:14:29.136233+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1288","last_scrub_stamp":"2024-09-12T19:14:29.136034+0000","last_deep_scrub":"265'1288","last_deep_scrub_stamp":"2024-09-12T19:14:29.136034+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.136034+0000","objects_scrubbed":12,"log_size":88,"log_dups_size":1200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:22.780326+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145649,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2006,"num_read_kb":3785,"num_write":1114,"num_write_kb":954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.948655+0000","last_change":"2024-09-12T19:14:32.948511+0000","last_active":"2024-09-12T19:14:32.948655+0000","last_peered":"2024-09-12T19:14:32.948655+0000","last_clean":"2024-09-12T19:14:32.948655+0000","last_became_active":"2024-09-12T18:26:47.886707+0000","last_became_peered":"2024-09-12T18:26:47.886707+0000","last_unstale":"2024-09-12T19:14:32.948655+0000","last_undegraded":"2024-09-12T19:14:32.948655+0000","last_fullsized":"2024-09-12T19:14:32.948655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:32.948325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:32.948325+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.948325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:02.738260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'198","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.169478+0000","last_change":"2024-09-12T19:14:32.169299+0000","last_active":"2024-09-12T19:14:32.169478+0000","last_peered":"2024-09-12T19:14:32.169478+0000","last_clean":"2024-09-12T19:14:32.169478+0000","last_became_active":"2024-09-12T18:26:49.909802+0000","last_became_peered":"2024-09-12T18:26:49.909802+0000","last_unstale":"2024-09-12T19:14:32.169478+0000","last_undegraded":"2024-09-12T19:14:32.169478+0000","last_fullsized":"2024-09-12T19:14:32.169478+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'198","last_scrub_stamp":"2024-09-12T19:14:32.169120+0000","last_deep_scrub":"265'198","last_deep_scrub_stamp":"2024-09-12T19:14:32.169120+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.169120+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:37.739092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":337,"num_read_kb":322,"num_write":434,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'395","reported_seq":1925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.062834+0000","last_change":"2024-09-12T19:14:10.062699+0000","last_active":"2024-09-12T19:14:10.062834+0000","last_peered":"2024-09-12T19:14:10.062834+0000","last_clean":"2024-09-12T19:14:10.062834+0000","last_became_active":"2024-09-12T18:26:41.868958+0000","last_became_peered":"2024-09-12T18:26:41.868958+0000","last_unstale":"2024-09-12T19:14:10.062834+0000","last_undegraded":"2024-09-12T19:14:10.062834+0000","last_fullsized":"2024-09-12T19:14:10.062834+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'395","last_scrub_stamp":"2024-09-12T19:14:10.062517+0000","last_deep_scrub":"265'395","last_deep_scrub_stamp":"2024-09-12T19:14:10.062517+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.062517+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:11.560866+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2137,"num_read_kb":2050,"num_write":435,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1191,"num_omap_keys":5,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.034479+0000","last_change":"2024-09-12T19:14:04.034267+0000","last_active":"2024-09-12T19:14:04.034479+0000","last_peered":"2024-09-12T19:14:04.034479+0000","last_clean":"2024-09-12T19:14:04.034479+0000","last_became_active":"2024-09-12T18:26:25.559069+0000","last_became_peered":"2024-09-12T18:26:25.559069+0000","last_unstale":"2024-09-12T19:14:04.034479+0000","last_undegraded":"2024-09-12T19:14:04.034479+0000","last_fullsized":"2024-09-12T19:14:04.034479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:04.034076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:04.034076+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.034076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:45.407307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00065344600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'305","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.182466+0000","last_change":"2024-09-12T19:14:20.182326+0000","last_active":"2024-09-12T19:14:20.182466+0000","last_peered":"2024-09-12T19:14:20.182466+0000","last_clean":"2024-09-12T19:14:20.182466+0000","last_became_active":"2024-09-12T18:26:39.832766+0000","last_became_peered":"2024-09-12T18:26:39.832766+0000","last_unstale":"2024-09-12T19:14:20.182466+0000","last_undegraded":"2024-09-12T19:14:20.182466+0000","last_fullsized":"2024-09-12T19:14:20.182466+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T19:14:20.182116+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T19:14:20.182116+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.182116+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:08.243108+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":386,"num_read_kb":10646,"num_write":879,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.043264+0000","last_change":"2024-09-12T19:14:15.043116+0000","last_active":"2024-09-12T19:14:15.043264+0000","last_peered":"2024-09-12T19:14:15.043264+0000","last_clean":"2024-09-12T19:14:15.043264+0000","last_became_active":"2024-09-12T18:26:43.843884+0000","last_became_peered":"2024-09-12T18:26:43.843884+0000","last_unstale":"2024-09-12T19:14:15.043264+0000","last_undegraded":"2024-09-12T19:14:15.043264+0000","last_fullsized":"2024-09-12T19:14:15.043264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:15.042938+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:15.042938+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.042938+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:57.556164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'246","reported_seq":1363,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.033767+0000","last_change":"2024-09-12T19:14:29.033627+0000","last_active":"2024-09-12T19:14:29.033767+0000","last_peered":"2024-09-12T19:14:29.033767+0000","last_clean":"2024-09-12T19:14:29.033767+0000","last_became_active":"2024-09-12T18:26:46.024474+0000","last_became_peered":"2024-09-12T18:26:46.024474+0000","last_unstale":"2024-09-12T19:14:29.033767+0000","last_undegraded":"2024-09-12T19:14:29.033767+0000","last_fullsized":"2024-09-12T19:14:29.033767+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'246","last_scrub_stamp":"2024-09-12T19:14:29.033403+0000","last_deep_scrub":"265'246","last_deep_scrub_stamp":"2024-09-12T19:14:29.033403+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.033403+0000","objects_scrubbed":9,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:35.289473+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.623507+0000","last_change":"2024-09-12T19:14:23.623352+0000","last_active":"2024-09-12T19:14:23.623507+0000","last_peered":"2024-09-12T19:14:23.623507+0000","last_clean":"2024-09-12T19:14:23.623507+0000","last_became_active":"2024-09-12T18:26:47.889718+0000","last_became_peered":"2024-09-12T18:26:47.889718+0000","last_unstale":"2024-09-12T19:14:23.623507+0000","last_undegraded":"2024-09-12T19:14:23.623507+0000","last_fullsized":"2024-09-12T19:14:23.623507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:23.623180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:23.623180+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.623180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:13.007796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'251","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.143065+0000","last_change":"2024-09-12T19:14:43.143065+0000","last_active":"2024-09-12T19:14:43.143065+0000","last_peered":"2024-09-12T19:14:43.143065+0000","last_clean":"2024-09-12T19:14:43.143065+0000","last_became_active":"2024-09-12T18:26:49.912488+0000","last_became_peered":"2024-09-12T18:26:49.912488+0000","last_unstale":"2024-09-12T19:14:43.143065+0000","last_undegraded":"2024-09-12T19:14:43.143065+0000","last_fullsized":"2024-09-12T19:14:43.143065+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'251","last_scrub_stamp":"2024-09-12T19:14:43.142896+0000","last_deep_scrub":"265'251","last_deep_scrub_stamp":"2024-09-12T19:14:43.142896+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.142896+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:21.062229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":492,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'923","reported_seq":2692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.118359+0000","last_change":"2024-09-12T19:14:14.118118+0000","last_active":"2024-09-12T19:14:14.118359+0000","last_peered":"2024-09-12T19:14:14.118359+0000","last_clean":"2024-09-12T19:14:14.118359+0000","last_became_active":"2024-09-12T18:26:41.847403+0000","last_became_peered":"2024-09-12T18:26:41.847403+0000","last_unstale":"2024-09-12T19:14:14.118359+0000","last_undegraded":"2024-09-12T19:14:14.118359+0000","last_fullsized":"2024-09-12T19:14:14.118359+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'923","last_scrub_stamp":"2024-09-12T19:14:14.117836+0000","last_deep_scrub":"265'923","last_deep_scrub_stamp":"2024-09-12T19:14:14.117836+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.117836+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:45.790389+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4497,"num_read_kb":4050,"num_write":1227,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3569,"num_omap_keys":15,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.604240+0000","last_change":"2024-09-12T19:14:05.604094+0000","last_active":"2024-09-12T19:14:05.604240+0000","last_peered":"2024-09-12T19:14:05.604240+0000","last_clean":"2024-09-12T19:14:05.604240+0000","last_became_active":"2024-09-12T18:26:25.483909+0000","last_became_peered":"2024-09-12T18:26:25.483909+0000","last_unstale":"2024-09-12T19:14:05.604240+0000","last_undegraded":"2024-09-12T19:14:05.604240+0000","last_fullsized":"2024-09-12T19:14:05.604240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T19:14:05.603905+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T19:14:05.603905+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.603905+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:00.442699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002260153,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'308","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.356090+0000","last_change":"2024-09-12T19:14:04.355955+0000","last_active":"2024-09-12T19:14:04.356090+0000","last_peered":"2024-09-12T19:14:04.356090+0000","last_clean":"2024-09-12T19:14:04.356090+0000","last_became_active":"2024-09-12T18:26:39.847002+0000","last_became_peered":"2024-09-12T18:26:39.847002+0000","last_unstale":"2024-09-12T19:14:04.356090+0000","last_undegraded":"2024-09-12T19:14:04.356090+0000","last_fullsized":"2024-09-12T19:14:04.356090+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'308","last_scrub_stamp":"2024-09-12T19:14:04.355733+0000","last_deep_scrub":"265'308","last_deep_scrub_stamp":"2024-09-12T19:14:04.355733+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.355733+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:41.026404+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":613,"num_read_kb":6223,"num_write":953,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.809254+0000","last_change":"2024-09-12T19:14:14.809100+0000","last_active":"2024-09-12T19:14:14.809254+0000","last_peered":"2024-09-12T19:14:14.809254+0000","last_clean":"2024-09-12T19:14:14.809254+0000","last_became_active":"2024-09-12T18:26:43.861753+0000","last_became_peered":"2024-09-12T18:26:43.861753+0000","last_unstale":"2024-09-12T19:14:14.809254+0000","last_undegraded":"2024-09-12T19:14:14.809254+0000","last_fullsized":"2024-09-12T19:14:14.809254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:14.808880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:14.808880+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.808880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:18.789841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'118","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.181685+0000","last_change":"2024-09-12T19:14:28.181545+0000","last_active":"2024-09-12T19:14:28.181685+0000","last_peered":"2024-09-12T19:14:28.181685+0000","last_clean":"2024-09-12T19:14:28.181685+0000","last_became_active":"2024-09-12T18:26:45.856615+0000","last_became_peered":"2024-09-12T18:26:45.856615+0000","last_unstale":"2024-09-12T19:14:28.181685+0000","last_undegraded":"2024-09-12T19:14:28.181685+0000","last_fullsized":"2024-09-12T19:14:28.181685+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T19:14:28.181357+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T19:14:28.181357+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.181357+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:08.289459+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.655183+0000","last_change":"2024-09-12T19:14:21.655037+0000","last_active":"2024-09-12T19:14:21.655183+0000","last_peered":"2024-09-12T19:14:21.655183+0000","last_clean":"2024-09-12T19:14:21.655183+0000","last_became_active":"2024-09-12T18:26:47.884981+0000","last_became_peered":"2024-09-12T18:26:47.884981+0000","last_unstale":"2024-09-12T19:14:21.655183+0000","last_undegraded":"2024-09-12T19:14:21.655183+0000","last_fullsized":"2024-09-12T19:14:21.655183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:21.654865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:21.654865+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.654865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:15.223256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'140","reported_seq":700,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.502576+0000","last_change":"2024-09-12T19:14:36.502576+0000","last_active":"2024-09-12T19:14:36.502576+0000","last_peered":"2024-09-12T19:14:36.502576+0000","last_clean":"2024-09-12T19:14:36.502576+0000","last_became_active":"2024-09-12T18:26:49.918043+0000","last_became_peered":"2024-09-12T18:26:49.918043+0000","last_unstale":"2024-09-12T19:14:36.502576+0000","last_undegraded":"2024-09-12T19:14:36.502576+0000","last_fullsized":"2024-09-12T19:14:36.502576+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T19:14:36.502391+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T19:14:36.502391+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.502391+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:34.316362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":258,"num_write":354,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'550","reported_seq":2248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.028687+0000","last_change":"2024-09-12T19:14:08.028527+0000","last_active":"2024-09-12T19:14:08.028687+0000","last_peered":"2024-09-12T19:14:08.028687+0000","last_clean":"2024-09-12T19:14:08.028687+0000","last_became_active":"2024-09-12T18:26:41.878269+0000","last_became_peered":"2024-09-12T18:26:41.878269+0000","last_unstale":"2024-09-12T19:14:08.028687+0000","last_undegraded":"2024-09-12T19:14:08.028687+0000","last_fullsized":"2024-09-12T19:14:08.028687+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'550","last_scrub_stamp":"2024-09-12T19:14:08.028346+0000","last_deep_scrub":"265'550","last_deep_scrub_stamp":"2024-09-12T19:14:08.028346+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.028346+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:00.737745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2954,"num_read_kb":2745,"num_write":669,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'462","reported_seq":1164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.591575+0000","last_change":"2024-09-12T19:14:04.591491+0000","last_active":"2024-09-12T19:14:04.591575+0000","last_peered":"2024-09-12T19:14:04.591575+0000","last_clean":"2024-09-12T19:14:04.591575+0000","last_became_active":"2024-09-12T18:26:39.851739+0000","last_became_peered":"2024-09-12T18:26:39.851739+0000","last_unstale":"2024-09-12T19:14:04.591575+0000","last_undegraded":"2024-09-12T19:14:04.591575+0000","last_fullsized":"2024-09-12T19:14:04.591575+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'462","last_scrub_stamp":"2024-09-12T19:14:04.591353+0000","last_deep_scrub":"265'462","last_deep_scrub_stamp":"2024-09-12T19:14:04.591353+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.591353+0000","objects_scrubbed":8,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:47:43.285385+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":848,"num_read_kb":21232,"num_write":1357,"num_write_kb":18457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:03.058708+0000","last_change":"2024-09-12T19:14:03.058458+0000","last_active":"2024-09-12T19:14:03.058708+0000","last_peered":"2024-09-12T19:14:03.058708+0000","last_clean":"2024-09-12T19:14:03.058708+0000","last_became_active":"2024-09-12T18:26:25.474997+0000","last_became_peered":"2024-09-12T18:26:25.474997+0000","last_unstale":"2024-09-12T19:14:03.058708+0000","last_undegraded":"2024-09-12T19:14:03.058708+0000","last_fullsized":"2024-09-12T19:14:03.058708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:03.058262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:03.058262+0000","last_clean_scrub_stamp":"2024-09-12T19:14:03.058262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:33.435710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099306900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.565116+0000","last_change":"2024-09-12T19:14:31.564869+0000","last_active":"2024-09-12T19:14:31.565116+0000","last_peered":"2024-09-12T19:14:31.565116+0000","last_clean":"2024-09-12T19:14:31.565116+0000","last_became_active":"2024-09-12T18:26:43.865697+0000","last_became_peered":"2024-09-12T18:26:43.865697+0000","last_unstale":"2024-09-12T19:14:31.565116+0000","last_undegraded":"2024-09-12T19:14:31.565116+0000","last_fullsized":"2024-09-12T19:14:31.565116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:31.564660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:31.564660+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.564660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:47.040558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'560","reported_seq":1234,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.683285+0000","last_change":"2024-09-12T19:14:22.683021+0000","last_active":"2024-09-12T19:14:22.683285+0000","last_peered":"2024-09-12T19:14:22.683285+0000","last_clean":"2024-09-12T19:14:22.683285+0000","last_became_active":"2024-09-12T18:26:45.877100+0000","last_became_peered":"2024-09-12T18:26:45.877100+0000","last_unstale":"2024-09-12T19:14:22.683285+0000","last_undegraded":"2024-09-12T19:14:22.683285+0000","last_fullsized":"2024-09-12T19:14:22.683285+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'560","last_scrub_stamp":"2024-09-12T19:14:22.682604+0000","last_deep_scrub":"265'560","last_deep_scrub_stamp":"2024-09-12T19:14:22.682604+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.682604+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:19.522572+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103009,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":952,"num_read_kb":2114,"num_write":816,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10824,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.436574+0000","last_change":"2024-09-12T19:14:33.436395+0000","last_active":"2024-09-12T19:14:33.436574+0000","last_peered":"2024-09-12T19:14:33.436574+0000","last_clean":"2024-09-12T19:14:33.436574+0000","last_became_active":"2024-09-12T18:26:47.900217+0000","last_became_peered":"2024-09-12T18:26:47.900217+0000","last_unstale":"2024-09-12T19:14:33.436574+0000","last_undegraded":"2024-09-12T19:14:33.436574+0000","last_fullsized":"2024-09-12T19:14:33.436574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:33.436202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:33.436202+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.436202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:41.332666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'145","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.662133+0000","last_change":"2024-09-12T19:14:35.662133+0000","last_active":"2024-09-12T19:14:35.662133+0000","last_peered":"2024-09-12T19:14:35.662133+0000","last_clean":"2024-09-12T19:14:35.662133+0000","last_became_active":"2024-09-12T18:26:49.921123+0000","last_became_peered":"2024-09-12T18:26:49.921123+0000","last_unstale":"2024-09-12T19:14:35.662133+0000","last_undegraded":"2024-09-12T19:14:35.662133+0000","last_fullsized":"2024-09-12T19:14:35.662133+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'145","last_scrub_stamp":"2024-09-12T19:14:35.661928+0000","last_deep_scrub":"265'145","last_deep_scrub_stamp":"2024-09-12T19:14:35.661928+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.661928+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:42.989154+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":212,"num_read_kb":188,"num_write":350,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'429","reported_seq":1891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.799785+0000","last_change":"2024-09-12T19:14:15.799636+0000","last_active":"2024-09-12T19:14:15.799785+0000","last_peered":"2024-09-12T19:14:15.799785+0000","last_clean":"2024-09-12T19:14:15.799785+0000","last_became_active":"2024-09-12T18:26:41.869426+0000","last_became_peered":"2024-09-12T18:26:41.869426+0000","last_unstale":"2024-09-12T19:14:15.799785+0000","last_undegraded":"2024-09-12T19:14:15.799785+0000","last_fullsized":"2024-09-12T19:14:15.799785+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'429","last_scrub_stamp":"2024-09-12T19:14:15.799455+0000","last_deep_scrub":"265'429","last_deep_scrub_stamp":"2024-09-12T19:14:15.799455+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.799455+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:25.588201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2246,"num_read_kb":2097,"num_write":505,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'373","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.025106+0000","last_change":"2024-09-12T19:14:09.024849+0000","last_active":"2024-09-12T19:14:09.025106+0000","last_peered":"2024-09-12T19:14:09.025106+0000","last_clean":"2024-09-12T19:14:09.025106+0000","last_became_active":"2024-09-12T18:26:39.832593+0000","last_became_peered":"2024-09-12T18:26:39.832593+0000","last_unstale":"2024-09-12T19:14:09.025106+0000","last_undegraded":"2024-09-12T19:14:09.025106+0000","last_fullsized":"2024-09-12T19:14:09.025106+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T19:14:09.024591+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T19:14:09.024591+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.024591+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:04.058256+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1569358,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":23528,"num_write":1214,"num_write_kb":24783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.854721+0000","last_change":"2024-09-12T19:14:08.854566+0000","last_active":"2024-09-12T19:14:08.854721+0000","last_peered":"2024-09-12T19:14:08.854721+0000","last_clean":"2024-09-12T19:14:08.854721+0000","last_became_active":"2024-09-12T18:26:25.484938+0000","last_became_peered":"2024-09-12T18:26:25.484938+0000","last_unstale":"2024-09-12T19:14:08.854721+0000","last_undegraded":"2024-09-12T19:14:08.854721+0000","last_fullsized":"2024-09-12T19:14:08.854721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:08.854352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:08.854352+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.854352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:10.919124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001083194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.597993+0000","last_change":"2024-09-12T19:14:18.597867+0000","last_active":"2024-09-12T19:14:18.597993+0000","last_peered":"2024-09-12T19:14:18.597993+0000","last_clean":"2024-09-12T19:14:18.597993+0000","last_became_active":"2024-09-12T18:26:43.863388+0000","last_became_peered":"2024-09-12T18:26:43.863388+0000","last_unstale":"2024-09-12T19:14:18.597993+0000","last_undegraded":"2024-09-12T19:14:18.597993+0000","last_fullsized":"2024-09-12T19:14:18.597993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:18.597691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:18.597691+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.597691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:16.253901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'168","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.137853+0000","last_change":"2024-09-12T19:14:22.137680+0000","last_active":"2024-09-12T19:14:22.137853+0000","last_peered":"2024-09-12T19:14:22.137853+0000","last_clean":"2024-09-12T19:14:22.137853+0000","last_became_active":"2024-09-12T18:26:46.020043+0000","last_became_peered":"2024-09-12T18:26:46.020043+0000","last_unstale":"2024-09-12T19:14:22.137853+0000","last_undegraded":"2024-09-12T19:14:22.137853+0000","last_fullsized":"2024-09-12T19:14:22.137853+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T19:14:22.137464+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T19:14:22.137464+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.137464+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:31.392371+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":189,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'815","reported_seq":2667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.414516+0000","last_change":"2024-09-12T19:14:32.414248+0000","last_active":"2024-09-12T19:14:32.414516+0000","last_peered":"2024-09-12T19:14:32.414516+0000","last_clean":"2024-09-12T19:14:32.414516+0000","last_became_active":"2024-09-12T18:26:47.879630+0000","last_became_peered":"2024-09-12T18:26:47.879630+0000","last_unstale":"2024-09-12T19:14:32.414516+0000","last_undegraded":"2024-09-12T19:14:32.414516+0000","last_fullsized":"2024-09-12T19:14:32.414516+0000","mapping_epoch":32,"log_start":"265'800","ondisk_log_start":"265'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'815","last_scrub_stamp":"2024-09-12T19:14:32.413965+0000","last_deep_scrub":"265'815","last_deep_scrub_stamp":"2024-09-12T19:14:32.413965+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.413965+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:16.861896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'143","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.167533+0000","last_change":"2024-09-12T19:14:36.167533+0000","last_active":"2024-09-12T19:14:36.167533+0000","last_peered":"2024-09-12T19:14:36.167533+0000","last_clean":"2024-09-12T19:14:36.167533+0000","last_became_active":"2024-09-12T18:26:49.919846+0000","last_became_peered":"2024-09-12T18:26:49.919846+0000","last_unstale":"2024-09-12T19:14:36.167533+0000","last_undegraded":"2024-09-12T19:14:36.167533+0000","last_fullsized":"2024-09-12T19:14:36.167533+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'143","last_scrub_stamp":"2024-09-12T19:14:36.167304+0000","last_deep_scrub":"265'143","last_deep_scrub_stamp":"2024-09-12T19:14:36.167304+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.167304+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:56.870847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":263,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'481","reported_seq":2017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.951799+0000","last_change":"2024-09-12T19:14:19.951639+0000","last_active":"2024-09-12T19:14:19.951799+0000","last_peered":"2024-09-12T19:14:19.951799+0000","last_clean":"2024-09-12T19:14:19.951799+0000","last_became_active":"2024-09-12T18:26:41.862008+0000","last_became_peered":"2024-09-12T18:26:41.862008+0000","last_unstale":"2024-09-12T19:14:19.951799+0000","last_undegraded":"2024-09-12T19:14:19.951799+0000","last_fullsized":"2024-09-12T19:14:19.951799+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'481","last_scrub_stamp":"2024-09-12T19:14:19.951462+0000","last_deep_scrub":"265'481","last_deep_scrub_stamp":"2024-09-12T19:14:19.951462+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.951462+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:03.077093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":2263,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'343","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.734772+0000","last_change":"2024-09-12T19:14:04.734724+0000","last_active":"2024-09-12T19:14:04.734772+0000","last_peered":"2024-09-12T19:14:04.734772+0000","last_clean":"2024-09-12T19:14:04.734772+0000","last_became_active":"2024-09-12T18:26:39.865123+0000","last_became_peered":"2024-09-12T18:26:39.865123+0000","last_unstale":"2024-09-12T19:14:04.734772+0000","last_undegraded":"2024-09-12T19:14:04.734772+0000","last_fullsized":"2024-09-12T19:14:04.734772+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:14:04.734653+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:14:04.734653+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.734653+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:27.841010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":68443,"num_write":1085,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.072373+0000","last_change":"2024-09-12T19:14:06.072144+0000","last_active":"2024-09-12T19:14:06.072373+0000","last_peered":"2024-09-12T19:14:06.072373+0000","last_clean":"2024-09-12T19:14:06.072373+0000","last_became_active":"2024-09-12T18:26:25.485137+0000","last_became_peered":"2024-09-12T18:26:25.485137+0000","last_unstale":"2024-09-12T19:14:06.072373+0000","last_undegraded":"2024-09-12T19:14:06.072373+0000","last_fullsized":"2024-09-12T19:14:06.072373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:06.071853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:06.071853+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.071853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:58.794679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013350759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":512,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.431634+0000","last_change":"2024-09-12T19:14:25.431505+0000","last_active":"2024-09-12T19:14:25.431634+0000","last_peered":"2024-09-12T19:14:25.431634+0000","last_clean":"2024-09-12T19:14:25.431634+0000","last_became_active":"2024-09-12T18:26:43.874845+0000","last_became_peered":"2024-09-12T18:26:43.874845+0000","last_unstale":"2024-09-12T19:14:25.431634+0000","last_undegraded":"2024-09-12T19:14:25.431634+0000","last_fullsized":"2024-09-12T19:14:25.431634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:25.431335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:25.431335+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.431335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:03.653096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'111","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.375797+0000","last_change":"2024-09-12T19:14:29.375629+0000","last_active":"2024-09-12T19:14:29.375797+0000","last_peered":"2024-09-12T19:14:29.375797+0000","last_clean":"2024-09-12T19:14:29.375797+0000","last_became_active":"2024-09-12T18:26:45.863254+0000","last_became_peered":"2024-09-12T18:26:45.863254+0000","last_unstale":"2024-09-12T19:14:29.375797+0000","last_undegraded":"2024-09-12T19:14:29.375797+0000","last_fullsized":"2024-09-12T19:14:29.375797+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'111","last_scrub_stamp":"2024-09-12T19:14:29.375431+0000","last_deep_scrub":"265'111","last_deep_scrub_stamp":"2024-09-12T19:14:29.375431+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.375431+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:57.740072+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'806","reported_seq":2529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.139058+0000","last_change":"2024-09-12T19:14:40.138891+0000","last_active":"2024-09-12T19:14:40.139058+0000","last_peered":"2024-09-12T19:14:40.139058+0000","last_clean":"2024-09-12T19:14:40.139058+0000","last_became_active":"2024-09-12T18:26:47.899682+0000","last_became_peered":"2024-09-12T18:26:47.899682+0000","last_unstale":"2024-09-12T19:14:40.139058+0000","last_undegraded":"2024-09-12T19:14:40.139058+0000","last_fullsized":"2024-09-12T19:14:40.139058+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T19:14:40.138717+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T19:14:40.138717+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.138717+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:51.728312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'168","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.669516+0000","last_change":"2024-09-12T19:14:34.669516+0000","last_active":"2024-09-12T19:14:34.669516+0000","last_peered":"2024-09-12T19:14:34.669516+0000","last_clean":"2024-09-12T19:14:34.669516+0000","last_became_active":"2024-09-12T18:26:49.917537+0000","last_became_peered":"2024-09-12T18:26:49.917537+0000","last_unstale":"2024-09-12T19:14:34.669516+0000","last_undegraded":"2024-09-12T19:14:34.669516+0000","last_fullsized":"2024-09-12T19:14:34.669516+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T19:14:34.669306+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T19:14:34.669306+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.669306+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:24.898251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":124,"num_write":364,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'446","reported_seq":1948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.329435+0000","last_change":"2024-09-12T19:14:08.329287+0000","last_active":"2024-09-12T19:14:08.329435+0000","last_peered":"2024-09-12T19:14:08.329435+0000","last_clean":"2024-09-12T19:14:08.329435+0000","last_became_active":"2024-09-12T18:26:41.871518+0000","last_became_peered":"2024-09-12T18:26:41.871518+0000","last_unstale":"2024-09-12T19:14:08.329435+0000","last_undegraded":"2024-09-12T19:14:08.329435+0000","last_fullsized":"2024-09-12T19:14:08.329435+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'446","last_scrub_stamp":"2024-09-12T19:14:08.329092+0000","last_deep_scrub":"265'446","last_deep_scrub_stamp":"2024-09-12T19:14:08.329092+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.329092+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:06.915175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2145,"num_write":516,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'315","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:03.905567+0000","last_change":"2024-09-12T19:14:03.905429+0000","last_active":"2024-09-12T19:14:03.905567+0000","last_peered":"2024-09-12T19:14:03.905567+0000","last_clean":"2024-09-12T19:14:03.905567+0000","last_became_active":"2024-09-12T18:26:39.833924+0000","last_became_peered":"2024-09-12T18:26:39.833924+0000","last_unstale":"2024-09-12T19:14:03.905567+0000","last_undegraded":"2024-09-12T19:14:03.905567+0000","last_fullsized":"2024-09-12T19:14:03.905567+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T19:14:03.905233+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T19:14:03.905233+0000","last_clean_scrub_stamp":"2024-09-12T19:14:03.905233+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:50.763493+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6467978,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":59970,"num_write":1010,"num_write_kb":34278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.502466+0000","last_change":"2024-09-12T19:14:06.502292+0000","last_active":"2024-09-12T19:14:06.502466+0000","last_peered":"2024-09-12T19:14:06.502466+0000","last_clean":"2024-09-12T19:14:06.502466+0000","last_became_active":"2024-09-12T18:26:25.487465+0000","last_became_peered":"2024-09-12T18:26:25.487465+0000","last_unstale":"2024-09-12T19:14:06.502466+0000","last_undegraded":"2024-09-12T19:14:06.502466+0000","last_fullsized":"2024-09-12T19:14:06.502466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:06.502115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:06.502115+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.502115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:23.228019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010368949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.160123+0000","last_change":"2024-09-12T19:14:27.159963+0000","last_active":"2024-09-12T19:14:27.160123+0000","last_peered":"2024-09-12T19:14:27.160123+0000","last_clean":"2024-09-12T19:14:27.160123+0000","last_became_active":"2024-09-12T18:26:43.850274+0000","last_became_peered":"2024-09-12T18:26:43.850274+0000","last_unstale":"2024-09-12T19:14:27.160123+0000","last_undegraded":"2024-09-12T19:14:27.160123+0000","last_fullsized":"2024-09-12T19:14:27.160123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:27.159785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:27.159785+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.159785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:35.905171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'726","reported_seq":1448,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.985314+0000","last_change":"2024-09-12T19:14:27.985159+0000","last_active":"2024-09-12T19:14:27.985314+0000","last_peered":"2024-09-12T19:14:27.985314+0000","last_clean":"2024-09-12T19:14:27.985314+0000","last_became_active":"2024-09-12T18:26:46.021217+0000","last_became_peered":"2024-09-12T18:26:46.021217+0000","last_unstale":"2024-09-12T19:14:27.985314+0000","last_undegraded":"2024-09-12T19:14:27.985314+0000","last_fullsized":"2024-09-12T19:14:27.985314+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'726","last_scrub_stamp":"2024-09-12T19:14:27.984936+0000","last_deep_scrub":"265'726","last_deep_scrub_stamp":"2024-09-12T19:14:27.984936+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.984936+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:44.715111+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1300,"num_read_kb":3120,"num_write":1062,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.147229+0000","last_change":"2024-09-12T19:14:33.147105+0000","last_active":"2024-09-12T19:14:33.147229+0000","last_peered":"2024-09-12T19:14:33.147229+0000","last_clean":"2024-09-12T19:14:33.147229+0000","last_became_active":"2024-09-12T18:26:47.902750+0000","last_became_peered":"2024-09-12T18:26:47.902750+0000","last_unstale":"2024-09-12T19:14:33.147229+0000","last_undegraded":"2024-09-12T19:14:33.147229+0000","last_fullsized":"2024-09-12T19:14:33.147229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:33.146930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:33.146930+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.146930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:58.966836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'110","reported_seq":618,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.468204+0000","last_change":"2024-09-12T19:14:37.468204+0000","last_active":"2024-09-12T19:14:37.468204+0000","last_peered":"2024-09-12T19:14:37.468204+0000","last_clean":"2024-09-12T19:14:37.468204+0000","last_became_active":"2024-09-12T18:26:49.919630+0000","last_became_peered":"2024-09-12T18:26:49.919630+0000","last_unstale":"2024-09-12T19:14:37.468204+0000","last_undegraded":"2024-09-12T19:14:37.468204+0000","last_fullsized":"2024-09-12T19:14:37.468204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T19:14:37.468006+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T19:14:37.468006+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.468006+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:22.357730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":269,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'144","reported_seq":715,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.618175+0000","last_change":"2024-09-12T19:14:38.617914+0000","last_active":"2024-09-12T19:14:38.618175+0000","last_peered":"2024-09-12T19:14:38.618175+0000","last_clean":"2024-09-12T19:14:38.618175+0000","last_became_active":"2024-09-12T18:26:49.912589+0000","last_became_peered":"2024-09-12T18:26:49.912589+0000","last_unstale":"2024-09-12T19:14:38.618175+0000","last_undegraded":"2024-09-12T19:14:38.618175+0000","last_fullsized":"2024-09-12T19:14:38.618175+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T19:14:38.617701+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T19:14:38.617701+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.617701+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:12.497842+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":221,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'914","reported_seq":2543,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.269753+0000","last_change":"2024-09-12T19:14:15.269753+0000","last_active":"2024-09-12T19:14:15.269753+0000","last_peered":"2024-09-12T19:14:15.269753+0000","last_clean":"2024-09-12T19:14:15.269753+0000","last_became_active":"2024-09-12T18:26:41.875870+0000","last_became_peered":"2024-09-12T18:26:41.875870+0000","last_unstale":"2024-09-12T19:14:15.269753+0000","last_undegraded":"2024-09-12T19:14:15.269753+0000","last_fullsized":"2024-09-12T19:14:15.269753+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'914","last_scrub_stamp":"2024-09-12T19:14:15.269571+0000","last_deep_scrub":"265'914","last_deep_scrub_stamp":"2024-09-12T19:14:15.269571+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.269571+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":900,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:16.227806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4445,"num_read_kb":3959,"num_write":1252,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'311","reported_seq":958,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.359664+0000","last_change":"2024-09-12T19:14:05.359664+0000","last_active":"2024-09-12T19:14:05.359664+0000","last_peered":"2024-09-12T19:14:05.359664+0000","last_clean":"2024-09-12T19:14:05.359664+0000","last_became_active":"2024-09-12T18:26:39.870576+0000","last_became_peered":"2024-09-12T18:26:39.870576+0000","last_unstale":"2024-09-12T19:14:05.359664+0000","last_undegraded":"2024-09-12T19:14:05.359664+0000","last_fullsized":"2024-09-12T19:14:05.359664+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'311","last_scrub_stamp":"2024-09-12T19:14:05.359443+0000","last_deep_scrub":"265'311","last_deep_scrub_stamp":"2024-09-12T19:14:05.359443+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.359443+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:08.218478+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":31608,"num_write":917,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.194115+0000","last_change":"2024-09-12T19:14:16.194115+0000","last_active":"2024-09-12T19:14:16.194115+0000","last_peered":"2024-09-12T19:14:16.194115+0000","last_clean":"2024-09-12T19:14:16.194115+0000","last_became_active":"2024-09-12T18:26:43.864969+0000","last_became_peered":"2024-09-12T18:26:43.864969+0000","last_unstale":"2024-09-12T19:14:16.194115+0000","last_undegraded":"2024-09-12T19:14:16.194115+0000","last_fullsized":"2024-09-12T19:14:16.194115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:16.193928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:16.193928+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.193928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:14.944724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'281","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.112064+0000","last_change":"2024-09-12T19:14:31.112064+0000","last_active":"2024-09-12T19:14:31.112064+0000","last_peered":"2024-09-12T19:14:31.112064+0000","last_clean":"2024-09-12T19:14:31.112064+0000","last_became_active":"2024-09-12T18:26:45.865329+0000","last_became_peered":"2024-09-12T18:26:45.865329+0000","last_unstale":"2024-09-12T19:14:31.112064+0000","last_undegraded":"2024-09-12T19:14:31.112064+0000","last_fullsized":"2024-09-12T19:14:31.112064+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-12T19:14:31.111802+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-12T19:14:31.111802+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.111802+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:31.456814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":1095,"num_write":382,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.132452+0000","last_change":"2024-09-12T19:14:42.132452+0000","last_active":"2024-09-12T19:14:42.132452+0000","last_peered":"2024-09-12T19:14:42.132452+0000","last_clean":"2024-09-12T19:14:42.132452+0000","last_became_active":"2024-09-12T18:26:47.890741+0000","last_became_peered":"2024-09-12T18:26:47.890741+0000","last_unstale":"2024-09-12T19:14:42.132452+0000","last_undegraded":"2024-09-12T19:14:42.132452+0000","last_fullsized":"2024-09-12T19:14:42.132452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:42.132277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:42.132277+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.132277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:17.240518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'198","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:44.120514+0000","last_change":"2024-09-12T19:14:44.120282+0000","last_active":"2024-09-12T19:14:44.120514+0000","last_peered":"2024-09-12T19:14:44.120514+0000","last_clean":"2024-09-12T19:14:44.120514+0000","last_became_active":"2024-09-12T18:26:49.914506+0000","last_became_peered":"2024-09-12T18:26:49.914506+0000","last_unstale":"2024-09-12T19:14:44.120514+0000","last_undegraded":"2024-09-12T19:14:44.120514+0000","last_fullsized":"2024-09-12T19:14:44.120514+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'198","last_scrub_stamp":"2024-09-12T19:14:44.120062+0000","last_deep_scrub":"265'198","last_deep_scrub_stamp":"2024-09-12T19:14:44.120062+0000","last_clean_scrub_stamp":"2024-09-12T19:14:44.120062+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:37.857137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":157,"num_write":456,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'903","reported_seq":2447,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.072876+0000","last_change":"2024-09-12T19:14:11.072876+0000","last_active":"2024-09-12T19:14:11.072876+0000","last_peered":"2024-09-12T19:14:11.072876+0000","last_clean":"2024-09-12T19:14:11.072876+0000","last_became_active":"2024-09-12T18:26:41.868082+0000","last_became_peered":"2024-09-12T18:26:41.868082+0000","last_unstale":"2024-09-12T19:14:11.072876+0000","last_undegraded":"2024-09-12T19:14:11.072876+0000","last_fullsized":"2024-09-12T19:14:11.072876+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'903","last_scrub_stamp":"2024-09-12T19:14:11.072670+0000","last_deep_scrub":"265'903","last_deep_scrub_stamp":"2024-09-12T19:14:11.072670+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.072670+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":800,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:29.244238+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4276,"num_read_kb":3807,"num_write":1253,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'386","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.818826+0000","last_change":"2024-09-12T19:14:11.818692+0000","last_active":"2024-09-12T19:14:11.818826+0000","last_peered":"2024-09-12T19:14:11.818826+0000","last_clean":"2024-09-12T19:14:11.818826+0000","last_became_active":"2024-09-12T18:26:39.869754+0000","last_became_peered":"2024-09-12T18:26:39.869754+0000","last_unstale":"2024-09-12T19:14:11.818826+0000","last_undegraded":"2024-09-12T19:14:11.818826+0000","last_fullsized":"2024-09-12T19:14:11.818826+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T19:14:11.818493+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T19:14:11.818493+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.818493+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:30.957800+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525344,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":32033,"num_write":1221,"num_write_kb":47606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"265'6","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.088539+0000","last_change":"2024-09-12T19:14:23.088539+0000","last_active":"2024-09-12T19:14:23.088539+0000","last_peered":"2024-09-12T19:14:23.088539+0000","last_clean":"2024-09-12T19:14:23.088539+0000","last_became_active":"2024-09-12T18:26:43.854155+0000","last_became_peered":"2024-09-12T18:26:43.854155+0000","last_unstale":"2024-09-12T19:14:23.088539+0000","last_undegraded":"2024-09-12T19:14:23.088539+0000","last_fullsized":"2024-09-12T19:14:23.088539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:23.088313+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:23.088313+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.088313+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:08.243249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'70","reported_seq":582,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.634014+0000","last_change":"2024-09-12T19:14:27.634014+0000","last_active":"2024-09-12T19:14:27.634014+0000","last_peered":"2024-09-12T19:14:27.634014+0000","last_clean":"2024-09-12T19:14:27.634014+0000","last_became_active":"2024-09-12T18:26:45.876785+0000","last_became_peered":"2024-09-12T18:26:45.876785+0000","last_unstale":"2024-09-12T19:14:27.634014+0000","last_undegraded":"2024-09-12T19:14:27.634014+0000","last_fullsized":"2024-09-12T19:14:27.634014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'70","last_scrub_stamp":"2024-09-12T19:14:27.633823+0000","last_deep_scrub":"265'70","last_deep_scrub_stamp":"2024-09-12T19:14:27.633823+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.633823+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:21.906210+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.946756+0000","last_change":"2024-09-12T19:14:34.946756+0000","last_active":"2024-09-12T19:14:34.946756+0000","last_peered":"2024-09-12T19:14:34.946756+0000","last_clean":"2024-09-12T19:14:34.946756+0000","last_became_active":"2024-09-12T18:26:47.890879+0000","last_became_peered":"2024-09-12T18:26:47.890879+0000","last_unstale":"2024-09-12T19:14:34.946756+0000","last_undegraded":"2024-09-12T19:14:34.946756+0000","last_fullsized":"2024-09-12T19:14:34.946756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:34.946573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:34.946573+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.946573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:29.143096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'242","reported_seq":779,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.586436+0000","last_change":"2024-09-12T19:14:39.586436+0000","last_active":"2024-09-12T19:14:39.586436+0000","last_peered":"2024-09-12T19:14:39.586436+0000","last_clean":"2024-09-12T19:14:39.586436+0000","last_became_active":"2024-09-12T18:26:49.925984+0000","last_became_peered":"2024-09-12T18:26:49.925984+0000","last_unstale":"2024-09-12T19:14:39.586436+0000","last_undegraded":"2024-09-12T19:14:39.586436+0000","last_fullsized":"2024-09-12T19:14:39.586436+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'242","last_scrub_stamp":"2024-09-12T19:14:39.586244+0000","last_deep_scrub":"265'242","last_deep_scrub_stamp":"2024-09-12T19:14:39.586244+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.586244+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:53.690239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":350,"num_read_kb":337,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'464","reported_seq":2031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.936402+0000","last_change":"2024-09-12T19:14:17.936402+0000","last_active":"2024-09-12T19:14:17.936402+0000","last_peered":"2024-09-12T19:14:17.936402+0000","last_clean":"2024-09-12T19:14:17.936402+0000","last_became_active":"2024-09-12T18:26:41.881971+0000","last_became_peered":"2024-09-12T18:26:41.881971+0000","last_unstale":"2024-09-12T19:14:17.936402+0000","last_undegraded":"2024-09-12T19:14:17.936402+0000","last_fullsized":"2024-09-12T19:14:17.936402+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'464","last_scrub_stamp":"2024-09-12T19:14:17.936203+0000","last_deep_scrub":"265'464","last_deep_scrub_stamp":"2024-09-12T19:14:17.936203+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.936203+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:43.789540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2569,"num_read_kb":2413,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'356","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.537282+0000","last_change":"2024-09-12T19:14:08.537024+0000","last_active":"2024-09-12T19:14:08.537282+0000","last_peered":"2024-09-12T19:14:08.537282+0000","last_clean":"2024-09-12T19:14:08.537282+0000","last_became_active":"2024-09-12T18:26:39.873510+0000","last_became_peered":"2024-09-12T18:26:39.873510+0000","last_unstale":"2024-09-12T19:14:08.537282+0000","last_undegraded":"2024-09-12T19:14:08.537282+0000","last_fullsized":"2024-09-12T19:14:08.537282+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T19:14:08.536754+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T19:14:08.536754+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.536754+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:17.499997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":9367,"num_write":1141,"num_write_kb":22463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.899799+0000","last_change":"2024-09-12T19:14:24.899799+0000","last_active":"2024-09-12T19:14:24.899799+0000","last_peered":"2024-09-12T19:14:24.899799+0000","last_clean":"2024-09-12T19:14:24.899799+0000","last_became_active":"2024-09-12T18:26:43.859847+0000","last_became_peered":"2024-09-12T18:26:43.859847+0000","last_unstale":"2024-09-12T19:14:24.899799+0000","last_undegraded":"2024-09-12T19:14:24.899799+0000","last_fullsized":"2024-09-12T19:14:24.899799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:24.899615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:24.899615+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.899615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:15.801326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'323","reported_seq":919,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.159233+0000","last_change":"2024-09-12T19:14:34.159233+0000","last_active":"2024-09-12T19:14:34.159233+0000","last_peered":"2024-09-12T19:14:34.159233+0000","last_clean":"2024-09-12T19:14:34.159233+0000","last_became_active":"2024-09-12T18:26:45.877790+0000","last_became_peered":"2024-09-12T18:26:45.877790+0000","last_unstale":"2024-09-12T19:14:34.159233+0000","last_undegraded":"2024-09-12T19:14:34.159233+0000","last_fullsized":"2024-09-12T19:14:34.159233+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'323","last_scrub_stamp":"2024-09-12T19:14:34.159030+0000","last_deep_scrub":"265'323","last_deep_scrub_stamp":"2024-09-12T19:14:34.159030+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.159030+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:12.177367+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53461,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1153,"num_write":418,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.660232+0000","last_change":"2024-09-12T19:14:24.660232+0000","last_active":"2024-09-12T19:14:24.660232+0000","last_peered":"2024-09-12T19:14:24.660232+0000","last_clean":"2024-09-12T19:14:24.660232+0000","last_became_active":"2024-09-12T18:26:47.888252+0000","last_became_peered":"2024-09-12T18:26:47.888252+0000","last_unstale":"2024-09-12T19:14:24.660232+0000","last_undegraded":"2024-09-12T19:14:24.660232+0000","last_fullsized":"2024-09-12T19:14:24.660232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:24.660011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:24.660011+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.660011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:19.539418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'147","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.421474+0000","last_change":"2024-09-12T19:14:40.421474+0000","last_active":"2024-09-12T19:14:40.421474+0000","last_peered":"2024-09-12T19:14:40.421474+0000","last_clean":"2024-09-12T19:14:40.421474+0000","last_became_active":"2024-09-12T18:26:49.922459+0000","last_became_peered":"2024-09-12T18:26:49.922459+0000","last_unstale":"2024-09-12T19:14:40.421474+0000","last_undegraded":"2024-09-12T19:14:40.421474+0000","last_fullsized":"2024-09-12T19:14:40.421474+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'147","last_scrub_stamp":"2024-09-12T19:14:40.421300+0000","last_deep_scrub":"265'147","last_deep_scrub_stamp":"2024-09-12T19:14:40.421300+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.421300+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:35.325046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":460,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":153,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'473","reported_seq":1990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.139968+0000","last_change":"2024-09-12T19:14:26.139968+0000","last_active":"2024-09-12T19:14:26.139968+0000","last_peered":"2024-09-12T19:14:26.139968+0000","last_clean":"2024-09-12T19:14:26.139968+0000","last_became_active":"2024-09-12T18:26:41.850749+0000","last_became_peered":"2024-09-12T18:26:41.850749+0000","last_unstale":"2024-09-12T19:14:26.139968+0000","last_undegraded":"2024-09-12T19:14:26.139968+0000","last_fullsized":"2024-09-12T19:14:26.139968+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T19:14:26.139906+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T19:14:26.139906+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.139906+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:31.076243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2503,"num_read_kb":2331,"num_write":575,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'394","reported_seq":1062,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.877935+0000","last_change":"2024-09-12T19:14:04.877872+0000","last_active":"2024-09-12T19:14:04.877935+0000","last_peered":"2024-09-12T19:14:04.877935+0000","last_clean":"2024-09-12T19:14:04.877935+0000","last_became_active":"2024-09-12T18:26:39.854328+0000","last_became_peered":"2024-09-12T18:26:39.854328+0000","last_unstale":"2024-09-12T19:14:04.877935+0000","last_undegraded":"2024-09-12T19:14:04.877935+0000","last_fullsized":"2024-09-12T19:14:04.877935+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T19:14:04.877782+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T19:14:04.877782+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.877782+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:04.369955+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653632,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":578,"num_read_kb":9662,"num_write":1241,"num_write_kb":35097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.636565+0000","last_change":"2024-09-12T19:14:19.636565+0000","last_active":"2024-09-12T19:14:19.636565+0000","last_peered":"2024-09-12T19:14:19.636565+0000","last_clean":"2024-09-12T19:14:19.636565+0000","last_became_active":"2024-09-12T18:26:43.865454+0000","last_became_peered":"2024-09-12T18:26:43.865454+0000","last_unstale":"2024-09-12T19:14:19.636565+0000","last_undegraded":"2024-09-12T19:14:19.636565+0000","last_fullsized":"2024-09-12T19:14:19.636565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:19.636385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:19.636385+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.636385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:25.727508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'251","reported_seq":823,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.957699+0000","last_change":"2024-09-12T19:14:30.957699+0000","last_active":"2024-09-12T19:14:30.957699+0000","last_peered":"2024-09-12T19:14:30.957699+0000","last_clean":"2024-09-12T19:14:30.957699+0000","last_became_active":"2024-09-12T18:26:45.867096+0000","last_became_peered":"2024-09-12T18:26:45.867096+0000","last_unstale":"2024-09-12T19:14:30.957699+0000","last_undegraded":"2024-09-12T19:14:30.957699+0000","last_fullsized":"2024-09-12T19:14:30.957699+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'251","last_scrub_stamp":"2024-09-12T19:14:30.957445+0000","last_deep_scrub":"265'251","last_deep_scrub_stamp":"2024-09-12T19:14:30.957445+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.957445+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:47.556501+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50031,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":412,"num_read_kb":948,"num_write":330,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.645346+0000","last_change":"2024-09-12T19:14:37.645346+0000","last_active":"2024-09-12T19:14:37.645346+0000","last_peered":"2024-09-12T19:14:37.645346+0000","last_clean":"2024-09-12T19:14:37.645346+0000","last_became_active":"2024-09-12T18:26:47.895092+0000","last_became_peered":"2024-09-12T18:26:47.895092+0000","last_unstale":"2024-09-12T19:14:37.645346+0000","last_undegraded":"2024-09-12T19:14:37.645346+0000","last_fullsized":"2024-09-12T19:14:37.645346+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:37.645167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:37.645167+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.645167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:11.713611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'824","reported_seq":2431,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.626437+0000","last_change":"2024-09-12T19:14:13.626256+0000","last_active":"2024-09-12T19:14:13.626437+0000","last_peered":"2024-09-12T19:14:13.626437+0000","last_clean":"2024-09-12T19:14:13.626437+0000","last_became_active":"2024-09-12T18:26:41.871943+0000","last_became_peered":"2024-09-12T18:26:41.871943+0000","last_unstale":"2024-09-12T19:14:13.626437+0000","last_undegraded":"2024-09-12T19:14:13.626437+0000","last_fullsized":"2024-09-12T19:14:13.626437+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'824","last_scrub_stamp":"2024-09-12T19:14:13.626053+0000","last_deep_scrub":"265'824","last_deep_scrub_stamp":"2024-09-12T19:14:13.626053+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.626053+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.562273+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3898,"num_read_kb":3510,"num_write":1047,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'395","reported_seq":1100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.825280+0000","last_change":"2024-09-12T19:14:12.825137+0000","last_active":"2024-09-12T19:14:12.825280+0000","last_peered":"2024-09-12T19:14:12.825280+0000","last_clean":"2024-09-12T19:14:12.825280+0000","last_became_active":"2024-09-12T18:26:39.830963+0000","last_became_peered":"2024-09-12T18:26:39.830963+0000","last_unstale":"2024-09-12T19:14:12.825280+0000","last_undegraded":"2024-09-12T19:14:12.825280+0000","last_fullsized":"2024-09-12T19:14:12.825280+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'395","last_scrub_stamp":"2024-09-12T19:14:12.824911+0000","last_deep_scrub":"265'395","last_deep_scrub_stamp":"2024-09-12T19:14:12.824911+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.824911+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:52.488076+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1535921,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":35487,"num_write":1279,"num_write_kb":27084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.765053+0000","last_change":"2024-09-12T19:14:16.764872+0000","last_active":"2024-09-12T19:14:16.765053+0000","last_peered":"2024-09-12T19:14:16.765053+0000","last_clean":"2024-09-12T19:14:16.765053+0000","last_became_active":"2024-09-12T18:26:43.861521+0000","last_became_peered":"2024-09-12T18:26:43.861521+0000","last_unstale":"2024-09-12T19:14:16.765053+0000","last_undegraded":"2024-09-12T19:14:16.765053+0000","last_fullsized":"2024-09-12T19:14:16.765053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:16.764692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:16.764692+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.764692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:50.424087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'455","reported_seq":1094,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.104481+0000","last_change":"2024-09-12T19:14:28.104481+0000","last_active":"2024-09-12T19:14:28.104481+0000","last_peered":"2024-09-12T19:14:28.104481+0000","last_clean":"2024-09-12T19:14:28.104481+0000","last_became_active":"2024-09-12T18:26:45.872177+0000","last_became_peered":"2024-09-12T18:26:45.872177+0000","last_unstale":"2024-09-12T19:14:28.104481+0000","last_undegraded":"2024-09-12T19:14:28.104481+0000","last_fullsized":"2024-09-12T19:14:28.104481+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'455","last_scrub_stamp":"2024-09-12T19:14:28.104260+0000","last_deep_scrub":"265'455","last_deep_scrub_stamp":"2024-09-12T19:14:28.104260+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.104260+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:34.205526+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101880,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":818,"num_read_kb":1923,"num_write":698,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.440404+0000","last_change":"2024-09-12T19:14:33.440404+0000","last_active":"2024-09-12T19:14:33.440404+0000","last_peered":"2024-09-12T19:14:33.440404+0000","last_clean":"2024-09-12T19:14:33.440404+0000","last_became_active":"2024-09-12T18:26:47.902702+0000","last_became_peered":"2024-09-12T18:26:47.902702+0000","last_unstale":"2024-09-12T19:14:33.440404+0000","last_undegraded":"2024-09-12T19:14:33.440404+0000","last_fullsized":"2024-09-12T19:14:33.440404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:33.440225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:33.440225+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.440225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:15.909780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'192","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:45.160203+0000","last_change":"2024-09-12T19:14:45.160203+0000","last_active":"2024-09-12T19:14:45.160203+0000","last_peered":"2024-09-12T19:14:45.160203+0000","last_clean":"2024-09-12T19:14:45.160203+0000","last_became_active":"2024-09-12T18:26:49.920066+0000","last_became_peered":"2024-09-12T18:26:49.920066+0000","last_unstale":"2024-09-12T19:14:45.160203+0000","last_undegraded":"2024-09-12T19:14:45.160203+0000","last_fullsized":"2024-09-12T19:14:45.160203+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'192","last_scrub_stamp":"2024-09-12T19:14:45.159929+0000","last_deep_scrub":"265'192","last_deep_scrub_stamp":"2024-09-12T19:14:45.159929+0000","last_clean_scrub_stamp":"2024-09-12T19:14:45.159929+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:13.869016+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":247,"num_read_kb":248,"num_write":459,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'766","reported_seq":2252,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.780295+0000","last_change":"2024-09-12T19:14:13.780033+0000","last_active":"2024-09-12T19:14:13.780295+0000","last_peered":"2024-09-12T19:14:13.780295+0000","last_clean":"2024-09-12T19:14:13.780295+0000","last_became_active":"2024-09-12T18:26:41.852157+0000","last_became_peered":"2024-09-12T18:26:41.852157+0000","last_unstale":"2024-09-12T19:14:13.780295+0000","last_undegraded":"2024-09-12T19:14:13.780295+0000","last_fullsized":"2024-09-12T19:14:13.780295+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'766","last_scrub_stamp":"2024-09-12T19:14:13.779803+0000","last_deep_scrub":"265'766","last_deep_scrub_stamp":"2024-09-12T19:14:13.779803+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.779803+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:23.013752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3590,"num_read_kb":3230,"num_write":1002,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'359","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.109273+0000","last_change":"2024-09-12T19:14:04.109273+0000","last_active":"2024-09-12T19:14:04.109273+0000","last_peered":"2024-09-12T19:14:04.109273+0000","last_clean":"2024-09-12T19:14:04.109273+0000","last_became_active":"2024-09-12T18:27:11.827218+0000","last_became_peered":"2024-09-12T18:27:11.827218+0000","last_unstale":"2024-09-12T19:14:04.109273+0000","last_undegraded":"2024-09-12T19:14:04.109273+0000","last_fullsized":"2024-09-12T19:14:04.109273+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-12T19:14:04.109120+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-12T19:14:04.109120+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.109120+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:11.700071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35618,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":7368,"num_write":1157,"num_write_kb":18791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.620363+0000","last_change":"2024-09-12T19:14:20.620223+0000","last_active":"2024-09-12T19:14:20.620363+0000","last_peered":"2024-09-12T19:14:20.620363+0000","last_clean":"2024-09-12T19:14:20.620363+0000","last_became_active":"2024-09-12T18:26:43.865319+0000","last_became_peered":"2024-09-12T18:26:43.865319+0000","last_unstale":"2024-09-12T19:14:20.620363+0000","last_undegraded":"2024-09-12T19:14:20.620363+0000","last_fullsized":"2024-09-12T19:14:20.620363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:20.620033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:20.620033+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.620033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:41.034438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'305","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.971413+0000","last_change":"2024-09-12T19:14:33.971413+0000","last_active":"2024-09-12T19:14:33.971413+0000","last_peered":"2024-09-12T19:14:33.971413+0000","last_clean":"2024-09-12T19:14:33.971413+0000","last_became_active":"2024-09-12T18:26:45.873197+0000","last_became_peered":"2024-09-12T18:26:45.873197+0000","last_unstale":"2024-09-12T19:14:33.971413+0000","last_undegraded":"2024-09-12T19:14:33.971413+0000","last_fullsized":"2024-09-12T19:14:33.971413+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T19:14:33.971112+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T19:14:33.971112+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.971112+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:32.411051+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55940,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":484,"num_read_kb":1049,"num_write":402,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.125907+0000","last_change":"2024-09-12T19:14:26.125907+0000","last_active":"2024-09-12T19:14:26.125907+0000","last_peered":"2024-09-12T19:14:26.125907+0000","last_clean":"2024-09-12T19:14:26.125907+0000","last_became_active":"2024-09-12T18:26:47.883930+0000","last_became_peered":"2024-09-12T18:26:47.883930+0000","last_unstale":"2024-09-12T19:14:26.125907+0000","last_undegraded":"2024-09-12T19:14:26.125907+0000","last_fullsized":"2024-09-12T19:14:26.125907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.125835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.125835+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.125835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:41.323040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'185","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.621808+0000","last_change":"2024-09-12T19:14:29.621808+0000","last_active":"2024-09-12T19:14:29.621808+0000","last_peered":"2024-09-12T19:14:29.621808+0000","last_clean":"2024-09-12T19:14:29.621808+0000","last_became_active":"2024-09-12T18:26:49.921797+0000","last_became_peered":"2024-09-12T18:26:49.921797+0000","last_unstale":"2024-09-12T19:14:29.621808+0000","last_undegraded":"2024-09-12T19:14:29.621808+0000","last_fullsized":"2024-09-12T19:14:29.621808+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'185","last_scrub_stamp":"2024-09-12T19:14:29.621585+0000","last_deep_scrub":"265'185","last_deep_scrub_stamp":"2024-09-12T19:14:29.621585+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.621585+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:37.942287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1230,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":213,"num_write":519,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'510","reported_seq":1866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.874616+0000","last_change":"2024-09-12T19:14:14.874616+0000","last_active":"2024-09-12T19:14:14.874616+0000","last_peered":"2024-09-12T19:14:14.874616+0000","last_clean":"2024-09-12T19:14:14.874616+0000","last_became_active":"2024-09-12T18:26:41.850647+0000","last_became_peered":"2024-09-12T18:26:41.850647+0000","last_unstale":"2024-09-12T19:14:14.874616+0000","last_undegraded":"2024-09-12T19:14:14.874616+0000","last_fullsized":"2024-09-12T19:14:14.874616+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'510","last_scrub_stamp":"2024-09-12T19:14:14.874432+0000","last_deep_scrub":"265'510","last_deep_scrub_stamp":"2024-09-12T19:14:14.874432+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.874432+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:42.100953+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2444,"num_write":714,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'370","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.335302+0000","last_change":"2024-09-12T19:14:06.335158+0000","last_active":"2024-09-12T19:14:06.335302+0000","last_peered":"2024-09-12T19:14:06.335302+0000","last_clean":"2024-09-12T19:14:06.335302+0000","last_became_active":"2024-09-12T18:26:39.840458+0000","last_became_peered":"2024-09-12T18:26:39.840458+0000","last_unstale":"2024-09-12T19:14:06.335302+0000","last_undegraded":"2024-09-12T19:14:06.335302+0000","last_fullsized":"2024-09-12T19:14:06.335302+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T19:14:06.334888+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T19:14:06.334888+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.334888+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:55.530203+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":36107,"num_write":1118,"num_write_kb":45658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.397690+0000","last_change":"2024-09-12T19:14:28.397690+0000","last_active":"2024-09-12T19:14:28.397690+0000","last_peered":"2024-09-12T19:14:28.397690+0000","last_clean":"2024-09-12T19:14:28.397690+0000","last_became_active":"2024-09-12T18:26:43.873669+0000","last_became_peered":"2024-09-12T18:26:43.873669+0000","last_unstale":"2024-09-12T19:14:28.397690+0000","last_undegraded":"2024-09-12T19:14:28.397690+0000","last_fullsized":"2024-09-12T19:14:28.397690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:28.397489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:28.397489+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.397489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:00.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'289","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.133092+0000","last_change":"2024-09-12T19:14:32.132819+0000","last_active":"2024-09-12T19:14:32.133092+0000","last_peered":"2024-09-12T19:14:32.133092+0000","last_clean":"2024-09-12T19:14:32.133092+0000","last_became_active":"2024-09-12T18:26:46.023025+0000","last_became_peered":"2024-09-12T18:26:46.023025+0000","last_unstale":"2024-09-12T19:14:32.133092+0000","last_undegraded":"2024-09-12T19:14:32.133092+0000","last_fullsized":"2024-09-12T19:14:32.133092+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'289","last_scrub_stamp":"2024-09-12T19:14:32.132594+0000","last_deep_scrub":"265'289","last_deep_scrub_stamp":"2024-09-12T19:14:32.132594+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.132594+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:06.506994+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44021,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":1142,"num_write":398,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.084987+0000","last_change":"2024-09-12T19:14:27.084809+0000","last_active":"2024-09-12T19:14:27.084987+0000","last_peered":"2024-09-12T19:14:27.084987+0000","last_clean":"2024-09-12T19:14:27.084987+0000","last_became_active":"2024-09-12T18:26:47.892678+0000","last_became_peered":"2024-09-12T18:26:47.892678+0000","last_unstale":"2024-09-12T19:14:27.084987+0000","last_undegraded":"2024-09-12T19:14:27.084987+0000","last_fullsized":"2024-09-12T19:14:27.084987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:27.084634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:27.084634+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.084634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:09.082275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'117","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.465745+0000","last_change":"2024-09-12T19:14:38.465745+0000","last_active":"2024-09-12T19:14:38.465745+0000","last_peered":"2024-09-12T19:14:38.465745+0000","last_clean":"2024-09-12T19:14:38.465745+0000","last_became_active":"2024-09-12T18:26:49.919229+0000","last_became_peered":"2024-09-12T18:26:49.919229+0000","last_unstale":"2024-09-12T19:14:38.465745+0000","last_undegraded":"2024-09-12T19:14:38.465745+0000","last_fullsized":"2024-09-12T19:14:38.465745+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'117","last_scrub_stamp":"2024-09-12T19:14:38.465553+0000","last_deep_scrub":"265'117","last_deep_scrub_stamp":"2024-09-12T19:14:38.465553+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.465553+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:11.984486+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":95,"num_write":270,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'505","reported_seq":2215,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.051477+0000","last_change":"2024-09-12T19:14:09.051264+0000","last_active":"2024-09-12T19:14:09.051477+0000","last_peered":"2024-09-12T19:14:09.051477+0000","last_clean":"2024-09-12T19:14:09.051477+0000","last_became_active":"2024-09-12T18:26:41.844608+0000","last_became_peered":"2024-09-12T18:26:41.844608+0000","last_unstale":"2024-09-12T19:14:09.051477+0000","last_undegraded":"2024-09-12T19:14:09.051477+0000","last_fullsized":"2024-09-12T19:14:09.051477+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T19:14:09.051011+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T19:14:09.051011+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.051011+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:05.391256+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2752,"num_read_kb":2596,"num_write":594,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'356","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.038812+0000","last_change":"2024-09-12T19:14:05.038747+0000","last_active":"2024-09-12T19:14:05.038812+0000","last_peered":"2024-09-12T19:14:05.038812+0000","last_clean":"2024-09-12T19:14:05.038812+0000","last_became_active":"2024-09-12T18:27:11.807022+0000","last_became_peered":"2024-09-12T18:27:11.807022+0000","last_unstale":"2024-09-12T19:14:05.038812+0000","last_undegraded":"2024-09-12T19:14:05.038812+0000","last_fullsized":"2024-09-12T19:14:05.038812+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T19:14:05.038645+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T19:14:05.038645+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.038645+0000","objects_scrubbed":10,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:35.165624+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4711351,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":491,"num_read_kb":61134,"num_write":1039,"num_write_kb":46178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.189124+0000","last_change":"2024-09-12T19:14:18.189124+0000","last_active":"2024-09-12T19:14:18.189124+0000","last_peered":"2024-09-12T19:14:18.189124+0000","last_clean":"2024-09-12T19:14:18.189124+0000","last_became_active":"2024-09-12T18:26:43.859997+0000","last_became_peered":"2024-09-12T18:26:43.859997+0000","last_unstale":"2024-09-12T19:14:18.189124+0000","last_undegraded":"2024-09-12T19:14:18.189124+0000","last_fullsized":"2024-09-12T19:14:18.189124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:18.188935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:18.188935+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.188935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:37.056353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'97","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.465679+0000","last_change":"2024-09-12T19:14:32.465536+0000","last_active":"2024-09-12T19:14:32.465679+0000","last_peered":"2024-09-12T19:14:32.465679+0000","last_clean":"2024-09-12T19:14:32.465679+0000","last_became_active":"2024-09-12T18:26:46.022246+0000","last_became_peered":"2024-09-12T18:26:46.022246+0000","last_unstale":"2024-09-12T19:14:32.465679+0000","last_undegraded":"2024-09-12T19:14:32.465679+0000","last_fullsized":"2024-09-12T19:14:32.465679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'97","last_scrub_stamp":"2024-09-12T19:14:32.465307+0000","last_deep_scrub":"265'97","last_deep_scrub_stamp":"2024-09-12T19:14:32.465307+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.465307+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:58.419382+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":130,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'771","reported_seq":2319,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.623054+0000","last_change":"2024-09-12T19:14:26.622931+0000","last_active":"2024-09-12T19:14:26.623054+0000","last_peered":"2024-09-12T19:14:26.623054+0000","last_clean":"2024-09-12T19:14:26.623054+0000","last_became_active":"2024-09-12T18:26:47.891107+0000","last_became_peered":"2024-09-12T18:26:47.891107+0000","last_unstale":"2024-09-12T19:14:26.623054+0000","last_undegraded":"2024-09-12T19:14:26.623054+0000","last_fullsized":"2024-09-12T19:14:26.623054+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-12T19:14:26.622749+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-12T19:14:26.622749+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.622749+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":701,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:47.744229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'115","reported_seq":612,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.951554+0000","last_change":"2024-09-12T19:14:37.951554+0000","last_active":"2024-09-12T19:14:37.951554+0000","last_peered":"2024-09-12T19:14:37.951554+0000","last_clean":"2024-09-12T19:14:37.951554+0000","last_became_active":"2024-09-12T18:26:49.915975+0000","last_became_peered":"2024-09-12T18:26:49.915975+0000","last_unstale":"2024-09-12T19:14:37.951554+0000","last_undegraded":"2024-09-12T19:14:37.951554+0000","last_fullsized":"2024-09-12T19:14:37.951554+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'115","last_scrub_stamp":"2024-09-12T19:14:37.951350+0000","last_deep_scrub":"265'115","last_deep_scrub_stamp":"2024-09-12T19:14:37.951350+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.951350+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:04.237891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":276,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'459","reported_seq":2189,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.267997+0000","last_change":"2024-09-12T19:14:17.267997+0000","last_active":"2024-09-12T19:14:17.267997+0000","last_peered":"2024-09-12T19:14:17.267997+0000","last_clean":"2024-09-12T19:14:17.267997+0000","last_became_active":"2024-09-12T18:26:41.853112+0000","last_became_peered":"2024-09-12T18:26:41.853112+0000","last_unstale":"2024-09-12T19:14:17.267997+0000","last_undegraded":"2024-09-12T19:14:17.267997+0000","last_fullsized":"2024-09-12T19:14:17.267997+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'459","last_scrub_stamp":"2024-09-12T19:14:17.267770+0000","last_deep_scrub":"265'459","last_deep_scrub_stamp":"2024-09-12T19:14:17.267770+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.267770+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:48.144249+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2539,"num_write":529,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'386","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.623237+0000","last_change":"2024-09-12T19:14:10.623072+0000","last_active":"2024-09-12T19:14:10.623237+0000","last_peered":"2024-09-12T19:14:10.623237+0000","last_clean":"2024-09-12T19:14:10.623237+0000","last_became_active":"2024-09-12T18:26:39.867136+0000","last_became_peered":"2024-09-12T18:26:39.867136+0000","last_unstale":"2024-09-12T19:14:10.623237+0000","last_undegraded":"2024-09-12T19:14:10.623237+0000","last_fullsized":"2024-09-12T19:14:10.623237+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T19:14:10.622850+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T19:14:10.622850+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.622850+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:12.986847+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":531,"num_read_kb":14806,"num_write":1141,"num_write_kb":34226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.948462+0000","last_change":"2024-09-12T19:14:26.948462+0000","last_active":"2024-09-12T19:14:26.948462+0000","last_peered":"2024-09-12T19:14:26.948462+0000","last_clean":"2024-09-12T19:14:26.948462+0000","last_became_active":"2024-09-12T18:26:43.876801+0000","last_became_peered":"2024-09-12T18:26:43.876801+0000","last_unstale":"2024-09-12T19:14:26.948462+0000","last_undegraded":"2024-09-12T19:14:26.948462+0000","last_fullsized":"2024-09-12T19:14:26.948462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.948178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.948178+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.948178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.096405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'301","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.448405+0000","last_change":"2024-09-12T19:14:34.448405+0000","last_active":"2024-09-12T19:14:34.448405+0000","last_peered":"2024-09-12T19:14:34.448405+0000","last_clean":"2024-09-12T19:14:34.448405+0000","last_became_active":"2024-09-12T18:26:45.872458+0000","last_became_peered":"2024-09-12T18:26:45.872458+0000","last_unstale":"2024-09-12T19:14:34.448405+0000","last_undegraded":"2024-09-12T19:14:34.448405+0000","last_fullsized":"2024-09-12T19:14:34.448405+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'301","last_scrub_stamp":"2024-09-12T19:14:34.448139+0000","last_deep_scrub":"265'301","last_deep_scrub_stamp":"2024-09-12T19:14:34.448139+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.448139+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:34.342174+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48239,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":1098,"num_write":396,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.612118+0000","last_change":"2024-09-12T19:14:32.612118+0000","last_active":"2024-09-12T19:14:32.612118+0000","last_peered":"2024-09-12T19:14:32.612118+0000","last_clean":"2024-09-12T19:14:32.612118+0000","last_became_active":"2024-09-12T18:26:47.894689+0000","last_became_peered":"2024-09-12T18:26:47.894689+0000","last_unstale":"2024-09-12T19:14:32.612118+0000","last_undegraded":"2024-09-12T19:14:32.612118+0000","last_fullsized":"2024-09-12T19:14:32.612118+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:32.611933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:32.611933+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.611933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:14.342442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'126","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.933153+0000","last_change":"2024-09-12T19:14:39.933153+0000","last_active":"2024-09-12T19:14:39.933153+0000","last_peered":"2024-09-12T19:14:39.933153+0000","last_clean":"2024-09-12T19:14:39.933153+0000","last_became_active":"2024-09-12T18:26:49.930794+0000","last_became_peered":"2024-09-12T18:26:49.930794+0000","last_unstale":"2024-09-12T19:14:39.933153+0000","last_undegraded":"2024-09-12T19:14:39.933153+0000","last_fullsized":"2024-09-12T19:14:39.933153+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T19:14:39.932971+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T19:14:39.932971+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.932971+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:37.505049+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":295,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'615","reported_seq":2283,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.306673+0000","last_change":"2024-09-12T19:14:16.306673+0000","last_active":"2024-09-12T19:14:16.306673+0000","last_peered":"2024-09-12T19:14:16.306673+0000","last_clean":"2024-09-12T19:14:16.306673+0000","last_became_active":"2024-09-12T18:26:41.856621+0000","last_became_peered":"2024-09-12T18:26:41.856621+0000","last_unstale":"2024-09-12T19:14:16.306673+0000","last_undegraded":"2024-09-12T19:14:16.306673+0000","last_fullsized":"2024-09-12T19:14:16.306673+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'615","last_scrub_stamp":"2024-09-12T19:14:16.306444+0000","last_deep_scrub":"265'615","last_deep_scrub_stamp":"2024-09-12T19:14:16.306444+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.306444+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:27.035273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3116,"num_read_kb":2841,"num_write":759,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'350","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.527370+0000","last_change":"2024-09-12T19:14:07.527194+0000","last_active":"2024-09-12T19:14:07.527370+0000","last_peered":"2024-09-12T19:14:07.527370+0000","last_clean":"2024-09-12T19:14:07.527370+0000","last_became_active":"2024-09-12T18:26:39.861108+0000","last_became_peered":"2024-09-12T18:26:39.861108+0000","last_unstale":"2024-09-12T19:14:07.527370+0000","last_undegraded":"2024-09-12T19:14:07.527370+0000","last_fullsized":"2024-09-12T19:14:07.527370+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-12T19:14:07.526998+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-12T19:14:07.526998+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.526998+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:41.778291+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":32271,"num_write":997,"num_write_kb":22718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.351092+0000","last_change":"2024-09-12T19:14:28.351092+0000","last_active":"2024-09-12T19:14:28.351092+0000","last_peered":"2024-09-12T19:14:28.351092+0000","last_clean":"2024-09-12T19:14:28.351092+0000","last_became_active":"2024-09-12T18:26:43.860336+0000","last_became_peered":"2024-09-12T18:26:43.860336+0000","last_unstale":"2024-09-12T19:14:28.351092+0000","last_undegraded":"2024-09-12T19:14:28.351092+0000","last_fullsized":"2024-09-12T19:14:28.351092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:28.350811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:28.350811+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.350811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:11.124551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'289","reported_seq":866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.608971+0000","last_change":"2024-09-12T19:14:25.608971+0000","last_active":"2024-09-12T19:14:25.608971+0000","last_peered":"2024-09-12T19:14:25.608971+0000","last_clean":"2024-09-12T19:14:25.608971+0000","last_became_active":"2024-09-12T18:26:45.881364+0000","last_became_peered":"2024-09-12T18:26:45.881364+0000","last_unstale":"2024-09-12T19:14:25.608971+0000","last_undegraded":"2024-09-12T19:14:25.608971+0000","last_fullsized":"2024-09-12T19:14:25.608971+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'289","last_scrub_stamp":"2024-09-12T19:14:25.608758+0000","last_deep_scrub":"265'289","last_deep_scrub_stamp":"2024-09-12T19:14:25.608758+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.608758+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:03.024276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1088,"num_write":384,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.618093+0000","last_change":"2024-09-12T19:14:25.618093+0000","last_active":"2024-09-12T19:14:25.618093+0000","last_peered":"2024-09-12T19:14:25.618093+0000","last_clean":"2024-09-12T19:14:25.618093+0000","last_became_active":"2024-09-12T18:26:47.888055+0000","last_became_peered":"2024-09-12T18:26:47.888055+0000","last_unstale":"2024-09-12T19:14:25.618093+0000","last_undegraded":"2024-09-12T19:14:25.618093+0000","last_fullsized":"2024-09-12T19:14:25.618093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:25.617917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:25.617917+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.617917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:04.933570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'127","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.153413+0000","last_change":"2024-09-12T19:14:41.153413+0000","last_active":"2024-09-12T19:14:41.153413+0000","last_peered":"2024-09-12T19:14:41.153413+0000","last_clean":"2024-09-12T19:14:41.153413+0000","last_became_active":"2024-09-12T18:26:49.922543+0000","last_became_peered":"2024-09-12T18:26:49.922543+0000","last_unstale":"2024-09-12T19:14:41.153413+0000","last_undegraded":"2024-09-12T19:14:41.153413+0000","last_fullsized":"2024-09-12T19:14:41.153413+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-12T19:14:41.153225+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-12T19:14:41.153225+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.153225+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:36.199893+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":203,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'473","reported_seq":2067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.004828+0000","last_change":"2024-09-12T19:14:21.004828+0000","last_active":"2024-09-12T19:14:21.004828+0000","last_peered":"2024-09-12T19:14:21.004828+0000","last_clean":"2024-09-12T19:14:21.004828+0000","last_became_active":"2024-09-12T18:26:41.850499+0000","last_became_peered":"2024-09-12T18:26:41.850499+0000","last_unstale":"2024-09-12T19:14:21.004828+0000","last_undegraded":"2024-09-12T19:14:21.004828+0000","last_fullsized":"2024-09-12T19:14:21.004828+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T19:14:21.004635+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T19:14:21.004635+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.004635+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:17.985937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2536,"num_read_kb":2375,"num_write":558,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2075,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'330","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.924005+0000","last_change":"2024-09-12T19:14:15.923865+0000","last_active":"2024-09-12T19:14:15.924005+0000","last_peered":"2024-09-12T19:14:15.924005+0000","last_clean":"2024-09-12T19:14:15.924005+0000","last_became_active":"2024-09-12T18:26:39.847422+0000","last_became_peered":"2024-09-12T18:26:39.847422+0000","last_unstale":"2024-09-12T19:14:15.924005+0000","last_undegraded":"2024-09-12T19:14:15.924005+0000","last_fullsized":"2024-09-12T19:14:15.924005+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T19:14:15.923637+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T19:14:15.923637+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.923637+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:08.399373+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568138,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":20074,"num_write":1068,"num_write_kb":42638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.378548+0000","last_change":"2024-09-12T19:14:27.378417+0000","last_active":"2024-09-12T19:14:27.378548+0000","last_peered":"2024-09-12T19:14:27.378548+0000","last_clean":"2024-09-12T19:14:27.378548+0000","last_became_active":"2024-09-12T18:26:43.874881+0000","last_became_peered":"2024-09-12T18:26:43.874881+0000","last_unstale":"2024-09-12T19:14:27.378548+0000","last_undegraded":"2024-09-12T19:14:27.378548+0000","last_fullsized":"2024-09-12T19:14:27.378548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:27.378198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:27.378198+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.378198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:47.322357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'276","reported_seq":840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.099273+0000","last_change":"2024-09-12T19:14:39.099273+0000","last_active":"2024-09-12T19:14:39.099273+0000","last_peered":"2024-09-12T19:14:39.099273+0000","last_clean":"2024-09-12T19:14:39.099273+0000","last_became_active":"2024-09-12T18:26:45.864264+0000","last_became_peered":"2024-09-12T18:26:45.864264+0000","last_unstale":"2024-09-12T19:14:39.099273+0000","last_undegraded":"2024-09-12T19:14:39.099273+0000","last_fullsized":"2024-09-12T19:14:39.099273+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'276","last_scrub_stamp":"2024-09-12T19:14:39.099101+0000","last_deep_scrub":"265'276","last_deep_scrub_stamp":"2024-09-12T19:14:39.099101+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.099101+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:20.021492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49732,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":471,"num_read_kb":1179,"num_write":398,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.379102+0000","last_change":"2024-09-12T19:14:37.379102+0000","last_active":"2024-09-12T19:14:37.379102+0000","last_peered":"2024-09-12T19:14:37.379102+0000","last_clean":"2024-09-12T19:14:37.379102+0000","last_became_active":"2024-09-12T18:26:47.882094+0000","last_became_peered":"2024-09-12T18:26:47.882094+0000","last_unstale":"2024-09-12T19:14:37.379102+0000","last_undegraded":"2024-09-12T19:14:37.379102+0000","last_fullsized":"2024-09-12T19:14:37.379102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:37.378923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:37.378923+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.378923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:57.166212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'200","reported_seq":1665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.981290+0000","last_change":"2024-09-12T19:14:38.981290+0000","last_active":"2024-09-12T19:14:38.981290+0000","last_peered":"2024-09-12T19:14:38.981290+0000","last_clean":"2024-09-12T19:14:38.981290+0000","last_became_active":"2024-09-12T18:26:49.920808+0000","last_became_peered":"2024-09-12T18:26:49.920808+0000","last_unstale":"2024-09-12T19:14:38.981290+0000","last_undegraded":"2024-09-12T19:14:38.981290+0000","last_fullsized":"2024-09-12T19:14:38.981290+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'200","last_scrub_stamp":"2024-09-12T19:14:38.981092+0000","last_deep_scrub":"265'200","last_deep_scrub_stamp":"2024-09-12T19:14:38.981092+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.981092+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:27.527614+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1188,"num_read_kb":1184,"num_write":433,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'794","reported_seq":2302,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.292005+0000","last_change":"2024-09-12T19:14:13.291683+0000","last_active":"2024-09-12T19:14:13.292005+0000","last_peered":"2024-09-12T19:14:13.292005+0000","last_clean":"2024-09-12T19:14:13.292005+0000","last_became_active":"2024-09-12T18:26:41.873690+0000","last_became_peered":"2024-09-12T18:26:41.873690+0000","last_unstale":"2024-09-12T19:14:13.292005+0000","last_undegraded":"2024-09-12T19:14:13.292005+0000","last_fullsized":"2024-09-12T19:14:13.292005+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'794","last_scrub_stamp":"2024-09-12T19:14:13.291444+0000","last_deep_scrub":"265'794","last_deep_scrub_stamp":"2024-09-12T19:14:13.291444+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.291444+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.167004+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3645,"num_read_kb":3278,"num_write":1029,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'366","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.869192+0000","last_change":"2024-09-12T19:14:05.869008+0000","last_active":"2024-09-12T19:14:05.869192+0000","last_peered":"2024-09-12T19:14:05.869192+0000","last_clean":"2024-09-12T19:14:05.869192+0000","last_became_active":"2024-09-12T18:27:11.829577+0000","last_became_peered":"2024-09-12T18:27:11.829577+0000","last_unstale":"2024-09-12T19:14:05.869192+0000","last_undegraded":"2024-09-12T19:14:05.869192+0000","last_fullsized":"2024-09-12T19:14:05.869192+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T19:14:05.868750+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T19:14:05.868750+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.868750+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:24.728613+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513384,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":509,"num_read_kb":8019,"num_write":1212,"num_write_kb":33613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.215657+0000","last_change":"2024-09-12T19:14:19.215657+0000","last_active":"2024-09-12T19:14:19.215657+0000","last_peered":"2024-09-12T19:14:19.215657+0000","last_clean":"2024-09-12T19:14:19.215657+0000","last_became_active":"2024-09-12T18:26:43.864719+0000","last_became_peered":"2024-09-12T18:26:43.864719+0000","last_unstale":"2024-09-12T19:14:19.215657+0000","last_undegraded":"2024-09-12T19:14:19.215657+0000","last_fullsized":"2024-09-12T19:14:19.215657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:19.215472+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:19.215472+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.215472+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:05.760013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'311","reported_seq":907,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.449025+0000","last_change":"2024-09-12T19:14:34.449025+0000","last_active":"2024-09-12T19:14:34.449025+0000","last_peered":"2024-09-12T19:14:34.449025+0000","last_clean":"2024-09-12T19:14:34.449025+0000","last_became_active":"2024-09-12T18:26:45.865711+0000","last_became_peered":"2024-09-12T18:26:45.865711+0000","last_unstale":"2024-09-12T19:14:34.449025+0000","last_undegraded":"2024-09-12T19:14:34.449025+0000","last_fullsized":"2024-09-12T19:14:34.449025+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'311","last_scrub_stamp":"2024-09-12T19:14:34.448810+0000","last_deep_scrub":"265'311","last_deep_scrub_stamp":"2024-09-12T19:14:34.448810+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.448810+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:58.928887+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47780,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1144,"num_write":416,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.622059+0000","last_change":"2024-09-12T19:14:36.622059+0000","last_active":"2024-09-12T19:14:36.622059+0000","last_peered":"2024-09-12T19:14:36.622059+0000","last_clean":"2024-09-12T19:14:36.622059+0000","last_became_active":"2024-09-12T18:26:47.883014+0000","last_became_peered":"2024-09-12T18:26:47.883014+0000","last_unstale":"2024-09-12T19:14:36.622059+0000","last_undegraded":"2024-09-12T19:14:36.622059+0000","last_fullsized":"2024-09-12T19:14:36.622059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:36.621864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:36.621864+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.621864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:58.258765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'109","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.431809+0000","last_change":"2024-09-12T19:14:36.431809+0000","last_active":"2024-09-12T19:14:36.431809+0000","last_peered":"2024-09-12T19:14:36.431809+0000","last_clean":"2024-09-12T19:14:36.431809+0000","last_became_active":"2024-09-12T18:26:49.921636+0000","last_became_peered":"2024-09-12T18:26:49.921636+0000","last_unstale":"2024-09-12T19:14:36.431809+0000","last_undegraded":"2024-09-12T19:14:36.431809+0000","last_fullsized":"2024-09-12T19:14:36.431809+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-12T19:14:36.431615+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-12T19:14:36.431615+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.431615+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:18.233287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":621,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":107,"num_write":252,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'1276","reported_seq":3089,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.158163+0000","last_change":"2024-09-12T19:14:15.157980+0000","last_active":"2024-09-12T19:14:15.158163+0000","last_peered":"2024-09-12T19:14:15.158163+0000","last_clean":"2024-09-12T19:14:15.158163+0000","last_became_active":"2024-09-12T18:26:41.872455+0000","last_became_peered":"2024-09-12T18:26:41.872455+0000","last_unstale":"2024-09-12T19:14:15.158163+0000","last_undegraded":"2024-09-12T19:14:15.158163+0000","last_fullsized":"2024-09-12T19:14:15.158163+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1276","last_scrub_stamp":"2024-09-12T19:14:15.157805+0000","last_deep_scrub":"265'1276","last_deep_scrub_stamp":"2024-09-12T19:14:15.157805+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.157805+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":1200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:47.614559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6298,"num_read_kb":5578,"num_write":1816,"num_write_kb":809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'415","reported_seq":1116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.516302+0000","last_change":"2024-09-12T19:14:07.516055+0000","last_active":"2024-09-12T19:14:07.516302+0000","last_peered":"2024-09-12T19:14:07.516302+0000","last_clean":"2024-09-12T19:14:07.516302+0000","last_became_active":"2024-09-12T18:26:39.847954+0000","last_became_peered":"2024-09-12T18:26:39.847954+0000","last_unstale":"2024-09-12T19:14:07.516302+0000","last_undegraded":"2024-09-12T19:14:07.516302+0000","last_fullsized":"2024-09-12T19:14:07.516302+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'415","last_scrub_stamp":"2024-09-12T19:14:07.515758+0000","last_deep_scrub":"265'415","last_deep_scrub_stamp":"2024-09-12T19:14:07.515758+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.515758+0000","objects_scrubbed":11,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:44.678357+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263330,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":589,"num_read_kb":77066,"num_write":1254,"num_write_kb":41008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'506","reported_seq":2159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.163931+0000","last_change":"2024-09-12T19:14:17.163693+0000","last_active":"2024-09-12T19:14:17.163931+0000","last_peered":"2024-09-12T19:14:17.163931+0000","last_clean":"2024-09-12T19:14:17.163931+0000","last_became_active":"2024-09-12T18:26:41.846040+0000","last_became_peered":"2024-09-12T18:26:41.846040+0000","last_unstale":"2024-09-12T19:14:17.163931+0000","last_undegraded":"2024-09-12T19:14:17.163931+0000","last_fullsized":"2024-09-12T19:14:17.163931+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'506","last_scrub_stamp":"2024-09-12T19:14:17.163451+0000","last_deep_scrub":"265'506","last_deep_scrub_stamp":"2024-09-12T19:14:17.163451+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.163451+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:17.436750+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2703,"num_read_kb":2531,"num_write":592,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'383","reported_seq":1106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.072813+0000","last_change":"2024-09-12T19:14:06.072667+0000","last_active":"2024-09-12T19:14:06.072813+0000","last_peered":"2024-09-12T19:14:06.072813+0000","last_clean":"2024-09-12T19:14:06.072813+0000","last_became_active":"2024-09-12T18:26:39.846028+0000","last_became_peered":"2024-09-12T18:26:39.846028+0000","last_unstale":"2024-09-12T19:14:06.072813+0000","last_undegraded":"2024-09-12T19:14:06.072813+0000","last_fullsized":"2024-09-12T19:14:06.072813+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T19:14:06.072441+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T19:14:06.072441+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.072441+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:27.496097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":778,"num_read_kb":5622,"num_write":1176,"num_write_kb":40701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'518","reported_seq":2050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.449208+0000","last_change":"2024-09-12T19:14:19.449064+0000","last_active":"2024-09-12T19:14:19.449208+0000","last_peered":"2024-09-12T19:14:19.449208+0000","last_clean":"2024-09-12T19:14:19.449208+0000","last_became_active":"2024-09-12T18:26:41.884394+0000","last_became_peered":"2024-09-12T18:26:41.884394+0000","last_unstale":"2024-09-12T19:14:19.449208+0000","last_undegraded":"2024-09-12T19:14:19.449208+0000","last_fullsized":"2024-09-12T19:14:19.449208+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'518","last_scrub_stamp":"2024-09-12T19:14:19.448882+0000","last_deep_scrub":"265'518","last_deep_scrub_stamp":"2024-09-12T19:14:19.448882+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.448882+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:45.429300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2704,"num_read_kb":2505,"num_write":657,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'348","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.576885+0000","last_change":"2024-09-12T19:14:09.576657+0000","last_active":"2024-09-12T19:14:09.576885+0000","last_peered":"2024-09-12T19:14:09.576885+0000","last_clean":"2024-09-12T19:14:09.576885+0000","last_became_active":"2024-09-12T18:26:39.856026+0000","last_became_peered":"2024-09-12T18:26:39.856026+0000","last_unstale":"2024-09-12T19:14:09.576885+0000","last_undegraded":"2024-09-12T19:14:09.576885+0000","last_fullsized":"2024-09-12T19:14:09.576885+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T19:14:09.576403+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T19:14:09.576403+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.576403+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:49.231864+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136883,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":16869,"num_write":1087,"num_write_kb":23838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'540","reported_seq":2164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.152123+0000","last_change":"2024-09-12T19:14:21.151938+0000","last_active":"2024-09-12T19:14:21.152123+0000","last_peered":"2024-09-12T19:14:21.152123+0000","last_clean":"2024-09-12T19:14:21.152123+0000","last_became_active":"2024-09-12T18:26:41.850519+0000","last_became_peered":"2024-09-12T18:26:41.850519+0000","last_unstale":"2024-09-12T19:14:21.152123+0000","last_undegraded":"2024-09-12T19:14:21.152123+0000","last_fullsized":"2024-09-12T19:14:21.152123+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'540","last_scrub_stamp":"2024-09-12T19:14:21.151755+0000","last_deep_scrub":"265'540","last_deep_scrub_stamp":"2024-09-12T19:14:21.151755+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.151755+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:23.137225+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2864,"num_read_kb":2647,"num_write":672,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'356","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.828255+0000","last_change":"2024-09-12T19:14:10.828101+0000","last_active":"2024-09-12T19:14:10.828255+0000","last_peered":"2024-09-12T19:14:10.828255+0000","last_clean":"2024-09-12T19:14:10.828255+0000","last_became_active":"2024-09-12T18:26:39.842852+0000","last_became_peered":"2024-09-12T18:26:39.842852+0000","last_unstale":"2024-09-12T19:14:10.828255+0000","last_undegraded":"2024-09-12T19:14:10.828255+0000","last_fullsized":"2024-09-12T19:14:10.828255+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T19:14:10.827863+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T19:14:10.827863+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.827863+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:51.034300+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524303,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":35620,"num_write":1162,"num_write_kb":31566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'816","reported_seq":2362,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.953836+0000","last_change":"2024-09-12T19:14:16.953680+0000","last_active":"2024-09-12T19:14:16.953836+0000","last_peered":"2024-09-12T19:14:16.953836+0000","last_clean":"2024-09-12T19:14:16.953836+0000","last_became_active":"2024-09-12T18:26:41.882458+0000","last_became_peered":"2024-09-12T18:26:41.882458+0000","last_unstale":"2024-09-12T19:14:16.953836+0000","last_undegraded":"2024-09-12T19:14:16.953836+0000","last_fullsized":"2024-09-12T19:14:16.953836+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'816","last_scrub_stamp":"2024-09-12T19:14:16.953485+0000","last_deep_scrub":"265'816","last_deep_scrub_stamp":"2024-09-12T19:14:16.953485+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.953485+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:39.442346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3832,"num_read_kb":3447,"num_write":1071,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'338","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.763905+0000","last_change":"2024-09-12T19:14:05.763769+0000","last_active":"2024-09-12T19:14:05.763905+0000","last_peered":"2024-09-12T19:14:05.763905+0000","last_clean":"2024-09-12T19:14:05.763905+0000","last_became_active":"2024-09-12T18:26:39.855654+0000","last_became_peered":"2024-09-12T18:26:39.855654+0000","last_unstale":"2024-09-12T19:14:05.763905+0000","last_undegraded":"2024-09-12T19:14:05.763905+0000","last_fullsized":"2024-09-12T19:14:05.763905+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'338","last_scrub_stamp":"2024-09-12T19:14:05.763566+0000","last_deep_scrub":"265'338","last_deep_scrub_stamp":"2024-09-12T19:14:05.763566+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.763566+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:37.605894+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":592,"num_read_kb":6402,"num_write":1048,"num_write_kb":32224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'1224","reported_seq":2866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.258685+0000","last_change":"2024-09-12T19:14:18.258534+0000","last_active":"2024-09-12T19:14:18.258685+0000","last_peered":"2024-09-12T19:14:18.258685+0000","last_clean":"2024-09-12T19:14:18.258685+0000","last_became_active":"2024-09-12T18:26:41.876138+0000","last_became_peered":"2024-09-12T18:26:41.876138+0000","last_unstale":"2024-09-12T19:14:18.258685+0000","last_undegraded":"2024-09-12T19:14:18.258685+0000","last_fullsized":"2024-09-12T19:14:18.258685+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1224","last_scrub_stamp":"2024-09-12T19:14:18.258312+0000","last_deep_scrub":"265'1224","last_deep_scrub_stamp":"2024-09-12T19:14:18.258312+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.258312+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":1200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:16.154638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4890,"num_write":1674,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'314","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.063931+0000","last_change":"2024-09-12T19:14:05.063835+0000","last_active":"2024-09-12T19:14:05.063931+0000","last_peered":"2024-09-12T19:14:05.063931+0000","last_clean":"2024-09-12T19:14:05.063931+0000","last_became_active":"2024-09-12T18:26:39.844346+0000","last_became_peered":"2024-09-12T18:26:39.844346+0000","last_unstale":"2024-09-12T19:14:05.063931+0000","last_undegraded":"2024-09-12T19:14:05.063931+0000","last_fullsized":"2024-09-12T19:14:05.063931+0000","mapping_epoch":24,"log_start":"265'301","ondisk_log_start":"265'301","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-12T19:14:05.063699+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-12T19:14:05.063699+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.063699+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":301,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:23.183938+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":67178,"num_write":993,"num_write_kb":30033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'745","reported_seq":2199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.035158+0000","last_change":"2024-09-12T19:14:08.035158+0000","last_active":"2024-09-12T19:14:08.035158+0000","last_peered":"2024-09-12T19:14:08.035158+0000","last_clean":"2024-09-12T19:14:08.035158+0000","last_became_active":"2024-09-12T18:27:11.823747+0000","last_became_peered":"2024-09-12T18:27:11.823747+0000","last_unstale":"2024-09-12T19:14:08.035158+0000","last_undegraded":"2024-09-12T19:14:08.035158+0000","last_fullsized":"2024-09-12T19:14:08.035158+0000","mapping_epoch":37,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'745","last_scrub_stamp":"2024-09-12T19:14:08.034931+0000","last_deep_scrub":"265'745","last_deep_scrub_stamp":"2024-09-12T19:14:08.034931+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.034931+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:31.331294+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3535,"num_read_kb":3187,"num_write":978,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"265'340","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.585320+0000","last_change":"2024-09-12T19:14:11.585184+0000","last_active":"2024-09-12T19:14:11.585320+0000","last_peered":"2024-09-12T19:14:11.585320+0000","last_clean":"2024-09-12T19:14:11.585320+0000","last_became_active":"2024-09-12T18:26:39.871119+0000","last_became_peered":"2024-09-12T18:26:39.871119+0000","last_unstale":"2024-09-12T19:14:11.585320+0000","last_undegraded":"2024-09-12T19:14:11.585320+0000","last_fullsized":"2024-09-12T19:14:11.585320+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T19:14:11.584993+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T19:14:11.584993+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.584993+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:59.549191+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695310,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":8461,"num_write":1111,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'1067","reported_seq":2783,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.624192+0000","last_change":"2024-09-12T19:14:14.623962+0000","last_active":"2024-09-12T19:14:14.624192+0000","last_peered":"2024-09-12T19:14:14.624192+0000","last_clean":"2024-09-12T19:14:14.624192+0000","last_became_active":"2024-09-12T18:26:41.863607+0000","last_became_peered":"2024-09-12T18:26:41.863607+0000","last_unstale":"2024-09-12T19:14:14.624192+0000","last_undegraded":"2024-09-12T19:14:14.624192+0000","last_fullsized":"2024-09-12T19:14:14.624192+0000","mapping_epoch":26,"log_start":"265'1000","ondisk_log_start":"265'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1067","last_scrub_stamp":"2024-09-12T19:14:14.623754+0000","last_deep_scrub":"265'1067","last_deep_scrub_stamp":"2024-09-12T19:14:14.623754+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.623754+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":1000,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:14.209154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5203,"num_read_kb":4615,"num_write":1535,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1418,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'347","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.809761+0000","last_change":"2024-09-12T19:14:06.809689+0000","last_active":"2024-09-12T19:14:06.809761+0000","last_peered":"2024-09-12T19:14:06.809761+0000","last_clean":"2024-09-12T19:14:06.809761+0000","last_became_active":"2024-09-12T18:26:39.827475+0000","last_became_peered":"2024-09-12T18:26:39.827475+0000","last_unstale":"2024-09-12T19:14:06.809761+0000","last_undegraded":"2024-09-12T19:14:06.809761+0000","last_fullsized":"2024-09-12T19:14:06.809761+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T19:14:06.809544+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T19:14:06.809544+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.809544+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:35.789447+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136911,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":492,"num_read_kb":48337,"num_write":1107,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'826","reported_seq":2446,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.731033+0000","last_change":"2024-09-12T19:14:19.731033+0000","last_active":"2024-09-12T19:14:19.731033+0000","last_peered":"2024-09-12T19:14:19.731033+0000","last_clean":"2024-09-12T19:14:19.731033+0000","last_became_active":"2024-09-12T18:26:41.851080+0000","last_became_peered":"2024-09-12T18:26:41.851080+0000","last_unstale":"2024-09-12T19:14:19.731033+0000","last_undegraded":"2024-09-12T19:14:19.731033+0000","last_fullsized":"2024-09-12T19:14:19.731033+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'826","last_scrub_stamp":"2024-09-12T19:14:19.730759+0000","last_deep_scrub":"265'826","last_deep_scrub_stamp":"2024-09-12T19:14:19.730759+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.730759+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:22.313239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4015,"num_read_kb":3626,"num_write":1096,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'362","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.617921+0000","last_change":"2024-09-12T19:14:11.617777+0000","last_active":"2024-09-12T19:14:11.617921+0000","last_peered":"2024-09-12T19:14:11.617921+0000","last_clean":"2024-09-12T19:14:11.617921+0000","last_became_active":"2024-09-12T18:26:39.849722+0000","last_became_peered":"2024-09-12T18:26:39.849722+0000","last_unstale":"2024-09-12T19:14:11.617921+0000","last_undegraded":"2024-09-12T19:14:11.617921+0000","last_fullsized":"2024-09-12T19:14:11.617921+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T19:14:11.617565+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T19:14:11.617565+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.617565+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:32.390820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":40604,"num_write":1102,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'396","reported_seq":1935,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.331338+0000","last_change":"2024-09-12T19:14:20.331338+0000","last_active":"2024-09-12T19:14:20.331338+0000","last_peered":"2024-09-12T19:14:20.331338+0000","last_clean":"2024-09-12T19:14:20.331338+0000","last_became_active":"2024-09-12T18:26:41.851159+0000","last_became_peered":"2024-09-12T18:26:41.851159+0000","last_unstale":"2024-09-12T19:14:20.331338+0000","last_undegraded":"2024-09-12T19:14:20.331338+0000","last_fullsized":"2024-09-12T19:14:20.331338+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'396","last_scrub_stamp":"2024-09-12T19:14:20.331149+0000","last_deep_scrub":"265'396","last_deep_scrub_stamp":"2024-09-12T19:14:20.331149+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.331149+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:03.216872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2139,"num_read_kb":2047,"num_write":455,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'312","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.866891+0000","last_change":"2024-09-12T19:14:13.866891+0000","last_active":"2024-09-12T19:14:13.866891+0000","last_peered":"2024-09-12T19:14:13.866891+0000","last_clean":"2024-09-12T19:14:13.866891+0000","last_became_active":"2024-09-12T18:26:39.827933+0000","last_became_peered":"2024-09-12T18:26:39.827933+0000","last_unstale":"2024-09-12T19:14:13.866891+0000","last_undegraded":"2024-09-12T19:14:13.866891+0000","last_fullsized":"2024-09-12T19:14:13.866891+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T19:14:13.866679+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T19:14:13.866679+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.866679+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:05.360145+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":423,"num_read_kb":364,"num_write":936,"num_write_kb":38290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'1178","reported_seq":2814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.081400+0000","last_change":"2024-09-12T19:14:10.081400+0000","last_active":"2024-09-12T19:14:10.081400+0000","last_peered":"2024-09-12T19:14:10.081400+0000","last_clean":"2024-09-12T19:14:10.081400+0000","last_became_active":"2024-09-12T18:26:41.872816+0000","last_became_peered":"2024-09-12T18:26:41.872816+0000","last_unstale":"2024-09-12T19:14:10.081400+0000","last_undegraded":"2024-09-12T19:14:10.081400+0000","last_fullsized":"2024-09-12T19:14:10.081400+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1178","last_scrub_stamp":"2024-09-12T19:14:10.081223+0000","last_deep_scrub":"265'1178","last_deep_scrub_stamp":"2024-09-12T19:14:10.081223+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.081223+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:17.777350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5354,"num_read_kb":4741,"num_write":1604,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'309","reported_seq":903,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.028209+0000","last_change":"2024-09-12T19:14:07.028067+0000","last_active":"2024-09-12T19:14:07.028209+0000","last_peered":"2024-09-12T19:14:07.028209+0000","last_clean":"2024-09-12T19:14:07.028209+0000","last_became_active":"2024-09-12T18:27:12.005906+0000","last_became_peered":"2024-09-12T18:27:12.005906+0000","last_unstale":"2024-09-12T19:14:07.028209+0000","last_undegraded":"2024-09-12T19:14:07.028209+0000","last_fullsized":"2024-09-12T19:14:07.028209+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-12T19:14:07.027874+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-12T19:14:07.027874+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.027874+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:58.637085+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":9281,"num_write":1029,"num_write_kb":40338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"265'421","reported_seq":1878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.299205+0000","last_change":"2024-09-12T19:14:19.299205+0000","last_active":"2024-09-12T19:14:19.299205+0000","last_peered":"2024-09-12T19:14:19.299205+0000","last_clean":"2024-09-12T19:14:19.299205+0000","last_became_active":"2024-09-12T18:26:41.866602+0000","last_became_peered":"2024-09-12T18:26:41.866602+0000","last_unstale":"2024-09-12T19:14:19.299205+0000","last_undegraded":"2024-09-12T19:14:19.299205+0000","last_fullsized":"2024-09-12T19:14:19.299205+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T19:14:19.298966+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T19:14:19.298966+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.298966+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:05.474113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2028,"num_write":492,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'368","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.808721+0000","last_change":"2024-09-12T19:14:12.808721+0000","last_active":"2024-09-12T19:14:12.808721+0000","last_peered":"2024-09-12T19:14:12.808721+0000","last_clean":"2024-09-12T19:14:12.808721+0000","last_became_active":"2024-09-12T18:26:39.871626+0000","last_became_peered":"2024-09-12T18:26:39.871626+0000","last_unstale":"2024-09-12T19:14:12.808721+0000","last_undegraded":"2024-09-12T19:14:12.808721+0000","last_fullsized":"2024-09-12T19:14:12.808721+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T19:14:12.808485+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T19:14:12.808485+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.808485+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:25.920885+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2185594,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":15528,"num_write":1112,"num_write_kb":35488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'1249","reported_seq":2895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.880698+0000","last_change":"2024-09-12T19:14:21.880698+0000","last_active":"2024-09-12T19:14:21.880698+0000","last_peered":"2024-09-12T19:14:21.880698+0000","last_clean":"2024-09-12T19:14:21.880698+0000","last_became_active":"2024-09-12T18:26:41.876708+0000","last_became_peered":"2024-09-12T18:26:41.876708+0000","last_unstale":"2024-09-12T19:14:21.880698+0000","last_undegraded":"2024-09-12T19:14:21.880698+0000","last_fullsized":"2024-09-12T19:14:21.880698+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1249","last_scrub_stamp":"2024-09-12T19:14:21.880516+0000","last_deep_scrub":"265'1249","last_deep_scrub_stamp":"2024-09-12T19:14:21.880516+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.880516+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":1200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:42.174249+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5682,"num_read_kb":5005,"num_write":1690,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'330","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.568489+0000","last_change":"2024-09-12T19:14:09.568489+0000","last_active":"2024-09-12T19:14:09.568489+0000","last_peered":"2024-09-12T19:14:09.568489+0000","last_clean":"2024-09-12T19:14:09.568489+0000","last_became_active":"2024-09-12T18:26:39.857956+0000","last_became_peered":"2024-09-12T18:26:39.857956+0000","last_unstale":"2024-09-12T19:14:09.568489+0000","last_undegraded":"2024-09-12T19:14:09.568489+0000","last_fullsized":"2024-09-12T19:14:09.568489+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T19:14:09.568184+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T19:14:09.568184+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.568184+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:20.538784+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2580367,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":492,"num_read_kb":32197,"num_write":944,"num_write_kb":38029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'899","reported_seq":2603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.791367+0000","last_change":"2024-09-12T19:14:17.791367+0000","last_active":"2024-09-12T19:14:17.791367+0000","last_peered":"2024-09-12T19:14:17.791367+0000","last_clean":"2024-09-12T19:14:17.791367+0000","last_became_active":"2024-09-12T18:26:41.854471+0000","last_became_peered":"2024-09-12T18:26:41.854471+0000","last_unstale":"2024-09-12T19:14:17.791367+0000","last_undegraded":"2024-09-12T19:14:17.791367+0000","last_fullsized":"2024-09-12T19:14:17.791367+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'899","last_scrub_stamp":"2024-09-12T19:14:17.791192+0000","last_deep_scrub":"265'899","last_deep_scrub_stamp":"2024-09-12T19:14:17.791192+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.791192+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:01.381428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4435,"num_read_kb":4011,"num_write":1173,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'389","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.836040+0000","last_change":"2024-09-12T19:14:13.836040+0000","last_active":"2024-09-12T19:14:13.836040+0000","last_peered":"2024-09-12T19:14:13.836040+0000","last_clean":"2024-09-12T19:14:13.836040+0000","last_became_active":"2024-09-12T18:26:39.869924+0000","last_became_peered":"2024-09-12T18:26:39.869924+0000","last_unstale":"2024-09-12T19:14:13.836040+0000","last_undegraded":"2024-09-12T19:14:13.836040+0000","last_fullsized":"2024-09-12T19:14:13.836040+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'389","last_scrub_stamp":"2024-09-12T19:14:13.835820+0000","last_deep_scrub":"265'389","last_deep_scrub_stamp":"2024-09-12T19:14:13.835820+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.835820+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:38.231301+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399013,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":35584,"num_write":1226,"num_write_kb":36960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'690","reported_seq":2488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.100626+0000","last_change":"2024-09-12T19:14:24.100626+0000","last_active":"2024-09-12T19:14:24.100626+0000","last_peered":"2024-09-12T19:14:24.100626+0000","last_clean":"2024-09-12T19:14:24.100626+0000","last_became_active":"2024-09-12T18:26:41.858362+0000","last_became_peered":"2024-09-12T18:26:41.858362+0000","last_unstale":"2024-09-12T19:14:24.100626+0000","last_undegraded":"2024-09-12T19:14:24.100626+0000","last_fullsized":"2024-09-12T19:14:24.100626+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'690","last_scrub_stamp":"2024-09-12T19:14:24.100446+0000","last_deep_scrub":"265'690","last_deep_scrub_stamp":"2024-09-12T19:14:24.100446+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.100446+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:25.838408+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3672,"num_read_kb":3341,"num_write":924,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3008,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'426","reported_seq":1217,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.038483+0000","last_change":"2024-09-12T19:14:12.038483+0000","last_active":"2024-09-12T19:14:12.038483+0000","last_peered":"2024-09-12T19:14:12.038483+0000","last_clean":"2024-09-12T19:14:12.038483+0000","last_became_active":"2024-09-12T18:26:39.847373+0000","last_became_peered":"2024-09-12T18:26:39.847373+0000","last_unstale":"2024-09-12T19:14:12.038483+0000","last_undegraded":"2024-09-12T19:14:12.038483+0000","last_fullsized":"2024-09-12T19:14:12.038483+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'426","last_scrub_stamp":"2024-09-12T19:14:12.038294+0000","last_deep_scrub":"265'426","last_deep_scrub_stamp":"2024-09-12T19:14:12.038294+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.038294+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:28.497991+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":812,"num_read_kb":75472,"num_write":1417,"num_write_kb":36911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'826","reported_seq":2401,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.851050+0000","last_change":"2024-09-12T19:14:19.850884+0000","last_active":"2024-09-12T19:14:19.851050+0000","last_peered":"2024-09-12T19:14:19.851050+0000","last_clean":"2024-09-12T19:14:19.851050+0000","last_became_active":"2024-09-12T18:26:41.871610+0000","last_became_peered":"2024-09-12T18:26:41.871610+0000","last_unstale":"2024-09-12T19:14:19.851050+0000","last_undegraded":"2024-09-12T19:14:19.851050+0000","last_fullsized":"2024-09-12T19:14:19.851050+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'826","last_scrub_stamp":"2024-09-12T19:14:19.850704+0000","last_deep_scrub":"265'826","last_deep_scrub_stamp":"2024-09-12T19:14:19.850704+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.850704+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:40.802958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3622,"num_write":1076,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'288","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.625440+0000","last_change":"2024-09-12T19:14:12.625440+0000","last_active":"2024-09-12T19:14:12.625440+0000","last_peered":"2024-09-12T19:14:12.625440+0000","last_clean":"2024-09-12T19:14:12.625440+0000","last_became_active":"2024-09-12T18:26:39.874710+0000","last_became_peered":"2024-09-12T18:26:39.874710+0000","last_unstale":"2024-09-12T19:14:12.625440+0000","last_undegraded":"2024-09-12T19:14:12.625440+0000","last_fullsized":"2024-09-12T19:14:12.625440+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'288","last_scrub_stamp":"2024-09-12T19:14:12.625246+0000","last_deep_scrub":"265'288","last_deep_scrub_stamp":"2024-09-12T19:14:12.625246+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.625246+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:05.154814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":12735,"num_write":942,"num_write_kb":23796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'359","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.643734+0000","last_change":"2024-09-12T19:14:14.643734+0000","last_active":"2024-09-12T19:14:14.643734+0000","last_peered":"2024-09-12T19:14:14.643734+0000","last_clean":"2024-09-12T19:14:14.643734+0000","last_became_active":"2024-09-12T18:26:39.846477+0000","last_became_peered":"2024-09-12T18:26:39.846477+0000","last_unstale":"2024-09-12T19:14:14.643734+0000","last_undegraded":"2024-09-12T19:14:14.643734+0000","last_fullsized":"2024-09-12T19:14:14.643734+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-12T19:14:14.643507+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-12T19:14:14.643507+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.643507+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:48.800351+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":32398,"num_write":1027,"num_write_kb":24916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'405","reported_seq":1878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.711466+0000","last_change":"2024-09-12T19:14:20.711466+0000","last_active":"2024-09-12T19:14:20.711466+0000","last_peered":"2024-09-12T19:14:20.711466+0000","last_clean":"2024-09-12T19:14:20.711466+0000","last_became_active":"2024-09-12T18:26:41.851295+0000","last_became_peered":"2024-09-12T18:26:41.851295+0000","last_unstale":"2024-09-12T19:14:20.711466+0000","last_undegraded":"2024-09-12T19:14:20.711466+0000","last_fullsized":"2024-09-12T19:14:20.711466+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-12T19:14:20.711236+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-12T19:14:20.711236+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.711236+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:44.617496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":455,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'322","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.037157+0000","last_change":"2024-09-12T19:14:07.037157+0000","last_active":"2024-09-12T19:14:07.037157+0000","last_peered":"2024-09-12T19:14:07.037157+0000","last_clean":"2024-09-12T19:14:07.037157+0000","last_became_active":"2024-09-12T18:26:39.857009+0000","last_became_peered":"2024-09-12T18:26:39.857009+0000","last_unstale":"2024-09-12T19:14:07.037157+0000","last_undegraded":"2024-09-12T19:14:07.037157+0000","last_fullsized":"2024-09-12T19:14:07.037157+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T19:14:07.036972+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T19:14:07.036972+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.036972+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:28.775839+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2355888,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":55513,"num_write":945,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'377","reported_seq":1774,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.366651+0000","last_change":"2024-09-12T19:14:21.366487+0000","last_active":"2024-09-12T19:14:21.366651+0000","last_peered":"2024-09-12T19:14:21.366651+0000","last_clean":"2024-09-12T19:14:21.366651+0000","last_became_active":"2024-09-12T18:26:41.872448+0000","last_became_peered":"2024-09-12T18:26:41.872448+0000","last_unstale":"2024-09-12T19:14:21.366651+0000","last_undegraded":"2024-09-12T19:14:21.366651+0000","last_fullsized":"2024-09-12T19:14:21.366651+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:14:21.366307+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:14:21.366307+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.366307+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:53.119707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1946,"num_read_kb":1855,"num_write":441,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6147,"num_read_kb":4433,"num_write":1993,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4707,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":966,"ondisk_log_size":966,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":14976,"num_read_kb":14648,"num_write":16787,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1738,"ondisk_log_size":1738,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":577,"ondisk_log_size":577,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1597681,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17400,"num_read_kb":36744,"num_write":14589,"num_write_kb":11628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":675720,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1996,"ondisk_log_size":1996,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212286,"num_read_kb":193833,"num_write":55194,"num_write_kb":18759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43776,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4064,"ondisk_log_size":4064,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":64167064,"num_objects":372,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":372,"num_whiteouts":0,"num_read":36315,"num_read_kb":1882823,"num_write":72228,"num_write_kb":2144860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":129474560,"data_stored":128334128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3882,"ondisk_log_size":3882,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":214446,"num_write":192,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":201134,"num_write":192,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510030,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266732,"kb_used_data":10652,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94105108,"statfs":{"total":96636764160,"available":96363630592,"internally_reserved":0,"allocated":10907648,"data_stored":9282789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510030,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131840,"kb_used_data":10480,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94240000,"statfs":{"total":96636764160,"available":96501760000,"internally_reserved":0,"allocated":10731520,"data_stored":9041400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510031,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92808,"kb_used_data":29688,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94279032,"statfs":{"total":96636764160,"available":96541728768,"internally_reserved":0,"allocated":30400512,"data_stored":28782462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510028,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266872,"kb_used_data":10792,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94104968,"statfs":{"total":96636764160,"available":96363487232,"internally_reserved":0,"allocated":11051008,"data_stored":9395858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510028,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95984,"kb_used_data":14880,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94275856,"statfs":{"total":96636764160,"available":96538476544,"internally_reserved":0,"allocated":15237120,"data_stored":13690985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510028,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284940,"kb_used_data":33084,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94086900,"statfs":{"total":96636764160,"available":96344985600,"internally_reserved":0,"allocated":33878016,"data_stored":32185380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":257882568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542735,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292816,"kb_used_data":18688,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94079024,"statfs":{"total":96636764160,"available":96336920576,"internally_reserved":0,"allocated":19136512,"data_stored":17444491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542733,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":167376,"kb_used_data":27968,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94204464,"statfs":{"total":96636764160,"available":96465371136,"internally_reserved":0,"allocated":28639232,"data_stored":27068681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29601792,"data_stored":29420904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24977408,"data_stored":24897183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11599872,"data_stored":11518686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7376896,"data_stored":7222226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26800128,"data_stored":26613106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7016448,"data_stored":6869386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7270400,"data_stored":7112125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14831616,"data_stored":14680512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:15:07.273 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:15:07.273 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T18:55:18.080142+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=55, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:15:07.274 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T18:43:31.858730+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=43, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:15:07.275 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T18:26:48.866488+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=18, tm_min=26, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=19, tm_min=14, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T19:15:07.277 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T19:15:27.279 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T19:15:27.648 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-12T19:15:27.661 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-09-12T19:15:27.663 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":1732,"stamp":"2024-09-12T19:15:26.499350+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":66372370,"num_objects":839,"num_object_clones":0,"num_object_copies":1678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":839,"num_whiteouts":0,"num_read":289963,"num_read_kb":2550992,"num_write":161318,"num_write_kb":2466794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":728023,"num_omap_keys":1788,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13599,"ondisk_log_size":13599,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1599368,"kb_used_data":156232,"kb_used_omap":12,"kb_used_meta":1442995,"kb_avail":753375352,"statfs":{"total":773094113280,"available":771456360448,"internally_reserved":0,"allocated":159981568,"data_stored":146892046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":1477627443},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009008"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:51.442728+0000","last_change":"2024-09-12T19:14:51.442575+0000","last_active":"2024-09-12T19:14:51.442728+0000","last_peered":"2024-09-12T19:14:51.442728+0000","last_clean":"2024-09-12T19:14:51.442728+0000","last_became_active":"2024-09-12T18:55:19.125009+0000","last_became_peered":"2024-09-12T18:55:19.125009+0000","last_unstale":"2024-09-12T19:14:51.442728+0000","last_undegraded":"2024-09-12T19:14:51.442728+0000","last_fullsized":"2024-09-12T19:14:51.442728+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:51.442356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:51.442356+0000","last_clean_scrub_stamp":"2024-09-12T19:14:51.442356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:43.740430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"262'7","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:47.466285+0000","last_change":"2024-09-12T19:14:47.466285+0000","last_active":"2024-09-12T19:14:47.466285+0000","last_peered":"2024-09-12T19:14:47.466285+0000","last_clean":"2024-09-12T19:14:47.466285+0000","last_became_active":"2024-09-12T18:43:32.908691+0000","last_became_peered":"2024-09-12T18:43:32.908691+0000","last_unstale":"2024-09-12T19:14:47.466285+0000","last_undegraded":"2024-09-12T19:14:47.466285+0000","last_fullsized":"2024-09-12T19:14:47.466285+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T19:14:47.466097+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T19:14:47.466097+0000","last_clean_scrub_stamp":"2024-09-12T19:14:47.466097+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:02:13.193101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:57.229218+0000","last_change":"2024-09-12T19:14:57.229218+0000","last_active":"2024-09-12T19:14:57.229218+0000","last_peered":"2024-09-12T19:14:57.229218+0000","last_clean":"2024-09-12T19:14:57.229218+0000","last_became_active":"2024-09-12T18:43:29.866493+0000","last_became_peered":"2024-09-12T18:43:29.866493+0000","last_unstale":"2024-09-12T19:14:57.229218+0000","last_undegraded":"2024-09-12T19:14:57.229218+0000","last_fullsized":"2024-09-12T19:14:57.229218+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:57.229038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:57.229038+0000","last_clean_scrub_stamp":"2024-09-12T19:14:57.229038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:52.079398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"265'18","reported_seq":108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:47.412142+0000","last_change":"2024-09-12T19:14:47.412005+0000","last_active":"2024-09-12T19:14:47.412142+0000","last_peered":"2024-09-12T19:14:47.412142+0000","last_clean":"2024-09-12T19:14:47.412142+0000","last_became_active":"2024-09-12T18:41:45.361841+0000","last_became_peered":"2024-09-12T18:41:45.361841+0000","last_unstale":"2024-09-12T19:14:47.412142+0000","last_undegraded":"2024-09-12T19:14:47.412142+0000","last_fullsized":"2024-09-12T19:14:47.412142+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'18","last_scrub_stamp":"2024-09-12T19:14:47.411835+0000","last_deep_scrub":"265'18","last_deep_scrub_stamp":"2024-09-12T19:14:47.411835+0000","last_clean_scrub_stamp":"2024-09-12T19:14:47.411835+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:18.921866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":66,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.893577+0000","last_change":"2024-09-12T19:14:33.893323+0000","last_active":"2024-09-12T19:14:33.893577+0000","last_peered":"2024-09-12T19:14:33.893577+0000","last_clean":"2024-09-12T19:14:33.893577+0000","last_became_active":"2024-09-12T18:55:19.150059+0000","last_became_peered":"2024-09-12T18:55:19.150059+0000","last_unstale":"2024-09-12T19:14:33.893577+0000","last_undegraded":"2024-09-12T19:14:33.893577+0000","last_fullsized":"2024-09-12T19:14:33.893577+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:33.893119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:33.893119+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.893119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:17.600330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"265'4","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:53.375403+0000","last_change":"2024-09-12T19:14:53.375403+0000","last_active":"2024-09-12T19:14:53.375403+0000","last_peered":"2024-09-12T19:14:53.375403+0000","last_clean":"2024-09-12T19:14:53.375403+0000","last_became_active":"2024-09-12T18:43:32.904914+0000","last_became_peered":"2024-09-12T18:43:32.904914+0000","last_unstale":"2024-09-12T19:14:53.375403+0000","last_undegraded":"2024-09-12T19:14:53.375403+0000","last_fullsized":"2024-09-12T19:14:53.375403+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:53.375212+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:53.375212+0000","last_clean_scrub_stamp":"2024-09-12T19:14:53.375212+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:17.046208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"265'3","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.240294+0000","last_change":"2024-09-12T19:14:36.240294+0000","last_active":"2024-09-12T19:14:36.240294+0000","last_peered":"2024-09-12T19:14:36.240294+0000","last_clean":"2024-09-12T19:14:36.240294+0000","last_became_active":"2024-09-12T18:43:29.891221+0000","last_became_peered":"2024-09-12T18:43:29.891221+0000","last_unstale":"2024-09-12T19:14:36.240294+0000","last_undegraded":"2024-09-12T19:14:36.240294+0000","last_fullsized":"2024-09-12T19:14:36.240294+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T19:14:36.240122+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T19:14:36.240122+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.240122+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:21:05.077317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"265'32","reported_seq":146,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.892397+0000","last_change":"2024-09-12T19:14:25.892397+0000","last_active":"2024-09-12T19:14:25.892397+0000","last_peered":"2024-09-12T19:14:25.892397+0000","last_clean":"2024-09-12T19:14:25.892397+0000","last_became_active":"2024-09-12T18:41:45.361664+0000","last_became_peered":"2024-09-12T18:41:45.361664+0000","last_unstale":"2024-09-12T19:14:25.892397+0000","last_undegraded":"2024-09-12T19:14:25.892397+0000","last_fullsized":"2024-09-12T19:14:25.892397+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T19:14:25.892204+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T19:14:25.892204+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.892204+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:20.883904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":119,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.603743+0000","last_change":"2024-09-12T19:14:42.603743+0000","last_active":"2024-09-12T19:14:42.603743+0000","last_peered":"2024-09-12T19:14:42.603743+0000","last_clean":"2024-09-12T19:14:42.603743+0000","last_became_active":"2024-09-12T18:55:19.119601+0000","last_became_peered":"2024-09-12T18:55:19.119601+0000","last_unstale":"2024-09-12T19:14:42.603743+0000","last_undegraded":"2024-09-12T19:14:42.603743+0000","last_fullsized":"2024-09-12T19:14:42.603743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:42.603555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:42.603555+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.603555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:44.001319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"265'8","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:00.361811+0000","last_change":"2024-09-12T19:15:00.361811+0000","last_active":"2024-09-12T19:15:00.361811+0000","last_peered":"2024-09-12T19:15:00.361811+0000","last_clean":"2024-09-12T19:15:00.361811+0000","last_became_active":"2024-09-12T18:43:32.916727+0000","last_became_peered":"2024-09-12T18:43:32.916727+0000","last_unstale":"2024-09-12T19:15:00.361811+0000","last_undegraded":"2024-09-12T19:15:00.361811+0000","last_fullsized":"2024-09-12T19:15:00.361811+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:15:00.361639+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:15:00.361639+0000","last_clean_scrub_stamp":"2024-09-12T19:15:00.361639+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:39:28.989648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12290,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"265'17","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.867868+0000","last_change":"2024-09-12T19:14:30.867868+0000","last_active":"2024-09-12T19:14:30.867868+0000","last_peered":"2024-09-12T19:14:30.867868+0000","last_clean":"2024-09-12T19:14:30.867868+0000","last_became_active":"2024-09-12T18:43:29.881401+0000","last_became_peered":"2024-09-12T18:43:29.881401+0000","last_unstale":"2024-09-12T19:14:30.867868+0000","last_undegraded":"2024-09-12T19:14:30.867868+0000","last_fullsized":"2024-09-12T19:14:30.867868+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-12T19:14:30.867685+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-12T19:14:30.867685+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.867685+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:04.890149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":40962,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"265'47","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:46.438523+0000","last_change":"2024-09-12T19:14:46.438523+0000","last_active":"2024-09-12T19:14:46.438523+0000","last_peered":"2024-09-12T19:14:46.438523+0000","last_clean":"2024-09-12T19:14:46.438523+0000","last_became_active":"2024-09-12T18:41:45.350377+0000","last_became_peered":"2024-09-12T18:41:45.350377+0000","last_unstale":"2024-09-12T19:14:46.438523+0000","last_undegraded":"2024-09-12T19:14:46.438523+0000","last_fullsized":"2024-09-12T19:14:46.438523+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'47","last_scrub_stamp":"2024-09-12T19:14:46.438312+0000","last_deep_scrub":"265'47","last_deep_scrub_stamp":"2024-09-12T19:14:46.438312+0000","last_clean_scrub_stamp":"2024-09-12T19:14:46.438312+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:09:25.071409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":164,"num_write":88,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:01.205454+0000","last_change":"2024-09-12T19:15:01.205454+0000","last_active":"2024-09-12T19:15:01.205454+0000","last_peered":"2024-09-12T19:15:01.205454+0000","last_clean":"2024-09-12T19:15:01.205454+0000","last_became_active":"2024-09-12T18:55:19.135875+0000","last_became_peered":"2024-09-12T18:55:19.135875+0000","last_unstale":"2024-09-12T19:15:01.205454+0000","last_undegraded":"2024-09-12T19:15:01.205454+0000","last_fullsized":"2024-09-12T19:15:01.205454+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:01.205270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:01.205270+0000","last_clean_scrub_stamp":"2024-09-12T19:15:01.205270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:47:00.445374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"265'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:51.238182+0000","last_change":"2024-09-12T19:14:51.238182+0000","last_active":"2024-09-12T19:14:51.238182+0000","last_peered":"2024-09-12T19:14:51.238182+0000","last_clean":"2024-09-12T19:14:51.238182+0000","last_became_active":"2024-09-12T18:43:32.935176+0000","last_became_peered":"2024-09-12T18:43:32.935176+0000","last_unstale":"2024-09-12T19:14:51.238182+0000","last_undegraded":"2024-09-12T19:14:51.238182+0000","last_fullsized":"2024-09-12T19:14:51.238182+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:51.237888+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:51.237888+0000","last_clean_scrub_stamp":"2024-09-12T19:14:51.237888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:32.541363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"265'7","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:44.417970+0000","last_change":"2024-09-12T19:14:44.417762+0000","last_active":"2024-09-12T19:14:44.417970+0000","last_peered":"2024-09-12T19:14:44.417970+0000","last_clean":"2024-09-12T19:14:44.417970+0000","last_became_active":"2024-09-12T18:43:29.873115+0000","last_became_peered":"2024-09-12T18:43:29.873115+0000","last_unstale":"2024-09-12T19:14:44.417970+0000","last_undegraded":"2024-09-12T19:14:44.417970+0000","last_fullsized":"2024-09-12T19:14:44.417970+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:14:44.417568+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:14:44.417568+0000","last_clean_scrub_stamp":"2024-09-12T19:14:44.417568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:58:50.532550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5120,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"265'47","reported_seq":177,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:50.241511+0000","last_change":"2024-09-12T19:14:50.241511+0000","last_active":"2024-09-12T19:14:50.241511+0000","last_peered":"2024-09-12T19:14:50.241511+0000","last_clean":"2024-09-12T19:14:50.241511+0000","last_became_active":"2024-09-12T18:41:45.350035+0000","last_became_peered":"2024-09-12T18:41:45.350035+0000","last_unstale":"2024-09-12T19:14:50.241511+0000","last_undegraded":"2024-09-12T19:14:50.241511+0000","last_fullsized":"2024-09-12T19:14:50.241511+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'47","last_scrub_stamp":"2024-09-12T19:14:50.241318+0000","last_deep_scrub":"265'47","last_deep_scrub_stamp":"2024-09-12T19:14:50.241318+0000","last_clean_scrub_stamp":"2024-09-12T19:14:50.241318+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:35:58.198239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":157,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:05.172725+0000","last_change":"2024-09-12T19:15:05.172725+0000","last_active":"2024-09-12T19:15:05.172725+0000","last_peered":"2024-09-12T19:15:05.172725+0000","last_clean":"2024-09-12T19:15:05.172725+0000","last_became_active":"2024-09-12T18:55:19.156936+0000","last_became_peered":"2024-09-12T18:55:19.156936+0000","last_unstale":"2024-09-12T19:15:05.172725+0000","last_undegraded":"2024-09-12T19:15:05.172725+0000","last_fullsized":"2024-09-12T19:15:05.172725+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:05.172500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:05.172500+0000","last_clean_scrub_stamp":"2024-09-12T19:15:05.172500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:41.223800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"262'2","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:48.438199+0000","last_change":"2024-09-12T19:14:48.438065+0000","last_active":"2024-09-12T19:14:48.438199+0000","last_peered":"2024-09-12T19:14:48.438199+0000","last_clean":"2024-09-12T19:14:48.438199+0000","last_became_active":"2024-09-12T18:43:32.930772+0000","last_became_peered":"2024-09-12T18:43:32.930772+0000","last_unstale":"2024-09-12T19:14:48.438199+0000","last_undegraded":"2024-09-12T19:14:48.438199+0000","last_fullsized":"2024-09-12T19:14:48.438199+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:14:48.437875+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:14:48.437875+0000","last_clean_scrub_stamp":"2024-09-12T19:14:48.437875+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:37.119431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"265'2","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:56.320969+0000","last_change":"2024-09-12T19:14:56.320780+0000","last_active":"2024-09-12T19:14:56.320969+0000","last_peered":"2024-09-12T19:14:56.320969+0000","last_clean":"2024-09-12T19:14:56.320969+0000","last_became_active":"2024-09-12T18:43:29.883399+0000","last_became_peered":"2024-09-12T18:43:29.883399+0000","last_unstale":"2024-09-12T19:14:56.320969+0000","last_undegraded":"2024-09-12T19:14:56.320969+0000","last_fullsized":"2024-09-12T19:14:56.320969+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:56.320610+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:56.320610+0000","last_clean_scrub_stamp":"2024-09-12T19:14:56.320610+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:52.233187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"265'25","reported_seq":125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:47.245470+0000","last_change":"2024-09-12T19:14:47.245470+0000","last_active":"2024-09-12T19:14:47.245470+0000","last_peered":"2024-09-12T19:14:47.245470+0000","last_clean":"2024-09-12T19:14:47.245470+0000","last_became_active":"2024-09-12T18:41:45.355180+0000","last_became_peered":"2024-09-12T18:41:45.355180+0000","last_unstale":"2024-09-12T19:14:47.245470+0000","last_undegraded":"2024-09-12T19:14:47.245470+0000","last_fullsized":"2024-09-12T19:14:47.245470+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-12T19:14:47.245284+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-12T19:14:47.245284+0000","last_clean_scrub_stamp":"2024-09-12T19:14:47.245284+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:20:40.355254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":92,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:46.167790+0000","last_change":"2024-09-12T19:14:46.167790+0000","last_active":"2024-09-12T19:14:46.167790+0000","last_peered":"2024-09-12T19:14:46.167790+0000","last_clean":"2024-09-12T19:14:46.167790+0000","last_became_active":"2024-09-12T18:55:19.138472+0000","last_became_peered":"2024-09-12T18:55:19.138472+0000","last_unstale":"2024-09-12T19:14:46.167790+0000","last_undegraded":"2024-09-12T19:14:46.167790+0000","last_fullsized":"2024-09-12T19:14:46.167790+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:46.167613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:46.167613+0000","last_clean_scrub_stamp":"2024-09-12T19:14:46.167613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:29.174849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.593244+0000","last_change":"2024-09-12T19:14:39.593109+0000","last_active":"2024-09-12T19:14:39.593244+0000","last_peered":"2024-09-12T19:14:39.593244+0000","last_clean":"2024-09-12T19:14:39.593244+0000","last_became_active":"2024-09-12T18:43:32.935898+0000","last_became_peered":"2024-09-12T18:43:32.935898+0000","last_unstale":"2024-09-12T19:14:39.593244+0000","last_undegraded":"2024-09-12T19:14:39.593244+0000","last_fullsized":"2024-09-12T19:14:39.593244+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:39.592923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:39.592923+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.592923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:09.296334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:46.396445+0000","last_change":"2024-09-12T19:14:46.396267+0000","last_active":"2024-09-12T19:14:46.396445+0000","last_peered":"2024-09-12T19:14:46.396445+0000","last_clean":"2024-09-12T19:14:46.396445+0000","last_became_active":"2024-09-12T18:43:29.882621+0000","last_became_peered":"2024-09-12T18:43:29.882621+0000","last_unstale":"2024-09-12T19:14:46.396445+0000","last_undegraded":"2024-09-12T19:14:46.396445+0000","last_fullsized":"2024-09-12T19:14:46.396445+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:46.396080+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:46.396080+0000","last_clean_scrub_stamp":"2024-09-12T19:14:46.396080+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:21:59.022865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"265'16","reported_seq":99,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.591269+0000","last_change":"2024-09-12T19:14:34.591269+0000","last_active":"2024-09-12T19:14:34.591269+0000","last_peered":"2024-09-12T19:14:34.591269+0000","last_clean":"2024-09-12T19:14:34.591269+0000","last_became_active":"2024-09-12T18:41:45.357957+0000","last_became_peered":"2024-09-12T18:41:45.357957+0000","last_unstale":"2024-09-12T19:14:34.591269+0000","last_undegraded":"2024-09-12T19:14:34.591269+0000","last_fullsized":"2024-09-12T19:14:34.591269+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'16","last_scrub_stamp":"2024-09-12T19:14:34.591083+0000","last_deep_scrub":"265'16","last_deep_scrub_stamp":"2024-09-12T19:14:34.591083+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.591083+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:09:57.301977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":53,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:03.109851+0000","last_change":"2024-09-12T19:15:03.109715+0000","last_active":"2024-09-12T19:15:03.109851+0000","last_peered":"2024-09-12T19:15:03.109851+0000","last_clean":"2024-09-12T19:15:03.109851+0000","last_became_active":"2024-09-12T18:55:19.147110+0000","last_became_peered":"2024-09-12T18:55:19.147110+0000","last_unstale":"2024-09-12T19:15:03.109851+0000","last_undegraded":"2024-09-12T19:15:03.109851+0000","last_fullsized":"2024-09-12T19:15:03.109851+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:15:03.109532+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:15:03.109532+0000","last_clean_scrub_stamp":"2024-09-12T19:15:03.109532+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:22.227822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.634793+0000","last_change":"2024-09-12T19:14:40.634793+0000","last_active":"2024-09-12T19:14:40.634793+0000","last_peered":"2024-09-12T19:14:40.634793+0000","last_clean":"2024-09-12T19:14:40.634793+0000","last_became_active":"2024-09-12T18:43:32.922514+0000","last_became_peered":"2024-09-12T18:43:32.922514+0000","last_unstale":"2024-09-12T19:14:40.634793+0000","last_undegraded":"2024-09-12T19:14:40.634793+0000","last_fullsized":"2024-09-12T19:14:40.634793+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:40.634623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:40.634623+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.634623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:57:12.146446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"265'6","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:47.376445+0000","last_change":"2024-09-12T19:14:47.376445+0000","last_active":"2024-09-12T19:14:47.376445+0000","last_peered":"2024-09-12T19:14:47.376445+0000","last_clean":"2024-09-12T19:14:47.376445+0000","last_became_active":"2024-09-12T18:43:29.904226+0000","last_became_peered":"2024-09-12T18:43:29.904226+0000","last_unstale":"2024-09-12T19:14:47.376445+0000","last_undegraded":"2024-09-12T19:14:47.376445+0000","last_fullsized":"2024-09-12T19:14:47.376445+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:47.376264+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:47.376264+0000","last_clean_scrub_stamp":"2024-09-12T19:14:47.376264+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:56.028120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":9216,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"265'21","reported_seq":111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:44.512829+0000","last_change":"2024-09-12T19:14:44.512829+0000","last_active":"2024-09-12T19:14:44.512829+0000","last_peered":"2024-09-12T19:14:44.512829+0000","last_clean":"2024-09-12T19:14:44.512829+0000","last_became_active":"2024-09-12T18:41:45.351791+0000","last_became_peered":"2024-09-12T18:41:45.351791+0000","last_unstale":"2024-09-12T19:14:44.512829+0000","last_undegraded":"2024-09-12T19:14:44.512829+0000","last_fullsized":"2024-09-12T19:14:44.512829+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'21","last_scrub_stamp":"2024-09-12T19:14:44.512633+0000","last_deep_scrub":"265'21","last_deep_scrub_stamp":"2024-09-12T19:14:44.512633+0000","last_clean_scrub_stamp":"2024-09-12T19:14:44.512633+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:05:07.728305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":72,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:02.063149+0000","last_change":"2024-09-12T19:15:02.062909+0000","last_active":"2024-09-12T19:15:02.063149+0000","last_peered":"2024-09-12T19:15:02.063149+0000","last_clean":"2024-09-12T19:15:02.063149+0000","last_became_active":"2024-09-12T18:55:19.148859+0000","last_became_peered":"2024-09-12T18:55:19.148859+0000","last_unstale":"2024-09-12T19:15:02.063149+0000","last_undegraded":"2024-09-12T19:15:02.063149+0000","last_fullsized":"2024-09-12T19:15:02.063149+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:02.062689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:02.062689+0000","last_clean_scrub_stamp":"2024-09-12T19:15:02.062689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:26.858709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:53.280948+0000","last_change":"2024-09-12T19:14:53.280948+0000","last_active":"2024-09-12T19:14:53.280948+0000","last_peered":"2024-09-12T19:14:53.280948+0000","last_clean":"2024-09-12T19:14:53.280948+0000","last_became_active":"2024-09-12T18:43:32.935669+0000","last_became_peered":"2024-09-12T18:43:32.935669+0000","last_unstale":"2024-09-12T19:14:53.280948+0000","last_undegraded":"2024-09-12T19:14:53.280948+0000","last_fullsized":"2024-09-12T19:14:53.280948+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:53.280744+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:53.280744+0000","last_clean_scrub_stamp":"2024-09-12T19:14:53.280744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:34.700136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'5","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:52.369578+0000","last_change":"2024-09-12T19:14:52.369578+0000","last_active":"2024-09-12T19:14:52.369578+0000","last_peered":"2024-09-12T19:14:52.369578+0000","last_clean":"2024-09-12T19:14:52.369578+0000","last_became_active":"2024-09-12T18:43:29.883324+0000","last_became_peered":"2024-09-12T18:43:29.883324+0000","last_unstale":"2024-09-12T19:14:52.369578+0000","last_undegraded":"2024-09-12T19:14:52.369578+0000","last_fullsized":"2024-09-12T19:14:52.369578+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:14:52.369406+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:14:52.369406+0000","last_clean_scrub_stamp":"2024-09-12T19:14:52.369406+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:45.335346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"265'60","reported_seq":227,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.204859+0000","last_change":"2024-09-12T19:14:33.204859+0000","last_active":"2024-09-12T19:14:33.204859+0000","last_peered":"2024-09-12T19:14:33.204859+0000","last_clean":"2024-09-12T19:14:33.204859+0000","last_became_active":"2024-09-12T18:41:45.339369+0000","last_became_peered":"2024-09-12T18:41:45.339369+0000","last_unstale":"2024-09-12T19:14:33.204859+0000","last_undegraded":"2024-09-12T19:14:33.204859+0000","last_fullsized":"2024-09-12T19:14:33.204859+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'60","last_scrub_stamp":"2024-09-12T19:14:33.204676+0000","last_deep_scrub":"265'60","last_deep_scrub_stamp":"2024-09-12T19:14:33.204676+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.204676+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:59.124298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":324,"num_read_kb":229,"num_write":103,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.254009+0000","last_change":"2024-09-12T19:14:42.254009+0000","last_active":"2024-09-12T19:14:42.254009+0000","last_peered":"2024-09-12T19:14:42.254009+0000","last_clean":"2024-09-12T19:14:42.254009+0000","last_became_active":"2024-09-12T18:55:19.122414+0000","last_became_peered":"2024-09-12T18:55:19.122414+0000","last_unstale":"2024-09-12T19:14:42.254009+0000","last_undegraded":"2024-09-12T19:14:42.254009+0000","last_fullsized":"2024-09-12T19:14:42.254009+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:42.253838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:42.253838+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.253838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:46:22.298367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:58.197030+0000","last_change":"2024-09-12T19:14:58.196861+0000","last_active":"2024-09-12T19:14:58.197030+0000","last_peered":"2024-09-12T19:14:58.197030+0000","last_clean":"2024-09-12T19:14:58.197030+0000","last_became_active":"2024-09-12T18:43:32.924570+0000","last_became_peered":"2024-09-12T18:43:32.924570+0000","last_unstale":"2024-09-12T19:14:58.197030+0000","last_undegraded":"2024-09-12T19:14:58.197030+0000","last_fullsized":"2024-09-12T19:14:58.197030+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:14:58.196680+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:14:58.196680+0000","last_clean_scrub_stamp":"2024-09-12T19:14:58.196680+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:50.364623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:45.427851+0000","last_change":"2024-09-12T19:14:45.427851+0000","last_active":"2024-09-12T19:14:45.427851+0000","last_peered":"2024-09-12T19:14:45.427851+0000","last_clean":"2024-09-12T19:14:45.427851+0000","last_became_active":"2024-09-12T18:43:29.868738+0000","last_became_peered":"2024-09-12T18:43:29.868738+0000","last_unstale":"2024-09-12T19:14:45.427851+0000","last_undegraded":"2024-09-12T19:14:45.427851+0000","last_fullsized":"2024-09-12T19:14:45.427851+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:45.427658+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:45.427658+0000","last_clean_scrub_stamp":"2024-09-12T19:14:45.427658+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:19.934295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"265'11","reported_seq":81,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:45.485125+0000","last_change":"2024-09-12T19:14:45.485125+0000","last_active":"2024-09-12T19:14:45.485125+0000","last_peered":"2024-09-12T19:14:45.485125+0000","last_clean":"2024-09-12T19:14:45.485125+0000","last_became_active":"2024-09-12T18:41:45.351553+0000","last_became_peered":"2024-09-12T18:41:45.351553+0000","last_unstale":"2024-09-12T19:14:45.485125+0000","last_undegraded":"2024-09-12T19:14:45.485125+0000","last_fullsized":"2024-09-12T19:14:45.485125+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T19:14:45.484873+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T19:14:45.484873+0000","last_clean_scrub_stamp":"2024-09-12T19:14:45.484873+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:13.929615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":29,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.872990+0000","last_change":"2024-09-12T19:14:32.872990+0000","last_active":"2024-09-12T19:14:32.872990+0000","last_peered":"2024-09-12T19:14:32.872990+0000","last_clean":"2024-09-12T19:14:32.872990+0000","last_became_active":"2024-09-12T18:55:19.138649+0000","last_became_peered":"2024-09-12T18:55:19.138649+0000","last_unstale":"2024-09-12T19:14:32.872990+0000","last_undegraded":"2024-09-12T19:14:32.872990+0000","last_fullsized":"2024-09-12T19:14:32.872990+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:32.872783+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:32.872783+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.872783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:04:29.362590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:03.170325+0000","last_change":"2024-09-12T19:15:03.170325+0000","last_active":"2024-09-12T19:15:03.170325+0000","last_peered":"2024-09-12T19:15:03.170325+0000","last_clean":"2024-09-12T19:15:03.170325+0000","last_became_active":"2024-09-12T18:43:32.927181+0000","last_became_peered":"2024-09-12T18:43:32.927181+0000","last_unstale":"2024-09-12T19:15:03.170325+0000","last_undegraded":"2024-09-12T19:15:03.170325+0000","last_fullsized":"2024-09-12T19:15:03.170325+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:15:03.170073+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:15:03.170073+0000","last_clean_scrub_stamp":"2024-09-12T19:15:03.170073+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:22:02.221581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"262'8","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:50.894380+0000","last_change":"2024-09-12T19:14:50.894186+0000","last_active":"2024-09-12T19:14:50.894380+0000","last_peered":"2024-09-12T19:14:50.894380+0000","last_clean":"2024-09-12T19:14:50.894380+0000","last_became_active":"2024-09-12T18:43:29.894650+0000","last_became_peered":"2024-09-12T18:43:29.894650+0000","last_unstale":"2024-09-12T19:14:50.894380+0000","last_undegraded":"2024-09-12T19:14:50.894380+0000","last_fullsized":"2024-09-12T19:14:50.894380+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T19:14:50.893953+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T19:14:50.893953+0000","last_clean_scrub_stamp":"2024-09-12T19:14:50.893953+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:13:08.487097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":8194,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"265'29","reported_seq":129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:46.197753+0000","last_change":"2024-09-12T19:14:46.197753+0000","last_active":"2024-09-12T19:14:46.197753+0000","last_peered":"2024-09-12T19:14:46.197753+0000","last_clean":"2024-09-12T19:14:46.197753+0000","last_became_active":"2024-09-12T18:41:45.360856+0000","last_became_peered":"2024-09-12T18:41:45.360856+0000","last_unstale":"2024-09-12T19:14:46.197753+0000","last_undegraded":"2024-09-12T19:14:46.197753+0000","last_fullsized":"2024-09-12T19:14:46.197753+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T19:14:46.197580+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T19:14:46.197580+0000","last_clean_scrub_stamp":"2024-09-12T19:14:46.197580+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:08:57.052501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":92,"num_write":58,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:01.047287+0000","last_change":"2024-09-12T19:15:01.047287+0000","last_active":"2024-09-12T19:15:01.047287+0000","last_peered":"2024-09-12T19:15:01.047287+0000","last_clean":"2024-09-12T19:15:01.047287+0000","last_became_active":"2024-09-12T18:55:19.123727+0000","last_became_peered":"2024-09-12T18:55:19.123727+0000","last_unstale":"2024-09-12T19:15:01.047287+0000","last_undegraded":"2024-09-12T19:15:01.047287+0000","last_fullsized":"2024-09-12T19:15:01.047287+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:01.047097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:01.047097+0000","last_clean_scrub_stamp":"2024-09-12T19:15:01.047097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:17:37.016224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:06.209681+0000","last_change":"2024-09-12T19:15:06.209681+0000","last_active":"2024-09-12T19:15:06.209681+0000","last_peered":"2024-09-12T19:15:06.209681+0000","last_clean":"2024-09-12T19:15:06.209681+0000","last_became_active":"2024-09-12T18:43:32.934654+0000","last_became_peered":"2024-09-12T18:43:32.934654+0000","last_unstale":"2024-09-12T19:15:06.209681+0000","last_undegraded":"2024-09-12T19:15:06.209681+0000","last_fullsized":"2024-09-12T19:15:06.209681+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:06.209498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:06.209498+0000","last_clean_scrub_stamp":"2024-09-12T19:15:06.209498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:06.360625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"265'4","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.906547+0000","last_change":"2024-09-12T19:14:27.906345+0000","last_active":"2024-09-12T19:14:27.906547+0000","last_peered":"2024-09-12T19:14:27.906547+0000","last_clean":"2024-09-12T19:14:27.906547+0000","last_became_active":"2024-09-12T18:43:29.863876+0000","last_became_peered":"2024-09-12T18:43:29.863876+0000","last_unstale":"2024-09-12T19:14:27.906547+0000","last_undegraded":"2024-09-12T19:14:27.906547+0000","last_fullsized":"2024-09-12T19:14:27.906547+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:27.906147+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:27.906147+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.906147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:02.539821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"265'15","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.896889+0000","last_change":"2024-09-12T19:14:24.896889+0000","last_active":"2024-09-12T19:14:24.896889+0000","last_peered":"2024-09-12T19:14:24.896889+0000","last_clean":"2024-09-12T19:14:24.896889+0000","last_became_active":"2024-09-12T18:41:45.346831+0000","last_became_peered":"2024-09-12T18:41:45.346831+0000","last_unstale":"2024-09-12T19:14:24.896889+0000","last_undegraded":"2024-09-12T19:14:24.896889+0000","last_fullsized":"2024-09-12T19:14:24.896889+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'15","last_scrub_stamp":"2024-09-12T19:14:24.896715+0000","last_deep_scrub":"265'15","last_deep_scrub_stamp":"2024-09-12T19:14:24.896715+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.896715+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:43.841424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":48,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:50.442335+0000","last_change":"2024-09-12T19:14:50.442335+0000","last_active":"2024-09-12T19:14:50.442335+0000","last_peered":"2024-09-12T19:14:50.442335+0000","last_clean":"2024-09-12T19:14:50.442335+0000","last_became_active":"2024-09-12T18:55:19.125607+0000","last_became_peered":"2024-09-12T18:55:19.125607+0000","last_unstale":"2024-09-12T19:14:50.442335+0000","last_undegraded":"2024-09-12T19:14:50.442335+0000","last_fullsized":"2024-09-12T19:14:50.442335+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:50.442162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:50.442162+0000","last_clean_scrub_stamp":"2024-09-12T19:14:50.442162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:32:45.000699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"265'4","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:51.397040+0000","last_change":"2024-09-12T19:14:51.396901+0000","last_active":"2024-09-12T19:14:51.397040+0000","last_peered":"2024-09-12T19:14:51.397040+0000","last_clean":"2024-09-12T19:14:51.397040+0000","last_became_active":"2024-09-12T18:43:32.908905+0000","last_became_peered":"2024-09-12T18:43:32.908905+0000","last_unstale":"2024-09-12T19:14:51.397040+0000","last_undegraded":"2024-09-12T19:14:51.397040+0000","last_fullsized":"2024-09-12T19:14:51.397040+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:51.396713+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:51.396713+0000","last_clean_scrub_stamp":"2024-09-12T19:14:51.396713+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:43.250876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"265'7","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:51.411138+0000","last_change":"2024-09-12T19:14:51.410961+0000","last_active":"2024-09-12T19:14:51.411138+0000","last_peered":"2024-09-12T19:14:51.411138+0000","last_clean":"2024-09-12T19:14:51.411138+0000","last_became_active":"2024-09-12T18:43:29.880462+0000","last_became_peered":"2024-09-12T18:43:29.880462+0000","last_unstale":"2024-09-12T19:14:51.411138+0000","last_undegraded":"2024-09-12T19:14:51.411138+0000","last_fullsized":"2024-09-12T19:14:51.411138+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:14:51.410782+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:14:51.410782+0000","last_clean_scrub_stamp":"2024-09-12T19:14:51.410782+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:15.243999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"262'6","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.981218+0000","last_change":"2024-09-12T19:14:43.981218+0000","last_active":"2024-09-12T19:14:43.981218+0000","last_peered":"2024-09-12T19:14:43.981218+0000","last_clean":"2024-09-12T19:14:43.981218+0000","last_became_active":"2024-09-12T18:41:45.359794+0000","last_became_peered":"2024-09-12T18:41:45.359794+0000","last_unstale":"2024-09-12T19:14:43.981218+0000","last_undegraded":"2024-09-12T19:14:43.981218+0000","last_fullsized":"2024-09-12T19:14:43.981218+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'6","last_scrub_stamp":"2024-09-12T19:14:43.981001+0000","last_deep_scrub":"262'6","last_deep_scrub_stamp":"2024-09-12T19:14:43.981001+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.981001+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:04.583940+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:00.173191+0000","last_change":"2024-09-12T19:15:00.173191+0000","last_active":"2024-09-12T19:15:00.173191+0000","last_peered":"2024-09-12T19:15:00.173191+0000","last_clean":"2024-09-12T19:15:00.173191+0000","last_became_active":"2024-09-12T18:55:19.152807+0000","last_became_peered":"2024-09-12T18:55:19.152807+0000","last_unstale":"2024-09-12T19:15:00.173191+0000","last_undegraded":"2024-09-12T19:15:00.173191+0000","last_fullsized":"2024-09-12T19:15:00.173191+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:00.173017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:00.173017+0000","last_clean_scrub_stamp":"2024-09-12T19:15:00.173017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:55:43.442731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.295407+0000","last_change":"2024-09-12T19:14:41.295407+0000","last_active":"2024-09-12T19:14:41.295407+0000","last_peered":"2024-09-12T19:14:41.295407+0000","last_clean":"2024-09-12T19:14:41.295407+0000","last_became_active":"2024-09-12T18:43:32.899988+0000","last_became_peered":"2024-09-12T18:43:32.899988+0000","last_unstale":"2024-09-12T19:14:41.295407+0000","last_undegraded":"2024-09-12T19:14:41.295407+0000","last_fullsized":"2024-09-12T19:14:41.295407+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:41.295235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:41.295235+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.295235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:08.234217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"265'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.454508+0000","last_change":"2024-09-12T19:14:43.454508+0000","last_active":"2024-09-12T19:14:43.454508+0000","last_peered":"2024-09-12T19:14:43.454508+0000","last_clean":"2024-09-12T19:14:43.454508+0000","last_became_active":"2024-09-12T18:43:29.880294+0000","last_became_peered":"2024-09-12T18:43:29.880294+0000","last_unstale":"2024-09-12T19:14:43.454508+0000","last_undegraded":"2024-09-12T19:14:43.454508+0000","last_fullsized":"2024-09-12T19:14:43.454508+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:43.454286+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:43.454286+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.454286+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:03:48.347559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"265'33","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:44.977518+0000","last_change":"2024-09-12T19:14:44.977518+0000","last_active":"2024-09-12T19:14:44.977518+0000","last_peered":"2024-09-12T19:14:44.977518+0000","last_clean":"2024-09-12T19:14:44.977518+0000","last_became_active":"2024-09-12T18:41:45.359405+0000","last_became_peered":"2024-09-12T18:41:45.359405+0000","last_unstale":"2024-09-12T19:14:44.977518+0000","last_undegraded":"2024-09-12T19:14:44.977518+0000","last_fullsized":"2024-09-12T19:14:44.977518+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-12T19:14:44.977303+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-12T19:14:44.977303+0000","last_clean_scrub_stamp":"2024-09-12T19:14:44.977303+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:50.210796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":128,"num_write":57,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:02.357581+0000","last_change":"2024-09-12T19:15:02.357581+0000","last_active":"2024-09-12T19:15:02.357581+0000","last_peered":"2024-09-12T19:15:02.357581+0000","last_clean":"2024-09-12T19:15:02.357581+0000","last_became_active":"2024-09-12T18:55:19.136822+0000","last_became_peered":"2024-09-12T18:55:19.136822+0000","last_unstale":"2024-09-12T19:15:02.357581+0000","last_undegraded":"2024-09-12T19:15:02.357581+0000","last_fullsized":"2024-09-12T19:15:02.357581+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:02.357399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:02.357399+0000","last_clean_scrub_stamp":"2024-09-12T19:15:02.357399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:00.308319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:44.201542+0000","last_change":"2024-09-12T19:14:44.201542+0000","last_active":"2024-09-12T19:14:44.201542+0000","last_peered":"2024-09-12T19:14:44.201542+0000","last_clean":"2024-09-12T19:14:44.201542+0000","last_became_active":"2024-09-12T18:43:32.906911+0000","last_became_peered":"2024-09-12T18:43:32.906911+0000","last_unstale":"2024-09-12T19:14:44.201542+0000","last_undegraded":"2024-09-12T19:14:44.201542+0000","last_fullsized":"2024-09-12T19:14:44.201542+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T19:14:44.201360+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T19:14:44.201360+0000","last_clean_scrub_stamp":"2024-09-12T19:14:44.201360+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:39:03.633247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"265'6","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:55.226442+0000","last_change":"2024-09-12T19:14:55.226442+0000","last_active":"2024-09-12T19:14:55.226442+0000","last_peered":"2024-09-12T19:14:55.226442+0000","last_clean":"2024-09-12T19:14:55.226442+0000","last_became_active":"2024-09-12T18:43:29.873561+0000","last_became_peered":"2024-09-12T18:43:29.873561+0000","last_unstale":"2024-09-12T19:14:55.226442+0000","last_undegraded":"2024-09-12T19:14:55.226442+0000","last_fullsized":"2024-09-12T19:14:55.226442+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:55.226261+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:55.226261+0000","last_clean_scrub_stamp":"2024-09-12T19:14:55.226261+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:48.936403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"265'40","reported_seq":165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.515779+0000","last_change":"2024-09-12T19:14:42.515779+0000","last_active":"2024-09-12T19:14:42.515779+0000","last_peered":"2024-09-12T19:14:42.515779+0000","last_clean":"2024-09-12T19:14:42.515779+0000","last_became_active":"2024-09-12T18:41:45.352482+0000","last_became_peered":"2024-09-12T18:41:45.352482+0000","last_unstale":"2024-09-12T19:14:42.515779+0000","last_undegraded":"2024-09-12T19:14:42.515779+0000","last_fullsized":"2024-09-12T19:14:42.515779+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'40","last_scrub_stamp":"2024-09-12T19:14:42.515590+0000","last_deep_scrub":"265'40","last_deep_scrub_stamp":"2024-09-12T19:14:42.515590+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.515590+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:20.756086+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":202,"num_read_kb":146,"num_write":76,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:59.340917+0000","last_change":"2024-09-12T19:14:59.340917+0000","last_active":"2024-09-12T19:14:59.340917+0000","last_peered":"2024-09-12T19:14:59.340917+0000","last_clean":"2024-09-12T19:14:59.340917+0000","last_became_active":"2024-09-12T18:55:19.132991+0000","last_became_peered":"2024-09-12T18:55:19.132991+0000","last_unstale":"2024-09-12T19:14:59.340917+0000","last_undegraded":"2024-09-12T19:14:59.340917+0000","last_fullsized":"2024-09-12T19:14:59.340917+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:59.340713+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:59.340713+0000","last_clean_scrub_stamp":"2024-09-12T19:14:59.340713+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:56:26.953686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"265'8","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:49.252082+0000","last_change":"2024-09-12T19:14:49.252082+0000","last_active":"2024-09-12T19:14:49.252082+0000","last_peered":"2024-09-12T19:14:49.252082+0000","last_clean":"2024-09-12T19:14:49.252082+0000","last_became_active":"2024-09-12T18:43:32.927109+0000","last_became_peered":"2024-09-12T18:43:32.927109+0000","last_unstale":"2024-09-12T19:14:49.252082+0000","last_undegraded":"2024-09-12T19:14:49.252082+0000","last_fullsized":"2024-09-12T19:14:49.252082+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T19:14:49.251906+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T19:14:49.251906+0000","last_clean_scrub_stamp":"2024-09-12T19:14:49.251906+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:32:53.966223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":28674,"num_write":8,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"265'2","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.565997+0000","last_change":"2024-09-12T19:14:36.565997+0000","last_active":"2024-09-12T19:14:36.565997+0000","last_peered":"2024-09-12T19:14:36.565997+0000","last_clean":"2024-09-12T19:14:36.565997+0000","last_became_active":"2024-09-12T18:43:29.880517+0000","last_became_peered":"2024-09-12T18:43:29.880517+0000","last_unstale":"2024-09-12T19:14:36.565997+0000","last_undegraded":"2024-09-12T19:14:36.565997+0000","last_fullsized":"2024-09-12T19:14:36.565997+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:36.565822+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:36.565822+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.565822+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:35:02.635626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.421270+0000","last_change":"2024-09-12T19:14:41.421270+0000","last_active":"2024-09-12T19:14:41.421270+0000","last_peered":"2024-09-12T19:14:41.421270+0000","last_clean":"2024-09-12T19:14:41.421270+0000","last_became_active":"2024-09-12T18:41:45.350632+0000","last_became_peered":"2024-09-12T18:41:45.350632+0000","last_unstale":"2024-09-12T19:14:41.421270+0000","last_undegraded":"2024-09-12T19:14:41.421270+0000","last_fullsized":"2024-09-12T19:14:41.421270+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-12T19:14:41.421072+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-12T19:14:41.421072+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.421072+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:50.795483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":75,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:52.259441+0000","last_change":"2024-09-12T19:14:52.259441+0000","last_active":"2024-09-12T19:14:52.259441+0000","last_peered":"2024-09-12T19:14:52.259441+0000","last_clean":"2024-09-12T19:14:52.259441+0000","last_became_active":"2024-09-12T18:55:19.150880+0000","last_became_peered":"2024-09-12T18:55:19.150880+0000","last_unstale":"2024-09-12T19:14:52.259441+0000","last_undegraded":"2024-09-12T19:14:52.259441+0000","last_fullsized":"2024-09-12T19:14:52.259441+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:52.259264+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:52.259264+0000","last_clean_scrub_stamp":"2024-09-12T19:14:52.259264+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:19:19.191374+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'16","reported_seq":74,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.602068+0000","last_change":"2024-09-12T19:14:37.602068+0000","last_active":"2024-09-12T19:14:37.602068+0000","last_peered":"2024-09-12T19:14:37.602068+0000","last_clean":"2024-09-12T19:14:37.602068+0000","last_became_active":"2024-09-12T18:43:32.927270+0000","last_became_peered":"2024-09-12T18:43:32.927270+0000","last_unstale":"2024-09-12T19:14:37.602068+0000","last_undegraded":"2024-09-12T19:14:37.602068+0000","last_fullsized":"2024-09-12T19:14:37.602068+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'16","last_scrub_stamp":"2024-09-12T19:14:37.601821+0000","last_deep_scrub":"265'16","last_deep_scrub_stamp":"2024-09-12T19:14:37.601821+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.601821+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:43.617916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":38914,"num_write":26,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"265'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:44.385330+0000","last_change":"2024-09-12T19:14:44.385330+0000","last_active":"2024-09-12T19:14:44.385330+0000","last_peered":"2024-09-12T19:14:44.385330+0000","last_clean":"2024-09-12T19:14:44.385330+0000","last_became_active":"2024-09-12T18:43:29.901627+0000","last_became_peered":"2024-09-12T18:43:29.901627+0000","last_unstale":"2024-09-12T19:14:44.385330+0000","last_undegraded":"2024-09-12T19:14:44.385330+0000","last_fullsized":"2024-09-12T19:14:44.385330+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:44.385148+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:44.385148+0000","last_clean_scrub_stamp":"2024-09-12T19:14:44.385148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:44:45.484496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"265'30","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:56.205937+0000","last_change":"2024-09-12T19:14:56.205937+0000","last_active":"2024-09-12T19:14:56.205937+0000","last_peered":"2024-09-12T19:14:56.205937+0000","last_clean":"2024-09-12T19:14:56.205937+0000","last_became_active":"2024-09-12T18:41:45.350670+0000","last_became_peered":"2024-09-12T18:41:45.350670+0000","last_unstale":"2024-09-12T19:14:56.205937+0000","last_undegraded":"2024-09-12T19:14:56.205937+0000","last_fullsized":"2024-09-12T19:14:56.205937+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:14:56.205727+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:14:56.205727+0000","last_clean_scrub_stamp":"2024-09-12T19:14:56.205727+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:16:01.557266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":105,"num_write":57,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.831222+0000","last_change":"2024-09-12T19:14:31.831089+0000","last_active":"2024-09-12T19:14:31.831222+0000","last_peered":"2024-09-12T19:14:31.831222+0000","last_clean":"2024-09-12T19:14:31.831222+0000","last_became_active":"2024-09-12T18:55:19.137332+0000","last_became_peered":"2024-09-12T18:55:19.137332+0000","last_unstale":"2024-09-12T19:14:31.831222+0000","last_undegraded":"2024-09-12T19:14:31.831222+0000","last_fullsized":"2024-09-12T19:14:31.831222+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:31.830906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:31.830906+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.830906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:18:09.304238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"265'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:54.414527+0000","last_change":"2024-09-12T19:14:54.414527+0000","last_active":"2024-09-12T19:14:54.414527+0000","last_peered":"2024-09-12T19:14:54.414527+0000","last_clean":"2024-09-12T19:14:54.414527+0000","last_became_active":"2024-09-12T18:44:13.007582+0000","last_became_peered":"2024-09-12T18:44:13.007582+0000","last_unstale":"2024-09-12T19:14:54.414527+0000","last_undegraded":"2024-09-12T19:14:54.414527+0000","last_fullsized":"2024-09-12T19:14:54.414527+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:54.414355+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:54.414355+0000","last_clean_scrub_stamp":"2024-09-12T19:14:54.414355+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:41:11.656022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.c","version":"262'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:49.943237+0000","last_change":"2024-09-12T19:14:49.942961+0000","last_active":"2024-09-12T19:14:49.943237+0000","last_peered":"2024-09-12T19:14:49.943237+0000","last_clean":"2024-09-12T19:14:49.943237+0000","last_became_active":"2024-09-12T18:43:29.888041+0000","last_became_peered":"2024-09-12T18:43:29.888041+0000","last_unstale":"2024-09-12T19:14:49.943237+0000","last_undegraded":"2024-09-12T19:14:49.943237+0000","last_fullsized":"2024-09-12T19:14:49.943237+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:14:49.942706+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:14:49.942706+0000","last_clean_scrub_stamp":"2024-09-12T19:14:49.942706+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:32.766473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"265'30","reported_seq":135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:59.169595+0000","last_change":"2024-09-12T19:14:59.169595+0000","last_active":"2024-09-12T19:14:59.169595+0000","last_peered":"2024-09-12T19:14:59.169595+0000","last_clean":"2024-09-12T19:14:59.169595+0000","last_became_active":"2024-09-12T18:41:45.354063+0000","last_became_peered":"2024-09-12T18:41:45.354063+0000","last_unstale":"2024-09-12T19:14:59.169595+0000","last_undegraded":"2024-09-12T19:14:59.169595+0000","last_fullsized":"2024-09-12T19:14:59.169595+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'30","last_scrub_stamp":"2024-09-12T19:14:59.169422+0000","last_deep_scrub":"265'30","last_deep_scrub_stamp":"2024-09-12T19:14:59.169422+0000","last_clean_scrub_stamp":"2024-09-12T19:14:59.169422+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:23:32.508734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":55,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:57.969238+0000","last_change":"2024-09-12T19:14:57.969238+0000","last_active":"2024-09-12T19:14:57.969238+0000","last_peered":"2024-09-12T19:14:57.969238+0000","last_clean":"2024-09-12T19:14:57.969238+0000","last_became_active":"2024-09-12T18:55:19.140331+0000","last_became_peered":"2024-09-12T18:55:19.140331+0000","last_unstale":"2024-09-12T19:14:57.969238+0000","last_undegraded":"2024-09-12T19:14:57.969238+0000","last_fullsized":"2024-09-12T19:14:57.969238+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:57.968950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:57.968950+0000","last_clean_scrub_stamp":"2024-09-12T19:14:57.968950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:49.663127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"265'4","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:02.195460+0000","last_change":"2024-09-12T19:15:02.195303+0000","last_active":"2024-09-12T19:15:02.195460+0000","last_peered":"2024-09-12T19:15:02.195460+0000","last_clean":"2024-09-12T19:15:02.195460+0000","last_became_active":"2024-09-12T18:43:32.934598+0000","last_became_peered":"2024-09-12T18:43:32.934598+0000","last_unstale":"2024-09-12T19:15:02.195460+0000","last_undegraded":"2024-09-12T19:15:02.195460+0000","last_fullsized":"2024-09-12T19:15:02.195460+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:15:02.195128+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:15:02.195128+0000","last_clean_scrub_stamp":"2024-09-12T19:15:02.195128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:10.834790+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"265'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.869444+0000","last_change":"2024-09-12T19:14:28.869286+0000","last_active":"2024-09-12T19:14:28.869444+0000","last_peered":"2024-09-12T19:14:28.869444+0000","last_clean":"2024-09-12T19:14:28.869444+0000","last_became_active":"2024-09-12T18:43:29.887500+0000","last_became_peered":"2024-09-12T18:43:29.887500+0000","last_unstale":"2024-09-12T19:14:28.869444+0000","last_undegraded":"2024-09-12T19:14:28.869444+0000","last_fullsized":"2024-09-12T19:14:28.869444+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:28.869104+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:28.869104+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.869104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:15:56.378736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"265'32","reported_seq":147,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.418810+0000","last_change":"2024-09-12T19:14:42.418810+0000","last_active":"2024-09-12T19:14:42.418810+0000","last_peered":"2024-09-12T19:14:42.418810+0000","last_clean":"2024-09-12T19:14:42.418810+0000","last_became_active":"2024-09-12T18:41:45.358914+0000","last_became_peered":"2024-09-12T18:41:45.358914+0000","last_unstale":"2024-09-12T19:14:42.418810+0000","last_undegraded":"2024-09-12T19:14:42.418810+0000","last_fullsized":"2024-09-12T19:14:42.418810+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T19:14:42.418633+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T19:14:42.418633+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.418633+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:42:43.329544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":122,"num_write":53,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.621787+0000","last_change":"2024-09-12T19:14:41.621631+0000","last_active":"2024-09-12T19:14:41.621787+0000","last_peered":"2024-09-12T19:14:41.621787+0000","last_clean":"2024-09-12T19:14:41.621787+0000","last_became_active":"2024-09-12T18:55:19.128236+0000","last_became_peered":"2024-09-12T18:55:19.128236+0000","last_unstale":"2024-09-12T19:14:41.621787+0000","last_undegraded":"2024-09-12T19:14:41.621787+0000","last_fullsized":"2024-09-12T19:14:41.621787+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:41.621448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:41.621448+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.621448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:27:46.166631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"265'4","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:45.161287+0000","last_change":"2024-09-12T19:14:45.160990+0000","last_active":"2024-09-12T19:14:45.161287+0000","last_peered":"2024-09-12T19:14:45.161287+0000","last_clean":"2024-09-12T19:14:45.161287+0000","last_became_active":"2024-09-12T18:43:32.899943+0000","last_became_peered":"2024-09-12T18:43:32.899943+0000","last_unstale":"2024-09-12T19:14:45.161287+0000","last_undegraded":"2024-09-12T19:14:45.161287+0000","last_fullsized":"2024-09-12T19:14:45.161287+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:45.160754+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:45.160754+0000","last_clean_scrub_stamp":"2024-09-12T19:14:45.160754+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:04.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3444,"num_write":4,"num_write_kb":1722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"265'4","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:50.389947+0000","last_change":"2024-09-12T19:14:50.389742+0000","last_active":"2024-09-12T19:14:50.389947+0000","last_peered":"2024-09-12T19:14:50.389947+0000","last_clean":"2024-09-12T19:14:50.389947+0000","last_became_active":"2024-09-12T18:43:29.877755+0000","last_became_peered":"2024-09-12T18:43:29.877755+0000","last_unstale":"2024-09-12T19:14:50.389947+0000","last_undegraded":"2024-09-12T19:14:50.389947+0000","last_fullsized":"2024-09-12T19:14:50.389947+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:50.389565+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:50.389565+0000","last_clean_scrub_stamp":"2024-09-12T19:14:50.389565+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:21.451717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4136,"num_write":4,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"262'17","reported_seq":102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.551734+0000","last_change":"2024-09-12T19:14:33.551734+0000","last_active":"2024-09-12T19:14:33.551734+0000","last_peered":"2024-09-12T19:14:33.551734+0000","last_clean":"2024-09-12T19:14:33.551734+0000","last_became_active":"2024-09-12T18:41:45.357562+0000","last_became_peered":"2024-09-12T18:41:45.357562+0000","last_unstale":"2024-09-12T19:14:33.551734+0000","last_undegraded":"2024-09-12T19:14:33.551734+0000","last_fullsized":"2024-09-12T19:14:33.551734+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'17","last_scrub_stamp":"2024-09-12T19:14:33.551517+0000","last_deep_scrub":"262'17","last_deep_scrub_stamp":"2024-09-12T19:14:33.551517+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.551517+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:16.826743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":61,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:56.952221+0000","last_change":"2024-09-12T19:14:56.952221+0000","last_active":"2024-09-12T19:14:56.952221+0000","last_peered":"2024-09-12T19:14:56.952221+0000","last_clean":"2024-09-12T19:14:56.952221+0000","last_became_active":"2024-09-12T18:55:19.136882+0000","last_became_peered":"2024-09-12T18:55:19.136882+0000","last_unstale":"2024-09-12T19:14:56.952221+0000","last_undegraded":"2024-09-12T19:14:56.952221+0000","last_fullsized":"2024-09-12T19:14:56.952221+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:56.952033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:56.952033+0000","last_clean_scrub_stamp":"2024-09-12T19:14:56.952033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:28:46.289676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"262'4","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:48.258613+0000","last_change":"2024-09-12T19:14:48.258453+0000","last_active":"2024-09-12T19:14:48.258613+0000","last_peered":"2024-09-12T19:14:48.258613+0000","last_clean":"2024-09-12T19:14:48.258613+0000","last_became_active":"2024-09-12T18:43:32.927372+0000","last_became_peered":"2024-09-12T18:43:32.927372+0000","last_unstale":"2024-09-12T19:14:48.258613+0000","last_undegraded":"2024-09-12T19:14:48.258613+0000","last_fullsized":"2024-09-12T19:14:48.258613+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'4","last_scrub_stamp":"2024-09-12T19:14:48.258241+0000","last_deep_scrub":"262'4","last_deep_scrub_stamp":"2024-09-12T19:14:48.258241+0000","last_clean_scrub_stamp":"2024-09-12T19:14:48.258241+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:18.284608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"262'5","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.279601+0000","last_change":"2024-09-12T19:14:39.279454+0000","last_active":"2024-09-12T19:14:39.279601+0000","last_peered":"2024-09-12T19:14:39.279601+0000","last_clean":"2024-09-12T19:14:39.279601+0000","last_became_active":"2024-09-12T18:43:29.888265+0000","last_became_peered":"2024-09-12T18:43:29.888265+0000","last_unstale":"2024-09-12T19:14:39.279601+0000","last_undegraded":"2024-09-12T19:14:39.279601+0000","last_fullsized":"2024-09-12T19:14:39.279601+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T19:14:39.279259+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T19:14:39.279259+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.279259+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:42:16.529065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"265'32","reported_seq":145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.875670+0000","last_change":"2024-09-12T19:14:23.875670+0000","last_active":"2024-09-12T19:14:23.875670+0000","last_peered":"2024-09-12T19:14:23.875670+0000","last_clean":"2024-09-12T19:14:23.875670+0000","last_became_active":"2024-09-12T18:41:45.335675+0000","last_became_peered":"2024-09-12T18:41:45.335675+0000","last_unstale":"2024-09-12T19:14:23.875670+0000","last_undegraded":"2024-09-12T19:14:23.875670+0000","last_fullsized":"2024-09-12T19:14:23.875670+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'32","last_scrub_stamp":"2024-09-12T19:14:23.875487+0000","last_deep_scrub":"265'32","last_deep_scrub_stamp":"2024-09-12T19:14:23.875487+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.875487+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:42.681180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":63,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:54.235651+0000","last_change":"2024-09-12T19:14:54.235651+0000","last_active":"2024-09-12T19:14:54.235651+0000","last_peered":"2024-09-12T19:14:54.235651+0000","last_clean":"2024-09-12T19:14:54.235651+0000","last_became_active":"2024-09-12T18:55:19.149794+0000","last_became_peered":"2024-09-12T18:55:19.149794+0000","last_unstale":"2024-09-12T19:14:54.235651+0000","last_undegraded":"2024-09-12T19:14:54.235651+0000","last_fullsized":"2024-09-12T19:14:54.235651+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:54.235440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:54.235440+0000","last_clean_scrub_stamp":"2024-09-12T19:14:54.235440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:54:42.719639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"262'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:49.405597+0000","last_change":"2024-09-12T19:14:49.405597+0000","last_active":"2024-09-12T19:14:49.405597+0000","last_peered":"2024-09-12T19:14:49.405597+0000","last_clean":"2024-09-12T19:14:49.405597+0000","last_became_active":"2024-09-12T18:43:32.908692+0000","last_became_peered":"2024-09-12T18:43:32.908692+0000","last_unstale":"2024-09-12T19:14:49.405597+0000","last_undegraded":"2024-09-12T19:14:49.405597+0000","last_fullsized":"2024-09-12T19:14:49.405597+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:14:49.405406+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:14:49.405406+0000","last_clean_scrub_stamp":"2024-09-12T19:14:49.405406+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:44.477787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'6","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:49.429955+0000","last_change":"2024-09-12T19:14:49.429955+0000","last_active":"2024-09-12T19:14:49.429955+0000","last_peered":"2024-09-12T19:14:49.429955+0000","last_clean":"2024-09-12T19:14:49.429955+0000","last_became_active":"2024-09-12T18:43:29.882915+0000","last_became_peered":"2024-09-12T18:43:29.882915+0000","last_unstale":"2024-09-12T19:14:49.429955+0000","last_undegraded":"2024-09-12T19:14:49.429955+0000","last_fullsized":"2024-09-12T19:14:49.429955+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:49.429685+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:49.429685+0000","last_clean_scrub_stamp":"2024-09-12T19:14:49.429685+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:34.757943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"265'74","reported_seq":253,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.481566+0000","last_change":"2024-09-12T19:14:43.481566+0000","last_active":"2024-09-12T19:14:43.481566+0000","last_peered":"2024-09-12T19:14:43.481566+0000","last_clean":"2024-09-12T19:14:43.481566+0000","last_became_active":"2024-09-12T18:41:45.351387+0000","last_became_peered":"2024-09-12T18:41:45.351387+0000","last_unstale":"2024-09-12T19:14:43.481566+0000","last_undegraded":"2024-09-12T19:14:43.481566+0000","last_fullsized":"2024-09-12T19:14:43.481566+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T19:14:43.481388+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T19:14:43.481388+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.481388+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:26:58.275602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":373,"num_read_kb":261,"num_write":135,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:00.028159+0000","last_change":"2024-09-12T19:15:00.028159+0000","last_active":"2024-09-12T19:15:00.028159+0000","last_peered":"2024-09-12T19:15:00.028159+0000","last_clean":"2024-09-12T19:15:00.028159+0000","last_became_active":"2024-09-12T18:55:19.149666+0000","last_became_peered":"2024-09-12T18:55:19.149666+0000","last_unstale":"2024-09-12T19:15:00.028159+0000","last_undegraded":"2024-09-12T19:15:00.028159+0000","last_fullsized":"2024-09-12T19:15:00.028159+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:00.027947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:00.027947+0000","last_clean_scrub_stamp":"2024-09-12T19:15:00.027947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:10:57.471575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"265'7","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:52.889488+0000","last_change":"2024-09-12T19:14:52.889488+0000","last_active":"2024-09-12T19:14:52.889488+0000","last_peered":"2024-09-12T19:14:52.889488+0000","last_clean":"2024-09-12T19:14:52.889488+0000","last_became_active":"2024-09-12T18:43:32.903112+0000","last_became_peered":"2024-09-12T18:43:32.903112+0000","last_unstale":"2024-09-12T19:14:52.889488+0000","last_undegraded":"2024-09-12T19:14:52.889488+0000","last_fullsized":"2024-09-12T19:14:52.889488+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T19:14:52.889210+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T19:14:52.889210+0000","last_clean_scrub_stamp":"2024-09-12T19:14:52.889210+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:41:50.413388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7168,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"262'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.316037+0000","last_change":"2024-09-12T19:14:40.316037+0000","last_active":"2024-09-12T19:14:40.316037+0000","last_peered":"2024-09-12T19:14:40.316037+0000","last_clean":"2024-09-12T19:14:40.316037+0000","last_became_active":"2024-09-12T18:43:29.887725+0000","last_became_peered":"2024-09-12T18:43:29.887725+0000","last_unstale":"2024-09-12T19:14:40.316037+0000","last_undegraded":"2024-09-12T19:14:40.316037+0000","last_fullsized":"2024-09-12T19:14:40.316037+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:14:40.315848+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:14:40.315848+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.315848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:48:20.157102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"265'2","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.940200+0000","last_change":"2024-09-12T19:14:42.940200+0000","last_active":"2024-09-12T19:14:42.940200+0000","last_peered":"2024-09-12T19:14:42.940200+0000","last_clean":"2024-09-12T19:14:42.940200+0000","last_became_active":"2024-09-12T18:41:45.353582+0000","last_became_peered":"2024-09-12T18:41:45.353582+0000","last_unstale":"2024-09-12T19:14:42.940200+0000","last_undegraded":"2024-09-12T19:14:42.940200+0000","last_fullsized":"2024-09-12T19:14:42.940200+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:42.940004+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:42.940004+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.940004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:22.109399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:59.014168+0000","last_change":"2024-09-12T19:14:59.014168+0000","last_active":"2024-09-12T19:14:59.014168+0000","last_peered":"2024-09-12T19:14:59.014168+0000","last_clean":"2024-09-12T19:14:59.014168+0000","last_became_active":"2024-09-12T18:55:19.146310+0000","last_became_peered":"2024-09-12T18:55:19.146310+0000","last_unstale":"2024-09-12T19:14:59.014168+0000","last_undegraded":"2024-09-12T19:14:59.014168+0000","last_fullsized":"2024-09-12T19:14:59.014168+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:59.013977+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:59.013977+0000","last_clean_scrub_stamp":"2024-09-12T19:14:59.013977+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:58.690382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.279653+0000","last_change":"2024-09-12T19:14:38.279523+0000","last_active":"2024-09-12T19:14:38.279653+0000","last_peered":"2024-09-12T19:14:38.279653+0000","last_clean":"2024-09-12T19:14:38.279653+0000","last_became_active":"2024-09-12T18:43:32.922056+0000","last_became_peered":"2024-09-12T18:43:32.922056+0000","last_unstale":"2024-09-12T19:14:38.279653+0000","last_undegraded":"2024-09-12T19:14:38.279653+0000","last_fullsized":"2024-09-12T19:14:38.279653+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:38.279343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:38.279343+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.279343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:07.605920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"265'4","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:48.399439+0000","last_change":"2024-09-12T19:14:48.399439+0000","last_active":"2024-09-12T19:14:48.399439+0000","last_peered":"2024-09-12T19:14:48.399439+0000","last_clean":"2024-09-12T19:14:48.399439+0000","last_became_active":"2024-09-12T18:43:29.885595+0000","last_became_peered":"2024-09-12T18:43:29.885595+0000","last_unstale":"2024-09-12T19:14:48.399439+0000","last_undegraded":"2024-09-12T19:14:48.399439+0000","last_fullsized":"2024-09-12T19:14:48.399439+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:48.399260+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:48.399260+0000","last_clean_scrub_stamp":"2024-09-12T19:14:48.399260+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:35.537456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5492,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"265'29","reported_seq":131,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.093979+0000","last_change":"2024-09-12T19:14:38.093979+0000","last_active":"2024-09-12T19:14:38.093979+0000","last_peered":"2024-09-12T19:14:38.093979+0000","last_clean":"2024-09-12T19:14:38.093979+0000","last_became_active":"2024-09-12T18:41:45.335258+0000","last_became_peered":"2024-09-12T18:41:45.335258+0000","last_unstale":"2024-09-12T19:14:38.093979+0000","last_undegraded":"2024-09-12T19:14:38.093979+0000","last_fullsized":"2024-09-12T19:14:38.093979+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T19:14:38.093802+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T19:14:38.093802+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.093802+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:43.894454+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":88,"num_write":60,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:58.333276+0000","last_change":"2024-09-12T19:14:58.333276+0000","last_active":"2024-09-12T19:14:58.333276+0000","last_peered":"2024-09-12T19:14:58.333276+0000","last_clean":"2024-09-12T19:14:58.333276+0000","last_became_active":"2024-09-12T18:55:19.140247+0000","last_became_peered":"2024-09-12T18:55:19.140247+0000","last_unstale":"2024-09-12T19:14:58.333276+0000","last_undegraded":"2024-09-12T19:14:58.333276+0000","last_fullsized":"2024-09-12T19:14:58.333276+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:58.333011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:58.333011+0000","last_clean_scrub_stamp":"2024-09-12T19:14:58.333011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:02.170077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'9","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:53.936868+0000","last_change":"2024-09-12T19:14:53.936868+0000","last_active":"2024-09-12T19:14:53.936868+0000","last_peered":"2024-09-12T19:14:53.936868+0000","last_clean":"2024-09-12T19:14:53.936868+0000","last_became_active":"2024-09-12T18:43:32.918077+0000","last_became_peered":"2024-09-12T18:43:32.918077+0000","last_unstale":"2024-09-12T19:14:53.936868+0000","last_undegraded":"2024-09-12T19:14:53.936868+0000","last_fullsized":"2024-09-12T19:14:53.936868+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'9","last_scrub_stamp":"2024-09-12T19:14:53.936669+0000","last_deep_scrub":"265'9","last_deep_scrub_stamp":"2024-09-12T19:14:53.936669+0000","last_clean_scrub_stamp":"2024-09-12T19:14:53.936669+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:35.464475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15362,"num_write":14,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.470598+0000","last_change":"2024-09-12T19:14:42.470472+0000","last_active":"2024-09-12T19:14:42.470598+0000","last_peered":"2024-09-12T19:14:42.470598+0000","last_clean":"2024-09-12T19:14:42.470598+0000","last_became_active":"2024-09-12T18:43:29.902444+0000","last_became_peered":"2024-09-12T18:43:29.902444+0000","last_unstale":"2024-09-12T19:14:42.470598+0000","last_undegraded":"2024-09-12T19:14:42.470598+0000","last_fullsized":"2024-09-12T19:14:42.470598+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:42.470264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:42.470264+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.470264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:34.096293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"265'31","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.555760+0000","last_change":"2024-09-12T19:14:32.555760+0000","last_active":"2024-09-12T19:14:32.555760+0000","last_peered":"2024-09-12T19:14:32.555760+0000","last_clean":"2024-09-12T19:14:32.555760+0000","last_became_active":"2024-09-12T18:41:45.350344+0000","last_became_peered":"2024-09-12T18:41:45.350344+0000","last_unstale":"2024-09-12T19:14:32.555760+0000","last_undegraded":"2024-09-12T19:14:32.555760+0000","last_fullsized":"2024-09-12T19:14:32.555760+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:14:32.555579+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:14:32.555579+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.555579+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:51.762007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":107,"num_write":63,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:54.949796+0000","last_change":"2024-09-12T19:14:54.949796+0000","last_active":"2024-09-12T19:14:54.949796+0000","last_peered":"2024-09-12T19:14:54.949796+0000","last_clean":"2024-09-12T19:14:54.949796+0000","last_became_active":"2024-09-12T18:55:19.144778+0000","last_became_peered":"2024-09-12T18:55:19.144778+0000","last_unstale":"2024-09-12T19:14:54.949796+0000","last_undegraded":"2024-09-12T19:14:54.949796+0000","last_fullsized":"2024-09-12T19:14:54.949796+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:54.949609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:54.949609+0000","last_clean_scrub_stamp":"2024-09-12T19:14:54.949609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:35.053301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"265'5","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:55.366913+0000","last_change":"2024-09-12T19:14:55.366764+0000","last_active":"2024-09-12T19:14:55.366913+0000","last_peered":"2024-09-12T19:14:55.366913+0000","last_clean":"2024-09-12T19:14:55.366913+0000","last_became_active":"2024-09-12T18:43:32.901790+0000","last_became_peered":"2024-09-12T18:43:32.901790+0000","last_unstale":"2024-09-12T19:14:55.366913+0000","last_undegraded":"2024-09-12T19:14:55.366913+0000","last_fullsized":"2024-09-12T19:14:55.366913+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:14:55.366576+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:14:55.366576+0000","last_clean_scrub_stamp":"2024-09-12T19:14:55.366576+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:39:45.292808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3072,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"262'3","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:47.958293+0000","last_change":"2024-09-12T19:14:47.958132+0000","last_active":"2024-09-12T19:14:47.958293+0000","last_peered":"2024-09-12T19:14:47.958293+0000","last_clean":"2024-09-12T19:14:47.958293+0000","last_became_active":"2024-09-12T18:43:29.889097+0000","last_became_peered":"2024-09-12T18:43:29.889097+0000","last_unstale":"2024-09-12T19:14:47.958293+0000","last_undegraded":"2024-09-12T19:14:47.958293+0000","last_fullsized":"2024-09-12T19:14:47.958293+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T19:14:47.957946+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T19:14:47.957946+0000","last_clean_scrub_stamp":"2024-09-12T19:14:47.957946+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:50.918309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"265'31","reported_seq":145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.555852+0000","last_change":"2024-09-12T19:14:41.555852+0000","last_active":"2024-09-12T19:14:41.555852+0000","last_peered":"2024-09-12T19:14:41.555852+0000","last_clean":"2024-09-12T19:14:41.555852+0000","last_became_active":"2024-09-12T18:41:45.364055+0000","last_became_peered":"2024-09-12T18:41:45.364055+0000","last_unstale":"2024-09-12T19:14:41.555852+0000","last_undegraded":"2024-09-12T19:14:41.555852+0000","last_fullsized":"2024-09-12T19:14:41.555852+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:14:41.555635+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:14:41.555635+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.555635+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:37.201797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":115,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:49.483369+0000","last_change":"2024-09-12T19:14:49.483369+0000","last_active":"2024-09-12T19:14:49.483369+0000","last_peered":"2024-09-12T19:14:49.483369+0000","last_clean":"2024-09-12T19:14:49.483369+0000","last_became_active":"2024-09-12T18:55:19.121805+0000","last_became_peered":"2024-09-12T18:55:19.121805+0000","last_unstale":"2024-09-12T19:14:49.483369+0000","last_undegraded":"2024-09-12T19:14:49.483369+0000","last_fullsized":"2024-09-12T19:14:49.483369+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:49.483182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:49.483182+0000","last_clean_scrub_stamp":"2024-09-12T19:14:49.483182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:53.086069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'11","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:53.410541+0000","last_change":"2024-09-12T19:14:53.410541+0000","last_active":"2024-09-12T19:14:53.410541+0000","last_peered":"2024-09-12T19:14:53.410541+0000","last_clean":"2024-09-12T19:14:53.410541+0000","last_became_active":"2024-09-12T18:43:32.898379+0000","last_became_peered":"2024-09-12T18:43:32.898379+0000","last_unstale":"2024-09-12T19:14:53.410541+0000","last_undegraded":"2024-09-12T19:14:53.410541+0000","last_fullsized":"2024-09-12T19:14:53.410541+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T19:14:53.410355+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T19:14:53.410355+0000","last_clean_scrub_stamp":"2024-09-12T19:14:53.410355+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:21.748107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":16388,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"265'6","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.863466+0000","last_change":"2024-09-12T19:14:26.863334+0000","last_active":"2024-09-12T19:14:26.863466+0000","last_peered":"2024-09-12T19:14:26.863466+0000","last_clean":"2024-09-12T19:14:26.863466+0000","last_became_active":"2024-09-12T18:43:29.897326+0000","last_became_peered":"2024-09-12T18:43:29.897326+0000","last_unstale":"2024-09-12T19:14:26.863466+0000","last_undegraded":"2024-09-12T19:14:26.863466+0000","last_fullsized":"2024-09-12T19:14:26.863466+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:26.863141+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:26.863141+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.863141+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:17.681641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":6,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"265'31","reported_seq":138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.563792+0000","last_change":"2024-09-12T19:14:31.563792+0000","last_active":"2024-09-12T19:14:31.563792+0000","last_peered":"2024-09-12T19:14:31.563792+0000","last_clean":"2024-09-12T19:14:31.563792+0000","last_became_active":"2024-09-12T18:41:45.350900+0000","last_became_peered":"2024-09-12T18:41:45.350900+0000","last_unstale":"2024-09-12T19:14:31.563792+0000","last_undegraded":"2024-09-12T19:14:31.563792+0000","last_fullsized":"2024-09-12T19:14:31.563792+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'31","last_scrub_stamp":"2024-09-12T19:14:31.563626+0000","last_deep_scrub":"265'31","last_deep_scrub_stamp":"2024-09-12T19:14:31.563626+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.563626+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:23.203129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":104,"num_write":59,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.235967+0000","last_change":"2024-09-12T19:14:43.235967+0000","last_active":"2024-09-12T19:14:43.235967+0000","last_peered":"2024-09-12T19:14:43.235967+0000","last_clean":"2024-09-12T19:14:43.235967+0000","last_became_active":"2024-09-12T18:55:19.122238+0000","last_became_peered":"2024-09-12T18:55:19.122238+0000","last_unstale":"2024-09-12T19:14:43.235967+0000","last_undegraded":"2024-09-12T19:14:43.235967+0000","last_fullsized":"2024-09-12T19:14:43.235967+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:43.235760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:43.235760+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.235760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:11.891226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:51.877994+0000","last_change":"2024-09-12T19:14:51.877994+0000","last_active":"2024-09-12T19:14:51.877994+0000","last_peered":"2024-09-12T19:14:51.877994+0000","last_clean":"2024-09-12T19:14:51.877994+0000","last_became_active":"2024-09-12T18:43:32.913108+0000","last_became_peered":"2024-09-12T18:43:32.913108+0000","last_unstale":"2024-09-12T19:14:51.877994+0000","last_undegraded":"2024-09-12T19:14:51.877994+0000","last_fullsized":"2024-09-12T19:14:51.877994+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:51.877815+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:51.877815+0000","last_clean_scrub_stamp":"2024-09-12T19:14:51.877815+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:00.128894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":16,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"262'8","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.411897+0000","last_change":"2024-09-12T19:14:43.411897+0000","last_active":"2024-09-12T19:14:43.411897+0000","last_peered":"2024-09-12T19:14:43.411897+0000","last_clean":"2024-09-12T19:14:43.411897+0000","last_became_active":"2024-09-12T18:43:29.877925+0000","last_became_peered":"2024-09-12T18:43:29.877925+0000","last_unstale":"2024-09-12T19:14:43.411897+0000","last_undegraded":"2024-09-12T19:14:43.411897+0000","last_fullsized":"2024-09-12T19:14:43.411897+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T19:14:43.411708+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T19:14:43.411708+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.411708+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:45.701934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20482,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'136","reported_seq":482,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.988051+0000","last_change":"2024-09-12T19:14:41.987916+0000","last_active":"2024-09-12T19:14:41.988051+0000","last_peered":"2024-09-12T19:14:41.988051+0000","last_clean":"2024-09-12T19:14:41.988051+0000","last_became_active":"2024-09-12T18:41:45.365175+0000","last_became_peered":"2024-09-12T18:41:45.365175+0000","last_unstale":"2024-09-12T19:14:41.988051+0000","last_undegraded":"2024-09-12T19:14:41.988051+0000","last_fullsized":"2024-09-12T19:14:41.988051+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T19:14:41.987735+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T19:14:41.987735+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.987735+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:27.035898+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":832,"num_read_kb":595,"num_write":177,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4212,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:52.385088+0000","last_change":"2024-09-12T19:14:52.385088+0000","last_active":"2024-09-12T19:14:52.385088+0000","last_peered":"2024-09-12T19:14:52.385088+0000","last_clean":"2024-09-12T19:14:52.385088+0000","last_became_active":"2024-09-12T18:55:19.130130+0000","last_became_peered":"2024-09-12T18:55:19.130130+0000","last_unstale":"2024-09-12T19:14:52.385088+0000","last_undegraded":"2024-09-12T19:14:52.385088+0000","last_fullsized":"2024-09-12T19:14:52.385088+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:52.384905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:52.384905+0000","last_clean_scrub_stamp":"2024-09-12T19:14:52.384905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:23.229832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"262'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:50.361024+0000","last_change":"2024-09-12T19:14:50.361024+0000","last_active":"2024-09-12T19:14:50.361024+0000","last_peered":"2024-09-12T19:14:50.361024+0000","last_clean":"2024-09-12T19:14:50.361024+0000","last_became_active":"2024-09-12T18:43:32.904789+0000","last_became_peered":"2024-09-12T18:43:32.904789+0000","last_unstale":"2024-09-12T19:14:50.361024+0000","last_undegraded":"2024-09-12T19:14:50.361024+0000","last_fullsized":"2024-09-12T19:14:50.361024+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T19:14:50.360832+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T19:14:50.360832+0000","last_clean_scrub_stamp":"2024-09-12T19:14:50.360832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:01.900688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:48.933812+0000","last_change":"2024-09-12T19:14:48.933812+0000","last_active":"2024-09-12T19:14:48.933812+0000","last_peered":"2024-09-12T19:14:48.933812+0000","last_clean":"2024-09-12T19:14:48.933812+0000","last_became_active":"2024-09-12T18:43:29.883790+0000","last_became_peered":"2024-09-12T18:43:29.883790+0000","last_unstale":"2024-09-12T19:14:48.933812+0000","last_undegraded":"2024-09-12T19:14:48.933812+0000","last_fullsized":"2024-09-12T19:14:48.933812+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:48.933628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:48.933628+0000","last_clean_scrub_stamp":"2024-09-12T19:14:48.933628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:56:36.842214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"265'6","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.251428+0000","last_change":"2024-09-12T19:14:35.251147+0000","last_active":"2024-09-12T19:14:35.251428+0000","last_peered":"2024-09-12T19:14:35.251428+0000","last_clean":"2024-09-12T19:14:35.251428+0000","last_became_active":"2024-09-12T18:41:45.357746+0000","last_became_peered":"2024-09-12T18:41:45.357746+0000","last_unstale":"2024-09-12T19:14:35.251428+0000","last_undegraded":"2024-09-12T19:14:35.251428+0000","last_fullsized":"2024-09-12T19:14:35.251428+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:35.250936+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:35.250936+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.250936+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:30.843137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.855209+0000","last_change":"2024-09-12T19:14:29.854932+0000","last_active":"2024-09-12T19:14:29.855209+0000","last_peered":"2024-09-12T19:14:29.855209+0000","last_clean":"2024-09-12T19:14:29.855209+0000","last_became_active":"2024-09-12T18:55:19.139565+0000","last_became_peered":"2024-09-12T18:55:19.139565+0000","last_unstale":"2024-09-12T19:14:29.855209+0000","last_undegraded":"2024-09-12T19:14:29.855209+0000","last_fullsized":"2024-09-12T19:14:29.855209+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:29.854724+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:29.854724+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.854724+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:30.370455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"265'2","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.286649+0000","last_change":"2024-09-12T19:14:37.286462+0000","last_active":"2024-09-12T19:14:37.286649+0000","last_peered":"2024-09-12T19:14:37.286649+0000","last_clean":"2024-09-12T19:14:37.286649+0000","last_became_active":"2024-09-12T18:43:32.904858+0000","last_became_peered":"2024-09-12T18:43:32.904858+0000","last_unstale":"2024-09-12T19:14:37.286649+0000","last_undegraded":"2024-09-12T19:14:37.286649+0000","last_fullsized":"2024-09-12T19:14:37.286649+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:37.286273+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:37.286273+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.286273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:27.729597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"265'4","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:46.002213+0000","last_change":"2024-09-12T19:14:46.002213+0000","last_active":"2024-09-12T19:14:46.002213+0000","last_peered":"2024-09-12T19:14:46.002213+0000","last_clean":"2024-09-12T19:14:46.002213+0000","last_became_active":"2024-09-12T18:43:29.889328+0000","last_became_peered":"2024-09-12T18:43:29.889328+0000","last_unstale":"2024-09-12T19:14:46.002213+0000","last_undegraded":"2024-09-12T19:14:46.002213+0000","last_fullsized":"2024-09-12T19:14:46.002213+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:46.002027+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:46.002027+0000","last_clean_scrub_stamp":"2024-09-12T19:14:46.002027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:06:39.507049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"262'8","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.434588+0000","last_change":"2024-09-12T19:14:41.434439+0000","last_active":"2024-09-12T19:14:41.434588+0000","last_peered":"2024-09-12T19:14:41.434588+0000","last_clean":"2024-09-12T19:14:41.434588+0000","last_became_active":"2024-09-12T18:41:45.353369+0000","last_became_peered":"2024-09-12T18:41:45.353369+0000","last_unstale":"2024-09-12T19:14:41.434588+0000","last_undegraded":"2024-09-12T19:14:41.434588+0000","last_fullsized":"2024-09-12T19:14:41.434588+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T19:14:41.434222+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T19:14:41.434222+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.434222+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:43.913683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":34,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:01.403442+0000","last_change":"2024-09-12T19:15:01.403442+0000","last_active":"2024-09-12T19:15:01.403442+0000","last_peered":"2024-09-12T19:15:01.403442+0000","last_clean":"2024-09-12T19:15:01.403442+0000","last_became_active":"2024-09-12T18:55:19.115920+0000","last_became_peered":"2024-09-12T18:55:19.115920+0000","last_unstale":"2024-09-12T19:15:01.403442+0000","last_undegraded":"2024-09-12T19:15:01.403442+0000","last_fullsized":"2024-09-12T19:15:01.403442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:15:01.403275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:15:01.403275+0000","last_clean_scrub_stamp":"2024-09-12T19:15:01.403275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:52:42.582415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:46.443166+0000","last_change":"2024-09-12T19:14:46.443166+0000","last_active":"2024-09-12T19:14:46.443166+0000","last_peered":"2024-09-12T19:14:46.443166+0000","last_clean":"2024-09-12T19:14:46.443166+0000","last_became_active":"2024-09-12T18:43:32.913259+0000","last_became_peered":"2024-09-12T18:43:32.913259+0000","last_unstale":"2024-09-12T19:14:46.443166+0000","last_undegraded":"2024-09-12T19:14:46.443166+0000","last_fullsized":"2024-09-12T19:14:46.443166+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:46.442950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:46.442950+0000","last_clean_scrub_stamp":"2024-09-12T19:14:46.442950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:06.341853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:46.958032+0000","last_change":"2024-09-12T19:14:46.957890+0000","last_active":"2024-09-12T19:14:46.958032+0000","last_peered":"2024-09-12T19:14:46.958032+0000","last_clean":"2024-09-12T19:14:46.958032+0000","last_became_active":"2024-09-12T18:43:29.882039+0000","last_became_peered":"2024-09-12T18:43:29.882039+0000","last_unstale":"2024-09-12T19:14:46.958032+0000","last_undegraded":"2024-09-12T19:14:46.958032+0000","last_fullsized":"2024-09-12T19:14:46.958032+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:46.957701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:46.957701+0000","last_clean_scrub_stamp":"2024-09-12T19:14:46.957701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:05.974488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"265'182","reported_seq":596,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:45.435352+0000","last_change":"2024-09-12T19:14:45.435181+0000","last_active":"2024-09-12T19:14:45.435352+0000","last_peered":"2024-09-12T19:14:45.435352+0000","last_clean":"2024-09-12T19:14:45.435352+0000","last_became_active":"2024-09-12T18:41:45.354142+0000","last_became_peered":"2024-09-12T18:41:45.354142+0000","last_unstale":"2024-09-12T19:14:45.435352+0000","last_undegraded":"2024-09-12T19:14:45.435352+0000","last_fullsized":"2024-09-12T19:14:45.435352+0000","mapping_epoch":252,"log_start":"262'100","ondisk_log_start":"262'100","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'182","last_scrub_stamp":"2024-09-12T19:14:45.434988+0000","last_deep_scrub":"265'182","last_deep_scrub_stamp":"2024-09-12T19:14:45.434988+0000","last_clean_scrub_stamp":"2024-09-12T19:14:45.434988+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:45:49.267458+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1050,"num_read_kb":838,"num_write":233,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":495,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:57.318891+0000","last_change":"2024-09-12T19:14:57.318891+0000","last_active":"2024-09-12T19:14:57.318891+0000","last_peered":"2024-09-12T19:14:57.318891+0000","last_clean":"2024-09-12T19:14:57.318891+0000","last_became_active":"2024-09-12T18:55:19.142412+0000","last_became_peered":"2024-09-12T18:55:19.142412+0000","last_unstale":"2024-09-12T19:14:57.318891+0000","last_undegraded":"2024-09-12T19:14:57.318891+0000","last_fullsized":"2024-09-12T19:14:57.318891+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:57.318714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:57.318714+0000","last_clean_scrub_stamp":"2024-09-12T19:14:57.318714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:22.828271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"265'5","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.583770+0000","last_change":"2024-09-12T19:14:38.583634+0000","last_active":"2024-09-12T19:14:38.583770+0000","last_peered":"2024-09-12T19:14:38.583770+0000","last_clean":"2024-09-12T19:14:38.583770+0000","last_became_active":"2024-09-12T18:43:32.939024+0000","last_became_peered":"2024-09-12T18:43:32.939024+0000","last_unstale":"2024-09-12T19:14:38.583770+0000","last_undegraded":"2024-09-12T19:14:38.583770+0000","last_fullsized":"2024-09-12T19:14:38.583770+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:14:38.583441+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:14:38.583441+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.583441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:41.132873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":10240,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"265'2","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.243074+0000","last_change":"2024-09-12T19:14:34.242928+0000","last_active":"2024-09-12T19:14:34.243074+0000","last_peered":"2024-09-12T19:14:34.243074+0000","last_clean":"2024-09-12T19:14:34.243074+0000","last_became_active":"2024-09-12T18:43:29.892060+0000","last_became_peered":"2024-09-12T18:43:29.892060+0000","last_unstale":"2024-09-12T19:14:34.243074+0000","last_undegraded":"2024-09-12T19:14:34.243074+0000","last_fullsized":"2024-09-12T19:14:34.243074+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:34.242755+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:34.242755+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.242755+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:28.135417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"265'50","reported_seq":192,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.569690+0000","last_change":"2024-09-12T19:14:30.569521+0000","last_active":"2024-09-12T19:14:30.569690+0000","last_peered":"2024-09-12T19:14:30.569690+0000","last_clean":"2024-09-12T19:14:30.569690+0000","last_became_active":"2024-09-12T18:41:45.355840+0000","last_became_peered":"2024-09-12T18:41:45.355840+0000","last_unstale":"2024-09-12T19:14:30.569690+0000","last_undegraded":"2024-09-12T19:14:30.569690+0000","last_fullsized":"2024-09-12T19:14:30.569690+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'50","last_scrub_stamp":"2024-09-12T19:14:30.569342+0000","last_deep_scrub":"265'50","last_deep_scrub_stamp":"2024-09-12T19:14:30.569342+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.569342+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:42:57.208477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":245,"num_read_kb":177,"num_write":88,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:55.935335+0000","last_change":"2024-09-12T19:14:55.935335+0000","last_active":"2024-09-12T19:14:55.935335+0000","last_peered":"2024-09-12T19:14:55.935335+0000","last_clean":"2024-09-12T19:14:55.935335+0000","last_became_active":"2024-09-12T18:55:19.155684+0000","last_became_peered":"2024-09-12T18:55:19.155684+0000","last_unstale":"2024-09-12T19:14:55.935335+0000","last_undegraded":"2024-09-12T19:14:55.935335+0000","last_fullsized":"2024-09-12T19:14:55.935335+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:55.935156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:55.935156+0000","last_clean_scrub_stamp":"2024-09-12T19:14:55.935156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:03.644530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'4","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:48.376640+0000","last_change":"2024-09-12T19:14:48.376477+0000","last_active":"2024-09-12T19:14:48.376640+0000","last_peered":"2024-09-12T19:14:48.376640+0000","last_clean":"2024-09-12T19:14:48.376640+0000","last_became_active":"2024-09-12T18:43:32.903273+0000","last_became_peered":"2024-09-12T18:43:32.903273+0000","last_unstale":"2024-09-12T19:14:48.376640+0000","last_undegraded":"2024-09-12T19:14:48.376640+0000","last_fullsized":"2024-09-12T19:14:48.376640+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:48.376299+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:48.376299+0000","last_clean_scrub_stamp":"2024-09-12T19:14:48.376299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:49:27.208401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"265'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.559913+0000","last_change":"2024-09-12T19:14:35.559742+0000","last_active":"2024-09-12T19:14:35.559913+0000","last_peered":"2024-09-12T19:14:35.559913+0000","last_clean":"2024-09-12T19:14:35.559913+0000","last_became_active":"2024-09-12T18:43:29.865413+0000","last_became_peered":"2024-09-12T18:43:29.865413+0000","last_unstale":"2024-09-12T19:14:35.559913+0000","last_undegraded":"2024-09-12T19:14:35.559913+0000","last_fullsized":"2024-09-12T19:14:35.559913+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T19:14:35.559570+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T19:14:35.559570+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.559570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:25.856774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"265'25","reported_seq":126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.938892+0000","last_change":"2024-09-12T19:14:40.938892+0000","last_active":"2024-09-12T19:14:40.938892+0000","last_peered":"2024-09-12T19:14:40.938892+0000","last_clean":"2024-09-12T19:14:40.938892+0000","last_became_active":"2024-09-12T18:41:45.362445+0000","last_became_peered":"2024-09-12T18:41:45.362445+0000","last_unstale":"2024-09-12T19:14:40.938892+0000","last_undegraded":"2024-09-12T19:14:40.938892+0000","last_fullsized":"2024-09-12T19:14:40.938892+0000","mapping_epoch":252,"log_start":"0'0","ondisk_log_start":"0'0","created":252,"last_epoch_clean":253,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-12T19:14:40.938699+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-12T19:14:40.938699+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.938699+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:00.250732+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"265'318","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.831899+0000","last_change":"2024-09-12T19:14:18.831615+0000","last_active":"2024-09-12T19:14:18.831899+0000","last_peered":"2024-09-12T19:14:18.831899+0000","last_clean":"2024-09-12T19:14:18.831899+0000","last_became_active":"2024-09-12T18:26:39.872863+0000","last_became_peered":"2024-09-12T18:26:39.872863+0000","last_unstale":"2024-09-12T19:14:18.831899+0000","last_undegraded":"2024-09-12T19:14:18.831899+0000","last_fullsized":"2024-09-12T19:14:18.831899+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T19:14:18.831273+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T19:14:18.831273+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.831273+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:35.503180+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65109,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":407,"num_read_kb":8020,"num_write":948,"num_write_kb":33098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"265'549","reported_seq":2210,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.381001+0000","last_change":"2024-09-12T19:14:23.381001+0000","last_active":"2024-09-12T19:14:23.381001+0000","last_peered":"2024-09-12T19:14:23.381001+0000","last_clean":"2024-09-12T19:14:23.381001+0000","last_became_active":"2024-09-12T18:26:41.879711+0000","last_became_peered":"2024-09-12T18:26:41.879711+0000","last_unstale":"2024-09-12T19:14:23.381001+0000","last_undegraded":"2024-09-12T19:14:23.381001+0000","last_fullsized":"2024-09-12T19:14:23.381001+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'549","last_scrub_stamp":"2024-09-12T19:14:23.380715+0000","last_deep_scrub":"265'549","last_deep_scrub_stamp":"2024-09-12T19:14:23.380715+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.380715+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:49.716008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2944,"num_read_kb":2757,"num_write":660,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"265'376","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.135455+0000","last_change":"2024-09-12T19:14:12.135299+0000","last_active":"2024-09-12T19:14:12.135455+0000","last_peered":"2024-09-12T19:14:12.135455+0000","last_clean":"2024-09-12T19:14:12.135455+0000","last_became_active":"2024-09-12T18:26:39.837462+0000","last_became_peered":"2024-09-12T18:26:39.837462+0000","last_unstale":"2024-09-12T19:14:12.135455+0000","last_undegraded":"2024-09-12T19:14:12.135455+0000","last_fullsized":"2024-09-12T19:14:12.135455+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T19:14:12.135058+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T19:14:12.135058+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.135058+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:27.693768+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10456094,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":565,"num_read_kb":60601,"num_write":1117,"num_write_kb":26482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"265'837","reported_seq":2241,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.904657+0000","last_change":"2024-09-12T19:14:23.904657+0000","last_active":"2024-09-12T19:14:23.904657+0000","last_peered":"2024-09-12T19:14:23.904657+0000","last_clean":"2024-09-12T19:14:23.904657+0000","last_became_active":"2024-09-12T18:26:41.863835+0000","last_became_peered":"2024-09-12T18:26:41.863835+0000","last_unstale":"2024-09-12T19:14:23.904657+0000","last_undegraded":"2024-09-12T19:14:23.904657+0000","last_fullsized":"2024-09-12T19:14:23.904657+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'837","last_scrub_stamp":"2024-09-12T19:14:23.904418+0000","last_deep_scrub":"265'837","last_deep_scrub_stamp":"2024-09-12T19:14:23.904418+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.904418+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:53.971623+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3830,"num_read_kb":3409,"num_write":1134,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"265'378","reported_seq":1063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.849257+0000","last_change":"2024-09-12T19:14:08.849112+0000","last_active":"2024-09-12T19:14:08.849257+0000","last_peered":"2024-09-12T19:14:08.849257+0000","last_clean":"2024-09-12T19:14:08.849257+0000","last_became_active":"2024-09-12T18:26:39.831522+0000","last_became_peered":"2024-09-12T18:26:39.831522+0000","last_unstale":"2024-09-12T19:14:08.849257+0000","last_undegraded":"2024-09-12T19:14:08.849257+0000","last_fullsized":"2024-09-12T19:14:08.849257+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'378","last_scrub_stamp":"2024-09-12T19:14:08.848850+0000","last_deep_scrub":"265'378","last_deep_scrub_stamp":"2024-09-12T19:14:08.848850+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.848850+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:46:42.012065+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":634,"num_read_kb":27264,"num_write":1166,"num_write_kb":30891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"265'366","reported_seq":1836,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.391877+0000","last_change":"2024-09-12T19:14:23.391877+0000","last_active":"2024-09-12T19:14:23.391877+0000","last_peered":"2024-09-12T19:14:23.391877+0000","last_clean":"2024-09-12T19:14:23.391877+0000","last_became_active":"2024-09-12T18:26:41.850001+0000","last_became_peered":"2024-09-12T18:26:41.850001+0000","last_unstale":"2024-09-12T19:14:23.391877+0000","last_undegraded":"2024-09-12T19:14:23.391877+0000","last_fullsized":"2024-09-12T19:14:23.391877+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T19:14:23.391604+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T19:14:23.391604+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.391604+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:51:22.771625+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2076,"num_read_kb":1992,"num_write":405,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":948,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"265'352","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.551177+0000","last_change":"2024-09-12T19:14:16.551022+0000","last_active":"2024-09-12T19:14:16.551177+0000","last_peered":"2024-09-12T19:14:16.551177+0000","last_clean":"2024-09-12T19:14:16.551177+0000","last_became_active":"2024-09-12T18:27:11.824331+0000","last_became_peered":"2024-09-12T18:27:11.824331+0000","last_unstale":"2024-09-12T19:14:16.551177+0000","last_undegraded":"2024-09-12T19:14:16.551177+0000","last_fullsized":"2024-09-12T19:14:16.551177+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'352","last_scrub_stamp":"2024-09-12T19:14:16.550844+0000","last_deep_scrub":"265'352","last_deep_scrub_stamp":"2024-09-12T19:14:16.550844+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.550844+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:58.419343+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":38329,"num_write":1089,"num_write_kb":37388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"265'504","reported_seq":2067,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.607377+0000","last_change":"2024-09-12T19:14:28.607377+0000","last_active":"2024-09-12T19:14:28.607377+0000","last_peered":"2024-09-12T19:14:28.607377+0000","last_clean":"2024-09-12T19:14:28.607377+0000","last_became_active":"2024-09-12T18:26:41.850866+0000","last_became_peered":"2024-09-12T18:26:41.850866+0000","last_unstale":"2024-09-12T19:14:28.607377+0000","last_undegraded":"2024-09-12T19:14:28.607377+0000","last_fullsized":"2024-09-12T19:14:28.607377+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'504","last_scrub_stamp":"2024-09-12T19:14:28.607197+0000","last_deep_scrub":"265'504","last_deep_scrub_stamp":"2024-09-12T19:14:28.607197+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.607197+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:40.118453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2664,"num_read_kb":2487,"num_write":637,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"265'375","reported_seq":1117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.824067+0000","last_change":"2024-09-12T19:14:17.824067+0000","last_active":"2024-09-12T19:14:17.824067+0000","last_peered":"2024-09-12T19:14:17.824067+0000","last_clean":"2024-09-12T19:14:17.824067+0000","last_became_active":"2024-09-12T18:26:39.870272+0000","last_became_peered":"2024-09-12T18:26:39.870272+0000","last_unstale":"2024-09-12T19:14:17.824067+0000","last_undegraded":"2024-09-12T19:14:17.824067+0000","last_fullsized":"2024-09-12T19:14:17.824067+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T19:14:17.823882+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T19:14:17.823882+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.823882+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:41:12.604920+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":771,"num_read_kb":17788,"num_write":1173,"num_write_kb":36512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"265'544","reported_seq":1978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.599536+0000","last_change":"2024-09-12T19:14:16.599400+0000","last_active":"2024-09-12T19:14:16.599536+0000","last_peered":"2024-09-12T19:14:16.599536+0000","last_clean":"2024-09-12T19:14:16.599536+0000","last_became_active":"2024-09-12T18:26:41.865288+0000","last_became_peered":"2024-09-12T18:26:41.865288+0000","last_unstale":"2024-09-12T19:14:16.599536+0000","last_undegraded":"2024-09-12T19:14:16.599536+0000","last_fullsized":"2024-09-12T19:14:16.599536+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'544","last_scrub_stamp":"2024-09-12T19:14:16.599227+0000","last_deep_scrub":"265'544","last_deep_scrub_stamp":"2024-09-12T19:14:16.599227+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.599227+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:43.374177+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2721,"num_read_kb":2571,"num_write":759,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"265'336","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.604868+0000","last_change":"2024-09-12T19:14:15.604868+0000","last_active":"2024-09-12T19:14:15.604868+0000","last_peered":"2024-09-12T19:14:15.604868+0000","last_clean":"2024-09-12T19:14:15.604868+0000","last_became_active":"2024-09-12T18:26:39.851253+0000","last_became_peered":"2024-09-12T18:26:39.851253+0000","last_unstale":"2024-09-12T19:14:15.604868+0000","last_undegraded":"2024-09-12T19:14:15.604868+0000","last_fullsized":"2024-09-12T19:14:15.604868+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T19:14:15.604676+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T19:14:15.604676+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.604676+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:42.167079+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493192,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":31766,"num_write":1103,"num_write_kb":25425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"265'809","reported_seq":2350,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.411683+0000","last_change":"2024-09-12T19:14:24.411445+0000","last_active":"2024-09-12T19:14:24.411683+0000","last_peered":"2024-09-12T19:14:24.411683+0000","last_clean":"2024-09-12T19:14:24.411683+0000","last_became_active":"2024-09-12T18:26:41.851811+0000","last_became_peered":"2024-09-12T18:26:41.851811+0000","last_unstale":"2024-09-12T19:14:24.411683+0000","last_undegraded":"2024-09-12T19:14:24.411683+0000","last_fullsized":"2024-09-12T19:14:24.411683+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'809","last_scrub_stamp":"2024-09-12T19:14:24.411193+0000","last_deep_scrub":"265'809","last_deep_scrub_stamp":"2024-09-12T19:14:24.411193+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.411193+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:30.044424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3792,"num_read_kb":3404,"num_write":1072,"num_write_kb":407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"265'361","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.808471+0000","last_change":"2024-09-12T19:14:16.808471+0000","last_active":"2024-09-12T19:14:16.808471+0000","last_peered":"2024-09-12T19:14:16.808471+0000","last_clean":"2024-09-12T19:14:16.808471+0000","last_became_active":"2024-09-12T18:26:39.861529+0000","last_became_peered":"2024-09-12T18:26:39.861529+0000","last_unstale":"2024-09-12T19:14:16.808471+0000","last_undegraded":"2024-09-12T19:14:16.808471+0000","last_fullsized":"2024-09-12T19:14:16.808471+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'361","last_scrub_stamp":"2024-09-12T19:14:16.808282+0000","last_deep_scrub":"265'361","last_deep_scrub_stamp":"2024-09-12T19:14:16.808282+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.808282+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:57:23.887451+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":30235,"num_write":1160,"num_write_kb":47172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"265'702","reported_seq":2327,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.344153+0000","last_change":"2024-09-12T19:14:22.343997+0000","last_active":"2024-09-12T19:14:22.344153+0000","last_peered":"2024-09-12T19:14:22.344153+0000","last_clean":"2024-09-12T19:14:22.344153+0000","last_became_active":"2024-09-12T18:26:41.878820+0000","last_became_peered":"2024-09-12T18:26:41.878820+0000","last_unstale":"2024-09-12T19:14:22.344153+0000","last_undegraded":"2024-09-12T19:14:22.344153+0000","last_fullsized":"2024-09-12T19:14:22.344153+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'702","last_scrub_stamp":"2024-09-12T19:14:22.343819+0000","last_deep_scrub":"265'702","last_deep_scrub_stamp":"2024-09-12T19:14:22.343819+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.343819+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:29.298164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3429,"num_read_kb":3073,"num_write":944,"num_write_kb":337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":731,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"265'345","reported_seq":1045,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.978941+0000","last_change":"2024-09-12T19:14:18.978941+0000","last_active":"2024-09-12T19:14:18.978941+0000","last_peered":"2024-09-12T19:14:18.978941+0000","last_clean":"2024-09-12T19:14:18.978941+0000","last_became_active":"2024-09-12T18:27:11.824008+0000","last_became_peered":"2024-09-12T18:27:11.824008+0000","last_unstale":"2024-09-12T19:14:18.978941+0000","last_undegraded":"2024-09-12T19:14:18.978941+0000","last_fullsized":"2024-09-12T19:14:18.978941+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'345","last_scrub_stamp":"2024-09-12T19:14:18.978754+0000","last_deep_scrub":"265'345","last_deep_scrub_stamp":"2024-09-12T19:14:18.978754+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.978754+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:11.553698+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":634,"num_read_kb":10155,"num_write":1129,"num_write_kb":30763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"265'678","reported_seq":2298,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.021610+0000","last_change":"2024-09-12T19:14:13.021352+0000","last_active":"2024-09-12T19:14:13.021610+0000","last_peered":"2024-09-12T19:14:13.021610+0000","last_clean":"2024-09-12T19:14:13.021610+0000","last_became_active":"2024-09-12T18:26:41.854487+0000","last_became_peered":"2024-09-12T18:26:41.854487+0000","last_unstale":"2024-09-12T19:14:13.021610+0000","last_undegraded":"2024-09-12T19:14:13.021610+0000","last_fullsized":"2024-09-12T19:14:13.021610+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'678","last_scrub_stamp":"2024-09-12T19:14:13.021126+0000","last_deep_scrub":"265'678","last_deep_scrub_stamp":"2024-09-12T19:14:13.021126+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.021126+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:16.262713+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3483,"num_read_kb":3149,"num_write":934,"num_write_kb":360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3253,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"265'464","reported_seq":2077,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.379502+0000","last_change":"2024-09-12T19:14:21.379502+0000","last_active":"2024-09-12T19:14:21.379502+0000","last_peered":"2024-09-12T19:14:21.379502+0000","last_clean":"2024-09-12T19:14:21.379502+0000","last_became_active":"2024-09-12T18:26:41.845080+0000","last_became_peered":"2024-09-12T18:26:41.845080+0000","last_unstale":"2024-09-12T19:14:21.379502+0000","last_undegraded":"2024-09-12T19:14:21.379502+0000","last_fullsized":"2024-09-12T19:14:21.379502+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'464","last_scrub_stamp":"2024-09-12T19:14:21.379327+0000","last_deep_scrub":"265'464","last_deep_scrub_stamp":"2024-09-12T19:14:21.379327+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.379327+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:35.754623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2421,"num_read_kb":2289,"num_write":534,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"265'377","reported_seq":1020,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.854636+0000","last_change":"2024-09-12T19:14:12.854483+0000","last_active":"2024-09-12T19:14:12.854636+0000","last_peered":"2024-09-12T19:14:12.854636+0000","last_clean":"2024-09-12T19:14:12.854636+0000","last_became_active":"2024-09-12T18:26:39.872936+0000","last_became_peered":"2024-09-12T18:26:39.872936+0000","last_unstale":"2024-09-12T19:14:12.854636+0000","last_undegraded":"2024-09-12T19:14:12.854636+0000","last_fullsized":"2024-09-12T19:14:12.854636+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:14:12.854221+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:14:12.854221+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.854221+0000","objects_scrubbed":8,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:07.012669+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":506,"num_read_kb":24957,"num_write":1245,"num_write_kb":33279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"265'560","reported_seq":2182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.878540+0000","last_change":"2024-09-12T19:14:20.878540+0000","last_active":"2024-09-12T19:14:20.878540+0000","last_peered":"2024-09-12T19:14:20.878540+0000","last_clean":"2024-09-12T19:14:20.878540+0000","last_became_active":"2024-09-12T18:26:41.865247+0000","last_became_peered":"2024-09-12T18:26:41.865247+0000","last_unstale":"2024-09-12T19:14:20.878540+0000","last_undegraded":"2024-09-12T19:14:20.878540+0000","last_fullsized":"2024-09-12T19:14:20.878540+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'560","last_scrub_stamp":"2024-09-12T19:14:20.878338+0000","last_deep_scrub":"265'560","last_deep_scrub_stamp":"2024-09-12T19:14:20.878338+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.878338+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:05.827599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2931,"num_read_kb":2718,"num_write":721,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"265'407","reported_seq":1125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.608821+0000","last_change":"2024-09-12T19:14:12.608658+0000","last_active":"2024-09-12T19:14:12.608821+0000","last_peered":"2024-09-12T19:14:12.608821+0000","last_clean":"2024-09-12T19:14:12.608821+0000","last_became_active":"2024-09-12T18:26:39.858964+0000","last_became_peered":"2024-09-12T18:26:39.858964+0000","last_unstale":"2024-09-12T19:14:12.608821+0000","last_undegraded":"2024-09-12T19:14:12.608821+0000","last_fullsized":"2024-09-12T19:14:12.608821+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'407","last_scrub_stamp":"2024-09-12T19:14:12.608446+0000","last_deep_scrub":"265'407","last_deep_scrub_stamp":"2024-09-12T19:14:12.608446+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.608446+0000","objects_scrubbed":4,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:42:32.397218+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":810,"num_read_kb":25615,"num_write":1319,"num_write_kb":27961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"265'829","reported_seq":2320,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.413316+0000","last_change":"2024-09-12T19:14:20.413316+0000","last_active":"2024-09-12T19:14:20.413316+0000","last_peered":"2024-09-12T19:14:20.413316+0000","last_clean":"2024-09-12T19:14:20.413316+0000","last_became_active":"2024-09-12T18:26:41.861762+0000","last_became_peered":"2024-09-12T18:26:41.861762+0000","last_unstale":"2024-09-12T19:14:20.413316+0000","last_undegraded":"2024-09-12T19:14:20.413316+0000","last_fullsized":"2024-09-12T19:14:20.413316+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'829","last_scrub_stamp":"2024-09-12T19:14:20.413148+0000","last_deep_scrub":"265'829","last_deep_scrub_stamp":"2024-09-12T19:14:20.413148+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.413148+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:56.664208+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3868,"num_read_kb":3443,"num_write":1111,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"265'398","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.589611+0000","last_change":"2024-09-12T19:14:10.589461+0000","last_active":"2024-09-12T19:14:10.589611+0000","last_peered":"2024-09-12T19:14:10.589611+0000","last_clean":"2024-09-12T19:14:10.589611+0000","last_became_active":"2024-09-12T18:26:39.856700+0000","last_became_peered":"2024-09-12T18:26:39.856700+0000","last_unstale":"2024-09-12T19:14:10.589611+0000","last_undegraded":"2024-09-12T19:14:10.589611+0000","last_fullsized":"2024-09-12T19:14:10.589611+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'398","last_scrub_stamp":"2024-09-12T19:14:10.589144+0000","last_deep_scrub":"265'398","last_deep_scrub_stamp":"2024-09-12T19:14:10.589144+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.589144+0000","objects_scrubbed":9,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:37:43.957851+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1632225,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":583,"num_read_kb":29092,"num_write":1242,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"265'409","reported_seq":1983,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.020835+0000","last_change":"2024-09-12T19:14:14.020591+0000","last_active":"2024-09-12T19:14:14.020835+0000","last_peered":"2024-09-12T19:14:14.020835+0000","last_clean":"2024-09-12T19:14:14.020835+0000","last_became_active":"2024-09-12T18:26:41.854687+0000","last_became_peered":"2024-09-12T18:26:41.854687+0000","last_unstale":"2024-09-12T19:14:14.020835+0000","last_undegraded":"2024-09-12T19:14:14.020835+0000","last_fullsized":"2024-09-12T19:14:14.020835+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'409","last_scrub_stamp":"2024-09-12T19:14:14.020301+0000","last_deep_scrub":"265'409","last_deep_scrub_stamp":"2024-09-12T19:14:14.020301+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.020301+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:02.096125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2203,"num_read_kb":2114,"num_write":459,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"265'308","reported_seq":1035,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.295640+0000","last_change":"2024-09-12T19:14:09.295484+0000","last_active":"2024-09-12T19:14:09.295640+0000","last_peered":"2024-09-12T19:14:09.295640+0000","last_clean":"2024-09-12T19:14:09.295640+0000","last_became_active":"2024-09-12T18:26:39.845295+0000","last_became_peered":"2024-09-12T18:26:39.845295+0000","last_unstale":"2024-09-12T19:14:09.295640+0000","last_undegraded":"2024-09-12T19:14:09.295640+0000","last_fullsized":"2024-09-12T19:14:09.295640+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'308","last_scrub_stamp":"2024-09-12T19:14:09.295239+0000","last_deep_scrub":"265'308","last_deep_scrub_stamp":"2024-09-12T19:14:09.295239+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.295239+0000","objects_scrubbed":9,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:26.941892+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306760,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":23315,"num_write":964,"num_write_kb":25673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"265'820","reported_seq":2476,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.067947+0000","last_change":"2024-09-12T19:14:11.067808+0000","last_active":"2024-09-12T19:14:11.067947+0000","last_peered":"2024-09-12T19:14:11.067947+0000","last_clean":"2024-09-12T19:14:11.067947+0000","last_became_active":"2024-09-12T18:26:41.856280+0000","last_became_peered":"2024-09-12T18:26:41.856280+0000","last_unstale":"2024-09-12T19:14:11.067947+0000","last_undegraded":"2024-09-12T19:14:11.067947+0000","last_fullsized":"2024-09-12T19:14:11.067947+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'820","last_scrub_stamp":"2024-09-12T19:14:11.067602+0000","last_deep_scrub":"265'820","last_deep_scrub_stamp":"2024-09-12T19:14:11.067602+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.067602+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:07.191479+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4038,"num_read_kb":3655,"num_write":1078,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1764,"num_omap_keys":7,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"265'416","reported_seq":1118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.822795+0000","last_change":"2024-09-12T19:14:09.822636+0000","last_active":"2024-09-12T19:14:09.822795+0000","last_peered":"2024-09-12T19:14:09.822795+0000","last_clean":"2024-09-12T19:14:09.822795+0000","last_became_active":"2024-09-12T18:26:39.842159+0000","last_became_peered":"2024-09-12T18:26:39.842159+0000","last_unstale":"2024-09-12T19:14:09.822795+0000","last_undegraded":"2024-09-12T19:14:09.822795+0000","last_fullsized":"2024-09-12T19:14:09.822795+0000","mapping_epoch":24,"log_start":"265'401","ondisk_log_start":"265'401","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'416","last_scrub_stamp":"2024-09-12T19:14:09.822414+0000","last_deep_scrub":"265'416","last_deep_scrub_stamp":"2024-09-12T19:14:09.822414+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.822414+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":401,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:56:12.755786+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":622,"num_read_kb":58105,"num_write":1270,"num_write_kb":62462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"265'846","reported_seq":2442,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.379526+0000","last_change":"2024-09-12T19:14:22.379392+0000","last_active":"2024-09-12T19:14:22.379526+0000","last_peered":"2024-09-12T19:14:22.379526+0000","last_clean":"2024-09-12T19:14:22.379526+0000","last_became_active":"2024-09-12T18:26:41.853403+0000","last_became_peered":"2024-09-12T18:26:41.853403+0000","last_unstale":"2024-09-12T19:14:22.379526+0000","last_undegraded":"2024-09-12T19:14:22.379526+0000","last_fullsized":"2024-09-12T19:14:22.379526+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'846","last_scrub_stamp":"2024-09-12T19:14:22.379204+0000","last_deep_scrub":"265'846","last_deep_scrub_stamp":"2024-09-12T19:14:22.379204+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.379204+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":800,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:10:29.289985+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3981,"num_read_kb":3579,"num_write":1130,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"265'408","reported_seq":1125,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.829466+0000","last_change":"2024-09-12T19:14:07.829466+0000","last_active":"2024-09-12T19:14:07.829466+0000","last_peered":"2024-09-12T19:14:07.829466+0000","last_clean":"2024-09-12T19:14:07.829466+0000","last_became_active":"2024-09-12T18:26:39.834006+0000","last_became_peered":"2024-09-12T18:26:39.834006+0000","last_unstale":"2024-09-12T19:14:07.829466+0000","last_undegraded":"2024-09-12T19:14:07.829466+0000","last_fullsized":"2024-09-12T19:14:07.829466+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'408","last_scrub_stamp":"2024-09-12T19:14:07.829075+0000","last_deep_scrub":"265'408","last_deep_scrub_stamp":"2024-09-12T19:14:07.829075+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.829075+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:08:01.756044+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":720,"num_read_kb":82742,"num_write":1326,"num_write_kb":55909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"265'116","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.402064+0000","last_change":"2024-09-12T19:14:38.401927+0000","last_active":"2024-09-12T19:14:38.402064+0000","last_peered":"2024-09-12T19:14:38.402064+0000","last_clean":"2024-09-12T19:14:38.402064+0000","last_became_active":"2024-09-12T18:26:49.906589+0000","last_became_peered":"2024-09-12T18:26:49.906589+0000","last_unstale":"2024-09-12T19:14:38.402064+0000","last_undegraded":"2024-09-12T19:14:38.402064+0000","last_fullsized":"2024-09-12T19:14:38.402064+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'116","last_scrub_stamp":"2024-09-12T19:14:38.401733+0000","last_deep_scrub":"265'116","last_deep_scrub_stamp":"2024-09-12T19:14:38.401733+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.401733+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:09:42.295621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":149,"num_write":280,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"265'755","reported_seq":2173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.828743+0000","last_change":"2024-09-12T19:14:11.828743+0000","last_active":"2024-09-12T19:14:11.828743+0000","last_peered":"2024-09-12T19:14:11.828743+0000","last_clean":"2024-09-12T19:14:11.828743+0000","last_became_active":"2024-09-12T18:26:41.852831+0000","last_became_peered":"2024-09-12T18:26:41.852831+0000","last_unstale":"2024-09-12T19:14:11.828743+0000","last_undegraded":"2024-09-12T19:14:11.828743+0000","last_fullsized":"2024-09-12T19:14:11.828743+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'755","last_scrub_stamp":"2024-09-12T19:14:11.828569+0000","last_deep_scrub":"265'755","last_deep_scrub_stamp":"2024-09-12T19:14:11.828569+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.828569+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:38.861938+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3501,"num_read_kb":3138,"num_write":986,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"265'391","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.849709+0000","last_change":"2024-09-12T19:14:10.849709+0000","last_active":"2024-09-12T19:14:10.849709+0000","last_peered":"2024-09-12T19:14:10.849709+0000","last_clean":"2024-09-12T19:14:10.849709+0000","last_became_active":"2024-09-12T18:27:11.823705+0000","last_became_peered":"2024-09-12T18:27:11.823705+0000","last_unstale":"2024-09-12T19:14:10.849709+0000","last_undegraded":"2024-09-12T19:14:10.849709+0000","last_fullsized":"2024-09-12T19:14:10.849709+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T19:14:10.849514+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T19:14:10.849514+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.849514+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:57.941792+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":587,"num_read_kb":55935,"num_write":1256,"num_write_kb":41601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.290759+0000","last_change":"2024-09-12T19:14:26.290526+0000","last_active":"2024-09-12T19:14:26.290759+0000","last_peered":"2024-09-12T19:14:26.290759+0000","last_clean":"2024-09-12T19:14:26.290759+0000","last_became_active":"2024-09-12T18:26:43.857754+0000","last_became_peered":"2024-09-12T18:26:43.857754+0000","last_unstale":"2024-09-12T19:14:26.290759+0000","last_undegraded":"2024-09-12T19:14:26.290759+0000","last_fullsized":"2024-09-12T19:14:26.290759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.290273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.290273+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.290273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:50.223630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"265'321","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.680778+0000","last_change":"2024-09-12T19:14:21.680630+0000","last_active":"2024-09-12T19:14:21.680778+0000","last_peered":"2024-09-12T19:14:21.680778+0000","last_clean":"2024-09-12T19:14:21.680778+0000","last_became_active":"2024-09-12T18:26:45.876070+0000","last_became_peered":"2024-09-12T18:26:45.876070+0000","last_unstale":"2024-09-12T19:14:21.680778+0000","last_undegraded":"2024-09-12T19:14:21.680778+0000","last_fullsized":"2024-09-12T19:14:21.680778+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T19:14:21.680429+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T19:14:21.680429+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.680429+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:28:11.520559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48204,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":519,"num_read_kb":1086,"num_write":410,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.987620+0000","last_change":"2024-09-12T19:14:36.987495+0000","last_active":"2024-09-12T19:14:36.987620+0000","last_peered":"2024-09-12T19:14:36.987620+0000","last_clean":"2024-09-12T19:14:36.987620+0000","last_became_active":"2024-09-12T18:26:47.895471+0000","last_became_peered":"2024-09-12T18:26:47.895471+0000","last_unstale":"2024-09-12T19:14:36.987620+0000","last_undegraded":"2024-09-12T19:14:36.987620+0000","last_fullsized":"2024-09-12T19:14:36.987620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:36.987320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:36.987320+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.987320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:48.128304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"265'2444","reported_seq":4334,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.421802+0000","last_change":"2024-09-12T19:14:39.421658+0000","last_active":"2024-09-12T19:14:39.421802+0000","last_peered":"2024-09-12T19:14:39.421802+0000","last_clean":"2024-09-12T19:14:39.421802+0000","last_became_active":"2024-09-12T18:26:49.913125+0000","last_became_peered":"2024-09-12T18:26:49.913125+0000","last_unstale":"2024-09-12T19:14:39.421802+0000","last_undegraded":"2024-09-12T19:14:39.421802+0000","last_fullsized":"2024-09-12T19:14:39.421802+0000","mapping_epoch":34,"log_start":"265'2400","ondisk_log_start":"265'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2444","last_scrub_stamp":"2024-09-12T19:14:39.421480+0000","last_deep_scrub":"265'2444","last_deep_scrub_stamp":"2024-09-12T19:14:39.421480+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.421480+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":2400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:36:47.047328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":635,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6085,"num_read_kb":6089,"num_write":4865,"num_write_kb":1791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"265'570","reported_seq":2199,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.473314+0000","last_change":"2024-09-12T19:14:18.473163+0000","last_active":"2024-09-12T19:14:18.473314+0000","last_peered":"2024-09-12T19:14:18.473314+0000","last_clean":"2024-09-12T19:14:18.473314+0000","last_became_active":"2024-09-12T18:26:41.871531+0000","last_became_peered":"2024-09-12T18:26:41.871531+0000","last_unstale":"2024-09-12T19:14:18.473314+0000","last_undegraded":"2024-09-12T19:14:18.473314+0000","last_fullsized":"2024-09-12T19:14:18.473314+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'570","last_scrub_stamp":"2024-09-12T19:14:18.472978+0000","last_deep_scrub":"265'570","last_deep_scrub_stamp":"2024-09-12T19:14:18.472978+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.472978+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":500,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:22.258961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2964,"num_read_kb":2726,"num_write":725,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3006,"num_omap_keys":12,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"265'370","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.853877+0000","last_change":"2024-09-12T19:14:06.853877+0000","last_active":"2024-09-12T19:14:06.853877+0000","last_peered":"2024-09-12T19:14:06.853877+0000","last_clean":"2024-09-12T19:14:06.853877+0000","last_became_active":"2024-09-12T18:26:39.871605+0000","last_became_peered":"2024-09-12T18:26:39.871605+0000","last_unstale":"2024-09-12T19:14:06.853877+0000","last_undegraded":"2024-09-12T19:14:06.853877+0000","last_fullsized":"2024-09-12T19:14:06.853877+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T19:14:06.853744+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T19:14:06.853744+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.853744+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:07:17.533292+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":721310,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":33411,"num_write":1198,"num_write_kb":31423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.044317+0000","last_change":"2024-09-12T19:14:22.044317+0000","last_active":"2024-09-12T19:14:22.044317+0000","last_peered":"2024-09-12T19:14:22.044317+0000","last_clean":"2024-09-12T19:14:22.044317+0000","last_became_active":"2024-09-12T18:26:43.865817+0000","last_became_peered":"2024-09-12T18:26:43.865817+0000","last_unstale":"2024-09-12T19:14:22.044317+0000","last_undegraded":"2024-09-12T19:14:22.044317+0000","last_fullsized":"2024-09-12T19:14:22.044317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:22.044143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:22.044143+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.044143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:11.814993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"265'78","reported_seq":614,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.411822+0000","last_change":"2024-09-12T19:14:31.411663+0000","last_active":"2024-09-12T19:14:31.411822+0000","last_peered":"2024-09-12T19:14:31.411822+0000","last_clean":"2024-09-12T19:14:31.411822+0000","last_became_active":"2024-09-12T18:26:45.854087+0000","last_became_peered":"2024-09-12T18:26:45.854087+0000","last_unstale":"2024-09-12T19:14:31.411822+0000","last_undegraded":"2024-09-12T19:14:31.411822+0000","last_fullsized":"2024-09-12T19:14:31.411822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'78","last_scrub_stamp":"2024-09-12T19:14:31.411447+0000","last_deep_scrub":"265'78","last_deep_scrub_stamp":"2024-09-12T19:14:31.411447+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.411447+0000","objects_scrubbed":3,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:27:41.644882+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":89,"num_read_kb":86,"num_write":58,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.411727+0000","last_change":"2024-09-12T19:14:35.411477+0000","last_active":"2024-09-12T19:14:35.411727+0000","last_peered":"2024-09-12T19:14:35.411727+0000","last_clean":"2024-09-12T19:14:35.411727+0000","last_became_active":"2024-09-12T18:26:47.880374+0000","last_became_peered":"2024-09-12T18:26:47.880374+0000","last_unstale":"2024-09-12T19:14:35.411727+0000","last_undegraded":"2024-09-12T19:14:35.411727+0000","last_fullsized":"2024-09-12T19:14:35.411727+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:35.411256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:35.411256+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.411256+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:16.321639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"265'124","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.600230+0000","last_change":"2024-09-12T19:14:40.600230+0000","last_active":"2024-09-12T19:14:40.600230+0000","last_peered":"2024-09-12T19:14:40.600230+0000","last_clean":"2024-09-12T19:14:40.600230+0000","last_became_active":"2024-09-12T18:26:49.926650+0000","last_became_peered":"2024-09-12T18:26:49.926650+0000","last_unstale":"2024-09-12T19:14:40.600230+0000","last_undegraded":"2024-09-12T19:14:40.600230+0000","last_fullsized":"2024-09-12T19:14:40.600230+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-12T19:14:40.600061+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-12T19:14:40.600061+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.600061+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:02.379306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":121,"num_read_kb":119,"num_write":266,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"265'509","reported_seq":2188,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.773342+0000","last_change":"2024-09-12T19:14:11.773187+0000","last_active":"2024-09-12T19:14:11.773342+0000","last_peered":"2024-09-12T19:14:11.773342+0000","last_clean":"2024-09-12T19:14:11.773342+0000","last_became_active":"2024-09-12T18:26:41.851928+0000","last_became_peered":"2024-09-12T18:26:41.851928+0000","last_unstale":"2024-09-12T19:14:11.773342+0000","last_undegraded":"2024-09-12T19:14:11.773342+0000","last_fullsized":"2024-09-12T19:14:11.773342+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'509","last_scrub_stamp":"2024-09-12T19:14:11.773008+0000","last_deep_scrub":"265'509","last_deep_scrub_stamp":"2024-09-12T19:14:11.773008+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.773008+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:15.496861+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2649,"num_read_kb":2492,"num_write":594,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"265'375","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.825389+0000","last_change":"2024-09-12T19:14:15.825389+0000","last_active":"2024-09-12T19:14:15.825389+0000","last_peered":"2024-09-12T19:14:15.825389+0000","last_clean":"2024-09-12T19:14:15.825389+0000","last_became_active":"2024-09-12T18:26:39.863389+0000","last_became_peered":"2024-09-12T18:26:39.863389+0000","last_unstale":"2024-09-12T19:14:15.825389+0000","last_undegraded":"2024-09-12T19:14:15.825389+0000","last_fullsized":"2024-09-12T19:14:15.825389+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T19:14:15.825196+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T19:14:15.825196+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.825196+0000","objects_scrubbed":2,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:24:32.797512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":529,"num_read_kb":22645,"num_write":1125,"num_write_kb":31309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.120956+0000","last_change":"2024-09-12T19:14:25.120777+0000","last_active":"2024-09-12T19:14:25.120956+0000","last_peered":"2024-09-12T19:14:25.120956+0000","last_clean":"2024-09-12T19:14:25.120956+0000","last_became_active":"2024-09-12T18:26:43.853736+0000","last_became_peered":"2024-09-12T18:26:43.853736+0000","last_unstale":"2024-09-12T19:14:25.120956+0000","last_undegraded":"2024-09-12T19:14:25.120956+0000","last_fullsized":"2024-09-12T19:14:25.120956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:25.120602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:25.120602+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.120602+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:22:00.437407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"265'118","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.965708+0000","last_change":"2024-09-12T19:14:21.965708+0000","last_active":"2024-09-12T19:14:21.965708+0000","last_peered":"2024-09-12T19:14:21.965708+0000","last_clean":"2024-09-12T19:14:21.965708+0000","last_became_active":"2024-09-12T18:26:45.853143+0000","last_became_peered":"2024-09-12T18:26:45.853143+0000","last_unstale":"2024-09-12T19:14:21.965708+0000","last_undegraded":"2024-09-12T19:14:21.965708+0000","last_fullsized":"2024-09-12T19:14:21.965708+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T19:14:21.965574+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T19:14:21.965574+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.965574+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:41:04.870883+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":129,"num_read_kb":120,"num_write":90,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"265'765","reported_seq":4120,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.961937+0000","last_change":"2024-09-12T19:14:35.961804+0000","last_active":"2024-09-12T19:14:35.961937+0000","last_peered":"2024-09-12T19:14:35.961937+0000","last_clean":"2024-09-12T19:14:35.961937+0000","last_became_active":"2024-09-12T18:26:47.895056+0000","last_became_peered":"2024-09-12T18:26:47.895056+0000","last_unstale":"2024-09-12T19:14:35.961937+0000","last_undegraded":"2024-09-12T19:14:35.961937+0000","last_fullsized":"2024-09-12T19:14:35.961937+0000","mapping_epoch":32,"log_start":"265'702","ondisk_log_start":"265'702","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'765","last_scrub_stamp":"2024-09-12T19:14:35.961585+0000","last_deep_scrub":"265'765","last_deep_scrub_stamp":"2024-09-12T19:14:35.961585+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.961585+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":702,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:37.718968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"265'176","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.370688+0000","last_change":"2024-09-12T19:14:39.370688+0000","last_active":"2024-09-12T19:14:39.370688+0000","last_peered":"2024-09-12T19:14:39.370688+0000","last_clean":"2024-09-12T19:14:39.370688+0000","last_became_active":"2024-09-12T18:26:49.890325+0000","last_became_peered":"2024-09-12T18:26:49.890325+0000","last_unstale":"2024-09-12T19:14:39.370688+0000","last_undegraded":"2024-09-12T19:14:39.370688+0000","last_fullsized":"2024-09-12T19:14:39.370688+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'176","last_scrub_stamp":"2024-09-12T19:14:39.370494+0000","last_deep_scrub":"265'176","last_deep_scrub_stamp":"2024-09-12T19:14:39.370494+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.370494+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:05.708623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":667,"num_read_kb":638,"num_write":360,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"265'756","reported_seq":2317,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.795602+0000","last_change":"2024-09-12T19:14:10.795472+0000","last_active":"2024-09-12T19:14:10.795602+0000","last_peered":"2024-09-12T19:14:10.795602+0000","last_clean":"2024-09-12T19:14:10.795602+0000","last_became_active":"2024-09-12T18:26:41.862240+0000","last_became_peered":"2024-09-12T18:26:41.862240+0000","last_unstale":"2024-09-12T19:14:10.795602+0000","last_undegraded":"2024-09-12T19:14:10.795602+0000","last_fullsized":"2024-09-12T19:14:10.795602+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'756","last_scrub_stamp":"2024-09-12T19:14:10.795293+0000","last_deep_scrub":"265'756","last_deep_scrub_stamp":"2024-09-12T19:14:10.795293+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.795293+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:49.343521+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3627,"num_read_kb":3298,"num_write":982,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"265'333","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.459163+0000","last_change":"2024-09-12T19:14:05.459163+0000","last_active":"2024-09-12T19:14:05.459163+0000","last_peered":"2024-09-12T19:14:05.459163+0000","last_clean":"2024-09-12T19:14:05.459163+0000","last_became_active":"2024-09-12T18:26:39.843351+0000","last_became_peered":"2024-09-12T18:26:39.843351+0000","last_unstale":"2024-09-12T19:14:05.459163+0000","last_undegraded":"2024-09-12T19:14:05.459163+0000","last_fullsized":"2024-09-12T19:14:05.459163+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T19:14:05.458982+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T19:14:05.458982+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.458982+0000","objects_scrubbed":4,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:06.506600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170084,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":479,"num_read_kb":20705,"num_write":1033,"num_write_kb":27627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.337255+0000","last_change":"2024-09-12T19:14:27.337030+0000","last_active":"2024-09-12T19:14:27.337255+0000","last_peered":"2024-09-12T19:14:27.337255+0000","last_clean":"2024-09-12T19:14:27.337255+0000","last_became_active":"2024-09-12T18:26:43.842479+0000","last_became_peered":"2024-09-12T18:26:43.842479+0000","last_unstale":"2024-09-12T19:14:27.337255+0000","last_undegraded":"2024-09-12T19:14:27.337255+0000","last_fullsized":"2024-09-12T19:14:27.337255+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:27.336832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:27.336832+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.336832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:05.189762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"265'290","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.925231+0000","last_change":"2024-09-12T19:14:31.925082+0000","last_active":"2024-09-12T19:14:31.925231+0000","last_peered":"2024-09-12T19:14:31.925231+0000","last_clean":"2024-09-12T19:14:31.925231+0000","last_became_active":"2024-09-12T18:26:46.024425+0000","last_became_peered":"2024-09-12T18:26:46.024425+0000","last_unstale":"2024-09-12T19:14:31.925231+0000","last_undegraded":"2024-09-12T19:14:31.925231+0000","last_fullsized":"2024-09-12T19:14:31.925231+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'290","last_scrub_stamp":"2024-09-12T19:14:31.924894+0000","last_deep_scrub":"265'290","last_deep_scrub_stamp":"2024-09-12T19:14:31.924894+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.924894+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:37.319952+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53269,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":475,"num_read_kb":1121,"num_write":396,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"265'805","reported_seq":2376,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.127838+0000","last_change":"2024-09-12T19:14:35.127838+0000","last_active":"2024-09-12T19:14:35.127838+0000","last_peered":"2024-09-12T19:14:35.127838+0000","last_clean":"2024-09-12T19:14:35.127838+0000","last_became_active":"2024-09-12T18:26:47.898903+0000","last_became_peered":"2024-09-12T18:26:47.898903+0000","last_unstale":"2024-09-12T19:14:35.127838+0000","last_undegraded":"2024-09-12T19:14:35.127838+0000","last_fullsized":"2024-09-12T19:14:35.127838+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'805","last_scrub_stamp":"2024-09-12T19:14:35.127664+0000","last_deep_scrub":"265'805","last_deep_scrub_stamp":"2024-09-12T19:14:35.127664+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.127664+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":700,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:40.173903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"265'763","reported_seq":2259,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.517406+0000","last_change":"2024-09-12T19:14:17.517243+0000","last_active":"2024-09-12T19:14:17.517406+0000","last_peered":"2024-09-12T19:14:17.517406+0000","last_clean":"2024-09-12T19:14:17.517406+0000","last_became_active":"2024-09-12T18:26:41.869852+0000","last_became_peered":"2024-09-12T18:26:41.869852+0000","last_unstale":"2024-09-12T19:14:17.517406+0000","last_undegraded":"2024-09-12T19:14:17.517406+0000","last_fullsized":"2024-09-12T19:14:17.517406+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'763","last_scrub_stamp":"2024-09-12T19:14:17.517055+0000","last_deep_scrub":"265'763","last_deep_scrub_stamp":"2024-09-12T19:14:17.517055+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.517055+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:25:12.395779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3529,"num_read_kb":3192,"num_write":1004,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"265'488","reported_seq":1218,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.860766+0000","last_change":"2024-09-12T19:14:07.860628+0000","last_active":"2024-09-12T19:14:07.860766+0000","last_peered":"2024-09-12T19:14:07.860766+0000","last_clean":"2024-09-12T19:14:07.860766+0000","last_became_active":"2024-09-12T18:26:39.873512+0000","last_became_peered":"2024-09-12T18:26:39.873512+0000","last_unstale":"2024-09-12T19:14:07.860766+0000","last_undegraded":"2024-09-12T19:14:07.860766+0000","last_fullsized":"2024-09-12T19:14:07.860766+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'488","last_scrub_stamp":"2024-09-12T19:14:07.860425+0000","last_deep_scrub":"265'488","last_deep_scrub_stamp":"2024-09-12T19:14:07.860425+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.860425+0000","objects_scrubbed":9,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:17.144835+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4719716,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":925,"num_read_kb":13008,"num_write":1544,"num_write_kb":39306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.943955+0000","last_change":"2024-09-12T19:14:25.943735+0000","last_active":"2024-09-12T19:14:25.943955+0000","last_peered":"2024-09-12T19:14:25.943955+0000","last_clean":"2024-09-12T19:14:25.943955+0000","last_became_active":"2024-09-12T18:26:43.871192+0000","last_became_peered":"2024-09-12T18:26:43.871192+0000","last_unstale":"2024-09-12T19:14:25.943955+0000","last_undegraded":"2024-09-12T19:14:25.943955+0000","last_fullsized":"2024-09-12T19:14:25.943955+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:25.943520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:25.943520+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.943520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:31:09.489365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"265'374","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.423698+0000","last_change":"2024-09-12T19:14:31.423562+0000","last_active":"2024-09-12T19:14:31.423698+0000","last_peered":"2024-09-12T19:14:31.423698+0000","last_clean":"2024-09-12T19:14:31.423698+0000","last_became_active":"2024-09-12T18:26:46.021239+0000","last_became_peered":"2024-09-12T18:26:46.021239+0000","last_unstale":"2024-09-12T19:14:31.423698+0000","last_undegraded":"2024-09-12T19:14:31.423698+0000","last_fullsized":"2024-09-12T19:14:31.423698+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'374","last_scrub_stamp":"2024-09-12T19:14:31.423337+0000","last_deep_scrub":"265'374","last_deep_scrub_stamp":"2024-09-12T19:14:31.423337+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.423337+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:14:09.733674+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43291,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":581,"num_read_kb":1196,"num_write":460,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.087460+0000","last_change":"2024-09-12T19:14:23.087460+0000","last_active":"2024-09-12T19:14:23.087460+0000","last_peered":"2024-09-12T19:14:23.087460+0000","last_clean":"2024-09-12T19:14:23.087460+0000","last_became_active":"2024-09-12T18:26:47.879079+0000","last_became_peered":"2024-09-12T18:26:47.879079+0000","last_unstale":"2024-09-12T19:14:23.087460+0000","last_undegraded":"2024-09-12T19:14:23.087460+0000","last_fullsized":"2024-09-12T19:14:23.087460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:23.087260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:23.087260+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.087260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:50:13.127777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"265'554","reported_seq":1371,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.469150+0000","last_change":"2024-09-12T19:14:35.468996+0000","last_active":"2024-09-12T19:14:35.469150+0000","last_peered":"2024-09-12T19:14:35.469150+0000","last_clean":"2024-09-12T19:14:35.469150+0000","last_became_active":"2024-09-12T18:26:49.913115+0000","last_became_peered":"2024-09-12T18:26:49.913115+0000","last_unstale":"2024-09-12T19:14:35.469150+0000","last_undegraded":"2024-09-12T19:14:35.469150+0000","last_fullsized":"2024-09-12T19:14:35.469150+0000","mapping_epoch":34,"log_start":"265'500","ondisk_log_start":"265'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'554","last_scrub_stamp":"2024-09-12T19:14:35.468768+0000","last_deep_scrub":"265'554","last_deep_scrub_stamp":"2024-09-12T19:14:35.468768+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.468768+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:18.817640+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1291,"num_read_kb":1285,"num_write":1159,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"265'406","reported_seq":1997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.255176+0000","last_change":"2024-09-12T19:14:11.255011+0000","last_active":"2024-09-12T19:14:11.255176+0000","last_peered":"2024-09-12T19:14:11.255176+0000","last_clean":"2024-09-12T19:14:11.255176+0000","last_became_active":"2024-09-12T18:26:41.854391+0000","last_became_peered":"2024-09-12T18:26:41.854391+0000","last_unstale":"2024-09-12T19:14:11.255176+0000","last_undegraded":"2024-09-12T19:14:11.255176+0000","last_fullsized":"2024-09-12T19:14:11.255176+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'406","last_scrub_stamp":"2024-09-12T19:14:11.254823+0000","last_deep_scrub":"265'406","last_deep_scrub_stamp":"2024-09-12T19:14:11.254823+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.254823+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:37:18.934488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2438,"num_read_kb":2340,"num_write":450,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"265'324","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.838638+0000","last_change":"2024-09-12T19:14:14.838638+0000","last_active":"2024-09-12T19:14:14.838638+0000","last_peered":"2024-09-12T19:14:14.838638+0000","last_clean":"2024-09-12T19:14:14.838638+0000","last_became_active":"2024-09-12T18:26:39.870641+0000","last_became_peered":"2024-09-12T18:26:39.870641+0000","last_unstale":"2024-09-12T19:14:14.838638+0000","last_undegraded":"2024-09-12T19:14:14.838638+0000","last_fullsized":"2024-09-12T19:14:14.838638+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T19:14:14.838413+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T19:14:14.838413+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.838413+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:05.370907+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":414,"num_read_kb":1418,"num_write":1020,"num_write_kb":24682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.038768+0000","last_change":"2024-09-12T19:14:16.038622+0000","last_active":"2024-09-12T19:14:16.038768+0000","last_peered":"2024-09-12T19:14:16.038768+0000","last_clean":"2024-09-12T19:14:16.038768+0000","last_became_active":"2024-09-12T18:26:43.853212+0000","last_became_peered":"2024-09-12T18:26:43.853212+0000","last_unstale":"2024-09-12T19:14:16.038768+0000","last_undegraded":"2024-09-12T19:14:16.038768+0000","last_fullsized":"2024-09-12T19:14:16.038768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:16.038447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:16.038447+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.038447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:54:19.209452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"265'268","reported_seq":844,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.140596+0000","last_change":"2024-09-12T19:14:29.140596+0000","last_active":"2024-09-12T19:14:29.140596+0000","last_peered":"2024-09-12T19:14:29.140596+0000","last_clean":"2024-09-12T19:14:29.140596+0000","last_became_active":"2024-09-12T18:26:45.865933+0000","last_became_peered":"2024-09-12T18:26:45.865933+0000","last_unstale":"2024-09-12T19:14:29.140596+0000","last_undegraded":"2024-09-12T19:14:29.140596+0000","last_fullsized":"2024-09-12T19:14:29.140596+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'268","last_scrub_stamp":"2024-09-12T19:14:29.140514+0000","last_deep_scrub":"265'268","last_deep_scrub_stamp":"2024-09-12T19:14:29.140514+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.140514+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:00:19.695815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":1093,"num_write":368,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.127307+0000","last_change":"2024-09-12T19:14:37.127144+0000","last_active":"2024-09-12T19:14:37.127307+0000","last_peered":"2024-09-12T19:14:37.127307+0000","last_clean":"2024-09-12T19:14:37.127307+0000","last_became_active":"2024-09-12T18:26:47.898056+0000","last_became_peered":"2024-09-12T18:26:47.898056+0000","last_unstale":"2024-09-12T19:14:37.127307+0000","last_undegraded":"2024-09-12T19:14:37.127307+0000","last_fullsized":"2024-09-12T19:14:37.127307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:37.126949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:37.126949+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.126949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:46:10.568305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"265'129","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.628744+0000","last_change":"2024-09-12T19:14:27.628586+0000","last_active":"2024-09-12T19:14:27.628744+0000","last_peered":"2024-09-12T19:14:27.628744+0000","last_clean":"2024-09-12T19:14:27.628744+0000","last_became_active":"2024-09-12T18:26:49.913180+0000","last_became_peered":"2024-09-12T18:26:49.913180+0000","last_unstale":"2024-09-12T19:14:27.628744+0000","last_undegraded":"2024-09-12T19:14:27.628744+0000","last_fullsized":"2024-09-12T19:14:27.628744+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T19:14:27.628402+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T19:14:27.628402+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.628402+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:51.688502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":126,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"265'516","reported_seq":2069,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.594030+0000","last_change":"2024-09-12T19:14:17.593883+0000","last_active":"2024-09-12T19:14:17.594030+0000","last_peered":"2024-09-12T19:14:17.594030+0000","last_clean":"2024-09-12T19:14:17.594030+0000","last_became_active":"2024-09-12T18:26:41.873229+0000","last_became_peered":"2024-09-12T18:26:41.873229+0000","last_unstale":"2024-09-12T19:14:17.594030+0000","last_undegraded":"2024-09-12T19:14:17.594030+0000","last_fullsized":"2024-09-12T19:14:17.594030+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'516","last_scrub_stamp":"2024-09-12T19:14:17.593701+0000","last_deep_scrub":"265'516","last_deep_scrub_stamp":"2024-09-12T19:14:17.593701+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.593701+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:37.476864+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2942,"num_read_kb":2741,"num_write":656,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"265'373","reported_seq":1160,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.839637+0000","last_change":"2024-09-12T19:14:06.839637+0000","last_active":"2024-09-12T19:14:06.839637+0000","last_peered":"2024-09-12T19:14:06.839637+0000","last_clean":"2024-09-12T19:14:06.839637+0000","last_became_active":"2024-09-12T18:26:39.865148+0000","last_became_peered":"2024-09-12T18:26:39.865148+0000","last_unstale":"2024-09-12T19:14:06.839637+0000","last_undegraded":"2024-09-12T19:14:06.839637+0000","last_fullsized":"2024-09-12T19:14:06.839637+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T19:14:06.839379+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T19:14:06.839379+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.839379+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:03:03.080191+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174540,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":883,"num_read_kb":25450,"num_write":1078,"num_write_kb":40926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.978124+0000","last_change":"2024-09-12T19:14:17.978124+0000","last_active":"2024-09-12T19:14:17.978124+0000","last_peered":"2024-09-12T19:14:17.978124+0000","last_clean":"2024-09-12T19:14:17.978124+0000","last_became_active":"2024-09-12T18:26:43.853084+0000","last_became_peered":"2024-09-12T18:26:43.853084+0000","last_unstale":"2024-09-12T19:14:17.978124+0000","last_undegraded":"2024-09-12T19:14:17.978124+0000","last_fullsized":"2024-09-12T19:14:17.978124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:17.977941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:17.977941+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.977941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:53.773804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"265'315","reported_seq":904,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.992045+0000","last_change":"2024-09-12T19:14:29.992045+0000","last_active":"2024-09-12T19:14:29.992045+0000","last_peered":"2024-09-12T19:14:29.992045+0000","last_clean":"2024-09-12T19:14:29.992045+0000","last_became_active":"2024-09-12T18:26:45.866325+0000","last_became_peered":"2024-09-12T18:26:45.866325+0000","last_unstale":"2024-09-12T19:14:29.992045+0000","last_undegraded":"2024-09-12T19:14:29.992045+0000","last_fullsized":"2024-09-12T19:14:29.992045+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T19:14:29.991846+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T19:14:29.991846+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.991846+0000","objects_scrubbed":8,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T07:06:32.915033+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64639,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":520,"num_read_kb":1214,"num_write":426,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"265'793","reported_seq":2660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.570416+0000","last_change":"2024-09-12T19:14:29.570416+0000","last_active":"2024-09-12T19:14:29.570416+0000","last_peered":"2024-09-12T19:14:29.570416+0000","last_clean":"2024-09-12T19:14:29.570416+0000","last_became_active":"2024-09-12T18:26:47.878956+0000","last_became_peered":"2024-09-12T18:26:47.878956+0000","last_unstale":"2024-09-12T19:14:29.570416+0000","last_undegraded":"2024-09-12T19:14:29.570416+0000","last_fullsized":"2024-09-12T19:14:29.570416+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'793","last_scrub_stamp":"2024-09-12T19:14:29.570202+0000","last_deep_scrub":"265'793","last_deep_scrub_stamp":"2024-09-12T19:14:29.570202+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.570202+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:34:44.401820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"265'149","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.666439+0000","last_change":"2024-09-12T19:14:33.666295+0000","last_active":"2024-09-12T19:14:33.666439+0000","last_peered":"2024-09-12T19:14:33.666439+0000","last_clean":"2024-09-12T19:14:33.666439+0000","last_became_active":"2024-09-12T18:26:49.926384+0000","last_became_peered":"2024-09-12T18:26:49.926384+0000","last_unstale":"2024-09-12T19:14:33.666439+0000","last_undegraded":"2024-09-12T19:14:33.666439+0000","last_fullsized":"2024-09-12T19:14:33.666439+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'149","last_scrub_stamp":"2024-09-12T19:14:33.666118+0000","last_deep_scrub":"265'149","last_deep_scrub_stamp":"2024-09-12T19:14:33.666118+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.666118+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:55.329801+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":610,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":155,"num_read_kb":144,"num_write":361,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"265'695","reported_seq":2124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.634374+0000","last_change":"2024-09-12T19:14:24.634374+0000","last_active":"2024-09-12T19:14:24.634374+0000","last_peered":"2024-09-12T19:14:24.634374+0000","last_clean":"2024-09-12T19:14:24.634374+0000","last_became_active":"2024-09-12T18:26:41.846589+0000","last_became_peered":"2024-09-12T18:26:41.846589+0000","last_unstale":"2024-09-12T19:14:24.634374+0000","last_undegraded":"2024-09-12T19:14:24.634374+0000","last_fullsized":"2024-09-12T19:14:24.634374+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'695","last_scrub_stamp":"2024-09-12T19:14:24.634180+0000","last_deep_scrub":"265'695","last_deep_scrub_stamp":"2024-09-12T19:14:24.634180+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.634180+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":600,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:28.875628+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3315,"num_read_kb":3003,"num_write":914,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"265'320","reported_seq":1021,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.671103+0000","last_change":"2024-09-12T19:14:13.671103+0000","last_active":"2024-09-12T19:14:13.671103+0000","last_peered":"2024-09-12T19:14:13.671103+0000","last_clean":"2024-09-12T19:14:13.671103+0000","last_became_active":"2024-09-12T18:26:39.849950+0000","last_became_peered":"2024-09-12T18:26:39.849950+0000","last_unstale":"2024-09-12T19:14:13.671103+0000","last_undegraded":"2024-09-12T19:14:13.671103+0000","last_fullsized":"2024-09-12T19:14:13.671103+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'320","last_scrub_stamp":"2024-09-12T19:14:13.670923+0000","last_deep_scrub":"265'320","last_deep_scrub_stamp":"2024-09-12T19:14:13.670923+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.670923+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:25:21.214840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67871,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":624,"num_read_kb":33808,"num_write":1047,"num_write_kb":22667,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.020856+0000","last_change":"2024-09-12T19:14:17.020705+0000","last_active":"2024-09-12T19:14:17.020856+0000","last_peered":"2024-09-12T19:14:17.020856+0000","last_clean":"2024-09-12T19:14:17.020856+0000","last_became_active":"2024-09-12T18:26:43.874837+0000","last_became_peered":"2024-09-12T18:26:43.874837+0000","last_unstale":"2024-09-12T19:14:17.020856+0000","last_undegraded":"2024-09-12T19:14:17.020856+0000","last_fullsized":"2024-09-12T19:14:17.020856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:17.020520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:17.020520+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.020520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:29:48.881506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"265'463","reported_seq":1104,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.750171+0000","last_change":"2024-09-12T19:14:18.750004+0000","last_active":"2024-09-12T19:14:18.750171+0000","last_peered":"2024-09-12T19:14:18.750171+0000","last_clean":"2024-09-12T19:14:18.750171+0000","last_became_active":"2024-09-12T18:26:45.875223+0000","last_became_peered":"2024-09-12T18:26:45.875223+0000","last_unstale":"2024-09-12T19:14:18.750171+0000","last_undegraded":"2024-09-12T19:14:18.750171+0000","last_fullsized":"2024-09-12T19:14:18.750171+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'463","last_scrub_stamp":"2024-09-12T19:14:18.749757+0000","last_deep_scrub":"265'463","last_deep_scrub_stamp":"2024-09-12T19:14:18.749757+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.749757+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:08:18.294446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89882,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":808,"num_read_kb":1944,"num_write":662,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.919177+0000","last_change":"2024-09-12T19:14:22.919044+0000","last_active":"2024-09-12T19:14:22.919177+0000","last_peered":"2024-09-12T19:14:22.919177+0000","last_clean":"2024-09-12T19:14:22.919177+0000","last_became_active":"2024-09-12T18:26:47.891736+0000","last_became_peered":"2024-09-12T18:26:47.891736+0000","last_unstale":"2024-09-12T19:14:22.919177+0000","last_undegraded":"2024-09-12T19:14:22.919177+0000","last_fullsized":"2024-09-12T19:14:22.919177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:22.918866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:22.918866+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.918866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:26.902442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"265'132","reported_seq":664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.138544+0000","last_change":"2024-09-12T19:14:31.138382+0000","last_active":"2024-09-12T19:14:31.138544+0000","last_peered":"2024-09-12T19:14:31.138544+0000","last_clean":"2024-09-12T19:14:31.138544+0000","last_became_active":"2024-09-12T18:26:49.904633+0000","last_became_peered":"2024-09-12T18:26:49.904633+0000","last_unstale":"2024-09-12T19:14:31.138544+0000","last_undegraded":"2024-09-12T19:14:31.138544+0000","last_fullsized":"2024-09-12T19:14:31.138544+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-12T19:14:31.138190+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-12T19:14:31.138190+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.138190+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:20:17.704300+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":192,"num_read_kb":176,"num_write":324,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"265'686","reported_seq":2227,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.254200+0000","last_change":"2024-09-12T19:14:10.254200+0000","last_active":"2024-09-12T19:14:10.254200+0000","last_peered":"2024-09-12T19:14:10.254200+0000","last_clean":"2024-09-12T19:14:10.254200+0000","last_became_active":"2024-09-12T18:26:41.852958+0000","last_became_peered":"2024-09-12T18:26:41.852958+0000","last_unstale":"2024-09-12T19:14:10.254200+0000","last_undegraded":"2024-09-12T19:14:10.254200+0000","last_fullsized":"2024-09-12T19:14:10.254200+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'686","last_scrub_stamp":"2024-09-12T19:14:10.253985+0000","last_deep_scrub":"265'686","last_deep_scrub_stamp":"2024-09-12T19:14:10.253985+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.253985+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":600,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:57.088986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3322,"num_read_kb":3047,"num_write":870,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"265'348","reported_seq":1026,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.823078+0000","last_change":"2024-09-12T19:14:07.823078+0000","last_active":"2024-09-12T19:14:07.823078+0000","last_peered":"2024-09-12T19:14:07.823078+0000","last_clean":"2024-09-12T19:14:07.823078+0000","last_became_active":"2024-09-12T18:26:39.842671+0000","last_became_peered":"2024-09-12T18:26:39.842671+0000","last_unstale":"2024-09-12T19:14:07.823078+0000","last_undegraded":"2024-09-12T19:14:07.823078+0000","last_fullsized":"2024-09-12T19:14:07.823078+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T19:14:07.822813+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T19:14:07.822813+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.822813+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:55.357796+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1239003,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":538,"num_read_kb":38368,"num_write":1135,"num_write_kb":24127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.990290+0000","last_change":"2024-09-12T19:14:18.990290+0000","last_active":"2024-09-12T19:14:18.990290+0000","last_peered":"2024-09-12T19:14:18.990290+0000","last_clean":"2024-09-12T19:14:18.990290+0000","last_became_active":"2024-09-12T18:26:43.863615+0000","last_became_peered":"2024-09-12T18:26:43.863615+0000","last_unstale":"2024-09-12T19:14:18.990290+0000","last_undegraded":"2024-09-12T19:14:18.990290+0000","last_fullsized":"2024-09-12T19:14:18.990290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:18.990106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:18.990106+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.990106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:09.209296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"265'300","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.394027+0000","last_change":"2024-09-12T19:14:30.394027+0000","last_active":"2024-09-12T19:14:30.394027+0000","last_peered":"2024-09-12T19:14:30.394027+0000","last_clean":"2024-09-12T19:14:30.394027+0000","last_became_active":"2024-09-12T18:26:45.864308+0000","last_became_peered":"2024-09-12T18:26:45.864308+0000","last_unstale":"2024-09-12T19:14:30.394027+0000","last_undegraded":"2024-09-12T19:14:30.394027+0000","last_fullsized":"2024-09-12T19:14:30.394027+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'300","last_scrub_stamp":"2024-09-12T19:14:30.393706+0000","last_deep_scrub":"265'300","last_deep_scrub_stamp":"2024-09-12T19:14:30.393706+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.393706+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:34:59.921731+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47552,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1125,"num_write":460,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.610186+0000","last_change":"2024-09-12T19:14:30.610186+0000","last_active":"2024-09-12T19:14:30.610186+0000","last_peered":"2024-09-12T19:14:30.610186+0000","last_clean":"2024-09-12T19:14:30.610186+0000","last_became_active":"2024-09-12T18:26:47.903984+0000","last_became_peered":"2024-09-12T18:26:47.903984+0000","last_unstale":"2024-09-12T19:14:30.610186+0000","last_undegraded":"2024-09-12T19:14:30.610186+0000","last_fullsized":"2024-09-12T19:14:30.610186+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:30.610001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:30.610001+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.610001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:31:49.149778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"265'133","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:15:04.184533+0000","last_change":"2024-09-12T19:15:04.184533+0000","last_active":"2024-09-12T19:15:04.184533+0000","last_peered":"2024-09-12T19:15:04.184533+0000","last_clean":"2024-09-12T19:15:04.184533+0000","last_became_active":"2024-09-12T18:26:49.916255+0000","last_became_peered":"2024-09-12T18:26:49.916255+0000","last_unstale":"2024-09-12T19:15:04.184533+0000","last_undegraded":"2024-09-12T19:15:04.184533+0000","last_fullsized":"2024-09-12T19:15:04.184533+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-12T19:15:04.184362+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-12T19:15:04.184362+0000","last_clean_scrub_stamp":"2024-09-12T19:15:04.184362+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:38.780938+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":172,"num_read_kb":153,"num_write":311,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"265'482","reported_seq":2167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.282073+0000","last_change":"2024-09-12T19:14:14.282073+0000","last_active":"2024-09-12T19:14:14.282073+0000","last_peered":"2024-09-12T19:14:14.282073+0000","last_clean":"2024-09-12T19:14:14.282073+0000","last_became_active":"2024-09-12T18:26:41.851789+0000","last_became_peered":"2024-09-12T18:26:41.851789+0000","last_unstale":"2024-09-12T19:14:14.282073+0000","last_undegraded":"2024-09-12T19:14:14.282073+0000","last_fullsized":"2024-09-12T19:14:14.282073+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'482","last_scrub_stamp":"2024-09-12T19:14:14.281887+0000","last_deep_scrub":"265'482","last_deep_scrub_stamp":"2024-09-12T19:14:14.281887+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.281887+0000","objects_scrubbed":3,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:43:45.318532+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2754,"num_read_kb":2601,"num_write":570,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"265'400","reported_seq":1059,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.541035+0000","last_change":"2024-09-12T19:14:08.540889+0000","last_active":"2024-09-12T19:14:08.541035+0000","last_peered":"2024-09-12T19:14:08.541035+0000","last_clean":"2024-09-12T19:14:08.541035+0000","last_became_active":"2024-09-12T18:26:39.849392+0000","last_became_peered":"2024-09-12T18:26:39.849392+0000","last_unstale":"2024-09-12T19:14:08.541035+0000","last_undegraded":"2024-09-12T19:14:08.541035+0000","last_fullsized":"2024-09-12T19:14:08.541035+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'400","last_scrub_stamp":"2024-09-12T19:14:08.540659+0000","last_deep_scrub":"265'400","last_deep_scrub_stamp":"2024-09-12T19:14:08.540659+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.540659+0000","objects_scrubbed":8,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:17.495615+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568421,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":663,"num_read_kb":7425,"num_write":1171,"num_write_kb":13361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.128970+0000","last_change":"2024-09-12T19:14:24.128970+0000","last_active":"2024-09-12T19:14:24.128970+0000","last_peered":"2024-09-12T19:14:24.128970+0000","last_clean":"2024-09-12T19:14:24.128970+0000","last_became_active":"2024-09-12T18:26:43.877257+0000","last_became_peered":"2024-09-12T18:26:43.877257+0000","last_unstale":"2024-09-12T19:14:24.128970+0000","last_undegraded":"2024-09-12T19:14:24.128970+0000","last_fullsized":"2024-09-12T19:14:24.128970+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:24.128757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:24.128757+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.128757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:40.291222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"265'294","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.969182+0000","last_change":"2024-09-12T19:14:19.969182+0000","last_active":"2024-09-12T19:14:19.969182+0000","last_peered":"2024-09-12T19:14:19.969182+0000","last_clean":"2024-09-12T19:14:19.969182+0000","last_became_active":"2024-09-12T18:26:45.861947+0000","last_became_peered":"2024-09-12T18:26:45.861947+0000","last_unstale":"2024-09-12T19:14:19.969182+0000","last_undegraded":"2024-09-12T19:14:19.969182+0000","last_fullsized":"2024-09-12T19:14:19.969182+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'294","last_scrub_stamp":"2024-09-12T19:14:19.968867+0000","last_deep_scrub":"265'294","last_deep_scrub_stamp":"2024-09-12T19:14:19.968867+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.968867+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:34:54.486748+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50433,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":477,"num_read_kb":1052,"num_write":380,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"265'756","reported_seq":2389,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.932810+0000","last_change":"2024-09-12T19:14:20.932810+0000","last_active":"2024-09-12T19:14:20.932810+0000","last_peered":"2024-09-12T19:14:20.932810+0000","last_clean":"2024-09-12T19:14:20.932810+0000","last_became_active":"2024-09-12T18:26:47.880400+0000","last_became_peered":"2024-09-12T18:26:47.880400+0000","last_unstale":"2024-09-12T19:14:20.932810+0000","last_undegraded":"2024-09-12T19:14:20.932810+0000","last_fullsized":"2024-09-12T19:14:20.932810+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'756","last_scrub_stamp":"2024-09-12T19:14:20.932627+0000","last_deep_scrub":"265'756","last_deep_scrub_stamp":"2024-09-12T19:14:20.932627+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.932627+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:38:26.073326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"265'142","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.141956+0000","last_change":"2024-09-12T19:14:25.141820+0000","last_active":"2024-09-12T19:14:25.141956+0000","last_peered":"2024-09-12T19:14:25.141956+0000","last_clean":"2024-09-12T19:14:25.141956+0000","last_became_active":"2024-09-12T18:26:49.913762+0000","last_became_peered":"2024-09-12T18:26:49.913762+0000","last_unstale":"2024-09-12T19:14:25.141956+0000","last_undegraded":"2024-09-12T19:14:25.141956+0000","last_fullsized":"2024-09-12T19:14:25.141956+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T19:14:25.141622+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T19:14:25.141622+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.141622+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:06:49.383630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":330,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"265'795","reported_seq":2371,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.242878+0000","last_change":"2024-09-12T19:14:12.242878+0000","last_active":"2024-09-12T19:14:12.242878+0000","last_peered":"2024-09-12T19:14:12.242878+0000","last_clean":"2024-09-12T19:14:12.242878+0000","last_became_active":"2024-09-12T18:26:41.866528+0000","last_became_peered":"2024-09-12T18:26:41.866528+0000","last_unstale":"2024-09-12T19:14:12.242878+0000","last_undegraded":"2024-09-12T19:14:12.242878+0000","last_fullsized":"2024-09-12T19:14:12.242878+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'795","last_scrub_stamp":"2024-09-12T19:14:12.242691+0000","last_deep_scrub":"265'795","last_deep_scrub_stamp":"2024-09-12T19:14:12.242691+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.242691+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:47:57.776142+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3788,"num_read_kb":3420,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"265'343","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.298428+0000","last_change":"2024-09-12T19:14:07.298219+0000","last_active":"2024-09-12T19:14:07.298428+0000","last_peered":"2024-09-12T19:14:07.298428+0000","last_clean":"2024-09-12T19:14:07.298428+0000","last_became_active":"2024-09-12T18:26:39.839762+0000","last_became_peered":"2024-09-12T18:26:39.839762+0000","last_unstale":"2024-09-12T19:14:07.298428+0000","last_undegraded":"2024-09-12T19:14:07.298428+0000","last_fullsized":"2024-09-12T19:14:07.298428+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:14:07.298004+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:14:07.298004+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.298004+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:50.827849+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1967405,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":414,"num_read_kb":30496,"num_write":1045,"num_write_kb":26286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1458,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.296902+0000","last_change":"2024-09-12T19:14:25.296902+0000","last_active":"2024-09-12T19:14:25.296902+0000","last_peered":"2024-09-12T19:14:25.296902+0000","last_clean":"2024-09-12T19:14:25.296902+0000","last_became_active":"2024-09-12T18:26:43.861969+0000","last_became_peered":"2024-09-12T18:26:43.861969+0000","last_unstale":"2024-09-12T19:14:25.296902+0000","last_undegraded":"2024-09-12T19:14:25.296902+0000","last_fullsized":"2024-09-12T19:14:25.296902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:25.296671+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:25.296671+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.296671+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:25.230803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"265'82","reported_seq":607,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.147478+0000","last_change":"2024-09-12T19:14:30.147478+0000","last_active":"2024-09-12T19:14:30.147478+0000","last_peered":"2024-09-12T19:14:30.147478+0000","last_clean":"2024-09-12T19:14:30.147478+0000","last_became_active":"2024-09-12T18:26:46.019895+0000","last_became_peered":"2024-09-12T18:26:46.019895+0000","last_unstale":"2024-09-12T19:14:30.147478+0000","last_undegraded":"2024-09-12T19:14:30.147478+0000","last_fullsized":"2024-09-12T19:14:30.147478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'82","last_scrub_stamp":"2024-09-12T19:14:30.147252+0000","last_deep_scrub":"265'82","last_deep_scrub_stamp":"2024-09-12T19:14:30.147252+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.147252+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:00:17.755307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"265'770","reported_seq":4382,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.673781+0000","last_change":"2024-09-12T19:14:23.673781+0000","last_active":"2024-09-12T19:14:23.673781+0000","last_peered":"2024-09-12T19:14:23.673781+0000","last_clean":"2024-09-12T19:14:23.673781+0000","last_became_active":"2024-09-12T18:26:47.882417+0000","last_became_peered":"2024-09-12T18:26:47.882417+0000","last_unstale":"2024-09-12T19:14:23.673781+0000","last_undegraded":"2024-09-12T19:14:23.673781+0000","last_fullsized":"2024-09-12T19:14:23.673781+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'770","last_scrub_stamp":"2024-09-12T19:14:23.673552+0000","last_deep_scrub":"265'770","last_deep_scrub_stamp":"2024-09-12T19:14:23.673552+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.673552+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":701,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:41.286038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"265'147","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.409211+0000","last_change":"2024-09-12T19:14:40.409054+0000","last_active":"2024-09-12T19:14:40.409211+0000","last_peered":"2024-09-12T19:14:40.409211+0000","last_clean":"2024-09-12T19:14:40.409211+0000","last_became_active":"2024-09-12T18:26:49.926637+0000","last_became_peered":"2024-09-12T18:26:49.926637+0000","last_unstale":"2024-09-12T19:14:40.409211+0000","last_undegraded":"2024-09-12T19:14:40.409211+0000","last_fullsized":"2024-09-12T19:14:40.409211+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'147","last_scrub_stamp":"2024-09-12T19:14:40.408868+0000","last_deep_scrub":"265'147","last_deep_scrub_stamp":"2024-09-12T19:14:40.408868+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.408868+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:01:45.542033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":124,"num_read_kb":120,"num_write":360,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"265'756","reported_seq":2278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.078131+0000","last_change":"2024-09-12T19:14:13.078131+0000","last_active":"2024-09-12T19:14:13.078131+0000","last_peered":"2024-09-12T19:14:13.078131+0000","last_clean":"2024-09-12T19:14:13.078131+0000","last_became_active":"2024-09-12T18:26:41.839152+0000","last_became_peered":"2024-09-12T18:26:41.839152+0000","last_unstale":"2024-09-12T19:14:13.078131+0000","last_undegraded":"2024-09-12T19:14:13.078131+0000","last_fullsized":"2024-09-12T19:14:13.078131+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'756","last_scrub_stamp":"2024-09-12T19:14:13.077954+0000","last_deep_scrub":"265'756","last_deep_scrub_stamp":"2024-09-12T19:14:13.077954+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.077954+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:43:32.408093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3609,"num_read_kb":3261,"num_write":1016,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"265'377","reported_seq":1249,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.786508+0000","last_change":"2024-09-12T19:14:08.786353+0000","last_active":"2024-09-12T19:14:08.786508+0000","last_peered":"2024-09-12T19:14:08.786508+0000","last_clean":"2024-09-12T19:14:08.786508+0000","last_became_active":"2024-09-12T18:26:39.839018+0000","last_became_peered":"2024-09-12T18:26:39.839018+0000","last_unstale":"2024-09-12T19:14:08.786508+0000","last_undegraded":"2024-09-12T19:14:08.786508+0000","last_fullsized":"2024-09-12T19:14:08.786508+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:14:08.786149+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:14:08.786149+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.786149+0000","objects_scrubbed":7,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:20.356579+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88291,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":988,"num_read_kb":16661,"num_write":1246,"num_write_kb":29221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.384473+0000","last_change":"2024-09-12T19:14:26.384473+0000","last_active":"2024-09-12T19:14:26.384473+0000","last_peered":"2024-09-12T19:14:26.384473+0000","last_clean":"2024-09-12T19:14:26.384473+0000","last_became_active":"2024-09-12T18:26:43.872882+0000","last_became_peered":"2024-09-12T18:26:43.872882+0000","last_unstale":"2024-09-12T19:14:26.384473+0000","last_undegraded":"2024-09-12T19:14:26.384473+0000","last_fullsized":"2024-09-12T19:14:26.384473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.384291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.384291+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.384291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:56.838256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"265'404","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.395106+0000","last_change":"2024-09-12T19:14:30.395106+0000","last_active":"2024-09-12T19:14:30.395106+0000","last_peered":"2024-09-12T19:14:30.395106+0000","last_clean":"2024-09-12T19:14:30.395106+0000","last_became_active":"2024-09-12T18:26:45.871011+0000","last_became_peered":"2024-09-12T18:26:45.871011+0000","last_unstale":"2024-09-12T19:14:30.395106+0000","last_undegraded":"2024-09-12T19:14:30.395106+0000","last_fullsized":"2024-09-12T19:14:30.395106+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T19:14:30.394900+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T19:14:30.394900+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.394900+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:57.258839+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47428,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1195,"num_read_kb":1786,"num_write":1700,"num_write_kb":1538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488484,"num_omap_keys":1128,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.641621+0000","last_change":"2024-09-12T19:14:22.641621+0000","last_active":"2024-09-12T19:14:22.641621+0000","last_peered":"2024-09-12T19:14:22.641621+0000","last_clean":"2024-09-12T19:14:22.641621+0000","last_became_active":"2024-09-12T18:26:47.893881+0000","last_became_peered":"2024-09-12T18:26:47.893881+0000","last_unstale":"2024-09-12T19:14:22.641621+0000","last_undegraded":"2024-09-12T19:14:22.641621+0000","last_fullsized":"2024-09-12T19:14:22.641621+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:22.641442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:22.641442+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.641442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:34.196498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"265'161","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.121134+0000","last_change":"2024-09-12T19:14:30.120976+0000","last_active":"2024-09-12T19:14:30.121134+0000","last_peered":"2024-09-12T19:14:30.121134+0000","last_clean":"2024-09-12T19:14:30.121134+0000","last_became_active":"2024-09-12T18:26:49.911403+0000","last_became_peered":"2024-09-12T18:26:49.911403+0000","last_unstale":"2024-09-12T19:14:30.121134+0000","last_undegraded":"2024-09-12T19:14:30.121134+0000","last_fullsized":"2024-09-12T19:14:30.121134+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'161","last_scrub_stamp":"2024-09-12T19:14:30.120766+0000","last_deep_scrub":"265'161","last_deep_scrub_stamp":"2024-09-12T19:14:30.120766+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.120766+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:49.239056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":468,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":155,"num_read_kb":152,"num_write":383,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"265'826","reported_seq":2340,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.591722+0000","last_change":"2024-09-12T19:14:15.591537+0000","last_active":"2024-09-12T19:14:15.591722+0000","last_peered":"2024-09-12T19:14:15.591722+0000","last_clean":"2024-09-12T19:14:15.591722+0000","last_became_active":"2024-09-12T18:26:41.873329+0000","last_became_peered":"2024-09-12T18:26:41.873329+0000","last_unstale":"2024-09-12T19:14:15.591722+0000","last_undegraded":"2024-09-12T19:14:15.591722+0000","last_fullsized":"2024-09-12T19:14:15.591722+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'826","last_scrub_stamp":"2024-09-12T19:14:15.591318+0000","last_deep_scrub":"265'826","last_deep_scrub_stamp":"2024-09-12T19:14:15.591318+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.591318+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:40.100277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3864,"num_read_kb":3455,"num_write":1112,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.823308+0000","last_change":"2024-09-12T19:14:05.823046+0000","last_active":"2024-09-12T19:14:05.823308+0000","last_peered":"2024-09-12T19:14:05.823308+0000","last_clean":"2024-09-12T19:14:05.823308+0000","last_became_active":"2024-09-12T18:26:20.488464+0000","last_became_peered":"2024-09-12T18:26:20.488464+0000","last_unstale":"2024-09-12T19:14:05.823308+0000","last_undegraded":"2024-09-12T19:14:05.823308+0000","last_fullsized":"2024-09-12T19:14:05.823308+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T19:14:05.822803+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T19:14:05.822803+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.822803+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:59:50.624649+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.565231+0000","last_change":"2024-09-12T19:14:06.564974+0000","last_active":"2024-09-12T19:14:06.565231+0000","last_peered":"2024-09-12T19:14:06.565231+0000","last_clean":"2024-09-12T19:14:06.565231+0000","last_became_active":"2024-09-12T18:26:25.483072+0000","last_became_peered":"2024-09-12T18:26:25.483072+0000","last_unstale":"2024-09-12T19:14:06.565231+0000","last_undegraded":"2024-09-12T19:14:06.565231+0000","last_fullsized":"2024-09-12T19:14:06.565231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:06.564760+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:06.564760+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.564760+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:34.986549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0010071489999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"265'369","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:03.767534+0000","last_change":"2024-09-12T19:14:03.767482+0000","last_active":"2024-09-12T19:14:03.767534+0000","last_peered":"2024-09-12T19:14:03.767534+0000","last_clean":"2024-09-12T19:14:03.767534+0000","last_became_active":"2024-09-12T18:26:39.855274+0000","last_became_peered":"2024-09-12T18:26:39.855274+0000","last_unstale":"2024-09-12T19:14:03.767534+0000","last_undegraded":"2024-09-12T19:14:03.767534+0000","last_fullsized":"2024-09-12T19:14:03.767534+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'369","last_scrub_stamp":"2024-09-12T19:14:03.767414+0000","last_deep_scrub":"265'369","last_deep_scrub_stamp":"2024-09-12T19:14:03.767414+0000","last_clean_scrub_stamp":"2024-09-12T19:14:03.767414+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:11.994783+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399238,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":585,"num_read_kb":43416,"num_write":1148,"num_write_kb":32341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"265'4","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.885397+0000","last_change":"2024-09-12T19:14:22.885214+0000","last_active":"2024-09-12T19:14:22.885397+0000","last_peered":"2024-09-12T19:14:22.885397+0000","last_clean":"2024-09-12T19:14:22.885397+0000","last_became_active":"2024-09-12T18:26:43.862599+0000","last_became_peered":"2024-09-12T18:26:43.862599+0000","last_unstale":"2024-09-12T19:14:22.885397+0000","last_undegraded":"2024-09-12T19:14:22.885397+0000","last_fullsized":"2024-09-12T19:14:22.885397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T19:14:22.885024+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T19:14:22.885024+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.885024+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:30.442155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"265'724","reported_seq":1431,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.410071+0000","last_change":"2024-09-12T19:14:29.410071+0000","last_active":"2024-09-12T19:14:29.410071+0000","last_peered":"2024-09-12T19:14:29.410071+0000","last_clean":"2024-09-12T19:14:29.410071+0000","last_became_active":"2024-09-12T18:26:45.870711+0000","last_became_peered":"2024-09-12T18:26:45.870711+0000","last_unstale":"2024-09-12T19:14:29.410071+0000","last_undegraded":"2024-09-12T19:14:29.410071+0000","last_fullsized":"2024-09-12T19:14:29.410071+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'724","last_scrub_stamp":"2024-09-12T19:14:29.409865+0000","last_deep_scrub":"265'724","last_deep_scrub_stamp":"2024-09-12T19:14:29.409865+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.409865+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:23:32.681147+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152164,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1400,"num_read_kb":3258,"num_write":1288,"num_write_kb":1147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89484,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.621767+0000","last_change":"2024-09-12T19:14:26.621630+0000","last_active":"2024-09-12T19:14:26.621767+0000","last_peered":"2024-09-12T19:14:26.621767+0000","last_clean":"2024-09-12T19:14:26.621767+0000","last_became_active":"2024-09-12T18:26:47.886696+0000","last_became_peered":"2024-09-12T18:26:47.886696+0000","last_unstale":"2024-09-12T19:14:26.621767+0000","last_undegraded":"2024-09-12T19:14:26.621767+0000","last_fullsized":"2024-09-12T19:14:26.621767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.621440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.621440+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.621440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:12.826430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"265'177","reported_seq":895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.599030+0000","last_change":"2024-09-12T19:14:28.598889+0000","last_active":"2024-09-12T19:14:28.599030+0000","last_peered":"2024-09-12T19:14:28.599030+0000","last_clean":"2024-09-12T19:14:28.599030+0000","last_became_active":"2024-09-12T18:26:49.909591+0000","last_became_peered":"2024-09-12T18:26:49.909591+0000","last_unstale":"2024-09-12T19:14:28.599030+0000","last_undegraded":"2024-09-12T19:14:28.599030+0000","last_fullsized":"2024-09-12T19:14:28.599030+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'177","last_scrub_stamp":"2024-09-12T19:14:28.598710+0000","last_deep_scrub":"265'177","last_deep_scrub_stamp":"2024-09-12T19:14:28.598710+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.598710+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:25.270781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":470,"num_read_kb":451,"num_write":354,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"265'449","reported_seq":1934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.828712+0000","last_change":"2024-09-12T19:14:09.828560+0000","last_active":"2024-09-12T19:14:09.828712+0000","last_peered":"2024-09-12T19:14:09.828712+0000","last_clean":"2024-09-12T19:14:09.828712+0000","last_became_active":"2024-09-12T18:27:11.825677+0000","last_became_peered":"2024-09-12T18:27:11.825677+0000","last_unstale":"2024-09-12T19:14:09.828712+0000","last_undegraded":"2024-09-12T19:14:09.828712+0000","last_fullsized":"2024-09-12T19:14:09.828712+0000","mapping_epoch":37,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'449","last_scrub_stamp":"2024-09-12T19:14:09.828367+0000","last_deep_scrub":"265'449","last_deep_scrub_stamp":"2024-09-12T19:14:09.828367+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.828367+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:10.327973+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2226,"num_read_kb":2089,"num_write":497,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.817334+0000","last_change":"2024-09-12T19:14:09.817097+0000","last_active":"2024-09-12T19:14:09.817334+0000","last_peered":"2024-09-12T19:14:09.817334+0000","last_clean":"2024-09-12T19:14:09.817334+0000","last_became_active":"2024-09-12T18:26:25.486681+0000","last_became_peered":"2024-09-12T18:26:25.486681+0000","last_unstale":"2024-09-12T19:14:09.817334+0000","last_undegraded":"2024-09-12T19:14:09.817334+0000","last_fullsized":"2024-09-12T19:14:09.817334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:09.816815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:09.816815+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.816815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:30:48.920838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001127308,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"265'447","reported_seq":1102,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:02.915533+0000","last_change":"2024-09-12T19:14:02.915481+0000","last_active":"2024-09-12T19:14:02.915533+0000","last_peered":"2024-09-12T19:14:02.915533+0000","last_clean":"2024-09-12T19:14:02.915533+0000","last_became_active":"2024-09-12T18:26:39.852604+0000","last_became_peered":"2024-09-12T18:26:39.852604+0000","last_unstale":"2024-09-12T19:14:02.915533+0000","last_undegraded":"2024-09-12T19:14:02.915533+0000","last_fullsized":"2024-09-12T19:14:02.915533+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'447","last_scrub_stamp":"2024-09-12T19:14:02.915389+0000","last_deep_scrub":"265'447","last_deep_scrub_stamp":"2024-09-12T19:14:02.915389+0000","last_clean_scrub_stamp":"2024-09-12T19:14:02.915389+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:58.385296+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1797992,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":612,"num_read_kb":8884,"num_write":1284,"num_write_kb":32875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.332526+0000","last_change":"2024-09-12T19:14:24.332526+0000","last_active":"2024-09-12T19:14:24.332526+0000","last_peered":"2024-09-12T19:14:24.332526+0000","last_clean":"2024-09-12T19:14:24.332526+0000","last_became_active":"2024-09-12T18:26:43.857619+0000","last_became_peered":"2024-09-12T18:26:43.857619+0000","last_unstale":"2024-09-12T19:14:24.332526+0000","last_undegraded":"2024-09-12T19:14:24.332526+0000","last_fullsized":"2024-09-12T19:14:24.332526+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:24.332345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:24.332345+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.332345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:34.488154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"265'1288","reported_seq":2804,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.136233+0000","last_change":"2024-09-12T19:14:29.136156+0000","last_active":"2024-09-12T19:14:29.136233+0000","last_peered":"2024-09-12T19:14:29.136233+0000","last_clean":"2024-09-12T19:14:29.136233+0000","last_became_active":"2024-09-12T18:26:45.865530+0000","last_became_peered":"2024-09-12T18:26:45.865530+0000","last_unstale":"2024-09-12T19:14:29.136233+0000","last_undegraded":"2024-09-12T19:14:29.136233+0000","last_fullsized":"2024-09-12T19:14:29.136233+0000","mapping_epoch":30,"log_start":"265'1200","ondisk_log_start":"265'1200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1288","last_scrub_stamp":"2024-09-12T19:14:29.136034+0000","last_deep_scrub":"265'1288","last_deep_scrub_stamp":"2024-09-12T19:14:29.136034+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.136034+0000","objects_scrubbed":12,"log_size":88,"log_dups_size":1200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:36:22.780326+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145649,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2006,"num_read_kb":3785,"num_write":1114,"num_write_kb":954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.948655+0000","last_change":"2024-09-12T19:14:32.948511+0000","last_active":"2024-09-12T19:14:32.948655+0000","last_peered":"2024-09-12T19:14:32.948655+0000","last_clean":"2024-09-12T19:14:32.948655+0000","last_became_active":"2024-09-12T18:26:47.886707+0000","last_became_peered":"2024-09-12T18:26:47.886707+0000","last_unstale":"2024-09-12T19:14:32.948655+0000","last_undegraded":"2024-09-12T19:14:32.948655+0000","last_fullsized":"2024-09-12T19:14:32.948655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:32.948325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:32.948325+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.948325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:12:02.738260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"265'198","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.169478+0000","last_change":"2024-09-12T19:14:32.169299+0000","last_active":"2024-09-12T19:14:32.169478+0000","last_peered":"2024-09-12T19:14:32.169478+0000","last_clean":"2024-09-12T19:14:32.169478+0000","last_became_active":"2024-09-12T18:26:49.909802+0000","last_became_peered":"2024-09-12T18:26:49.909802+0000","last_unstale":"2024-09-12T19:14:32.169478+0000","last_undegraded":"2024-09-12T19:14:32.169478+0000","last_fullsized":"2024-09-12T19:14:32.169478+0000","mapping_epoch":34,"log_start":"262'100","ondisk_log_start":"262'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'198","last_scrub_stamp":"2024-09-12T19:14:32.169120+0000","last_deep_scrub":"265'198","last_deep_scrub_stamp":"2024-09-12T19:14:32.169120+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.169120+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:07:37.739092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":337,"num_read_kb":322,"num_write":434,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"265'395","reported_seq":1925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.062834+0000","last_change":"2024-09-12T19:14:10.062699+0000","last_active":"2024-09-12T19:14:10.062834+0000","last_peered":"2024-09-12T19:14:10.062834+0000","last_clean":"2024-09-12T19:14:10.062834+0000","last_became_active":"2024-09-12T18:26:41.868958+0000","last_became_peered":"2024-09-12T18:26:41.868958+0000","last_unstale":"2024-09-12T19:14:10.062834+0000","last_undegraded":"2024-09-12T19:14:10.062834+0000","last_fullsized":"2024-09-12T19:14:10.062834+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'395","last_scrub_stamp":"2024-09-12T19:14:10.062517+0000","last_deep_scrub":"265'395","last_deep_scrub_stamp":"2024-09-12T19:14:10.062517+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.062517+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:53:11.560866+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2137,"num_read_kb":2050,"num_write":435,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1191,"num_omap_keys":5,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.034479+0000","last_change":"2024-09-12T19:14:04.034267+0000","last_active":"2024-09-12T19:14:04.034479+0000","last_peered":"2024-09-12T19:14:04.034479+0000","last_clean":"2024-09-12T19:14:04.034479+0000","last_became_active":"2024-09-12T18:26:25.559069+0000","last_became_peered":"2024-09-12T18:26:25.559069+0000","last_unstale":"2024-09-12T19:14:04.034479+0000","last_undegraded":"2024-09-12T19:14:04.034479+0000","last_fullsized":"2024-09-12T19:14:04.034479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:04.034076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:04.034076+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.034076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:45.407307+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00065344600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"265'305","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.182466+0000","last_change":"2024-09-12T19:14:20.182326+0000","last_active":"2024-09-12T19:14:20.182466+0000","last_peered":"2024-09-12T19:14:20.182466+0000","last_clean":"2024-09-12T19:14:20.182466+0000","last_became_active":"2024-09-12T18:26:39.832766+0000","last_became_peered":"2024-09-12T18:26:39.832766+0000","last_unstale":"2024-09-12T19:14:20.182466+0000","last_undegraded":"2024-09-12T19:14:20.182466+0000","last_fullsized":"2024-09-12T19:14:20.182466+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T19:14:20.182116+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T19:14:20.182116+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.182116+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:08.243108+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":386,"num_read_kb":10646,"num_write":879,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.043264+0000","last_change":"2024-09-12T19:14:15.043116+0000","last_active":"2024-09-12T19:14:15.043264+0000","last_peered":"2024-09-12T19:14:15.043264+0000","last_clean":"2024-09-12T19:14:15.043264+0000","last_became_active":"2024-09-12T18:26:43.843884+0000","last_became_peered":"2024-09-12T18:26:43.843884+0000","last_unstale":"2024-09-12T19:14:15.043264+0000","last_undegraded":"2024-09-12T19:14:15.043264+0000","last_fullsized":"2024-09-12T19:14:15.043264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:15.042938+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:15.042938+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.042938+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:51:57.556164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"265'246","reported_seq":1363,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.033767+0000","last_change":"2024-09-12T19:14:29.033627+0000","last_active":"2024-09-12T19:14:29.033767+0000","last_peered":"2024-09-12T19:14:29.033767+0000","last_clean":"2024-09-12T19:14:29.033767+0000","last_became_active":"2024-09-12T18:26:46.024474+0000","last_became_peered":"2024-09-12T18:26:46.024474+0000","last_unstale":"2024-09-12T19:14:29.033767+0000","last_undegraded":"2024-09-12T19:14:29.033767+0000","last_fullsized":"2024-09-12T19:14:29.033767+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'246","last_scrub_stamp":"2024-09-12T19:14:29.033403+0000","last_deep_scrub":"265'246","last_deep_scrub_stamp":"2024-09-12T19:14:29.033403+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.033403+0000","objects_scrubbed":9,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:35.289473+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":182,"num_read_kb":174,"num_write":155,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.623507+0000","last_change":"2024-09-12T19:14:23.623352+0000","last_active":"2024-09-12T19:14:23.623507+0000","last_peered":"2024-09-12T19:14:23.623507+0000","last_clean":"2024-09-12T19:14:23.623507+0000","last_became_active":"2024-09-12T18:26:47.889718+0000","last_became_peered":"2024-09-12T18:26:47.889718+0000","last_unstale":"2024-09-12T19:14:23.623507+0000","last_undegraded":"2024-09-12T19:14:23.623507+0000","last_fullsized":"2024-09-12T19:14:23.623507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:23.623180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:23.623180+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.623180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:13.007796+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"265'251","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:43.143065+0000","last_change":"2024-09-12T19:14:43.143065+0000","last_active":"2024-09-12T19:14:43.143065+0000","last_peered":"2024-09-12T19:14:43.143065+0000","last_clean":"2024-09-12T19:14:43.143065+0000","last_became_active":"2024-09-12T18:26:49.912488+0000","last_became_peered":"2024-09-12T18:26:49.912488+0000","last_unstale":"2024-09-12T19:14:43.143065+0000","last_undegraded":"2024-09-12T19:14:43.143065+0000","last_fullsized":"2024-09-12T19:14:43.143065+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'251","last_scrub_stamp":"2024-09-12T19:14:43.142896+0000","last_deep_scrub":"265'251","last_deep_scrub_stamp":"2024-09-12T19:14:43.142896+0000","last_clean_scrub_stamp":"2024-09-12T19:14:43.142896+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:21.062229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":492,"num_write":531,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"265'923","reported_seq":2692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.118359+0000","last_change":"2024-09-12T19:14:14.118118+0000","last_active":"2024-09-12T19:14:14.118359+0000","last_peered":"2024-09-12T19:14:14.118359+0000","last_clean":"2024-09-12T19:14:14.118359+0000","last_became_active":"2024-09-12T18:26:41.847403+0000","last_became_peered":"2024-09-12T18:26:41.847403+0000","last_unstale":"2024-09-12T19:14:14.118359+0000","last_undegraded":"2024-09-12T19:14:14.118359+0000","last_fullsized":"2024-09-12T19:14:14.118359+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'923","last_scrub_stamp":"2024-09-12T19:14:14.117836+0000","last_deep_scrub":"265'923","last_deep_scrub_stamp":"2024-09-12T19:14:14.117836+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.117836+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:50:45.790389+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4497,"num_read_kb":4050,"num_write":1227,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3569,"num_omap_keys":15,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.604240+0000","last_change":"2024-09-12T19:14:05.604094+0000","last_active":"2024-09-12T19:14:05.604240+0000","last_peered":"2024-09-12T19:14:05.604240+0000","last_clean":"2024-09-12T19:14:05.604240+0000","last_became_active":"2024-09-12T18:26:25.483909+0000","last_became_peered":"2024-09-12T18:26:25.483909+0000","last_unstale":"2024-09-12T19:14:05.604240+0000","last_undegraded":"2024-09-12T19:14:05.604240+0000","last_fullsized":"2024-09-12T19:14:05.604240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T19:14:05.603905+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T19:14:05.603905+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.603905+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:00.442699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002260153,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"265'308","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.356090+0000","last_change":"2024-09-12T19:14:04.355955+0000","last_active":"2024-09-12T19:14:04.356090+0000","last_peered":"2024-09-12T19:14:04.356090+0000","last_clean":"2024-09-12T19:14:04.356090+0000","last_became_active":"2024-09-12T18:26:39.847002+0000","last_became_peered":"2024-09-12T18:26:39.847002+0000","last_unstale":"2024-09-12T19:14:04.356090+0000","last_undegraded":"2024-09-12T19:14:04.356090+0000","last_fullsized":"2024-09-12T19:14:04.356090+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'308","last_scrub_stamp":"2024-09-12T19:14:04.355733+0000","last_deep_scrub":"265'308","last_deep_scrub_stamp":"2024-09-12T19:14:04.355733+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.355733+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:38:41.026404+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":613,"num_read_kb":6223,"num_write":953,"num_write_kb":32520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.809254+0000","last_change":"2024-09-12T19:14:14.809100+0000","last_active":"2024-09-12T19:14:14.809254+0000","last_peered":"2024-09-12T19:14:14.809254+0000","last_clean":"2024-09-12T19:14:14.809254+0000","last_became_active":"2024-09-12T18:26:43.861753+0000","last_became_peered":"2024-09-12T18:26:43.861753+0000","last_unstale":"2024-09-12T19:14:14.809254+0000","last_undegraded":"2024-09-12T19:14:14.809254+0000","last_fullsized":"2024-09-12T19:14:14.809254+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:14.808880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:14.808880+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.808880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:24:18.789841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"265'118","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.181685+0000","last_change":"2024-09-12T19:14:28.181545+0000","last_active":"2024-09-12T19:14:28.181685+0000","last_peered":"2024-09-12T19:14:28.181685+0000","last_clean":"2024-09-12T19:14:28.181685+0000","last_became_active":"2024-09-12T18:26:45.856615+0000","last_became_peered":"2024-09-12T18:26:45.856615+0000","last_unstale":"2024-09-12T19:14:28.181685+0000","last_undegraded":"2024-09-12T19:14:28.181685+0000","last_fullsized":"2024-09-12T19:14:28.181685+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T19:14:28.181357+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T19:14:28.181357+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.181357+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:08.289459+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.655183+0000","last_change":"2024-09-12T19:14:21.655037+0000","last_active":"2024-09-12T19:14:21.655183+0000","last_peered":"2024-09-12T19:14:21.655183+0000","last_clean":"2024-09-12T19:14:21.655183+0000","last_became_active":"2024-09-12T18:26:47.884981+0000","last_became_peered":"2024-09-12T18:26:47.884981+0000","last_unstale":"2024-09-12T19:14:21.655183+0000","last_undegraded":"2024-09-12T19:14:21.655183+0000","last_fullsized":"2024-09-12T19:14:21.655183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:21.654865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:21.654865+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.654865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:15.223256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"265'140","reported_seq":700,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.502576+0000","last_change":"2024-09-12T19:14:36.502576+0000","last_active":"2024-09-12T19:14:36.502576+0000","last_peered":"2024-09-12T19:14:36.502576+0000","last_clean":"2024-09-12T19:14:36.502576+0000","last_became_active":"2024-09-12T18:26:49.918043+0000","last_became_peered":"2024-09-12T18:26:49.918043+0000","last_unstale":"2024-09-12T19:14:36.502576+0000","last_undegraded":"2024-09-12T19:14:36.502576+0000","last_fullsized":"2024-09-12T19:14:36.502576+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'140","last_scrub_stamp":"2024-09-12T19:14:36.502391+0000","last_deep_scrub":"265'140","last_deep_scrub_stamp":"2024-09-12T19:14:36.502391+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.502391+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:31:34.316362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":258,"num_write":354,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"265'550","reported_seq":2248,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.028687+0000","last_change":"2024-09-12T19:14:08.028527+0000","last_active":"2024-09-12T19:14:08.028687+0000","last_peered":"2024-09-12T19:14:08.028687+0000","last_clean":"2024-09-12T19:14:08.028687+0000","last_became_active":"2024-09-12T18:26:41.878269+0000","last_became_peered":"2024-09-12T18:26:41.878269+0000","last_unstale":"2024-09-12T19:14:08.028687+0000","last_undegraded":"2024-09-12T19:14:08.028687+0000","last_fullsized":"2024-09-12T19:14:08.028687+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'550","last_scrub_stamp":"2024-09-12T19:14:08.028346+0000","last_deep_scrub":"265'550","last_deep_scrub_stamp":"2024-09-12T19:14:08.028346+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.028346+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:04:00.737745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2954,"num_read_kb":2745,"num_write":669,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"265'462","reported_seq":1164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.591575+0000","last_change":"2024-09-12T19:14:04.591491+0000","last_active":"2024-09-12T19:14:04.591575+0000","last_peered":"2024-09-12T19:14:04.591575+0000","last_clean":"2024-09-12T19:14:04.591575+0000","last_became_active":"2024-09-12T18:26:39.851739+0000","last_became_peered":"2024-09-12T18:26:39.851739+0000","last_unstale":"2024-09-12T19:14:04.591575+0000","last_undegraded":"2024-09-12T19:14:04.591575+0000","last_fullsized":"2024-09-12T19:14:04.591575+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'462","last_scrub_stamp":"2024-09-12T19:14:04.591353+0000","last_deep_scrub":"265'462","last_deep_scrub_stamp":"2024-09-12T19:14:04.591353+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.591353+0000","objects_scrubbed":8,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:47:43.285385+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":848,"num_read_kb":21232,"num_write":1357,"num_write_kb":18457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:03.058708+0000","last_change":"2024-09-12T19:14:03.058458+0000","last_active":"2024-09-12T19:14:03.058708+0000","last_peered":"2024-09-12T19:14:03.058708+0000","last_clean":"2024-09-12T19:14:03.058708+0000","last_became_active":"2024-09-12T18:26:25.474997+0000","last_became_peered":"2024-09-12T18:26:25.474997+0000","last_unstale":"2024-09-12T19:14:03.058708+0000","last_undegraded":"2024-09-12T19:14:03.058708+0000","last_fullsized":"2024-09-12T19:14:03.058708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:03.058262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:03.058262+0000","last_clean_scrub_stamp":"2024-09-12T19:14:03.058262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:33.435710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00099306900000000007,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.565116+0000","last_change":"2024-09-12T19:14:31.564869+0000","last_active":"2024-09-12T19:14:31.565116+0000","last_peered":"2024-09-12T19:14:31.565116+0000","last_clean":"2024-09-12T19:14:31.565116+0000","last_became_active":"2024-09-12T18:26:43.865697+0000","last_became_peered":"2024-09-12T18:26:43.865697+0000","last_unstale":"2024-09-12T19:14:31.565116+0000","last_undegraded":"2024-09-12T19:14:31.565116+0000","last_fullsized":"2024-09-12T19:14:31.565116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:31.564660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:31.564660+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.564660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:47.040558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"265'560","reported_seq":1234,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.683285+0000","last_change":"2024-09-12T19:14:22.683021+0000","last_active":"2024-09-12T19:14:22.683285+0000","last_peered":"2024-09-12T19:14:22.683285+0000","last_clean":"2024-09-12T19:14:22.683285+0000","last_became_active":"2024-09-12T18:26:45.877100+0000","last_became_peered":"2024-09-12T18:26:45.877100+0000","last_unstale":"2024-09-12T19:14:22.683285+0000","last_undegraded":"2024-09-12T19:14:22.683285+0000","last_fullsized":"2024-09-12T19:14:22.683285+0000","mapping_epoch":30,"log_start":"265'500","ondisk_log_start":"265'500","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'560","last_scrub_stamp":"2024-09-12T19:14:22.682604+0000","last_deep_scrub":"265'560","last_deep_scrub_stamp":"2024-09-12T19:14:22.682604+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.682604+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:44:19.522572+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103009,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":952,"num_read_kb":2114,"num_write":816,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10824,"num_omap_keys":26,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.436574+0000","last_change":"2024-09-12T19:14:33.436395+0000","last_active":"2024-09-12T19:14:33.436574+0000","last_peered":"2024-09-12T19:14:33.436574+0000","last_clean":"2024-09-12T19:14:33.436574+0000","last_became_active":"2024-09-12T18:26:47.900217+0000","last_became_peered":"2024-09-12T18:26:47.900217+0000","last_unstale":"2024-09-12T19:14:33.436574+0000","last_undegraded":"2024-09-12T19:14:33.436574+0000","last_fullsized":"2024-09-12T19:14:33.436574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:33.436202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:33.436202+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.436202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:41.332666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"265'145","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:35.662133+0000","last_change":"2024-09-12T19:14:35.662133+0000","last_active":"2024-09-12T19:14:35.662133+0000","last_peered":"2024-09-12T19:14:35.662133+0000","last_clean":"2024-09-12T19:14:35.662133+0000","last_became_active":"2024-09-12T18:26:49.921123+0000","last_became_peered":"2024-09-12T18:26:49.921123+0000","last_unstale":"2024-09-12T19:14:35.662133+0000","last_undegraded":"2024-09-12T19:14:35.662133+0000","last_fullsized":"2024-09-12T19:14:35.662133+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'145","last_scrub_stamp":"2024-09-12T19:14:35.661928+0000","last_deep_scrub":"265'145","last_deep_scrub_stamp":"2024-09-12T19:14:35.661928+0000","last_clean_scrub_stamp":"2024-09-12T19:14:35.661928+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:20:42.989154+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":212,"num_read_kb":188,"num_write":350,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"265'429","reported_seq":1891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.799785+0000","last_change":"2024-09-12T19:14:15.799636+0000","last_active":"2024-09-12T19:14:15.799785+0000","last_peered":"2024-09-12T19:14:15.799785+0000","last_clean":"2024-09-12T19:14:15.799785+0000","last_became_active":"2024-09-12T18:26:41.869426+0000","last_became_peered":"2024-09-12T18:26:41.869426+0000","last_unstale":"2024-09-12T19:14:15.799785+0000","last_undegraded":"2024-09-12T19:14:15.799785+0000","last_fullsized":"2024-09-12T19:14:15.799785+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'429","last_scrub_stamp":"2024-09-12T19:14:15.799455+0000","last_deep_scrub":"265'429","last_deep_scrub_stamp":"2024-09-12T19:14:15.799455+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.799455+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":400,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:25.588201+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2246,"num_read_kb":2097,"num_write":505,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"265'373","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.025106+0000","last_change":"2024-09-12T19:14:09.024849+0000","last_active":"2024-09-12T19:14:09.025106+0000","last_peered":"2024-09-12T19:14:09.025106+0000","last_clean":"2024-09-12T19:14:09.025106+0000","last_became_active":"2024-09-12T18:26:39.832593+0000","last_became_peered":"2024-09-12T18:26:39.832593+0000","last_unstale":"2024-09-12T19:14:09.025106+0000","last_undegraded":"2024-09-12T19:14:09.025106+0000","last_fullsized":"2024-09-12T19:14:09.025106+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T19:14:09.024591+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T19:14:09.024591+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.024591+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:07:04.058256+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1569358,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":644,"num_read_kb":23528,"num_write":1214,"num_write_kb":24783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.854721+0000","last_change":"2024-09-12T19:14:08.854566+0000","last_active":"2024-09-12T19:14:08.854721+0000","last_peered":"2024-09-12T19:14:08.854721+0000","last_clean":"2024-09-12T19:14:08.854721+0000","last_became_active":"2024-09-12T18:26:25.484938+0000","last_became_peered":"2024-09-12T18:26:25.484938+0000","last_unstale":"2024-09-12T19:14:08.854721+0000","last_undegraded":"2024-09-12T19:14:08.854721+0000","last_fullsized":"2024-09-12T19:14:08.854721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:08.854352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:08.854352+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.854352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:10:10.919124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001083194,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.597993+0000","last_change":"2024-09-12T19:14:18.597867+0000","last_active":"2024-09-12T19:14:18.597993+0000","last_peered":"2024-09-12T19:14:18.597993+0000","last_clean":"2024-09-12T19:14:18.597993+0000","last_became_active":"2024-09-12T18:26:43.863388+0000","last_became_peered":"2024-09-12T18:26:43.863388+0000","last_unstale":"2024-09-12T19:14:18.597993+0000","last_undegraded":"2024-09-12T19:14:18.597993+0000","last_fullsized":"2024-09-12T19:14:18.597993+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:18.597691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:18.597691+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.597691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:16.253901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"265'168","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:22.137853+0000","last_change":"2024-09-12T19:14:22.137680+0000","last_active":"2024-09-12T19:14:22.137853+0000","last_peered":"2024-09-12T19:14:22.137853+0000","last_clean":"2024-09-12T19:14:22.137853+0000","last_became_active":"2024-09-12T18:26:46.020043+0000","last_became_peered":"2024-09-12T18:26:46.020043+0000","last_unstale":"2024-09-12T19:14:22.137853+0000","last_undegraded":"2024-09-12T19:14:22.137853+0000","last_fullsized":"2024-09-12T19:14:22.137853+0000","mapping_epoch":30,"log_start":"262'100","ondisk_log_start":"262'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T19:14:22.137464+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T19:14:22.137464+0000","last_clean_scrub_stamp":"2024-09-12T19:14:22.137464+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:13:31.392371+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":197,"num_read_kb":189,"num_write":132,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"265'815","reported_seq":2667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.414516+0000","last_change":"2024-09-12T19:14:32.414248+0000","last_active":"2024-09-12T19:14:32.414516+0000","last_peered":"2024-09-12T19:14:32.414516+0000","last_clean":"2024-09-12T19:14:32.414516+0000","last_became_active":"2024-09-12T18:26:47.879630+0000","last_became_peered":"2024-09-12T18:26:47.879630+0000","last_unstale":"2024-09-12T19:14:32.414516+0000","last_undegraded":"2024-09-12T19:14:32.414516+0000","last_fullsized":"2024-09-12T19:14:32.414516+0000","mapping_epoch":32,"log_start":"265'800","ondisk_log_start":"265'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'815","last_scrub_stamp":"2024-09-12T19:14:32.413965+0000","last_deep_scrub":"265'815","last_deep_scrub_stamp":"2024-09-12T19:14:32.413965+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.413965+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:51:16.861896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"265'143","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.167533+0000","last_change":"2024-09-12T19:14:36.167533+0000","last_active":"2024-09-12T19:14:36.167533+0000","last_peered":"2024-09-12T19:14:36.167533+0000","last_clean":"2024-09-12T19:14:36.167533+0000","last_became_active":"2024-09-12T18:26:49.919846+0000","last_became_peered":"2024-09-12T18:26:49.919846+0000","last_unstale":"2024-09-12T19:14:36.167533+0000","last_undegraded":"2024-09-12T19:14:36.167533+0000","last_fullsized":"2024-09-12T19:14:36.167533+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'143","last_scrub_stamp":"2024-09-12T19:14:36.167304+0000","last_deep_scrub":"265'143","last_deep_scrub_stamp":"2024-09-12T19:14:36.167304+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.167304+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:56.870847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":913,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":263,"num_write":340,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"265'481","reported_seq":2017,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.951799+0000","last_change":"2024-09-12T19:14:19.951639+0000","last_active":"2024-09-12T19:14:19.951799+0000","last_peered":"2024-09-12T19:14:19.951799+0000","last_clean":"2024-09-12T19:14:19.951799+0000","last_became_active":"2024-09-12T18:26:41.862008+0000","last_became_peered":"2024-09-12T18:26:41.862008+0000","last_unstale":"2024-09-12T19:14:19.951799+0000","last_undegraded":"2024-09-12T19:14:19.951799+0000","last_fullsized":"2024-09-12T19:14:19.951799+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'481","last_scrub_stamp":"2024-09-12T19:14:19.951462+0000","last_deep_scrub":"265'481","last_deep_scrub_stamp":"2024-09-12T19:14:19.951462+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.951462+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:03.077093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2427,"num_read_kb":2263,"num_write":581,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"265'343","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.734772+0000","last_change":"2024-09-12T19:14:04.734724+0000","last_active":"2024-09-12T19:14:04.734772+0000","last_peered":"2024-09-12T19:14:04.734772+0000","last_clean":"2024-09-12T19:14:04.734772+0000","last_became_active":"2024-09-12T18:26:39.865123+0000","last_became_peered":"2024-09-12T18:26:39.865123+0000","last_unstale":"2024-09-12T19:14:04.734772+0000","last_undegraded":"2024-09-12T19:14:04.734772+0000","last_fullsized":"2024-09-12T19:14:04.734772+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T19:14:04.734653+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T19:14:04.734653+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.734653+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:56:27.841010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":480,"num_read_kb":68443,"num_write":1085,"num_write_kb":35089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.072373+0000","last_change":"2024-09-12T19:14:06.072144+0000","last_active":"2024-09-12T19:14:06.072373+0000","last_peered":"2024-09-12T19:14:06.072373+0000","last_clean":"2024-09-12T19:14:06.072373+0000","last_became_active":"2024-09-12T18:26:25.485137+0000","last_became_peered":"2024-09-12T18:26:25.485137+0000","last_unstale":"2024-09-12T19:14:06.072373+0000","last_undegraded":"2024-09-12T19:14:06.072373+0000","last_fullsized":"2024-09-12T19:14:06.072373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:06.071853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:06.071853+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.071853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:58.794679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013350759999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":512,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.431634+0000","last_change":"2024-09-12T19:14:25.431505+0000","last_active":"2024-09-12T19:14:25.431634+0000","last_peered":"2024-09-12T19:14:25.431634+0000","last_clean":"2024-09-12T19:14:25.431634+0000","last_became_active":"2024-09-12T18:26:43.874845+0000","last_became_peered":"2024-09-12T18:26:43.874845+0000","last_unstale":"2024-09-12T19:14:25.431634+0000","last_undegraded":"2024-09-12T19:14:25.431634+0000","last_fullsized":"2024-09-12T19:14:25.431634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:25.431335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:25.431335+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.431335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:03.653096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"265'111","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.375797+0000","last_change":"2024-09-12T19:14:29.375629+0000","last_active":"2024-09-12T19:14:29.375797+0000","last_peered":"2024-09-12T19:14:29.375797+0000","last_clean":"2024-09-12T19:14:29.375797+0000","last_became_active":"2024-09-12T18:26:45.863254+0000","last_became_peered":"2024-09-12T18:26:45.863254+0000","last_unstale":"2024-09-12T19:14:29.375797+0000","last_undegraded":"2024-09-12T19:14:29.375797+0000","last_fullsized":"2024-09-12T19:14:29.375797+0000","mapping_epoch":30,"log_start":"265'100","ondisk_log_start":"265'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'111","last_scrub_stamp":"2024-09-12T19:14:29.375431+0000","last_deep_scrub":"265'111","last_deep_scrub_stamp":"2024-09-12T19:14:29.375431+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.375431+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:57.740072+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"265'806","reported_seq":2529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.139058+0000","last_change":"2024-09-12T19:14:40.138891+0000","last_active":"2024-09-12T19:14:40.139058+0000","last_peered":"2024-09-12T19:14:40.139058+0000","last_clean":"2024-09-12T19:14:40.139058+0000","last_became_active":"2024-09-12T18:26:47.899682+0000","last_became_peered":"2024-09-12T18:26:47.899682+0000","last_unstale":"2024-09-12T19:14:40.139058+0000","last_undegraded":"2024-09-12T19:14:40.139058+0000","last_fullsized":"2024-09-12T19:14:40.139058+0000","mapping_epoch":32,"log_start":"265'700","ondisk_log_start":"265'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'806","last_scrub_stamp":"2024-09-12T19:14:40.138717+0000","last_deep_scrub":"265'806","last_deep_scrub_stamp":"2024-09-12T19:14:40.138717+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.138717+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:18:51.728312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"265'168","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.669516+0000","last_change":"2024-09-12T19:14:34.669516+0000","last_active":"2024-09-12T19:14:34.669516+0000","last_peered":"2024-09-12T19:14:34.669516+0000","last_clean":"2024-09-12T19:14:34.669516+0000","last_became_active":"2024-09-12T18:26:49.917537+0000","last_became_peered":"2024-09-12T18:26:49.917537+0000","last_unstale":"2024-09-12T19:14:34.669516+0000","last_undegraded":"2024-09-12T19:14:34.669516+0000","last_fullsized":"2024-09-12T19:14:34.669516+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T19:14:34.669306+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T19:14:34.669306+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.669306+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:24.898251+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":133,"num_read_kb":124,"num_write":364,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"265'446","reported_seq":1948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.329435+0000","last_change":"2024-09-12T19:14:08.329287+0000","last_active":"2024-09-12T19:14:08.329435+0000","last_peered":"2024-09-12T19:14:08.329435+0000","last_clean":"2024-09-12T19:14:08.329435+0000","last_became_active":"2024-09-12T18:26:41.871518+0000","last_became_peered":"2024-09-12T18:26:41.871518+0000","last_unstale":"2024-09-12T19:14:08.329435+0000","last_undegraded":"2024-09-12T19:14:08.329435+0000","last_fullsized":"2024-09-12T19:14:08.329435+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'446","last_scrub_stamp":"2024-09-12T19:14:08.329092+0000","last_deep_scrub":"265'446","last_deep_scrub_stamp":"2024-09-12T19:14:08.329092+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.329092+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":400,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:28:06.915175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2287,"num_read_kb":2145,"num_write":516,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"265'315","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:03.905567+0000","last_change":"2024-09-12T19:14:03.905429+0000","last_active":"2024-09-12T19:14:03.905567+0000","last_peered":"2024-09-12T19:14:03.905567+0000","last_clean":"2024-09-12T19:14:03.905567+0000","last_became_active":"2024-09-12T18:26:39.833924+0000","last_became_peered":"2024-09-12T18:26:39.833924+0000","last_unstale":"2024-09-12T19:14:03.905567+0000","last_undegraded":"2024-09-12T19:14:03.905567+0000","last_fullsized":"2024-09-12T19:14:03.905567+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T19:14:03.905233+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T19:14:03.905233+0000","last_clean_scrub_stamp":"2024-09-12T19:14:03.905233+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:40:50.763493+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6467978,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":474,"num_read_kb":59970,"num_write":1010,"num_write_kb":34278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":525,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.502466+0000","last_change":"2024-09-12T19:14:06.502292+0000","last_active":"2024-09-12T19:14:06.502466+0000","last_peered":"2024-09-12T19:14:06.502466+0000","last_clean":"2024-09-12T19:14:06.502466+0000","last_became_active":"2024-09-12T18:26:25.487465+0000","last_became_peered":"2024-09-12T18:26:25.487465+0000","last_unstale":"2024-09-12T19:14:06.502466+0000","last_undegraded":"2024-09-12T19:14:06.502466+0000","last_fullsized":"2024-09-12T19:14:06.502466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:06.502115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:06.502115+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.502115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:23.228019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010368949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.160123+0000","last_change":"2024-09-12T19:14:27.159963+0000","last_active":"2024-09-12T19:14:27.160123+0000","last_peered":"2024-09-12T19:14:27.160123+0000","last_clean":"2024-09-12T19:14:27.160123+0000","last_became_active":"2024-09-12T18:26:43.850274+0000","last_became_peered":"2024-09-12T18:26:43.850274+0000","last_unstale":"2024-09-12T19:14:27.160123+0000","last_undegraded":"2024-09-12T19:14:27.160123+0000","last_fullsized":"2024-09-12T19:14:27.160123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:27.159785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:27.159785+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.159785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:35.905171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"265'726","reported_seq":1448,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.985314+0000","last_change":"2024-09-12T19:14:27.985159+0000","last_active":"2024-09-12T19:14:27.985314+0000","last_peered":"2024-09-12T19:14:27.985314+0000","last_clean":"2024-09-12T19:14:27.985314+0000","last_became_active":"2024-09-12T18:26:46.021217+0000","last_became_peered":"2024-09-12T18:26:46.021217+0000","last_unstale":"2024-09-12T19:14:27.985314+0000","last_undegraded":"2024-09-12T19:14:27.985314+0000","last_fullsized":"2024-09-12T19:14:27.985314+0000","mapping_epoch":30,"log_start":"265'700","ondisk_log_start":"265'700","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'726","last_scrub_stamp":"2024-09-12T19:14:27.984936+0000","last_deep_scrub":"265'726","last_deep_scrub_stamp":"2024-09-12T19:14:27.984936+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.984936+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":700,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:24:44.715111+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152409,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1300,"num_read_kb":3120,"num_write":1062,"num_write_kb":918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.147229+0000","last_change":"2024-09-12T19:14:33.147105+0000","last_active":"2024-09-12T19:14:33.147229+0000","last_peered":"2024-09-12T19:14:33.147229+0000","last_clean":"2024-09-12T19:14:33.147229+0000","last_became_active":"2024-09-12T18:26:47.902750+0000","last_became_peered":"2024-09-12T18:26:47.902750+0000","last_unstale":"2024-09-12T19:14:33.147229+0000","last_undegraded":"2024-09-12T19:14:33.147229+0000","last_fullsized":"2024-09-12T19:14:33.147229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:33.146930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:33.146930+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.146930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:58.966836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"265'110","reported_seq":618,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.468204+0000","last_change":"2024-09-12T19:14:37.468204+0000","last_active":"2024-09-12T19:14:37.468204+0000","last_peered":"2024-09-12T19:14:37.468204+0000","last_clean":"2024-09-12T19:14:37.468204+0000","last_became_active":"2024-09-12T18:26:49.919630+0000","last_became_peered":"2024-09-12T18:26:49.919630+0000","last_unstale":"2024-09-12T19:14:37.468204+0000","last_undegraded":"2024-09-12T19:14:37.468204+0000","last_fullsized":"2024-09-12T19:14:37.468204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T19:14:37.468006+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T19:14:37.468006+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.468006+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:00:22.357730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":389,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":145,"num_read_kb":134,"num_write":269,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"265'144","reported_seq":715,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.618175+0000","last_change":"2024-09-12T19:14:38.617914+0000","last_active":"2024-09-12T19:14:38.618175+0000","last_peered":"2024-09-12T19:14:38.618175+0000","last_clean":"2024-09-12T19:14:38.618175+0000","last_became_active":"2024-09-12T18:26:49.912589+0000","last_became_peered":"2024-09-12T18:26:49.912589+0000","last_unstale":"2024-09-12T19:14:38.618175+0000","last_undegraded":"2024-09-12T19:14:38.618175+0000","last_fullsized":"2024-09-12T19:14:38.618175+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T19:14:38.617701+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T19:14:38.617701+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.617701+0000","objects_scrubbed":1,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:12.497842+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":229,"num_read_kb":221,"num_write":317,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"265'914","reported_seq":2543,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.269753+0000","last_change":"2024-09-12T19:14:15.269753+0000","last_active":"2024-09-12T19:14:15.269753+0000","last_peered":"2024-09-12T19:14:15.269753+0000","last_clean":"2024-09-12T19:14:15.269753+0000","last_became_active":"2024-09-12T18:26:41.875870+0000","last_became_peered":"2024-09-12T18:26:41.875870+0000","last_unstale":"2024-09-12T19:14:15.269753+0000","last_undegraded":"2024-09-12T19:14:15.269753+0000","last_fullsized":"2024-09-12T19:14:15.269753+0000","mapping_epoch":26,"log_start":"265'900","ondisk_log_start":"265'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'914","last_scrub_stamp":"2024-09-12T19:14:15.269571+0000","last_deep_scrub":"265'914","last_deep_scrub_stamp":"2024-09-12T19:14:15.269571+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.269571+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":900,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:16.227806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4445,"num_read_kb":3959,"num_write":1252,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"265'311","reported_seq":958,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.359664+0000","last_change":"2024-09-12T19:14:05.359664+0000","last_active":"2024-09-12T19:14:05.359664+0000","last_peered":"2024-09-12T19:14:05.359664+0000","last_clean":"2024-09-12T19:14:05.359664+0000","last_became_active":"2024-09-12T18:26:39.870576+0000","last_became_peered":"2024-09-12T18:26:39.870576+0000","last_unstale":"2024-09-12T19:14:05.359664+0000","last_undegraded":"2024-09-12T19:14:05.359664+0000","last_fullsized":"2024-09-12T19:14:05.359664+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'311","last_scrub_stamp":"2024-09-12T19:14:05.359443+0000","last_deep_scrub":"265'311","last_deep_scrub_stamp":"2024-09-12T19:14:05.359443+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.359443+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:08.218478+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194345,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":31608,"num_write":917,"num_write_kb":54582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.194115+0000","last_change":"2024-09-12T19:14:16.194115+0000","last_active":"2024-09-12T19:14:16.194115+0000","last_peered":"2024-09-12T19:14:16.194115+0000","last_clean":"2024-09-12T19:14:16.194115+0000","last_became_active":"2024-09-12T18:26:43.864969+0000","last_became_peered":"2024-09-12T18:26:43.864969+0000","last_unstale":"2024-09-12T19:14:16.194115+0000","last_undegraded":"2024-09-12T19:14:16.194115+0000","last_fullsized":"2024-09-12T19:14:16.194115+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:16.193928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:16.193928+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.193928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:33:14.944724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"265'281","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:31.112064+0000","last_change":"2024-09-12T19:14:31.112064+0000","last_active":"2024-09-12T19:14:31.112064+0000","last_peered":"2024-09-12T19:14:31.112064+0000","last_clean":"2024-09-12T19:14:31.112064+0000","last_became_active":"2024-09-12T18:26:45.865329+0000","last_became_peered":"2024-09-12T18:26:45.865329+0000","last_unstale":"2024-09-12T19:14:31.112064+0000","last_undegraded":"2024-09-12T19:14:31.112064+0000","last_fullsized":"2024-09-12T19:14:31.112064+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'281","last_scrub_stamp":"2024-09-12T19:14:31.111802+0000","last_deep_scrub":"265'281","last_deep_scrub_stamp":"2024-09-12T19:14:31.111802+0000","last_clean_scrub_stamp":"2024-09-12T19:14:31.111802+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:30:31.456814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47061,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":469,"num_read_kb":1095,"num_write":382,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:42.132452+0000","last_change":"2024-09-12T19:14:42.132452+0000","last_active":"2024-09-12T19:14:42.132452+0000","last_peered":"2024-09-12T19:14:42.132452+0000","last_clean":"2024-09-12T19:14:42.132452+0000","last_became_active":"2024-09-12T18:26:47.890741+0000","last_became_peered":"2024-09-12T18:26:47.890741+0000","last_unstale":"2024-09-12T19:14:42.132452+0000","last_undegraded":"2024-09-12T19:14:42.132452+0000","last_fullsized":"2024-09-12T19:14:42.132452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:42.132277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:42.132277+0000","last_clean_scrub_stamp":"2024-09-12T19:14:42.132277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:17.240518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"265'198","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:44.120514+0000","last_change":"2024-09-12T19:14:44.120282+0000","last_active":"2024-09-12T19:14:44.120514+0000","last_peered":"2024-09-12T19:14:44.120514+0000","last_clean":"2024-09-12T19:14:44.120514+0000","last_became_active":"2024-09-12T18:26:49.914506+0000","last_became_peered":"2024-09-12T18:26:49.914506+0000","last_unstale":"2024-09-12T19:14:44.120514+0000","last_undegraded":"2024-09-12T19:14:44.120514+0000","last_fullsized":"2024-09-12T19:14:44.120514+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'198","last_scrub_stamp":"2024-09-12T19:14:44.120062+0000","last_deep_scrub":"265'198","last_deep_scrub_stamp":"2024-09-12T19:14:44.120062+0000","last_clean_scrub_stamp":"2024-09-12T19:14:44.120062+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:00:37.857137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":429,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":174,"num_read_kb":157,"num_write":456,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"265'903","reported_seq":2447,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.072876+0000","last_change":"2024-09-12T19:14:11.072876+0000","last_active":"2024-09-12T19:14:11.072876+0000","last_peered":"2024-09-12T19:14:11.072876+0000","last_clean":"2024-09-12T19:14:11.072876+0000","last_became_active":"2024-09-12T18:26:41.868082+0000","last_became_peered":"2024-09-12T18:26:41.868082+0000","last_unstale":"2024-09-12T19:14:11.072876+0000","last_undegraded":"2024-09-12T19:14:11.072876+0000","last_fullsized":"2024-09-12T19:14:11.072876+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'903","last_scrub_stamp":"2024-09-12T19:14:11.072670+0000","last_deep_scrub":"265'903","last_deep_scrub_stamp":"2024-09-12T19:14:11.072670+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.072670+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":800,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:29.244238+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4276,"num_read_kb":3807,"num_write":1253,"num_write_kb":541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"265'386","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.818826+0000","last_change":"2024-09-12T19:14:11.818692+0000","last_active":"2024-09-12T19:14:11.818826+0000","last_peered":"2024-09-12T19:14:11.818826+0000","last_clean":"2024-09-12T19:14:11.818826+0000","last_became_active":"2024-09-12T18:26:39.869754+0000","last_became_peered":"2024-09-12T18:26:39.869754+0000","last_unstale":"2024-09-12T19:14:11.818826+0000","last_undegraded":"2024-09-12T19:14:11.818826+0000","last_fullsized":"2024-09-12T19:14:11.818826+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T19:14:11.818493+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T19:14:11.818493+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.818493+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:10:30.957800+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525344,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":520,"num_read_kb":32033,"num_write":1221,"num_write_kb":47606,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"265'6","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:23.088539+0000","last_change":"2024-09-12T19:14:23.088539+0000","last_active":"2024-09-12T19:14:23.088539+0000","last_peered":"2024-09-12T19:14:23.088539+0000","last_clean":"2024-09-12T19:14:23.088539+0000","last_became_active":"2024-09-12T18:26:43.854155+0000","last_became_peered":"2024-09-12T18:26:43.854155+0000","last_unstale":"2024-09-12T19:14:23.088539+0000","last_undegraded":"2024-09-12T19:14:23.088539+0000","last_fullsized":"2024-09-12T19:14:23.088539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T19:14:23.088313+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T19:14:23.088313+0000","last_clean_scrub_stamp":"2024-09-12T19:14:23.088313+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:52:08.243249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"265'70","reported_seq":582,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.634014+0000","last_change":"2024-09-12T19:14:27.634014+0000","last_active":"2024-09-12T19:14:27.634014+0000","last_peered":"2024-09-12T19:14:27.634014+0000","last_clean":"2024-09-12T19:14:27.634014+0000","last_became_active":"2024-09-12T18:26:45.876785+0000","last_became_peered":"2024-09-12T18:26:45.876785+0000","last_unstale":"2024-09-12T19:14:27.634014+0000","last_undegraded":"2024-09-12T19:14:27.634014+0000","last_fullsized":"2024-09-12T19:14:27.634014+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'70","last_scrub_stamp":"2024-09-12T19:14:27.633823+0000","last_deep_scrub":"265'70","last_deep_scrub_stamp":"2024-09-12T19:14:27.633823+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.633823+0000","objects_scrubbed":3,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:21.906210+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.946756+0000","last_change":"2024-09-12T19:14:34.946756+0000","last_active":"2024-09-12T19:14:34.946756+0000","last_peered":"2024-09-12T19:14:34.946756+0000","last_clean":"2024-09-12T19:14:34.946756+0000","last_became_active":"2024-09-12T18:26:47.890879+0000","last_became_peered":"2024-09-12T18:26:47.890879+0000","last_unstale":"2024-09-12T19:14:34.946756+0000","last_undegraded":"2024-09-12T19:14:34.946756+0000","last_fullsized":"2024-09-12T19:14:34.946756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:34.946573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:34.946573+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.946573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:29.143096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"265'242","reported_seq":779,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.586436+0000","last_change":"2024-09-12T19:14:39.586436+0000","last_active":"2024-09-12T19:14:39.586436+0000","last_peered":"2024-09-12T19:14:39.586436+0000","last_clean":"2024-09-12T19:14:39.586436+0000","last_became_active":"2024-09-12T18:26:49.925984+0000","last_became_peered":"2024-09-12T18:26:49.925984+0000","last_unstale":"2024-09-12T19:14:39.586436+0000","last_undegraded":"2024-09-12T19:14:39.586436+0000","last_fullsized":"2024-09-12T19:14:39.586436+0000","mapping_epoch":34,"log_start":"265'200","ondisk_log_start":"265'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'242","last_scrub_stamp":"2024-09-12T19:14:39.586244+0000","last_deep_scrub":"265'242","last_deep_scrub_stamp":"2024-09-12T19:14:39.586244+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.586244+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:53.690239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":350,"num_read_kb":337,"num_write":545,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"265'464","reported_seq":2031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.936402+0000","last_change":"2024-09-12T19:14:17.936402+0000","last_active":"2024-09-12T19:14:17.936402+0000","last_peered":"2024-09-12T19:14:17.936402+0000","last_clean":"2024-09-12T19:14:17.936402+0000","last_became_active":"2024-09-12T18:26:41.881971+0000","last_became_peered":"2024-09-12T18:26:41.881971+0000","last_unstale":"2024-09-12T19:14:17.936402+0000","last_undegraded":"2024-09-12T19:14:17.936402+0000","last_fullsized":"2024-09-12T19:14:17.936402+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'464","last_scrub_stamp":"2024-09-12T19:14:17.936203+0000","last_deep_scrub":"265'464","last_deep_scrub_stamp":"2024-09-12T19:14:17.936203+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.936203+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:55:43.789540+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2569,"num_read_kb":2413,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"265'356","reported_seq":1016,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.537282+0000","last_change":"2024-09-12T19:14:08.537024+0000","last_active":"2024-09-12T19:14:08.537282+0000","last_peered":"2024-09-12T19:14:08.537282+0000","last_clean":"2024-09-12T19:14:08.537282+0000","last_became_active":"2024-09-12T18:26:39.873510+0000","last_became_peered":"2024-09-12T18:26:39.873510+0000","last_unstale":"2024-09-12T19:14:08.537282+0000","last_undegraded":"2024-09-12T19:14:08.537282+0000","last_fullsized":"2024-09-12T19:14:08.537282+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T19:14:08.536754+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T19:14:08.536754+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.536754+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:33:17.499997+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":9367,"num_write":1141,"num_write_kb":22463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.899799+0000","last_change":"2024-09-12T19:14:24.899799+0000","last_active":"2024-09-12T19:14:24.899799+0000","last_peered":"2024-09-12T19:14:24.899799+0000","last_clean":"2024-09-12T19:14:24.899799+0000","last_became_active":"2024-09-12T18:26:43.859847+0000","last_became_peered":"2024-09-12T18:26:43.859847+0000","last_unstale":"2024-09-12T19:14:24.899799+0000","last_undegraded":"2024-09-12T19:14:24.899799+0000","last_fullsized":"2024-09-12T19:14:24.899799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:24.899615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:24.899615+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.899615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:15.801326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"265'323","reported_seq":919,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.159233+0000","last_change":"2024-09-12T19:14:34.159233+0000","last_active":"2024-09-12T19:14:34.159233+0000","last_peered":"2024-09-12T19:14:34.159233+0000","last_clean":"2024-09-12T19:14:34.159233+0000","last_became_active":"2024-09-12T18:26:45.877790+0000","last_became_peered":"2024-09-12T18:26:45.877790+0000","last_unstale":"2024-09-12T19:14:34.159233+0000","last_undegraded":"2024-09-12T19:14:34.159233+0000","last_fullsized":"2024-09-12T19:14:34.159233+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'323","last_scrub_stamp":"2024-09-12T19:14:34.159030+0000","last_deep_scrub":"265'323","last_deep_scrub_stamp":"2024-09-12T19:14:34.159030+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.159030+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:45:12.177367+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53461,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":520,"num_read_kb":1153,"num_write":418,"num_write_kb":315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.660232+0000","last_change":"2024-09-12T19:14:24.660232+0000","last_active":"2024-09-12T19:14:24.660232+0000","last_peered":"2024-09-12T19:14:24.660232+0000","last_clean":"2024-09-12T19:14:24.660232+0000","last_became_active":"2024-09-12T18:26:47.888252+0000","last_became_peered":"2024-09-12T18:26:47.888252+0000","last_unstale":"2024-09-12T19:14:24.660232+0000","last_undegraded":"2024-09-12T19:14:24.660232+0000","last_fullsized":"2024-09-12T19:14:24.660232+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:24.660011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:24.660011+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.660011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:19.539418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"265'147","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:40.421474+0000","last_change":"2024-09-12T19:14:40.421474+0000","last_active":"2024-09-12T19:14:40.421474+0000","last_peered":"2024-09-12T19:14:40.421474+0000","last_clean":"2024-09-12T19:14:40.421474+0000","last_became_active":"2024-09-12T18:26:49.922459+0000","last_became_peered":"2024-09-12T18:26:49.922459+0000","last_unstale":"2024-09-12T19:14:40.421474+0000","last_undegraded":"2024-09-12T19:14:40.421474+0000","last_fullsized":"2024-09-12T19:14:40.421474+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'147","last_scrub_stamp":"2024-09-12T19:14:40.421300+0000","last_deep_scrub":"265'147","last_deep_scrub_stamp":"2024-09-12T19:14:40.421300+0000","last_clean_scrub_stamp":"2024-09-12T19:14:40.421300+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:35.325046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":460,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":156,"num_read_kb":153,"num_write":340,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"265'473","reported_seq":1990,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.139968+0000","last_change":"2024-09-12T19:14:26.139968+0000","last_active":"2024-09-12T19:14:26.139968+0000","last_peered":"2024-09-12T19:14:26.139968+0000","last_clean":"2024-09-12T19:14:26.139968+0000","last_became_active":"2024-09-12T18:26:41.850749+0000","last_became_peered":"2024-09-12T18:26:41.850749+0000","last_unstale":"2024-09-12T19:14:26.139968+0000","last_undegraded":"2024-09-12T19:14:26.139968+0000","last_fullsized":"2024-09-12T19:14:26.139968+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T19:14:26.139906+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T19:14:26.139906+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.139906+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:53:31.076243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2503,"num_read_kb":2331,"num_write":575,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"265'394","reported_seq":1062,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.877935+0000","last_change":"2024-09-12T19:14:04.877872+0000","last_active":"2024-09-12T19:14:04.877935+0000","last_peered":"2024-09-12T19:14:04.877935+0000","last_clean":"2024-09-12T19:14:04.877935+0000","last_became_active":"2024-09-12T18:26:39.854328+0000","last_became_peered":"2024-09-12T18:26:39.854328+0000","last_unstale":"2024-09-12T19:14:04.877935+0000","last_undegraded":"2024-09-12T19:14:04.877935+0000","last_fullsized":"2024-09-12T19:14:04.877935+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T19:14:04.877782+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T19:14:04.877782+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.877782+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:02:04.369955+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1653632,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":578,"num_read_kb":9662,"num_write":1241,"num_write_kb":35097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.636565+0000","last_change":"2024-09-12T19:14:19.636565+0000","last_active":"2024-09-12T19:14:19.636565+0000","last_peered":"2024-09-12T19:14:19.636565+0000","last_clean":"2024-09-12T19:14:19.636565+0000","last_became_active":"2024-09-12T18:26:43.865454+0000","last_became_peered":"2024-09-12T18:26:43.865454+0000","last_unstale":"2024-09-12T19:14:19.636565+0000","last_undegraded":"2024-09-12T19:14:19.636565+0000","last_fullsized":"2024-09-12T19:14:19.636565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:19.636385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:19.636385+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.636385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:25.727508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"265'251","reported_seq":823,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:30.957699+0000","last_change":"2024-09-12T19:14:30.957699+0000","last_active":"2024-09-12T19:14:30.957699+0000","last_peered":"2024-09-12T19:14:30.957699+0000","last_clean":"2024-09-12T19:14:30.957699+0000","last_became_active":"2024-09-12T18:26:45.867096+0000","last_became_peered":"2024-09-12T18:26:45.867096+0000","last_unstale":"2024-09-12T19:14:30.957699+0000","last_undegraded":"2024-09-12T19:14:30.957699+0000","last_fullsized":"2024-09-12T19:14:30.957699+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'251","last_scrub_stamp":"2024-09-12T19:14:30.957445+0000","last_deep_scrub":"265'251","last_deep_scrub_stamp":"2024-09-12T19:14:30.957445+0000","last_clean_scrub_stamp":"2024-09-12T19:14:30.957445+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:47.556501+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50031,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":412,"num_read_kb":948,"num_write":330,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.645346+0000","last_change":"2024-09-12T19:14:37.645346+0000","last_active":"2024-09-12T19:14:37.645346+0000","last_peered":"2024-09-12T19:14:37.645346+0000","last_clean":"2024-09-12T19:14:37.645346+0000","last_became_active":"2024-09-12T18:26:47.895092+0000","last_became_peered":"2024-09-12T18:26:47.895092+0000","last_unstale":"2024-09-12T19:14:37.645346+0000","last_undegraded":"2024-09-12T19:14:37.645346+0000","last_fullsized":"2024-09-12T19:14:37.645346+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:37.645167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:37.645167+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.645167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:19:11.713611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"265'824","reported_seq":2431,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.626437+0000","last_change":"2024-09-12T19:14:13.626256+0000","last_active":"2024-09-12T19:14:13.626437+0000","last_peered":"2024-09-12T19:14:13.626437+0000","last_clean":"2024-09-12T19:14:13.626437+0000","last_became_active":"2024-09-12T18:26:41.871943+0000","last_became_peered":"2024-09-12T18:26:41.871943+0000","last_unstale":"2024-09-12T19:14:13.626437+0000","last_undegraded":"2024-09-12T19:14:13.626437+0000","last_fullsized":"2024-09-12T19:14:13.626437+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'824","last_scrub_stamp":"2024-09-12T19:14:13.626053+0000","last_deep_scrub":"265'824","last_deep_scrub_stamp":"2024-09-12T19:14:13.626053+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.626053+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:14:44.562273+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3898,"num_read_kb":3510,"num_write":1047,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":465,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"265'395","reported_seq":1100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.825280+0000","last_change":"2024-09-12T19:14:12.825137+0000","last_active":"2024-09-12T19:14:12.825280+0000","last_peered":"2024-09-12T19:14:12.825280+0000","last_clean":"2024-09-12T19:14:12.825280+0000","last_became_active":"2024-09-12T18:26:39.830963+0000","last_became_peered":"2024-09-12T18:26:39.830963+0000","last_unstale":"2024-09-12T19:14:12.825280+0000","last_undegraded":"2024-09-12T19:14:12.825280+0000","last_fullsized":"2024-09-12T19:14:12.825280+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'395","last_scrub_stamp":"2024-09-12T19:14:12.824911+0000","last_deep_scrub":"265'395","last_deep_scrub_stamp":"2024-09-12T19:14:12.824911+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.824911+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:01:52.488076+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1535921,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":629,"num_read_kb":35487,"num_write":1279,"num_write_kb":27084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.765053+0000","last_change":"2024-09-12T19:14:16.764872+0000","last_active":"2024-09-12T19:14:16.765053+0000","last_peered":"2024-09-12T19:14:16.765053+0000","last_clean":"2024-09-12T19:14:16.765053+0000","last_became_active":"2024-09-12T18:26:43.861521+0000","last_became_peered":"2024-09-12T18:26:43.861521+0000","last_unstale":"2024-09-12T19:14:16.765053+0000","last_undegraded":"2024-09-12T19:14:16.765053+0000","last_fullsized":"2024-09-12T19:14:16.765053+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:16.764692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:16.764692+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.764692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:50.424087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"265'455","reported_seq":1094,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.104481+0000","last_change":"2024-09-12T19:14:28.104481+0000","last_active":"2024-09-12T19:14:28.104481+0000","last_peered":"2024-09-12T19:14:28.104481+0000","last_clean":"2024-09-12T19:14:28.104481+0000","last_became_active":"2024-09-12T18:26:45.872177+0000","last_became_peered":"2024-09-12T18:26:45.872177+0000","last_unstale":"2024-09-12T19:14:28.104481+0000","last_undegraded":"2024-09-12T19:14:28.104481+0000","last_fullsized":"2024-09-12T19:14:28.104481+0000","mapping_epoch":30,"log_start":"265'400","ondisk_log_start":"265'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'455","last_scrub_stamp":"2024-09-12T19:14:28.104260+0000","last_deep_scrub":"265'455","last_deep_scrub_stamp":"2024-09-12T19:14:28.104260+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.104260+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:40:34.205526+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101880,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":818,"num_read_kb":1923,"num_write":698,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.440404+0000","last_change":"2024-09-12T19:14:33.440404+0000","last_active":"2024-09-12T19:14:33.440404+0000","last_peered":"2024-09-12T19:14:33.440404+0000","last_clean":"2024-09-12T19:14:33.440404+0000","last_became_active":"2024-09-12T18:26:47.902702+0000","last_became_peered":"2024-09-12T18:26:47.902702+0000","last_unstale":"2024-09-12T19:14:33.440404+0000","last_undegraded":"2024-09-12T19:14:33.440404+0000","last_fullsized":"2024-09-12T19:14:33.440404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:33.440225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:33.440225+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.440225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:20:15.909780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"265'192","reported_seq":707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:45.160203+0000","last_change":"2024-09-12T19:14:45.160203+0000","last_active":"2024-09-12T19:14:45.160203+0000","last_peered":"2024-09-12T19:14:45.160203+0000","last_clean":"2024-09-12T19:14:45.160203+0000","last_became_active":"2024-09-12T18:26:49.920066+0000","last_became_peered":"2024-09-12T18:26:49.920066+0000","last_unstale":"2024-09-12T19:14:45.160203+0000","last_undegraded":"2024-09-12T19:14:45.160203+0000","last_fullsized":"2024-09-12T19:14:45.160203+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'192","last_scrub_stamp":"2024-09-12T19:14:45.159929+0000","last_deep_scrub":"265'192","last_deep_scrub_stamp":"2024-09-12T19:14:45.159929+0000","last_clean_scrub_stamp":"2024-09-12T19:14:45.159929+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:13.869016+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1488,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":247,"num_read_kb":248,"num_write":459,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"265'766","reported_seq":2252,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.780295+0000","last_change":"2024-09-12T19:14:13.780033+0000","last_active":"2024-09-12T19:14:13.780295+0000","last_peered":"2024-09-12T19:14:13.780295+0000","last_clean":"2024-09-12T19:14:13.780295+0000","last_became_active":"2024-09-12T18:26:41.852157+0000","last_became_peered":"2024-09-12T18:26:41.852157+0000","last_unstale":"2024-09-12T19:14:13.780295+0000","last_undegraded":"2024-09-12T19:14:13.780295+0000","last_fullsized":"2024-09-12T19:14:13.780295+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'766","last_scrub_stamp":"2024-09-12T19:14:13.779803+0000","last_deep_scrub":"265'766","last_deep_scrub_stamp":"2024-09-12T19:14:13.779803+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.779803+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":700,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:21:23.013752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3590,"num_read_kb":3230,"num_write":1002,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"265'359","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:04.109369+0000","last_change":"2024-09-12T19:14:04.109273+0000","last_active":"2024-09-12T19:14:04.109369+0000","last_peered":"2024-09-12T19:14:04.109369+0000","last_clean":"2024-09-12T19:14:04.109369+0000","last_became_active":"2024-09-12T18:27:11.827218+0000","last_became_peered":"2024-09-12T18:27:11.827218+0000","last_unstale":"2024-09-12T19:14:04.109369+0000","last_undegraded":"2024-09-12T19:14:04.109369+0000","last_fullsized":"2024-09-12T19:14:04.109369+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-12T19:14:04.109120+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-12T19:14:04.109120+0000","last_clean_scrub_stamp":"2024-09-12T19:14:04.109120+0000","objects_scrubbed":7,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:11.700071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35618,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":7368,"num_write":1157,"num_write_kb":18791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.620363+0000","last_change":"2024-09-12T19:14:20.620223+0000","last_active":"2024-09-12T19:14:20.620363+0000","last_peered":"2024-09-12T19:14:20.620363+0000","last_clean":"2024-09-12T19:14:20.620363+0000","last_became_active":"2024-09-12T18:26:43.865319+0000","last_became_peered":"2024-09-12T18:26:43.865319+0000","last_unstale":"2024-09-12T19:14:20.620363+0000","last_undegraded":"2024-09-12T19:14:20.620363+0000","last_fullsized":"2024-09-12T19:14:20.620363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:20.620033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:20.620033+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.620033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:07:41.034438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"265'305","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:33.971413+0000","last_change":"2024-09-12T19:14:33.971413+0000","last_active":"2024-09-12T19:14:33.971413+0000","last_peered":"2024-09-12T19:14:33.971413+0000","last_clean":"2024-09-12T19:14:33.971413+0000","last_became_active":"2024-09-12T18:26:45.873197+0000","last_became_peered":"2024-09-12T18:26:45.873197+0000","last_unstale":"2024-09-12T19:14:33.971413+0000","last_undegraded":"2024-09-12T19:14:33.971413+0000","last_fullsized":"2024-09-12T19:14:33.971413+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T19:14:33.971112+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T19:14:33.971112+0000","last_clean_scrub_stamp":"2024-09-12T19:14:33.971112+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:22:32.411051+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55940,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":484,"num_read_kb":1049,"num_write":402,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.125907+0000","last_change":"2024-09-12T19:14:26.125907+0000","last_active":"2024-09-12T19:14:26.125907+0000","last_peered":"2024-09-12T19:14:26.125907+0000","last_clean":"2024-09-12T19:14:26.125907+0000","last_became_active":"2024-09-12T18:26:47.883930+0000","last_became_peered":"2024-09-12T18:26:47.883930+0000","last_unstale":"2024-09-12T19:14:26.125907+0000","last_undegraded":"2024-09-12T19:14:26.125907+0000","last_fullsized":"2024-09-12T19:14:26.125907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.125835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.125835+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.125835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:41.323040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"265'185","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:29.621808+0000","last_change":"2024-09-12T19:14:29.621808+0000","last_active":"2024-09-12T19:14:29.621808+0000","last_peered":"2024-09-12T19:14:29.621808+0000","last_clean":"2024-09-12T19:14:29.621808+0000","last_became_active":"2024-09-12T18:26:49.921797+0000","last_became_peered":"2024-09-12T18:26:49.921797+0000","last_unstale":"2024-09-12T19:14:29.621808+0000","last_undegraded":"2024-09-12T19:14:29.621808+0000","last_fullsized":"2024-09-12T19:14:29.621808+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'185","last_scrub_stamp":"2024-09-12T19:14:29.621585+0000","last_deep_scrub":"265'185","last_deep_scrub_stamp":"2024-09-12T19:14:29.621585+0000","last_clean_scrub_stamp":"2024-09-12T19:14:29.621585+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:37.942287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1230,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":213,"num_write":519,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"265'510","reported_seq":1866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.874616+0000","last_change":"2024-09-12T19:14:14.874616+0000","last_active":"2024-09-12T19:14:14.874616+0000","last_peered":"2024-09-12T19:14:14.874616+0000","last_clean":"2024-09-12T19:14:14.874616+0000","last_became_active":"2024-09-12T18:26:41.850647+0000","last_became_peered":"2024-09-12T18:26:41.850647+0000","last_unstale":"2024-09-12T19:14:14.874616+0000","last_undegraded":"2024-09-12T19:14:14.874616+0000","last_fullsized":"2024-09-12T19:14:14.874616+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'510","last_scrub_stamp":"2024-09-12T19:14:14.874432+0000","last_deep_scrub":"265'510","last_deep_scrub_stamp":"2024-09-12T19:14:14.874432+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.874432+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:02:42.100953+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2601,"num_read_kb":2444,"num_write":714,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"265'370","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.335302+0000","last_change":"2024-09-12T19:14:06.335158+0000","last_active":"2024-09-12T19:14:06.335302+0000","last_peered":"2024-09-12T19:14:06.335302+0000","last_clean":"2024-09-12T19:14:06.335302+0000","last_became_active":"2024-09-12T18:26:39.840458+0000","last_became_peered":"2024-09-12T18:26:39.840458+0000","last_unstale":"2024-09-12T19:14:06.335302+0000","last_undegraded":"2024-09-12T19:14:06.335302+0000","last_fullsized":"2024-09-12T19:14:06.335302+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'370","last_scrub_stamp":"2024-09-12T19:14:06.334888+0000","last_deep_scrub":"265'370","last_deep_scrub_stamp":"2024-09-12T19:14:06.334888+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.334888+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:21:55.530203+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":36107,"num_write":1118,"num_write_kb":45658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.397690+0000","last_change":"2024-09-12T19:14:28.397690+0000","last_active":"2024-09-12T19:14:28.397690+0000","last_peered":"2024-09-12T19:14:28.397690+0000","last_clean":"2024-09-12T19:14:28.397690+0000","last_became_active":"2024-09-12T18:26:43.873669+0000","last_became_peered":"2024-09-12T18:26:43.873669+0000","last_unstale":"2024-09-12T19:14:28.397690+0000","last_undegraded":"2024-09-12T19:14:28.397690+0000","last_fullsized":"2024-09-12T19:14:28.397690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:28.397489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:28.397489+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.397489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:59:00.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"265'289","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.133092+0000","last_change":"2024-09-12T19:14:32.132819+0000","last_active":"2024-09-12T19:14:32.133092+0000","last_peered":"2024-09-12T19:14:32.133092+0000","last_clean":"2024-09-12T19:14:32.133092+0000","last_became_active":"2024-09-12T18:26:46.023025+0000","last_became_peered":"2024-09-12T18:26:46.023025+0000","last_unstale":"2024-09-12T19:14:32.133092+0000","last_undegraded":"2024-09-12T19:14:32.133092+0000","last_fullsized":"2024-09-12T19:14:32.133092+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'289","last_scrub_stamp":"2024-09-12T19:14:32.132594+0000","last_deep_scrub":"265'289","last_deep_scrub_stamp":"2024-09-12T19:14:32.132594+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.132594+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:06.506994+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44021,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":1142,"num_write":398,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.084987+0000","last_change":"2024-09-12T19:14:27.084809+0000","last_active":"2024-09-12T19:14:27.084987+0000","last_peered":"2024-09-12T19:14:27.084987+0000","last_clean":"2024-09-12T19:14:27.084987+0000","last_became_active":"2024-09-12T18:26:47.892678+0000","last_became_peered":"2024-09-12T18:26:47.892678+0000","last_unstale":"2024-09-12T19:14:27.084987+0000","last_undegraded":"2024-09-12T19:14:27.084987+0000","last_fullsized":"2024-09-12T19:14:27.084987+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:27.084634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:27.084634+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.084634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:10:09.082275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"265'117","reported_seq":608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.465745+0000","last_change":"2024-09-12T19:14:38.465745+0000","last_active":"2024-09-12T19:14:38.465745+0000","last_peered":"2024-09-12T19:14:38.465745+0000","last_clean":"2024-09-12T19:14:38.465745+0000","last_became_active":"2024-09-12T18:26:49.919229+0000","last_became_peered":"2024-09-12T18:26:49.919229+0000","last_unstale":"2024-09-12T19:14:38.465745+0000","last_undegraded":"2024-09-12T19:14:38.465745+0000","last_fullsized":"2024-09-12T19:14:38.465745+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'117","last_scrub_stamp":"2024-09-12T19:14:38.465553+0000","last_deep_scrub":"265'117","last_deep_scrub_stamp":"2024-09-12T19:14:38.465553+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.465553+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:15:11.984486+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":97,"num_read_kb":95,"num_write":270,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"265'505","reported_seq":2215,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.051477+0000","last_change":"2024-09-12T19:14:09.051264+0000","last_active":"2024-09-12T19:14:09.051477+0000","last_peered":"2024-09-12T19:14:09.051477+0000","last_clean":"2024-09-12T19:14:09.051477+0000","last_became_active":"2024-09-12T18:26:41.844608+0000","last_became_peered":"2024-09-12T18:26:41.844608+0000","last_unstale":"2024-09-12T19:14:09.051477+0000","last_undegraded":"2024-09-12T19:14:09.051477+0000","last_fullsized":"2024-09-12T19:14:09.051477+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'505","last_scrub_stamp":"2024-09-12T19:14:09.051011+0000","last_deep_scrub":"265'505","last_deep_scrub_stamp":"2024-09-12T19:14:09.051011+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.051011+0000","objects_scrubbed":2,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:05.391256+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2752,"num_read_kb":2596,"num_write":594,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"265'356","reported_seq":994,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.038812+0000","last_change":"2024-09-12T19:14:05.038747+0000","last_active":"2024-09-12T19:14:05.038812+0000","last_peered":"2024-09-12T19:14:05.038812+0000","last_clean":"2024-09-12T19:14:05.038812+0000","last_became_active":"2024-09-12T18:27:11.807022+0000","last_became_peered":"2024-09-12T18:27:11.807022+0000","last_unstale":"2024-09-12T19:14:05.038812+0000","last_undegraded":"2024-09-12T19:14:05.038812+0000","last_fullsized":"2024-09-12T19:14:05.038812+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T19:14:05.038645+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T19:14:05.038645+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.038645+0000","objects_scrubbed":10,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:35.165624+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4711351,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":491,"num_read_kb":61134,"num_write":1039,"num_write_kb":46178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.189124+0000","last_change":"2024-09-12T19:14:18.189124+0000","last_active":"2024-09-12T19:14:18.189124+0000","last_peered":"2024-09-12T19:14:18.189124+0000","last_clean":"2024-09-12T19:14:18.189124+0000","last_became_active":"2024-09-12T18:26:43.859997+0000","last_became_peered":"2024-09-12T18:26:43.859997+0000","last_unstale":"2024-09-12T19:14:18.189124+0000","last_undegraded":"2024-09-12T19:14:18.189124+0000","last_fullsized":"2024-09-12T19:14:18.189124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:18.188935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:18.188935+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.188935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:37.056353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"265'97","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.465679+0000","last_change":"2024-09-12T19:14:32.465536+0000","last_active":"2024-09-12T19:14:32.465679+0000","last_peered":"2024-09-12T19:14:32.465679+0000","last_clean":"2024-09-12T19:14:32.465679+0000","last_became_active":"2024-09-12T18:26:46.022246+0000","last_became_peered":"2024-09-12T18:26:46.022246+0000","last_unstale":"2024-09-12T19:14:32.465679+0000","last_undegraded":"2024-09-12T19:14:32.465679+0000","last_fullsized":"2024-09-12T19:14:32.465679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'97","last_scrub_stamp":"2024-09-12T19:14:32.465307+0000","last_deep_scrub":"265'97","last_deep_scrub_stamp":"2024-09-12T19:14:32.465307+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.465307+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:58.419382+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":115,"num_read_kb":110,"num_write":130,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"265'771","reported_seq":2319,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.623054+0000","last_change":"2024-09-12T19:14:26.622931+0000","last_active":"2024-09-12T19:14:26.623054+0000","last_peered":"2024-09-12T19:14:26.623054+0000","last_clean":"2024-09-12T19:14:26.623054+0000","last_became_active":"2024-09-12T18:26:47.891107+0000","last_became_peered":"2024-09-12T18:26:47.891107+0000","last_unstale":"2024-09-12T19:14:26.623054+0000","last_undegraded":"2024-09-12T19:14:26.623054+0000","last_fullsized":"2024-09-12T19:14:26.623054+0000","mapping_epoch":32,"log_start":"265'701","ondisk_log_start":"265'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'771","last_scrub_stamp":"2024-09-12T19:14:26.622749+0000","last_deep_scrub":"265'771","last_deep_scrub_stamp":"2024-09-12T19:14:26.622749+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.622749+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":701,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:47.744229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"265'115","reported_seq":612,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.951554+0000","last_change":"2024-09-12T19:14:37.951554+0000","last_active":"2024-09-12T19:14:37.951554+0000","last_peered":"2024-09-12T19:14:37.951554+0000","last_clean":"2024-09-12T19:14:37.951554+0000","last_became_active":"2024-09-12T18:26:49.915975+0000","last_became_peered":"2024-09-12T18:26:49.915975+0000","last_unstale":"2024-09-12T19:14:37.951554+0000","last_undegraded":"2024-09-12T19:14:37.951554+0000","last_fullsized":"2024-09-12T19:14:37.951554+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'115","last_scrub_stamp":"2024-09-12T19:14:37.951350+0000","last_deep_scrub":"265'115","last_deep_scrub_stamp":"2024-09-12T19:14:37.951350+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.951350+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:04.237891+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":276,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"265'459","reported_seq":2189,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.267997+0000","last_change":"2024-09-12T19:14:17.267997+0000","last_active":"2024-09-12T19:14:17.267997+0000","last_peered":"2024-09-12T19:14:17.267997+0000","last_clean":"2024-09-12T19:14:17.267997+0000","last_became_active":"2024-09-12T18:26:41.853112+0000","last_became_peered":"2024-09-12T18:26:41.853112+0000","last_unstale":"2024-09-12T19:14:17.267997+0000","last_undegraded":"2024-09-12T19:14:17.267997+0000","last_fullsized":"2024-09-12T19:14:17.267997+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'459","last_scrub_stamp":"2024-09-12T19:14:17.267770+0000","last_deep_scrub":"265'459","last_deep_scrub_stamp":"2024-09-12T19:14:17.267770+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.267770+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:16:48.144249+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2668,"num_read_kb":2539,"num_write":529,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"265'386","reported_seq":1024,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.623237+0000","last_change":"2024-09-12T19:14:10.623072+0000","last_active":"2024-09-12T19:14:10.623237+0000","last_peered":"2024-09-12T19:14:10.623237+0000","last_clean":"2024-09-12T19:14:10.623237+0000","last_became_active":"2024-09-12T18:26:39.867136+0000","last_became_peered":"2024-09-12T18:26:39.867136+0000","last_unstale":"2024-09-12T19:14:10.623237+0000","last_undegraded":"2024-09-12T19:14:10.623237+0000","last_fullsized":"2024-09-12T19:14:10.623237+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T19:14:10.622850+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T19:14:10.622850+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.622850+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:23:12.986847+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":531,"num_read_kb":14806,"num_write":1141,"num_write_kb":34226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:26.948462+0000","last_change":"2024-09-12T19:14:26.948462+0000","last_active":"2024-09-12T19:14:26.948462+0000","last_peered":"2024-09-12T19:14:26.948462+0000","last_clean":"2024-09-12T19:14:26.948462+0000","last_became_active":"2024-09-12T18:26:43.876801+0000","last_became_peered":"2024-09-12T18:26:43.876801+0000","last_unstale":"2024-09-12T19:14:26.948462+0000","last_undegraded":"2024-09-12T19:14:26.948462+0000","last_fullsized":"2024-09-12T19:14:26.948462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:26.948178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:26.948178+0000","last_clean_scrub_stamp":"2024-09-12T19:14:26.948178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:06.096405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"265'301","reported_seq":888,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.448655+0000","last_change":"2024-09-12T19:14:34.448405+0000","last_active":"2024-09-12T19:14:34.448655+0000","last_peered":"2024-09-12T19:14:34.448655+0000","last_clean":"2024-09-12T19:14:34.448655+0000","last_became_active":"2024-09-12T18:26:45.872458+0000","last_became_peered":"2024-09-12T18:26:45.872458+0000","last_unstale":"2024-09-12T19:14:34.448655+0000","last_undegraded":"2024-09-12T19:14:34.448655+0000","last_fullsized":"2024-09-12T19:14:34.448655+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'301","last_scrub_stamp":"2024-09-12T19:14:34.448139+0000","last_deep_scrub":"265'301","last_deep_scrub_stamp":"2024-09-12T19:14:34.448139+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.448139+0000","objects_scrubbed":7,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:34.342174+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48239,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":1098,"num_write":396,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:32.612263+0000","last_change":"2024-09-12T19:14:32.612118+0000","last_active":"2024-09-12T19:14:32.612263+0000","last_peered":"2024-09-12T19:14:32.612263+0000","last_clean":"2024-09-12T19:14:32.612263+0000","last_became_active":"2024-09-12T18:26:47.894689+0000","last_became_peered":"2024-09-12T18:26:47.894689+0000","last_unstale":"2024-09-12T19:14:32.612263+0000","last_undegraded":"2024-09-12T19:14:32.612263+0000","last_fullsized":"2024-09-12T19:14:32.612263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:32.611933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:32.611933+0000","last_clean_scrub_stamp":"2024-09-12T19:14:32.611933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:14.342442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"265'126","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.933316+0000","last_change":"2024-09-12T19:14:39.933153+0000","last_active":"2024-09-12T19:14:39.933316+0000","last_peered":"2024-09-12T19:14:39.933316+0000","last_clean":"2024-09-12T19:14:39.933316+0000","last_became_active":"2024-09-12T18:26:49.930794+0000","last_became_peered":"2024-09-12T18:26:49.930794+0000","last_unstale":"2024-09-12T19:14:39.933316+0000","last_undegraded":"2024-09-12T19:14:39.933316+0000","last_fullsized":"2024-09-12T19:14:39.933316+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T19:14:39.932971+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T19:14:39.932971+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.932971+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:38:37.505049+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":295,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"265'615","reported_seq":2283,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.306673+0000","last_change":"2024-09-12T19:14:16.306673+0000","last_active":"2024-09-12T19:14:16.306673+0000","last_peered":"2024-09-12T19:14:16.306673+0000","last_clean":"2024-09-12T19:14:16.306673+0000","last_became_active":"2024-09-12T18:26:41.856621+0000","last_became_peered":"2024-09-12T18:26:41.856621+0000","last_unstale":"2024-09-12T19:14:16.306673+0000","last_undegraded":"2024-09-12T19:14:16.306673+0000","last_fullsized":"2024-09-12T19:14:16.306673+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'615","last_scrub_stamp":"2024-09-12T19:14:16.306444+0000","last_deep_scrub":"265'615","last_deep_scrub_stamp":"2024-09-12T19:14:16.306444+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.306444+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:27.035273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3116,"num_read_kb":2841,"num_write":759,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"265'350","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.527370+0000","last_change":"2024-09-12T19:14:07.527194+0000","last_active":"2024-09-12T19:14:07.527370+0000","last_peered":"2024-09-12T19:14:07.527370+0000","last_clean":"2024-09-12T19:14:07.527370+0000","last_became_active":"2024-09-12T18:26:39.861108+0000","last_became_peered":"2024-09-12T18:26:39.861108+0000","last_unstale":"2024-09-12T19:14:07.527370+0000","last_undegraded":"2024-09-12T19:14:07.527370+0000","last_fullsized":"2024-09-12T19:14:07.527370+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'350","last_scrub_stamp":"2024-09-12T19:14:07.526998+0000","last_deep_scrub":"265'350","last_deep_scrub_stamp":"2024-09-12T19:14:07.526998+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.526998+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:41.778291+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":32271,"num_write":997,"num_write_kb":22718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:28.351092+0000","last_change":"2024-09-12T19:14:28.351092+0000","last_active":"2024-09-12T19:14:28.351092+0000","last_peered":"2024-09-12T19:14:28.351092+0000","last_clean":"2024-09-12T19:14:28.351092+0000","last_became_active":"2024-09-12T18:26:43.860336+0000","last_became_peered":"2024-09-12T18:26:43.860336+0000","last_unstale":"2024-09-12T19:14:28.351092+0000","last_undegraded":"2024-09-12T19:14:28.351092+0000","last_fullsized":"2024-09-12T19:14:28.351092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:28.350811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:28.350811+0000","last_clean_scrub_stamp":"2024-09-12T19:14:28.350811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:47:11.124551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"265'289","reported_seq":867,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.609130+0000","last_change":"2024-09-12T19:14:25.608971+0000","last_active":"2024-09-12T19:14:25.609130+0000","last_peered":"2024-09-12T19:14:25.609130+0000","last_clean":"2024-09-12T19:14:25.609130+0000","last_became_active":"2024-09-12T18:26:45.881364+0000","last_became_peered":"2024-09-12T18:26:45.881364+0000","last_unstale":"2024-09-12T19:14:25.609130+0000","last_undegraded":"2024-09-12T19:14:25.609130+0000","last_fullsized":"2024-09-12T19:14:25.609130+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'289","last_scrub_stamp":"2024-09-12T19:14:25.608758+0000","last_deep_scrub":"265'289","last_deep_scrub_stamp":"2024-09-12T19:14:25.608758+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.608758+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:43:03.024276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":463,"num_read_kb":1088,"num_write":384,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:25.618240+0000","last_change":"2024-09-12T19:14:25.618093+0000","last_active":"2024-09-12T19:14:25.618240+0000","last_peered":"2024-09-12T19:14:25.618240+0000","last_clean":"2024-09-12T19:14:25.618240+0000","last_became_active":"2024-09-12T18:26:47.888055+0000","last_became_peered":"2024-09-12T18:26:47.888055+0000","last_unstale":"2024-09-12T19:14:25.618240+0000","last_undegraded":"2024-09-12T19:14:25.618240+0000","last_fullsized":"2024-09-12T19:14:25.618240+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:25.617917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:25.617917+0000","last_clean_scrub_stamp":"2024-09-12T19:14:25.617917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:05:04.933570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"265'127","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:41.153563+0000","last_change":"2024-09-12T19:14:41.153413+0000","last_active":"2024-09-12T19:14:41.153563+0000","last_peered":"2024-09-12T19:14:41.153563+0000","last_clean":"2024-09-12T19:14:41.153563+0000","last_became_active":"2024-09-12T18:26:49.922543+0000","last_became_peered":"2024-09-12T18:26:49.922543+0000","last_unstale":"2024-09-12T19:14:41.153563+0000","last_undegraded":"2024-09-12T19:14:41.153563+0000","last_fullsized":"2024-09-12T19:14:41.153563+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-12T19:14:41.153225+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-12T19:14:41.153225+0000","last_clean_scrub_stamp":"2024-09-12T19:14:41.153225+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:45:36.199893+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":221,"num_read_kb":203,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"265'473","reported_seq":2068,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.005020+0000","last_change":"2024-09-12T19:14:21.004828+0000","last_active":"2024-09-12T19:14:21.005020+0000","last_peered":"2024-09-12T19:14:21.005020+0000","last_clean":"2024-09-12T19:14:21.005020+0000","last_became_active":"2024-09-12T18:26:41.850499+0000","last_became_peered":"2024-09-12T18:26:41.850499+0000","last_unstale":"2024-09-12T19:14:21.005020+0000","last_undegraded":"2024-09-12T19:14:21.005020+0000","last_fullsized":"2024-09-12T19:14:21.005020+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'473","last_scrub_stamp":"2024-09-12T19:14:21.004635+0000","last_deep_scrub":"265'473","last_deep_scrub_stamp":"2024-09-12T19:14:21.004635+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.004635+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:17.985937+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2536,"num_read_kb":2375,"num_write":558,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2075,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"265'330","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.924005+0000","last_change":"2024-09-12T19:14:15.923865+0000","last_active":"2024-09-12T19:14:15.924005+0000","last_peered":"2024-09-12T19:14:15.924005+0000","last_clean":"2024-09-12T19:14:15.924005+0000","last_became_active":"2024-09-12T18:26:39.847422+0000","last_became_peered":"2024-09-12T18:26:39.847422+0000","last_unstale":"2024-09-12T19:14:15.924005+0000","last_undegraded":"2024-09-12T19:14:15.924005+0000","last_fullsized":"2024-09-12T19:14:15.924005+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T19:14:15.923637+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T19:14:15.923637+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.923637+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:08.399373+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568138,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":435,"num_read_kb":20074,"num_write":1068,"num_write_kb":42638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:27.378548+0000","last_change":"2024-09-12T19:14:27.378417+0000","last_active":"2024-09-12T19:14:27.378548+0000","last_peered":"2024-09-12T19:14:27.378548+0000","last_clean":"2024-09-12T19:14:27.378548+0000","last_became_active":"2024-09-12T18:26:43.874881+0000","last_became_peered":"2024-09-12T18:26:43.874881+0000","last_unstale":"2024-09-12T19:14:27.378548+0000","last_undegraded":"2024-09-12T19:14:27.378548+0000","last_fullsized":"2024-09-12T19:14:27.378548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:27.378198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:27.378198+0000","last_clean_scrub_stamp":"2024-09-12T19:14:27.378198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:47.322357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"265'276","reported_seq":840,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:39.099273+0000","last_change":"2024-09-12T19:14:39.099273+0000","last_active":"2024-09-12T19:14:39.099273+0000","last_peered":"2024-09-12T19:14:39.099273+0000","last_clean":"2024-09-12T19:14:39.099273+0000","last_became_active":"2024-09-12T18:26:45.864264+0000","last_became_peered":"2024-09-12T18:26:45.864264+0000","last_unstale":"2024-09-12T19:14:39.099273+0000","last_undegraded":"2024-09-12T19:14:39.099273+0000","last_fullsized":"2024-09-12T19:14:39.099273+0000","mapping_epoch":30,"log_start":"265'200","ondisk_log_start":"265'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'276","last_scrub_stamp":"2024-09-12T19:14:39.099101+0000","last_deep_scrub":"265'276","last_deep_scrub_stamp":"2024-09-12T19:14:39.099101+0000","last_clean_scrub_stamp":"2024-09-12T19:14:39.099101+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:18:20.021492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49732,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":471,"num_read_kb":1179,"num_write":398,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:37.379102+0000","last_change":"2024-09-12T19:14:37.379102+0000","last_active":"2024-09-12T19:14:37.379102+0000","last_peered":"2024-09-12T19:14:37.379102+0000","last_clean":"2024-09-12T19:14:37.379102+0000","last_became_active":"2024-09-12T18:26:47.882094+0000","last_became_peered":"2024-09-12T18:26:47.882094+0000","last_unstale":"2024-09-12T19:14:37.379102+0000","last_undegraded":"2024-09-12T19:14:37.379102+0000","last_fullsized":"2024-09-12T19:14:37.379102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:37.378923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:37.378923+0000","last_clean_scrub_stamp":"2024-09-12T19:14:37.378923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:57.166212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"265'200","reported_seq":1666,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:38.981421+0000","last_change":"2024-09-12T19:14:38.981290+0000","last_active":"2024-09-12T19:14:38.981421+0000","last_peered":"2024-09-12T19:14:38.981421+0000","last_clean":"2024-09-12T19:14:38.981421+0000","last_became_active":"2024-09-12T18:26:49.920808+0000","last_became_peered":"2024-09-12T18:26:49.920808+0000","last_unstale":"2024-09-12T19:14:38.981421+0000","last_undegraded":"2024-09-12T19:14:38.981421+0000","last_fullsized":"2024-09-12T19:14:38.981421+0000","mapping_epoch":34,"log_start":"265'100","ondisk_log_start":"265'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'200","last_scrub_stamp":"2024-09-12T19:14:38.981092+0000","last_deep_scrub":"265'200","last_deep_scrub_stamp":"2024-09-12T19:14:38.981092+0000","last_clean_scrub_stamp":"2024-09-12T19:14:38.981092+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:27.527614+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":441,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1188,"num_read_kb":1184,"num_write":433,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"265'794","reported_seq":2302,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.292005+0000","last_change":"2024-09-12T19:14:13.291683+0000","last_active":"2024-09-12T19:14:13.292005+0000","last_peered":"2024-09-12T19:14:13.292005+0000","last_clean":"2024-09-12T19:14:13.292005+0000","last_became_active":"2024-09-12T18:26:41.873690+0000","last_became_peered":"2024-09-12T18:26:41.873690+0000","last_unstale":"2024-09-12T19:14:13.292005+0000","last_undegraded":"2024-09-12T19:14:13.292005+0000","last_fullsized":"2024-09-12T19:14:13.292005+0000","mapping_epoch":26,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'794","last_scrub_stamp":"2024-09-12T19:14:13.291444+0000","last_deep_scrub":"265'794","last_deep_scrub_stamp":"2024-09-12T19:14:13.291444+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.291444+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:38:33.167004+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3645,"num_read_kb":3278,"num_write":1029,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"265'366","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.869192+0000","last_change":"2024-09-12T19:14:05.869008+0000","last_active":"2024-09-12T19:14:05.869192+0000","last_peered":"2024-09-12T19:14:05.869192+0000","last_clean":"2024-09-12T19:14:05.869192+0000","last_became_active":"2024-09-12T18:27:11.829577+0000","last_became_peered":"2024-09-12T18:27:11.829577+0000","last_unstale":"2024-09-12T19:14:05.869192+0000","last_undegraded":"2024-09-12T19:14:05.869192+0000","last_fullsized":"2024-09-12T19:14:05.869192+0000","mapping_epoch":37,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T19:14:05.868750+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T19:14:05.868750+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.868750+0000","objects_scrubbed":8,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:53:24.728613+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":513384,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":509,"num_read_kb":8019,"num_write":1212,"num_write_kb":33613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.215859+0000","last_change":"2024-09-12T19:14:19.215657+0000","last_active":"2024-09-12T19:14:19.215859+0000","last_peered":"2024-09-12T19:14:19.215859+0000","last_clean":"2024-09-12T19:14:19.215859+0000","last_became_active":"2024-09-12T18:26:43.864719+0000","last_became_peered":"2024-09-12T18:26:43.864719+0000","last_unstale":"2024-09-12T19:14:19.215859+0000","last_undegraded":"2024-09-12T19:14:19.215859+0000","last_fullsized":"2024-09-12T19:14:19.215859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T19:14:19.215472+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T19:14:19.215472+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.215472+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:05.760013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"265'311","reported_seq":907,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:34.449025+0000","last_change":"2024-09-12T19:14:34.449025+0000","last_active":"2024-09-12T19:14:34.449025+0000","last_peered":"2024-09-12T19:14:34.449025+0000","last_clean":"2024-09-12T19:14:34.449025+0000","last_became_active":"2024-09-12T18:26:45.865711+0000","last_became_peered":"2024-09-12T18:26:45.865711+0000","last_unstale":"2024-09-12T19:14:34.449025+0000","last_undegraded":"2024-09-12T19:14:34.449025+0000","last_fullsized":"2024-09-12T19:14:34.449025+0000","mapping_epoch":30,"log_start":"265'300","ondisk_log_start":"265'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'311","last_scrub_stamp":"2024-09-12T19:14:34.448810+0000","last_deep_scrub":"265'311","last_deep_scrub_stamp":"2024-09-12T19:14:34.448810+0000","last_clean_scrub_stamp":"2024-09-12T19:14:34.448810+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:16:58.928887+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47780,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1144,"num_write":416,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.622059+0000","last_change":"2024-09-12T19:14:36.622059+0000","last_active":"2024-09-12T19:14:36.622059+0000","last_peered":"2024-09-12T19:14:36.622059+0000","last_clean":"2024-09-12T19:14:36.622059+0000","last_became_active":"2024-09-12T18:26:47.883014+0000","last_became_peered":"2024-09-12T18:26:47.883014+0000","last_unstale":"2024-09-12T19:14:36.622059+0000","last_undegraded":"2024-09-12T19:14:36.622059+0000","last_fullsized":"2024-09-12T19:14:36.622059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T19:14:36.621864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T19:14:36.621864+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.621864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:35:58.258765+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"265'109","reported_seq":620,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:36.431809+0000","last_change":"2024-09-12T19:14:36.431809+0000","last_active":"2024-09-12T19:14:36.431809+0000","last_peered":"2024-09-12T19:14:36.431809+0000","last_clean":"2024-09-12T19:14:36.431809+0000","last_became_active":"2024-09-12T18:26:49.921636+0000","last_became_peered":"2024-09-12T18:26:49.921636+0000","last_unstale":"2024-09-12T19:14:36.431809+0000","last_undegraded":"2024-09-12T19:14:36.431809+0000","last_fullsized":"2024-09-12T19:14:36.431809+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'109","last_scrub_stamp":"2024-09-12T19:14:36.431615+0000","last_deep_scrub":"265'109","last_deep_scrub_stamp":"2024-09-12T19:14:36.431615+0000","last_clean_scrub_stamp":"2024-09-12T19:14:36.431615+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:18.233287+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":621,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":107,"num_write":252,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"265'1276","reported_seq":3089,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:15.158163+0000","last_change":"2024-09-12T19:14:15.157980+0000","last_active":"2024-09-12T19:14:15.158163+0000","last_peered":"2024-09-12T19:14:15.158163+0000","last_clean":"2024-09-12T19:14:15.158163+0000","last_became_active":"2024-09-12T18:26:41.872455+0000","last_became_peered":"2024-09-12T18:26:41.872455+0000","last_unstale":"2024-09-12T19:14:15.158163+0000","last_undegraded":"2024-09-12T19:14:15.158163+0000","last_fullsized":"2024-09-12T19:14:15.158163+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1276","last_scrub_stamp":"2024-09-12T19:14:15.157805+0000","last_deep_scrub":"265'1276","last_deep_scrub_stamp":"2024-09-12T19:14:15.157805+0000","last_clean_scrub_stamp":"2024-09-12T19:14:15.157805+0000","objects_scrubbed":3,"log_size":76,"log_dups_size":1200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:50:47.614559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6298,"num_read_kb":5578,"num_write":1816,"num_write_kb":809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2046,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"265'415","reported_seq":1116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.516302+0000","last_change":"2024-09-12T19:14:07.516055+0000","last_active":"2024-09-12T19:14:07.516302+0000","last_peered":"2024-09-12T19:14:07.516302+0000","last_clean":"2024-09-12T19:14:07.516302+0000","last_became_active":"2024-09-12T18:26:39.847954+0000","last_became_peered":"2024-09-12T18:26:39.847954+0000","last_unstale":"2024-09-12T19:14:07.516302+0000","last_undegraded":"2024-09-12T19:14:07.516302+0000","last_fullsized":"2024-09-12T19:14:07.516302+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'415","last_scrub_stamp":"2024-09-12T19:14:07.515758+0000","last_deep_scrub":"265'415","last_deep_scrub_stamp":"2024-09-12T19:14:07.515758+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.515758+0000","objects_scrubbed":11,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:41:44.678357+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263330,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":589,"num_read_kb":77066,"num_write":1254,"num_write_kb":41008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"265'506","reported_seq":2159,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.163931+0000","last_change":"2024-09-12T19:14:17.163693+0000","last_active":"2024-09-12T19:14:17.163931+0000","last_peered":"2024-09-12T19:14:17.163931+0000","last_clean":"2024-09-12T19:14:17.163931+0000","last_became_active":"2024-09-12T18:26:41.846040+0000","last_became_peered":"2024-09-12T18:26:41.846040+0000","last_unstale":"2024-09-12T19:14:17.163931+0000","last_undegraded":"2024-09-12T19:14:17.163931+0000","last_fullsized":"2024-09-12T19:14:17.163931+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'506","last_scrub_stamp":"2024-09-12T19:14:17.163451+0000","last_deep_scrub":"265'506","last_deep_scrub_stamp":"2024-09-12T19:14:17.163451+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.163451+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:21:17.436750+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2703,"num_read_kb":2531,"num_write":592,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"265'383","reported_seq":1106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.072813+0000","last_change":"2024-09-12T19:14:06.072667+0000","last_active":"2024-09-12T19:14:06.072813+0000","last_peered":"2024-09-12T19:14:06.072813+0000","last_clean":"2024-09-12T19:14:06.072813+0000","last_became_active":"2024-09-12T18:26:39.846028+0000","last_became_peered":"2024-09-12T18:26:39.846028+0000","last_unstale":"2024-09-12T19:14:06.072813+0000","last_undegraded":"2024-09-12T19:14:06.072813+0000","last_fullsized":"2024-09-12T19:14:06.072813+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'383","last_scrub_stamp":"2024-09-12T19:14:06.072441+0000","last_deep_scrub":"265'383","last_deep_scrub_stamp":"2024-09-12T19:14:06.072441+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.072441+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:28:27.496097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":778,"num_read_kb":5622,"num_write":1176,"num_write_kb":40701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"265'518","reported_seq":2050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.449208+0000","last_change":"2024-09-12T19:14:19.449064+0000","last_active":"2024-09-12T19:14:19.449208+0000","last_peered":"2024-09-12T19:14:19.449208+0000","last_clean":"2024-09-12T19:14:19.449208+0000","last_became_active":"2024-09-12T18:26:41.884394+0000","last_became_peered":"2024-09-12T18:26:41.884394+0000","last_unstale":"2024-09-12T19:14:19.449208+0000","last_undegraded":"2024-09-12T19:14:19.449208+0000","last_fullsized":"2024-09-12T19:14:19.449208+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'518","last_scrub_stamp":"2024-09-12T19:14:19.448882+0000","last_deep_scrub":"265'518","last_deep_scrub_stamp":"2024-09-12T19:14:19.448882+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.448882+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:45.429300+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2704,"num_read_kb":2505,"num_write":657,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"265'348","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.576885+0000","last_change":"2024-09-12T19:14:09.576657+0000","last_active":"2024-09-12T19:14:09.576885+0000","last_peered":"2024-09-12T19:14:09.576885+0000","last_clean":"2024-09-12T19:14:09.576885+0000","last_became_active":"2024-09-12T18:26:39.856026+0000","last_became_peered":"2024-09-12T18:26:39.856026+0000","last_unstale":"2024-09-12T19:14:09.576885+0000","last_undegraded":"2024-09-12T19:14:09.576885+0000","last_fullsized":"2024-09-12T19:14:09.576885+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'348","last_scrub_stamp":"2024-09-12T19:14:09.576403+0000","last_deep_scrub":"265'348","last_deep_scrub_stamp":"2024-09-12T19:14:09.576403+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.576403+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:31:49.231864+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136883,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":531,"num_read_kb":16869,"num_write":1087,"num_write_kb":23838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"265'540","reported_seq":2164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.152123+0000","last_change":"2024-09-12T19:14:21.151938+0000","last_active":"2024-09-12T19:14:21.152123+0000","last_peered":"2024-09-12T19:14:21.152123+0000","last_clean":"2024-09-12T19:14:21.152123+0000","last_became_active":"2024-09-12T18:26:41.850519+0000","last_became_peered":"2024-09-12T18:26:41.850519+0000","last_unstale":"2024-09-12T19:14:21.152123+0000","last_undegraded":"2024-09-12T19:14:21.152123+0000","last_fullsized":"2024-09-12T19:14:21.152123+0000","mapping_epoch":26,"log_start":"265'500","ondisk_log_start":"265'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'540","last_scrub_stamp":"2024-09-12T19:14:21.151755+0000","last_deep_scrub":"265'540","last_deep_scrub_stamp":"2024-09-12T19:14:21.151755+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.151755+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:23.137225+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2864,"num_read_kb":2647,"num_write":672,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"265'356","reported_seq":1013,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.828255+0000","last_change":"2024-09-12T19:14:10.828101+0000","last_active":"2024-09-12T19:14:10.828255+0000","last_peered":"2024-09-12T19:14:10.828255+0000","last_clean":"2024-09-12T19:14:10.828255+0000","last_became_active":"2024-09-12T18:26:39.842852+0000","last_became_peered":"2024-09-12T18:26:39.842852+0000","last_unstale":"2024-09-12T19:14:10.828255+0000","last_undegraded":"2024-09-12T19:14:10.828255+0000","last_fullsized":"2024-09-12T19:14:10.828255+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'356","last_scrub_stamp":"2024-09-12T19:14:10.827863+0000","last_deep_scrub":"265'356","last_deep_scrub_stamp":"2024-09-12T19:14:10.827863+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.827863+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:32:51.034300+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524303,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":35620,"num_write":1162,"num_write_kb":31566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"265'816","reported_seq":2362,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:16.953836+0000","last_change":"2024-09-12T19:14:16.953680+0000","last_active":"2024-09-12T19:14:16.953836+0000","last_peered":"2024-09-12T19:14:16.953836+0000","last_clean":"2024-09-12T19:14:16.953836+0000","last_became_active":"2024-09-12T18:26:41.882458+0000","last_became_peered":"2024-09-12T18:26:41.882458+0000","last_unstale":"2024-09-12T19:14:16.953836+0000","last_undegraded":"2024-09-12T19:14:16.953836+0000","last_fullsized":"2024-09-12T19:14:16.953836+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'816","last_scrub_stamp":"2024-09-12T19:14:16.953485+0000","last_deep_scrub":"265'816","last_deep_scrub_stamp":"2024-09-12T19:14:16.953485+0000","last_clean_scrub_stamp":"2024-09-12T19:14:16.953485+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:15:39.442346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3832,"num_read_kb":3447,"num_write":1071,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"265'338","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.763905+0000","last_change":"2024-09-12T19:14:05.763769+0000","last_active":"2024-09-12T19:14:05.763905+0000","last_peered":"2024-09-12T19:14:05.763905+0000","last_clean":"2024-09-12T19:14:05.763905+0000","last_became_active":"2024-09-12T18:26:39.855654+0000","last_became_peered":"2024-09-12T18:26:39.855654+0000","last_unstale":"2024-09-12T19:14:05.763905+0000","last_undegraded":"2024-09-12T19:14:05.763905+0000","last_fullsized":"2024-09-12T19:14:05.763905+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'338","last_scrub_stamp":"2024-09-12T19:14:05.763566+0000","last_deep_scrub":"265'338","last_deep_scrub_stamp":"2024-09-12T19:14:05.763566+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.763566+0000","objects_scrubbed":7,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:37.605894+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":592,"num_read_kb":6402,"num_write":1048,"num_write_kb":32224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"265'1224","reported_seq":2866,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:18.258685+0000","last_change":"2024-09-12T19:14:18.258534+0000","last_active":"2024-09-12T19:14:18.258685+0000","last_peered":"2024-09-12T19:14:18.258685+0000","last_clean":"2024-09-12T19:14:18.258685+0000","last_became_active":"2024-09-12T18:26:41.876138+0000","last_became_peered":"2024-09-12T18:26:41.876138+0000","last_unstale":"2024-09-12T19:14:18.258685+0000","last_undegraded":"2024-09-12T19:14:18.258685+0000","last_fullsized":"2024-09-12T19:14:18.258685+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1224","last_scrub_stamp":"2024-09-12T19:14:18.258312+0000","last_deep_scrub":"265'1224","last_deep_scrub_stamp":"2024-09-12T19:14:18.258312+0000","last_clean_scrub_stamp":"2024-09-12T19:14:18.258312+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":1200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:37:16.154638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5532,"num_read_kb":4890,"num_write":1674,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"265'314","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:05.063931+0000","last_change":"2024-09-12T19:14:05.063835+0000","last_active":"2024-09-12T19:14:05.063931+0000","last_peered":"2024-09-12T19:14:05.063931+0000","last_clean":"2024-09-12T19:14:05.063931+0000","last_became_active":"2024-09-12T18:26:39.844346+0000","last_became_peered":"2024-09-12T18:26:39.844346+0000","last_unstale":"2024-09-12T19:14:05.063931+0000","last_undegraded":"2024-09-12T19:14:05.063931+0000","last_fullsized":"2024-09-12T19:14:05.063931+0000","mapping_epoch":24,"log_start":"265'301","ondisk_log_start":"265'301","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-12T19:14:05.063699+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-12T19:14:05.063699+0000","last_clean_scrub_stamp":"2024-09-12T19:14:05.063699+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":301,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:23.183938+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":67178,"num_write":993,"num_write_kb":30033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"265'745","reported_seq":2200,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:08.035417+0000","last_change":"2024-09-12T19:14:08.035158+0000","last_active":"2024-09-12T19:14:08.035417+0000","last_peered":"2024-09-12T19:14:08.035417+0000","last_clean":"2024-09-12T19:14:08.035417+0000","last_became_active":"2024-09-12T18:27:11.823747+0000","last_became_peered":"2024-09-12T18:27:11.823747+0000","last_unstale":"2024-09-12T19:14:08.035417+0000","last_undegraded":"2024-09-12T19:14:08.035417+0000","last_fullsized":"2024-09-12T19:14:08.035417+0000","mapping_epoch":37,"log_start":"265'700","ondisk_log_start":"265'700","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'745","last_scrub_stamp":"2024-09-12T19:14:08.034931+0000","last_deep_scrub":"265'745","last_deep_scrub_stamp":"2024-09-12T19:14:08.034931+0000","last_clean_scrub_stamp":"2024-09-12T19:14:08.034931+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":700,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:28:31.331294+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3535,"num_read_kb":3187,"num_write":978,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.26","version":"265'340","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.585320+0000","last_change":"2024-09-12T19:14:11.585184+0000","last_active":"2024-09-12T19:14:11.585320+0000","last_peered":"2024-09-12T19:14:11.585320+0000","last_clean":"2024-09-12T19:14:11.585320+0000","last_became_active":"2024-09-12T18:26:39.871119+0000","last_became_peered":"2024-09-12T18:26:39.871119+0000","last_unstale":"2024-09-12T19:14:11.585320+0000","last_undegraded":"2024-09-12T19:14:11.585320+0000","last_fullsized":"2024-09-12T19:14:11.585320+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'340","last_scrub_stamp":"2024-09-12T19:14:11.584993+0000","last_deep_scrub":"265'340","last_deep_scrub_stamp":"2024-09-12T19:14:11.584993+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.584993+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:59.549191+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":695310,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":8461,"num_write":1111,"num_write_kb":27008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"265'1067","reported_seq":2783,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.624192+0000","last_change":"2024-09-12T19:14:14.623962+0000","last_active":"2024-09-12T19:14:14.624192+0000","last_peered":"2024-09-12T19:14:14.624192+0000","last_clean":"2024-09-12T19:14:14.624192+0000","last_became_active":"2024-09-12T18:26:41.863607+0000","last_became_peered":"2024-09-12T18:26:41.863607+0000","last_unstale":"2024-09-12T19:14:14.624192+0000","last_undegraded":"2024-09-12T19:14:14.624192+0000","last_fullsized":"2024-09-12T19:14:14.624192+0000","mapping_epoch":26,"log_start":"265'1000","ondisk_log_start":"265'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1067","last_scrub_stamp":"2024-09-12T19:14:14.623754+0000","last_deep_scrub":"265'1067","last_deep_scrub_stamp":"2024-09-12T19:14:14.623754+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.623754+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":1000,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:20:14.209154+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5203,"num_read_kb":4615,"num_write":1535,"num_write_kb":715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1418,"num_omap_keys":6,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"265'347","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:06.809761+0000","last_change":"2024-09-12T19:14:06.809689+0000","last_active":"2024-09-12T19:14:06.809761+0000","last_peered":"2024-09-12T19:14:06.809761+0000","last_clean":"2024-09-12T19:14:06.809761+0000","last_became_active":"2024-09-12T18:26:39.827475+0000","last_became_peered":"2024-09-12T18:26:39.827475+0000","last_unstale":"2024-09-12T19:14:06.809761+0000","last_undegraded":"2024-09-12T19:14:06.809761+0000","last_fullsized":"2024-09-12T19:14:06.809761+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T19:14:06.809544+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T19:14:06.809544+0000","last_clean_scrub_stamp":"2024-09-12T19:14:06.809544+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:35.789447+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136911,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":492,"num_read_kb":48337,"num_write":1107,"num_write_kb":41435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"265'826","reported_seq":2446,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.731033+0000","last_change":"2024-09-12T19:14:19.731033+0000","last_active":"2024-09-12T19:14:19.731033+0000","last_peered":"2024-09-12T19:14:19.731033+0000","last_clean":"2024-09-12T19:14:19.731033+0000","last_became_active":"2024-09-12T18:26:41.851080+0000","last_became_peered":"2024-09-12T18:26:41.851080+0000","last_unstale":"2024-09-12T19:14:19.731033+0000","last_undegraded":"2024-09-12T19:14:19.731033+0000","last_fullsized":"2024-09-12T19:14:19.731033+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'826","last_scrub_stamp":"2024-09-12T19:14:19.730759+0000","last_deep_scrub":"265'826","last_deep_scrub_stamp":"2024-09-12T19:14:19.730759+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.730759+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:22.313239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4015,"num_read_kb":3626,"num_write":1096,"num_write_kb":401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"265'362","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:11.617921+0000","last_change":"2024-09-12T19:14:11.617777+0000","last_active":"2024-09-12T19:14:11.617921+0000","last_peered":"2024-09-12T19:14:11.617921+0000","last_clean":"2024-09-12T19:14:11.617921+0000","last_became_active":"2024-09-12T18:26:39.849722+0000","last_became_peered":"2024-09-12T18:26:39.849722+0000","last_unstale":"2024-09-12T19:14:11.617921+0000","last_undegraded":"2024-09-12T19:14:11.617921+0000","last_fullsized":"2024-09-12T19:14:11.617921+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T19:14:11.617565+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T19:14:11.617565+0000","last_clean_scrub_stamp":"2024-09-12T19:14:11.617565+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:48:32.390820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":509,"num_read_kb":40604,"num_write":1102,"num_write_kb":41780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"265'396","reported_seq":1935,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.331338+0000","last_change":"2024-09-12T19:14:20.331338+0000","last_active":"2024-09-12T19:14:20.331338+0000","last_peered":"2024-09-12T19:14:20.331338+0000","last_clean":"2024-09-12T19:14:20.331338+0000","last_became_active":"2024-09-12T18:26:41.851159+0000","last_became_peered":"2024-09-12T18:26:41.851159+0000","last_unstale":"2024-09-12T19:14:20.331338+0000","last_undegraded":"2024-09-12T19:14:20.331338+0000","last_fullsized":"2024-09-12T19:14:20.331338+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'396","last_scrub_stamp":"2024-09-12T19:14:20.331149+0000","last_deep_scrub":"265'396","last_deep_scrub_stamp":"2024-09-12T19:14:20.331149+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.331149+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:53:03.216872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2139,"num_read_kb":2047,"num_write":455,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"265'312","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.866891+0000","last_change":"2024-09-12T19:14:13.866891+0000","last_active":"2024-09-12T19:14:13.866891+0000","last_peered":"2024-09-12T19:14:13.866891+0000","last_clean":"2024-09-12T19:14:13.866891+0000","last_became_active":"2024-09-12T18:26:39.827933+0000","last_became_peered":"2024-09-12T18:26:39.827933+0000","last_unstale":"2024-09-12T19:14:13.866891+0000","last_undegraded":"2024-09-12T19:14:13.866891+0000","last_fullsized":"2024-09-12T19:14:13.866891+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T19:14:13.866679+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T19:14:13.866679+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.866679+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:24:05.360145+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":423,"num_read_kb":364,"num_write":936,"num_write_kb":38290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"265'1178","reported_seq":2814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:10.081400+0000","last_change":"2024-09-12T19:14:10.081400+0000","last_active":"2024-09-12T19:14:10.081400+0000","last_peered":"2024-09-12T19:14:10.081400+0000","last_clean":"2024-09-12T19:14:10.081400+0000","last_became_active":"2024-09-12T18:26:41.872816+0000","last_became_peered":"2024-09-12T18:26:41.872816+0000","last_unstale":"2024-09-12T19:14:10.081400+0000","last_undegraded":"2024-09-12T19:14:10.081400+0000","last_fullsized":"2024-09-12T19:14:10.081400+0000","mapping_epoch":26,"log_start":"265'1100","ondisk_log_start":"265'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1178","last_scrub_stamp":"2024-09-12T19:14:10.081223+0000","last_deep_scrub":"265'1178","last_deep_scrub_stamp":"2024-09-12T19:14:10.081223+0000","last_clean_scrub_stamp":"2024-09-12T19:14:10.081223+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":1100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:00:17.777350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5354,"num_read_kb":4741,"num_write":1604,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"265'309","reported_seq":903,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.028209+0000","last_change":"2024-09-12T19:14:07.028067+0000","last_active":"2024-09-12T19:14:07.028209+0000","last_peered":"2024-09-12T19:14:07.028209+0000","last_clean":"2024-09-12T19:14:07.028209+0000","last_became_active":"2024-09-12T18:27:12.005906+0000","last_became_peered":"2024-09-12T18:27:12.005906+0000","last_unstale":"2024-09-12T19:14:07.028209+0000","last_undegraded":"2024-09-12T19:14:07.028209+0000","last_fullsized":"2024-09-12T19:14:07.028209+0000","mapping_epoch":37,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-12T19:14:07.027874+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-12T19:14:07.027874+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.027874+0000","objects_scrubbed":4,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:58.637085+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":420,"num_read_kb":9281,"num_write":1029,"num_write_kb":40338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"265'421","reported_seq":1878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.299205+0000","last_change":"2024-09-12T19:14:19.299205+0000","last_active":"2024-09-12T19:14:19.299205+0000","last_peered":"2024-09-12T19:14:19.299205+0000","last_clean":"2024-09-12T19:14:19.299205+0000","last_became_active":"2024-09-12T18:26:41.866602+0000","last_became_peered":"2024-09-12T18:26:41.866602+0000","last_unstale":"2024-09-12T19:14:19.299205+0000","last_undegraded":"2024-09-12T19:14:19.299205+0000","last_fullsized":"2024-09-12T19:14:19.299205+0000","mapping_epoch":26,"log_start":"265'400","ondisk_log_start":"265'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'421","last_scrub_stamp":"2024-09-12T19:14:19.298966+0000","last_deep_scrub":"265'421","last_deep_scrub_stamp":"2024-09-12T19:14:19.298966+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.298966+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:36:05.474113+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2157,"num_read_kb":2028,"num_write":492,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"265'368","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.808721+0000","last_change":"2024-09-12T19:14:12.808721+0000","last_active":"2024-09-12T19:14:12.808721+0000","last_peered":"2024-09-12T19:14:12.808721+0000","last_clean":"2024-09-12T19:14:12.808721+0000","last_became_active":"2024-09-12T18:26:39.871626+0000","last_became_peered":"2024-09-12T18:26:39.871626+0000","last_unstale":"2024-09-12T19:14:12.808721+0000","last_undegraded":"2024-09-12T19:14:12.808721+0000","last_fullsized":"2024-09-12T19:14:12.808721+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T19:14:12.808485+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T19:14:12.808485+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.808485+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T06:29:25.920885+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2185594,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":15528,"num_write":1112,"num_write_kb":35488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"265'1249","reported_seq":2895,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.880698+0000","last_change":"2024-09-12T19:14:21.880698+0000","last_active":"2024-09-12T19:14:21.880698+0000","last_peered":"2024-09-12T19:14:21.880698+0000","last_clean":"2024-09-12T19:14:21.880698+0000","last_became_active":"2024-09-12T18:26:41.876708+0000","last_became_peered":"2024-09-12T18:26:41.876708+0000","last_unstale":"2024-09-12T19:14:21.880698+0000","last_undegraded":"2024-09-12T19:14:21.880698+0000","last_fullsized":"2024-09-12T19:14:21.880698+0000","mapping_epoch":26,"log_start":"265'1200","ondisk_log_start":"265'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1249","last_scrub_stamp":"2024-09-12T19:14:21.880516+0000","last_deep_scrub":"265'1249","last_deep_scrub_stamp":"2024-09-12T19:14:21.880516+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.880516+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":1200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:05:42.174249+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5682,"num_read_kb":5005,"num_write":1690,"num_write_kb":688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":710,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"265'330","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:09.568489+0000","last_change":"2024-09-12T19:14:09.568489+0000","last_active":"2024-09-12T19:14:09.568489+0000","last_peered":"2024-09-12T19:14:09.568489+0000","last_clean":"2024-09-12T19:14:09.568489+0000","last_became_active":"2024-09-12T18:26:39.857956+0000","last_became_peered":"2024-09-12T18:26:39.857956+0000","last_unstale":"2024-09-12T19:14:09.568489+0000","last_undegraded":"2024-09-12T19:14:09.568489+0000","last_fullsized":"2024-09-12T19:14:09.568489+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T19:14:09.568184+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T19:14:09.568184+0000","last_clean_scrub_stamp":"2024-09-12T19:14:09.568184+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:20.538784+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2580367,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":492,"num_read_kb":32197,"num_write":944,"num_write_kb":38029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"265'899","reported_seq":2603,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:17.791367+0000","last_change":"2024-09-12T19:14:17.791367+0000","last_active":"2024-09-12T19:14:17.791367+0000","last_peered":"2024-09-12T19:14:17.791367+0000","last_clean":"2024-09-12T19:14:17.791367+0000","last_became_active":"2024-09-12T18:26:41.854471+0000","last_became_peered":"2024-09-12T18:26:41.854471+0000","last_unstale":"2024-09-12T19:14:17.791367+0000","last_undegraded":"2024-09-12T19:14:17.791367+0000","last_fullsized":"2024-09-12T19:14:17.791367+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'899","last_scrub_stamp":"2024-09-12T19:14:17.791192+0000","last_deep_scrub":"265'899","last_deep_scrub_stamp":"2024-09-12T19:14:17.791192+0000","last_clean_scrub_stamp":"2024-09-12T19:14:17.791192+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":800,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:45:01.381428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4435,"num_read_kb":4011,"num_write":1173,"num_write_kb":437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"265'389","reported_seq":1053,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:13.836040+0000","last_change":"2024-09-12T19:14:13.836040+0000","last_active":"2024-09-12T19:14:13.836040+0000","last_peered":"2024-09-12T19:14:13.836040+0000","last_clean":"2024-09-12T19:14:13.836040+0000","last_became_active":"2024-09-12T18:26:39.869924+0000","last_became_peered":"2024-09-12T18:26:39.869924+0000","last_unstale":"2024-09-12T19:14:13.836040+0000","last_undegraded":"2024-09-12T19:14:13.836040+0000","last_fullsized":"2024-09-12T19:14:13.836040+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'389","last_scrub_stamp":"2024-09-12T19:14:13.835820+0000","last_deep_scrub":"265'389","last_deep_scrub_stamp":"2024-09-12T19:14:13.835820+0000","last_clean_scrub_stamp":"2024-09-12T19:14:13.835820+0000","objects_scrubbed":7,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:38.231301+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1399013,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":542,"num_read_kb":35584,"num_write":1226,"num_write_kb":36960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"265'690","reported_seq":2488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:24.100626+0000","last_change":"2024-09-12T19:14:24.100626+0000","last_active":"2024-09-12T19:14:24.100626+0000","last_peered":"2024-09-12T19:14:24.100626+0000","last_clean":"2024-09-12T19:14:24.100626+0000","last_became_active":"2024-09-12T18:26:41.858362+0000","last_became_peered":"2024-09-12T18:26:41.858362+0000","last_unstale":"2024-09-12T19:14:24.100626+0000","last_undegraded":"2024-09-12T19:14:24.100626+0000","last_fullsized":"2024-09-12T19:14:24.100626+0000","mapping_epoch":26,"log_start":"265'600","ondisk_log_start":"265'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'690","last_scrub_stamp":"2024-09-12T19:14:24.100446+0000","last_deep_scrub":"265'690","last_deep_scrub_stamp":"2024-09-12T19:14:24.100446+0000","last_clean_scrub_stamp":"2024-09-12T19:14:24.100446+0000","objects_scrubbed":6,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:25.838408+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3672,"num_read_kb":3341,"num_write":924,"num_write_kb":325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3008,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"265'426","reported_seq":1217,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.038483+0000","last_change":"2024-09-12T19:14:12.038483+0000","last_active":"2024-09-12T19:14:12.038483+0000","last_peered":"2024-09-12T19:14:12.038483+0000","last_clean":"2024-09-12T19:14:12.038483+0000","last_became_active":"2024-09-12T18:26:39.847373+0000","last_became_peered":"2024-09-12T18:26:39.847373+0000","last_unstale":"2024-09-12T19:14:12.038483+0000","last_undegraded":"2024-09-12T19:14:12.038483+0000","last_fullsized":"2024-09-12T19:14:12.038483+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'426","last_scrub_stamp":"2024-09-12T19:14:12.038294+0000","last_deep_scrub":"265'426","last_deep_scrub_stamp":"2024-09-12T19:14:12.038294+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.038294+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:51:28.497991+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262203,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":812,"num_read_kb":75472,"num_write":1417,"num_write_kb":36911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"265'826","reported_seq":2401,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:19.851050+0000","last_change":"2024-09-12T19:14:19.850884+0000","last_active":"2024-09-12T19:14:19.851050+0000","last_peered":"2024-09-12T19:14:19.851050+0000","last_clean":"2024-09-12T19:14:19.851050+0000","last_became_active":"2024-09-12T18:26:41.871610+0000","last_became_peered":"2024-09-12T18:26:41.871610+0000","last_unstale":"2024-09-12T19:14:19.851050+0000","last_undegraded":"2024-09-12T19:14:19.851050+0000","last_fullsized":"2024-09-12T19:14:19.851050+0000","mapping_epoch":26,"log_start":"265'800","ondisk_log_start":"265'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'826","last_scrub_stamp":"2024-09-12T19:14:19.850704+0000","last_deep_scrub":"265'826","last_deep_scrub_stamp":"2024-09-12T19:14:19.850704+0000","last_clean_scrub_stamp":"2024-09-12T19:14:19.850704+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:03:40.802958+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3622,"num_write":1076,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"265'288","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:12.625440+0000","last_change":"2024-09-12T19:14:12.625440+0000","last_active":"2024-09-12T19:14:12.625440+0000","last_peered":"2024-09-12T19:14:12.625440+0000","last_clean":"2024-09-12T19:14:12.625440+0000","last_became_active":"2024-09-12T18:26:39.874710+0000","last_became_peered":"2024-09-12T18:26:39.874710+0000","last_unstale":"2024-09-12T19:14:12.625440+0000","last_undegraded":"2024-09-12T19:14:12.625440+0000","last_fullsized":"2024-09-12T19:14:12.625440+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'288","last_scrub_stamp":"2024-09-12T19:14:12.625246+0000","last_deep_scrub":"265'288","last_deep_scrub_stamp":"2024-09-12T19:14:12.625246+0000","last_clean_scrub_stamp":"2024-09-12T19:14:12.625246+0000","objects_scrubbed":4,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:40:05.154814+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":445,"num_read_kb":12735,"num_write":942,"num_write_kb":23796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"265'359","reported_seq":1018,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:14.643734+0000","last_change":"2024-09-12T19:14:14.643734+0000","last_active":"2024-09-12T19:14:14.643734+0000","last_peered":"2024-09-12T19:14:14.643734+0000","last_clean":"2024-09-12T19:14:14.643734+0000","last_became_active":"2024-09-12T18:26:39.846477+0000","last_became_peered":"2024-09-12T18:26:39.846477+0000","last_unstale":"2024-09-12T19:14:14.643734+0000","last_undegraded":"2024-09-12T19:14:14.643734+0000","last_fullsized":"2024-09-12T19:14:14.643734+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'359","last_scrub_stamp":"2024-09-12T19:14:14.643507+0000","last_deep_scrub":"265'359","last_deep_scrub_stamp":"2024-09-12T19:14:14.643507+0000","last_clean_scrub_stamp":"2024-09-12T19:14:14.643507+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:48.800351+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":508,"num_read_kb":32398,"num_write":1027,"num_write_kb":24916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"265'405","reported_seq":1879,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:20.711726+0000","last_change":"2024-09-12T19:14:20.711466+0000","last_active":"2024-09-12T19:14:20.711726+0000","last_peered":"2024-09-12T19:14:20.711726+0000","last_clean":"2024-09-12T19:14:20.711726+0000","last_became_active":"2024-09-12T18:26:41.851295+0000","last_became_peered":"2024-09-12T18:26:41.851295+0000","last_unstale":"2024-09-12T19:14:20.711726+0000","last_undegraded":"2024-09-12T19:14:20.711726+0000","last_fullsized":"2024-09-12T19:14:20.711726+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'405","last_scrub_stamp":"2024-09-12T19:14:20.711236+0000","last_deep_scrub":"265'405","last_deep_scrub_stamp":"2024-09-12T19:14:20.711236+0000","last_clean_scrub_stamp":"2024-09-12T19:14:20.711236+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:44.617496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2153,"num_read_kb":2041,"num_write":455,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"265'322","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:07.037157+0000","last_change":"2024-09-12T19:14:07.037157+0000","last_active":"2024-09-12T19:14:07.037157+0000","last_peered":"2024-09-12T19:14:07.037157+0000","last_clean":"2024-09-12T19:14:07.037157+0000","last_became_active":"2024-09-12T18:26:39.857009+0000","last_became_peered":"2024-09-12T18:26:39.857009+0000","last_unstale":"2024-09-12T19:14:07.037157+0000","last_undegraded":"2024-09-12T19:14:07.037157+0000","last_fullsized":"2024-09-12T19:14:07.037157+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T19:14:07.036972+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T19:14:07.036972+0000","last_clean_scrub_stamp":"2024-09-12T19:14:07.036972+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:19:28.775839+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2355888,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":55513,"num_write":945,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"265'377","reported_seq":1774,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T19:14:21.366651+0000","last_change":"2024-09-12T19:14:21.366487+0000","last_active":"2024-09-12T19:14:21.366651+0000","last_peered":"2024-09-12T19:14:21.366651+0000","last_clean":"2024-09-12T19:14:21.366651+0000","last_became_active":"2024-09-12T18:26:41.872448+0000","last_became_peered":"2024-09-12T18:26:41.872448+0000","last_unstale":"2024-09-12T19:14:21.366651+0000","last_undegraded":"2024-09-12T19:14:21.366651+0000","last_fullsized":"2024-09-12T19:14:21.366651+0000","mapping_epoch":26,"log_start":"265'300","ondisk_log_start":"265'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'377","last_scrub_stamp":"2024-09-12T19:14:21.366307+0000","last_deep_scrub":"265'377","last_deep_scrub_stamp":"2024-09-12T19:14:21.366307+0000","last_clean_scrub_stamp":"2024-09-12T19:14:21.366307+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:53.119707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1946,"num_read_kb":1855,"num_write":441,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6147,"num_read_kb":4433,"num_write":1993,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4707,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":966,"ondisk_log_size":966,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":14976,"num_read_kb":14648,"num_write":16787,"num_write_kb":4894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1741,"ondisk_log_size":1741,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":577,"ondisk_log_size":577,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1597681,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17400,"num_read_kb":36744,"num_write":14589,"num_write_kb":11628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":675720,"num_omap_keys":1570,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1996,"ondisk_log_size":1996,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212286,"num_read_kb":193833,"num_write":55194,"num_write_kb":18759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43776,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4064,"ondisk_log_size":4064,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":64167064,"num_objects":372,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":372,"num_whiteouts":0,"num_read":36315,"num_read_kb":1882823,"num_write":72228,"num_write_kb":2144860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":129474560,"data_stored":128334128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3882,"ondisk_log_size":3882,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":214446,"num_write":192,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":177,"num_read_kb":201134,"num_write":192,"num_write_kb":142054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510034,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266732,"kb_used_data":10652,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94105108,"statfs":{"total":96636764160,"available":96363630592,"internally_reserved":0,"allocated":10907648,"data_stored":9282789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":262207942},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510034,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":131840,"kb_used_data":10480,"kb_used_omap":1,"kb_used_meta":121342,"kb_avail":94240000,"statfs":{"total":96636764160,"available":96501760000,"internally_reserved":0,"allocated":10731520,"data_stored":9041400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124254661},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510035,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92808,"kb_used_data":29688,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94279032,"statfs":{"total":96636764160,"available":96541728768,"internally_reserved":0,"allocated":30400512,"data_stored":28782462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510032,"num_pgs":117,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266872,"kb_used_data":10792,"kb_used_omap":1,"kb_used_meta":256062,"kb_avail":94104968,"statfs":{"total":96636764160,"available":96363487232,"internally_reserved":0,"allocated":11051008,"data_stored":9395858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":262207943},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510032,"num_pgs":83,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95984,"kb_used_data":14880,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94275856,"statfs":{"total":96636764160,"available":96538476544,"internally_reserved":0,"allocated":15237120,"data_stored":13690985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510032,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284940,"kb_used_data":33084,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94086900,"statfs":{"total":96636764160,"available":96344985600,"internally_reserved":0,"allocated":33878016,"data_stored":32185380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":257882568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542739,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292816,"kb_used_data":18688,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94079024,"statfs":{"total":96636764160,"available":96336920576,"internally_reserved":0,"allocated":19136512,"data_stored":17444491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":280689098},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542737,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":167376,"kb_used_data":27968,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94204464,"statfs":{"total":96636764160,"available":96465371136,"internally_reserved":0,"allocated":28639232,"data_stored":27068681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29601792,"data_stored":29420904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24977408,"data_stored":24897183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11599872,"data_stored":11518686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7376896,"data_stored":7222226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":26800128,"data_stored":26613106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7016448,"data_stored":6869386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7270400,"data_stored":7112125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14831616,"data_stored":14680512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":5181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T19:15:27.684 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T19:15:28.050 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T19:15:28.051 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T19:15:28.051 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T19:15:28.051 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:15:28.151 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T19:15:28.151 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T19:15:28.151 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:15:28.240 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T19:15:28.240 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T19:15:28.240 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:15:29.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-12T19:15:34.342 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T19:15:34.342 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T19:15:34.342 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:15:34.433 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T19:15:34.434 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T19:15:34.434 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:15:34.510 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T19:15:34.510 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T19:15:34.511 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:15:34.609 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T19:15:34.609 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T19:15:34.609 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:15:35.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-12T19:15:35.315 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-12T19:15:40.711 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T19:15:40.711 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T19:15:40.711 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:15:40.802 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T19:15:40.802 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T19:15:40.803 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T19:15:40.803 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:15:40.833 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T19:15:40.833 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T19:15:40.834 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:15:40.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-12T19:15:40.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-09-12T19:15:40.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-12T19:15:40.862 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T19:15:40.862 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T19:15:40.862 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T19:15:40.863 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:15:40.896 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T19:15:40.896 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T19:15:40.896 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:15:40.964 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T19:15:40.964 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T19:15:40.964 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T19:15:40.991 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T19:15:40.991 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T19:15:40.991 DEBUG:teuthology.orchestra.run.smithi111:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T19:15:41.021 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T19:15:41.021 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T19:15:41.482 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T19:15:41.482 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T19:15:41.707 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T19:15:41.707 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T19:15:41.893 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T19:15:41.894 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T19:15:42.073 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T19:15:42.074 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T19:15:42.617 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T19:15:42.618 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T19:15:42.826 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T19:15:42.826 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T19:15:43.000 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T19:15:43.000 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T19:15:43.152 INFO:tasks.ceph:Archiving mon data... 2024-09-12T19:15:43.154 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7902784/data/mon.a.tgz 2024-09-12T19:15:43.154 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-09-12T19:15:43.160 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.6WmrcpxiAY 2024-09-12T19:15:43.160 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.6WmrcpxiAY 2024-09-12T19:15:43.343 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.6WmrcpxiAY 2024-09-12T19:15:43.406 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.6WmrcpxiAY is 537KB 2024-09-12T19:15:43.468 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.6WmrcpxiAY 2024-09-12T19:15:43.473 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7902784/data/mon.c.tgz 2024-09-12T19:15:43.473 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-09-12T19:15:43.518 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.nlMZ490O3W 2024-09-12T19:15:43.519 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.nlMZ490O3W 2024-09-12T19:15:43.713 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.nlMZ490O3W 2024-09-12T19:15:43.778 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.nlMZ490O3W is 573KB 2024-09-12T19:15:43.840 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.nlMZ490O3W 2024-09-12T19:15:43.845 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7902784/data/mon.b.tgz 2024-09-12T19:15:43.845 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-12T19:15:43.851 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.oDXvhALip9 2024-09-12T19:15:43.851 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.oDXvhALip9 2024-09-12T19:15:44.051 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.oDXvhALip9 2024-09-12T19:15:44.119 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.oDXvhALip9 is 573KB 2024-09-12T19:15:44.180 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.oDXvhALip9 2024-09-12T19:15:44.186 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T19:15:44.186 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T19:15:44.188 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T19:15:44.248 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T19:15:44.294 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T19:15:44.295 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T19:15:44.297 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7902784/remote/smithi111/crash 2024-09-12T19:15:44.297 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T19:15:44.311 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7902784/remote/smithi153/crash 2024-09-12T19:15:44.312 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T19:15:44.351 INFO:tasks.ceph:Compressing logs... 2024-09-12T19:15:44.351 DEBUG:teuthology.orchestra.run.smithi111:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T19:15:44.355 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T19:15:44.373 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85333.log 2024-09-12T19:15:44.374 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158006.log 2024-09-12T19:15:44.374 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.85333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78253.log 2024-09-12T19:15:44.376 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.158006.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.85333.log.gz 2024-09-12T19:15:44.376 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88283.log 2024-09-12T19:15:44.376 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158006.log.gz 2024-09-12T19:15:44.376 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.78253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33091.log 2024-09-12T19:15:44.376 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.88283.log: gzip -5 82.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.78253.log.gz -- 2024-09-12T19:15:44.376 INFO:teuthology.orchestra.run.smithi111.stderr: /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T19:15:44.376 INFO:teuthology.orchestra.run.smithi111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.88283.log.gz 2024-09-12T19:15:44.376 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61445.log 2024-09-12T19:15:44.376 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33091.log.gz 2024-09-12T19:15:44.378 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179543.log 2024-09-12T19:15:44.378 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.61445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131357.log 2024-09-12T19:15:44.378 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.179543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33088.log 2024-09-12T19:15:44.378 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.131357.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.179543.log.gz 2024-09-12T19:15:44.378 INFO:teuthology.orchestra.run.smithi111.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.131357.log.gz 2024-09-12T19:15:44.378 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32671.log 2024-09-12T19:15:44.379 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169135.log 2024-09-12T19:15:44.379 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33088.log: /var/log/ceph/ceph-client.admin.32671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33088.log.gz 2024-09-12T19:15:44.379 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32671.log.gz 2024-09-12T19:15:44.379 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33507.log 2024-09-12T19:15:44.381 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145517.log 2024-09-12T19:15:44.381 INFO:teuthology.orchestra.run.smithi111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.61445.log.gz 2024-09-12T19:15:44.381 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.169135.log: /var/log/ceph/ceph-client.admin.33507.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.169135.log.gz 2024-09-12T19:15:44.381 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.33507.log.gz 2024-09-12T19:15:44.382 INFO:teuthology.orchestra.run.smithi111.stderr: -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T19:15:44.382 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.145517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53837.log 2024-09-12T19:15:44.382 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107166.log 2024-09-12T19:15:44.382 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124866.log 2024-09-12T19:15:44.382 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53837.log.gz 2024-09-12T19:15:44.382 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.107166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58864.log 2024-09-12T19:15:44.382 INFO:teuthology.orchestra.run.smithi111.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.107166.log.gz 2024-09-12T19:15:44.382 INFO:teuthology.orchestra.run.smithi111.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.145517.log.gz 2024-09-12T19:15:44.382 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.124866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124276.log 2024-09-12T19:15:44.382 INFO:teuthology.orchestra.run.smithi111.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.124866.log.gz 2024-09-12T19:15:44.384 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.58864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33320.log 2024-09-12T19:15:44.385 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.124276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183047.log 2024-09-12T19:15:44.385 INFO:teuthology.orchestra.run.smithi111.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.124276.log.gz 2024-09-12T19:15:44.385 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5/var/log/ceph/ceph-client.admin.33320.log: --verbose -- /var/log/ceph/ceph-client.admin.32525.log 2024-09-12T19:15:44.385 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33320.log.gz 2024-09-12T19:15:44.385 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172677.log 2024-09-12T19:15:44.385 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183047.log.gz 2024-09-12T19:15:44.385 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176807.log 2024-09-12T19:15:44.385 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32525.log.gz 2024-09-12T19:15:44.385 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.172677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139027.log 2024-09-12T19:15:44.385 INFO:teuthology.orchestra.run.smithi111.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.0.172677.log.gz 2024-09-12T19:15:44.385 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.176807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36409.log 2024-09-12T19:15:44.388 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.139027.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.176807.log.gz 2024-09-12T19:15:44.388 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45527.log 2024-09-12T19:15:44.388 INFO:teuthology.orchestra.run.smithi111.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.139027.log.gz 2024-09-12T19:15:44.389 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32623.log 2024-09-12T19:15:44.389 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.36409.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.36409.log.gz 2024-09-12T19:15:44.389 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.45527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163395.log 2024-09-12T19:15:44.389 INFO:teuthology.orchestra.run.smithi111.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.45527.log.gz 2024-09-12T19:15:44.389 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T19:15:44.389 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32623.log.gz 2024-09-12T19:15:44.389 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.163395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65324.log 2024-09-12T19:15:44.389 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91233.log 2024-09-12T19:15:44.389 INFO:teuthology.orchestra.run.smithi111.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.163395.log.gz 2024-09-12T19:15:44.389 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.65324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.160109.log 2024-09-12T19:15:44.389 INFO:teuthology.orchestra.run.smithi111.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.65324.log.gz 2024-09-12T19:15:44.389 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.91233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93595.log 2024-09-12T19:15:44.392 INFO:teuthology.orchestra.run.smithi111.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.91233.log.gz 2024-09-12T19:15:44.392 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.160109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117786.log 2024-09-12T19:15:44.392 INFO:teuthology.orchestra.run.smithi111.stderr: 84.4%/var/log/ceph/ceph-client.admin.93595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164700.log 2024-09-12T19:15:44.393 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.0.160109.log.gz 2024-09-12T19:15:44.393 INFO:teuthology.orchestra.run.smithi111.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.58864.log.gz 2024-09-12T19:15:44.393 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.117786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108346.log 2024-09-12T19:15:44.393 INFO:teuthology.orchestra.run.smithi111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93595.log.gz 2024-09-12T19:15:44.393 INFO:teuthology.orchestra.run.smithi111.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.117786.log.gz 2024-09-12T19:15:44.393 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.164700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161291.log 2024-09-12T19:15:44.393 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.108346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183203.log 2024-09-12T19:15:44.393 INFO:teuthology.orchestra.run.smithi111.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.164700.log.gz 2024-09-12T19:15:44.393 INFO:teuthology.orchestra.run.smithi111.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108346.log.gz 2024-09-12T19:15:44.393 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.161291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66202.log 2024-09-12T19:15:44.393 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183125.log 2024-09-12T19:15:44.393 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183203.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.161291.log.gz 2024-09-12T19:15:44.393 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183203.log.gz 2024-09-12T19:15:44.394 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149649.log 2024-09-12T19:15:44.394 INFO:teuthology.orchestra.run.smithi111.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.66202.log.gz 2024-09-12T19:15:44.394 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183125.log.gz 2024-09-12T19:15:44.394 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105396.log 2024-09-12T19:15:44.399 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.149649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32041.log 2024-09-12T19:15:44.400 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.105396.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.149649.log.gz 2024-09-12T19:15:44.400 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117196.log 2024-09-12T19:15:44.400 INFO:teuthology.orchestra.run.smithi111.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.105396.log.gz 2024-09-12T19:15:44.400 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165289.log 2024-09-12T19:15:44.400 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32041.log.gz 2024-09-12T19:15:44.400 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.117196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96545.log 2024-09-12T19:15:44.400 INFO:teuthology.orchestra.run.smithi111.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.117196.log.gz 2024-09-12T19:15:44.400 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.165289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139617.log 2024-09-12T19:15:44.400 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41887.log 2024-09-12T19:15:44.400 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.96545.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.165289.log.gz 2024-09-12T19:15:44.400 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.139617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82383.log 2024-09-12T19:15:44.400 INFO:teuthology.orchestra.run.smithi111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.96545.log.gz 2024-09-12T19:15:44.400 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143157.log 2024-09-12T19:15:44.401 INFO:teuthology.orchestra.run.smithi111.stderr: 82.2%/var/log/ceph/ceph-client.admin.82383.log: -- replaced with /var/log/ceph/ceph-client.admin.41887.log.gz 2024-09-12T19:15:44.401 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183177.log 2024-09-12T19:15:44.401 INFO:teuthology.orchestra.run.smithi111.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.82383.log.gz 2024-09-12T19:15:44.401 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.143157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134307.log 2024-09-12T19:15:44.401 INFO:teuthology.orchestra.run.smithi111.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.143157.log.gz 2024-09-12T19:15:44.401 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98905.log 2024-09-12T19:15:44.401 INFO:teuthology.orchestra.run.smithi111.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.139617.log.gz 2024-09-12T19:15:44.401 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183177.log.gz 2024-09-12T19:15:44.401 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.134307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77663.log 2024-09-12T19:15:44.401 INFO:teuthology.orchestra.run.smithi111.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.134307.log.gz 2024-09-12T19:15:44.401 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119556.log 2024-09-12T19:15:44.401 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.98905.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.98905.log.gz 2024-09-12T19:15:44.402 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.77663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136077.log 2024-09-12T19:15:44.402 INFO:teuthology.orchestra.run.smithi111.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.77663.log.gz 2024-09-12T19:15:44.402 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53887.log 2024-09-12T19:15:44.402 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.119556.log: /var/log/ceph/ceph-client.admin.136077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182813.log 2024-09-12T19:15:44.402 INFO:teuthology.orchestra.run.smithi111.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.119556.log.gz 2024-09-12T19:15:44.402 INFO:teuthology.orchestra.run.smithi111.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.136077.log.gz 2024-09-12T19:15:44.402 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32864.log 2024-09-12T19:15:44.402 INFO:teuthology.orchestra.run.smithi111.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.53887.log.gz 2024-09-12T19:15:44.402 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.182813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167355.log 2024-09-12T19:15:44.402 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182813.log.gz 2024-09-12T19:15:44.402 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183281.log 2024-09-12T19:15:44.402 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32864.log.gz 2024-09-12T19:15:44.411 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.167355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174447.log 2024-09-12T19:15:44.411 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183281.log.gz 2024-09-12T19:15:44.411 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138437.log 2024-09-12T19:15:44.411 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.174447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49067.log 2024-09-12T19:15:44.411 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.138437.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.174447.log.gz 2024-09-12T19:15:44.411 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80023.log 2024-09-12T19:15:44.411 INFO:teuthology.orchestra.run.smithi111.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.138437.log.gz 2024-09-12T19:15:44.411 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.49067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53862.log 2024-09-12T19:15:44.411 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69797.log 2024-09-12T19:15:44.411 INFO:teuthology.orchestra.run.smithi111.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.49067.log.gz 2024-09-12T19:15:44.412 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.80023.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.167355.log.gz 2024-09-12T19:15:44.412 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158031.log 2024-09-12T19:15:44.412 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53862.log.gz 2024-09-12T19:15:44.412 INFO:teuthology.orchestra.run.smithi111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.80023.log.gz 2024-09-12T19:15:44.412 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33319.log 2024-09-12T19:15:44.412 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.69797.log: /var/log/ceph/ceph-client.admin.158031.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.69797.log.gz 2024-09-12T19:15:44.412 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51452.log 2024-09-12T19:15:44.412 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170907.log 2024-09-12T19:15:44.412 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33319.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.158031.log.gz 0.0% 2024-09-12T19:15:44.412 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33319.log.gz 2024-09-12T19:15:44.412 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.51452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131947.log 2024-09-12T19:15:44.412 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51452.log.gz 2024-09-12T19:15:44.413 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.170907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90643.log 2024-09-12T19:15:44.413 INFO:teuthology.orchestra.run.smithi111.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.170907.log.gz 2024-09-12T19:15:44.413 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.131947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32545.log 2024-09-12T19:15:44.413 INFO:teuthology.orchestra.run.smithi111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.131947.log.gz 2024-09-12T19:15:44.413 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32857.log 2024-09-12T19:15:44.413 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.90643.log: /var/log/ceph/ceph-client.admin.32545.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T19:15:44.413 INFO:teuthology.orchestra.run.smithi111.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.90643.log.gz 2024-09-12T19:15:44.413 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32545.log.gz 2024-09-12T19:15:44.413 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32857.log.gz 2024-09-12T19:15:44.413 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180133.log 2024-09-12T19:15:44.413 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33089.log 2024-09-12T19:15:44.413 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.180133.log: gzip -5 --verbose 24.7% -- -- replaced with /var/log/ceph/ceph-client.admin.180133.log.gz /var/log/ceph/ceph-client.admin.94775.log 2024-09-12T19:15:44.413 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-09-12T19:15:44.414 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43067.log 2024-09-12T19:15:44.414 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33089.log.gz 2024-09-12T19:15:44.414 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.94775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107756.log 2024-09-12T19:15:44.414 INFO:teuthology.orchestra.run.smithi111.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.94775.log.gz 2024-09-12T19:15:44.414 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49657.log 2024-09-12T19:15:44.414 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43067.log.gz 2024-09-12T19:15:44.414 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.107756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70435.log 2024-09-12T19:15:44.414 INFO:teuthology.orchestra.run.smithi111.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.107756.log.gz 2024-09-12T19:15:44.414 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.49657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168545.log 2024-09-12T19:15:44.414 INFO:teuthology.orchestra.run.smithi111.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.49657.log.gz 2024-09-12T19:15:44.414 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.70435.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T19:15:44.414 INFO:teuthology.orchestra.run.smithi111.stderr: 50.9% -- replaced with /var/log/ceph/ceph-client.admin.70435.log.gz 2024-09-12T19:15:44.414 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.168545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33481.log 2024-09-12T19:15:44.414 INFO:teuthology.orchestra.run.smithi111.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.0.168545.log.gz 2024-09-12T19:15:44.415 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126636.log 2024-09-12T19:15:44.415 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153801.log 2024-09-12T19:15:44.415 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33481.log.gz/var/log/ceph/ceph-client.admin.126636.log: 2024-09-12T19:15:44.415 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89463.log 2024-09-12T19:15:44.415 INFO:teuthology.orchestra.run.smithi111.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.126636.log.gz 2024-09-12T19:15:44.424 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26767.log 2024-09-12T19:15:44.424 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T19:15:44.424 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.26767.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.26767.log.gz --verbose 2024-09-12T19:15:44.424 INFO:teuthology.orchestra.run.smithi153.stderr: -- /var/log/ceph/ceph-osd.6.log 2024-09-12T19:15:44.424 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26863.log 2024-09-12T19:15:44.424 INFO:teuthology.orchestra.run.smithi153.stderr:gzip/var/log/ceph/ceph-osd.6.log: -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T19:15:44.424 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.26863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26791.log 2024-09-12T19:15:44.424 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26863.log.gz 2024-09-12T19:15:44.424 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26911.log 2024-09-12T19:15:44.424 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.26791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26791.log.gz 2024-09-12T19:15:44.424 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26815.log 2024-09-12T19:15:44.425 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T19:15:44.425 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.26911.log: /var/log/ceph/ceph-client.admin.26815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26911.log.gz 2024-09-12T19:15:44.425 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T19:15:44.425 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26815.log.gz 2024-09-12T19:15:44.425 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26839.log 2024-09-12T19:15:44.425 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26743.log 2024-09-12T19:15:44.425 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.26839.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T19:15:44.425 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26839.log.gz 2024-09-12T19:15:44.425 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T19:15:44.425 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.26743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26743.log.gz 2024-09-12T19:15:44.425 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T19:15:44.425 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26887.log 2024-09-12T19:15:44.425 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.4.log: 90.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T19:15:44.425 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.26887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26887.log.gz 2024-09-12T19:15:44.428 INFO:teuthology.orchestra.run.smithi153.stderr: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T19:15:44.433 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.153801.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.153801.log.gz 2024-09-12T19:15:44.433 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56947.log 2024-09-12T19:15:44.433 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.89463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86513.log 2024-09-12T19:15:44.433 INFO:teuthology.orchestra.run.smithi111.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.89463.log.gz 2024-09-12T19:15:44.433 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180181.log 2024-09-12T19:15:44.433 INFO:teuthology.orchestra.run.smithi111.stderr: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.56947.log.gz 2024-09-12T19:15:44.433 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.86513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140207.log 2024-09-12T19:15:44.433 INFO:teuthology.orchestra.run.smithi111.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.86513.log.gz 2024-09-12T19:15:44.433 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33273.log 2024-09-12T19:15:44.434 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.180181.log: /var/log/ceph/ceph-client.admin.140207.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56323.log 2024-09-12T19:15:44.434 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.180181.log.gz 2024-09-12T19:15:44.434 INFO:teuthology.orchestra.run.smithi111.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.140207.log.gz 2024-09-12T19:15:44.434 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33273.log.gz 2024-09-12T19:15:44.434 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88873.log 2024-09-12T19:15:44.434 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114246.log 2024-09-12T19:15:44.434 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.88873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77073.log 2024-09-12T19:15:44.434 INFO:teuthology.orchestra.run.smithi111.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.88873.log.gz 2024-09-12T19:15:44.434 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.114246.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.114246.log.gz 2024-09-12T19:15:44.434 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32872.log 2024-09-12T19:15:44.434 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.77073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135487.log 2024-09-12T19:15:44.434 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32872.log: 90.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32872.log.gz 2024-09-12T19:15:44.434 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.77073.log.gz 2024-09-12T19:15:44.435 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52067.log 2024-09-12T19:15:44.435 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.135487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137847.log 2024-09-12T19:15:44.435 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52067.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.52067.log.gz 2024-09-12T19:15:44.435 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155571.log 2024-09-12T19:15:44.435 INFO:teuthology.orchestra.run.smithi111.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.135487.log.gz 2024-09-12T19:15:44.435 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.137847.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.137847.log.gz 2024-09-12T19:15:44.435 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179470.log 2024-09-12T19:15:44.435 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.155571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55067.log 2024-09-12T19:15:44.435 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.179470.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.155571.log.gz 2024-09-12T19:15:44.435 INFO:teuthology.orchestra.run.smithi111.stderr: 25.5% -- replaced with /var/log/ceph/ceph-client.admin.179470.log.gz 2024-09-12T19:15:44.435 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150239.log 2024-09-12T19:15:44.435 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146697.log 2024-09-12T19:15:44.435 INFO:teuthology.orchestra.run.smithi111.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.55067.log.gz 2024-09-12T19:15:44.435 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.150239.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.150239.log.gz 2024-09-12T19:15:44.436 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130767.log 2024-09-12T19:15:44.436 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.146697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180156.log 2024-09-12T19:15:44.436 INFO:teuthology.orchestra.run.smithi111.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.146697.log.gz 2024-09-12T19:15:44.436 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.130767.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.130767.log.gz 2024-09-12T19:15:44.436 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183229.log 2024-09-12T19:15:44.436 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.180156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111296.log 2024-09-12T19:15:44.436 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180156.log.gz 2024-09-12T19:15:44.436 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183229.log.gz 2024-09-12T19:15:44.436 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85923.log 2024-09-12T19:15:44.436 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.111296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183255.log 2024-09-12T19:15:44.436 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.85923.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111296.log.gz 2024-09-12T19:15:44.436 INFO:teuthology.orchestra.run.smithi111.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.85923.log.gz 2024-09-12T19:15:44.436 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183364.log 2024-09-12T19:15:44.437 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32867.log 2024-09-12T19:15:44.437 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183255.log.gz 2024-09-12T19:15:44.437 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183364.log.gz 2024-09-12T19:15:44.437 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156211.log 2024-09-12T19:15:44.437 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183021.log 2024-09-12T19:15:44.437 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32867.log.gz 2024-09-12T19:15:44.437 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.156211.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.156211.log.gz 2024-09-12T19:15:44.437 INFO:teuthology.orchestra.run.smithi111.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56323.log.gz 2024-09-12T19:15:44.437 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149059.log 2024-09-12T19:15:44.437 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81203.log 2024-09-12T19:15:44.437 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183021.log.gz 2024-09-12T19:15:44.437 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.149059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34614.log 2024-09-12T19:15:44.437 INFO:teuthology.orchestra.run.smithi111.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.149059.log.gz 2024-09-12T19:15:44.438 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72943.log 2024-09-12T19:15:44.438 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.81203.log: /var/log/ceph/ceph-client.admin.34614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34614.log.gz 2024-09-12T19:15:44.438 INFO:teuthology.orchestra.run.smithi111.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.81203.log.gz 2024-09-12T19:15:44.444 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180854.log 2024-09-12T19:15:44.444 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180232.log 2024-09-12T19:15:44.444 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.72943.log: /var/log/ceph/ceph-client.0.180854.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.72943.log.gz 2024-09-12T19:15:44.444 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127816.log 2024-09-12T19:15:44.444 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26842.log 2024-09-12T19:15:44.444 INFO:teuthology.orchestra.run.smithi111.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.0.180854.log.gz 2024-09-12T19:15:44.444 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.180232.log: /var/log/ceph/ceph-client.admin.127816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180232.log.gz 2024-09-12T19:15:44.444 INFO:teuthology.orchestra.run.smithi111.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.127816.log.gz 2024-09-12T19:15:44.444 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92413.log 2024-09-12T19:15:44.445 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.26842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179493.log 2024-09-12T19:15:44.445 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26842.log.gz 2024-09-12T19:15:44.445 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.92413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74713.log 2024-09-12T19:15:44.445 INFO:teuthology.orchestra.run.smithi111.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.92413.log.gz 2024-09-12T19:15:44.445 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156186.log 2024-09-12T19:15:44.445 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.179493.log: /var/log/ceph/ceph-client.admin.74713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113066.log 2024-09-12T19:15:44.445 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179493.log.gz 2024-09-12T19:15:44.445 INFO:teuthology.orchestra.run.smithi111.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.74713.log.gz 2024-09-12T19:15:44.445 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.156186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156186.log.gz 2024-09-12T19:15:44.445 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178290.log 2024-09-12T19:15:44.445 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.113066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99495.log 2024-09-12T19:15:44.445 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.178290.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113066.log.gz 2024-09-12T19:15:44.445 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182969.log 2024-09-12T19:15:44.446 INFO:teuthology.orchestra.run.smithi111.stderr: 83.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32882.log 2024-09-12T19:15:44.446 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.178290.log.gz/var/log/ceph/ceph-client.admin.99495.log: 2024-09-12T19:15:44.446 INFO:teuthology.orchestra.run.smithi111.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.99495.log.gz 2024-09-12T19:15:44.446 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.182969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182969.log.gz 2024-09-12T19:15:44.446 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148467.log 2024-09-12T19:15:44.446 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32668.log 2024-09-12T19:15:44.446 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32882.log.gz 2024-09-12T19:15:44.446 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.148467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32665.log 2024-09-12T19:15:44.446 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97725.log 2024-09-12T19:15:44.446 INFO:teuthology.orchestra.run.smithi111.stderr: 85.5%/var/log/ceph/ceph-client.admin.32668.log: -- replaced with /var/log/ceph/ceph-client.admin.148467.log.gz 2024-09-12T19:15:44.446 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32668.log.gz 2024-09-12T19:15:44.446 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32665.log.gz 2024-09-12T19:15:44.446 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57572.log 2024-09-12T19:15:44.447 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.97725.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T19:15:44.447 INFO:teuthology.orchestra.run.smithi111.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.97725.log.gz 2024-09-12T19:15:44.447 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.57572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32885.log 2024-09-12T19:15:44.447 INFO:teuthology.orchestra.run.smithi153.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T19:15:44.448 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32674.log 2024-09-12T19:15:44.449 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32885.log.gz 2024-09-12T19:15:44.449 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167944.log 2024-09-12T19:15:44.449 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32674.log.gz 2024-09-12T19:15:44.449 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33281.log 2024-09-12T19:15:44.449 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.167944.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.167944.log.gz 2024-09-12T19:15:44.449 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157391.log 2024-09-12T19:15:44.450 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33281.log.gz 2024-09-12T19:15:44.450 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110116.log 2024-09-12T19:15:44.451 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.157391.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.157391.log.gz 2024-09-12T19:15:44.452 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183390.log 2024-09-12T19:15:44.453 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.110116.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110116.log.gz 2024-09-12T19:15:44.453 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153189.log 2024-09-12T19:15:44.454 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183390.log.gz 2024-09-12T19:15:44.454 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147877.log 2024-09-12T19:15:44.455 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.153189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153189.log.gz 2024-09-12T19:15:44.455 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109526.log 2024-09-12T19:15:44.456 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.147877.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.147877.log.gz 2024-09-12T19:15:44.457 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136667.log 2024-09-12T19:15:44.457 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.109526.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.109526.log.gz 2024-09-12T19:15:44.458 INFO:teuthology.orchestra.run.smithi111.stderr: 93.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118966.log 2024-09-12T19:15:44.458 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57572.log.gz 2024-09-12T19:15:44.459 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.136667.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.136667.log.gz 2024-09-12T19:15:44.459 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56068.log 2024-09-12T19:15:44.460 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26695.log 2024-09-12T19:15:44.460 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.118966.log: /var/log/ceph/ceph-client.admin.56068.log: 48.4% -- replaced with /var/log/ceph/ceph-client.admin.56068.log.gz 2024-09-12T19:15:44.460 INFO:teuthology.orchestra.run.smithi111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118966.log.gz 2024-09-12T19:15:44.460 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80613.log 2024-09-12T19:15:44.461 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69155.log 2024-09-12T19:15:44.462 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.26695.log: /var/log/ceph/ceph-client.admin.80613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26695.log.gz 2024-09-12T19:15:44.462 INFO:teuthology.orchestra.run.smithi111.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.80613.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33277.log 2024-09-12T19:15:44.462 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-09-12T19:15:44.462 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.69155.log: 25.8% -- replaced with /var/log/ceph/ceph-client.admin.69155.log.gz 2024-09-12T19:15:44.462 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97135.log 2024-09-12T19:15:44.463 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93003.log 2024-09-12T19:15:44.463 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33277.log: /var/log/ceph/ceph-client.admin.97135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33277.log.gz 2024-09-12T19:15:44.464 INFO:teuthology.orchestra.run.smithi111.stderr: 82.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.97135.log.gz -5 --verbose -- /var/log/ceph/ceph-client.0.70472.log 2024-09-12T19:15:44.464 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-09-12T19:15:44.464 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.93003.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.93003.log.gz 2024-09-12T19:15:44.464 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182839.log 2024-09-12T19:15:44.465 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140797.log 2024-09-12T19:15:44.466 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.70472.log: /var/log/ceph/ceph-client.admin.182839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182839.log.gz 2024-09-12T19:15:44.468 INFO:teuthology.orchestra.run.smithi111.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.70472.log.gz 2024-09-12T19:15:44.469 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100675.log 2024-09-12T19:15:44.469 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115426.log 2024-09-12T19:15:44.470 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.140797.log: /var/log/ceph/ceph-client.admin.100675.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.140797.log.gz 2024-09-12T19:15:44.470 INFO:teuthology.orchestra.run.smithi111.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.100675.log.gzgzip 2024-09-12T19:15:44.470 INFO:teuthology.orchestra.run.smithi111.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54477.log 2024-09-12T19:15:44.470 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.115426.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.115426.log.gz 2024-09-12T19:15:44.471 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43117.log 2024-09-12T19:15:44.471 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182865.log 2024-09-12T19:15:44.472 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54477.log: /var/log/ceph/ceph-client.admin.43117.log: 85.3% 86.3% -- replaced with /var/log/ceph/ceph-client.admin.43117.log.gz -- replaced with /var/log/ceph/ceph-client.admin.54477.log.gz 2024-09-12T19:15:44.472 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-09-12T19:15:44.472 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44887.log 2024-09-12T19:15:44.473 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T19:15:44.473 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.182865.log: /var/log/ceph/ceph-client.admin.44887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182865.log.gz 2024-09-12T19:15:44.474 INFO:teuthology.orchestra.run.smithi111.stderr: 85.6%gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T19:15:44.474 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44887.log.gz 2024-09-12T19:15:44.478 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: 94.1% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T19:15:44.479 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183099.log 2024-09-12T19:15:44.480 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90053.log 2024-09-12T19:15:44.480 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.183099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183099.log.gz 2024-09-12T19:15:44.494 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173267.log 2024-09-12T19:15:44.495 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.90053.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.90053.log.gz 2024-09-12T19:15:44.495 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112476.log 2024-09-12T19:15:44.496 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.173267.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.173267.log.gz 2024-09-12T19:15:44.497 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34588.log 2024-09-12T19:15:44.498 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.112476.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.112476.log.gz 2024-09-12T19:15:44.498 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64026.log 2024-09-12T19:15:44.499 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34588.log.gz 2024-09-12T19:15:44.499 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55989.log 2024-09-12T19:15:44.501 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.64026.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64026.log.gz 2024-09-12T19:15:44.501 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121916.log 2024-09-12T19:15:44.502 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55989.log: 51.6% -- replaced with /var/log/ceph/ceph-client.admin.55989.log.gz 2024-09-12T19:15:44.503 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128406.log 2024-09-12T19:15:44.503 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.121916.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.121916.log.gz 2024-09-12T19:15:44.504 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33318.log 2024-09-12T19:15:44.505 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.128406.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.128406.log.gz 2024-09-12T19:15:44.505 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130177.log 2024-09-12T19:15:44.506 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33318.log.gz 2024-09-12T19:15:44.506 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43707.log 2024-09-12T19:15:44.507 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.130177.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.130177.log.gz 2024-09-12T19:15:44.507 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143747.log 2024-09-12T19:15:44.508 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43707.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.43707.log.gz 2024-09-12T19:15:44.509 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81793.log 2024-09-12T19:15:44.511 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.143747.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.143747.log.gz 2024-09-12T19:15:44.511 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165878.log 2024-09-12T19:15:44.512 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.81793.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81793.log.gz 2024-09-12T19:15:44.513 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64672.log 2024-09-12T19:15:44.514 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.165878.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.165878.log.gz 2024-09-12T19:15:44.514 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78843.log 2024-09-12T19:15:44.519 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.64672.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.64672.log.gz 2024-09-12T19:15:44.519 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33087.log 2024-09-12T19:15:44.520 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.78843.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.78843.log.gz 2024-09-12T19:15:44.520 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32571.log 2024-09-12T19:15:44.521 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33087.log.gz 2024-09-12T19:15:44.521 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134897.log 2024-09-12T19:15:44.522 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32571.log.gz 2024-09-12T19:15:44.522 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144927.log 2024-09-12T19:15:44.523 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.134897.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.134897.log.gz 2024-09-12T19:15:44.523 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79433.log 2024-09-12T19:15:44.525 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.144927.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.144927.log.gz 2024-09-12T19:15:44.525 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21903.log 2024-09-12T19:15:44.526 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.79433.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.79433.log.gz 2024-09-12T19:15:44.526 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56255.log 2024-09-12T19:15:44.527 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.tmp-client.admin.21903.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21903.log.gz 2024-09-12T19:15:44.527 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178880.log 2024-09-12T19:15:44.528 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56255.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.56255.log.gz 2024-09-12T19:15:44.528 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73533.log 2024-09-12T19:15:44.529 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.178880.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.178880.log.gz 2024-09-12T19:15:44.530 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175037.log 2024-09-12T19:15:44.531 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.73533.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.73533.log.gz 2024-09-12T19:15:44.531 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62736.log 2024-09-12T19:15:44.532 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.175037.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.175037.log.gz 2024-09-12T19:15:44.532 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38167.log 2024-09-12T19:15:44.535 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.62736.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.62736.log.gz 2024-09-12T19:15:44.535 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101265.log 2024-09-12T19:15:44.536 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.38167.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.38167.log.gz 2024-09-12T19:15:44.536 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137257.log 2024-09-12T19:15:44.537 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.101265.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.101265.log.gz 2024-09-12T19:15:44.538 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114836.log 2024-09-12T19:15:44.539 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.137257.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.137257.log.gz 2024-09-12T19:15:44.539 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T19:15:44.541 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.114836.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114836.log.gz 2024-09-12T19:15:44.542 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182917.log 2024-09-12T19:15:44.554 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.log: 93.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84153.log 2024-09-12T19:15:44.554 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.182917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182917.log.gz 2024-09-12T19:15:44.555 INFO:teuthology.orchestra.run.smithi111.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T19:15:44.555 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133717.log 2024-09-12T19:15:44.556 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.84153.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.84153.log.gz 2024-09-12T19:15:44.556 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111886.log 2024-09-12T19:15:44.557 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.133717.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.133717.log.gz 2024-09-12T19:15:44.557 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118376.log 2024-09-12T19:15:44.558 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.111886.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.111886.log.gz 2024-09-12T19:15:44.559 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103036.log 2024-09-12T19:15:44.560 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.118376.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.118376.log.gz 2024-09-12T19:15:44.560 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182943.log 2024-09-12T19:15:44.561 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.103036.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.103036.log.gz 2024-09-12T19:15:44.561 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71759.log 2024-09-12T19:15:44.562 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.182943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182943.log.gz 2024-09-12T19:15:44.562 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171497.log 2024-09-12T19:15:44.563 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.71759.log: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.71759.log.gz 2024-09-12T19:15:44.564 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120146.log 2024-09-12T19:15:44.565 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.171497.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.171497.log.gz 2024-09-12T19:15:44.565 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182891.log 2024-09-12T19:15:44.566 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.120146.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.120146.log.gz 2024-09-12T19:15:44.566 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48477.log 2024-09-12T19:15:44.567 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.182891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182891.log.gz 2024-09-12T19:15:44.567 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116016.log 2024-09-12T19:15:44.568 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48477.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.48477.log.gz 2024-09-12T19:15:44.569 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52657.log 2024-09-12T19:15:44.570 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.116016.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116016.log.gz 2024-09-12T19:15:44.570 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133127.log 2024-09-12T19:15:44.571 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52657.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.52657.log.gz 2024-09-12T19:15:44.571 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141387.log 2024-09-12T19:15:44.572 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.133127.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.133127.log.gz 2024-09-12T19:15:44.573 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144337.log 2024-09-12T19:15:44.573 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.141387.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.141387.log.gz 2024-09-12T19:15:44.574 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182761.log 2024-09-12T19:15:44.575 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.144337.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.144337.log.gz 2024-09-12T19:15:44.575 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46707.log 2024-09-12T19:15:44.576 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.182761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182761.log.gz 2024-09-12T19:15:44.576 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32884.log 2024-09-12T19:15:44.577 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.46707.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.46707.log.gz 2024-09-12T19:15:44.577 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108936.log 2024-09-12T19:15:44.578 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32884.log.gz 2024-09-12T19:15:44.578 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180257.log 2024-09-12T19:15:44.579 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.108936.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.108936.log.gz 2024-09-12T19:15:44.580 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75303.log 2024-09-12T19:15:44.581 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.180257.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.180257.log.gz 2024-09-12T19:15:44.581 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34538.log 2024-09-12T19:15:44.582 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.75303.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.75303.log.gz 2024-09-12T19:15:44.582 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95365.log 2024-09-12T19:15:44.583 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34538.log.gz 2024-09-12T19:15:44.583 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101856.log 2024-09-12T19:15:44.584 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.95365.log: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.95365.log.gz 2024-09-12T19:15:44.585 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60155.log 2024-09-12T19:15:44.586 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.101856.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101856.log.gz 2024-09-12T19:15:44.586 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106576.log 2024-09-12T19:15:44.592 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.60155.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.60155.log.gz 2024-09-12T19:15:44.592 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100085.log 2024-09-12T19:15:44.595 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.106576.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.106576.log.gz 2024-09-12T19:15:44.595 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T19:15:44.597 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.100085.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.100085.log.gz 2024-09-12T19:15:44.597 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120736.log 2024-09-12T19:15:44.614 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129587.log 2024-09-12T19:15:44.616 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.120736.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.120736.log.gz 2024-09-12T19:15:44.630 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63381.log 2024-09-12T19:15:44.630 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.129587.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.129587.log.gz 2024-09-12T19:15:44.631 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32500.log 2024-09-12T19:15:44.633 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.63381.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63381.log.gz 2024-09-12T19:15:44.650 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183309.log 2024-09-12T19:15:44.651 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32500.log.gz 2024-09-12T19:15:44.658 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46117.log 2024-09-12T19:15:44.658 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183309.log.gz 2024-09-12T19:15:44.666 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51477.log 2024-09-12T19:15:44.666 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.46117.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.46117.log.gz 2024-09-12T19:15:44.674 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110706.log 2024-09-12T19:15:44.674 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.51477.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.51477.log.gz 2024-09-12T19:15:44.687 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56376.log 2024-09-12T19:15:44.688 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.110706.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.110706.log.gz 2024-09-12T19:15:44.706 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68564.log 2024-09-12T19:15:44.706 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56376.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.56376.log.gz 2024-09-12T19:15:44.710 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179518.log 2024-09-12T19:15:44.711 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.68564.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.68564.log.gz 2024-09-12T19:15:44.711 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38751.log 2024-09-12T19:15:44.711 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.179518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179518.log.gz 2024-09-12T19:15:44.718 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122506.log 2024-09-12T19:15:44.730 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.38751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162217.log 2024-09-12T19:15:44.730 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.122506.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122506.log.gz 2024-09-12T19:15:44.734 INFO:teuthology.orchestra.run.smithi111.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.38751.log.gz 2024-09-12T19:15:44.738 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104806.log 2024-09-12T19:15:44.746 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.162217.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.162217.log.gz 2024-09-12T19:15:44.748 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98315.log 2024-09-12T19:15:44.749 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.104806.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104806.log.gz 2024-09-12T19:15:44.758 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59509.log 2024-09-12T19:15:44.758 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.98315.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98315.log.gz 2024-09-12T19:15:44.766 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176217.log 2024-09-12T19:15:44.774 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.59509.log: 93.3%gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T19:15:44.774 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.176217.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.176217.log.gz 2024-09-12T19:15:44.782 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104216.log 2024-09-12T19:15:44.786 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ops-log-ceph-client.0.log: -- replaced with /var/log/ceph/ceph-client.admin.59509.log.gz 2024-09-12T19:15:44.790 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62090.log 2024-09-12T19:15:44.790 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.104216.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.104216.log.gz 2024-09-12T19:15:44.814 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50247.log 2024-09-12T19:15:44.826 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.62090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83563.log 2024-09-12T19:15:44.826 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.50247.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.50247.log.gz 2024-09-12T19:15:44.834 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41297.log 2024-09-12T19:15:44.835 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.83563.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.83563.log.gz 2024-09-12T19:15:44.842 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103626.log 2024-09-12T19:15:44.842 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41297.log: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.41297.log.gz 2024-09-12T19:15:44.850 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82973.log 2024-09-12T19:15:44.850 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.103626.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103626.log.gz 2024-09-12T19:15:44.855 INFO:teuthology.orchestra.run.smithi111.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.62090.log.gz 2024-09-12T19:15:44.857 INFO:teuthology.orchestra.run.smithi111.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T19:15:44.858 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T19:15:44.859 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.82973.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.82973.log.gz 2024-09-12T19:15:44.859 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47297.log 2024-09-12T19:15:44.863 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.audit.log: 94.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T19:15:44.863 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142567.log 2024-09-12T19:15:44.864 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47297.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.47297.log.gz 2024-09-12T19:15:44.864 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147287.log 2024-09-12T19:15:44.865 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.142567.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.142567.log.gz 2024-09-12T19:15:44.865 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170317.log 2024-09-12T19:15:44.867 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.147287.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.147287.log.gz 2024-09-12T19:15:44.867 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127226.log 2024-09-12T19:15:44.868 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.170317.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.170317.log.gz 2024-09-12T19:15:44.868 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180206.log 2024-09-12T19:15:44.871 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.127226.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.127226.log.gz 2024-09-12T19:15:44.871 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33093.log 2024-09-12T19:15:44.871 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.180206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180206.log.gz 2024-09-12T19:15:44.872 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33533.log 2024-09-12T19:15:44.872 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33093.log.gz 2024-09-12T19:15:44.873 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95955.log 2024-09-12T19:15:44.873 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33533.log.gz 2024-09-12T19:15:44.874 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45502.log 2024-09-12T19:15:44.874 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.95955.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.95955.log.gz 2024-09-12T19:15:44.875 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172087.log 2024-09-12T19:15:44.875 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.45502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45502.log.gz 2024-09-12T19:15:44.876 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125456.log 2024-09-12T19:15:44.877 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.172087.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.172087.log.gz 2024-09-12T19:15:44.877 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113656.log 2024-09-12T19:15:44.878 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.125456.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.125456.log.gz 2024-09-12T19:15:44.878 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33321.log 2024-09-12T19:15:44.879 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.113656.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.113656.log.gz 2024-09-12T19:15:44.879 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40707.log 2024-09-12T19:15:44.880 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33321.log.gz 2024-09-12T19:15:44.880 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56298.log 2024-09-12T19:15:44.881 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.40707.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.40707.log.gz 2024-09-12T19:15:44.881 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177397.log 2024-09-12T19:15:44.882 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56298.log.gz 2024-09-12T19:15:44.882 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37583.log 2024-09-12T19:15:44.883 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.177397.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.177397.log.gz 2024-09-12T19:15:44.883 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166467.log 2024-09-12T19:15:44.884 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.37583.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37583.log.gz 2024-09-12T19:15:44.884 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32873.log 2024-09-12T19:15:44.885 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.166467.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.166467.log.gz 2024-09-12T19:15:44.886 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182787.log 2024-09-12T19:15:44.886 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32873.log.gz 2024-09-12T19:15:44.887 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32597.log 2024-09-12T19:15:44.887 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.182787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182787.log.gz 2024-09-12T19:15:44.888 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157981.log 2024-09-12T19:15:44.888 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32597.log.gz 2024-09-12T19:15:44.889 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146107.log 2024-09-12T19:15:44.889 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.157981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157981.log.gz 2024-09-12T19:15:44.893 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32677.log 2024-09-12T19:15:44.893 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.146107.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.146107.log.gz 2024-09-12T19:15:44.893 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91823.log 2024-09-12T19:15:44.893 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32677.log.gz 2024-09-12T19:15:44.893 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45477.log 2024-09-12T19:15:44.894 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.91823.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.91823.log.gz 2024-09-12T19:15:44.895 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94185.log 2024-09-12T19:15:44.895 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.45477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45477.log.gz 2024-09-12T19:15:44.895 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32670.log 2024-09-12T19:15:44.896 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.94185.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.94185.log.gz 2024-09-12T19:15:44.896 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72353.log 2024-09-12T19:15:44.897 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32670.log.gz 2024-09-12T19:15:44.897 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67383.log 2024-09-12T19:15:44.898 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.72353.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.72353.log.gz 2024-09-12T19:15:44.898 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74123.log 2024-09-12T19:15:44.900 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67383.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.67383.log.gz 2024-09-12T19:15:44.900 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36993.log 2024-09-12T19:15:44.901 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.74123.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.74123.log.gz 2024-09-12T19:15:44.901 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34564.log 2024-09-12T19:15:44.902 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.36993.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.36993.log.gz 2024-09-12T19:15:44.902 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87693.log 2024-09-12T19:15:44.903 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.34564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34564.log.gz 2024-09-12T19:15:44.903 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26938.log 2024-09-12T19:15:44.904 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.87693.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.87693.log.gz 2024-09-12T19:15:44.904 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154391.log 2024-09-12T19:15:44.905 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.26938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26938.log.gz 2024-09-12T19:15:44.905 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156161.log 2024-09-12T19:15:44.906 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.154391.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.154391.log.gz 2024-09-12T19:15:44.906 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156801.log 2024-09-12T19:15:44.907 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.156161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156161.log.gz 2024-09-12T19:15:44.907 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87103.log 2024-09-12T19:15:44.908 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.156801.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.156801.log.gz 2024-09-12T19:15:44.909 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67973.log 2024-09-12T19:15:44.909 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.87103.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.87103.log.gz 2024-09-12T19:15:44.910 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33092.log 2024-09-12T19:15:44.910 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.67973.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.67973.log.gz 2024-09-12T19:15:44.911 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56920.log 2024-09-12T19:15:44.911 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33092.log.gz 2024-09-12T19:15:44.912 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33069.log 2024-09-12T19:15:44.912 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56920.log: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.56920.log.gz 2024-09-12T19:15:44.913 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181450.log 2024-09-12T19:15:44.913 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33069.log.gz 2024-09-12T19:15:44.914 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169727.log 2024-09-12T19:15:44.928 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.181450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50837.log 2024-09-12T19:15:44.929 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.169727.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.169727.log.gz 2024-09-12T19:15:44.929 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76483.log 2024-09-12T19:15:44.938 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.50837.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.50837.log.gz 2024-09-12T19:15:44.938 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105986.log 2024-09-12T19:15:44.939 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.76483.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.76483.log.gz 2024-09-12T19:15:44.948 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152009.log 2024-09-12T19:15:44.949 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.105986.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.105986.log.gz 2024-09-12T19:15:44.950 INFO:teuthology.orchestra.run.smithi111.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.0.181450.log.gz 2024-09-12T19:15:44.962 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175627.log 2024-09-12T19:15:44.962 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.152009.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.152009.log.gz 2024-09-12T19:15:44.982 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153211.log 2024-09-12T19:15:44.983 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.175627.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.175627.log.gz 2024-09-12T19:15:44.989 INFO:teuthology.orchestra.run.smithi111.stderr: 94.5% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T19:15:44.989 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158621.log 2024-09-12T19:15:44.990 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.153211.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.153211.log.gz 2024-09-12T19:15:44.990 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75893.log 2024-09-12T19:15:44.991 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.158621.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.158621.log.gz 2024-09-12T19:15:44.991 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55751.log 2024-09-12T19:15:44.992 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.75893.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.75893.log.gz 2024-09-12T19:15:44.992 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33317.log 2024-09-12T19:15:44.993 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55751.log: 63.4% -- replaced with /var/log/ceph/ceph-client.admin.55751.log.gz 2024-09-12T19:15:44.993 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183073.log 2024-09-12T19:15:44.993 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33317.log.gz 2024-09-12T19:15:44.994 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42477.log 2024-09-12T19:15:44.994 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183073.log.gz 2024-09-12T19:15:44.995 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151419.log 2024-09-12T19:15:44.995 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42477.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.42477.log.gz 2024-09-12T19:15:44.995 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84743.log 2024-09-12T19:15:44.996 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.151419.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.151419.log.gz 2024-09-12T19:15:44.996 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121326.log 2024-09-12T19:15:44.997 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.84743.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.84743.log.gz 2024-09-12T19:15:44.997 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35235.log 2024-09-12T19:15:44.997 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.121326.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.121326.log.gz 2024-09-12T19:15:44.998 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160702.log 2024-09-12T19:15:44.999 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.35235.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.35235.log.gz 2024-09-12T19:15:44.999 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34637.log 2024-09-12T19:15:45.003 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.160702.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.160702.log.gz 2024-09-12T19:15:45.003 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39335.log 2024-09-12T19:15:45.005 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.34637.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.34637.log.gz 2024-09-12T19:15:45.005 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163984.log 2024-09-12T19:15:45.006 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.39335.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.39335.log.gz 2024-09-12T19:15:45.006 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123096.log 2024-09-12T19:15:45.006 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.163984.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.163984.log.gz 2024-09-12T19:15:45.007 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162806.log 2024-09-12T19:15:45.007 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.123096.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.123096.log.gz 2024-09-12T19:15:45.008 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126046.log 2024-09-12T19:15:45.009 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.162806.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.162806.log.gz 2024-09-12T19:15:45.009 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123686.log 2024-09-12T19:15:45.010 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.126046.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.126046.log.gz 2024-09-12T19:15:45.010 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32676.log 2024-09-12T19:15:45.011 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.123686.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.123686.log.gz 2024-09-12T19:15:45.012 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43092.log 2024-09-12T19:15:45.012 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32676.log.gz 2024-09-12T19:15:45.012 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128997.log 2024-09-12T19:15:45.012 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43092.log.gz 2024-09-12T19:15:45.013 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60800.log 2024-09-12T19:15:45.013 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.128997.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128997.log.gz 2024-09-12T19:15:45.014 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56983.log 2024-09-12T19:15:45.016 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.60800.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.60800.log.gz 2024-09-12T19:15:45.016 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66791.log 2024-09-12T19:15:45.017 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56983.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.56983.log.gz 2024-09-12T19:15:45.017 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154981.log 2024-09-12T19:15:45.017 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.66791.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.66791.log.gz 2024-09-12T19:15:45.018 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150829.log 2024-09-12T19:15:45.019 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.154981.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.154981.log.gz 2024-09-12T19:15:45.019 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35819.log 2024-09-12T19:15:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.150829.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.150829.log.gz 2024-09-12T19:15:45.020 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47887.log 2024-09-12T19:15:45.021 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.35819.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.35819.log.gz 2024-09-12T19:15:45.021 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71062.log 2024-09-12T19:15:45.022 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47887.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.47887.log.gz 2024-09-12T19:15:45.022 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183151.log 2024-09-12T19:15:45.023 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.71062.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.71062.log.gz 2024-09-12T19:15:45.024 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132537.log 2024-09-12T19:15:45.024 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183151.log.gz 2024-09-12T19:15:45.025 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69207.log 2024-09-12T19:15:45.025 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.132537.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.132537.log.gz 2024-09-12T19:15:45.026 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141977.log 2024-09-12T19:15:45.027 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.69207.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.69207.log.gz 2024-09-12T19:15:45.027 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33065.log 2024-09-12T19:15:45.028 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.141977.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.141977.log.gz 2024-09-12T19:15:45.028 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58219.log 2024-09-12T19:15:45.029 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.33065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33065.log.gz 2024-09-12T19:15:45.029 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159211.log 2024-09-12T19:15:45.030 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.58219.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.58219.log.gz 2024-09-12T19:15:45.031 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32657.log 2024-09-12T19:15:45.031 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.159211.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.159211.log.gz 2024-09-12T19:15:45.032 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102446.log 2024-09-12T19:15:45.032 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32657.log.gz 2024-09-12T19:15:45.033 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56351.log 2024-09-12T19:15:45.034 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.102446.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.102446.log.gz 2024-09-12T19:15:45.034 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152599.log 2024-09-12T19:15:45.035 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56351.log: 54.9% -- replaced with /var/log/ceph/ceph-client.admin.56351.log.gz 2024-09-12T19:15:45.035 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32475.log 2024-09-12T19:15:45.036 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.152599.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.152599.log.gz 2024-09-12T19:15:45.036 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183414.log 2024-09-12T19:15:45.037 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.32475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32475.log.gz 2024-09-12T19:15:45.037 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53247.log 2024-09-12T19:15:45.038 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183414.log.gz 2024-09-12T19:15:45.038 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116606.log 2024-09-12T19:15:45.039 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53247.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.53247.log.gz 2024-09-12T19:15:45.039 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51427.log 2024-09-12T19:15:45.040 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.116606.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.116606.log.gz 2024-09-12T19:15:45.041 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182995.log 2024-09-12T19:15:45.041 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.51427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51427.log.gz 2024-09-12T19:15:45.041 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44297.log 2024-09-12T19:15:45.042 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.182995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182995.log.gz 2024-09-12T19:15:45.042 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183335.log 2024-09-12T19:15:45.043 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44297.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.44297.log.gz 2024-09-12T19:15:45.043 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173857.log 2024-09-12T19:15:45.044 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.183335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183335.log.gz 2024-09-12T19:15:45.045 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.0.173857.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.173857.log.gz 2024-09-12T19:15:45.361 INFO:teuthology.orchestra.run.smithi153.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T19:15:45.630 INFO:teuthology.orchestra.run.smithi111.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T19:15:45.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-12T19:15:45.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-09-12T19:15:46.475 INFO:teuthology.orchestra.run.smithi111.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T19:15:48.607 INFO:teuthology.orchestra.run.smithi111.stderr: 93.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T19:15:51.311 INFO:teuthology.orchestra.run.smithi111.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T19:15:53.842 INFO:teuthology.orchestra.run.smithi111.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T19:15:53.884 INFO:teuthology.orchestra.run.smithi153.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T19:15:53.890 INFO:teuthology.orchestra.run.smithi153.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T19:15:53.997 INFO:teuthology.orchestra.run.smithi153.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T19:15:57.915 INFO:teuthology.orchestra.run.smithi111.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T19:15:58.578 INFO:teuthology.orchestra.run.smithi153.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T19:15:58.580 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-12T19:15:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m14.182s 2024-09-12T19:15:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m42.117s 2024-09-12T19:15:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m1.557s 2024-09-12T19:16:03.175 INFO:teuthology.orchestra.run.smithi111.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T19:16:03.177 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-09-12T19:16:03.177 INFO:teuthology.orchestra.run.smithi111.stderr:real 0m18.820s 2024-09-12T19:16:03.177 INFO:teuthology.orchestra.run.smithi111.stderr:user 0m54.753s 2024-09-12T19:16:03.177 INFO:teuthology.orchestra.run.smithi111.stderr:sys 0m2.091s 2024-09-12T19:16:03.178 INFO:tasks.ceph:Archiving logs... 2024-09-12T19:16:03.178 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7902784/remote/smithi111/log 2024-09-12T19:16:03.179 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T19:16:09.598 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7902784/remote/smithi153/log 2024-09-12T19:16:09.598 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T19:16:14.965 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T19:16:14.976 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T19:16:14.976 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T19:16:14.979 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T19:16:15.057 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T19:16:15.068 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T19:16:15.068 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T19:16:15.071 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T19:16:15.081 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T19:16:15.081 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-09-12T19:16:15.081 INFO:teuthology.orchestra.run.smithi111.stdout:*hv01.front.sepi 67.205.162.81 3 u 28 64 377 0.076 -1.208 0.270 2024-09-12T19:16:15.081 INFO:teuthology.orchestra.run.smithi111.stdout:+hv02.front.sepi 96.245.170.99 3 u 28 64 377 0.069 -3.189 0.176 2024-09-12T19:16:15.081 INFO:teuthology.orchestra.run.smithi111.stdout:+hv03.front.sepi 74.6.168.72 3 u 44 64 377 0.062 -0.022 0.133 2024-09-12T19:16:15.081 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T19:16:15.085 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T19:16:15.085 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-09-12T19:16:15.085 INFO:teuthology.orchestra.run.smithi153.stdout:*hv01.front.sepi 67.205.162.81 3 u 87 128 377 0.082 -1.170 0.337 2024-09-12T19:16:15.086 INFO:teuthology.orchestra.run.smithi153.stdout:+hv02.front.sepi 96.245.170.99 3 u 107 128 377 0.109 -2.424 0.732 2024-09-12T19:16:15.086 INFO:teuthology.orchestra.run.smithi153.stdout:+hv03.front.sepi 74.6.168.72 3 u 19 128 377 0.127 +0.189 0.538 2024-09-12T19:16:15.086 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T19:16:15.087 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T19:16:15.099 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T19:16:15.100 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T19:16:15.134 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T19:16:15.190 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T19:16:15.225 INFO:teuthology.task.internal:Duration was 3631.666644 seconds 2024-09-12T19:16:15.225 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T19:16:15.259 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T19:16:15.259 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T19:16:15.262 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T19:16:15.300 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T19:16:15.300 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2024-09-12T19:16:15.300 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T19:16:15.351 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T19:16:15.351 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T19:16:15.361 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T19:16:15.362 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T19:16:15.395 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T19:16:15.432 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T19:16:15.432 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T19:16:15.463 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T19:16:15.532 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T19:16:15.543 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T19:16:15.544 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T19:16:15.555 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T19:16:15.566 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T19:16:15.584 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:16:15.599 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:16:15.607 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2024-09-12T19:16:15.622 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-09-12T19:16:15.647 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:16:15.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T19:16:15.670 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T19:16:15.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T19:16:15.694 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T19:16:15.706 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T19:16:15.707 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7902784/remote/smithi111 2024-09-12T19:16:15.707 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T19:16:15.742 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_18:03:08-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7902784/remote/smithi153 2024-09-12T19:16:15.742 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T19:16:15.765 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T19:16:15.765 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T19:16:15.775 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T19:16:15.806 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T19:16:15.818 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T19:16:15.818 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T19:16:15.843 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T19:16:15.843 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T19:16:15.845 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T19:16:15.848 INFO:teuthology.orchestra.run.smithi111.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 19:16 /home/ubuntu/cephtest 2024-09-12T19:16:15.854 INFO:teuthology.orchestra.run.smithi153.stdout: 658621 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 19:16 /home/ubuntu/cephtest 2024-09-12T19:16:15.856 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T19:16:15.878 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T19:16:15.947 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3631.666644334793 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T19:16:15.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T19:16:16.019 INFO:teuthology.run:pass